2024-09-12T00:02:03.646 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T00:02:03.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:02:03.800 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901839 branch: wip-cls-rgw-busy-resharding description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7901839' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ2ubMwIyAKgco9wENXPWHa7DRoqwwUhP9QQ2m4CS4TeAj0dTUjQjZZMs7HDuQvFMy4sn/nsT31PkbusXAlj/o8= smithi160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNaKUeMym1fAd3oT7E21zpytXgEmXJc9aV4DkAqfkLs3gg+Kj+M6vQ8ixZifHBtIoFLTWvY+YjzsPkKt88MEMiM= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: force-branch: wip-67986 rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T00:02:03.801 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-12T00:02:03.802 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-12T00:02:03.802 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T00:02:03.803 INFO:teuthology.task.internal:Checking packages... 2024-09-12T00:02:03.827 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-12T00:02:03.827 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T00:02:03.828 INFO:teuthology.packaging:ref: None 2024-09-12T00:02:03.828 INFO:teuthology.packaging:tag: None 2024-09-12T00:02:03.828 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-12T00:02:03.828 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:02:03.828 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-12T00:02:03.983 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753.gd011c522 2024-09-12T00:02:03.984 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T00:02:04.026 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T00:02:04.026 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T00:02:04.046 INFO:teuthology.task.internal:Saving configuration 2024-09-12T00:02:04.063 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T00:02:04.071 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T00:02:04.104 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901839', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:57:05.451697', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ2ubMwIyAKgco9wENXPWHa7DRoqwwUhP9QQ2m4CS4TeAj0dTUjQjZZMs7HDuQvFMy4sn/nsT31PkbusXAlj/o8='} 2024-09-12T00:02:04.135 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901839', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:57:05.450570', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNaKUeMym1fAd3oT7E21zpytXgEmXJc9aV4DkAqfkLs3gg+Kj+M6vQ8ixZifHBtIoFLTWvY+YjzsPkKt88MEMiM='} 2024-09-12T00:02:04.135 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T00:02:04.168 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:02:04.168 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:02:04.168 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T00:02:04.262 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff8935bbbe0>, signals=[15]) 2024-09-12T00:02:04.262 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T00:02:04.278 INFO:teuthology.task.internal:Opening connections... 2024-09-12T00:02:04.279 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2024-09-12T00:02:04.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:02:04.367 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2024-09-12T00:02:04.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:02:04.472 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T00:02:04.523 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-09-12T00:02:04.542 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-09-12T00:02:04.543 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-09-12T00:02:04.601 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-09-12T00:02:04.602 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2024-09-12T00:02:04.602 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-09-12T00:02:04.602 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-09-12T00:02:04.602 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2024-09-12T00:02:04.602 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2024-09-12T00:02:04.602 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T00:02:04.602 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-09-12T00:02:04.602 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2024-09-12T00:02:04.602 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T00:02:04.602 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-09-12T00:02:04.602 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T00:02:04.602 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T00:02:04.602 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T00:02:04.603 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-09-12T00:02:04.628 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2024-09-12T00:02:04.648 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2024-09-12T00:02:04.648 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-09-12T00:02:04.706 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2024-09-12T00:02:04.706 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="9" 2024-09-12T00:02:04.706 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2024-09-12T00:02:04.706 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2024-09-12T00:02:04.706 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="9" 2024-09-12T00:02:04.706 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el9" 2024-09-12T00:02:04.707 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T00:02:04.707 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2024-09-12T00:02:04.707 INFO:teuthology.orchestra.run.smithi160.stdout:LOGO="fedora-logo-icon" 2024-09-12T00:02:04.707 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T00:02:04.707 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2024-09-12T00:02:04.707 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T00:02:04.707 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T00:02:04.707 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T00:02:04.707 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-09-12T00:02:04.736 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T00:02:04.794 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T00:02:04.886 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T00:02:04.886 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:02:04.888 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:02:04.905 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T00:02:04.965 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T00:02:04.965 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:02:04.967 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:02:05.065 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T00:02:05.178 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T00:02:05.205 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T00:02:05.206 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T00:02:05.206 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:02:05.207 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:02:05.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:02:05.225 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-09-12T00:02:05.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:02:05.226 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-09-12T00:02:05.285 INFO:teuthology.orchestra.run.smithi133.stdout:5.14.0-503.el9.x86_64 2024-09-12T00:02:05.286 INFO:teuthology.task.kernel:Running kernel on smithi133: 5.14.0-503.el9.x86_64 2024-09-12T00:02:05.286 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum install -y kernel 2024-09-12T00:02:05.288 INFO:teuthology.orchestra.run.smithi160.stdout:5.14.0-503.el9.x86_64 2024-09-12T00:02:05.288 INFO:teuthology.task.kernel:Running kernel on smithi160: 5.14.0-503.el9.x86_64 2024-09-12T00:02:05.289 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum install -y kernel 2024-09-12T00:02:07.514 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-12T00:02:08.122 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - BaseOS 7.7 MB/s | 8.2 MB 00:01 2024-09-12T00:02:09.398 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-12T00:02:14.065 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 6.5 MB 00:00 2024-09-12T00:02:15.425 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - AppStream 3.3 MB/s | 20 MB 00:06 2024-09-12T00:02:16.599 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 19 kB 00:01 2024-09-12T00:02:17.537 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T00:02:21.315 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-12T00:02:23.009 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-12T00:02:23.023 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-12T00:02:23.778 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-12T00:02:24.983 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T00:02:24.983 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T00:02:25.072 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-12T00:02:25.077 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-12T00:02:25.077 INFO:teuthology.orchestra.run.smithi160.stdout: Package Architecture Version Repository Size 2024-09-12T00:02:25.078 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-12T00:02:25.078 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-12T00:02:25.078 INFO:teuthology.orchestra.run.smithi160.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T00:02:25.078 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-12T00:02:25.078 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T00:02:25.078 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T00:02:25.078 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T00:02:25.078 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:02:25.078 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-12T00:02:25.078 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-12T00:02:25.078 INFO:teuthology.orchestra.run.smithi160.stdout:Install 4 Packages 2024-09-12T00:02:25.078 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:02:25.079 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 79 M 2024-09-12T00:02:25.079 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 126 M 2024-09-12T00:02:25.079 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-12T00:02:25.477 INFO:teuthology.orchestra.run.smithi160.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 204 kB/s | 23 kB 00:00 2024-09-12T00:02:26.081 INFO:teuthology.orchestra.run.smithi160.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 48 MB/s | 29 MB 00:00 2024-09-12T00:02:26.394 INFO:teuthology.orchestra.run.smithi160.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 34 MB/s | 35 MB 00:01 2024-09-12T00:02:26.745 INFO:teuthology.orchestra.run.smithi160.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-12T00:02:26.745 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:02:26.745 INFO:teuthology.orchestra.run.smithi160.stdout:Total 47 MB/s | 79 MB 00:01 2024-09-12T00:02:27.430 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-12T00:02:27.794 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-12T00:02:27.794 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-12T00:02:28.775 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-12T00:02:28.775 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-12T00:02:29.250 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-12T00:02:31.232 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T00:02:31.232 INFO:teuthology.orchestra.run.smithi133.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T00:02:31.253 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-12T00:02:31.313 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-09-12T00:02:31.322 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-09-12T00:02:31.323 INFO:teuthology.orchestra.run.smithi133.stdout: Package Architecture Version Repository Size 2024-09-12T00:02:31.323 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-09-12T00:02:31.323 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-09-12T00:02:31.323 INFO:teuthology.orchestra.run.smithi133.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T00:02:31.323 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-09-12T00:02:31.323 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T00:02:31.323 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T00:02:31.323 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T00:02:31.324 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:02:31.324 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-09-12T00:02:31.324 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-09-12T00:02:31.324 INFO:teuthology.orchestra.run.smithi133.stdout:Install 4 Packages 2024-09-12T00:02:31.324 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:02:31.324 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 79 M 2024-09-12T00:02:31.325 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 126 M 2024-09-12T00:02:31.325 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-09-12T00:02:31.702 INFO:teuthology.orchestra.run.smithi133.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 241 kB/s | 23 kB 00:00 2024-09-12T00:02:31.914 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:02:31.998 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:02:32.093 INFO:teuthology.orchestra.run.smithi133.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-12T00:02:32.468 INFO:teuthology.orchestra.run.smithi133.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 37 MB/s | 29 MB 00:00 2024-09-12T00:02:32.777 INFO:teuthology.orchestra.run.smithi133.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 30 MB/s | 35 MB 00:01 2024-09-12T00:02:32.778 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:02:32.778 INFO:teuthology.orchestra.run.smithi133.stdout:Total 54 MB/s | 79 MB 00:01 2024-09-12T00:02:33.457 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-09-12T00:02:33.802 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-09-12T00:02:33.802 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-09-12T00:02:34.759 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-09-12T00:02:34.759 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-09-12T00:02:34.788 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:02:34.914 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:02:37.209 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-09-12T00:02:37.910 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:02:38.010 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:02:39.747 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:02:39.839 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:02:40.819 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:02:40.945 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:02:44.687 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:02:45.788 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:02:45.912 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:02:50.753 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:03:22.731 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:03:22.770 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:03:23.113 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:03:23.114 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:03:23.114 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:03:23.114 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:03:23.976 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:03:23.976 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:03:23.976 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-12T00:03:23.976 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T00:03:23.976 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T00:03:23.976 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T00:03:23.976 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T00:03:23.977 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:03:23.977 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-12T00:03:24.330 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:03:24.419 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:03:24.420 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:03:24.420 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T00:03:24.420 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:03:24.420 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:03:24.420 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T00:03:24.420 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi160.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:03:24.421 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:03:24.480 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:03:24.480 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:03:24.481 DEBUG:teuthology.orchestra.run.smithi160:> sudo rpm -qi grub2-tools 2024-09-12T00:03:24.512 INFO:teuthology.orchestra.run.smithi160.stdout:Name : grub2-tools 2024-09-12T00:03:24.513 INFO:teuthology.orchestra.run.smithi160.stdout:Epoch : 1 2024-09-12T00:03:24.513 INFO:teuthology.orchestra.run.smithi160.stdout:Version : 2.06 2024-09-12T00:03:24.513 INFO:teuthology.orchestra.run.smithi160.stdout:Release : 82.el9 2024-09-12T00:03:24.513 INFO:teuthology.orchestra.run.smithi160.stdout:Architecture: x86_64 2024-09-12T00:03:24.513 INFO:teuthology.orchestra.run.smithi160.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T00:03:24.513 INFO:teuthology.orchestra.run.smithi160.stdout:Group : Unspecified 2024-09-12T00:03:24.513 INFO:teuthology.orchestra.run.smithi160.stdout:Size : 8274670 2024-09-12T00:03:24.513 INFO:teuthology.orchestra.run.smithi160.stdout:License : GPLv3+ 2024-09-12T00:03:24.513 INFO:teuthology.orchestra.run.smithi160.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T00:03:24.513 INFO:teuthology.orchestra.run.smithi160.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T00:03:24.514 INFO:teuthology.orchestra.run.smithi160.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T00:03:24.514 INFO:teuthology.orchestra.run.smithi160.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T00:03:24.514 INFO:teuthology.orchestra.run.smithi160.stdout:Packager : builder@centos.org 2024-09-12T00:03:24.514 INFO:teuthology.orchestra.run.smithi160.stdout:Vendor : CentOS 2024-09-12T00:03:24.514 INFO:teuthology.orchestra.run.smithi160.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T00:03:24.514 INFO:teuthology.orchestra.run.smithi160.stdout:Summary : Support tools for GRUB. 2024-09-12T00:03:24.514 INFO:teuthology.orchestra.run.smithi160.stdout:Description : 2024-09-12T00:03:24.514 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:03:24.514 INFO:teuthology.orchestra.run.smithi160.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T00:03:24.514 INFO:teuthology.orchestra.run.smithi160.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T00:03:24.514 INFO:teuthology.orchestra.run.smithi160.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T00:03:24.514 INFO:teuthology.orchestra.run.smithi160.stdout:hardware devices. 2024-09-12T00:03:24.514 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:03:24.514 INFO:teuthology.orchestra.run.smithi160.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T00:03:24.515 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T00:03:24.515 INFO:teuthology.task.kernel:Updating grub on smithi160 to boot 5.14.0-505.el9.x86_64 2024-09-12T00:03:24.516 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T00:03:25.134 INFO:teuthology.orchestra.run.smithi160.stderr:Generating grub configuration file ... 2024-09-12T00:03:26.467 INFO:teuthology.orchestra.run.smithi160.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T00:03:26.492 INFO:teuthology.orchestra.run.smithi160.stderr:done 2024-09-12T00:03:26.494 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-09-12T00:03:26.510 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.GbwrmYKNKu 2024-09-12T00:03:26.510 DEBUG:teuthology.orchestra.run.smithi160:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GbwrmYKNKu 2024-09-12T00:03:26.577 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.GbwrmYKNKu 2024-09-12T00:03:26.713 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.GbwrmYKNKu is 6KB 2024-09-12T00:03:26.762 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.GbwrmYKNKu 2024-09-12T00:03:26.777 DEBUG:teuthology.orchestra.run.smithi160:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T00:03:26.841 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T00:03:26.841 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T00:03:26.841 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T00:03:26.841 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T00:03:26.842 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T00:03:26.988 DEBUG:teuthology.orchestra.run.smithi160:> sudo shutdown -r now 2024-09-12T00:03:28.907 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:03:28.947 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:03:29.231 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:03:29.231 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:03:29.231 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:03:29.231 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:03:30.043 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:03:30.043 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:03:30.043 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-09-12T00:03:30.043 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T00:03:30.044 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T00:03:30.044 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T00:03:30.044 INFO:teuthology.orchestra.run.smithi133.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T00:03:30.044 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:03:30.044 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-09-12T00:03:30.389 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:03:30.484 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:03:30.484 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:03:30.484 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T00:03:30.484 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:03:30.484 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:03:30.484 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T00:03:30.485 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi133.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:03:30.485 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:03:30.543 INFO:teuthology.orchestra.run.smithi133.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:03:30.544 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:03:30.544 DEBUG:teuthology.orchestra.run.smithi133:> sudo rpm -qi grub2-tools 2024-09-12T00:03:30.580 INFO:teuthology.orchestra.run.smithi133.stdout:Name : grub2-tools 2024-09-12T00:03:30.580 INFO:teuthology.orchestra.run.smithi133.stdout:Epoch : 1 2024-09-12T00:03:30.580 INFO:teuthology.orchestra.run.smithi133.stdout:Version : 2.06 2024-09-12T00:03:30.580 INFO:teuthology.orchestra.run.smithi133.stdout:Release : 82.el9 2024-09-12T00:03:30.580 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: x86_64 2024-09-12T00:03:30.580 INFO:teuthology.orchestra.run.smithi133.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T00:03:30.581 INFO:teuthology.orchestra.run.smithi133.stdout:Group : Unspecified 2024-09-12T00:03:30.581 INFO:teuthology.orchestra.run.smithi133.stdout:Size : 8274670 2024-09-12T00:03:30.581 INFO:teuthology.orchestra.run.smithi133.stdout:License : GPLv3+ 2024-09-12T00:03:30.581 INFO:teuthology.orchestra.run.smithi133.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T00:03:30.581 INFO:teuthology.orchestra.run.smithi133.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T00:03:30.581 INFO:teuthology.orchestra.run.smithi133.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T00:03:30.581 INFO:teuthology.orchestra.run.smithi133.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T00:03:30.581 INFO:teuthology.orchestra.run.smithi133.stdout:Packager : builder@centos.org 2024-09-12T00:03:30.581 INFO:teuthology.orchestra.run.smithi133.stdout:Vendor : CentOS 2024-09-12T00:03:30.581 INFO:teuthology.orchestra.run.smithi133.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T00:03:30.581 INFO:teuthology.orchestra.run.smithi133.stdout:Summary : Support tools for GRUB. 2024-09-12T00:03:30.581 INFO:teuthology.orchestra.run.smithi133.stdout:Description : 2024-09-12T00:03:30.581 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:03:30.582 INFO:teuthology.orchestra.run.smithi133.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T00:03:30.582 INFO:teuthology.orchestra.run.smithi133.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T00:03:30.582 INFO:teuthology.orchestra.run.smithi133.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T00:03:30.582 INFO:teuthology.orchestra.run.smithi133.stdout:hardware devices. 2024-09-12T00:03:30.582 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:03:30.582 INFO:teuthology.orchestra.run.smithi133.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T00:03:30.583 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T00:03:30.583 INFO:teuthology.task.kernel:Updating grub on smithi133 to boot 5.14.0-505.el9.x86_64 2024-09-12T00:03:30.583 DEBUG:teuthology.orchestra.run.smithi133:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T00:03:31.256 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2024-09-12T00:03:32.583 INFO:teuthology.orchestra.run.smithi133.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T00:03:32.611 INFO:teuthology.orchestra.run.smithi133.stderr:done 2024-09-12T00:03:32.613 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-09-12T00:03:32.629 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.YK8oDfm4SE 2024-09-12T00:03:32.629 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YK8oDfm4SE 2024-09-12T00:03:32.696 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.YK8oDfm4SE 2024-09-12T00:03:32.835 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.YK8oDfm4SE is 6KB 2024-09-12T00:03:32.884 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.YK8oDfm4SE 2024-09-12T00:03:32.899 DEBUG:teuthology.orchestra.run.smithi133:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T00:03:32.961 INFO:teuthology.orchestra.run.smithi133.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T00:03:32.961 INFO:teuthology.orchestra.run.smithi133.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T00:03:32.962 INFO:teuthology.orchestra.run.smithi133.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T00:03:32.962 INFO:teuthology.orchestra.run.smithi133.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T00:03:32.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T00:03:33.112 DEBUG:teuthology.orchestra.run.smithi133:> sudo shutdown -r now 2024-09-12T00:03:57.013 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T00:03:57.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-12T00:03:57.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:04:03.121 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T00:04:03.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-09-12T00:04:03.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:04:31.677 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-09-12T00:04:40.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-12T00:04:40.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:04:59.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-09-12T00:05:03.153 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T00:05:11.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-12T00:05:11.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:05:11.377 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-09-12T00:05:11.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-12T00:05:11.764 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T00:05:11.764 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-09-12T00:05:11.779 INFO:teuthology.orchestra.run.smithi160.stdout:5.14.0-505.el9.x86_64 2024-09-12T00:05:11.779 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T00:05:11.779 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:05:11.779 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T00:05:12.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-09-12T00:05:12.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:05:12.508 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-09-12T00:05:12.780 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T00:05:12.781 DEBUG:teuthology.orchestra.run.smithi160:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:05:12.869 INFO:teuthology.orchestra.run.smithi160.stdout:ttyS1 2024-09-12T00:05:12.888 DEBUG:teuthology.parallel:result is None 2024-09-12T00:05:12.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-09-12T00:05:12.889 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T00:05:12.889 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2024-09-12T00:05:12.903 INFO:teuthology.orchestra.run.smithi133.stdout:5.14.0-505.el9.x86_64 2024-09-12T00:05:12.903 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T00:05:12.904 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:05:12.904 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T00:05:13.904 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T00:05:13.905 DEBUG:teuthology.orchestra.run.smithi133:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:05:14.008 INFO:teuthology.orchestra.run.smithi133.stdout:ttyS1 2024-09-12T00:05:14.029 DEBUG:teuthology.parallel:result is None 2024-09-12T00:05:14.029 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T00:05:14.036 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T00:05:14.036 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:05:14.038 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:05:14.053 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T00:05:14.058 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T00:05:14.065 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T00:05:14.066 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:05:14.097 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:05:14.127 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T00:05:14.132 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T00:05:14.132 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:05:14.170 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:05:14.196 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:05:14.198 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:05:14.207 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:05:14.209 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:05:14.210 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T00:05:14.215 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T00:05:14.215 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:05:14.256 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:05:14.280 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T00:05:14.288 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T00:05:14.289 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:05:14.326 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:05:14.341 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:05:14.436 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:05:14.476 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:05:14.574 DEBUG:teuthology.orchestra.run.smithi133:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:05:14.605 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:05:14.606 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:05:14.674 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:05:14.724 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:05:14.762 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:05:14.852 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:05:14.884 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:05:14.884 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:05:14.947 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2024-09-12T00:05:14.949 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2024-09-12T00:05:14.997 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:05:15.145 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:05:15.284 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T00:05:15.375 INFO:teuthology.task.internal:Starting timer... 2024-09-12T00:05:15.375 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T00:05:15.439 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T00:05:15.488 DEBUG:teuthology.orchestra.run.smithi133:> sudo service auditd rotate 2024-09-12T00:05:15.558 INFO:teuthology.orchestra.run.smithi133.stdout:Rotating logs: 2024-09-12T00:05:15.560 DEBUG:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2024-09-12T00:05:15.698 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: 2024-09-12T00:05:15.701 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T00:05:15.702 DEBUG:teuthology.orchestra.run.smithi133:> /usr/sbin/getenforce 2024-09-12T00:05:15.726 INFO:teuthology.orchestra.run.smithi133.stdout:Permissive 2024-09-12T00:05:15.726 DEBUG:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2024-09-12T00:05:15.781 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2024-09-12T00:05:15.781 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi133.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi160.front.sepia.ceph.com': 'permissive'} 2024-09-12T00:05:15.782 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T00:05:15.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:05:15.807 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T00:05:15.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:05:15.853 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T00:05:15.854 DEBUG:teuthology.orchestra.run.smithi133:> sudo /usr/sbin/setenforce permissive 2024-09-12T00:05:15.897 DEBUG:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2024-09-12T00:05:15.968 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T00:05:15.978 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T00:05:15.991 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T00:05:15.992 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi133.front.sepia.ceph.com,smithi160.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T00:09:01.660 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi133.front.sepia.ceph.com'), Remote(name='ubuntu@smithi160.front.sepia.ceph.com')] 2024-09-12T00:09:01.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-09-12T00:09:01.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:09:01.795 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-09-12T00:09:01.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-09-12T00:09:01.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-12T00:09:01.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:09:01.962 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-09-12T00:09:02.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-12T00:09:02.042 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T00:09:02.074 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T00:09:02.074 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:09:02.075 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:09:02.077 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:09:02.077 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:09:02.105 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T00:09:02.120 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T00:09:02.124 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T00:09:02.140 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T00:09:02.144 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: ntpd: command not found 2024-09-12T00:09:02.156 INFO:teuthology.orchestra.run.smithi133.stdout:506 Cannot talk to daemon 2024-09-12T00:09:02.166 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2024-09-12T00:09:02.170 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T00:09:02.178 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2024-09-12T00:09:02.184 INFO:teuthology.orchestra.run.smithi133.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T00:09:02.193 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T00:09:02.208 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T00:09:02.247 INFO:teuthology.orchestra.run.smithi133.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:09:02.250 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:09:02.250 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-09-12T00:09:02.250 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:09:02.250 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:09:02.250 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:09:02.250 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:09:02.275 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:09:02.279 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:09:02.279 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-09-12T00:09:02.279 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:09:02.279 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:09:02.279 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:09:02.279 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:09:02.279 INFO:teuthology.run_tasks:Running task install... 2024-09-12T00:09:02.836 DEBUG:teuthology.task.install:project ceph 2024-09-12T00:09:02.836 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-12T00:09:02.836 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-12T00:09:02.836 INFO:teuthology.task.install:Using flavor: default 2024-09-12T00:09:02.841 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T00:09:02.842 INFO:teuthology.task.install:extra packages: [] 2024-09-12T00:09:02.842 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'tag': None, 'wait_for_package': False} 2024-09-12T00:09:02.843 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:09:02.845 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'tag': None, 'wait_for_package': False} 2024-09-12T00:09:02.845 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:09:03.002 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/ 2024-09-12T00:09:03.002 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4753.gd011c522 2024-09-12T00:09:03.016 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/ 2024-09-12T00:09:03.016 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4753.gd011c522 2024-09-12T00:09:03.126 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T00:09:03.127 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:09:03.127 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T00:09:03.134 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T00:09:03.134 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:09:03.134 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T00:09:03.157 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T00:09:03.157 DEBUG:teuthology.orchestra.run.smithi133:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d011c522bb171e70fc5782f1e7a71ce5f37e573f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T00:09:03.164 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T00:09:03.164 DEBUG:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d011c522bb171e70fc5782f1e7a71ce5f37e573f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T00:09:03.226 DEBUG:teuthology.orchestra.run.smithi133:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T00:09:03.234 DEBUG:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T00:09:03.304 DEBUG:teuthology.orchestra.run.smithi133:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T00:09:03.315 DEBUG:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T00:09:03.369 INFO:teuthology.orchestra.run.smithi133.stdout:check_obsoletes = 1 2024-09-12T00:09:03.371 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum clean all 2024-09-12T00:09:03.382 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2024-09-12T00:09:03.384 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2024-09-12T00:09:03.597 INFO:teuthology.orchestra.run.smithi133.stdout:45 files removed 2024-09-12T00:09:03.615 INFO:teuthology.orchestra.run.smithi160.stdout:45 files removed 2024-09-12T00:09:03.624 DEBUG:teuthology.orchestra.run.smithi133:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T00:09:03.642 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T00:09:04.177 INFO:teuthology.orchestra.run.smithi133.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-09-12T00:09:04.201 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-12T00:09:04.453 INFO:teuthology.orchestra.run.smithi133.stdout:ceph noarch packages 104 kB/s | 24 kB 00:00 2024-09-12T00:09:04.493 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-12T00:09:04.720 INFO:teuthology.orchestra.run.smithi133.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-12T00:09:04.768 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-12T00:09:05.237 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-12T00:09:05.477 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-12T00:09:08.430 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-09-12T00:09:08.720 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-09-12T00:09:13.747 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-12T00:09:14.287 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-12T00:09:15.597 INFO:teuthology.orchestra.run.smithi133.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-12T00:09:16.079 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-12T00:09:16.385 INFO:teuthology.orchestra.run.smithi133.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T00:09:16.875 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T00:09:21.841 INFO:teuthology.orchestra.run.smithi133.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-12T00:09:22.389 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T00:09:24.170 INFO:teuthology.orchestra.run.smithi133.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:09:24.171 INFO:teuthology.orchestra.run.smithi133.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:09:24.269 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-09-12T00:09:24.295 INFO:teuthology.orchestra.run.smithi133.stdout:====================================================================================================== 2024-09-12T00:09:24.295 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-09-12T00:09:24.296 INFO:teuthology.orchestra.run.smithi133.stdout:====================================================================================================== 2024-09-12T00:09:24.296 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-09-12T00:09:24.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph x86_64 2:19.3.0-4753.gd011c522.el9 ceph 6.6 k 2024-09-12T00:09:24.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:09:24.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 899 k 2024-09-12T00:09:24.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4753.gd011c522.el9 ceph 145 k 2024-09-12T00:09:24.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr x86_64 2:19.3.0-4753.gd011c522.el9 ceph 1.5 M 2024-09-12T00:09:24.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 154 k 2024-09-12T00:09:24.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 14 M 2024-09-12T00:09:24.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 7.4 M 2024-09-12T00:09:24.296 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 49 k 2024-09-12T00:09:24.297 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 11 M 2024-09-12T00:09:24.297 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test x86_64 2:19.3.0-4753.gd011c522.el9 ceph 50 M 2024-09-12T00:09:24.297 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 285 k 2024-09-12T00:09:24.297 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 782 k 2024-09-12T00:09:24.297 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 32 k 2024-09-12T00:09:24.297 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 755 k 2024-09-12T00:09:24.297 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 126 k 2024-09-12T00:09:24.297 INFO:teuthology.orchestra.run.smithi133.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T00:09:24.297 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:09:24.297 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados x86_64 2:19.3.0-4753.gd011c522.el9 ceph 322 k 2024-09-12T00:09:24.297 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 306 k 2024-09-12T00:09:24.297 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 99 k 2024-09-12T00:09:24.297 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 85 k 2024-09-12T00:09:24.298 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:09:24.298 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 170 k 2024-09-12T00:09:24.298 INFO:teuthology.orchestra.run.smithi133.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T00:09:24.298 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrading: 2024-09-12T00:09:24.298 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.5 M 2024-09-12T00:09:24.298 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:09:24.298 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-09-12T00:09:24.298 INFO:teuthology.orchestra.run.smithi133.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T00:09:24.298 INFO:teuthology.orchestra.run.smithi133.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T00:09:24.298 INFO:teuthology.orchestra.run.smithi133.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T00:09:24.298 INFO:teuthology.orchestra.run.smithi133.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T00:09:24.298 INFO:teuthology.orchestra.run.smithi133.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T00:09:24.299 INFO:teuthology.orchestra.run.smithi133.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T00:09:24.299 INFO:teuthology.orchestra.run.smithi133.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T00:09:24.299 INFO:teuthology.orchestra.run.smithi133.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T00:09:24.299 INFO:teuthology.orchestra.run.smithi133.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T00:09:24.299 INFO:teuthology.orchestra.run.smithi133.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T00:09:24.299 INFO:teuthology.orchestra.run.smithi133.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T00:09:24.299 INFO:teuthology.orchestra.run.smithi133.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T00:09:24.299 INFO:teuthology.orchestra.run.smithi133.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T00:09:24.299 INFO:teuthology.orchestra.run.smithi133.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T00:09:24.299 INFO:teuthology.orchestra.run.smithi133.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T00:09:24.299 INFO:teuthology.orchestra.run.smithi133.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T00:09:24.299 INFO:teuthology.orchestra.run.smithi133.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T00:09:24.299 INFO:teuthology.orchestra.run.smithi133.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T00:09:24.300 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 22 M 2024-09-12T00:09:24.300 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 34 k 2024-09-12T00:09:24.300 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds x86_64 2:19.3.0-4753.gd011c522.el9 ceph 2.4 M 2024-09-12T00:09:24.300 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 291 k 2024-09-12T00:09:24.300 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon x86_64 2:19.3.0-4753.gd011c522.el9 ceph 4.8 M 2024-09-12T00:09:24.300 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 17 M 2024-09-12T00:09:24.300 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 16 k 2024-09-12T00:09:24.300 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux x86_64 2:19.3.0-4753.gd011c522.el9 ceph 25 k 2024-09-12T00:09:24.300 INFO:teuthology.orchestra.run.smithi133.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T00:09:24.300 INFO:teuthology.orchestra.run.smithi133.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T00:09:24.300 INFO:teuthology.orchestra.run.smithi133.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T00:09:24.300 INFO:teuthology.orchestra.run.smithi133.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T00:09:24.300 INFO:teuthology.orchestra.run.smithi133.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T00:09:24.301 INFO:teuthology.orchestra.run.smithi133.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T00:09:24.301 INFO:teuthology.orchestra.run.smithi133.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T00:09:24.301 INFO:teuthology.orchestra.run.smithi133.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T00:09:24.301 INFO:teuthology.orchestra.run.smithi133.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T00:09:24.301 INFO:teuthology.orchestra.run.smithi133.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T00:09:24.301 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T00:09:24.301 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T00:09:24.301 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T00:09:24.301 INFO:teuthology.orchestra.run.smithi133.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T00:09:24.301 INFO:teuthology.orchestra.run.smithi133.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T00:09:24.301 INFO:teuthology.orchestra.run.smithi133.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T00:09:24.301 INFO:teuthology.orchestra.run.smithi133.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T00:09:24.301 INFO:teuthology.orchestra.run.smithi133.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T00:09:24.301 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T00:09:24.302 INFO:teuthology.orchestra.run.smithi133.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T00:09:24.302 INFO:teuthology.orchestra.run.smithi133.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T00:09:24.302 INFO:teuthology.orchestra.run.smithi133.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T00:09:24.302 INFO:teuthology.orchestra.run.smithi133.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T00:09:24.302 INFO:teuthology.orchestra.run.smithi133.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T00:09:24.302 INFO:teuthology.orchestra.run.smithi133.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T00:09:24.302 INFO:teuthology.orchestra.run.smithi133.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T00:09:24.302 INFO:teuthology.orchestra.run.smithi133.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T00:09:24.302 INFO:teuthology.orchestra.run.smithi133.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T00:09:24.302 INFO:teuthology.orchestra.run.smithi133.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T00:09:24.302 INFO:teuthology.orchestra.run.smithi133.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T00:09:24.302 INFO:teuthology.orchestra.run.smithi133.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T00:09:24.302 INFO:teuthology.orchestra.run.smithi133.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T00:09:24.303 INFO:teuthology.orchestra.run.smithi133.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T00:09:24.303 INFO:teuthology.orchestra.run.smithi133.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T00:09:24.303 INFO:teuthology.orchestra.run.smithi133.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T00:09:24.303 INFO:teuthology.orchestra.run.smithi133.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T00:09:24.303 INFO:teuthology.orchestra.run.smithi133.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T00:09:24.303 INFO:teuthology.orchestra.run.smithi133.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T00:09:24.303 INFO:teuthology.orchestra.run.smithi133.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T00:09:24.303 INFO:teuthology.orchestra.run.smithi133.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T00:09:24.303 INFO:teuthology.orchestra.run.smithi133.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T00:09:24.303 INFO:teuthology.orchestra.run.smithi133.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T00:09:24.303 INFO:teuthology.orchestra.run.smithi133.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T00:09:24.303 INFO:teuthology.orchestra.run.smithi133.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T00:09:24.303 INFO:teuthology.orchestra.run.smithi133.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T00:09:24.303 INFO:teuthology.orchestra.run.smithi133.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T00:09:24.304 INFO:teuthology.orchestra.run.smithi133.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T00:09:24.304 INFO:teuthology.orchestra.run.smithi133.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T00:09:24.304 INFO:teuthology.orchestra.run.smithi133.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T00:09:24.304 INFO:teuthology.orchestra.run.smithi133.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T00:09:24.304 INFO:teuthology.orchestra.run.smithi133.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T00:09:24.304 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T00:09:24.304 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T00:09:24.304 INFO:teuthology.orchestra.run.smithi133.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T00:09:24.304 INFO:teuthology.orchestra.run.smithi133.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T00:09:24.304 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:09:24.304 INFO:teuthology.orchestra.run.smithi133.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T00:09:24.304 INFO:teuthology.orchestra.run.smithi133.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T00:09:24.304 INFO:teuthology.orchestra.run.smithi133.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T00:09:24.305 INFO:teuthology.orchestra.run.smithi133.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T00:09:24.305 INFO:teuthology.orchestra.run.smithi133.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T00:09:24.305 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T00:09:24.305 INFO:teuthology.orchestra.run.smithi133.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T00:09:24.305 INFO:teuthology.orchestra.run.smithi133.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T00:09:24.305 INFO:teuthology.orchestra.run.smithi133.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T00:09:24.305 INFO:teuthology.orchestra.run.smithi133.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T00:09:24.305 INFO:teuthology.orchestra.run.smithi133.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T00:09:24.305 INFO:teuthology.orchestra.run.smithi133.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T00:09:24.305 INFO:teuthology.orchestra.run.smithi133.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T00:09:24.305 INFO:teuthology.orchestra.run.smithi133.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T00:09:24.305 INFO:teuthology.orchestra.run.smithi133.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T00:09:24.305 INFO:teuthology.orchestra.run.smithi133.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T00:09:24.305 INFO:teuthology.orchestra.run.smithi133.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T00:09:24.306 INFO:teuthology.orchestra.run.smithi133.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T00:09:24.306 INFO:teuthology.orchestra.run.smithi133.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T00:09:24.306 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T00:09:24.306 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T00:09:24.306 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 508 k 2024-09-12T00:09:24.306 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T00:09:24.306 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:09:24.306 INFO:teuthology.orchestra.run.smithi133.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T00:09:24.306 INFO:teuthology.orchestra.run.smithi133.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T00:09:24.306 INFO:teuthology.orchestra.run.smithi133.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T00:09:24.306 INFO:teuthology.orchestra.run.smithi133.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T00:09:24.306 INFO:teuthology.orchestra.run.smithi133.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T00:09:24.306 INFO:teuthology.orchestra.run.smithi133.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T00:09:24.307 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T00:09:24.307 INFO:teuthology.orchestra.run.smithi133.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T00:09:24.307 INFO:teuthology.orchestra.run.smithi133.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T00:09:24.307 INFO:teuthology.orchestra.run.smithi133.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T00:09:24.307 INFO:teuthology.orchestra.run.smithi133.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T00:09:24.307 INFO:teuthology.orchestra.run.smithi133.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T00:09:24.307 INFO:teuthology.orchestra.run.smithi133.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T00:09:24.307 INFO:teuthology.orchestra.run.smithi133.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T00:09:24.307 INFO:teuthology.orchestra.run.smithi133.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T00:09:24.307 INFO:teuthology.orchestra.run.smithi133.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T00:09:24.307 INFO:teuthology.orchestra.run.smithi133.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T00:09:24.307 INFO:teuthology.orchestra.run.smithi133.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T00:09:24.307 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T00:09:24.307 INFO:teuthology.orchestra.run.smithi133.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T00:09:24.308 INFO:teuthology.orchestra.run.smithi133.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T00:09:24.308 INFO:teuthology.orchestra.run.smithi133.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T00:09:24.308 INFO:teuthology.orchestra.run.smithi133.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T00:09:24.308 INFO:teuthology.orchestra.run.smithi133.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T00:09:24.308 INFO:teuthology.orchestra.run.smithi133.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T00:09:24.308 INFO:teuthology.orchestra.run.smithi133.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T00:09:24.308 INFO:teuthology.orchestra.run.smithi133.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T00:09:24.308 INFO:teuthology.orchestra.run.smithi133.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T00:09:24.308 INFO:teuthology.orchestra.run.smithi133.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T00:09:24.308 INFO:teuthology.orchestra.run.smithi133.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T00:09:24.308 INFO:teuthology.orchestra.run.smithi133.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T00:09:24.308 INFO:teuthology.orchestra.run.smithi133.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T00:09:24.309 INFO:teuthology.orchestra.run.smithi133.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T00:09:24.309 INFO:teuthology.orchestra.run.smithi133.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T00:09:24.309 INFO:teuthology.orchestra.run.smithi133.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T00:09:24.309 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T00:09:24.309 INFO:teuthology.orchestra.run.smithi133.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T00:09:24.309 INFO:teuthology.orchestra.run.smithi133.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T00:09:24.309 INFO:teuthology.orchestra.run.smithi133.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T00:09:24.309 INFO:teuthology.orchestra.run.smithi133.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T00:09:24.309 INFO:teuthology.orchestra.run.smithi133.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T00:09:24.309 INFO:teuthology.orchestra.run.smithi133.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T00:09:24.309 INFO:teuthology.orchestra.run.smithi133.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T00:09:24.309 INFO:teuthology.orchestra.run.smithi133.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T00:09:24.309 INFO:teuthology.orchestra.run.smithi133.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T00:09:24.310 INFO:teuthology.orchestra.run.smithi133.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T00:09:24.310 INFO:teuthology.orchestra.run.smithi133.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T00:09:24.310 INFO:teuthology.orchestra.run.smithi133.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T00:09:24.310 INFO:teuthology.orchestra.run.smithi133.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T00:09:24.310 INFO:teuthology.orchestra.run.smithi133.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T00:09:24.310 INFO:teuthology.orchestra.run.smithi133.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T00:09:24.310 INFO:teuthology.orchestra.run.smithi133.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T00:09:24.310 INFO:teuthology.orchestra.run.smithi133.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T00:09:24.310 INFO:teuthology.orchestra.run.smithi133.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T00:09:24.310 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T00:09:24.310 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T00:09:24.310 INFO:teuthology.orchestra.run.smithi133.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T00:09:24.310 INFO:teuthology.orchestra.run.smithi133.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T00:09:24.310 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T00:09:24.311 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T00:09:24.311 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T00:09:24.311 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T00:09:24.311 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 45 k 2024-09-12T00:09:24.311 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 143 k 2024-09-12T00:09:24.311 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T00:09:24.311 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T00:09:24.311 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T00:09:24.311 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T00:09:24.311 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T00:09:24.311 INFO:teuthology.orchestra.run.smithi133.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T00:09:24.311 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T00:09:24.311 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T00:09:24.311 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T00:09:24.312 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T00:09:24.312 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T00:09:24.312 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T00:09:24.312 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T00:09:24.312 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T00:09:24.312 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T00:09:24.312 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T00:09:24.312 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T00:09:24.312 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T00:09:24.312 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T00:09:24.312 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T00:09:24.312 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T00:09:24.312 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T00:09:24.313 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T00:09:24.313 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T00:09:24.313 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T00:09:24.313 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T00:09:24.313 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T00:09:24.313 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T00:09:24.313 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T00:09:24.313 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T00:09:24.313 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T00:09:24.313 INFO:teuthology.orchestra.run.smithi133.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T00:09:24.313 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T00:09:24.313 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T00:09:24.313 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T00:09:24.313 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T00:09:24.314 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T00:09:24.314 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T00:09:24.314 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T00:09:24.314 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T00:09:24.314 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T00:09:24.314 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T00:09:24.314 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T00:09:24.314 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T00:09:24.314 INFO:teuthology.orchestra.run.smithi133.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T00:09:24.314 INFO:teuthology.orchestra.run.smithi133.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T00:09:24.314 INFO:teuthology.orchestra.run.smithi133.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T00:09:24.314 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T00:09:24.314 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T00:09:24.315 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T00:09:24.315 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T00:09:24.315 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T00:09:24.315 INFO:teuthology.orchestra.run.smithi133.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T00:09:24.315 INFO:teuthology.orchestra.run.smithi133.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T00:09:24.315 INFO:teuthology.orchestra.run.smithi133.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T00:09:24.315 INFO:teuthology.orchestra.run.smithi133.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T00:09:24.315 INFO:teuthology.orchestra.run.smithi133.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T00:09:24.315 INFO:teuthology.orchestra.run.smithi133.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T00:09:24.315 INFO:teuthology.orchestra.run.smithi133.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T00:09:24.315 INFO:teuthology.orchestra.run.smithi133.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T00:09:24.315 INFO:teuthology.orchestra.run.smithi133.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T00:09:24.315 INFO:teuthology.orchestra.run.smithi133.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T00:09:24.315 INFO:teuthology.orchestra.run.smithi133.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T00:09:24.316 INFO:teuthology.orchestra.run.smithi133.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T00:09:24.316 INFO:teuthology.orchestra.run.smithi133.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T00:09:24.316 INFO:teuthology.orchestra.run.smithi133.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T00:09:24.316 INFO:teuthology.orchestra.run.smithi133.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T00:09:24.316 INFO:teuthology.orchestra.run.smithi133.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T00:09:24.316 INFO:teuthology.orchestra.run.smithi133.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T00:09:24.316 INFO:teuthology.orchestra.run.smithi133.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T00:09:24.316 INFO:teuthology.orchestra.run.smithi133.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T00:09:24.316 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T00:09:24.316 INFO:teuthology.orchestra.run.smithi133.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T00:09:24.316 INFO:teuthology.orchestra.run.smithi133.stdout:Installing weak dependencies: 2024-09-12T00:09:24.316 INFO:teuthology.orchestra.run.smithi133.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T00:09:24.316 INFO:teuthology.orchestra.run.smithi133.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T00:09:24.317 INFO:teuthology.orchestra.run.smithi133.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T00:09:24.317 INFO:teuthology.orchestra.run.smithi133.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T00:09:24.317 INFO:teuthology.orchestra.run.smithi133.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T00:09:24.317 INFO:teuthology.orchestra.run.smithi133.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T00:09:24.317 INFO:teuthology.orchestra.run.smithi133.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T00:09:24.317 INFO:teuthology.orchestra.run.smithi133.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T00:09:24.317 INFO:teuthology.orchestra.run.smithi133.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T00:09:24.317 INFO:teuthology.orchestra.run.smithi133.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T00:09:24.317 INFO:teuthology.orchestra.run.smithi133.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T00:09:24.317 INFO:teuthology.orchestra.run.smithi133.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T00:09:24.317 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T00:09:24.317 INFO:teuthology.orchestra.run.smithi133.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T00:09:24.317 INFO:teuthology.orchestra.run.smithi133.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T00:09:24.317 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:09:24.318 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-09-12T00:09:24.318 INFO:teuthology.orchestra.run.smithi133.stdout:====================================================================================================== 2024-09-12T00:09:24.318 INFO:teuthology.orchestra.run.smithi133.stdout:Install 283 Packages 2024-09-12T00:09:24.318 INFO:teuthology.orchestra.run.smithi133.stdout:Upgrade 2 Packages 2024-09-12T00:09:24.318 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:09:24.318 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 327 M 2024-09-12T00:09:24.319 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-09-12T00:09:24.710 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:09:24.710 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:09:24.802 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-12T00:09:24.826 INFO:teuthology.orchestra.run.smithi160.stdout:====================================================================================================== 2024-09-12T00:09:24.827 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-09-12T00:09:24.827 INFO:teuthology.orchestra.run.smithi160.stdout:====================================================================================================== 2024-09-12T00:09:24.827 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-12T00:09:24.827 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:19.3.0-4753.gd011c522.el9 ceph 6.6 k 2024-09-12T00:09:24.827 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:09:24.827 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 899 k 2024-09-12T00:09:24.827 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4753.gd011c522.el9 ceph 145 k 2024-09-12T00:09:24.827 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:19.3.0-4753.gd011c522.el9 ceph 1.5 M 2024-09-12T00:09:24.827 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 154 k 2024-09-12T00:09:24.827 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 14 M 2024-09-12T00:09:24.827 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 7.4 M 2024-09-12T00:09:24.828 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 49 k 2024-09-12T00:09:24.828 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 11 M 2024-09-12T00:09:24.828 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:19.3.0-4753.gd011c522.el9 ceph 50 M 2024-09-12T00:09:24.828 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 285 k 2024-09-12T00:09:24.828 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 782 k 2024-09-12T00:09:24.828 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 32 k 2024-09-12T00:09:24.828 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 755 k 2024-09-12T00:09:24.828 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 126 k 2024-09-12T00:09:24.828 INFO:teuthology.orchestra.run.smithi160.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T00:09:24.828 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:09:24.828 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:19.3.0-4753.gd011c522.el9 ceph 322 k 2024-09-12T00:09:24.828 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 306 k 2024-09-12T00:09:24.829 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 99 k 2024-09-12T00:09:24.829 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 85 k 2024-09-12T00:09:24.829 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:09:24.829 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 170 k 2024-09-12T00:09:24.829 INFO:teuthology.orchestra.run.smithi160.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T00:09:24.829 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2024-09-12T00:09:24.829 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.5 M 2024-09-12T00:09:24.829 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:09:24.829 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-12T00:09:24.829 INFO:teuthology.orchestra.run.smithi160.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T00:09:24.829 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T00:09:24.829 INFO:teuthology.orchestra.run.smithi160.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T00:09:24.829 INFO:teuthology.orchestra.run.smithi160.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T00:09:24.830 INFO:teuthology.orchestra.run.smithi160.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T00:09:24.830 INFO:teuthology.orchestra.run.smithi160.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T00:09:24.830 INFO:teuthology.orchestra.run.smithi160.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T00:09:24.830 INFO:teuthology.orchestra.run.smithi160.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T00:09:24.830 INFO:teuthology.orchestra.run.smithi160.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T00:09:24.830 INFO:teuthology.orchestra.run.smithi160.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T00:09:24.830 INFO:teuthology.orchestra.run.smithi160.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T00:09:24.830 INFO:teuthology.orchestra.run.smithi160.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T00:09:24.830 INFO:teuthology.orchestra.run.smithi160.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T00:09:24.830 INFO:teuthology.orchestra.run.smithi160.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T00:09:24.830 INFO:teuthology.orchestra.run.smithi160.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T00:09:24.830 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T00:09:24.831 INFO:teuthology.orchestra.run.smithi160.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T00:09:24.831 INFO:teuthology.orchestra.run.smithi160.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T00:09:24.831 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 22 M 2024-09-12T00:09:24.831 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 34 k 2024-09-12T00:09:24.831 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:19.3.0-4753.gd011c522.el9 ceph 2.4 M 2024-09-12T00:09:24.831 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 291 k 2024-09-12T00:09:24.831 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:19.3.0-4753.gd011c522.el9 ceph 4.8 M 2024-09-12T00:09:24.831 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 17 M 2024-09-12T00:09:24.831 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 16 k 2024-09-12T00:09:24.831 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:19.3.0-4753.gd011c522.el9 ceph 25 k 2024-09-12T00:09:24.831 INFO:teuthology.orchestra.run.smithi160.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T00:09:24.831 INFO:teuthology.orchestra.run.smithi160.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T00:09:24.831 INFO:teuthology.orchestra.run.smithi160.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T00:09:24.832 INFO:teuthology.orchestra.run.smithi160.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T00:09:24.832 INFO:teuthology.orchestra.run.smithi160.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T00:09:24.832 INFO:teuthology.orchestra.run.smithi160.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T00:09:24.832 INFO:teuthology.orchestra.run.smithi160.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T00:09:24.832 INFO:teuthology.orchestra.run.smithi160.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T00:09:24.832 INFO:teuthology.orchestra.run.smithi160.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T00:09:24.832 INFO:teuthology.orchestra.run.smithi160.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T00:09:24.832 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T00:09:24.832 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T00:09:24.832 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T00:09:24.832 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T00:09:24.832 INFO:teuthology.orchestra.run.smithi160.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T00:09:24.832 INFO:teuthology.orchestra.run.smithi160.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T00:09:24.832 INFO:teuthology.orchestra.run.smithi160.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T00:09:24.833 INFO:teuthology.orchestra.run.smithi160.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T00:09:24.833 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T00:09:24.833 INFO:teuthology.orchestra.run.smithi160.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T00:09:24.833 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T00:09:24.833 INFO:teuthology.orchestra.run.smithi160.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T00:09:24.833 INFO:teuthology.orchestra.run.smithi160.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T00:09:24.833 INFO:teuthology.orchestra.run.smithi160.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T00:09:24.833 INFO:teuthology.orchestra.run.smithi160.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T00:09:24.833 INFO:teuthology.orchestra.run.smithi160.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T00:09:24.833 INFO:teuthology.orchestra.run.smithi160.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T00:09:24.833 INFO:teuthology.orchestra.run.smithi160.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T00:09:24.833 INFO:teuthology.orchestra.run.smithi160.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T00:09:24.833 INFO:teuthology.orchestra.run.smithi160.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T00:09:24.834 INFO:teuthology.orchestra.run.smithi160.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T00:09:24.834 INFO:teuthology.orchestra.run.smithi160.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T00:09:24.834 INFO:teuthology.orchestra.run.smithi160.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T00:09:24.834 INFO:teuthology.orchestra.run.smithi160.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T00:09:24.834 INFO:teuthology.orchestra.run.smithi160.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T00:09:24.834 INFO:teuthology.orchestra.run.smithi160.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T00:09:24.834 INFO:teuthology.orchestra.run.smithi160.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T00:09:24.834 INFO:teuthology.orchestra.run.smithi160.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T00:09:24.834 INFO:teuthology.orchestra.run.smithi160.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T00:09:24.834 INFO:teuthology.orchestra.run.smithi160.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T00:09:24.834 INFO:teuthology.orchestra.run.smithi160.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T00:09:24.834 INFO:teuthology.orchestra.run.smithi160.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T00:09:24.834 INFO:teuthology.orchestra.run.smithi160.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T00:09:24.834 INFO:teuthology.orchestra.run.smithi160.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T00:09:24.835 INFO:teuthology.orchestra.run.smithi160.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T00:09:24.835 INFO:teuthology.orchestra.run.smithi160.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T00:09:24.835 INFO:teuthology.orchestra.run.smithi160.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T00:09:24.835 INFO:teuthology.orchestra.run.smithi160.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T00:09:24.835 INFO:teuthology.orchestra.run.smithi160.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T00:09:24.835 INFO:teuthology.orchestra.run.smithi160.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T00:09:24.835 INFO:teuthology.orchestra.run.smithi160.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T00:09:24.835 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T00:09:24.835 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T00:09:24.835 INFO:teuthology.orchestra.run.smithi160.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T00:09:24.835 INFO:teuthology.orchestra.run.smithi160.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T00:09:24.835 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:09:24.835 INFO:teuthology.orchestra.run.smithi160.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T00:09:24.836 INFO:teuthology.orchestra.run.smithi160.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T00:09:24.836 INFO:teuthology.orchestra.run.smithi160.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T00:09:24.836 INFO:teuthology.orchestra.run.smithi160.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T00:09:24.836 INFO:teuthology.orchestra.run.smithi160.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T00:09:24.836 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T00:09:24.836 INFO:teuthology.orchestra.run.smithi160.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T00:09:24.836 INFO:teuthology.orchestra.run.smithi160.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T00:09:24.836 INFO:teuthology.orchestra.run.smithi160.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T00:09:24.836 INFO:teuthology.orchestra.run.smithi160.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T00:09:24.836 INFO:teuthology.orchestra.run.smithi160.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T00:09:24.836 INFO:teuthology.orchestra.run.smithi160.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T00:09:24.836 INFO:teuthology.orchestra.run.smithi160.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T00:09:24.836 INFO:teuthology.orchestra.run.smithi160.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T00:09:24.837 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T00:09:24.837 INFO:teuthology.orchestra.run.smithi160.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T00:09:24.837 INFO:teuthology.orchestra.run.smithi160.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T00:09:24.837 INFO:teuthology.orchestra.run.smithi160.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T00:09:24.837 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T00:09:24.837 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T00:09:24.837 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T00:09:24.837 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 508 k 2024-09-12T00:09:24.837 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T00:09:24.837 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:09:24.837 INFO:teuthology.orchestra.run.smithi160.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T00:09:24.837 INFO:teuthology.orchestra.run.smithi160.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T00:09:24.837 INFO:teuthology.orchestra.run.smithi160.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T00:09:24.837 INFO:teuthology.orchestra.run.smithi160.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T00:09:24.838 INFO:teuthology.orchestra.run.smithi160.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T00:09:24.838 INFO:teuthology.orchestra.run.smithi160.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T00:09:24.838 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T00:09:24.838 INFO:teuthology.orchestra.run.smithi160.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T00:09:24.838 INFO:teuthology.orchestra.run.smithi160.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T00:09:24.838 INFO:teuthology.orchestra.run.smithi160.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T00:09:24.838 INFO:teuthology.orchestra.run.smithi160.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T00:09:24.838 INFO:teuthology.orchestra.run.smithi160.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T00:09:24.838 INFO:teuthology.orchestra.run.smithi160.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T00:09:24.838 INFO:teuthology.orchestra.run.smithi160.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T00:09:24.839 INFO:teuthology.orchestra.run.smithi160.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T00:09:24.839 INFO:teuthology.orchestra.run.smithi160.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T00:09:24.839 INFO:teuthology.orchestra.run.smithi160.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T00:09:24.839 INFO:teuthology.orchestra.run.smithi160.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T00:09:24.839 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T00:09:24.839 INFO:teuthology.orchestra.run.smithi160.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T00:09:24.839 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T00:09:24.839 INFO:teuthology.orchestra.run.smithi160.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T00:09:24.839 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T00:09:24.839 INFO:teuthology.orchestra.run.smithi160.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T00:09:24.839 INFO:teuthology.orchestra.run.smithi160.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T00:09:24.839 INFO:teuthology.orchestra.run.smithi160.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T00:09:24.839 INFO:teuthology.orchestra.run.smithi160.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T00:09:24.840 INFO:teuthology.orchestra.run.smithi160.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T00:09:24.840 INFO:teuthology.orchestra.run.smithi160.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T00:09:24.840 INFO:teuthology.orchestra.run.smithi160.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T00:09:24.840 INFO:teuthology.orchestra.run.smithi160.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T00:09:24.840 INFO:teuthology.orchestra.run.smithi160.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T00:09:24.840 INFO:teuthology.orchestra.run.smithi160.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T00:09:24.840 INFO:teuthology.orchestra.run.smithi160.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T00:09:24.840 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T00:09:24.840 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T00:09:24.840 INFO:teuthology.orchestra.run.smithi160.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T00:09:24.840 INFO:teuthology.orchestra.run.smithi160.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T00:09:24.840 INFO:teuthology.orchestra.run.smithi160.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T00:09:24.840 INFO:teuthology.orchestra.run.smithi160.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T00:09:24.841 INFO:teuthology.orchestra.run.smithi160.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T00:09:24.841 INFO:teuthology.orchestra.run.smithi160.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T00:09:24.841 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T00:09:24.841 INFO:teuthology.orchestra.run.smithi160.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T00:09:24.841 INFO:teuthology.orchestra.run.smithi160.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T00:09:24.841 INFO:teuthology.orchestra.run.smithi160.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T00:09:24.841 INFO:teuthology.orchestra.run.smithi160.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T00:09:24.841 INFO:teuthology.orchestra.run.smithi160.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T00:09:24.841 INFO:teuthology.orchestra.run.smithi160.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T00:09:24.841 INFO:teuthology.orchestra.run.smithi160.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T00:09:24.841 INFO:teuthology.orchestra.run.smithi160.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T00:09:24.841 INFO:teuthology.orchestra.run.smithi160.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T00:09:24.841 INFO:teuthology.orchestra.run.smithi160.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T00:09:24.841 INFO:teuthology.orchestra.run.smithi160.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T00:09:24.842 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T00:09:24.842 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T00:09:24.842 INFO:teuthology.orchestra.run.smithi160.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T00:09:24.842 INFO:teuthology.orchestra.run.smithi160.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T00:09:24.842 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T00:09:24.842 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T00:09:24.842 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T00:09:24.842 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T00:09:24.842 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 45 k 2024-09-12T00:09:24.842 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 143 k 2024-09-12T00:09:24.842 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T00:09:24.842 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T00:09:24.842 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T00:09:24.843 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T00:09:24.843 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T00:09:24.843 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T00:09:24.843 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T00:09:24.843 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T00:09:24.843 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T00:09:24.843 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T00:09:24.843 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T00:09:24.843 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T00:09:24.843 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T00:09:24.843 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T00:09:24.843 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T00:09:24.843 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T00:09:24.843 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T00:09:24.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T00:09:24.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T00:09:24.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T00:09:24.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T00:09:24.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T00:09:24.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T00:09:24.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T00:09:24.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T00:09:24.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T00:09:24.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T00:09:24.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T00:09:24.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T00:09:24.844 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T00:09:24.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T00:09:24.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T00:09:24.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T00:09:24.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T00:09:24.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T00:09:24.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T00:09:24.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T00:09:24.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T00:09:24.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T00:09:24.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T00:09:24.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T00:09:24.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T00:09:24.845 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T00:09:24.846 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T00:09:24.846 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T00:09:24.846 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T00:09:24.846 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T00:09:24.846 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T00:09:24.846 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T00:09:24.846 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T00:09:24.846 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T00:09:24.846 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T00:09:24.846 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T00:09:24.846 INFO:teuthology.orchestra.run.smithi160.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T00:09:24.846 INFO:teuthology.orchestra.run.smithi160.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T00:09:24.846 INFO:teuthology.orchestra.run.smithi160.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T00:09:24.847 INFO:teuthology.orchestra.run.smithi160.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T00:09:24.847 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T00:09:24.847 INFO:teuthology.orchestra.run.smithi160.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T00:09:24.847 INFO:teuthology.orchestra.run.smithi160.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T00:09:24.847 INFO:teuthology.orchestra.run.smithi160.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T00:09:24.847 INFO:teuthology.orchestra.run.smithi160.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T00:09:24.847 INFO:teuthology.orchestra.run.smithi160.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T00:09:24.847 INFO:teuthology.orchestra.run.smithi160.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T00:09:24.847 INFO:teuthology.orchestra.run.smithi160.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T00:09:24.847 INFO:teuthology.orchestra.run.smithi160.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T00:09:24.847 INFO:teuthology.orchestra.run.smithi160.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T00:09:24.847 INFO:teuthology.orchestra.run.smithi160.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T00:09:24.847 INFO:teuthology.orchestra.run.smithi160.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T00:09:24.847 INFO:teuthology.orchestra.run.smithi160.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T00:09:24.848 INFO:teuthology.orchestra.run.smithi160.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T00:09:24.848 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T00:09:24.848 INFO:teuthology.orchestra.run.smithi160.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T00:09:24.848 INFO:teuthology.orchestra.run.smithi160.stdout:Installing weak dependencies: 2024-09-12T00:09:24.848 INFO:teuthology.orchestra.run.smithi160.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T00:09:24.848 INFO:teuthology.orchestra.run.smithi160.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T00:09:24.848 INFO:teuthology.orchestra.run.smithi160.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T00:09:24.848 INFO:teuthology.orchestra.run.smithi160.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T00:09:24.848 INFO:teuthology.orchestra.run.smithi160.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T00:09:24.848 INFO:teuthology.orchestra.run.smithi160.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T00:09:24.848 INFO:teuthology.orchestra.run.smithi160.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T00:09:24.848 INFO:teuthology.orchestra.run.smithi160.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T00:09:24.848 INFO:teuthology.orchestra.run.smithi160.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T00:09:24.849 INFO:teuthology.orchestra.run.smithi160.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T00:09:24.849 INFO:teuthology.orchestra.run.smithi160.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T00:09:24.849 INFO:teuthology.orchestra.run.smithi160.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T00:09:24.849 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T00:09:24.849 INFO:teuthology.orchestra.run.smithi160.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T00:09:24.849 INFO:teuthology.orchestra.run.smithi160.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T00:09:24.849 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:09:24.849 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-12T00:09:24.849 INFO:teuthology.orchestra.run.smithi160.stdout:====================================================================================================== 2024-09-12T00:09:24.849 INFO:teuthology.orchestra.run.smithi160.stdout:Install 283 Packages 2024-09-12T00:09:24.849 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 2 Packages 2024-09-12T00:09:24.849 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:09:24.850 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 327 M 2024-09-12T00:09:24.850 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-12T00:09:25.058 INFO:teuthology.orchestra.run.smithi133.stdout:(1/285): ceph-19.3.0-4753.gd011c522.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-09-12T00:09:25.309 INFO:teuthology.orchestra.run.smithi133.stdout:(2/285): ceph-fuse-19.3.0-4753.gd011c522.el9.x8 3.5 MB/s | 899 kB 00:00 2024-09-12T00:09:25.382 INFO:teuthology.orchestra.run.smithi160.stdout:(1/285): ceph-19.3.0-4753.gd011c522.el9.x86_64. 30 kB/s | 6.6 kB 00:00 2024-09-12T00:09:25.392 INFO:teuthology.orchestra.run.smithi133.stdout:(3/285): ceph-base-19.3.0-4753.gd011c522.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-12T00:09:25.417 INFO:teuthology.orchestra.run.smithi133.stdout:(4/285): ceph-immutable-object-cache-19.3.0-475 1.3 MB/s | 145 kB 00:00 2024-09-12T00:09:25.509 INFO:teuthology.orchestra.run.smithi133.stdout:(5/285): ceph-mds-19.3.0-4753.gd011c522.el9.x86 20 MB/s | 2.4 MB 00:00 2024-09-12T00:09:25.793 INFO:teuthology.orchestra.run.smithi133.stdout:(6/285): ceph-mon-19.3.0-4753.gd011c522.el9.x86 17 MB/s | 4.8 MB 00:00 2024-09-12T00:09:25.949 INFO:teuthology.orchestra.run.smithi160.stdout:(2/285): ceph-fuse-19.3.0-4753.gd011c522.el9.x8 1.6 MB/s | 899 kB 00:00 2024-09-12T00:09:26.015 INFO:teuthology.orchestra.run.smithi160.stdout:(3/285): ceph-immutable-object-cache-19.3.0-475 2.1 MB/s | 145 kB 00:00 2024-09-12T00:09:26.102 INFO:teuthology.orchestra.run.smithi133.stdout:(7/285): ceph-common-19.3.0-4753.gd011c522.el9. 18 MB/s | 22 MB 00:01 2024-09-12T00:09:26.143 INFO:teuthology.orchestra.run.smithi133.stdout:(8/285): ceph-mgr-19.3.0-4753.gd011c522.el9.x86 2.1 MB/s | 1.5 MB 00:00 2024-09-12T00:09:26.202 INFO:teuthology.orchestra.run.smithi133.stdout:(9/285): ceph-selinux-19.3.0-4753.gd011c522.el9 431 kB/s | 25 kB 00:00 2024-09-12T00:09:26.636 INFO:teuthology.orchestra.run.smithi133.stdout:(10/285): ceph-radosgw-19.3.0-4753.gd011c522.el 21 MB/s | 11 MB 00:00 2024-09-12T00:09:26.649 INFO:teuthology.orchestra.run.smithi160.stdout:(4/285): ceph-mds-19.3.0-4753.gd011c522.el9.x86 3.7 MB/s | 2.4 MB 00:00 2024-09-12T00:09:26.686 INFO:teuthology.orchestra.run.smithi133.stdout:(11/285): libcephfs-devel-19.3.0-4753.gd011c522 638 kB/s | 32 kB 00:00 2024-09-12T00:09:26.849 INFO:teuthology.orchestra.run.smithi160.stdout:(5/285): ceph-mgr-19.3.0-4753.gd011c522.el9.x86 7.6 MB/s | 1.5 MB 00:00 2024-09-12T00:09:26.895 INFO:teuthology.orchestra.run.smithi133.stdout:(12/285): ceph-osd-19.3.0-4753.gd011c522.el9.x8 16 MB/s | 17 MB 00:01 2024-09-12T00:09:26.936 INFO:teuthology.orchestra.run.smithi133.stdout:(13/285): libcephfs2-19.3.0-4753.gd011c522.el9. 2.9 MB/s | 755 kB 00:00 2024-09-12T00:09:26.962 INFO:teuthology.orchestra.run.smithi133.stdout:(14/285): libcephsqlite-19.3.0-4753.gd011c522.e 2.4 MB/s | 161 kB 00:00 2024-09-12T00:09:26.987 INFO:teuthology.orchestra.run.smithi133.stdout:(15/285): librados-devel-19.3.0-4753.gd011c522. 2.5 MB/s | 126 kB 00:00 2024-09-12T00:09:27.029 INFO:teuthology.orchestra.run.smithi133.stdout:(16/285): libradosstriper1-19.3.0-4753.gd011c52 7.4 MB/s | 508 kB 00:00 2024-09-12T00:09:27.113 INFO:teuthology.orchestra.run.smithi133.stdout:(17/285): python3-ceph-argparse-19.3.0-4753.gd0 542 kB/s | 45 kB 00:00 2024-09-12T00:09:27.197 INFO:teuthology.orchestra.run.smithi133.stdout:(18/285): python3-ceph-common-19.3.0-4753.gd011 1.7 MB/s | 143 kB 00:00 2024-09-12T00:09:27.297 INFO:teuthology.orchestra.run.smithi133.stdout:(19/285): librgw2-19.3.0-4753.gd011c522.el9.x86 18 MB/s | 5.5 MB 00:00 2024-09-12T00:09:27.322 INFO:teuthology.orchestra.run.smithi133.stdout:(20/285): python3-cephfs-19.3.0-4753.gd011c522. 1.3 MB/s | 161 kB 00:00 2024-09-12T00:09:27.355 INFO:teuthology.orchestra.run.smithi133.stdout:(21/285): python3-rados-19.3.0-4753.gd011c522.e 5.4 MB/s | 322 kB 00:00 2024-09-12T00:09:27.358 INFO:teuthology.orchestra.run.smithi160.stdout:(6/285): ceph-mon-19.3.0-4753.gd011c522.el9.x86 9.4 MB/s | 4.8 MB 00:00 2024-09-12T00:09:27.381 INFO:teuthology.orchestra.run.smithi133.stdout:(22/285): python3-rbd-19.3.0-4753.gd011c522.el9 5.1 MB/s | 306 kB 00:00 2024-09-12T00:09:27.406 INFO:teuthology.orchestra.run.smithi133.stdout:(23/285): python3-rgw-19.3.0-4753.gd011c522.el9 1.9 MB/s | 99 kB 00:00 2024-09-12T00:09:27.432 INFO:teuthology.orchestra.run.smithi133.stdout:(24/285): rbd-fuse-19.3.0-4753.gd011c522.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-12T00:09:27.506 INFO:teuthology.orchestra.run.smithi133.stdout:(25/285): rbd-nbd-19.3.0-4753.gd011c522.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-12T00:09:27.557 INFO:teuthology.orchestra.run.smithi133.stdout:(26/285): rbd-mirror-19.3.0-4753.gd011c522.el9. 21 MB/s | 3.2 MB 00:00 2024-09-12T00:09:27.567 INFO:teuthology.orchestra.run.smithi160.stdout:(7/285): ceph-common-19.3.0-4753.gd011c522.el9. 9.0 MB/s | 22 MB 00:02 2024-09-12T00:09:27.582 INFO:teuthology.orchestra.run.smithi133.stdout:(27/285): ceph-grafana-dashboards-19.3.0-4753.g 455 kB/s | 34 kB 00:00 2024-09-12T00:09:27.607 INFO:teuthology.orchestra.run.smithi133.stdout:(28/285): ceph-mgr-cephadm-19.3.0-4753.gd011c52 3.0 MB/s | 154 kB 00:00 2024-09-12T00:09:27.633 INFO:teuthology.orchestra.run.smithi160.stdout:(8/285): ceph-base-19.3.0-4753.gd011c522.el9.x8 2.2 MB/s | 5.5 MB 00:02 2024-09-12T00:09:27.742 INFO:teuthology.orchestra.run.smithi160.stdout:(9/285): ceph-selinux-19.3.0-4753.gd011c522.el9 232 kB/s | 25 kB 00:00 2024-09-12T00:09:28.108 INFO:teuthology.orchestra.run.smithi133.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 15 MB/s | 7.4 MB 00:00 2024-09-12T00:09:28.183 INFO:teuthology.orchestra.run.smithi133.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4753.gd0 3.8 MB/s | 291 kB 00:00 2024-09-12T00:09:28.258 INFO:teuthology.orchestra.run.smithi133.stdout:(31/285): ceph-mgr-rook-19.3.0-4753.gd011c522.e 660 kB/s | 49 kB 00:00 2024-09-12T00:09:28.317 INFO:teuthology.orchestra.run.smithi133.stdout:(32/285): ceph-prometheus-alerts-19.3.0-4753.gd 281 kB/s | 16 kB 00:00 2024-09-12T00:09:28.376 INFO:teuthology.orchestra.run.smithi133.stdout:(33/285): ceph-volume-19.3.0-4753.gd011c522.el9 4.8 MB/s | 285 kB 00:00 2024-09-12T00:09:28.392 INFO:teuthology.orchestra.run.smithi160.stdout:(10/285): ceph-radosgw-19.3.0-4753.gd011c522.el 13 MB/s | 11 MB 00:00 2024-09-12T00:09:28.459 INFO:teuthology.orchestra.run.smithi160.stdout:(11/285): libcephfs-devel-19.3.0-4753.gd011c522 477 kB/s | 32 kB 00:00 2024-09-12T00:09:28.460 INFO:teuthology.orchestra.run.smithi133.stdout:(34/285): cephadm-19.3.0-4753.gd011c522.el9.noa 9.2 MB/s | 782 kB 00:00 2024-09-12T00:09:28.534 INFO:teuthology.orchestra.run.smithi160.stdout:(12/285): libcephfs2-19.3.0-4753.gd011c522.el9. 9.9 MB/s | 755 kB 00:00 2024-09-12T00:09:28.585 INFO:teuthology.orchestra.run.smithi160.stdout:(13/285): libcephsqlite-19.3.0-4753.gd011c522.e 3.2 MB/s | 161 kB 00:00 2024-09-12T00:09:28.601 INFO:teuthology.orchestra.run.smithi133.stdout:(35/285): ceph-mgr-dashboard-19.3.0-4753.gd011c 14 MB/s | 14 MB 00:01 2024-09-12T00:09:28.635 INFO:teuthology.orchestra.run.smithi160.stdout:(14/285): librados-devel-19.3.0-4753.gd011c522. 2.5 MB/s | 126 kB 00:00 2024-09-12T00:09:28.694 INFO:teuthology.orchestra.run.smithi160.stdout:(15/285): libradosstriper1-19.3.0-4753.gd011c52 8.5 MB/s | 508 kB 00:00 2024-09-12T00:09:28.702 INFO:teuthology.orchestra.run.smithi133.stdout:(36/285): ModemManager-glib-1.20.2-1.el9.x86_64 1.4 MB/s | 335 kB 00:00 2024-09-12T00:09:28.727 INFO:teuthology.orchestra.run.smithi133.stdout:(37/285): bluez-libs-5.56-6.el9.x86_64.rpm 679 kB/s | 85 kB 00:00 2024-09-12T00:09:28.752 INFO:teuthology.orchestra.run.smithi133.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 985 kB/s | 49 kB 00:00 2024-09-12T00:09:28.786 INFO:teuthology.orchestra.run.smithi133.stdout:(39/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 4.4 MB/s | 262 kB 00:00 2024-09-12T00:09:28.811 INFO:teuthology.orchestra.run.smithi133.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 1.3 MB/s | 80 kB 00:00 2024-09-12T00:09:28.855 INFO:teuthology.orchestra.run.smithi133.stdout:(41/285): libpciaccess-0.16-7.el9.x86_64.rpm 647 kB/s | 27 kB 00:00 2024-09-12T00:09:28.878 INFO:teuthology.orchestra.run.smithi133.stdout:(42/285): libgfortran-11.5.0-2.el9.x86_64.rpm 8.5 MB/s | 801 kB 00:00 2024-09-12T00:09:28.903 INFO:teuthology.orchestra.run.smithi133.stdout:(43/285): libquadmath-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T00:09:28.910 INFO:teuthology.orchestra.run.smithi160.stdout:(16/285): ceph-osd-19.3.0-4753.gd011c522.el9.x8 11 MB/s | 17 MB 00:01 2024-09-12T00:09:28.929 INFO:teuthology.orchestra.run.smithi133.stdout:(44/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-09-12T00:09:28.952 INFO:teuthology.orchestra.run.smithi160.stdout:(17/285): python3-ceph-argparse-19.3.0-4753.gd0 1.1 MB/s | 45 kB 00:00 2024-09-12T00:09:28.954 INFO:teuthology.orchestra.run.smithi133.stdout:(45/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-09-12T00:09:28.996 INFO:teuthology.orchestra.run.smithi133.stdout:(46/285): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-09-12T00:09:29.021 INFO:teuthology.orchestra.run.smithi133.stdout:(47/285): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-12T00:09:29.044 INFO:teuthology.orchestra.run.smithi160.stdout:(18/285): librgw2-19.3.0-4753.gd011c522.el9.x86 16 MB/s | 5.5 MB 00:00 2024-09-12T00:09:29.047 INFO:teuthology.orchestra.run.smithi133.stdout:(48/285): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T00:09:29.069 INFO:teuthology.orchestra.run.smithi160.stdout:(19/285): python3-ceph-common-19.3.0-4753.gd011 1.2 MB/s | 143 kB 00:00 2024-09-12T00:09:29.072 INFO:teuthology.orchestra.run.smithi133.stdout:(49/285): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T00:09:29.095 INFO:teuthology.orchestra.run.smithi160.stdout:(20/285): python3-cephfs-19.3.0-4753.gd011c522. 3.2 MB/s | 161 kB 00:00 2024-09-12T00:09:29.097 INFO:teuthology.orchestra.run.smithi133.stdout:(50/285): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-12T00:09:29.120 INFO:teuthology.orchestra.run.smithi160.stdout:(21/285): python3-rados-19.3.0-4753.gd011c522.e 6.2 MB/s | 322 kB 00:00 2024-09-12T00:09:29.145 INFO:teuthology.orchestra.run.smithi160.stdout:(22/285): python3-rbd-19.3.0-4753.gd011c522.el9 6.0 MB/s | 306 kB 00:00 2024-09-12T00:09:29.162 INFO:teuthology.orchestra.run.smithi160.stdout:(23/285): python3-rgw-19.3.0-4753.gd011c522.el9 2.3 MB/s | 99 kB 00:00 2024-09-12T00:09:29.187 INFO:teuthology.orchestra.run.smithi160.stdout:(24/285): rbd-fuse-19.3.0-4753.gd011c522.el9.x8 2.0 MB/s | 85 kB 00:00 2024-09-12T00:09:29.238 INFO:teuthology.orchestra.run.smithi160.stdout:(25/285): rbd-nbd-19.3.0-4753.gd011c522.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-12T00:09:29.288 INFO:teuthology.orchestra.run.smithi160.stdout:(26/285): ceph-grafana-dashboards-19.3.0-4753.g 687 kB/s | 34 kB 00:00 2024-09-12T00:09:29.322 INFO:teuthology.orchestra.run.smithi133.stdout:(51/285): adwaita-cursor-theme-40.1.1-3.el9.noa 2.5 MB/s | 650 kB 00:00 2024-09-12T00:09:29.338 INFO:teuthology.orchestra.run.smithi160.stdout:(27/285): ceph-mgr-cephadm-19.3.0-4753.gd011c52 3.0 MB/s | 154 kB 00:00 2024-09-12T00:09:29.406 INFO:teuthology.orchestra.run.smithi160.stdout:(28/285): rbd-mirror-19.3.0-4753.gd011c522.el9. 13 MB/s | 3.2 MB 00:00 2024-09-12T00:09:29.489 INFO:teuthology.orchestra.run.smithi133.stdout:(52/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 3.1 MB/s | 523 kB 00:00 2024-09-12T00:09:29.540 INFO:teuthology.orchestra.run.smithi133.stdout:(53/285): apache-commons-cli-1.4-17.el9.noarch. 1.4 MB/s | 71 kB 00:00 2024-09-12T00:09:29.656 INFO:teuthology.orchestra.run.smithi133.stdout:(54/285): apache-commons-codec-1.15-7.el9.noarc 2.5 MB/s | 302 kB 00:00 2024-09-12T00:09:29.749 INFO:teuthology.orchestra.run.smithi133.stdout:(55/285): apache-commons-io-2.8.0-8.el9.noarch. 3.0 MB/s | 283 kB 00:00 2024-09-12T00:09:29.890 INFO:teuthology.orchestra.run.smithi133.stdout:(56/285): apache-commons-lang3-3.12.0-6.el9.noa 3.9 MB/s | 559 kB 00:00 2024-09-12T00:09:29.922 INFO:teuthology.orchestra.run.smithi160.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 14 MB/s | 7.4 MB 00:00 2024-09-12T00:09:29.941 INFO:teuthology.orchestra.run.smithi133.stdout:(57/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-09-12T00:09:30.024 INFO:teuthology.orchestra.run.smithi133.stdout:(58/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-09-12T00:09:30.064 INFO:teuthology.orchestra.run.smithi160.stdout:(30/285): ceph-mgr-dashboard-19.3.0-4753.gd011c 20 MB/s | 14 MB 00:00 2024-09-12T00:09:30.085 INFO:teuthology.orchestra.run.smithi133.stdout:(59/285): atinject-1.0.3-6.el9.noarch.rpm 384 kB/s | 23 kB 00:00 2024-09-12T00:09:30.089 INFO:teuthology.orchestra.run.smithi160.stdout:(31/285): ceph-mgr-modules-core-19.3.0-4753.gd0 1.7 MB/s | 291 kB 00:00 2024-09-12T00:09:30.115 INFO:teuthology.orchestra.run.smithi160.stdout:(32/285): ceph-mgr-rook-19.3.0-4753.gd011c522.e 985 kB/s | 49 kB 00:00 2024-09-12T00:09:30.140 INFO:teuthology.orchestra.run.smithi160.stdout:(33/285): ceph-prometheus-alerts-19.3.0-4753.gd 327 kB/s | 16 kB 00:00 2024-09-12T00:09:30.165 INFO:teuthology.orchestra.run.smithi160.stdout:(34/285): ceph-volume-19.3.0-4753.gd011c522.el9 5.6 MB/s | 285 kB 00:00 2024-09-12T00:09:30.168 INFO:teuthology.orchestra.run.smithi133.stdout:(60/285): atk-2.36.0-5.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-12T00:09:30.211 INFO:teuthology.orchestra.run.smithi133.stdout:(61/285): avahi-glib-0.8-21.el9.x86_64.rpm 357 kB/s | 15 kB 00:00 2024-09-12T00:09:30.215 INFO:teuthology.orchestra.run.smithi160.stdout:(35/285): cephadm-19.3.0-4753.gd011c522.el9.noa 10 MB/s | 782 kB 00:00 2024-09-12T00:09:30.252 INFO:teuthology.orchestra.run.smithi133.stdout:(62/285): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-12T00:09:30.299 INFO:teuthology.orchestra.run.smithi160.stdout:(36/285): ModemManager-glib-1.20.2-1.el9.x86_64 2.5 MB/s | 335 kB 00:00 2024-09-12T00:09:30.303 INFO:teuthology.orchestra.run.smithi133.stdout:(63/285): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 53 kB 00:00 2024-09-12T00:09:30.341 INFO:teuthology.orchestra.run.smithi160.stdout:(37/285): bluez-libs-5.56-6.el9.x86_64.rpm 674 kB/s | 85 kB 00:00 2024-09-12T00:09:30.367 INFO:teuthology.orchestra.run.smithi160.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 735 kB/s | 49 kB 00:00 2024-09-12T00:09:30.386 INFO:teuthology.orchestra.run.smithi133.stdout:(64/285): colord-libs-1.4.5-4.el9.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2024-09-12T00:09:30.437 INFO:teuthology.orchestra.run.smithi133.stdout:(65/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-12T00:09:30.442 INFO:teuthology.orchestra.run.smithi160.stdout:(39/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.6 MB/s | 262 kB 00:00 2024-09-12T00:09:30.467 INFO:teuthology.orchestra.run.smithi160.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 796 kB/s | 80 kB 00:00 2024-09-12T00:09:30.487 INFO:teuthology.orchestra.run.smithi133.stdout:(66/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 565 kB/s | 28 kB 00:00 2024-09-12T00:09:30.537 INFO:teuthology.orchestra.run.smithi133.stdout:(67/285): dconf-0.40.0-6.el9.x86_64.rpm 2.2 MB/s | 113 kB 00:00 2024-09-12T00:09:30.542 INFO:teuthology.orchestra.run.smithi160.stdout:(41/285): libgfortran-11.5.0-2.el9.x86_64.rpm 7.8 MB/s | 801 kB 00:00 2024-09-12T00:09:30.559 INFO:teuthology.orchestra.run.smithi160.stdout:(42/285): libpciaccess-0.16-7.el9.x86_64.rpm 293 kB/s | 27 kB 00:00 2024-09-12T00:09:30.626 INFO:teuthology.orchestra.run.smithi160.stdout:(43/285): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-12T00:09:30.652 INFO:teuthology.orchestra.run.smithi160.stdout:(44/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.0 MB/s | 94 kB 00:00 2024-09-12T00:09:30.679 INFO:teuthology.orchestra.run.smithi133.stdout:(68/285): exempi-2.6.0-0.2.20211007gite23c213.e 3.6 MB/s | 525 kB 00:00 2024-09-12T00:09:30.704 INFO:teuthology.orchestra.run.smithi160.stdout:(45/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-12T00:09:30.761 INFO:teuthology.orchestra.run.smithi160.stdout:(46/285): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-12T00:09:30.786 INFO:teuthology.orchestra.run.smithi160.stdout:(47/285): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-09-12T00:09:30.836 INFO:teuthology.orchestra.run.smithi160.stdout:(48/285): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-12T00:09:30.861 INFO:teuthology.orchestra.run.smithi160.stdout:(49/285): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-12T00:09:30.871 INFO:teuthology.orchestra.run.smithi133.stdout:(69/285): exiv2-0.27.5-2.el9.x86_64.rpm 5.0 MB/s | 980 kB 00:00 2024-09-12T00:09:30.920 INFO:teuthology.orchestra.run.smithi160.stdout:(50/285): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-12T00:09:31.037 INFO:teuthology.orchestra.run.smithi160.stdout:(51/285): adwaita-cursor-theme-40.1.1-3.el9.noa 3.6 MB/s | 650 kB 00:00 2024-09-12T00:09:31.038 INFO:teuthology.orchestra.run.smithi133.stdout:(70/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 4.6 MB/s | 781 kB 00:00 2024-09-12T00:09:31.087 INFO:teuthology.orchestra.run.smithi160.stdout:(52/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 10 MB/s | 523 kB 00:00 2024-09-12T00:09:31.122 INFO:teuthology.orchestra.run.smithi133.stdout:(71/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.8 MB/s | 325 kB 00:00 2024-09-12T00:09:31.129 INFO:teuthology.orchestra.run.smithi160.stdout:(53/285): apache-commons-cli-1.4-17.el9.noarch. 1.7 MB/s | 71 kB 00:00 2024-09-12T00:09:31.171 INFO:teuthology.orchestra.run.smithi160.stdout:(54/285): apache-commons-codec-1.15-7.el9.noarc 7.1 MB/s | 302 kB 00:00 2024-09-12T00:09:31.213 INFO:teuthology.orchestra.run.smithi160.stdout:(55/285): apache-commons-io-2.8.0-8.el9.noarch. 6.7 MB/s | 283 kB 00:00 2024-09-12T00:09:31.239 INFO:teuthology.orchestra.run.smithi133.stdout:(72/285): adwaita-icon-theme-40.1.1-3.el9.noarc 5.6 MB/s | 12 MB 00:02 2024-09-12T00:09:31.264 INFO:teuthology.orchestra.run.smithi133.stdout:(73/285): flac-libs-1.3.3-12.el9.x86_64.rpm 1.5 MB/s | 218 kB 00:00 2024-09-12T00:09:31.315 INFO:teuthology.orchestra.run.smithi133.stdout:(74/285): flatpak-selinux-1.12.9-1.el9.noarch.r 434 kB/s | 22 kB 00:00 2024-09-12T00:09:31.346 INFO:teuthology.orchestra.run.smithi160.stdout:(56/285): adwaita-icon-theme-40.1.1-3.el9.noarc 28 MB/s | 12 MB 00:00 2024-09-12T00:09:31.365 INFO:teuthology.orchestra.run.smithi133.stdout:(75/285): flatpak-session-helper-1.12.9-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-09-12T00:09:31.380 INFO:teuthology.orchestra.run.smithi160.stdout:(57/285): apache-commons-lang3-3.12.0-6.el9.noa 3.3 MB/s | 559 kB 00:00 2024-09-12T00:09:31.405 INFO:teuthology.orchestra.run.smithi160.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2024-09-12T00:09:31.430 INFO:teuthology.orchestra.run.smithi160.stdout:(59/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-09-12T00:09:31.456 INFO:teuthology.orchestra.run.smithi160.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 461 kB/s | 23 kB 00:00 2024-09-12T00:09:31.481 INFO:teuthology.orchestra.run.smithi160.stdout:(61/285): atk-2.36.0-5.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T00:09:31.507 INFO:teuthology.orchestra.run.smithi160.stdout:(62/285): avahi-glib-0.8-21.el9.x86_64.rpm 297 kB/s | 15 kB 00:00 2024-09-12T00:09:31.531 INFO:teuthology.orchestra.run.smithi160.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-12T00:09:31.557 INFO:teuthology.orchestra.run.smithi160.stdout:(64/285): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 53 kB 00:00 2024-09-12T00:09:31.582 INFO:teuthology.orchestra.run.smithi160.stdout:(65/285): colord-libs-1.4.5-4.el9.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2024-09-12T00:09:31.608 INFO:teuthology.orchestra.run.smithi160.stdout:(66/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-12T00:09:31.633 INFO:teuthology.orchestra.run.smithi160.stdout:(67/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 560 kB/s | 28 kB 00:00 2024-09-12T00:09:31.658 INFO:teuthology.orchestra.run.smithi160.stdout:(68/285): dconf-0.40.0-6.el9.x86_64.rpm 2.2 MB/s | 113 kB 00:00 2024-09-12T00:09:31.692 INFO:teuthology.orchestra.run.smithi160.stdout:(69/285): exempi-2.6.0-0.2.20211007gite23c213.e 8.8 MB/s | 525 kB 00:00 2024-09-12T00:09:31.734 INFO:teuthology.orchestra.run.smithi160.stdout:(70/285): exiv2-0.27.5-2.el9.x86_64.rpm 13 MB/s | 980 kB 00:00 2024-09-12T00:09:31.767 INFO:teuthology.orchestra.run.smithi160.stdout:(71/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 10 MB/s | 781 kB 00:00 2024-09-12T00:09:31.793 INFO:teuthology.orchestra.run.smithi160.stdout:(72/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 5.4 MB/s | 325 kB 00:00 2024-09-12T00:09:31.815 INFO:teuthology.orchestra.run.smithi133.stdout:(76/285): ceph-test-19.3.0-4753.gd011c522.el9.x 8.9 MB/s | 50 MB 00:05 2024-09-12T00:09:31.826 INFO:teuthology.orchestra.run.smithi160.stdout:(73/285): flac-libs-1.3.3-12.el9.x86_64.rpm 3.6 MB/s | 218 kB 00:00 2024-09-12T00:09:31.840 INFO:teuthology.orchestra.run.smithi133.stdout:(77/285): flexiblas-3.0.4-8.el9.x86_64.rpm 69 kB/s | 33 kB 00:00 2024-09-12T00:09:31.868 INFO:teuthology.orchestra.run.smithi160.stdout:(74/285): flatpak-1.12.9-1.el9.x86_64.rpm 23 MB/s | 1.7 MB 00:00 2024-09-12T00:09:31.882 INFO:teuthology.orchestra.run.smithi133.stdout:(78/285): flatpak-1.12.9-1.el9.x86_64.rpm 2.7 MB/s | 1.7 MB 00:00 2024-09-12T00:09:31.885 INFO:teuthology.orchestra.run.smithi160.stdout:(75/285): flatpak-selinux-1.12.9-1.el9.noarch.r 370 kB/s | 22 kB 00:00 2024-09-12T00:09:31.907 INFO:teuthology.orchestra.run.smithi133.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-12T00:09:31.910 INFO:teuthology.orchestra.run.smithi160.stdout:(76/285): flatpak-session-helper-1.12.9-1.el9.x 1.7 MB/s | 73 kB 00:00 2024-09-12T00:09:31.927 INFO:teuthology.orchestra.run.smithi160.stdout:(77/285): flexiblas-3.0.4-8.el9.x86_64.rpm 784 kB/s | 33 kB 00:00 2024-09-12T00:09:31.932 INFO:teuthology.orchestra.run.smithi133.stdout:(80/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.7 MB/s | 89 kB 00:00 2024-09-12T00:09:31.983 INFO:teuthology.orchestra.run.smithi133.stdout:(81/285): giflib-5.2.1-9.el9.x86_64.rpm 976 kB/s | 49 kB 00:00 2024-09-12T00:09:31.986 INFO:teuthology.orchestra.run.smithi160.stdout:(78/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 40 MB/s | 3.0 MB 00:00 2024-09-12T00:09:32.003 INFO:teuthology.orchestra.run.smithi160.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-12T00:09:32.008 INFO:teuthology.orchestra.run.smithi133.stdout:(82/285): geoclue2-2.6.0-7.el9.x86_64.rpm 1.2 MB/s | 124 kB 00:00 2024-09-12T00:09:32.028 INFO:teuthology.orchestra.run.smithi160.stdout:(80/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 2.1 MB/s | 89 kB 00:00 2024-09-12T00:09:32.054 INFO:teuthology.orchestra.run.smithi160.stdout:(81/285): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 124 kB 00:00 2024-09-12T00:09:32.058 INFO:teuthology.orchestra.run.smithi133.stdout:(83/285): graphene-1.10.6-2.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-09-12T00:09:32.079 INFO:teuthology.orchestra.run.smithi160.stdout:(82/285): giflib-5.2.1-9.el9.x86_64.rpm 971 kB/s | 49 kB 00:00 2024-09-12T00:09:32.104 INFO:teuthology.orchestra.run.smithi160.stdout:(83/285): google-guice-4.2.3-9.el9.noarch.rpm 9.2 MB/s | 473 kB 00:00 2024-09-12T00:09:32.108 INFO:teuthology.orchestra.run.smithi133.stdout:(84/285): google-guice-4.2.3-9.el9.noarch.rpm 3.7 MB/s | 473 kB 00:00 2024-09-12T00:09:32.130 INFO:teuthology.orchestra.run.smithi160.stdout:(84/285): graphene-1.10.6-2.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-09-12T00:09:32.134 INFO:teuthology.orchestra.run.smithi133.stdout:(85/285): gsm-1.0.19-6.el9.x86_64.rpm 453 kB/s | 34 kB 00:00 2024-09-12T00:09:32.155 INFO:teuthology.orchestra.run.smithi160.stdout:(85/285): gsm-1.0.19-6.el9.x86_64.rpm 679 kB/s | 34 kB 00:00 2024-09-12T00:09:32.197 INFO:teuthology.orchestra.run.smithi160.stdout:(86/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 21 MB/s | 1.4 MB 00:00 2024-09-12T00:09:32.238 INFO:teuthology.orchestra.run.smithi160.stdout:(87/285): gtk-update-icon-cache-3.24.31-5.el9.x 797 kB/s | 33 kB 00:00 2024-09-12T00:09:32.289 INFO:teuthology.orchestra.run.smithi160.stdout:(88/285): gstreamer1-plugins-base-1.22.1-2.el9. 17 MB/s | 2.2 MB 00:00 2024-09-12T00:09:32.342 INFO:teuthology.orchestra.run.smithi133.stdout:(86/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 6.1 MB/s | 1.4 MB 00:00 2024-09-12T00:09:32.373 INFO:teuthology.orchestra.run.smithi160.stdout:(89/285): gtk3-3.24.31-5.el9.x86_64.rpm 37 MB/s | 4.9 MB 00:00 2024-09-12T00:09:32.393 INFO:teuthology.orchestra.run.smithi133.stdout:(87/285): gtk-update-icon-cache-3.24.31-5.el9.x 664 kB/s | 33 kB 00:00 2024-09-12T00:09:32.414 INFO:teuthology.orchestra.run.smithi160.stdout:(90/285): guava-30.1-6.el9.noarch.rpm 19 MB/s | 2.3 MB 00:00 2024-09-12T00:09:32.440 INFO:teuthology.orchestra.run.smithi160.stdout:(91/285): hicolor-icon-theme-0.17-13.el9.noarch 3.2 MB/s | 219 kB 00:00 2024-09-12T00:09:32.482 INFO:teuthology.orchestra.run.smithi160.stdout:(92/285): httpcomponents-client-4.5.13-3.el9.no 9.6 MB/s | 657 kB 00:00 2024-09-12T00:09:32.523 INFO:teuthology.orchestra.run.smithi160.stdout:(93/285): httpcomponents-core-4.4.13-7.el9.noar 7.4 MB/s | 632 kB 00:00 2024-09-12T00:09:32.569 INFO:teuthology.orchestra.run.smithi133.stdout:(88/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.0 MB/s | 3.0 MB 00:00 2024-09-12T00:09:32.582 INFO:teuthology.orchestra.run.smithi160.stdout:(94/285): iso-codes-4.6.0-3.el9.noarch.rpm 35 MB/s | 3.5 MB 00:00 2024-09-12T00:09:32.607 INFO:teuthology.orchestra.run.smithi160.stdout:(95/285): jakarta-annotations-1.3.5-13.el9.noar 540 kB/s | 45 kB 00:00 2024-09-12T00:09:32.643 INFO:teuthology.orchestra.run.smithi133.stdout:(89/285): gstreamer1-plugins-base-1.22.1-2.el9. 4.4 MB/s | 2.2 MB 00:00 2024-09-12T00:09:32.653 INFO:teuthology.orchestra.run.smithi160.stdout:(96/285): jansi-2.3.3-6.el9.x86_64.rpm 1.5 MB/s | 110 kB 00:00 2024-09-12T00:09:32.683 INFO:teuthology.orchestra.run.smithi160.stdout:(97/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 5.3 MB/s | 413 kB 00:00 2024-09-12T00:09:32.736 INFO:teuthology.orchestra.run.smithi133.stdout:(90/285): hicolor-icon-theme-0.17-13.el9.noarch 2.3 MB/s | 219 kB 00:00 2024-09-12T00:09:32.750 INFO:teuthology.orchestra.run.smithi160.stdout:(98/285): java-11-openjdk-devel-11.0.20.1.1-2.e 34 MB/s | 3.3 MB 00:00 2024-09-12T00:09:32.792 INFO:teuthology.orchestra.run.smithi160.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 314 kB/s | 13 kB 00:00 2024-09-12T00:09:32.834 INFO:teuthology.orchestra.run.smithi160.stdout:(100/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.2 MB/s | 53 kB 00:00 2024-09-12T00:09:32.876 INFO:teuthology.orchestra.run.smithi160.stdout:(101/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 578 kB/s | 24 kB 00:00 2024-09-12T00:09:32.885 INFO:teuthology.orchestra.run.smithi133.stdout:(91/285): httpcomponents-client-4.5.13-3.el9.no 4.3 MB/s | 657 kB 00:00 2024-09-12T00:09:32.918 INFO:teuthology.orchestra.run.smithi160.stdout:(102/285): jsoup-1.13.1-10.el9.noarch.rpm 8.9 MB/s | 377 kB 00:00 2024-09-12T00:09:32.960 INFO:teuthology.orchestra.run.smithi160.stdout:(103/285): jsr-305-3.0.2-6.el9.noarch.rpm 854 kB/s | 35 kB 00:00 2024-09-12T00:09:33.002 INFO:teuthology.orchestra.run.smithi160.stdout:(104/285): lcms2-2.12-3.el9.x86_64.rpm 4.0 MB/s | 168 kB 00:00 2024-09-12T00:09:33.036 INFO:teuthology.orchestra.run.smithi133.stdout:(92/285): gtk3-3.24.31-5.el9.x86_64.rpm 7.6 MB/s | 4.9 MB 00:00 2024-09-12T00:09:33.043 INFO:teuthology.orchestra.run.smithi160.stdout:(105/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 268 kB/s | 11 kB 00:00 2024-09-12T00:09:33.085 INFO:teuthology.orchestra.run.smithi160.stdout:(106/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 581 kB/s | 24 kB 00:00 2024-09-12T00:09:33.086 INFO:teuthology.orchestra.run.smithi133.stdout:(93/285): guava-30.1-6.el9.noarch.rpm 4.5 MB/s | 2.3 MB 00:00 2024-09-12T00:09:33.120 INFO:teuthology.orchestra.run.smithi133.stdout:(94/285): httpcomponents-core-4.4.13-7.el9.noar 2.6 MB/s | 632 kB 00:00 2024-09-12T00:09:33.127 INFO:teuthology.orchestra.run.smithi160.stdout:(107/285): libXcursor-1.2.0-7.el9.x86_64.rpm 737 kB/s | 31 kB 00:00 2024-09-12T00:09:33.153 INFO:teuthology.orchestra.run.smithi133.stdout:(95/285): jakarta-annotations-1.3.5-13.el9.noar 675 kB/s | 45 kB 00:00 2024-09-12T00:09:33.179 INFO:teuthology.orchestra.run.smithi133.stdout:(96/285): jansi-2.3.3-6.el9.x86_64.rpm 1.8 MB/s | 110 kB 00:00 2024-09-12T00:09:33.245 INFO:teuthology.orchestra.run.smithi133.stdout:(97/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 4.4 MB/s | 413 kB 00:00 2024-09-12T00:09:33.412 INFO:teuthology.orchestra.run.smithi133.stdout:(98/285): iso-codes-4.6.0-3.el9.noarch.rpm 9.4 MB/s | 3.5 MB 00:00 2024-09-12T00:09:33.464 INFO:teuthology.orchestra.run.smithi133.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 262 kB/s | 13 kB 00:00 2024-09-12T00:09:33.469 INFO:teuthology.orchestra.run.smithi160.stdout:(108/285): java-11-openjdk-headless-11.0.20.1.1 50 MB/s | 39 MB 00:00 2024-09-12T00:09:33.495 INFO:teuthology.orchestra.run.smithi160.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 62 kB/s | 23 kB 00:00 2024-09-12T00:09:33.513 INFO:teuthology.orchestra.run.smithi133.stdout:(100/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-12T00:09:33.520 INFO:teuthology.orchestra.run.smithi160.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 397 kB/s | 20 kB 00:00 2024-09-12T00:09:33.545 INFO:teuthology.orchestra.run.smithi160.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 790 kB/s | 40 kB 00:00 2024-09-12T00:09:33.563 INFO:teuthology.orchestra.run.smithi133.stdout:(101/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 482 kB/s | 24 kB 00:00 2024-09-12T00:09:33.570 INFO:teuthology.orchestra.run.smithi160.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 300 kB/s | 15 kB 00:00 2024-09-12T00:09:33.596 INFO:teuthology.orchestra.run.smithi160.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 568 kB/s | 28 kB 00:00 2024-09-12T00:09:33.621 INFO:teuthology.orchestra.run.smithi160.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 428 kB/s | 21 kB 00:00 2024-09-12T00:09:33.622 INFO:teuthology.orchestra.run.smithi133.stdout:(102/285): jsoup-1.13.1-10.el9.noarch.rpm 6.3 MB/s | 377 kB 00:00 2024-09-12T00:09:33.646 INFO:teuthology.orchestra.run.smithi160.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 381 kB/s | 19 kB 00:00 2024-09-12T00:09:33.663 INFO:teuthology.orchestra.run.smithi160.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 450 kB/s | 19 kB 00:00 2024-09-12T00:09:33.680 INFO:teuthology.orchestra.run.smithi160.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 912 kB/s | 30 kB 00:00 2024-09-12T00:09:33.705 INFO:teuthology.orchestra.run.smithi133.stdout:(103/285): java-11-openjdk-devel-11.0.20.1.1-2. 6.3 MB/s | 3.3 MB 00:00 2024-09-12T00:09:33.706 INFO:teuthology.orchestra.run.smithi160.stdout:(118/285): libcanberra-0.30-27.el9.x86_64.rpm 2.0 MB/s | 86 kB 00:00 2024-09-12T00:09:33.722 INFO:teuthology.orchestra.run.smithi160.stdout:(119/285): libcanberra-gtk3-0.30-27.el9.x86_64. 762 kB/s | 32 kB 00:00 2024-09-12T00:09:33.730 INFO:teuthology.orchestra.run.smithi133.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 327 kB/s | 35 kB 00:00 2024-09-12T00:09:33.748 INFO:teuthology.orchestra.run.smithi160.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 3.8 MB/s | 161 kB 00:00 2024-09-12T00:09:33.756 INFO:teuthology.orchestra.run.smithi133.stdout:(105/285): lcms2-2.12-3.el9.x86_64.rpm 3.3 MB/s | 168 kB 00:00 2024-09-12T00:09:33.773 INFO:teuthology.orchestra.run.smithi160.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-09-12T00:09:33.781 INFO:teuthology.orchestra.run.smithi133.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 221 kB/s | 11 kB 00:00 2024-09-12T00:09:33.798 INFO:teuthology.orchestra.run.smithi160.stdout:(122/285): libexif-0.6.22-6.el9.x86_64.rpm 8.5 MB/s | 435 kB 00:00 2024-09-12T00:09:33.806 INFO:teuthology.orchestra.run.smithi133.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 482 kB/s | 24 kB 00:00 2024-09-12T00:09:33.823 INFO:teuthology.orchestra.run.smithi160.stdout:(123/285): libfontenc-1.1.3-17.el9.x86_64.rpm 620 kB/s | 31 kB 00:00 2024-09-12T00:09:33.831 INFO:teuthology.orchestra.run.smithi133.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 611 kB/s | 31 kB 00:00 2024-09-12T00:09:33.849 INFO:teuthology.orchestra.run.smithi160.stdout:(124/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-09-12T00:09:33.857 INFO:teuthology.orchestra.run.smithi133.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 454 kB/s | 23 kB 00:00 2024-09-12T00:09:33.874 INFO:teuthology.orchestra.run.smithi160.stdout:(125/285): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-09-12T00:09:33.882 INFO:teuthology.orchestra.run.smithi133.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 394 kB/s | 20 kB 00:00 2024-09-12T00:09:33.899 INFO:teuthology.orchestra.run.smithi160.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 732 kB/s | 37 kB 00:00 2024-09-12T00:09:33.907 INFO:teuthology.orchestra.run.smithi133.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 788 kB/s | 40 kB 00:00 2024-09-12T00:09:33.933 INFO:teuthology.orchestra.run.smithi133.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 300 kB/s | 15 kB 00:00 2024-09-12T00:09:33.933 INFO:teuthology.orchestra.run.smithi160.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.4 MB/s | 142 kB 00:00 2024-09-12T00:09:33.958 INFO:teuthology.orchestra.run.smithi133.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 566 kB/s | 28 kB 00:00 2024-09-12T00:09:33.958 INFO:teuthology.orchestra.run.smithi160.stdout:(128/285): libgsf-1.14.47-5.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-09-12T00:09:33.975 INFO:teuthology.orchestra.run.smithi160.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2024-09-12T00:09:33.983 INFO:teuthology.orchestra.run.smithi133.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 428 kB/s | 21 kB 00:00 2024-09-12T00:09:34.001 INFO:teuthology.orchestra.run.smithi160.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.4 MB/s | 61 kB 00:00 2024-09-12T00:09:34.008 INFO:teuthology.orchestra.run.smithi133.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 380 kB/s | 19 kB 00:00 2024-09-12T00:09:34.026 INFO:teuthology.orchestra.run.smithi160.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 822 kB/s | 41 kB 00:00 2024-09-12T00:09:34.033 INFO:teuthology.orchestra.run.smithi133.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 374 kB/s | 19 kB 00:00 2024-09-12T00:09:34.051 INFO:teuthology.orchestra.run.smithi160.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 872 kB/s | 44 kB 00:00 2024-09-12T00:09:34.059 INFO:teuthology.orchestra.run.smithi133.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 608 kB/s | 30 kB 00:00 2024-09-12T00:09:34.076 INFO:teuthology.orchestra.run.smithi133.stdout:(118/285): libcanberra-0.30-27.el9.x86_64.rpm 2.0 MB/s | 86 kB 00:00 2024-09-12T00:09:34.076 INFO:teuthology.orchestra.run.smithi160.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 669 kB/s | 34 kB 00:00 2024-09-12T00:09:34.102 INFO:teuthology.orchestra.run.smithi160.stdout:(134/285): libosinfo-1.10.0-1.el9.x86_64.rpm 6.2 MB/s | 319 kB 00:00 2024-09-12T00:09:34.118 INFO:teuthology.orchestra.run.smithi133.stdout:(119/285): libcanberra-gtk3-0.30-27.el9.x86_64. 539 kB/s | 32 kB 00:00 2024-09-12T00:09:34.127 INFO:teuthology.orchestra.run.smithi160.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-12T00:09:34.144 INFO:teuthology.orchestra.run.smithi133.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 2.3 MB/s | 161 kB 00:00 2024-09-12T00:09:34.152 INFO:teuthology.orchestra.run.smithi160.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-12T00:09:34.177 INFO:teuthology.orchestra.run.smithi133.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-09-12T00:09:34.194 INFO:teuthology.orchestra.run.smithi160.stdout:(137/285): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-12T00:09:34.219 INFO:teuthology.orchestra.run.smithi160.stdout:(138/285): libsbc-1.4-9.el9.x86_64.rpm 671 kB/s | 45 kB 00:00 2024-09-12T00:09:34.227 INFO:teuthology.orchestra.run.smithi133.stdout:(122/285): libexif-0.6.22-6.el9.x86_64.rpm 5.1 MB/s | 435 kB 00:00 2024-09-12T00:09:34.245 INFO:teuthology.orchestra.run.smithi160.stdout:(139/285): libsndfile-1.0.31-8.el9.x86_64.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T00:09:34.252 INFO:teuthology.orchestra.run.smithi133.stdout:(123/285): libfontenc-1.1.3-17.el9.x86_64.rpm 412 kB/s | 31 kB 00:00 2024-09-12T00:09:34.270 INFO:teuthology.orchestra.run.smithi160.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 3.2 MB/s | 164 kB 00:00 2024-09-12T00:09:34.278 INFO:teuthology.orchestra.run.smithi133.stdout:(124/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-09-12T00:09:34.295 INFO:teuthology.orchestra.run.smithi160.stdout:(141/285): libtiff-4.4.0-13.el9.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2024-09-12T00:09:34.303 INFO:teuthology.orchestra.run.smithi133.stdout:(125/285): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-09-12T00:09:34.321 INFO:teuthology.orchestra.run.smithi160.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 711 kB/s | 36 kB 00:00 2024-09-12T00:09:34.328 INFO:teuthology.orchestra.run.smithi133.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 729 kB/s | 37 kB 00:00 2024-09-12T00:09:34.346 INFO:teuthology.orchestra.run.smithi160.stdout:(143/285): libtracker-sparql-3.1.2-3.el9.x86_64 6.3 MB/s | 324 kB 00:00 2024-09-12T00:09:34.362 INFO:teuthology.orchestra.run.smithi133.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.4 MB/s | 142 kB 00:00 2024-09-12T00:09:34.371 INFO:teuthology.orchestra.run.smithi160.stdout:(144/285): libvisual-0.4.0-34.el9.x86_64.rpm 2.8 MB/s | 144 kB 00:00 2024-09-12T00:09:34.388 INFO:teuthology.orchestra.run.smithi133.stdout:(128/285): libgsf-1.14.47-5.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-09-12T00:09:34.397 INFO:teuthology.orchestra.run.smithi160.stdout:(145/285): libvorbis-1.3.7-5.el9.x86_64.rpm 3.8 MB/s | 193 kB 00:00 2024-09-12T00:09:34.413 INFO:teuthology.orchestra.run.smithi133.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-09-12T00:09:34.422 INFO:teuthology.orchestra.run.smithi160.stdout:(146/285): libwayland-client-1.21.0-1.el9.x86_6 666 kB/s | 33 kB 00:00 2024-09-12T00:09:34.446 INFO:teuthology.orchestra.run.smithi133.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.0 MB/s | 61 kB 00:00 2024-09-12T00:09:34.447 INFO:teuthology.orchestra.run.smithi160.stdout:(147/285): libwayland-cursor-1.21.0-1.el9.x86_6 386 kB/s | 19 kB 00:00 2024-09-12T00:09:34.471 INFO:teuthology.orchestra.run.smithi133.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 707 kB/s | 41 kB 00:00 2024-09-12T00:09:34.472 INFO:teuthology.orchestra.run.smithi160.stdout:(148/285): libwayland-egl-1.21.0-1.el9.x86_64.r 257 kB/s | 13 kB 00:00 2024-09-12T00:09:34.497 INFO:teuthology.orchestra.run.smithi133.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 871 kB/s | 44 kB 00:00 2024-09-12T00:09:34.497 INFO:teuthology.orchestra.run.smithi160.stdout:(149/285): libwayland-server-1.21.0-1.el9.x86_6 834 kB/s | 42 kB 00:00 2024-09-12T00:09:34.522 INFO:teuthology.orchestra.run.smithi133.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 667 kB/s | 34 kB 00:00 2024-09-12T00:09:34.523 INFO:teuthology.orchestra.run.smithi160.stdout:(150/285): libwebp-1.2.0-8.el9.x86_64.rpm 5.4 MB/s | 277 kB 00:00 2024-09-12T00:09:34.548 INFO:teuthology.orchestra.run.smithi160.stdout:(151/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.6 MB/s | 133 kB 00:00 2024-09-12T00:09:34.556 INFO:teuthology.orchestra.run.smithi133.stdout:(134/285): libosinfo-1.10.0-1.el9.x86_64.rpm 5.3 MB/s | 319 kB 00:00 2024-09-12T00:09:34.573 INFO:teuthology.orchestra.run.smithi160.stdout:(152/285): libxshmfence-1.3-10.el9.x86_64.rpm 252 kB/s | 13 kB 00:00 2024-09-12T00:09:34.581 INFO:teuthology.orchestra.run.smithi133.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-12T00:09:34.599 INFO:teuthology.orchestra.run.smithi160.stdout:(153/285): low-memory-monitor-2.1-4.el9.x86_64. 714 kB/s | 36 kB 00:00 2024-09-12T00:09:34.606 INFO:teuthology.orchestra.run.smithi133.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-09-12T00:09:34.632 INFO:teuthology.orchestra.run.smithi160.stdout:(154/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-12T00:09:34.656 INFO:teuthology.orchestra.run.smithi133.stdout:(137/285): libsbc-1.4-9.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-12T00:09:34.657 INFO:teuthology.orchestra.run.smithi160.stdout:(155/285): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-12T00:09:34.682 INFO:teuthology.orchestra.run.smithi133.stdout:(138/285): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-12T00:09:34.691 INFO:teuthology.orchestra.run.smithi160.stdout:(156/285): lua-posix-35.0-8.el9.x86_64.rpm 2.5 MB/s | 151 kB 00:00 2024-09-12T00:09:34.709 INFO:teuthology.orchestra.run.smithi160.stdout:(157/285): maven-3.6.3-15.el9.noarch.rpm 351 kB/s | 18 kB 00:00 2024-09-12T00:09:34.715 INFO:teuthology.orchestra.run.smithi133.stdout:(139/285): libsndfile-1.0.31-8.el9.x86_64.rpm 3.5 MB/s | 206 kB 00:00 2024-09-12T00:09:34.741 INFO:teuthology.orchestra.run.smithi133.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-12T00:09:34.759 INFO:teuthology.orchestra.run.smithi160.stdout:(158/285): maven-lib-3.6.3-15.el9.noarch.rpm 22 MB/s | 1.5 MB 00:00 2024-09-12T00:09:34.774 INFO:teuthology.orchestra.run.smithi133.stdout:(141/285): libtiff-4.4.0-13.el9.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2024-09-12T00:09:34.784 INFO:teuthology.orchestra.run.smithi160.stdout:(159/285): maven-openjdk11-3.6.3-15.el9.noarch. 120 kB/s | 9.0 kB 00:00 2024-09-12T00:09:34.800 INFO:teuthology.orchestra.run.smithi133.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 608 kB/s | 36 kB 00:00 2024-09-12T00:09:34.833 INFO:teuthology.orchestra.run.smithi133.stdout:(143/285): libtracker-sparql-3.1.2-3.el9.x86_64 5.4 MB/s | 324 kB 00:00 2024-09-12T00:09:34.842 INFO:teuthology.orchestra.run.smithi160.stdout:(160/285): maven-resolver-1.6.1-10.el9.noarch.r 6.1 MB/s | 517 kB 00:00 2024-09-12T00:09:34.858 INFO:teuthology.orchestra.run.smithi133.stdout:(144/285): libvisual-0.4.0-34.el9.x86_64.rpm 2.4 MB/s | 144 kB 00:00 2024-09-12T00:09:34.892 INFO:teuthology.orchestra.run.smithi133.stdout:(145/285): libvorbis-1.3.7-5.el9.x86_64.rpm 3.2 MB/s | 193 kB 00:00 2024-09-12T00:09:34.917 INFO:teuthology.orchestra.run.smithi133.stdout:(146/285): libwayland-client-1.21.0-1.el9.x86_6 569 kB/s | 33 kB 00:00 2024-09-12T00:09:34.943 INFO:teuthology.orchestra.run.smithi133.stdout:(147/285): libwayland-cursor-1.21.0-1.el9.x86_6 388 kB/s | 19 kB 00:00 2024-09-12T00:09:34.968 INFO:teuthology.orchestra.run.smithi133.stdout:(148/285): libwayland-egl-1.21.0-1.el9.x86_64.r 257 kB/s | 13 kB 00:00 2024-09-12T00:09:34.993 INFO:teuthology.orchestra.run.smithi133.stdout:(149/285): libwayland-server-1.21.0-1.el9.x86_6 828 kB/s | 42 kB 00:00 2024-09-12T00:09:35.010 INFO:teuthology.orchestra.run.smithi160.stdout:(161/285): maven-shared-utils-3.3.4-3.el9.noarc 669 kB/s | 151 kB 00:00 2024-09-12T00:09:35.027 INFO:teuthology.orchestra.run.smithi133.stdout:(150/285): libwebp-1.2.0-8.el9.x86_64.rpm 4.6 MB/s | 277 kB 00:00 2024-09-12T00:09:35.043 INFO:teuthology.orchestra.run.smithi160.stdout:(162/285): maven-wagon-3.4.2-7.el9.noarch.rpm 561 kB/s | 112 kB 00:00 2024-09-12T00:09:35.052 INFO:teuthology.orchestra.run.smithi133.stdout:(151/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.2 MB/s | 133 kB 00:00 2024-09-12T00:09:35.078 INFO:teuthology.orchestra.run.smithi133.stdout:(152/285): libxshmfence-1.3-10.el9.x86_64.rpm 251 kB/s | 13 kB 00:00 2024-09-12T00:09:35.085 INFO:teuthology.orchestra.run.smithi160.stdout:(163/285): mesa-filesystem-24.1.2-3.el9.x86_64. 272 kB/s | 11 kB 00:00 2024-09-12T00:09:35.111 INFO:teuthology.orchestra.run.smithi133.stdout:(153/285): low-memory-monitor-2.1-4.el9.x86_64. 614 kB/s | 36 kB 00:00 2024-09-12T00:09:35.127 INFO:teuthology.orchestra.run.smithi160.stdout:(164/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 3.3 MB/s | 139 kB 00:00 2024-09-12T00:09:35.136 INFO:teuthology.orchestra.run.smithi133.stdout:(154/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-12T00:09:35.170 INFO:teuthology.orchestra.run.smithi133.stdout:(155/285): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-12T00:09:35.204 INFO:teuthology.orchestra.run.smithi133.stdout:(156/285): lua-posix-35.0-8.el9.x86_64.rpm 2.2 MB/s | 151 kB 00:00 2024-09-12T00:09:35.227 INFO:teuthology.orchestra.run.smithi160.stdout:(165/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 41 MB/s | 8.8 MB 00:00 2024-09-12T00:09:35.228 INFO:teuthology.orchestra.run.smithi133.stdout:(157/285): maven-3.6.3-15.el9.noarch.rpm 303 kB/s | 18 kB 00:00 2024-09-12T00:09:35.253 INFO:teuthology.orchestra.run.smithi160.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.3 MB/s | 171 kB 00:00 2024-09-12T00:09:35.278 INFO:teuthology.orchestra.run.smithi160.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 726 kB/s | 36 kB 00:00 2024-09-12T00:09:35.279 INFO:teuthology.orchestra.run.smithi133.stdout:(158/285): maven-openjdk11-3.6.3-15.el9.noarch. 180 kB/s | 9.0 kB 00:00 2024-09-12T00:09:35.303 INFO:teuthology.orchestra.run.smithi160.stdout:(168/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 915 kB/s | 46 kB 00:00 2024-09-12T00:09:35.328 INFO:teuthology.orchestra.run.smithi160.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 642 kB/s | 32 kB 00:00 2024-09-12T00:09:35.353 INFO:teuthology.orchestra.run.smithi160.stdout:(170/285): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-12T00:09:35.371 INFO:teuthology.orchestra.run.smithi133.stdout:(159/285): maven-lib-3.6.3-15.el9.noarch.rpm 8.9 MB/s | 1.5 MB 00:00 2024-09-12T00:09:35.396 INFO:teuthology.orchestra.run.smithi160.stdout:(171/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 3.8 MB/s | 163 kB 00:00 2024-09-12T00:09:35.396 INFO:teuthology.orchestra.run.smithi133.stdout:(160/285): maven-resolver-1.6.1-10.el9.noarch.r 4.3 MB/s | 517 kB 00:00 2024-09-12T00:09:35.455 INFO:teuthology.orchestra.run.smithi133.stdout:(161/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.9 MB/s | 112 kB 00:00 2024-09-12T00:09:35.471 INFO:teuthology.orchestra.run.smithi160.stdout:(172/285): openblas-openmp-0.3.26-2.el9.x86_64. 35 MB/s | 4.9 MB 00:00 2024-09-12T00:09:35.496 INFO:teuthology.orchestra.run.smithi160.stdout:(173/285): opus-1.3.1-10.el9.x86_64.rpm 2.0 MB/s | 200 kB 00:00 2024-09-12T00:09:35.521 INFO:teuthology.orchestra.run.smithi160.stdout:(174/285): orc-0.4.31-8.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-09-12T00:09:35.547 INFO:teuthology.orchestra.run.smithi160.stdout:(175/285): osinfo-db-20240701-2.el9.noarch.rpm 10 MB/s | 531 kB 00:00 2024-09-12T00:09:35.572 INFO:teuthology.orchestra.run.smithi160.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.4 MB/s | 74 kB 00:00 2024-09-12T00:09:35.588 INFO:teuthology.orchestra.run.smithi133.stdout:(162/285): maven-shared-utils-3.3.4-3.el9.noarc 696 kB/s | 151 kB 00:00 2024-09-12T00:09:35.597 INFO:teuthology.orchestra.run.smithi160.stdout:(177/285): ostree-libs-2024.7-2.el9.x86_64.rpm 9.2 MB/s | 468 kB 00:00 2024-09-12T00:09:35.622 INFO:teuthology.orchestra.run.smithi160.stdout:(178/285): p11-kit-server-0.25.3-2.el9.x86_64.r 4.8 MB/s | 246 kB 00:00 2024-09-12T00:09:35.647 INFO:teuthology.orchestra.run.smithi133.stdout:(163/285): mesa-filesystem-24.1.2-3.el9.x86_64. 193 kB/s | 11 kB 00:00 2024-09-12T00:09:35.648 INFO:teuthology.orchestra.run.smithi160.stdout:(179/285): pipewire-1.0.1-1.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-09-12T00:09:35.673 INFO:teuthology.orchestra.run.smithi160.stdout:(180/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 57 kB 00:00 2024-09-12T00:09:35.698 INFO:teuthology.orchestra.run.smithi160.stdout:(181/285): pipewire-jack-audio-connection-kit-1 182 kB/s | 9.1 kB 00:00 2024-09-12T00:09:35.706 INFO:teuthology.orchestra.run.smithi133.stdout:(164/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.3 MB/s | 139 kB 00:00 2024-09-12T00:09:35.732 INFO:teuthology.orchestra.run.smithi160.stdout:(182/285): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 135 kB 00:00 2024-09-12T00:09:35.764 INFO:teuthology.orchestra.run.smithi133.stdout:(165/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-09-12T00:09:35.774 INFO:teuthology.orchestra.run.smithi160.stdout:(183/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 26 MB/s | 1.9 MB 00:00 2024-09-12T00:09:35.800 INFO:teuthology.orchestra.run.smithi160.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.5 MB/s | 192 kB 00:00 2024-09-12T00:09:35.814 INFO:teuthology.orchestra.run.smithi133.stdout:(166/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 728 kB/s | 36 kB 00:00 2024-09-12T00:09:35.824 INFO:teuthology.orchestra.run.smithi160.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-09-12T00:09:35.849 INFO:teuthology.orchestra.run.smithi160.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-12T00:09:35.865 INFO:teuthology.orchestra.run.smithi133.stdout:(167/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 921 kB/s | 46 kB 00:00 2024-09-12T00:09:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:(187/285): plexus-containers-component-annotati 367 kB/s | 18 kB 00:00 2024-09-12T00:09:35.900 INFO:teuthology.orchestra.run.smithi160.stdout:(188/285): plexus-interpolation-1.26-11.el9.noa 1.6 MB/s | 80 kB 00:00 2024-09-12T00:09:35.915 INFO:teuthology.orchestra.run.smithi133.stdout:(168/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 644 kB/s | 32 kB 00:00 2024-09-12T00:09:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:(189/285): plexus-sec-dispatcher-1.4-37.el9.noa 671 kB/s | 34 kB 00:00 2024-09-12T00:09:35.959 INFO:teuthology.orchestra.run.smithi160.stdout:(190/285): plexus-utils-3.3.0-10.el9.noarch.rpm 4.2 MB/s | 254 kB 00:00 2024-09-12T00:09:35.965 INFO:teuthology.orchestra.run.smithi133.stdout:(169/285): openblas-0.3.26-2.el9.x86_64.rpm 772 kB/s | 38 kB 00:00 2024-09-12T00:09:36.001 INFO:teuthology.orchestra.run.smithi160.stdout:(191/285): poppler-21.01.0-21.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2024-09-12T00:09:36.052 INFO:teuthology.orchestra.run.smithi160.stdout:(192/285): poppler-data-0.4.9-9.el9.noarch.rpm 20 MB/s | 1.9 MB 00:00 2024-09-12T00:09:36.077 INFO:teuthology.orchestra.run.smithi160.stdout:(193/285): poppler-glib-21.01.0-21.el9.x86_64.r 2.0 MB/s | 152 kB 00:00 2024-09-12T00:09:36.107 INFO:teuthology.orchestra.run.smithi133.stdout:(170/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 13 MB/s | 8.8 MB 00:00 2024-09-12T00:09:36.119 INFO:teuthology.orchestra.run.smithi160.stdout:(194/285): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-12T00:09:36.144 INFO:teuthology.orchestra.run.smithi160.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 1.2 MB/s | 83 kB 00:00 2024-09-12T00:09:36.166 INFO:teuthology.orchestra.run.smithi133.stdout:(171/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.8 MB/s | 163 kB 00:00 2024-09-12T00:09:36.186 INFO:teuthology.orchestra.run.smithi160.stdout:(196/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 9.9 MB/s | 679 kB 00:00 2024-09-12T00:09:36.224 INFO:teuthology.orchestra.run.smithi133.stdout:(172/285): opus-1.3.1-10.el9.x86_64.rpm 3.4 MB/s | 200 kB 00:00 2024-09-12T00:09:36.227 INFO:teuthology.orchestra.run.smithi160.stdout:(197/285): python3-devel-3.9.19-8.el9.x86_64.rp 5.8 MB/s | 245 kB 00:00 2024-09-12T00:09:36.275 INFO:teuthology.orchestra.run.smithi133.stdout:(173/285): orc-0.4.31-8.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-09-12T00:09:36.303 INFO:teuthology.orchestra.run.smithi160.stdout:(198/285): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 6.0 MB 00:00 2024-09-12T00:09:36.328 INFO:teuthology.orchestra.run.smithi160.stdout:(199/285): python3-jinja2-2.11.3-6.el9.noarch.r 2.4 MB/s | 248 kB 00:00 2024-09-12T00:09:36.333 INFO:teuthology.orchestra.run.smithi133.stdout:(174/285): osinfo-db-20240701-2.el9.noarch.rpm 8.9 MB/s | 531 kB 00:00 2024-09-12T00:09:36.345 INFO:teuthology.orchestra.run.smithi160.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 616 kB/s | 26 kB 00:00 2024-09-12T00:09:36.362 INFO:teuthology.orchestra.run.smithi160.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 574 kB/s | 19 kB 00:00 2024-09-12T00:09:36.388 INFO:teuthology.orchestra.run.smithi160.stdout:(202/285): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-12T00:09:36.400 INFO:teuthology.orchestra.run.smithi133.stdout:(175/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.1 MB/s | 74 kB 00:00 2024-09-12T00:09:36.413 INFO:teuthology.orchestra.run.smithi160.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 694 kB/s | 35 kB 00:00 2024-09-12T00:09:36.455 INFO:teuthology.orchestra.run.smithi160.stdout:(204/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 5.9 MB/s | 250 kB 00:00 2024-09-12T00:09:36.476 INFO:teuthology.orchestra.run.smithi133.stdout:(176/285): ostree-libs-2024.7-2.el9.x86_64.rpm 6.1 MB/s | 468 kB 00:00 2024-09-12T00:09:36.534 INFO:teuthology.orchestra.run.smithi133.stdout:(177/285): p11-kit-server-0.25.3-2.el9.x86_64.r 4.1 MB/s | 246 kB 00:00 2024-09-12T00:09:36.626 INFO:teuthology.orchestra.run.smithi133.stdout:(178/285): openblas-openmp-0.3.26-2.el9.x86_64. 7.5 MB/s | 4.9 MB 00:00 2024-09-12T00:09:36.651 INFO:teuthology.orchestra.run.smithi133.stdout:(179/285): pipewire-1.0.1-1.el9.x86_64.rpm 911 kB/s | 107 kB 00:00 2024-09-12T00:09:36.677 INFO:teuthology.orchestra.run.smithi133.stdout:(180/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 57 kB 00:00 2024-09-12T00:09:36.702 INFO:teuthology.orchestra.run.smithi133.stdout:(181/285): pipewire-jack-audio-connection-kit-1 182 kB/s | 9.1 kB 00:00 2024-09-12T00:09:36.727 INFO:teuthology.orchestra.run.smithi133.stdout:(182/285): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 135 kB 00:00 2024-09-12T00:09:36.777 INFO:teuthology.orchestra.run.smithi133.stdout:(183/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.8 MB/s | 192 kB 00:00 2024-09-12T00:09:36.853 INFO:teuthology.orchestra.run.smithi133.stdout:(184/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 13 MB/s | 1.9 MB 00:00 2024-09-12T00:09:36.872 INFO:teuthology.orchestra.run.smithi160.stdout:(205/285): ceph-test-19.3.0-4753.gd011c522.el9. 5.5 MB/s | 50 MB 00:09 2024-09-12T00:09:36.878 INFO:teuthology.orchestra.run.smithi133.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 257 kB/s | 26 kB 00:00 2024-09-12T00:09:36.897 INFO:teuthology.orchestra.run.smithi160.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 503 kB/s | 222 kB 00:00 2024-09-12T00:09:36.911 INFO:teuthology.orchestra.run.smithi133.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 1.0 MB/s | 60 kB 00:00 2024-09-12T00:09:36.937 INFO:teuthology.orchestra.run.smithi133.stdout:(187/285): plexus-containers-component-annotati 313 kB/s | 18 kB 00:00 2024-09-12T00:09:36.964 INFO:teuthology.orchestra.run.smithi160.stdout:(207/285): python3-numpy-1.20.1-5.el9.x86_64.rp 8.8 MB/s | 5.1 MB 00:00 2024-09-12T00:09:36.989 INFO:teuthology.orchestra.run.smithi160.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 459 kB/s | 42 kB 00:00 2024-09-12T00:09:36.990 INFO:teuthology.orchestra.run.smithi133.stdout:(188/285): plexus-interpolation-1.26-11.el9.noa 1.0 MB/s | 80 kB 00:00 2024-09-12T00:09:37.014 INFO:teuthology.orchestra.run.smithi160.stdout:(209/285): python3-packaging-20.9-5.el9.noarch. 543 kB/s | 77 kB 00:00 2024-09-12T00:09:37.021 INFO:teuthology.orchestra.run.smithi133.stdout:(189/285): plexus-sec-dispatcher-1.4-37.el9.noa 403 kB/s | 34 kB 00:00 2024-09-12T00:09:37.040 INFO:teuthology.orchestra.run.smithi160.stdout:(210/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 3.1 MB/s | 159 kB 00:00 2024-09-12T00:09:37.046 INFO:teuthology.orchestra.run.smithi133.stdout:(190/285): plexus-utils-3.3.0-10.el9.noarch.rpm 4.5 MB/s | 254 kB 00:00 2024-09-12T00:09:37.065 INFO:teuthology.orchestra.run.smithi160.stdout:(211/285): python3-protobuf-3.14.0-13.el9.noarc 2.6 MB/s | 269 kB 00:00 2024-09-12T00:09:37.090 INFO:teuthology.orchestra.run.smithi160.stdout:(212/285): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T00:09:37.115 INFO:teuthology.orchestra.run.smithi160.stdout:(213/285): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-09-12T00:09:37.130 INFO:teuthology.orchestra.run.smithi133.stdout:(191/285): poppler-21.01.0-21.el9.x86_64.rpm 9.8 MB/s | 1.1 MB 00:00 2024-09-12T00:09:37.141 INFO:teuthology.orchestra.run.smithi160.stdout:(214/285): python3-pyasn1-modules-0.4.8-6.el9.n 2.2 MB/s | 279 kB 00:00 2024-09-12T00:09:37.166 INFO:teuthology.orchestra.run.smithi160.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-12T00:09:37.191 INFO:teuthology.orchestra.run.smithi160.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T00:09:37.197 INFO:teuthology.orchestra.run.smithi133.stdout:(192/285): poppler-glib-21.01.0-21.el9.x86_64.r 2.2 MB/s | 152 kB 00:00 2024-09-12T00:09:37.217 INFO:teuthology.orchestra.run.smithi160.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 715 kB/s | 36 kB 00:00 2024-09-12T00:09:37.242 INFO:teuthology.orchestra.run.smithi160.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-12T00:09:37.267 INFO:teuthology.orchestra.run.smithi160.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-12T00:09:37.292 INFO:teuthology.orchestra.run.smithi160.stdout:(220/285): sisu-0.3.4-10.el9.noarch.rpm 10 MB/s | 510 kB 00:00 2024-09-12T00:09:37.313 INFO:teuthology.orchestra.run.smithi133.stdout:(193/285): protobuf-3.14.0-13.el9.x86_64.rpm 8.7 MB/s | 1.0 MB 00:00 2024-09-12T00:09:37.317 INFO:teuthology.orchestra.run.smithi160.stdout:(221/285): slf4j-1.7.30-13.el9.noarch.rpm 1.3 MB/s | 69 kB 00:00 2024-09-12T00:09:37.343 INFO:teuthology.orchestra.run.smithi160.stdout:(222/285): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T00:09:37.356 INFO:teuthology.orchestra.run.smithi133.stdout:(194/285): poppler-data-0.4.9-9.el9.noarch.rpm 6.1 MB/s | 1.9 MB 00:00 2024-09-12T00:09:37.368 INFO:teuthology.orchestra.run.smithi160.stdout:(223/285): sound-theme-freedesktop-0.8-17.el9.n 7.4 MB/s | 383 kB 00:00 2024-09-12T00:09:37.381 INFO:teuthology.orchestra.run.smithi133.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 1.2 MB/s | 83 kB 00:00 2024-09-12T00:09:37.393 INFO:teuthology.orchestra.run.smithi160.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 3.0 MB/s | 152 kB 00:00 2024-09-12T00:09:37.427 INFO:teuthology.orchestra.run.smithi160.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 9.3 MB/s | 555 kB 00:00 2024-09-12T00:09:37.448 INFO:teuthology.orchestra.run.smithi133.stdout:(196/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 7.2 MB/s | 679 kB 00:00 2024-09-12T00:09:37.469 INFO:teuthology.orchestra.run.smithi160.stdout:(226/285): tracker-miners-3.1.2-4.el9.x86_64.rp 12 MB/s | 944 kB 00:00 2024-09-12T00:09:37.494 INFO:teuthology.orchestra.run.smithi160.stdout:(227/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 795 kB/s | 53 kB 00:00 2024-09-12T00:09:37.506 INFO:teuthology.orchestra.run.smithi133.stdout:(197/285): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-12T00:09:37.520 INFO:teuthology.orchestra.run.smithi160.stdout:(228/285): tzdata-java-2024a-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-12T00:09:37.546 INFO:teuthology.orchestra.run.smithi160.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 3.4 MB/s | 173 kB 00:00 2024-09-12T00:09:37.565 INFO:teuthology.orchestra.run.smithi133.stdout:(198/285): python3-jinja2-2.11.3-6.el9.noarch.r 4.2 MB/s | 248 kB 00:00 2024-09-12T00:09:37.570 INFO:teuthology.orchestra.run.smithi160.stdout:(230/285): webrtc-audio-processing-0.3.1-8.el9. 6.0 MB/s | 306 kB 00:00 2024-09-12T00:09:37.595 INFO:teuthology.orchestra.run.smithi160.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-12T00:09:37.621 INFO:teuthology.orchestra.run.smithi160.stdout:(232/285): wireplumber-libs-0.4.14-1.el9.x86_64 7.0 MB/s | 358 kB 00:00 2024-09-12T00:09:37.623 INFO:teuthology.orchestra.run.smithi133.stdout:(199/285): python3-jsonpatch-1.21-16.el9.noarch 439 kB/s | 26 kB 00:00 2024-09-12T00:09:37.646 INFO:teuthology.orchestra.run.smithi160.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 844 kB/s | 42 kB 00:00 2024-09-12T00:09:37.671 INFO:teuthology.orchestra.run.smithi160.stdout:(234/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 7.5 MB/s | 385 kB 00:00 2024-09-12T00:09:37.674 INFO:teuthology.orchestra.run.smithi133.stdout:(200/285): python3-jsonpointer-2.0-4.el9.noarch 382 kB/s | 19 kB 00:00 2024-09-12T00:09:37.696 INFO:teuthology.orchestra.run.smithi160.stdout:(235/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.6 MB/s | 134 kB 00:00 2024-09-12T00:09:37.730 INFO:teuthology.orchestra.run.smithi160.stdout:(236/285): xkeyboard-config-2.33-2.el9.noarch.r 14 MB/s | 859 kB 00:00 2024-09-12T00:09:37.732 INFO:teuthology.orchestra.run.smithi133.stdout:(201/285): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-12T00:09:37.747 INFO:teuthology.orchestra.run.smithi160.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T00:09:37.789 INFO:teuthology.orchestra.run.smithi160.stdout:(238/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 8.4 MB/s | 505 kB 00:00 2024-09-12T00:09:37.791 INFO:teuthology.orchestra.run.smithi133.stdout:(202/285): python3-markupsafe-1.1.1-12.el9.x86_ 597 kB/s | 35 kB 00:00 2024-09-12T00:09:37.839 INFO:teuthology.orchestra.run.smithi160.stdout:(239/285): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-12T00:09:37.900 INFO:teuthology.orchestra.run.smithi133.stdout:(203/285): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-09-12T00:09:37.958 INFO:teuthology.orchestra.run.smithi133.stdout:(204/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.2 MB/s | 250 kB 00:00 2024-09-12T00:09:38.017 INFO:teuthology.orchestra.run.smithi133.stdout:(205/285): python3-oauthlib-3.1.1-5.el9.noarch. 3.7 MB/s | 222 kB 00:00 2024-09-12T00:09:38.031 INFO:teuthology.orchestra.run.smithi160.stdout:(240/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-12T00:09:38.073 INFO:teuthology.orchestra.run.smithi160.stdout:(241/285): abseil-cpp-20211102.0-3.el9.x86_64.r 2.3 MB/s | 548 kB 00:00 2024-09-12T00:09:38.098 INFO:teuthology.orchestra.run.smithi160.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 839 kB/s | 19 kB 00:00 2024-09-12T00:09:38.140 INFO:teuthology.orchestra.run.smithi160.stdout:(243/285): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-09-12T00:09:38.166 INFO:teuthology.orchestra.run.smithi160.stdout:(244/285): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-12T00:09:38.199 INFO:teuthology.orchestra.run.smithi160.stdout:(245/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-09-12T00:09:38.224 INFO:teuthology.orchestra.run.smithi160.stdout:(246/285): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-09-12T00:09:38.250 INFO:teuthology.orchestra.run.smithi160.stdout:(247/285): liboath-2.6.7-2.el9.x86_64.rpm 581 kB/s | 49 kB 00:00 2024-09-12T00:09:38.275 INFO:teuthology.orchestra.run.smithi160.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-12T00:09:38.317 INFO:teuthology.orchestra.run.smithi160.stdout:(249/285): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-12T00:09:38.342 INFO:teuthology.orchestra.run.smithi160.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T00:09:38.351 INFO:teuthology.orchestra.run.smithi133.stdout:(206/285): java-11-openjdk-headless-11.0.20.1.1 7.7 MB/s | 39 MB 00:05 2024-09-12T00:09:38.367 INFO:teuthology.orchestra.run.smithi160.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T00:09:38.368 INFO:teuthology.orchestra.run.smithi133.stdout:(207/285): python3-packaging-20.9-5.el9.noarch. 220 kB/s | 77 kB 00:00 2024-09-12T00:09:38.393 INFO:teuthology.orchestra.run.smithi160.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-12T00:09:38.401 INFO:teuthology.orchestra.run.smithi133.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 847 kB/s | 42 kB 00:00 2024-09-12T00:09:38.426 INFO:teuthology.orchestra.run.smithi160.stdout:(253/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.6 MB/s | 839 kB 00:00 2024-09-12T00:09:38.443 INFO:teuthology.orchestra.run.smithi160.stdout:(254/285): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T00:09:38.477 INFO:teuthology.orchestra.run.smithi160.stdout:(255/285): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-12T00:09:38.484 INFO:teuthology.orchestra.run.smithi133.stdout:(209/285): python3-numpy-1.20.1-5.el9.x86_64.rp 7.4 MB/s | 5.1 MB 00:00 2024-09-12T00:09:38.502 INFO:teuthology.orchestra.run.smithi160.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T00:09:38.518 INFO:teuthology.orchestra.run.smithi133.stdout:(210/285): python3-protobuf-3.14.0-13.el9.noarc 1.7 MB/s | 269 kB 00:00 2024-09-12T00:09:38.536 INFO:teuthology.orchestra.run.smithi160.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-12T00:09:38.543 INFO:teuthology.orchestra.run.smithi133.stdout:(211/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.1 MB/s | 159 kB 00:00 2024-09-12T00:09:38.561 INFO:teuthology.orchestra.run.smithi160.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-12T00:09:38.569 INFO:teuthology.orchestra.run.smithi133.stdout:(212/285): python3-pyasn1-modules-0.4.8-6.el9.n 3.2 MB/s | 279 kB 00:00 2024-09-12T00:09:38.586 INFO:teuthology.orchestra.run.smithi160.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-12T00:09:38.594 INFO:teuthology.orchestra.run.smithi133.stdout:(213/285): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-12T00:09:38.612 INFO:teuthology.orchestra.run.smithi160.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 936 kB/s | 23 kB 00:00 2024-09-12T00:09:38.619 INFO:teuthology.orchestra.run.smithi133.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 712 kB/s | 54 kB 00:00 2024-09-12T00:09:38.637 INFO:teuthology.orchestra.run.smithi160.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-12T00:09:38.653 INFO:teuthology.orchestra.run.smithi133.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 708 kB/s | 42 kB 00:00 2024-09-12T00:09:38.662 INFO:teuthology.orchestra.run.smithi160.stdout:(262/285): python3-jaraco-text-3.2.0-6.el9.noar 795 kB/s | 20 kB 00:00 2024-09-12T00:09:38.678 INFO:teuthology.orchestra.run.smithi133.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T00:09:38.704 INFO:teuthology.orchestra.run.smithi133.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 716 kB/s | 36 kB 00:00 2024-09-12T00:09:38.721 INFO:teuthology.orchestra.run.smithi160.stdout:(263/285): python3-kubernetes-26.1.0-2.el9.noar 18 MB/s | 1.0 MB 00:00 2024-09-12T00:09:38.729 INFO:teuthology.orchestra.run.smithi133.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-12T00:09:38.746 INFO:teuthology.orchestra.run.smithi160.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T00:09:38.754 INFO:teuthology.orchestra.run.smithi133.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-12T00:09:38.772 INFO:teuthology.orchestra.run.smithi160.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T00:09:38.805 INFO:teuthology.orchestra.run.smithi133.stdout:(220/285): slf4j-1.7.30-13.el9.noarch.rpm 1.3 MB/s | 69 kB 00:00 2024-09-12T00:09:38.822 INFO:teuthology.orchestra.run.smithi160.stdout:(266/285): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-09-12T00:09:38.829 INFO:teuthology.orchestra.run.smithi133.stdout:(221/285): sisu-0.3.4-10.el9.noarch.rpm 5.0 MB/s | 510 kB 00:00 2024-09-12T00:09:38.847 INFO:teuthology.orchestra.run.smithi160.stdout:(267/285): python3-natsort-7.1.1-5.el9.noarch.r 768 kB/s | 58 kB 00:00 2024-09-12T00:09:38.863 INFO:teuthology.orchestra.run.smithi133.stdout:(222/285): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-12T00:09:38.875 INFO:teuthology.orchestra.run.smithi160.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-12T00:09:38.889 INFO:teuthology.orchestra.run.smithi133.stdout:(223/285): sound-theme-freedesktop-0.8-17.el9.n 6.4 MB/s | 383 kB 00:00 2024-09-12T00:09:38.897 INFO:teuthology.orchestra.run.smithi160.stdout:(269/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T00:09:38.922 INFO:teuthology.orchestra.run.smithi133.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 2.6 MB/s | 152 kB 00:00 2024-09-12T00:09:38.923 INFO:teuthology.orchestra.run.smithi160.stdout:(270/285): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-12T00:09:38.949 INFO:teuthology.orchestra.run.smithi160.stdout:(271/285): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-12T00:09:38.975 INFO:teuthology.orchestra.run.smithi160.stdout:(272/285): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T00:09:38.981 INFO:teuthology.orchestra.run.smithi133.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 5.9 MB/s | 555 kB 00:00 2024-09-12T00:09:39.032 INFO:teuthology.orchestra.run.smithi160.stdout:(273/285): libarrow-9.0.0-11.el9.x86_64.rpm 4.7 MB/s | 4.4 MB 00:00 2024-09-12T00:09:39.039 INFO:teuthology.orchestra.run.smithi133.stdout:(226/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 914 kB/s | 53 kB 00:00 2024-09-12T00:09:39.057 INFO:teuthology.orchestra.run.smithi160.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 428 kB/s | 36 kB 00:00 2024-09-12T00:09:39.073 INFO:teuthology.orchestra.run.smithi133.stdout:(227/285): tracker-miners-3.1.2-4.el9.x86_64.rp 6.1 MB/s | 944 kB 00:00 2024-09-12T00:09:39.083 INFO:teuthology.orchestra.run.smithi160.stdout:(275/285): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-12T00:09:39.098 INFO:teuthology.orchestra.run.smithi133.stdout:(228/285): tzdata-java-2024a-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-12T00:09:39.108 INFO:teuthology.orchestra.run.smithi160.stdout:(276/285): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-12T00:09:39.132 INFO:teuthology.orchestra.run.smithi133.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 2.9 MB/s | 173 kB 00:00 2024-09-12T00:09:39.133 INFO:teuthology.orchestra.run.smithi160.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-12T00:09:39.157 INFO:teuthology.orchestra.run.smithi133.stdout:(230/285): webrtc-audio-processing-0.3.1-8.el9. 5.1 MB/s | 306 kB 00:00 2024-09-12T00:09:39.158 INFO:teuthology.orchestra.run.smithi160.stdout:(278/285): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T00:09:39.175 INFO:teuthology.orchestra.run.smithi160.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 477 kB/s | 20 kB 00:00 2024-09-12T00:09:39.191 INFO:teuthology.orchestra.run.smithi133.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-12T00:09:39.200 INFO:teuthology.orchestra.run.smithi160.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-12T00:09:39.226 INFO:teuthology.orchestra.run.smithi160.stdout:(281/285): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-12T00:09:39.251 INFO:teuthology.orchestra.run.smithi160.stdout:(282/285): s3cmd-2.4.0-1.el9.noarch.rpm 2.7 MB/s | 206 kB 00:00 2024-09-12T00:09:39.310 INFO:teuthology.orchestra.run.smithi160.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T00:09:39.325 INFO:teuthology.orchestra.run.smithi133.stdout:(232/285): wireplumber-libs-0.4.14-1.el9.x86_64 2.1 MB/s | 358 kB 00:00 2024-09-12T00:09:39.350 INFO:teuthology.orchestra.run.smithi133.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 267 kB/s | 42 kB 00:00 2024-09-12T00:09:39.383 INFO:teuthology.orchestra.run.smithi133.stdout:(234/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 6.5 MB/s | 385 kB 00:00 2024-09-12T00:09:39.408 INFO:teuthology.orchestra.run.smithi133.stdout:(235/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.2 MB/s | 134 kB 00:00 2024-09-12T00:09:39.459 INFO:teuthology.orchestra.run.smithi133.stdout:(236/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T00:09:39.492 INFO:teuthology.orchestra.run.smithi133.stdout:(237/285): xkeyboard-config-2.33-2.el9.noarch.r 7.7 MB/s | 859 kB 00:00 2024-09-12T00:09:39.535 INFO:teuthology.orchestra.run.smithi160.stdout:(284/285): librados2-19.3.0-4753.gd011c522.el9. 11 MB/s | 3.5 MB 00:00 2024-09-12T00:09:39.551 INFO:teuthology.orchestra.run.smithi133.stdout:(238/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.4 MB/s | 505 kB 00:00 2024-09-12T00:09:39.643 INFO:teuthology.orchestra.run.smithi160.stdout:(285/285): librbd1-19.3.0-4753.gd011c522.el9.x8 8.2 MB/s | 3.2 MB 00:00 2024-09-12T00:09:39.650 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:09:39.651 INFO:teuthology.orchestra.run.smithi160.stdout:Total 22 MB/s | 327 MB 00:14 2024-09-12T00:09:39.818 INFO:teuthology.orchestra.run.smithi133.stdout:(239/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-12T00:09:39.877 INFO:teuthology.orchestra.run.smithi133.stdout:(240/285): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T00:09:39.902 INFO:teuthology.orchestra.run.smithi133.stdout:(241/285): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-12T00:09:39.927 INFO:teuthology.orchestra.run.smithi133.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-12T00:09:40.044 INFO:teuthology.orchestra.run.smithi133.stdout:(243/285): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-12T00:09:40.061 INFO:teuthology.orchestra.run.smithi133.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.6 MB/s | 26 kB 00:00 2024-09-12T00:09:40.086 INFO:teuthology.orchestra.run.smithi133.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T00:09:40.103 INFO:teuthology.orchestra.run.smithi133.stdout:(246/285): libunwind-1.6.2-1.el9.x86_64.rpm 4.0 MB/s | 67 kB 00:00 2024-09-12T00:09:40.128 INFO:teuthology.orchestra.run.smithi133.stdout:(247/285): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T00:09:40.162 INFO:teuthology.orchestra.run.smithi133.stdout:(248/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-12T00:09:40.195 INFO:teuthology.orchestra.run.smithi133.stdout:(249/285): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-12T00:09:40.221 INFO:teuthology.orchestra.run.smithi133.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T00:09:40.246 INFO:teuthology.orchestra.run.smithi133.stdout:(251/285): lua-devel-5.4.4-4.el9.x86_64.rpm 30 kB/s | 22 kB 00:00 2024-09-12T00:09:40.272 INFO:teuthology.orchestra.run.smithi133.stdout:(252/285): python3-cachetools-4.2.4-1.el9.noarc 654 kB/s | 32 kB 00:00 2024-09-12T00:09:40.305 INFO:teuthology.orchestra.run.smithi133.stdout:(253/285): python3-cheroot-8.6.0-4.el9.noarch.r 6.5 MB/s | 172 kB 00:00 2024-09-12T00:09:40.331 INFO:teuthology.orchestra.run.smithi133.stdout:(254/285): python3-certifi-2023.05.07-4.el9.noa 169 kB/s | 14 kB 00:00 2024-09-12T00:09:40.356 INFO:teuthology.orchestra.run.smithi133.stdout:(255/285): python3-google-auth-2.34.0-1.el9.noa 8.7 MB/s | 220 kB 00:00 2024-09-12T00:09:40.381 INFO:teuthology.orchestra.run.smithi133.stdout:(256/285): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-09-12T00:09:40.406 INFO:teuthology.orchestra.run.smithi133.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T00:09:40.431 INFO:teuthology.orchestra.run.smithi133.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-09-12T00:09:40.457 INFO:teuthology.orchestra.run.smithi133.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-12T00:09:40.482 INFO:teuthology.orchestra.run.smithi133.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-09-12T00:09:40.507 INFO:teuthology.orchestra.run.smithi133.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-12T00:09:40.532 INFO:teuthology.orchestra.run.smithi133.stdout:(262/285): python3-jaraco-text-3.2.0-6.el9.noar 794 kB/s | 20 kB 00:00 2024-09-12T00:09:40.583 INFO:teuthology.orchestra.run.smithi133.stdout:(263/285): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-12T00:09:40.608 INFO:teuthology.orchestra.run.smithi133.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T00:09:40.633 INFO:teuthology.orchestra.run.smithi133.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T00:09:40.659 INFO:teuthology.orchestra.run.smithi133.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T00:09:40.692 INFO:teuthology.orchestra.run.smithi133.stdout:(267/285): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-12T00:09:40.734 INFO:teuthology.orchestra.run.smithi133.stdout:(268/285): protobuf-compiler-3.14.0-13.el9.x86_ 730 kB/s | 863 kB 00:01 2024-09-12T00:09:40.759 INFO:teuthology.orchestra.run.smithi133.stdout:(269/285): python3-portend-3.1.0-2.el9.noarch.r 250 kB/s | 16 kB 00:00 2024-09-12T00:09:40.793 INFO:teuthology.orchestra.run.smithi133.stdout:(270/285): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-12T00:09:40.835 INFO:teuthology.orchestra.run.smithi133.stdout:(271/285): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-09-12T00:09:40.860 INFO:teuthology.orchestra.run.smithi133.stdout:(272/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 715 kB/s | 90 kB 00:00 2024-09-12T00:09:40.886 INFO:teuthology.orchestra.run.smithi133.stdout:(273/285): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T00:09:40.911 INFO:teuthology.orchestra.run.smithi133.stdout:(274/285): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-12T00:09:40.945 INFO:teuthology.orchestra.run.smithi133.stdout:(275/285): python3-tempora-5.0.0-2.el9.noarch.r 427 kB/s | 36 kB 00:00 2024-09-12T00:09:40.961 INFO:teuthology.orchestra.run.smithi133.stdout:(276/285): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-12T00:09:40.987 INFO:teuthology.orchestra.run.smithi133.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-12T00:09:41.012 INFO:teuthology.orchestra.run.smithi133.stdout:(278/285): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T00:09:41.037 INFO:teuthology.orchestra.run.smithi133.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-12T00:09:41.062 INFO:teuthology.orchestra.run.smithi133.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T00:09:41.088 INFO:teuthology.orchestra.run.smithi133.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T00:09:41.113 INFO:teuthology.orchestra.run.smithi133.stdout:(282/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-12T00:09:41.163 INFO:teuthology.orchestra.run.smithi133.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T00:09:41.380 INFO:teuthology.orchestra.run.smithi133.stdout:(284/285): librbd1-19.3.0-4753.gd011c522.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-12T00:09:41.472 INFO:teuthology.orchestra.run.smithi133.stdout:(285/285): librados2-19.3.0-4753.gd011c522.el9. 9.0 MB/s | 3.5 MB 00:00 2024-09-12T00:09:41.479 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:09:41.479 INFO:teuthology.orchestra.run.smithi133.stdout:Total 19 MB/s | 327 MB 00:17 2024-09-12T00:09:42.802 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-12T00:09:42.988 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-12T00:09:42.988 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-12T00:09:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-09-12T00:09:44.849 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-09-12T00:09:44.849 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-09-12T00:09:46.164 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-12T00:09:46.164 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-12T00:09:48.116 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-09-12T00:09:48.116 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-09-12T00:09:56.216 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T00:09:56.371 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T00:09:56.526 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-12T00:09:56.593 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T00:09:56.670 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T00:09:56.933 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T00:09:56.980 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T00:09:57.034 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T00:09:57.074 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T00:09:57.107 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T00:09:57.161 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T00:09:57.502 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T00:09:57.617 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:09:57.739 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:09:57.768 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:09:57.869 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:09:57.897 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:09:57.940 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T00:09:57.981 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T00:09:58.015 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T00:09:58.042 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T00:09:58.082 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T00:09:58.107 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T00:09:58.135 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T00:09:58.274 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T00:09:58.340 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T00:09:58.408 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T00:09:58.441 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T00:09:58.477 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T00:09:58.501 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T00:09:58.505 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:09:58.611 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:09:58.640 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:09:58.653 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-09-12T00:09:58.705 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:09:58.725 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T00:09:58.736 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T00:09:58.758 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:09:58.759 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T00:09:58.783 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:09:58.919 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T00:09:58.970 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:09:58.980 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T00:09:59.000 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:09:59.035 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T00:09:59.069 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T00:09:59.094 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T00:09:59.113 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T00:09:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T00:09:59.159 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T00:09:59.195 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T00:09:59.274 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T00:09:59.322 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T00:09:59.362 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T00:09:59.405 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T00:09:59.430 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T00:09:59.457 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T00:09:59.490 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T00:09:59.503 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T00:09:59.540 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T00:09:59.569 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T00:09:59.587 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:09:59.601 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T00:09:59.634 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T00:09:59.682 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T00:09:59.717 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:09:59.724 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:09:59.746 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:09:59.794 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:09:59.837 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:09:59.851 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T00:09:59.866 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:09:59.881 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T00:09:59.913 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T00:09:59.935 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T00:09:59.943 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T00:09:59.968 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T00:09:59.976 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T00:09:59.995 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T00:10:00.009 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T00:10:00.051 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T00:10:00.077 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T00:10:00.096 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T00:10:00.105 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T00:10:00.128 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 51/287 2024-09-12T00:10:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 52/287 2024-09-12T00:10:00.213 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 53/287 2024-09-12T00:10:00.249 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T00:10:00.290 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T00:10:00.374 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T00:10:00.411 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T00:10:00.428 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T00:10:00.446 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T00:10:00.475 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:10:00.483 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T00:10:00.578 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:10:00.601 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:10:00.664 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:10:00.689 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T00:10:00.719 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:10:00.753 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:10:00.939 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:10:00.969 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:10:01.029 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T00:10:01.078 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T00:10:01.112 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T00:10:01.112 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T00:10:01.148 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T00:10:01.148 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T00:10:01.224 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T00:10:01.226 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T00:10:01.271 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T00:10:01.282 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T00:10:01.307 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T00:10:01.323 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T00:10:01.336 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T00:10:01.366 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T00:10:01.390 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T00:10:01.407 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T00:10:01.417 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T00:10:01.442 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T00:10:01.455 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T00:10:01.468 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T00:10:01.488 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T00:10:01.497 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T00:10:01.529 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T00:10:01.541 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T00:10:01.562 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T00:10:01.578 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 68/287 2024-09-12T00:10:01.611 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T00:10:01.616 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T00:10:01.644 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T00:10:01.644 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:10:01.685 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T00:10:01.711 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:10:01.752 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:10:01.770 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T00:10:01.786 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T00:10:01.799 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T00:10:01.823 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T00:10:01.842 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T00:10:01.884 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T00:10:01.916 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T00:10:01.919 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T00:10:01.989 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T00:10:01.996 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T00:10:02.029 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 51/287 2024-09-12T00:10:02.061 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T00:10:02.073 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 52/287 2024-09-12T00:10:02.100 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T00:10:02.115 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 53/287 2024-09-12T00:10:02.145 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T00:10:02.192 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T00:10:02.198 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T00:10:02.237 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T00:10:02.279 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T00:10:02.335 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T00:10:02.392 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T00:10:02.421 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T00:10:02.464 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T00:10:02.506 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T00:10:02.610 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T00:10:02.640 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T00:10:02.682 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T00:10:02.723 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/287 2024-09-12T00:10:02.750 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T00:10:02.847 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T00:10:02.935 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T00:10:02.976 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T00:10:03.018 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T00:10:03.029 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T00:10:03.058 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T00:10:03.127 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T00:10:03.163 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T00:10:03.199 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T00:10:03.229 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T00:10:03.235 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T00:10:03.276 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T00:10:03.299 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T00:10:03.307 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T00:10:03.332 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T00:10:03.337 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T00:10:03.364 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T00:10:03.399 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T00:10:03.403 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T00:10:03.432 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:10:03.437 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 68/287 2024-09-12T00:10:03.447 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:10:03.447 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T00:10:03.447 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:10:03.470 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T00:10:03.502 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T00:10:03.544 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T00:10:03.602 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:10:03.637 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T00:10:03.653 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T00:10:03.673 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T00:10:03.730 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T00:10:03.766 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T00:10:03.788 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T00:10:03.813 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:10:03.830 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T00:10:03.842 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:10:03.873 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T00:10:03.928 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T00:10:03.959 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T00:10:03.995 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T00:10:04.042 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T00:10:04.087 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T00:10:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T00:10:04.263 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:10:04.267 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T00:10:04.302 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:10:04.314 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T00:10:04.316 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:10:04.316 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T00:10:04.316 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:10:04.355 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T00:10:04.357 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T00:10:04.392 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T00:10:04.426 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T00:10:04.459 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T00:10:04.468 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T00:10:04.490 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T00:10:04.502 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T00:10:04.531 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T00:10:04.562 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/287 2024-09-12T00:10:04.587 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T00:10:04.599 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T00:10:04.649 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T00:10:04.673 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T00:10:04.688 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T00:10:04.793 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T00:10:04.797 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T00:10:04.846 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T00:10:04.848 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T00:10:05.050 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T00:10:05.090 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T00:10:05.121 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T00:10:05.160 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T00:10:05.202 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T00:10:05.230 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:10:05.244 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:10:05.245 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T00:10:05.245 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:10:05.434 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T00:10:05.513 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T00:10:05.569 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T00:10:05.595 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:10:05.596 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T00:10:05.625 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:10:05.645 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T00:10:05.654 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T00:10:05.678 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T00:10:05.789 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T00:10:05.844 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T00:10:06.039 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T00:10:06.093 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T00:10:06.094 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:10:06.124 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:10:06.135 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T00:10:06.138 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:10:06.138 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T00:10:06.138 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:10:06.181 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T00:10:06.215 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T00:10:06.248 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T00:10:06.290 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T00:10:06.324 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T00:10:06.420 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T00:10:06.481 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T00:10:06.511 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T00:10:06.617 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T00:10:06.647 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T00:10:06.679 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T00:10:06.713 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T00:10:06.746 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T00:10:06.780 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T00:10:06.814 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T00:10:07.008 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T00:10:07.045 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T00:10:07.124 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T00:10:07.428 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T00:10:07.475 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T00:10:07.510 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T00:10:07.643 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T00:10:07.710 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T00:10:07.792 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T00:10:07.892 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T00:10:07.913 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T00:10:07.932 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T00:10:07.979 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T00:10:08.481 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T00:10:08.541 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T00:10:08.579 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T00:10:08.612 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T00:10:08.646 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T00:10:08.832 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T00:10:08.860 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T00:10:08.930 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T00:10:09.228 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T00:10:09.313 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T00:10:09.381 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T00:10:09.415 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T00:10:09.443 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T00:10:09.472 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:10:09.484 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:10:09.484 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T00:10:09.484 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:10:09.535 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T00:10:09.559 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T00:10:09.588 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T00:10:09.616 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T00:10:09.736 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T00:10:09.920 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T00:10:09.961 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:10:10.059 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:10:10.090 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 145/287 2024-09-12T00:10:10.123 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T00:10:10.160 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T00:10:10.220 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T00:10:10.251 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T00:10:10.277 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T00:10:10.338 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T00:10:10.366 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:10:10.619 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:10:10.660 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T00:10:10.688 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T00:10:10.713 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T00:10:10.739 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T00:10:10.773 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T00:10:10.798 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T00:10:10.826 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T00:10:10.870 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T00:10:10.912 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T00:10:10.946 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T00:10:10.994 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T00:10:11.008 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T00:10:11.021 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T00:10:11.087 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T00:10:11.138 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T00:10:11.173 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T00:10:11.199 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T00:10:11.238 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:10:11.250 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:10:11.250 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T00:10:11.250 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:10:11.301 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T00:10:11.333 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T00:10:11.361 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T00:10:11.507 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T00:10:11.649 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T00:10:11.680 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T00:10:11.711 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T00:10:11.724 INFO:teuthology.orchestra.run.smithi133.stdout: Upgrading : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:10:11.752 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T00:10:11.789 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T00:10:11.807 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:10:11.839 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 145/287 2024-09-12T00:10:11.857 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T00:10:11.871 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T00:10:11.900 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T00:10:11.910 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T00:10:11.936 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:10:11.956 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:10:11.958 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T00:10:11.983 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T00:10:11.991 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T00:10:12.009 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T00:10:12.017 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T00:10:12.047 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T00:10:12.055 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T00:10:12.072 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:10:12.081 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:10:12.382 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:10:12.417 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T00:10:12.445 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T00:10:12.470 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T00:10:12.496 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T00:10:12.521 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T00:10:12.546 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T00:10:12.574 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T00:10:12.610 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T00:10:12.653 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T00:10:12.685 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T00:10:12.733 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T00:10:12.769 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T00:10:13.224 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T00:10:13.359 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T00:10:13.417 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T00:10:13.442 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T00:10:13.470 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T00:10:13.547 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T00:10:13.601 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T00:10:13.626 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:10:13.646 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:10:13.672 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T00:10:13.698 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T00:10:13.736 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T00:10:13.762 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:10:23.009 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:10:23.055 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T00:10:23.091 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T00:10:23.137 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T00:10:23.166 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T00:10:23.201 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T00:10:23.729 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T00:10:23.756 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:10:23.844 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:10:23.867 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 184/287 2024-09-12T00:10:25.370 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:10:25.411 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T00:10:25.439 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T00:10:25.479 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T00:10:25.513 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T00:10:25.549 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T00:10:26.068 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T00:10:26.095 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:10:26.176 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:10:26.205 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:10:26.206 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 184/287 2024-09-12T00:10:26.257 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:10:26.833 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:10:26.885 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:10:26.976 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:10:26.976 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T00:10:26.976 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T00:10:26.977 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:10:27.003 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:10:28.543 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:10:28.579 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:10:29.156 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:10:29.208 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:10:29.302 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:10:29.302 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T00:10:29.302 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T00:10:29.303 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:10:29.334 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:10:36.263 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:10:36.263 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2024-09-12T00:10:36.263 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2024-09-12T00:10:36.263 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2024-09-12T00:10:36.263 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2024-09-12T00:10:36.263 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2024-09-12T00:10:36.263 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /root 2024-09-12T00:10:36.264 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2024-09-12T00:10:36.264 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:10:36.434 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:10:36.450 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:10:36.450 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:36.450 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:10:36.451 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:10:37.926 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:10:37.953 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:10:37.953 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:37.954 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:10:37.954 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:10:37.954 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:10:37.954 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:10:38.185 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:10:38.209 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:10:38.209 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:38.209 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:10:38.209 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:10:38.209 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:10:38.209 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:10:38.644 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:10:38.644 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /sys 2024-09-12T00:10:38.644 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /proc 2024-09-12T00:10:38.645 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /mnt 2024-09-12T00:10:38.645 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /var/tmp 2024-09-12T00:10:38.645 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /home 2024-09-12T00:10:38.645 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /root 2024-09-12T00:10:38.645 INFO:teuthology.orchestra.run.smithi133.stdout:skipping the directory /tmp 2024-09-12T00:10:38.645 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:10:38.652 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:10:38.676 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:10:38.676 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:38.676 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:10:38.676 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:10:38.677 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:10:38.677 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:10:38.779 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T00:10:38.814 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:10:38.830 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:10:38.830 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:38.830 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:10:38.830 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:10:40.290 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:10:40.317 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:10:40.317 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:40.317 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:10:40.318 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:10:40.318 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:10:40.318 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:10:40.541 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:10:40.564 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:10:40.564 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:40.564 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:10:40.564 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:10:40.564 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:10:40.564 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:10:41.008 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:10:41.031 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:10:41.031 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:41.031 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:10:41.031 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:10:41.031 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:10:41.031 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:10:41.126 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T00:10:41.662 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T00:10:41.800 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T00:10:41.860 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T00:10:41.917 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T00:10:42.111 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T00:10:42.165 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T00:10:42.243 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T00:10:42.331 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T00:10:42.479 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T00:10:42.530 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T00:10:42.565 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T00:10:43.435 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T00:10:43.488 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:10:43.857 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:10:43.894 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T00:10:43.925 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T00:10:43.953 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T00:10:43.970 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T00:10:43.987 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T00:10:44.025 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T00:10:44.060 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T00:10:44.066 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T00:10:44.094 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T00:10:44.122 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T00:10:44.128 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T00:10:44.153 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T00:10:44.179 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T00:10:44.180 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T00:10:44.205 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T00:10:44.232 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T00:10:44.262 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T00:10:44.290 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T00:10:44.325 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T00:10:44.361 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T00:10:44.373 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T00:10:44.392 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T00:10:44.419 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T00:10:44.426 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T00:10:44.460 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T00:10:44.498 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T00:10:44.501 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T00:10:44.537 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T00:10:44.586 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T00:10:44.587 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T00:10:44.631 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T00:10:44.662 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T00:10:44.694 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T00:10:44.727 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T00:10:44.749 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T00:10:44.778 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T00:10:44.779 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T00:10:44.809 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T00:10:44.811 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T00:10:44.838 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T00:10:44.872 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T00:10:45.052 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T00:10:45.089 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T00:10:45.116 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T00:10:45.151 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T00:10:45.184 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T00:10:45.333 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T00:10:45.399 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T00:10:45.476 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T00:10:45.507 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:10:45.624 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:10:45.674 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T00:10:45.688 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:10:45.712 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:10:45.726 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:10:45.748 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T00:10:45.771 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T00:10:46.080 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:10:46.110 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:10:46.124 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T00:10:46.134 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:10:46.150 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:10:46.150 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T00:10:46.150 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:10:46.175 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T00:10:46.207 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T00:10:46.242 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T00:10:46.279 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T00:10:46.306 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T00:10:46.332 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T00:10:46.367 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T00:10:46.375 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T00:10:46.391 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T00:10:46.417 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T00:10:46.443 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T00:10:46.455 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T00:10:46.470 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T00:10:46.500 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T00:10:46.500 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T00:10:46.528 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T00:10:46.536 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T00:10:46.562 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T00:10:46.563 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T00:10:46.598 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T00:10:46.629 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T00:10:46.663 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T00:10:46.698 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T00:10:46.734 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T00:10:46.772 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T00:10:46.815 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T00:10:46.859 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T00:10:46.891 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T00:10:46.914 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T00:10:46.975 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T00:10:46.976 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:10:47.007 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:10:47.008 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T00:10:47.023 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:10:47.038 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T00:10:47.067 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T00:10:47.093 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T00:10:47.263 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T00:10:47.293 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T00:10:47.320 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T00:10:47.347 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T00:10:47.388 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T00:10:47.509 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:10:47.510 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T00:10:47.569 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T00:10:47.594 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:10:47.639 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:10:47.644 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T00:10:47.668 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:10:47.675 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:10:47.795 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:10:47.831 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:10:47.846 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:10:47.871 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T00:10:47.884 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T00:10:47.907 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T00:10:47.937 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T00:10:47.963 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:10:47.986 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:10:48.014 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:10:48.085 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:10:48.117 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:10:48.129 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:10:48.159 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:10:48.177 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:10:48.202 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T00:10:48.320 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:10:48.406 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:10:48.406 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:10:48.406 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T00:10:48.406 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:10:48.578 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T00:10:48.653 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:10:48.656 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T00:10:48.682 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:10:48.702 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T00:10:48.716 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 265/287 2024-09-12T00:10:48.740 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T00:10:48.772 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T00:10:48.782 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 266/287 2024-09-12T00:10:48.807 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:10:49.188 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:10:49.218 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:10:49.235 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:10:49.741 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:10:49.820 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:10:49.869 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:10:49.897 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:10:50.094 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T00:10:50.152 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T00:10:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:10:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:10:50.234 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:10:50.300 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:10:50.328 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:10:50.339 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:10:50.370 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:10:50.390 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:10:50.413 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T00:10:50.849 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:10:50.870 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:10:50.895 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 265/287 2024-09-12T00:10:50.962 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 266/287 2024-09-12T00:10:50.987 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:10:52.017 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:10:52.072 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:10:53.040 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:10:53.072 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:10:53.188 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:10:53.358 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 270/287 2024-09-12T00:10:53.390 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:10:53.414 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:10:53.414 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:53.414 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:10:53.414 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:10:53.414 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:10:53.414 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:10:53.465 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:10:53.476 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:10:53.500 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 273/287 2024-09-12T00:10:53.529 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T00:10:53.577 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T00:10:53.601 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:10:53.617 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:10:53.617 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T00:10:53.617 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:10:54.167 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:10:54.235 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:10:54.577 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:10:54.600 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:10:54.601 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:54.601 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:10:54.601 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:10:54.601 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:10:54.601 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:10:54.652 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:10:54.675 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:10:54.675 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:54.676 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:10:54.676 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:10:54.994 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:10:55.018 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:10:55.018 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:55.018 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:10:55.018 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:10:55.018 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:10:55.019 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:10:55.197 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:10:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:10:55.344 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:10:55.505 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 270/287 2024-09-12T00:10:55.537 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:10:55.560 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:10:55.560 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:55.561 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:10:55.561 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:10:55.561 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:10:55.561 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:10:55.612 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:10:55.624 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:10:55.638 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 273/287 2024-09-12T00:10:55.667 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T00:10:55.715 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T00:10:55.739 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:10:55.755 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:10:55.756 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T00:10:55.756 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:10:56.707 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:10:56.730 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:10:56.730 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:56.730 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:10:56.730 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:10:56.730 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:10:56.730 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:10:56.774 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:10:56.797 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:10:56.797 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:56.797 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:10:56.797 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:10:57.108 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:10:57.131 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:10:57.132 INFO:teuthology.orchestra.run.smithi133.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:10:57.132 INFO:teuthology.orchestra.run.smithi133.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:10:57.132 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:10:57.132 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:10:57.132 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:10:59.706 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 280/287 2024-09-12T00:10:59.747 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 281/287 2024-09-12T00:10:59.779 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 282/287 2024-09-12T00:10:59.884 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 283/287 2024-09-12T00:10:59.939 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:10:59.970 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T00:10:59.970 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:11:00.062 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:11:00.062 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:11:00.161 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:11:00.182 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T00:11:00.188 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T00:11:00.197 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T00:11:00.208 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T00:11:00.208 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:11:00.208 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:11:00.208 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:00.264 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:11:00.332 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:11:01.803 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 280/287 2024-09-12T00:11:01.844 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 281/287 2024-09-12T00:11:01.876 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 282/287 2024-09-12T00:11:01.980 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 283/287 2024-09-12T00:11:02.043 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:11:02.075 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T00:11:02.076 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:11:02.168 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:11:02.168 INFO:teuthology.orchestra.run.smithi133.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:11:02.259 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:11:02.283 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T00:11:02.289 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T00:11:02.298 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T00:11:02.309 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T00:11:02.309 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:11:02.310 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:11:02.310 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:02.378 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:11:02.446 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:11:10.316 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:11:10.316 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 1/287 2024-09-12T00:11:10.317 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2/287 2024-09-12T00:11:10.317 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 3/287 2024-09-12T00:11:10.317 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 4/287 2024-09-12T00:11:10.317 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 5/287 2024-09-12T00:11:10.317 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 6/287 2024-09-12T00:11:10.317 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 7/287 2024-09-12T00:11:10.317 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 8/287 2024-09-12T00:11:10.317 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 9/287 2024-09-12T00:11:10.318 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:11:10.318 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:11:10.318 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:11:10.318 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 13/287 2024-09-12T00:11:10.318 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 14/287 2024-09-12T00:11:10.318 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 15/287 2024-09-12T00:11:10.318 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 16/287 2024-09-12T00:11:10.318 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 17/287 2024-09-12T00:11:10.318 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 18/287 2024-09-12T00:11:10.318 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 19/287 2024-09-12T00:11:10.318 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 20/287 2024-09-12T00:11:10.318 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 21/287 2024-09-12T00:11:10.318 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 22/287 2024-09-12T00:11:10.319 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 23/287 2024-09-12T00:11:10.319 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:11:10.319 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 25/287 2024-09-12T00:11:10.319 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 26/287 2024-09-12T00:11:10.319 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 27/287 2024-09-12T00:11:10.319 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 28/287 2024-09-12T00:11:10.319 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 29/287 2024-09-12T00:11:10.319 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 30/287 2024-09-12T00:11:10.319 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 31/287 2024-09-12T00:11:10.319 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 32/287 2024-09-12T00:11:10.319 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 33/287 2024-09-12T00:11:10.319 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 34/287 2024-09-12T00:11:10.319 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 35/287 2024-09-12T00:11:10.320 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 36/287 2024-09-12T00:11:10.320 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T00:11:10.320 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T00:11:10.320 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T00:11:10.320 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T00:11:10.320 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T00:11:10.320 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T00:11:10.320 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T00:11:10.320 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T00:11:10.320 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T00:11:10.320 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T00:11:10.321 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T00:11:10.321 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T00:11:10.321 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T00:11:10.321 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T00:11:10.321 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T00:11:10.321 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T00:11:10.321 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T00:11:10.321 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T00:11:10.321 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T00:11:10.321 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T00:11:10.321 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T00:11:10.321 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T00:11:10.321 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T00:11:10.321 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T00:11:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T00:11:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T00:11:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T00:11:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T00:11:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T00:11:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T00:11:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T00:11:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T00:11:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T00:11:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T00:11:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T00:11:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:11:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T00:11:10.323 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T00:11:10.323 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T00:11:10.323 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T00:11:10.323 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T00:11:10.323 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T00:11:10.323 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T00:11:10.323 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T00:11:10.323 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T00:11:10.323 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T00:11:10.323 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T00:11:10.323 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T00:11:10.323 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T00:11:10.323 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T00:11:10.323 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T00:11:10.324 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T00:11:10.324 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T00:11:10.324 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T00:11:10.324 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T00:11:10.324 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T00:11:10.324 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T00:11:10.324 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T00:11:10.324 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T00:11:10.324 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T00:11:10.324 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T00:11:10.324 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T00:11:10.324 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T00:11:10.324 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T00:11:10.325 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T00:11:10.325 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T00:11:10.325 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T00:11:10.325 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T00:11:10.325 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T00:11:10.325 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T00:11:10.325 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T00:11:10.325 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T00:11:10.325 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T00:11:10.325 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T00:11:10.325 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T00:11:10.325 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T00:11:10.325 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T00:11:10.325 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T00:11:10.326 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T00:11:10.326 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T00:11:10.326 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T00:11:10.326 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T00:11:10.326 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T00:11:10.326 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T00:11:10.326 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T00:11:10.326 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T00:11:10.326 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T00:11:10.326 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T00:11:10.326 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T00:11:10.326 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T00:11:10.326 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T00:11:10.326 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T00:11:10.327 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T00:11:10.327 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T00:11:10.327 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T00:11:10.327 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T00:11:10.327 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T00:11:10.327 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T00:11:10.327 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T00:11:10.327 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T00:11:10.327 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T00:11:10.327 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T00:11:10.327 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T00:11:10.327 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T00:11:10.327 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T00:11:10.327 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T00:11:10.328 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T00:11:10.328 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T00:11:10.328 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T00:11:10.328 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T00:11:10.328 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T00:11:10.328 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T00:11:10.328 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T00:11:10.328 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T00:11:10.328 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T00:11:10.328 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T00:11:10.328 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T00:11:10.328 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T00:11:10.328 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T00:11:10.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T00:11:10.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T00:11:10.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T00:11:10.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T00:11:10.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T00:11:10.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T00:11:10.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T00:11:10.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T00:11:10.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T00:11:10.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T00:11:10.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T00:11:10.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T00:11:10.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T00:11:10.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T00:11:10.329 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T00:11:10.330 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T00:11:10.330 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T00:11:10.330 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T00:11:10.330 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T00:11:10.330 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T00:11:10.330 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T00:11:10.330 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T00:11:10.330 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T00:11:10.330 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T00:11:10.330 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T00:11:10.330 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T00:11:10.330 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T00:11:10.331 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T00:11:10.331 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T00:11:10.331 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T00:11:10.331 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T00:11:10.331 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T00:11:10.331 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T00:11:10.331 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T00:11:10.331 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T00:11:10.331 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T00:11:10.331 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T00:11:10.331 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T00:11:10.331 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T00:11:10.331 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T00:11:10.332 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T00:11:10.332 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T00:11:10.332 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T00:11:10.332 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T00:11:10.332 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T00:11:10.332 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T00:11:10.332 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T00:11:10.332 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T00:11:10.332 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T00:11:10.332 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T00:11:10.332 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T00:11:10.332 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T00:11:10.333 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T00:11:10.333 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T00:11:10.333 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T00:11:10.333 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T00:11:10.333 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T00:11:10.333 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T00:11:10.333 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T00:11:10.333 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T00:11:10.333 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T00:11:10.333 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T00:11:10.333 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T00:11:10.333 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T00:11:10.334 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T00:11:10.334 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T00:11:10.334 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T00:11:10.334 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T00:11:10.334 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T00:11:10.334 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T00:11:10.334 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T00:11:10.334 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T00:11:10.334 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T00:11:10.334 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T00:11:10.334 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T00:11:10.334 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T00:11:10.334 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T00:11:10.335 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T00:11:10.335 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T00:11:10.335 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T00:11:10.335 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T00:11:10.335 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T00:11:10.335 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T00:11:10.335 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T00:11:10.335 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T00:11:10.335 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T00:11:10.335 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T00:11:10.335 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 243/287 2024-09-12T00:11:10.335 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T00:11:10.335 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T00:11:10.335 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T00:11:10.336 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T00:11:10.336 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T00:11:10.336 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T00:11:10.336 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T00:11:10.336 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T00:11:10.336 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T00:11:10.336 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T00:11:10.336 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T00:11:10.336 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T00:11:10.336 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T00:11:10.336 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T00:11:10.337 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T00:11:10.337 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T00:11:10.337 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T00:11:10.337 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T00:11:10.337 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T00:11:10.337 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T00:11:10.337 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T00:11:10.337 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T00:11:10.337 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T00:11:10.337 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T00:11:10.337 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T00:11:10.337 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T00:11:10.338 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T00:11:10.338 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T00:11:10.338 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T00:11:10.338 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T00:11:10.338 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T00:11:10.338 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T00:11:10.338 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T00:11:10.338 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T00:11:10.338 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T00:11:10.338 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T00:11:10.338 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T00:11:10.338 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T00:11:10.338 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T00:11:10.339 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T00:11:10.339 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:11:10.339 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T00:11:10.339 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 286/287 2024-09-12T00:11:12.131 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:11:12.131 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 1/287 2024-09-12T00:11:12.131 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2/287 2024-09-12T00:11:12.131 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 3/287 2024-09-12T00:11:12.131 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 4/287 2024-09-12T00:11:12.131 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 5/287 2024-09-12T00:11:12.131 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 6/287 2024-09-12T00:11:12.131 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 7/287 2024-09-12T00:11:12.131 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 8/287 2024-09-12T00:11:12.131 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 9/287 2024-09-12T00:11:12.131 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:11:12.132 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:11:12.132 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:11:12.132 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 13/287 2024-09-12T00:11:12.132 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 14/287 2024-09-12T00:11:12.132 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 15/287 2024-09-12T00:11:12.132 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 16/287 2024-09-12T00:11:12.132 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 17/287 2024-09-12T00:11:12.132 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 18/287 2024-09-12T00:11:12.132 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 19/287 2024-09-12T00:11:12.132 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 20/287 2024-09-12T00:11:12.132 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 21/287 2024-09-12T00:11:12.132 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 22/287 2024-09-12T00:11:12.132 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 23/287 2024-09-12T00:11:12.133 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:11:12.133 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 25/287 2024-09-12T00:11:12.133 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 26/287 2024-09-12T00:11:12.133 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 27/287 2024-09-12T00:11:12.133 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 28/287 2024-09-12T00:11:12.133 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 29/287 2024-09-12T00:11:12.133 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 30/287 2024-09-12T00:11:12.155 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 31/287 2024-09-12T00:11:12.155 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 32/287 2024-09-12T00:11:12.155 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 33/287 2024-09-12T00:11:12.155 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 34/287 2024-09-12T00:11:12.155 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 35/287 2024-09-12T00:11:12.155 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 36/287 2024-09-12T00:11:12.156 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T00:11:12.156 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T00:11:12.156 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T00:11:12.156 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T00:11:12.156 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T00:11:12.156 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T00:11:12.156 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T00:11:12.156 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T00:11:12.156 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T00:11:12.156 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T00:11:12.156 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T00:11:12.156 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T00:11:12.156 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T00:11:12.157 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T00:11:12.157 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T00:11:12.157 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T00:11:12.157 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T00:11:12.157 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T00:11:12.157 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T00:11:12.157 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T00:11:12.157 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T00:11:12.157 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T00:11:12.157 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T00:11:12.157 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T00:11:12.157 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T00:11:12.157 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T00:11:12.157 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T00:11:12.158 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T00:11:12.158 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T00:11:12.158 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T00:11:12.158 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T00:11:12.158 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T00:11:12.158 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T00:11:12.158 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T00:11:12.158 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T00:11:12.158 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:11:12.158 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T00:11:12.158 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T00:11:12.158 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T00:11:12.158 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T00:11:12.159 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T00:11:12.159 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T00:11:12.159 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T00:11:12.159 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T00:11:12.159 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T00:11:12.159 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T00:11:12.159 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T00:11:12.159 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T00:11:12.159 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T00:11:12.159 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T00:11:12.159 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T00:11:12.159 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T00:11:12.159 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T00:11:12.159 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T00:11:12.160 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T00:11:12.160 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T00:11:12.160 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T00:11:12.160 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T00:11:12.160 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T00:11:12.160 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T00:11:12.160 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T00:11:12.160 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T00:11:12.160 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T00:11:12.160 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T00:11:12.160 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T00:11:12.160 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T00:11:12.160 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T00:11:12.160 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T00:11:12.161 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T00:11:12.161 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T00:11:12.161 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T00:11:12.161 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T00:11:12.161 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T00:11:12.161 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T00:11:12.161 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T00:11:12.161 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T00:11:12.161 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T00:11:12.161 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T00:11:12.161 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T00:11:12.161 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T00:11:12.161 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T00:11:12.161 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T00:11:12.162 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T00:11:12.162 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T00:11:12.162 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T00:11:12.162 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T00:11:12.162 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T00:11:12.162 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T00:11:12.162 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T00:11:12.162 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T00:11:12.162 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T00:11:12.162 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T00:11:12.162 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T00:11:12.162 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T00:11:12.162 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T00:11:12.162 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T00:11:12.163 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T00:11:12.163 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T00:11:12.163 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T00:11:12.163 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T00:11:12.163 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T00:11:12.163 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T00:11:12.163 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T00:11:12.163 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T00:11:12.163 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T00:11:12.163 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T00:11:12.163 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T00:11:12.163 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T00:11:12.163 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T00:11:12.164 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T00:11:12.164 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T00:11:12.164 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T00:11:12.164 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T00:11:12.164 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T00:11:12.164 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T00:11:12.164 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T00:11:12.164 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T00:11:12.164 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T00:11:12.164 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T00:11:12.164 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T00:11:12.164 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T00:11:12.164 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T00:11:12.164 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T00:11:12.165 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T00:11:12.165 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T00:11:12.165 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T00:11:12.165 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T00:11:12.165 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T00:11:12.165 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T00:11:12.165 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T00:11:12.165 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T00:11:12.165 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T00:11:12.165 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T00:11:12.165 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T00:11:12.165 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T00:11:12.165 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T00:11:12.166 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T00:11:12.166 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T00:11:12.166 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T00:11:12.166 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T00:11:12.166 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T00:11:12.166 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T00:11:12.166 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T00:11:12.166 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T00:11:12.166 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T00:11:12.166 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T00:11:12.166 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T00:11:12.166 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T00:11:12.166 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T00:11:12.166 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T00:11:12.166 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T00:11:12.167 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T00:11:12.167 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T00:11:12.167 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T00:11:12.167 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T00:11:12.167 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T00:11:12.167 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T00:11:12.167 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T00:11:12.167 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T00:11:12.167 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T00:11:12.167 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T00:11:12.167 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T00:11:12.167 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T00:11:12.167 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T00:11:12.167 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T00:11:12.168 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T00:11:12.168 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T00:11:12.168 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T00:11:12.168 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T00:11:12.168 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T00:11:12.168 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T00:11:12.168 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T00:11:12.168 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T00:11:12.168 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T00:11:12.168 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T00:11:12.168 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T00:11:12.168 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T00:11:12.168 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T00:11:12.169 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T00:11:12.169 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T00:11:12.169 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T00:11:12.169 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T00:11:12.169 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T00:11:12.169 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T00:11:12.169 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T00:11:12.169 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T00:11:12.169 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T00:11:12.169 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T00:11:12.169 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T00:11:12.169 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T00:11:12.169 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T00:11:12.169 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T00:11:12.170 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T00:11:12.170 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T00:11:12.170 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T00:11:12.170 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T00:11:12.170 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T00:11:12.170 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T00:11:12.170 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T00:11:12.170 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T00:11:12.170 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T00:11:12.170 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T00:11:12.170 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T00:11:12.170 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T00:11:12.170 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T00:11:12.170 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T00:11:12.171 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 243/287 2024-09-12T00:11:12.171 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T00:11:12.171 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T00:11:12.171 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T00:11:12.171 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T00:11:12.171 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T00:11:12.171 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T00:11:12.171 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T00:11:12.171 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T00:11:12.171 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T00:11:12.171 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T00:11:12.171 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T00:11:12.171 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T00:11:12.171 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T00:11:12.172 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T00:11:12.172 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T00:11:12.172 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T00:11:12.172 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T00:11:12.172 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T00:11:12.172 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T00:11:12.172 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T00:11:12.172 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T00:11:12.172 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T00:11:12.172 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T00:11:12.172 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T00:11:12.172 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T00:11:12.172 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T00:11:12.172 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T00:11:12.173 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T00:11:12.173 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T00:11:12.173 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T00:11:12.173 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T00:11:12.173 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T00:11:12.173 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T00:11:12.173 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T00:11:12.173 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T00:11:12.173 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T00:11:12.173 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T00:11:12.174 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T00:11:12.174 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T00:11:12.174 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T00:11:12.174 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:11:12.174 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T00:11:12.174 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 286/287 2024-09-12T00:11:13.651 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:11:13.651 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:13.651 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2024-09-12T00:11:13.651 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.651 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.651 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-12T00:11:13.652 INFO:teuthology.orchestra.run.smithi160.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T00:11:13.652 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:11:13.652 INFO:teuthology.orchestra.run.smithi160.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T00:11:13.652 INFO:teuthology.orchestra.run.smithi160.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T00:11:13.652 INFO:teuthology.orchestra.run.smithi160.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T00:11:13.652 INFO:teuthology.orchestra.run.smithi160.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T00:11:13.652 INFO:teuthology.orchestra.run.smithi160.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T00:11:13.652 INFO:teuthology.orchestra.run.smithi160.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T00:11:13.652 INFO:teuthology.orchestra.run.smithi160.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T00:11:13.652 INFO:teuthology.orchestra.run.smithi160.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T00:11:13.652 INFO:teuthology.orchestra.run.smithi160.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T00:11:13.653 INFO:teuthology.orchestra.run.smithi160.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T00:11:13.653 INFO:teuthology.orchestra.run.smithi160.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T00:11:13.653 INFO:teuthology.orchestra.run.smithi160.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T00:11:13.653 INFO:teuthology.orchestra.run.smithi160.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T00:11:13.653 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:11:13.653 INFO:teuthology.orchestra.run.smithi160.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T00:11:13.653 INFO:teuthology.orchestra.run.smithi160.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T00:11:13.653 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.653 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.653 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.653 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.653 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:13.654 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.654 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.654 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.654 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:13.654 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:13.654 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:13.654 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:13.654 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:13.654 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.654 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.654 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:13.654 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.655 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.655 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.655 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:13.655 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:13.655 INFO:teuthology.orchestra.run.smithi160.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T00:11:13.655 INFO:teuthology.orchestra.run.smithi160.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T00:11:13.655 INFO:teuthology.orchestra.run.smithi160.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T00:11:13.655 INFO:teuthology.orchestra.run.smithi160.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T00:11:13.656 INFO:teuthology.orchestra.run.smithi160.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T00:11:13.656 INFO:teuthology.orchestra.run.smithi160.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T00:11:13.656 INFO:teuthology.orchestra.run.smithi160.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T00:11:13.656 INFO:teuthology.orchestra.run.smithi160.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T00:11:13.656 INFO:teuthology.orchestra.run.smithi160.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T00:11:13.656 INFO:teuthology.orchestra.run.smithi160.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T00:11:13.656 INFO:teuthology.orchestra.run.smithi160.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T00:11:13.656 INFO:teuthology.orchestra.run.smithi160.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T00:11:13.656 INFO:teuthology.orchestra.run.smithi160.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T00:11:13.656 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:11:13.656 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:11:13.656 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:11:13.657 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:11:13.657 INFO:teuthology.orchestra.run.smithi160.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T00:11:13.657 INFO:teuthology.orchestra.run.smithi160.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T00:11:13.657 INFO:teuthology.orchestra.run.smithi160.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T00:11:13.657 INFO:teuthology.orchestra.run.smithi160.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T00:11:13.657 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:11:13.657 INFO:teuthology.orchestra.run.smithi160.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T00:11:13.657 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:11:13.657 INFO:teuthology.orchestra.run.smithi160.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T00:11:13.657 INFO:teuthology.orchestra.run.smithi160.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T00:11:13.657 INFO:teuthology.orchestra.run.smithi160.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T00:11:13.657 INFO:teuthology.orchestra.run.smithi160.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T00:11:13.657 INFO:teuthology.orchestra.run.smithi160.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T00:11:13.658 INFO:teuthology.orchestra.run.smithi160.stdout: guava-30.1-6.el9.noarch 2024-09-12T00:11:13.658 INFO:teuthology.orchestra.run.smithi160.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T00:11:13.658 INFO:teuthology.orchestra.run.smithi160.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T00:11:13.658 INFO:teuthology.orchestra.run.smithi160.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T00:11:13.658 INFO:teuthology.orchestra.run.smithi160.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T00:11:13.658 INFO:teuthology.orchestra.run.smithi160.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T00:11:13.658 INFO:teuthology.orchestra.run.smithi160.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T00:11:13.658 INFO:teuthology.orchestra.run.smithi160.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:11:13.658 INFO:teuthology.orchestra.run.smithi160.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:11:13.658 INFO:teuthology.orchestra.run.smithi160.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:11:13.659 INFO:teuthology.orchestra.run.smithi160.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T00:11:13.659 INFO:teuthology.orchestra.run.smithi160.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T00:11:13.659 INFO:teuthology.orchestra.run.smithi160.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T00:11:13.659 INFO:teuthology.orchestra.run.smithi160.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T00:11:13.659 INFO:teuthology.orchestra.run.smithi160.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T00:11:13.659 INFO:teuthology.orchestra.run.smithi160.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T00:11:13.659 INFO:teuthology.orchestra.run.smithi160.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T00:11:13.659 INFO:teuthology.orchestra.run.smithi160.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T00:11:13.659 INFO:teuthology.orchestra.run.smithi160.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T00:11:13.659 INFO:teuthology.orchestra.run.smithi160.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T00:11:13.659 INFO:teuthology.orchestra.run.smithi160.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T00:11:13.659 INFO:teuthology.orchestra.run.smithi160.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T00:11:13.659 INFO:teuthology.orchestra.run.smithi160.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T00:11:13.660 INFO:teuthology.orchestra.run.smithi160.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T00:11:13.660 INFO:teuthology.orchestra.run.smithi160.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T00:11:13.660 INFO:teuthology.orchestra.run.smithi160.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T00:11:13.660 INFO:teuthology.orchestra.run.smithi160.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T00:11:13.660 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:11:13.660 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:11:13.660 INFO:teuthology.orchestra.run.smithi160.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T00:11:13.660 INFO:teuthology.orchestra.run.smithi160.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T00:11:13.660 INFO:teuthology.orchestra.run.smithi160.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T00:11:13.661 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.661 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.661 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.661 INFO:teuthology.orchestra.run.smithi160.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T00:11:13.661 INFO:teuthology.orchestra.run.smithi160.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T00:11:13.661 INFO:teuthology.orchestra.run.smithi160.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T00:11:13.661 INFO:teuthology.orchestra.run.smithi160.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T00:11:13.661 INFO:teuthology.orchestra.run.smithi160.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T00:11:13.661 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:11:13.661 INFO:teuthology.orchestra.run.smithi160.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T00:11:13.662 INFO:teuthology.orchestra.run.smithi160.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T00:11:13.662 INFO:teuthology.orchestra.run.smithi160.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T00:11:13.662 INFO:teuthology.orchestra.run.smithi160.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T00:11:13.662 INFO:teuthology.orchestra.run.smithi160.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T00:11:13.662 INFO:teuthology.orchestra.run.smithi160.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T00:11:13.662 INFO:teuthology.orchestra.run.smithi160.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T00:11:13.662 INFO:teuthology.orchestra.run.smithi160.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T00:11:13.662 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:11:13.662 INFO:teuthology.orchestra.run.smithi160.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T00:11:13.662 INFO:teuthology.orchestra.run.smithi160.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T00:11:13.662 INFO:teuthology.orchestra.run.smithi160.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T00:11:13.662 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:11:13.663 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:11:13.663 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:11:13.663 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.663 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.663 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:11:13.663 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.663 INFO:teuthology.orchestra.run.smithi160.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T00:11:13.663 INFO:teuthology.orchestra.run.smithi160.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T00:11:13.663 INFO:teuthology.orchestra.run.smithi160.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T00:11:13.663 INFO:teuthology.orchestra.run.smithi160.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T00:11:13.663 INFO:teuthology.orchestra.run.smithi160.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T00:11:13.663 INFO:teuthology.orchestra.run.smithi160.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T00:11:13.664 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:11:13.664 INFO:teuthology.orchestra.run.smithi160.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T00:11:13.664 INFO:teuthology.orchestra.run.smithi160.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T00:11:13.664 INFO:teuthology.orchestra.run.smithi160.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T00:11:13.664 INFO:teuthology.orchestra.run.smithi160.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T00:11:13.664 INFO:teuthology.orchestra.run.smithi160.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T00:11:13.664 INFO:teuthology.orchestra.run.smithi160.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T00:11:13.664 INFO:teuthology.orchestra.run.smithi160.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T00:11:13.664 INFO:teuthology.orchestra.run.smithi160.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T00:11:13.664 INFO:teuthology.orchestra.run.smithi160.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T00:11:13.665 INFO:teuthology.orchestra.run.smithi160.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T00:11:13.665 INFO:teuthology.orchestra.run.smithi160.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T00:11:13.665 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:11:13.665 INFO:teuthology.orchestra.run.smithi160.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:11:13.665 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:11:13.665 INFO:teuthology.orchestra.run.smithi160.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T00:11:13.665 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:11:13.665 INFO:teuthology.orchestra.run.smithi160.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T00:11:13.665 INFO:teuthology.orchestra.run.smithi160.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T00:11:13.665 INFO:teuthology.orchestra.run.smithi160.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T00:11:13.665 INFO:teuthology.orchestra.run.smithi160.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T00:11:13.665 INFO:teuthology.orchestra.run.smithi160.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T00:11:13.666 INFO:teuthology.orchestra.run.smithi160.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T00:11:13.666 INFO:teuthology.orchestra.run.smithi160.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T00:11:13.666 INFO:teuthology.orchestra.run.smithi160.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T00:11:13.666 INFO:teuthology.orchestra.run.smithi160.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T00:11:13.666 INFO:teuthology.orchestra.run.smithi160.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T00:11:13.666 INFO:teuthology.orchestra.run.smithi160.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T00:11:13.666 INFO:teuthology.orchestra.run.smithi160.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T00:11:13.666 INFO:teuthology.orchestra.run.smithi160.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T00:11:13.666 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:11:13.666 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:11:13.666 INFO:teuthology.orchestra.run.smithi160.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T00:11:13.666 INFO:teuthology.orchestra.run.smithi160.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T00:11:13.667 INFO:teuthology.orchestra.run.smithi160.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T00:11:13.667 INFO:teuthology.orchestra.run.smithi160.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T00:11:13.667 INFO:teuthology.orchestra.run.smithi160.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T00:11:13.667 INFO:teuthology.orchestra.run.smithi160.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T00:11:13.667 INFO:teuthology.orchestra.run.smithi160.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T00:11:13.667 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:11:13.667 INFO:teuthology.orchestra.run.smithi160.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T00:11:13.667 INFO:teuthology.orchestra.run.smithi160.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T00:11:13.667 INFO:teuthology.orchestra.run.smithi160.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T00:11:13.667 INFO:teuthology.orchestra.run.smithi160.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T00:11:13.668 INFO:teuthology.orchestra.run.smithi160.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T00:11:13.668 INFO:teuthology.orchestra.run.smithi160.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T00:11:13.668 INFO:teuthology.orchestra.run.smithi160.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T00:11:13.668 INFO:teuthology.orchestra.run.smithi160.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T00:11:13.668 INFO:teuthology.orchestra.run.smithi160.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T00:11:13.668 INFO:teuthology.orchestra.run.smithi160.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T00:11:13.668 INFO:teuthology.orchestra.run.smithi160.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T00:11:13.668 INFO:teuthology.orchestra.run.smithi160.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T00:11:13.669 INFO:teuthology.orchestra.run.smithi160.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T00:11:13.669 INFO:teuthology.orchestra.run.smithi160.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T00:11:13.669 INFO:teuthology.orchestra.run.smithi160.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T00:11:13.669 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:11:13.669 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:11:13.669 INFO:teuthology.orchestra.run.smithi160.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T00:11:13.669 INFO:teuthology.orchestra.run.smithi160.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T00:11:13.669 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:11:13.669 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:11:13.669 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:11:13.670 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:11:13.670 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.670 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.670 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.670 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:11:13.670 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:11:13.670 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:11:13.670 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:11:13.670 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:11:13.670 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:11:13.670 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:11:13.670 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:11:13.670 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:11:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:11:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:11:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:11:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:11:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:11:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:11:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:11:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:11:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:11:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:11:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:11:13.671 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:11:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:11:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:11:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:11:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:11:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:11:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:11:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:11:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:11:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:11:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:11:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:11:13.672 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:11:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:11:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:11:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:11:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:11:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:11:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:11:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:11:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:11:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:11:13.673 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:11:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:11:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:11:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:11:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:11:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:11:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:11:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:11:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:11:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:11:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:11:13.674 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:11:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:11:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T00:11:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T00:11:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T00:11:13.675 INFO:teuthology.orchestra.run.smithi160.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T00:11:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:11:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T00:11:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:11:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T00:11:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T00:11:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T00:11:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T00:11:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T00:11:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T00:11:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T00:11:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T00:11:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T00:11:13.676 INFO:teuthology.orchestra.run.smithi160.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T00:11:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T00:11:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T00:11:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T00:11:13.677 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:11:13.678 INFO:teuthology.orchestra.run.smithi160.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T00:11:13.678 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:13.678 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-12T00:11:14.098 DEBUG:teuthology.parallel:result is None 2024-09-12T00:11:15.752 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:11:15.753 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:15.753 INFO:teuthology.orchestra.run.smithi133.stdout:Upgraded: 2024-09-12T00:11:15.753 INFO:teuthology.orchestra.run.smithi133.stdout: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.753 INFO:teuthology.orchestra.run.smithi133.stdout: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.753 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-09-12T00:11:15.753 INFO:teuthology.orchestra.run.smithi133.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T00:11:15.753 INFO:teuthology.orchestra.run.smithi133.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:11:15.753 INFO:teuthology.orchestra.run.smithi133.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T00:11:15.753 INFO:teuthology.orchestra.run.smithi133.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T00:11:15.753 INFO:teuthology.orchestra.run.smithi133.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T00:11:15.753 INFO:teuthology.orchestra.run.smithi133.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T00:11:15.754 INFO:teuthology.orchestra.run.smithi133.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T00:11:15.754 INFO:teuthology.orchestra.run.smithi133.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T00:11:15.754 INFO:teuthology.orchestra.run.smithi133.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T00:11:15.754 INFO:teuthology.orchestra.run.smithi133.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T00:11:15.754 INFO:teuthology.orchestra.run.smithi133.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T00:11:15.754 INFO:teuthology.orchestra.run.smithi133.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T00:11:15.754 INFO:teuthology.orchestra.run.smithi133.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T00:11:15.754 INFO:teuthology.orchestra.run.smithi133.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T00:11:15.754 INFO:teuthology.orchestra.run.smithi133.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T00:11:15.754 INFO:teuthology.orchestra.run.smithi133.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:11:15.754 INFO:teuthology.orchestra.run.smithi133.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T00:11:15.754 INFO:teuthology.orchestra.run.smithi133.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T00:11:15.754 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.755 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.755 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.755 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.755 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-grafana-dashboards-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:15.755 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-immutable-object-cache-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.755 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.755 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.755 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:15.755 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:15.755 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:15.755 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:15.755 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:15.755 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.756 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.756 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:15.756 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.756 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.756 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.756 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:15.756 INFO:teuthology.orchestra.run.smithi133.stdout: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:11:15.756 INFO:teuthology.orchestra.run.smithi133.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T00:11:15.756 INFO:teuthology.orchestra.run.smithi133.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T00:11:15.756 INFO:teuthology.orchestra.run.smithi133.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T00:11:15.756 INFO:teuthology.orchestra.run.smithi133.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T00:11:15.756 INFO:teuthology.orchestra.run.smithi133.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T00:11:15.756 INFO:teuthology.orchestra.run.smithi133.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T00:11:15.757 INFO:teuthology.orchestra.run.smithi133.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T00:11:15.757 INFO:teuthology.orchestra.run.smithi133.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T00:11:15.757 INFO:teuthology.orchestra.run.smithi133.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T00:11:15.757 INFO:teuthology.orchestra.run.smithi133.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T00:11:15.757 INFO:teuthology.orchestra.run.smithi133.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T00:11:15.757 INFO:teuthology.orchestra.run.smithi133.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T00:11:15.757 INFO:teuthology.orchestra.run.smithi133.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T00:11:15.757 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:11:15.757 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:11:15.757 INFO:teuthology.orchestra.run.smithi133.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:11:15.757 INFO:teuthology.orchestra.run.smithi133.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:11:15.757 INFO:teuthology.orchestra.run.smithi133.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T00:11:15.757 INFO:teuthology.orchestra.run.smithi133.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T00:11:15.758 INFO:teuthology.orchestra.run.smithi133.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T00:11:15.758 INFO:teuthology.orchestra.run.smithi133.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T00:11:15.758 INFO:teuthology.orchestra.run.smithi133.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:11:15.758 INFO:teuthology.orchestra.run.smithi133.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T00:11:15.758 INFO:teuthology.orchestra.run.smithi133.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:11:15.758 INFO:teuthology.orchestra.run.smithi133.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T00:11:15.758 INFO:teuthology.orchestra.run.smithi133.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T00:11:15.758 INFO:teuthology.orchestra.run.smithi133.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T00:11:15.758 INFO:teuthology.orchestra.run.smithi133.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T00:11:15.758 INFO:teuthology.orchestra.run.smithi133.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T00:11:15.758 INFO:teuthology.orchestra.run.smithi133.stdout: guava-30.1-6.el9.noarch 2024-09-12T00:11:15.758 INFO:teuthology.orchestra.run.smithi133.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T00:11:15.758 INFO:teuthology.orchestra.run.smithi133.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T00:11:15.758 INFO:teuthology.orchestra.run.smithi133.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T00:11:15.759 INFO:teuthology.orchestra.run.smithi133.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T00:11:15.759 INFO:teuthology.orchestra.run.smithi133.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T00:11:15.759 INFO:teuthology.orchestra.run.smithi133.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T00:11:15.759 INFO:teuthology.orchestra.run.smithi133.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:11:15.759 INFO:teuthology.orchestra.run.smithi133.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:11:15.759 INFO:teuthology.orchestra.run.smithi133.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:11:15.759 INFO:teuthology.orchestra.run.smithi133.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T00:11:15.759 INFO:teuthology.orchestra.run.smithi133.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T00:11:15.759 INFO:teuthology.orchestra.run.smithi133.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T00:11:15.759 INFO:teuthology.orchestra.run.smithi133.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T00:11:15.759 INFO:teuthology.orchestra.run.smithi133.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T00:11:15.759 INFO:teuthology.orchestra.run.smithi133.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T00:11:15.759 INFO:teuthology.orchestra.run.smithi133.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T00:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T00:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T00:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T00:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T00:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T00:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T00:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T00:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T00:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T00:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T00:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T00:11:15.760 INFO:teuthology.orchestra.run.smithi133.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T00:11:15.761 INFO:teuthology.orchestra.run.smithi133.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T00:11:15.761 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.761 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.761 INFO:teuthology.orchestra.run.smithi133.stdout: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.761 INFO:teuthology.orchestra.run.smithi133.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T00:11:15.761 INFO:teuthology.orchestra.run.smithi133.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T00:11:15.761 INFO:teuthology.orchestra.run.smithi133.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T00:11:15.761 INFO:teuthology.orchestra.run.smithi133.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T00:11:15.761 INFO:teuthology.orchestra.run.smithi133.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T00:11:15.761 INFO:teuthology.orchestra.run.smithi133.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:11:15.761 INFO:teuthology.orchestra.run.smithi133.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T00:11:15.761 INFO:teuthology.orchestra.run.smithi133.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T00:11:15.761 INFO:teuthology.orchestra.run.smithi133.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T00:11:15.762 INFO:teuthology.orchestra.run.smithi133.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T00:11:15.762 INFO:teuthology.orchestra.run.smithi133.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T00:11:15.762 INFO:teuthology.orchestra.run.smithi133.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T00:11:15.762 INFO:teuthology.orchestra.run.smithi133.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T00:11:15.762 INFO:teuthology.orchestra.run.smithi133.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T00:11:15.762 INFO:teuthology.orchestra.run.smithi133.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:11:15.762 INFO:teuthology.orchestra.run.smithi133.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T00:11:15.762 INFO:teuthology.orchestra.run.smithi133.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T00:11:15.762 INFO:teuthology.orchestra.run.smithi133.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T00:11:15.762 INFO:teuthology.orchestra.run.smithi133.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:11:15.762 INFO:teuthology.orchestra.run.smithi133.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:11:15.763 INFO:teuthology.orchestra.run.smithi133.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:11:15.763 INFO:teuthology.orchestra.run.smithi133.stdout: librados-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.763 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.763 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:11:15.763 INFO:teuthology.orchestra.run.smithi133.stdout: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.763 INFO:teuthology.orchestra.run.smithi133.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T00:11:15.763 INFO:teuthology.orchestra.run.smithi133.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T00:11:15.763 INFO:teuthology.orchestra.run.smithi133.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T00:11:15.763 INFO:teuthology.orchestra.run.smithi133.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T00:11:15.763 INFO:teuthology.orchestra.run.smithi133.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T00:11:15.763 INFO:teuthology.orchestra.run.smithi133.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T00:11:15.763 INFO:teuthology.orchestra.run.smithi133.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:11:15.764 INFO:teuthology.orchestra.run.smithi133.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T00:11:15.764 INFO:teuthology.orchestra.run.smithi133.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T00:11:15.764 INFO:teuthology.orchestra.run.smithi133.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T00:11:15.764 INFO:teuthology.orchestra.run.smithi133.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T00:11:15.764 INFO:teuthology.orchestra.run.smithi133.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T00:11:15.764 INFO:teuthology.orchestra.run.smithi133.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T00:11:15.764 INFO:teuthology.orchestra.run.smithi133.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T00:11:15.764 INFO:teuthology.orchestra.run.smithi133.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T00:11:15.764 INFO:teuthology.orchestra.run.smithi133.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T00:11:15.764 INFO:teuthology.orchestra.run.smithi133.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T00:11:15.765 INFO:teuthology.orchestra.run.smithi133.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T00:11:15.765 INFO:teuthology.orchestra.run.smithi133.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:11:15.765 INFO:teuthology.orchestra.run.smithi133.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:11:15.765 INFO:teuthology.orchestra.run.smithi133.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:11:15.765 INFO:teuthology.orchestra.run.smithi133.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T00:11:15.765 INFO:teuthology.orchestra.run.smithi133.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:11:15.765 INFO:teuthology.orchestra.run.smithi133.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T00:11:15.765 INFO:teuthology.orchestra.run.smithi133.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T00:11:15.765 INFO:teuthology.orchestra.run.smithi133.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T00:11:15.765 INFO:teuthology.orchestra.run.smithi133.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T00:11:15.765 INFO:teuthology.orchestra.run.smithi133.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T00:11:15.765 INFO:teuthology.orchestra.run.smithi133.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T00:11:15.766 INFO:teuthology.orchestra.run.smithi133.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T00:11:15.766 INFO:teuthology.orchestra.run.smithi133.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T00:11:15.766 INFO:teuthology.orchestra.run.smithi133.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T00:11:15.766 INFO:teuthology.orchestra.run.smithi133.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T00:11:15.766 INFO:teuthology.orchestra.run.smithi133.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T00:11:15.766 INFO:teuthology.orchestra.run.smithi133.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T00:11:15.766 INFO:teuthology.orchestra.run.smithi133.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T00:11:15.766 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:11:15.766 INFO:teuthology.orchestra.run.smithi133.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:11:15.766 INFO:teuthology.orchestra.run.smithi133.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T00:11:15.766 INFO:teuthology.orchestra.run.smithi133.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T00:11:15.766 INFO:teuthology.orchestra.run.smithi133.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T00:11:15.766 INFO:teuthology.orchestra.run.smithi133.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T00:11:15.766 INFO:teuthology.orchestra.run.smithi133.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T00:11:15.767 INFO:teuthology.orchestra.run.smithi133.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T00:11:15.767 INFO:teuthology.orchestra.run.smithi133.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T00:11:15.767 INFO:teuthology.orchestra.run.smithi133.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:11:15.767 INFO:teuthology.orchestra.run.smithi133.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T00:11:15.767 INFO:teuthology.orchestra.run.smithi133.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T00:11:15.767 INFO:teuthology.orchestra.run.smithi133.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T00:11:15.767 INFO:teuthology.orchestra.run.smithi133.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T00:11:15.767 INFO:teuthology.orchestra.run.smithi133.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T00:11:15.768 INFO:teuthology.orchestra.run.smithi133.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T00:11:15.768 INFO:teuthology.orchestra.run.smithi133.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T00:11:15.768 INFO:teuthology.orchestra.run.smithi133.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T00:11:15.768 INFO:teuthology.orchestra.run.smithi133.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T00:11:15.768 INFO:teuthology.orchestra.run.smithi133.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T00:11:15.768 INFO:teuthology.orchestra.run.smithi133.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T00:11:15.768 INFO:teuthology.orchestra.run.smithi133.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T00:11:15.768 INFO:teuthology.orchestra.run.smithi133.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T00:11:15.768 INFO:teuthology.orchestra.run.smithi133.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T00:11:15.768 INFO:teuthology.orchestra.run.smithi133.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T00:11:15.768 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:11:15.768 INFO:teuthology.orchestra.run.smithi133.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:11:15.768 INFO:teuthology.orchestra.run.smithi133.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T00:11:15.768 INFO:teuthology.orchestra.run.smithi133.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T00:11:15.769 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:11:15.769 INFO:teuthology.orchestra.run.smithi133.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:11:15.769 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:11:15.769 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:11:15.769 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.769 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.769 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.769 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:11:15.769 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:11:15.769 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:11:15.769 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:11:15.769 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:11:15.769 INFO:teuthology.orchestra.run.smithi133.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:11:15.770 INFO:teuthology.orchestra.run.smithi133.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:11:15.770 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:11:15.770 INFO:teuthology.orchestra.run.smithi133.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:11:15.770 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:11:15.770 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:11:15.770 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:11:15.771 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:11:15.771 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:11:15.771 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:11:15.771 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:11:15.771 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:11:15.771 INFO:teuthology.orchestra.run.smithi133.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:11:15.771 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:11:15.771 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:11:15.771 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:11:15.772 INFO:teuthology.orchestra.run.smithi133.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:11:15.772 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:11:15.772 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:11:15.772 INFO:teuthology.orchestra.run.smithi133.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:11:15.772 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:11:15.772 INFO:teuthology.orchestra.run.smithi133.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:11:15.772 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:11:15.772 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:11:15.772 INFO:teuthology.orchestra.run.smithi133.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:11:15.772 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:11:15.772 INFO:teuthology.orchestra.run.smithi133.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:11:15.772 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:11:15.772 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:11:15.773 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:11:15.773 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:11:15.773 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:11:15.773 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.773 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.773 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:11:15.773 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:11:15.773 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:11:15.773 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.773 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:11:15.773 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:11:15.773 INFO:teuthology.orchestra.run.smithi133.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:11:15.773 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:11:15.774 INFO:teuthology.orchestra.run.smithi133.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:11:15.774 INFO:teuthology.orchestra.run.smithi133.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:11:15.774 INFO:teuthology.orchestra.run.smithi133.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:11:15.774 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:11:15.774 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:11:15.774 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:11:15.774 INFO:teuthology.orchestra.run.smithi133.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:11:15.774 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:11:15.774 INFO:teuthology.orchestra.run.smithi133.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:11:15.774 INFO:teuthology.orchestra.run.smithi133.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:11:15.774 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.774 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.774 INFO:teuthology.orchestra.run.smithi133.stdout: rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:11:15.774 INFO:teuthology.orchestra.run.smithi133.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:11:15.775 INFO:teuthology.orchestra.run.smithi133.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T00:11:15.775 INFO:teuthology.orchestra.run.smithi133.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T00:11:15.775 INFO:teuthology.orchestra.run.smithi133.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T00:11:15.775 INFO:teuthology.orchestra.run.smithi133.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T00:11:15.775 INFO:teuthology.orchestra.run.smithi133.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:11:15.775 INFO:teuthology.orchestra.run.smithi133.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T00:11:15.775 INFO:teuthology.orchestra.run.smithi133.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:11:15.775 INFO:teuthology.orchestra.run.smithi133.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T00:11:15.775 INFO:teuthology.orchestra.run.smithi133.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T00:11:15.775 INFO:teuthology.orchestra.run.smithi133.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T00:11:15.775 INFO:teuthology.orchestra.run.smithi133.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T00:11:15.775 INFO:teuthology.orchestra.run.smithi133.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T00:11:15.775 INFO:teuthology.orchestra.run.smithi133.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T00:11:15.775 INFO:teuthology.orchestra.run.smithi133.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T00:11:15.775 INFO:teuthology.orchestra.run.smithi133.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T00:11:15.776 INFO:teuthology.orchestra.run.smithi133.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T00:11:15.776 INFO:teuthology.orchestra.run.smithi133.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T00:11:15.776 INFO:teuthology.orchestra.run.smithi133.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T00:11:15.776 INFO:teuthology.orchestra.run.smithi133.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T00:11:15.776 INFO:teuthology.orchestra.run.smithi133.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T00:11:15.776 INFO:teuthology.orchestra.run.smithi133.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:11:15.776 INFO:teuthology.orchestra.run.smithi133.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T00:11:15.776 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:15.776 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-09-12T00:11:16.181 DEBUG:teuthology.parallel:result is None 2024-09-12T00:11:16.182 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:11:16.344 DEBUG:teuthology.orchestra.run.smithi133:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:11:16.408 INFO:teuthology.orchestra.run.smithi133.stdout:19.3.0-4753.gd011c522.el9 2024-09-12T00:11:16.409 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753.gd011c522.el9 2024-09-12T00:11:16.409 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753.gd011c522 is installed. 2024-09-12T00:11:16.411 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:11:16.561 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:11:16.632 INFO:teuthology.orchestra.run.smithi160.stdout:19.3.0-4753.gd011c522.el9 2024-09-12T00:11:16.632 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753.gd011c522.el9 2024-09-12T00:11:16.632 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753.gd011c522 is installed. 2024-09-12T00:11:16.634 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:11:16.634 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:16.634 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:11:16.674 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:11:16.674 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:11:16.722 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:11:16.722 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:16.722 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:11:16.760 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:11:16.840 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:11:16.841 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:11:16.882 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:11:16.964 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:11:16.964 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:16.964 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:11:17.003 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:11:17.083 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:11:17.084 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:11:17.125 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:11:17.206 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:11:17.207 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:17.207 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:11:17.246 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:11:17.326 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:11:17.327 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:11:17.366 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:11:17.445 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:11:17.867 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:11:17.867 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2024-09-12T00:11:17.870 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /var/log/ceph 2024-09-12T00:11:17.910 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:11:17.910 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:11:17.953 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:11:17.992 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:11:17.992 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:11:18.033 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:11:18.383 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:11:18.383 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:11:18.383 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901839', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7901839', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi133.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ2ubMwIyAKgco9wENXPWHa7DRoqwwUhP9QQ2m4CS4TeAj0dTUjQjZZMs7HDuQvFMy4sn/nsT31PkbusXAlj/o8=', 'smithi160.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNaKUeMym1fAd3oT7E21zpytXgEmXJc9aV4DkAqfkLs3gg+Kj+M6vQ8ixZifHBtIoFLTWvY+YjzsPkKt88MEMiM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:11:18.384 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:11:18.387 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:11:18.416 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:11:18.456 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:11:18.494 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:18.495 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:11:18.562 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:11:18.562 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2024-09-12T00:11:18.630 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:11:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:11:18.631 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T00:11:18.631 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:11:18.631 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:11:18.631 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-09-12 00:11:03.476986885 +0000 2024-09-12T00:11:18.631 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-09-12 00:08:41.120600366 +0000 2024-09-12T00:11:18.631 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-09-12 00:08:41.120600366 +0000 2024-09-12T00:11:18.631 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-09-12 00:08:41.120600366 +0000 2024-09-12T00:11:18.632 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:11:18.708 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-09-12T00:11:18.708 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-09-12T00:11:18.709 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000237426 s, 2.2 MB/s 2024-09-12T00:11:18.710 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:11:18.779 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2024-09-12T00:11:18.849 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:11:18.849 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:11:18.849 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-09-12T00:11:18.849 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:11:18.849 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:11:18.849 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-09-12 00:11:03.476986885 +0000 2024-09-12T00:11:18.849 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-09-12 00:08:41.435594777 +0000 2024-09-12T00:11:18.850 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-09-12 00:08:41.435594777 +0000 2024-09-12T00:11:18.850 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-09-12 00:08:41.435594777 +0000 2024-09-12T00:11:18.850 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:11:18.926 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-09-12T00:11:18.927 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-09-12T00:11:18.927 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000187314 s, 2.7 MB/s 2024-09-12T00:11:18.928 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:11:18.998 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2024-09-12T00:11:19.067 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:11:19.068 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:11:19.068 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 707 Links: 1 2024-09-12T00:11:19.068 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:11:19.068 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:11:19.068 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-09-12 00:11:03.477986868 +0000 2024-09-12T00:11:19.068 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-09-12 00:08:41.743589313 +0000 2024-09-12T00:11:19.068 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-09-12 00:08:41.743589313 +0000 2024-09-12T00:11:19.068 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-09-12 00:08:41.743589313 +0000 2024-09-12T00:11:19.068 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:11:19.145 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-09-12T00:11:19.145 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-09-12T00:11:19.145 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000185196 s, 2.8 MB/s 2024-09-12T00:11:19.146 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:11:19.216 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2024-09-12T00:11:19.285 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:11:19.285 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:11:19.285 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T00:11:19.285 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:11:19.285 INFO:teuthology.orchestra.run.smithi133.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:11:19.285 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2024-09-12 00:11:03.477986868 +0000 2024-09-12T00:11:19.285 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2024-09-12 00:08:42.059583707 +0000 2024-09-12T00:11:19.285 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2024-09-12 00:08:42.059583707 +0000 2024-09-12T00:11:19.285 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2024-09-12 00:08:42.059583707 +0000 2024-09-12T00:11:19.286 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:11:19.365 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2024-09-12T00:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2024-09-12T00:11:19.366 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000213646 s, 2.4 MB/s 2024-09-12T00:11:19.366 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:11:19.436 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:11:19.436 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:11:19.436 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:11:19.474 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:11:19.475 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 2024-09-12T00:11:19.548 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:11:19.548 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:11:19.548 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T00:11:19.548 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:11:19.548 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:11:19.548 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-12 00:11:01.392158663 +0000 2024-09-12T00:11:19.548 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-12 00:08:41.975775294 +0000 2024-09-12T00:11:19.548 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-12 00:08:41.975775294 +0000 2024-09-12T00:11:19.548 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-12 00:08:41.975775294 +0000 2024-09-12T00:11:19.549 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:11:19.629 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-12T00:11:19.629 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-12T00:11:19.629 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000275408 s, 1.9 MB/s 2024-09-12T00:11:19.630 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:11:19.704 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 2024-09-12T00:11:19.775 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:11:19.775 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:11:19.775 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T00:11:19.775 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:11:19.775 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:11:19.776 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-12 00:11:01.392158663 +0000 2024-09-12T00:11:19.776 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-12 00:08:42.317770745 +0000 2024-09-12T00:11:19.776 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-12 00:08:42.317770745 +0000 2024-09-12T00:11:19.776 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-12 00:08:42.317770745 +0000 2024-09-12T00:11:19.776 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:11:19.856 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-12T00:11:19.856 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-12T00:11:19.856 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000216316 s, 2.4 MB/s 2024-09-12T00:11:19.857 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:11:19.928 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 2024-09-12T00:11:19.996 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:11:19.997 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:11:19.997 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T00:11:19.997 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:11:19.997 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:11:19.997 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-12 00:11:01.393158649 +0000 2024-09-12T00:11:19.997 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-12 00:08:42.640766449 +0000 2024-09-12T00:11:19.997 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-12 00:08:42.640766449 +0000 2024-09-12T00:11:19.997 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-12 00:08:42.640766449 +0000 2024-09-12T00:11:19.997 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:11:20.073 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-12T00:11:20.073 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-12T00:11:20.074 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000208065 s, 2.5 MB/s 2024-09-12T00:11:20.075 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:11:20.145 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 2024-09-12T00:11:20.214 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:11:20.214 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:11:20.214 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T00:11:20.214 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:11:20.214 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:11:20.215 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-12 00:11:01.393158649 +0000 2024-09-12T00:11:20.215 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-12 00:08:42.975761994 +0000 2024-09-12T00:11:20.215 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-12 00:08:42.975761994 +0000 2024-09-12T00:11:20.215 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-12 00:08:42.975761994 +0000 2024-09-12T00:11:20.215 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:11:20.292 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-12T00:11:20.293 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-12T00:11:20.293 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000210637 s, 2.4 MB/s 2024-09-12T00:11:20.294 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:11:20.365 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:11:20.366 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:11:20.366 INFO:tasks.ceph:Generating config... 2024-09-12T00:11:20.367 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T00:11:20.367 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T00:11:20.367 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T00:11:20.367 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T00:11:20.367 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T00:11:20.367 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:11:20.368 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T00:11:20.368 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-12T00:11:20.368 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-12T00:11:20.368 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-12T00:11:20.368 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T00:11:20.368 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T00:11:20.368 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T00:11:20.368 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T00:11:20.368 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T00:11:20.368 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T00:11:20.368 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T00:11:20.369 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T00:11:20.369 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T00:11:20.369 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-12T00:11:20.369 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T00:11:20.369 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T00:11:20.369 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-09-12T00:11:20.369 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:11:20.369 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:11:20.369 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:11:20.369 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:11:20.369 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:11:20.369 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-12T00:11:20.369 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:11:20.369 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:11:20.370 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:11:20.370 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:11:20.370 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:11:20.370 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:11:20.370 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:11:20.370 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:11:20.370 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T00:11:20.370 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:11:20.370 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:11:20.370 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:11:20.370 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:11:20.371 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:11:20.371 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:11:20.371 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-12T00:11:20.371 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:11:20.371 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T00:11:20.371 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:11:20.371 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:11:20.444 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:11:20.448 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:11:20.509 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:11:20.549 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.133'), ('mon.c', '[v2:172.21.15.133:3301,v1:172.21.15.133:6790]'), ('mon.b', '172.21.15.160')] 2024-09-12T00:11:20.549 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.133,[v2:172.21.15.133:3301,v1:172.21.15.133:6790],172.21.15.160', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T00:11:20.550 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:20.550 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:11:20.618 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.133 --addv c '[v2:172.21.15.133:3301,v1:172.21.15.133:6790]' --add b 172.21.15.160 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:20.720 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:11:20.720 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:11:20.721 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:20.721 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: generated fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:11:20.721 INFO:teuthology.orchestra.run.smithi133.stdout:setting min_mon_release = quincy 2024-09-12T00:11:20.721 INFO:teuthology.orchestra.run.smithi133.stdout:epoch 0 2024-09-12T00:11:20.721 INFO:teuthology.orchestra.run.smithi133.stdout:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:11:20.721 INFO:teuthology.orchestra.run.smithi133.stdout:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:11:20.721 INFO:teuthology.orchestra.run.smithi133.stdout:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:11:20.721 INFO:teuthology.orchestra.run.smithi133.stdout:min_mon_release 17 (quincy) 2024-09-12T00:11:20.721 INFO:teuthology.orchestra.run.smithi133.stdout:election_strategy: 1 2024-09-12T00:11:20.721 INFO:teuthology.orchestra.run.smithi133.stdout:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:11:20.721 INFO:teuthology.orchestra.run.smithi133.stdout:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:11:20.721 INFO:teuthology.orchestra.run.smithi133.stdout:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:11:20.722 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T00:11:20.723 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:11:20.752 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9d5b883a-c64b-4bbd-824a-b1076948973e... 2024-09-12T00:11:20.753 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:11:20.795 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:11:20.850 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2024-09-12T00:11:20.850 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2024-09-12T00:11:20.850 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:11:20.850 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2024-09-12T00:11:20.850 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.850 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2024-09-12T00:11:20.850 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.850 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2024-09-12T00:11:20.850 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.850 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2024-09-12T00:11:20.851 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2024-09-12T00:11:20.851 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.851 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2024-09-12T00:11:20.851 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2024-09-12T00:11:20.851 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.851 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:11:20.851 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2024-09-12T00:11:20.851 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.851 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:11:20.851 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:11:20.851 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.851 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2024-09-12T00:11:20.851 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.852 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2024-09-12T00:11:20.852 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2024-09-12T00:11:20.852 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:11:20.852 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:11:20.852 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2024-09-12T00:11:20.852 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:11:20.852 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2024-09-12T00:11:20.852 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:11:20.852 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:11:20.852 INFO:teuthology.orchestra.run.smithi133.stdout: mon_allow_pool_size_one = true 2024-09-12T00:11:20.852 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.852 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:11:20.852 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.853 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2024-09-12T00:11:20.853 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.853 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2024-09-12T00:11:20.853 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.853 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2024-09-12T00:11:20.853 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2024-09-12T00:11:20.853 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2024-09-12T00:11:20.853 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.133,[v2:172.21.15.133:3301,v1:172.21.15.133:6790],172.21.15.160" 2024-09-12T00:11:20.853 INFO:teuthology.orchestra.run.smithi133.stdout: mon client directed command retry = 5 2024-09-12T00:11:20.853 INFO:teuthology.orchestra.run.smithi133.stdout: ms inject socket failures = 5000 2024-09-12T00:11:20.853 INFO:teuthology.orchestra.run.smithi133.stdout: osd heartbeat grace = 40 2024-09-12T00:11:20.853 INFO:teuthology.orchestra.run.smithi133.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:11:20.853 INFO:teuthology.orchestra.run.smithi133.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:11:20.853 INFO:teuthology.orchestra.run.smithi133.stdout: rgw override bucket index max shards = 1 2024-09-12T00:11:20.854 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:11:20.854 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.854 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2024-09-12T00:11:20.854 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2024-09-12T00:11:20.854 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.854 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2024-09-12T00:11:20.854 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2024-09-12T00:11:20.854 INFO:teuthology.orchestra.run.smithi133.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:11:20.854 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.854 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2024-09-12T00:11:20.854 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2024-09-12T00:11:20.854 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.854 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2024-09-12T00:11:20.854 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2024-09-12T00:11:20.855 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2024-09-12T00:11:20.855 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug trim objects = true 2024-09-12T00:11:20.855 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.855 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2024-09-12T00:11:20.855 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2024-09-12T00:11:20.855 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.855 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:11:20.855 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.855 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2024-09-12T00:11:20.855 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.855 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2024-09-12T00:11:20.855 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.855 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:11:20.855 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2024-09-12T00:11:20.856 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.856 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2024-09-12T00:11:20.856 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2024-09-12T00:11:20.856 INFO:teuthology.orchestra.run.smithi133.stdout: bdev async discard = True 2024-09-12T00:11:20.856 INFO:teuthology.orchestra.run.smithi133.stdout: bdev enable discard = True 2024-09-12T00:11:20.856 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore allocator = bitmap 2024-09-12T00:11:20.856 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2024-09-12T00:11:20.856 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2024-09-12T00:11:20.856 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 1/20 2024-09-12T00:11:20.856 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 1/20 2024-09-12T00:11:20.856 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-09-12T00:11:20.857 INFO:teuthology.orchestra.run.smithi133.stdout: debug objclass = 20 2024-09-12T00:11:20.857 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 20 2024-09-12T00:11:20.857 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 4/10 2024-09-12T00:11:20.857 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:11:20.857 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2024-09-12T00:11:20.857 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:11:20.857 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:11:20.857 INFO:teuthology.orchestra.run.smithi133.stdout: osd fast shutdown = False 2024-09-12T00:11:20.857 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2024-09-12T00:11:20.857 INFO:teuthology.orchestra.run.smithi133.stdout: osd shutdown pgref assert = True 2024-09-12T00:11:20.857 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.857 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2024-09-12T00:11:20.857 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-09-12T00:11:20.857 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2024-09-12T00:11:20.858 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-09-12T00:11:20.858 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-09-12T00:11:20.858 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:11:20.858 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:11:20.858 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2024-09-12T00:11:20.858 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.858 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2024-09-12T00:11:20.858 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2024-09-12T00:11:20.858 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2024-09-12T00:11:20.858 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2024-09-12T00:11:20.858 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2024-09-12T00:11:20.858 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2024-09-12T00:11:20.858 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2024-09-12T00:11:20.859 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:11:20.859 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2024-09-12T00:11:20.859 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2024-09-12T00:11:20.859 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:11:20.859 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.859 INFO:teuthology.orchestra.run.smithi133.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:11:20.859 INFO:teuthology.orchestra.run.smithi133.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:11:20.859 INFO:teuthology.orchestra.run.smithi133.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:11:20.859 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.859 INFO:teuthology.orchestra.run.smithi133.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:11:20.859 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:11:20.859 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:11:20.859 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.859 INFO:teuthology.orchestra.run.smithi133.stdout: # 1m isn't quite enough 2024-09-12T00:11:20.860 INFO:teuthology.orchestra.run.smithi133.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:11:20.860 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.860 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:11:20.860 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd crush smoke test = False 2024-09-12T00:11:20.860 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:11:20.860 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2024-09-12T00:11:20.860 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2024-09-12T00:11:20.860 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = True 2024-09-12T00:11:20.860 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2024-09-12T00:11:20.860 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:11:20.860 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:11:20.860 INFO:teuthology.orchestra.run.smithi133.stdout: debug rgw = 20 2024-09-12T00:11:20.860 INFO:teuthology.orchestra.run.smithi133.stdout: debug rgw notification = 20 2024-09-12T00:11:20.860 INFO:teuthology.orchestra.run.smithi133.stdout: rgw bucket counters cache = True 2024-09-12T00:11:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: rgw crypt require ssl = False 2024-09-12T00:11:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:11:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:11:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T00:11:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T00:11:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T00:11:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:11:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: rgw s3 auth use sts = True 2024-09-12T00:11:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:11:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: rgw torrent flag = True 2024-09-12T00:11:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: rgw user counters cache = True 2024-09-12T00:11:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: setgroup = ceph 2024-09-12T00:11:20.861 INFO:teuthology.orchestra.run.smithi133.stdout: setuser = ceph 2024-09-12T00:11:20.861 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2024-09-12T00:11:20.862 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2024-09-12T00:11:20.862 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2024-09-12T00:11:20.862 INFO:teuthology.orchestra.run.smithi160.stdout:[global] 2024-09-12T00:11:20.862 INFO:teuthology.orchestra.run.smithi160.stdout: chdir = "" 2024-09-12T00:11:20.862 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:11:20.863 INFO:teuthology.orchestra.run.smithi160.stdout: auth supported = cephx 2024-09-12T00:11:20.863 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.863 INFO:teuthology.orchestra.run.smithi160.stdout: filestore xattr use omap = true 2024-09-12T00:11:20.863 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.863 INFO:teuthology.orchestra.run.smithi160.stdout: mon clock drift allowed = 1.000 2024-09-12T00:11:20.863 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.863 INFO:teuthology.orchestra.run.smithi160.stdout: osd crush chooseleaf type = 0 2024-09-12T00:11:20.863 INFO:teuthology.orchestra.run.smithi160.stdout: auth debug = true 2024-09-12T00:11:20.863 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.863 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on old message = true 2024-09-12T00:11:20.863 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on bug = true 2024-09-12T00:11:20.863 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.863 INFO:teuthology.orchestra.run.smithi160.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:11:20.863 INFO:teuthology.orchestra.run.smithi160.stdout: mon pg warn max object skew = 0 2024-09-12T00:11:20.864 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.864 INFO:teuthology.orchestra.run.smithi160.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:11:20.864 INFO:teuthology.orchestra.run.smithi160.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:11:20.864 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.864 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default size = 2 2024-09-12T00:11:20.864 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.864 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow primary affinity = true 2024-09-12T00:11:20.864 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow pg remap = true 2024-09-12T00:11:20.864 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:11:20.864 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:11:20.864 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on no sortbitwise = false 2024-09-12T00:11:20.864 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:11:20.864 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on too few osds = false 2024-09-12T00:11:20.865 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:11:20.865 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:11:20.865 INFO:teuthology.orchestra.run.smithi160.stdout: mon_allow_pool_size_one = true 2024-09-12T00:11:20.865 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.865 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:11:20.865 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.865 INFO:teuthology.orchestra.run.smithi160.stdout: osd default data pool replay window = 5 2024-09-12T00:11:20.865 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.865 INFO:teuthology.orchestra.run.smithi160.stdout: mon allow pool delete = true 2024-09-12T00:11:20.865 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.865 INFO:teuthology.orchestra.run.smithi160.stdout: mon cluster log file level = debug 2024-09-12T00:11:20.865 INFO:teuthology.orchestra.run.smithi160.stdout: debug asserts on shutdown = true 2024-09-12T00:11:20.865 INFO:teuthology.orchestra.run.smithi160.stdout: mon health detail to clog = false 2024-09-12T00:11:20.865 INFO:teuthology.orchestra.run.smithi160.stdout: mon host = "172.21.15.133,[v2:172.21.15.133:3301,v1:172.21.15.133:6790],172.21.15.160" 2024-09-12T00:11:20.866 INFO:teuthology.orchestra.run.smithi160.stdout: mon client directed command retry = 5 2024-09-12T00:11:20.866 INFO:teuthology.orchestra.run.smithi160.stdout: ms inject socket failures = 5000 2024-09-12T00:11:20.866 INFO:teuthology.orchestra.run.smithi160.stdout: osd heartbeat grace = 40 2024-09-12T00:11:20.866 INFO:teuthology.orchestra.run.smithi160.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:11:20.866 INFO:teuthology.orchestra.run.smithi160.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:11:20.866 INFO:teuthology.orchestra.run.smithi160.stdout: rgw override bucket index max shards = 1 2024-09-12T00:11:20.866 INFO:teuthology.orchestra.run.smithi160.stdout: fsid = 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:11:20.866 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.866 INFO:teuthology.orchestra.run.smithi160.stdout:[osd] 2024-09-12T00:11:20.866 INFO:teuthology.orchestra.run.smithi160.stdout: osd journal size = 100 2024-09-12T00:11:20.866 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.866 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub load threshold = 5.0 2024-09-12T00:11:20.866 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub max interval = 600 2024-09-12T00:11:20.867 INFO:teuthology.orchestra.run.smithi160.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:11:20.867 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.867 INFO:teuthology.orchestra.run.smithi160.stdout: osd recover clone overlap = true 2024-09-12T00:11:20.867 INFO:teuthology.orchestra.run.smithi160.stdout: osd recovery max chunk = 1048576 2024-09-12T00:11:20.867 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.867 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug shutdown = true 2024-09-12T00:11:20.867 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug op order = true 2024-09-12T00:11:20.867 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug verify stray on activate = true 2024-09-12T00:11:20.867 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug trim objects = true 2024-09-12T00:11:20.867 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.867 INFO:teuthology.orchestra.run.smithi160.stdout: osd open classes on start = true 2024-09-12T00:11:20.867 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug pg log writeout = true 2024-09-12T00:11:20.867 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.867 INFO:teuthology.orchestra.run.smithi160.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:11:20.868 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.868 INFO:teuthology.orchestra.run.smithi160.stdout: osd map max advance = 10 2024-09-12T00:11:20.868 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.868 INFO:teuthology.orchestra.run.smithi160.stdout: journal zero on create = true 2024-09-12T00:11:20.868 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.868 INFO:teuthology.orchestra.run.smithi160.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:11:20.868 INFO:teuthology.orchestra.run.smithi160.stdout: filestore apply finisher threads = 3 2024-09-12T00:11:20.868 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.868 INFO:teuthology.orchestra.run.smithi160.stdout: bdev debug aio = true 2024-09-12T00:11:20.868 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug misdirected ops = true 2024-09-12T00:11:20.868 INFO:teuthology.orchestra.run.smithi160.stdout: bdev async discard = True 2024-09-12T00:11:20.868 INFO:teuthology.orchestra.run.smithi160.stdout: bdev enable discard = True 2024-09-12T00:11:20.868 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore allocator = bitmap 2024-09-12T00:11:20.868 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore block size = 96636764160 2024-09-12T00:11:20.869 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore fsck on mount = True 2024-09-12T00:11:20.869 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluefs = 1/20 2024-09-12T00:11:20.869 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluestore = 1/20 2024-09-12T00:11:20.869 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-09-12T00:11:20.869 INFO:teuthology.orchestra.run.smithi160.stdout: debug objclass = 20 2024-09-12T00:11:20.869 INFO:teuthology.orchestra.run.smithi160.stdout: debug osd = 20 2024-09-12T00:11:20.869 INFO:teuthology.orchestra.run.smithi160.stdout: debug rocksdb = 4/10 2024-09-12T00:11:20.869 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:11:20.869 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd full ratio = 0.9 2024-09-12T00:11:20.869 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:11:20.869 INFO:teuthology.orchestra.run.smithi160.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:11:20.869 INFO:teuthology.orchestra.run.smithi160.stdout: osd fast shutdown = False 2024-09-12T00:11:20.869 INFO:teuthology.orchestra.run.smithi160.stdout: osd objectstore = bluestore 2024-09-12T00:11:20.869 INFO:teuthology.orchestra.run.smithi160.stdout: osd shutdown pgref assert = True 2024-09-12T00:11:20.870 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.870 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr] 2024-09-12T00:11:20.870 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-09-12T00:11:20.870 INFO:teuthology.orchestra.run.smithi160.stdout: debug mgr = 20 2024-09-12T00:11:20.870 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2024-09-12T00:11:20.870 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2024-09-12T00:11:20.870 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:11:20.870 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:11:20.870 INFO:teuthology.orchestra.run.smithi160.stdout: mgr/telemetry/nag = false 2024-09-12T00:11:20.870 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.870 INFO:teuthology.orchestra.run.smithi160.stdout:[mon] 2024-09-12T00:11:20.870 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-09-12T00:11:20.870 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2024-09-12T00:11:20.870 INFO:teuthology.orchestra.run.smithi160.stdout: debug paxos = 20 2024-09-12T00:11:20.871 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2024-09-12T00:11:20.871 INFO:teuthology.orchestra.run.smithi160.stdout: mon data avail warn = 5 2024-09-12T00:11:20.871 INFO:teuthology.orchestra.run.smithi160.stdout: mon mgr mkfs grace = 240 2024-09-12T00:11:20.871 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:11:20.871 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd reporter subtree level = osd 2024-09-12T00:11:20.871 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd prime pg temp = true 2024-09-12T00:11:20.871 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:11:20.871 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.871 INFO:teuthology.orchestra.run.smithi160.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:11:20.871 INFO:teuthology.orchestra.run.smithi160.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:11:20.871 INFO:teuthology.orchestra.run.smithi160.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:11:20.871 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.872 INFO:teuthology.orchestra.run.smithi160.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:11:20.872 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:11:20.872 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:11:20.872 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.872 INFO:teuthology.orchestra.run.smithi160.stdout: # 1m isn't quite enough 2024-09-12T00:11:20.872 INFO:teuthology.orchestra.run.smithi160.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:11:20.872 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.872 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:11:20.872 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd crush smoke test = False 2024-09-12T00:11:20.872 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-12T00:11:20.872 INFO:teuthology.orchestra.run.smithi160.stdout:[client] 2024-09-12T00:11:20.872 INFO:teuthology.orchestra.run.smithi160.stdout: rgw cache enabled = true 2024-09-12T00:11:20.873 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable ops log = True 2024-09-12T00:11:20.873 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable usage log = true 2024-09-12T00:11:20.873 INFO:teuthology.orchestra.run.smithi160.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:11:20.873 INFO:teuthology.orchestra.run.smithi160.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:11:20.873 INFO:teuthology.orchestra.run.smithi160.stdout: debug rgw = 20 2024-09-12T00:11:20.873 INFO:teuthology.orchestra.run.smithi160.stdout: debug rgw notification = 20 2024-09-12T00:11:20.873 INFO:teuthology.orchestra.run.smithi160.stdout: rgw bucket counters cache = True 2024-09-12T00:11:20.873 INFO:teuthology.orchestra.run.smithi160.stdout: rgw crypt require ssl = False 2024-09-12T00:11:20.873 INFO:teuthology.orchestra.run.smithi160.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:11:20.873 INFO:teuthology.orchestra.run.smithi160.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:11:20.873 INFO:teuthology.orchestra.run.smithi160.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-12T00:11:20.873 INFO:teuthology.orchestra.run.smithi160.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-12T00:11:20.873 INFO:teuthology.orchestra.run.smithi160.stdout: rgw d3n l1 local datacache enabled = True 2024-09-12T00:11:20.873 INFO:teuthology.orchestra.run.smithi160.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:11:20.874 INFO:teuthology.orchestra.run.smithi160.stdout: rgw s3 auth use sts = True 2024-09-12T00:11:20.874 INFO:teuthology.orchestra.run.smithi160.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:11:20.874 INFO:teuthology.orchestra.run.smithi160.stdout: rgw torrent flag = True 2024-09-12T00:11:20.874 INFO:teuthology.orchestra.run.smithi160.stdout: rgw user counters cache = True 2024-09-12T00:11:20.874 INFO:teuthology.orchestra.run.smithi160.stdout: setgroup = ceph 2024-09-12T00:11:20.874 INFO:teuthology.orchestra.run.smithi160.stdout: setuser = ceph 2024-09-12T00:11:20.874 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.a] 2024-09-12T00:11:20.874 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.c] 2024-09-12T00:11:20.874 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.b] 2024-09-12T00:11:20.876 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:11:20.876 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:11:20.945 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:11:20.945 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:20.945 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:11:20.974 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:20.974 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:11:21.044 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2024-09-12T00:11:21.044 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:21.044 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:11:21.045 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:11:21.134 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:21.134 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:21.203 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi160.front.sepia.ceph.com 2024-09-12T00:11:21.203 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:11:21.203 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:11:21.203 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:11:21.254 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:11:21.254 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:21.322 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:11:21.322 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:11:21.322 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:11:21.387 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:11:21.390 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:11:21.464 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:11:21.467 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:11:21.467 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:11:21.467 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:11:21.522 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:11:21.535 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T00:11:21.592 INFO:teuthology.orchestra.run.smithi160.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T00:11:21.605 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:11:21.605 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:11:21.605 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:11:21.644 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:11:21.644 INFO:tasks.ceph:role: osd.0 2024-09-12T00:11:21.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2024-09-12T00:11:21.645 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:11:21.731 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:11:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:11:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:11:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:11:21.731 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:11:21.731 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:11:21.731 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:11:21.732 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:11:21.732 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:11:21.732 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:11:22.228 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-09-12T00:11:22.230 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-09-12T00:11:22.231 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:11:22.359 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:11:22.404 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:11:22.442 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:11:22.442 INFO:tasks.ceph:role: osd.1 2024-09-12T00:11:22.443 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com 2024-09-12T00:11:22.443 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:11:22.528 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:11:22.528 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:11:22.528 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:11:22.528 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:11:22.528 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:11:22.528 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:11:22.528 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:11:22.528 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:11:22.528 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:11:22.528 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:11:22.994 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-09-12T00:11:22.996 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-09-12T00:11:22.996 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T00:11:23.061 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:11:23.103 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:11:23.183 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:11:23.183 INFO:tasks.ceph:role: osd.2 2024-09-12T00:11:23.183 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com 2024-09-12T00:11:23.183 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:11:23.269 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:11:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:11:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:11:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:11:23.270 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:11:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:11:23.270 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:11:23.270 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:11:23.270 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:11:23.270 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:11:23.761 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-09-12T00:11:23.763 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-09-12T00:11:23.763 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T00:11:23.859 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:11:23.905 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:11:23.944 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:11:23.944 INFO:tasks.ceph:role: osd.3 2024-09-12T00:11:23.944 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com 2024-09-12T00:11:23.944 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:11:24.029 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:11:24.029 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:11:24.029 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:11:24.029 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:11:24.029 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:11:24.029 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:11:24.030 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:11:24.030 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:11:24.030 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:11:24.030 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:11:24.523 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2024-09-12T00:11:24.525 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2024-09-12T00:11:24.525 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T00:11:24.621 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:11:24.667 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:24.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:24.737+0000 7fadf980d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:11:24.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:24.742+0000 7fadf980d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:11:24.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:24.742+0000 7fadf980d640 -1 bdev(0x55ce64c47800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:11:24.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:24.742+0000 7fadf980d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:11:27.901 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:11:27.945 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:28.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:28.047+0000 7fe6463c3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:11:28.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:28.047+0000 7fe6463c3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:11:28.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:28.047+0000 7fe6463c3640 -1 bdev(0x5602911d9800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:11:28.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:28.047+0000 7fe6463c3640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:11:31.211 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:11:31.256 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:31.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:31.320+0000 7fe404ef1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:11:31.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:31.320+0000 7fe404ef1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:11:31.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:31.320+0000 7fe404ef1640 -1 bdev(0x555c7cceb800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:11:31.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:31.320+0000 7fe404ef1640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:11:34.489 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:11:34.534 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:34.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:34.598+0000 7ffb9e00d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:11:34.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:34.598+0000 7ffb9e00d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:11:34.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:34.598+0000 7ffb9e00d640 -1 bdev(0x55f05a40d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:11:34.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:11:34.598+0000 7ffb9e00d640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:11:37.510 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:11:37.551 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T00:11:37.597 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:11:37.598 INFO:tasks.ceph:role: osd.4 2024-09-12T00:11:37.598 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-12T00:11:37.598 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:11:37.647 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:11:37.647 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:11:37.647 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:11:37.647 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:11:37.647 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:11:37.647 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:11:37.647 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:11:37.648 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:11:37.648 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:11:37.648 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:11:38.169 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-09-12T00:11:38.171 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-09-12T00:11:38.172 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T00:11:38.298 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T00:11:38.349 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T00:11:38.390 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:11:38.390 INFO:tasks.ceph:role: osd.5 2024-09-12T00:11:38.390 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-12T00:11:38.390 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:11:38.476 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:11:38.476 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:11:38.477 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:11:38.477 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:11:38.477 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:11:38.477 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:11:38.477 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:11:38.477 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:11:38.477 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:11:38.477 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:11:38.937 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-09-12T00:11:38.938 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-09-12T00:11:38.939 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T00:11:39.012 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T00:11:39.067 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T00:11:39.156 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:11:39.156 INFO:tasks.ceph:role: osd.6 2024-09-12T00:11:39.156 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-12T00:11:39.156 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:11:39.250 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:11:39.251 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:11:39.251 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:11:39.251 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:11:39.252 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:11:39.252 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:11:39.252 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:11:39.252 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:11:39.252 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:11:39.252 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:11:39.772 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-09-12T00:11:39.774 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-09-12T00:11:39.774 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T00:11:39.869 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T00:11:39.912 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T00:11:39.990 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:11:39.990 INFO:tasks.ceph:role: osd.7 2024-09-12T00:11:39.990 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-12T00:11:39.990 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:11:40.077 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:11:40.077 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:11:40.078 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:11:40.078 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:11:40.078 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:11:40.078 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:11:40.078 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:11:40.078 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:11:40.078 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:11:40.078 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:11:40.583 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-09-12T00:11:40.585 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-09-12T00:11:40.585 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T00:11:40.690 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T00:11:40.735 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:40.845 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:40.845+0000 7f11eafb0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T00:11:40.845 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:40.845+0000 7f11eafb0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T00:11:40.845 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:40.845+0000 7f11eafb0640 -1 bdev(0x562150285800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T00:11:40.845 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:40.845+0000 7f11eafb0640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T00:11:43.995 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T00:11:44.037 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:44.137 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:44.138+0000 7f59a25bb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T00:11:44.138 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:44.138+0000 7f59a25bb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T00:11:44.138 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:44.138+0000 7f59a25bb640 -1 bdev(0x56214c145800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T00:11:44.138 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:44.138+0000 7f59a25bb640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T00:11:47.299 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T00:11:47.344 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:47.407 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:47.408+0000 7f093dfa8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T00:11:47.408 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:47.409+0000 7f093dfa8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T00:11:47.408 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:47.409+0000 7f093dfa8640 -1 bdev(0x5574153fd800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T00:11:47.408 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:47.409+0000 7f093dfa8640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T00:11:50.569 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T00:11:50.609 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:50.708 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:50.709+0000 7f8cd62b6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T00:11:50.708 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:50.709+0000 7f8cd62b6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T00:11:50.709 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:50.709+0000 7f8cd62b6640 -1 bdev(0x562eeb1a1800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T00:11:50.709 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-12T00:11:50.709+0000 7f8cd62b6640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T00:11:53.862 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T00:11:53.903 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:11:53.903 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:53.903 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T00:11:53.950 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:53.950 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:11:54.033 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:54.033 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:11:54.114 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:54.114 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:11:54.194 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:54.194 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:11:54.273 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:11:54.273 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:11:54.315 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:11:54.315 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T00:11:54.395 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:11:54.395 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T00:11:54.476 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:11:54.477 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T00:11:54.556 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:11:54.556 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T00:11:54.634 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:11:54.635 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:11:54.665 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:11:54.665 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T00:11:54.703 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:11:54.703 DEBUG:teuthology.orchestra.run.smithi133:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:11:54.707 DEBUG:teuthology.orchestra.run.smithi160:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:11:54.747 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.y] 2024-09-12T00:11:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCpMeJmUGUyFxAAU9Lx6nCdk/1ClgBvNZEJBA== 2024-09-12T00:11:54.747 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.0] 2024-09-12T00:11:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCsMeJmaZr+KxAAF9jiZVgg6+CixLRS1luzKQ== 2024-09-12T00:11:54.747 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.1] 2024-09-12T00:11:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCwMeJm2G7fAhAAq+f6Y2v+adqOyGB/MVSs9w== 2024-09-12T00:11:54.747 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.2] 2024-09-12T00:11:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCzMeJmwIwoExAAADfmjr/rbRZCDLvZ/boE0A== 2024-09-12T00:11:54.747 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.3] 2024-09-12T00:11:54.747 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC2MeJmj0a3IxAAoQehjPNwRtwuh4933vHa9g== 2024-09-12T00:11:54.748 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.x] 2024-09-12T00:11:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCpMeJmDqfQGxAAE7+WXqVxWRWbI2/wcze9EA== 2024-09-12T00:11:54.748 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.4] 2024-09-12T00:11:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC8MeJm+8hwMhAAv+XUCUXcYHXAdwfPfWfFPg== 2024-09-12T00:11:54.748 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.5] 2024-09-12T00:11:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDAMeJmOOZNCBAA/iowR3JMRs2wBAmN2iTA3A== 2024-09-12T00:11:54.748 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.6] 2024-09-12T00:11:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDDMeJmoLVpGBAANBDtMDg/VNNa20NtqG2N5Q== 2024-09-12T00:11:54.748 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.7] 2024-09-12T00:11:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDGMeJmDG9SKhAAL9sCPcs3LZ/zvW40wZHMRw== 2024-09-12T00:11:54.748 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2024-09-12T00:11:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCpMeJmC90/HxAAeK82OJoI5LUHG7eh4nKYTw== 2024-09-12T00:11:54.748 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2024-09-12T00:11:54.748 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCpMeJmB5NxIxAAZei7NNK+bwZU3DNa9laEtw== 2024-09-12T00:11:54.782 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.y] 2024-09-12T00:11:54.782 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQCpMeJmUGUyFxAAU9Lx6nCdk/1ClgBvNZEJBA== 2024-09-12T00:11:54.782 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.0] 2024-09-12T00:11:54.782 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQCsMeJmaZr+KxAAF9jiZVgg6+CixLRS1luzKQ== 2024-09-12T00:11:54.783 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.1] 2024-09-12T00:11:54.783 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQCwMeJm2G7fAhAAq+f6Y2v+adqOyGB/MVSs9w== 2024-09-12T00:11:54.783 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.2] 2024-09-12T00:11:54.783 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQCzMeJmwIwoExAAADfmjr/rbRZCDLvZ/boE0A== 2024-09-12T00:11:54.783 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.3] 2024-09-12T00:11:54.783 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQC2MeJmj0a3IxAAoQehjPNwRtwuh4933vHa9g== 2024-09-12T00:11:54.783 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.x] 2024-09-12T00:11:54.783 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQCpMeJmDqfQGxAAE7+WXqVxWRWbI2/wcze9EA== 2024-09-12T00:11:54.783 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.4] 2024-09-12T00:11:54.783 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQC8MeJm+8hwMhAAv+XUCUXcYHXAdwfPfWfFPg== 2024-09-12T00:11:54.783 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.5] 2024-09-12T00:11:54.783 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDAMeJmOOZNCBAA/iowR3JMRs2wBAmN2iTA3A== 2024-09-12T00:11:54.784 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.6] 2024-09-12T00:11:54.784 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDDMeJmoLVpGBAANBDtMDg/VNNa20NtqG2N5Q== 2024-09-12T00:11:54.784 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.7] 2024-09-12T00:11:54.784 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDGMeJmDG9SKhAAL9sCPcs3LZ/zvW40wZHMRw== 2024-09-12T00:11:54.784 INFO:teuthology.orchestra.run.smithi160.stdout:[client.0] 2024-09-12T00:11:54.784 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQCpMeJmC90/HxAAeK82OJoI5LUHG7eh4nKYTw== 2024-09-12T00:11:54.784 INFO:teuthology.orchestra.run.smithi160.stdout:[client.1] 2024-09-12T00:11:54.784 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQCpMeJmB5NxIxAAZei7NNK+bwZU3DNa9laEtw== 2024-09-12T00:11:54.785 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:11:54.793 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:11:54.890 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:54.893 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:54.957 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:54.960 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:55.024 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:55.028 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:55.093 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:55.095 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:55.160 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:11:55.162 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:11:55.228 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:55.230 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:55.297 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:55.299 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:55.364 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:55.366 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:55.430 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:55.433 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:55.497 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:11:55.499 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:11:55.568 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:11:55.570 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:11:55.638 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:11:55.638 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:11:55.677 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:11:55.787 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:11:55.826 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T00:11:55.903 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:11:56.017 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T00:11:56.054 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T00:11:56.094 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:11:56.202 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T00:11:56.240 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:56.243 DEBUG:teuthology.orchestra.run.smithi160:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:56.310 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:11:56.310 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:11:56.311 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:11:56.313 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:11:56.314 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T00:11:56.314 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T00:11:56.316 INFO:tasks.ceph.mon.c:Started 2024-09-12T00:11:56.316 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T00:11:56.317 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T00:11:56.353 INFO:tasks.ceph.mon.b:Started 2024-09-12T00:11:56.353 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:11:56.353 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T00:11:56.354 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T00:11:56.356 INFO:tasks.ceph.mgr.y:Started 2024-09-12T00:11:56.356 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:11:56.356 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:11:56.358 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:11:56.358 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:11:56.358 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:11:56.358 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:12:02.550 INFO:teuthology.orchestra.run.smithi133.stderr:adjusted tunables profile to default 2024-09-12T00:12:02.563 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:12:02.563 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:12:02.563 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:12:02.563 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:12:02.604 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:12:02.604 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:12:02.683 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:12:02.683 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:12:02.762 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:12:02.763 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:12:02.841 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:12:02.841 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T00:12:02.880 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:12:02.880 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T00:12:02.958 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:12:02.959 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T00:12:03.038 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-12T00:12:03.038 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T00:12:03.118 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new c0128c84-3570-4ca5-8336-c753493c12fe 0 2024-09-12T00:12:03.359 INFO:teuthology.orchestra.run.smithi160.stdout:0 2024-09-12T00:12:03.371 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new be51a288-832a-49ba-9506-3eb4fa95b40f 1 2024-09-12T00:12:03.566 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-12T00:12:03.577 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 021f20b3-af9a-4656-befa-1ca354c52361 2 2024-09-12T00:12:03.776 INFO:teuthology.orchestra.run.smithi160.stdout:2 2024-09-12T00:12:03.787 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new fce1d083-a186-44ac-85c6-edf8ce90f136 3 2024-09-12T00:12:03.987 INFO:teuthology.orchestra.run.smithi160.stdout:3 2024-09-12T00:12:03.998 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 4d167a93-3b84-456b-807b-d9ae224829fe 4 2024-09-12T00:12:04.197 INFO:teuthology.orchestra.run.smithi160.stdout:4 2024-09-12T00:12:04.209 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 8f0d9a3f-3b6f-40ae-add4-30b07b28766c 5 2024-09-12T00:12:04.408 INFO:teuthology.orchestra.run.smithi160.stdout:5 2024-09-12T00:12:04.423 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new bf07fb18-89f4-43b6-9221-13dfa970fc2a 6 2024-09-12T00:12:04.620 INFO:teuthology.orchestra.run.smithi160.stdout:6 2024-09-12T00:12:04.631 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new e33d6d84-dae7-4ab8-b569-5b5c9008d405 7 2024-09-12T00:12:04.826 INFO:teuthology.orchestra.run.smithi160.stdout:7 2024-09-12T00:12:04.838 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:12:04.838 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:12:04.840 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:12:04.840 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:12:04.840 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:12:04.842 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:12:04.842 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:12:04.843 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:12:04.845 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:12:04.845 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:12:04.845 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:12:04.847 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:12:04.847 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T00:12:04.848 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T00:12:04.850 INFO:tasks.ceph.osd.4:Started 2024-09-12T00:12:04.850 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T00:12:04.850 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T00:12:04.852 INFO:tasks.ceph.osd.5:Started 2024-09-12T00:12:04.852 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T00:12:04.852 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T00:12:04.855 INFO:tasks.ceph.osd.6:Started 2024-09-12T00:12:04.855 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T00:12:04.855 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T00:12:04.857 INFO:tasks.ceph.osd.7:Started 2024-09-12T00:12:04.857 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:12:05.080 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:12:05.080 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":10,"fsid":"9d5b883a-c64b-4bbd-824a-b1076948973e","created":"2024-09-12T00:12:01.635987+0000","modified":"2024-09-12T00:12:04.826322+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:12:04.826322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c0128c84-3570-4ca5-8336-c753493c12fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"be51a288-832a-49ba-9506-3eb4fa95b40f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"021f20b3-af9a-4656-befa-1ca354c52361","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fce1d083-a186-44ac-85c6-edf8ce90f136","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4d167a93-3b84-456b-807b-d9ae224829fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8f0d9a3f-3b6f-40ae-add4-30b07b28766c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bf07fb18-89f4-43b6-9221-13dfa970fc2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e33d6d84-dae7-4ab8-b569-5b5c9008d405","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:12:05.092 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:12:05.092 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:12:05.855 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-09-12T00:12:05.856+0000 7f35abb02640 -1 Falling back to public interface 2024-09-12T00:12:05.899 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:12:06.077 INFO:teuthology.misc.health.smithi133.stdout: 2024-09-12T00:12:06.077 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":10,"fsid":"9d5b883a-c64b-4bbd-824a-b1076948973e","created":"2024-09-12T00:12:01.635987+0000","modified":"2024-09-12T00:12:04.826322+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:12:04.826322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c0128c84-3570-4ca5-8336-c753493c12fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"be51a288-832a-49ba-9506-3eb4fa95b40f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"021f20b3-af9a-4656-befa-1ca354c52361","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fce1d083-a186-44ac-85c6-edf8ce90f136","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4d167a93-3b84-456b-807b-d9ae224829fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8f0d9a3f-3b6f-40ae-add4-30b07b28766c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bf07fb18-89f4-43b6-9221-13dfa970fc2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e33d6d84-dae7-4ab8-b569-5b5c9008d405","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:12:06.087 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:12:06.332 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-09-12T00:12:06.333+0000 7f63bf9d4640 -1 Falling back to public interface 2024-09-12T00:12:06.333 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-09-12T00:12:06.333+0000 7f313f5b9640 -1 Falling back to public interface 2024-09-12T00:12:06.340 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-12T00:12:06.341+0000 7f361f4f1640 -1 Falling back to public interface 2024-09-12T00:12:06.385 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-09-12T00:12:06.385+0000 7f599b3ae640 -1 Falling back to public interface 2024-09-12T00:12:06.553 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-09-12T00:12:06.554+0000 7f0964414640 -1 Falling back to public interface 2024-09-12T00:12:06.594 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-09-12T00:12:06.594+0000 7f40b35cc640 -1 Falling back to public interface 2024-09-12T00:12:06.599 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-09-12T00:12:06.599+0000 7f54387b2640 -1 Falling back to public interface 2024-09-12T00:12:06.925 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-12T00:12:06.926+0000 7fba75177640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T00:12:06.926 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-12T00:12:06.927+0000 7fba75177640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T00:12:09.859 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-09-12T00:12:09.860+0000 7f35abb02640 -1 osd.5 0 log_to_monitors true 2024-09-12T00:12:10.067 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-09-12T00:12:10.068+0000 7f63bf9d4640 -1 osd.4 0 log_to_monitors true 2024-09-12T00:12:10.165 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-09-12T00:12:10.166+0000 7f54387b2640 -1 osd.1 0 log_to_monitors true 2024-09-12T00:12:10.381 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-12T00:12:10.383+0000 7f361f4f1640 -1 osd.7 0 log_to_monitors true 2024-09-12T00:12:10.422 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-09-12T00:12:10.423+0000 7f313f5b9640 -1 osd.0 0 log_to_monitors true 2024-09-12T00:12:10.441 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-09-12T00:12:10.442+0000 7f599b3ae640 -1 osd.3 0 log_to_monitors true 2024-09-12T00:12:10.532 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-09-12T00:12:10.534+0000 7f0964414640 -1 osd.6 0 log_to_monitors true 2024-09-12T00:12:10.644 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-09-12T00:12:10.645+0000 7f40b35cc640 -1 osd.2 0 log_to_monitors true 2024-09-12T00:12:11.800 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-09-12T00:12:11.801+0000 7f35a82aa640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:12:11.810 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-09-12T00:12:11.811+0000 7f359f8b5640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:12:12.897 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:12:13.340 INFO:teuthology.misc.health.smithi133.stdout: 2024-09-12T00:12:13.340 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":14,"fsid":"9d5b883a-c64b-4bbd-824a-b1076948973e","created":"2024-09-12T00:12:01.635987+0000","modified":"2024-09-12T00:12:13.043464+0000","last_up_change":"2024-09-12T00:12:11.935450+0000","last_in_change":"2024-09-12T00:12:04.826322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c0128c84-3570-4ca5-8336-c753493c12fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"be51a288-832a-49ba-9506-3eb4fa95b40f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"021f20b3-af9a-4656-befa-1ca354c52361","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fce1d083-a186-44ac-85c6-edf8ce90f136","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4d167a93-3b84-456b-807b-d9ae224829fe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8f0d9a3f-3b6f-40ae-add4-30b07b28766c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6801","nonce":2429451477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6803","nonce":2429451477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6807","nonce":2429451477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6805","nonce":2429451477}]},"public_addr":"172.21.15.160:6801/2429451477","cluster_addr":"172.21.15.160:6803/2429451477","heartbeat_back_addr":"172.21.15.160:6807/2429451477","heartbeat_front_addr":"172.21.15.160:6805/2429451477","state":["exists","up"]},{"osd":6,"uuid":"bf07fb18-89f4-43b6-9221-13dfa970fc2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e33d6d84-dae7-4ab8-b569-5b5c9008d405","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:10.828388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:12:13.355 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-12T00:12:13.615 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-12T00:12:13.616+0000 7f361b485640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:12:13.628 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-12T00:12:13.630+0000 7f36132a4640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:12:13.638 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-09-12T00:12:13.639+0000 7f63bb968640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:12:13.640 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-09-12T00:12:13.641+0000 7f095fe21640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:12:13.650 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-09-12T00:12:13.652+0000 7f63b3787640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:12:13.651 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-09-12T00:12:13.652+0000 7f0957c40640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:12:13.981 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-09-12T00:12:13.982+0000 7f40afd74640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:12:13.993 INFO:tasks.ceph.osd.2.smithi133.stderr:2024-09-12T00:12:13.994+0000 7f40a737f640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:12:14.004 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-09-12T00:12:14.005+0000 7f5997342640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:12:14.015 INFO:tasks.ceph.osd.3.smithi133.stderr:2024-09-12T00:12:14.017+0000 7f598f161640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:12:14.016 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-09-12T00:12:14.017+0000 7f5434746640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:12:14.030 INFO:tasks.ceph.osd.1.smithi133.stderr:2024-09-12T00:12:14.032+0000 7f542c565640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:12:14.038 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-09-12T00:12:14.040+0000 7f313b54d640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:12:14.055 INFO:tasks.ceph.osd.0.smithi133.stderr:2024-09-12T00:12:14.057+0000 7f313336c640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:12:20.162 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:12:20.467 INFO:teuthology.misc.health.smithi133.stdout: 2024-09-12T00:12:20.467 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":19,"fsid":"9d5b883a-c64b-4bbd-824a-b1076948973e","created":"2024-09-12T00:12:01.635987+0000","modified":"2024-09-12T00:12:18.677287+0000","last_up_change":"2024-09-12T00:12:14.620358+0000","last_in_change":"2024-09-12T00:12:04.826322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:12:15.937266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0128c84-3570-4ca5-8336-c753493c12fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6801","nonce":3885452980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6803","nonce":3885452980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6807","nonce":3885452980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6805","nonce":3885452980}]},"public_addr":"172.21.15.133:6801/3885452980","cluster_addr":"172.21.15.133:6803/3885452980","heartbeat_back_addr":"172.21.15.133:6807/3885452980","heartbeat_front_addr":"172.21.15.133:6805/3885452980","state":["exists","up"]},{"osd":1,"uuid":"be51a288-832a-49ba-9506-3eb4fa95b40f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6825","nonce":186004193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6827","nonce":186004193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6831","nonce":186004193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6829","nonce":186004193}]},"public_addr":"172.21.15.133:6825/186004193","cluster_addr":"172.21.15.133:6827/186004193","heartbeat_back_addr":"172.21.15.133:6831/186004193","heartbeat_front_addr":"172.21.15.133:6829/186004193","state":["exists","up"]},{"osd":2,"uuid":"021f20b3-af9a-4656-befa-1ca354c52361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6817","nonce":1011460824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6819","nonce":1011460824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6823","nonce":1011460824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6821","nonce":1011460824}]},"public_addr":"172.21.15.133:6817/1011460824","cluster_addr":"172.21.15.133:6819/1011460824","heartbeat_back_addr":"172.21.15.133:6823/1011460824","heartbeat_front_addr":"172.21.15.133:6821/1011460824","state":["exists","up"]},{"osd":3,"uuid":"fce1d083-a186-44ac-85c6-edf8ce90f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6809","nonce":2746645038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6811","nonce":2746645038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6815","nonce":2746645038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6813","nonce":2746645038}]},"public_addr":"172.21.15.133:6809/2746645038","cluster_addr":"172.21.15.133:6811/2746645038","heartbeat_back_addr":"172.21.15.133:6815/2746645038","heartbeat_front_addr":"172.21.15.133:6813/2746645038","state":["exists","up"]},{"osd":4,"uuid":"4d167a93-3b84-456b-807b-d9ae224829fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6811","nonce":170425375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6813","nonce":170425375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6817","nonce":170425375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6815","nonce":170425375}]},"public_addr":"172.21.15.160:6811/170425375","cluster_addr":"172.21.15.160:6813/170425375","heartbeat_back_addr":"172.21.15.160:6817/170425375","heartbeat_front_addr":"172.21.15.160:6815/170425375","state":["exists","up"]},{"osd":5,"uuid":"8f0d9a3f-3b6f-40ae-add4-30b07b28766c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6801","nonce":2429451477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6803","nonce":2429451477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6807","nonce":2429451477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6805","nonce":2429451477}]},"public_addr":"172.21.15.160:6801/2429451477","cluster_addr":"172.21.15.160:6803/2429451477","heartbeat_back_addr":"172.21.15.160:6807/2429451477","heartbeat_front_addr":"172.21.15.160:6805/2429451477","state":["exists","up"]},{"osd":6,"uuid":"bf07fb18-89f4-43b6-9221-13dfa970fc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6827","nonce":253795424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6829","nonce":253795424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6833","nonce":253795424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6831","nonce":253795424}]},"public_addr":"172.21.15.160:6827/253795424","cluster_addr":"172.21.15.160:6829/253795424","heartbeat_back_addr":"172.21.15.160:6833/253795424","heartbeat_front_addr":"172.21.15.160:6831/253795424","state":["exists","up"]},{"osd":7,"uuid":"e33d6d84-dae7-4ab8-b569-5b5c9008d405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6819","nonce":507321805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6821","nonce":507321805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6825","nonce":507321805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6823","nonce":507321805}]},"public_addr":"172.21.15.160:6819/507321805","cluster_addr":"172.21.15.160:6821/507321805","heartbeat_back_addr":"172.21.15.160:6825/507321805","heartbeat_front_addr":"172.21.15.160:6823/507321805","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.382831+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.172774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.629093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.412020+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.078833+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:10.828388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.581535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.351723+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:12:20.479 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T00:12:20.479 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:12:20.479 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:12:21.699 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'rbd' created 2024-09-12T00:12:21.717 DEBUG:teuthology.orchestra.run.smithi133:> rbd --cluster ceph pool init rbd 2024-09-12T00:12:21.978 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:21.978 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:24.726 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:12:24.726 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:12:24.727 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:12:25.037 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:12:25.050 INFO:teuthology.orchestra.run.smithi133.stdout:[{"version":9,"timestamp":"2024-09-12T00:12:14.041088+0000","name":"","changes":[{"name":"osd.0/osd_mclock_max_capacity_iops_ssd","new_value":"5357.022181"}]}] 2024-09-12T00:12:25.050 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T00:12:25.051 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:12:25.051 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:12:25.051 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:12:25.400 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:12:25.411 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2578085440},{"type":"v1","addr":"172.21.15.160:6809","nonce":2578085440}]},"active_addr":"172.21.15.160:6809/2578085440","active_change":"2024-09-12T00:12:05.916582+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4109,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":2408734632}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":3434226984}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":1917745617}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":1488184119}]}]} 2024-09-12T00:12:25.416 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:12:25.416 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:12:25.417 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:12:25.719 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:12:25.719 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":23,"fsid":"9d5b883a-c64b-4bbd-824a-b1076948973e","created":"2024-09-12T00:12:01.635987+0000","modified":"2024-09-12T00:12:24.712018+0000","last_up_change":"2024-09-12T00:12:14.620358+0000","last_in_change":"2024-09-12T00:12:04.826322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:12:15.937266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:12:20.783409+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0128c84-3570-4ca5-8336-c753493c12fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6801","nonce":3885452980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6803","nonce":3885452980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6807","nonce":3885452980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6805","nonce":3885452980}]},"public_addr":"172.21.15.133:6801/3885452980","cluster_addr":"172.21.15.133:6803/3885452980","heartbeat_back_addr":"172.21.15.133:6807/3885452980","heartbeat_front_addr":"172.21.15.133:6805/3885452980","state":["exists","up"]},{"osd":1,"uuid":"be51a288-832a-49ba-9506-3eb4fa95b40f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6825","nonce":186004193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6827","nonce":186004193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6831","nonce":186004193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6829","nonce":186004193}]},"public_addr":"172.21.15.133:6825/186004193","cluster_addr":"172.21.15.133:6827/186004193","heartbeat_back_addr":"172.21.15.133:6831/186004193","heartbeat_front_addr":"172.21.15.133:6829/186004193","state":["exists","up"]},{"osd":2,"uuid":"021f20b3-af9a-4656-befa-1ca354c52361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6817","nonce":1011460824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6819","nonce":1011460824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6823","nonce":1011460824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6821","nonce":1011460824}]},"public_addr":"172.21.15.133:6817/1011460824","cluster_addr":"172.21.15.133:6819/1011460824","heartbeat_back_addr":"172.21.15.133:6823/1011460824","heartbeat_front_addr":"172.21.15.133:6821/1011460824","state":["exists","up"]},{"osd":3,"uuid":"fce1d083-a186-44ac-85c6-edf8ce90f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6809","nonce":2746645038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6811","nonce":2746645038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6815","nonce":2746645038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6813","nonce":2746645038}]},"public_addr":"172.21.15.133:6809/2746645038","cluster_addr":"172.21.15.133:6811/2746645038","heartbeat_back_addr":"172.21.15.133:6815/2746645038","heartbeat_front_addr":"172.21.15.133:6813/2746645038","state":["exists","up"]},{"osd":4,"uuid":"4d167a93-3b84-456b-807b-d9ae224829fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6811","nonce":170425375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6813","nonce":170425375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6817","nonce":170425375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6815","nonce":170425375}]},"public_addr":"172.21.15.160:6811/170425375","cluster_addr":"172.21.15.160:6813/170425375","heartbeat_back_addr":"172.21.15.160:6817/170425375","heartbeat_front_addr":"172.21.15.160:6815/170425375","state":["exists","up"]},{"osd":5,"uuid":"8f0d9a3f-3b6f-40ae-add4-30b07b28766c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6801","nonce":2429451477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6803","nonce":2429451477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6807","nonce":2429451477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6805","nonce":2429451477}]},"public_addr":"172.21.15.160:6801/2429451477","cluster_addr":"172.21.15.160:6803/2429451477","heartbeat_back_addr":"172.21.15.160:6807/2429451477","heartbeat_front_addr":"172.21.15.160:6805/2429451477","state":["exists","up"]},{"osd":6,"uuid":"bf07fb18-89f4-43b6-9221-13dfa970fc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6827","nonce":253795424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6829","nonce":253795424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6833","nonce":253795424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6831","nonce":253795424}]},"public_addr":"172.21.15.160:6827/253795424","cluster_addr":"172.21.15.160:6829/253795424","heartbeat_back_addr":"172.21.15.160:6833/253795424","heartbeat_front_addr":"172.21.15.160:6831/253795424","state":["exists","up"]},{"osd":7,"uuid":"e33d6d84-dae7-4ab8-b569-5b5c9008d405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6819","nonce":507321805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6821","nonce":507321805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6825","nonce":507321805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6823","nonce":507321805}]},"public_addr":"172.21.15.160:6819/507321805","cluster_addr":"172.21.15.160:6821/507321805","heartbeat_back_addr":"172.21.15.160:6825/507321805","heartbeat_front_addr":"172.21.15.160:6823/507321805","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.382831+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.172774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.629093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.412020+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.078833+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:10.828388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.581535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.351723+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:12:25.733 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:12:25.734 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:12:26.031 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:12:26.032 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":23,"fsid":"9d5b883a-c64b-4bbd-824a-b1076948973e","created":"2024-09-12T00:12:01.635987+0000","modified":"2024-09-12T00:12:24.712018+0000","last_up_change":"2024-09-12T00:12:14.620358+0000","last_in_change":"2024-09-12T00:12:04.826322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:12:15.937266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:12:20.783409+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0128c84-3570-4ca5-8336-c753493c12fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6801","nonce":3885452980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6803","nonce":3885452980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6807","nonce":3885452980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6805","nonce":3885452980}]},"public_addr":"172.21.15.133:6801/3885452980","cluster_addr":"172.21.15.133:6803/3885452980","heartbeat_back_addr":"172.21.15.133:6807/3885452980","heartbeat_front_addr":"172.21.15.133:6805/3885452980","state":["exists","up"]},{"osd":1,"uuid":"be51a288-832a-49ba-9506-3eb4fa95b40f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6825","nonce":186004193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6827","nonce":186004193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6831","nonce":186004193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6829","nonce":186004193}]},"public_addr":"172.21.15.133:6825/186004193","cluster_addr":"172.21.15.133:6827/186004193","heartbeat_back_addr":"172.21.15.133:6831/186004193","heartbeat_front_addr":"172.21.15.133:6829/186004193","state":["exists","up"]},{"osd":2,"uuid":"021f20b3-af9a-4656-befa-1ca354c52361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6817","nonce":1011460824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6819","nonce":1011460824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6823","nonce":1011460824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6821","nonce":1011460824}]},"public_addr":"172.21.15.133:6817/1011460824","cluster_addr":"172.21.15.133:6819/1011460824","heartbeat_back_addr":"172.21.15.133:6823/1011460824","heartbeat_front_addr":"172.21.15.133:6821/1011460824","state":["exists","up"]},{"osd":3,"uuid":"fce1d083-a186-44ac-85c6-edf8ce90f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6809","nonce":2746645038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6811","nonce":2746645038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6815","nonce":2746645038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6813","nonce":2746645038}]},"public_addr":"172.21.15.133:6809/2746645038","cluster_addr":"172.21.15.133:6811/2746645038","heartbeat_back_addr":"172.21.15.133:6815/2746645038","heartbeat_front_addr":"172.21.15.133:6813/2746645038","state":["exists","up"]},{"osd":4,"uuid":"4d167a93-3b84-456b-807b-d9ae224829fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6811","nonce":170425375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6813","nonce":170425375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6817","nonce":170425375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6815","nonce":170425375}]},"public_addr":"172.21.15.160:6811/170425375","cluster_addr":"172.21.15.160:6813/170425375","heartbeat_back_addr":"172.21.15.160:6817/170425375","heartbeat_front_addr":"172.21.15.160:6815/170425375","state":["exists","up"]},{"osd":5,"uuid":"8f0d9a3f-3b6f-40ae-add4-30b07b28766c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6801","nonce":2429451477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6803","nonce":2429451477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6807","nonce":2429451477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6805","nonce":2429451477}]},"public_addr":"172.21.15.160:6801/2429451477","cluster_addr":"172.21.15.160:6803/2429451477","heartbeat_back_addr":"172.21.15.160:6807/2429451477","heartbeat_front_addr":"172.21.15.160:6805/2429451477","state":["exists","up"]},{"osd":6,"uuid":"bf07fb18-89f4-43b6-9221-13dfa970fc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6827","nonce":253795424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6829","nonce":253795424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6833","nonce":253795424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6831","nonce":253795424}]},"public_addr":"172.21.15.160:6827/253795424","cluster_addr":"172.21.15.160:6829/253795424","heartbeat_back_addr":"172.21.15.160:6833/253795424","heartbeat_front_addr":"172.21.15.160:6831/253795424","state":["exists","up"]},{"osd":7,"uuid":"e33d6d84-dae7-4ab8-b569-5b5c9008d405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6819","nonce":507321805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6821","nonce":507321805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6825","nonce":507321805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6823","nonce":507321805}]},"public_addr":"172.21.15.160:6819/507321805","cluster_addr":"172.21.15.160:6821/507321805","heartbeat_back_addr":"172.21.15.160:6825/507321805","heartbeat_front_addr":"172.21.15.160:6823/507321805","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.382831+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.172774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.629093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.412020+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.078833+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:10.828388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.581535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.351723+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:12:26.045 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:12:26.045 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:12:26.046 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:12:26.046 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:12:26.046 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:12:26.047 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:12:26.047 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:12:26.048 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:12:26.309 INFO:teuthology.orchestra.run.smithi133.stdout:64424509446 2024-09-12T00:12:26.309 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:12:26.310 INFO:teuthology.orchestra.run.smithi133.stdout:64424509446 2024-09-12T00:12:26.311 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:12:26.311 INFO:teuthology.orchestra.run.smithi133.stdout:64424509447 2024-09-12T00:12:26.312 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:12:26.313 INFO:teuthology.orchestra.run.smithi133.stdout:64424509446 2024-09-12T00:12:26.313 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:12:26.315 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2024-09-12T00:12:26.316 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:12:26.316 INFO:teuthology.orchestra.run.smithi133.stdout:64424509446 2024-09-12T00:12:26.317 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:12:26.318 INFO:teuthology.orchestra.run.smithi133.stdout:64424509447 2024-09-12T00:12:26.319 INFO:teuthology.orchestra.run.smithi133.stdout:64424509446 2024-09-12T00:12:26.319 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:12:26.320 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:12:26.895 INFO:teuthology.orchestra.run.smithi133.stdout:64424509445 2024-09-12T00:12:26.912 INFO:teuthology.orchestra.run.smithi133.stdout:64424509445 2024-09-12T00:12:26.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-09-12T00:12:26.922 INFO:teuthology.orchestra.run.smithi133.stdout:64424509446 2024-09-12T00:12:26.922 INFO:teuthology.orchestra.run.smithi133.stdout:64424509445 2024-09-12T00:12:26.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2024-09-12T00:12:26.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-09-12T00:12:26.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-09-12T00:12:26.957 INFO:teuthology.orchestra.run.smithi133.stdout:64424509445 2024-09-12T00:12:26.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-09-12T00:12:26.971 INFO:teuthology.orchestra.run.smithi133.stdout:64424509445 2024-09-12T00:12:26.971 INFO:teuthology.orchestra.run.smithi133.stdout:64424509446 2024-09-12T00:12:26.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2024-09-12T00:12:26.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2024-09-12T00:12:26.996 INFO:teuthology.orchestra.run.smithi133.stdout:55834574852 2024-09-12T00:12:27.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-09-12T00:12:27.915 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:12:27.935 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:12:27.943 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:12:27.944 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:12:27.971 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:12:27.986 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:12:27.990 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:12:28.010 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:12:28.491 INFO:teuthology.orchestra.run.smithi133.stdout:64424509445 2024-09-12T00:12:28.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2024-09-12T00:12:28.553 INFO:teuthology.orchestra.run.smithi133.stdout:64424509445 2024-09-12T00:12:28.563 INFO:teuthology.orchestra.run.smithi133.stdout:64424509445 2024-09-12T00:12:28.567 INFO:teuthology.orchestra.run.smithi133.stdout:64424509445 2024-09-12T00:12:28.570 INFO:teuthology.orchestra.run.smithi133.stdout:64424509446 2024-09-12T00:12:28.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2024-09-12T00:12:28.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-09-12T00:12:28.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2024-09-12T00:12:28.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-09-12T00:12:28.601 INFO:teuthology.orchestra.run.smithi133.stdout:64424509446 2024-09-12T00:12:28.605 INFO:teuthology.orchestra.run.smithi133.stdout:64424509445 2024-09-12T00:12:28.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2024-09-12T00:12:28.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-09-12T00:12:28.621 INFO:teuthology.orchestra.run.smithi133.stdout:55834574852 2024-09-12T00:12:28.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-09-12T00:12:29.514 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:12:29.574 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:12:29.588 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:12:29.588 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:12:29.590 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:12:29.615 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:12:29.619 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:12:29.636 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:12:30.055 INFO:teuthology.orchestra.run.smithi133.stdout:64424509446 2024-09-12T00:12:30.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-12T00:12:30.072 DEBUG:teuthology.parallel:result is None 2024-09-12T00:12:30.159 INFO:teuthology.orchestra.run.smithi133.stdout:64424509447 2024-09-12T00:12:30.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-09-12T00:12:30.172 DEBUG:teuthology.parallel:result is None 2024-09-12T00:12:30.177 INFO:teuthology.orchestra.run.smithi133.stdout:64424509446 2024-09-12T00:12:30.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-09-12T00:12:30.191 DEBUG:teuthology.parallel:result is None 2024-09-12T00:12:30.211 INFO:teuthology.orchestra.run.smithi133.stdout:64424509447 2024-09-12T00:12:30.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-09-12T00:12:30.225 DEBUG:teuthology.parallel:result is None 2024-09-12T00:12:30.228 INFO:teuthology.orchestra.run.smithi133.stdout:64424509446 2024-09-12T00:12:30.237 INFO:teuthology.orchestra.run.smithi133.stdout:64424509446 2024-09-12T00:12:30.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-09-12T00:12:30.245 DEBUG:teuthology.parallel:result is None 2024-09-12T00:12:30.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-09-12T00:12:30.255 DEBUG:teuthology.parallel:result is None 2024-09-12T00:12:30.267 INFO:teuthology.orchestra.run.smithi133.stdout:64424509446 2024-09-12T00:12:30.272 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2024-09-12T00:12:30.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-09-12T00:12:30.282 DEBUG:teuthology.parallel:result is None 2024-09-12T00:12:30.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2024-09-12T00:12:30.285 DEBUG:teuthology.parallel:result is None 2024-09-12T00:12:30.285 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:12:30.285 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:12:30.632 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:12:30.632 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-09-12T00:12:30.640 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T00:12:29.925208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219248,"kb_used_data":2992,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755472,"statfs":{"total":773094113280,"available":772869603328,"internally_reserved":0,"allocated":3063808,"data_stored":1814286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.217597"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:24.720016+0000","last_change":"2024-09-12T00:12:24.720016+0000","last_active":"2024-09-12T00:12:24.720016+0000","last_peered":"2024-09-12T00:12:24.720016+0000","last_clean":"2024-09-12T00:12:24.720016+0000","last_became_active":"2024-09-12T00:12:22.875444+0000","last_became_peered":"2024-09-12T00:12:22.875444+0000","last_unstale":"2024-09-12T00:12:24.720016+0000","last_undegraded":"2024-09-12T00:12:24.720016+0000","last_fullsized":"2024-09-12T00:12:24.720016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:01.561555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001017387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:24.719145+0000","last_change":"2024-09-12T00:12:24.719145+0000","last_active":"2024-09-12T00:12:24.719145+0000","last_peered":"2024-09-12T00:12:24.719145+0000","last_clean":"2024-09-12T00:12:24.719145+0000","last_became_active":"2024-09-12T00:12:22.875452+0000","last_became_peered":"2024-09-12T00:12:22.875452+0000","last_unstale":"2024-09-12T00:12:24.719145+0000","last_undegraded":"2024-09-12T00:12:24.719145+0000","last_fullsized":"2024-09-12T00:12:24.719145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:18.582665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040035500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:24.719653+0000","last_change":"2024-09-12T00:12:24.719653+0000","last_active":"2024-09-12T00:12:24.719653+0000","last_peered":"2024-09-12T00:12:24.719653+0000","last_clean":"2024-09-12T00:12:24.719653+0000","last_became_active":"2024-09-12T00:12:22.713263+0000","last_became_peered":"2024-09-12T00:12:22.713263+0000","last_unstale":"2024-09-12T00:12:24.719653+0000","last_undegraded":"2024-09-12T00:12:24.719653+0000","last_fullsized":"2024-09-12T00:12:24.719653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:13.032469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065424400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:24.787808+0000","last_change":"2024-09-12T00:12:24.788080+0000","last_active":"2024-09-12T00:12:24.787808+0000","last_peered":"2024-09-12T00:12:24.787808+0000","last_clean":"2024-09-12T00:12:24.787808+0000","last_became_active":"2024-09-12T00:12:22.840210+0000","last_became_peered":"2024-09-12T00:12:22.840210+0000","last_unstale":"2024-09-12T00:12:24.787808+0000","last_undegraded":"2024-09-12T00:12:24.787808+0000","last_fullsized":"2024-09-12T00:12:24.787808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.906053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043827699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"23'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:24.722400+0000","last_change":"2024-09-12T00:12:24.719660+0000","last_active":"2024-09-12T00:12:24.722400+0000","last_peered":"2024-09-12T00:12:24.722400+0000","last_clean":"2024-09-12T00:12:24.722400+0000","last_became_active":"2024-09-12T00:12:22.840587+0000","last_became_peered":"2024-09-12T00:12:22.840587+0000","last_unstale":"2024-09-12T00:12:24.722400+0000","last_undegraded":"2024-09-12T00:12:24.722400+0000","last_fullsized":"2024-09-12T00:12:24.722400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:04.555069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065014999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:25.140210+0000","last_change":"2024-09-12T00:12:25.140418+0000","last_active":"2024-09-12T00:12:25.140210+0000","last_peered":"2024-09-12T00:12:25.140210+0000","last_clean":"2024-09-12T00:12:25.140210+0000","last_became_active":"2024-09-12T00:12:22.714487+0000","last_became_peered":"2024-09-12T00:12:22.714487+0000","last_unstale":"2024-09-12T00:12:25.140210+0000","last_undegraded":"2024-09-12T00:12:25.140210+0000","last_fullsized":"2024-09-12T00:12:25.140210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:43.265742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038937299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:24.720267+0000","last_change":"2024-09-12T00:12:24.720267+0000","last_active":"2024-09-12T00:12:24.720267+0000","last_peered":"2024-09-12T00:12:24.720267+0000","last_clean":"2024-09-12T00:12:24.720267+0000","last_became_active":"2024-09-12T00:12:22.713657+0000","last_became_peered":"2024-09-12T00:12:22.713657+0000","last_unstale":"2024-09-12T00:12:24.720267+0000","last_undegraded":"2024-09-12T00:12:24.720267+0000","last_fullsized":"2024-09-12T00:12:24.720267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:55.127846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012667690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"21'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:24.720432+0000","last_change":"2024-09-12T00:12:24.720432+0000","last_active":"2024-09-12T00:12:24.720432+0000","last_peered":"2024-09-12T00:12:24.720432+0000","last_clean":"2024-09-12T00:12:24.720432+0000","last_became_active":"2024-09-12T00:12:22.713297+0000","last_became_peered":"2024-09-12T00:12:22.713297+0000","last_unstale":"2024-09-12T00:12:24.720432+0000","last_undegraded":"2024-09-12T00:12:24.720432+0000","last_fullsized":"2024-09-12T00:12:24.720432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:31.323737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014022310000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:25.139375+0000","last_change":"2024-09-12T00:12:17.818843+0000","last_active":"2024-09-12T00:12:25.139375+0000","last_peered":"2024-09-12T00:12:25.139375+0000","last_clean":"2024-09-12T00:12:25.139375+0000","last_became_active":"2024-09-12T00:12:17.817880+0000","last_became_peered":"2024-09-12T00:12:17.817880+0000","last_unstale":"2024-09-12T00:12:25.139375+0000","last_undegraded":"2024-09-12T00:12:25.139375+0000","last_fullsized":"2024-09-12T00:12:25.139375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:16.658840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:16.658840+0000","last_clean_scrub_stamp":"2024-09-12T00:12:16.658840+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:23.769027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":79208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":79208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":827392,"data_stored":669557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":827392,"data_stored":669557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:12:30.641 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:12:30.939 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:12:30.940 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-09-12T00:12:30.952 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T00:12:29.925208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219248,"kb_used_data":2992,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755472,"statfs":{"total":773094113280,"available":772869603328,"internally_reserved":0,"allocated":3063808,"data_stored":1814286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.217597"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:24.720016+0000","last_change":"2024-09-12T00:12:24.720016+0000","last_active":"2024-09-12T00:12:24.720016+0000","last_peered":"2024-09-12T00:12:24.720016+0000","last_clean":"2024-09-12T00:12:24.720016+0000","last_became_active":"2024-09-12T00:12:22.875444+0000","last_became_peered":"2024-09-12T00:12:22.875444+0000","last_unstale":"2024-09-12T00:12:24.720016+0000","last_undegraded":"2024-09-12T00:12:24.720016+0000","last_fullsized":"2024-09-12T00:12:24.720016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:01.561555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001017387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:24.719145+0000","last_change":"2024-09-12T00:12:24.719145+0000","last_active":"2024-09-12T00:12:24.719145+0000","last_peered":"2024-09-12T00:12:24.719145+0000","last_clean":"2024-09-12T00:12:24.719145+0000","last_became_active":"2024-09-12T00:12:22.875452+0000","last_became_peered":"2024-09-12T00:12:22.875452+0000","last_unstale":"2024-09-12T00:12:24.719145+0000","last_undegraded":"2024-09-12T00:12:24.719145+0000","last_fullsized":"2024-09-12T00:12:24.719145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:18.582665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040035500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:24.719653+0000","last_change":"2024-09-12T00:12:24.719653+0000","last_active":"2024-09-12T00:12:24.719653+0000","last_peered":"2024-09-12T00:12:24.719653+0000","last_clean":"2024-09-12T00:12:24.719653+0000","last_became_active":"2024-09-12T00:12:22.713263+0000","last_became_peered":"2024-09-12T00:12:22.713263+0000","last_unstale":"2024-09-12T00:12:24.719653+0000","last_undegraded":"2024-09-12T00:12:24.719653+0000","last_fullsized":"2024-09-12T00:12:24.719653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:13.032469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065424400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:24.787808+0000","last_change":"2024-09-12T00:12:24.788080+0000","last_active":"2024-09-12T00:12:24.787808+0000","last_peered":"2024-09-12T00:12:24.787808+0000","last_clean":"2024-09-12T00:12:24.787808+0000","last_became_active":"2024-09-12T00:12:22.840210+0000","last_became_peered":"2024-09-12T00:12:22.840210+0000","last_unstale":"2024-09-12T00:12:24.787808+0000","last_undegraded":"2024-09-12T00:12:24.787808+0000","last_fullsized":"2024-09-12T00:12:24.787808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.906053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043827699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"23'2","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:24.722400+0000","last_change":"2024-09-12T00:12:24.719660+0000","last_active":"2024-09-12T00:12:24.722400+0000","last_peered":"2024-09-12T00:12:24.722400+0000","last_clean":"2024-09-12T00:12:24.722400+0000","last_became_active":"2024-09-12T00:12:22.840587+0000","last_became_peered":"2024-09-12T00:12:22.840587+0000","last_unstale":"2024-09-12T00:12:24.722400+0000","last_undegraded":"2024-09-12T00:12:24.722400+0000","last_fullsized":"2024-09-12T00:12:24.722400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:04.555069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065014999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:25.140210+0000","last_change":"2024-09-12T00:12:25.140418+0000","last_active":"2024-09-12T00:12:25.140210+0000","last_peered":"2024-09-12T00:12:25.140210+0000","last_clean":"2024-09-12T00:12:25.140210+0000","last_became_active":"2024-09-12T00:12:22.714487+0000","last_became_peered":"2024-09-12T00:12:22.714487+0000","last_unstale":"2024-09-12T00:12:25.140210+0000","last_undegraded":"2024-09-12T00:12:25.140210+0000","last_fullsized":"2024-09-12T00:12:25.140210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:43.265742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038937299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:24.720267+0000","last_change":"2024-09-12T00:12:24.720267+0000","last_active":"2024-09-12T00:12:24.720267+0000","last_peered":"2024-09-12T00:12:24.720267+0000","last_clean":"2024-09-12T00:12:24.720267+0000","last_became_active":"2024-09-12T00:12:22.713657+0000","last_became_peered":"2024-09-12T00:12:22.713657+0000","last_unstale":"2024-09-12T00:12:24.720267+0000","last_undegraded":"2024-09-12T00:12:24.720267+0000","last_fullsized":"2024-09-12T00:12:24.720267+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:55.127846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012667690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"21'1","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:24.720432+0000","last_change":"2024-09-12T00:12:24.720432+0000","last_active":"2024-09-12T00:12:24.720432+0000","last_peered":"2024-09-12T00:12:24.720432+0000","last_clean":"2024-09-12T00:12:24.720432+0000","last_became_active":"2024-09-12T00:12:22.713297+0000","last_became_peered":"2024-09-12T00:12:22.713297+0000","last_unstale":"2024-09-12T00:12:24.720432+0000","last_undegraded":"2024-09-12T00:12:24.720432+0000","last_fullsized":"2024-09-12T00:12:24.720432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:31.323737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014022310000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":112,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T00:12:25.139375+0000","last_change":"2024-09-12T00:12:17.818843+0000","last_active":"2024-09-12T00:12:25.139375+0000","last_peered":"2024-09-12T00:12:25.139375+0000","last_clean":"2024-09-12T00:12:25.139375+0000","last_became_active":"2024-09-12T00:12:17.817880+0000","last_became_peered":"2024-09-12T00:12:17.817880+0000","last_unstale":"2024-09-12T00:12:25.139375+0000","last_undegraded":"2024-09-12T00:12:25.139375+0000","last_fullsized":"2024-09-12T00:12:25.139375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:16.658840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:16.658840+0000","last_clean_scrub_stamp":"2024-09-12T00:12:16.658840+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:23.769027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":79208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":79208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":827392,"data_stored":669557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":827392,"data_stored":669557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:12:30.953 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:12:30.953 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:12:30.953 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:12:30.953 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:12:31.289 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:12:31.289 INFO:teuthology.orchestra.run.smithi133.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:12:31.302 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:12:31.303 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T00:12:31.665 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:12:31.711 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-12T00:12:31.711 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:12:31.712 INFO:tasks.rgw:Creating data pools 2024-09-12T00:12:31.712 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:12:31.712 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-12T00:12:33.004 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T00:12:35.004 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:12:35.030 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:12:36.006 INFO:teuthology.orchestra.run.smithi133.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:12:36.033 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:12:37.011 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:12:37.033 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:12:38.026 INFO:teuthology.orchestra.run.smithi133.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:12:38.054 DEBUG:tasks.rgw:Pools created 2024-09-12T00:12:38.054 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T00:12:38.054 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:12:38.054 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:12:38.054 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:12:38.161 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:38.161 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:40.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.068+0000 7f8b59470640 0 -- 172.21.15.133:0/1482389842 >> [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] conn(0x7f8a34076380 msgr2=0x7f8a34078840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:40.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.073+0000 7f8b5cf28800 20 rados->read ofs=0 len=0 2024-09-12T00:12:40.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.074+0000 7f8b5846e640 0 -- 172.21.15.133:0/2190589304 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x562360884f50 msgr2=0x5623608873c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:40.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.275+0000 7f8b5cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:40.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.275+0000 7f8b5cf28800 20 realm 2024-09-12T00:12:40.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.275+0000 7f8b5cf28800 20 rados->read ofs=0 len=0 2024-09-12T00:12:40.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.276+0000 7f8b5cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:40.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.276+0000 7f8b5cf28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:40.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.276+0000 7f8b5cf28800 20 rados->read ofs=0 len=0 2024-09-12T00:12:40.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.276+0000 7f8b5cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:40.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.276+0000 7f8b5cf28800 20 rados->read ofs=0 len=0 2024-09-12T00:12:40.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.277+0000 7f8b5cf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:40.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.277+0000 7f8b5cf28800 20 rados->read ofs=0 len=0 2024-09-12T00:12:40.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.278+0000 7f8b5cf28800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:12:40.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.278+0000 7f8b5cf28800 20 searching for the correct realm 2024-09-12T00:12:40.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.290+0000 7f8b5cf28800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:12:40.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.290+0000 7f8b5cf28800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:12:40.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.290+0000 7f8b5cf28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:12:40.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.290+0000 7f8b5cf28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:12:40.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.290+0000 7f8b5cf28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:12:40.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.290+0000 7f8b5cf28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:12:40.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.290+0000 7f8b5cf28800 20 rados->read ofs=0 len=0 2024-09-12T00:12:40.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.290+0000 7f8b5cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:40.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.290+0000 7f8b5cf28800 20 rados->read ofs=0 len=0 2024-09-12T00:12:40.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.291+0000 7f8b5cf28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:40.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.291+0000 7f8b5cf28800 20 rados->read ofs=0 len=0 2024-09-12T00:12:40.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.291+0000 7f8b5cf28800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:12:40.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.291+0000 7f8b5cf28800 20 zone default found 2024-09-12T00:12:40.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.291+0000 7f8b5cf28800 4 Realm: () 2024-09-12T00:12:40.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.291+0000 7f8b5cf28800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:12:40.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.291+0000 7f8b5cf28800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:12:40.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.291+0000 7f8b5cf28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:12:40.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.291+0000 7f8b5cf28800 20 zonegroup default 2024-09-12T00:12:40.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.291+0000 7f8b5cf28800 20 rados->read ofs=0 len=0 2024-09-12T00:12:40.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.291+0000 7f8b5cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:40.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:40.291+0000 7f8b5cf28800 20 rados->read ofs=0 len=0 2024-09-12T00:12:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:42.048+0000 7f8b5cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:42.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:42.048+0000 7f8b5cf28800 20 rados->read ofs=0 len=0 2024-09-12T00:12:42.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:42.049+0000 7f8b5cf28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:42.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:42.049+0000 7f8b5cf28800 20 started sync module instance, tier type = 2024-09-12T00:12:42.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:42.049+0000 7f8b5cf28800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:12:44.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.082+0000 7f8b5cf28800 20 add_watcher() i=0 2024-09-12T00:12:44.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.082+0000 7f8b5cf28800 20 add_watcher() i=1 2024-09-12T00:12:44.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.082+0000 7f8b5cf28800 20 add_watcher() i=2 2024-09-12T00:12:44.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.082+0000 7f8b5cf28800 20 add_watcher() i=3 2024-09-12T00:12:44.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.082+0000 7f8b5cf28800 20 add_watcher() i=4 2024-09-12T00:12:44.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.082+0000 7f8b5cf28800 20 add_watcher() i=5 2024-09-12T00:12:44.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.082+0000 7f8b5cf28800 20 add_watcher() i=6 2024-09-12T00:12:44.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.086+0000 7f8b5cf28800 20 add_watcher() i=7 2024-09-12T00:12:44.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.086+0000 7f8b5cf28800 2 all 8 watchers are set, enabling cache 2024-09-12T00:12:44.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.086+0000 7f8b5cf28800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T00:12:44.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.086+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T00:12:44.084 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.086+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.086+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T00:12:44.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.086+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T00:12:44.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.086+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.086+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T00:12:44.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.086+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T00:12:44.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.086+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.087+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T00:12:44.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.087+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T00:12:44.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.087+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.087+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T00:12:44.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.087+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T00:12:44.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.087+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.087+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T00:12:44.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.087+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T00:12:44.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.087+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.087+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T00:12:44.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.087+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T00:12:44.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.087+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.088+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T00:12:44.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.088+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T00:12:44.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.088+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.088+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T00:12:44.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.088+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T00:12:44.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.088+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.088+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T00:12:44.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.088+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T00:12:44.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.088+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.088+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T00:12:44.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.088+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T00:12:44.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.088+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.089+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T00:12:44.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.089+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T00:12:44.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.089+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.089+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T00:12:44.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.089+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T00:12:44.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.089+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.089+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T00:12:44.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.089+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T00:12:44.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.089+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.089+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T00:12:44.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.089+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T00:12:44.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.089+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.090+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T00:12:44.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.090+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T00:12:44.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.090+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.090+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T00:12:44.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.090+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T00:12:44.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.090+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.090+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T00:12:44.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.090+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T00:12:44.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.090+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.090+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T00:12:44.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.090+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T00:12:44.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.090+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.090+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T00:12:44.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.090+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T00:12:44.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.090+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.091+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T00:12:44.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.091+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T00:12:44.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.091+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.091+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T00:12:44.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.091+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T00:12:44.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.091+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.091+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T00:12:44.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.091+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T00:12:44.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.091+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.091+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T00:12:44.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.091+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T00:12:44.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.091+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.092+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T00:12:44.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.092+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T00:12:44.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.092+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.092+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T00:12:44.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.092+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T00:12:44.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.092+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.092+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T00:12:44.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.092+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T00:12:44.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.092+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.092+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T00:12:44.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.092+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T00:12:44.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.092+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.093+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T00:12:44.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.093+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T00:12:44.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.093+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.093+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T00:12:44.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.093+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T00:12:44.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.093+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.093+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T00:12:44.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.093+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T00:12:44.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.093+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.093+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T00:12:44.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.093+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T00:12:44.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.093+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.094+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T00:12:44.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.094+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T00:12:44.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.094+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.094+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T00:12:44.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.094+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T00:12:44.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.094+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.094+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T00:12:44.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.094+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T00:12:44.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.094+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.095+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T00:12:44.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.095+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T00:12:44.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.095+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.095+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T00:12:44.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.095+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T00:12:44.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.095+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.095+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T00:12:44.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.095+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T00:12:44.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.095+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.095+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T00:12:44.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.095+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T00:12:44.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.095+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.096+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T00:12:44.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.096+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T00:12:44.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.096+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.096+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T00:12:44.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.096+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T00:12:44.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.096+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.096+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T00:12:44.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.096+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T00:12:44.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.096+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.096+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T00:12:44.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.096+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T00:12:44.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.096+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.096+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T00:12:44.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.096+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T00:12:44.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.096+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.097+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T00:12:44.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.097+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T00:12:44.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.097+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.097+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T00:12:44.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.097+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T00:12:44.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.097+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.097+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T00:12:44.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.097+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T00:12:44.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.097+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.097+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T00:12:44.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.097+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T00:12:44.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.097+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.098+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T00:12:44.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.098+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T00:12:44.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.098+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.098+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T00:12:44.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.098+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T00:12:44.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.098+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.098+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T00:12:44.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.098+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T00:12:44.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.098+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.098+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T00:12:44.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.098+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T00:12:44.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.098+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.099+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T00:12:44.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.099+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T00:12:44.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.099+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.099+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T00:12:44.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.099+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T00:12:44.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.099+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.099+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T00:12:44.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.099+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T00:12:44.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.099+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.099+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T00:12:44.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.099+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T00:12:44.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.099+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.100+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T00:12:44.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.100+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T00:12:44.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.100+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.100+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T00:12:44.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.100+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T00:12:44.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.100+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.100+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T00:12:44.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.100+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T00:12:44.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.100+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.100+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T00:12:44.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.100+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T00:12:44.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.100+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.100+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T00:12:44.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.100+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T00:12:44.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.100+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.101+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T00:12:44.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.101+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T00:12:44.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.101+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.101+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T00:12:44.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.101+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T00:12:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.101+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.101+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T00:12:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.101+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T00:12:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.101+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.102+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T00:12:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.102+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T00:12:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.102+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.102+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T00:12:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.102+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T00:12:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.102+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.102+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T00:12:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.102+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T00:12:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.102+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.102+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T00:12:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.102+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T00:12:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.102+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.102+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T00:12:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.102+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T00:12:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.102+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.103+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T00:12:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.103+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T00:12:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.103+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.103+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T00:12:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.103+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T00:12:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.103+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.103+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T00:12:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.103+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T00:12:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.103+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.103+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T00:12:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.103+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T00:12:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.103+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.103+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T00:12:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.103+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T00:12:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.103+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.104+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T00:12:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.104+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T00:12:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.104+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.104+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T00:12:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.104+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T00:12:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.104+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.104+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T00:12:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.104+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T00:12:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.104+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.105+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T00:12:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.105+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T00:12:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.105+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.105+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T00:12:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.105+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T00:12:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.105+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.105+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T00:12:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.105+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T00:12:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.105+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.105+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T00:12:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.105+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T00:12:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.105+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.106+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T00:12:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.106+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T00:12:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.106+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.106+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T00:12:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.106+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T00:12:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.106+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.106+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T00:12:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.106+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T00:12:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.106+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.106+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T00:12:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.106+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T00:12:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.106+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.106+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T00:12:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.106+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T00:12:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.106+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.107+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T00:12:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.107+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T00:12:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.107+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.107+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T00:12:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.107+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T00:12:44.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.107+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.107+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T00:12:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.107+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T00:12:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.107+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.107+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T00:12:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.107+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T00:12:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.107+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.108+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T00:12:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.108+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T00:12:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.108+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.108+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T00:12:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.108+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T00:12:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.108+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.108+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T00:12:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.108+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T00:12:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.108+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.108+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T00:12:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.108+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T00:12:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.108+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.109+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T00:12:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.109+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T00:12:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.109+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.109+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T00:12:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.109+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T00:12:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.109+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.109+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T00:12:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.109+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T00:12:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.109+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.109+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T00:12:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.109+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T00:12:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.109+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.110+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T00:12:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.110+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T00:12:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.110+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.110+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T00:12:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.110+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T00:12:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.110+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.110+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T00:12:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.110+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T00:12:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.110+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.110+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T00:12:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.110+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T00:12:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.110+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.110+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T00:12:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.110+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T00:12:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.110+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.111+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T00:12:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.111+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T00:12:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.111+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.111+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T00:12:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.111+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T00:12:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.111+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.111+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T00:12:44.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.111+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T00:12:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.111+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.111+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T00:12:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.111+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T00:12:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.111+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.112+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T00:12:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.112+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T00:12:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.112+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.112+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T00:12:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.112+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T00:12:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.112+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.112+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T00:12:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.112+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T00:12:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.112+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.112+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T00:12:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.112+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T00:12:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.112+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.112+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T00:12:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.112+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T00:12:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.112+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.113+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T00:12:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.113+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T00:12:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.113+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.113+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T00:12:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.113+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T00:12:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.113+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.113+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T00:12:44.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.113+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T00:12:44.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.113+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.113+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T00:12:44.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.113+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T00:12:44.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.113+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.114+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T00:12:44.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.114+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T00:12:44.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.114+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.114+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T00:12:44.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.114+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T00:12:44.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.114+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.114+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T00:12:44.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.114+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T00:12:44.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.114+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.114+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T00:12:44.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.114+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T00:12:44.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.114+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.114+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T00:12:44.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.114+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T00:12:44.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.114+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.115+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T00:12:44.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.115+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T00:12:44.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.115+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.115+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T00:12:44.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.115+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T00:12:44.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.115+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.115+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T00:12:44.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.115+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T00:12:44.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.115+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.115+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T00:12:44.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.115+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T00:12:44.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.115+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.116+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T00:12:44.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.116+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T00:12:44.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.116+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.116+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T00:12:44.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.116+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T00:12:44.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.116+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.116+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T00:12:44.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.116+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T00:12:44.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.116+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.116+0000 7f8b5cf28800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T00:12:44.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.116+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T00:12:44.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.117+0000 7f8b5cf28800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:12:44.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.126+0000 7f8a0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:44.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.126+0000 7f8b5cf28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:44.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:44.126+0000 7f8b5cf28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.058+0000 7f8b5cf28800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T00:12:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.058+0000 7f8b5cf28800 5 note: GC not initialized 2024-09-12T00:12:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.058+0000 7f8a09fe3640 20 reqs_thread_entry: start 2024-09-12T00:12:47.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.058+0000 7f8b5cf28800 20 init_complete bucket index max shards: 1 2024-09-12T00:12:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.058+0000 7f8b5cf28800 20 Filter name: none 2024-09-12T00:12:47.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.059+0000 7f896b7fe640 20 reqs_thread_entry: start 2024-09-12T00:12:47.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.087+0000 7f8a0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:47.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.089+0000 7f8b5cf28800 20 remove_watcher() i=0 2024-09-12T00:12:47.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.089+0000 7f8b5cf28800 2 removed watcher, disabling cache 2024-09-12T00:12:47.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.091+0000 7f8b5cf28800 20 remove_watcher() i=1 2024-09-12T00:12:47.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.092+0000 7f8b5cf28800 20 remove_watcher() i=2 2024-09-12T00:12:47.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.093+0000 7f8b5cf28800 20 remove_watcher() i=3 2024-09-12T00:12:47.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.094+0000 7f8b5cf28800 20 remove_watcher() i=4 2024-09-12T00:12:47.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.096+0000 7f8b5cf28800 20 remove_watcher() i=5 2024-09-12T00:12:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.097+0000 7f8b5cf28800 20 remove_watcher() i=6 2024-09-12T00:12:47.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.098+0000 7f8b5cf28800 20 remove_watcher() i=7 2024-09-12T00:12:47.165 INFO:teuthology.orchestra.run.smithi133.stdout:[] 2024-09-12T00:12:47.165 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:12:47.165 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:12:47.165 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:12:47.166 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T00:12:47.230 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:47.230 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:47.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.257+0000 7f6b88087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:47.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.257+0000 7f6b88087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:47.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.260+0000 7f69bbfff640 20 reqs_thread_entry: start 2024-09-12T00:12:47.276 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"dc288c8f-59ac-48eb-bf10-42b042d6f57a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:12:47.276 DEBUG:tasks.util.rgw: json result: {'id': 'dc288c8f-59ac-48eb-bf10-42b042d6f57a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:12:47.276 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:12:47.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:12:47.277 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:12:47.333 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:47.333 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:47.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.366+0000 7f509600e800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.368+0000 7f509600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:47.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.368+0000 7f509600e800 20 realm 2024-09-12T00:12:47.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.368+0000 7f509600e800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.369+0000 7f509600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:47.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.369+0000 7f509600e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:47.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.369+0000 7f509600e800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.369+0000 7f509600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:47.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.369+0000 7f509600e800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.370+0000 7f509600e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:47.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.370+0000 7f509600e800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.370+0000 7f509600e800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:12:47.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.370+0000 7f509600e800 20 searching for the correct realm 2024-09-12T00:12:47.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.373+0000 7f5091f6c640 0 -- 172.21.15.133:0/606589087 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f508c08f120 msgr2=0x7f508c05f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:47.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.578+0000 7f509176b640 0 -- 172.21.15.133:0/606589087 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x55ac1e14c740 msgr2=0x55ac1e14eb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.583+0000 7f509600e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:12:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.583+0000 7f509600e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:12:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.583+0000 7f509600e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:12:47.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.583+0000 7f509600e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:12:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.583+0000 7f509600e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:12:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.583+0000 7f509600e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:12:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.583+0000 7f509600e800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.583+0000 7f509600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:47.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.583+0000 7f509600e800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.584+0000 7f509600e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:47.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.584+0000 7f509600e800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.584+0000 7f509600e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:12:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.584+0000 7f509600e800 20 zone default found 2024-09-12T00:12:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.584+0000 7f509600e800 4 Realm: () 2024-09-12T00:12:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.584+0000 7f509600e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:12:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.584+0000 7f509600e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:12:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.584+0000 7f509600e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:12:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.584+0000 7f509600e800 20 zonegroup default 2024-09-12T00:12:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.584+0000 7f509600e800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.584+0000 7f509600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.584+0000 7f509600e800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.584+0000 7f509600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.584+0000 7f509600e800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.585+0000 7f509600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:47.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.585+0000 7f509600e800 20 started sync module instance, tier type = 2024-09-12T00:12:47.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.585+0000 7f509600e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:12:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.602+0000 7f509600e800 20 add_watcher() i=0 2024-09-12T00:12:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.602+0000 7f509600e800 20 add_watcher() i=1 2024-09-12T00:12:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.602+0000 7f509600e800 20 add_watcher() i=2 2024-09-12T00:12:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.602+0000 7f509600e800 20 add_watcher() i=3 2024-09-12T00:12:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.602+0000 7f509600e800 20 add_watcher() i=4 2024-09-12T00:12:47.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.602+0000 7f509600e800 20 add_watcher() i=5 2024-09-12T00:12:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.602+0000 7f509600e800 20 add_watcher() i=6 2024-09-12T00:12:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.604+0000 7f509600e800 20 add_watcher() i=7 2024-09-12T00:12:47.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.604+0000 7f509600e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:12:47.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.607+0000 7f4f47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.607+0000 7f509600e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.607+0000 7f509600e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.607+0000 7f509600e800 5 note: GC not initialized 2024-09-12T00:12:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.607+0000 7f4f46fe5640 20 reqs_thread_entry: start 2024-09-12T00:12:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.607+0000 7f509600e800 20 init_complete bucket index max shards: 1 2024-09-12T00:12:47.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.607+0000 7f509600e800 20 Filter name: none 2024-09-12T00:12:47.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.607+0000 7f4f44fe1640 20 reqs_thread_entry: start 2024-09-12T00:12:47.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.617+0000 7f4f47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.619+0000 7f509600e800 20 remove_watcher() i=0 2024-09-12T00:12:47.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.619+0000 7f509600e800 2 removed watcher, disabling cache 2024-09-12T00:12:47.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.620+0000 7f509600e800 20 remove_watcher() i=1 2024-09-12T00:12:47.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.621+0000 7f509600e800 20 remove_watcher() i=2 2024-09-12T00:12:47.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.623+0000 7f509600e800 20 remove_watcher() i=3 2024-09-12T00:12:47.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.626+0000 7f509600e800 20 remove_watcher() i=4 2024-09-12T00:12:47.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.627+0000 7f509600e800 20 remove_watcher() i=5 2024-09-12T00:12:47.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.628+0000 7f509600e800 20 remove_watcher() i=6 2024-09-12T00:12:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.629+0000 7f509600e800 20 remove_watcher() i=7 2024-09-12T00:12:47.638 INFO:teuthology.orchestra.run.smithi133.stdout:[] 2024-09-12T00:12:47.639 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:12:47.639 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:12:47.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:12:47.639 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T00:12:47.702 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:47.702 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.728+0000 7fb02ed26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:47.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.728+0000 7fb02ed26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:47.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.732+0000 7faeed7e2640 20 reqs_thread_entry: start 2024-09-12T00:12:47.746 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"dc288c8f-59ac-48eb-bf10-42b042d6f57a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:12:47.747 DEBUG:tasks.util.rgw: json result: {'id': 'dc288c8f-59ac-48eb-bf10-42b042d6f57a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:12:47.747 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-12T00:12:47.747 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p /tmp/rgw_datacache 2024-09-12T00:12:47.775 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-12T00:12:47.854 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:12:47.854 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:12:47.854 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:12:47.950 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:47.950 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:47.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.984+0000 7fb4acb37800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.986+0000 7fb4acb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.986+0000 7fb4acb37800 20 realm 2024-09-12T00:12:47.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.986+0000 7fb4acb37800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.986+0000 7fb4acb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.986+0000 7fb4acb37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:12:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.986+0000 7fb4acb37800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.987+0000 7fb4acb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.987+0000 7fb4acb37800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.987+0000 7fb4acb37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:47.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.987+0000 7fb4acb37800 20 rados->read ofs=0 len=0 2024-09-12T00:12:47.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.988+0000 7fb4acb37800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:12:47.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.988+0000 7fb4acb37800 20 searching for the correct realm 2024-09-12T00:12:47.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.990+0000 7fb49ffc2640 0 -- 172.21.15.133:0/2170238030 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fb490029030 msgr2=0x7fb490065980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:47.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:47.994+0000 7fb49ffc2640 0 -- 172.21.15.133:0/2170238030 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fb49802e910 msgr2=0x7fb4980473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:12:48.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.201+0000 7fb4acb37800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:12:48.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.201+0000 7fb4acb37800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:12:48.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.201+0000 7fb4acb37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:12:48.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.201+0000 7fb4acb37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:12:48.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.201+0000 7fb4acb37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:12:48.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.201+0000 7fb4acb37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:12:48.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.201+0000 7fb4acb37800 20 rados->read ofs=0 len=0 2024-09-12T00:12:48.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.201+0000 7fb4acb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:48.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.201+0000 7fb4acb37800 20 rados->read ofs=0 len=0 2024-09-12T00:12:48.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.201+0000 7fb4acb37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:12:48.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.201+0000 7fb4acb37800 20 rados->read ofs=0 len=0 2024-09-12T00:12:48.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.202+0000 7fb4acb37800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:12:48.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.202+0000 7fb4acb37800 20 zone default found 2024-09-12T00:12:48.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.202+0000 7fb4acb37800 4 Realm: () 2024-09-12T00:12:48.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.202+0000 7fb4acb37800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:12:48.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.202+0000 7fb4acb37800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:12:48.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.202+0000 7fb4acb37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:12:48.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.202+0000 7fb4acb37800 20 zonegroup default 2024-09-12T00:12:48.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.202+0000 7fb4acb37800 20 rados->read ofs=0 len=0 2024-09-12T00:12:48.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.202+0000 7fb4acb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:48.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.203+0000 7fb4acb37800 20 rados->read ofs=0 len=0 2024-09-12T00:12:48.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.203+0000 7fb4acb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:48.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.203+0000 7fb4acb37800 20 rados->read ofs=0 len=0 2024-09-12T00:12:48.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.203+0000 7fb4acb37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:12:48.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.203+0000 7fb4acb37800 20 started sync module instance, tier type = 2024-09-12T00:12:48.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.203+0000 7fb4acb37800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:12:48.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.219+0000 7fb4acb37800 20 add_watcher() i=0 2024-09-12T00:12:48.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.219+0000 7fb4acb37800 20 add_watcher() i=1 2024-09-12T00:12:48.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.219+0000 7fb4acb37800 20 add_watcher() i=2 2024-09-12T00:12:48.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.219+0000 7fb4acb37800 20 add_watcher() i=3 2024-09-12T00:12:48.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.219+0000 7fb4acb37800 20 add_watcher() i=4 2024-09-12T00:12:48.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.219+0000 7fb4acb37800 20 add_watcher() i=5 2024-09-12T00:12:48.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.219+0000 7fb4acb37800 20 add_watcher() i=6 2024-09-12T00:12:48.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.221+0000 7fb4acb37800 20 add_watcher() i=7 2024-09-12T00:12:48.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.221+0000 7fb4acb37800 2 all 8 watchers are set, enabling cache 2024-09-12T00:12:48.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.223+0000 7fb35efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:48.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.223+0000 7fb4acb37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:48.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.223+0000 7fb4acb37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:48.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.223+0000 7fb4acb37800 5 note: GC not initialized 2024-09-12T00:12:48.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.223+0000 7fb35dfdb640 20 reqs_thread_entry: start 2024-09-12T00:12:48.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.223+0000 7fb4acb37800 20 init_complete bucket index max shards: 1 2024-09-12T00:12:48.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.223+0000 7fb4acb37800 20 Filter name: none 2024-09-12T00:12:48.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.223+0000 7fb2cf7fe640 20 reqs_thread_entry: start 2024-09-12T00:12:48.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.233+0000 7fb35efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:12:48.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.235+0000 7fb4acb37800 20 remove_watcher() i=0 2024-09-12T00:12:48.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.235+0000 7fb4acb37800 2 removed watcher, disabling cache 2024-09-12T00:12:48.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.236+0000 7fb4acb37800 20 remove_watcher() i=1 2024-09-12T00:12:48.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.237+0000 7fb4acb37800 20 remove_watcher() i=2 2024-09-12T00:12:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.238+0000 7fb4acb37800 20 remove_watcher() i=3 2024-09-12T00:12:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.240+0000 7fb4acb37800 20 remove_watcher() i=4 2024-09-12T00:12:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.241+0000 7fb4acb37800 20 remove_watcher() i=5 2024-09-12T00:12:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.242+0000 7fb4acb37800 20 remove_watcher() i=6 2024-09-12T00:12:48.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.244+0000 7fb4acb37800 20 remove_watcher() i=7 2024-09-12T00:12:48.253 INFO:teuthology.orchestra.run.smithi133.stdout:[] 2024-09-12T00:12:48.253 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:12:48.254 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T00:12:48.254 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:12:48.254 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:12:48.254 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T00:12:48.316 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:48.318 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:48.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.343+0000 7fa03230c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:48.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.343+0000 7fa03230c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:48.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.346+0000 7f9e9dffb640 20 reqs_thread_entry: start 2024-09-12T00:12:48.360 INFO:teuthology.orchestra.run.smithi133.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T00:12:48.360 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T00:12:48.360 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:12:48.360 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:12:48.360 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T00:12:48.424 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:48.424 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:48.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.450+0000 7f250c52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:48.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.450+0000 7f250c52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:48.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.454+0000 7f237e7fc640 20 reqs_thread_entry: start 2024-09-12T00:12:48.468 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"dc288c8f-59ac-48eb-bf10-42b042d6f57a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:12:48.469 DEBUG:tasks.util.rgw: json result: {'id': 'dc288c8f-59ac-48eb-bf10-42b042d6f57a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:12:48.469 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T00:12:48.469 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:12:48.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:12:48.469 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T00:12:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:48.531 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:48.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.557+0000 7f778a723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:48.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.557+0000 7f778a723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:48.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.561+0000 7f7648fe1640 20 reqs_thread_entry: start 2024-09-12T00:12:48.576 INFO:teuthology.orchestra.run.smithi133.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T00:12:48.577 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T00:12:48.577 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:12:48.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:12:48.577 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T00:12:48.641 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:48.641 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:48.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.668+0000 7efdcf130800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:12:48.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.668+0000 7efdcf130800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:12:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:12:48.673+0000 7efc8d7e2640 20 reqs_thread_entry: start 2024-09-12T00:12:48.687 INFO:teuthology.orchestra.run.smithi133.stdout:{"id":"dc288c8f-59ac-48eb-bf10-42b042d6f57a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:12:48.688 DEBUG:tasks.util.rgw: json result: {'id': 'dc288c8f-59ac-48eb-bf10-42b042d6f57a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:12:48.688 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:12:48.688 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-12T00:12:48.688 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:12:48.688 DEBUG:teuthology.orchestra.run.smithi133:> sudo echo -n http://smithi133.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:12:48.729 INFO:teuthology.orchestra.run.smithi133.stdout:http://smithi133.front.sepia.ceph.com:80 2024-09-12T00:12:48.729 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:12:48.810 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-12T00:12:48.810 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:12:48.810 DEBUG:teuthology.orchestra.run.smithi133:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:12:48.857 INFO:tasks.rgw.client.0:Started 2024-09-12T00:12:48.857 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi133.front.sepia.ceph.com:80/ 2024-09-12T00:12:48.857 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-09-12T00:12:48.900 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:12:48.900 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:12:48.901 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:12:48.901 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:12:48.901 INFO:teuthology.orchestra.run.smithi133.stderr:curl: (7) Failed to connect to smithi133.front.sepia.ceph.com port 80: Connection refused 2024-09-12T00:12:49.901 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-09-12T00:12:49.935 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:12:49.935 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:12:49.935 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:12:49.935 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:12:49.935 INFO:teuthology.orchestra.run.smithi133.stderr:curl: (7) Failed to connect to smithi133.front.sepia.ceph.com port 80: Connection refused 2024-09-12T00:12:51.937 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-09-12T00:12:51.969 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:12:51.970 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:12:51.970 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:12:51.970 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:12:51.971 INFO:teuthology.orchestra.run.smithi133.stderr:curl: (7) Failed to connect to smithi133.front.sepia.ceph.com port 80: Connection refused 2024-09-12T00:12:55.972 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-09-12T00:12:56.005 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:12:56.005 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:12:56.005 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:12:56.006 INFO:teuthology.orchestra.run.smithi133.stderr:curl: (7) Failed to connect to smithi133.front.sepia.ceph.com port 80: Connection refused 2024-09-12T00:12:56.006 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:13:04.008 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-09-12T00:13:04.040 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:13:04.041 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:13:04.041 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:13:04.041 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:13:04.042 INFO:teuthology.orchestra.run.smithi133.stderr:curl: (7) Failed to connect to smithi133.front.sepia.ceph.com port 80: Connection refused 2024-09-12T00:13:20.042 DEBUG:teuthology.orchestra.run.smithi133:> curl http://smithi133.front.sepia.ceph.com:80/ 2024-09-12T00:13:20.083 INFO:teuthology.orchestra.run.smithi133.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:13:20.083 INFO:teuthology.orchestra.run.smithi133.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:13:20.393 INFO:teuthology.orchestra.run.smithi133.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 603 0 --:--:-- --:--:-- --:--:-- 603 2024-09-12T00:13:20.393 INFO:teuthology.orchestra.run.smithi133.stdout:anonymous 2024-09-12T00:13:20.394 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T00:13:20.406 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T00:13:20.406 DEBUG:teuthology.orchestra.run.smithi133:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T00:13:22.736 DEBUG:teuthology.orchestra.run.smithi133:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T00:13:23.260 INFO:teuthology.orchestra.run.smithi133.stdout:Collecting tox==3.15.0 2024-09-12T00:13:23.310 INFO:teuthology.orchestra.run.smithi133.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T00:13:23.615 INFO:teuthology.orchestra.run.smithi133.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T00:13:23.636 INFO:teuthology.orchestra.run.smithi133.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T00:13:23.880 INFO:teuthology.orchestra.run.smithi133.stdout:Collecting packaging>=14 2024-09-12T00:13:23.894 INFO:teuthology.orchestra.run.smithi133.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T00:13:23.995 INFO:teuthology.orchestra.run.smithi133.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T00:13:24.010 INFO:teuthology.orchestra.run.smithi133.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T00:13:24.080 INFO:teuthology.orchestra.run.smithi133.stdout:Collecting toml>=0.9.4 2024-09-12T00:13:24.094 INFO:teuthology.orchestra.run.smithi133.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T00:13:24.175 INFO:teuthology.orchestra.run.smithi133.stdout:Collecting py<2,>=1.4.17 2024-09-12T00:13:24.193 INFO:teuthology.orchestra.run.smithi133.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T00:13:24.283 INFO:teuthology.orchestra.run.smithi133.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T00:13:24.299 INFO:teuthology.orchestra.run.smithi133.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T00:13:24.380 INFO:teuthology.orchestra.run.smithi133.stdout:Collecting six<2,>=1.14.0 2024-09-12T00:13:24.395 INFO:teuthology.orchestra.run.smithi133.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:13:24.539 INFO:teuthology.orchestra.run.smithi133.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T00:13:24.553 INFO:teuthology.orchestra.run.smithi133.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T00:13:24.645 INFO:teuthology.orchestra.run.smithi133.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T00:13:24.661 INFO:teuthology.orchestra.run.smithi133.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T00:13:24.780 INFO:teuthology.orchestra.run.smithi133.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-12T00:13:25.593 INFO:teuthology.orchestra.run.smithi133.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T00:13:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-12T00:13:25.816 INFO:teuthology.orchestra.run.smithi133.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-12T00:13:25.880 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:13:25.895 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:13:25.895 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:13:25.896 DEBUG:teuthology.orchestra.run.smithi133:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:13:25.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:13:25.926 INFO:teuthology.orchestra.run.smithi133.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:13:25.926 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:13:25.995 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:13:25.996 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:13:26.065 INFO:tasks.workunit:timeout=3h 2024-09-12T00:13:26.065 INFO:tasks.workunit:cleanup=True 2024-09-12T00:13:26.066 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:13:26.134 INFO:tasks.workunit.client.0.smithi133.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:14:10.255 INFO:tasks.workunit.client.0.smithi133.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:14:10.256 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:14:10.256 INFO:tasks.workunit.client.0.smithi133.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:14:10.256 INFO:tasks.workunit.client.0.smithi133.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:14:10.256 INFO:tasks.workunit.client.0.smithi133.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:14:10.256 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:14:10.256 INFO:tasks.workunit.client.0.smithi133.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:14:10.256 INFO:tasks.workunit.client.0.smithi133.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:14:10.256 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:14:10.256 INFO:tasks.workunit.client.0.smithi133.stderr: git switch -c 2024-09-12T00:14:10.257 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:14:10.257 INFO:tasks.workunit.client.0.smithi133.stderr:Or undo this operation with: 2024-09-12T00:14:10.257 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:14:10.257 INFO:tasks.workunit.client.0.smithi133.stderr: git switch - 2024-09-12T00:14:10.257 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:14:10.257 INFO:tasks.workunit.client.0.smithi133.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:14:10.257 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:14:10.257 INFO:tasks.workunit.client.0.smithi133.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:14:10.259 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:14:10.351 INFO:tasks.workunit.client.0.smithi133.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:14:10.352 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:14:10.352 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:14:10.967 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:14:11.036 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:14:11.077 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:14:11.079 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:14:11.079 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:14:11.118 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:14:11.122 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:14:11.122 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:14:11.179 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-12T00:14:11.180 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-12T00:14:11.180 DEBUG:teuthology.orchestra.run.smithi133:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T00:14:11.266 INFO:tasks.workunit.client.0.smithi133.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-12T00:14:11.267 INFO:tasks.workunit.client.0.smithi133.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:14:11.267 INFO:tasks.workunit.client.0.smithi133.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:14:13.557 INFO:tasks.workunit.client.0.smithi133.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:14:13.557 INFO:tasks.workunit.client.0.smithi133.stderr:++ deactivate nondestructive 2024-09-12T00:14:13.557 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T00:14:13.558 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T00:14:13.558 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:14:13.558 INFO:tasks.workunit.client.0.smithi133.stderr:++ hash -r 2024-09-12T00:14:13.558 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T00:14:13.558 INFO:tasks.workunit.client.0.smithi133.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:14:13.558 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:14:13.558 INFO:tasks.workunit.client.0.smithi133.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:14:13.559 INFO:tasks.workunit.client.0.smithi133.stderr:++ export VIRTUAL_ENV 2024-09-12T00:14:13.560 INFO:tasks.workunit.client.0.smithi133.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:14:13.560 INFO:tasks.workunit.client.0.smithi133.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:14:13.560 INFO:tasks.workunit.client.0.smithi133.stderr:++ export PATH 2024-09-12T00:14:13.560 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T00:14:13.560 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -z '' ']' 2024-09-12T00:14:13.560 INFO:tasks.workunit.client.0.smithi133.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:14:13.560 INFO:tasks.workunit.client.0.smithi133.stderr:++ PS1='(rgw) ' 2024-09-12T00:14:13.560 INFO:tasks.workunit.client.0.smithi133.stderr:++ export PS1 2024-09-12T00:14:13.560 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:14:13.561 INFO:tasks.workunit.client.0.smithi133.stderr:++ hash -r 2024-09-12T00:14:13.561 INFO:tasks.workunit.client.0.smithi133.stderr:+ pip install pip --upgrade 2024-09-12T00:14:13.784 INFO:tasks.workunit.client.0.smithi133.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:14:13.968 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting pip 2024-09-12T00:14:14.020 INFO:tasks.workunit.client.0.smithi133.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:14:14.167 INFO:tasks.workunit.client.0.smithi133.stdout:Installing collected packages: pip 2024-09-12T00:14:14.168 INFO:tasks.workunit.client.0.smithi133.stdout: Attempting uninstall: pip 2024-09-12T00:14:14.168 INFO:tasks.workunit.client.0.smithi133.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:14:14.322 INFO:tasks.workunit.client.0.smithi133.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:14:14.327 INFO:tasks.workunit.client.0.smithi133.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:14:15.053 INFO:tasks.workunit.client.0.smithi133.stdout:Successfully installed pip-24.2 2024-09-12T00:14:15.300 INFO:tasks.workunit.client.0.smithi133.stderr:+ pip install configobj 2024-09-12T00:14:15.668 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting configobj 2024-09-12T00:14:15.712 INFO:tasks.workunit.client.0.smithi133.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-12T00:14:15.833 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting six (from configobj) 2024-09-12T00:14:15.847 INFO:tasks.workunit.client.0.smithi133.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:14:15.910 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-12T00:14:15.984 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:14:16.047 INFO:tasks.workunit.client.0.smithi133.stdout:Installing collected packages: six, configobj 2024-09-12T00:14:16.173 INFO:tasks.workunit.client.0.smithi133.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-12T00:14:16.218 INFO:tasks.workunit.client.0.smithi133.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-12T00:14:16.252 INFO:tasks.workunit.client.0.smithi133.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-12T00:14:16.252 INFO:tasks.workunit.client.0.smithi133.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-12T00:14:16.253 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:command succeeded 2024-09-12T00:14:16.253 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-12T00:14:16.254 INFO:tasks.workunit.client.0.smithi133.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:14:16.254 INFO:tasks.workunit.client.0.smithi133.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-12T00:14:16.331 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:command succeeded 2024-09-12T00:14:16.331 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:b'tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 46771/valgrind \ntcp6 0 0 :::80 :::* LISTEN 46771/valgrind \n' 2024-09-12T00:14:16.331 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:radosgw port: 80 2024-09-12T00:14:16.331 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-12T00:14:16.331 INFO:tasks.workunit.client.0.smithi133.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-12T00:14:16.353 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:command succeeded 2024-09-12T00:14:16.353 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:b'' 2024-09-12T00:14:16.353 INFO:tasks.workunit.client.0.smithi133.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-12T00:14:16.921 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:command succeeded 2024-09-12T00:14:16.921 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-12T00:14:16.866816Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-12T00:14:16.866805Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-12T00:14:16.921 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:Creating s3cmd config... 2024-09-12T00:14:16.921 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:proto for s3cmd config is http 2024-09-12T00:14:16.921 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:s3cmd config written 2024-09-12T00:14:16.921 INFO:tasks.workunit.client.0.smithi133.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-12T00:14:17.460 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:command succeeded 2024-09-12T00:14:17.460 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-12T00:14:17.460 INFO:tasks.workunit.client.0.smithi133.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-12T00:14:19.026 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:command succeeded 2024-09-12T00:14:19.027 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 1.3 seconds, 5.26 MB/s) [1 of 1]\n" 2024-09-12T00:14:19.027 INFO:tasks.workunit.client.0.smithi133.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-12T00:14:19.528 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:command succeeded 2024-09-12T00:14:19.529 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.3 seconds, 26.72 MB/s)\n" 2024-09-12T00:14:19.529 INFO:tasks.workunit.client.0.smithi133.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-12T00:14:19.851 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:command succeeded 2024-09-12T00:14:19.851 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7368844,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "lz4",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4210766\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4210766,\n "len": 3158078\n }\n ]\n },\n "etag": "0a27e8b97485cad243e23090e98fd289",\n "tag": "dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10633931434826317447",\n "manifest": {\n "objs": [],\n "obj_size": 7368844,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".5PyxE7YTq_tQwSCLV8rOXijOwRFW7rN_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 4194304,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1",\n "bucket_id": "dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4194304,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1",\n "bucket_id": "dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".5PyxE7YTq_tQwSCLV8rOXijOwRFW7rN_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 4194304,\n "ofs": 7368844,\n "stripe_size": 3174540,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1",\n "bucket_id": "dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".5PyxE7YTq_tQwSCLV8rOXijOwRFW7rN_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-12T00:14:18.929164Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10633931434826317447",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726100056/ctime:1726100056/gid:1333/gname:ubuntu/md5:0a27e8b97485cad243e23090e98fd289/mode:33188/mtime:1726100056/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-12T00:14:19.851 INFO:tasks.workunit.client.0.smithi133.stderr:DEBUG:root:Cached object name is: .5PyxE7YTq_tQwSCLV8rOXijOwRFW7rN_ 2024-09-12T00:14:19.851 INFO:tasks.workunit.client.0.smithi133.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-12T00:14:19.936 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:command succeeded 2024-09-12T00:14:19.937 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:b'0\n' 2024-09-12T00:14:19.937 INFO:tasks.workunit.client.0.smithi133.stderr:DEBUG:root:Check cache dir content: 0 2024-09-12T00:14:19.937 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-12T00:14:19.937 INFO:tasks.workunit.client.0.smithi133.stderr:INFO:root:Completed Datacache tests 2024-09-12T00:14:19.942 INFO:tasks.workunit.client.0.smithi133.stderr:+ deactivate 2024-09-12T00:14:19.942 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:14:19.942 INFO:tasks.workunit.client.0.smithi133.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:14:19.942 INFO:tasks.workunit.client.0.smithi133.stderr:+ export PATH 2024-09-12T00:14:19.942 INFO:tasks.workunit.client.0.smithi133.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:14:19.942 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n '' ']' 2024-09-12T00:14:19.942 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:14:19.942 INFO:tasks.workunit.client.0.smithi133.stderr:+ hash -r 2024-09-12T00:14:19.942 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n '' ']' 2024-09-12T00:14:19.942 INFO:tasks.workunit.client.0.smithi133.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:14:19.942 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:14:19.942 INFO:tasks.workunit.client.0.smithi133.stderr:+ unset -f deactivate 2024-09-12T00:14:19.942 INFO:tasks.workunit.client.0.smithi133.stderr:+ echo OK. 2024-09-12T00:14:19.943 INFO:tasks.workunit.client.0.smithi133.stdout:OK. 2024-09-12T00:14:19.944 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:14:19.944 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:14:20.025 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-12T00:14:20.025 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:14:20.356 DEBUG:teuthology.parallel:result is None 2024-09-12T00:14:20.357 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:14:20.396 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:14:20.396 DEBUG:teuthology.orchestra.run.smithi133:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:14:20.474 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:14:20.474 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:14:20.484 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:14:20.484 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:14:20.484 DEBUG:teuthology.orchestra.run.smithi133:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:14:20.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:14:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:14:20.543 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:14:20.612 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:14:20.612 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:14:20.685 INFO:tasks.workunit:timeout=3h 2024-09-12T00:14:20.685 INFO:tasks.workunit:cleanup=True 2024-09-12T00:14:20.685 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:14:20.755 INFO:tasks.workunit.client.0.smithi133.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:15:05.078 INFO:tasks.workunit.client.0.smithi133.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:15:05.078 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:05.078 INFO:tasks.workunit.client.0.smithi133.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:15:05.079 INFO:tasks.workunit.client.0.smithi133.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:15:05.079 INFO:tasks.workunit.client.0.smithi133.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:15:05.079 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:05.079 INFO:tasks.workunit.client.0.smithi133.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:15:05.079 INFO:tasks.workunit.client.0.smithi133.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:15:05.079 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:05.079 INFO:tasks.workunit.client.0.smithi133.stderr: git switch -c 2024-09-12T00:15:05.079 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:05.079 INFO:tasks.workunit.client.0.smithi133.stderr:Or undo this operation with: 2024-09-12T00:15:05.079 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:05.079 INFO:tasks.workunit.client.0.smithi133.stderr: git switch - 2024-09-12T00:15:05.079 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:05.079 INFO:tasks.workunit.client.0.smithi133.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:15:05.079 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:05.080 INFO:tasks.workunit.client.0.smithi133.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:15:05.082 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:15:05.152 INFO:tasks.workunit.client.0.smithi133.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:15:05.154 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:15:05.154 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:15:05.204 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:15:05.252 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:15:05.291 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:15:05.292 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:15:05.292 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:15:05.330 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:15:05.334 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:15:05.334 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:15:05.403 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T00:15:05.404 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T00:15:05.404 DEBUG:teuthology.orchestra.run.smithi133:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:15:05.476 INFO:tasks.workunit.client.0.smithi133.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:15:05.477 INFO:tasks.workunit.client.0.smithi133.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:15:05.477 INFO:tasks.workunit.client.0.smithi133.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:15:07.790 INFO:tasks.workunit.client.0.smithi133.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:15:07.790 INFO:tasks.workunit.client.0.smithi133.stderr:++ deactivate nondestructive 2024-09-12T00:15:07.790 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T00:15:07.790 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T00:15:07.790 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:15:07.791 INFO:tasks.workunit.client.0.smithi133.stderr:++ hash -r 2024-09-12T00:15:07.791 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T00:15:07.791 INFO:tasks.workunit.client.0.smithi133.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:15:07.791 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:15:07.791 INFO:tasks.workunit.client.0.smithi133.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:15:07.791 INFO:tasks.workunit.client.0.smithi133.stderr:++ export VIRTUAL_ENV 2024-09-12T00:15:07.791 INFO:tasks.workunit.client.0.smithi133.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:15:07.791 INFO:tasks.workunit.client.0.smithi133.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:15:07.791 INFO:tasks.workunit.client.0.smithi133.stderr:++ export PATH 2024-09-12T00:15:07.791 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T00:15:07.791 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -z '' ']' 2024-09-12T00:15:07.791 INFO:tasks.workunit.client.0.smithi133.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:15:07.792 INFO:tasks.workunit.client.0.smithi133.stderr:++ PS1='(rgw) ' 2024-09-12T00:15:07.792 INFO:tasks.workunit.client.0.smithi133.stderr:++ export PS1 2024-09-12T00:15:07.792 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:15:07.792 INFO:tasks.workunit.client.0.smithi133.stderr:++ hash -r 2024-09-12T00:15:07.792 INFO:tasks.workunit.client.0.smithi133.stderr:+ pip install pip --upgrade 2024-09-12T00:15:08.013 INFO:tasks.workunit.client.0.smithi133.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:15:08.194 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting pip 2024-09-12T00:15:08.199 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:15:08.243 INFO:tasks.workunit.client.0.smithi133.stdout:Installing collected packages: pip 2024-09-12T00:15:08.243 INFO:tasks.workunit.client.0.smithi133.stdout: Attempting uninstall: pip 2024-09-12T00:15:08.243 INFO:tasks.workunit.client.0.smithi133.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:15:08.395 INFO:tasks.workunit.client.0.smithi133.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:15:08.400 INFO:tasks.workunit.client.0.smithi133.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:15:09.119 INFO:tasks.workunit.client.0.smithi133.stdout:Successfully installed pip-24.2 2024-09-12T00:15:09.171 INFO:tasks.workunit.client.0.smithi133.stderr:+ pip install boto3 2024-09-12T00:15:10.017 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting boto3 2024-09-12T00:15:10.076 INFO:tasks.workunit.client.0.smithi133.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:15:10.738 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:15:10.753 INFO:tasks.workunit.client.0.smithi133.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:15:10.874 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:15:10.888 INFO:tasks.workunit.client.0.smithi133.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:15:11.014 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:15:11.029 INFO:tasks.workunit.client.0.smithi133.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:15:11.157 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:15:11.172 INFO:tasks.workunit.client.0.smithi133.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:15:11.328 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:15:11.342 INFO:tasks.workunit.client.0.smithi133.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:15:11.572 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:15:11.574 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:15:11.592 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:15:11.678 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:15:11.887 INFO:tasks.workunit.client.0.smithi133.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 62.7 MB/s eta 0:00:00 2024-09-12T00:15:11.907 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:15:11.961 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:15:12.025 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:15:12.102 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:15:12.154 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:15:12.228 INFO:tasks.workunit.client.0.smithi133.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:15:13.248 INFO:tasks.workunit.client.0.smithi133.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:15:13.373 INFO:tasks.workunit.client.0.smithi133.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T00:15:13.517 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T00:15:13.551 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:13.551 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:13.590 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.591+0000 7f866292e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:13.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.593+0000 7f866292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:13.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.593+0000 7f866292e800 20 realm 2024-09-12T00:15:13.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.593+0000 7f866292e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:13.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.593+0000 7f866292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:13.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.593+0000 7f866292e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:13.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.593+0000 7f866292e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:13.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.593+0000 7f866292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:13.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.593+0000 7f866292e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:13.593 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.594+0000 7f866292e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:13.593 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.594+0000 7f866292e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:13.593 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.595+0000 7f865eede640 0 -- 172.21.15.133:0/131011321 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x564a18659b10 msgr2=0x564a1865bf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:13.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.595+0000 7f866292e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:13.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.596+0000 7f866292e800 20 searching for the correct realm 2024-09-12T00:15:13.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.597+0000 7f865e6dd640 0 -- 172.21.15.133:0/131011321 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x564a18652050 msgr2=0x564a186544e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:13.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.605+0000 7f866292e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:13.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.605+0000 7f866292e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:13.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.605+0000 7f866292e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:13.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.605+0000 7f866292e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:13.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.605+0000 7f866292e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:13.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.605+0000 7f866292e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:13.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.605+0000 7f866292e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:13.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.606+0000 7f866292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:13.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.606+0000 7f866292e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:13.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.606+0000 7f866292e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:13.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.606+0000 7f866292e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:13.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.606+0000 7f866292e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:13.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.606+0000 7f866292e800 20 zone default found 2024-09-12T00:15:13.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.606+0000 7f866292e800 4 Realm: () 2024-09-12T00:15:13.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.606+0000 7f866292e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:13.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.606+0000 7f866292e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:13.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.606+0000 7f866292e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:13.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.606+0000 7f866292e800 20 zonegroup default 2024-09-12T00:15:13.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.606+0000 7f866292e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.607+0000 7f866292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.607+0000 7f866292e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.607+0000 7f866292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.607+0000 7f866292e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.607+0000 7f866292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.607+0000 7f866292e800 20 started sync module instance, tier type = 2024-09-12T00:15:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.607+0000 7f866292e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:13.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.623+0000 7f866292e800 20 add_watcher() i=0 2024-09-12T00:15:13.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.623+0000 7f866292e800 20 add_watcher() i=1 2024-09-12T00:15:13.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.623+0000 7f866292e800 20 add_watcher() i=2 2024-09-12T00:15:13.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.623+0000 7f866292e800 20 add_watcher() i=3 2024-09-12T00:15:13.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.623+0000 7f866292e800 20 add_watcher() i=4 2024-09-12T00:15:13.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.623+0000 7f866292e800 20 add_watcher() i=5 2024-09-12T00:15:13.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.623+0000 7f866292e800 20 add_watcher() i=6 2024-09-12T00:15:13.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.624+0000 7f866292e800 20 add_watcher() i=7 2024-09-12T00:15:13.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.624+0000 7f866292e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:13.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.626+0000 7f8514fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:13.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.626+0000 7f866292e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:13.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.626+0000 7f866292e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:13.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.626+0000 7f866292e800 5 note: GC not initialized 2024-09-12T00:15:13.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.626+0000 7f848f7fe640 20 reqs_thread_entry: start 2024-09-12T00:15:13.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.627+0000 7f866292e800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:13.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.627+0000 7f866292e800 20 Filter name: none 2024-09-12T00:15:13.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.627+0000 7f848d7fa640 20 reqs_thread_entry: start 2024-09-12T00:15:13.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.627+0000 7f866292e800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T00:15:13.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.627+0000 7f866292e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:13.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.627+0000 7f866292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:13.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.627+0000 7f866292e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T00:15:13.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.627+0000 7f866292e800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:15:13.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.627+0000 7f866292e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T00:15:13.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.627+0000 7f866292e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:13.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.627+0000 7f866292e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:13.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.627+0000 7f866292e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T00:15:13.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.627+0000 7f866292e800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:15:13.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.627+0000 7f866292e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:15:13.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.627+0000 7f866292e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:15:13.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.629+0000 7f866292e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:15:13.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.629+0000 7f866292e800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:15:13.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.629+0000 7f866292e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T00:15:13.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.629+0000 7f85417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 176093659137 cookie 94876236888784 notifier 4637 bl.length()=593 2024-09-12T00:15:13.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.629+0000 7f85417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:15:13.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.629+0000 7f85417fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:15:13.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.633+0000 7f866292e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:15:13.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.633+0000 7f866292e800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:15:13.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.633+0000 7f866292e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T00:15:13.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.633+0000 7f85417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 176093659136 cookie 94876236881648 notifier 4637 bl.length()=186 2024-09-12T00:15:13.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.633+0000 7f85417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:15:13.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.633+0000 7f85417fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:15:13.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.635+0000 7f8514fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:13.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.638+0000 7f866292e800 20 remove_watcher() i=0 2024-09-12T00:15:13.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.638+0000 7f866292e800 2 removed watcher, disabling cache 2024-09-12T00:15:13.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.639+0000 7f866292e800 20 remove_watcher() i=1 2024-09-12T00:15:13.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.640+0000 7f866292e800 20 remove_watcher() i=2 2024-09-12T00:15:13.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.641+0000 7f866292e800 20 remove_watcher() i=3 2024-09-12T00:15:13.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.642+0000 7f866292e800 20 remove_watcher() i=4 2024-09-12T00:15:13.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.644+0000 7f866292e800 20 remove_watcher() i=5 2024-09-12T00:15:13.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.645+0000 7f866292e800 20 remove_watcher() i=6 2024-09-12T00:15:13.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:13.646+0000 7f866292e800 20 remove_watcher() i=7 2024-09-12T00:15:14.602 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T00:15:14.602 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:14.603 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:15:14.633 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:14.633 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:14.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.672+0000 7f254602f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:14.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.673+0000 7f254602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:14.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.673+0000 7f254602f800 20 realm 2024-09-12T00:15:14.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.673+0000 7f254602f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:14.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.674+0000 7f254602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:14.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.674+0000 7f254602f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:14.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.674+0000 7f254602f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:14.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.674+0000 7f254602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:14.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.674+0000 7f254602f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:14.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.675+0000 7f254602f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:14.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.675+0000 7f254602f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:14.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.676+0000 7f254602f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:14.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.676+0000 7f254602f800 20 searching for the correct realm 2024-09-12T00:15:14.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.676+0000 7f2543b19640 0 -- 172.21.15.133:0/2406596285 >> [v2:172.21.15.133:6816/1011460824,v1:172.21.15.133:6817/1011460824] conn(0x7f253c031020 msgr2=0x7f253c066750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:14.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.881+0000 7f2543b19640 0 -- 172.21.15.133:0/2406596285 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x55d89cbe7cd0 msgr2=0x55d89cbea0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:14.887 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.887+0000 7f254602f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:14.887 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.887+0000 7f254602f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:14.887 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.887+0000 7f254602f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:14.887 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.887+0000 7f254602f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:14.887 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.887+0000 7f254602f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:14.887 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.887+0000 7f254602f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:14.887 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.887+0000 7f254602f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:14.887 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.888+0000 7f254602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:14.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.888+0000 7f254602f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:14.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.888+0000 7f254602f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:14.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.888+0000 7f254602f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:14.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.888+0000 7f254602f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:14.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.888+0000 7f254602f800 20 zone default found 2024-09-12T00:15:14.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.888+0000 7f254602f800 4 Realm: () 2024-09-12T00:15:14.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.888+0000 7f254602f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:14.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.888+0000 7f254602f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:14.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.888+0000 7f254602f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:14.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.888+0000 7f254602f800 20 zonegroup default 2024-09-12T00:15:14.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.888+0000 7f254602f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:14.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.888+0000 7f254602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:14.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.888+0000 7f254602f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:14.889 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.889+0000 7f254602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:14.889 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.889+0000 7f254602f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:14.889 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.889+0000 7f254602f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:14.889 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.889+0000 7f254602f800 20 started sync module instance, tier type = 2024-09-12T00:15:14.889 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.889+0000 7f254602f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:14.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.904+0000 7f254602f800 20 add_watcher() i=0 2024-09-12T00:15:14.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.904+0000 7f254602f800 20 add_watcher() i=1 2024-09-12T00:15:14.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.904+0000 7f254602f800 20 add_watcher() i=2 2024-09-12T00:15:14.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.904+0000 7f254602f800 20 add_watcher() i=3 2024-09-12T00:15:14.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.904+0000 7f254602f800 20 add_watcher() i=4 2024-09-12T00:15:14.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.904+0000 7f254602f800 20 add_watcher() i=5 2024-09-12T00:15:14.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.904+0000 7f254602f800 20 add_watcher() i=6 2024-09-12T00:15:14.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.905+0000 7f254602f800 20 add_watcher() i=7 2024-09-12T00:15:14.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.905+0000 7f254602f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:14.905 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.907+0000 7f23f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:14.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.907+0000 7f254602f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:14.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.907+0000 7f254602f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:14.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.907+0000 7f254602f800 5 note: GC not initialized 2024-09-12T00:15:14.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.908+0000 7f23f8fe1640 20 reqs_thread_entry: start 2024-09-12T00:15:14.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.908+0000 7f254602f800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:14.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.908+0000 7f254602f800 20 Filter name: none 2024-09-12T00:15:14.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.908+0000 7f23727fc640 20 reqs_thread_entry: start 2024-09-12T00:15:14.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.908+0000 7f254602f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:15:14.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.908+0000 7f254602f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:14.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.909+0000 7f254602f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:14.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.909+0000 7f254602f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:15:14.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.909+0000 7f254602f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:15:14.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.909+0000 7f254602f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 : miss 2024-09-12T00:15:14.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.909+0000 7f254602f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:14.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.909+0000 7f254602f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:14.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.909+0000 7f254602f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 info.flags=0x17 2024-09-12T00:15:14.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.909+0000 7f254602f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 to cache LRU end 2024-09-12T00:15:14.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.909+0000 7f254602f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:15:14.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.909+0000 7f254602f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:15:14.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.909+0000 7f254602f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 2024-09-12T00:15:14.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.909+0000 7f254602f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:14.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.914+0000 7f23f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:14.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.916+0000 7f254602f800 20 remove_watcher() i=0 2024-09-12T00:15:14.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.916+0000 7f254602f800 2 removed watcher, disabling cache 2024-09-12T00:15:14.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.917+0000 7f254602f800 20 remove_watcher() i=1 2024-09-12T00:15:14.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.918+0000 7f254602f800 20 remove_watcher() i=2 2024-09-12T00:15:14.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.919+0000 7f254602f800 20 remove_watcher() i=3 2024-09-12T00:15:14.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.921+0000 7f254602f800 20 remove_watcher() i=4 2024-09-12T00:15:14.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.922+0000 7f254602f800 20 remove_watcher() i=5 2024-09-12T00:15:14.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.923+0000 7f254602f800 20 remove_watcher() i=6 2024-09-12T00:15:14.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:14.924+0000 7f254602f800 20 remove_watcher() i=7 2024-09-12T00:15:14.934 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:15:14.963 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:14.964 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:15.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.002+0000 7f18a7040800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.004+0000 7f18a7040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:15.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.004+0000 7f18a7040800 20 realm 2024-09-12T00:15:15.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.004+0000 7f18a7040800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.004+0000 7f18a7040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:15.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.004+0000 7f18a7040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:15.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.004+0000 7f18a7040800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.004+0000 7f18a7040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:15.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.004+0000 7f18a7040800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.005+0000 7f18a7040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:15.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.005+0000 7f18a7040800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.006+0000 7f18a7040800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:15.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.006+0000 7f18a7040800 20 searching for the correct realm 2024-09-12T00:15:15.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.007+0000 7f189ffff640 0 -- 172.21.15.133:0/3210161207 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f1890046020 msgr2=0x7f189006d800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:15.211 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.213+0000 7f189ffff640 0 -- 172.21.15.133:0/3210161207 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f189806c440 msgr2=0x7f1898066cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:15.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.420+0000 7f18a7040800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:15.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.420+0000 7f18a7040800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:15.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.420+0000 7f18a7040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:15.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.420+0000 7f18a7040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:15.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.420+0000 7f18a7040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:15.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.420+0000 7f18a7040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:15.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.420+0000 7f18a7040800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.421+0000 7f18a7040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:15.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.421+0000 7f18a7040800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.421+0000 7f18a7040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:15.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.421+0000 7f18a7040800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.421+0000 7f18a7040800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:15.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.421+0000 7f18a7040800 20 zone default found 2024-09-12T00:15:15.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.421+0000 7f18a7040800 4 Realm: () 2024-09-12T00:15:15.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.421+0000 7f18a7040800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:15.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.421+0000 7f18a7040800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:15.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.421+0000 7f18a7040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:15.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.421+0000 7f18a7040800 20 zonegroup default 2024-09-12T00:15:15.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.421+0000 7f18a7040800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.422+0000 7f18a7040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:15.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.422+0000 7f18a7040800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.422+0000 7f18a7040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:15.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.422+0000 7f18a7040800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.422+0000 7f18a7040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:15.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.422+0000 7f18a7040800 20 started sync module instance, tier type = 2024-09-12T00:15:15.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.422+0000 7f18a7040800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:15.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.432+0000 7f18a7040800 20 add_watcher() i=0 2024-09-12T00:15:15.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.432+0000 7f18a7040800 20 add_watcher() i=1 2024-09-12T00:15:15.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.432+0000 7f18a7040800 20 add_watcher() i=2 2024-09-12T00:15:15.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.432+0000 7f18a7040800 20 add_watcher() i=3 2024-09-12T00:15:15.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.432+0000 7f18a7040800 20 add_watcher() i=4 2024-09-12T00:15:15.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.432+0000 7f18a7040800 20 add_watcher() i=5 2024-09-12T00:15:15.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.432+0000 7f18a7040800 20 add_watcher() i=6 2024-09-12T00:15:15.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.433+0000 7f18a7040800 20 add_watcher() i=7 2024-09-12T00:15:15.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.433+0000 7f18a7040800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:15.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.435+0000 7f175b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:15.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.435+0000 7f18a7040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:15.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.435+0000 7f18a7040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:15.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.435+0000 7f18a7040800 5 note: GC not initialized 2024-09-12T00:15:15.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.436+0000 7f175a7e4640 20 reqs_thread_entry: start 2024-09-12T00:15:15.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.436+0000 7f18a7040800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:15.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.436+0000 7f18a7040800 20 Filter name: none 2024-09-12T00:15:15.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.436+0000 7f1753fff640 20 reqs_thread_entry: start 2024-09-12T00:15:15.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.436+0000 7f18a7040800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.437+0000 7f18a7040800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:15.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.437+0000 7f18a7040800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.437+0000 7f18a7040800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:15.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.437+0000 7f18a7040800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:15.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.437+0000 7f18a7040800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.437+0000 7f18a7040800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:15.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.438+0000 7f18a7040800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.438+0000 7f18a7040800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:15.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.438+0000 7f18a7040800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:15.438 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.439+0000 7f175b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:15.440 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.442+0000 7f18a7040800 20 remove_watcher() i=0 2024-09-12T00:15:15.440 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.442+0000 7f18a7040800 2 removed watcher, disabling cache 2024-09-12T00:15:15.442 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.443+0000 7f18a7040800 20 remove_watcher() i=1 2024-09-12T00:15:15.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.444+0000 7f18a7040800 20 remove_watcher() i=2 2024-09-12T00:15:15.444 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.445+0000 7f18a7040800 20 remove_watcher() i=3 2024-09-12T00:15:15.445 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.446+0000 7f18a7040800 20 remove_watcher() i=4 2024-09-12T00:15:15.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.448+0000 7f18a7040800 20 remove_watcher() i=5 2024-09-12T00:15:15.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.449+0000 7f18a7040800 20 remove_watcher() i=6 2024-09-12T00:15:15.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.450+0000 7f18a7040800 20 remove_watcher() i=7 2024-09-12T00:15:15.459 INFO:tasks.workunit.client.0.smithi133.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 76, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T00:15:15.459 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T00:15:15.459 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:15.460 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:15:15.493 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:15.493 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:15.530 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.531+0000 7fca49ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.533+0000 7fca49ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:15.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.533+0000 7fca49ebb800 20 realm 2024-09-12T00:15:15.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.533+0000 7fca49ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.533+0000 7fca49ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:15.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.533+0000 7fca49ebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:15.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.533+0000 7fca49ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.533+0000 7fca49ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:15.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.533+0000 7fca49ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.534+0000 7fca49ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:15.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.534+0000 7fca49ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.534 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.535+0000 7fca49ebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:15.534 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.535+0000 7fca49ebb800 20 searching for the correct realm 2024-09-12T00:15:15.536 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.537+0000 7fca481a6640 0 -- 172.21.15.133:0/2997999589 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x562ac2172c50 msgr2=0x562ac2175040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:15.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.540+0000 7fca471a4640 0 -- 172.21.15.133:0/2997999589 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fca38024070 msgr2=0x7fca38061220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:15.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.747+0000 7fca49ebb800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:15.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.747+0000 7fca49ebb800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:15.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.747+0000 7fca49ebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:15.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.747+0000 7fca49ebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:15.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.747+0000 7fca49ebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:15.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.747+0000 7fca49ebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:15.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.747+0000 7fca49ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.747+0000 7fca49ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:15.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.747+0000 7fca49ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.747+0000 7fca49ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:15.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.747+0000 7fca49ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.748+0000 7fca49ebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:15.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.748+0000 7fca49ebb800 20 zone default found 2024-09-12T00:15:15.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.748+0000 7fca49ebb800 4 Realm: () 2024-09-12T00:15:15.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.748+0000 7fca49ebb800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:15.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.748+0000 7fca49ebb800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:15.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.748+0000 7fca49ebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:15.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.748+0000 7fca49ebb800 20 zonegroup default 2024-09-12T00:15:15.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.748+0000 7fca49ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.748+0000 7fca49ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:15.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.748+0000 7fca49ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.748+0000 7fca49ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:15.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.748+0000 7fca49ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.749+0000 7fca49ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:15.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.749+0000 7fca49ebb800 20 started sync module instance, tier type = 2024-09-12T00:15:15.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.749+0000 7fca49ebb800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:15.763 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.765+0000 7fca49ebb800 20 add_watcher() i=0 2024-09-12T00:15:15.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.765+0000 7fca49ebb800 20 add_watcher() i=1 2024-09-12T00:15:15.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.765+0000 7fca49ebb800 20 add_watcher() i=2 2024-09-12T00:15:15.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.765+0000 7fca49ebb800 20 add_watcher() i=3 2024-09-12T00:15:15.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.765+0000 7fca49ebb800 20 add_watcher() i=4 2024-09-12T00:15:15.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.765+0000 7fca49ebb800 20 add_watcher() i=5 2024-09-12T00:15:15.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.765+0000 7fca49ebb800 20 add_watcher() i=6 2024-09-12T00:15:15.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.767+0000 7fca49ebb800 20 add_watcher() i=7 2024-09-12T00:15:15.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.767+0000 7fca49ebb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:15.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.769+0000 7fc8fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:15.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.770+0000 7fca49ebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:15.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.770+0000 7fca49ebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:15.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.770+0000 7fca49ebb800 5 note: GC not initialized 2024-09-12T00:15:15.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.770+0000 7fc8fcfe1640 20 reqs_thread_entry: start 2024-09-12T00:15:15.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.770+0000 7fca49ebb800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:15.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.770+0000 7fca49ebb800 20 Filter name: none 2024-09-12T00:15:15.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.770+0000 7fc8767fc640 20 reqs_thread_entry: start 2024-09-12T00:15:15.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.770+0000 7fca49ebb800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:15:15.770 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.770+0000 7fca49ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.770 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.771+0000 7fca49ebb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:15.770 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.771+0000 7fca49ebb800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:15:15.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.771+0000 7fca49ebb800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:15:15.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.771+0000 7fca49ebb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 : miss 2024-09-12T00:15:15.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.771+0000 7fca49ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:15.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.771+0000 7fca49ebb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:15.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.771+0000 7fca49ebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 info.flags=0x17 2024-09-12T00:15:15.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.771+0000 7fca49ebb800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 to cache LRU end 2024-09-12T00:15:15.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.771+0000 7fca49ebb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:15:15.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.771+0000 7fca49ebb800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:15:15.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.772+0000 7fca49ebb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 2024-09-12T00:15:15.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.772+0000 7fca49ebb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:15.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.772+0000 7fca49ebb800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:15:15.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.772+0000 7fca49ebb800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:15:15.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.773+0000 7fc8fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:15.774 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.776+0000 7fca49ebb800 20 remove_watcher() i=0 2024-09-12T00:15:15.774 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.776+0000 7fca49ebb800 2 removed watcher, disabling cache 2024-09-12T00:15:15.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.776+0000 7fca49ebb800 20 remove_watcher() i=1 2024-09-12T00:15:15.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.778+0000 7fca49ebb800 20 remove_watcher() i=2 2024-09-12T00:15:15.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.779+0000 7fca49ebb800 20 remove_watcher() i=3 2024-09-12T00:15:15.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.780+0000 7fca49ebb800 20 remove_watcher() i=4 2024-09-12T00:15:15.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.781+0000 7fca49ebb800 20 remove_watcher() i=5 2024-09-12T00:15:15.781 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.782+0000 7fca49ebb800 20 remove_watcher() i=6 2024-09-12T00:15:15.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:15.784+0000 7fca49ebb800 20 remove_watcher() i=7 2024-09-12T00:15:15.794 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:15:16.185 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:15:17.676 INFO:tasks.workunit.client.0.smithi133.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:15:17.677 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:15:17.707 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:17.707 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:17.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.745+0000 7f2564730800 20 rados->read ofs=0 len=0 2024-09-12T00:15:17.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.747+0000 7f2564730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:17.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.747+0000 7f2564730800 20 realm 2024-09-12T00:15:17.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.747+0000 7f2564730800 20 rados->read ofs=0 len=0 2024-09-12T00:15:17.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.747+0000 7f2564730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:17.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.747+0000 7f2564730800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:17.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.747+0000 7f2564730800 20 rados->read ofs=0 len=0 2024-09-12T00:15:17.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.747+0000 7f2564730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:17.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.747+0000 7f2564730800 20 rados->read ofs=0 len=0 2024-09-12T00:15:17.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.748+0000 7f2564730800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:17.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.748+0000 7f2564730800 20 rados->read ofs=0 len=0 2024-09-12T00:15:17.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.749+0000 7f2564730800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:17.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.749+0000 7f2564730800 20 searching for the correct realm 2024-09-12T00:15:17.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.751+0000 7f2557fff640 0 -- 172.21.15.133:0/1611578843 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f254808e510 msgr2=0x7f25480183e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:17.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.754+0000 7f2557fff640 0 -- 172.21.15.133:0/1611578843 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f255006d060 msgr2=0x7f25500a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:17.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.960+0000 7f2564730800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:17.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.960+0000 7f2564730800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:17.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.960+0000 7f2564730800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:17.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.960+0000 7f2564730800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:17.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.960+0000 7f2564730800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:17.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.960+0000 7f2564730800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:17.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.960+0000 7f2564730800 20 rados->read ofs=0 len=0 2024-09-12T00:15:17.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.961+0000 7f2564730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:17.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.961+0000 7f2564730800 20 rados->read ofs=0 len=0 2024-09-12T00:15:17.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.961+0000 7f2564730800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:17.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.961+0000 7f2564730800 20 rados->read ofs=0 len=0 2024-09-12T00:15:17.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.961+0000 7f2564730800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:17.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.961+0000 7f2564730800 20 zone default found 2024-09-12T00:15:17.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.961+0000 7f2564730800 4 Realm: () 2024-09-12T00:15:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.961+0000 7f2564730800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.961+0000 7f2564730800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.961+0000 7f2564730800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.961+0000 7f2564730800 20 zonegroup default 2024-09-12T00:15:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.961+0000 7f2564730800 20 rados->read ofs=0 len=0 2024-09-12T00:15:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.962+0000 7f2564730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.962+0000 7f2564730800 20 rados->read ofs=0 len=0 2024-09-12T00:15:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.962+0000 7f2564730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.962+0000 7f2564730800 20 rados->read ofs=0 len=0 2024-09-12T00:15:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.962+0000 7f2564730800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:17.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.962+0000 7f2564730800 20 started sync module instance, tier type = 2024-09-12T00:15:17.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.962+0000 7f2564730800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:17.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.975+0000 7f2564730800 20 add_watcher() i=0 2024-09-12T00:15:17.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.975+0000 7f2564730800 20 add_watcher() i=1 2024-09-12T00:15:17.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.975+0000 7f2564730800 20 add_watcher() i=2 2024-09-12T00:15:17.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.975+0000 7f2564730800 20 add_watcher() i=3 2024-09-12T00:15:17.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.975+0000 7f2564730800 20 add_watcher() i=4 2024-09-12T00:15:17.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.975+0000 7f2564730800 20 add_watcher() i=5 2024-09-12T00:15:17.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.975+0000 7f2564730800 20 add_watcher() i=6 2024-09-12T00:15:17.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.977+0000 7f2564730800 20 add_watcher() i=7 2024-09-12T00:15:17.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.977+0000 7f2564730800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:17.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.979+0000 7f2416fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:17.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.979+0000 7f2564730800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:17.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.979+0000 7f2564730800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:17.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.979+0000 7f2564730800 5 note: GC not initialized 2024-09-12T00:15:17.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.979+0000 7f2415fdb640 20 reqs_thread_entry: start 2024-09-12T00:15:17.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.979+0000 7f2564730800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:17.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.980+0000 7f2564730800 20 Filter name: none 2024-09-12T00:15:17.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.980+0000 7f23877fe640 20 reqs_thread_entry: start 2024-09-12T00:15:17.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.980+0000 7f2564730800 20 rados->read ofs=0 len=0 2024-09-12T00:15:17.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.980+0000 7f2564730800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:17.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.980+0000 7f2564730800 20 rados->read ofs=0 len=0 2024-09-12T00:15:17.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.981+0000 7f2564730800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:17.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.981+0000 7f2564730800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:17.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.981+0000 7f2564730800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:15:17.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.981+0000 7f2564730800 20 INFO: main: starting shard=0 2024-09-12T00:15:17.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.981+0000 7f2564730800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:17.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.981+0000 7f2564730800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:15:17.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.981+0000 7f2564730800 20 INFO: main: done 2024-09-12T00:15:17.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.982+0000 7f2416fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:17.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.984+0000 7f2564730800 20 remove_watcher() i=0 2024-09-12T00:15:17.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.984+0000 7f2564730800 2 removed watcher, disabling cache 2024-09-12T00:15:17.984 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.985+0000 7f2564730800 20 remove_watcher() i=1 2024-09-12T00:15:17.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.986+0000 7f2564730800 20 remove_watcher() i=2 2024-09-12T00:15:17.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.987+0000 7f2564730800 20 remove_watcher() i=3 2024-09-12T00:15:17.987 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.988+0000 7f2564730800 20 remove_watcher() i=4 2024-09-12T00:15:17.988 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.989+0000 7f2564730800 20 remove_watcher() i=5 2024-09-12T00:15:17.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.991+0000 7f2564730800 20 remove_watcher() i=6 2024-09-12T00:15:17.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:17.992+0000 7f2564730800 20 remove_watcher() i=7 2024-09-12T00:15:18.150 INFO:tasks.workunit.client.0.smithi133.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:15:18.150 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:15:18.180 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:18.180 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:18.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.218+0000 7fc834c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.219+0000 7fc834c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:18.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.219+0000 7fc834c0e800 20 realm 2024-09-12T00:15:18.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.219+0000 7fc834c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.220 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.220+0000 7fc834c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:18.220 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.220+0000 7fc834c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:18.220 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.220+0000 7fc834c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.220 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.220+0000 7fc834c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:18.220 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.220+0000 7fc834c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.220 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.220+0000 7fc834c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:18.221 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.220+0000 7fc834c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.221 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.221+0000 7fc834c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:18.221 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.221+0000 7fc834c0e800 20 searching for the correct realm 2024-09-12T00:15:18.226 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.223+0000 7fc827bdf640 0 -- 172.21.15.133:0/1371075042 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fc81807b040 msgr2=0x7fc818065410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:18.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.429+0000 7fc827bdf640 0 -- 172.21.15.133:0/1371075042 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fc82007c500 msgr2=0x7fc820068a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:15:18.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.637+0000 7fc834c0e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:18.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.637+0000 7fc834c0e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:18.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.637+0000 7fc834c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:18.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.637+0000 7fc834c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:18.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.637+0000 7fc834c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:18.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.637+0000 7fc834c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:18.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.637+0000 7fc834c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.637+0000 7fc834c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:18.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.637+0000 7fc834c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.637+0000 7fc834c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:18.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.637+0000 7fc834c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.638+0000 7fc834c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:18.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.638+0000 7fc834c0e800 20 zone default found 2024-09-12T00:15:18.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.638+0000 7fc834c0e800 4 Realm: () 2024-09-12T00:15:18.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.638+0000 7fc834c0e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:18.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.638+0000 7fc834c0e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:18.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.638+0000 7fc834c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:18.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.638+0000 7fc834c0e800 20 zonegroup default 2024-09-12T00:15:18.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.638+0000 7fc834c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.638+0000 7fc834c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:18.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.638+0000 7fc834c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.638+0000 7fc834c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:18.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.638+0000 7fc834c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.639+0000 7fc834c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:18.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.639+0000 7fc834c0e800 20 started sync module instance, tier type = 2024-09-12T00:15:18.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.639+0000 7fc834c0e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:18.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.650+0000 7fc834c0e800 20 add_watcher() i=0 2024-09-12T00:15:18.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.650+0000 7fc834c0e800 20 add_watcher() i=1 2024-09-12T00:15:18.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.650+0000 7fc834c0e800 20 add_watcher() i=2 2024-09-12T00:15:18.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.650+0000 7fc834c0e800 20 add_watcher() i=3 2024-09-12T00:15:18.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.650+0000 7fc834c0e800 20 add_watcher() i=4 2024-09-12T00:15:18.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.650+0000 7fc834c0e800 20 add_watcher() i=5 2024-09-12T00:15:18.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.650+0000 7fc834c0e800 20 add_watcher() i=6 2024-09-12T00:15:18.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.651+0000 7fc834c0e800 20 add_watcher() i=7 2024-09-12T00:15:18.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.651+0000 7fc834c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:18.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.653+0000 7fc6e6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:18.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.653+0000 7fc834c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:18.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.653+0000 7fc834c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:18.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.653+0000 7fc834c0e800 5 note: GC not initialized 2024-09-12T00:15:18.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.653+0000 7fc6e5fdb640 20 reqs_thread_entry: start 2024-09-12T00:15:18.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.653+0000 7fc834c0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:18.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.653+0000 7fc834c0e800 20 Filter name: none 2024-09-12T00:15:18.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.653+0000 7fc6577fe640 20 reqs_thread_entry: start 2024-09-12T00:15:18.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.654+0000 7fc834c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.654+0000 7fc834c0e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:18.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.654+0000 7fc834c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.654+0000 7fc834c0e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:18.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.654+0000 7fc834c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:18.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.654+0000 7fc834c0e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:15:18.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.654+0000 7fc834c0e800 20 INFO: main: starting shard=0 2024-09-12T00:15:18.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.654+0000 7fc834c0e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:18.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.655+0000 7fc834c0e800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:15:18.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.655+0000 7fc834c0e800 20 INFO: main: done 2024-09-12T00:15:18.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.656+0000 7fc6e6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:18.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.658+0000 7fc834c0e800 20 remove_watcher() i=0 2024-09-12T00:15:18.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.658+0000 7fc834c0e800 2 removed watcher, disabling cache 2024-09-12T00:15:18.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.659+0000 7fc834c0e800 20 remove_watcher() i=1 2024-09-12T00:15:18.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.660+0000 7fc834c0e800 20 remove_watcher() i=2 2024-09-12T00:15:18.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.661+0000 7fc834c0e800 20 remove_watcher() i=3 2024-09-12T00:15:18.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.662+0000 7fc834c0e800 20 remove_watcher() i=4 2024-09-12T00:15:18.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.663+0000 7fc834c0e800 20 remove_watcher() i=5 2024-09-12T00:15:18.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.665+0000 7fc834c0e800 20 remove_watcher() i=6 2024-09-12T00:15:18.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.666+0000 7fc834c0e800 20 remove_watcher() i=7 2024-09-12T00:15:18.787 INFO:tasks.workunit.client.0.smithi133.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:15:18.788 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:15:18.819 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:18.819 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:18.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.857+0000 7f609f498800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.859+0000 7f609f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:18.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.859+0000 7f609f498800 20 realm 2024-09-12T00:15:18.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.859+0000 7f609f498800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.859+0000 7f609f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:18.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.859+0000 7f609f498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:18.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.859+0000 7f609f498800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.859+0000 7f609f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:18.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.859+0000 7f609f498800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.860+0000 7f609f498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:18.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.860+0000 7f609f498800 20 rados->read ofs=0 len=0 2024-09-12T00:15:18.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.861+0000 7f609f498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:18.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.861+0000 7f609f498800 20 searching for the correct realm 2024-09-12T00:15:18.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:18.862+0000 7f6097fff640 0 -- 172.21.15.133:0/1360370222 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f608802b070 msgr2=0x7f608801b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:19.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.067+0000 7f6097fff640 0 -- 172.21.15.133:0/1360370222 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f609008f960 msgr2=0x7f6090064430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:19.272 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.273+0000 7f609f498800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:19.272 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.273+0000 7f609f498800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:19.272 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.273+0000 7f609f498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:19.272 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.273+0000 7f609f498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:19.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.273+0000 7f609f498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:19.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.273+0000 7f609f498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:19.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.273+0000 7f609f498800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.274+0000 7f609f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:19.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.274+0000 7f609f498800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.274+0000 7f609f498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:19.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.274+0000 7f609f498800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.274+0000 7f609f498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:19.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.274+0000 7f609f498800 20 zone default found 2024-09-12T00:15:19.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.274+0000 7f609f498800 4 Realm: () 2024-09-12T00:15:19.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.274+0000 7f609f498800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:19.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.274+0000 7f609f498800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:19.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.274+0000 7f609f498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:19.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.274+0000 7f609f498800 20 zonegroup default 2024-09-12T00:15:19.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.274+0000 7f609f498800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.275+0000 7f609f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:19.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.275+0000 7f609f498800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.275+0000 7f609f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:19.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.275+0000 7f609f498800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.275+0000 7f609f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:19.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.275+0000 7f609f498800 20 started sync module instance, tier type = 2024-09-12T00:15:19.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.275+0000 7f609f498800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:19.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.289+0000 7f609f498800 20 add_watcher() i=0 2024-09-12T00:15:19.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.289+0000 7f609f498800 20 add_watcher() i=1 2024-09-12T00:15:19.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.289+0000 7f609f498800 20 add_watcher() i=2 2024-09-12T00:15:19.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.289+0000 7f609f498800 20 add_watcher() i=3 2024-09-12T00:15:19.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.289+0000 7f609f498800 20 add_watcher() i=4 2024-09-12T00:15:19.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.289+0000 7f609f498800 20 add_watcher() i=5 2024-09-12T00:15:19.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.289+0000 7f609f498800 20 add_watcher() i=6 2024-09-12T00:15:19.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.291+0000 7f609f498800 20 add_watcher() i=7 2024-09-12T00:15:19.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.291+0000 7f609f498800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:19.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.294+0000 7f5f52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:19.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.294+0000 7f609f498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:19.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.294+0000 7f609f498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:19.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.294+0000 7f609f498800 5 note: GC not initialized 2024-09-12T00:15:19.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.294+0000 7f5f51fe3640 20 reqs_thread_entry: start 2024-09-12T00:15:19.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.294+0000 7f609f498800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:19.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.294+0000 7f609f498800 20 Filter name: none 2024-09-12T00:15:19.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.294+0000 7f5ec37fe640 20 reqs_thread_entry: start 2024-09-12T00:15:19.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.295+0000 7f609f498800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.295+0000 7f609f498800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:19.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.295+0000 7f609f498800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.296+0000 7f609f498800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:19.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.296+0000 7f609f498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:19.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.296+0000 7f609f498800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:15:19.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.296+0000 7f609f498800 20 INFO: main: starting shard=0 2024-09-12T00:15:19.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.296+0000 7f609f498800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:19.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.297+0000 7f609f498800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:15:19.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.297+0000 7f609f498800 20 INFO: main: done 2024-09-12T00:15:19.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.298+0000 7f5f52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:19.298 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.300+0000 7f609f498800 20 remove_watcher() i=0 2024-09-12T00:15:19.298 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.300+0000 7f609f498800 2 removed watcher, disabling cache 2024-09-12T00:15:19.300 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.301+0000 7f609f498800 20 remove_watcher() i=1 2024-09-12T00:15:19.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.302+0000 7f609f498800 20 remove_watcher() i=2 2024-09-12T00:15:19.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.303+0000 7f609f498800 20 remove_watcher() i=3 2024-09-12T00:15:19.303 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.304+0000 7f609f498800 20 remove_watcher() i=4 2024-09-12T00:15:19.304 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.305+0000 7f609f498800 20 remove_watcher() i=5 2024-09-12T00:15:19.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.306+0000 7f609f498800 20 remove_watcher() i=6 2024-09-12T00:15:19.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.308+0000 7f609f498800 20 remove_watcher() i=7 2024-09-12T00:15:19.428 INFO:tasks.workunit.client.0.smithi133.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:15:19.429 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:15:19.459 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:19.460 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:19.497 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.498+0000 7f5f31925800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.500+0000 7f5f31925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:19.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.500+0000 7f5f31925800 20 realm 2024-09-12T00:15:19.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.500+0000 7f5f31925800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.500+0000 7f5f31925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:19.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.500+0000 7f5f31925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:19.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.500+0000 7f5f31925800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.500+0000 7f5f31925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:19.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.500+0000 7f5f31925800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.703+0000 7f5f31925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:19.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.703+0000 7f5f31925800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.704+0000 7f5f31925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:19.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.704+0000 7f5f31925800 20 searching for the correct realm 2024-09-12T00:15:19.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.704+0000 7f5f2d533640 0 -- 172.21.15.133:0/3034037260 >> [v2:172.21.15.133:6816/1011460824,v1:172.21.15.133:6817/1011460824] conn(0x5650b8b16a00 msgr2=0x7f5f28067b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:19.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.909+0000 7f5f2d533640 0 -- 172.21.15.133:0/3034037260 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x5650b8d4f960 msgr2=0x5650b8d51d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:19.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.915+0000 7f5f31925800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:19.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.915+0000 7f5f31925800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:19.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.915+0000 7f5f31925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:19.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.915+0000 7f5f31925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:19.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.915+0000 7f5f31925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:19.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.915+0000 7f5f31925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:19.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.915+0000 7f5f31925800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.916+0000 7f5f31925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:19.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.916+0000 7f5f31925800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.916+0000 7f5f31925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:19.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.916+0000 7f5f31925800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.916+0000 7f5f31925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:19.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.916+0000 7f5f31925800 20 zone default found 2024-09-12T00:15:19.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.916+0000 7f5f31925800 4 Realm: () 2024-09-12T00:15:19.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.916+0000 7f5f31925800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:19.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.916+0000 7f5f31925800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:19.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.916+0000 7f5f31925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:19.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.916+0000 7f5f31925800 20 zonegroup default 2024-09-12T00:15:19.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.916+0000 7f5f31925800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.916+0000 7f5f31925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:19.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.916+0000 7f5f31925800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.917+0000 7f5f31925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:19.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.917+0000 7f5f31925800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.917+0000 7f5f31925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:19.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.917+0000 7f5f31925800 20 started sync module instance, tier type = 2024-09-12T00:15:19.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.917+0000 7f5f31925800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:19.926 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.927+0000 7f5f31925800 20 add_watcher() i=0 2024-09-12T00:15:19.926 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.927+0000 7f5f31925800 20 add_watcher() i=1 2024-09-12T00:15:19.926 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.927+0000 7f5f31925800 20 add_watcher() i=2 2024-09-12T00:15:19.926 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.927+0000 7f5f31925800 20 add_watcher() i=3 2024-09-12T00:15:19.926 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.927+0000 7f5f31925800 20 add_watcher() i=4 2024-09-12T00:15:19.926 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.927+0000 7f5f31925800 20 add_watcher() i=5 2024-09-12T00:15:19.927 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.927+0000 7f5f31925800 20 add_watcher() i=6 2024-09-12T00:15:19.927 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.929+0000 7f5f31925800 20 add_watcher() i=7 2024-09-12T00:15:19.927 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.929+0000 7f5f31925800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:19.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.930+0000 7f5de3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:19.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.931+0000 7f5f31925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:19.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.931+0000 7f5f31925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:19.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.931+0000 7f5f31925800 5 note: GC not initialized 2024-09-12T00:15:19.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.931+0000 7f5de2fe5640 20 reqs_thread_entry: start 2024-09-12T00:15:19.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.931+0000 7f5f31925800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:19.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.931+0000 7f5f31925800 20 Filter name: none 2024-09-12T00:15:19.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.931+0000 7f5de0fe1640 20 reqs_thread_entry: start 2024-09-12T00:15:19.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.931+0000 7f5f31925800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.932+0000 7f5f31925800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:19.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.932+0000 7f5f31925800 20 rados->read ofs=0 len=0 2024-09-12T00:15:19.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.932+0000 7f5f31925800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:19.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.932+0000 7f5f31925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:19.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.932+0000 7f5f31925800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:15:19.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.932+0000 7f5f31925800 20 INFO: main: starting shard=0 2024-09-12T00:15:19.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.932+0000 7f5f31925800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:19.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.933+0000 7f5f31925800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:15:19.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.933+0000 7f5f31925800 20 INFO: main: done 2024-09-12T00:15:19.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.933+0000 7f5de3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:19.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.936+0000 7f5f31925800 20 remove_watcher() i=0 2024-09-12T00:15:19.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.936+0000 7f5f31925800 2 removed watcher, disabling cache 2024-09-12T00:15:19.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.937+0000 7f5f31925800 20 remove_watcher() i=1 2024-09-12T00:15:19.936 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.938+0000 7f5f31925800 20 remove_watcher() i=2 2024-09-12T00:15:19.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.939+0000 7f5f31925800 20 remove_watcher() i=3 2024-09-12T00:15:19.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.940+0000 7f5f31925800 20 remove_watcher() i=4 2024-09-12T00:15:19.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.941+0000 7f5f31925800 20 remove_watcher() i=5 2024-09-12T00:15:19.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.942+0000 7f5f31925800 20 remove_watcher() i=6 2024-09-12T00:15:19.942 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:19.944+0000 7f5f31925800 20 remove_watcher() i=7 2024-09-12T00:15:19.979 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:15:20.372 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:15:20.763 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T00:15:20.763 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:20.764 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:15:20.796 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:20.797 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:20.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:20.835+0000 7f07b3319800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:20.837+0000 7f07b3319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:20.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:20.837+0000 7f07b3319800 20 realm 2024-09-12T00:15:20.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:20.837+0000 7f07b3319800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:20.837+0000 7f07b3319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:20.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:20.837+0000 7f07b3319800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:20.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:20.837+0000 7f07b3319800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:20.837+0000 7f07b3319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:20.837 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:20.837+0000 7f07b3319800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.837 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:20.838+0000 7f07b3319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:20.837 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:20.838+0000 7f07b3319800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:20.839+0000 7f07b3319800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:20.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:20.839+0000 7f07b3319800 20 searching for the correct realm 2024-09-12T00:15:20.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:20.841+0000 7f07b160b640 0 -- 172.21.15.133:0/640237065 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x558c6853a1f0 msgr2=0x558c6853c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:15:20.843 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:20.845+0000 7f07abfff640 0 -- 172.21.15.133:0/640237065 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f07a406d070 msgr2=0x7f07a4056980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:21.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.053+0000 7f07b3319800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:21.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.053+0000 7f07b3319800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:21.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.053+0000 7f07b3319800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:21.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.053+0000 7f07b3319800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:21.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.053+0000 7f07b3319800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:21.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.053+0000 7f07b3319800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:21.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.053+0000 7f07b3319800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.053+0000 7f07b3319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:21.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.053+0000 7f07b3319800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.054+0000 7f07b3319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:21.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.054+0000 7f07b3319800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.054+0000 7f07b3319800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:21.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.054+0000 7f07b3319800 20 zone default found 2024-09-12T00:15:21.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.054+0000 7f07b3319800 4 Realm: () 2024-09-12T00:15:21.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.054+0000 7f07b3319800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:21.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.054+0000 7f07b3319800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:21.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.054+0000 7f07b3319800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:21.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.054+0000 7f07b3319800 20 zonegroup default 2024-09-12T00:15:21.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.054+0000 7f07b3319800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.054+0000 7f07b3319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:21.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.054+0000 7f07b3319800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.055+0000 7f07b3319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:21.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.055+0000 7f07b3319800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.055+0000 7f07b3319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:21.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.055+0000 7f07b3319800 20 started sync module instance, tier type = 2024-09-12T00:15:21.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.055+0000 7f07b3319800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:21.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.065+0000 7f07b3319800 20 add_watcher() i=0 2024-09-12T00:15:21.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.065+0000 7f07b3319800 20 add_watcher() i=1 2024-09-12T00:15:21.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.065+0000 7f07b3319800 20 add_watcher() i=2 2024-09-12T00:15:21.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.065+0000 7f07b3319800 20 add_watcher() i=3 2024-09-12T00:15:21.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.065+0000 7f07b3319800 20 add_watcher() i=4 2024-09-12T00:15:21.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.065+0000 7f07b3319800 20 add_watcher() i=5 2024-09-12T00:15:21.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.066+0000 7f07b3319800 20 add_watcher() i=6 2024-09-12T00:15:21.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.067+0000 7f07b3319800 20 add_watcher() i=7 2024-09-12T00:15:21.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.067+0000 7f07b3319800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:21.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.069+0000 7f0666fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:21.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.069+0000 7f07b3319800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:21.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.069+0000 7f07b3319800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:21.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.069+0000 7f07b3319800 5 note: GC not initialized 2024-09-12T00:15:21.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.069+0000 7f0665fe3640 20 reqs_thread_entry: start 2024-09-12T00:15:21.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.069+0000 7f07b3319800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:21.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.069+0000 7f07b3319800 20 Filter name: none 2024-09-12T00:15:21.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.070+0000 7f05d77fe640 20 reqs_thread_entry: start 2024-09-12T00:15:21.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.070+0000 7f07b3319800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:15:21.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.070+0000 7f07b3319800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.070+0000 7f07b3319800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:21.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.070+0000 7f07b3319800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:15:21.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.070+0000 7f07b3319800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:15:21.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.070+0000 7f07b3319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 : miss 2024-09-12T00:15:21.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.070+0000 7f07b3319800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.070+0000 7f07b3319800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:21.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.070+0000 7f07b3319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 info.flags=0x17 2024-09-12T00:15:21.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.070+0000 7f07b3319800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 to cache LRU end 2024-09-12T00:15:21.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.070+0000 7f07b3319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:15:21.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.070+0000 7f07b3319800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:15:21.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.070+0000 7f07b3319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 2024-09-12T00:15:21.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.071+0000 7f07b3319800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.072+0000 7f07b3319800 1 NOTICE: finished shard 0 (4 entries found) 2024-09-12T00:15:21.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.072+0000 7f07b3319800 1 NOTICE: finished all shards (4 entries found) 2024-09-12T00:15:21.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.073+0000 7f0666fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:21.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.078+0000 7f07b3319800 20 remove_watcher() i=0 2024-09-12T00:15:21.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.078+0000 7f07b3319800 2 removed watcher, disabling cache 2024-09-12T00:15:21.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.079+0000 7f07b3319800 20 remove_watcher() i=1 2024-09-12T00:15:21.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.080+0000 7f07b3319800 20 remove_watcher() i=2 2024-09-12T00:15:21.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.082+0000 7f07b3319800 20 remove_watcher() i=3 2024-09-12T00:15:21.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.083+0000 7f07b3319800 20 remove_watcher() i=4 2024-09-12T00:15:21.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.084+0000 7f07b3319800 20 remove_watcher() i=5 2024-09-12T00:15:21.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.085+0000 7f07b3319800 20 remove_watcher() i=6 2024-09-12T00:15:21.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.087+0000 7f07b3319800 20 remove_watcher() i=7 2024-09-12T00:15:21.096 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: unlinked entries are not listable 2024-09-12T00:15:21.096 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:21.204 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T00:15:21.204 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:21.333 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T00:15:21.333 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:21.334 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:15:21.368 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:21.369 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:21.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.608+0000 7f1745146800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.610+0000 7f1745146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:21.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.610+0000 7f1745146800 20 realm 2024-09-12T00:15:21.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.610+0000 7f1745146800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.611+0000 7f1745146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:21.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.611+0000 7f1745146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:21.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.611+0000 7f1745146800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.611+0000 7f1745146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:21.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.611+0000 7f1745146800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.612+0000 7f1745146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:21.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.612+0000 7f1745146800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.613+0000 7f1745146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:21.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.613+0000 7f1745146800 20 searching for the correct realm 2024-09-12T00:15:21.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.613+0000 7f1743431640 0 -- 172.21.15.133:0/2558439666 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x55796cf25ab0 msgr2=0x55796cf27ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:21.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.616+0000 7f1743431640 0 -- 172.21.15.133:0/2558439666 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x55796ccdb7a0 msgr2=0x7f173c05e140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:21.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.624+0000 7f1745146800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:21.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.624+0000 7f1745146800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:21.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.624+0000 7f1745146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:21.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.624+0000 7f1745146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:21.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.624+0000 7f1745146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:21.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.624+0000 7f1745146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:21.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.624+0000 7f1745146800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.624+0000 7f1745146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:21.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.624+0000 7f1745146800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.624+0000 7f1745146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:21.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.624+0000 7f1745146800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.625+0000 7f1745146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:21.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.625+0000 7f1745146800 20 zone default found 2024-09-12T00:15:21.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.625+0000 7f1745146800 4 Realm: () 2024-09-12T00:15:21.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.625+0000 7f1745146800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:21.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.625+0000 7f1745146800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:21.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.625+0000 7f1745146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:21.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.625+0000 7f1745146800 20 zonegroup default 2024-09-12T00:15:21.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.625+0000 7f1745146800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.625+0000 7f1745146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:21.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.625+0000 7f1745146800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.625+0000 7f1745146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:21.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.625+0000 7f1745146800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.625+0000 7f1745146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:21.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.625+0000 7f1745146800 20 started sync module instance, tier type = 2024-09-12T00:15:21.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.625+0000 7f1745146800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:21.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.639+0000 7f1745146800 20 add_watcher() i=0 2024-09-12T00:15:21.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.639+0000 7f1745146800 20 add_watcher() i=1 2024-09-12T00:15:21.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.639+0000 7f1745146800 20 add_watcher() i=2 2024-09-12T00:15:21.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.639+0000 7f1745146800 20 add_watcher() i=3 2024-09-12T00:15:21.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.639+0000 7f1745146800 20 add_watcher() i=4 2024-09-12T00:15:21.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.639+0000 7f1745146800 20 add_watcher() i=5 2024-09-12T00:15:21.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.639+0000 7f1745146800 20 add_watcher() i=6 2024-09-12T00:15:21.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.643+0000 7f1745146800 20 add_watcher() i=7 2024-09-12T00:15:21.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.643+0000 7f1745146800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:21.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.644+0000 7f15f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:21.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.645+0000 7f1745146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:21.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.645+0000 7f1745146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:21.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.645+0000 7f1745146800 5 note: GC not initialized 2024-09-12T00:15:21.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.645+0000 7f1573fff640 20 reqs_thread_entry: start 2024-09-12T00:15:21.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.645+0000 7f1745146800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:21.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.645+0000 7f1745146800 20 Filter name: none 2024-09-12T00:15:21.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.645+0000 7f1571ffb640 20 reqs_thread_entry: start 2024-09-12T00:15:21.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.645+0000 7f1745146800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:15:21.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.645+0000 7f1745146800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.646+0000 7f1745146800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:21.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.646+0000 7f1745146800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:15:21.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.646+0000 7f1745146800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:15:21.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.646+0000 7f1745146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 : miss 2024-09-12T00:15:21.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.646+0000 7f1745146800 20 rados->read ofs=0 len=0 2024-09-12T00:15:21.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.646+0000 7f1745146800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:21.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.646+0000 7f1745146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 info.flags=0x17 2024-09-12T00:15:21.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.646+0000 7f1745146800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 to cache LRU end 2024-09-12T00:15:21.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.646+0000 7f1745146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:15:21.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.646+0000 7f1745146800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:15:21.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.646+0000 7f1745146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 2024-09-12T00:15:21.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.646+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.647+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.648+0000 7f1745146800 20 get_obj_state: octx=0x55796cc90690 obj=check-bucket:c state=0x55796cf5ed48 s->prefetch_data=0 2024-09-12T00:15:21.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.648+0000 7f1745146800 20 get_obj_state: setting s->obj_tag to 2cdob7l1n5ie19wgxvq8uxrbf7p3fqrg 2024-09-12T00:15:21.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.648+0000 7f1745146800 20 get_obj_state_impl: setting s->olh_tag to i0yr2yroq494rf5f567m3woc4s756o66 2024-09-12T00:15:21.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.648+0000 7f1745146800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=i0yr2yroq494rf5f567m3woc4s756o66 2024-09-12T00:15:21.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.650+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.655+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.656+0000 7f1745146800 20 olh_log_entry: epoch=3 op=3 key=c[yZyRH6RgEJsRE3l3GHXHqV3zUt7qyYR] 2024-09-12T00:15:21.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.656+0000 7f1745146800 20 get_obj_state: octx=0x55796cc90690 obj=check-bucket:_:yZyRH6RgEJsRE3l3GHXHqV3zUt7qyYR_c state=0x55796cf95338 s->prefetch_data=0 2024-09-12T00:15:21.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.656+0000 7f1745146800 10 manifest: total_size = 22 2024-09-12T00:15:21.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.656+0000 7f1745146800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9379521040410515257 2024-09-12T00:15:21.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.656+0000 7f1745146800 20 get_obj_state: octx=0x55796cc90690 obj=check-bucket:_:yZyRH6RgEJsRE3l3GHXHqV3zUt7qyYR_c state=0x55796cf95338 s->prefetch_data=0 2024-09-12T00:15:21.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.656+0000 7f1745146800 20 prepare_atomic_modification: state is not atomic. state=0x55796cf95338 2024-09-12T00:15:21.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.656+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.659+0000 7f1745146800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:15:21.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.659+0000 7f1745146800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:15:21.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.659+0000 7f1745146800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:15:21.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.659+0000 7f1745146800 5 delete_objs_inline: removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2__shadow:yZyRH6RgEJsRE3l3GHXHqV3zUt7qyYR_.X6bV2e8iMaO_Kscv7yx6o3g19YyF2GH_0 2024-09-12T00:15:21.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.662+0000 7f16267fc640 20 handle_completion(): completion ok for obj=c[yZyRH6RgEJsRE3l3GHXHqV3zUt7qyYR] 2024-09-12T00:15:21.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.662+0000 7f1745146800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:15:21.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.664+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.664+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.666+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.667+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.667+0000 7f1745146800 20 get_obj_state: octx=0x55796cc90690 obj=check-bucket:d state=0x55796cf5ed48 s->prefetch_data=0 2024-09-12T00:15:21.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.667+0000 7f1745146800 20 get_obj_state: setting s->obj_tag to 81wqdst1std4kb72lyu3obcpph074t3t 2024-09-12T00:15:21.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.667+0000 7f1745146800 20 get_obj_state_impl: setting s->olh_tag to do73aecgpt8rv777lymv2iseyj08jnzr 2024-09-12T00:15:21.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.667+0000 7f1745146800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=do73aecgpt8rv777lymv2iseyj08jnzr 2024-09-12T00:15:21.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.674+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.676+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.676+0000 7f1745146800 20 olh_log_entry: epoch=3 op=3 key=d[BmWl-mP8862k5tUsteM9sL.89IfdoP1] 2024-09-12T00:15:21.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.676+0000 7f1745146800 20 get_obj_state: octx=0x55796cc90690 obj=check-bucket:_:BmWl-mP8862k5tUsteM9sL.89IfdoP1_d state=0x55796cf55b78 s->prefetch_data=0 2024-09-12T00:15:21.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.677+0000 7f1745146800 10 manifest: total_size = 11 2024-09-12T00:15:21.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.677+0000 7f1745146800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18309229021781058344 2024-09-12T00:15:21.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.677+0000 7f1745146800 20 get_obj_state: octx=0x55796cc90690 obj=check-bucket:_:BmWl-mP8862k5tUsteM9sL.89IfdoP1_d state=0x55796cf55b78 s->prefetch_data=0 2024-09-12T00:15:21.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.677+0000 7f1745146800 20 prepare_atomic_modification: state is not atomic. state=0x55796cf55b78 2024-09-12T00:15:21.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.677+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.679+0000 7f1745146800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:15:21.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.679+0000 7f1745146800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:15:21.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.679+0000 7f1745146800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:15:21.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.679+0000 7f1745146800 5 delete_objs_inline: removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2__shadow:BmWl-mP8862k5tUsteM9sL.89IfdoP1_.8sFmkU4Mjon-zEmF7YxZ0ajiGqmbNmg_0 2024-09-12T00:15:21.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.680+0000 7f1745146800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:15:21.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.680+0000 7f1625ffb640 20 handle_completion(): completion ok for obj=d[BmWl-mP8862k5tUsteM9sL.89IfdoP1] 2024-09-12T00:15:21.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.683+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.683+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.684+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.685+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.685+0000 7f1745146800 20 get_obj_state: octx=0x55796cc90690 obj=check-bucket:e state=0x55796cf5ed48 s->prefetch_data=0 2024-09-12T00:15:21.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.685+0000 7f1745146800 20 get_obj_state: setting s->obj_tag to gby1ej8tij9vtldu7om5wh5c6ga9rlp6 2024-09-12T00:15:21.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.685+0000 7f1745146800 20 get_obj_state_impl: setting s->olh_tag to r4kw1vjqbz1yl0t8f7h2ini8ehcg9eil 2024-09-12T00:15:21.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.685+0000 7f1745146800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=r4kw1vjqbz1yl0t8f7h2ini8ehcg9eil 2024-09-12T00:15:21.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.686+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.688+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.688+0000 7f1745146800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:15:21.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.688+0000 7f1745146800 20 olh_log_entry: epoch=2 op=3 key=e[5CAKeFlFx-uBPopPUX96pZap04w.Zfc] 2024-09-12T00:15:21.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.688+0000 7f1745146800 20 get_obj_state: octx=0x55796cc90690 obj=check-bucket:_:5CAKeFlFx-uBPopPUX96pZap04w.Zfc_e state=0x55796cf56b88 s->prefetch_data=0 2024-09-12T00:15:21.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.688+0000 7f1745146800 10 manifest: total_size = 12 2024-09-12T00:15:21.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.689+0000 7f1745146800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11810066384773196506 2024-09-12T00:15:21.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.689+0000 7f1745146800 20 get_obj_state: octx=0x55796cc90690 obj=check-bucket:_:5CAKeFlFx-uBPopPUX96pZap04w.Zfc_e state=0x55796cf56b88 s->prefetch_data=0 2024-09-12T00:15:21.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.689+0000 7f1745146800 20 prepare_atomic_modification: state is not atomic. state=0x55796cf56b88 2024-09-12T00:15:21.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.689+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.691+0000 7f1745146800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:15:21.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.691+0000 7f1745146800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:15:21.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.691+0000 7f1745146800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:15:21.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.691+0000 7f1745146800 5 delete_objs_inline: removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2__shadow:5CAKeFlFx-uBPopPUX96pZap04w.Zfc_.lv_7HrHNdesaGV2H6a9lrLViCYKmwyQ_0 2024-09-12T00:15:21.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.692+0000 7f16267fc640 20 handle_completion(): completion ok for obj=e[5CAKeFlFx-uBPopPUX96pZap04w.Zfc] 2024-09-12T00:15:21.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.692+0000 7f1745146800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:15:21.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.695+0000 7f1745146800 20 get_obj_state: octx=0x55796cc90690 obj=check-bucket:e state=0x55796cf5ed48 s->prefetch_data=0 2024-09-12T00:15:21.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.695+0000 7f1745146800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=r4kw1vjqbz1yl0t8f7h2ini8ehcg9eil 2024-09-12T00:15:21.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.698+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.699+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.700+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.700+0000 7f1745146800 20 get_obj_state: octx=0x55796cc90690 obj=check-bucket:f state=0x55796cf5ed48 s->prefetch_data=0 2024-09-12T00:15:21.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.700+0000 7f1745146800 20 get_obj_state: setting s->obj_tag to f2ip7heghh67ngke71i2r5u90qukw8qn 2024-09-12T00:15:21.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.700+0000 7f1745146800 20 get_obj_state_impl: setting s->olh_tag to mhzqskg1sqb8d4loqppnat8bppm9qyif 2024-09-12T00:15:21.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.700+0000 7f1745146800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mhzqskg1sqb8d4loqppnat8bppm9qyif 2024-09-12T00:15:21.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.701+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.703+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.703+0000 7f1745146800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:15:21.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.703+0000 7f1745146800 20 olh_log_entry: epoch=2 op=3 key=f[UBEvXpXfTLC-Ip6OPrhcNajifpCGWfI] 2024-09-12T00:15:21.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.703+0000 7f1745146800 20 get_obj_state: octx=0x55796cc90690 obj=check-bucket:_:UBEvXpXfTLC-Ip6OPrhcNajifpCGWfI_f state=0x55796cf97a38 s->prefetch_data=0 2024-09-12T00:15:21.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.703+0000 7f1745146800 10 manifest: total_size = 12 2024-09-12T00:15:21.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.703+0000 7f1745146800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10563359327887812532 2024-09-12T00:15:21.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.703+0000 7f1745146800 20 get_obj_state: octx=0x55796cc90690 obj=check-bucket:_:UBEvXpXfTLC-Ip6OPrhcNajifpCGWfI_f state=0x55796cf97a38 s->prefetch_data=0 2024-09-12T00:15:21.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.703+0000 7f1745146800 20 prepare_atomic_modification: state is not atomic. state=0x55796cf97a38 2024-09-12T00:15:21.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.703+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.708+0000 7f1745146800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:15:21.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.708+0000 7f1745146800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:15:21.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.708+0000 7f1745146800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:15:21.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.708+0000 7f1745146800 5 delete_objs_inline: removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2__shadow:UBEvXpXfTLC-Ip6OPrhcNajifpCGWfI_.KMQW7cPIEk6y4x8cMhcofomFQzPCLIX_0 2024-09-12T00:15:21.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.711+0000 7f1745146800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:15:21.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.714+0000 7f1745146800 20 get_obj_state: octx=0x55796cc90690 obj=check-bucket:f state=0x55796cf5ed48 s->prefetch_data=0 2024-09-12T00:15:21.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.714+0000 7f1745146800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mhzqskg1sqb8d4loqppnat8bppm9qyif 2024-09-12T00:15:21.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.714+0000 7f16267fc640 20 handle_completion(): completion ok for obj=f[UBEvXpXfTLC-Ip6OPrhcNajifpCGWfI] 2024-09-12T00:15:21.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.717+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.718+0000 7f1745146800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:21.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.718+0000 7f1745146800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T00:15:21.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.718+0000 7f1745146800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:15:21.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.719+0000 7f15f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:21.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.721+0000 7f1745146800 20 remove_watcher() i=0 2024-09-12T00:15:21.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.721+0000 7f1745146800 2 removed watcher, disabling cache 2024-09-12T00:15:21.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.722+0000 7f1745146800 20 remove_watcher() i=1 2024-09-12T00:15:21.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.723+0000 7f1745146800 20 remove_watcher() i=2 2024-09-12T00:15:21.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.724+0000 7f1745146800 20 remove_watcher() i=3 2024-09-12T00:15:21.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.725+0000 7f1745146800 20 remove_watcher() i=4 2024-09-12T00:15:21.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.726+0000 7f1745146800 20 remove_watcher() i=5 2024-09-12T00:15:21.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.728+0000 7f1745146800 20 remove_watcher() i=6 2024-09-12T00:15:21.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:21.730+0000 7f1745146800 20 remove_watcher() i=7 2024-09-12T00:15:21.820 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T00:15:21.820 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:21.974 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T00:15:21.974 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:21.976 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:15:22.008 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:22.009 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:22.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.048+0000 7f3bd9135800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.049+0000 7f3bd9135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:22.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.049+0000 7f3bd9135800 20 realm 2024-09-12T00:15:22.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.049+0000 7f3bd9135800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.050+0000 7f3bd9135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:22.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.050+0000 7f3bd9135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:22.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.050+0000 7f3bd9135800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.050+0000 7f3bd9135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:22.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.050+0000 7f3bd9135800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.050+0000 7f3bd9135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:22.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.050+0000 7f3bd9135800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.051+0000 7f3bd9135800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:22.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.051+0000 7f3bd9135800 20 searching for the correct realm 2024-09-12T00:15:22.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.053+0000 7f3bcc6e3640 0 -- 172.21.15.133:0/2815710690 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f3bbc024070 msgr2=0x7f3bbc0790c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:22.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.057+0000 7f3bcc6e3640 0 -- 172.21.15.133:0/2815710690 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x55a6256c8240 msgr2=0x7f3bc403f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:22.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.264+0000 7f3bd9135800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:22.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.264+0000 7f3bd9135800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:22.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.264+0000 7f3bd9135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:22.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.264+0000 7f3bd9135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:22.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.264+0000 7f3bd9135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:22.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.264+0000 7f3bd9135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:22.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.264+0000 7f3bd9135800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.265+0000 7f3bd9135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:22.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.265+0000 7f3bd9135800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.265+0000 7f3bd9135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:22.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.265+0000 7f3bd9135800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.265+0000 7f3bd9135800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:22.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.265+0000 7f3bd9135800 20 zone default found 2024-09-12T00:15:22.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.265+0000 7f3bd9135800 4 Realm: () 2024-09-12T00:15:22.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.265+0000 7f3bd9135800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:22.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.265+0000 7f3bd9135800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:22.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.265+0000 7f3bd9135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:22.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.265+0000 7f3bd9135800 20 zonegroup default 2024-09-12T00:15:22.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.265+0000 7f3bd9135800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.266 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.266+0000 7f3bd9135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:22.266 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.266+0000 7f3bd9135800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.266 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.266+0000 7f3bd9135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:22.266 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.266+0000 7f3bd9135800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.266 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.266+0000 7f3bd9135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:22.266 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.266+0000 7f3bd9135800 20 started sync module instance, tier type = 2024-09-12T00:15:22.266 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.266+0000 7f3bd9135800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:22.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.279+0000 7f3bd9135800 20 add_watcher() i=0 2024-09-12T00:15:22.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.279+0000 7f3bd9135800 20 add_watcher() i=1 2024-09-12T00:15:22.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.279+0000 7f3bd9135800 20 add_watcher() i=2 2024-09-12T00:15:22.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.279+0000 7f3bd9135800 20 add_watcher() i=3 2024-09-12T00:15:22.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.279+0000 7f3bd9135800 20 add_watcher() i=4 2024-09-12T00:15:22.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.279+0000 7f3bd9135800 20 add_watcher() i=5 2024-09-12T00:15:22.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.279+0000 7f3bd9135800 20 add_watcher() i=6 2024-09-12T00:15:22.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.280+0000 7f3bd9135800 20 add_watcher() i=7 2024-09-12T00:15:22.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.280+0000 7f3bd9135800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:22.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.282+0000 7f3a8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:22.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.282+0000 7f3bd9135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:22.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.282+0000 7f3bd9135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:22.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.282+0000 7f3bd9135800 5 note: GC not initialized 2024-09-12T00:15:22.282 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.282+0000 7f3a89fe3640 20 reqs_thread_entry: start 2024-09-12T00:15:22.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.283+0000 7f3bd9135800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:22.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.283+0000 7f3bd9135800 20 Filter name: none 2024-09-12T00:15:22.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.283+0000 7f39fb7fe640 20 reqs_thread_entry: start 2024-09-12T00:15:22.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.283+0000 7f3bd9135800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:15:22.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.283+0000 7f3bd9135800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.283+0000 7f3bd9135800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:22.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.283+0000 7f3bd9135800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:15:22.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.283+0000 7f3bd9135800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:15:22.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.283+0000 7f3bd9135800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 : miss 2024-09-12T00:15:22.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.283+0000 7f3bd9135800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.284+0000 7f3bd9135800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:22.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.284+0000 7f3bd9135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 info.flags=0x17 2024-09-12T00:15:22.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.284+0000 7f3bd9135800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 to cache LRU end 2024-09-12T00:15:22.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.284+0000 7f3bd9135800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:15:22.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.284+0000 7f3bd9135800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:15:22.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.284+0000 7f3bd9135800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 2024-09-12T00:15:22.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.284+0000 7f3bd9135800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:22.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.284+0000 7f3bd9135800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:15:22.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.284+0000 7f3bd9135800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:15:22.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.285+0000 7f3a8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:22.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.289+0000 7f3bd9135800 20 remove_watcher() i=0 2024-09-12T00:15:22.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.289+0000 7f3bd9135800 2 removed watcher, disabling cache 2024-09-12T00:15:22.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.290+0000 7f3bd9135800 20 remove_watcher() i=1 2024-09-12T00:15:22.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.291+0000 7f3bd9135800 20 remove_watcher() i=2 2024-09-12T00:15:22.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.293+0000 7f3bd9135800 20 remove_watcher() i=3 2024-09-12T00:15:22.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.293+0000 7f3bd9135800 20 remove_watcher() i=4 2024-09-12T00:15:22.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.295+0000 7f3bd9135800 20 remove_watcher() i=5 2024-09-12T00:15:22.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.296+0000 7f3bd9135800 20 remove_watcher() i=6 2024-09-12T00:15:22.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.297+0000 7f3bd9135800 20 remove_watcher() i=7 2024-09-12T00:15:22.498 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:15:22.529 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:22.529 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:22.567 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.568+0000 7f93ed915800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.569+0000 7f93ed915800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:22.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.569+0000 7f93ed915800 20 realm 2024-09-12T00:15:22.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.569+0000 7f93ed915800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.569+0000 7f93ed915800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:22.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.569+0000 7f93ed915800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:22.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.569+0000 7f93ed915800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.570+0000 7f93ed915800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:22.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.570+0000 7f93ed915800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.570+0000 7f93ed915800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:22.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.570+0000 7f93ed915800 20 rados->read ofs=0 len=0 2024-09-12T00:15:22.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.571+0000 7f93ed915800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:22.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.571+0000 7f93ed915800 20 searching for the correct realm 2024-09-12T00:15:22.572 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:22.572+0000 7f93eb3ff640 0 -- 172.21.15.133:0/3689869646 >> [v2:172.21.15.133:6816/1011460824,v1:172.21.15.133:6817/1011460824] conn(0x7f93e4029040 msgr2=0x7f93e401a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:23.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.178+0000 7f93ebc00640 0 -- 172.21.15.133:0/3689869646 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x55866b3fbd40 msgr2=0x7f93e403c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:23.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.186+0000 7f93ed915800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:23.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.186+0000 7f93ed915800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:23.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.186+0000 7f93ed915800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:23.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.186+0000 7f93ed915800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:23.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.186+0000 7f93ed915800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:23.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.186+0000 7f93ed915800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:23.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.186+0000 7f93ed915800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.186+0000 7f93ed915800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.186+0000 7f93ed915800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.186+0000 7f93ed915800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:23.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.186+0000 7f93ed915800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.187+0000 7f93ed915800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:23.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.187+0000 7f93ed915800 20 zone default found 2024-09-12T00:15:23.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.187+0000 7f93ed915800 4 Realm: () 2024-09-12T00:15:23.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.187+0000 7f93ed915800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:23.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.187+0000 7f93ed915800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:23.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.187+0000 7f93ed915800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:23.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.187+0000 7f93ed915800 20 zonegroup default 2024-09-12T00:15:23.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.187+0000 7f93ed915800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.187+0000 7f93ed915800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.187+0000 7f93ed915800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.187+0000 7f93ed915800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.187+0000 7f93ed915800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.188+0000 7f93ed915800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.188+0000 7f93ed915800 20 started sync module instance, tier type = 2024-09-12T00:15:23.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.188+0000 7f93ed915800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:23.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.202+0000 7f93ed915800 20 add_watcher() i=0 2024-09-12T00:15:23.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.202+0000 7f93ed915800 20 add_watcher() i=1 2024-09-12T00:15:23.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.202+0000 7f93ed915800 20 add_watcher() i=2 2024-09-12T00:15:23.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.202+0000 7f93ed915800 20 add_watcher() i=3 2024-09-12T00:15:23.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.202+0000 7f93ed915800 20 add_watcher() i=4 2024-09-12T00:15:23.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.202+0000 7f93ed915800 20 add_watcher() i=5 2024-09-12T00:15:23.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.202+0000 7f93ed915800 20 add_watcher() i=6 2024-09-12T00:15:23.202 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.203+0000 7f93ed915800 20 add_watcher() i=7 2024-09-12T00:15:23.202 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.203+0000 7f93ed915800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:23.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.205+0000 7f92a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:23.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.206+0000 7f93ed915800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:23.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.206+0000 7f93ed915800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:23.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.206+0000 7f93ed915800 5 note: GC not initialized 2024-09-12T00:15:23.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.206+0000 7f92a0fe1640 20 reqs_thread_entry: start 2024-09-12T00:15:23.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.206+0000 7f93ed915800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:23.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.206+0000 7f93ed915800 20 Filter name: none 2024-09-12T00:15:23.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.206+0000 7f921a7fc640 20 reqs_thread_entry: start 2024-09-12T00:15:23.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.206+0000 7f93ed915800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.207+0000 7f93ed915800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:23.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.207+0000 7f93ed915800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.207+0000 7f93ed915800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:23.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.207+0000 7f93ed915800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:23.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.207+0000 7f93ed915800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:15:23.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.207+0000 7f93ed915800 20 INFO: main: starting shard=0 2024-09-12T00:15:23.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.207+0000 7f93ed915800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:23.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.208+0000 7f93ed915800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:15:23.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.208+0000 7f93ed915800 20 INFO: main: done 2024-09-12T00:15:23.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.208+0000 7f92a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:23.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.211+0000 7f93ed915800 20 remove_watcher() i=0 2024-09-12T00:15:23.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.211+0000 7f93ed915800 2 removed watcher, disabling cache 2024-09-12T00:15:23.211 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.212+0000 7f93ed915800 20 remove_watcher() i=1 2024-09-12T00:15:23.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.214+0000 7f93ed915800 20 remove_watcher() i=2 2024-09-12T00:15:23.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.216+0000 7f93ed915800 20 remove_watcher() i=3 2024-09-12T00:15:23.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.218+0000 7f93ed915800 20 remove_watcher() i=4 2024-09-12T00:15:23.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.219+0000 7f93ed915800 20 remove_watcher() i=5 2024-09-12T00:15:23.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.220+0000 7f93ed915800 20 remove_watcher() i=6 2024-09-12T00:15:23.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.221+0000 7f93ed915800 20 remove_watcher() i=7 2024-09-12T00:15:23.232 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:15:23.262 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:23.262 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:23.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.300+0000 7f2315726800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.302+0000 7f2315726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.302+0000 7f2315726800 20 realm 2024-09-12T00:15:23.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.302+0000 7f2315726800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.302+0000 7f2315726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.302+0000 7f2315726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:23.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.302+0000 7f2315726800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.303+0000 7f2315726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.303+0000 7f2315726800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.303+0000 7f2315726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:23.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.303+0000 7f2315726800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.304+0000 7f2315726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:23.303 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.304+0000 7f2315726800 20 searching for the correct realm 2024-09-12T00:15:23.304 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.306+0000 7f230bfff640 0 -- 172.21.15.133:0/1639175579 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f22fc07d030 msgr2=0x7f22fc073290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:23.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.309+0000 7f230bfff640 0 -- 172.21.15.133:0/1639175579 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f230407f040 msgr2=0x7f230407f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:23.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.515+0000 7f2315726800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:23.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.515+0000 7f2315726800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:23.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.515+0000 7f2315726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:23.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.515+0000 7f2315726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:23.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.515+0000 7f2315726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:23.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.515+0000 7f2315726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:23.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.515+0000 7f2315726800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.515+0000 7f2315726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.515+0000 7f2315726800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.516+0000 7f2315726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:23.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.516+0000 7f2315726800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.516+0000 7f2315726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:23.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.516+0000 7f2315726800 20 zone default found 2024-09-12T00:15:23.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.516+0000 7f2315726800 4 Realm: () 2024-09-12T00:15:23.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.516+0000 7f2315726800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:23.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.516+0000 7f2315726800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:23.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.516+0000 7f2315726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:23.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.516+0000 7f2315726800 20 zonegroup default 2024-09-12T00:15:23.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.516+0000 7f2315726800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.516+0000 7f2315726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.516+0000 7f2315726800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.517+0000 7f2315726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.517+0000 7f2315726800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.517+0000 7f2315726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.517+0000 7f2315726800 20 started sync module instance, tier type = 2024-09-12T00:15:23.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.517+0000 7f2315726800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:23.531 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.533+0000 7f2315726800 20 add_watcher() i=0 2024-09-12T00:15:23.531 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.533+0000 7f2315726800 20 add_watcher() i=1 2024-09-12T00:15:23.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.533+0000 7f2315726800 20 add_watcher() i=2 2024-09-12T00:15:23.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.533+0000 7f2315726800 20 add_watcher() i=3 2024-09-12T00:15:23.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.533+0000 7f2315726800 20 add_watcher() i=4 2024-09-12T00:15:23.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.533+0000 7f2315726800 20 add_watcher() i=5 2024-09-12T00:15:23.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.533+0000 7f2315726800 20 add_watcher() i=6 2024-09-12T00:15:23.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.534+0000 7f2315726800 20 add_watcher() i=7 2024-09-12T00:15:23.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.534+0000 7f2315726800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:23.534 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.535+0000 7f21c7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:23.535 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.536+0000 7f2315726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:23.536 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.536+0000 7f2315726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:23.536 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.536+0000 7f2315726800 5 note: GC not initialized 2024-09-12T00:15:23.536 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.536+0000 7f21c6fe5640 20 reqs_thread_entry: start 2024-09-12T00:15:23.536 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.536+0000 7f2315726800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:23.536 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.536+0000 7f2315726800 20 Filter name: none 2024-09-12T00:15:23.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.536+0000 7f21c4fe1640 20 reqs_thread_entry: start 2024-09-12T00:15:23.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.536+0000 7f2315726800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.537+0000 7f2315726800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:23.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.537+0000 7f2315726800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.537+0000 7f2315726800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:23.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.537+0000 7f2315726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:23.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.537+0000 7f2315726800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:15:23.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.537+0000 7f2315726800 20 INFO: main: starting shard=0 2024-09-12T00:15:23.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.537+0000 7f2315726800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:23.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.538+0000 7f2315726800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:15:23.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.538+0000 7f2315726800 20 INFO: main: done 2024-09-12T00:15:23.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.538+0000 7f21c7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:23.540 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.541+0000 7f2315726800 20 remove_watcher() i=0 2024-09-12T00:15:23.540 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.541+0000 7f2315726800 2 removed watcher, disabling cache 2024-09-12T00:15:23.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.542+0000 7f2315726800 20 remove_watcher() i=1 2024-09-12T00:15:23.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.543+0000 7f2315726800 20 remove_watcher() i=2 2024-09-12T00:15:23.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.544+0000 7f2315726800 20 remove_watcher() i=3 2024-09-12T00:15:23.546 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.547+0000 7f2315726800 20 remove_watcher() i=4 2024-09-12T00:15:23.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.548+0000 7f2315726800 20 remove_watcher() i=5 2024-09-12T00:15:23.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.549+0000 7f2315726800 20 remove_watcher() i=6 2024-09-12T00:15:23.549 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.550+0000 7f2315726800 20 remove_watcher() i=7 2024-09-12T00:15:23.559 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T00:15:23.560 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:23.560 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:15:23.591 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:23.591 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:23.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.629+0000 7f4b5760e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.631+0000 7f4b5760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.631+0000 7f4b5760e800 20 realm 2024-09-12T00:15:23.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.631+0000 7f4b5760e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.631+0000 7f4b5760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.631+0000 7f4b5760e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:23.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.631+0000 7f4b5760e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.631+0000 7f4b5760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.631+0000 7f4b5760e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.632+0000 7f4b5760e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:23.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.632+0000 7f4b5760e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.632+0000 7f4b5760e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:23.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.632+0000 7f4b5760e800 20 searching for the correct realm 2024-09-12T00:15:23.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.635+0000 7f4b5356c640 0 -- 172.21.15.133:0/3754607205 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f4b4c091b60 msgr2=0x7f4b4c055410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:23.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.840+0000 7f4b52d6b640 0 -- 172.21.15.133:0/3754607205 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x55b93fb091c0 msgr2=0x55b93fb0b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:23.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.844+0000 7f4b5760e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:23.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.844+0000 7f4b5760e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:23.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.844+0000 7f4b5760e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:23.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.844+0000 7f4b5760e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:23.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.844+0000 7f4b5760e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:23.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.844+0000 7f4b5760e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:23.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.844+0000 7f4b5760e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.844+0000 7f4b5760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.844+0000 7f4b5760e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.844+0000 7f4b5760e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.844+0000 7f4b5760e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.845+0000 7f4b5760e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.845+0000 7f4b5760e800 20 zone default found 2024-09-12T00:15:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.845+0000 7f4b5760e800 4 Realm: () 2024-09-12T00:15:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.845+0000 7f4b5760e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.845+0000 7f4b5760e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.845+0000 7f4b5760e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.845+0000 7f4b5760e800 20 zonegroup default 2024-09-12T00:15:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.845+0000 7f4b5760e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.845+0000 7f4b5760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.845+0000 7f4b5760e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.845+0000 7f4b5760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.845+0000 7f4b5760e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.845+0000 7f4b5760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.847 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.845+0000 7f4b5760e800 20 started sync module instance, tier type = 2024-09-12T00:15:23.847 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.845+0000 7f4b5760e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:23.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.860+0000 7f4b5760e800 20 add_watcher() i=0 2024-09-12T00:15:23.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.860+0000 7f4b5760e800 20 add_watcher() i=1 2024-09-12T00:15:23.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.860+0000 7f4b5760e800 20 add_watcher() i=2 2024-09-12T00:15:23.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.860+0000 7f4b5760e800 20 add_watcher() i=3 2024-09-12T00:15:23.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.860+0000 7f4b5760e800 20 add_watcher() i=4 2024-09-12T00:15:23.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.860+0000 7f4b5760e800 20 add_watcher() i=5 2024-09-12T00:15:23.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.860+0000 7f4b5760e800 20 add_watcher() i=6 2024-09-12T00:15:23.862 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.864+0000 7f4b5760e800 20 add_watcher() i=7 2024-09-12T00:15:23.862 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.864+0000 7f4b5760e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:23.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.866+0000 7f4a097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:23.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.866+0000 7f4b5760e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:23.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.866+0000 7f4b5760e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:23.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.866+0000 7f4b5760e800 5 note: GC not initialized 2024-09-12T00:15:23.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.866+0000 7f4983fff640 20 reqs_thread_entry: start 2024-09-12T00:15:23.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.867+0000 7f4b5760e800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:23.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.867+0000 7f4b5760e800 20 Filter name: none 2024-09-12T00:15:23.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.867+0000 7f4981ffb640 20 reqs_thread_entry: start 2024-09-12T00:15:23.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.867+0000 7f4b5760e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:15:23.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.867+0000 7f4b5760e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.867 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.867+0000 7f4b5760e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:23.867 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.867+0000 7f4b5760e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:15:23.867 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.867+0000 7f4b5760e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:15:23.867 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.867+0000 7f4b5760e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 : miss 2024-09-12T00:15:23.867 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.867+0000 7f4b5760e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.868+0000 7f4b5760e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:23.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.868+0000 7f4b5760e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 info.flags=0x17 2024-09-12T00:15:23.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.868+0000 7f4b5760e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 to cache LRU end 2024-09-12T00:15:23.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.868+0000 7f4b5760e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:15:23.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.868+0000 7f4b5760e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:15:23.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.868+0000 7f4b5760e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 2024-09-12T00:15:23.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.868+0000 7f4b5760e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:23.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.868+0000 7f4b5760e800 1 NOTICE: finished shard 0 (2 entries found) 2024-09-12T00:15:23.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.868+0000 7f4b5760e800 1 NOTICE: finished all shards (2 entries found) 2024-09-12T00:15:23.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.869+0000 7f4a097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:23.870 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.871+0000 7f4b5760e800 20 remove_watcher() i=0 2024-09-12T00:15:23.870 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.871+0000 7f4b5760e800 2 removed watcher, disabling cache 2024-09-12T00:15:23.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.873+0000 7f4b5760e800 20 remove_watcher() i=1 2024-09-12T00:15:23.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.874+0000 7f4b5760e800 20 remove_watcher() i=2 2024-09-12T00:15:23.875 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.876+0000 7f4b5760e800 20 remove_watcher() i=3 2024-09-12T00:15:23.876 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.877+0000 7f4b5760e800 20 remove_watcher() i=4 2024-09-12T00:15:23.877 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.878+0000 7f4b5760e800 20 remove_watcher() i=5 2024-09-12T00:15:23.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.879+0000 7f4b5760e800 20 remove_watcher() i=6 2024-09-12T00:15:23.881 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.882+0000 7f4b5760e800 20 remove_watcher() i=7 2024-09-12T00:15:23.891 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T00:15:23.892 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:23.893 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:15:23.925 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:23.925 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:23.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.964+0000 7f0666e14800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.965+0000 7f0666e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.965+0000 7f0666e14800 20 realm 2024-09-12T00:15:23.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.965+0000 7f0666e14800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.966+0000 7f0666e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.966+0000 7f0666e14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:23.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.966+0000 7f0666e14800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.966+0000 7f0666e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:23.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.966+0000 7f0666e14800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.966+0000 7f0666e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:23.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.967+0000 7f0666e14800 20 rados->read ofs=0 len=0 2024-09-12T00:15:23.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.967+0000 7f0666e14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:23.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.967+0000 7f0666e14800 20 searching for the correct realm 2024-09-12T00:15:23.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:23.969+0000 7f065bfff640 0 -- 172.21.15.133:0/3314029581 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f064c036070 msgr2=0x7f064c073680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:24.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.175+0000 7f065bfff640 0 -- 172.21.15.133:0/3314029581 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f06540aa9b0 msgr2=0x7f06540ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:15:24.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.382+0000 7f0666e14800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:24.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.382+0000 7f0666e14800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:24.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.382+0000 7f0666e14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:24.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.382+0000 7f0666e14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:24.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.382+0000 7f0666e14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:24.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.383+0000 7f0666e14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:24.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.383+0000 7f0666e14800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.383+0000 7f0666e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:24.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.383+0000 7f0666e14800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.383+0000 7f0666e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:24.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.383+0000 7f0666e14800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.383+0000 7f0666e14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:24.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.383+0000 7f0666e14800 20 zone default found 2024-09-12T00:15:24.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.383+0000 7f0666e14800 4 Realm: () 2024-09-12T00:15:24.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.383+0000 7f0666e14800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:24.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.383+0000 7f0666e14800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:24.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.383+0000 7f0666e14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:24.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.383+0000 7f0666e14800 20 zonegroup default 2024-09-12T00:15:24.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.383+0000 7f0666e14800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.384+0000 7f0666e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:24.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.384+0000 7f0666e14800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.384+0000 7f0666e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:24.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.384+0000 7f0666e14800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.384+0000 7f0666e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:24.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.384+0000 7f0666e14800 20 started sync module instance, tier type = 2024-09-12T00:15:24.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.384+0000 7f0666e14800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:24.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.400+0000 7f0666e14800 20 add_watcher() i=0 2024-09-12T00:15:24.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.400+0000 7f0666e14800 20 add_watcher() i=1 2024-09-12T00:15:24.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.400+0000 7f0666e14800 20 add_watcher() i=2 2024-09-12T00:15:24.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.400+0000 7f0666e14800 20 add_watcher() i=3 2024-09-12T00:15:24.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.400+0000 7f0666e14800 20 add_watcher() i=4 2024-09-12T00:15:24.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.400+0000 7f0666e14800 20 add_watcher() i=5 2024-09-12T00:15:24.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.400+0000 7f0666e14800 20 add_watcher() i=6 2024-09-12T00:15:24.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.403+0000 7f0666e14800 20 add_watcher() i=7 2024-09-12T00:15:24.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.403+0000 7f0666e14800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:24.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.405+0000 7f0518fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:24.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.405+0000 7f0666e14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:24.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.405+0000 7f0666e14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:24.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.405+0000 7f0666e14800 5 note: GC not initialized 2024-09-12T00:15:24.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.405+0000 7f04937fe640 20 reqs_thread_entry: start 2024-09-12T00:15:24.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.406+0000 7f0666e14800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:24.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.406+0000 7f0666e14800 20 Filter name: none 2024-09-12T00:15:24.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.406+0000 7f04917fa640 20 reqs_thread_entry: start 2024-09-12T00:15:24.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.406+0000 7f0666e14800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:15:24.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.406+0000 7f0666e14800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.406+0000 7f0666e14800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:24.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.406+0000 7f0666e14800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:15:24.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.406+0000 7f0666e14800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:15:24.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.406+0000 7f0666e14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 : miss 2024-09-12T00:15:24.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.406+0000 7f0666e14800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.407+0000 7f0666e14800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:24.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.407+0000 7f0666e14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 info.flags=0x17 2024-09-12T00:15:24.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.407+0000 7f0666e14800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 to cache LRU end 2024-09-12T00:15:24.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.407+0000 7f0666e14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:15:24.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.407+0000 7f0666e14800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:15:24.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.407+0000 7f0666e14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 2024-09-12T00:15:24.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.407+0000 7f0666e14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:24.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.407+0000 7f0666e14800 20 get_obj_state: octx=0x559ca4776660 obj=check-bucket:c state=0x559ca4a425e8 s->prefetch_data=0 2024-09-12T00:15:24.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.408+0000 7f0666e14800 20 get_obj_state: setting s->obj_tag to 2cdob7l1n5ie19wgxvq8uxrbf7p3fqrg 2024-09-12T00:15:24.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.408+0000 7f0666e14800 20 get_obj_state_impl: setting s->olh_tag to i0yr2yroq494rf5f567m3woc4s756o66 2024-09-12T00:15:24.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.408+0000 7f0666e14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:24.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.408+0000 7f0666e14800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T00:15:24.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.408+0000 7f0666e14800 20 olh_log_entry: epoch=4 op=3 key=c[o5pIhXrVFn7zJmzdien734vG28.ow08] 2024-09-12T00:15:24.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.408+0000 7f0666e14800 20 get_obj_state: octx=0x559ca4a7c0b0 obj=check-bucket:_:o5pIhXrVFn7zJmzdien734vG28.ow08_c state=0x559ca4a41388 s->prefetch_data=0 2024-09-12T00:15:24.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.410+0000 7f0666e14800 20 get_obj_state: octx=0x559ca4a7c0b0 obj=check-bucket:c state=0x559ca4a3d348 s->prefetch_data=0 2024-09-12T00:15:24.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.410+0000 7f0666e14800 20 get_obj_state: setting s->obj_tag to 2cdob7l1n5ie19wgxvq8uxrbf7p3fqrg 2024-09-12T00:15:24.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.410+0000 7f0666e14800 20 get_obj_state_impl: setting s->olh_tag to i0yr2yroq494rf5f567m3woc4s756o66 2024-09-12T00:15:24.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.410+0000 7f0666e14800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=i0yr2yroq494rf5f567m3woc4s756o66 2024-09-12T00:15:24.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.419+0000 7f0666e14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:24.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.424+0000 7f0666e14800 20 get_obj_state: octx=0x559ca4776660 obj=check-bucket:d state=0x559ca4a425e8 s->prefetch_data=0 2024-09-12T00:15:24.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.424+0000 7f0666e14800 20 get_obj_state: setting s->obj_tag to 81wqdst1std4kb72lyu3obcpph074t3t 2024-09-12T00:15:24.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.424+0000 7f0666e14800 20 get_obj_state_impl: setting s->olh_tag to do73aecgpt8rv777lymv2iseyj08jnzr 2024-09-12T00:15:24.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.424+0000 7f0666e14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:24.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.424+0000 7f0666e14800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T00:15:24.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.424+0000 7f0666e14800 20 olh_log_entry: epoch=4 op=3 key=d[YBKOgDCIBytzkQ70aNvjETeuw.XvNTV] 2024-09-12T00:15:24.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.424+0000 7f0666e14800 20 get_obj_state: octx=0x559ca4a7c0b0 obj=check-bucket:_:YBKOgDCIBytzkQ70aNvjETeuw.XvNTV_d state=0x559ca4a7fb38 s->prefetch_data=0 2024-09-12T00:15:24.424 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.426+0000 7f0666e14800 20 get_obj_state: octx=0x559ca4a7c0b0 obj=check-bucket:d state=0x559ca4a437e8 s->prefetch_data=0 2024-09-12T00:15:24.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.426+0000 7f0666e14800 20 get_obj_state: setting s->obj_tag to 81wqdst1std4kb72lyu3obcpph074t3t 2024-09-12T00:15:24.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.426+0000 7f0666e14800 20 get_obj_state_impl: setting s->olh_tag to do73aecgpt8rv777lymv2iseyj08jnzr 2024-09-12T00:15:24.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.426+0000 7f0666e14800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=do73aecgpt8rv777lymv2iseyj08jnzr 2024-09-12T00:15:24.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.432+0000 7f0666e14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:24.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.434+0000 7f0666e14800 1 NOTICE: finished shard 0 (2 entries removed) 2024-09-12T00:15:24.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.434+0000 7f0666e14800 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T00:15:24.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.434+0000 7f0518fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:24.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.437+0000 7f0666e14800 20 remove_watcher() i=0 2024-09-12T00:15:24.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.437+0000 7f0666e14800 2 removed watcher, disabling cache 2024-09-12T00:15:24.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.438+0000 7f0666e14800 20 remove_watcher() i=1 2024-09-12T00:15:24.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.439+0000 7f0666e14800 20 remove_watcher() i=2 2024-09-12T00:15:24.439 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.440+0000 7f0666e14800 20 remove_watcher() i=3 2024-09-12T00:15:24.440 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.441+0000 7f0666e14800 20 remove_watcher() i=4 2024-09-12T00:15:24.441 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.442+0000 7f0666e14800 20 remove_watcher() i=5 2024-09-12T00:15:24.442 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.443+0000 7f0666e14800 20 remove_watcher() i=6 2024-09-12T00:15:24.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.445+0000 7f0666e14800 20 remove_watcher() i=7 2024-09-12T00:15:24.455 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:15:24.486 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:24.486 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:24.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.524+0000 7f3b95326800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.526+0000 7f3b95326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:24.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.526+0000 7f3b95326800 20 realm 2024-09-12T00:15:24.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.526+0000 7f3b95326800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.526+0000 7f3b95326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:24.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.526+0000 7f3b95326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:24.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.526+0000 7f3b95326800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.526 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.527+0000 7f3b95326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:24.526 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.527+0000 7f3b95326800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.526 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.527+0000 7f3b95326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:24.526 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.527+0000 7f3b95326800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.528+0000 7f3b95326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:24.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.528+0000 7f3b95326800 20 searching for the correct realm 2024-09-12T00:15:24.529 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.530+0000 7f3b917da640 0 -- 172.21.15.133:0/2902052879 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x55b83738a000 msgr2=0x55b83738c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:24.531 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.533+0000 7f3b8bfff640 0 -- 172.21.15.133:0/2902052879 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f3b7c024020 msgr2=0x7f3b7c060880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:24.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.739+0000 7f3b95326800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:24.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.739+0000 7f3b95326800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:24.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.739+0000 7f3b95326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:24.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.739+0000 7f3b95326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:24.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.739+0000 7f3b95326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:24.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.739+0000 7f3b95326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:24.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.739+0000 7f3b95326800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.739+0000 7f3b95326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:24.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.739+0000 7f3b95326800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.739+0000 7f3b95326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:24.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.739+0000 7f3b95326800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.740+0000 7f3b95326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:24.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.740+0000 7f3b95326800 20 zone default found 2024-09-12T00:15:24.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.740+0000 7f3b95326800 4 Realm: () 2024-09-12T00:15:24.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.740+0000 7f3b95326800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:24.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.740+0000 7f3b95326800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:24.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.740+0000 7f3b95326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:24.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.740+0000 7f3b95326800 20 zonegroup default 2024-09-12T00:15:24.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.740+0000 7f3b95326800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.740+0000 7f3b95326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:24.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.740+0000 7f3b95326800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.740+0000 7f3b95326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:24.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.740+0000 7f3b95326800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.740+0000 7f3b95326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:24.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.740+0000 7f3b95326800 20 started sync module instance, tier type = 2024-09-12T00:15:24.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.740+0000 7f3b95326800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:24.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.750+0000 7f3b95326800 20 add_watcher() i=0 2024-09-12T00:15:24.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.750+0000 7f3b95326800 20 add_watcher() i=1 2024-09-12T00:15:24.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.750+0000 7f3b95326800 20 add_watcher() i=2 2024-09-12T00:15:24.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.750+0000 7f3b95326800 20 add_watcher() i=3 2024-09-12T00:15:24.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.750+0000 7f3b95326800 20 add_watcher() i=4 2024-09-12T00:15:24.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.750+0000 7f3b95326800 20 add_watcher() i=5 2024-09-12T00:15:24.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.750+0000 7f3b95326800 20 add_watcher() i=6 2024-09-12T00:15:24.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.753+0000 7f3b95326800 20 add_watcher() i=7 2024-09-12T00:15:24.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.753+0000 7f3b95326800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:24.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.755+0000 7f3a45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:24.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.755+0000 7f3b95326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:24.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.755+0000 7f3b95326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:24.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.755+0000 7f3b95326800 5 note: GC not initialized 2024-09-12T00:15:24.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.756+0000 7f3a44fe1640 20 reqs_thread_entry: start 2024-09-12T00:15:24.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.756+0000 7f3b95326800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:24.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.756+0000 7f3b95326800 20 Filter name: none 2024-09-12T00:15:24.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.756+0000 7f39be7fc640 20 reqs_thread_entry: start 2024-09-12T00:15:24.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.756+0000 7f3b95326800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.756+0000 7f3b95326800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:24.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.756+0000 7f3b95326800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.757+0000 7f3b95326800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:24.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.757+0000 7f3b95326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:24.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.757+0000 7f3b95326800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:15:24.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.757+0000 7f3b95326800 20 INFO: main: starting shard=0 2024-09-12T00:15:24.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.757+0000 7f3b95326800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:24.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.757+0000 7f3b95326800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:15:24.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.757+0000 7f3b95326800 20 INFO: main: done 2024-09-12T00:15:24.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.758+0000 7f3a45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:24.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.760+0000 7f3b95326800 20 remove_watcher() i=0 2024-09-12T00:15:24.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.760+0000 7f3b95326800 2 removed watcher, disabling cache 2024-09-12T00:15:24.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.761+0000 7f3b95326800 20 remove_watcher() i=1 2024-09-12T00:15:24.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.762+0000 7f3b95326800 20 remove_watcher() i=2 2024-09-12T00:15:24.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.763+0000 7f3b95326800 20 remove_watcher() i=3 2024-09-12T00:15:24.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.764+0000 7f3b95326800 20 remove_watcher() i=4 2024-09-12T00:15:24.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.766+0000 7f3b95326800 20 remove_watcher() i=5 2024-09-12T00:15:24.765 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.767+0000 7f3b95326800 20 remove_watcher() i=6 2024-09-12T00:15:24.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.768+0000 7f3b95326800 20 remove_watcher() i=7 2024-09-12T00:15:24.779 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:15:24.809 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:24.809 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:24.847 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.848+0000 7f370df2e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.849 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.850+0000 7f370df2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:24.849 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.850+0000 7f370df2e800 20 realm 2024-09-12T00:15:24.849 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.850+0000 7f370df2e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.849 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.850+0000 7f370df2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:24.849 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.850+0000 7f370df2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:24.849 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.850+0000 7f370df2e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.849 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.850+0000 7f370df2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:24.849 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.850+0000 7f370df2e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.849 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.851+0000 7f370df2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:24.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.851+0000 7f370df2e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:24.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.852+0000 7f370df2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:24.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.852+0000 7f370df2e800 20 searching for the correct realm 2024-09-12T00:15:24.852 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.854+0000 7f370a365640 0 -- 172.21.15.133:0/1236810318 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x564ecf9b5e70 msgr2=0x564ecf9b8260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:24.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:24.856+0000 7f3703fff640 0 -- 172.21.15.133:0/1236810318 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f36fc063070 msgr2=0x7f36fc0cd1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:25.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.062+0000 7f370df2e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:25.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.062+0000 7f370df2e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:25.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.062+0000 7f370df2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:25.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.062+0000 7f370df2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:25.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.062+0000 7f370df2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:25.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.062+0000 7f370df2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:25.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.062+0000 7f370df2e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.062+0000 7f370df2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:25.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.062+0000 7f370df2e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.062+0000 7f370df2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:25.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.062+0000 7f370df2e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.063+0000 7f370df2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:25.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.063+0000 7f370df2e800 20 zone default found 2024-09-12T00:15:25.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.063+0000 7f370df2e800 4 Realm: () 2024-09-12T00:15:25.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.063+0000 7f370df2e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:25.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.063+0000 7f370df2e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:25.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.063+0000 7f370df2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:25.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.063+0000 7f370df2e800 20 zonegroup default 2024-09-12T00:15:25.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.063+0000 7f370df2e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.063+0000 7f370df2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:25.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.063+0000 7f370df2e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.063+0000 7f370df2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:25.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.063+0000 7f370df2e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.064+0000 7f370df2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:25.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.064+0000 7f370df2e800 20 started sync module instance, tier type = 2024-09-12T00:15:25.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.064+0000 7f370df2e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:25.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.072+0000 7f370df2e800 20 add_watcher() i=0 2024-09-12T00:15:25.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.072+0000 7f370df2e800 20 add_watcher() i=1 2024-09-12T00:15:25.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.072+0000 7f370df2e800 20 add_watcher() i=2 2024-09-12T00:15:25.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.072+0000 7f370df2e800 20 add_watcher() i=3 2024-09-12T00:15:25.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.072+0000 7f370df2e800 20 add_watcher() i=4 2024-09-12T00:15:25.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.072+0000 7f370df2e800 20 add_watcher() i=5 2024-09-12T00:15:25.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.072+0000 7f370df2e800 20 add_watcher() i=6 2024-09-12T00:15:25.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.075+0000 7f370df2e800 20 add_watcher() i=7 2024-09-12T00:15:25.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.075+0000 7f370df2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:25.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.077+0000 7f35bbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:25.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.078+0000 7f370df2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:25.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.078+0000 7f370df2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:25.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.078+0000 7f370df2e800 5 note: GC not initialized 2024-09-12T00:15:25.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.078+0000 7f35baffd640 20 reqs_thread_entry: start 2024-09-12T00:15:25.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.078+0000 7f370df2e800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:25.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.078+0000 7f370df2e800 20 Filter name: none 2024-09-12T00:15:25.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.078+0000 7f35b8ff9640 20 reqs_thread_entry: start 2024-09-12T00:15:25.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.078+0000 7f370df2e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.079+0000 7f370df2e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:25.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.079+0000 7f370df2e800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.079+0000 7f370df2e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:25.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.079+0000 7f370df2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:25.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.079+0000 7f370df2e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:15:25.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.079+0000 7f370df2e800 20 INFO: main: starting shard=0 2024-09-12T00:15:25.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.079+0000 7f370df2e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:25.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.080+0000 7f370df2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:15:25.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.080+0000 7f370df2e800 20 INFO: main: done 2024-09-12T00:15:25.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.080+0000 7f35bbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:25.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.083+0000 7f370df2e800 20 remove_watcher() i=0 2024-09-12T00:15:25.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.083+0000 7f370df2e800 2 removed watcher, disabling cache 2024-09-12T00:15:25.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.084+0000 7f370df2e800 20 remove_watcher() i=1 2024-09-12T00:15:25.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.085+0000 7f370df2e800 20 remove_watcher() i=2 2024-09-12T00:15:25.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.086+0000 7f370df2e800 20 remove_watcher() i=3 2024-09-12T00:15:25.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.087+0000 7f370df2e800 20 remove_watcher() i=4 2024-09-12T00:15:25.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.088+0000 7f370df2e800 20 remove_watcher() i=5 2024-09-12T00:15:25.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.089+0000 7f370df2e800 20 remove_watcher() i=6 2024-09-12T00:15:25.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.090+0000 7f370df2e800 20 remove_watcher() i=7 2024-09-12T00:15:25.099 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T00:15:25.099 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:25.100 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:15:25.131 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:25.131 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:25.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.169+0000 7f1da671f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.169 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.170+0000 7f1da671f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:25.169 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.170+0000 7f1da671f800 20 realm 2024-09-12T00:15:25.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.170+0000 7f1da671f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.171+0000 7f1da671f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:25.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.171+0000 7f1da671f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:25.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.171+0000 7f1da671f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.171+0000 7f1da671f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:25.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.171+0000 7f1da671f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.171+0000 7f1da671f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:25.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.171+0000 7f1da671f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.172+0000 7f1da671f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:25.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.172+0000 7f1da671f800 20 searching for the correct realm 2024-09-12T00:15:25.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.174+0000 7f1da1ca1640 0 -- 172.21.15.133:0/4087890054 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f1d98016c90 msgr2=0x7f1d9806c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:25.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.379+0000 7f1da1ca1640 0 -- 172.21.15.133:0/4087890054 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f1d9407e040 msgr2=0x7f1d94055920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:15:25.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.586+0000 7f1da671f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:25.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.586+0000 7f1da671f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:25.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.586+0000 7f1da671f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:25.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.586+0000 7f1da671f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:25.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.586+0000 7f1da671f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:25.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.586+0000 7f1da671f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:25.586 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.586+0000 7f1da671f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.586 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.586+0000 7f1da671f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:25.586 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.586+0000 7f1da671f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.586 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.586+0000 7f1da671f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:25.586 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.586+0000 7f1da671f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.587+0000 7f1da671f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:25.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.587+0000 7f1da671f800 20 zone default found 2024-09-12T00:15:25.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.587+0000 7f1da671f800 4 Realm: () 2024-09-12T00:15:25.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.587+0000 7f1da671f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:25.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.587+0000 7f1da671f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:25.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.587+0000 7f1da671f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:25.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.587+0000 7f1da671f800 20 zonegroup default 2024-09-12T00:15:25.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.587+0000 7f1da671f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.587+0000 7f1da671f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:25.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.587+0000 7f1da671f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.587+0000 7f1da671f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:25.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.587+0000 7f1da671f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.588+0000 7f1da671f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:25.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.588+0000 7f1da671f800 20 started sync module instance, tier type = 2024-09-12T00:15:25.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.588+0000 7f1da671f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:25.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.596+0000 7f1da671f800 20 add_watcher() i=0 2024-09-12T00:15:25.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.596+0000 7f1da671f800 20 add_watcher() i=1 2024-09-12T00:15:25.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.597+0000 7f1da671f800 20 add_watcher() i=2 2024-09-12T00:15:25.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.597+0000 7f1da671f800 20 add_watcher() i=3 2024-09-12T00:15:25.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.597+0000 7f1da671f800 20 add_watcher() i=4 2024-09-12T00:15:25.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.597+0000 7f1da671f800 20 add_watcher() i=5 2024-09-12T00:15:25.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.597+0000 7f1da671f800 20 add_watcher() i=6 2024-09-12T00:15:25.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.597+0000 7f1da671f800 20 add_watcher() i=7 2024-09-12T00:15:25.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.597+0000 7f1da671f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:25.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.599+0000 7f1c58fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:25.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.599+0000 7f1da671f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:25.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.599+0000 7f1da671f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:25.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.599+0000 7f1da671f800 5 note: GC not initialized 2024-09-12T00:15:25.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.600+0000 7f1bd37fe640 20 reqs_thread_entry: start 2024-09-12T00:15:25.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.600+0000 7f1da671f800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:25.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.600+0000 7f1da671f800 20 Filter name: none 2024-09-12T00:15:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.600+0000 7f1bd17fa640 20 reqs_thread_entry: start 2024-09-12T00:15:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.600+0000 7f1da671f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:15:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.600+0000 7f1da671f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.601+0000 7f1da671f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.601+0000 7f1da671f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:15:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.601+0000 7f1da671f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:15:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.601+0000 7f1da671f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 : miss 2024-09-12T00:15:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.601+0000 7f1da671f800 20 rados->read ofs=0 len=0 2024-09-12T00:15:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.601+0000 7f1da671f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.601+0000 7f1da671f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 info.flags=0x17 2024-09-12T00:15:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.601+0000 7f1da671f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 to cache LRU end 2024-09-12T00:15:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.601+0000 7f1da671f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:15:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.601+0000 7f1da671f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:15:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.601+0000 7f1da671f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 2024-09-12T00:15:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.601+0000 7f1da671f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:25.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.602+0000 7f1da671f800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:15:25.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.602+0000 7f1da671f800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:15:25.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.602+0000 7f1c58fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:25.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.604+0000 7f1da671f800 20 remove_watcher() i=0 2024-09-12T00:15:25.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.604+0000 7f1da671f800 2 removed watcher, disabling cache 2024-09-12T00:15:25.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.605+0000 7f1da671f800 20 remove_watcher() i=1 2024-09-12T00:15:25.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.606+0000 7f1da671f800 20 remove_watcher() i=2 2024-09-12T00:15:25.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.607+0000 7f1da671f800 20 remove_watcher() i=3 2024-09-12T00:15:25.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.609+0000 7f1da671f800 20 remove_watcher() i=4 2024-09-12T00:15:25.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.610+0000 7f1da671f800 20 remove_watcher() i=5 2024-09-12T00:15:25.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.611+0000 7f1da671f800 20 remove_watcher() i=6 2024-09-12T00:15:25.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:25.612+0000 7f1da671f800 20 remove_watcher() i=7 2024-09-12T00:15:25.621 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T00:15:25.622 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:25.737 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T00:15:25.737 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:15:26.477 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:15:26.864 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:15:28.347 INFO:tasks.workunit.client.0.smithi133.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:15:28.348 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:15:28.381 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:28.382 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:28.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.422+0000 7fd72a640800 20 rados->read ofs=0 len=0 2024-09-12T00:15:28.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.423+0000 7fd72a640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:28.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.423+0000 7fd72a640800 20 realm 2024-09-12T00:15:28.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.423+0000 7fd72a640800 20 rados->read ofs=0 len=0 2024-09-12T00:15:28.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.424+0000 7fd72a640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:28.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.424+0000 7fd72a640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:28.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.424+0000 7fd72a640800 20 rados->read ofs=0 len=0 2024-09-12T00:15:28.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.424+0000 7fd72a640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:28.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.424+0000 7fd72a640800 20 rados->read ofs=0 len=0 2024-09-12T00:15:28.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.424+0000 7fd72a640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:28.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.424+0000 7fd72a640800 20 rados->read ofs=0 len=0 2024-09-12T00:15:28.424 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.425+0000 7fd72a640800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:28.424 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.425+0000 7fd72a640800 20 searching for the correct realm 2024-09-12T00:15:28.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.427+0000 7fd727930640 0 -- 172.21.15.133:0/3711048135 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fd71c017020 msgr2=0x7fd71c05f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:28.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.632+0000 7fd727930640 0 -- 172.21.15.133:0/3711048135 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fd718017910 msgr2=0x7fd71804a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:28.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.839+0000 7fd72a640800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:28.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.839+0000 7fd72a640800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:28.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.839+0000 7fd72a640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:28.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.839+0000 7fd72a640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:28.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.839+0000 7fd72a640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:28.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.839+0000 7fd72a640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:28.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.839+0000 7fd72a640800 20 rados->read ofs=0 len=0 2024-09-12T00:15:28.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.840+0000 7fd72a640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:28.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.840+0000 7fd72a640800 20 rados->read ofs=0 len=0 2024-09-12T00:15:28.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.840+0000 7fd72a640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:28.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.840+0000 7fd72a640800 20 rados->read ofs=0 len=0 2024-09-12T00:15:28.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.840+0000 7fd72a640800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:28.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.840+0000 7fd72a640800 20 zone default found 2024-09-12T00:15:28.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.840+0000 7fd72a640800 4 Realm: () 2024-09-12T00:15:28.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.840+0000 7fd72a640800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:28.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.840+0000 7fd72a640800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:28.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.840+0000 7fd72a640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:28.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.840+0000 7fd72a640800 20 zonegroup default 2024-09-12T00:15:28.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.840+0000 7fd72a640800 20 rados->read ofs=0 len=0 2024-09-12T00:15:28.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.841+0000 7fd72a640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:28.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.841+0000 7fd72a640800 20 rados->read ofs=0 len=0 2024-09-12T00:15:28.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.841+0000 7fd72a640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:28.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.841+0000 7fd72a640800 20 rados->read ofs=0 len=0 2024-09-12T00:15:28.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.841+0000 7fd72a640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:28.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.841+0000 7fd72a640800 20 started sync module instance, tier type = 2024-09-12T00:15:28.842 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.841+0000 7fd72a640800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:28.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.852+0000 7fd72a640800 20 add_watcher() i=0 2024-09-12T00:15:28.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.852+0000 7fd72a640800 20 add_watcher() i=1 2024-09-12T00:15:28.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.852+0000 7fd72a640800 20 add_watcher() i=2 2024-09-12T00:15:28.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.852+0000 7fd72a640800 20 add_watcher() i=3 2024-09-12T00:15:28.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.852+0000 7fd72a640800 20 add_watcher() i=4 2024-09-12T00:15:28.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.852+0000 7fd72a640800 20 add_watcher() i=5 2024-09-12T00:15:28.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.852+0000 7fd72a640800 20 add_watcher() i=6 2024-09-12T00:15:28.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.853+0000 7fd72a640800 20 add_watcher() i=7 2024-09-12T00:15:28.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.853+0000 7fd72a640800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:28.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.855+0000 7fd5defdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:28.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.856+0000 7fd72a640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:28.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.856+0000 7fd72a640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:28.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.856+0000 7fd72a640800 5 note: GC not initialized 2024-09-12T00:15:28.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.856+0000 7fd5ddfdb640 20 reqs_thread_entry: start 2024-09-12T00:15:28.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.856+0000 7fd72a640800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:28.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.856+0000 7fd72a640800 20 Filter name: none 2024-09-12T00:15:28.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.856+0000 7fd54f7fe640 20 reqs_thread_entry: start 2024-09-12T00:15:28.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.856+0000 7fd72a640800 20 rados->read ofs=0 len=0 2024-09-12T00:15:28.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.857+0000 7fd72a640800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:28.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.857+0000 7fd72a640800 20 rados->read ofs=0 len=0 2024-09-12T00:15:28.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.857+0000 7fd72a640800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:28.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.857+0000 7fd72a640800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:28.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.857+0000 7fd72a640800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:15:28.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.857+0000 7fd72a640800 20 INFO: main: starting shard=0 2024-09-12T00:15:28.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.857+0000 7fd72a640800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:28.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.858+0000 7fd72a640800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:15:28.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.858+0000 7fd72a640800 20 INFO: main: done 2024-09-12T00:15:28.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.859+0000 7fd5defdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:28.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.861+0000 7fd72a640800 20 remove_watcher() i=0 2024-09-12T00:15:28.860 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.861+0000 7fd72a640800 2 removed watcher, disabling cache 2024-09-12T00:15:28.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.862+0000 7fd72a640800 20 remove_watcher() i=1 2024-09-12T00:15:28.862 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.863+0000 7fd72a640800 20 remove_watcher() i=2 2024-09-12T00:15:28.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.864+0000 7fd72a640800 20 remove_watcher() i=3 2024-09-12T00:15:28.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.866+0000 7fd72a640800 20 remove_watcher() i=4 2024-09-12T00:15:28.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.867+0000 7fd72a640800 20 remove_watcher() i=5 2024-09-12T00:15:28.867 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.868+0000 7fd72a640800 20 remove_watcher() i=6 2024-09-12T00:15:28.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:28.869+0000 7fd72a640800 20 remove_watcher() i=7 2024-09-12T00:15:28.989 INFO:tasks.workunit.client.0.smithi133.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:15:28.990 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:15:29.022 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:29.022 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:29.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.060+0000 7f3d15325800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.062+0000 7f3d15325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.062+0000 7f3d15325800 20 realm 2024-09-12T00:15:29.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.062+0000 7f3d15325800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.062+0000 7f3d15325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.062+0000 7f3d15325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:29.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.062+0000 7f3d15325800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.063+0000 7f3d15325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.063+0000 7f3d15325800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.063+0000 7f3d15325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:29.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.063+0000 7f3d15325800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.064+0000 7f3d15325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:29.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.064+0000 7f3d15325800 20 searching for the correct realm 2024-09-12T00:15:29.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.066+0000 7f3d0bfff640 0 -- 172.21.15.133:0/3525396798 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f3cfc092020 msgr2=0x7f3cfc092b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:29.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.270+0000 7f3d10fb5640 0 -- 172.21.15.133:0/3525396798 >> [v2:172.21.15.160:6818/507321805,v1:172.21.15.160:6819/507321805] conn(0x7f3cfc0d1be0 msgr2=0x7f3cfc092b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:15:29.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:29.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:29.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:29.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:29.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:29.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:29.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:29.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:29.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 20 zone default found 2024-09-12T00:15:29.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 4 Realm: () 2024-09-12T00:15:29.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:29.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:29.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:29.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 20 zonegroup default 2024-09-12T00:15:29.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.277+0000 7f3d15325800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.278+0000 7f3d15325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.278+0000 7f3d15325800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.278+0000 7f3d15325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.278+0000 7f3d15325800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.279 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.278+0000 7f3d15325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.279 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.278+0000 7f3d15325800 20 started sync module instance, tier type = 2024-09-12T00:15:29.279 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.278+0000 7f3d15325800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:29.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.288+0000 7f3d15325800 20 add_watcher() i=0 2024-09-12T00:15:29.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.288+0000 7f3d15325800 20 add_watcher() i=1 2024-09-12T00:15:29.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.288+0000 7f3d15325800 20 add_watcher() i=2 2024-09-12T00:15:29.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.288+0000 7f3d15325800 20 add_watcher() i=3 2024-09-12T00:15:29.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.288+0000 7f3d15325800 20 add_watcher() i=4 2024-09-12T00:15:29.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.288+0000 7f3d15325800 20 add_watcher() i=5 2024-09-12T00:15:29.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.288+0000 7f3d15325800 20 add_watcher() i=6 2024-09-12T00:15:29.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.289+0000 7f3d15325800 20 add_watcher() i=7 2024-09-12T00:15:29.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.289+0000 7f3d15325800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:29.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.291+0000 7f3bc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:29.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.291+0000 7f3d15325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:29.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.291+0000 7f3d15325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:29.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.291+0000 7f3d15325800 5 note: GC not initialized 2024-09-12T00:15:29.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.292+0000 7f3bc5fe3640 20 reqs_thread_entry: start 2024-09-12T00:15:29.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.292+0000 7f3d15325800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:29.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.292+0000 7f3d15325800 20 Filter name: none 2024-09-12T00:15:29.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.292+0000 7f3b377fe640 20 reqs_thread_entry: start 2024-09-12T00:15:29.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.292+0000 7f3d15325800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.292+0000 7f3d15325800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:29.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.292+0000 7f3d15325800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.293+0000 7f3d15325800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:29.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.293+0000 7f3d15325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:29.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.293+0000 7f3d15325800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:15:29.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.293+0000 7f3d15325800 20 INFO: main: starting shard=0 2024-09-12T00:15:29.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.293+0000 7f3d15325800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:29.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.293+0000 7f3d15325800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:15:29.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.294+0000 7f3d15325800 20 INFO: main: done 2024-09-12T00:15:29.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.294+0000 7f3bc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:29.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.296+0000 7f3d15325800 20 remove_watcher() i=0 2024-09-12T00:15:29.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.296+0000 7f3d15325800 2 removed watcher, disabling cache 2024-09-12T00:15:29.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.297+0000 7f3d15325800 20 remove_watcher() i=1 2024-09-12T00:15:29.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.298+0000 7f3d15325800 20 remove_watcher() i=2 2024-09-12T00:15:29.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.300+0000 7f3d15325800 20 remove_watcher() i=3 2024-09-12T00:15:29.300 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.302+0000 7f3d15325800 20 remove_watcher() i=4 2024-09-12T00:15:29.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.303+0000 7f3d15325800 20 remove_watcher() i=5 2024-09-12T00:15:29.303 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.304+0000 7f3d15325800 20 remove_watcher() i=6 2024-09-12T00:15:29.304 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.305+0000 7f3d15325800 20 remove_watcher() i=7 2024-09-12T00:15:29.447 INFO:tasks.workunit.client.0.smithi133.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:15:29.448 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:15:29.478 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:29.478 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:29.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.516+0000 7fc0fe4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.517+0000 7fc0fe4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.517+0000 7fc0fe4bb800 20 realm 2024-09-12T00:15:29.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.517+0000 7fc0fe4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.518+0000 7fc0fe4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.518+0000 7fc0fe4bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:29.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.518+0000 7fc0fe4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.518+0000 7fc0fe4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.518+0000 7fc0fe4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.518+0000 7fc0fe4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:29.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.518+0000 7fc0fe4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.518 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.519+0000 7fc0fe4bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:29.518 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.519+0000 7fc0fe4bb800 20 searching for the correct realm 2024-09-12T00:15:29.520 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.521+0000 7fc0fb7ab640 0 -- 172.21.15.133:0/2868026088 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fc0f0075070 msgr2=0x7fc0f0061db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:29.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.524+0000 7fc0fb7ab640 0 -- 172.21.15.133:0/2868026088 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fc0ec090420 msgr2=0x7fc0ec090860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:29.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.731+0000 7fc0fe4bb800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:29.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.731+0000 7fc0fe4bb800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:29.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.731+0000 7fc0fe4bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:29.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.731+0000 7fc0fe4bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:29.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.731+0000 7fc0fe4bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:29.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.731+0000 7fc0fe4bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:29.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.731+0000 7fc0fe4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.731+0000 7fc0fe4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.731+0000 7fc0fe4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.731+0000 7fc0fe4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:29.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.731+0000 7fc0fe4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.732+0000 7fc0fe4bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:29.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.732+0000 7fc0fe4bb800 20 zone default found 2024-09-12T00:15:29.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.732+0000 7fc0fe4bb800 4 Realm: () 2024-09-12T00:15:29.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.732+0000 7fc0fe4bb800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:29.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.732+0000 7fc0fe4bb800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:29.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.732+0000 7fc0fe4bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:29.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.732+0000 7fc0fe4bb800 20 zonegroup default 2024-09-12T00:15:29.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.732+0000 7fc0fe4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.732+0000 7fc0fe4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.732+0000 7fc0fe4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.732+0000 7fc0fe4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.732+0000 7fc0fe4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.733+0000 7fc0fe4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.733+0000 7fc0fe4bb800 20 started sync module instance, tier type = 2024-09-12T00:15:29.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.733+0000 7fc0fe4bb800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:29.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.743+0000 7fc0fe4bb800 20 add_watcher() i=0 2024-09-12T00:15:29.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.743+0000 7fc0fe4bb800 20 add_watcher() i=1 2024-09-12T00:15:29.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.743+0000 7fc0fe4bb800 20 add_watcher() i=2 2024-09-12T00:15:29.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.743+0000 7fc0fe4bb800 20 add_watcher() i=3 2024-09-12T00:15:29.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.743+0000 7fc0fe4bb800 20 add_watcher() i=4 2024-09-12T00:15:29.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.743+0000 7fc0fe4bb800 20 add_watcher() i=5 2024-09-12T00:15:29.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.743+0000 7fc0fe4bb800 20 add_watcher() i=6 2024-09-12T00:15:29.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.744+0000 7fc0fe4bb800 20 add_watcher() i=7 2024-09-12T00:15:29.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.744+0000 7fc0fe4bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:29.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.746+0000 7fbfb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:29.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.746+0000 7fc0fe4bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:29.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.746+0000 7fc0fe4bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:29.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.746+0000 7fc0fe4bb800 5 note: GC not initialized 2024-09-12T00:15:29.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.747+0000 7fbfb0fe1640 20 reqs_thread_entry: start 2024-09-12T00:15:29.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.747+0000 7fc0fe4bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:29.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.747+0000 7fc0fe4bb800 20 Filter name: none 2024-09-12T00:15:29.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.747+0000 7fbf2a7fc640 20 reqs_thread_entry: start 2024-09-12T00:15:29.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.747+0000 7fc0fe4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.748+0000 7fc0fe4bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:29.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.748+0000 7fc0fe4bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.748+0000 7fc0fe4bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:29.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.748+0000 7fc0fe4bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:29.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.748+0000 7fc0fe4bb800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:15:29.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.748+0000 7fc0fe4bb800 20 INFO: main: starting shard=0 2024-09-12T00:15:29.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.748+0000 7fc0fe4bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:29.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.749+0000 7fc0fe4bb800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:15:29.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.749+0000 7fc0fe4bb800 20 INFO: main: done 2024-09-12T00:15:29.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.749+0000 7fbfb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:29.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.751+0000 7fc0fe4bb800 20 remove_watcher() i=0 2024-09-12T00:15:29.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.751+0000 7fc0fe4bb800 2 removed watcher, disabling cache 2024-09-12T00:15:29.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.752+0000 7fc0fe4bb800 20 remove_watcher() i=1 2024-09-12T00:15:29.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.754+0000 7fc0fe4bb800 20 remove_watcher() i=2 2024-09-12T00:15:29.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.754+0000 7fc0fe4bb800 20 remove_watcher() i=3 2024-09-12T00:15:29.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.756+0000 7fc0fe4bb800 20 remove_watcher() i=4 2024-09-12T00:15:29.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.757+0000 7fc0fe4bb800 20 remove_watcher() i=5 2024-09-12T00:15:29.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.758+0000 7fc0fe4bb800 20 remove_watcher() i=6 2024-09-12T00:15:29.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.759+0000 7fc0fe4bb800 20 remove_watcher() i=7 2024-09-12T00:15:29.877 INFO:tasks.workunit.client.0.smithi133.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:15:29.878 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:15:29.908 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:29.909 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:29.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.946+0000 7f10a732c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.948+0000 7f10a732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.948+0000 7f10a732c800 20 realm 2024-09-12T00:15:29.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.948+0000 7f10a732c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.948+0000 7f10a732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.948+0000 7f10a732c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:29.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.948+0000 7f10a732c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.948+0000 7f10a732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:29.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.948+0000 7f10a732c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.949+0000 7f10a732c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:29.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.949+0000 7f10a732c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:29.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.950+0000 7f10a732c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:29.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.950+0000 7f10a732c800 20 searching for the correct realm 2024-09-12T00:15:29.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.952+0000 7f109a73d640 0 -- 172.21.15.133:0/17958023 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f108c0777b0 msgr2=0x7f108c028040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:29.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:29.955+0000 7f109a73d640 0 -- 172.21.15.133:0/17958023 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f109403c120 msgr2=0x7f1094059ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:30.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.161+0000 7f10a732c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:30.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.161+0000 7f10a732c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:30.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.161+0000 7f10a732c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.161+0000 7f10a732c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.161+0000 7f10a732c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.161+0000 7f10a732c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.161+0000 7f10a732c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.161+0000 7f10a732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.161+0000 7f10a732c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.161+0000 7f10a732c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.161+0000 7f10a732c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:30.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.162+0000 7f10a732c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:30.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.162+0000 7f10a732c800 20 zone default found 2024-09-12T00:15:30.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.162+0000 7f10a732c800 4 Realm: () 2024-09-12T00:15:30.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.162+0000 7f10a732c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:30.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.162+0000 7f10a732c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:30.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.162+0000 7f10a732c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:30.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.162+0000 7f10a732c800 20 zonegroup default 2024-09-12T00:15:30.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.162+0000 7f10a732c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:30.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.162+0000 7f10a732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:30.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.162+0000 7f10a732c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:30.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.162+0000 7f10a732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:30.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.162+0000 7f10a732c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:30.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.163+0000 7f10a732c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:30.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.163+0000 7f10a732c800 20 started sync module instance, tier type = 2024-09-12T00:15:30.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.163+0000 7f10a732c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:30.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.173+0000 7f10a732c800 20 add_watcher() i=0 2024-09-12T00:15:30.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.173+0000 7f10a732c800 20 add_watcher() i=1 2024-09-12T00:15:30.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.173+0000 7f10a732c800 20 add_watcher() i=2 2024-09-12T00:15:30.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.173+0000 7f10a732c800 20 add_watcher() i=3 2024-09-12T00:15:30.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.173+0000 7f10a732c800 20 add_watcher() i=4 2024-09-12T00:15:30.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.173+0000 7f10a732c800 20 add_watcher() i=5 2024-09-12T00:15:30.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.173+0000 7f10a732c800 20 add_watcher() i=6 2024-09-12T00:15:30.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.174+0000 7f10a732c800 20 add_watcher() i=7 2024-09-12T00:15:30.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.174+0000 7f10a732c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:30.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.176+0000 7f0f597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.176+0000 7f10a732c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.176+0000 7f10a732c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.176+0000 7f10a732c800 5 note: GC not initialized 2024-09-12T00:15:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.176+0000 7f0ed3fff640 20 reqs_thread_entry: start 2024-09-12T00:15:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.176+0000 7f10a732c800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.176+0000 7f10a732c800 20 Filter name: none 2024-09-12T00:15:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.176+0000 7f0ed1ffb640 20 reqs_thread_entry: start 2024-09-12T00:15:30.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.176+0000 7f10a732c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:30.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.177+0000 7f10a732c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:30.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.177+0000 7f10a732c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:30.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.177+0000 7f10a732c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:30.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.177+0000 7f10a732c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:30.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.177+0000 7f10a732c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:15:30.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.177+0000 7f10a732c800 20 INFO: main: starting shard=0 2024-09-12T00:15:30.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.177+0000 7f10a732c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:30.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.178+0000 7f10a732c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:15:30.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.178+0000 7f10a732c800 20 INFO: main: done 2024-09-12T00:15:30.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.179+0000 7f0f597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:30.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.181+0000 7f10a732c800 20 remove_watcher() i=0 2024-09-12T00:15:30.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.181+0000 7f10a732c800 2 removed watcher, disabling cache 2024-09-12T00:15:30.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.182+0000 7f10a732c800 20 remove_watcher() i=1 2024-09-12T00:15:30.183 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.183+0000 7f10a732c800 20 remove_watcher() i=2 2024-09-12T00:15:30.183 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.184+0000 7f10a732c800 20 remove_watcher() i=3 2024-09-12T00:15:30.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.185+0000 7f10a732c800 20 remove_watcher() i=4 2024-09-12T00:15:30.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.186+0000 7f10a732c800 20 remove_watcher() i=5 2024-09-12T00:15:30.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.187+0000 7f10a732c800 20 remove_watcher() i=6 2024-09-12T00:15:30.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:30.189+0000 7f10a732c800 20 remove_watcher() i=7 2024-09-12T00:15:30.224 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:15:30.610 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:15:31.007 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:15:31.037 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:31.037 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:31.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.075+0000 7f0f5e136800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.077+0000 7f0f5e136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:31.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.077+0000 7f0f5e136800 20 realm 2024-09-12T00:15:31.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.077+0000 7f0f5e136800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.077+0000 7f0f5e136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:31.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.077+0000 7f0f5e136800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:31.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.077+0000 7f0f5e136800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.077+0000 7f0f5e136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:31.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.077+0000 7f0f5e136800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.078+0000 7f0f5e136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:31.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.078+0000 7f0f5e136800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.079+0000 7f0f5e136800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:31.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.079+0000 7f0f5e136800 20 searching for the correct realm 2024-09-12T00:15:31.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.082+0000 7f0f5a6b8640 0 -- 172.21.15.133:0/2097271754 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f0f54018030 msgr2=0x7f0f5408f5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:15:31.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.287+0000 7f0f59eb7640 0 -- 172.21.15.133:0/2097271754 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x5563a13eeac0 msgr2=0x5563a13f0f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:31.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.291+0000 7f0f5e136800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:31.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.291+0000 7f0f5e136800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:31.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.291+0000 7f0f5e136800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:31.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.291+0000 7f0f5e136800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:31.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.291+0000 7f0f5e136800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:31.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.291+0000 7f0f5e136800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:31.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.291+0000 7f0f5e136800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.291+0000 7f0f5e136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:31.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.291+0000 7f0f5e136800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.292+0000 7f0f5e136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:31.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.292+0000 7f0f5e136800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.292+0000 7f0f5e136800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:31.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.292+0000 7f0f5e136800 20 zone default found 2024-09-12T00:15:31.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.292+0000 7f0f5e136800 4 Realm: () 2024-09-12T00:15:31.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.292+0000 7f0f5e136800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:31.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.292+0000 7f0f5e136800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:31.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.292+0000 7f0f5e136800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:31.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.292+0000 7f0f5e136800 20 zonegroup default 2024-09-12T00:15:31.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.292+0000 7f0f5e136800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.292+0000 7f0f5e136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:31.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.292+0000 7f0f5e136800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.293+0000 7f0f5e136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:31.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.293+0000 7f0f5e136800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.293+0000 7f0f5e136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:31.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.293+0000 7f0f5e136800 20 started sync module instance, tier type = 2024-09-12T00:15:31.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.293+0000 7f0f5e136800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:31.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.303+0000 7f0f5e136800 20 add_watcher() i=0 2024-09-12T00:15:31.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.303+0000 7f0f5e136800 20 add_watcher() i=1 2024-09-12T00:15:31.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.303+0000 7f0f5e136800 20 add_watcher() i=2 2024-09-12T00:15:31.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.303+0000 7f0f5e136800 20 add_watcher() i=3 2024-09-12T00:15:31.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.303+0000 7f0f5e136800 20 add_watcher() i=4 2024-09-12T00:15:31.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.303+0000 7f0f5e136800 20 add_watcher() i=5 2024-09-12T00:15:31.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.303+0000 7f0f5e136800 20 add_watcher() i=6 2024-09-12T00:15:31.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.304+0000 7f0f5e136800 20 add_watcher() i=7 2024-09-12T00:15:31.303 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.304+0000 7f0f5e136800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:31.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.306+0000 7f0e0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:31.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.306+0000 7f0f5e136800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:31.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.306+0000 7f0f5e136800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:31.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.307+0000 7f0f5e136800 5 note: GC not initialized 2024-09-12T00:15:31.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.307+0000 7f0e0a7fc640 20 reqs_thread_entry: start 2024-09-12T00:15:31.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.307+0000 7f0f5e136800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:31.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.307+0000 7f0f5e136800 20 Filter name: none 2024-09-12T00:15:31.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.307+0000 7f0d7bfff640 20 reqs_thread_entry: start 2024-09-12T00:15:31.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.307+0000 7f0f5e136800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:15:31.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.307+0000 7f0f5e136800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.308+0000 7f0f5e136800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:31.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.308+0000 7f0f5e136800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:15:31.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.308+0000 7f0f5e136800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:15:31.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.308+0000 7f0f5e136800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 : miss 2024-09-12T00:15:31.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.308+0000 7f0f5e136800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.308+0000 7f0f5e136800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:31.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.308+0000 7f0f5e136800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 info.flags=0x17 2024-09-12T00:15:31.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.308+0000 7f0f5e136800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 to cache LRU end 2024-09-12T00:15:31.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.308+0000 7f0f5e136800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:15:31.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.308+0000 7f0f5e136800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:15:31.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.308+0000 7f0f5e136800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 2024-09-12T00:15:31.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.308+0000 7f0f5e136800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.312+0000 7f0e0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:31.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.314+0000 7f0f5e136800 20 remove_watcher() i=0 2024-09-12T00:15:31.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.314+0000 7f0f5e136800 2 removed watcher, disabling cache 2024-09-12T00:15:31.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.315+0000 7f0f5e136800 20 remove_watcher() i=1 2024-09-12T00:15:31.315 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.317+0000 7f0f5e136800 20 remove_watcher() i=2 2024-09-12T00:15:31.316 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.318+0000 7f0f5e136800 20 remove_watcher() i=3 2024-09-12T00:15:31.317 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.319+0000 7f0f5e136800 20 remove_watcher() i=4 2024-09-12T00:15:31.318 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.320+0000 7f0f5e136800 20 remove_watcher() i=5 2024-09-12T00:15:31.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.321+0000 7f0f5e136800 20 remove_watcher() i=6 2024-09-12T00:15:31.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.322+0000 7f0f5e136800 20 remove_watcher() i=7 2024-09-12T00:15:31.332 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:15:31.367 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:31.367 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:31.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.406+0000 7f915f32c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.408+0000 7f915f32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:31.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.408+0000 7f915f32c800 20 realm 2024-09-12T00:15:31.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.408+0000 7f915f32c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.408+0000 7f915f32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:31.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.408+0000 7f915f32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:31.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.408+0000 7f915f32c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.408+0000 7f915f32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:31.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.408+0000 7f915f32c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.409+0000 7f915f32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:31.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.409+0000 7f915f32c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.410+0000 7f915f32c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:31.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.410+0000 7f915f32c800 20 searching for the correct realm 2024-09-12T00:15:31.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.411+0000 7f915af3e640 0 -- 172.21.15.133:0/728414560 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x563a39b05800 msgr2=0x563a39b07ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:31.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.414+0000 7f915af3e640 0 -- 172.21.15.133:0/728414560 >> [v2:172.21.15.160:6818/507321805,v1:172.21.15.160:6819/507321805] conn(0x7f914405f420 msgr2=0x7f914405f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:31.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.621+0000 7f915f32c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:31.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.621+0000 7f915f32c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:31.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.621+0000 7f915f32c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:31.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.621+0000 7f915f32c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:31.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.621+0000 7f915f32c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:31.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.621+0000 7f915f32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:31.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.621+0000 7f915f32c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.622+0000 7f915f32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:31.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.622+0000 7f915f32c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.622+0000 7f915f32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:31.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.622+0000 7f915f32c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.622+0000 7f915f32c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:31.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.622+0000 7f915f32c800 20 zone default found 2024-09-12T00:15:31.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.622+0000 7f915f32c800 4 Realm: () 2024-09-12T00:15:31.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.622+0000 7f915f32c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:31.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.622+0000 7f915f32c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:31.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.622+0000 7f915f32c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:31.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.622+0000 7f915f32c800 20 zonegroup default 2024-09-12T00:15:31.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.622+0000 7f915f32c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.623+0000 7f915f32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:31.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.623+0000 7f915f32c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.623+0000 7f915f32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:31.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.623+0000 7f915f32c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.623+0000 7f915f32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:31.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.623+0000 7f915f32c800 20 started sync module instance, tier type = 2024-09-12T00:15:31.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.623+0000 7f915f32c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:31.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.635+0000 7f915f32c800 20 add_watcher() i=0 2024-09-12T00:15:31.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.635+0000 7f915f32c800 20 add_watcher() i=1 2024-09-12T00:15:31.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.635+0000 7f915f32c800 20 add_watcher() i=2 2024-09-12T00:15:31.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.635+0000 7f915f32c800 20 add_watcher() i=3 2024-09-12T00:15:31.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.635+0000 7f915f32c800 20 add_watcher() i=4 2024-09-12T00:15:31.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.635+0000 7f915f32c800 20 add_watcher() i=5 2024-09-12T00:15:31.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.635+0000 7f915f32c800 20 add_watcher() i=6 2024-09-12T00:15:31.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.637+0000 7f915f32c800 20 add_watcher() i=7 2024-09-12T00:15:31.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.637+0000 7f915f32c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:31.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.639+0000 7f90117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:31.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.639+0000 7f915f32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:31.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.639+0000 7f915f32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:31.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.639+0000 7f915f32c800 5 note: GC not initialized 2024-09-12T00:15:31.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.639+0000 7f8f8bfff640 20 reqs_thread_entry: start 2024-09-12T00:15:31.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.639+0000 7f915f32c800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:31.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.639+0000 7f915f32c800 20 Filter name: none 2024-09-12T00:15:31.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.640+0000 7f8f89ffb640 20 reqs_thread_entry: start 2024-09-12T00:15:31.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.640+0000 7f915f32c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:15:31.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.640+0000 7f915f32c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.640+0000 7f915f32c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:31.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.640+0000 7f915f32c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:15:31.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.640+0000 7f915f32c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:15:31.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.640+0000 7f915f32c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 : miss 2024-09-12T00:15:31.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.640+0000 7f915f32c800 20 rados->read ofs=0 len=0 2024-09-12T00:15:31.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.641+0000 7f915f32c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:31.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.641+0000 7f915f32c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 info.flags=0x17 2024-09-12T00:15:31.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.641+0000 7f915f32c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 to cache LRU end 2024-09-12T00:15:31.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.641+0000 7f915f32c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:15:31.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.641+0000 7f915f32c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:15:31.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.641+0000 7f915f32c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2 2024-09-12T00:15:31.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.641+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.642+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.642+0000 7f915f32c800 20 get_obj_state: octx=0x563a39876690 obj=check-bucket:c state=0x563a39b466f8 s->prefetch_data=0 2024-09-12T00:15:31.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.643+0000 7f915f32c800 20 get_obj_state: setting s->obj_tag to 3gicqti4gib0zuo6lh0clm2oube2u2n0 2024-09-12T00:15:31.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.643+0000 7f915f32c800 20 get_obj_state_impl: setting s->olh_tag to znjut67rp50zawmtok6skqb48l7vayo1 2024-09-12T00:15:31.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.643+0000 7f915f32c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=znjut67rp50zawmtok6skqb48l7vayo1 2024-09-12T00:15:31.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.644+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.646+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.646+0000 7f915f32c800 20 olh_log_entry: epoch=3 op=3 key=c[5Z.Qqwj-lwnWndz2n5j.AEc8-bzenyt] 2024-09-12T00:15:31.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.646+0000 7f915f32c800 20 get_obj_state: octx=0x563a39876690 obj=check-bucket:_:5Z.Qqwj-lwnWndz2n5j.AEc8-bzenyt_c state=0x563a39b7ce38 s->prefetch_data=0 2024-09-12T00:15:31.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.646+0000 7f915f32c800 10 manifest: total_size = 11 2024-09-12T00:15:31.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.646+0000 7f915f32c800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10711611409632113667 2024-09-12T00:15:31.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.646+0000 7f915f32c800 20 get_obj_state: octx=0x563a39876690 obj=check-bucket:_:5Z.Qqwj-lwnWndz2n5j.AEc8-bzenyt_c state=0x563a39b7ce38 s->prefetch_data=0 2024-09-12T00:15:31.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.646+0000 7f915f32c800 20 prepare_atomic_modification: state is not atomic. state=0x563a39b7ce38 2024-09-12T00:15:31.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.646+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.649+0000 7f915f32c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:15:31.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.649+0000 7f915f32c800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:15:31.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.649+0000 7f915f32c800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:15:31.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.649+0000 7f915f32c800 5 delete_objs_inline: removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2__shadow:5Z.Qqwj-lwnWndz2n5j.AEc8-bzenyt_.VOmwT7Ii8MjBlgc8myWD_phaIsRc6VZ_0 2024-09-12T00:15:31.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.650+0000 7f915f32c800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:15:31.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.651+0000 7f903dffb640 20 handle_completion(): completion ok for obj=c[5Z.Qqwj-lwnWndz2n5j.AEc8-bzenyt] 2024-09-12T00:15:31.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.652+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.652+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.653+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.653+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.654+0000 7f915f32c800 20 get_obj_state: octx=0x563a39876690 obj=check-bucket:d state=0x563a39b466f8 s->prefetch_data=0 2024-09-12T00:15:31.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.654+0000 7f915f32c800 20 get_obj_state: setting s->obj_tag to ff36dgsu8isk4limqx6ggsvycozusctu 2024-09-12T00:15:31.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.654+0000 7f915f32c800 20 get_obj_state_impl: setting s->olh_tag to 2scprbypytp63nukfusayu0meuwiofaz 2024-09-12T00:15:31.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.654+0000 7f915f32c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2scprbypytp63nukfusayu0meuwiofaz 2024-09-12T00:15:31.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.655+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.658+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.658+0000 7f915f32c800 20 olh_log_entry: epoch=3 op=3 key=d[l3gDub6uv9809hm6CjYEGaFc-8etzGZ] 2024-09-12T00:15:31.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.658+0000 7f915f32c800 20 get_obj_state: octx=0x563a39876690 obj=check-bucket:_:l3gDub6uv9809hm6CjYEGaFc-8etzGZ_d state=0x563a39b7ce38 s->prefetch_data=0 2024-09-12T00:15:31.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.658+0000 7f915f32c800 10 manifest: total_size = 22 2024-09-12T00:15:31.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.658+0000 7f915f32c800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9095531689217563404 2024-09-12T00:15:31.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.658+0000 7f915f32c800 20 get_obj_state: octx=0x563a39876690 obj=check-bucket:_:l3gDub6uv9809hm6CjYEGaFc-8etzGZ_d state=0x563a39b7ce38 s->prefetch_data=0 2024-09-12T00:15:31.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.658+0000 7f915f32c800 20 prepare_atomic_modification: state is not atomic. state=0x563a39b7ce38 2024-09-12T00:15:31.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.658+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.661+0000 7f915f32c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:15:31.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.661+0000 7f915f32c800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:15:31.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.661+0000 7f915f32c800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:15:31.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.661+0000 7f915f32c800 5 delete_objs_inline: removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2__shadow:l3gDub6uv9809hm6CjYEGaFc-8etzGZ_.EcsmcIzUH6wvGHk4LjknV19OWTZoJEL_0 2024-09-12T00:15:31.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.664+0000 7f903e7fc640 20 handle_completion(): completion ok for obj=d[l3gDub6uv9809hm6CjYEGaFc-8etzGZ] 2024-09-12T00:15:31.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.671+0000 7f915f32c800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:15:31.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.672+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.672+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.673+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.674+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.674+0000 7f915f32c800 20 get_obj_state: octx=0x563a39876690 obj=check-bucket:e state=0x563a39b466f8 s->prefetch_data=0 2024-09-12T00:15:31.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.674+0000 7f915f32c800 20 get_obj_state: setting s->obj_tag to 22idgsik25lq4dgc601qggoj2zqyyp9q 2024-09-12T00:15:31.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.674+0000 7f915f32c800 20 get_obj_state_impl: setting s->olh_tag to hevvkew8mr56a6mzg5xxm05a7y22k9gm 2024-09-12T00:15:31.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.674+0000 7f915f32c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=hevvkew8mr56a6mzg5xxm05a7y22k9gm 2024-09-12T00:15:31.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.676+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.677+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.678+0000 7f915f32c800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:15:31.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.678+0000 7f915f32c800 20 olh_log_entry: epoch=2 op=3 key=e[EHpLbymCvftusU4sSyNVQv0Hya3wQUz] 2024-09-12T00:15:31.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.678+0000 7f915f32c800 20 get_obj_state: octx=0x563a39876690 obj=check-bucket:_:EHpLbymCvftusU4sSyNVQv0Hya3wQUz_e state=0x563a39b7ce38 s->prefetch_data=0 2024-09-12T00:15:31.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.678+0000 7f915f32c800 10 manifest: total_size = 22 2024-09-12T00:15:31.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.678+0000 7f915f32c800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1130856191392872869 2024-09-12T00:15:31.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.678+0000 7f915f32c800 20 get_obj_state: octx=0x563a39876690 obj=check-bucket:_:EHpLbymCvftusU4sSyNVQv0Hya3wQUz_e state=0x563a39b7ce38 s->prefetch_data=0 2024-09-12T00:15:31.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.678+0000 7f915f32c800 20 prepare_atomic_modification: state is not atomic. state=0x563a39b7ce38 2024-09-12T00:15:31.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.678+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.680+0000 7f915f32c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:15:31.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.680+0000 7f915f32c800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:15:31.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.680+0000 7f915f32c800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:15:31.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.680+0000 7f915f32c800 5 delete_objs_inline: removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2__shadow:EHpLbymCvftusU4sSyNVQv0Hya3wQUz_.EqCMzhUIW-i_XEHGqUo-Pgo0PIPnSag_0 2024-09-12T00:15:31.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.682+0000 7f903e7fc640 20 handle_completion(): completion ok for obj=e[EHpLbymCvftusU4sSyNVQv0Hya3wQUz] 2024-09-12T00:15:31.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.682+0000 7f915f32c800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:15:31.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.685+0000 7f915f32c800 20 get_obj_state: octx=0x563a39876690 obj=check-bucket:e state=0x563a39b466f8 s->prefetch_data=0 2024-09-12T00:15:31.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.685+0000 7f915f32c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=hevvkew8mr56a6mzg5xxm05a7y22k9gm 2024-09-12T00:15:31.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.692+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.694+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.695+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.695+0000 7f915f32c800 20 get_obj_state: octx=0x563a39876690 obj=check-bucket:f state=0x563a39b466f8 s->prefetch_data=0 2024-09-12T00:15:31.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.695+0000 7f915f32c800 20 get_obj_state: setting s->obj_tag to 86tn8io7iszgnvo97vseh3zz1oym8gpk 2024-09-12T00:15:31.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.695+0000 7f915f32c800 20 get_obj_state_impl: setting s->olh_tag to c35m5ihmbcsz71d165ox1lcm9ogp13v0 2024-09-12T00:15:31.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.695+0000 7f915f32c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c35m5ihmbcsz71d165ox1lcm9ogp13v0 2024-09-12T00:15:31.695 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.696+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.698+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.698+0000 7f915f32c800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:15:31.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.698+0000 7f915f32c800 20 olh_log_entry: epoch=2 op=3 key=f[ZWnSLHS2LMzOk1RQnF1pJRfGrhV4Flo] 2024-09-12T00:15:31.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.698+0000 7f915f32c800 20 get_obj_state: octx=0x563a39876690 obj=check-bucket:_:ZWnSLHS2LMzOk1RQnF1pJRfGrhV4Flo_f state=0x563a39b7ce38 s->prefetch_data=0 2024-09-12T00:15:31.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.698+0000 7f915f32c800 10 manifest: total_size = 11 2024-09-12T00:15:31.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.698+0000 7f915f32c800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12117299153433077431 2024-09-12T00:15:31.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.698+0000 7f915f32c800 20 get_obj_state: octx=0x563a39876690 obj=check-bucket:_:ZWnSLHS2LMzOk1RQnF1pJRfGrhV4Flo_f state=0x563a39b7ce38 s->prefetch_data=0 2024-09-12T00:15:31.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.698+0000 7f915f32c800 20 prepare_atomic_modification: state is not atomic. state=0x563a39b7ce38 2024-09-12T00:15:31.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.699+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.702+0000 7f915f32c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:15:31.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.702+0000 7f915f32c800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:15:31.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.702+0000 7f915f32c800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:15:31.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.702+0000 7f915f32c800 5 delete_objs_inline: removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2__shadow:ZWnSLHS2LMzOk1RQnF1pJRfGrhV4Flo_.6S-g3JcPzj8xX56G-KI4FFmDFlRosnl_0 2024-09-12T00:15:31.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.708+0000 7f903e7fc640 20 handle_completion(): completion ok for obj=f[ZWnSLHS2LMzOk1RQnF1pJRfGrhV4Flo] 2024-09-12T00:15:31.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.708+0000 7f915f32c800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:15:31.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.709+0000 7f915f32c800 20 get_obj_state: octx=0x563a39876690 obj=check-bucket:f state=0x563a39b466f8 s->prefetch_data=0 2024-09-12T00:15:31.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.709+0000 7f915f32c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c35m5ihmbcsz71d165ox1lcm9ogp13v0 2024-09-12T00:15:31.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.716+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.718+0000 7f915f32c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2.0 2024-09-12T00:15:31.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.718+0000 7f915f32c800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T00:15:31.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.718+0000 7f915f32c800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:15:31.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.719+0000 7f90117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:31.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.722+0000 7f915f32c800 20 remove_watcher() i=0 2024-09-12T00:15:31.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.722+0000 7f915f32c800 2 removed watcher, disabling cache 2024-09-12T00:15:31.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.724+0000 7f915f32c800 20 remove_watcher() i=1 2024-09-12T00:15:31.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.725+0000 7f915f32c800 20 remove_watcher() i=2 2024-09-12T00:15:31.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.726+0000 7f915f32c800 20 remove_watcher() i=3 2024-09-12T00:15:31.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.727+0000 7f915f32c800 20 remove_watcher() i=4 2024-09-12T00:15:31.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.728+0000 7f915f32c800 20 remove_watcher() i=5 2024-09-12T00:15:31.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.729+0000 7f915f32c800 20 remove_watcher() i=6 2024-09-12T00:15:31.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:31.730+0000 7f915f32c800 20 remove_watcher() i=7 2024-09-12T00:15:31.961 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:15:31.989 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:31.989 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:32.026 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.028+0000 7f34b24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:32.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.030+0000 7f34b24bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:32.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.030+0000 7f34b24bb800 20 realm 2024-09-12T00:15:32.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.030+0000 7f34b24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:32.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.030+0000 7f34b24bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:32.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.030+0000 7f34b24bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:32.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.030+0000 7f34b24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:32.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.030+0000 7f34b24bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:32.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.030+0000 7f34b24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:32.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.031+0000 7f34b24bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:32.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.031+0000 7f34b24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:32.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.032+0000 7f34b24bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:32.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.032+0000 7f34b24bb800 20 searching for the correct realm 2024-09-12T00:15:32.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.035+0000 7f34b07a6640 0 -- 172.21.15.133:0/2393212169 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f34a8027070 msgr2=0x7f34a803e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:32.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.240+0000 7f34affa5640 0 -- 172.21.15.133:0/2393212169 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x55dee1e787e0 msgr2=0x55dee1e7ac50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:32.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.244+0000 7f34b24bb800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:15:32.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.244+0000 7f34b24bb800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:15:32.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.244+0000 7f34b24bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:32.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.244+0000 7f34b24bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:32.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.244+0000 7f34b24bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:32.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.244+0000 7f34b24bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:32.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.244+0000 7f34b24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:32.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.244+0000 7f34b24bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:32.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.244+0000 7f34b24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:32.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.244+0000 7f34b24bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:32.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.244+0000 7f34b24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:32.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.245+0000 7f34b24bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:32.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.245+0000 7f34b24bb800 20 zone default found 2024-09-12T00:15:32.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.245+0000 7f34b24bb800 4 Realm: () 2024-09-12T00:15:32.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.245+0000 7f34b24bb800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:15:32.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.245+0000 7f34b24bb800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:15:32.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.245+0000 7f34b24bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:32.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.245+0000 7f34b24bb800 20 zonegroup default 2024-09-12T00:15:32.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.245+0000 7f34b24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:32.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.245+0000 7f34b24bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:32.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.245+0000 7f34b24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:32.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.245+0000 7f34b24bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:32.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.245+0000 7f34b24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:32.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.245+0000 7f34b24bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:32.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.245+0000 7f34b24bb800 20 started sync module instance, tier type = 2024-09-12T00:15:32.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.245+0000 7f34b24bb800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:15:32.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.255+0000 7f34b24bb800 20 add_watcher() i=0 2024-09-12T00:15:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.255+0000 7f34b24bb800 20 add_watcher() i=1 2024-09-12T00:15:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.255+0000 7f34b24bb800 20 add_watcher() i=2 2024-09-12T00:15:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.255+0000 7f34b24bb800 20 add_watcher() i=3 2024-09-12T00:15:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.255+0000 7f34b24bb800 20 add_watcher() i=4 2024-09-12T00:15:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.255+0000 7f34b24bb800 20 add_watcher() i=5 2024-09-12T00:15:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.255+0000 7f34b24bb800 20 add_watcher() i=6 2024-09-12T00:15:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.256+0000 7f34b24bb800 20 add_watcher() i=7 2024-09-12T00:15:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.256+0000 7f34b24bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:32.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.257+0000 7f3365fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:32.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.257+0000 7f34b24bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:32.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.257+0000 7f34b24bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:32.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.257+0000 7f34b24bb800 5 note: GC not initialized 2024-09-12T00:15:32.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.258+0000 7f3364fe1640 20 reqs_thread_entry: start 2024-09-12T00:15:32.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.258+0000 7f34b24bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:32.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.258+0000 7f34b24bb800 20 Filter name: none 2024-09-12T00:15:32.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.258+0000 7f32de7fc640 20 reqs_thread_entry: start 2024-09-12T00:15:32.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.258+0000 7f34b24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:32.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.258+0000 7f34b24bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:32.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.258+0000 7f34b24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:32.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.259+0000 7f34b24bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:32.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.259+0000 7f34b24bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:32.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.259+0000 7f34b24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:32.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.259+0000 7f34b24bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:15:32.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.259+0000 7f34b24bb800 20 rados->read ofs=0 len=0 2024-09-12T00:15:32.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.259+0000 7f34b24bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:15:32.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.259+0000 7f34b24bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:15:32.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.260+0000 7f3365fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:32.261 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.263+0000 7f34b24bb800 20 remove_watcher() i=0 2024-09-12T00:15:32.261 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.263+0000 7f34b24bb800 2 removed watcher, disabling cache 2024-09-12T00:15:32.262 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.263+0000 7f34b24bb800 20 remove_watcher() i=1 2024-09-12T00:15:32.263 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.265+0000 7f34b24bb800 20 remove_watcher() i=2 2024-09-12T00:15:32.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.266+0000 7f34b24bb800 20 remove_watcher() i=3 2024-09-12T00:15:32.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.266+0000 7f34b24bb800 20 remove_watcher() i=4 2024-09-12T00:15:32.266 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.268+0000 7f34b24bb800 20 remove_watcher() i=5 2024-09-12T00:15:32.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.269+0000 7f34b24bb800 20 remove_watcher() i=6 2024-09-12T00:15:32.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:15:32.269+0000 7f34b24bb800 20 remove_watcher() i=7 2024-09-12T00:15:32.279 INFO:tasks.workunit.client.0.smithi133.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:15:32.279 INFO:tasks.workunit.client.0.smithi133.stderr:Deleting bucket check-bucket 2024-09-12T00:15:32.436 INFO:tasks.workunit.client.0.smithi133.stderr:Completed bucket check tests 2024-09-12T00:15:32.436 INFO:tasks.workunit.client.0.smithi133.stdout:connected to http://localhost:80 2024-09-12T00:15:32.496 INFO:tasks.workunit.client.0.smithi133.stderr:+ deactivate 2024-09-12T00:15:32.496 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:15:32.496 INFO:tasks.workunit.client.0.smithi133.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:15:32.496 INFO:tasks.workunit.client.0.smithi133.stderr:+ export PATH 2024-09-12T00:15:32.496 INFO:tasks.workunit.client.0.smithi133.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:15:32.496 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n '' ']' 2024-09-12T00:15:32.497 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:15:32.497 INFO:tasks.workunit.client.0.smithi133.stderr:+ hash -r 2024-09-12T00:15:32.497 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n '' ']' 2024-09-12T00:15:32.497 INFO:tasks.workunit.client.0.smithi133.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:15:32.497 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:15:32.497 INFO:tasks.workunit.client.0.smithi133.stderr:+ unset -f deactivate 2024-09-12T00:15:32.497 INFO:tasks.workunit.client.0.smithi133.stderr:+ echo OK. 2024-09-12T00:15:32.498 INFO:tasks.workunit.client.0.smithi133.stdout:OK. 2024-09-12T00:15:32.498 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:15:32.498 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:15:32.578 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T00:15:32.578 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:15:32.950 DEBUG:teuthology.parallel:result is None 2024-09-12T00:15:32.950 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:15:32.989 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:15:32.989 DEBUG:teuthology.orchestra.run.smithi133:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:15:33.058 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:15:33.058 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:15:33.124 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:15:33.124 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:15:33.124 DEBUG:teuthology.orchestra.run.smithi133:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:15:33.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:15:33.155 INFO:teuthology.orchestra.run.smithi133.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:15:33.155 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:15:33.225 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:15:33.225 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:15:33.295 INFO:tasks.workunit:timeout=3h 2024-09-12T00:15:33.295 INFO:tasks.workunit:cleanup=True 2024-09-12T00:15:33.296 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:15:33.365 INFO:tasks.workunit.client.0.smithi133.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:16:17.385 INFO:tasks.workunit.client.0.smithi133.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:16:17.385 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:16:17.386 INFO:tasks.workunit.client.0.smithi133.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:16:17.386 INFO:tasks.workunit.client.0.smithi133.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:16:17.386 INFO:tasks.workunit.client.0.smithi133.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:16:17.386 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:16:17.386 INFO:tasks.workunit.client.0.smithi133.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:16:17.386 INFO:tasks.workunit.client.0.smithi133.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:16:17.386 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:16:17.386 INFO:tasks.workunit.client.0.smithi133.stderr: git switch -c 2024-09-12T00:16:17.386 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:16:17.386 INFO:tasks.workunit.client.0.smithi133.stderr:Or undo this operation with: 2024-09-12T00:16:17.386 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:16:17.386 INFO:tasks.workunit.client.0.smithi133.stderr: git switch - 2024-09-12T00:16:17.386 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:16:17.387 INFO:tasks.workunit.client.0.smithi133.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:16:17.387 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:16:17.387 INFO:tasks.workunit.client.0.smithi133.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:16:17.389 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:16:17.458 INFO:tasks.workunit.client.0.smithi133.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:16:17.460 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:16:17.461 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:16:17.508 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:16:17.557 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:16:17.596 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:16:17.598 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:16:17.598 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:16:17.635 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:16:17.639 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:16:17.639 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:16:17.709 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T00:16:17.710 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T00:16:17.710 DEBUG:teuthology.orchestra.run.smithi133:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T00:16:17.792 INFO:tasks.workunit.client.0.smithi133.stdout:Running main() from gmock_main.cc 2024-09-12T00:16:17.792 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:16:17.792 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:16:17.792 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 11 tests from ClsLock 2024-09-12T00:16:17.792 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T00:16:19.265 INFO:tasks.workunit.client.0.smithi133.stdout:lock: mylock 2024-09-12T00:16:19.265 INFO:tasks.workunit.client.0.smithi133.stdout: lock_type: exclusive 2024-09-12T00:16:19.265 INFO:tasks.workunit.client.0.smithi133.stdout: tag: 2024-09-12T00:16:19.266 INFO:tasks.workunit.client.0.smithi133.stdout: lockers: 2024-09-12T00:16:19.266 INFO:tasks.workunit.client.0.smithi133.stdout: client.5265 expiration=2024-09-12T00:18:19.259358+0000 addr=v1:172.21.15.133:0/1401861417 cookie= 2024-09-12T00:16:19.273 INFO:tasks.workunit.client.0.smithi133.stdout:lock: mylock 2024-09-12T00:16:19.273 INFO:tasks.workunit.client.0.smithi133.stdout: lock_type: shared 2024-09-12T00:16:19.273 INFO:tasks.workunit.client.0.smithi133.stdout: tag: 2024-09-12T00:16:19.274 INFO:tasks.workunit.client.0.smithi133.stdout: lockers: 2024-09-12T00:16:19.274 INFO:tasks.workunit.client.0.smithi133.stdout: client.5265 expiration=2024-09-12T00:18:19.272752+0000 addr=v1:172.21.15.133:0/1401861417 cookie= 2024-09-12T00:16:19.274 INFO:tasks.workunit.client.0.smithi133.stdout: client.5271 expiration=0.000000 addr=v1:172.21.15.133:0/312749126 cookie= 2024-09-12T00:16:19.275 INFO:tasks.workunit.client.0.smithi133.stdout:lock: mylock 2024-09-12T00:16:19.276 INFO:tasks.workunit.client.0.smithi133.stdout: lock_type: shared 2024-09-12T00:16:19.276 INFO:tasks.workunit.client.0.smithi133.stdout: tag: 2024-09-12T00:16:19.276 INFO:tasks.workunit.client.0.smithi133.stdout: lockers: 2024-09-12T00:16:19.276 INFO:tasks.workunit.client.0.smithi133.stdout: client.5271 expiration=0.000000 addr=v1:172.21.15.133:0/312749126 cookie= 2024-09-12T00:16:20.223 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ClsLock.TestMultiLocking (2431 ms) 2024-09-12T00:16:20.223 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T00:16:22.693 INFO:tasks.workunit.client.0.smithi133.stdout:lock: mylock 2024-09-12T00:16:22.694 INFO:tasks.workunit.client.0.smithi133.stdout: lock_type: shared 2024-09-12T00:16:22.694 INFO:tasks.workunit.client.0.smithi133.stdout: tag: 2024-09-12T00:16:22.694 INFO:tasks.workunit.client.0.smithi133.stdout: lockers: 2024-09-12T00:16:22.694 INFO:tasks.workunit.client.0.smithi133.stdout: client.5280 expiration=0.000000 addr=v1:172.21.15.133:0/4010274154 cookie= 2024-09-12T00:16:22.698 INFO:tasks.workunit.client.0.smithi133.stdout:lock: mylock 2024-09-12T00:16:22.698 INFO:tasks.workunit.client.0.smithi133.stdout: lock_type: exclusive 2024-09-12T00:16:22.698 INFO:tasks.workunit.client.0.smithi133.stdout: tag: new_tag 2024-09-12T00:16:22.698 INFO:tasks.workunit.client.0.smithi133.stdout: lockers: 2024-09-12T00:16:22.698 INFO:tasks.workunit.client.0.smithi133.stdout: client.5099 expiration=0.000000 addr=v1:172.21.15.133:0/2939256956 cookie= 2024-09-12T00:16:23.259 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ClsLock.TestMeta (3036 ms) 2024-09-12T00:16:23.259 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T00:16:25.294 INFO:tasks.workunit.client.0.smithi133.stdout:lock: mylock 2024-09-12T00:16:25.295 INFO:tasks.workunit.client.0.smithi133.stdout: lock_type: exclusive 2024-09-12T00:16:25.295 INFO:tasks.workunit.client.0.smithi133.stdout: tag: 2024-09-12T00:16:25.295 INFO:tasks.workunit.client.0.smithi133.stdout: lockers: 2024-09-12T00:16:25.297 INFO:tasks.workunit.client.0.smithi133.stdout:lock: mylock 2024-09-12T00:16:25.297 INFO:tasks.workunit.client.0.smithi133.stdout: lock_type: shared 2024-09-12T00:16:25.297 INFO:tasks.workunit.client.0.smithi133.stdout: tag: 2024-09-12T00:16:25.297 INFO:tasks.workunit.client.0.smithi133.stdout: lockers: 2024-09-12T00:16:25.297 INFO:tasks.workunit.client.0.smithi133.stdout: client.5289 expiration=0.000000 addr=v1:172.21.15.133:0/2743024117 cookie= 2024-09-12T00:16:25.297 INFO:tasks.workunit.client.0.smithi133.stdout: client.5289 expiration=0.000000 addr=v1:172.21.15.133:0/2743024117 cookie=new cookie 2024-09-12T00:16:26.281 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ClsLock.TestCookie (3022 ms) 2024-09-12T00:16:26.281 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T00:16:29.292 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ClsLock.TestMultipleLocks (3011 ms) 2024-09-12T00:16:29.292 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T00:16:37.313 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ClsLock.TestLockDuration (8019 ms) 2024-09-12T00:16:37.313 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T00:16:40.344 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ClsLock.TestAssertLocked (3033 ms) 2024-09-12T00:16:40.345 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T00:16:43.354 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ClsLock.TestSetCookie (3010 ms) 2024-09-12T00:16:43.354 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T00:17:04.414 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ClsLock.TestRenew (21059 ms) 2024-09-12T00:17:04.414 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T00:17:10.501 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6087 ms) 2024-09-12T00:17:10.501 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T00:17:17.578 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7078 ms) 2024-09-12T00:17:17.579 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T00:17:25.608 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8030 ms) 2024-09-12T00:17:25.608 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 11 tests from ClsLock (67816 ms total) 2024-09-12T00:17:25.608 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:17:25.609 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:17:25.609 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 11 tests from 1 test suite ran. (67816 ms total) 2024-09-12T00:17:25.609 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 11 tests. 2024-09-12T00:17:25.613 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:17:25.613 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:17:25.697 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T00:17:25.698 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T00:17:25.699 DEBUG:teuthology.orchestra.run.smithi133:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T00:17:25.784 INFO:tasks.workunit.client.0.smithi133.stdout:Running main() from gmock_main.cc 2024-09-12T00:17:25.784 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:17:25.784 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:17:25.785 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 4 tests from cls_log 2024-09-12T00:17:25.785 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T00:17:28.634 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_log.test_log_add_same_time (2849 ms) 2024-09-12T00:17:28.634 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T00:17:31.664 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_log.test_log_add_different_time (3028 ms) 2024-09-12T00:17:31.664 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T00:17:34.710 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_log.trim_by_time (3049 ms) 2024-09-12T00:17:34.711 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T00:17:37.711 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_log.trim_by_marker (3001 ms) 2024-09-12T00:17:37.711 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 4 tests from cls_log (11927 ms total) 2024-09-12T00:17:37.711 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:17:37.711 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:17:37.711 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 4 tests from 1 test suite ran. (11927 ms total) 2024-09-12T00:17:37.711 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 4 tests. 2024-09-12T00:17:37.713 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:17:37.713 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:17:37.756 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T00:17:37.758 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T00:17:37.758 DEBUG:teuthology.orchestra.run.smithi133:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T00:17:37.843 INFO:tasks.workunit.client.0.smithi133.stdout:Running main() from gmock_main.cc 2024-09-12T00:17:37.843 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:17:37.843 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:17:37.843 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 10 tests from cls_refcount 2024-09-12T00:17:37.843 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T00:17:40.743 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_refcount.test_implicit (2900 ms) 2024-09-12T00:17:40.743 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T00:17:43.751 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3007 ms) 2024-09-12T00:17:43.751 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T00:17:52.804 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_refcount.test_put_snap (9053 ms) 2024-09-12T00:17:52.804 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T00:17:55.835 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_refcount.test_explicit (3029 ms) 2024-09-12T00:17:55.835 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_refcount.set 2024-09-12T00:17:58.855 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_refcount.set (3023 ms) 2024-09-12T00:17:58.855 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T00:18:05.884 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_refcount.test_implicit_ec (7029 ms) 2024-09-12T00:18:05.884 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T00:18:12.932 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7048 ms) 2024-09-12T00:18:12.932 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T00:18:25.023 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_refcount.test_put_snap_ec (12091 ms) 2024-09-12T00:18:25.023 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T00:18:32.039 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_refcount.test_explicit_ec (7016 ms) 2024-09-12T00:18:32.039 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T00:18:39.060 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_refcount.set_ec (7021 ms) 2024-09-12T00:18:39.060 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 10 tests from cls_refcount (61217 ms total) 2024-09-12T00:18:39.061 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:18:39.061 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:18:39.061 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 10 tests from 1 test suite ran. (61217 ms total) 2024-09-12T00:18:39.061 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 10 tests. 2024-09-12T00:18:39.063 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:18:39.063 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:18:39.106 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T00:18:39.107 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T00:18:39.107 DEBUG:teuthology.orchestra.run.smithi133:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T00:18:39.191 INFO:tasks.workunit.client.0.smithi133.stdout:Running main() from gmock_main.cc 2024-09-12T00:18:39.191 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:18:39.191 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:18:39.191 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 19 tests from cls_rgw 2024-09-12T00:18:41.086 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T00:18:41.136 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.index_basic (51 ms) 2024-09-12T00:18:41.136 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T00:18:41.169 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (34 ms) 2024-09-12T00:18:41.170 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T00:18:41.210 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.index_remove_object (40 ms) 2024-09-12T00:18:41.210 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T00:18:42.676 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.index_suggest (1466 ms) 2024-09-12T00:18:42.676 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T00:18:42.684 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.index_suggest_complete (8 ms) 2024-09-12T00:18:42.684 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T00:18:42.706 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.index_list (22 ms) 2024-09-12T00:18:42.706 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T00:19:05.977 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.index_list_delimited (23270 ms) 2024-09-12T00:19:05.978 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T00:19:06.066 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.bi_list (90 ms) 2024-09-12T00:19:06.066 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T00:19:06.079 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.gc_set (13 ms) 2024-09-12T00:19:06.079 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T00:19:06.091 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.gc_list (12 ms) 2024-09-12T00:19:06.091 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T00:19:13.158 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.gc_defer (7067 ms) 2024-09-12T00:19:13.159 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T00:19:13.250 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.usage_basic (92 ms) 2024-09-12T00:19:13.250 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T00:19:13.255 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.usage_clear_no_obj (6 ms) 2024-09-12T00:19:13.255 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T00:19:13.348 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.usage_clear (92 ms) 2024-09-12T00:19:13.348 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T00:19:13.404 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.bi_log_trim (56 ms) 2024-09-12T00:19:13.404 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T00:19:13.418 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.index_racing_removes (14 ms) 2024-09-12T00:19:13.418 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T00:19:13.435 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.reshardlog_list (17 ms) 2024-09-12T00:19:13.435 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T00:19:13.445 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.reshardlog_num (10 ms) 2024-09-12T00:19:13.445 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-12T00:19:13.472 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw.bi_put_entries (27 ms) 2024-09-12T00:19:14.177 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 19 tests from cls_rgw (32387 ms total) 2024-09-12T00:19:14.177 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:19:14.177 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:19:14.177 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 19 tests from 1 test suite ran. (34986 ms total) 2024-09-12T00:19:14.177 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 19 tests. 2024-09-12T00:19:14.180 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:19:14.180 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:19:14.223 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T00:19:14.225 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T00:19:14.225 DEBUG:teuthology.orchestra.run.smithi133:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T00:19:14.311 INFO:tasks.workunit.client.0.smithi133.stdout:Running main() from gmock_main.cc 2024-09-12T00:19:14.312 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:19:14.312 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:19:14.312 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T00:19:14.312 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T00:19:16.175 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw_gc.init (1863 ms) 2024-09-12T00:19:16.175 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T00:19:16.199 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (24 ms) 2024-09-12T00:19:16.199 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T00:19:16.199 INFO:tasks.workunit.client.0.smithi133.stderr:[ ] list info tag = chain-0 2024-09-12T00:19:16.206 INFO:tasks.workunit.client.0.smithi133.stderr:[ ] next_marker is: = 0/4263 2024-09-12T00:19:16.206 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (8 ms) 2024-09-12T00:19:16.206 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T00:19:16.214 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (8 ms) 2024-09-12T00:19:16.215 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T00:19:16.222 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (8 ms) 2024-09-12T00:19:16.222 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T00:19:16.230 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (7 ms) 2024-09-12T00:19:16.230 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T00:19:16.237 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (8 ms) 2024-09-12T00:19:16.237 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T00:19:16.244 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (6 ms) 2024-09-12T00:19:16.244 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T00:19:17.190 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw_gc.finalize (946 ms) 2024-09-12T00:19:17.190 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 9 tests from cls_rgw_gc (2878 ms total) 2024-09-12T00:19:17.190 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:19:17.190 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:19:17.190 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 9 tests from 1 test suite ran. (2878 ms total) 2024-09-12T00:19:17.190 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 9 tests. 2024-09-12T00:19:17.193 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:19:17.193 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:19:17.236 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T00:19:17.237 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T00:19:17.237 DEBUG:teuthology.orchestra.run.smithi133:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T00:19:17.330 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:17.331 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:17.331 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T00:19:17.331 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:19:19.206 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T00:19:19.206 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T00:19:19.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.219+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~1WAAJWS33OV7.0 size=1048576 2024-09-12T00:19:19.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.221+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~1WAAJWS33OV7.1 size=477602 2024-09-12T00:19:19.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.221+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=1WAAJWS33OV7 tag=OSBGBWKZHQNE type=write size=2574754 2024-09-12T00:19:19.220 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.222+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=PP3F9NB3SI94 type=del size=3908282 2024-09-12T00:19:19.222 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.224+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=07YOGWMFVUFW type=write size=578614 2024-09-12T00:19:19.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.226+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~ZLE07UOTOX8L.0 size=172020 2024-09-12T00:19:19.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.226+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=ZLE07UOTOX8L tag=3SDOLGVFFWL8 type=write size=1220596 2024-09-12T00:19:19.227 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.228+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=C243ESB5POE0 type=del size=2397310 2024-09-12T00:19:19.228 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.230+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=R3YYCAZKKGY2 type=del size=3633271 2024-09-12T00:19:19.230 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.232+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=LLHZ1W2AQ82K type=del size=3302654 2024-09-12T00:19:19.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.235+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~LSDQF1OZIICE.0 size=599758 2024-09-12T00:19:19.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.235+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=LSDQF1OZIICE tag=I26AB09XPQVD type=write size=1648334 2024-09-12T00:19:19.236 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.238+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~VWC2QCPE36HR.0 size=1048576 2024-09-12T00:19:19.237 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.239+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~VWC2QCPE36HR.1 size=566578 2024-09-12T00:19:19.237 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.239+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=VWC2QCPE36HR tag=QA8SQXX7509K type=write size=2663730 2024-09-12T00:19:19.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.240+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=BD9W0XXB0A9O type=del size=1413004 2024-09-12T00:19:19.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.242+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=DCEUFUPSE85F type=del size=2991639 2024-09-12T00:19:19.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.245+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~86E0SX019H91.0 size=1048576 2024-09-12T00:19:19.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.246+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~86E0SX019H91.1 size=474527 2024-09-12T00:19:19.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.246+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=86E0SX019H91 tag=QXHRGGC3PQQB type=write size=2571679 2024-09-12T00:19:19.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.247+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=M6FQMMCWJZM7 type=del size=2111665 2024-09-12T00:19:19.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.250+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~YJNUOJN04QXU.0 size=1048576 2024-09-12T00:19:19.250 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.251+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~YJNUOJN04QXU.1 size=1048576 2024-09-12T00:19:19.251 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.252+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~YJNUOJN04QXU.2 size=695030 2024-09-12T00:19:19.251 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.252+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=YJNUOJN04QXU tag=K645OP8C6VM9 type=write size=3840758 2024-09-12T00:19:19.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.255+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~FTTUZ7WNFCEF.0 size=1048576 2024-09-12T00:19:19.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.256+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~FTTUZ7WNFCEF.1 size=1039840 2024-09-12T00:19:19.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.256+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=FTTUZ7WNFCEF tag=XJ33YCRMTQEZ type=write size=3136992 2024-09-12T00:19:19.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.259+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~6N3MESFER2LA.0 size=1048576 2024-09-12T00:19:19.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.260+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~6N3MESFER2LA.1 size=1048576 2024-09-12T00:19:19.260 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.261+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~6N3MESFER2LA.2 size=664793 2024-09-12T00:19:19.260 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.261+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=6N3MESFER2LA tag=ZZI1D5JSF3ED type=write size=3810521 2024-09-12T00:19:19.262 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.263+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~1WAAJWS33OV7.0 size=1048576 2024-09-12T00:19:19.263 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.265+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~1WAAJWS33OV7.1 size=477602 2024-09-12T00:19:19.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.267+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=1WAAJWS33OV7 tag=OSBGBWKZHQNE type=write size=2574754 2024-09-12T00:19:19.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.270+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~4GIXR1VXZD72.0 size=1048576 2024-09-12T00:19:19.271 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.272+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~4GIXR1VXZD72.1 size=1048576 2024-09-12T00:19:19.272 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.273+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~4GIXR1VXZD72.2 size=739614 2024-09-12T00:19:19.272 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.273+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=4GIXR1VXZD72 tag=5IYCV6FXLK2I type=write size=3885342 2024-09-12T00:19:19.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.276+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=PP3F9NB3SI94 type=del 2024-09-12T00:19:19.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.277+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=H9J15J11M8UH type=del size=977185 2024-09-12T00:19:19.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.278+0000 7f682945b780 1 < canceled operation key=JAVE3HR52R5C tag=07YOGWMFVUFW type=write size=578614 2024-09-12T00:19:19.279 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.280+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=2AXE7S2Q3BT0 type=del size=2049592 2024-09-12T00:19:19.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.283+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~ZLE07UOTOX8L.0 size=172020 2024-09-12T00:19:19.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.285+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=ZLE07UOTOX8L tag=3SDOLGVFFWL8 type=write size=1220596 2024-09-12T00:19:19.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.286+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=PORL08TV5Q4M type=del size=2941725 2024-09-12T00:19:19.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.287+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=C243ESB5POE0 type=del 2024-09-12T00:19:19.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.289+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=OYFNBAHL0IGX type=del size=2015419 2024-09-12T00:19:19.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.293+0000 7f682945b780 1 < suggested remove operation key=TYNSP8BHYO65 tag=R3YYCAZKKGY2 type=del 2024-09-12T00:19:19.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.295+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~ODD0ZG1Z2Q2V.0 size=1048576 2024-09-12T00:19:19.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.296+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~ODD0ZG1Z2Q2V.1 size=325183 2024-09-12T00:19:19.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.296+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=ODD0ZG1Z2Q2V tag=SGMOF255ZJ71 type=write size=2422335 2024-09-12T00:19:19.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.297+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=LLHZ1W2AQ82K type=del 2024-09-12T00:19:19.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.301+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~PR58GBAJX5AF.0 size=984274 2024-09-12T00:19:19.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.301+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=PR58GBAJX5AF tag=7LICP01J3ULE type=write size=2032850 2024-09-12T00:19:19.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.302+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~LSDQF1OZIICE.0 size=599758 2024-09-12T00:19:19.303 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.305+0000 7f682945b780 1 < completed multipart upload key=D06ZUP2ZXX42 upload=LSDQF1OZIICE tag=I26AB09XPQVD type=write size=1648334 2024-09-12T00:19:19.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.306+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=4PWC924U764Q type=del size=2343379 2024-09-12T00:19:19.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.308+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~VWC2QCPE36HR.0 size=1048576 2024-09-12T00:19:19.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.309+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~VWC2QCPE36HR.1 size=566578 2024-09-12T00:19:19.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.311+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=VWC2QCPE36HR tag=QA8SQXX7509K type=write size=2663730 2024-09-12T00:19:19.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.315+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~3OYL4GFF7B1J.0 size=1048576 2024-09-12T00:19:19.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.316+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~3OYL4GFF7B1J.1 size=362293 2024-09-12T00:19:19.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.316+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=3OYL4GFF7B1J tag=BO0F5ESKKIDQ type=write size=2459445 2024-09-12T00:19:19.316 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.317+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=BD9W0XXB0A9O type=del 2024-09-12T00:19:19.317 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.318+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=30HOEZN997VG type=del size=2636646 2024-09-12T00:19:19.318 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.320+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=DCEUFUPSE85F type=del 2024-09-12T00:19:19.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.321+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=PA54V868Z2P9 type=del size=2070851 2024-09-12T00:19:19.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.322+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~86E0SX019H91.0 size=1048576 2024-09-12T00:19:19.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.323+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~86E0SX019H91.1 size=474527 2024-09-12T00:19:19.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.326+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=86E0SX019H91 tag=QXHRGGC3PQQB type=write size=2571679 2024-09-12T00:19:19.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.329+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~09JXW6NQ1K9L.0 size=1048576 2024-09-12T00:19:19.329 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.330+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~09JXW6NQ1K9L.1 size=1048576 2024-09-12T00:19:19.330 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.331+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~09JXW6NQ1K9L.2 size=723897 2024-09-12T00:19:19.330 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.331+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=09JXW6NQ1K9L tag=LAVBK3VSK3U0 type=write size=3869625 2024-09-12T00:19:19.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.333+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=M6FQMMCWJZM7 type=del 2024-09-12T00:19:19.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.334+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=1PUKO1WIE3T5 type=del size=376566 2024-09-12T00:19:19.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.335+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~YJNUOJN04QXU.0 size=1048576 2024-09-12T00:19:19.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.337+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~YJNUOJN04QXU.1 size=1048576 2024-09-12T00:19:19.336 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.338+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~YJNUOJN04QXU.2 size=695030 2024-09-12T00:19:19.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.340+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=YJNUOJN04QXU tag=K645OP8C6VM9 type=write size=3840758 2024-09-12T00:19:19.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.341+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=6DSDNF3P14MH type=del size=75815 2024-09-12T00:19:19.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.343+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~FTTUZ7WNFCEF.0 size=1048576 2024-09-12T00:19:19.343 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.345+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~FTTUZ7WNFCEF.1 size=1039840 2024-09-12T00:19:19.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.347+0000 7f682945b780 1 < completed multipart upload key=D06ZUP2ZXX42 upload=FTTUZ7WNFCEF tag=XJ33YCRMTQEZ type=write size=3136992 2024-09-12T00:19:19.348 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.350+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~2XNYQ5FK7TUS.0 size=1048576 2024-09-12T00:19:19.349 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.350+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~2XNYQ5FK7TUS.1 size=349753 2024-09-12T00:19:19.349 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.350+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=2XNYQ5FK7TUS tag=OFD8CT0IVXGX type=write size=2446905 2024-09-12T00:19:19.350 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.352+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~6N3MESFER2LA.0 size=1048576 2024-09-12T00:19:19.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.353+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~6N3MESFER2LA.1 size=1048576 2024-09-12T00:19:19.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.354+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~6N3MESFER2LA.2 size=664793 2024-09-12T00:19:19.355 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.357+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=6N3MESFER2LA tag=ZZI1D5JSF3ED type=write size=3810521 2024-09-12T00:19:19.358 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.359+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~UJRDOM8R0L0J.0 size=1048576 2024-09-12T00:19:19.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.360+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~UJRDOM8R0L0J.1 size=1048576 2024-09-12T00:19:19.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.362+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~UJRDOM8R0L0J.2 size=198992 2024-09-12T00:19:19.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.362+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=UJRDOM8R0L0J tag=78BBVSJAR7AW type=write size=3344720 2024-09-12T00:19:19.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.364+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~4GIXR1VXZD72.0 size=1048576 2024-09-12T00:19:19.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.365+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~4GIXR1VXZD72.1 size=1048576 2024-09-12T00:19:19.364 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.366+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~4GIXR1VXZD72.2 size=739614 2024-09-12T00:19:19.368 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.369+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=4GIXR1VXZD72 tag=5IYCV6FXLK2I type=write size=3885342 2024-09-12T00:19:19.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.372+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=323NQVE4ZE7G type=del size=2995477 2024-09-12T00:19:19.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.375+0000 7f682945b780 -1 < failed to complete operation key=TYNSP8BHYO65 tag=H9J15J11M8UH type=del size=977185: (22) Invalid argument 2024-09-12T00:19:19.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.378+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~W5XDY57MG18A.0 size=1048576 2024-09-12T00:19:19.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.379+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~W5XDY57MG18A.1 size=809304 2024-09-12T00:19:19.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.379+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=W5XDY57MG18A tag=2H0JMHJ64V25 type=write size=2906456 2024-09-12T00:19:19.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.380+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=2AXE7S2Q3BT0 type=del 2024-09-12T00:19:19.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.383+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~K115G512A7N4.0 size=1048576 2024-09-12T00:19:19.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.384+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~K115G512A7N4.1 size=35191 2024-09-12T00:19:19.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.384+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=K115G512A7N4 tag=XZ8IK9BYA78D type=write size=2132343 2024-09-12T00:19:19.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.385+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=PORL08TV5Q4M type=del 2024-09-12T00:19:19.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.388+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~43NWDAYXBEGZ.0 size=580550 2024-09-12T00:19:19.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.388+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=43NWDAYXBEGZ tag=K2NOB5WUJW0I type=write size=1629126 2024-09-12T00:19:19.388 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.389+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=OYFNBAHL0IGX type=del 2024-09-12T00:19:19.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.392+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~TCWDPI3V06YQ.0 size=1048576 2024-09-12T00:19:19.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.393+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~TCWDPI3V06YQ.1 size=1048576 2024-09-12T00:19:19.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.394+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~TCWDPI3V06YQ.2 size=141055 2024-09-12T00:19:19.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.394+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=TCWDPI3V06YQ tag=QJ31PVNURTAC type=write size=3286783 2024-09-12T00:19:19.394 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.395+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~ODD0ZG1Z2Q2V.0 size=1048576 2024-09-12T00:19:19.395 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.396+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~ODD0ZG1Z2Q2V.1 size=325183 2024-09-12T00:19:19.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.399+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=ODD0ZG1Z2Q2V tag=SGMOF255ZJ71 type=write size=2422335 2024-09-12T00:19:19.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.400+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=MFCJ5IFBPR26 type=del size=1973568 2024-09-12T00:19:19.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.402+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~PR58GBAJX5AF.0 size=984274 2024-09-12T00:19:19.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.404+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=PR58GBAJX5AF tag=7LICP01J3ULE type=write size=2032850 2024-09-12T00:19:19.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.406+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~816OQEC9IASS.0 size=1048576 2024-09-12T00:19:19.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.407+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~816OQEC9IASS.1 size=799303 2024-09-12T00:19:19.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.407+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=816OQEC9IASS tag=C367P61JVBLH type=write size=2896455 2024-09-12T00:19:19.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.408+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=4PWC924U764Q type=del 2024-09-12T00:19:19.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.410+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=4DXSEUXJP0EN type=write size=316148 2024-09-12T00:19:19.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.411+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~3OYL4GFF7B1J.0 size=1048576 2024-09-12T00:19:19.411 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.412+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~3OYL4GFF7B1J.1 size=362293 2024-09-12T00:19:19.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.414+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=3OYL4GFF7B1J tag=BO0F5ESKKIDQ type=write size=2459445 2024-09-12T00:19:19.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.417+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~QNYF2EMPIDI1.0 size=1048576 2024-09-12T00:19:19.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.418+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~QNYF2EMPIDI1.1 size=959414 2024-09-12T00:19:19.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.418+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=QNYF2EMPIDI1 tag=7UEKCMWCN4EP type=write size=3056566 2024-09-12T00:19:19.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.419+0000 7f682945b780 1 < canceled operation key=BI3KCKV4CRWR tag=30HOEZN997VG type=del size=2636646 2024-09-12T00:19:19.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.422+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~OSKCX304MJ40.0 size=124285 2024-09-12T00:19:19.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.422+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=OSKCX304MJ40 tag=QSWK46MR5J04 type=write size=1172861 2024-09-12T00:19:19.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.423+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=PA54V868Z2P9 type=del 2024-09-12T00:19:19.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.425+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=AHFWLTYSPKQ0 type=del size=3034013 2024-09-12T00:19:19.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.427+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~09JXW6NQ1K9L.0 size=1048576 2024-09-12T00:19:19.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.427+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~09JXW6NQ1K9L.1 size=1048576 2024-09-12T00:19:19.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.429+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~09JXW6NQ1K9L.2 size=723897 2024-09-12T00:19:19.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.431+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=09JXW6NQ1K9L tag=LAVBK3VSK3U0 type=write size=3869625 2024-09-12T00:19:19.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.433+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~9ALMM1ZFFNZ5.0 size=1048576 2024-09-12T00:19:19.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.435+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~9ALMM1ZFFNZ5.1 size=1048576 2024-09-12T00:19:19.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.436+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~9ALMM1ZFFNZ5.2 size=233944 2024-09-12T00:19:19.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.436+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=9ALMM1ZFFNZ5 tag=VGHG74S5V4QJ type=write size=3379672 2024-09-12T00:19:19.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.439+0000 7f682945b780 1 < suggested remove operation key=BK212Z99RM7F tag=1PUKO1WIE3T5 type=del 2024-09-12T00:19:19.440 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.441+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~AD31HK3A9EC6.0 size=1048576 2024-09-12T00:19:19.441 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.442+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~AD31HK3A9EC6.1 size=1048576 2024-09-12T00:19:19.442 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.444+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~AD31HK3A9EC6.2 size=972116 2024-09-12T00:19:19.442 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.444+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=AD31HK3A9EC6 tag=A73DH9QQDZUU type=write size=4117844 2024-09-12T00:19:19.444 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.445+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=6DSDNF3P14MH type=del 2024-09-12T00:19:19.445 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.446+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=6EG2NTUNKXOD type=del size=3579638 2024-09-12T00:19:19.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.448+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~2XNYQ5FK7TUS.0 size=1048576 2024-09-12T00:19:19.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.449+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~2XNYQ5FK7TUS.1 size=349753 2024-09-12T00:19:19.450 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.451+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=2XNYQ5FK7TUS tag=OFD8CT0IVXGX type=write size=2446905 2024-09-12T00:19:19.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.453+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=6FYNXB1PY9PZ type=write size=324491 2024-09-12T00:19:19.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.454+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~UJRDOM8R0L0J.0 size=1048576 2024-09-12T00:19:19.454 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.456+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~UJRDOM8R0L0J.1 size=1048576 2024-09-12T00:19:19.455 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.457+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~UJRDOM8R0L0J.2 size=198992 2024-09-12T00:19:19.458 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.459+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=UJRDOM8R0L0J tag=78BBVSJAR7AW type=write size=3344720 2024-09-12T00:19:19.459 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.461+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=F5YJ13QQL3FO type=write size=724598 2024-09-12T00:19:19.460 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.462+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=323NQVE4ZE7G type=del 2024-09-12T00:19:19.463 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.464+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~M818SZXWOE9K.0 size=1048576 2024-09-12T00:19:19.464 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.465+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~M818SZXWOE9K.1 size=1048576 2024-09-12T00:19:19.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.466+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~M818SZXWOE9K.2 size=327302 2024-09-12T00:19:19.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.466+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=M818SZXWOE9K tag=0KYA95E7P9QU type=write size=3473030 2024-09-12T00:19:19.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.468+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~W5XDY57MG18A.0 size=1048576 2024-09-12T00:19:19.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.469+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~W5XDY57MG18A.1 size=809304 2024-09-12T00:19:19.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.471+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=W5XDY57MG18A tag=2H0JMHJ64V25 type=write size=2906456 2024-09-12T00:19:19.471 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.472+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=E1IUL8ZAH1EC type=del size=191846 2024-09-12T00:19:19.472 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.474+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~K115G512A7N4.0 size=1048576 2024-09-12T00:19:19.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.475+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~K115G512A7N4.1 size=35191 2024-09-12T00:19:19.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.477+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=K115G512A7N4 tag=XZ8IK9BYA78D type=write size=2132343 2024-09-12T00:19:19.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.478+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=2GI5G9A8I624 type=del size=3775175 2024-09-12T00:19:19.478 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.479+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~43NWDAYXBEGZ.0 size=580550 2024-09-12T00:19:19.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.482+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=43NWDAYXBEGZ tag=K2NOB5WUJW0I type=write size=1629126 2024-09-12T00:19:19.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.484+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~C0I16YT79RX9.0 size=1048576 2024-09-12T00:19:19.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.485+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~C0I16YT79RX9.1 size=1048576 2024-09-12T00:19:19.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.486+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~C0I16YT79RX9.2 size=430927 2024-09-12T00:19:19.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.486+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=C0I16YT79RX9 tag=36UDMLU0D6F0 type=write size=3576655 2024-09-12T00:19:19.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.487+0000 7f682945b780 1 < canceled part key=_multipart_EYHGJ82COSE9.2~TCWDPI3V06YQ.0 size=1048576 2024-09-12T00:19:19.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.488+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~TCWDPI3V06YQ.1 size=1048576 2024-09-12T00:19:19.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.489+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~TCWDPI3V06YQ.2 size=141055 2024-09-12T00:19:19.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.491+0000 7f682945b780 1 < canceled multipart upload key=EYHGJ82COSE9 upload=TCWDPI3V06YQ tag=QJ31PVNURTAC type=write size=3286783 2024-09-12T00:19:19.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.492+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=3H446C4E5QLY type=del size=354969 2024-09-12T00:19:19.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.494+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=MFCJ5IFBPR26 type=del 2024-09-12T00:19:19.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.495+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=GZV2DA4EUWSK type=del size=211686 2024-09-12T00:19:19.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.498+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~816OQEC9IASS.0 size=1048576 2024-09-12T00:19:19.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.499+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~816OQEC9IASS.1 size=799303 2024-09-12T00:19:19.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.502+0000 7f682945b780 1 < completed multipart upload key=CT2L8L3849IN upload=816OQEC9IASS tag=C367P61JVBLH type=write size=2896455 2024-09-12T00:19:19.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.502+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=0I2E1UP210YL type=del size=2487299 2024-09-12T00:19:19.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.504+0000 7f682945b780 1 < completed write operation key=BI3KCKV4CRWR tag=4DXSEUXJP0EN type=write size=316148 2024-09-12T00:19:19.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.505+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=TRPL8IPWQL5P type=del size=40717 2024-09-12T00:19:19.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.506+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~QNYF2EMPIDI1.0 size=1048576 2024-09-12T00:19:19.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.506+0000 7f682945b780 1 < canceled part key=_multipart_G0ONSUVW4M7R.2~QNYF2EMPIDI1.1 size=959414 2024-09-12T00:19:19.507 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.509+0000 7f682945b780 1 < canceled multipart upload key=G0ONSUVW4M7R upload=QNYF2EMPIDI1 tag=7UEKCMWCN4EP type=write size=3056566 2024-09-12T00:19:19.508 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.510+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=LWEBPZ7FNL8K type=del size=3390310 2024-09-12T00:19:19.510 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.511+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~OSKCX304MJ40.0 size=124285 2024-09-12T00:19:19.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.513+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=OSKCX304MJ40 tag=QSWK46MR5J04 type=write size=1172861 2024-09-12T00:19:19.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.515+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=EKY3J7RW8SJH type=del size=3569434 2024-09-12T00:19:19.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.517+0000 7f682945b780 1 < suggested update operation key=CT2L8L3849IN tag=AHFWLTYSPKQ0 type=del size=3034013 2024-09-12T00:19:19.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.519+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=2SZ67TRRV4E5 type=del size=3424531 2024-09-12T00:19:19.519 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.520+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~9ALMM1ZFFNZ5.0 size=1048576 2024-09-12T00:19:19.520 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.521+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~9ALMM1ZFFNZ5.1 size=1048576 2024-09-12T00:19:19.521 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.522+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~9ALMM1ZFFNZ5.2 size=233944 2024-09-12T00:19:19.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.524+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=9ALMM1ZFFNZ5 tag=VGHG74S5V4QJ type=write size=3379672 2024-09-12T00:19:19.526 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.527+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~I4FQGRTN5AZ7.0 size=1048576 2024-09-12T00:19:19.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.528+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~I4FQGRTN5AZ7.1 size=111596 2024-09-12T00:19:19.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.528+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=I4FQGRTN5AZ7 tag=6Q3FULTFW3X5 type=write size=2208748 2024-09-12T00:19:19.528 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.530+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~AD31HK3A9EC6.0 size=1048576 2024-09-12T00:19:19.529 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.532+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~AD31HK3A9EC6.1 size=1048576 2024-09-12T00:19:19.531 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.533+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~AD31HK3A9EC6.2 size=972116 2024-09-12T00:19:19.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.535+0000 7f682945b780 1 < completed multipart upload key=8D9UC8FJ16UK upload=AD31HK3A9EC6 tag=A73DH9QQDZUU type=write size=4117844 2024-09-12T00:19:19.534 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.536+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=M2QA8EOL3VFN type=del size=2350610 2024-09-12T00:19:19.536 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.537+0000 7f682945b780 -1 < failed to complete operation key=CT2L8L3849IN tag=6EG2NTUNKXOD type=del size=3579638: (22) Invalid argument 2024-09-12T00:19:19.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.539+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=0AM3PYJ1EM5F type=del size=3002328 2024-09-12T00:19:19.540 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.542+0000 7f682945b780 1 < suggested update operation key=Y65K9I6K41X5 tag=6FYNXB1PY9PZ type=write size=324491 2024-09-12T00:19:19.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.543+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=SYU1IEEW9UR7 type=del size=1762713 2024-09-12T00:19:19.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.546+0000 7f682945b780 -1 < failed to complete operation key=Y65K9I6K41X5 tag=F5YJ13QQL3FO type=write size=724598: (22) Invalid argument 2024-09-12T00:19:19.546 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.548+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~N7XUJPX7OUK1.0 size=55838 2024-09-12T00:19:19.546 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.548+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=N7XUJPX7OUK1 tag=YQVQCF1FYKZE type=write size=1104414 2024-09-12T00:19:19.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.549+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~M818SZXWOE9K.0 size=1048576 2024-09-12T00:19:19.549 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.550+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~M818SZXWOE9K.1 size=1048576 2024-09-12T00:19:19.551 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.552+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~M818SZXWOE9K.2 size=327302 2024-09-12T00:19:19.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.555+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=M818SZXWOE9K tag=0KYA95E7P9QU type=write size=3473030 2024-09-12T00:19:19.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.557+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~3GUZ7LITOWUH.0 size=1048576 2024-09-12T00:19:19.557 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.559+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~3GUZ7LITOWUH.1 size=279954 2024-09-12T00:19:19.557 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.559+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=3GUZ7LITOWUH tag=5P98Y7UTL8BN type=write size=2377106 2024-09-12T00:19:19.559 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.560+0000 7f682945b780 -1 < failed to complete operation key=Y65K9I6K41X5 tag=E1IUL8ZAH1EC type=del size=191846: (22) Invalid argument 2024-09-12T00:19:19.561 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.563+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~TLB383A3J2AG.0 size=1048576 2024-09-12T00:19:19.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.564+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~TLB383A3J2AG.1 size=1048576 2024-09-12T00:19:19.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.565+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~TLB383A3J2AG.2 size=244756 2024-09-12T00:19:19.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.565+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=TLB383A3J2AG tag=6MGX5T92UQRB type=write size=3390484 2024-09-12T00:19:19.566 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.567+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=2GI5G9A8I624 type=del 2024-09-12T00:19:19.567 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.569+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=NB49XSH8O2FS type=write size=927212 2024-09-12T00:19:19.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.570+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~C0I16YT79RX9.0 size=1048576 2024-09-12T00:19:19.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.571+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~C0I16YT79RX9.1 size=1048576 2024-09-12T00:19:19.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.572+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~C0I16YT79RX9.2 size=430927 2024-09-12T00:19:19.573 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.575+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=C0I16YT79RX9 tag=36UDMLU0D6F0 type=write size=3576655 2024-09-12T00:19:19.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.578+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~NQYPGGYHN0IZ.0 size=1048576 2024-09-12T00:19:19.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.579+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~NQYPGGYHN0IZ.1 size=1048576 2024-09-12T00:19:19.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.580+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~NQYPGGYHN0IZ.2 size=515252 2024-09-12T00:19:19.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.580+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=NQYPGGYHN0IZ tag=EPG36IXM0JA1 type=write size=3660980 2024-09-12T00:19:19.581 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.583+0000 7f682945b780 1 < suggested remove operation key=17S1X3WXCNAR tag=3H446C4E5QLY type=del 2024-09-12T00:19:19.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.584+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=TI2IOKGD552I type=del size=1242465 2024-09-12T00:19:19.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.585+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=GZV2DA4EUWSK type=del 2024-09-12T00:19:19.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.587+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=K1A6B80T5A7H type=del size=114462 2024-09-12T00:19:19.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.588+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=0I2E1UP210YL type=del 2024-09-12T00:19:19.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.590+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=HBYHORSE3W3J type=del size=1633675 2024-09-12T00:19:19.590 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.591+0000 7f682945b780 -1 < failed to complete operation key=17S1X3WXCNAR tag=TRPL8IPWQL5P type=del size=40717: (22) Invalid argument 2024-09-12T00:19:19.593 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.594+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~NFPDOIP5DKD3.0 size=1048576 2024-09-12T00:19:19.593 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.595+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~NFPDOIP5DKD3.1 size=331543 2024-09-12T00:19:19.593 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.595+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=NFPDOIP5DKD3 tag=0H04PUVANUF2 type=write size=2428695 2024-09-12T00:19:19.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.596+0000 7f682945b780 1 < canceled operation key=8D9UC8FJ16UK tag=LWEBPZ7FNL8K type=del size=3390310 2024-09-12T00:19:19.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.599+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~04SZ1Z14N2V2.0 size=1048576 2024-09-12T00:19:19.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.600+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~04SZ1Z14N2V2.1 size=1048576 2024-09-12T00:19:19.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.601+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~04SZ1Z14N2V2.2 size=671013 2024-09-12T00:19:19.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.601+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=04SZ1Z14N2V2 tag=60MNOE0NHBOC type=write size=3816741 2024-09-12T00:19:19.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.603+0000 7f682945b780 1 < suggested update operation key=COUJXCOSVPDS tag=EKY3J7RW8SJH type=del size=3569434 2024-09-12T00:19:19.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.605+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=32GJ5FS84TGW type=del size=1899754 2024-09-12T00:19:19.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.606+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=2SZ67TRRV4E5 type=del 2024-09-12T00:19:19.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.609+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~O7KNYJBTA7XO.0 size=1048576 2024-09-12T00:19:19.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.610+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~O7KNYJBTA7XO.1 size=1048576 2024-09-12T00:19:19.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.611+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~O7KNYJBTA7XO.2 size=717591 2024-09-12T00:19:19.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.611+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=O7KNYJBTA7XO tag=GXLIXEW5RGM5 type=write size=3863319 2024-09-12T00:19:19.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.612+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~I4FQGRTN5AZ7.0 size=1048576 2024-09-12T00:19:19.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.613+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~I4FQGRTN5AZ7.1 size=111596 2024-09-12T00:19:19.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.615+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=I4FQGRTN5AZ7 tag=6Q3FULTFW3X5 type=write size=2208748 2024-09-12T00:19:19.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.618+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~TESLHNIMWNFU.0 size=1048576 2024-09-12T00:19:19.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.619+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~TESLHNIMWNFU.1 size=1048576 2024-09-12T00:19:19.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.620+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~TESLHNIMWNFU.2 size=254053 2024-09-12T00:19:19.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.620+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=TESLHNIMWNFU tag=YR1SO3K0VX74 type=write size=3399781 2024-09-12T00:19:19.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.622+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=M2QA8EOL3VFN type=del 2024-09-12T00:19:19.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.624+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~LFEG29GYH8DE.0 size=524368 2024-09-12T00:19:19.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.624+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=LFEG29GYH8DE tag=RZWA5T9CSL9Z type=write size=1572944 2024-09-12T00:19:19.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.625+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=0AM3PYJ1EM5F type=del 2024-09-12T00:19:19.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.629+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~5OYTH0KDIUCL.0 size=1048576 2024-09-12T00:19:19.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.631+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~5OYTH0KDIUCL.1 size=1048576 2024-09-12T00:19:19.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.631+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~5OYTH0KDIUCL.2 size=814001 2024-09-12T00:19:19.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.631+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=5OYTH0KDIUCL tag=CDA9W670KIVX type=write size=3959729 2024-09-12T00:19:19.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.632+0000 7f682945b780 1 < canceled operation key=IUPAGGPATJB4 tag=SYU1IEEW9UR7 type=del size=1762713 2024-09-12T00:19:19.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.634+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=MQ2BEQK1WQ9K type=del size=1460728 2024-09-12T00:19:19.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.635+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~N7XUJPX7OUK1.0 size=55838 2024-09-12T00:19:19.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.638+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=N7XUJPX7OUK1 tag=YQVQCF1FYKZE type=write size=1104414 2024-09-12T00:19:19.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.639+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=ITQ1YUC2N2EF type=del size=2115437 2024-09-12T00:19:19.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.640+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~3GUZ7LITOWUH.0 size=1048576 2024-09-12T00:19:19.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.642+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~3GUZ7LITOWUH.1 size=279954 2024-09-12T00:19:19.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.644+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=3GUZ7LITOWUH tag=5P98Y7UTL8BN type=write size=2377106 2024-09-12T00:19:19.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.645+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=JSL5YPEUNZYW type=del size=336883 2024-09-12T00:19:19.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.647+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~TLB383A3J2AG.0 size=1048576 2024-09-12T00:19:19.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.648+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~TLB383A3J2AG.1 size=1048576 2024-09-12T00:19:19.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.649+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~TLB383A3J2AG.2 size=244756 2024-09-12T00:19:19.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.652+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=TLB383A3J2AG tag=6MGX5T92UQRB type=write size=3390484 2024-09-12T00:19:19.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.653+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=O8O3ZNJ7GZND type=del size=3998415 2024-09-12T00:19:19.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.654+0000 7f682945b780 -1 < failed to complete operation key=17S1X3WXCNAR tag=NB49XSH8O2FS type=write size=927212: (22) Invalid argument 2024-09-12T00:19:19.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.656+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~NOGOCOJFB3OR.0 size=367620 2024-09-12T00:19:19.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.656+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=NOGOCOJFB3OR tag=29OHSO196R50 type=write size=1416196 2024-09-12T00:19:19.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.657+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~NQYPGGYHN0IZ.0 size=1048576 2024-09-12T00:19:19.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.659+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~NQYPGGYHN0IZ.1 size=1048576 2024-09-12T00:19:19.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.660+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~NQYPGGYHN0IZ.2 size=515252 2024-09-12T00:19:19.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.662+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=NQYPGGYHN0IZ tag=EPG36IXM0JA1 type=write size=3660980 2024-09-12T00:19:19.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.663+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=WLFMJ2LKFMQ6 type=write size=430732 2024-09-12T00:19:19.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.665+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=TI2IOKGD552I type=del 2024-09-12T00:19:19.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.666+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=MPUVMXFXW09F type=del size=2039409 2024-09-12T00:19:19.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.668+0000 7f682945b780 1 < suggested update operation key=38JJBFDTIYSU tag=K1A6B80T5A7H type=del size=114462 2024-09-12T00:19:19.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.670+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=XJL3J4J5BI03 type=del size=317407 2024-09-12T00:19:19.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.671+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=HBYHORSE3W3J type=del 2024-09-12T00:19:19.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.673+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~XQU20MDUXRV4.0 size=1048576 2024-09-12T00:19:19.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.674+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~XQU20MDUXRV4.1 size=1048576 2024-09-12T00:19:19.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.676+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~XQU20MDUXRV4.2 size=721273 2024-09-12T00:19:19.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.676+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=XQU20MDUXRV4 tag=HP00HS90AAPK type=write size=3867001 2024-09-12T00:19:19.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.677+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~NFPDOIP5DKD3.0 size=1048576 2024-09-12T00:19:19.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.678+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~NFPDOIP5DKD3.1 size=331543 2024-09-12T00:19:19.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.680+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=NFPDOIP5DKD3 tag=0H04PUVANUF2 type=write size=2428695 2024-09-12T00:19:19.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.681+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=XN1V3KQIQBW1 type=del size=605587 2024-09-12T00:19:19.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.683+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~04SZ1Z14N2V2.0 size=1048576 2024-09-12T00:19:19.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.684+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~04SZ1Z14N2V2.1 size=1048576 2024-09-12T00:19:19.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.685+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~04SZ1Z14N2V2.2 size=671013 2024-09-12T00:19:19.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.690+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=04SZ1Z14N2V2 tag=60MNOE0NHBOC type=write size=3816741 2024-09-12T00:19:19.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.691+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=8PD1IV6S3QAK type=del size=2624320 2024-09-12T00:19:19.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.692+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=32GJ5FS84TGW type=del 2024-09-12T00:19:19.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.694+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=WNHA9GMBS3MR type=del size=1695650 2024-09-12T00:19:19.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.695+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~O7KNYJBTA7XO.0 size=1048576 2024-09-12T00:19:19.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.695+0000 7f682945b780 1 < canceled part key=_multipart_COUJXCOSVPDS.2~O7KNYJBTA7XO.1 size=1048576 2024-09-12T00:19:19.695 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.696+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~O7KNYJBTA7XO.2 size=717591 2024-09-12T00:19:19.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.699+0000 7f682945b780 1 < canceled multipart upload key=COUJXCOSVPDS upload=O7KNYJBTA7XO tag=GXLIXEW5RGM5 type=write size=3863319 2024-09-12T00:19:19.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.700+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=UH7RFKEYN0KE type=del size=2715957 2024-09-12T00:19:19.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.702+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~TESLHNIMWNFU.0 size=1048576 2024-09-12T00:19:19.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.703+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~TESLHNIMWNFU.1 size=1048576 2024-09-12T00:19:19.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.704+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~TESLHNIMWNFU.2 size=254053 2024-09-12T00:19:19.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.706+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=TESLHNIMWNFU tag=YR1SO3K0VX74 type=write size=3399781 2024-09-12T00:19:19.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.708+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~4UWXCWCUEXHH.0 size=1048576 2024-09-12T00:19:19.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.709+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~4UWXCWCUEXHH.1 size=1048576 2024-09-12T00:19:19.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.710+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~4UWXCWCUEXHH.2 size=281896 2024-09-12T00:19:19.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.710+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=4UWXCWCUEXHH tag=93C2LRNK5OL8 type=write size=3427624 2024-09-12T00:19:19.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.711+0000 7f682945b780 1 < canceled part key=_multipart_7RRJO383D8TH.2~LFEG29GYH8DE.0 size=524368 2024-09-12T00:19:19.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.713+0000 7f682945b780 1 < canceled multipart upload key=7RRJO383D8TH upload=LFEG29GYH8DE tag=RZWA5T9CSL9Z type=write size=1572944 2024-09-12T00:19:19.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.714+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=XRBN8G7Y0RUN type=write size=374641 2024-09-12T00:19:19.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.715+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~5OYTH0KDIUCL.0 size=1048576 2024-09-12T00:19:19.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.716+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~5OYTH0KDIUCL.1 size=1048576 2024-09-12T00:19:19.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.718+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~5OYTH0KDIUCL.2 size=814001 2024-09-12T00:19:19.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.720+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=5OYTH0KDIUCL tag=CDA9W670KIVX type=write size=3959729 2024-09-12T00:19:19.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.721+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=DKT0V3VT5TVB type=del size=3758331 2024-09-12T00:19:19.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.723+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=MQ2BEQK1WQ9K type=del 2024-09-12T00:19:19.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.724+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=EVYQF7GJUU7Z type=del size=1860534 2024-09-12T00:19:19.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.726+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=ITQ1YUC2N2EF type=del 2024-09-12T00:19:19.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.727+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=1FPU64DZ518F type=write size=1046392 2024-09-12T00:19:19.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.728+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=JSL5YPEUNZYW type=del 2024-09-12T00:19:19.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.729+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=JYRIGCET3WAI type=del size=1348784 2024-09-12T00:19:19.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.733+0000 7f682945b780 1 < suggested update operation key=IYYTX8TCLF30 tag=O8O3ZNJ7GZND type=del size=3998415 2024-09-12T00:19:19.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.733+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=YKOHJZP1M0V1 type=del size=247011 2024-09-12T00:19:19.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.735+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~NOGOCOJFB3OR.0 size=367620 2024-09-12T00:19:19.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.737+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=NOGOCOJFB3OR tag=29OHSO196R50 type=write size=1416196 2024-09-12T00:19:19.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.738+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=SRPAXV1RB1ZF type=del size=2517172 2024-09-12T00:19:19.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.740+0000 7f682945b780 1 < completed write operation key=Z7408WO050VI tag=WLFMJ2LKFMQ6 type=write size=430732 2024-09-12T00:19:19.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.744+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~3DCASV2MH2VD.0 size=730036 2024-09-12T00:19:19.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.744+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=3DCASV2MH2VD tag=3KBPMXLZ15N8 type=write size=1778612 2024-09-12T00:19:19.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.747+0000 7f682945b780 1 < suggested update operation key=Z7408WO050VI tag=MPUVMXFXW09F type=del size=2039409 2024-09-12T00:19:19.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.748+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=TYDTYBPF3S2S type=del size=997124 2024-09-12T00:19:19.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.750+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=XJL3J4J5BI03 type=del 2024-09-12T00:19:19.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.753+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~03DUBY9XNDH3.0 size=1048576 2024-09-12T00:19:19.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.754+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~03DUBY9XNDH3.1 size=1048576 2024-09-12T00:19:19.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.755+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~03DUBY9XNDH3.2 size=227166 2024-09-12T00:19:19.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.755+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=03DUBY9XNDH3 tag=QVDRPBP6RJBS type=write size=3372894 2024-09-12T00:19:19.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.758+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~XQU20MDUXRV4.0 size=1048576 2024-09-12T00:19:19.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.758+0000 7f682945b780 1 < canceled part key=_multipart_P56VIP3WIOJL.2~XQU20MDUXRV4.1 size=1048576 2024-09-12T00:19:19.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.758+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~XQU20MDUXRV4.2 size=721273 2024-09-12T00:19:19.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.763+0000 7f682945b780 1 < canceled multipart upload key=P56VIP3WIOJL upload=XQU20MDUXRV4 tag=HP00HS90AAPK type=write size=3867001 2024-09-12T00:19:19.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.765+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=5MH1NVFJ1IA2 type=write size=116219 2024-09-12T00:19:19.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.765+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=XN1V3KQIQBW1 type=del 2024-09-12T00:19:19.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.768+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~85UV0PK04KX2.0 size=1048576 2024-09-12T00:19:19.767 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.769+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~85UV0PK04KX2.1 size=441563 2024-09-12T00:19:19.767 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.769+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=85UV0PK04KX2 tag=ZJ7V3N0EDMCA type=write size=2538715 2024-09-12T00:19:19.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.770+0000 7f682945b780 1 < canceled operation key=COUJXCOSVPDS tag=8PD1IV6S3QAK type=del size=2624320 2024-09-12T00:19:19.770 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.771+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=ZBMP3ZZTW48U type=del size=3582588 2024-09-12T00:19:19.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.773+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=WNHA9GMBS3MR type=del 2024-09-12T00:19:19.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.774+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=GE0LXKYWZB9A type=del size=1836665 2024-09-12T00:19:19.774 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.775+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=UH7RFKEYN0KE type=del 2024-09-12T00:19:19.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.777+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=0BL4E1J2715M type=write size=641633 2024-09-12T00:19:19.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.777+0000 7f682945b780 1 < canceled part key=_multipart_P56VIP3WIOJL.2~4UWXCWCUEXHH.0 size=1048576 2024-09-12T00:19:19.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.778+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~4UWXCWCUEXHH.1 size=1048576 2024-09-12T00:19:19.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.780+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~4UWXCWCUEXHH.2 size=281896 2024-09-12T00:19:19.780 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.782+0000 7f682945b780 1 < canceled multipart upload key=P56VIP3WIOJL upload=4UWXCWCUEXHH tag=93C2LRNK5OL8 type=write size=3427624 2024-09-12T00:19:19.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.785+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~HRBGKY9TLYOV.0 size=553502 2024-09-12T00:19:19.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.785+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=HRBGKY9TLYOV tag=Z2U2HEKRY2YD type=write size=1602078 2024-09-12T00:19:19.786 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.788+0000 7f682945b780 1 < suggested update operation key=EYHGJ82COSE9 tag=XRBN8G7Y0RUN type=write size=374641 2024-09-12T00:19:19.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.789+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=1OD3ONB80P67 type=del size=3756560 2024-09-12T00:19:19.789 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.790+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=DKT0V3VT5TVB type=del 2024-09-12T00:19:19.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.793+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=DYMW1MOE4CAO type=del size=1446662 2024-09-12T00:19:19.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.793+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=EVYQF7GJUU7Z type=del 2024-09-12T00:19:19.793 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.795+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=OIDZPXDSDYL1 type=del size=2039469 2024-09-12T00:19:19.795 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.796+0000 7f682945b780 1 < completed write operation key=8D9UC8FJ16UK tag=1FPU64DZ518F type=write size=1046392 2024-09-12T00:19:19.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.798+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=ESDCQL6609AB type=del size=3301939 2024-09-12T00:19:19.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.799+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=JYRIGCET3WAI type=del 2024-09-12T00:19:19.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.801+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=FJKQ8UDQCOF4 type=del size=1445754 2024-09-12T00:19:19.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.802+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=YKOHJZP1M0V1 type=del 2024-09-12T00:19:19.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.804+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=MG0FVA9W43VU type=del size=3301501 2024-09-12T00:19:19.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.805+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=SRPAXV1RB1ZF type=del 2024-09-12T00:19:19.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.807+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~5GS8ME3VNB3A.0 size=1048576 2024-09-12T00:19:19.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.809+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~5GS8ME3VNB3A.1 size=1048576 2024-09-12T00:19:19.808 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.810+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~5GS8ME3VNB3A.2 size=234377 2024-09-12T00:19:19.808 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.810+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=5GS8ME3VNB3A tag=755OW5EGSHZD type=write size=3380105 2024-09-12T00:19:19.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.811+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~3DCASV2MH2VD.0 size=730036 2024-09-12T00:19:19.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.814+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=3DCASV2MH2VD tag=3KBPMXLZ15N8 type=write size=1778612 2024-09-12T00:19:19.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.815+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=XEX6UUPL9405 type=del size=3089013 2024-09-12T00:19:19.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.817+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=TYDTYBPF3S2S type=del 2024-09-12T00:19:19.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.825+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~WBVBJ218YVYO.0 size=1048576 2024-09-12T00:19:19.825 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.827+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~WBVBJ218YVYO.1 size=1048576 2024-09-12T00:19:19.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.828+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~WBVBJ218YVYO.2 size=559817 2024-09-12T00:19:19.827 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.828+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=WBVBJ218YVYO tag=RFJXFE3SYWEE type=write size=3705545 2024-09-12T00:19:19.828 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.829+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~03DUBY9XNDH3.0 size=1048576 2024-09-12T00:19:19.829 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.830+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~03DUBY9XNDH3.1 size=1048576 2024-09-12T00:19:19.830 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.831+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~03DUBY9XNDH3.2 size=227166 2024-09-12T00:19:19.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.834+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=03DUBY9XNDH3 tag=QVDRPBP6RJBS type=write size=3372894 2024-09-12T00:19:19.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.836+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=F0V0W36SGW20 type=del size=1937192 2024-09-12T00:19:19.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.838+0000 7f682945b780 1 < completed write operation key=38JJBFDTIYSU tag=5MH1NVFJ1IA2 type=write size=116219 2024-09-12T00:19:19.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.840+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~2ORA1UOCRRO2.0 size=814775 2024-09-12T00:19:19.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.840+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=2ORA1UOCRRO2 tag=JVP0938N2GIP type=write size=1863351 2024-09-12T00:19:19.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.840+0000 7f682945b780 1 < canceled part key=_multipart_CT2L8L3849IN.2~85UV0PK04KX2.0 size=1048576 2024-09-12T00:19:19.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.840+0000 7f682945b780 1 < canceled part key=_multipart_CT2L8L3849IN.2~85UV0PK04KX2.1 size=441563 2024-09-12T00:19:19.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.843+0000 7f682945b780 1 < canceled multipart upload key=CT2L8L3849IN upload=85UV0PK04KX2 tag=ZJ7V3N0EDMCA type=write size=2538715 2024-09-12T00:19:19.842 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.844+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=NG1QG2ENJA04 type=del size=79357 2024-09-12T00:19:19.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.845+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=ZBMP3ZZTW48U type=del 2024-09-12T00:19:19.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.847+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=B972VZOJMJF1 type=del size=585626 2024-09-12T00:19:19.847 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.848+0000 7f682945b780 1 < canceled operation key=G0ONSUVW4M7R tag=GE0LXKYWZB9A type=del size=1836665 2024-09-12T00:19:19.848 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.850+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=5IGKWLKDV78R type=del size=4083358 2024-09-12T00:19:19.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.851+0000 7f682945b780 1 < completed write operation key=IYYTX8TCLF30 tag=0BL4E1J2715M type=write size=641633 2024-09-12T00:19:19.852 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.854+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~QGRT36F2U0U8.0 size=1048576 2024-09-12T00:19:19.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.855+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~QGRT36F2U0U8.1 size=1048576 2024-09-12T00:19:19.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.856+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~QGRT36F2U0U8.2 size=47517 2024-09-12T00:19:19.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.856+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=QGRT36F2U0U8 tag=PFH37A2VJ2AR type=write size=3193245 2024-09-12T00:19:19.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.857+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~HRBGKY9TLYOV.0 size=553502 2024-09-12T00:19:19.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.859+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=HRBGKY9TLYOV tag=Z2U2HEKRY2YD type=write size=1602078 2024-09-12T00:19:19.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.862+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~DYEMHYEWKAPM.0 size=1048576 2024-09-12T00:19:19.862 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.863+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~DYEMHYEWKAPM.1 size=1048576 2024-09-12T00:19:19.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.864+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~DYEMHYEWKAPM.2 size=327937 2024-09-12T00:19:19.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.864+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=DYEMHYEWKAPM tag=1U1PYGB5GCFY type=write size=3473665 2024-09-12T00:19:19.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.867+0000 7f682945b780 1 < suggested update operation key=Y65K9I6K41X5 tag=1OD3ONB80P67 type=del size=3756560 2024-09-12T00:19:19.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.870+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~3XAXUCZFME3J.0 size=933050 2024-09-12T00:19:19.869 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.870+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=3XAXUCZFME3J tag=7LO9OZW5XLUG type=write size=1981626 2024-09-12T00:19:19.870 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.871+0000 7f682945b780 1 < canceled operation key=TGOBZH6DZK71 tag=DYMW1MOE4CAO type=del size=1446662 2024-09-12T00:19:19.871 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.873+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=OY5JW49NNCV1 type=del size=3846997 2024-09-12T00:19:19.874 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.875+0000 7f682945b780 1 < suggested update operation key=BI3KCKV4CRWR tag=OIDZPXDSDYL1 type=del size=2039469 2024-09-12T00:19:19.875 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.877+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=C449USUSCBSA type=del size=999174 2024-09-12T00:19:19.877 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.878+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=ESDCQL6609AB type=del 2024-09-12T00:19:19.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.881+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~GIBJ3BFNU1CR.0 size=542229 2024-09-12T00:19:19.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.881+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=GIBJ3BFNU1CR tag=F3GTXS6I1HQQ type=write size=1590805 2024-09-12T00:19:19.881 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.882+0000 7f682945b780 -1 < failed to complete operation key=BI3KCKV4CRWR tag=FJKQ8UDQCOF4 type=del size=1445754: (22) Invalid argument 2024-09-12T00:19:19.882 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.883+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=N0NJVPSN856R type=del size=2225198 2024-09-12T00:19:19.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.886+0000 7f682945b780 1 < suggested update operation key=G0ONSUVW4M7R tag=MG0FVA9W43VU type=del size=3301501 2024-09-12T00:19:19.887 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.889+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~IWAQIXYOI6JL.0 size=913486 2024-09-12T00:19:19.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.889+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=IWAQIXYOI6JL tag=1T0H1753MYLD type=write size=1962062 2024-09-12T00:19:19.889 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.891+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~5GS8ME3VNB3A.0 size=1048576 2024-09-12T00:19:19.890 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.892+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~5GS8ME3VNB3A.1 size=1048576 2024-09-12T00:19:19.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.893+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~5GS8ME3VNB3A.2 size=234377 2024-09-12T00:19:19.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.895+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=5GS8ME3VNB3A tag=755OW5EGSHZD type=write size=3380105 2024-09-12T00:19:19.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.897+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=VR62RAXOE3GV type=del size=746107 2024-09-12T00:19:19.897 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.899+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=XEX6UUPL9405 type=del 2024-09-12T00:19:19.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.901+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~C5AFH9EC5NR8.0 size=1048576 2024-09-12T00:19:19.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.902+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~C5AFH9EC5NR8.1 size=389843 2024-09-12T00:19:19.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.902+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=C5AFH9EC5NR8 tag=IR7ICRDJ428C type=write size=2486995 2024-09-12T00:19:19.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.904+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~WBVBJ218YVYO.0 size=1048576 2024-09-12T00:19:19.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.905+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~WBVBJ218YVYO.1 size=1048576 2024-09-12T00:19:19.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.906+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~WBVBJ218YVYO.2 size=559817 2024-09-12T00:19:19.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.909+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=WBVBJ218YVYO tag=RFJXFE3SYWEE type=write size=3705545 2024-09-12T00:19:19.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.910+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=FSZ2IZLESDZ0 type=write size=514093 2024-09-12T00:19:19.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.911+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=F0V0W36SGW20 type=del 2024-09-12T00:19:19.911 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.912+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=S1QPP2TK5KFT type=del size=3474774 2024-09-12T00:19:19.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.914+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~2ORA1UOCRRO2.0 size=814775 2024-09-12T00:19:19.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.917+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=2ORA1UOCRRO2 tag=JVP0938N2GIP type=write size=1863351 2024-09-12T00:19:19.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.919+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~39WS6AS53V9U.0 size=1048576 2024-09-12T00:19:19.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.920+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~39WS6AS53V9U.1 size=361021 2024-09-12T00:19:19.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.920+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=39WS6AS53V9U tag=D47LW0LA5BM7 type=write size=2458173 2024-09-12T00:19:19.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.921+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=NG1QG2ENJA04 type=del 2024-09-12T00:19:19.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.923+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~AGSUM4CQS8CE.0 size=1048576 2024-09-12T00:19:19.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.924+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~AGSUM4CQS8CE.1 size=1048576 2024-09-12T00:19:19.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.925+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~AGSUM4CQS8CE.2 size=93310 2024-09-12T00:19:19.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.925+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=AGSUM4CQS8CE tag=6M8Q9F001G39 type=write size=3239038 2024-09-12T00:19:19.926 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.928+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=B972VZOJMJF1 type=del 2024-09-12T00:19:19.927 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.928+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=UB91BTN94IPV type=del size=2612825 2024-09-12T00:19:19.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.930+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=5IGKWLKDV78R type=del 2024-09-12T00:19:19.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.931+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=21Z4562ZEA7Q type=del size=1340394 2024-09-12T00:19:19.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.933+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~QGRT36F2U0U8.0 size=1048576 2024-09-12T00:19:19.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.935+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~QGRT36F2U0U8.1 size=1048576 2024-09-12T00:19:19.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.936+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~QGRT36F2U0U8.2 size=47517 2024-09-12T00:19:19.936 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.938+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=QGRT36F2U0U8 tag=PFH37A2VJ2AR type=write size=3193245 2024-09-12T00:19:19.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.939+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=4L7N457BSWVU type=del size=2777749 2024-09-12T00:19:19.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.941+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~DYEMHYEWKAPM.0 size=1048576 2024-09-12T00:19:19.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.942+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~DYEMHYEWKAPM.1 size=1048576 2024-09-12T00:19:19.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.943+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~DYEMHYEWKAPM.2 size=327937 2024-09-12T00:19:19.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.945+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=DYEMHYEWKAPM tag=1U1PYGB5GCFY type=write size=3473665 2024-09-12T00:19:19.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.946+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=8Q3LO4A66XIF type=write size=303894 2024-09-12T00:19:19.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.948+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~3XAXUCZFME3J.0 size=933050 2024-09-12T00:19:19.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.950+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=3XAXUCZFME3J tag=7LO9OZW5XLUG type=write size=1981626 2024-09-12T00:19:19.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.952+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=M6U2IXFTVP5E type=write size=412276 2024-09-12T00:19:19.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.953+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=OY5JW49NNCV1 type=del 2024-09-12T00:19:19.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.956+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~5TLY8Y6FUT7Q.0 size=1048576 2024-09-12T00:19:19.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.957+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~5TLY8Y6FUT7Q.1 size=1048576 2024-09-12T00:19:19.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.958+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~5TLY8Y6FUT7Q.2 size=337073 2024-09-12T00:19:19.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.958+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=5TLY8Y6FUT7Q tag=KRQWETL9U0O7 type=write size=3482801 2024-09-12T00:19:19.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.959+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=C449USUSCBSA type=del 2024-09-12T00:19:19.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.961+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=E1NQVAA2WA5K type=del size=4187548 2024-09-12T00:19:19.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.963+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~GIBJ3BFNU1CR.0 size=542229 2024-09-12T00:19:19.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.965+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=GIBJ3BFNU1CR tag=F3GTXS6I1HQQ type=write size=1590805 2024-09-12T00:19:19.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.968+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~M3UF9SV1DLFF.0 size=903317 2024-09-12T00:19:19.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.968+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=M3UF9SV1DLFF tag=29OZJUKXZT48 type=write size=1951893 2024-09-12T00:19:19.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.970+0000 7f682945b780 1 < suggested update operation key=922B2PPJFX2Z tag=N0NJVPSN856R type=del size=2225198 2024-09-12T00:19:19.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.973+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~M08QMH9BFFU1.0 size=1048576 2024-09-12T00:19:19.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.974+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~M08QMH9BFFU1.1 size=749525 2024-09-12T00:19:19.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.974+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=M08QMH9BFFU1 tag=XD99V798OXNH type=write size=2846677 2024-09-12T00:19:19.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.976+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~IWAQIXYOI6JL.0 size=913486 2024-09-12T00:19:19.976 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.978+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=IWAQIXYOI6JL tag=1T0H1753MYLD type=write size=1962062 2024-09-12T00:19:19.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.980+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~91384OMRX12J.0 size=981879 2024-09-12T00:19:19.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.980+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=91384OMRX12J tag=HLBBEKY3XLFN type=write size=2030455 2024-09-12T00:19:19.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.982+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=VR62RAXOE3GV type=del 2024-09-12T00:19:19.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.983+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=I6SBHP8YKZ9U type=del size=882972 2024-09-12T00:19:19.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.985+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~C5AFH9EC5NR8.0 size=1048576 2024-09-12T00:19:19.984 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.986+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~C5AFH9EC5NR8.1 size=389843 2024-09-12T00:19:19.987 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.989+0000 7f682945b780 1 < completed multipart upload key=D06ZUP2ZXX42 upload=C5AFH9EC5NR8 tag=IR7ICRDJ428C type=write size=2486995 2024-09-12T00:19:19.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.990+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~FU4H5BFGGGE1.0 size=371646 2024-09-12T00:19:19.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.990+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=FU4H5BFGGGE1 tag=VPGCDYJ2FT6W type=write size=1420222 2024-09-12T00:19:19.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.992+0000 7f682945b780 1 < completed write operation key=Y65K9I6K41X5 tag=FSZ2IZLESDZ0 type=write size=514093 2024-09-12T00:19:19.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.993+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=14SN08HJQ4XE type=del size=1061107 2024-09-12T00:19:19.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.995+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=S1QPP2TK5KFT type=del 2024-09-12T00:19:19.995 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.996+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=7LLALLUOHZZF type=del size=832218 2024-09-12T00:19:19.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.997+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~39WS6AS53V9U.0 size=1048576 2024-09-12T00:19:19.997 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:19.999+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~39WS6AS53V9U.1 size=361021 2024-09-12T00:19:19.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.001+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=39WS6AS53V9U tag=D47LW0LA5BM7 type=write size=2458173 2024-09-12T00:19:20.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.002+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=5W4DQ2YCV11X type=del size=2495884 2024-09-12T00:19:20.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.004+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~AGSUM4CQS8CE.0 size=1048576 2024-09-12T00:19:20.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.005+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~AGSUM4CQS8CE.1 size=1048576 2024-09-12T00:19:20.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.006+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~AGSUM4CQS8CE.2 size=93310 2024-09-12T00:19:20.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.008+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=AGSUM4CQS8CE tag=6M8Q9F001G39 type=write size=3239038 2024-09-12T00:19:20.008 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.009+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=E62XUCXP92VQ type=write size=333632 2024-09-12T00:19:20.010 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.012+0000 7f682945b780 1 < suggested remove operation key=R7V03ML1H80V tag=UB91BTN94IPV type=del 2024-09-12T00:19:20.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.014+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~TB30UF8UPA9I.0 size=497210 2024-09-12T00:19:20.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.014+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=TB30UF8UPA9I tag=FTLOU4LR0I8R type=write size=1545786 2024-09-12T00:19:20.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.016+0000 7f682945b780 1 < canceled operation key=BI3KCKV4CRWR tag=21Z4562ZEA7Q type=del size=1340394 2024-09-12T00:19:20.016 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.017+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=ELFQLUUHQ98O type=del size=4003924 2024-09-12T00:19:20.017 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.019+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=4L7N457BSWVU type=del 2024-09-12T00:19:20.018 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.020+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=QBAOGDEWJP5X type=del size=538010 2024-09-12T00:19:20.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.021+0000 7f682945b780 1 < completed write operation key=Y65K9I6K41X5 tag=8Q3LO4A66XIF type=write size=303894 2024-09-12T00:19:20.022 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.024+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~FH88H37S2P5M.0 size=1048576 2024-09-12T00:19:20.023 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.025+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~FH88H37S2P5M.1 size=308362 2024-09-12T00:19:20.023 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.025+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=FH88H37S2P5M tag=XCJJEUSMR337 type=write size=2405514 2024-09-12T00:19:20.025 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.027+0000 7f682945b780 1 < completed write operation key=3JFMN39G6TTF tag=M6U2IXFTVP5E type=write size=412276 2024-09-12T00:19:20.027 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.028+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=V53WEQVM5GJN type=write size=12317 2024-09-12T00:19:20.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.030+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~5TLY8Y6FUT7Q.0 size=1048576 2024-09-12T00:19:20.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.031+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~5TLY8Y6FUT7Q.1 size=1048576 2024-09-12T00:19:20.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.032+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~5TLY8Y6FUT7Q.2 size=337073 2024-09-12T00:19:20.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.034+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=5TLY8Y6FUT7Q tag=KRQWETL9U0O7 type=write size=3482801 2024-09-12T00:19:20.035 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.036+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~UEWVNT0F10CZ.0 size=1048576 2024-09-12T00:19:20.036 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.037+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~UEWVNT0F10CZ.1 size=235900 2024-09-12T00:19:20.036 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.037+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=UEWVNT0F10CZ tag=WJZMDO6Z9FTA type=write size=2333052 2024-09-12T00:19:20.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.039+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=E1NQVAA2WA5K type=del 2024-09-12T00:19:20.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.042+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~R16UTY9REZRB.0 size=1048576 2024-09-12T00:19:20.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.043+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~R16UTY9REZRB.1 size=1048576 2024-09-12T00:19:20.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.044+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~R16UTY9REZRB.2 size=806362 2024-09-12T00:19:20.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.044+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=R16UTY9REZRB tag=0EMNIDZSSKNF type=write size=3952090 2024-09-12T00:19:20.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.045+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~M3UF9SV1DLFF.0 size=903317 2024-09-12T00:19:20.046 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.047+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=M3UF9SV1DLFF tag=29OZJUKXZT48 type=write size=1951893 2024-09-12T00:19:20.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.050+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~NHC0NLZ8MJTG.0 size=438014 2024-09-12T00:19:20.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.050+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=NHC0NLZ8MJTG tag=HS45P6H6PQO1 type=write size=1486590 2024-09-12T00:19:20.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.051+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~M08QMH9BFFU1.0 size=1048576 2024-09-12T00:19:20.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.052+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~M08QMH9BFFU1.1 size=749525 2024-09-12T00:19:20.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.054+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=M08QMH9BFFU1 tag=XD99V798OXNH type=write size=2846677 2024-09-12T00:19:20.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.057+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~9HGOV6PTIQKY.0 size=1048576 2024-09-12T00:19:20.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.058+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~9HGOV6PTIQKY.1 size=203696 2024-09-12T00:19:20.057 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.058+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=9HGOV6PTIQKY tag=L9V1YYVNI3K1 type=write size=2300848 2024-09-12T00:19:20.058 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.060+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~91384OMRX12J.0 size=981879 2024-09-12T00:19:20.060 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.062+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=91384OMRX12J tag=HLBBEKY3XLFN type=write size=2030455 2024-09-12T00:19:20.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.063+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=8BMGCSQX453A type=del size=3955579 2024-09-12T00:19:20.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.065+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=I6SBHP8YKZ9U type=del 2024-09-12T00:19:20.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.066+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=RY2JHUS6OZD7 type=del size=273589 2024-09-12T00:19:20.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.067+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~FU4H5BFGGGE1.0 size=371646 2024-09-12T00:19:20.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.070+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=FU4H5BFGGGE1 tag=VPGCDYJ2FT6W type=write size=1420222 2024-09-12T00:19:20.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.072+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~JL1E9Z53VPW5.0 size=1048576 2024-09-12T00:19:20.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.073+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~JL1E9Z53VPW5.1 size=296471 2024-09-12T00:19:20.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.073+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=JL1E9Z53VPW5 tag=NSJ2ZREWUVKN type=write size=2393623 2024-09-12T00:19:20.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.075+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=14SN08HJQ4XE type=del 2024-09-12T00:19:20.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.077+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~FMVCPJQMYNQQ.0 size=1048576 2024-09-12T00:19:20.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.078+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~FMVCPJQMYNQQ.1 size=477674 2024-09-12T00:19:20.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.078+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=FMVCPJQMYNQQ tag=189D4DQO3BL5 type=write size=2574826 2024-09-12T00:19:20.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.080+0000 7f682945b780 1 < completed delete operation key=8D9UC8FJ16UK tag=7LLALLUOHZZF type=del 2024-09-12T00:19:20.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.081+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=732E6S6KESYB type=del size=122655 2024-09-12T00:19:20.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.082+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=5W4DQ2YCV11X type=del 2024-09-12T00:19:20.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.083+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=SRYQFAIKFNC9 type=del size=3671818 2024-09-12T00:19:20.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.085+0000 7f682945b780 1 < completed write operation key=7RRJO383D8TH tag=E62XUCXP92VQ type=write size=333632 2024-09-12T00:19:20.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.086+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=IHBNHI6Y0I3I type=del size=3777114 2024-09-12T00:19:20.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.088+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~TB30UF8UPA9I.0 size=497210 2024-09-12T00:19:20.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.090+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=TB30UF8UPA9I tag=FTLOU4LR0I8R type=write size=1545786 2024-09-12T00:19:20.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.092+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=XLZ3SPVCOQ9K type=del size=493965 2024-09-12T00:19:20.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.092+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=ELFQLUUHQ98O type=del 2024-09-12T00:19:20.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.095+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~VLQBAQ6KPMV8.0 size=1048576 2024-09-12T00:19:20.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.096+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~VLQBAQ6KPMV8.1 size=269703 2024-09-12T00:19:20.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.096+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=VLQBAQ6KPMV8 tag=2IPMDGNPY9JH type=write size=2366855 2024-09-12T00:19:20.096 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.097+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=QBAOGDEWJP5X type=del 2024-09-12T00:19:20.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.098+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=ZO2EAEJR96Q9 type=del size=1649416 2024-09-12T00:19:20.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.100+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~FH88H37S2P5M.0 size=1048576 2024-09-12T00:19:20.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.100+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~FH88H37S2P5M.1 size=308362 2024-09-12T00:19:20.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.103+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=FH88H37S2P5M tag=XCJJEUSMR337 type=write size=2405514 2024-09-12T00:19:20.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.104+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=BMPDGDU4FJKY type=del size=1452642 2024-09-12T00:19:20.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.106+0000 7f682945b780 1 < completed write operation key=38JJBFDTIYSU tag=V53WEQVM5GJN type=write size=12317 2024-09-12T00:19:20.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.108+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=M7FOY3DLZBKA type=del size=1082464 2024-09-12T00:19:20.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.108+0000 7f682945b780 1 < canceled part key=_multipart_TYNSP8BHYO65.2~UEWVNT0F10CZ.0 size=1048576 2024-09-12T00:19:20.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.109+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~UEWVNT0F10CZ.1 size=235900 2024-09-12T00:19:20.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.112+0000 7f682945b780 1 < canceled multipart upload key=TYNSP8BHYO65 upload=UEWVNT0F10CZ tag=WJZMDO6Z9FTA type=write size=2333052 2024-09-12T00:19:20.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.113+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=PZHDYWC9PTHU type=del size=2597766 2024-09-12T00:19:20.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.114+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~R16UTY9REZRB.0 size=1048576 2024-09-12T00:19:20.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.114+0000 7f682945b780 1 < canceled part key=_multipart_EYHGJ82COSE9.2~R16UTY9REZRB.1 size=1048576 2024-09-12T00:19:20.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.116+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~R16UTY9REZRB.2 size=806362 2024-09-12T00:19:20.116 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.118+0000 7f682945b780 1 < canceled multipart upload key=EYHGJ82COSE9 upload=R16UTY9REZRB tag=0EMNIDZSSKNF type=write size=3952090 2024-09-12T00:19:20.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.120+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~BSSY5GE143KP.0 size=68696 2024-09-12T00:19:20.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.120+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=BSSY5GE143KP tag=KL47PLJUPGHT type=write size=1117272 2024-09-12T00:19:20.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.122+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~NHC0NLZ8MJTG.0 size=438014 2024-09-12T00:19:20.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.124+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=NHC0NLZ8MJTG tag=HS45P6H6PQO1 type=write size=1486590 2024-09-12T00:19:20.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.125+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=XYI6E92Z5T7J type=del size=2050966 2024-09-12T00:19:20.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.127+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~9HGOV6PTIQKY.0 size=1048576 2024-09-12T00:19:20.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.128+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~9HGOV6PTIQKY.1 size=203696 2024-09-12T00:19:20.128 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.130+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=9HGOV6PTIQKY tag=L9V1YYVNI3K1 type=write size=2300848 2024-09-12T00:19:20.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.133+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~APEOP0X2U4SS.0 size=1048576 2024-09-12T00:19:20.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.134+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~APEOP0X2U4SS.1 size=394814 2024-09-12T00:19:20.133 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.134+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=APEOP0X2U4SS tag=L9BK3AXXCH2Q type=write size=2491966 2024-09-12T00:19:20.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.135+0000 7f682945b780 1 < canceled operation key=IYYTX8TCLF30 tag=8BMGCSQX453A type=del size=3955579 2024-09-12T00:19:20.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.136+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=3PEDMOETW6AM type=del size=2030184 2024-09-12T00:19:20.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.139+0000 7f682945b780 1 < suggested remove operation key=CT2L8L3849IN tag=RY2JHUS6OZD7 type=del 2024-09-12T00:19:20.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.142+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~MIQ6H2IWG2TA.0 size=1048576 2024-09-12T00:19:20.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.143+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~MIQ6H2IWG2TA.1 size=1048576 2024-09-12T00:19:20.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.144+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~MIQ6H2IWG2TA.2 size=52127 2024-09-12T00:19:20.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.144+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=MIQ6H2IWG2TA tag=FRB9MDFKZRJX type=write size=3197855 2024-09-12T00:19:20.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.144+0000 7f682945b780 1 < canceled part key=_multipart_R2OAUUKLV7OK.2~JL1E9Z53VPW5.0 size=1048576 2024-09-12T00:19:20.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.146+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~JL1E9Z53VPW5.1 size=296471 2024-09-12T00:19:20.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.148+0000 7f682945b780 1 < canceled multipart upload key=R2OAUUKLV7OK upload=JL1E9Z53VPW5 tag=NSJ2ZREWUVKN type=write size=2393623 2024-09-12T00:19:20.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.150+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~KD9F45NY34S6.0 size=1048576 2024-09-12T00:19:20.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.152+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~KD9F45NY34S6.1 size=1048576 2024-09-12T00:19:20.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.153+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~KD9F45NY34S6.2 size=560112 2024-09-12T00:19:20.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.153+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=KD9F45NY34S6 tag=39ES1LL778E8 type=write size=3705840 2024-09-12T00:19:20.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.155+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~FMVCPJQMYNQQ.0 size=1048576 2024-09-12T00:19:20.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.156+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~FMVCPJQMYNQQ.1 size=477674 2024-09-12T00:19:20.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.158+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=FMVCPJQMYNQQ tag=189D4DQO3BL5 type=write size=2574826 2024-09-12T00:19:20.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.159+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=XER3GTF3PTF8 type=del size=2506134 2024-09-12T00:19:20.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.162+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=732E6S6KESYB type=del 2024-09-12T00:19:20.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.162+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=VAGY8TPRJCAK type=del size=1392301 2024-09-12T00:19:20.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.166+0000 7f682945b780 1 < suggested update operation key=17S1X3WXCNAR tag=SRYQFAIKFNC9 type=del size=3671818 2024-09-12T00:19:20.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.169+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~ES0RREEVR3CH.0 size=1048576 2024-09-12T00:19:20.169 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.170+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~ES0RREEVR3CH.1 size=1048576 2024-09-12T00:19:20.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.171+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~ES0RREEVR3CH.2 size=735348 2024-09-12T00:19:20.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.171+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=ES0RREEVR3CH tag=CLM98T4096SS type=write size=3881076 2024-09-12T00:19:20.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.172+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=IHBNHI6Y0I3I type=del 2024-09-12T00:19:20.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.175+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~POEPHKXDEGZ7.0 size=455764 2024-09-12T00:19:20.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.175+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=POEPHKXDEGZ7 tag=OVC537Z7OS1F type=write size=1504340 2024-09-12T00:19:20.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.178+0000 7f682945b780 1 < suggested remove operation key=17S1X3WXCNAR tag=XLZ3SPVCOQ9K type=del 2024-09-12T00:19:20.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.180+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=LTV8PCEKQP99 type=del size=1375394 2024-09-12T00:19:20.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.181+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~VLQBAQ6KPMV8.0 size=1048576 2024-09-12T00:19:20.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.182+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~VLQBAQ6KPMV8.1 size=269703 2024-09-12T00:19:20.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.184+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=VLQBAQ6KPMV8 tag=2IPMDGNPY9JH type=write size=2366855 2024-09-12T00:19:20.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.185+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=TT2XRUIHG8ZP type=del size=2023786 2024-09-12T00:19:20.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.186+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=ZO2EAEJR96Q9 type=del 2024-09-12T00:19:20.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.189+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~XQN0P0XX40NB.0 size=1048576 2024-09-12T00:19:20.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.190+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~XQN0P0XX40NB.1 size=350328 2024-09-12T00:19:20.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.190+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=XQN0P0XX40NB tag=MQIGB66RCNEA type=write size=2447480 2024-09-12T00:19:20.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.192+0000 7f682945b780 1 < suggested update operation key=BI3KCKV4CRWR tag=BMPDGDU4FJKY type=del size=1452642 2024-09-12T00:19:20.192 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.194+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=RE44DG52A5T9 type=del size=1922700 2024-09-12T00:19:20.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.195+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=M7FOY3DLZBKA type=del 2024-09-12T00:19:20.195 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.197+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=LN8LDVJJ33JT type=del size=426614 2024-09-12T00:19:20.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.199+0000 7f682945b780 1 < suggested update operation key=D06ZUP2ZXX42 tag=PZHDYWC9PTHU type=del size=2597766 2024-09-12T00:19:20.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.206+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=W5PHR5ZUNJFF type=del size=3059279 2024-09-12T00:19:20.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.208+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~BSSY5GE143KP.0 size=68696 2024-09-12T00:19:20.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.211+0000 7f682945b780 1 < completed multipart upload key=6DUQKU3R1RL8 upload=BSSY5GE143KP tag=KL47PLJUPGHT type=write size=1117272 2024-09-12T00:19:20.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.213+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~TJRSAUASV5LO.0 size=1048576 2024-09-12T00:19:20.213 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.214+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~TJRSAUASV5LO.1 size=122893 2024-09-12T00:19:20.213 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.214+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=TJRSAUASV5LO tag=GOPLY1N8WJIZ type=write size=2220045 2024-09-12T00:19:20.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.216+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=XYI6E92Z5T7J type=del 2024-09-12T00:19:20.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.217+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=77FTL1TMNK3V type=write size=344974 2024-09-12T00:19:20.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.219+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~APEOP0X2U4SS.0 size=1048576 2024-09-12T00:19:20.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.220+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~APEOP0X2U4SS.1 size=394814 2024-09-12T00:19:20.221 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.223+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=APEOP0X2U4SS tag=L9BK3AXXCH2Q type=write size=2491966 2024-09-12T00:19:20.224 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.225+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~ZWS8F0K00ZGP.0 size=1048576 2024-09-12T00:19:20.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.226+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~ZWS8F0K00ZGP.1 size=1048576 2024-09-12T00:19:20.226 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.228+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~ZWS8F0K00ZGP.2 size=101813 2024-09-12T00:19:20.226 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.228+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=ZWS8F0K00ZGP tag=4QH3R7M5NRCD type=write size=3247541 2024-09-12T00:19:20.228 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.229+0000 7f682945b780 1 < completed delete operation key=38JJBFDTIYSU tag=3PEDMOETW6AM type=del 2024-09-12T00:19:20.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.231+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=6OBTGW2UYN4L type=del size=1268651 2024-09-12T00:19:20.231 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.232+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~MIQ6H2IWG2TA.0 size=1048576 2024-09-12T00:19:20.232 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.234+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~MIQ6H2IWG2TA.1 size=1048576 2024-09-12T00:19:20.232 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.234+0000 7f682945b780 1 < canceled part key=_multipart_17S1X3WXCNAR.2~MIQ6H2IWG2TA.2 size=52127 2024-09-12T00:19:20.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.236+0000 7f682945b780 1 < canceled multipart upload key=17S1X3WXCNAR upload=MIQ6H2IWG2TA tag=FRB9MDFKZRJX type=write size=3197855 2024-09-12T00:19:20.236 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.238+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=NRPK446XYL1I type=del size=3756447 2024-09-12T00:19:20.237 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.238+0000 7f682945b780 1 < canceled part key=_multipart_COUJXCOSVPDS.2~KD9F45NY34S6.0 size=1048576 2024-09-12T00:19:20.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.239+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~KD9F45NY34S6.1 size=1048576 2024-09-12T00:19:20.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.240+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~KD9F45NY34S6.2 size=560112 2024-09-12T00:19:20.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.243+0000 7f682945b780 1 < canceled multipart upload key=COUJXCOSVPDS upload=KD9F45NY34S6 tag=39ES1LL778E8 type=write size=3705840 2024-09-12T00:19:20.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.244+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=W5D98AEGUQYC type=del size=2566917 2024-09-12T00:19:20.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.246+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=XER3GTF3PTF8 type=del 2024-09-12T00:19:20.247 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.248+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~NPTHZHUM4J1N.0 size=1048576 2024-09-12T00:19:20.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.249+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~NPTHZHUM4J1N.1 size=1048576 2024-09-12T00:19:20.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.251+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~NPTHZHUM4J1N.2 size=150399 2024-09-12T00:19:20.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.251+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=NPTHZHUM4J1N tag=IJNUZRF96KCZ type=write size=3296127 2024-09-12T00:19:20.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.254+0000 7f682945b780 1 < suggested update operation key=JAVE3HR52R5C tag=VAGY8TPRJCAK type=del size=1392301 2024-09-12T00:19:20.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.255+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=N9IV0RLJH2ZE type=del size=2659411 2024-09-12T00:19:20.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.256+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~ES0RREEVR3CH.0 size=1048576 2024-09-12T00:19:20.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.257+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~ES0RREEVR3CH.1 size=1048576 2024-09-12T00:19:20.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.259+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~ES0RREEVR3CH.2 size=735348 2024-09-12T00:19:20.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.261+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=ES0RREEVR3CH tag=CLM98T4096SS type=write size=3881076 2024-09-12T00:19:20.262 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.263+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~XQ07KKMMQLZA.0 size=1048576 2024-09-12T00:19:20.263 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.264+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~XQ07KKMMQLZA.1 size=1048576 2024-09-12T00:19:20.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.265+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~XQ07KKMMQLZA.2 size=612645 2024-09-12T00:19:20.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.265+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=XQ07KKMMQLZA tag=JFADRCNYA50H type=write size=3758373 2024-09-12T00:19:20.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.267+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~POEPHKXDEGZ7.0 size=455764 2024-09-12T00:19:20.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.270+0000 7f682945b780 1 < completed multipart upload key=8D9UC8FJ16UK upload=POEPHKXDEGZ7 tag=OVC537Z7OS1F type=write size=1504340 2024-09-12T00:19:20.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.270+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=ODPOF5R1KPXD type=write size=445039 2024-09-12T00:19:20.271 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.272+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=LTV8PCEKQP99 type=del 2024-09-12T00:19:20.272 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.274+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=ANL4I6E1UN50 type=del size=1827436 2024-09-12T00:19:20.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.275+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=TT2XRUIHG8ZP type=del 2024-09-12T00:19:20.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.276+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=FIWTNBM2GLYB type=del size=105140 2024-09-12T00:19:20.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.278+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~XQN0P0XX40NB.0 size=1048576 2024-09-12T00:19:20.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.279+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~XQN0P0XX40NB.1 size=350328 2024-09-12T00:19:20.279 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.281+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=XQN0P0XX40NB tag=MQIGB66RCNEA type=write size=2447480 2024-09-12T00:19:20.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.283+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~7L3GIVH59OBM.0 size=1048576 2024-09-12T00:19:20.282 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.284+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~7L3GIVH59OBM.1 size=774933 2024-09-12T00:19:20.282 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.284+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=7L3GIVH59OBM tag=60WS8U2PWCMM type=write size=2872085 2024-09-12T00:19:20.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.287+0000 7f682945b780 1 < suggested remove operation key=CT2L8L3849IN tag=RE44DG52A5T9 type=del 2024-09-12T00:19:20.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.289+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=J13HF82Y9O6H type=write size=1002532 2024-09-12T00:19:20.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.291+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=LN8LDVJJ33JT type=del 2024-09-12T00:19:20.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.293+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=CGKOASGVO71T type=write size=879450 2024-09-12T00:19:20.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.296+0000 7f682945b780 1 < suggested update operation key=Y65K9I6K41X5 tag=W5PHR5ZUNJFF type=del size=3059279 2024-09-12T00:19:20.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.298+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~XYBJDVZ2ZTXJ.0 size=1048576 2024-09-12T00:19:20.298 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.299+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~XYBJDVZ2ZTXJ.1 size=886464 2024-09-12T00:19:20.298 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.300+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=XYBJDVZ2ZTXJ tag=JF8N5RREQU83 type=write size=2983616 2024-09-12T00:19:20.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.301+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~TJRSAUASV5LO.0 size=1048576 2024-09-12T00:19:20.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.302+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~TJRSAUASV5LO.1 size=122893 2024-09-12T00:19:20.303 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.304+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=TJRSAUASV5LO tag=GOPLY1N8WJIZ type=write size=2220045 2024-09-12T00:19:20.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.308+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~7C64VIJW89F2.0 size=1048576 2024-09-12T00:19:20.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.309+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~7C64VIJW89F2.1 size=1048576 2024-09-12T00:19:20.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.310+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~7C64VIJW89F2.2 size=155746 2024-09-12T00:19:20.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.310+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=7C64VIJW89F2 tag=3PSK8R9D1R7V type=write size=3301474 2024-09-12T00:19:20.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.311+0000 7f682945b780 1 < completed write operation key=922B2PPJFX2Z tag=77FTL1TMNK3V type=write size=344974 2024-09-12T00:19:20.312 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.313+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~AD7F0DHM3W0O.0 size=705044 2024-09-12T00:19:20.312 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.313+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=AD7F0DHM3W0O tag=Z5Z6CHVVF85S type=write size=1753620 2024-09-12T00:19:20.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.315+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~ZWS8F0K00ZGP.0 size=1048576 2024-09-12T00:19:20.315 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.317+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~ZWS8F0K00ZGP.1 size=1048576 2024-09-12T00:19:20.315 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.317+0000 7f682945b780 1 < canceled part key=_multipart_7RRJO383D8TH.2~ZWS8F0K00ZGP.2 size=101813 2024-09-12T00:19:20.317 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.319+0000 7f682945b780 1 < canceled multipart upload key=7RRJO383D8TH upload=ZWS8F0K00ZGP tag=4QH3R7M5NRCD type=write size=3247541 2024-09-12T00:19:20.318 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.320+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=DT5ZOHZTMGPM type=del size=344386 2024-09-12T00:19:20.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.322+0000 7f682945b780 1 < suggested remove operation key=7RRJO383D8TH tag=6OBTGW2UYN4L type=del 2024-09-12T00:19:20.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.324+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=O9M7SHM55SVD type=write size=34221 2024-09-12T00:19:20.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.326+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=NRPK446XYL1I type=del 2024-09-12T00:19:20.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.327+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=BK4I3URSYL11 type=del size=3599359 2024-09-12T00:19:20.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.329+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=W5D98AEGUQYC type=del 2024-09-12T00:19:20.329 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.330+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=NQHP8Z3O2DS6 type=del size=62487 2024-09-12T00:19:20.330 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.331+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~NPTHZHUM4J1N.0 size=1048576 2024-09-12T00:19:20.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.333+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~NPTHZHUM4J1N.1 size=1048576 2024-09-12T00:19:20.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.334+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~NPTHZHUM4J1N.2 size=150399 2024-09-12T00:19:20.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.336+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=NPTHZHUM4J1N tag=IJNUZRF96KCZ type=write size=3296127 2024-09-12T00:19:20.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.338+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~VTDS27LNAT2Q.0 size=1048576 2024-09-12T00:19:20.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.339+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~VTDS27LNAT2Q.1 size=1048576 2024-09-12T00:19:20.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.341+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~VTDS27LNAT2Q.2 size=631083 2024-09-12T00:19:20.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.341+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=VTDS27LNAT2Q tag=GY1422WBSIPI type=write size=3776811 2024-09-12T00:19:20.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.342+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=N9IV0RLJH2ZE type=del 2024-09-12T00:19:20.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.343+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=QL8O1NSXWIC7 type=write size=665744 2024-09-12T00:19:20.343 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.345+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~XQ07KKMMQLZA.0 size=1048576 2024-09-12T00:19:20.344 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.346+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~XQ07KKMMQLZA.1 size=1048576 2024-09-12T00:19:20.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.347+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~XQ07KKMMQLZA.2 size=612645 2024-09-12T00:19:20.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.349+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=XQ07KKMMQLZA tag=JFADRCNYA50H type=write size=3758373 2024-09-12T00:19:20.348 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.350+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=2XMHMIOBPPNE type=write size=988648 2024-09-12T00:19:20.350 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.351+0000 7f682945b780 1 < completed write operation key=COUJXCOSVPDS tag=ODPOF5R1KPXD type=write size=445039 2024-09-12T00:19:20.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.353+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=SGOF6H75EFRG type=del size=3876810 2024-09-12T00:19:20.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.354+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=ANL4I6E1UN50 type=del 2024-09-12T00:19:20.355 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.356+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~SGG2AX7D13VO.0 size=1048576 2024-09-12T00:19:20.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.358+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~SGG2AX7D13VO.1 size=1044817 2024-09-12T00:19:20.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.358+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=SGG2AX7D13VO tag=86DCHW107F0S type=write size=3141969 2024-09-12T00:19:20.358 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.359+0000 7f682945b780 1 < completed delete operation key=38JJBFDTIYSU tag=FIWTNBM2GLYB type=del 2024-09-12T00:19:20.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.361+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~R11S2JM9GZDX.0 size=32244 2024-09-12T00:19:20.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.361+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=R11S2JM9GZDX tag=IOAAWLJQX4YM type=write size=1080820 2024-09-12T00:19:20.361 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.363+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~7L3GIVH59OBM.0 size=1048576 2024-09-12T00:19:20.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.364+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~7L3GIVH59OBM.1 size=774933 2024-09-12T00:19:20.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.367+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=7L3GIVH59OBM tag=60WS8U2PWCMM type=write size=2872085 2024-09-12T00:19:20.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.368+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=7WJZ62GB38XH type=del size=572898 2024-09-12T00:19:20.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.371+0000 7f682945b780 1 < suggested update operation key=TYNSP8BHYO65 tag=J13HF82Y9O6H type=write size=1002532 2024-09-12T00:19:20.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.373+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~Y3Y04X93QIBN.0 size=1048576 2024-09-12T00:19:20.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.374+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~Y3Y04X93QIBN.1 size=696447 2024-09-12T00:19:20.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.374+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=Y3Y04X93QIBN tag=X8CMIZPND84Z type=write size=2793599 2024-09-12T00:19:20.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.375+0000 7f682945b780 1 < completed write operation key=BMTPXZ1OA2TZ tag=CGKOASGVO71T type=write size=879450 2024-09-12T00:19:20.375 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.376+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=WKZPO3AHN9XU type=del size=3859502 2024-09-12T00:19:20.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.378+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~XYBJDVZ2ZTXJ.0 size=1048576 2024-09-12T00:19:20.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.379+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~XYBJDVZ2ZTXJ.1 size=886464 2024-09-12T00:19:20.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.381+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=XYBJDVZ2ZTXJ tag=JF8N5RREQU83 type=write size=2983616 2024-09-12T00:19:20.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.382+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=7G8YI0Z8DTRI type=del size=1486748 2024-09-12T00:19:20.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.384+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~7C64VIJW89F2.0 size=1048576 2024-09-12T00:19:20.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.385+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~7C64VIJW89F2.1 size=1048576 2024-09-12T00:19:20.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.386+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~7C64VIJW89F2.2 size=155746 2024-09-12T00:19:20.387 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.389+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=7C64VIJW89F2 tag=3PSK8R9D1R7V type=write size=3301474 2024-09-12T00:19:20.389 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.391+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~7WHK0GOZY6CQ.0 size=383511 2024-09-12T00:19:20.389 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.391+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=7WHK0GOZY6CQ tag=Z9GYRTM7CPSR type=write size=1432087 2024-09-12T00:19:20.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.392+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~AD7F0DHM3W0O.0 size=705044 2024-09-12T00:19:20.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.394+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=AD7F0DHM3W0O tag=Z5Z6CHVVF85S type=write size=1753620 2024-09-12T00:19:20.394 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.396+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=ZGMSX324HH10 type=del size=2566563 2024-09-12T00:19:20.396 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.397+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=DT5ZOHZTMGPM type=del 2024-09-12T00:19:20.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.398+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=IZ9DNKWDUK9Y type=del size=274397 2024-09-12T00:19:20.398 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.400+0000 7f682945b780 1 < completed write operation key=3JFMN39G6TTF tag=O9M7SHM55SVD type=write size=34221 2024-09-12T00:19:20.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.402+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~KYYEJSJWFJ1K.0 size=1048576 2024-09-12T00:19:20.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.404+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~KYYEJSJWFJ1K.1 size=640992 2024-09-12T00:19:20.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.404+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=KYYEJSJWFJ1K tag=H7VIH5F3WYQL type=write size=2738144 2024-09-12T00:19:20.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.405+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=BK4I3URSYL11 type=del 2024-09-12T00:19:20.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.407+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~WH12DJB1B3YX.0 size=504782 2024-09-12T00:19:20.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.407+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=WH12DJB1B3YX tag=6OINPHT363HX type=write size=1553358 2024-09-12T00:19:20.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.409+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=NQHP8Z3O2DS6 type=del 2024-09-12T00:19:20.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.410+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=KE1HFTTH5RD8 type=del size=1983118 2024-09-12T00:19:20.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.411+0000 7f682945b780 1 < canceled part key=_multipart_3JFMN39G6TTF.2~VTDS27LNAT2Q.0 size=1048576 2024-09-12T00:19:20.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.412+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~VTDS27LNAT2Q.1 size=1048576 2024-09-12T00:19:20.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.413+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~VTDS27LNAT2Q.2 size=631083 2024-09-12T00:19:20.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.416+0000 7f682945b780 1 < canceled multipart upload key=3JFMN39G6TTF upload=VTDS27LNAT2Q tag=GY1422WBSIPI type=write size=3776811 2024-09-12T00:19:20.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.419+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=3LBPCBXT00IA type=write size=81556 2024-09-12T00:19:20.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.422+0000 7f682945b780 1 < suggested update operation key=P56VIP3WIOJL tag=QL8O1NSXWIC7 type=write size=665744 2024-09-12T00:19:20.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.423+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=055EB85F1W2Z type=write size=504548 2024-09-12T00:19:20.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.425+0000 7f682945b780 1 < completed write operation key=7RRJO383D8TH tag=2XMHMIOBPPNE type=write size=988648 2024-09-12T00:19:20.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.426+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=VGX2Q51ECV4M type=del size=4058386 2024-09-12T00:19:20.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.428+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=SGOF6H75EFRG type=del 2024-09-12T00:19:20.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.429+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=UAIW5IAP5QWT type=del size=2652562 2024-09-12T00:19:20.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.430+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~SGG2AX7D13VO.0 size=1048576 2024-09-12T00:19:20.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.431+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~SGG2AX7D13VO.1 size=1044817 2024-09-12T00:19:20.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.434+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=SGG2AX7D13VO tag=86DCHW107F0S type=write size=3141969 2024-09-12T00:19:20.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.436+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=659RU2XTLY78 type=del size=2273873 2024-09-12T00:19:20.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.437+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~R11S2JM9GZDX.0 size=32244 2024-09-12T00:19:20.438 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.439+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=R11S2JM9GZDX tag=IOAAWLJQX4YM type=write size=1080820 2024-09-12T00:19:20.439 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.441+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=OFIOAR3RNNN2 type=del size=958826 2024-09-12T00:19:20.441 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.442+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=7WJZ62GB38XH type=del 2024-09-12T00:19:20.442 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.444+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=81DE0QQN9IKH type=del size=2296433 2024-09-12T00:19:20.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.444+0000 7f682945b780 1 < canceled part key=_multipart_8D9UC8FJ16UK.2~Y3Y04X93QIBN.0 size=1048576 2024-09-12T00:19:20.444 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.445+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~Y3Y04X93QIBN.1 size=696447 2024-09-12T00:19:20.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.447+0000 7f682945b780 1 < canceled multipart upload key=8D9UC8FJ16UK upload=Y3Y04X93QIBN tag=X8CMIZPND84Z type=write size=2793599 2024-09-12T00:19:20.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.450+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~P3EDYBCURCI4.0 size=1048576 2024-09-12T00:19:20.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.451+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~P3EDYBCURCI4.1 size=898246 2024-09-12T00:19:20.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.451+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=P3EDYBCURCI4 tag=6HSDWQTAU586 type=write size=2995398 2024-09-12T00:19:20.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.452+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=WKZPO3AHN9XU type=del 2024-09-12T00:19:20.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.454+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=KJOTZXMM9NH1 type=write size=763118 2024-09-12T00:19:20.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.455+0000 7f682945b780 -1 < failed to complete operation key=P56VIP3WIOJL tag=7G8YI0Z8DTRI type=del size=1486748: (22) Invalid argument 2024-09-12T00:19:20.455 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.456+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=R23SRIEZPZC2 type=del size=816679 2024-09-12T00:19:20.456 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.458+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~7WHK0GOZY6CQ.0 size=383511 2024-09-12T00:19:20.458 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.460+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=7WHK0GOZY6CQ tag=Z9GYRTM7CPSR type=write size=1432087 2024-09-12T00:19:20.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.462+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~7B9PW4LO78WE.0 size=359354 2024-09-12T00:19:20.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.462+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=7B9PW4LO78WE tag=S65JN2LR4ZQZ type=write size=1407930 2024-09-12T00:19:20.462 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.464+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=ZGMSX324HH10 type=del 2024-09-12T00:19:20.463 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.465+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=SV4I5POGMU9N type=del size=2175693 2024-09-12T00:19:20.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.468+0000 7f682945b780 1 < suggested update operation key=1RAFARG1JXFQ tag=IZ9DNKWDUK9Y type=del size=274397 2024-09-12T00:19:20.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.470+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~63EFVNOGUI2W.0 size=644224 2024-09-12T00:19:20.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.470+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=63EFVNOGUI2W tag=9X4LRAWRYP94 type=write size=1692800 2024-09-12T00:19:20.471 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.472+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~KYYEJSJWFJ1K.0 size=1048576 2024-09-12T00:19:20.471 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.472+0000 7f682945b780 1 < canceled part key=_multipart_IUPAGGPATJB4.2~KYYEJSJWFJ1K.1 size=640992 2024-09-12T00:19:20.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.475+0000 7f682945b780 1 < canceled multipart upload key=IUPAGGPATJB4 upload=KYYEJSJWFJ1K tag=H7VIH5F3WYQL type=write size=2738144 2024-09-12T00:19:20.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.477+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~7DEK241MEX9C.0 size=1048576 2024-09-12T00:19:20.476 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.478+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~7DEK241MEX9C.1 size=1048576 2024-09-12T00:19:20.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.479+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~7DEK241MEX9C.2 size=128886 2024-09-12T00:19:20.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.479+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=7DEK241MEX9C tag=YB46K7OKEC0V type=write size=3274614 2024-09-12T00:19:20.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.479+0000 7f682945b780 1 < canceled part key=_multipart_7RRJO383D8TH.2~WH12DJB1B3YX.0 size=504782 2024-09-12T00:19:20.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.481+0000 7f682945b780 1 < canceled multipart upload key=7RRJO383D8TH upload=WH12DJB1B3YX tag=6OINPHT363HX type=write size=1553358 2024-09-12T00:19:20.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.482+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=8E8RXL7330NL type=del size=1904297 2024-09-12T00:19:20.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.484+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=KE1HFTTH5RD8 type=del 2024-09-12T00:19:20.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.486+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~81MPLRPF6UYL.0 size=1048576 2024-09-12T00:19:20.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.487+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~81MPLRPF6UYL.1 size=1048576 2024-09-12T00:19:20.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.489+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~81MPLRPF6UYL.2 size=796975 2024-09-12T00:19:20.488 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.489+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=81MPLRPF6UYL tag=MMUF7PBZTM0T type=write size=3942703 2024-09-12T00:19:20.489 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.490+0000 7f682945b780 1 < completed write operation key=JAVE3HR52R5C tag=3LBPCBXT00IA type=write size=81556 2024-09-12T00:19:20.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.492+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=KY35NKDSI580 type=del size=3963864 2024-09-12T00:19:20.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.493+0000 7f682945b780 1 < completed write operation key=EYHGJ82COSE9 tag=055EB85F1W2Z type=write size=504548 2024-09-12T00:19:20.495 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.496+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~SFEI3OY143IE.0 size=1048576 2024-09-12T00:19:20.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.497+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~SFEI3OY143IE.1 size=714499 2024-09-12T00:19:20.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.497+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=SFEI3OY143IE tag=TMI1S2M054SI type=write size=2811651 2024-09-12T00:19:20.497 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.499+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=VGX2Q51ECV4M type=del 2024-09-12T00:19:20.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.500+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=BLDBY39UO0JB type=del size=3633053 2024-09-12T00:19:20.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.502+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=UAIW5IAP5QWT type=del 2024-09-12T00:19:20.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.504+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=CGX1TP51FQCL type=del size=96407 2024-09-12T00:19:20.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.505+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=659RU2XTLY78 type=del 2024-09-12T00:19:20.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.507+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=VQAFSQIQOWNP type=del size=1293355 2024-09-12T00:19:20.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.508+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=OFIOAR3RNNN2 type=del 2024-09-12T00:19:20.508 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.509+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=3I0QJOOX5P4O type=write size=32883 2024-09-12T00:19:20.510 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.511+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=81DE0QQN9IKH type=del 2024-09-12T00:19:20.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.514+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~K8VLRMODV1KI.0 size=884414 2024-09-12T00:19:20.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.514+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=K8VLRMODV1KI tag=FE7TGXELYMDZ type=write size=1932990 2024-09-12T00:19:20.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.515+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~P3EDYBCURCI4.0 size=1048576 2024-09-12T00:19:20.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.516+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~P3EDYBCURCI4.1 size=898246 2024-09-12T00:19:20.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.519+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=P3EDYBCURCI4 tag=6HSDWQTAU586 type=write size=2995398 2024-09-12T00:19:20.520 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.521+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~WA1TS2SFRAMP.0 size=1048576 2024-09-12T00:19:20.521 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.522+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~WA1TS2SFRAMP.1 size=1048576 2024-09-12T00:19:20.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.523+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~WA1TS2SFRAMP.2 size=652312 2024-09-12T00:19:20.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.523+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=WA1TS2SFRAMP tag=48AKED5KWXEY type=write size=3798040 2024-09-12T00:19:20.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.525+0000 7f682945b780 1 < completed write operation key=SGWTWN8RTKDD tag=KJOTZXMM9NH1 type=write size=763118 2024-09-12T00:19:20.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.526+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=N2TU19QXMAXS type=del size=3637497 2024-09-12T00:19:20.526 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.528+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=R23SRIEZPZC2 type=del 2024-09-12T00:19:20.528 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.529+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=QW3QVDGFM8R0 type=del size=1918014 2024-09-12T00:19:20.529 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.531+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~7B9PW4LO78WE.0 size=359354 2024-09-12T00:19:20.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.533+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=7B9PW4LO78WE tag=S65JN2LR4ZQZ type=write size=1407930 2024-09-12T00:19:20.534 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.535+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~6RN2M557RNKD.0 size=1048576 2024-09-12T00:19:20.535 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.536+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~6RN2M557RNKD.1 size=1048576 2024-09-12T00:19:20.536 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.537+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~6RN2M557RNKD.2 size=704801 2024-09-12T00:19:20.536 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.537+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=6RN2M557RNKD tag=2NKRZTQBJ0FA type=write size=3850529 2024-09-12T00:19:20.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.539+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=SV4I5POGMU9N type=del 2024-09-12T00:19:20.540 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.542+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~T698F6HC7D78.0 size=1019271 2024-09-12T00:19:20.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.542+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=T698F6HC7D78 tag=T1PQK6HO05KN type=write size=2067847 2024-09-12T00:19:20.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.543+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~63EFVNOGUI2W.0 size=644224 2024-09-12T00:19:20.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.545+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=63EFVNOGUI2W tag=9X4LRAWRYP94 type=write size=1692800 2024-09-12T00:19:20.545 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.546+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=0VZU7IY7E8KM type=del size=1147975 2024-09-12T00:19:20.545 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.546+0000 7f682945b780 1 < canceled part key=_multipart_38JJBFDTIYSU.2~7DEK241MEX9C.0 size=1048576 2024-09-12T00:19:20.546 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.547+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~7DEK241MEX9C.1 size=1048576 2024-09-12T00:19:20.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.549+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~7DEK241MEX9C.2 size=128886 2024-09-12T00:19:20.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.551+0000 7f682945b780 1 < canceled multipart upload key=38JJBFDTIYSU upload=7DEK241MEX9C tag=YB46K7OKEC0V type=write size=3274614 2024-09-12T00:19:20.552 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.554+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~64GCVBX1ZOJ4.0 size=1048576 2024-09-12T00:19:20.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.555+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~64GCVBX1ZOJ4.1 size=370132 2024-09-12T00:19:20.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.555+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=64GCVBX1ZOJ4 tag=M3B2IOSRIBYX type=write size=2467284 2024-09-12T00:19:20.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.556+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=8E8RXL7330NL type=del 2024-09-12T00:19:20.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.557+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=E3ZOCIS2JUV1 type=write size=606488 2024-09-12T00:19:20.557 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.558+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~81MPLRPF6UYL.0 size=1048576 2024-09-12T00:19:20.558 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.559+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~81MPLRPF6UYL.1 size=1048576 2024-09-12T00:19:20.559 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.561+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~81MPLRPF6UYL.2 size=796975 2024-09-12T00:19:20.561 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.563+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=81MPLRPF6UYL tag=MMUF7PBZTM0T type=write size=3942703 2024-09-12T00:19:20.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.564+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=PCGVLQ7UUH7Z type=del size=3652726 2024-09-12T00:19:20.565 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.567+0000 7f682945b780 1 < suggested remove operation key=EYHGJ82COSE9 tag=KY35NKDSI580 type=del 2024-09-12T00:19:20.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.569+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~BG1ZK3HSU2BI.0 size=1048576 2024-09-12T00:19:20.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.571+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~BG1ZK3HSU2BI.1 size=1048576 2024-09-12T00:19:20.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.572+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~BG1ZK3HSU2BI.2 size=783993 2024-09-12T00:19:20.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.572+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=BG1ZK3HSU2BI tag=MRXAJX2V2IWR type=write size=3929721 2024-09-12T00:19:20.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.572+0000 7f682945b780 1 < canceled part key=_multipart_1RAFARG1JXFQ.2~SFEI3OY143IE.0 size=1048576 2024-09-12T00:19:20.572 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.573+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~SFEI3OY143IE.1 size=714499 2024-09-12T00:19:20.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.576+0000 7f682945b780 1 < canceled multipart upload key=1RAFARG1JXFQ upload=SFEI3OY143IE tag=TMI1S2M054SI type=write size=2811651 2024-09-12T00:19:20.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.577+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=BFMT07YJJJFT type=del size=51071 2024-09-12T00:19:20.580 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.582+0000 7f682945b780 1 < suggested remove operation key=9Q4HFV4F2KE2 tag=BLDBY39UO0JB type=del 2024-09-12T00:19:20.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.583+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=P5XPKP32HHLL type=write size=299374 2024-09-12T00:19:20.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.586+0000 7f682945b780 1 < suggested remove operation key=CE5EBY7EGY4Z tag=CGX1TP51FQCL type=del 2024-09-12T00:19:20.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.589+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~GCDZNV8W32TM.0 size=1048576 2024-09-12T00:19:20.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.590+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~GCDZNV8W32TM.1 size=941261 2024-09-12T00:19:20.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.590+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=GCDZNV8W32TM tag=ZAAWDTIA1X0E type=write size=3038413 2024-09-12T00:19:20.590 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.591+0000 7f682945b780 -1 < failed to complete operation key=9Q4HFV4F2KE2 tag=VQAFSQIQOWNP type=del size=1293355: (22) Invalid argument 2024-09-12T00:19:20.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.594+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~ICRIAJSVUM8I.0 size=1048576 2024-09-12T00:19:20.593 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.595+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~ICRIAJSVUM8I.1 size=876759 2024-09-12T00:19:20.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.595+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=ICRIAJSVUM8I tag=ZSKUNEISP050 type=write size=2973911 2024-09-12T00:19:20.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.596+0000 7f682945b780 1 < completed write operation key=38JJBFDTIYSU tag=3I0QJOOX5P4O type=write size=32883 2024-09-12T00:19:20.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.598+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=24JWJBNUOA2Q type=write size=334265 2024-09-12T00:19:20.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.599+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~K8VLRMODV1KI.0 size=884414 2024-09-12T00:19:20.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.601+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=K8VLRMODV1KI tag=FE7TGXELYMDZ type=write size=1932990 2024-09-12T00:19:20.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.603+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=ISU48650SNHL type=del size=196312 2024-09-12T00:19:20.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.604+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~WA1TS2SFRAMP.0 size=1048576 2024-09-12T00:19:20.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.605+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~WA1TS2SFRAMP.1 size=1048576 2024-09-12T00:19:20.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.607+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~WA1TS2SFRAMP.2 size=652312 2024-09-12T00:19:20.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.609+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=WA1TS2SFRAMP tag=48AKED5KWXEY type=write size=3798040 2024-09-12T00:19:20.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.610+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=UBOZG97M3H2S type=del size=3572707 2024-09-12T00:19:20.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.613+0000 7f682945b780 1 < suggested remove operation key=8D9UC8FJ16UK tag=N2TU19QXMAXS type=del 2024-09-12T00:19:20.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.615+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~3T3QQQKIGYVJ.0 size=1048576 2024-09-12T00:19:20.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.616+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~3T3QQQKIGYVJ.1 size=1048576 2024-09-12T00:19:20.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.617+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~3T3QQQKIGYVJ.2 size=502908 2024-09-12T00:19:20.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.617+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=3T3QQQKIGYVJ tag=UQPAR0J7DO47 type=write size=3648636 2024-09-12T00:19:20.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.619+0000 7f682945b780 -1 < failed to complete operation key=CE5EBY7EGY4Z tag=QW3QVDGFM8R0 type=del size=1918014: (22) Invalid argument 2024-09-12T00:19:20.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.622+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~1ROAEAZNRG9A.0 size=787692 2024-09-12T00:19:20.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.622+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=1ROAEAZNRG9A tag=QQMAJFVVGSZF type=write size=1836268 2024-09-12T00:19:20.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.623+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~6RN2M557RNKD.0 size=1048576 2024-09-12T00:19:20.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.624+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~6RN2M557RNKD.1 size=1048576 2024-09-12T00:19:20.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.625+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~6RN2M557RNKD.2 size=704801 2024-09-12T00:19:20.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.628+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=6RN2M557RNKD tag=2NKRZTQBJ0FA type=write size=3850529 2024-09-12T00:19:20.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.629+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=7KTRDERJ0BMX type=del size=2459067 2024-09-12T00:19:20.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.631+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~T698F6HC7D78.0 size=1019271 2024-09-12T00:19:20.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.633+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=T698F6HC7D78 tag=T1PQK6HO05KN type=write size=2067847 2024-09-12T00:19:20.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.635+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~E6UWF4LO235B.0 size=978160 2024-09-12T00:19:20.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.635+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=E6UWF4LO235B tag=0O1H2DPG4ET2 type=write size=2026736 2024-09-12T00:19:20.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.637+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=0VZU7IY7E8KM type=del 2024-09-12T00:19:20.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.639+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~6O7GQ770IKE6.0 size=1048576 2024-09-12T00:19:20.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.640+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~6O7GQ770IKE6.1 size=1048576 2024-09-12T00:19:20.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.641+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~6O7GQ770IKE6.2 size=562924 2024-09-12T00:19:20.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.641+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=6O7GQ770IKE6 tag=NCRCAFDOKB2H type=write size=3708652 2024-09-12T00:19:20.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.643+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~64GCVBX1ZOJ4.0 size=1048576 2024-09-12T00:19:20.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.644+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~64GCVBX1ZOJ4.1 size=370132 2024-09-12T00:19:20.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.646+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=64GCVBX1ZOJ4 tag=M3B2IOSRIBYX type=write size=2467284 2024-09-12T00:19:20.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.647+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=TUG1W10ZR5EW type=del size=1861188 2024-09-12T00:19:20.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.649+0000 7f682945b780 1 < completed write operation key=3JFMN39G6TTF tag=E3ZOCIS2JUV1 type=write size=606488 2024-09-12T00:19:20.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.650+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=86V64NN02PQ0 type=del size=2632517 2024-09-12T00:19:20.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.651+0000 7f682945b780 -1 < no bi entry to suggest for operation key=8D9UC8FJ16UK tag=PCGVLQ7UUH7Z type=del size=3652726: (2) No such file or directory 2024-09-12T00:19:20.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.654+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~AAY0TB1AHFCO.0 size=1048576 2024-09-12T00:19:20.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.654+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~AAY0TB1AHFCO.1 size=1048576 2024-09-12T00:19:20.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.655+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~AAY0TB1AHFCO.2 size=76312 2024-09-12T00:19:20.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.655+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=AAY0TB1AHFCO tag=6FCBA8KREUVH type=write size=3222040 2024-09-12T00:19:20.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.657+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~BG1ZK3HSU2BI.0 size=1048576 2024-09-12T00:19:20.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.659+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~BG1ZK3HSU2BI.1 size=1048576 2024-09-12T00:19:20.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.659+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~BG1ZK3HSU2BI.2 size=783993 2024-09-12T00:19:20.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.662+0000 7f682945b780 1 < completed multipart upload key=8D9UC8FJ16UK upload=BG1ZK3HSU2BI tag=MRXAJX2V2IWR type=write size=3929721 2024-09-12T00:19:20.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.663+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=7IHYJ6MBR5KZ type=del size=343568 2024-09-12T00:19:20.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.664+0000 7f682945b780 1 < canceled operation key=D06ZUP2ZXX42 tag=BFMT07YJJJFT type=del size=51071 2024-09-12T00:19:20.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.666+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=8GV4HK7TN3X7 type=del size=1886135 2024-09-12T00:19:20.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.669+0000 7f682945b780 1 < suggested update operation key=8D9UC8FJ16UK tag=P5XPKP32HHLL type=write size=299374 2024-09-12T00:19:20.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.671+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~QELI9O9UZ2W1.0 size=1048576 2024-09-12T00:19:20.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.672+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~QELI9O9UZ2W1.1 size=1048576 2024-09-12T00:19:20.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.673+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~QELI9O9UZ2W1.2 size=470033 2024-09-12T00:19:20.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.673+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=QELI9O9UZ2W1 tag=QKTTQ8RCGE2D type=write size=3615761 2024-09-12T00:19:20.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.674+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~GCDZNV8W32TM.0 size=1048576 2024-09-12T00:19:20.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.675+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~GCDZNV8W32TM.1 size=941261 2024-09-12T00:19:20.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.678+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=GCDZNV8W32TM tag=ZAAWDTIA1X0E type=write size=3038413 2024-09-12T00:19:20.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.680+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=137RNAM4ZV1R type=del size=3515737 2024-09-12T00:19:20.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.681+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~ICRIAJSVUM8I.0 size=1048576 2024-09-12T00:19:20.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.682+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~ICRIAJSVUM8I.1 size=876759 2024-09-12T00:19:20.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.684+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=ICRIAJSVUM8I tag=ZSKUNEISP050 type=write size=2973911 2024-09-12T00:19:20.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.686+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=69U0BNC1W5UT type=del size=3215342 2024-09-12T00:19:20.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.687+0000 7f682945b780 1 < canceled operation key=JAVE3HR52R5C tag=24JWJBNUOA2Q type=write size=334265 2024-09-12T00:19:20.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.689+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~6PG0S19D648O.0 size=412799 2024-09-12T00:19:20.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.689+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=6PG0S19D648O tag=SRBIGSB7KGL0 type=write size=1461375 2024-09-12T00:19:20.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.691+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=ISU48650SNHL type=del 2024-09-12T00:19:20.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.692+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=K7D0Z2Y74EW0 type=del size=1381340 2024-09-12T00:19:20.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.693+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=UBOZG97M3H2S type=del 2024-09-12T00:19:20.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.695+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~3G8I5KTMGWUJ.0 size=183512 2024-09-12T00:19:20.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.695+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=3G8I5KTMGWUJ tag=SJMFDC1NJZWZ type=write size=1232088 2024-09-12T00:19:20.695 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.697+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~3T3QQQKIGYVJ.0 size=1048576 2024-09-12T00:19:20.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.698+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~3T3QQQKIGYVJ.1 size=1048576 2024-09-12T00:19:20.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.699+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~3T3QQQKIGYVJ.2 size=502908 2024-09-12T00:19:20.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.700+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=3T3QQQKIGYVJ tag=UQPAR0J7DO47 type=write size=3648636 2024-09-12T00:19:20.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.702+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=3T2NKF2MLLC9 type=del size=162499 2024-09-12T00:19:20.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.703+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~1ROAEAZNRG9A.0 size=787692 2024-09-12T00:19:20.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.706+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=1ROAEAZNRG9A tag=QQMAJFVVGSZF type=write size=1836268 2024-09-12T00:19:20.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.707+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=UYG91RA8BN8O type=del size=1277474 2024-09-12T00:19:20.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.708+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=7KTRDERJ0BMX type=del 2024-09-12T00:19:20.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.710+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~EFA89L038G3J.0 size=273742 2024-09-12T00:19:20.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.710+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=EFA89L038G3J tag=59Q9DKXQHGAU type=write size=1322318 2024-09-12T00:19:20.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.712+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~E6UWF4LO235B.0 size=978160 2024-09-12T00:19:20.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.714+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=E6UWF4LO235B tag=0O1H2DPG4ET2 type=write size=2026736 2024-09-12T00:19:20.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.715+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=2T143NSXXHM4 type=write size=434326 2024-09-12T00:19:20.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.717+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~6O7GQ770IKE6.0 size=1048576 2024-09-12T00:19:20.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.718+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~6O7GQ770IKE6.1 size=1048576 2024-09-12T00:19:20.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.718+0000 7f682945b780 1 < canceled part key=_multipart_IYYTX8TCLF30.2~6O7GQ770IKE6.2 size=562924 2024-09-12T00:19:20.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.720+0000 7f682945b780 1 < canceled multipart upload key=IYYTX8TCLF30 upload=6O7GQ770IKE6 tag=NCRCAFDOKB2H type=write size=3708652 2024-09-12T00:19:20.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.722+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~O8TTL5480K8S.0 size=800892 2024-09-12T00:19:20.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.722+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=O8TTL5480K8S tag=1WML2Q71NLEA type=write size=1849468 2024-09-12T00:19:20.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.724+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=TUG1W10ZR5EW type=del 2024-09-12T00:19:20.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.726+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~YSGTO573JBEG.0 size=1048576 2024-09-12T00:19:20.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.727+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~YSGTO573JBEG.1 size=467957 2024-09-12T00:19:20.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.727+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=YSGTO573JBEG tag=Z5D834TFVDS5 type=write size=2565109 2024-09-12T00:19:20.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.728+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=86V64NN02PQ0 type=del 2024-09-12T00:19:20.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.731+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~0YFODL8QJ7CO.0 size=1048576 2024-09-12T00:19:20.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.732+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~0YFODL8QJ7CO.1 size=1048576 2024-09-12T00:19:20.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.733+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~0YFODL8QJ7CO.2 size=807891 2024-09-12T00:19:20.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.733+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=0YFODL8QJ7CO tag=54DNTNCK7QGB type=write size=3953619 2024-09-12T00:19:20.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.734+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~AAY0TB1AHFCO.0 size=1048576 2024-09-12T00:19:20.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.735+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~AAY0TB1AHFCO.1 size=1048576 2024-09-12T00:19:20.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.737+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~AAY0TB1AHFCO.2 size=76312 2024-09-12T00:19:20.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.740+0000 7f682945b780 1 < completed multipart upload key=CT2L8L3849IN upload=AAY0TB1AHFCO tag=6FCBA8KREUVH type=write size=3222040 2024-09-12T00:19:20.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.740+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=YZA0MPYSEN36 type=del size=2555496 2024-09-12T00:19:20.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.743+0000 7f682945b780 1 < suggested update operation key=CT2L8L3849IN tag=7IHYJ6MBR5KZ type=del size=343568 2024-09-12T00:19:20.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.746+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~GLJJ4PSVXLZZ.0 size=1048576 2024-09-12T00:19:20.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.747+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~GLJJ4PSVXLZZ.1 size=1048576 2024-09-12T00:19:20.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.748+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~GLJJ4PSVXLZZ.2 size=1008447 2024-09-12T00:19:20.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.748+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=GLJJ4PSVXLZZ tag=E5P3LV954WFB type=write size=4154175 2024-09-12T00:19:20.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.750+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=8GV4HK7TN3X7 type=del 2024-09-12T00:19:20.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.751+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=7RPHGP7S3VXN type=del size=108155 2024-09-12T00:19:20.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.753+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~QELI9O9UZ2W1.0 size=1048576 2024-09-12T00:19:20.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.755+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~QELI9O9UZ2W1.1 size=1048576 2024-09-12T00:19:20.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.755+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~QELI9O9UZ2W1.2 size=470033 2024-09-12T00:19:20.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.759+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=QELI9O9UZ2W1 tag=QKTTQ8RCGE2D type=write size=3615761 2024-09-12T00:19:20.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.760+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=9KEEUDA8LX3J type=del size=3230182 2024-09-12T00:19:20.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.761+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=137RNAM4ZV1R type=del 2024-09-12T00:19:20.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.764+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=JLARCEN3V5QO type=del size=1760137 2024-09-12T00:19:20.765 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.767+0000 7f682945b780 1 < suggested remove operation key=7RRJO383D8TH tag=69U0BNC1W5UT type=del 2024-09-12T00:19:20.767 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.768+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=1KQMGHBQ5NYQ type=del size=2448984 2024-09-12T00:19:20.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.770+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~6PG0S19D648O.0 size=412799 2024-09-12T00:19:20.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.773+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=6PG0S19D648O tag=SRBIGSB7KGL0 type=write size=1461375 2024-09-12T00:19:20.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.774+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=L272L282P012 type=del size=3923894 2024-09-12T00:19:20.774 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.776+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=K7D0Z2Y74EW0 type=del 2024-09-12T00:19:20.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.778+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~FS9IPDOQ3AY9.0 size=1048576 2024-09-12T00:19:20.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.780+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~FS9IPDOQ3AY9.1 size=1048576 2024-09-12T00:19:20.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.781+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~FS9IPDOQ3AY9.2 size=793676 2024-09-12T00:19:20.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.781+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=FS9IPDOQ3AY9 tag=R89BZ889L5VH type=write size=3939404 2024-09-12T00:19:20.781 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.782+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~3G8I5KTMGWUJ.0 size=183512 2024-09-12T00:19:20.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.785+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=3G8I5KTMGWUJ tag=SJMFDC1NJZWZ type=write size=1232088 2024-09-12T00:19:20.785 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.787+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=FBU959833WZ7 type=del size=922661 2024-09-12T00:19:20.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.788+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=3T2NKF2MLLC9 type=del 2024-09-12T00:19:20.789 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.791+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~RR8156WL4JWM.0 size=1048576 2024-09-12T00:19:20.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.793+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~RR8156WL4JWM.1 size=723802 2024-09-12T00:19:20.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.793+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=RR8156WL4JWM tag=KL0FFAQE8UHD type=write size=2820954 2024-09-12T00:19:20.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.794+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=UYG91RA8BN8O type=del 2024-09-12T00:19:20.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.795+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=9413TOEPP40G type=del size=3435204 2024-09-12T00:19:20.795 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.797+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~EFA89L038G3J.0 size=273742 2024-09-12T00:19:20.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.799+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=EFA89L038G3J tag=59Q9DKXQHGAU type=write size=1322318 2024-09-12T00:19:20.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.801+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=69PI92VXMZCG type=write size=943429 2024-09-12T00:19:20.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.802+0000 7f682945b780 -1 < failed to complete operation key=CT2L8L3849IN tag=2T143NSXXHM4 type=write size=434326: (22) Invalid argument 2024-09-12T00:19:20.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.804+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=GDYPN4Y31QE1 type=del size=1296345 2024-09-12T00:19:20.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.806+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~O8TTL5480K8S.0 size=800892 2024-09-12T00:19:20.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.808+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=O8TTL5480K8S tag=1WML2Q71NLEA type=write size=1849468 2024-09-12T00:19:20.808 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.809+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=PP4Q07GJ1MOC type=del size=3616054 2024-09-12T00:19:20.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.811+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~YSGTO573JBEG.0 size=1048576 2024-09-12T00:19:20.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.812+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~YSGTO573JBEG.1 size=467957 2024-09-12T00:19:20.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.814+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=YSGTO573JBEG tag=Z5D834TFVDS5 type=write size=2565109 2024-09-12T00:19:20.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.817+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~E3ZRP77BR2K7.0 size=1048576 2024-09-12T00:19:20.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.817+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~E3ZRP77BR2K7.1 size=1048576 2024-09-12T00:19:20.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.818+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~E3ZRP77BR2K7.2 size=377549 2024-09-12T00:19:20.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.818+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=E3ZRP77BR2K7 tag=7IPNX24YQOJX type=write size=3523277 2024-09-12T00:19:20.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.820+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~0YFODL8QJ7CO.0 size=1048576 2024-09-12T00:19:20.819 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.821+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~0YFODL8QJ7CO.1 size=1048576 2024-09-12T00:19:20.820 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.822+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~0YFODL8QJ7CO.2 size=807891 2024-09-12T00:19:20.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.824+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=0YFODL8QJ7CO tag=54DNTNCK7QGB type=write size=3953619 2024-09-12T00:19:20.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.826+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=AQRBB37R4NXA type=del size=1993264 2024-09-12T00:19:20.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.827+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=YZA0MPYSEN36 type=del 2024-09-12T00:19:20.827 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.828+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=GF84BJN24QML type=del size=1751418 2024-09-12T00:19:20.828 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.830+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~GLJJ4PSVXLZZ.0 size=1048576 2024-09-12T00:19:20.830 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.831+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~GLJJ4PSVXLZZ.1 size=1048576 2024-09-12T00:19:20.831 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.832+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~GLJJ4PSVXLZZ.2 size=1008447 2024-09-12T00:19:20.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.835+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=GLJJ4PSVXLZZ tag=E5P3LV954WFB type=write size=4154175 2024-09-12T00:19:20.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.837+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~7DGIDNQI8BUY.0 size=897621 2024-09-12T00:19:20.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.837+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=7DGIDNQI8BUY tag=N1WDZ33XKHTE type=write size=1946197 2024-09-12T00:19:20.837 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.839+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=7RPHGP7S3VXN type=del 2024-09-12T00:19:20.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.842+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~4GV179BUHETC.0 size=1048576 2024-09-12T00:19:20.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.843+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~4GV179BUHETC.1 size=1048576 2024-09-12T00:19:20.842 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.843+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~4GV179BUHETC.2 size=810236 2024-09-12T00:19:20.842 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.843+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=4GV179BUHETC tag=TTZJ5J1EJR0A type=write size=3955964 2024-09-12T00:19:20.843 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.845+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=9KEEUDA8LX3J type=del 2024-09-12T00:19:20.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.846+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=IP000CMWLCMA type=del size=1727501 2024-09-12T00:19:20.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.848+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=JLARCEN3V5QO type=del 2024-09-12T00:19:20.848 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.849+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=S8F8NISGBFTY type=del size=612933 2024-09-12T00:19:20.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.852+0000 7f682945b780 1 < suggested remove operation key=IYYTX8TCLF30 tag=1KQMGHBQ5NYQ type=del 2024-09-12T00:19:20.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.855+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~LCUKJQ5POY5I.0 size=1048576 2024-09-12T00:19:20.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.856+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~LCUKJQ5POY5I.1 size=1048576 2024-09-12T00:19:20.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.857+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~LCUKJQ5POY5I.2 size=25952 2024-09-12T00:19:20.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.857+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=LCUKJQ5POY5I tag=M3ED038HD4CO type=write size=3171680 2024-09-12T00:19:20.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.859+0000 7f682945b780 -1 < failed to complete operation key=IYYTX8TCLF30 tag=L272L282P012 type=del size=3923894: (22) Invalid argument 2024-09-12T00:19:20.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.860+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=OVJYFYV88APC type=del size=114454 2024-09-12T00:19:20.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.862+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~FS9IPDOQ3AY9.0 size=1048576 2024-09-12T00:19:20.862 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.863+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~FS9IPDOQ3AY9.1 size=1048576 2024-09-12T00:19:20.862 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.863+0000 7f682945b780 1 < canceled part key=_multipart_Z7408WO050VI.2~FS9IPDOQ3AY9.2 size=793676 2024-09-12T00:19:20.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.865+0000 7f682945b780 1 < canceled multipart upload key=Z7408WO050VI upload=FS9IPDOQ3AY9 tag=R89BZ889L5VH type=write size=3939404 2024-09-12T00:19:20.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.867+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=41HHPC3YGWCR type=del size=3015911 2024-09-12T00:19:20.867 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.868+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=FBU959833WZ7 type=del 2024-09-12T00:19:20.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.869+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=6CDVDCFN7204 type=write size=884263 2024-09-12T00:19:20.869 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.872+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~RR8156WL4JWM.0 size=1048576 2024-09-12T00:19:20.871 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.872+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~RR8156WL4JWM.1 size=723802 2024-09-12T00:19:20.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.875+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=RR8156WL4JWM tag=KL0FFAQE8UHD type=write size=2820954 2024-09-12T00:19:20.875 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.876+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=KQDXCM3HJNMN type=write size=927203 2024-09-12T00:19:20.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.879+0000 7f682945b780 1 < suggested update operation key=AZKLWMQ818SW tag=9413TOEPP40G type=del size=3435204 2024-09-12T00:19:20.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.881+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=85IMQK2LPG6D type=del size=2920502 2024-09-12T00:19:20.881 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.883+0000 7f682945b780 1 < completed write operation key=CE5EBY7EGY4Z tag=69PI92VXMZCG type=write size=943429 2024-09-12T00:19:20.884 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.885+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~QWS008TZ5A0T.0 size=1048576 2024-09-12T00:19:20.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.887+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~QWS008TZ5A0T.1 size=1048576 2024-09-12T00:19:20.886 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.887+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~QWS008TZ5A0T.2 size=561024 2024-09-12T00:19:20.886 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.887+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=QWS008TZ5A0T tag=0CC8E0D41TVE type=write size=3706752 2024-09-12T00:19:20.889 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.890+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=GDYPN4Y31QE1 type=del 2024-09-12T00:19:20.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.893+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~29F007OF4U7D.0 size=1048576 2024-09-12T00:19:20.893 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.895+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~29F007OF4U7D.1 size=648109 2024-09-12T00:19:20.893 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.895+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=29F007OF4U7D tag=G0K0S8J145HX type=write size=2745261 2024-09-12T00:19:20.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.896+0000 7f682945b780 1 < canceled operation key=CE5EBY7EGY4Z tag=PP4Q07GJ1MOC type=del size=3616054 2024-09-12T00:19:20.896 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.898+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=L9RBEQFUE4HH type=del size=4085642 2024-09-12T00:19:20.898 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.900+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~E3ZRP77BR2K7.0 size=1048576 2024-09-12T00:19:20.899 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.901+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~E3ZRP77BR2K7.1 size=1048576 2024-09-12T00:19:20.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.902+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~E3ZRP77BR2K7.2 size=377549 2024-09-12T00:19:20.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.904+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=E3ZRP77BR2K7 tag=7IPNX24YQOJX type=write size=3523277 2024-09-12T00:19:20.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.906+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=Z0G028K874BE type=del size=3526999 2024-09-12T00:19:20.906 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.907+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=AQRBB37R4NXA type=del 2024-09-12T00:19:20.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.909+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=XZGJ69L24Q9U type=del size=3765730 2024-09-12T00:19:20.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.912+0000 7f682945b780 1 < suggested update operation key=BMTPXZ1OA2TZ tag=GF84BJN24QML type=del size=1751418 2024-09-12T00:19:20.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.914+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=7W38NU94WN0U type=del size=436481 2024-09-12T00:19:20.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.915+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~7DGIDNQI8BUY.0 size=897621 2024-09-12T00:19:20.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.917+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=7DGIDNQI8BUY tag=N1WDZ33XKHTE type=write size=1946197 2024-09-12T00:19:20.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.918+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=GXH9W266JMRD type=del size=3196497 2024-09-12T00:19:20.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.920+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~4GV179BUHETC.0 size=1048576 2024-09-12T00:19:20.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.921+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~4GV179BUHETC.1 size=1048576 2024-09-12T00:19:20.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.922+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~4GV179BUHETC.2 size=810236 2024-09-12T00:19:20.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.925+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=4GV179BUHETC tag=TTZJ5J1EJR0A type=write size=3955964 2024-09-12T00:19:20.926 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.928+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~9H7NTGON9Y4Y.0 size=1048576 2024-09-12T00:19:20.927 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.929+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~9H7NTGON9Y4Y.1 size=1048576 2024-09-12T00:19:20.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.929+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~9H7NTGON9Y4Y.2 size=228726 2024-09-12T00:19:20.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.929+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=9H7NTGON9Y4Y tag=ZH29AR96Z9BE type=write size=3374454 2024-09-12T00:19:20.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.931+0000 7f682945b780 -1 < failed to complete operation key=IYYTX8TCLF30 tag=IP000CMWLCMA type=del size=1727501: (22) Invalid argument 2024-09-12T00:19:20.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.934+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~1O4VO4TC1KHL.0 size=769248 2024-09-12T00:19:20.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.934+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=1O4VO4TC1KHL tag=Z24JKP4VSCOU type=write size=1817824 2024-09-12T00:19:20.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.935+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=S8F8NISGBFTY type=del 2024-09-12T00:19:20.936 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.938+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~W4XPSVS3K2WH.0 size=1048576 2024-09-12T00:19:20.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.939+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~W4XPSVS3K2WH.1 size=749017 2024-09-12T00:19:20.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.939+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=W4XPSVS3K2WH tag=NHG1GU13URRT type=write size=2846169 2024-09-12T00:19:20.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.940+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~LCUKJQ5POY5I.0 size=1048576 2024-09-12T00:19:20.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.941+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~LCUKJQ5POY5I.1 size=1048576 2024-09-12T00:19:20.942 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.944+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~LCUKJQ5POY5I.2 size=25952 2024-09-12T00:19:20.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.946+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=LCUKJQ5POY5I tag=M3ED038HD4CO type=write size=3171680 2024-09-12T00:19:20.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.947+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=SMK3CLIOKL3P type=del size=1333235 2024-09-12T00:19:20.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.949+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=OVJYFYV88APC type=del 2024-09-12T00:19:20.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.951+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~5IA5QYL77S49.0 size=1048576 2024-09-12T00:19:20.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.952+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~5IA5QYL77S49.1 size=1048576 2024-09-12T00:19:20.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.953+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~5IA5QYL77S49.2 size=108902 2024-09-12T00:19:20.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.953+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=5IA5QYL77S49 tag=30A3HLLZ7B8N type=write size=3254630 2024-09-12T00:19:20.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.956+0000 7f682945b780 1 < suggested update operation key=AZKLWMQ818SW tag=41HHPC3YGWCR type=del size=3015911 2024-09-12T00:19:20.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.958+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=N5O5F1X3AP43 type=del size=596479 2024-09-12T00:19:20.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.959+0000 7f682945b780 1 < completed write operation key=IYYTX8TCLF30 tag=6CDVDCFN7204 type=write size=884263 2024-09-12T00:19:20.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.961+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=IZ6Z6S51KOLG type=write size=134478 2024-09-12T00:19:20.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.962+0000 7f682945b780 1 < completed write operation key=CT2L8L3849IN tag=KQDXCM3HJNMN type=write size=927203 2024-09-12T00:19:20.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.964+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~GSHX7BB028UV.0 size=113221 2024-09-12T00:19:20.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.964+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=GSHX7BB028UV tag=RHDOZUAIPNI5 type=write size=1161797 2024-09-12T00:19:20.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.966+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=85IMQK2LPG6D type=del 2024-09-12T00:19:20.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.968+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~VS1V2IVAVO3K.0 size=1048576 2024-09-12T00:19:20.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.969+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~VS1V2IVAVO3K.1 size=1048576 2024-09-12T00:19:20.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.970+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~VS1V2IVAVO3K.2 size=64486 2024-09-12T00:19:20.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.970+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=VS1V2IVAVO3K tag=SAMPXLFM8YCP type=write size=3210214 2024-09-12T00:19:20.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.972+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~QWS008TZ5A0T.0 size=1048576 2024-09-12T00:19:20.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.973+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~QWS008TZ5A0T.1 size=1048576 2024-09-12T00:19:20.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.974+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~QWS008TZ5A0T.2 size=561024 2024-09-12T00:19:20.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.976+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=QWS008TZ5A0T tag=0CC8E0D41TVE type=write size=3706752 2024-09-12T00:19:20.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.978+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~7KRJG741Q9K9.0 size=1048576 2024-09-12T00:19:20.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.980+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~7KRJG741Q9K9.1 size=1048576 2024-09-12T00:19:20.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.981+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~7KRJG741Q9K9.2 size=795100 2024-09-12T00:19:20.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.981+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=7KRJG741Q9K9 tag=KDEHTUIQSZ28 type=write size=3940828 2024-09-12T00:19:20.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.982+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~29F007OF4U7D.0 size=1048576 2024-09-12T00:19:20.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.983+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~29F007OF4U7D.1 size=648109 2024-09-12T00:19:20.984 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.986+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=29F007OF4U7D tag=G0K0S8J145HX type=write size=2745261 2024-09-12T00:19:20.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.988+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~QJF871HUV2A6.0 size=1041152 2024-09-12T00:19:20.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.988+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=QJF871HUV2A6 tag=SFFEI9ESEQWK type=write size=2089728 2024-09-12T00:19:20.988 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.989+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=L9RBEQFUE4HH type=del 2024-09-12T00:19:20.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.991+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=TI36908KJUAB type=del size=3417068 2024-09-12T00:19:20.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.992+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=Z0G028K874BE type=del 2024-09-12T00:19:20.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.993+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=6832QXW8F99Q type=del size=1859543 2024-09-12T00:19:20.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.995+0000 7f682945b780 -1 < failed to complete operation key=BMTPXZ1OA2TZ tag=XZGJ69L24Q9U type=del size=3765730: (22) Invalid argument 2024-09-12T00:19:20.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.998+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~WQUQ3CYERNEN.0 size=1048576 2024-09-12T00:19:20.997 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.999+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~WQUQ3CYERNEN.1 size=123741 2024-09-12T00:19:20.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:20.999+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=WQUQ3CYERNEN tag=2GBOCNNZPZER type=write size=2220893 2024-09-12T00:19:20.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.000+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=7W38NU94WN0U type=del 2024-09-12T00:19:21.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.002+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=D2FZ2198A89R type=del size=2290344 2024-09-12T00:19:21.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.004+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=GXH9W266JMRD type=del 2024-09-12T00:19:21.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.006+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~W8D3OG65BJT3.0 size=1048576 2024-09-12T00:19:21.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.008+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~W8D3OG65BJT3.1 size=1048576 2024-09-12T00:19:21.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.009+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~W8D3OG65BJT3.2 size=756314 2024-09-12T00:19:21.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.009+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=W8D3OG65BJT3 tag=0K55FAK88H27 type=write size=3902042 2024-09-12T00:19:21.009 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.010+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~9H7NTGON9Y4Y.0 size=1048576 2024-09-12T00:19:21.010 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.011+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~9H7NTGON9Y4Y.1 size=1048576 2024-09-12T00:19:21.011 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.013+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~9H7NTGON9Y4Y.2 size=228726 2024-09-12T00:19:21.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.015+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=9H7NTGON9Y4Y tag=ZH29AR96Z9BE type=write size=3374454 2024-09-12T00:19:21.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.017+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=APCHXMST016C type=write size=935534 2024-09-12T00:19:21.017 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.018+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~1O4VO4TC1KHL.0 size=769248 2024-09-12T00:19:21.019 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.021+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=1O4VO4TC1KHL tag=Z24JKP4VSCOU type=write size=1817824 2024-09-12T00:19:21.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.023+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=22BVM3MYHL2D type=del size=181694 2024-09-12T00:19:21.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.024+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~W4XPSVS3K2WH.0 size=1048576 2024-09-12T00:19:21.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.025+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~W4XPSVS3K2WH.1 size=749017 2024-09-12T00:19:21.026 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.027+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=W4XPSVS3K2WH tag=NHG1GU13URRT type=write size=2846169 2024-09-12T00:19:21.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.031+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~S0EV3LF8DPKO.0 size=1048576 2024-09-12T00:19:21.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.031+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~S0EV3LF8DPKO.1 size=365545 2024-09-12T00:19:21.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.031+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=S0EV3LF8DPKO tag=SFXP1HUF8P2J type=write size=2462697 2024-09-12T00:19:21.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.033+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=SMK3CLIOKL3P type=del 2024-09-12T00:19:21.034 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.035+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~7SIVJCPGXGU0.0 size=1048576 2024-09-12T00:19:21.035 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.037+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~7SIVJCPGXGU0.1 size=536610 2024-09-12T00:19:21.035 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.037+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=7SIVJCPGXGU0 tag=8U7B9FMLGE2S type=write size=2633762 2024-09-12T00:19:21.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.039+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~5IA5QYL77S49.0 size=1048576 2024-09-12T00:19:21.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.039+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~5IA5QYL77S49.1 size=1048576 2024-09-12T00:19:21.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.040+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~5IA5QYL77S49.2 size=108902 2024-09-12T00:19:21.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.044+0000 7f682945b780 1 < completed multipart upload key=8D9UC8FJ16UK upload=5IA5QYL77S49 tag=30A3HLLZ7B8N type=write size=3254630 2024-09-12T00:19:21.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.046+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~OZAQUHDBRJRG.0 size=1048576 2024-09-12T00:19:21.046 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.047+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~OZAQUHDBRJRG.1 size=863873 2024-09-12T00:19:21.046 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.047+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=OZAQUHDBRJRG tag=P1IXP8XKW3VY type=write size=2961025 2024-09-12T00:19:21.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.049+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=N5O5F1X3AP43 type=del 2024-09-12T00:19:21.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.053+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~VD2Z3L0Q1PVC.0 size=83079 2024-09-12T00:19:21.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.053+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=VD2Z3L0Q1PVC tag=PB33DHMQ6SI0 type=write size=1131655 2024-09-12T00:19:21.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.054+0000 7f682945b780 1 < completed write operation key=TYNSP8BHYO65 tag=IZ6Z6S51KOLG type=write size=134478 2024-09-12T00:19:21.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.056+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=QY35IT8LJEGF type=del size=3639229 2024-09-12T00:19:21.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.057+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~GSHX7BB028UV.0 size=113221 2024-09-12T00:19:21.058 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.059+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=GSHX7BB028UV tag=RHDOZUAIPNI5 type=write size=1161797 2024-09-12T00:19:21.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.061+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=3CBCTEIIV4BC type=write size=620911 2024-09-12T00:19:21.060 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.062+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~VS1V2IVAVO3K.0 size=1048576 2024-09-12T00:19:21.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.064+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~VS1V2IVAVO3K.1 size=1048576 2024-09-12T00:19:21.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.064+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~VS1V2IVAVO3K.2 size=64486 2024-09-12T00:19:21.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.068+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=VS1V2IVAVO3K tag=SAMPXLFM8YCP type=write size=3210214 2024-09-12T00:19:21.067 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.069+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=J6XLM2VAMGMC type=del size=3025838 2024-09-12T00:19:21.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.071+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~7KRJG741Q9K9.0 size=1048576 2024-09-12T00:19:21.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.071+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~7KRJG741Q9K9.1 size=1048576 2024-09-12T00:19:21.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.072+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~7KRJG741Q9K9.2 size=795100 2024-09-12T00:19:21.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.076+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=7KRJG741Q9K9 tag=KDEHTUIQSZ28 type=write size=3940828 2024-09-12T00:19:21.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.077+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=F3RLJX6026HW type=del size=1446658 2024-09-12T00:19:21.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.079+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~QJF871HUV2A6.0 size=1041152 2024-09-12T00:19:21.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.081+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=QJF871HUV2A6 tag=SFFEI9ESEQWK type=write size=2089728 2024-09-12T00:19:21.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.084+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~UJ522TVLOSU1.0 size=1048576 2024-09-12T00:19:21.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.085+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~UJ522TVLOSU1.1 size=1048576 2024-09-12T00:19:21.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.086+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~UJ522TVLOSU1.2 size=536132 2024-09-12T00:19:21.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.086+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=UJ522TVLOSU1 tag=6RX1PYRNA7PO type=write size=3681860 2024-09-12T00:19:21.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.088+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=TI36908KJUAB type=del 2024-09-12T00:19:21.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.088+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=YDPPE7OSVB86 type=del size=3309205 2024-09-12T00:19:21.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.090+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=6832QXW8F99Q type=del 2024-09-12T00:19:21.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.093+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~LSGT1B3ZDRPO.0 size=1048576 2024-09-12T00:19:21.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.094+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~LSGT1B3ZDRPO.1 size=1048576 2024-09-12T00:19:21.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.095+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~LSGT1B3ZDRPO.2 size=635827 2024-09-12T00:19:21.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.095+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=LSGT1B3ZDRPO tag=03UYENP9MYBR type=write size=3781555 2024-09-12T00:19:21.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.096+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~WQUQ3CYERNEN.0 size=1048576 2024-09-12T00:19:21.096 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.097+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~WQUQ3CYERNEN.1 size=123741 2024-09-12T00:19:21.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.099+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=WQUQ3CYERNEN tag=2GBOCNNZPZER type=write size=2220893 2024-09-12T00:19:21.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.101+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=X1URGERTSHOR type=del size=1993072 2024-09-12T00:19:21.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.102+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=D2FZ2198A89R type=del 2024-09-12T00:19:21.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.103+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=JUF707HHOVNC type=del size=1437878 2024-09-12T00:19:21.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.105+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~W8D3OG65BJT3.0 size=1048576 2024-09-12T00:19:21.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.105+0000 7f682945b780 1 < canceled part key=_multipart_BI3KCKV4CRWR.2~W8D3OG65BJT3.1 size=1048576 2024-09-12T00:19:21.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.106+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~W8D3OG65BJT3.2 size=756314 2024-09-12T00:19:21.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.109+0000 7f682945b780 1 < canceled multipart upload key=BI3KCKV4CRWR upload=W8D3OG65BJT3 tag=0K55FAK88H27 type=write size=3902042 2024-09-12T00:19:21.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.110+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=5X3KDUE9I6L1 type=del size=4169610 2024-09-12T00:19:21.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.112+0000 7f682945b780 1 < completed write operation key=8D9UC8FJ16UK tag=APCHXMST016C type=write size=935534 2024-09-12T00:19:21.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.113+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=J4AU4ULCX01M type=del size=983661 2024-09-12T00:19:21.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.115+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=22BVM3MYHL2D type=del 2024-09-12T00:19:21.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.116+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=J81U1HNT0O9Z type=del size=1208290 2024-09-12T00:19:21.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.118+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~S0EV3LF8DPKO.0 size=1048576 2024-09-12T00:19:21.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.119+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~S0EV3LF8DPKO.1 size=365545 2024-09-12T00:19:21.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.122+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=S0EV3LF8DPKO tag=SFXP1HUF8P2J type=write size=2462697 2024-09-12T00:19:21.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.123+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=WKSKKQOYDGXJ type=del size=1728943 2024-09-12T00:19:21.123 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.124+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~7SIVJCPGXGU0.0 size=1048576 2024-09-12T00:19:21.123 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.124+0000 7f682945b780 1 < canceled part key=_multipart_17S1X3WXCNAR.2~7SIVJCPGXGU0.1 size=536610 2024-09-12T00:19:21.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.127+0000 7f682945b780 1 < canceled multipart upload key=17S1X3WXCNAR upload=7SIVJCPGXGU0 tag=8U7B9FMLGE2S type=write size=2633762 2024-09-12T00:19:21.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.128+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=DY4YAFAMR2RC type=del size=172789 2024-09-12T00:19:21.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.128+0000 7f682945b780 1 < canceled part key=_multipart_8D9UC8FJ16UK.2~OZAQUHDBRJRG.0 size=1048576 2024-09-12T00:19:21.128 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.129+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~OZAQUHDBRJRG.1 size=863873 2024-09-12T00:19:21.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.131+0000 7f682945b780 1 < canceled multipart upload key=8D9UC8FJ16UK upload=OZAQUHDBRJRG tag=P1IXP8XKW3VY type=write size=2961025 2024-09-12T00:19:21.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.133+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=TYWU1JFJNQYY type=del size=2566569 2024-09-12T00:19:21.133 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.134+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~VD2Z3L0Q1PVC.0 size=83079 2024-09-12T00:19:21.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.136+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=VD2Z3L0Q1PVC tag=PB33DHMQ6SI0 type=write size=1131655 2024-09-12T00:19:21.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.139+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=BP1X0CHYFTYW type=write size=257649 2024-09-12T00:19:21.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.140+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=QY35IT8LJEGF type=del 2024-09-12T00:19:21.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.142+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=2QUPYTAHXH9J type=write size=9327 2024-09-12T00:19:21.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.145+0000 7f682945b780 1 < suggested remove operation key=8D9UC8FJ16UK tag=3CBCTEIIV4BC type=write 2024-09-12T00:19:21.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.146+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=EHP9Q1479PO3 type=del size=1742781 2024-09-12T00:19:21.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.148+0000 7f682945b780 -1 < failed to complete operation key=8D9UC8FJ16UK tag=J6XLM2VAMGMC type=del size=3025838: (22) Invalid argument 2024-09-12T00:19:21.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.149+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=PO6SG9U63K0U type=del size=3569179 2024-09-12T00:19:21.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.152+0000 7f682945b780 1 < suggested update operation key=TYNSP8BHYO65 tag=F3RLJX6026HW type=del size=1446658 2024-09-12T00:19:21.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.153+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=UES3THVTB6Y0 type=del size=1846508 2024-09-12T00:19:21.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.155+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~UJ522TVLOSU1.0 size=1048576 2024-09-12T00:19:21.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.156+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~UJ522TVLOSU1.1 size=1048576 2024-09-12T00:19:21.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.157+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~UJ522TVLOSU1.2 size=536132 2024-09-12T00:19:21.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.160+0000 7f682945b780 1 < completed multipart upload key=CT2L8L3849IN upload=UJ522TVLOSU1 tag=6RX1PYRNA7PO type=write size=3681860 2024-09-12T00:19:21.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.162+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~ZOCLZ1DAF2ZP.0 size=1048576 2024-09-12T00:19:21.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.163+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~ZOCLZ1DAF2ZP.1 size=1048576 2024-09-12T00:19:21.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.165+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~ZOCLZ1DAF2ZP.2 size=149610 2024-09-12T00:19:21.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.165+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=ZOCLZ1DAF2ZP tag=35EQYT9UB5HZ type=write size=3295338 2024-09-12T00:19:21.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.166+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=YDPPE7OSVB86 type=del 2024-09-12T00:19:21.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.168+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=IGMKRKRDGBMF type=del size=2138800 2024-09-12T00:19:21.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.169+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~LSGT1B3ZDRPO.0 size=1048576 2024-09-12T00:19:21.169 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.170+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~LSGT1B3ZDRPO.1 size=1048576 2024-09-12T00:19:21.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.171+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~LSGT1B3ZDRPO.2 size=635827 2024-09-12T00:19:21.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.174+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=LSGT1B3ZDRPO tag=03UYENP9MYBR type=write size=3781555 2024-09-12T00:19:21.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.175+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=S6Z5TXID9ZCB type=del size=1527571 2024-09-12T00:19:21.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.178+0000 7f682945b780 1 < suggested update operation key=R7V03ML1H80V tag=X1URGERTSHOR type=del size=1993072 2024-09-12T00:19:21.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.181+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~1IV6WDWV93PJ.0 size=909151 2024-09-12T00:19:21.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.181+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=1IV6WDWV93PJ tag=JTQI8GDBY9I5 type=write size=1957727 2024-09-12T00:19:21.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.182+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=JUF707HHOVNC type=del 2024-09-12T00:19:21.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.184+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=M0B7M3Y38XMI type=write size=661537 2024-09-12T00:19:21.183 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.185+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=5X3KDUE9I6L1 type=del 2024-09-12T00:19:21.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.187+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~10BKJ4N5D3CX.0 size=1048576 2024-09-12T00:19:21.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.189+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~10BKJ4N5D3CX.1 size=351891 2024-09-12T00:19:21.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.189+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=10BKJ4N5D3CX tag=IV0LPGU643S1 type=write size=2449043 2024-09-12T00:19:21.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.190+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=J4AU4ULCX01M type=del 2024-09-12T00:19:21.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.193+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~4KT0FLD04I8Y.0 size=1048576 2024-09-12T00:19:21.192 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.194+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~4KT0FLD04I8Y.1 size=850628 2024-09-12T00:19:21.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.194+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=4KT0FLD04I8Y tag=DV82NA8LNFSF type=write size=2947780 2024-09-12T00:19:21.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.195+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=J81U1HNT0O9Z type=del 2024-09-12T00:19:21.196 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.197+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=UVILZPX4O13O type=del size=2858650 2024-09-12T00:19:21.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.198+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=WKSKKQOYDGXJ type=del 2024-09-12T00:19:21.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.201+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~7KIFFK5M7Q65.0 size=1048576 2024-09-12T00:19:21.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.202+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~7KIFFK5M7Q65.1 size=460400 2024-09-12T00:19:21.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.202+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=7KIFFK5M7Q65 tag=NEL4JYUBQKOL type=write size=2557552 2024-09-12T00:19:21.202 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.203+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=DY4YAFAMR2RC type=del 2024-09-12T00:19:21.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.205+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=F4C40WKNZKKB type=del size=1574211 2024-09-12T00:19:21.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.206+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=TYWU1JFJNQYY type=del 2024-09-12T00:19:21.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.209+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~9QUNRD3ZVDNX.0 size=1048576 2024-09-12T00:19:21.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.210+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~9QUNRD3ZVDNX.1 size=1048576 2024-09-12T00:19:21.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.211+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~9QUNRD3ZVDNX.2 size=140359 2024-09-12T00:19:21.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.211+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=9QUNRD3ZVDNX tag=SICCLIVMRF20 type=write size=3286087 2024-09-12T00:19:21.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.212+0000 7f682945b780 1 < completed write operation key=EYHGJ82COSE9 tag=BP1X0CHYFTYW type=write size=257649 2024-09-12T00:19:21.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.213+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=KACXO1OYKY36 type=del size=612390 2024-09-12T00:19:21.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.216+0000 7f682945b780 1 < suggested update operation key=Z7408WO050VI tag=2QUPYTAHXH9J type=write size=9327 2024-09-12T00:19:21.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.217+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=3RX3M72VCZHU type=del size=1316044 2024-09-12T00:19:21.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.219+0000 7f682945b780 1 < suggested remove operation key=BI3KCKV4CRWR tag=EHP9Q1479PO3 type=del 2024-09-12T00:19:21.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.221+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=64J0UTKL13QT type=del size=782920 2024-09-12T00:19:21.222 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.223+0000 7f682945b780 1 < suggested update operation key=Z7408WO050VI tag=PO6SG9U63K0U type=del size=3569179 2024-09-12T00:19:21.224 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.226+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~YRPN0PSJU9NX.0 size=1048576 2024-09-12T00:19:21.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.226+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~YRPN0PSJU9NX.1 size=429483 2024-09-12T00:19:21.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.226+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=YRPN0PSJU9NX tag=4EPTJ7RXCSYR type=write size=2526635 2024-09-12T00:19:21.226 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.228+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=UES3THVTB6Y0 type=del 2024-09-12T00:19:21.227 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.229+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=UW1UBJ1BS0UM type=del size=2505515 2024-09-12T00:19:21.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.230+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~ZOCLZ1DAF2ZP.0 size=1048576 2024-09-12T00:19:21.230 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.231+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~ZOCLZ1DAF2ZP.1 size=1048576 2024-09-12T00:19:21.231 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.232+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~ZOCLZ1DAF2ZP.2 size=149610 2024-09-12T00:19:21.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.234+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=ZOCLZ1DAF2ZP tag=35EQYT9UB5HZ type=write size=3295338 2024-09-12T00:19:21.235 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.237+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~URJ2Y9J5XPPQ.0 size=187147 2024-09-12T00:19:21.235 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.237+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=URJ2Y9J5XPPQ tag=D2WNATGELLPR type=write size=1235723 2024-09-12T00:19:21.237 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.238+0000 7f682945b780 1 < completed delete operation key=COUJXCOSVPDS tag=IGMKRKRDGBMF type=del 2024-09-12T00:19:21.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.240+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~4H4B0BE9JQK7.0 size=146101 2024-09-12T00:19:21.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.240+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=4H4B0BE9JQK7 tag=2OWITS3E5WUR type=write size=1194677 2024-09-12T00:19:21.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.242+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=S6Z5TXID9ZCB type=del 2024-09-12T00:19:21.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.244+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~5U5XT6RI8NOA.0 size=1048576 2024-09-12T00:19:21.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.245+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~5U5XT6RI8NOA.1 size=787255 2024-09-12T00:19:21.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.245+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=5U5XT6RI8NOA tag=04ASAI1NMWV3 type=write size=2884407 2024-09-12T00:19:21.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.246+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~1IV6WDWV93PJ.0 size=909151 2024-09-12T00:19:21.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.248+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=1IV6WDWV93PJ tag=JTQI8GDBY9I5 type=write size=1957727 2024-09-12T00:19:21.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.249+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=G2ZAD75E0AS4 type=del size=3209874 2024-09-12T00:19:21.250 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.252+0000 7f682945b780 1 < suggested update operation key=IYYTX8TCLF30 tag=M0B7M3Y38XMI type=write size=661537 2024-09-12T00:19:21.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.254+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~DN0T519QE022.0 size=1048576 2024-09-12T00:19:21.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.256+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~DN0T519QE022.1 size=962345 2024-09-12T00:19:21.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.256+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=DN0T519QE022 tag=YD38HRVC0VWS type=write size=3059497 2024-09-12T00:19:21.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.256+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~10BKJ4N5D3CX.0 size=1048576 2024-09-12T00:19:21.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.258+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~10BKJ4N5D3CX.1 size=351891 2024-09-12T00:19:21.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.260+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=10BKJ4N5D3CX tag=IV0LPGU643S1 type=write size=2449043 2024-09-12T00:19:21.261 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.263+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~69U2TE59V4UX.0 size=1048576 2024-09-12T00:19:21.262 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.263+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~69U2TE59V4UX.1 size=1048576 2024-09-12T00:19:21.263 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.265+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~69U2TE59V4UX.2 size=337478 2024-09-12T00:19:21.263 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.265+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=69U2TE59V4UX tag=875CMC0EP8X3 type=write size=3483206 2024-09-12T00:19:21.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.266+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~4KT0FLD04I8Y.0 size=1048576 2024-09-12T00:19:21.266 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.267+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~4KT0FLD04I8Y.1 size=850628 2024-09-12T00:19:21.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.270+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=4KT0FLD04I8Y tag=DV82NA8LNFSF type=write size=2947780 2024-09-12T00:19:21.271 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.273+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~1KUGSH69W66D.0 size=585713 2024-09-12T00:19:21.271 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.273+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=1KUGSH69W66D tag=JNK9MQ65V1PL type=write size=1634289 2024-09-12T00:19:21.272 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.274+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=UVILZPX4O13O type=del 2024-09-12T00:19:21.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.275+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=UR8ZETI809O1 type=del size=2769377 2024-09-12T00:19:21.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.276+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~7KIFFK5M7Q65.0 size=1048576 2024-09-12T00:19:21.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.278+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~7KIFFK5M7Q65.1 size=460400 2024-09-12T00:19:21.279 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.280+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=7KIFFK5M7Q65 tag=NEL4JYUBQKOL type=write size=2557552 2024-09-12T00:19:21.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.282+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=H7P66KP5TZIU type=write size=789959 2024-09-12T00:19:21.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.286+0000 7f682945b780 1 < suggested remove operation key=COUJXCOSVPDS tag=F4C40WKNZKKB type=del 2024-09-12T00:19:21.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.287+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=3JU4OJCZ5C6D type=del size=3053215 2024-09-12T00:19:21.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.288+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~9QUNRD3ZVDNX.0 size=1048576 2024-09-12T00:19:21.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.290+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~9QUNRD3ZVDNX.1 size=1048576 2024-09-12T00:19:21.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.290+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~9QUNRD3ZVDNX.2 size=140359 2024-09-12T00:19:21.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.293+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=9QUNRD3ZVDNX tag=SICCLIVMRF20 type=write size=3286087 2024-09-12T00:19:21.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.294+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=KE61UH3U5NRB type=write size=752876 2024-09-12T00:19:21.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.296+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=KACXO1OYKY36 type=del 2024-09-12T00:19:21.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.298+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=R4BKQWB50RAU type=del size=4137845 2024-09-12T00:19:21.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.298+0000 7f682945b780 -1 < failed to complete operation key=COUJXCOSVPDS tag=3RX3M72VCZHU type=del size=1316044: (22) Invalid argument 2024-09-12T00:19:21.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.300+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=9HP7YXA4UOSJ type=write size=247342 2024-09-12T00:19:21.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.303+0000 7f682945b780 1 < suggested update operation key=9Q4HFV4F2KE2 tag=64J0UTKL13QT type=del size=782920 2024-09-12T00:19:21.303 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.304+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=WHHA1GRSRHUH type=del size=1193470 2024-09-12T00:19:21.303 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.305+0000 7f682945b780 1 < canceled part key=_multipart_922B2PPJFX2Z.2~YRPN0PSJU9NX.0 size=1048576 2024-09-12T00:19:21.304 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.306+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~YRPN0PSJU9NX.1 size=429483 2024-09-12T00:19:21.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.308+0000 7f682945b780 1 < canceled multipart upload key=922B2PPJFX2Z upload=YRPN0PSJU9NX tag=4EPTJ7RXCSYR type=write size=2526635 2024-09-12T00:19:21.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.310+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=FC1IB3C82WIT type=del size=3146243 2024-09-12T00:19:21.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.311+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=UW1UBJ1BS0UM type=del 2024-09-12T00:19:21.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.314+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~REVSAXJDH7OT.0 size=828377 2024-09-12T00:19:21.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.314+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=REVSAXJDH7OT tag=B88HSO8JLCXM type=write size=1876953 2024-09-12T00:19:21.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.316+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~URJ2Y9J5XPPQ.0 size=187147 2024-09-12T00:19:21.316 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.318+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=URJ2Y9J5XPPQ tag=D2WNATGELLPR type=write size=1235723 2024-09-12T00:19:21.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.321+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~NE3Z1FDBU252.0 size=55258 2024-09-12T00:19:21.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.321+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=NE3Z1FDBU252 tag=QGGRP7NFMUEE type=write size=1103834 2024-09-12T00:19:21.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.323+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~4H4B0BE9JQK7.0 size=146101 2024-09-12T00:19:21.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.325+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=4H4B0BE9JQK7 tag=2OWITS3E5WUR type=write size=1194677 2024-09-12T00:19:21.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.327+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=GQYL1OQRJ9FC type=del size=3328753 2024-09-12T00:19:21.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.328+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~5U5XT6RI8NOA.0 size=1048576 2024-09-12T00:19:21.328 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.330+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~5U5XT6RI8NOA.1 size=787255 2024-09-12T00:19:21.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.332+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=5U5XT6RI8NOA tag=04ASAI1NMWV3 type=write size=2884407 2024-09-12T00:19:21.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.334+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=AJY4FPH3ZWXQ type=del size=3779759 2024-09-12T00:19:21.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.338+0000 7f682945b780 1 < suggested remove operation key=9Q4HFV4F2KE2 tag=G2ZAD75E0AS4 type=del 2024-09-12T00:19:21.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.341+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~UMDP3O488PVR.0 size=1048576 2024-09-12T00:19:21.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.342+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~UMDP3O488PVR.1 size=1048576 2024-09-12T00:19:21.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.343+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~UMDP3O488PVR.2 size=631011 2024-09-12T00:19:21.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.343+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=UMDP3O488PVR tag=32DHBUE0GUB3 type=write size=3776739 2024-09-12T00:19:21.343 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.344+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~DN0T519QE022.0 size=1048576 2024-09-12T00:19:21.344 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.346+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~DN0T519QE022.1 size=962345 2024-09-12T00:19:21.346 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.348+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=DN0T519QE022 tag=YD38HRVC0VWS type=write size=3059497 2024-09-12T00:19:21.349 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.350+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~CBH995VSXCU9.0 size=1048576 2024-09-12T00:19:21.350 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.351+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~CBH995VSXCU9.1 size=1048576 2024-09-12T00:19:21.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.352+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~CBH995VSXCU9.2 size=667556 2024-09-12T00:19:21.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.352+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=CBH995VSXCU9 tag=E6GH4I7WFBTV type=write size=3813284 2024-09-12T00:19:21.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.354+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~69U2TE59V4UX.0 size=1048576 2024-09-12T00:19:21.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.355+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~69U2TE59V4UX.1 size=1048576 2024-09-12T00:19:21.355 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.356+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~69U2TE59V4UX.2 size=337478 2024-09-12T00:19:21.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.360+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=69U2TE59V4UX tag=875CMC0EP8X3 type=write size=3483206 2024-09-12T00:19:21.361 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.362+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~CZROJ1D77EA4.0 size=1048576 2024-09-12T00:19:21.361 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.363+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~CZROJ1D77EA4.1 size=447371 2024-09-12T00:19:21.361 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.363+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=CZROJ1D77EA4 tag=SLP7JVPN9WV1 type=write size=2544523 2024-09-12T00:19:21.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.365+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~1KUGSH69W66D.0 size=585713 2024-09-12T00:19:21.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.368+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=1KUGSH69W66D tag=JNK9MQ65V1PL type=write size=1634289 2024-09-12T00:19:21.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.370+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=OODOBD8GW541 type=del size=3316228 2024-09-12T00:19:21.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.371+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=UR8ZETI809O1 type=del 2024-09-12T00:19:21.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.372+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=QDP1E5SUKEO2 type=del size=2073010 2024-09-12T00:19:21.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.374+0000 7f682945b780 1 < completed write operation key=AZKLWMQ818SW tag=H7P66KP5TZIU type=write size=789959 2024-09-12T00:19:21.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.376+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=HI8F90Y5WE8Q type=del size=2340279 2024-09-12T00:19:21.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.377+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=3JU4OJCZ5C6D type=del 2024-09-12T00:19:21.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.379+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=Y38B8DVZR6TM type=write size=686069 2024-09-12T00:19:21.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.381+0000 7f682945b780 1 < completed write operation key=6DUQKU3R1RL8 tag=KE61UH3U5NRB type=write size=752876 2024-09-12T00:19:21.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.383+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~H0EC2I8JW9VI.0 size=1048576 2024-09-12T00:19:21.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.385+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~H0EC2I8JW9VI.1 size=1048576 2024-09-12T00:19:21.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.386+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~H0EC2I8JW9VI.2 size=446173 2024-09-12T00:19:21.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.386+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=H0EC2I8JW9VI tag=NEDX5E7HY9UU type=write size=3591901 2024-09-12T00:19:21.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.388+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=R4BKQWB50RAU type=del 2024-09-12T00:19:21.389 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.390+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~6N4IHSQXGFG7.0 size=1048576 2024-09-12T00:19:21.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.392+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~6N4IHSQXGFG7.1 size=1048576 2024-09-12T00:19:21.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.394+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~6N4IHSQXGFG7.2 size=371356 2024-09-12T00:19:21.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.394+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=6N4IHSQXGFG7 tag=54VIBGVO0TC0 type=write size=3517084 2024-09-12T00:19:21.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.395+0000 7f682945b780 1 < completed write operation key=BV3D543J63H1 tag=9HP7YXA4UOSJ type=write size=247342 2024-09-12T00:19:21.395 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.396+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=BVMLPLIBDYGF type=del size=1775039 2024-09-12T00:19:21.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.398+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=WHHA1GRSRHUH type=del 2024-09-12T00:19:21.398 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.400+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=6Q14O0S2JLJR type=del size=2743957 2024-09-12T00:19:21.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.401+0000 7f682945b780 1 < completed delete operation key=R7V03ML1H80V tag=FC1IB3C82WIT type=del 2024-09-12T00:19:21.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.405+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~S2DYRQKQZDXE.0 size=1048576 2024-09-12T00:19:21.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.405+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~S2DYRQKQZDXE.1 size=996864 2024-09-12T00:19:21.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.405+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=S2DYRQKQZDXE tag=GLV4PT2GRJ4W type=write size=3094016 2024-09-12T00:19:21.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.406+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~REVSAXJDH7OT.0 size=828377 2024-09-12T00:19:21.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.409+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=REVSAXJDH7OT tag=B88HSO8JLCXM type=write size=1876953 2024-09-12T00:19:21.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.410+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=GR4L98UKS03F type=del size=2199483 2024-09-12T00:19:21.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.412+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~NE3Z1FDBU252.0 size=55258 2024-09-12T00:19:21.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.415+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=NE3Z1FDBU252 tag=QGGRP7NFMUEE type=write size=1103834 2024-09-12T00:19:21.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.417+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~WI7GTWOMHOGN.0 size=1048576 2024-09-12T00:19:21.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.419+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~WI7GTWOMHOGN.1 size=124238 2024-09-12T00:19:21.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.419+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=WI7GTWOMHOGN tag=QL3PYGDF4CTJ type=write size=2221390 2024-09-12T00:19:21.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.420+0000 7f682945b780 1 < completed delete operation key=R7V03ML1H80V tag=GQYL1OQRJ9FC type=del 2024-09-12T00:19:21.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.423+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~ZSLAG5TODXB6.0 size=1048576 2024-09-12T00:19:21.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.424+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~ZSLAG5TODXB6.1 size=284802 2024-09-12T00:19:21.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.424+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=ZSLAG5TODXB6 tag=SY5G6ZZV7J49 type=write size=2381954 2024-09-12T00:19:21.424 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.425+0000 7f682945b780 1 < canceled operation key=CT2L8L3849IN tag=AJY4FPH3ZWXQ type=del size=3779759 2024-09-12T00:19:21.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.428+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~2AZO0AP8FUDJ.0 size=1048576 2024-09-12T00:19:21.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.429+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~2AZO0AP8FUDJ.1 size=509774 2024-09-12T00:19:21.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.429+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=2AZO0AP8FUDJ tag=WO14GIY0EVIS type=write size=2606926 2024-09-12T00:19:21.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.430+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~UMDP3O488PVR.0 size=1048576 2024-09-12T00:19:21.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.431+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~UMDP3O488PVR.1 size=1048576 2024-09-12T00:19:21.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.433+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~UMDP3O488PVR.2 size=631011 2024-09-12T00:19:21.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.435+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=UMDP3O488PVR tag=32DHBUE0GUB3 type=write size=3776739 2024-09-12T00:19:21.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.436+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=PJFXHE5WRZ5O type=del size=349568 2024-09-12T00:19:21.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.436+0000 7f682945b780 1 < canceled part key=_multipart_JAVE3HR52R5C.2~CBH995VSXCU9.0 size=1048576 2024-09-12T00:19:21.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.437+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~CBH995VSXCU9.1 size=1048576 2024-09-12T00:19:21.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.438+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~CBH995VSXCU9.2 size=667556 2024-09-12T00:19:21.440 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.442+0000 7f682945b780 1 < canceled multipart upload key=JAVE3HR52R5C upload=CBH995VSXCU9 tag=E6GH4I7WFBTV type=write size=3813284 2024-09-12T00:19:21.441 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.443+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=ONWFW232KKM7 type=write size=467800 2024-09-12T00:19:21.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.444+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~CZROJ1D77EA4.0 size=1048576 2024-09-12T00:19:21.444 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.445+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~CZROJ1D77EA4.1 size=447371 2024-09-12T00:19:21.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.448+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=CZROJ1D77EA4 tag=SLP7JVPN9WV1 type=write size=2544523 2024-09-12T00:19:21.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.450+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=2I47FCTS0YRN type=del size=496080 2024-09-12T00:19:21.450 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.451+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=OODOBD8GW541 type=del 2024-09-12T00:19:21.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.453+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=7DNXQSGX8KWS type=del size=1269661 2024-09-12T00:19:21.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.454+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=QDP1E5SUKEO2 type=del 2024-09-12T00:19:21.454 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.455+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=HP66UXKLM2RS type=del size=3417223 2024-09-12T00:19:21.455 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.457+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=HI8F90Y5WE8Q type=del 2024-09-12T00:19:21.458 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.459+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~ANCUNJAF4V3E.0 size=717686 2024-09-12T00:19:21.458 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.459+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=ANCUNJAF4V3E tag=UENHEDXSMK3V type=write size=1766262 2024-09-12T00:19:21.459 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.461+0000 7f682945b780 1 < completed write operation key=BMTPXZ1OA2TZ tag=Y38B8DVZR6TM type=write size=686069 2024-09-12T00:19:21.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.462+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=SB164QPGRY3K type=write size=377250 2024-09-12T00:19:21.462 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.464+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~H0EC2I8JW9VI.0 size=1048576 2024-09-12T00:19:21.463 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.465+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~H0EC2I8JW9VI.1 size=1048576 2024-09-12T00:19:21.464 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.466+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~H0EC2I8JW9VI.2 size=446173 2024-09-12T00:19:21.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.468+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=H0EC2I8JW9VI tag=NEDX5E7HY9UU type=write size=3591901 2024-09-12T00:19:21.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.469+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=O93R62HC1BM1 type=del size=847316 2024-09-12T00:19:21.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.471+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~6N4IHSQXGFG7.0 size=1048576 2024-09-12T00:19:21.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.472+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~6N4IHSQXGFG7.1 size=1048576 2024-09-12T00:19:21.472 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.473+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~6N4IHSQXGFG7.2 size=371356 2024-09-12T00:19:21.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.477+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=6N4IHSQXGFG7 tag=54VIBGVO0TC0 type=write size=3517084 2024-09-12T00:19:21.476 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.477+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=DZX0RUT11YZQ type=del size=3506977 2024-09-12T00:19:21.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.479+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=BVMLPLIBDYGF type=del 2024-09-12T00:19:21.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.481+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=1NGSHXPGAGBD type=write size=619129 2024-09-12T00:19:21.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.482+0000 7f682945b780 1 < canceled operation key=BMTPXZ1OA2TZ tag=6Q14O0S2JLJR type=del size=2743957 2024-09-12T00:19:21.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.484+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=7EOYDNS566NP type=del size=2860884 2024-09-12T00:19:21.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.486+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~S2DYRQKQZDXE.0 size=1048576 2024-09-12T00:19:21.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.488+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~S2DYRQKQZDXE.1 size=996864 2024-09-12T00:19:21.488 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.489+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=S2DYRQKQZDXE tag=GLV4PT2GRJ4W type=write size=3094016 2024-09-12T00:19:21.489 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.492+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=HRCE048F845Y type=del size=671216 2024-09-12T00:19:21.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.492+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=GR4L98UKS03F type=del 2024-09-12T00:19:21.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.494+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=ED9EGJ63S3JE type=write size=979843 2024-09-12T00:19:21.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.497+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~WI7GTWOMHOGN.0 size=1048576 2024-09-12T00:19:21.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.498+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~WI7GTWOMHOGN.1 size=124238 2024-09-12T00:19:21.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.500+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=WI7GTWOMHOGN tag=QL3PYGDF4CTJ type=write size=2221390 2024-09-12T00:19:21.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.502+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=U9DVUVKB7LW8 type=del size=1056895 2024-09-12T00:19:21.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.503+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~ZSLAG5TODXB6.0 size=1048576 2024-09-12T00:19:21.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.504+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~ZSLAG5TODXB6.1 size=284802 2024-09-12T00:19:21.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.507+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=ZSLAG5TODXB6 tag=SY5G6ZZV7J49 type=write size=2381954 2024-09-12T00:19:21.508 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.511+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~YNGCQTQMA5GQ.0 size=1048576 2024-09-12T00:19:21.510 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.512+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~YNGCQTQMA5GQ.1 size=1048576 2024-09-12T00:19:21.511 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.513+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~YNGCQTQMA5GQ.2 size=637428 2024-09-12T00:19:21.511 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.513+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=YNGCQTQMA5GQ tag=06DRC7ME8PDX type=write size=3783156 2024-09-12T00:19:21.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.514+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~2AZO0AP8FUDJ.0 size=1048576 2024-09-12T00:19:21.520 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.522+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~2AZO0AP8FUDJ.1 size=509774 2024-09-12T00:19:21.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.524+0000 7f682945b780 1 < completed multipart upload key=CT2L8L3849IN upload=2AZO0AP8FUDJ tag=WO14GIY0EVIS type=write size=2606926 2024-09-12T00:19:21.524 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.526+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=MK5H3X61L37N type=del size=7291 2024-09-12T00:19:21.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.529+0000 7f682945b780 1 < suggested update operation key=TYNSP8BHYO65 tag=PJFXHE5WRZ5O type=del size=349568 2024-09-12T00:19:21.529 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.531+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=IUUNEJF9303G type=write size=277422 2024-09-12T00:19:21.530 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.532+0000 7f682945b780 1 < completed write operation key=BI3KCKV4CRWR tag=ONWFW232KKM7 type=write size=467800 2024-09-12T00:19:21.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.533+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=V30ET2E4838B type=write size=898017 2024-09-12T00:19:21.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.535+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=2I47FCTS0YRN type=del 2024-09-12T00:19:21.535 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.537+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=6GJNJL8ZZ8MF type=del size=2570936 2024-09-12T00:19:21.536 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.537+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=7DNXQSGX8KWS type=del 2024-09-12T00:19:21.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.541+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~P6COHUW38Y94.0 size=1048576 2024-09-12T00:19:21.540 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.542+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~P6COHUW38Y94.1 size=509013 2024-09-12T00:19:21.540 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.542+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=P6COHUW38Y94 tag=YWEPDNUWGHIB type=write size=2606165 2024-09-12T00:19:21.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.544+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=HP66UXKLM2RS type=del 2024-09-12T00:19:21.545 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.547+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~5EOF02Y7ZBP9.0 size=1048576 2024-09-12T00:19:21.546 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.548+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~5EOF02Y7ZBP9.1 size=1048576 2024-09-12T00:19:21.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.550+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~5EOF02Y7ZBP9.2 size=493050 2024-09-12T00:19:21.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.550+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=5EOF02Y7ZBP9 tag=44V9MKGXRB24 type=write size=3638778 2024-09-12T00:19:21.549 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.551+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~ANCUNJAF4V3E.0 size=717686 2024-09-12T00:19:21.551 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.553+0000 7f682945b780 1 < completed multipart upload key=D06ZUP2ZXX42 upload=ANCUNJAF4V3E tag=UENHEDXSMK3V type=write size=1766262 2024-09-12T00:19:21.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.556+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~36LLFEQF8683.0 size=687292 2024-09-12T00:19:21.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.556+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=36LLFEQF8683 tag=8UPKPYEYM8SX type=write size=1735868 2024-09-12T00:19:21.557 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.558+0000 7f682945b780 1 < suggested remove operation key=9Q4HFV4F2KE2 tag=SB164QPGRY3K type=write 2024-09-12T00:19:21.558 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.560+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=N5L916YI5QUL type=del size=516163 2024-09-12T00:19:21.561 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.563+0000 7f682945b780 1 < suggested remove operation key=1RAFARG1JXFQ tag=O93R62HC1BM1 type=del 2024-09-12T00:19:21.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.565+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~LFEJUKUB4NM2.0 size=735428 2024-09-12T00:19:21.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.565+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=LFEJUKUB4NM2 tag=UXVWGEQ6Y2YX type=write size=1784004 2024-09-12T00:19:21.565 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.567+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=DZX0RUT11YZQ type=del 2024-09-12T00:19:21.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.569+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~9ENR9QYOZUOX.0 size=1048576 2024-09-12T00:19:21.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.571+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~9ENR9QYOZUOX.1 size=1048576 2024-09-12T00:19:21.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.572+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~9ENR9QYOZUOX.2 size=864711 2024-09-12T00:19:21.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.572+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=9ENR9QYOZUOX tag=XP4BS1US3DCU type=write size=4010439 2024-09-12T00:19:21.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.573+0000 7f682945b780 1 < completed write operation key=38JJBFDTIYSU tag=1NGSHXPGAGBD type=write size=619129 2024-09-12T00:19:21.573 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.575+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=RUZIO8T15DSL type=del size=2638107 2024-09-12T00:19:21.575 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.576+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=7EOYDNS566NP type=del 2024-09-12T00:19:21.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.578+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~ZZSMJ7EV2190.0 size=1048576 2024-09-12T00:19:21.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.580+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~ZZSMJ7EV2190.1 size=1048576 2024-09-12T00:19:21.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.581+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~ZZSMJ7EV2190.2 size=917709 2024-09-12T00:19:21.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.581+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=ZZSMJ7EV2190 tag=YN7GLDF41R3I type=write size=4063437 2024-09-12T00:19:21.581 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.582+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=HRCE048F845Y type=del 2024-09-12T00:19:21.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.584+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~37D97V8RWCHQ.0 size=1048576 2024-09-12T00:19:21.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.586+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~37D97V8RWCHQ.1 size=1018841 2024-09-12T00:19:21.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.586+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=37D97V8RWCHQ tag=W74R5BI02NBK type=write size=3115993 2024-09-12T00:19:21.586 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.588+0000 7f682945b780 1 < completed write operation key=3JFMN39G6TTF tag=ED9EGJ63S3JE type=write size=979843 2024-09-12T00:19:21.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.589+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=64TLZFXXV40T type=write size=639624 2024-09-12T00:19:21.589 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.591+0000 7f682945b780 1 < canceled operation key=EYHGJ82COSE9 tag=U9DVUVKB7LW8 type=del size=1056895 2024-09-12T00:19:21.590 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.592+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=79WKA5OS3L3J type=del size=1805779 2024-09-12T00:19:21.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.593+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~YNGCQTQMA5GQ.0 size=1048576 2024-09-12T00:19:21.593 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.594+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~YNGCQTQMA5GQ.1 size=1048576 2024-09-12T00:19:21.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.597+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~YNGCQTQMA5GQ.2 size=637428 2024-09-12T00:19:21.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.599+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=YNGCQTQMA5GQ tag=06DRC7ME8PDX type=write size=3783156 2024-09-12T00:19:21.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.600+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=03Z8FVF6YCB2 type=del size=3962230 2024-09-12T00:19:21.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.601+0000 7f682945b780 1 < canceled operation key=7RRJO383D8TH tag=MK5H3X61L37N type=del size=7291 2024-09-12T00:19:21.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.603+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=3MC3FI9LFPZN type=del size=1853328 2024-09-12T00:19:21.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.605+0000 7f682945b780 -1 < failed to complete operation key=9Q4HFV4F2KE2 tag=IUUNEJF9303G type=write size=277422: (22) Invalid argument 2024-09-12T00:19:21.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.605+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=CDO3HMIUBPPL type=del size=1559455 2024-09-12T00:19:21.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.607+0000 7f682945b780 1 < completed write operation key=8D9UC8FJ16UK tag=V30ET2E4838B type=write size=898017 2024-09-12T00:19:21.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.610+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~34WICRK4ORXX.0 size=390300 2024-09-12T00:19:21.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.610+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=34WICRK4ORXX tag=55D2JQ0H529K type=write size=1438876 2024-09-12T00:19:21.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.611+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=6GJNJL8ZZ8MF type=del 2024-09-12T00:19:21.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.612+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=Y18PHI1QV01M type=del size=925194 2024-09-12T00:19:21.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.615+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~P6COHUW38Y94.0 size=1048576 2024-09-12T00:19:21.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.616+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~P6COHUW38Y94.1 size=509013 2024-09-12T00:19:21.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.617+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=P6COHUW38Y94 tag=YWEPDNUWGHIB type=write size=2606165 2024-09-12T00:19:21.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.620+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=RLKHSSNYLSAK type=write size=44924 2024-09-12T00:19:21.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.624+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~5EOF02Y7ZBP9.0 size=1048576 2024-09-12T00:19:21.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.625+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~5EOF02Y7ZBP9.1 size=1048576 2024-09-12T00:19:21.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.626+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~5EOF02Y7ZBP9.2 size=493050 2024-09-12T00:19:21.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.628+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=5EOF02Y7ZBP9 tag=44V9MKGXRB24 type=write size=3638778 2024-09-12T00:19:21.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.629+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=6RII9LPJWZHL type=del size=1682206 2024-09-12T00:19:21.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.631+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~36LLFEQF8683.0 size=687292 2024-09-12T00:19:21.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.633+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=36LLFEQF8683 tag=8UPKPYEYM8SX type=write size=1735868 2024-09-12T00:19:21.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.636+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~MIWUP6HGPPI1.0 size=1048576 2024-09-12T00:19:21.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.637+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~MIWUP6HGPPI1.1 size=514800 2024-09-12T00:19:21.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.637+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=MIWUP6HGPPI1 tag=10GMX34D0FIM type=write size=2611952 2024-09-12T00:19:21.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.638+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=N5L916YI5QUL type=del 2024-09-12T00:19:21.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.640+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=6XZXVYJVLBBN type=del size=436821 2024-09-12T00:19:21.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.642+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~LFEJUKUB4NM2.0 size=735428 2024-09-12T00:19:21.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.644+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=LFEJUKUB4NM2 tag=UXVWGEQ6Y2YX type=write size=1784004 2024-09-12T00:19:21.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.646+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~3910W2FATIS4.0 size=1048576 2024-09-12T00:19:21.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.648+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~3910W2FATIS4.1 size=2210 2024-09-12T00:19:21.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.648+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=3910W2FATIS4 tag=UUFFC0BF8C6C type=write size=2099362 2024-09-12T00:19:21.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.648+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~9ENR9QYOZUOX.0 size=1048576 2024-09-12T00:19:21.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.650+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~9ENR9QYOZUOX.1 size=1048576 2024-09-12T00:19:21.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.651+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~9ENR9QYOZUOX.2 size=864711 2024-09-12T00:19:21.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.653+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=9ENR9QYOZUOX tag=XP4BS1US3DCU type=write size=4010439 2024-09-12T00:19:21.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.654+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=52M8VNUOJC8M type=del size=3429214 2024-09-12T00:19:21.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.655+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=RUZIO8T15DSL type=del 2024-09-12T00:19:21.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.658+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~U4DRCB4W0O6Z.0 size=835203 2024-09-12T00:19:21.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.658+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=U4DRCB4W0O6Z tag=M50ATM9EKRCO type=write size=1883779 2024-09-12T00:19:21.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.660+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~ZZSMJ7EV2190.0 size=1048576 2024-09-12T00:19:21.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.661+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~ZZSMJ7EV2190.1 size=1048576 2024-09-12T00:19:21.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.661+0000 7f682945b780 1 < canceled part key=_multipart_AZKLWMQ818SW.2~ZZSMJ7EV2190.2 size=917709 2024-09-12T00:19:21.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.664+0000 7f682945b780 1 < canceled multipart upload key=AZKLWMQ818SW upload=ZZSMJ7EV2190 tag=YN7GLDF41R3I type=write size=4063437 2024-09-12T00:19:21.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.664+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=74VD6ULZ6BHA type=del size=2757619 2024-09-12T00:19:21.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.667+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~37D97V8RWCHQ.0 size=1048576 2024-09-12T00:19:21.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.667+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~37D97V8RWCHQ.1 size=1018841 2024-09-12T00:19:21.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.670+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=37D97V8RWCHQ tag=W74R5BI02NBK type=write size=3115993 2024-09-12T00:19:21.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.673+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~RGMXQGRQ0T54.0 size=1048576 2024-09-12T00:19:21.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.674+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~RGMXQGRQ0T54.1 size=526478 2024-09-12T00:19:21.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.674+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=RGMXQGRQ0T54 tag=PUUEAOLYE0S3 type=write size=2623630 2024-09-12T00:19:21.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.675+0000 7f682945b780 1 < completed write operation key=17S1X3WXCNAR tag=64TLZFXXV40T type=write size=639624 2024-09-12T00:19:21.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.678+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~1Y0VPV2MYK1F.0 size=998958 2024-09-12T00:19:21.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.678+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=1Y0VPV2MYK1F tag=RSNDJ1ITF1CX type=write size=2047534 2024-09-12T00:19:21.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.679+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=79WKA5OS3L3J type=del 2024-09-12T00:19:21.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.680+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=XU8ROFSM5SW0 type=del size=1305423 2024-09-12T00:19:21.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.682+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=03Z8FVF6YCB2 type=del 2024-09-12T00:19:21.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.684+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~DIE2T1KVE3IT.0 size=1048576 2024-09-12T00:19:21.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.686+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~DIE2T1KVE3IT.1 size=845974 2024-09-12T00:19:21.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.686+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=DIE2T1KVE3IT tag=8J3RC64U0M1P type=write size=2943126 2024-09-12T00:19:21.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.687+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=3MC3FI9LFPZN type=del 2024-09-12T00:19:21.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.689+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=2ALY9PD62ZIR type=del size=2445611 2024-09-12T00:19:21.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.690+0000 7f682945b780 1 < completed delete operation key=8D9UC8FJ16UK tag=CDO3HMIUBPPL type=del 2024-09-12T00:19:21.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.693+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~YK0UG605BEPB.0 size=1048576 2024-09-12T00:19:21.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.694+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~YK0UG605BEPB.1 size=61108 2024-09-12T00:19:21.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.694+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=YK0UG605BEPB tag=8YKLX6JSW1US type=write size=2158260 2024-09-12T00:19:21.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.695+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~34WICRK4ORXX.0 size=390300 2024-09-12T00:19:21.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.697+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=34WICRK4ORXX tag=55D2JQ0H529K type=write size=1438876 2024-09-12T00:19:21.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.700+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~FPRYBWEIC040.0 size=1048576 2024-09-12T00:19:21.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.701+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~FPRYBWEIC040.1 size=1048576 2024-09-12T00:19:21.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.702+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~FPRYBWEIC040.2 size=851421 2024-09-12T00:19:21.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.702+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=FPRYBWEIC040 tag=DMOSY3G8BH3D type=write size=3997149 2024-09-12T00:19:21.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.703+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=Y18PHI1QV01M type=del 2024-09-12T00:19:21.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.706+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~NDX8UQVZHNB6.0 size=1048576 2024-09-12T00:19:21.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.707+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~NDX8UQVZHNB6.1 size=1048576 2024-09-12T00:19:21.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.708+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~NDX8UQVZHNB6.2 size=977275 2024-09-12T00:19:21.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.708+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=NDX8UQVZHNB6 tag=QGDHL2U70AN7 type=write size=4123003 2024-09-12T00:19:21.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.709+0000 7f682945b780 1 < canceled operation key=IUPAGGPATJB4 tag=RLKHSSNYLSAK type=write size=44924 2024-09-12T00:19:21.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.712+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~XVTJ5PMG8UEW.0 size=1048576 2024-09-12T00:19:21.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.713+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~XVTJ5PMG8UEW.1 size=1048576 2024-09-12T00:19:21.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.714+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~XVTJ5PMG8UEW.2 size=546242 2024-09-12T00:19:21.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.714+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=XVTJ5PMG8UEW tag=UJPYRPSIJ2LR type=write size=3691970 2024-09-12T00:19:21.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.718+0000 7f682945b780 1 < suggested update operation key=TYNSP8BHYO65 tag=6RII9LPJWZHL type=del size=1682206 2024-09-12T00:19:21.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.719+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=IDL36W27NMAU type=write size=829372 2024-09-12T00:19:21.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.721+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~MIWUP6HGPPI1.0 size=1048576 2024-09-12T00:19:21.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.723+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~MIWUP6HGPPI1.1 size=514800 2024-09-12T00:19:21.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.725+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=MIWUP6HGPPI1 tag=10GMX34D0FIM type=write size=2611952 2024-09-12T00:19:21.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.726+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=IEQ2HUDW4NOM type=write size=674395 2024-09-12T00:19:21.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.728+0000 7f682945b780 1 < canceled operation key=COUJXCOSVPDS tag=6XZXVYJVLBBN type=del size=436821 2024-09-12T00:19:21.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.730+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=7LA7KUSVKXXX type=del size=1631163 2024-09-12T00:19:21.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.731+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~3910W2FATIS4.0 size=1048576 2024-09-12T00:19:21.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.733+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~3910W2FATIS4.1 size=2210 2024-09-12T00:19:21.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.735+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=3910W2FATIS4 tag=UUFFC0BF8C6C type=write size=2099362 2024-09-12T00:19:21.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.736+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=NBEFPSOPXSQY type=write size=905314 2024-09-12T00:19:21.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.738+0000 7f682945b780 1 < completed delete operation key=8D9UC8FJ16UK tag=52M8VNUOJC8M type=del 2024-09-12T00:19:21.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.739+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=VZ4U1V3V4FVG type=del size=4041871 2024-09-12T00:19:21.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.740+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~U4DRCB4W0O6Z.0 size=835203 2024-09-12T00:19:21.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.743+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=U4DRCB4W0O6Z tag=M50ATM9EKRCO type=write size=1883779 2024-09-12T00:19:21.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.744+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=FDSPSBLLY85C type=del size=3072486 2024-09-12T00:19:21.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.746+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=74VD6ULZ6BHA type=del 2024-09-12T00:19:21.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.747+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=XGVO1QNV5193 type=write size=275978 2024-09-12T00:19:21.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.749+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~RGMXQGRQ0T54.0 size=1048576 2024-09-12T00:19:21.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.750+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~RGMXQGRQ0T54.1 size=526478 2024-09-12T00:19:21.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.753+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=RGMXQGRQ0T54 tag=PUUEAOLYE0S3 type=write size=2623630 2024-09-12T00:19:21.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.755+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=3R05HL0VFS3F type=del size=2664690 2024-09-12T00:19:21.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.756+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~1Y0VPV2MYK1F.0 size=998958 2024-09-12T00:19:21.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.758+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=1Y0VPV2MYK1F tag=RSNDJ1ITF1CX type=write size=2047534 2024-09-12T00:19:21.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.760+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=P4YZA2C6ZIF7 type=write size=84408 2024-09-12T00:19:21.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.761+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=XU8ROFSM5SW0 type=del 2024-09-12T00:19:21.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.764+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~3GUO27XD1SGA.0 size=1048576 2024-09-12T00:19:21.763 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.765+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~3GUO27XD1SGA.1 size=1048576 2024-09-12T00:19:21.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.766+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~3GUO27XD1SGA.2 size=655680 2024-09-12T00:19:21.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.766+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=3GUO27XD1SGA tag=V24W5D2V3PRK type=write size=3801408 2024-09-12T00:19:21.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.767+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~DIE2T1KVE3IT.0 size=1048576 2024-09-12T00:19:21.767 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.768+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~DIE2T1KVE3IT.1 size=845974 2024-09-12T00:19:21.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.771+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=DIE2T1KVE3IT tag=8J3RC64U0M1P type=write size=2943126 2024-09-12T00:19:21.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.772+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=9STLPGZVNFXG type=del size=2002181 2024-09-12T00:19:21.774 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.776+0000 7f682945b780 1 < suggested remove operation key=CT2L8L3849IN tag=2ALY9PD62ZIR type=del 2024-09-12T00:19:21.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.777+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=TDS81AK5TJEM type=del size=149808 2024-09-12T00:19:21.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.778+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~YK0UG605BEPB.0 size=1048576 2024-09-12T00:19:21.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.779+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~YK0UG605BEPB.1 size=61108 2024-09-12T00:19:21.780 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.781+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=YK0UG605BEPB tag=8YKLX6JSW1US type=write size=2158260 2024-09-12T00:19:21.781 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.783+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=2ZOU6NBU5UN4 type=write size=581607 2024-09-12T00:19:21.781 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.783+0000 7f682945b780 1 < canceled part key=_multipart_922B2PPJFX2Z.2~FPRYBWEIC040.0 size=1048576 2024-09-12T00:19:21.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.784+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~FPRYBWEIC040.1 size=1048576 2024-09-12T00:19:21.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.785+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~FPRYBWEIC040.2 size=851421 2024-09-12T00:19:21.786 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.788+0000 7f682945b780 1 < canceled multipart upload key=922B2PPJFX2Z upload=FPRYBWEIC040 tag=DMOSY3G8BH3D type=write size=3997149 2024-09-12T00:19:21.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.789+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=BO79VQWIXKF2 type=write size=346048 2024-09-12T00:19:21.789 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.790+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~NDX8UQVZHNB6.0 size=1048576 2024-09-12T00:19:21.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.792+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~NDX8UQVZHNB6.1 size=1048576 2024-09-12T00:19:21.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.793+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~NDX8UQVZHNB6.2 size=977275 2024-09-12T00:19:21.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.796+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=NDX8UQVZHNB6 tag=QGDHL2U70AN7 type=write size=4123003 2024-09-12T00:19:21.795 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.796+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=6PEQB370AVTE type=del size=942947 2024-09-12T00:19:21.796 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.798+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~XVTJ5PMG8UEW.0 size=1048576 2024-09-12T00:19:21.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.799+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~XVTJ5PMG8UEW.1 size=1048576 2024-09-12T00:19:21.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.800+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~XVTJ5PMG8UEW.2 size=546242 2024-09-12T00:19:21.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.802+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=XVTJ5PMG8UEW tag=UJPYRPSIJ2LR type=write size=3691970 2024-09-12T00:19:21.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.805+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~9UMQPVECKHYR.0 size=1048576 2024-09-12T00:19:21.804 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.806+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~9UMQPVECKHYR.1 size=716025 2024-09-12T00:19:21.805 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.806+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=9UMQPVECKHYR tag=QM10JYANU9E7 type=write size=2813177 2024-09-12T00:19:21.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.807+0000 7f682945b780 1 < completed write operation key=9Q4HFV4F2KE2 tag=IDL36W27NMAU type=write size=829372 2024-09-12T00:19:21.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.809+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=H2GMTIAUHZJT type=write size=304420 2024-09-12T00:19:21.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.811+0000 7f682945b780 1 < completed write operation key=TYNSP8BHYO65 tag=IEQ2HUDW4NOM type=write size=674395 2024-09-12T00:19:21.811 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.813+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~AGW590YU7NS8.0 size=1048576 2024-09-12T00:19:21.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.814+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~AGW590YU7NS8.1 size=985896 2024-09-12T00:19:21.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.814+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=AGW590YU7NS8 tag=9GIBV42EGJ2Z type=write size=3083048 2024-09-12T00:19:21.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.815+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=7LA7KUSVKXXX type=del 2024-09-12T00:19:21.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.818+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~9ZY7Z0VC6N7U.0 size=442220 2024-09-12T00:19:21.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.818+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=9ZY7Z0VC6N7U tag=FJTFC4JRCXG8 type=write size=1490796 2024-09-12T00:19:21.819 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.821+0000 7f682945b780 1 < suggested update operation key=17S1X3WXCNAR tag=NBEFPSOPXSQY type=write size=905314 2024-09-12T00:19:21.821 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.822+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=4AAO93A9VYKB type=del size=3309537 2024-09-12T00:19:21.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.824+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=VZ4U1V3V4FVG type=del 2024-09-12T00:19:21.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.825+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=CDL2UOZNAP2L type=write size=815977 2024-09-12T00:19:21.825 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.827+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=FDSPSBLLY85C type=del 2024-09-12T00:19:21.827 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.828+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=W2MLWZUGVO9G type=del size=337254 2024-09-12T00:19:21.828 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.829+0000 7f682945b780 1 < completed write operation key=CE5EBY7EGY4Z tag=XGVO1QNV5193 type=write size=275978 2024-09-12T00:19:21.831 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.833+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~6IVSSBS70UDL.0 size=1013337 2024-09-12T00:19:21.831 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.833+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=6IVSSBS70UDL tag=UNENDM0IEPLB type=write size=2061913 2024-09-12T00:19:21.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.835+0000 7f682945b780 1 < suggested update operation key=BK212Z99RM7F tag=3R05HL0VFS3F type=del size=2664690 2024-09-12T00:19:21.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.838+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~1P05YUSKEZTE.0 size=840831 2024-09-12T00:19:21.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.838+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=1P05YUSKEZTE tag=IQH2HMQAR20S type=write size=1889407 2024-09-12T00:19:21.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.841+0000 7f682945b780 1 < suggested remove operation key=EYHGJ82COSE9 tag=P4YZA2C6ZIF7 type=write 2024-09-12T00:19:21.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.842+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=EZLS06503WE7 type=del size=1970394 2024-09-12T00:19:21.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.843+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~3GUO27XD1SGA.0 size=1048576 2024-09-12T00:19:21.843 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.844+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~3GUO27XD1SGA.1 size=1048576 2024-09-12T00:19:21.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.845+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~3GUO27XD1SGA.2 size=655680 2024-09-12T00:19:21.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.848+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=3GUO27XD1SGA tag=V24W5D2V3PRK type=write size=3801408 2024-09-12T00:19:21.847 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.849+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=OVEKYTK1TKHO type=write size=869934 2024-09-12T00:19:21.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.852+0000 7f682945b780 1 < suggested update operation key=AZKLWMQ818SW tag=9STLPGZVNFXG type=del size=2002181 2024-09-12T00:19:21.852 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.853+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=6QUQWXZLDUES type=del size=1991550 2024-09-12T00:19:21.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.855+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=TDS81AK5TJEM type=del 2024-09-12T00:19:21.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.856+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=DOG1Y38N35JS type=del size=3629465 2024-09-12T00:19:21.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.860+0000 7f682945b780 1 < suggested remove operation key=8D9UC8FJ16UK tag=2ZOU6NBU5UN4 type=write 2024-09-12T00:19:21.860 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.861+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=N3XZ1AKQAO1V type=write size=814447 2024-09-12T00:19:21.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.865+0000 7f682945b780 1 < suggested update operation key=SGWTWN8RTKDD tag=BO79VQWIXKF2 type=write size=346048 2024-09-12T00:19:21.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.866+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=2RCMYJP36DHB type=del size=3039143 2024-09-12T00:19:21.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.868+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=6PEQB370AVTE type=del 2024-09-12T00:19:21.869 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.870+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~S6TO48Y5HOI4.0 size=328057 2024-09-12T00:19:21.869 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.870+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=S6TO48Y5HOI4 tag=F16DBB7MHZDO type=write size=1376633 2024-09-12T00:19:21.870 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.872+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~9UMQPVECKHYR.0 size=1048576 2024-09-12T00:19:21.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.873+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~9UMQPVECKHYR.1 size=716025 2024-09-12T00:19:21.874 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.876+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=9UMQPVECKHYR tag=QM10JYANU9E7 type=write size=2813177 2024-09-12T00:19:21.876 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.877+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=LGWI2U7TWEWP type=del size=2242702 2024-09-12T00:19:21.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.880+0000 7f682945b780 1 < suggested update operation key=BI3KCKV4CRWR tag=H2GMTIAUHZJT type=write size=304420 2024-09-12T00:19:21.880 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.882+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=RXKNZ376L1L6 type=del size=979177 2024-09-12T00:19:21.882 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.883+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~AGW590YU7NS8.0 size=1048576 2024-09-12T00:19:21.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.885+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~AGW590YU7NS8.1 size=985896 2024-09-12T00:19:21.886 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.888+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=AGW590YU7NS8 tag=9GIBV42EGJ2Z type=write size=3083048 2024-09-12T00:19:21.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.889+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=TP1J28W6RC4C type=del size=764768 2024-09-12T00:19:21.889 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.891+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~9ZY7Z0VC6N7U.0 size=442220 2024-09-12T00:19:21.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.893+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=9ZY7Z0VC6N7U tag=FJTFC4JRCXG8 type=write size=1490796 2024-09-12T00:19:21.893 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.894+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=44R2LIQIBY4N type=del size=542520 2024-09-12T00:19:21.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.896+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=4AAO93A9VYKB type=del 2024-09-12T00:19:21.896 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.898+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=4GB9XQZICME2 type=write size=204161 2024-09-12T00:19:21.897 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.899+0000 7f682945b780 1 < completed write operation key=Y65K9I6K41X5 tag=CDL2UOZNAP2L type=write size=815977 2024-09-12T00:19:21.899 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.900+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=MTNG253E5ZQ8 type=del size=385584 2024-09-12T00:19:21.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.902+0000 7f682945b780 1 < canceled operation key=6DUQKU3R1RL8 tag=W2MLWZUGVO9G type=del size=337254 2024-09-12T00:19:21.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.903+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=6R5FU0YK4ZCV type=write size=1045852 2024-09-12T00:19:21.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.905+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~6IVSSBS70UDL.0 size=1013337 2024-09-12T00:19:21.905 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.907+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=6IVSSBS70UDL tag=UNENDM0IEPLB type=write size=2061913 2024-09-12T00:19:21.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.909+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=WOK51LDKG3F9 type=write size=715199 2024-09-12T00:19:21.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.910+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~1P05YUSKEZTE.0 size=840831 2024-09-12T00:19:21.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.912+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=1P05YUSKEZTE tag=IQH2HMQAR20S type=write size=1889407 2024-09-12T00:19:21.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.913+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=C5NQTDTPMKEM type=del size=2094917 2024-09-12T00:19:21.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.916+0000 7f682945b780 1 < suggested update operation key=BK212Z99RM7F tag=EZLS06503WE7 type=del size=1970394 2024-09-12T00:19:21.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.917+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=A4YYY67DXD22 type=del size=3409778 2024-09-12T00:19:21.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.919+0000 7f682945b780 1 < completed write operation key=D06ZUP2ZXX42 tag=OVEKYTK1TKHO type=write size=869934 2024-09-12T00:19:21.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.920+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=F4ICXGPXWEHI type=del size=443624 2024-09-12T00:19:21.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.923+0000 7f682945b780 1 < suggested update operation key=Z7408WO050VI tag=6QUQWXZLDUES type=del size=1991550 2024-09-12T00:19:21.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.925+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=4DEWHN4D01DS type=del size=2142067 2024-09-12T00:19:21.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.926+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=DOG1Y38N35JS type=del 2024-09-12T00:19:21.925 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.928+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=BKKTBUVT0T8E type=del size=2738995 2024-09-12T00:19:21.927 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.928+0000 7f682945b780 1 < completed write operation key=3JFMN39G6TTF tag=N3XZ1AKQAO1V type=write size=814447 2024-09-12T00:19:21.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.930+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=SKQK29LGO59M type=del size=1463084 2024-09-12T00:19:21.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.933+0000 7f682945b780 1 < suggested remove operation key=17S1X3WXCNAR tag=2RCMYJP36DHB type=del 2024-09-12T00:19:21.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.934+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=LRAKD00Z5KLG type=del size=189076 2024-09-12T00:19:21.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.936+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~S6TO48Y5HOI4.0 size=328057 2024-09-12T00:19:21.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.938+0000 7f682945b780 1 < completed multipart upload key=D06ZUP2ZXX42 upload=S6TO48Y5HOI4 tag=F16DBB7MHZDO type=write size=1376633 2024-09-12T00:19:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.941+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~ZRZOL0V3W1NW.0 size=918428 2024-09-12T00:19:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.941+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=ZRZOL0V3W1NW tag=YRNIJRIB8KM5 type=write size=1967004 2024-09-12T00:19:21.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.942+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=LGWI2U7TWEWP type=del 2024-09-12T00:19:21.942 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.944+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=LIDROQCDEMOS type=del size=2162732 2024-09-12T00:19:21.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.945+0000 7f682945b780 1 < completed delete operation key=38JJBFDTIYSU tag=RXKNZ376L1L6 type=del 2024-09-12T00:19:21.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.948+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~1GWK0CZPOZ7V.0 size=84781 2024-09-12T00:19:21.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.948+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=1GWK0CZPOZ7V tag=W84J2RZ8K1N2 type=write size=1133357 2024-09-12T00:19:21.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.949+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=TP1J28W6RC4C type=del 2024-09-12T00:19:21.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.951+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=ZLFEWW0FDKKK type=del size=2176142 2024-09-12T00:19:21.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.952+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=44R2LIQIBY4N type=del 2024-09-12T00:19:21.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.953+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=5I7OI8SSIU50 type=del size=1416979 2024-09-12T00:19:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.955+0000 7f682945b780 1 < completed write operation key=IYYTX8TCLF30 tag=4GB9XQZICME2 type=write size=204161 2024-09-12T00:19:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.958+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~FXU91MSVRE0V.0 size=1048576 2024-09-12T00:19:21.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.959+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~FXU91MSVRE0V.1 size=1025032 2024-09-12T00:19:21.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.959+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=FXU91MSVRE0V tag=JNJ0OW21ZFZT type=write size=3122184 2024-09-12T00:19:21.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.960+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=MTNG253E5ZQ8 type=del 2024-09-12T00:19:21.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.962+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=C9ZEX93P88LO type=del size=1845374 2024-09-12T00:19:21.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.965+0000 7f682945b780 1 < suggested update operation key=38JJBFDTIYSU tag=6R5FU0YK4ZCV type=write size=1045852 2024-09-12T00:19:21.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.968+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~PB9GVLNTF487.0 size=346284 2024-09-12T00:19:21.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.968+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=PB9GVLNTF487 tag=PC8TJN6JU7PL type=write size=1394860 2024-09-12T00:19:21.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.969+0000 7f682945b780 1 < completed write operation key=1RAFARG1JXFQ tag=WOK51LDKG3F9 type=write size=715199 2024-09-12T00:19:21.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.971+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=1ZXD2O8K0WL4 type=del size=3289702 2024-09-12T00:19:21.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.972+0000 7f682945b780 1 < completed delete operation key=8D9UC8FJ16UK tag=C5NQTDTPMKEM type=del 2024-09-12T00:19:21.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.974+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=7M670AXG3O4J type=del size=3414400 2024-09-12T00:19:21.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.977+0000 7f682945b780 1 < suggested update operation key=IUPAGGPATJB4 tag=A4YYY67DXD22 type=del size=3409778 2024-09-12T00:19:21.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.979+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~2F28Y0HA4MLP.0 size=1048576 2024-09-12T00:19:21.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.980+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~2F28Y0HA4MLP.1 size=1048576 2024-09-12T00:19:21.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.981+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~2F28Y0HA4MLP.2 size=693034 2024-09-12T00:19:21.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.981+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=2F28Y0HA4MLP tag=TFUDSHJKORRX type=write size=3838762 2024-09-12T00:19:21.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.984+0000 7f682945b780 1 < suggested remove operation key=7RRJO383D8TH tag=F4ICXGPXWEHI type=del 2024-09-12T00:19:21.984 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.986+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=TDQMDJ707789 type=del size=3006962 2024-09-12T00:19:21.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.987+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=4DEWHN4D01DS type=del 2024-09-12T00:19:21.987 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.988+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=VV4KE4LSLX9F type=del size=4165782 2024-09-12T00:19:21.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.991+0000 7f682945b780 1 < suggested update operation key=TGOBZH6DZK71 tag=BKKTBUVT0T8E type=del size=2738995 2024-09-12T00:19:21.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.994+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~ZZ80IMELFW21.0 size=579252 2024-09-12T00:19:21.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.994+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=ZZ80IMELFW21 tag=BN3D91KTAXX0 type=write size=1627828 2024-09-12T00:19:21.995 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.997+0000 7f682945b780 1 < suggested update operation key=Z7408WO050VI tag=SKQK29LGO59M type=del size=1463084 2024-09-12T00:19:21.997 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.998+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=XF9G5WLNU3MU type=del size=1889086 2024-09-12T00:19:21.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:21.999+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=LRAKD00Z5KLG type=del 2024-09-12T00:19:21.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.002+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=6ADAOQGFWP1H type=del size=3432666 2024-09-12T00:19:22.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.002+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~ZRZOL0V3W1NW.0 size=918428 2024-09-12T00:19:22.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.005+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=ZRZOL0V3W1NW tag=YRNIJRIB8KM5 type=write size=1967004 2024-09-12T00:19:22.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.006+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=1W1XENYB1UF0 type=write size=989039 2024-09-12T00:19:22.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.008+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=LIDROQCDEMOS type=del 2024-09-12T00:19:22.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.009+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=W08R5039CCCA type=del size=2244064 2024-09-12T00:19:22.009 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.011+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~1GWK0CZPOZ7V.0 size=84781 2024-09-12T00:19:22.011 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.013+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=1GWK0CZPOZ7V tag=W84J2RZ8K1N2 type=write size=1133357 2024-09-12T00:19:22.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.014+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=04K46B33TD45 type=del size=2574625 2024-09-12T00:19:22.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.016+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=ZLFEWW0FDKKK type=del 2024-09-12T00:19:22.017 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.018+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~3T7HODLJLW7C.0 size=962869 2024-09-12T00:19:22.017 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.018+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=3T7HODLJLW7C tag=KK5AZHR4JTPB type=write size=2011445 2024-09-12T00:19:22.018 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.019+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=5I7OI8SSIU50 type=del 2024-09-12T00:19:22.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.022+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~JNTC30X8EM28.0 size=1048576 2024-09-12T00:19:22.022 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.023+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~JNTC30X8EM28.1 size=971639 2024-09-12T00:19:22.022 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.023+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=JNTC30X8EM28 tag=CG25KQ2MDAWT type=write size=3068791 2024-09-12T00:19:22.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.026+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~FXU91MSVRE0V.0 size=1048576 2024-09-12T00:19:22.025 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.027+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~FXU91MSVRE0V.1 size=1025032 2024-09-12T00:19:22.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.030+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=FXU91MSVRE0V tag=JNJ0OW21ZFZT type=write size=3122184 2024-09-12T00:19:22.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.031+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=U9IOWZ7JAPTL type=del size=1923038 2024-09-12T00:19:22.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.032+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=C9ZEX93P88LO type=del 2024-09-12T00:19:22.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.034+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=8I9B22HRVWLS type=write size=578102 2024-09-12T00:19:22.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.035+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~PB9GVLNTF487.0 size=346284 2024-09-12T00:19:22.036 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.038+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=PB9GVLNTF487 tag=PC8TJN6JU7PL type=write size=1394860 2024-09-12T00:19:22.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.040+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~IZN636VQTTOL.0 size=1048576 2024-09-12T00:19:22.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.041+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~IZN636VQTTOL.1 size=1048576 2024-09-12T00:19:22.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.042+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~IZN636VQTTOL.2 size=827170 2024-09-12T00:19:22.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.042+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=IZN636VQTTOL tag=F7G5O6E0FOZY type=write size=3972898 2024-09-12T00:19:22.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.043+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=1ZXD2O8K0WL4 type=del 2024-09-12T00:19:22.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.045+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~VV558L0U6WKW.0 size=104767 2024-09-12T00:19:22.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.045+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=VV558L0U6WKW tag=B89Z5DMLOQP5 type=write size=1153343 2024-09-12T00:19:22.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.047+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=7M670AXG3O4J type=del 2024-09-12T00:19:22.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.048+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=ZA3D0ZO1159A type=del size=3883108 2024-09-12T00:19:22.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.049+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~2F28Y0HA4MLP.0 size=1048576 2024-09-12T00:19:22.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.050+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~2F28Y0HA4MLP.1 size=1048576 2024-09-12T00:19:22.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.051+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~2F28Y0HA4MLP.2 size=693034 2024-09-12T00:19:22.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.054+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=2F28Y0HA4MLP tag=TFUDSHJKORRX type=write size=3838762 2024-09-12T00:19:22.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.056+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~O6TAIG4GQ5A6.0 size=1048576 2024-09-12T00:19:22.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.057+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~O6TAIG4GQ5A6.1 size=280824 2024-09-12T00:19:22.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.057+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=O6TAIG4GQ5A6 tag=XGVRTI8Q20C6 type=write size=2377976 2024-09-12T00:19:22.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.061+0000 7f682945b780 1 < suggested update operation key=9Q4HFV4F2KE2 tag=TDQMDJ707789 type=del size=3006962 2024-09-12T00:19:22.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.063+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~H7D6IH16LYYI.0 size=1048576 2024-09-12T00:19:22.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.064+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~H7D6IH16LYYI.1 size=467545 2024-09-12T00:19:22.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.064+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=H7D6IH16LYYI tag=6F8IF9DC0JL3 type=write size=2564697 2024-09-12T00:19:22.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.066+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=VV4KE4LSLX9F type=del 2024-09-12T00:19:22.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.067+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=L8QYSF9RCL71 type=del size=26226 2024-09-12T00:19:22.067 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.069+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~ZZ80IMELFW21.0 size=579252 2024-09-12T00:19:22.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.071+0000 7f682945b780 1 < completed multipart upload key=6DUQKU3R1RL8 upload=ZZ80IMELFW21 tag=BN3D91KTAXX0 type=write size=1627828 2024-09-12T00:19:22.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.074+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~1X5LU9N1FKD2.0 size=1048576 2024-09-12T00:19:22.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.075+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~1X5LU9N1FKD2.1 size=1048576 2024-09-12T00:19:22.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.076+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~1X5LU9N1FKD2.2 size=481965 2024-09-12T00:19:22.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.076+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=1X5LU9N1FKD2 tag=VV0U09ZVPAU5 type=write size=3627693 2024-09-12T00:19:22.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.079+0000 7f682945b780 1 < suggested update operation key=922B2PPJFX2Z tag=XF9G5WLNU3MU type=del size=1889086 2024-09-12T00:19:22.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.081+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=Z0NGH1EP4P55 type=del size=1345393 2024-09-12T00:19:22.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.082+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=6ADAOQGFWP1H type=del 2024-09-12T00:19:22.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.085+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~UYWAM9HJDFHP.0 size=1048576 2024-09-12T00:19:22.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.086+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~UYWAM9HJDFHP.1 size=924552 2024-09-12T00:19:22.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.086+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=UYWAM9HJDFHP tag=IFTNMM095LUM type=write size=3021704 2024-09-12T00:19:22.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.088+0000 7f682945b780 1 < completed write operation key=TYNSP8BHYO65 tag=1W1XENYB1UF0 type=write size=989039 2024-09-12T00:19:22.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.090+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=WCJZRSR8Y74I type=write size=821500 2024-09-12T00:19:22.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.091+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=W08R5039CCCA type=del 2024-09-12T00:19:22.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.093+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=7RONB1GE4RI6 type=write size=1023192 2024-09-12T00:19:22.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.094+0000 7f682945b780 1 < canceled operation key=8D9UC8FJ16UK tag=04K46B33TD45 type=del size=2574625 2024-09-12T00:19:22.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.096+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=9KV0FD64B0A5 type=del size=3057528 2024-09-12T00:19:22.096 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.097+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~3T7HODLJLW7C.0 size=962869 2024-09-12T00:19:22.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.099+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=3T7HODLJLW7C tag=KK5AZHR4JTPB type=write size=2011445 2024-09-12T00:19:22.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.101+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=P36JYP4V14YH type=write size=691161 2024-09-12T00:19:22.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.103+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~JNTC30X8EM28.0 size=1048576 2024-09-12T00:19:22.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.104+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~JNTC30X8EM28.1 size=971639 2024-09-12T00:19:22.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.107+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=JNTC30X8EM28 tag=CG25KQ2MDAWT type=write size=3068791 2024-09-12T00:19:22.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.108+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=03276XRKLJHD type=del size=3604896 2024-09-12T00:19:22.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.110+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=U9IOWZ7JAPTL type=del 2024-09-12T00:19:22.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.112+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~CUSZ6YDC5D2W.0 size=119582 2024-09-12T00:19:22.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.112+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=CUSZ6YDC5D2W tag=CXS2WO7LN9KN type=write size=1168158 2024-09-12T00:19:22.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.113+0000 7f682945b780 1 < completed write operation key=TYNSP8BHYO65 tag=8I9B22HRVWLS type=write size=578102 2024-09-12T00:19:22.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.115+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=OUKJ1ULPJEE3 type=del size=3865432 2024-09-12T00:19:22.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.116+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~IZN636VQTTOL.0 size=1048576 2024-09-12T00:19:22.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.118+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~IZN636VQTTOL.1 size=1048576 2024-09-12T00:19:22.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.118+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~IZN636VQTTOL.2 size=827170 2024-09-12T00:19:22.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.121+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=IZN636VQTTOL tag=F7G5O6E0FOZY type=write size=3972898 2024-09-12T00:19:22.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.122+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=KR2E3IC40M1I type=del size=840981 2024-09-12T00:19:22.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.124+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~VV558L0U6WKW.0 size=104767 2024-09-12T00:19:22.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.126+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=VV558L0U6WKW tag=B89Z5DMLOQP5 type=write size=1153343 2024-09-12T00:19:22.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.127+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=G5A25C82GZHI type=del size=1127476 2024-09-12T00:19:22.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.128+0000 7f682945b780 1 < canceled operation key=Y65K9I6K41X5 tag=ZA3D0ZO1159A type=del size=3883108 2024-09-12T00:19:22.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.130+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=H3O4L43WX0HT type=del size=971614 2024-09-12T00:19:22.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.132+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~O6TAIG4GQ5A6.0 size=1048576 2024-09-12T00:19:22.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.133+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~O6TAIG4GQ5A6.1 size=280824 2024-09-12T00:19:22.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.135+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=O6TAIG4GQ5A6 tag=XGVRTI8Q20C6 type=write size=2377976 2024-09-12T00:19:22.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.137+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=2QFS6RMJVF21 type=del size=3896419 2024-09-12T00:19:22.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.138+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~H7D6IH16LYYI.0 size=1048576 2024-09-12T00:19:22.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.138+0000 7f682945b780 1 < canceled part key=_multipart_Z7408WO050VI.2~H7D6IH16LYYI.1 size=467545 2024-09-12T00:19:22.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.140+0000 7f682945b780 1 < canceled multipart upload key=Z7408WO050VI upload=H7D6IH16LYYI tag=6F8IF9DC0JL3 type=write size=2564697 2024-09-12T00:19:22.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.143+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~MALJY7QS9C81.0 size=903812 2024-09-12T00:19:22.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.143+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=MALJY7QS9C81 tag=8X7L0CUPAGRQ type=write size=1952388 2024-09-12T00:19:22.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.146+0000 7f682945b780 1 < suggested update operation key=R2OAUUKLV7OK tag=L8QYSF9RCL71 type=del size=26226 2024-09-12T00:19:22.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.147+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=I4O44V0RLHJK type=del size=1594321 2024-09-12T00:19:22.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.148+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~1X5LU9N1FKD2.0 size=1048576 2024-09-12T00:19:22.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.149+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~1X5LU9N1FKD2.1 size=1048576 2024-09-12T00:19:22.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.151+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~1X5LU9N1FKD2.2 size=481965 2024-09-12T00:19:22.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.153+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=1X5LU9N1FKD2 tag=VV0U09ZVPAU5 type=write size=3627693 2024-09-12T00:19:22.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.155+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=OI3CWMY2M670 type=del size=3153511 2024-09-12T00:19:22.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.156+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=Z0NGH1EP4P55 type=del 2024-09-12T00:19:22.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.159+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=YQIZQG6HVT47 type=del size=4042654 2024-09-12T00:19:22.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.160+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~UYWAM9HJDFHP.0 size=1048576 2024-09-12T00:19:22.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.162+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~UYWAM9HJDFHP.1 size=924552 2024-09-12T00:19:22.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.165+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=UYWAM9HJDFHP tag=IFTNMM095LUM type=write size=3021704 2024-09-12T00:19:22.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.166+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=B32THIE0KJ1S type=del size=1647777 2024-09-12T00:19:22.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.167+0000 7f682945b780 1 < completed write operation key=TGOBZH6DZK71 tag=WCJZRSR8Y74I type=write size=821500 2024-09-12T00:19:22.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.169+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=OQ06OOM001Q5 type=del size=67206 2024-09-12T00:19:22.169 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.170+0000 7f682945b780 1 < completed write operation key=EYHGJ82COSE9 tag=7RONB1GE4RI6 type=write size=1023192 2024-09-12T00:19:22.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.172+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=Y2NL77XZ85E5 type=del size=1784469 2024-09-12T00:19:22.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.173+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=9KV0FD64B0A5 type=del 2024-09-12T00:19:22.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.175+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=9LD34ZBKHH3E type=del size=790460 2024-09-12T00:19:22.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.177+0000 7f682945b780 1 < suggested remove operation key=CE5EBY7EGY4Z tag=P36JYP4V14YH type=write 2024-09-12T00:19:22.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.180+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~AMLL43K4XCB9.0 size=1048576 2024-09-12T00:19:22.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.181+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~AMLL43K4XCB9.1 size=885432 2024-09-12T00:19:22.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.181+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=AMLL43K4XCB9 tag=W5KVNGDQBC75 type=write size=2982584 2024-09-12T00:19:22.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.184+0000 7f682945b780 1 < suggested update operation key=922B2PPJFX2Z tag=03276XRKLJHD type=del size=3604896 2024-09-12T00:19:22.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.185+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=JPPX51LIIBME type=write size=207280 2024-09-12T00:19:22.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.187+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~CUSZ6YDC5D2W.0 size=119582 2024-09-12T00:19:22.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.189+0000 7f682945b780 1 < completed multipart upload key=8D9UC8FJ16UK upload=CUSZ6YDC5D2W tag=CXS2WO7LN9KN type=write size=1168158 2024-09-12T00:19:22.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.192+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~P8RO62L0T6RG.0 size=605107 2024-09-12T00:19:22.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.192+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=P8RO62L0T6RG tag=H4G40UMDAQRI type=write size=1653683 2024-09-12T00:19:22.192 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.193+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=OUKJ1ULPJEE3 type=del 2024-09-12T00:19:22.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.195+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=6S44XB8JE5SY type=del size=3096343 2024-09-12T00:19:22.196 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.197+0000 7f682945b780 1 < suggested update operation key=AZKLWMQ818SW tag=KR2E3IC40M1I type=del size=840981 2024-09-12T00:19:22.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.199+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=ZO6ADPE7TD27 type=write size=993945 2024-09-12T00:19:22.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.200+0000 7f682945b780 1 < canceled operation key=TYNSP8BHYO65 tag=G5A25C82GZHI type=del size=1127476 2024-09-12T00:19:22.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.201+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=DPJXNHBWX7KF type=del size=4175666 2024-09-12T00:19:22.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.203+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=H3O4L43WX0HT type=del 2024-09-12T00:19:22.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.205+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~WFPPR543KRC9.0 size=1048576 2024-09-12T00:19:22.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.206+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~WFPPR543KRC9.1 size=1048576 2024-09-12T00:19:22.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.207+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~WFPPR543KRC9.2 size=862301 2024-09-12T00:19:22.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.207+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=WFPPR543KRC9 tag=CAFCWV21INNM type=write size=4008029 2024-09-12T00:19:22.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.210+0000 7f682945b780 1 < suggested remove operation key=IUPAGGPATJB4 tag=2QFS6RMJVF21 type=del 2024-09-12T00:19:22.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.211+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=S69KUPZGE6I4 type=del size=216742 2024-09-12T00:19:22.211 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.213+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~MALJY7QS9C81.0 size=903812 2024-09-12T00:19:22.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.215+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=MALJY7QS9C81 tag=8X7L0CUPAGRQ type=write size=1952388 2024-09-12T00:19:22.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.217+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~6FXBI2Y3FEPI.0 size=1048576 2024-09-12T00:19:22.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.219+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~6FXBI2Y3FEPI.1 size=840893 2024-09-12T00:19:22.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.219+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=6FXBI2Y3FEPI tag=AFJ8NJWBE3MP type=write size=2938045 2024-09-12T00:19:22.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.220+0000 7f682945b780 1 < canceled operation key=TGOBZH6DZK71 tag=I4O44V0RLHJK type=del size=1594321 2024-09-12T00:19:22.220 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.222+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=O3PQDMAEPA3B type=del size=1216959 2024-09-12T00:19:22.221 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.223+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=OI3CWMY2M670 type=del 2024-09-12T00:19:22.223 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.225+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=YOOO2LE4YWDM type=del size=2171316 2024-09-12T00:19:22.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.226+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=YQIZQG6HVT47 type=del 2024-09-12T00:19:22.227 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.229+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~GGYO5EXMLN4T.0 size=1048576 2024-09-12T00:19:22.228 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.230+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~GGYO5EXMLN4T.1 size=1048576 2024-09-12T00:19:22.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.231+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~GGYO5EXMLN4T.2 size=795864 2024-09-12T00:19:22.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.231+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=GGYO5EXMLN4T tag=JMAIN37NW2IA type=write size=3941592 2024-09-12T00:19:22.231 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.232+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=B32THIE0KJ1S type=del 2024-09-12T00:19:22.232 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.234+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=ZMRAJEHEQOP7 type=del size=822964 2024-09-12T00:19:22.235 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.237+0000 7f682945b780 1 < suggested remove operation key=Z7408WO050VI tag=OQ06OOM001Q5 type=del 2024-09-12T00:19:22.237 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.238+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=OJNA1LHT25PN type=write size=472825 2024-09-12T00:19:22.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.240+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=Y2NL77XZ85E5 type=del 2024-09-12T00:19:22.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.241+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=60ADEQ7Q9YNT type=del size=676147 2024-09-12T00:19:22.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.243+0000 7f682945b780 1 < canceled operation key=P56VIP3WIOJL tag=9LD34ZBKHH3E type=del size=790460 2024-09-12T00:19:22.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.245+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~P07LWOFZBFL1.0 size=1048576 2024-09-12T00:19:22.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.247+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~P07LWOFZBFL1.1 size=879040 2024-09-12T00:19:22.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.247+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=P07LWOFZBFL1 tag=FL26ECFI1K5Z type=write size=2976192 2024-09-12T00:19:22.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.248+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~AMLL43K4XCB9.0 size=1048576 2024-09-12T00:19:22.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.249+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~AMLL43K4XCB9.1 size=885432 2024-09-12T00:19:22.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.252+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=AMLL43K4XCB9 tag=W5KVNGDQBC75 type=write size=2982584 2024-09-12T00:19:22.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.254+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~IRQCOT9Y35ML.0 size=1048576 2024-09-12T00:19:22.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.255+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~IRQCOT9Y35ML.1 size=288499 2024-09-12T00:19:22.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.255+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=IRQCOT9Y35ML tag=W5IF1IDLWIS8 type=write size=2385651 2024-09-12T00:19:22.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.257+0000 7f682945b780 1 < completed write operation key=TGOBZH6DZK71 tag=JPPX51LIIBME type=write size=207280 2024-09-12T00:19:22.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.259+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=T17142FCCFKB type=del size=3660912 2024-09-12T00:19:22.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.259+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~P8RO62L0T6RG.0 size=605107 2024-09-12T00:19:22.260 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.262+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=P8RO62L0T6RG tag=H4G40UMDAQRI type=write size=1653683 2024-09-12T00:19:22.263 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.264+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~Y9EO66PT3IHC.0 size=1048576 2024-09-12T00:19:22.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.265+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~Y9EO66PT3IHC.1 size=84610 2024-09-12T00:19:22.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.265+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=Y9EO66PT3IHC tag=UCPQ0BQNLRWY type=write size=2181762 2024-09-12T00:19:22.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.266+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=6S44XB8JE5SY type=del 2024-09-12T00:19:22.266 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.268+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=JDUSTRMK0YN6 type=del size=1941146 2024-09-12T00:19:22.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.270+0000 7f682945b780 1 < suggested update operation key=BK212Z99RM7F tag=ZO6ADPE7TD27 type=write size=993945 2024-09-12T00:19:22.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.272+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=362Q6BPS40Z1 type=del size=2447928 2024-09-12T00:19:22.272 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.273+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=DPJXNHBWX7KF type=del 2024-09-12T00:19:22.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.275+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=EBYEQW0O12JA type=del size=3500633 2024-09-12T00:19:22.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.276+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~WFPPR543KRC9.0 size=1048576 2024-09-12T00:19:22.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.277+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~WFPPR543KRC9.1 size=1048576 2024-09-12T00:19:22.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.277+0000 7f682945b780 1 < canceled part key=_multipart_922B2PPJFX2Z.2~WFPPR543KRC9.2 size=862301 2024-09-12T00:19:22.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.279+0000 7f682945b780 1 < canceled multipart upload key=922B2PPJFX2Z upload=WFPPR543KRC9 tag=CAFCWV21INNM type=write size=4008029 2024-09-12T00:19:22.279 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.281+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=0BBZRE6872X2 type=write size=113789 2024-09-12T00:19:22.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.282+0000 7f682945b780 1 < canceled operation key=17S1X3WXCNAR tag=S69KUPZGE6I4 type=del size=216742 2024-09-12T00:19:22.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.284+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=47F465RZT1CZ type=del size=3187868 2024-09-12T00:19:22.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.285+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~6FXBI2Y3FEPI.0 size=1048576 2024-09-12T00:19:22.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.286+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~6FXBI2Y3FEPI.1 size=840893 2024-09-12T00:19:22.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.289+0000 7f682945b780 1 < completed multipart upload key=8D9UC8FJ16UK upload=6FXBI2Y3FEPI tag=AFJ8NJWBE3MP type=write size=2938045 2024-09-12T00:19:22.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.290+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=LGYL71WOI2BN type=del size=2771596 2024-09-12T00:19:22.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.292+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=O3PQDMAEPA3B type=del 2024-09-12T00:19:22.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.293+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=A6LPU7Q6LQ21 type=del size=9675 2024-09-12T00:19:22.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.295+0000 7f682945b780 1 < completed delete operation key=8D9UC8FJ16UK tag=YOOO2LE4YWDM type=del 2024-09-12T00:19:22.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.298+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~AVIRJT7FDCLK.0 size=892335 2024-09-12T00:19:22.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.298+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=AVIRJT7FDCLK tag=KPPALM91M8YE type=write size=1940911 2024-09-12T00:19:22.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.299+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~GGYO5EXMLN4T.0 size=1048576 2024-09-12T00:19:22.298 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.300+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~GGYO5EXMLN4T.1 size=1048576 2024-09-12T00:19:22.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.301+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~GGYO5EXMLN4T.2 size=795864 2024-09-12T00:19:22.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.303+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=GGYO5EXMLN4T tag=JMAIN37NW2IA type=write size=3941592 2024-09-12T00:19:22.304 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.305+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~AZ3G52FNL0GZ.0 size=1048576 2024-09-12T00:19:22.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.307+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~AZ3G52FNL0GZ.1 size=391036 2024-09-12T00:19:22.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.307+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=AZ3G52FNL0GZ tag=TCPRHEF61KUF type=write size=2488188 2024-09-12T00:19:22.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.309+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=ZMRAJEHEQOP7 type=del 2024-09-12T00:19:22.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.311+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~BXDT1IMWN0ZB.0 size=1048576 2024-09-12T00:19:22.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.312+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~BXDT1IMWN0ZB.1 size=257395 2024-09-12T00:19:22.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.312+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=BXDT1IMWN0ZB tag=UUXEYR9X3M13 type=write size=2354547 2024-09-12T00:19:22.312 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.313+0000 7f682945b780 1 < completed write operation key=38JJBFDTIYSU tag=OJNA1LHT25PN type=write size=472825 2024-09-12T00:19:22.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.315+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=I97I1G5IG0GT type=del size=3525058 2024-09-12T00:19:22.315 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.316+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=60ADEQ7Q9YNT type=del 2024-09-12T00:19:22.316 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.318+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=151AV2MSS66R type=del size=1747312 2024-09-12T00:19:22.318 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.319+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~P07LWOFZBFL1.0 size=1048576 2024-09-12T00:19:22.318 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.319+0000 7f682945b780 1 < canceled part key=_multipart_D06ZUP2ZXX42.2~P07LWOFZBFL1.1 size=879040 2024-09-12T00:19:22.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.322+0000 7f682945b780 1 < canceled multipart upload key=D06ZUP2ZXX42 upload=P07LWOFZBFL1 tag=FL26ECFI1K5Z type=write size=2976192 2024-09-12T00:19:22.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.326+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~GOPE02IHB5V7.0 size=1048576 2024-09-12T00:19:22.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.327+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~GOPE02IHB5V7.1 size=428553 2024-09-12T00:19:22.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.327+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=GOPE02IHB5V7 tag=8LVQS293B7ZM type=write size=2525705 2024-09-12T00:19:22.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.329+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~IRQCOT9Y35ML.0 size=1048576 2024-09-12T00:19:22.328 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.329+0000 7f682945b780 1 < canceled part key=_multipart_3JFMN39G6TTF.2~IRQCOT9Y35ML.1 size=288499 2024-09-12T00:19:22.330 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.331+0000 7f682945b780 1 < canceled multipart upload key=3JFMN39G6TTF upload=IRQCOT9Y35ML tag=W5IF1IDLWIS8 type=write size=2385651 2024-09-12T00:19:22.333 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.334+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~ZGM01QUFYX66.0 size=1048576 2024-09-12T00:19:22.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.335+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~ZGM01QUFYX66.1 size=840037 2024-09-12T00:19:22.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.335+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=ZGM01QUFYX66 tag=4Y4E7N6XMSVJ type=write size=2937189 2024-09-12T00:19:22.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.337+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=T17142FCCFKB type=del 2024-09-12T00:19:22.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.338+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=S0JGZK5IF0UM type=write size=5558 2024-09-12T00:19:22.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.340+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~Y9EO66PT3IHC.0 size=1048576 2024-09-12T00:19:22.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.342+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~Y9EO66PT3IHC.1 size=84610 2024-09-12T00:19:22.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.343+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=Y9EO66PT3IHC tag=UCPQ0BQNLRWY type=write size=2181762 2024-09-12T00:19:22.343 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.345+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=2FW8O7MDPS5N type=del size=1123488 2024-09-12T00:19:22.346 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.348+0000 7f682945b780 1 < suggested update operation key=JAVE3HR52R5C tag=JDUSTRMK0YN6 type=del size=1941146 2024-09-12T00:19:22.349 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.350+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=D0F4A8J3UG39 type=write size=379364 2024-09-12T00:19:22.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.353+0000 7f682945b780 1 < suggested update operation key=SGWTWN8RTKDD tag=362Q6BPS40Z1 type=del size=2447928 2024-09-12T00:19:22.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.355+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=RQ075WZQIUZW type=del size=1865078 2024-09-12T00:19:22.355 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.356+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=EBYEQW0O12JA type=del 2024-09-12T00:19:22.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.357+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=DVRUYPYG8KCS type=write size=909970 2024-09-12T00:19:22.358 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.360+0000 7f682945b780 1 < suggested remove operation key=38JJBFDTIYSU tag=0BBZRE6872X2 type=write 2024-09-12T00:19:22.361 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.363+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~AG38CREUUJUK.0 size=1048576 2024-09-12T00:19:22.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.364+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~AG38CREUUJUK.1 size=1048576 2024-09-12T00:19:22.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.365+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~AG38CREUUJUK.2 size=777781 2024-09-12T00:19:22.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.365+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=AG38CREUUJUK tag=EIXLR2UZ8HQ1 type=write size=3923509 2024-09-12T00:19:22.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.367+0000 7f682945b780 1 < suggested update operation key=Z7408WO050VI tag=47F465RZT1CZ type=del size=3187868 2024-09-12T00:19:22.368 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.370+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~VQ6K0WCF5928.0 size=1048576 2024-09-12T00:19:22.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.371+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~VQ6K0WCF5928.1 size=354423 2024-09-12T00:19:22.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.371+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=VQ6K0WCF5928 tag=ZGOH15VJNC75 type=write size=2451575 2024-09-12T00:19:22.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.372+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=LGYL71WOI2BN type=del 2024-09-12T00:19:22.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.374+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=VI794OBHG2FW type=write size=258495 2024-09-12T00:19:22.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.375+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=A6LPU7Q6LQ21 type=del 2024-09-12T00:19:22.375 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.376+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=MGYOS7MIBYAL type=del size=4122080 2024-09-12T00:19:22.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.378+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~AVIRJT7FDCLK.0 size=892335 2024-09-12T00:19:22.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.381+0000 7f682945b780 1 < completed multipart upload key=6DUQKU3R1RL8 upload=AVIRJT7FDCLK tag=KPPALM91M8YE type=write size=1940911 2024-09-12T00:19:22.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.383+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~O2RMP520JKIM.0 size=1048576 2024-09-12T00:19:22.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.384+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~O2RMP520JKIM.1 size=661537 2024-09-12T00:19:22.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.384+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=O2RMP520JKIM tag=EYA1DYMWKZZ9 type=write size=2758689 2024-09-12T00:19:22.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.385+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~AZ3G52FNL0GZ.0 size=1048576 2024-09-12T00:19:22.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.386+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~AZ3G52FNL0GZ.1 size=391036 2024-09-12T00:19:22.387 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.389+0000 7f682945b780 1 < completed multipart upload key=8D9UC8FJ16UK upload=AZ3G52FNL0GZ tag=TCPRHEF61KUF type=write size=2488188 2024-09-12T00:19:22.389 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.390+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=PBI5OJN9JT2Z type=write size=1024256 2024-09-12T00:19:22.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.392+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~BXDT1IMWN0ZB.0 size=1048576 2024-09-12T00:19:22.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.394+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~BXDT1IMWN0ZB.1 size=257395 2024-09-12T00:19:22.394 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.396+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=BXDT1IMWN0ZB tag=UUXEYR9X3M13 type=write size=2354547 2024-09-12T00:19:22.395 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.397+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=3RO0QEG5X5CQ type=del size=3384539 2024-09-12T00:19:22.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.398+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=I97I1G5IG0GT type=del 2024-09-12T00:19:22.398 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.400+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=3QMAP6MEP5TP type=del size=1330501 2024-09-12T00:19:22.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.401+0000 7f682945b780 1 < canceled operation key=BMTPXZ1OA2TZ tag=151AV2MSS66R type=del size=1747312 2024-09-12T00:19:22.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.402+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=FN72TTEV4NZO type=del size=342512 2024-09-12T00:19:22.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.404+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~GOPE02IHB5V7.0 size=1048576 2024-09-12T00:19:22.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.405+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~GOPE02IHB5V7.1 size=428553 2024-09-12T00:19:22.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.407+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=GOPE02IHB5V7 tag=8LVQS293B7ZM type=write size=2525705 2024-09-12T00:19:22.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.410+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~CGYE301AG3E0.0 size=1048576 2024-09-12T00:19:22.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.411+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~CGYE301AG3E0.1 size=945300 2024-09-12T00:19:22.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.411+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=CGYE301AG3E0 tag=TF4LD8EJIM5Q type=write size=3042452 2024-09-12T00:19:22.411 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.413+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~ZGM01QUFYX66.0 size=1048576 2024-09-12T00:19:22.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.413+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~ZGM01QUFYX66.1 size=840037 2024-09-12T00:19:22.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.416+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=ZGM01QUFYX66 tag=4Y4E7N6XMSVJ type=write size=2937189 2024-09-12T00:19:22.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.419+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~79TWWX1JBY7O.0 size=1048576 2024-09-12T00:19:22.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.419+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~79TWWX1JBY7O.1 size=817197 2024-09-12T00:19:22.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.419+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=79TWWX1JBY7O tag=IB7TP3HURAED type=write size=2914349 2024-09-12T00:19:22.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.422+0000 7f682945b780 1 < suggested remove operation key=IUPAGGPATJB4 tag=S0JGZK5IF0UM type=write 2024-09-12T00:19:22.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.423+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=W0NOUV6E7JRI type=del size=3165406 2024-09-12T00:19:22.424 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.426+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=2FW8O7MDPS5N type=del 2024-09-12T00:19:22.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.429+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~B6IRZ3BVF1PK.0 size=1048576 2024-09-12T00:19:22.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.430+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~B6IRZ3BVF1PK.1 size=391200 2024-09-12T00:19:22.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.430+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=B6IRZ3BVF1PK tag=ZU9UW3N7YRS3 type=write size=2488352 2024-09-12T00:19:22.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.431+0000 7f682945b780 1 < completed write operation key=BV3D543J63H1 tag=D0F4A8J3UG39 type=write size=379364 2024-09-12T00:19:22.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.434+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~0UO3K4W4FY5R.0 size=1048576 2024-09-12T00:19:22.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.435+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~0UO3K4W4FY5R.1 size=1048576 2024-09-12T00:19:22.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.436+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~0UO3K4W4FY5R.2 size=672317 2024-09-12T00:19:22.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.436+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=0UO3K4W4FY5R tag=2M4YQEZPB8D0 type=write size=3818045 2024-09-12T00:19:22.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.438+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=RQ075WZQIUZW type=del 2024-09-12T00:19:22.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.439+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=X7RXOTSEFSX3 type=del size=1057789 2024-09-12T00:19:22.439 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.440+0000 7f682945b780 -1 < failed to complete operation key=Z7408WO050VI tag=DVRUYPYG8KCS type=write size=909970: (22) Invalid argument 2024-09-12T00:19:22.440 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.442+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=O19CJC4F9F1S type=del size=2764923 2024-09-12T00:19:22.442 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.444+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~AG38CREUUJUK.0 size=1048576 2024-09-12T00:19:22.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.445+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~AG38CREUUJUK.1 size=1048576 2024-09-12T00:19:22.445 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.446+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~AG38CREUUJUK.2 size=777781 2024-09-12T00:19:22.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.448+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=AG38CREUUJUK tag=EIXLR2UZ8HQ1 type=write size=3923509 2024-09-12T00:19:22.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.451+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~4ITYY214K82B.0 size=349899 2024-09-12T00:19:22.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.451+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=4ITYY214K82B tag=06SMYI7FJ5H3 type=write size=1398475 2024-09-12T00:19:22.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.452+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~VQ6K0WCF5928.0 size=1048576 2024-09-12T00:19:22.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.453+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~VQ6K0WCF5928.1 size=354423 2024-09-12T00:19:22.456 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.456+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=VQ6K0WCF5928 tag=ZGOH15VJNC75 type=write size=2451575 2024-09-12T00:19:22.457 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.458+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~0DGVJ3WC26GT.0 size=45022 2024-09-12T00:19:22.457 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.458+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=0DGVJ3WC26GT tag=1IZ92ZHJYDU7 type=write size=1093598 2024-09-12T00:19:22.458 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.460+0000 7f682945b780 1 < completed write operation key=BI3KCKV4CRWR tag=VI794OBHG2FW type=write size=258495 2024-09-12T00:19:22.459 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.461+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=FSOZTFJUAUVJ type=del size=2714301 2024-09-12T00:19:22.462 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.464+0000 7f682945b780 1 < suggested remove operation key=TYNSP8BHYO65 tag=MGYOS7MIBYAL type=del 2024-09-12T00:19:22.464 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.465+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=TMVOXJMT6PQP type=del size=236576 2024-09-12T00:19:22.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.466+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~O2RMP520JKIM.0 size=1048576 2024-09-12T00:19:22.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.468+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~O2RMP520JKIM.1 size=661537 2024-09-12T00:19:22.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.471+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=O2RMP520JKIM tag=EYA1DYMWKZZ9 type=write size=2758689 2024-09-12T00:19:22.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.471+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=K0P21D0HL1JV type=del size=3042468 2024-09-12T00:19:22.471 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.473+0000 7f682945b780 1 < completed write operation key=BV3D543J63H1 tag=PBI5OJN9JT2Z type=write size=1024256 2024-09-12T00:19:22.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.474+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=RPX6TGPXJ912 type=del size=2744850 2024-09-12T00:19:22.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.476+0000 7f682945b780 1 < completed delete operation key=8D9UC8FJ16UK tag=3RO0QEG5X5CQ type=del 2024-09-12T00:19:22.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.478+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~72DLRCE93M48.0 size=1048576 2024-09-12T00:19:22.478 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.479+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~72DLRCE93M48.1 size=689568 2024-09-12T00:19:22.478 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.479+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=72DLRCE93M48 tag=7HZ2X5NUO5FZ type=write size=2786720 2024-09-12T00:19:22.479 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.481+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=3QMAP6MEP5TP type=del 2024-09-12T00:19:22.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.482+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=HISMCFBRUWOO type=del size=398779 2024-09-12T00:19:22.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.484+0000 7f682945b780 1 < completed delete operation key=R7V03ML1H80V tag=FN72TTEV4NZO type=del 2024-09-12T00:19:22.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.485+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=C8K2Z6J9DQ6L type=del size=1941712 2024-09-12T00:19:22.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.486+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~CGYE301AG3E0.0 size=1048576 2024-09-12T00:19:22.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.488+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~CGYE301AG3E0.1 size=945300 2024-09-12T00:19:22.489 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.490+0000 7f682945b780 1 < completed multipart upload key=D06ZUP2ZXX42 upload=CGYE301AG3E0 tag=TF4LD8EJIM5Q type=write size=3042452 2024-09-12T00:19:22.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.492+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=5X2KX3TC3VVP type=del size=1031874 2024-09-12T00:19:22.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.493+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~79TWWX1JBY7O.0 size=1048576 2024-09-12T00:19:22.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.494+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~79TWWX1JBY7O.1 size=817197 2024-09-12T00:19:22.495 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.497+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=79TWWX1JBY7O tag=IB7TP3HURAED type=write size=2914349 2024-09-12T00:19:22.497 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.498+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=8HX0B75835O3 type=write size=511634 2024-09-12T00:19:22.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.501+0000 7f682945b780 1 < suggested update operation key=1RAFARG1JXFQ tag=W0NOUV6E7JRI type=del size=3165406 2024-09-12T00:19:22.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.503+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=VHMR6C3B81TN type=del size=3616290 2024-09-12T00:19:22.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.504+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~B6IRZ3BVF1PK.0 size=1048576 2024-09-12T00:19:22.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.504+0000 7f682945b780 1 < canceled part key=_multipart_7RRJO383D8TH.2~B6IRZ3BVF1PK.1 size=391200 2024-09-12T00:19:22.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.507+0000 7f682945b780 1 < canceled multipart upload key=7RRJO383D8TH upload=B6IRZ3BVF1PK tag=ZU9UW3N7YRS3 type=write size=2488352 2024-09-12T00:19:22.508 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.509+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~Q9LQF7HSOVIU.0 size=162105 2024-09-12T00:19:22.508 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.509+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=Q9LQF7HSOVIU tag=70N4OPGETSB3 type=write size=1210681 2024-09-12T00:19:22.509 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.511+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~0UO3K4W4FY5R.0 size=1048576 2024-09-12T00:19:22.510 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.512+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~0UO3K4W4FY5R.1 size=1048576 2024-09-12T00:19:22.511 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.513+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~0UO3K4W4FY5R.2 size=672317 2024-09-12T00:19:22.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.516+0000 7f682945b780 1 < completed multipart upload key=CT2L8L3849IN upload=0UO3K4W4FY5R tag=2M4YQEZPB8D0 type=write size=3818045 2024-09-12T00:19:22.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.519+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~S4IPKBO78352.0 size=52037 2024-09-12T00:19:22.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.519+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=S4IPKBO78352 tag=ADRRHR3TQ21O type=write size=1100613 2024-09-12T00:19:22.518 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.520+0000 7f682945b780 1 < completed delete operation key=COUJXCOSVPDS tag=X7RXOTSEFSX3 type=del 2024-09-12T00:19:22.520 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.521+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=PX8WB9AMTGBT type=write size=277775 2024-09-12T00:19:22.521 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.522+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=O19CJC4F9F1S type=del 2024-09-12T00:19:22.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.524+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=UY1UAT4L9CMR type=write size=937835 2024-09-12T00:19:22.524 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.525+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~4ITYY214K82B.0 size=349899 2024-09-12T00:19:22.526 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.527+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=4ITYY214K82B tag=06SMYI7FJ5H3 type=write size=1398475 2024-09-12T00:19:22.528 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.530+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~9I3L98D5WAL9.0 size=15947 2024-09-12T00:19:22.529 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.530+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=9I3L98D5WAL9 tag=KVS3VH83W4CB type=write size=1064523 2024-09-12T00:19:22.530 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.532+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~0DGVJ3WC26GT.0 size=45022 2024-09-12T00:19:22.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.534+0000 7f682945b780 1 < completed multipart upload key=D06ZUP2ZXX42 upload=0DGVJ3WC26GT tag=1IZ92ZHJYDU7 type=write size=1093598 2024-09-12T00:19:22.535 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.537+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~YJI6LQAQF9PY.0 size=1048576 2024-09-12T00:19:22.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.538+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~YJI6LQAQF9PY.1 size=1048576 2024-09-12T00:19:22.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.539+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~YJI6LQAQF9PY.2 size=215802 2024-09-12T00:19:22.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.539+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=YJI6LQAQF9PY tag=RCG6QMV8AZBL type=write size=3361530 2024-09-12T00:19:22.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.540+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=FSOZTFJUAUVJ type=del 2024-09-12T00:19:22.540 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.542+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=CWXZLSS1L1Q7 type=del size=1577204 2024-09-12T00:19:22.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.543+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=TMVOXJMT6PQP type=del 2024-09-12T00:19:22.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.545+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=E10WB5LPMYD8 type=del size=2468623 2024-09-12T00:19:22.545 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.546+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=K0P21D0HL1JV type=del 2024-09-12T00:19:22.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.549+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~WSM5DC8ID9Y7.0 size=1048576 2024-09-12T00:19:22.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.550+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~WSM5DC8ID9Y7.1 size=117695 2024-09-12T00:19:22.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.550+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=WSM5DC8ID9Y7 tag=9YH4C0H7UZ31 type=write size=2214847 2024-09-12T00:19:22.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.551+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=RPX6TGPXJ912 type=del 2024-09-12T00:19:22.552 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.553+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=4271B3SBSTE7 type=del size=1647623 2024-09-12T00:19:22.552 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.554+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~72DLRCE93M48.0 size=1048576 2024-09-12T00:19:22.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.555+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~72DLRCE93M48.1 size=689568 2024-09-12T00:19:22.557 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.559+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=72DLRCE93M48 tag=7HZ2X5NUO5FZ type=write size=2786720 2024-09-12T00:19:22.558 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.560+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=2TSXKHA45KE8 type=del size=2510361 2024-09-12T00:19:22.560 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.561+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=HISMCFBRUWOO type=del 2024-09-12T00:19:22.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.565+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~G15H4Q3C6MUA.0 size=504505 2024-09-12T00:19:22.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.565+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=G15H4Q3C6MUA tag=B3AZLORBRTJN type=write size=1553081 2024-09-12T00:19:22.566 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.568+0000 7f682945b780 1 < suggested update operation key=TGOBZH6DZK71 tag=C8K2Z6J9DQ6L type=del size=1941712 2024-09-12T00:19:22.567 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.568+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=Z77XR0E0UKRQ type=del size=2740707 2024-09-12T00:19:22.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.570+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=5X2KX3TC3VVP type=del 2024-09-12T00:19:22.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.572+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=JR86YUI6GX43 type=write size=358304 2024-09-12T00:19:22.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.573+0000 7f682945b780 1 < completed write operation key=D06ZUP2ZXX42 tag=8HX0B75835O3 type=write size=511634 2024-09-12T00:19:22.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.576+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~JYA7FD2FEN7P.0 size=100648 2024-09-12T00:19:22.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.576+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=JYA7FD2FEN7P tag=GQ8TS537Q0XV type=write size=1149224 2024-09-12T00:19:22.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.577+0000 7f682945b780 1 < canceled operation key=9Q4HFV4F2KE2 tag=VHMR6C3B81TN type=del size=3616290 2024-09-12T00:19:22.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.578+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=NW0NH0C3FF8Q type=write size=153345 2024-09-12T00:19:22.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.580+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~Q9LQF7HSOVIU.0 size=162105 2024-09-12T00:19:22.581 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.583+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=Q9LQF7HSOVIU tag=70N4OPGETSB3 type=write size=1210681 2024-09-12T00:19:22.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.584+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=UMNI2C0DIA3T type=del size=4061178 2024-09-12T00:19:22.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.586+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~S4IPKBO78352.0 size=52037 2024-09-12T00:19:22.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.589+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=S4IPKBO78352 tag=ADRRHR3TQ21O type=write size=1100613 2024-09-12T00:19:22.589 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.591+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=8ZI5C3BOVABS type=del size=3092698 2024-09-12T00:19:22.590 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.592+0000 7f682945b780 1 < completed write operation key=38JJBFDTIYSU tag=PX8WB9AMTGBT type=write size=277775 2024-09-12T00:19:22.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.593+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=UB9ORF39XGPB type=del size=1381466 2024-09-12T00:19:22.593 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.595+0000 7f682945b780 1 < completed write operation key=IYYTX8TCLF30 tag=UY1UAT4L9CMR type=write size=937835 2024-09-12T00:19:22.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.597+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~OLZ471PU20PZ.0 size=1048576 2024-09-12T00:19:22.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.598+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~OLZ471PU20PZ.1 size=309598 2024-09-12T00:19:22.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.598+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=OLZ471PU20PZ tag=A6080PSJ6X3E type=write size=2406750 2024-09-12T00:19:22.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.600+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~9I3L98D5WAL9.0 size=15947 2024-09-12T00:19:22.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.602+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=9I3L98D5WAL9 tag=KVS3VH83W4CB type=write size=1064523 2024-09-12T00:19:22.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.605+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~CZEZY7SMV2GK.0 size=1048576 2024-09-12T00:19:22.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.606+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~CZEZY7SMV2GK.1 size=1048576 2024-09-12T00:19:22.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.607+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~CZEZY7SMV2GK.2 size=197522 2024-09-12T00:19:22.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.607+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=CZEZY7SMV2GK tag=7Y8EBFEY0HWB type=write size=3343250 2024-09-12T00:19:22.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.609+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~YJI6LQAQF9PY.0 size=1048576 2024-09-12T00:19:22.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.610+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~YJI6LQAQF9PY.1 size=1048576 2024-09-12T00:19:22.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.610+0000 7f682945b780 1 < canceled part key=_multipart_JAVE3HR52R5C.2~YJI6LQAQF9PY.2 size=215802 2024-09-12T00:19:22.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.614+0000 7f682945b780 1 < canceled multipart upload key=JAVE3HR52R5C upload=YJI6LQAQF9PY tag=RCG6QMV8AZBL type=write size=3361530 2024-09-12T00:19:22.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.617+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~IZWG75XOC43G.0 size=1048576 2024-09-12T00:19:22.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.618+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~IZWG75XOC43G.1 size=373892 2024-09-12T00:19:22.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.618+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=IZWG75XOC43G tag=RGIXYZPGP4DT type=write size=2471044 2024-09-12T00:19:22.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.619+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=CWXZLSS1L1Q7 type=del 2024-09-12T00:19:22.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.621+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=2BX3T2L4510F type=write size=653859 2024-09-12T00:19:22.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.622+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=E10WB5LPMYD8 type=del 2024-09-12T00:19:22.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.624+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=E6DOSR6K1E87 type=del size=1740701 2024-09-12T00:19:22.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.625+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~WSM5DC8ID9Y7.0 size=1048576 2024-09-12T00:19:22.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.627+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~WSM5DC8ID9Y7.1 size=117695 2024-09-12T00:19:22.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.629+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=WSM5DC8ID9Y7 tag=9YH4C0H7UZ31 type=write size=2214847 2024-09-12T00:19:22.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.631+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=XM31K06C3JX5 type=del size=2077720 2024-09-12T00:19:22.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.632+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=4271B3SBSTE7 type=del 2024-09-12T00:19:22.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.634+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=T0RARXQDZ4XT type=del size=2091348 2024-09-12T00:19:22.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.637+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=2TSXKHA45KE8 type=del 2024-09-12T00:19:22.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.639+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~YCW59D5SRKEX.0 size=1048576 2024-09-12T00:19:22.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.641+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~YCW59D5SRKEX.1 size=971699 2024-09-12T00:19:22.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.641+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=YCW59D5SRKEX tag=C7LTSO5Y0F3R type=write size=3068851 2024-09-12T00:19:22.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.641+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~G15H4Q3C6MUA.0 size=504505 2024-09-12T00:19:22.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.645+0000 7f682945b780 1 < completed multipart upload key=CT2L8L3849IN upload=G15H4Q3C6MUA tag=B3AZLORBRTJN type=write size=1553081 2024-09-12T00:19:22.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.646+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=3QZHZ0P648KM type=del size=957901 2024-09-12T00:19:22.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.648+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=Z77XR0E0UKRQ type=del 2024-09-12T00:19:22.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.651+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~04QGI0VU4TYL.0 size=1048576 2024-09-12T00:19:22.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.651+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~04QGI0VU4TYL.1 size=548540 2024-09-12T00:19:22.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.651+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=04QGI0VU4TYL tag=BQJJD622Q1BP type=write size=2645692 2024-09-12T00:19:22.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.653+0000 7f682945b780 1 < completed write operation key=9Q4HFV4F2KE2 tag=JR86YUI6GX43 type=write size=358304 2024-09-12T00:19:22.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.656+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~AIYAQ57Z46LU.0 size=590884 2024-09-12T00:19:22.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.656+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=AIYAQ57Z46LU tag=SZBSVK983WU9 type=write size=1639460 2024-09-12T00:19:22.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.658+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~JYA7FD2FEN7P.0 size=100648 2024-09-12T00:19:22.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.661+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=JYA7FD2FEN7P tag=GQ8TS537Q0XV type=write size=1149224 2024-09-12T00:19:22.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.662+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=Q710KC4ZYIIW type=write size=471431 2024-09-12T00:19:22.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.664+0000 7f682945b780 1 < completed write operation key=COUJXCOSVPDS tag=NW0NH0C3FF8Q type=write size=153345 2024-09-12T00:19:22.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.667+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~388NV8JEV16A.0 size=1048576 2024-09-12T00:19:22.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.669+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~388NV8JEV16A.1 size=1048576 2024-09-12T00:19:22.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.669+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~388NV8JEV16A.2 size=181412 2024-09-12T00:19:22.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.669+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=388NV8JEV16A tag=9KMYVVJT6KUI type=write size=3327140 2024-09-12T00:19:22.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.673+0000 7f682945b780 1 < suggested update operation key=BV3D543J63H1 tag=UMNI2C0DIA3T type=del size=4061178 2024-09-12T00:19:22.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.676+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~9J91LKW715Y7.0 size=1048576 2024-09-12T00:19:22.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.677+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~9J91LKW715Y7.1 size=1048576 2024-09-12T00:19:22.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.678+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~9J91LKW715Y7.2 size=629767 2024-09-12T00:19:22.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.678+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=9J91LKW715Y7 tag=XJ7CUGRR258A type=write size=3775495 2024-09-12T00:19:22.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.681+0000 7f682945b780 1 < suggested remove operation key=BMTPXZ1OA2TZ tag=8ZI5C3BOVABS type=del 2024-09-12T00:19:22.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.683+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=J2RSYOMYGXZ3 type=del size=656362 2024-09-12T00:19:22.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.685+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=UB9ORF39XGPB type=del 2024-09-12T00:19:22.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.688+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~BIHECH9GB8K0.0 size=1048576 2024-09-12T00:19:22.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.689+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~BIHECH9GB8K0.1 size=1048576 2024-09-12T00:19:22.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.690+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~BIHECH9GB8K0.2 size=587158 2024-09-12T00:19:22.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.690+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=BIHECH9GB8K0 tag=45DTYJXTVB1E type=write size=3732886 2024-09-12T00:19:22.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.691+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~OLZ471PU20PZ.0 size=1048576 2024-09-12T00:19:22.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.692+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~OLZ471PU20PZ.1 size=309598 2024-09-12T00:19:22.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.695+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=OLZ471PU20PZ tag=A6080PSJ6X3E type=write size=2406750 2024-09-12T00:19:22.695 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.696+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=0QCSB80BB66W type=del size=1982014 2024-09-12T00:19:22.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.698+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~CZEZY7SMV2GK.0 size=1048576 2024-09-12T00:19:22.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.698+0000 7f682945b780 1 < canceled part key=_multipart_R7V03ML1H80V.2~CZEZY7SMV2GK.1 size=1048576 2024-09-12T00:19:22.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.699+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~CZEZY7SMV2GK.2 size=197522 2024-09-12T00:19:22.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.702+0000 7f682945b780 1 < canceled multipart upload key=R7V03ML1H80V upload=CZEZY7SMV2GK tag=7Y8EBFEY0HWB type=write size=3343250 2024-09-12T00:19:22.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.704+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=5INHNYEWB863 type=del size=1014055 2024-09-12T00:19:22.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.705+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~IZWG75XOC43G.0 size=1048576 2024-09-12T00:19:22.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.706+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~IZWG75XOC43G.1 size=373892 2024-09-12T00:19:22.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.709+0000 7f682945b780 1 < completed multipart upload key=6DUQKU3R1RL8 upload=IZWG75XOC43G tag=RGIXYZPGP4DT type=write size=2471044 2024-09-12T00:19:22.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.710+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=36R7U95I2MJU type=write size=133205 2024-09-12T00:19:22.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.712+0000 7f682945b780 1 < completed write operation key=IYYTX8TCLF30 tag=2BX3T2L4510F type=write size=653859 2024-09-12T00:19:22.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.713+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=ECP5Y18E204C type=del size=813477 2024-09-12T00:19:22.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.716+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=E6DOSR6K1E87 type=del 2024-09-12T00:19:22.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.719+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~11IZEZXYK97W.0 size=70457 2024-09-12T00:19:22.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.719+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=11IZEZXYK97W tag=XCW5ZCYULHX7 type=write size=1119033 2024-09-12T00:19:22.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.720+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=XM31K06C3JX5 type=del 2024-09-12T00:19:22.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.721+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=A3HIB9BC0OT4 type=del size=1255606 2024-09-12T00:19:22.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.723+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=T0RARXQDZ4XT type=del 2024-09-12T00:19:22.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.724+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=LAL71AE7L2MF type=del size=3509812 2024-09-12T00:19:22.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.726+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~YCW59D5SRKEX.0 size=1048576 2024-09-12T00:19:22.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.727+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~YCW59D5SRKEX.1 size=971699 2024-09-12T00:19:22.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.730+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=YCW59D5SRKEX tag=C7LTSO5Y0F3R type=write size=3068851 2024-09-12T00:19:22.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.731+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=1LFLTG5S6O4V type=del size=3243571 2024-09-12T00:19:22.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.733+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=3QZHZ0P648KM type=del 2024-09-12T00:19:22.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.734+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=2SI5LYA22EBH type=del size=3776205 2024-09-12T00:19:22.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.735+0000 7f682945b780 1 < canceled part key=_multipart_BV3D543J63H1.2~04QGI0VU4TYL.0 size=1048576 2024-09-12T00:19:22.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.736+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~04QGI0VU4TYL.1 size=548540 2024-09-12T00:19:22.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.738+0000 7f682945b780 1 < canceled multipart upload key=BV3D543J63H1 upload=04QGI0VU4TYL tag=BQJJD622Q1BP type=write size=2645692 2024-09-12T00:19:22.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.742+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~EW5G7WSS3D5I.0 size=64068 2024-09-12T00:19:22.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.742+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=EW5G7WSS3D5I tag=NQUP3RH64EVI type=write size=1112644 2024-09-12T00:19:22.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.743+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~AIYAQ57Z46LU.0 size=590884 2024-09-12T00:19:22.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.745+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=AIYAQ57Z46LU tag=SZBSVK983WU9 type=write size=1639460 2024-09-12T00:19:22.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.748+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~0RS15P7T76A9.0 size=1048576 2024-09-12T00:19:22.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.748+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~0RS15P7T76A9.1 size=1048576 2024-09-12T00:19:22.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.750+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~0RS15P7T76A9.2 size=464266 2024-09-12T00:19:22.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.750+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=0RS15P7T76A9 tag=9R2E1A24GKYD type=write size=3609994 2024-09-12T00:19:22.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.751+0000 7f682945b780 1 < completed write operation key=38JJBFDTIYSU tag=Q710KC4ZYIIW type=write size=471431 2024-09-12T00:19:22.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.753+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=NIS5V9FMBS0L type=del size=1923325 2024-09-12T00:19:22.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.754+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~388NV8JEV16A.0 size=1048576 2024-09-12T00:19:22.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.755+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~388NV8JEV16A.1 size=1048576 2024-09-12T00:19:22.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.756+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~388NV8JEV16A.2 size=181412 2024-09-12T00:19:22.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.760+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=388NV8JEV16A tag=9KMYVVJT6KUI type=write size=3327140 2024-09-12T00:19:22.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.760+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=5GIAPMZ336Y7 type=del size=2302084 2024-09-12T00:19:22.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.762+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~9J91LKW715Y7.0 size=1048576 2024-09-12T00:19:22.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.763+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~9J91LKW715Y7.1 size=1048576 2024-09-12T00:19:22.763 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.765+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~9J91LKW715Y7.2 size=629767 2024-09-12T00:19:22.765 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.767+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=9J91LKW715Y7 tag=XJ7CUGRR258A type=write size=3775495 2024-09-12T00:19:22.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.769+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~WQOSSGWI8GDI.0 size=546089 2024-09-12T00:19:22.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.769+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=WQOSSGWI8GDI tag=NHA6OKDL5Z5Y type=write size=1594665 2024-09-12T00:19:22.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.771+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=J2RSYOMYGXZ3 type=del 2024-09-12T00:19:22.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.772+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=RN0KGGWRWHX0 type=del size=1317367 2024-09-12T00:19:22.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.775+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~BIHECH9GB8K0.0 size=1048576 2024-09-12T00:19:22.774 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.776+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~BIHECH9GB8K0.1 size=1048576 2024-09-12T00:19:22.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.777+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~BIHECH9GB8K0.2 size=587158 2024-09-12T00:19:22.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.779+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=BIHECH9GB8K0 tag=45DTYJXTVB1E type=write size=3732886 2024-09-12T00:19:22.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.780+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=1QHMJHEXE4H7 type=del size=1636586 2024-09-12T00:19:22.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.783+0000 7f682945b780 1 < suggested update operation key=AZKLWMQ818SW tag=0QCSB80BB66W type=del size=1982014 2024-09-12T00:19:22.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.785+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~DKUC2947M5WQ.0 size=37614 2024-09-12T00:19:22.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.785+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=DKUC2947M5WQ tag=F80RBA8SQPVV type=write size=1086190 2024-09-12T00:19:22.785 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.787+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=5INHNYEWB863 type=del 2024-09-12T00:19:22.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.788+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=4YFQ1W4KKVWG type=del size=3536217 2024-09-12T00:19:22.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.789+0000 7f682945b780 1 < completed write operation key=CE5EBY7EGY4Z tag=36R7U95I2MJU type=write size=133205 2024-09-12T00:19:22.789 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.791+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=4Y41P1VXNOZV type=del size=3772366 2024-09-12T00:19:22.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.792+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=ECP5Y18E204C type=del 2024-09-12T00:19:22.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.794+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=WFQVSU61VEF2 type=del size=1648603 2024-09-12T00:19:22.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.796+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~11IZEZXYK97W.0 size=70457 2024-09-12T00:19:22.796 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.798+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=11IZEZXYK97W tag=XCW5ZCYULHX7 type=write size=1119033 2024-09-12T00:19:22.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.800+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=YE6QPWS7U8YQ type=del size=3137927 2024-09-12T00:19:22.800 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.801+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=A3HIB9BC0OT4 type=del 2024-09-12T00:19:22.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.805+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~L8W2XDML7VDS.0 size=1048576 2024-09-12T00:19:22.804 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.805+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~L8W2XDML7VDS.1 size=1048576 2024-09-12T00:19:22.805 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.807+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~L8W2XDML7VDS.2 size=189880 2024-09-12T00:19:22.805 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.807+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=L8W2XDML7VDS tag=LXLZLXLJC2OV type=write size=3335608 2024-09-12T00:19:22.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.808+0000 7f682945b780 1 < canceled operation key=JAVE3HR52R5C tag=LAL71AE7L2MF type=del size=3509812 2024-09-12T00:19:22.808 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.809+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=RT2XF7ZKZW8S type=del size=1221246 2024-09-12T00:19:22.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.811+0000 7f682945b780 1 < canceled operation key=G0ONSUVW4M7R tag=1LFLTG5S6O4V type=del size=3243571 2024-09-12T00:19:22.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.813+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~Q3A7Z57U5WN7.0 size=1048576 2024-09-12T00:19:22.813 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.814+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~Q3A7Z57U5WN7.1 size=1048576 2024-09-12T00:19:22.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.816+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~Q3A7Z57U5WN7.2 size=553117 2024-09-12T00:19:22.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.816+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=Q3A7Z57U5WN7 tag=VJ2YBZHIZ3ME type=write size=3698845 2024-09-12T00:19:22.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.817+0000 7f682945b780 1 < completed delete operation key=38JJBFDTIYSU tag=2SI5LYA22EBH type=del 2024-09-12T00:19:22.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.819+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=HBNTXJMF96X5 type=del size=3757244 2024-09-12T00:19:22.819 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.820+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~EW5G7WSS3D5I.0 size=64068 2024-09-12T00:19:22.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.823+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=EW5G7WSS3D5I tag=NQUP3RH64EVI type=write size=1112644 2024-09-12T00:19:22.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.824+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=6JMDZQVIGE3V type=del size=3738032 2024-09-12T00:19:22.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.826+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~0RS15P7T76A9.0 size=1048576 2024-09-12T00:19:22.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.827+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~0RS15P7T76A9.1 size=1048576 2024-09-12T00:19:22.827 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.828+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~0RS15P7T76A9.2 size=464266 2024-09-12T00:19:22.829 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.830+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=0RS15P7T76A9 tag=9R2E1A24GKYD type=write size=3609994 2024-09-12T00:19:22.830 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.832+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=ZXP2WHNSSOP9 type=write size=55356 2024-09-12T00:19:22.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.833+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=NIS5V9FMBS0L type=del 2024-09-12T00:19:22.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.836+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~212G42D7YZCM.0 size=1048576 2024-09-12T00:19:22.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.837+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~212G42D7YZCM.1 size=1048576 2024-09-12T00:19:22.837 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.840+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~212G42D7YZCM.2 size=117584 2024-09-12T00:19:22.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.840+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=212G42D7YZCM tag=PB6P6U55G0ZZ type=write size=3263312 2024-09-12T00:19:22.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.841+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=5GIAPMZ336Y7 type=del 2024-09-12T00:19:22.842 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.844+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=KH9AO6BSFL9V type=del size=977738 2024-09-12T00:19:22.843 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.845+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~WQOSSGWI8GDI.0 size=546089 2024-09-12T00:19:22.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.848+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=WQOSSGWI8GDI tag=NHA6OKDL5Z5Y type=write size=1594665 2024-09-12T00:19:22.847 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.848+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=P67QG3VI6KLY type=del size=1834638 2024-09-12T00:19:22.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.852+0000 7f682945b780 1 < suggested remove operation key=CE5EBY7EGY4Z tag=RN0KGGWRWHX0 type=del 2024-09-12T00:19:22.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.855+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~WFJIPDU4ED94.0 size=1048576 2024-09-12T00:19:22.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.856+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~WFJIPDU4ED94.1 size=685299 2024-09-12T00:19:22.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.856+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=WFJIPDU4ED94 tag=X5NVT7RMWVQ2 type=write size=2782451 2024-09-12T00:19:22.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.858+0000 7f682945b780 1 < completed delete operation key=COUJXCOSVPDS tag=1QHMJHEXE4H7 type=del 2024-09-12T00:19:22.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.859+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=BUFPOM38XSRT type=del size=3784480 2024-09-12T00:19:22.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.861+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~DKUC2947M5WQ.0 size=37614 2024-09-12T00:19:22.862 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.863+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=DKUC2947M5WQ tag=F80RBA8SQPVV type=write size=1086190 2024-09-12T00:19:22.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.866+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~ZKQDLA17YFG5.0 size=1048576 2024-09-12T00:19:22.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.868+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~ZKQDLA17YFG5.1 size=915909 2024-09-12T00:19:22.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.868+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=ZKQDLA17YFG5 tag=QZ4GSYUNCHLS type=write size=3013061 2024-09-12T00:19:22.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.869+0000 7f682945b780 1 < canceled operation key=TGOBZH6DZK71 tag=4YFQ1W4KKVWG type=del size=3536217 2024-09-12T00:19:22.870 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.871+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~KX4BHXKPJNC1.0 size=1048576 2024-09-12T00:19:22.871 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.872+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~KX4BHXKPJNC1.1 size=1048576 2024-09-12T00:19:22.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.873+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~KX4BHXKPJNC1.2 size=745186 2024-09-12T00:19:22.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.873+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=KX4BHXKPJNC1 tag=NEBVCAKTSMTZ type=write size=3890914 2024-09-12T00:19:22.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.875+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=4Y41P1VXNOZV type=del 2024-09-12T00:19:22.876 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.878+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~JBZGQEGJYQL2.0 size=1048576 2024-09-12T00:19:22.877 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.879+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~JBZGQEGJYQL2.1 size=782362 2024-09-12T00:19:22.877 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.879+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=JBZGQEGJYQL2 tag=K0L514RGBPAC type=write size=2879514 2024-09-12T00:19:22.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.880+0000 7f682945b780 1 < completed delete operation key=R7V03ML1H80V tag=WFQVSU61VEF2 type=del 2024-09-12T00:19:22.880 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.882+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=YP63G7B2GW38 type=del size=2732785 2024-09-12T00:19:22.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.885+0000 7f682945b780 1 < suggested update operation key=3JFMN39G6TTF tag=YE6QPWS7U8YQ type=del size=3137927 2024-09-12T00:19:22.886 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.887+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~0W0EV5LSF92W.0 size=1048576 2024-09-12T00:19:22.887 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.888+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~0W0EV5LSF92W.1 size=1048576 2024-09-12T00:19:22.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.889+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~0W0EV5LSF92W.2 size=319757 2024-09-12T00:19:22.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.889+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=0W0EV5LSF92W tag=SSPU6G7D9XZQ type=write size=3465485 2024-09-12T00:19:22.889 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.891+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~L8W2XDML7VDS.0 size=1048576 2024-09-12T00:19:22.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.892+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~L8W2XDML7VDS.1 size=1048576 2024-09-12T00:19:22.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.893+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~L8W2XDML7VDS.2 size=189880 2024-09-12T00:19:22.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.896+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=L8W2XDML7VDS tag=LXLZLXLJC2OV type=write size=3335608 2024-09-12T00:19:22.897 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.898+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~YWQGKMW7I8DW.0 size=1048576 2024-09-12T00:19:22.898 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.899+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~YWQGKMW7I8DW.1 size=832297 2024-09-12T00:19:22.898 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.899+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=YWQGKMW7I8DW tag=1WT61UUYOVP7 type=write size=2929449 2024-09-12T00:19:22.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.902+0000 7f682945b780 1 < completed delete operation key=38JJBFDTIYSU tag=RT2XF7ZKZW8S type=del 2024-09-12T00:19:22.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.904+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=TMKSDD8Z546K type=del size=279739 2024-09-12T00:19:22.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.905+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~Q3A7Z57U5WN7.0 size=1048576 2024-09-12T00:19:22.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.905+0000 7f682945b780 1 < canceled part key=_multipart_9Q4HFV4F2KE2.2~Q3A7Z57U5WN7.1 size=1048576 2024-09-12T00:19:22.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.906+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~Q3A7Z57U5WN7.2 size=553117 2024-09-12T00:19:22.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.908+0000 7f682945b780 1 < canceled multipart upload key=9Q4HFV4F2KE2 upload=Q3A7Z57U5WN7 tag=VJ2YBZHIZ3ME type=write size=3698845 2024-09-12T00:19:22.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.910+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=H0JOTSIXM3ZA type=del size=3125381 2024-09-12T00:19:22.911 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.913+0000 7f682945b780 1 < suggested remove operation key=Y65K9I6K41X5 tag=HBNTXJMF96X5 type=del 2024-09-12T00:19:22.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.914+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=6Q0F94AUDD77 type=del size=1014487 2024-09-12T00:19:22.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.918+0000 7f682945b780 1 < suggested remove operation key=P56VIP3WIOJL tag=6JMDZQVIGE3V type=del 2024-09-12T00:19:22.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.919+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=SXAWOC2E4N6H type=del size=2875000 2024-09-12T00:19:22.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.921+0000 7f682945b780 1 < completed write operation key=9Q4HFV4F2KE2 tag=ZXP2WHNSSOP9 type=write size=55356 2024-09-12T00:19:22.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.923+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=89CERAD1BQCB type=write size=446533 2024-09-12T00:19:22.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.924+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~212G42D7YZCM.0 size=1048576 2024-09-12T00:19:22.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.925+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~212G42D7YZCM.1 size=1048576 2024-09-12T00:19:22.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.926+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~212G42D7YZCM.2 size=117584 2024-09-12T00:19:22.927 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.928+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=212G42D7YZCM tag=PB6P6U55G0ZZ type=write size=3263312 2024-09-12T00:19:22.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.931+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~G9AFCXP8X07T.0 size=642431 2024-09-12T00:19:22.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.931+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=G9AFCXP8X07T tag=3BJZT4HCXRD7 type=write size=1691007 2024-09-12T00:19:22.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.932+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=KH9AO6BSFL9V type=del 2024-09-12T00:19:22.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.934+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=B91TKWRFNIF9 type=write size=263786 2024-09-12T00:19:22.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.935+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=P67QG3VI6KLY type=del 2024-09-12T00:19:22.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.937+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=6BMKXPD26RNI type=del size=3590688 2024-09-12T00:19:22.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.938+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~WFJIPDU4ED94.0 size=1048576 2024-09-12T00:19:22.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.939+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~WFJIPDU4ED94.1 size=685299 2024-09-12T00:19:22.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.942+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=WFJIPDU4ED94 tag=X5NVT7RMWVQ2 type=write size=2782451 2024-09-12T00:19:22.942 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.943+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=2KQ9U8C9I9OH type=del size=1042203 2024-09-12T00:19:22.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.945+0000 7f682945b780 1 < canceled operation key=AZKLWMQ818SW tag=BUFPOM38XSRT type=del size=3784480 2024-09-12T00:19:22.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.948+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~552GGZ5BWYVO.0 size=1048576 2024-09-12T00:19:22.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.949+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~552GGZ5BWYVO.1 size=773804 2024-09-12T00:19:22.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.949+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=552GGZ5BWYVO tag=V30T6J19H4KX type=write size=2870956 2024-09-12T00:19:22.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.951+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~ZKQDLA17YFG5.0 size=1048576 2024-09-12T00:19:22.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.951+0000 7f682945b780 1 < canceled part key=_multipart_SGWTWN8RTKDD.2~ZKQDLA17YFG5.1 size=915909 2024-09-12T00:19:22.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.953+0000 7f682945b780 1 < canceled multipart upload key=SGWTWN8RTKDD upload=ZKQDLA17YFG5 tag=QZ4GSYUNCHLS type=write size=3013061 2024-09-12T00:19:22.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.955+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=QOEBS1UCFCIK type=del size=2909876 2024-09-12T00:19:22.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.956+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~KX4BHXKPJNC1.0 size=1048576 2024-09-12T00:19:22.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.958+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~KX4BHXKPJNC1.1 size=1048576 2024-09-12T00:19:22.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.959+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~KX4BHXKPJNC1.2 size=745186 2024-09-12T00:19:22.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.961+0000 7f682945b780 1 < completed multipart upload key=6DUQKU3R1RL8 upload=KX4BHXKPJNC1 tag=NEBVCAKTSMTZ type=write size=3890914 2024-09-12T00:19:22.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.963+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=9PAX3NUZX9D0 type=del size=1213298 2024-09-12T00:19:22.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.965+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~JBZGQEGJYQL2.0 size=1048576 2024-09-12T00:19:22.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.965+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~JBZGQEGJYQL2.1 size=782362 2024-09-12T00:19:22.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.968+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=JBZGQEGJYQL2 tag=K0L514RGBPAC type=write size=2879514 2024-09-12T00:19:22.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.969+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=YPXYQR46508X type=del size=46250 2024-09-12T00:19:22.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.971+0000 7f682945b780 -1 < failed to complete operation key=Y65K9I6K41X5 tag=YP63G7B2GW38 type=del size=2732785: (22) Invalid argument 2024-09-12T00:19:22.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.972+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=7ON5ABUEON43 type=write size=688042 2024-09-12T00:19:22.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.974+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~0W0EV5LSF92W.0 size=1048576 2024-09-12T00:19:22.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.975+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~0W0EV5LSF92W.1 size=1048576 2024-09-12T00:19:22.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.975+0000 7f682945b780 1 < canceled part key=_multipart_9Q4HFV4F2KE2.2~0W0EV5LSF92W.2 size=319757 2024-09-12T00:19:22.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.979+0000 7f682945b780 1 < canceled multipart upload key=9Q4HFV4F2KE2 upload=0W0EV5LSF92W tag=SSPU6G7D9XZQ type=write size=3465485 2024-09-12T00:19:22.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.981+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=3P8ZYZNU8MK3 type=write size=1033603 2024-09-12T00:19:22.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.983+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~YWQGKMW7I8DW.0 size=1048576 2024-09-12T00:19:22.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.984+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~YWQGKMW7I8DW.1 size=832297 2024-09-12T00:19:22.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.987+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=YWQGKMW7I8DW tag=1WT61UUYOVP7 type=write size=2929449 2024-09-12T00:19:22.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.988+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=NTXIN2IF02OK type=write size=337432 2024-09-12T00:19:22.988 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.990+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=TMKSDD8Z546K type=del 2024-09-12T00:19:22.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.992+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=VLXM807LJK01 type=del size=367925 2024-09-12T00:19:22.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.993+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=H0JOTSIXM3ZA type=del 2024-09-12T00:19:22.994 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.995+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~RZCO3VZ4N0YZ.0 size=470277 2024-09-12T00:19:22.994 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.995+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=RZCO3VZ4N0YZ tag=SS8GSP0FWTLL type=write size=1518853 2024-09-12T00:19:22.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:22.997+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=6Q0F94AUDD77 type=del 2024-09-12T00:19:22.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.000+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~T9LO57NAINNW.0 size=276903 2024-09-12T00:19:22.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.000+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=T9LO57NAINNW tag=UIFGPF8EEX6M type=write size=1325479 2024-09-12T00:19:23.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.001+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=SXAWOC2E4N6H type=del 2024-09-12T00:19:23.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.004+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~D3S1O4S2Y51O.0 size=752420 2024-09-12T00:19:23.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.004+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=D3S1O4S2Y51O tag=FYVHILBQSX6E type=write size=1800996 2024-09-12T00:19:23.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.006+0000 7f682945b780 1 < completed write operation key=SGWTWN8RTKDD tag=89CERAD1BQCB type=write size=446533 2024-09-12T00:19:23.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.007+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=8C6BJV8BHKWC type=del size=3365172 2024-09-12T00:19:23.008 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.010+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~G9AFCXP8X07T.0 size=642431 2024-09-12T00:19:23.010 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.012+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=G9AFCXP8X07T tag=3BJZT4HCXRD7 type=write size=1691007 2024-09-12T00:19:23.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.015+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~O1KTCZWDY4YJ.0 size=882421 2024-09-12T00:19:23.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.015+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=O1KTCZWDY4YJ tag=Y7OO4Y2ZNS9C type=write size=1930997 2024-09-12T00:19:23.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.016+0000 7f682945b780 1 < completed write operation key=CT2L8L3849IN tag=B91TKWRFNIF9 type=write size=263786 2024-09-12T00:19:23.017 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.019+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~0W9ZJ66R01O2.0 size=116848 2024-09-12T00:19:23.018 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.019+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=0W9ZJ66R01O2 tag=0DI28UVRD4NU type=write size=1165424 2024-09-12T00:19:23.019 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.020+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=6BMKXPD26RNI type=del 2024-09-12T00:19:23.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.022+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=9BTGALFAZTNS type=del size=3354187 2024-09-12T00:19:23.022 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.024+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=2KQ9U8C9I9OH type=del 2024-09-12T00:19:23.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.025+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=N0P2973TTIK6 type=del size=3873002 2024-09-12T00:19:23.025 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.027+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~552GGZ5BWYVO.0 size=1048576 2024-09-12T00:19:23.027 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.028+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~552GGZ5BWYVO.1 size=773804 2024-09-12T00:19:23.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.030+0000 7f682945b780 1 < completed multipart upload key=D06ZUP2ZXX42 upload=552GGZ5BWYVO tag=V30T6J19H4KX type=write size=2870956 2024-09-12T00:19:23.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.032+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=CYA8UYHZ2XBF type=del size=3826365 2024-09-12T00:19:23.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.034+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=QOEBS1UCFCIK type=del 2024-09-12T00:19:23.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.035+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=JMYWL63NG1AL type=del size=135916 2024-09-12T00:19:23.035 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.036+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=9PAX3NUZX9D0 type=del 2024-09-12T00:19:23.036 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.038+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=LZLLG0N8JKUD type=write size=298923 2024-09-12T00:19:23.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.039+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=YPXYQR46508X type=del 2024-09-12T00:19:23.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.041+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=ZOTN3GWDBWXM type=del size=3612144 2024-09-12T00:19:23.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.043+0000 7f682945b780 1 < completed write operation key=BK212Z99RM7F tag=7ON5ABUEON43 type=write size=688042 2024-09-12T00:19:23.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.045+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~VAB9QXDYB2XC.0 size=1048576 2024-09-12T00:19:23.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.047+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~VAB9QXDYB2XC.1 size=1048576 2024-09-12T00:19:23.046 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.048+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~VAB9QXDYB2XC.2 size=252642 2024-09-12T00:19:23.046 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.048+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=VAB9QXDYB2XC tag=6XTFRY775E2J type=write size=3398370 2024-09-12T00:19:23.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.049+0000 7f682945b780 1 < canceled operation key=7RRJO383D8TH tag=3P8ZYZNU8MK3 type=write size=1033603 2024-09-12T00:19:23.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.051+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=XZJ48HX2BAQX type=del size=241255 2024-09-12T00:19:23.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.052+0000 7f682945b780 1 < completed write operation key=BFY578HP8GAW tag=NTXIN2IF02OK type=write size=337432 2024-09-12T00:19:23.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.054+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=MED8WJLTU3K6 type=del size=4157205 2024-09-12T00:19:23.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.055+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=VLXM807LJK01 type=del 2024-09-12T00:19:23.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.059+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~BJ4VENIZV493.0 size=1048576 2024-09-12T00:19:23.058 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.060+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~BJ4VENIZV493.1 size=1048576 2024-09-12T00:19:23.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.060+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~BJ4VENIZV493.2 size=211104 2024-09-12T00:19:23.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.060+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=BJ4VENIZV493 tag=RMIBSMK2CYI4 type=write size=3356832 2024-09-12T00:19:23.060 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.062+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~RZCO3VZ4N0YZ.0 size=470277 2024-09-12T00:19:23.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.064+0000 7f682945b780 1 < completed multipart upload key=8D9UC8FJ16UK upload=RZCO3VZ4N0YZ tag=SS8GSP0FWTLL type=write size=1518853 2024-09-12T00:19:23.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.066+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=BGDEFURH0CWU type=del size=1439198 2024-09-12T00:19:23.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.067+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~T9LO57NAINNW.0 size=276903 2024-09-12T00:19:23.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.069+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=T9LO57NAINNW tag=UIFGPF8EEX6M type=write size=1325479 2024-09-12T00:19:23.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.071+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=EIKMM36F0FKA type=del size=892920 2024-09-12T00:19:23.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.071+0000 7f682945b780 1 < canceled part key=_multipart_IUPAGGPATJB4.2~D3S1O4S2Y51O.0 size=752420 2024-09-12T00:19:23.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.073+0000 7f682945b780 1 < canceled multipart upload key=IUPAGGPATJB4 upload=D3S1O4S2Y51O tag=FYVHILBQSX6E type=write size=1800996 2024-09-12T00:19:23.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.075+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=070S5F2G86BX type=del size=149800 2024-09-12T00:19:23.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.076+0000 7f682945b780 1 < canceled operation key=EYHGJ82COSE9 tag=8C6BJV8BHKWC type=del size=3365172 2024-09-12T00:19:23.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.077+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=VIN0EHG3I5UJ type=del size=265791 2024-09-12T00:19:23.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.079+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~O1KTCZWDY4YJ.0 size=882421 2024-09-12T00:19:23.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.081+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=O1KTCZWDY4YJ tag=Y7OO4Y2ZNS9C type=write size=1930997 2024-09-12T00:19:23.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.082+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=W6IOSMVYLX98 type=del size=2355484 2024-09-12T00:19:23.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.084+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~0W9ZJ66R01O2.0 size=116848 2024-09-12T00:19:23.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.086+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=0W9ZJ66R01O2 tag=0DI28UVRD4NU type=write size=1165424 2024-09-12T00:19:23.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.088+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=F7Y5076DYW72 type=del size=359964 2024-09-12T00:19:23.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.089+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=9BTGALFAZTNS type=del 2024-09-12T00:19:23.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.091+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=9OXV231VJHCA type=del size=3162819 2024-09-12T00:19:23.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.092+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=N0P2973TTIK6 type=del 2024-09-12T00:19:23.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.094+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=JAA1B0PK7TMO type=del size=3181150 2024-09-12T00:19:23.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.096+0000 7f682945b780 1 < suggested remove operation key=922B2PPJFX2Z tag=CYA8UYHZ2XBF type=del 2024-09-12T00:19:23.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.100+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~UJT1LDD9NTKJ.0 size=219436 2024-09-12T00:19:23.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.100+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=UJT1LDD9NTKJ tag=OIOL9ZCJ13VG type=write size=1268012 2024-09-12T00:19:23.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.102+0000 7f682945b780 1 < suggested update operation key=7RRJO383D8TH tag=JMYWL63NG1AL type=del size=135916 2024-09-12T00:19:23.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.103+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=36DT6EGBW7AK type=write size=763037 2024-09-12T00:19:23.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.105+0000 7f682945b780 1 < completed write operation key=EYHGJ82COSE9 tag=LZLLG0N8JKUD type=write size=298923 2024-09-12T00:19:23.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.107+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=WQDSTNY1KJ32 type=del size=3525240 2024-09-12T00:19:23.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.108+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=ZOTN3GWDBWXM type=del 2024-09-12T00:19:23.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.111+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~0I1U6AWENSF6.0 size=1048576 2024-09-12T00:19:23.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.111+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~0I1U6AWENSF6.1 size=1048576 2024-09-12T00:19:23.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.112+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~0I1U6AWENSF6.2 size=1017666 2024-09-12T00:19:23.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.112+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=0I1U6AWENSF6 tag=FEJX0T1OF26E type=write size=4163394 2024-09-12T00:19:23.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.115+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~VAB9QXDYB2XC.0 size=1048576 2024-09-12T00:19:23.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.116+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~VAB9QXDYB2XC.1 size=1048576 2024-09-12T00:19:23.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.116+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~VAB9QXDYB2XC.2 size=252642 2024-09-12T00:19:23.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.120+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=VAB9QXDYB2XC tag=6XTFRY775E2J type=write size=3398370 2024-09-12T00:19:23.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.121+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=1RI3GQ43IP5C type=del size=4080194 2024-09-12T00:19:23.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.123+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=XZJ48HX2BAQX type=del 2024-09-12T00:19:23.123 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.124+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=A1JZNNE3DARY type=del size=2340293 2024-09-12T00:19:23.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.126+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=MED8WJLTU3K6 type=del 2024-09-12T00:19:23.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.127+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=S60S93QFNQ9I type=del size=2657715 2024-09-12T00:19:23.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.129+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~BJ4VENIZV493.0 size=1048576 2024-09-12T00:19:23.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.130+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~BJ4VENIZV493.1 size=1048576 2024-09-12T00:19:23.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.130+0000 7f682945b780 1 < canceled part key=_multipart_R7V03ML1H80V.2~BJ4VENIZV493.2 size=211104 2024-09-12T00:19:23.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.133+0000 7f682945b780 1 < canceled multipart upload key=R7V03ML1H80V upload=BJ4VENIZV493 tag=RMIBSMK2CYI4 type=write size=3356832 2024-09-12T00:19:23.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.135+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~ELAD7HTHHCV4.0 size=806854 2024-09-12T00:19:23.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.135+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=ELAD7HTHHCV4 tag=0K92IZG0XSX9 type=write size=1855430 2024-09-12T00:19:23.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.137+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=BGDEFURH0CWU type=del 2024-09-12T00:19:23.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.138+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=K4H35PSACVHN type=write size=589650 2024-09-12T00:19:23.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.141+0000 7f682945b780 1 < suggested update operation key=COUJXCOSVPDS tag=EIKMM36F0FKA type=del size=892920 2024-09-12T00:19:23.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.142+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=NIJYFEEKXMPH type=del size=2735635 2024-09-12T00:19:23.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.144+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=070S5F2G86BX type=del 2024-09-12T00:19:23.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.145+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=P44BTDQNIHEN type=write size=838333 2024-09-12T00:19:23.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.147+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=VIN0EHG3I5UJ type=del 2024-09-12T00:19:23.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.148+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=1P7HTAP3NA7X type=del size=1831921 2024-09-12T00:19:23.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.150+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=W6IOSMVYLX98 type=del 2024-09-12T00:19:23.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.151+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=HGOC7LHBZKKN type=del size=974819 2024-09-12T00:19:23.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.152+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=F7Y5076DYW72 type=del 2024-09-12T00:19:23.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.154+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=7Y9NAQKODSGR type=write size=210014 2024-09-12T00:19:23.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.155+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=9OXV231VJHCA type=del 2024-09-12T00:19:23.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.158+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~L15EYJ6713J3.0 size=1048576 2024-09-12T00:19:23.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.159+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~L15EYJ6713J3.1 size=1048576 2024-09-12T00:19:23.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.160+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~L15EYJ6713J3.2 size=3829 2024-09-12T00:19:23.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.160+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=L15EYJ6713J3 tag=LLQQ4BZJ4Z2C type=write size=3149557 2024-09-12T00:19:23.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.161+0000 7f682945b780 -1 < failed to complete operation key=COUJXCOSVPDS tag=JAA1B0PK7TMO type=del size=3181150: (22) Invalid argument 2024-09-12T00:19:23.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.164+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~07FL3AP9CNBR.0 size=759765 2024-09-12T00:19:23.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.164+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=07FL3AP9CNBR tag=MDJMG59QISGJ type=write size=1808341 2024-09-12T00:19:23.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.164+0000 7f682945b780 1 < canceled part key=_multipart_922B2PPJFX2Z.2~UJT1LDD9NTKJ.0 size=219436 2024-09-12T00:19:23.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.167+0000 7f682945b780 1 < canceled multipart upload key=922B2PPJFX2Z upload=UJT1LDD9NTKJ tag=OIOL9ZCJ13VG type=write size=1268012 2024-09-12T00:19:23.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.170+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~KOXJ57B0JZHH.0 size=481886 2024-09-12T00:19:23.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.170+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=KOXJ57B0JZHH tag=LBQI92OGO064 type=write size=1530462 2024-09-12T00:19:23.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.171+0000 7f682945b780 1 < completed write operation key=CE5EBY7EGY4Z tag=36DT6EGBW7AK type=write size=763037 2024-09-12T00:19:23.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.174+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~OC59UHSLN832.0 size=1048576 2024-09-12T00:19:23.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.175+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~OC59UHSLN832.1 size=292292 2024-09-12T00:19:23.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.175+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=OC59UHSLN832 tag=DVR173GE3IH1 type=write size=2389444 2024-09-12T00:19:23.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.176+0000 7f682945b780 1 < canceled operation key=Y65K9I6K41X5 tag=WQDSTNY1KJ32 type=del size=3525240 2024-09-12T00:19:23.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.178+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=LLB65TQROY8J type=write size=953781 2024-09-12T00:19:23.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.179+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~0I1U6AWENSF6.0 size=1048576 2024-09-12T00:19:23.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.180+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~0I1U6AWENSF6.1 size=1048576 2024-09-12T00:19:23.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.182+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~0I1U6AWENSF6.2 size=1017666 2024-09-12T00:19:23.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.184+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=0I1U6AWENSF6 tag=FEJX0T1OF26E type=write size=4163394 2024-09-12T00:19:23.183 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.185+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=7SAMMI6CVTL6 type=del size=751467 2024-09-12T00:19:23.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.187+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=1RI3GQ43IP5C type=del 2024-09-12T00:19:23.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.188+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=UL8Q8C8VZOA7 type=del size=2442375 2024-09-12T00:19:23.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.189+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=A1JZNNE3DARY type=del 2024-09-12T00:19:23.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.191+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=4ZN2Z281Q9MC type=del size=2029311 2024-09-12T00:19:23.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.193+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=S60S93QFNQ9I type=del 2024-09-12T00:19:23.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.194+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=7QO02A4QESSA type=del size=4063967 2024-09-12T00:19:23.195 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.195+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~ELAD7HTHHCV4.0 size=806854 2024-09-12T00:19:23.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.198+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=ELAD7HTHHCV4 tag=0K92IZG0XSX9 type=write size=1855430 2024-09-12T00:19:23.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.199+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=ENZAOGQ32ZQF type=del size=3203487 2024-09-12T00:19:23.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.201+0000 7f682945b780 1 < completed write operation key=922B2PPJFX2Z tag=K4H35PSACVHN type=write size=589650 2024-09-12T00:19:23.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.202+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=W1C3TFFUBQD9 type=del size=2079982 2024-09-12T00:19:23.202 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.203+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=NIJYFEEKXMPH type=del 2024-09-12T00:19:23.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.206+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=TC3USHIG1AYO type=del size=1792639 2024-09-12T00:19:23.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.209+0000 7f682945b780 1 < suggested remove operation key=SGWTWN8RTKDD tag=P44BTDQNIHEN type=write 2024-09-12T00:19:23.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.212+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~AJWO4H62IUMW.0 size=1048576 2024-09-12T00:19:23.211 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.213+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~AJWO4H62IUMW.1 size=712410 2024-09-12T00:19:23.211 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.213+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=AJWO4H62IUMW tag=M10VY6XUTQET type=write size=2809562 2024-09-12T00:19:23.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.215+0000 7f682945b780 1 < suggested remove operation key=EYHGJ82COSE9 tag=1P7HTAP3NA7X type=del 2024-09-12T00:19:23.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.217+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=2LS7HM5BCW14 type=write size=818114 2024-09-12T00:19:23.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.218+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=HGOC7LHBZKKN type=del 2024-09-12T00:19:23.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.220+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=XQKG6L8C44GC type=write size=387774 2024-09-12T00:19:23.220 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.221+0000 7f682945b780 1 < completed write operation key=CT2L8L3849IN tag=7Y9NAQKODSGR type=write size=210014 2024-09-12T00:19:23.221 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.223+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=H38JV271J7HS type=del size=450635 2024-09-12T00:19:23.223 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.224+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~L15EYJ6713J3.0 size=1048576 2024-09-12T00:19:23.223 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.224+0000 7f682945b780 1 < canceled part key=_multipart_CT2L8L3849IN.2~L15EYJ6713J3.1 size=1048576 2024-09-12T00:19:23.224 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.225+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~L15EYJ6713J3.2 size=3829 2024-09-12T00:19:23.227 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.228+0000 7f682945b780 1 < canceled multipart upload key=CT2L8L3849IN upload=L15EYJ6713J3 tag=LLQQ4BZJ4Z2C type=write size=3149557 2024-09-12T00:19:23.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.231+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~556M1G96GTNX.0 size=1048576 2024-09-12T00:19:23.230 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.232+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~556M1G96GTNX.1 size=449594 2024-09-12T00:19:23.231 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.232+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=556M1G96GTNX tag=PZV6L58P0PTE type=write size=2546746 2024-09-12T00:19:23.232 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.233+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~07FL3AP9CNBR.0 size=759765 2024-09-12T00:19:23.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.236+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=07FL3AP9CNBR tag=MDJMG59QISGJ type=write size=1808341 2024-09-12T00:19:23.236 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.237+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=HRVKMTNJMCG7 type=del size=3795417 2024-09-12T00:19:23.237 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.239+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~KOXJ57B0JZHH.0 size=481886 2024-09-12T00:19:23.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.241+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=KOXJ57B0JZHH tag=LBQI92OGO064 type=write size=1530462 2024-09-12T00:19:23.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.242+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=RHDXPO2PQB1J type=del size=46380 2024-09-12T00:19:23.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.244+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~OC59UHSLN832.0 size=1048576 2024-09-12T00:19:23.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.245+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~OC59UHSLN832.1 size=292292 2024-09-12T00:19:23.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.247+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=OC59UHSLN832 tag=DVR173GE3IH1 type=write size=2389444 2024-09-12T00:19:23.247 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.249+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=AOK819XSH51B type=write size=198556 2024-09-12T00:19:23.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.250+0000 7f682945b780 1 < canceled operation key=IUPAGGPATJB4 tag=LLB65TQROY8J type=write size=953781 2024-09-12T00:19:23.250 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.252+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=XB7MGWOHOFYA type=write size=538734 2024-09-12T00:19:23.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.253+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=7SAMMI6CVTL6 type=del 2024-09-12T00:19:23.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.256+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~30BR0WACKJVV.0 size=1048576 2024-09-12T00:19:23.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.258+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~30BR0WACKJVV.1 size=875051 2024-09-12T00:19:23.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.258+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=30BR0WACKJVV tag=PWSU2XQ5DS8D type=write size=2972203 2024-09-12T00:19:23.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.260+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=UL8Q8C8VZOA7 type=del 2024-09-12T00:19:23.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.261+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=91TPGPDF52FC type=del size=1881935 2024-09-12T00:19:23.261 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.263+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=4ZN2Z281Q9MC type=del 2024-09-12T00:19:23.263 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.264+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=J82WDWXVCYXW type=del size=2816261 2024-09-12T00:19:23.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.266+0000 7f682945b780 1 < canceled operation key=6DUQKU3R1RL8 tag=7QO02A4QESSA type=del size=4063967 2024-09-12T00:19:23.266 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.267+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=73JB1KX2PPN7 type=del size=300503 2024-09-12T00:19:23.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.269+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=ENZAOGQ32ZQF type=del 2024-09-12T00:19:23.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.270+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=38E5R9UJ1AF7 type=write size=628298 2024-09-12T00:19:23.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.272+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=W1C3TFFUBQD9 type=del 2024-09-12T00:19:23.271 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.273+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=9UXGOOTM4MU9 type=write size=199003 2024-09-12T00:19:23.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.274+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=TC3USHIG1AYO type=del 2024-09-12T00:19:23.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.277+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~SLUI1UO27LYP.0 size=241259 2024-09-12T00:19:23.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.277+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=SLUI1UO27LYP tag=D3ZQPPXCEPCI type=write size=1289835 2024-09-12T00:19:23.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.278+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~AJWO4H62IUMW.0 size=1048576 2024-09-12T00:19:23.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.280+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~AJWO4H62IUMW.1 size=712410 2024-09-12T00:19:23.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.282+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=AJWO4H62IUMW tag=M10VY6XUTQET type=write size=2809562 2024-09-12T00:19:23.282 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.284+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=0957XIYXTV7J type=del size=2101524 2024-09-12T00:19:23.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.285+0000 7f682945b780 1 < completed write operation key=Y65K9I6K41X5 tag=2LS7HM5BCW14 type=write size=818114 2024-09-12T00:19:23.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.289+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~FGOJ4SG05G94.0 size=1048576 2024-09-12T00:19:23.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.289+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~FGOJ4SG05G94.1 size=1048576 2024-09-12T00:19:23.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.290+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~FGOJ4SG05G94.2 size=820562 2024-09-12T00:19:23.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.290+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=FGOJ4SG05G94 tag=RKN3QEADMKLI type=write size=3966290 2024-09-12T00:19:23.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.293+0000 7f682945b780 1 < suggested remove operation key=G0ONSUVW4M7R tag=XQKG6L8C44GC type=write 2024-09-12T00:19:23.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.296+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~6YUHH4R6O56S.0 size=457191 2024-09-12T00:19:23.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.296+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=6YUHH4R6O56S tag=56NJUB1FO3WC type=write size=1505767 2024-09-12T00:19:23.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.297+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=H38JV271J7HS type=del 2024-09-12T00:19:23.298 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.300+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~1P229E5C9QCX.0 size=1048576 2024-09-12T00:19:23.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.301+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~1P229E5C9QCX.1 size=256397 2024-09-12T00:19:23.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.301+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=1P229E5C9QCX tag=Z8QCPLC0HPI0 type=write size=2353549 2024-09-12T00:19:23.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.302+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~556M1G96GTNX.0 size=1048576 2024-09-12T00:19:23.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.304+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~556M1G96GTNX.1 size=449594 2024-09-12T00:19:23.304 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.306+0000 7f682945b780 1 < completed multipart upload key=D06ZUP2ZXX42 upload=556M1G96GTNX tag=PZV6L58P0PTE type=write size=2546746 2024-09-12T00:19:23.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.307+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=VQF5QU0LCLDO type=del size=1460931 2024-09-12T00:19:23.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.309+0000 7f682945b780 1 < completed delete operation key=COUJXCOSVPDS tag=HRVKMTNJMCG7 type=del 2024-09-12T00:19:23.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.311+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~V3ZF02PIWR8N.0 size=1048576 2024-09-12T00:19:23.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.313+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~V3ZF02PIWR8N.1 size=290469 2024-09-12T00:19:23.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.313+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=V3ZF02PIWR8N tag=63R4MAE9UVG5 type=write size=2387621 2024-09-12T00:19:23.312 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.314+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=RHDXPO2PQB1J type=del 2024-09-12T00:19:23.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.315+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=XQ6F8FQH4AT1 type=write size=556422 2024-09-12T00:19:23.317 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.319+0000 7f682945b780 1 < suggested remove operation key=Y65K9I6K41X5 tag=AOK819XSH51B type=write 2024-09-12T00:19:23.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.321+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~RF3LLFW917IF.0 size=1035574 2024-09-12T00:19:23.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.321+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=RF3LLFW917IF tag=H8E83GW0AX4M type=write size=2084150 2024-09-12T00:19:23.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.322+0000 7f682945b780 1 < canceled operation key=38JJBFDTIYSU tag=XB7MGWOHOFYA type=write size=538734 2024-09-12T00:19:23.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.323+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=EIXSH9SZ65N3 type=del size=1657332 2024-09-12T00:19:23.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.325+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~30BR0WACKJVV.0 size=1048576 2024-09-12T00:19:23.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.326+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~30BR0WACKJVV.1 size=875051 2024-09-12T00:19:23.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.328+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=30BR0WACKJVV tag=PWSU2XQ5DS8D type=write size=2972203 2024-09-12T00:19:23.328 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.330+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=8UT8EQBFKBBC type=del size=2960710 2024-09-12T00:19:23.330 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.331+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=91TPGPDF52FC type=del 2024-09-12T00:19:23.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.334+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~E53USJBSJ6OL.0 size=1048576 2024-09-12T00:19:23.333 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.335+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~E53USJBSJ6OL.1 size=1048576 2024-09-12T00:19:23.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.336+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~E53USJBSJ6OL.2 size=1045304 2024-09-12T00:19:23.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.336+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=E53USJBSJ6OL tag=JWA5LSKZXPN6 type=write size=4191032 2024-09-12T00:19:23.336 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.337+0000 7f682945b780 1 < canceled operation key=IUPAGGPATJB4 tag=J82WDWXVCYXW type=del size=2816261 2024-09-12T00:19:23.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.340+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~M0GWK7S7AX21.0 size=1048576 2024-09-12T00:19:23.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.341+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~M0GWK7S7AX21.1 size=1048576 2024-09-12T00:19:23.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.342+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~M0GWK7S7AX21.2 size=428132 2024-09-12T00:19:23.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.342+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=M0GWK7S7AX21 tag=EU35NBHXW6KT type=write size=3573860 2024-09-12T00:19:23.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.344+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=73JB1KX2PPN7 type=del 2024-09-12T00:19:23.344 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.345+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=R6325FP7CRJ6 type=del size=632268 2024-09-12T00:19:23.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.346+0000 7f682945b780 1 < completed write operation key=8D9UC8FJ16UK tag=38E5R9UJ1AF7 type=write size=628298 2024-09-12T00:19:23.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.348+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=OFYRSE49JMYJ type=del size=3280218 2024-09-12T00:19:23.348 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.349+0000 7f682945b780 1 < completed write operation key=IYYTX8TCLF30 tag=9UXGOOTM4MU9 type=write size=199003 2024-09-12T00:19:23.349 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.351+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=I1INSLFP9MC1 type=del size=3824638 2024-09-12T00:19:23.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.353+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~SLUI1UO27LYP.0 size=241259 2024-09-12T00:19:23.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.355+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=SLUI1UO27LYP tag=D3ZQPPXCEPCI type=write size=1289835 2024-09-12T00:19:23.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.358+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~MTMAZ8MG041B.0 size=1048576 2024-09-12T00:19:23.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.359+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~MTMAZ8MG041B.1 size=421734 2024-09-12T00:19:23.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.359+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=MTMAZ8MG041B tag=H4M7FKRJ604T type=write size=2518886 2024-09-12T00:19:23.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.360+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=0957XIYXTV7J type=del 2024-09-12T00:19:23.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.362+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=VCAKTA67Y7NH type=del size=3943315 2024-09-12T00:19:23.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.363+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~FGOJ4SG05G94.0 size=1048576 2024-09-12T00:19:23.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.365+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~FGOJ4SG05G94.1 size=1048576 2024-09-12T00:19:23.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.366+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~FGOJ4SG05G94.2 size=820562 2024-09-12T00:19:23.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.369+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=FGOJ4SG05G94 tag=RKN3QEADMKLI type=write size=3966290 2024-09-12T00:19:23.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.372+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~KVA64QMFZ6YB.0 size=1048576 2024-09-12T00:19:23.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.373+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~KVA64QMFZ6YB.1 size=345569 2024-09-12T00:19:23.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.373+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=KVA64QMFZ6YB tag=KOZI69YOUIT7 type=write size=2442721 2024-09-12T00:19:23.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.374+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~6YUHH4R6O56S.0 size=457191 2024-09-12T00:19:23.375 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.376+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=6YUHH4R6O56S tag=56NJUB1FO3WC type=write size=1505767 2024-09-12T00:19:23.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.379+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~MXP26IROC4UF.0 size=1048576 2024-09-12T00:19:23.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.380+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~MXP26IROC4UF.1 size=364295 2024-09-12T00:19:23.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.380+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=MXP26IROC4UF tag=OGCEHB5SH5TP type=write size=2461447 2024-09-12T00:19:23.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.380+0000 7f682945b780 1 < canceled part key=_multipart_7RRJO383D8TH.2~1P229E5C9QCX.0 size=1048576 2024-09-12T00:19:23.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.381+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~1P229E5C9QCX.1 size=256397 2024-09-12T00:19:23.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.383+0000 7f682945b780 1 < canceled multipart upload key=7RRJO383D8TH upload=1P229E5C9QCX tag=Z8QCPLC0HPI0 type=write size=2353549 2024-09-12T00:19:23.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.384+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=W3XSRW6X0E15 type=del size=3797963 2024-09-12T00:19:23.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.386+0000 7f682945b780 1 < canceled operation key=BFY578HP8GAW tag=VQF5QU0LCLDO type=del size=1460931 2024-09-12T00:19:23.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.387+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=IP5EYON2HU3H type=write size=938664 2024-09-12T00:19:23.387 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.389+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~V3ZF02PIWR8N.0 size=1048576 2024-09-12T00:19:23.388 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.390+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~V3ZF02PIWR8N.1 size=290469 2024-09-12T00:19:23.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.394+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=V3ZF02PIWR8N tag=63R4MAE9UVG5 type=write size=2387621 2024-09-12T00:19:23.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.394+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=701MDIDR42NB type=del size=4071961 2024-09-12T00:19:23.395 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.396+0000 7f682945b780 1 < completed write operation key=R7V03ML1H80V tag=XQ6F8FQH4AT1 type=write size=556422 2024-09-12T00:19:23.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.399+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~RXJSHXJKAAOS.0 size=1048576 2024-09-12T00:19:23.398 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.400+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~RXJSHXJKAAOS.1 size=1048576 2024-09-12T00:19:23.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.401+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~RXJSHXJKAAOS.2 size=654718 2024-09-12T00:19:23.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.401+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=RXJSHXJKAAOS tag=R7SDPCONKF73 type=write size=3800446 2024-09-12T00:19:23.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.401+0000 7f682945b780 1 < canceled part key=_multipart_BV3D543J63H1.2~RF3LLFW917IF.0 size=1035574 2024-09-12T00:19:23.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.403+0000 7f682945b780 1 < canceled multipart upload key=BV3D543J63H1 upload=RF3LLFW917IF tag=H8E83GW0AX4M type=write size=2084150 2024-09-12T00:19:23.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.405+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=Q3AO76YQMMZ3 type=del size=91108 2024-09-12T00:19:23.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.406+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=EIXSH9SZ65N3 type=del 2024-09-12T00:19:23.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.409+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~XYB99OUG8SD1.0 size=912869 2024-09-12T00:19:23.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.409+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=XYB99OUG8SD1 tag=1112OUN428K2 type=write size=1961445 2024-09-12T00:19:23.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.410+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=8UT8EQBFKBBC type=del 2024-09-12T00:19:23.411 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.413+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~XKJQDM11YIAQ.0 size=670269 2024-09-12T00:19:23.411 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.413+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=XKJQDM11YIAQ tag=LCVROG2ZTQ3W type=write size=1718845 2024-09-12T00:19:23.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.414+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~E53USJBSJ6OL.0 size=1048576 2024-09-12T00:19:23.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.415+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~E53USJBSJ6OL.1 size=1048576 2024-09-12T00:19:23.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.417+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~E53USJBSJ6OL.2 size=1045304 2024-09-12T00:19:23.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.418+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=E53USJBSJ6OL tag=JWA5LSKZXPN6 type=write size=4191032 2024-09-12T00:19:23.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.420+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=ZSM7R9K5GTAW type=write size=321877 2024-09-12T00:19:23.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.421+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~M0GWK7S7AX21.0 size=1048576 2024-09-12T00:19:23.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.423+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~M0GWK7S7AX21.1 size=1048576 2024-09-12T00:19:23.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.424+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~M0GWK7S7AX21.2 size=428132 2024-09-12T00:19:23.424 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.426+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=M0GWK7S7AX21 tag=EU35NBHXW6KT type=write size=3573860 2024-09-12T00:19:23.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.429+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~NS60FCIVNFXM.0 size=1048576 2024-09-12T00:19:23.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.429+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~NS60FCIVNFXM.1 size=1048576 2024-09-12T00:19:23.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.431+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~NS60FCIVNFXM.2 size=837465 2024-09-12T00:19:23.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.431+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=NS60FCIVNFXM tag=DPWSDI8UUBOY type=write size=3983193 2024-09-12T00:19:23.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.432+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=R6325FP7CRJ6 type=del 2024-09-12T00:19:23.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.433+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=XPGY5KYK4F59 type=del size=2689177 2024-09-12T00:19:23.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.435+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=OFYRSE49JMYJ type=del 2024-09-12T00:19:23.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.436+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=51H7SQZRHBO5 type=del size=885379 2024-09-12T00:19:23.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.438+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=I1INSLFP9MC1 type=del 2024-09-12T00:19:23.439 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.441+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~YG2KIP41TV6S.0 size=1048576 2024-09-12T00:19:23.440 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.441+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~YG2KIP41TV6S.1 size=1048576 2024-09-12T00:19:23.441 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.442+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~YG2KIP41TV6S.2 size=17695 2024-09-12T00:19:23.441 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.442+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=YG2KIP41TV6S tag=JF9BX6A7ONM1 type=write size=3163423 2024-09-12T00:19:23.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.444+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~MTMAZ8MG041B.0 size=1048576 2024-09-12T00:19:23.444 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.446+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~MTMAZ8MG041B.1 size=421734 2024-09-12T00:19:23.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.448+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=MTMAZ8MG041B tag=H4M7FKRJ604T type=write size=2518886 2024-09-12T00:19:23.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.450+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~4V7RYJRNFIGT.0 size=1048576 2024-09-12T00:19:23.450 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.452+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~4V7RYJRNFIGT.1 size=488130 2024-09-12T00:19:23.450 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.452+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=4V7RYJRNFIGT tag=1Q9HINGCR3Y4 type=write size=2585282 2024-09-12T00:19:23.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.455+0000 7f682945b780 1 < suggested remove operation key=IUPAGGPATJB4 tag=VCAKTA67Y7NH type=del 2024-09-12T00:19:23.455 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.457+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=RNB5N3EW0WNY type=del size=3282263 2024-09-12T00:19:23.457 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.459+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~KVA64QMFZ6YB.0 size=1048576 2024-09-12T00:19:23.458 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.460+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~KVA64QMFZ6YB.1 size=345569 2024-09-12T00:19:23.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.463+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=KVA64QMFZ6YB tag=KOZI69YOUIT7 type=write size=2442721 2024-09-12T00:19:23.463 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.464+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=EU3DZIIWWRZX type=del size=3598993 2024-09-12T00:19:23.464 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.466+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~MXP26IROC4UF.0 size=1048576 2024-09-12T00:19:23.464 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.466+0000 7f682945b780 1 < canceled part key=_multipart_SGWTWN8RTKDD.2~MXP26IROC4UF.1 size=364295 2024-09-12T00:19:23.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.468+0000 7f682945b780 1 < canceled multipart upload key=SGWTWN8RTKDD upload=MXP26IROC4UF tag=OGCEHB5SH5TP type=write size=2461447 2024-09-12T00:19:23.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.469+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=K4GEF5W22GOW type=del size=3394234 2024-09-12T00:19:23.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.471+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=W3XSRW6X0E15 type=del 2024-09-12T00:19:23.472 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.474+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~9IA62GT4WETH.0 size=1048576 2024-09-12T00:19:23.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.475+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~9IA62GT4WETH.1 size=918033 2024-09-12T00:19:23.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.475+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=9IA62GT4WETH tag=S3D17NA7WPH7 type=write size=3015185 2024-09-12T00:19:23.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.477+0000 7f682945b780 1 < completed write operation key=BFY578HP8GAW tag=IP5EYON2HU3H type=write size=938664 2024-09-12T00:19:23.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.478+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=GSW8YPO5BVHL type=write size=82117 2024-09-12T00:19:23.478 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.480+0000 7f682945b780 1 < completed delete operation key=38JJBFDTIYSU tag=701MDIDR42NB type=del 2024-09-12T00:19:23.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.481+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=QI2W3P8CO0WH type=write size=348540 2024-09-12T00:19:23.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.483+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~RXJSHXJKAAOS.0 size=1048576 2024-09-12T00:19:23.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.484+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~RXJSHXJKAAOS.1 size=1048576 2024-09-12T00:19:23.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.485+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~RXJSHXJKAAOS.2 size=654718 2024-09-12T00:19:23.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.488+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=RXJSHXJKAAOS tag=R7SDPCONKF73 type=write size=3800446 2024-09-12T00:19:23.488 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.489+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=XNW00KL5QQZV type=write size=264764 2024-09-12T00:19:23.489 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.491+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=Q3AO76YQMMZ3 type=del 2024-09-12T00:19:23.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.493+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=EIZESW8X6TUF type=del size=2094277 2024-09-12T00:19:23.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.494+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~XYB99OUG8SD1.0 size=912869 2024-09-12T00:19:23.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.496+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=XYB99OUG8SD1 tag=1112OUN428K2 type=write size=1961445 2024-09-12T00:19:23.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.498+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=HL86IVRNLZGO type=del size=823212 2024-09-12T00:19:23.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.499+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~XKJQDM11YIAQ.0 size=670269 2024-09-12T00:19:23.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.502+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=XKJQDM11YIAQ tag=LCVROG2ZTQ3W type=write size=1718845 2024-09-12T00:19:23.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.503+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=9UPI22ZMVXM1 type=del size=3168246 2024-09-12T00:19:23.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.505+0000 7f682945b780 1 < completed write operation key=CE5EBY7EGY4Z tag=ZSM7R9K5GTAW type=write size=321877 2024-09-12T00:19:23.504 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.506+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=7CJR9CCMB8M1 type=del size=169964 2024-09-12T00:19:23.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.507+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~NS60FCIVNFXM.0 size=1048576 2024-09-12T00:19:23.507 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.508+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~NS60FCIVNFXM.1 size=1048576 2024-09-12T00:19:23.508 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.510+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~NS60FCIVNFXM.2 size=837465 2024-09-12T00:19:23.511 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.513+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=NS60FCIVNFXM tag=DPWSDI8UUBOY type=write size=3983193 2024-09-12T00:19:23.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.515+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~5CGJY1KJYR59.0 size=1048576 2024-09-12T00:19:23.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.517+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~5CGJY1KJYR59.1 size=1048576 2024-09-12T00:19:23.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.517+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~5CGJY1KJYR59.2 size=314683 2024-09-12T00:19:23.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.517+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=5CGJY1KJYR59 tag=ESZUU3JN1BVP type=write size=3460411 2024-09-12T00:19:23.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.518+0000 7f682945b780 -1 < no bi entry to suggest for operation key=IUPAGGPATJB4 tag=XPGY5KYK4F59 type=del size=2689177: (2) No such file or directory 2024-09-12T00:19:23.518 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.519+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=BLVX09KSQUWO type=del size=1332869 2024-09-12T00:19:23.520 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.521+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=51H7SQZRHBO5 type=del 2024-09-12T00:19:23.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.524+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~R9YE8A4GE6RT.0 size=1048576 2024-09-12T00:19:23.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.525+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~R9YE8A4GE6RT.1 size=1048576 2024-09-12T00:19:23.526 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.528+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~R9YE8A4GE6RT.2 size=757861 2024-09-12T00:19:23.526 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.528+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=R9YE8A4GE6RT tag=1GTOFFQRD175 type=write size=3903589 2024-09-12T00:19:23.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.529+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~YG2KIP41TV6S.0 size=1048576 2024-09-12T00:19:23.529 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.530+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~YG2KIP41TV6S.1 size=1048576 2024-09-12T00:19:23.530 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.531+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~YG2KIP41TV6S.2 size=17695 2024-09-12T00:19:23.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.534+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=YG2KIP41TV6S tag=JF9BX6A7ONM1 type=write size=3163423 2024-09-12T00:19:23.535 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.537+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~4A8U5CBV2NCQ.0 size=924 2024-09-12T00:19:23.535 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.537+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=4A8U5CBV2NCQ tag=28Z2COLVCTZN type=write size=1049500 2024-09-12T00:19:23.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.538+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~4V7RYJRNFIGT.0 size=1048576 2024-09-12T00:19:23.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.539+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~4V7RYJRNFIGT.1 size=488130 2024-09-12T00:19:23.540 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.542+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=4V7RYJRNFIGT tag=1Q9HINGCR3Y4 type=write size=2585282 2024-09-12T00:19:23.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.543+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=2DCRHO7JCNE7 type=del size=1608137 2024-09-12T00:19:23.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.544+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=RNB5N3EW0WNY type=del 2024-09-12T00:19:23.545 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.547+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~63PQOD4G1IFX.0 size=386898 2024-09-12T00:19:23.545 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.547+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=63PQOD4G1IFX tag=6LANBORJKZNH type=write size=1435474 2024-09-12T00:19:23.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.548+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=EU3DZIIWWRZX type=del 2024-09-12T00:19:23.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.549+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=MLDTK74WNLA3 type=del size=237753 2024-09-12T00:19:23.549 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.551+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=K4GEF5W22GOW type=del 2024-09-12T00:19:23.552 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.553+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~LZHU8JTPSFRK.0 size=1048576 2024-09-12T00:19:23.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.554+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~LZHU8JTPSFRK.1 size=1048576 2024-09-12T00:19:23.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.556+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~LZHU8JTPSFRK.2 size=833869 2024-09-12T00:19:23.555 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.556+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=LZHU8JTPSFRK tag=6ZG8WDNZKHN7 type=write size=3979597 2024-09-12T00:19:23.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.557+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~9IA62GT4WETH.0 size=1048576 2024-09-12T00:19:23.557 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.558+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~9IA62GT4WETH.1 size=918033 2024-09-12T00:19:23.560 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.561+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=9IA62GT4WETH tag=S3D17NA7WPH7 type=write size=3015185 2024-09-12T00:19:23.561 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.563+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=CZ0GJ4OIHP77 type=write size=233709 2024-09-12T00:19:23.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.564+0000 7f682945b780 1 < completed write operation key=G0ONSUVW4M7R tag=GSW8YPO5BVHL type=write size=82117 2024-09-12T00:19:23.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.566+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=B7DF69TL1R0Y type=del size=1381035 2024-09-12T00:19:23.567 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.569+0000 7f682945b780 1 < suggested update operation key=R7V03ML1H80V tag=QI2W3P8CO0WH type=write size=348540 2024-09-12T00:19:23.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.571+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~QHMX6CXYYHOX.0 size=537181 2024-09-12T00:19:23.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.571+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=QHMX6CXYYHOX tag=U9KA9D2AH0ZG type=write size=1585757 2024-09-12T00:19:23.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.573+0000 7f682945b780 1 < completed write operation key=TGOBZH6DZK71 tag=XNW00KL5QQZV type=write size=264764 2024-09-12T00:19:23.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.575+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~BVOOE0GEZIGJ.0 size=1048576 2024-09-12T00:19:23.575 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.576+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~BVOOE0GEZIGJ.1 size=824725 2024-09-12T00:19:23.575 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.576+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=BVOOE0GEZIGJ tag=1327IYEQREWE type=write size=2921877 2024-09-12T00:19:23.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.578+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=EIZESW8X6TUF type=del 2024-09-12T00:19:23.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.579+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=37FOLHF0LJUK type=write size=373063 2024-09-12T00:19:23.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.581+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=HL86IVRNLZGO type=del 2024-09-12T00:19:23.580 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.582+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=2I277P60GH73 type=del size=4062654 2024-09-12T00:19:23.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.583+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=9UPI22ZMVXM1 type=del 2024-09-12T00:19:23.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.586+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~MPQ3FH7R4EYJ.0 size=451537 2024-09-12T00:19:23.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.586+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=MPQ3FH7R4EYJ tag=PNTWBS0GMTEV type=write size=1500113 2024-09-12T00:19:23.586 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.587+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=7CJR9CCMB8M1 type=del 2024-09-12T00:19:23.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.589+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=645TMI2Y458E type=write size=497393 2024-09-12T00:19:23.589 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.590+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~5CGJY1KJYR59.0 size=1048576 2024-09-12T00:19:23.590 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.592+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~5CGJY1KJYR59.1 size=1048576 2024-09-12T00:19:23.591 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.593+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~5CGJY1KJYR59.2 size=314683 2024-09-12T00:19:23.593 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.595+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=5CGJY1KJYR59 tag=ESZUU3JN1BVP type=write size=3460411 2024-09-12T00:19:23.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.598+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~KA2YQXCS7GW3.0 size=394789 2024-09-12T00:19:23.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.598+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=KA2YQXCS7GW3 tag=SMQ7BJ02DYUG type=write size=1443365 2024-09-12T00:19:23.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.599+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=BLVX09KSQUWO type=del 2024-09-12T00:19:23.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.601+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=K213M1CR3TQ8 type=del size=2866986 2024-09-12T00:19:23.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.602+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~R9YE8A4GE6RT.0 size=1048576 2024-09-12T00:19:23.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.603+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~R9YE8A4GE6RT.1 size=1048576 2024-09-12T00:19:23.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.604+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~R9YE8A4GE6RT.2 size=757861 2024-09-12T00:19:23.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.607+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=R9YE8A4GE6RT tag=1GTOFFQRD175 type=write size=3903589 2024-09-12T00:19:23.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.611+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~28QVZGC5A4X5.0 size=1048576 2024-09-12T00:19:23.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.613+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~28QVZGC5A4X5.1 size=768516 2024-09-12T00:19:23.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.613+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=28QVZGC5A4X5 tag=EK6C0YG2JZBV type=write size=2865668 2024-09-12T00:19:23.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.614+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~4A8U5CBV2NCQ.0 size=924 2024-09-12T00:19:23.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.616+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=4A8U5CBV2NCQ tag=28Z2COLVCTZN type=write size=1049500 2024-09-12T00:19:23.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.618+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=NDYZIQIM8M0H type=write size=779723 2024-09-12T00:19:23.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.619+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=2DCRHO7JCNE7 type=del 2024-09-12T00:19:23.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.622+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~VKVBEIJ34I8E.0 size=155832 2024-09-12T00:19:23.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.622+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=VKVBEIJ34I8E tag=X7BF0ZXZQCSY type=write size=1204408 2024-09-12T00:19:23.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.623+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~63PQOD4G1IFX.0 size=386898 2024-09-12T00:19:23.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.626+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=63PQOD4G1IFX tag=6LANBORJKZNH type=write size=1435474 2024-09-12T00:19:23.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.627+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=0DV8RHNFVZIX type=write size=953324 2024-09-12T00:19:23.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.629+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=MLDTK74WNLA3 type=del 2024-09-12T00:19:23.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.632+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~SCVNZU7T2ICO.0 size=1048576 2024-09-12T00:19:23.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.633+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~SCVNZU7T2ICO.1 size=1048576 2024-09-12T00:19:23.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.634+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~SCVNZU7T2ICO.2 size=780965 2024-09-12T00:19:23.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.634+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=SCVNZU7T2ICO tag=NM2802VQ4BOC type=write size=3926693 2024-09-12T00:19:23.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.636+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~LZHU8JTPSFRK.0 size=1048576 2024-09-12T00:19:23.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.638+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~LZHU8JTPSFRK.1 size=1048576 2024-09-12T00:19:23.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.639+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~LZHU8JTPSFRK.2 size=833869 2024-09-12T00:19:23.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.642+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=LZHU8JTPSFRK tag=6ZG8WDNZKHN7 type=write size=3979597 2024-09-12T00:19:23.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.644+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=EA6462CDD5DX type=del size=2083292 2024-09-12T00:19:23.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.646+0000 7f682945b780 1 < completed write operation key=JAVE3HR52R5C tag=CZ0GJ4OIHP77 type=write size=233709 2024-09-12T00:19:23.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.648+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~EL6JOP1YX5RL.0 size=1048576 2024-09-12T00:19:23.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.649+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~EL6JOP1YX5RL.1 size=1048576 2024-09-12T00:19:23.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.651+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~EL6JOP1YX5RL.2 size=30940 2024-09-12T00:19:23.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.651+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=EL6JOP1YX5RL tag=WZ07LEVMS00Z type=write size=3176668 2024-09-12T00:19:23.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.652+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=B7DF69TL1R0Y type=del 2024-09-12T00:19:23.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.653+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=W8TIFZRPQEFJ type=del size=1278731 2024-09-12T00:19:23.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.655+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~QHMX6CXYYHOX.0 size=537181 2024-09-12T00:19:23.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.657+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=QHMX6CXYYHOX tag=U9KA9D2AH0ZG type=write size=1585757 2024-09-12T00:19:23.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.660+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~G4RJL2PHU6BJ.0 size=1048576 2024-09-12T00:19:23.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.661+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~G4RJL2PHU6BJ.1 size=1048576 2024-09-12T00:19:23.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.662+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~G4RJL2PHU6BJ.2 size=272561 2024-09-12T00:19:23.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.662+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=G4RJL2PHU6BJ tag=CXSOXIQ7CD7E type=write size=3418289 2024-09-12T00:19:23.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.665+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~BVOOE0GEZIGJ.0 size=1048576 2024-09-12T00:19:23.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.666+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~BVOOE0GEZIGJ.1 size=824725 2024-09-12T00:19:23.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.668+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=BVOOE0GEZIGJ tag=1327IYEQREWE type=write size=2921877 2024-09-12T00:19:23.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.669+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=Z52MXUNMBZQG type=del size=3476351 2024-09-12T00:19:23.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.671+0000 7f682945b780 1 < completed write operation key=IYYTX8TCLF30 tag=37FOLHF0LJUK type=write size=373063 2024-09-12T00:19:23.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.673+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~5JB9D1UZSZRM.0 size=1048576 2024-09-12T00:19:23.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.675+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~5JB9D1UZSZRM.1 size=1048576 2024-09-12T00:19:23.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.676+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~5JB9D1UZSZRM.2 size=973065 2024-09-12T00:19:23.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.676+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=5JB9D1UZSZRM tag=L8M5IWULMRZB type=write size=4118793 2024-09-12T00:19:23.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.679+0000 7f682945b780 1 < suggested update operation key=Z7408WO050VI tag=2I277P60GH73 type=del size=4062654 2024-09-12T00:19:23.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.682+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~5OKO9F9CE4M1.0 size=1048576 2024-09-12T00:19:23.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.683+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~5OKO9F9CE4M1.1 size=1048576 2024-09-12T00:19:23.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.684+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~5OKO9F9CE4M1.2 size=676870 2024-09-12T00:19:23.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.684+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=5OKO9F9CE4M1 tag=8GO68MG7NJWX type=write size=3822598 2024-09-12T00:19:23.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.686+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~MPQ3FH7R4EYJ.0 size=451537 2024-09-12T00:19:23.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.688+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=MPQ3FH7R4EYJ tag=PNTWBS0GMTEV type=write size=1500113 2024-09-12T00:19:23.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.690+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=8G4DMORK43GP type=del size=1243791 2024-09-12T00:19:23.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.693+0000 7f682945b780 1 < suggested remove operation key=R2OAUUKLV7OK tag=645TMI2Y458E type=write 2024-09-12T00:19:23.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.695+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~X5FIPC2BZK1U.0 size=795739 2024-09-12T00:19:23.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.695+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=X5FIPC2BZK1U tag=83EOHO3W7ZM2 type=write size=1844315 2024-09-12T00:19:23.695 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.697+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~KA2YQXCS7GW3.0 size=394789 2024-09-12T00:19:23.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.699+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=KA2YQXCS7GW3 tag=SMQ7BJ02DYUG type=write size=1443365 2024-09-12T00:19:23.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.701+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=YU6IAHLQ8YC9 type=del size=1992625 2024-09-12T00:19:23.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.702+0000 7f682945b780 1 < canceled operation key=TGOBZH6DZK71 tag=K213M1CR3TQ8 type=del size=2866986 2024-09-12T00:19:23.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.704+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=PID9ELZMVND8 type=del size=4162244 2024-09-12T00:19:23.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.706+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~28QVZGC5A4X5.0 size=1048576 2024-09-12T00:19:23.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.707+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~28QVZGC5A4X5.1 size=768516 2024-09-12T00:19:23.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.709+0000 7f682945b780 1 < completed multipart upload key=CT2L8L3849IN upload=28QVZGC5A4X5 tag=EK6C0YG2JZBV type=write size=2865668 2024-09-12T00:19:23.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.713+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~VI66L971GQ9Q.0 size=685011 2024-09-12T00:19:23.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.713+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=VI66L971GQ9Q tag=OWKS5WX3W9P4 type=write size=1733587 2024-09-12T00:19:23.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.713+0000 7f682945b780 1 < canceled operation key=G0ONSUVW4M7R tag=NDYZIQIM8M0H type=write size=779723 2024-09-12T00:19:23.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.715+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=YFL9WHHKEEQZ type=del size=3237967 2024-09-12T00:19:23.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.716+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~VKVBEIJ34I8E.0 size=155832 2024-09-12T00:19:23.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.719+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=VKVBEIJ34I8E tag=X7BF0ZXZQCSY type=write size=1204408 2024-09-12T00:19:23.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.722+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~0FQ4QO40WSH0.0 size=1048576 2024-09-12T00:19:23.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.723+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~0FQ4QO40WSH0.1 size=1048576 2024-09-12T00:19:23.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.724+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~0FQ4QO40WSH0.2 size=731512 2024-09-12T00:19:23.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.724+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=0FQ4QO40WSH0 tag=V1STIP9AMJXH type=write size=3877240 2024-09-12T00:19:23.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.727+0000 7f682945b780 1 < suggested update operation key=CT2L8L3849IN tag=0DV8RHNFVZIX type=write size=953324 2024-09-12T00:19:23.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.728+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=POQSZ1FRQMC8 type=del size=3417806 2024-09-12T00:19:23.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.730+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~SCVNZU7T2ICO.0 size=1048576 2024-09-12T00:19:23.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.732+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~SCVNZU7T2ICO.1 size=1048576 2024-09-12T00:19:23.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.733+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~SCVNZU7T2ICO.2 size=780965 2024-09-12T00:19:23.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.736+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=SCVNZU7T2ICO tag=NM2802VQ4BOC type=write size=3926693 2024-09-12T00:19:23.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.738+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=VGOMYABYVPQU type=write size=937274 2024-09-12T00:19:23.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.739+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=EA6462CDD5DX type=del 2024-09-12T00:19:23.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.741+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=1BGDHNA013YM type=del size=1658041 2024-09-12T00:19:23.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.742+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~EL6JOP1YX5RL.0 size=1048576 2024-09-12T00:19:23.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.744+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~EL6JOP1YX5RL.1 size=1048576 2024-09-12T00:19:23.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.745+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~EL6JOP1YX5RL.2 size=30940 2024-09-12T00:19:23.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.747+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=EL6JOP1YX5RL tag=WZ07LEVMS00Z type=write size=3176668 2024-09-12T00:19:23.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.749+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=JADLJTP592CL type=del size=2246746 2024-09-12T00:19:23.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.750+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=W8TIFZRPQEFJ type=del 2024-09-12T00:19:23.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.752+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=HX3KLSPDH2HO type=del size=1148842 2024-09-12T00:19:23.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.753+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~G4RJL2PHU6BJ.0 size=1048576 2024-09-12T00:19:23.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.754+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~G4RJL2PHU6BJ.1 size=1048576 2024-09-12T00:19:23.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.755+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~G4RJL2PHU6BJ.2 size=272561 2024-09-12T00:19:23.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.758+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=G4RJL2PHU6BJ tag=CXSOXIQ7CD7E type=write size=3418289 2024-09-12T00:19:23.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.759+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=R338TQ1NV023 type=del size=1652738 2024-09-12T00:19:23.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.761+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=Z52MXUNMBZQG type=del 2024-09-12T00:19:23.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.762+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=SV6BMXZD4SRN type=del size=2980678 2024-09-12T00:19:23.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.764+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~5JB9D1UZSZRM.0 size=1048576 2024-09-12T00:19:23.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.765+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~5JB9D1UZSZRM.1 size=1048576 2024-09-12T00:19:23.765 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.766+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~5JB9D1UZSZRM.2 size=973065 2024-09-12T00:19:23.767 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.769+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=5JB9D1UZSZRM tag=L8M5IWULMRZB type=write size=4118793 2024-09-12T00:19:23.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.771+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~NOJAT2VE2FGK.0 size=1048576 2024-09-12T00:19:23.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.772+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~NOJAT2VE2FGK.1 size=606593 2024-09-12T00:19:23.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.772+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=NOJAT2VE2FGK tag=YT6TPU5MTMBP type=write size=2703745 2024-09-12T00:19:23.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.772+0000 7f682945b780 1 < canceled part key=_multipart_EYHGJ82COSE9.2~5OKO9F9CE4M1.0 size=1048576 2024-09-12T00:19:23.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.774+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~5OKO9F9CE4M1.1 size=1048576 2024-09-12T00:19:23.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.774+0000 7f682945b780 1 < canceled part key=_multipart_EYHGJ82COSE9.2~5OKO9F9CE4M1.2 size=676870 2024-09-12T00:19:23.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.776+0000 7f682945b780 1 < canceled multipart upload key=EYHGJ82COSE9 upload=5OKO9F9CE4M1 tag=8GO68MG7NJWX type=write size=3822598 2024-09-12T00:19:23.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.778+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=US95YTQLGMJU type=del size=2879180 2024-09-12T00:19:23.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.780+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=8G4DMORK43GP type=del 2024-09-12T00:19:23.781 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.782+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~IIHAICPWF5MQ.0 size=1048576 2024-09-12T00:19:23.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.783+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~IIHAICPWF5MQ.1 size=897047 2024-09-12T00:19:23.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.783+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=IIHAICPWF5MQ tag=WL7K1W25YNEK type=write size=2994199 2024-09-12T00:19:23.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.785+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~X5FIPC2BZK1U.0 size=795739 2024-09-12T00:19:23.786 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.787+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=X5FIPC2BZK1U tag=83EOHO3W7ZM2 type=write size=1844315 2024-09-12T00:19:23.789 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.791+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~CU2OP7208UUS.0 size=865132 2024-09-12T00:19:23.789 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.791+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=CU2OP7208UUS tag=KUBOV2E5S1QH type=write size=1913708 2024-09-12T00:19:23.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.792+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=YU6IAHLQ8YC9 type=del 2024-09-12T00:19:23.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.795+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~46F0I5IKV8DL.0 size=1048576 2024-09-12T00:19:23.795 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.796+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~46F0I5IKV8DL.1 size=1048576 2024-09-12T00:19:23.796 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.798+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~46F0I5IKV8DL.2 size=873321 2024-09-12T00:19:23.796 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.798+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=46F0I5IKV8DL tag=6I5G05ITPQ0X type=write size=4019049 2024-09-12T00:19:23.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.800+0000 7f682945b780 1 < suggested remove operation key=IYYTX8TCLF30 tag=PID9ELZMVND8 type=del 2024-09-12T00:19:23.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.804+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~07IERHCNU23Y.0 size=611478 2024-09-12T00:19:23.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.804+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=07IERHCNU23Y tag=SNAPYAUU1JUH type=write size=1660054 2024-09-12T00:19:23.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.804+0000 7f682945b780 1 < canceled part key=_multipart_1RAFARG1JXFQ.2~VI66L971GQ9Q.0 size=685011 2024-09-12T00:19:23.805 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.806+0000 7f682945b780 1 < canceled multipart upload key=1RAFARG1JXFQ upload=VI66L971GQ9Q tag=OWKS5WX3W9P4 type=write size=1733587 2024-09-12T00:19:23.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.808+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=694KFSANGIJI type=del size=71048 2024-09-12T00:19:23.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.811+0000 7f682945b780 1 < suggested update operation key=Z7408WO050VI tag=YFL9WHHKEEQZ type=del size=3237967 2024-09-12T00:19:23.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.813+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~JX6BFP73DESJ.0 size=1048576 2024-09-12T00:19:23.813 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.815+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~JX6BFP73DESJ.1 size=1048576 2024-09-12T00:19:23.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.816+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~JX6BFP73DESJ.2 size=433718 2024-09-12T00:19:23.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.816+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=JX6BFP73DESJ tag=6LVTBKTPE73H type=write size=3579446 2024-09-12T00:19:23.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.817+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~0FQ4QO40WSH0.0 size=1048576 2024-09-12T00:19:23.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.819+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~0FQ4QO40WSH0.1 size=1048576 2024-09-12T00:19:23.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.820+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~0FQ4QO40WSH0.2 size=731512 2024-09-12T00:19:23.821 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.822+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=0FQ4QO40WSH0 tag=V1STIP9AMJXH type=write size=3877240 2024-09-12T00:19:23.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.825+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~48K375I5Z6SE.0 size=389398 2024-09-12T00:19:23.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.825+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=48K375I5Z6SE tag=KCGPE7I0YYSW type=write size=1437974 2024-09-12T00:19:23.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.826+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=POQSZ1FRQMC8 type=del 2024-09-12T00:19:23.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.827+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=KI9H8H7SKW5Z type=del size=3025333 2024-09-12T00:19:23.829 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.830+0000 7f682945b780 1 < suggested update operation key=7RRJO383D8TH tag=VGOMYABYVPQU type=write size=937274 2024-09-12T00:19:23.830 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.831+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=AF7SBCZQPVXI type=write size=633646 2024-09-12T00:19:23.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.834+0000 7f682945b780 1 < suggested update operation key=AZKLWMQ818SW tag=1BGDHNA013YM type=del size=1658041 2024-09-12T00:19:23.835 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.837+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~OIGB9NAQVN1L.0 size=1048576 2024-09-12T00:19:23.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.838+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~OIGB9NAQVN1L.1 size=1048576 2024-09-12T00:19:23.837 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.839+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~OIGB9NAQVN1L.2 size=899082 2024-09-12T00:19:23.837 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.839+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=OIGB9NAQVN1L tag=O7I19JG4YMBQ type=write size=4044810 2024-09-12T00:19:23.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.840+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=JADLJTP592CL type=del 2024-09-12T00:19:23.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.842+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=L6707KL87211 type=del size=2187981 2024-09-12T00:19:23.842 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.844+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=HX3KLSPDH2HO type=del 2024-09-12T00:19:23.843 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.846+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=JJS5CNNJ3B0E type=del size=456814 2024-09-12T00:19:23.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.846+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=R338TQ1NV023 type=del 2024-09-12T00:19:23.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.848+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=K03FBT7D7CXZ type=del size=1073111 2024-09-12T00:19:23.848 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.850+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=SV6BMXZD4SRN type=del 2024-09-12T00:19:23.851 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.853+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~X6N6JG53UEE6.0 size=1048576 2024-09-12T00:19:23.852 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.853+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~X6N6JG53UEE6.1 size=1048576 2024-09-12T00:19:23.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.854+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~X6N6JG53UEE6.2 size=464852 2024-09-12T00:19:23.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.854+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=X6N6JG53UEE6 tag=20QAD8EI4UDE type=write size=3610580 2024-09-12T00:19:23.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.856+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~NOJAT2VE2FGK.0 size=1048576 2024-09-12T00:19:23.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.857+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~NOJAT2VE2FGK.1 size=606593 2024-09-12T00:19:23.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.860+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=NOJAT2VE2FGK tag=YT6TPU5MTMBP type=write size=2703745 2024-09-12T00:19:23.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.862+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~H2JG27B902E2.0 size=1048576 2024-09-12T00:19:23.862 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.864+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~H2JG27B902E2.1 size=1048576 2024-09-12T00:19:23.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.865+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~H2JG27B902E2.2 size=313289 2024-09-12T00:19:23.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.865+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=H2JG27B902E2 tag=45FG5T6T702L type=write size=3459017 2024-09-12T00:19:23.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.866+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=US95YTQLGMJU type=del 2024-09-12T00:19:23.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.869+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=PPPZ1ODE5C15 type=del size=2088331 2024-09-12T00:19:23.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.869+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~IIHAICPWF5MQ.0 size=1048576 2024-09-12T00:19:23.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.869+0000 7f682945b780 1 < canceled part key=_multipart_CE5EBY7EGY4Z.2~IIHAICPWF5MQ.1 size=897047 2024-09-12T00:19:23.870 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.872+0000 7f682945b780 1 < canceled multipart upload key=CE5EBY7EGY4Z upload=IIHAICPWF5MQ tag=WL7K1W25YNEK type=write size=2994199 2024-09-12T00:19:23.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.873+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=E8YVXGZXGBHP type=del size=3282413 2024-09-12T00:19:23.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.875+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~CU2OP7208UUS.0 size=865132 2024-09-12T00:19:23.876 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.878+0000 7f682945b780 1 < completed multipart upload key=CT2L8L3849IN upload=CU2OP7208UUS tag=KUBOV2E5S1QH type=write size=1913708 2024-09-12T00:19:23.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.880+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~2XPXUG35EQD6.0 size=1048576 2024-09-12T00:19:23.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.881+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~2XPXUG35EQD6.1 size=987711 2024-09-12T00:19:23.880 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.881+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=2XPXUG35EQD6 tag=BLWD4L7AVML2 type=write size=3084863 2024-09-12T00:19:23.881 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.882+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~46F0I5IKV8DL.0 size=1048576 2024-09-12T00:19:23.882 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.883+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~46F0I5IKV8DL.1 size=1048576 2024-09-12T00:19:23.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.884+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~46F0I5IKV8DL.2 size=873321 2024-09-12T00:19:23.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.886+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=46F0I5IKV8DL tag=6I5G05ITPQ0X type=write size=4019049 2024-09-12T00:19:23.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.890+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~3AURXEVZGBDT.0 size=1000871 2024-09-12T00:19:23.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.890+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=3AURXEVZGBDT tag=ZSOH3G7NZDVK type=write size=2049447 2024-09-12T00:19:23.889 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.890+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~07IERHCNU23Y.0 size=611478 2024-09-12T00:19:23.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.893+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=07IERHCNU23Y tag=SNAPYAUU1JUH type=write size=1660054 2024-09-12T00:19:23.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.895+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~EGOX26LAAZG0.0 size=1048576 2024-09-12T00:19:23.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.897+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~EGOX26LAAZG0.1 size=663008 2024-09-12T00:19:23.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.897+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=EGOX26LAAZG0 tag=JDQ6P1COR9DW type=write size=2760160 2024-09-12T00:19:23.896 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.898+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=694KFSANGIJI type=del 2024-09-12T00:19:23.898 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.899+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=TUS7O281HY9J type=del size=4073395 2024-09-12T00:19:23.899 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.901+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~JX6BFP73DESJ.0 size=1048576 2024-09-12T00:19:23.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.902+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~JX6BFP73DESJ.1 size=1048576 2024-09-12T00:19:23.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.903+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~JX6BFP73DESJ.2 size=433718 2024-09-12T00:19:23.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.905+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=JX6BFP73DESJ tag=6LVTBKTPE73H type=write size=3579446 2024-09-12T00:19:23.905 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.906+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=YDKVHMGMK1K2 type=del size=3630256 2024-09-12T00:19:23.906 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.907+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~48K375I5Z6SE.0 size=389398 2024-09-12T00:19:23.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.910+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=48K375I5Z6SE tag=KCGPE7I0YYSW type=write size=1437974 2024-09-12T00:19:23.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.912+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=FBT3FPZJDRCC type=del size=559825 2024-09-12T00:19:23.911 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.913+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=KI9H8H7SKW5Z type=del 2024-09-12T00:19:23.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.914+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=PQIJ3X84FY39 type=del size=1930489 2024-09-12T00:19:23.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.915+0000 7f682945b780 1 < completed write operation key=922B2PPJFX2Z tag=AF7SBCZQPVXI type=write size=633646 2024-09-12T00:19:23.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.917+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=HY9KFRXO6NFN type=del size=3174391 2024-09-12T00:19:23.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.918+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~OIGB9NAQVN1L.0 size=1048576 2024-09-12T00:19:23.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.920+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~OIGB9NAQVN1L.1 size=1048576 2024-09-12T00:19:23.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.921+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~OIGB9NAQVN1L.2 size=899082 2024-09-12T00:19:23.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.923+0000 7f682945b780 1 < completed multipart upload key=6DUQKU3R1RL8 upload=OIGB9NAQVN1L tag=O7I19JG4YMBQ type=write size=4044810 2024-09-12T00:19:23.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.926+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=QUQ8W0D378E6 type=write size=515603 2024-09-12T00:19:23.925 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.927+0000 7f682945b780 1 < canceled operation key=AZKLWMQ818SW tag=L6707KL87211 type=del size=2187981 2024-09-12T00:19:23.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.929+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~ZZ9ITFMU13VO.0 size=899296 2024-09-12T00:19:23.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.929+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=ZZ9ITFMU13VO tag=KTJ3R87DWYK0 type=write size=1947872 2024-09-12T00:19:23.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.931+0000 7f682945b780 1 < canceled operation key=AZKLWMQ818SW tag=JJS5CNNJ3B0E type=del size=456814 2024-09-12T00:19:23.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.933+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=1CBTN31LIN95 type=del size=2008819 2024-09-12T00:19:23.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.936+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=K03FBT7D7CXZ type=del 2024-09-12T00:19:23.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.937+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=XZAAFKT2MK44 type=del size=273069 2024-09-12T00:19:23.936 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.937+0000 7f682945b780 1 < canceled part key=_multipart_G0ONSUVW4M7R.2~X6N6JG53UEE6.0 size=1048576 2024-09-12T00:19:23.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.938+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~X6N6JG53UEE6.1 size=1048576 2024-09-12T00:19:23.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.940+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~X6N6JG53UEE6.2 size=464852 2024-09-12T00:19:23.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.942+0000 7f682945b780 1 < canceled multipart upload key=G0ONSUVW4M7R upload=X6N6JG53UEE6 tag=20QAD8EI4UDE type=write size=3610580 2024-09-12T00:19:23.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.945+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~PCWQR0E4A8F9.0 size=339591 2024-09-12T00:19:23.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.945+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=PCWQR0E4A8F9 tag=V6FNLD47V9VK type=write size=1388167 2024-09-12T00:19:23.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.947+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~H2JG27B902E2.0 size=1048576 2024-09-12T00:19:23.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.947+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~H2JG27B902E2.1 size=1048576 2024-09-12T00:19:23.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.948+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~H2JG27B902E2.2 size=313289 2024-09-12T00:19:23.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.951+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=H2JG27B902E2 tag=45FG5T6T702L type=write size=3459017 2024-09-12T00:19:23.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.953+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~7IHPUNAP6T9Y.0 size=1048576 2024-09-12T00:19:23.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.954+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~7IHPUNAP6T9Y.1 size=320245 2024-09-12T00:19:23.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.954+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=7IHPUNAP6T9Y tag=SBX0FR39HO7V type=write size=2417397 2024-09-12T00:19:23.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.956+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=PPPZ1ODE5C15 type=del 2024-09-12T00:19:23.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.958+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~1T5B4KDTVY0Z.0 size=1048576 2024-09-12T00:19:23.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.959+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~1T5B4KDTVY0Z.1 size=227197 2024-09-12T00:19:23.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.959+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=1T5B4KDTVY0Z tag=8VOE0KSQNTXH type=write size=2324349 2024-09-12T00:19:23.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.960+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=E8YVXGZXGBHP type=del 2024-09-12T00:19:23.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.964+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~1M19EGQPMA0D.0 size=873127 2024-09-12T00:19:23.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.964+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=1M19EGQPMA0D tag=E3VUOSLEEHUH type=write size=1921703 2024-09-12T00:19:23.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.964+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~2XPXUG35EQD6.0 size=1048576 2024-09-12T00:19:23.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.965+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~2XPXUG35EQD6.1 size=987711 2024-09-12T00:19:23.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.968+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=2XPXUG35EQD6 tag=BLWD4L7AVML2 type=write size=3084863 2024-09-12T00:19:23.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.969+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=IOXSXQL7SH23 type=del size=2704735 2024-09-12T00:19:23.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.970+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~3AURXEVZGBDT.0 size=1000871 2024-09-12T00:19:23.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.973+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=3AURXEVZGBDT tag=ZSOH3G7NZDVK type=write size=2049447 2024-09-12T00:19:23.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.975+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=O3Z9KYGQC467 type=del size=3766825 2024-09-12T00:19:23.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.976+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~EGOX26LAAZG0.0 size=1048576 2024-09-12T00:19:23.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.977+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~EGOX26LAAZG0.1 size=663008 2024-09-12T00:19:23.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.979+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=EGOX26LAAZG0 tag=JDQ6P1COR9DW type=write size=2760160 2024-09-12T00:19:23.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.980+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=EKTUCH02NCWU type=del size=1173574 2024-09-12T00:19:23.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.981+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=TUS7O281HY9J type=del 2024-09-12T00:19:23.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.983+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=9JZR0KJ5U46J type=del size=394188 2024-09-12T00:19:23.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.984+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=YDKVHMGMK1K2 type=del 2024-09-12T00:19:23.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.987+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~DMW906RLUY8P.0 size=300313 2024-09-12T00:19:23.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.987+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=DMW906RLUY8P tag=DD24W28NKH26 type=write size=1348889 2024-09-12T00:19:23.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.988+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=FBT3FPZJDRCC type=del 2024-09-12T00:19:23.988 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.990+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=DKNQ9PULC03P type=del size=2339076 2024-09-12T00:19:23.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.991+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=PQIJ3X84FY39 type=del 2024-09-12T00:19:23.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.994+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~N2C5HX663V5W.0 size=1048576 2024-09-12T00:19:23.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.996+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~N2C5HX663V5W.1 size=536867 2024-09-12T00:19:23.994 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.996+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=N2C5HX663V5W tag=CPED8RRCEV2L type=write size=2634019 2024-09-12T00:19:23.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.998+0000 7f682945b780 1 < suggested update operation key=BMTPXZ1OA2TZ tag=HY9KFRXO6NFN type=del size=3174391 2024-09-12T00:19:23.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:23.999+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=JG7RYI9DANGF type=del size=1324527 2024-09-12T00:19:24.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.002+0000 7f682945b780 1 < suggested update operation key=BK212Z99RM7F tag=QUQ8W0D378E6 type=write size=515603 2024-09-12T00:19:24.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.005+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~HQ39CKDUPRZ0.0 size=1048576 2024-09-12T00:19:24.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.006+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~HQ39CKDUPRZ0.1 size=476016 2024-09-12T00:19:24.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.006+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=HQ39CKDUPRZ0 tag=UV22BZBPD423 type=write size=2573168 2024-09-12T00:19:24.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.007+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~ZZ9ITFMU13VO.0 size=899296 2024-09-12T00:19:24.008 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.010+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=ZZ9ITFMU13VO tag=KTJ3R87DWYK0 type=write size=1947872 2024-09-12T00:19:24.011 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.013+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~48Y8RP2HW70M.0 size=1048576 2024-09-12T00:19:24.012 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.014+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~48Y8RP2HW70M.1 size=1048576 2024-09-12T00:19:24.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.015+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~48Y8RP2HW70M.2 size=226168 2024-09-12T00:19:24.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.015+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=48Y8RP2HW70M tag=3QQ9CZBFP19V type=write size=3371896 2024-09-12T00:19:24.016 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.018+0000 7f682945b780 1 < suggested update operation key=TYNSP8BHYO65 tag=1CBTN31LIN95 type=del size=2008819 2024-09-12T00:19:24.019 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.020+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~18XFK71GR81Z.0 size=1048576 2024-09-12T00:19:24.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.021+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~18XFK71GR81Z.1 size=765274 2024-09-12T00:19:24.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.021+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=18XFK71GR81Z tag=DXBOS8FR0A3H type=write size=2862426 2024-09-12T00:19:24.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.023+0000 7f682945b780 1 < completed delete operation key=R7V03ML1H80V tag=XZAAFKT2MK44 type=del 2024-09-12T00:19:24.023 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.024+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=2LD98LIOH0SK type=write size=791402 2024-09-12T00:19:24.023 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.024+0000 7f682945b780 1 < canceled part key=_multipart_CE5EBY7EGY4Z.2~PCWQR0E4A8F9.0 size=339591 2024-09-12T00:19:24.025 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.027+0000 7f682945b780 1 < canceled multipart upload key=CE5EBY7EGY4Z upload=PCWQR0E4A8F9 tag=V6FNLD47V9VK type=write size=1388167 2024-09-12T00:19:24.027 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.028+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=EE9JRNQ48TT8 type=del size=2289614 2024-09-12T00:19:24.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.029+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~7IHPUNAP6T9Y.0 size=1048576 2024-09-12T00:19:24.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.029+0000 7f682945b780 1 < canceled part key=_multipart_BV3D543J63H1.2~7IHPUNAP6T9Y.1 size=320245 2024-09-12T00:19:24.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.032+0000 7f682945b780 1 < canceled multipart upload key=BV3D543J63H1 upload=7IHPUNAP6T9Y tag=SBX0FR39HO7V type=write size=2417397 2024-09-12T00:19:24.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.033+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=D6ICAUFZEB1W type=del size=1630941 2024-09-12T00:19:24.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.034+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~1T5B4KDTVY0Z.0 size=1048576 2024-09-12T00:19:24.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.034+0000 7f682945b780 1 < canceled part key=_multipart_D06ZUP2ZXX42.2~1T5B4KDTVY0Z.1 size=227197 2024-09-12T00:19:24.035 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.037+0000 7f682945b780 1 < canceled multipart upload key=D06ZUP2ZXX42 upload=1T5B4KDTVY0Z tag=8VOE0KSQNTXH type=write size=2324349 2024-09-12T00:19:24.036 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.038+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=JOSQ9R8R2F5W type=del size=1256596 2024-09-12T00:19:24.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.040+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~1M19EGQPMA0D.0 size=873127 2024-09-12T00:19:24.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.043+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=1M19EGQPMA0D tag=E3VUOSLEEHUH type=write size=1921703 2024-09-12T00:19:24.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.044+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=71KWYKIN16F6 type=del size=3274235 2024-09-12T00:19:24.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.045+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=IOXSXQL7SH23 type=del 2024-09-12T00:19:24.046 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.048+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~EBEPDU0NTFR9.0 size=1048576 2024-09-12T00:19:24.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.049+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~EBEPDU0NTFR9.1 size=551540 2024-09-12T00:19:24.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.049+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=EBEPDU0NTFR9 tag=8N0E4ZY2O6GB type=write size=2648692 2024-09-12T00:19:24.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.051+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=O3Z9KYGQC467 type=del 2024-09-12T00:19:24.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.052+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=3OUFFSLLGI15 type=del size=110154 2024-09-12T00:19:24.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.053+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=EKTUCH02NCWU type=del 2024-09-12T00:19:24.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.055+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=SXECQCZ88E6P type=del size=2351795 2024-09-12T00:19:24.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.056+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=9JZR0KJ5U46J type=del 2024-09-12T00:19:24.057 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.059+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~I55XDOFT83H6.0 size=1048576 2024-09-12T00:19:24.058 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.060+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~I55XDOFT83H6.1 size=1048576 2024-09-12T00:19:24.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.061+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~I55XDOFT83H6.2 size=1028803 2024-09-12T00:19:24.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.061+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=I55XDOFT83H6 tag=R472IP1CQ3PY type=write size=4174531 2024-09-12T00:19:24.060 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.061+0000 7f682945b780 1 < canceled part key=_multipart_38JJBFDTIYSU.2~DMW906RLUY8P.0 size=300313 2024-09-12T00:19:24.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.063+0000 7f682945b780 1 < canceled multipart upload key=38JJBFDTIYSU upload=DMW906RLUY8P tag=DD24W28NKH26 type=write size=1348889 2024-09-12T00:19:24.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.067+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~GR4LS7GZJZPH.0 size=1048576 2024-09-12T00:19:24.067 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.068+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~GR4LS7GZJZPH.1 size=1048576 2024-09-12T00:19:24.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.069+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~GR4LS7GZJZPH.2 size=926137 2024-09-12T00:19:24.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.069+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=GR4LS7GZJZPH tag=AIBRPXL3P34J type=write size=4071865 2024-09-12T00:19:24.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.071+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=DKNQ9PULC03P type=del 2024-09-12T00:19:24.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.072+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=GJIE4HDPOJLR type=del size=1335712 2024-09-12T00:19:24.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.073+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~N2C5HX663V5W.0 size=1048576 2024-09-12T00:19:24.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.075+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~N2C5HX663V5W.1 size=536867 2024-09-12T00:19:24.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.077+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=N2C5HX663V5W tag=CPED8RRCEV2L type=write size=2634019 2024-09-12T00:19:24.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.078+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=0DMNUT9HP493 type=del size=4124697 2024-09-12T00:19:24.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.080+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=JG7RYI9DANGF type=del 2024-09-12T00:19:24.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.082+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~6EMM1B7GW2FN.0 size=1048576 2024-09-12T00:19:24.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.083+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~6EMM1B7GW2FN.1 size=1048576 2024-09-12T00:19:24.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.084+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~6EMM1B7GW2FN.2 size=476335 2024-09-12T00:19:24.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.084+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=6EMM1B7GW2FN tag=JZJWP2RDC319 type=write size=3622063 2024-09-12T00:19:24.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.086+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~HQ39CKDUPRZ0.0 size=1048576 2024-09-12T00:19:24.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.086+0000 7f682945b780 1 < canceled part key=_multipart_1RAFARG1JXFQ.2~HQ39CKDUPRZ0.1 size=476016 2024-09-12T00:19:24.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.088+0000 7f682945b780 1 < canceled multipart upload key=1RAFARG1JXFQ upload=HQ39CKDUPRZ0 tag=UV22BZBPD423 type=write size=2573168 2024-09-12T00:19:24.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.089+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=Z0UYQVUER967 type=del size=61672 2024-09-12T00:19:24.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.091+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~48Y8RP2HW70M.0 size=1048576 2024-09-12T00:19:24.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.092+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~48Y8RP2HW70M.1 size=1048576 2024-09-12T00:19:24.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.093+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~48Y8RP2HW70M.2 size=226168 2024-09-12T00:19:24.096 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.095+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=48Y8RP2HW70M tag=3QQ9CZBFP19V type=write size=3371896 2024-09-12T00:19:24.096 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.097+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=REI9SHCR8XPH type=del size=2091071 2024-09-12T00:19:24.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.098+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~18XFK71GR81Z.0 size=1048576 2024-09-12T00:19:24.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.098+0000 7f682945b780 1 < canceled part key=_multipart_AZKLWMQ818SW.2~18XFK71GR81Z.1 size=765274 2024-09-12T00:19:24.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.101+0000 7f682945b780 1 < canceled multipart upload key=AZKLWMQ818SW upload=18XFK71GR81Z tag=DXBOS8FR0A3H type=write size=2862426 2024-09-12T00:19:24.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.103+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~WJAKIO4JX2IJ.0 size=1048576 2024-09-12T00:19:24.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.104+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~WJAKIO4JX2IJ.1 size=899811 2024-09-12T00:19:24.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.104+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=WJAKIO4JX2IJ tag=WIX1UNZRHZBE type=write size=2996963 2024-09-12T00:19:24.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.106+0000 7f682945b780 1 < completed write operation key=BK212Z99RM7F tag=2LD98LIOH0SK type=write size=791402 2024-09-12T00:19:24.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.107+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=LQK4FE3MK2LR type=write size=283956 2024-09-12T00:19:24.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.109+0000 7f682945b780 1 < completed delete operation key=38JJBFDTIYSU tag=EE9JRNQ48TT8 type=del 2024-09-12T00:19:24.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.110+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=GFAD2N557MXG type=write size=235331 2024-09-12T00:19:24.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.113+0000 7f682945b780 1 < suggested update operation key=P56VIP3WIOJL tag=D6ICAUFZEB1W type=del size=1630941 2024-09-12T00:19:24.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.115+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=NAN4H0EUBCE6 type=write size=351479 2024-09-12T00:19:24.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.116+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=JOSQ9R8R2F5W type=del 2024-09-12T00:19:24.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.119+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~R8Z24JVN4K85.0 size=1048576 2024-09-12T00:19:24.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.120+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~R8Z24JVN4K85.1 size=1048576 2024-09-12T00:19:24.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.122+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~R8Z24JVN4K85.2 size=641986 2024-09-12T00:19:24.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.122+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=R8Z24JVN4K85 tag=YZSGHWGMPLP0 type=write size=3787714 2024-09-12T00:19:24.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.124+0000 7f682945b780 1 < suggested update operation key=G0ONSUVW4M7R tag=71KWYKIN16F6 type=del size=3274235 2024-09-12T00:19:24.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.126+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~7IDMZNRLSCE6.0 size=845325 2024-09-12T00:19:24.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.126+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=7IDMZNRLSCE6 tag=GLLG3CC0OEVD type=write size=1893901 2024-09-12T00:19:24.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.128+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~EBEPDU0NTFR9.0 size=1048576 2024-09-12T00:19:24.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.129+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~EBEPDU0NTFR9.1 size=551540 2024-09-12T00:19:24.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.131+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=EBEPDU0NTFR9 tag=8N0E4ZY2O6GB type=write size=2648692 2024-09-12T00:19:24.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.133+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~0JM5VERMTHVK.0 size=799890 2024-09-12T00:19:24.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.133+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=0JM5VERMTHVK tag=BN7D0FWV0L34 type=write size=1848466 2024-09-12T00:19:24.133 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.135+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=3OUFFSLLGI15 type=del 2024-09-12T00:19:24.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.136+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=OP1TPSENTKHL type=del size=247488 2024-09-12T00:19:24.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.137+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=SXECQCZ88E6P type=del 2024-09-12T00:19:24.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.139+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=4IBG4036RLOX type=del size=2010153 2024-09-12T00:19:24.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.140+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~I55XDOFT83H6.0 size=1048576 2024-09-12T00:19:24.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.142+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~I55XDOFT83H6.1 size=1048576 2024-09-12T00:19:24.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.143+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~I55XDOFT83H6.2 size=1028803 2024-09-12T00:19:24.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.145+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=I55XDOFT83H6 tag=R472IP1CQ3PY type=write size=4174531 2024-09-12T00:19:24.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.146+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=O9U6ZB2HA90X type=del size=1468989 2024-09-12T00:19:24.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.148+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~GR4LS7GZJZPH.0 size=1048576 2024-09-12T00:19:24.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.149+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~GR4LS7GZJZPH.1 size=1048576 2024-09-12T00:19:24.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.151+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~GR4LS7GZJZPH.2 size=926137 2024-09-12T00:19:24.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.152+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=GR4LS7GZJZPH tag=AIBRPXL3P34J type=write size=4071865 2024-09-12T00:19:24.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.155+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~G9CDQ60WCC2Y.0 size=1048576 2024-09-12T00:19:24.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.156+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~G9CDQ60WCC2Y.1 size=303790 2024-09-12T00:19:24.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.156+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=G9CDQ60WCC2Y tag=3VGZ8JTTFU7P type=write size=2400942 2024-09-12T00:19:24.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.157+0000 7f682945b780 1 < canceled operation key=R2OAUUKLV7OK tag=GJIE4HDPOJLR type=del size=1335712 2024-09-12T00:19:24.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.158+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=1FU7XGXHKDII type=del size=3072313 2024-09-12T00:19:24.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.160+0000 7f682945b780 1 < canceled operation key=JAVE3HR52R5C tag=0DMNUT9HP493 type=del size=4124697 2024-09-12T00:19:24.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.161+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=L1G9W1Y3HBN5 type=del size=2570652 2024-09-12T00:19:24.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.162+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~6EMM1B7GW2FN.0 size=1048576 2024-09-12T00:19:24.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.164+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~6EMM1B7GW2FN.1 size=1048576 2024-09-12T00:19:24.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.165+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~6EMM1B7GW2FN.2 size=476335 2024-09-12T00:19:24.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.168+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=6EMM1B7GW2FN tag=JZJWP2RDC319 type=write size=3622063 2024-09-12T00:19:24.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.169+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=8DENCV3NO8OA type=del size=2663090 2024-09-12T00:19:24.169 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.171+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=Z0UYQVUER967 type=del 2024-09-12T00:19:24.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.172+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=JJPH2HATGFOB type=del size=3647935 2024-09-12T00:19:24.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.173+0000 7f682945b780 1 < canceled operation key=BV3D543J63H1 tag=REI9SHCR8XPH type=del size=2091071 2024-09-12T00:19:24.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.175+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=7DI8SPOA8GG6 type=del size=2385340 2024-09-12T00:19:24.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.176+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~WJAKIO4JX2IJ.0 size=1048576 2024-09-12T00:19:24.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.179+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~WJAKIO4JX2IJ.1 size=899811 2024-09-12T00:19:24.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.182+0000 7f682945b780 1 < completed multipart upload key=8D9UC8FJ16UK upload=WJAKIO4JX2IJ tag=WIX1UNZRHZBE type=write size=2996963 2024-09-12T00:19:24.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.183+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=99GAVOKS629D type=del size=2766325 2024-09-12T00:19:24.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.186+0000 7f682945b780 1 < suggested remove operation key=CE5EBY7EGY4Z tag=LQK4FE3MK2LR type=write 2024-09-12T00:19:24.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.187+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=NG06XADEDS4Q type=del size=188983 2024-09-12T00:19:24.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.188+0000 7f682945b780 1 < completed write operation key=TGOBZH6DZK71 tag=GFAD2N557MXG type=write size=235331 2024-09-12T00:19:24.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.191+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~0OIJPAE33YZX.0 size=1048576 2024-09-12T00:19:24.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.192+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~0OIJPAE33YZX.1 size=1048576 2024-09-12T00:19:24.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.193+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~0OIJPAE33YZX.2 size=738465 2024-09-12T00:19:24.192 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.193+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=0OIJPAE33YZX tag=F35N3PWMET82 type=write size=3884193 2024-09-12T00:19:24.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.194+0000 7f682945b780 1 < completed write operation key=Y65K9I6K41X5 tag=NAN4H0EUBCE6 type=write size=351479 2024-09-12T00:19:24.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.198+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~N23COC5ZENXZ.0 size=1048576 2024-09-12T00:19:24.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.199+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~N23COC5ZENXZ.1 size=947139 2024-09-12T00:19:24.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.199+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=N23COC5ZENXZ tag=07NSNYMMK5K2 type=write size=3044291 2024-09-12T00:19:24.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.201+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~R8Z24JVN4K85.0 size=1048576 2024-09-12T00:19:24.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.202+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~R8Z24JVN4K85.1 size=1048576 2024-09-12T00:19:24.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.202+0000 7f682945b780 1 < canceled part key=_multipart_SGWTWN8RTKDD.2~R8Z24JVN4K85.2 size=641986 2024-09-12T00:19:24.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.204+0000 7f682945b780 1 < canceled multipart upload key=SGWTWN8RTKDD upload=R8Z24JVN4K85 tag=YZSGHWGMPLP0 type=write size=3787714 2024-09-12T00:19:24.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.207+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~633XJAY81BOR.0 size=1048576 2024-09-12T00:19:24.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.208+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~633XJAY81BOR.1 size=633116 2024-09-12T00:19:24.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.208+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=633XJAY81BOR tag=O7MRT6KIYZ22 type=write size=2730268 2024-09-12T00:19:24.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.208+0000 7f682945b780 1 < canceled part key=_multipart_BV3D543J63H1.2~7IDMZNRLSCE6.0 size=845325 2024-09-12T00:19:24.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.210+0000 7f682945b780 1 < canceled multipart upload key=BV3D543J63H1 upload=7IDMZNRLSCE6 tag=GLLG3CC0OEVD type=write size=1893901 2024-09-12T00:19:24.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.212+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=Y1TIVV9OFDY0 type=del size=1149425 2024-09-12T00:19:24.211 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.213+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~0JM5VERMTHVK.0 size=799890 2024-09-12T00:19:24.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.215+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=0JM5VERMTHVK tag=BN7D0FWV0L34 type=write size=1848466 2024-09-12T00:19:24.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.217+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=6WOD8CHLD2HZ type=del size=1226819 2024-09-12T00:19:24.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.218+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=OP1TPSENTKHL type=del 2024-09-12T00:19:24.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.221+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~IH63WTO6OEPY.0 size=1048576 2024-09-12T00:19:24.220 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.222+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~IH63WTO6OEPY.1 size=254187 2024-09-12T00:19:24.220 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.222+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=IH63WTO6OEPY tag=LD401AJK5S1T type=write size=2351339 2024-09-12T00:19:24.221 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.223+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=4IBG4036RLOX type=del 2024-09-12T00:19:24.224 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.226+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~C4ILZ4LGU1QJ.0 size=1048576 2024-09-12T00:19:24.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.227+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~C4ILZ4LGU1QJ.1 size=1048576 2024-09-12T00:19:24.226 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.228+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~C4ILZ4LGU1QJ.2 size=939908 2024-09-12T00:19:24.226 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.228+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=C4ILZ4LGU1QJ tag=DJLTQTJ61B9M type=write size=4085636 2024-09-12T00:19:24.227 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.229+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=O9U6ZB2HA90X type=del 2024-09-12T00:19:24.230 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.232+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~WYSPZ9N6KEP7.0 size=1048576 2024-09-12T00:19:24.231 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.233+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~WYSPZ9N6KEP7.1 size=1041121 2024-09-12T00:19:24.231 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.233+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=WYSPZ9N6KEP7 tag=JW9R05DND0AO type=write size=3138273 2024-09-12T00:19:24.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.234+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~G9CDQ60WCC2Y.0 size=1048576 2024-09-12T00:19:24.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.235+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~G9CDQ60WCC2Y.1 size=303790 2024-09-12T00:19:24.236 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.237+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=G9CDQ60WCC2Y tag=3VGZ8JTTFU7P type=write size=2400942 2024-09-12T00:19:24.237 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.239+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=O9RHGJ7721KW type=del size=3442347 2024-09-12T00:19:24.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.240+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=1FU7XGXHKDII type=del 2024-09-12T00:19:24.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.243+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~6R2681JSBNZ4.0 size=514251 2024-09-12T00:19:24.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.243+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=6R2681JSBNZ4 tag=BNAH14PIYWVS type=write size=1562827 2024-09-12T00:19:24.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.245+0000 7f682945b780 1 < suggested update operation key=6DUQKU3R1RL8 tag=L1G9W1Y3HBN5 type=del size=2570652 2024-09-12T00:19:24.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.246+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=H2UB689FBSH8 type=del size=414313 2024-09-12T00:19:24.247 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.248+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=8DENCV3NO8OA type=del 2024-09-12T00:19:24.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.249+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=B3X1LH6ME3UA type=del size=2619050 2024-09-12T00:19:24.251 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.252+0000 7f682945b780 1 < suggested remove operation key=G0ONSUVW4M7R tag=JJPH2HATGFOB type=del 2024-09-12T00:19:24.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.253+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=HAE563C2IGKT type=del size=716298 2024-09-12T00:19:24.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.255+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=7DI8SPOA8GG6 type=del 2024-09-12T00:19:24.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.256+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=PTN0CALL4S3S type=del size=1224598 2024-09-12T00:19:24.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.257+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=99GAVOKS629D type=del 2024-09-12T00:19:24.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.260+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~1ZA35S3XBMQW.0 size=1048576 2024-09-12T00:19:24.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.261+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~1ZA35S3XBMQW.1 size=1048576 2024-09-12T00:19:24.260 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.262+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~1ZA35S3XBMQW.2 size=389912 2024-09-12T00:19:24.260 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.262+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=1ZA35S3XBMQW tag=SEM2FPDTXDXJ type=write size=3535640 2024-09-12T00:19:24.263 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.264+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=NG06XADEDS4Q type=del 2024-09-12T00:19:24.266 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.267+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~G573JM81BY35.0 size=1048576 2024-09-12T00:19:24.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.268+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~G573JM81BY35.1 size=1048576 2024-09-12T00:19:24.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.269+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~G573JM81BY35.2 size=916444 2024-09-12T00:19:24.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.269+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=G573JM81BY35 tag=544MAZ3Z0PGY type=write size=4062172 2024-09-12T00:19:24.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.271+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~0OIJPAE33YZX.0 size=1048576 2024-09-12T00:19:24.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.272+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~0OIJPAE33YZX.1 size=1048576 2024-09-12T00:19:24.271 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.273+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~0OIJPAE33YZX.2 size=738465 2024-09-12T00:19:24.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.275+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=0OIJPAE33YZX tag=F35N3PWMET82 type=write size=3884193 2024-09-12T00:19:24.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.277+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=AFA7I7C1Z5N8 type=del size=4078126 2024-09-12T00:19:24.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.279+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~N23COC5ZENXZ.0 size=1048576 2024-09-12T00:19:24.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.279+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~N23COC5ZENXZ.1 size=947139 2024-09-12T00:19:24.280 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.281+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=N23COC5ZENXZ tag=07NSNYMMK5K2 type=write size=3044291 2024-09-12T00:19:24.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.283+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=EX0OTANG7H33 type=del size=470072 2024-09-12T00:19:24.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.284+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~633XJAY81BOR.0 size=1048576 2024-09-12T00:19:24.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.285+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~633XJAY81BOR.1 size=633116 2024-09-12T00:19:24.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.287+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=633XJAY81BOR tag=O7MRT6KIYZ22 type=write size=2730268 2024-09-12T00:19:24.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.291+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~XYI78MPYC43D.0 size=1048576 2024-09-12T00:19:24.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.291+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~XYI78MPYC43D.1 size=1048576 2024-09-12T00:19:24.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.293+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~XYI78MPYC43D.2 size=218630 2024-09-12T00:19:24.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.293+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=XYI78MPYC43D tag=71LVW8XAW72F type=write size=3364358 2024-09-12T00:19:24.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.294+0000 7f682945b780 1 < completed delete operation key=8D9UC8FJ16UK tag=Y1TIVV9OFDY0 type=del 2024-09-12T00:19:24.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.297+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~BFFHTVQOBB0D.0 size=1048576 2024-09-12T00:19:24.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.297+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~BFFHTVQOBB0D.1 size=321115 2024-09-12T00:19:24.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.297+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=BFFHTVQOBB0D tag=TYJI78N1IZP2 type=write size=2418267 2024-09-12T00:19:24.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.299+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=6WOD8CHLD2HZ type=del 2024-09-12T00:19:24.300 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.302+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~UACY7BK75QY8.0 size=923378 2024-09-12T00:19:24.300 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.302+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=UACY7BK75QY8 tag=JCN0Y3Z0DHWQ type=write size=1971954 2024-09-12T00:19:24.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.303+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~IH63WTO6OEPY.0 size=1048576 2024-09-12T00:19:24.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.304+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~IH63WTO6OEPY.1 size=254187 2024-09-12T00:19:24.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.306+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=IH63WTO6OEPY tag=LD401AJK5S1T type=write size=2351339 2024-09-12T00:19:24.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.308+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=FWLGN43LHDV1 type=del size=2667756 2024-09-12T00:19:24.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.308+0000 7f682945b780 1 < canceled part key=_multipart_IYYTX8TCLF30.2~C4ILZ4LGU1QJ.0 size=1048576 2024-09-12T00:19:24.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.309+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~C4ILZ4LGU1QJ.1 size=1048576 2024-09-12T00:19:24.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.309+0000 7f682945b780 1 < canceled part key=_multipart_IYYTX8TCLF30.2~C4ILZ4LGU1QJ.2 size=939908 2024-09-12T00:19:24.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.311+0000 7f682945b780 1 < canceled multipart upload key=IYYTX8TCLF30 upload=C4ILZ4LGU1QJ tag=DJLTQTJ61B9M type=write size=4085636 2024-09-12T00:19:24.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.315+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~6O6Y9TK9JJ3Z.0 size=965990 2024-09-12T00:19:24.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.315+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=6O6Y9TK9JJ3Z tag=AN2BKN5RH105 type=write size=2014566 2024-09-12T00:19:24.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.315+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~WYSPZ9N6KEP7.0 size=1048576 2024-09-12T00:19:24.315 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.317+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~WYSPZ9N6KEP7.1 size=1041121 2024-09-12T00:19:24.318 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.319+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=WYSPZ9N6KEP7 tag=JW9R05DND0AO type=write size=3138273 2024-09-12T00:19:24.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.322+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~6HSZ5X77JCYR.0 size=1048576 2024-09-12T00:19:24.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.324+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~6HSZ5X77JCYR.1 size=1048576 2024-09-12T00:19:24.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.325+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~6HSZ5X77JCYR.2 size=1021006 2024-09-12T00:19:24.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.325+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=6HSZ5X77JCYR tag=KO9NGYZ0MTPS type=write size=4166734 2024-09-12T00:19:24.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.327+0000 7f682945b780 -1 < failed to complete operation key=G0ONSUVW4M7R tag=O9RHGJ7721KW type=del size=3442347: (22) Invalid argument 2024-09-12T00:19:24.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.329+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=56FTGVJPT276 type=write size=376369 2024-09-12T00:19:24.328 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.330+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~6R2681JSBNZ4.0 size=514251 2024-09-12T00:19:24.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.333+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=6R2681JSBNZ4 tag=BNAH14PIYWVS type=write size=1562827 2024-09-12T00:19:24.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.334+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=24C8CR10LODO type=write size=237927 2024-09-12T00:19:24.333 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.335+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=H2UB689FBSH8 type=del 2024-09-12T00:19:24.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.336+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=UE62L10ZXS73 type=del size=2543708 2024-09-12T00:19:24.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.338+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=B3X1LH6ME3UA type=del 2024-09-12T00:19:24.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.339+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=C5FO8MHA8S1C type=del size=2657142 2024-09-12T00:19:24.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.341+0000 7f682945b780 1 < completed delete operation key=38JJBFDTIYSU tag=HAE563C2IGKT type=del 2024-09-12T00:19:24.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.342+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=G6EYBKMNL3LD type=del size=3043015 2024-09-12T00:19:24.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.343+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=PTN0CALL4S3S type=del 2024-09-12T00:19:24.343 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.345+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=2KDN5JHV7I5A type=del size=3844902 2024-09-12T00:19:24.344 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.347+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~1ZA35S3XBMQW.0 size=1048576 2024-09-12T00:19:24.346 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.347+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~1ZA35S3XBMQW.1 size=1048576 2024-09-12T00:19:24.346 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.347+0000 7f682945b780 1 < canceled part key=_multipart_IYYTX8TCLF30.2~1ZA35S3XBMQW.2 size=389912 2024-09-12T00:19:24.348 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.349+0000 7f682945b780 1 < canceled multipart upload key=IYYTX8TCLF30 upload=1ZA35S3XBMQW tag=SEM2FPDTXDXJ type=write size=3535640 2024-09-12T00:19:24.349 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.351+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=3XX1OJ27Y3C9 type=del size=2070724 2024-09-12T00:19:24.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.352+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~G573JM81BY35.0 size=1048576 2024-09-12T00:19:24.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.352+0000 7f682945b780 1 < canceled part key=_multipart_3JFMN39G6TTF.2~G573JM81BY35.1 size=1048576 2024-09-12T00:19:24.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.353+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~G573JM81BY35.2 size=916444 2024-09-12T00:19:24.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.356+0000 7f682945b780 1 < canceled multipart upload key=3JFMN39G6TTF upload=G573JM81BY35 tag=544MAZ3Z0PGY type=write size=4062172 2024-09-12T00:19:24.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.357+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=TJ9SWIIJV3KS type=del size=3149485 2024-09-12T00:19:24.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.358+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=AFA7I7C1Z5N8 type=del 2024-09-12T00:19:24.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.361+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~OQ8BPMWGHG0B.0 size=87688 2024-09-12T00:19:24.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.361+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=OQ8BPMWGHG0B tag=W1GO4VLRXNPQ type=write size=1136264 2024-09-12T00:19:24.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.364+0000 7f682945b780 1 < suggested remove operation key=8D9UC8FJ16UK tag=EX0OTANG7H33 type=del 2024-09-12T00:19:24.364 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.365+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=7FXWRWH0ZYBN type=write size=580497 2024-09-12T00:19:24.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.367+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~XYI78MPYC43D.0 size=1048576 2024-09-12T00:19:24.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.369+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~XYI78MPYC43D.1 size=1048576 2024-09-12T00:19:24.368 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.369+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~XYI78MPYC43D.2 size=218630 2024-09-12T00:19:24.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.371+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=XYI78MPYC43D tag=71LVW8XAW72F type=write size=3364358 2024-09-12T00:19:24.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.374+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=9GGD7VMZT3H4 type=del size=1158783 2024-09-12T00:19:24.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.374+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~BFFHTVQOBB0D.0 size=1048576 2024-09-12T00:19:24.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.376+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~BFFHTVQOBB0D.1 size=321115 2024-09-12T00:19:24.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.379+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=BFFHTVQOBB0D tag=TYJI78N1IZP2 type=write size=2418267 2024-09-12T00:19:24.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.381+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~I4O3F8M024PG.0 size=1048576 2024-09-12T00:19:24.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.382+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~I4O3F8M024PG.1 size=1048576 2024-09-12T00:19:24.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.383+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~I4O3F8M024PG.2 size=647003 2024-09-12T00:19:24.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.383+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=I4O3F8M024PG tag=BYC4Y7MWGT2F type=write size=3792731 2024-09-12T00:19:24.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.384+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~UACY7BK75QY8.0 size=923378 2024-09-12T00:19:24.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.386+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=UACY7BK75QY8 tag=JCN0Y3Z0DHWQ type=write size=1971954 2024-09-12T00:19:24.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.388+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=3DNGD64735PM type=del size=1220987 2024-09-12T00:19:24.387 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.389+0000 7f682945b780 1 < canceled operation key=CT2L8L3849IN tag=FWLGN43LHDV1 type=del size=2667756 2024-09-12T00:19:24.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.392+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~L31R0CU5MS0C.0 size=1048576 2024-09-12T00:19:24.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.393+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~L31R0CU5MS0C.1 size=1048576 2024-09-12T00:19:24.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.394+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~L31R0CU5MS0C.2 size=303856 2024-09-12T00:19:24.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.394+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=L31R0CU5MS0C tag=VL2TUEO1Q1CU type=write size=3449584 2024-09-12T00:19:24.394 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.395+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~6O6Y9TK9JJ3Z.0 size=965990 2024-09-12T00:19:24.396 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.397+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=6O6Y9TK9JJ3Z tag=AN2BKN5RH105 type=write size=2014566 2024-09-12T00:19:24.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.399+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=YFCGKT4IWJMG type=del size=1052057 2024-09-12T00:19:24.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.400+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~6HSZ5X77JCYR.0 size=1048576 2024-09-12T00:19:24.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.401+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~6HSZ5X77JCYR.1 size=1048576 2024-09-12T00:19:24.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.403+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~6HSZ5X77JCYR.2 size=1021006 2024-09-12T00:19:24.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.406+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=6HSZ5X77JCYR tag=KO9NGYZ0MTPS type=write size=4166734 2024-09-12T00:19:24.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.408+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~YGYADMLR9MQX.0 size=1048576 2024-09-12T00:19:24.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.409+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~YGYADMLR9MQX.1 size=1048576 2024-09-12T00:19:24.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.410+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~YGYADMLR9MQX.2 size=738784 2024-09-12T00:19:24.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.410+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=YGYADMLR9MQX tag=QM2J2ZPZFJMB type=write size=3884512 2024-09-12T00:19:24.411 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.413+0000 7f682945b780 1 < suggested remove operation key=7RRJO383D8TH tag=56FTGVJPT276 type=write 2024-09-12T00:19:24.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.414+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=7RDR2QU3RS53 type=write size=50268 2024-09-12T00:19:24.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.416+0000 7f682945b780 1 < canceled operation key=JAVE3HR52R5C tag=24C8CR10LODO type=write size=237927 2024-09-12T00:19:24.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.417+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=VYN5R1J1WQ3A type=del size=1510181 2024-09-12T00:19:24.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.419+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=UE62L10ZXS73 type=del 2024-09-12T00:19:24.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.420+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=Z174SBN4IGE3 type=write size=829136 2024-09-12T00:19:24.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.422+0000 7f682945b780 1 < completed delete operation key=R7V03ML1H80V tag=C5FO8MHA8S1C type=del 2024-09-12T00:19:24.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.425+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~OQXGSHIF36AH.0 size=1048576 2024-09-12T00:19:24.424 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.427+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~OQXGSHIF36AH.1 size=166999 2024-09-12T00:19:24.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.427+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=OQXGSHIF36AH tag=1K3MD2KGRUA4 type=write size=2264151 2024-09-12T00:19:24.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.428+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=G6EYBKMNL3LD type=del 2024-09-12T00:19:24.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.429+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=6AHIU07202M1 type=del size=3495975 2024-09-12T00:19:24.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.430+0000 7f682945b780 1 < completed delete operation key=COUJXCOSVPDS tag=2KDN5JHV7I5A type=del 2024-09-12T00:19:24.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.433+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~AZCDNES948A1.0 size=1048576 2024-09-12T00:19:24.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.434+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~AZCDNES948A1.1 size=428193 2024-09-12T00:19:24.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.434+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=AZCDNES948A1 tag=P9JMYAHY5URG type=write size=2525345 2024-09-12T00:19:24.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.435+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=3XX1OJ27Y3C9 type=del 2024-09-12T00:19:24.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.437+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=TD9I7ZOM0W1U type=del size=2177451 2024-09-12T00:19:24.438 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.440+0000 7f682945b780 1 < suggested remove operation key=TYNSP8BHYO65 tag=TJ9SWIIJV3KS type=del 2024-09-12T00:19:24.440 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.443+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~7K59K26EPXM8.0 size=1048576 2024-09-12T00:19:24.441 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.443+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~7K59K26EPXM8.1 size=290775 2024-09-12T00:19:24.442 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.443+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=7K59K26EPXM8 tag=TLPKQR91EP8H type=write size=2387927 2024-09-12T00:19:24.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.444+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~OQ8BPMWGHG0B.0 size=87688 2024-09-12T00:19:24.445 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.447+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=OQ8BPMWGHG0B tag=W1GO4VLRXNPQ type=write size=1136264 2024-09-12T00:19:24.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.449+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=23SSAJDEG9K8 type=del size=1444967 2024-09-12T00:19:24.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.450+0000 7f682945b780 1 < completed write operation key=Y65K9I6K41X5 tag=7FXWRWH0ZYBN type=write size=580497 2024-09-12T00:19:24.450 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.451+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=QRKXKNLIXDUC type=del size=2129539 2024-09-12T00:19:24.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.453+0000 7f682945b780 1 < completed delete operation key=R7V03ML1H80V tag=9GGD7VMZT3H4 type=del 2024-09-12T00:19:24.455 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.457+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~G6DJH4L77M5T.0 size=1048576 2024-09-12T00:19:24.456 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.458+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~G6DJH4L77M5T.1 size=1048576 2024-09-12T00:19:24.457 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.459+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~G6DJH4L77M5T.2 size=887118 2024-09-12T00:19:24.457 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.459+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=G6DJH4L77M5T tag=WKID9M8XBW77 type=write size=4032846 2024-09-12T00:19:24.459 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.460+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~I4O3F8M024PG.0 size=1048576 2024-09-12T00:19:24.460 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.461+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~I4O3F8M024PG.1 size=1048576 2024-09-12T00:19:24.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.462+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~I4O3F8M024PG.2 size=647003 2024-09-12T00:19:24.463 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.465+0000 7f682945b780 1 < completed multipart upload key=CT2L8L3849IN upload=I4O3F8M024PG tag=BYC4Y7MWGT2F type=write size=3792731 2024-09-12T00:19:24.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.467+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~8QX85L30Z230.0 size=1048576 2024-09-12T00:19:24.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.468+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~8QX85L30Z230.1 size=532285 2024-09-12T00:19:24.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.468+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=8QX85L30Z230 tag=LQP8HXF57JN1 type=write size=2629437 2024-09-12T00:19:24.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.470+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=3DNGD64735PM type=del 2024-09-12T00:19:24.471 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.473+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~FGBYNE479FL4.0 size=1048576 2024-09-12T00:19:24.472 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.473+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~FGBYNE479FL4.1 size=1048576 2024-09-12T00:19:24.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.474+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~FGBYNE479FL4.2 size=401202 2024-09-12T00:19:24.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.474+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=FGBYNE479FL4 tag=QEUKD01MA62P type=write size=3546930 2024-09-12T00:19:24.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.476+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~L31R0CU5MS0C.0 size=1048576 2024-09-12T00:19:24.476 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.478+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~L31R0CU5MS0C.1 size=1048576 2024-09-12T00:19:24.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.479+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~L31R0CU5MS0C.2 size=303856 2024-09-12T00:19:24.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.482+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=L31R0CU5MS0C tag=VL2TUEO1Q1CU type=write size=3449584 2024-09-12T00:19:24.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.483+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=7TETC5V1W8LA type=del size=2701021 2024-09-12T00:19:24.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.486+0000 7f682945b780 1 < suggested update operation key=IYYTX8TCLF30 tag=YFCGKT4IWJMG type=del size=1052057 2024-09-12T00:19:24.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.489+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~IC4O8137SPJR.0 size=1048576 2024-09-12T00:19:24.488 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.490+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~IC4O8137SPJR.1 size=737695 2024-09-12T00:19:24.488 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.490+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=IC4O8137SPJR tag=OQP5ZJXFC2WQ type=write size=2834847 2024-09-12T00:19:24.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.492+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~YGYADMLR9MQX.0 size=1048576 2024-09-12T00:19:24.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.492+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~YGYADMLR9MQX.1 size=1048576 2024-09-12T00:19:24.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.493+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~YGYADMLR9MQX.2 size=738784 2024-09-12T00:19:24.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.496+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=YGYADMLR9MQX tag=QM2J2ZPZFJMB type=write size=3884512 2024-09-12T00:19:24.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.497+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=O425SM8UHH9F type=del size=1361319 2024-09-12T00:19:24.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.500+0000 7f682945b780 1 < suggested remove operation key=Z7408WO050VI tag=7RDR2QU3RS53 type=write 2024-09-12T00:19:24.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.501+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=PXJ0MQZMDYH4 type=del size=3020938 2024-09-12T00:19:24.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.503+0000 7f682945b780 -1 < failed to complete operation key=TYNSP8BHYO65 tag=VYN5R1J1WQ3A type=del size=1510181: (22) Invalid argument 2024-09-12T00:19:24.504 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.505+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~KWM49883XZ9P.0 size=1048576 2024-09-12T00:19:24.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.506+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~KWM49883XZ9P.1 size=1048576 2024-09-12T00:19:24.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.508+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~KWM49883XZ9P.2 size=585765 2024-09-12T00:19:24.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.508+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=KWM49883XZ9P tag=MWO5BPUUHXQO type=write size=3731493 2024-09-12T00:19:24.509 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.511+0000 7f682945b780 1 < suggested remove operation key=1RAFARG1JXFQ tag=Z174SBN4IGE3 type=write 2024-09-12T00:19:24.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.513+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~Q3Z1P7TBY67M.0 size=336734 2024-09-12T00:19:24.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.513+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=Q3Z1P7TBY67M tag=6VHPQDLVVY7X type=write size=1385310 2024-09-12T00:19:24.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.515+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~OQXGSHIF36AH.0 size=1048576 2024-09-12T00:19:24.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.517+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~OQXGSHIF36AH.1 size=166999 2024-09-12T00:19:24.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.518+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=OQXGSHIF36AH tag=1K3MD2KGRUA4 type=write size=2264151 2024-09-12T00:19:24.519 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.521+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~LS8JCY8L64WH.0 size=1048576 2024-09-12T00:19:24.520 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.522+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~LS8JCY8L64WH.1 size=1048576 2024-09-12T00:19:24.521 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.523+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~LS8JCY8L64WH.2 size=24446 2024-09-12T00:19:24.521 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.523+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=LS8JCY8L64WH tag=DGXVUK51WSJN type=write size=3170174 2024-09-12T00:19:24.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.524+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=6AHIU07202M1 type=del 2024-09-12T00:19:24.524 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.526+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=GE71BU7RQQZK type=del size=2052293 2024-09-12T00:19:24.526 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.528+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~AZCDNES948A1.0 size=1048576 2024-09-12T00:19:24.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.529+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~AZCDNES948A1.1 size=428193 2024-09-12T00:19:24.530 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.532+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=AZCDNES948A1 tag=P9JMYAHY5URG type=write size=2525345 2024-09-12T00:19:24.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.534+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~GRSX61XQD1XC.0 size=729473 2024-09-12T00:19:24.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.534+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=GRSX61XQD1XC tag=BLEVTC1CFIOR type=write size=1778049 2024-09-12T00:19:24.534 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.537+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=TD9I7ZOM0W1U type=del 2024-09-12T00:19:24.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.540+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~7LFQ3KRMIX8A.0 size=1048576 2024-09-12T00:19:24.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.540+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~7LFQ3KRMIX8A.1 size=688032 2024-09-12T00:19:24.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.540+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=7LFQ3KRMIX8A tag=AYIV1XCQ7ZS2 type=write size=2785184 2024-09-12T00:19:24.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.543+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~7K59K26EPXM8.0 size=1048576 2024-09-12T00:19:24.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.543+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~7K59K26EPXM8.1 size=290775 2024-09-12T00:19:24.544 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.546+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=7K59K26EPXM8 tag=TLPKQR91EP8H type=write size=2387927 2024-09-12T00:19:24.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.549+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~Y30BA60RUQO5.0 size=133329 2024-09-12T00:19:24.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.549+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=Y30BA60RUQO5 tag=1AUW2LU5HVFM type=write size=1181905 2024-09-12T00:19:24.549 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.550+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=23SSAJDEG9K8 type=del 2024-09-12T00:19:24.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.553+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=JWUV3JXO49RP type=del size=3188103 2024-09-12T00:19:24.552 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.553+0000 7f682945b780 1 < canceled operation key=8D9UC8FJ16UK tag=QRKXKNLIXDUC type=del size=2129539 2024-09-12T00:19:24.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.555+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=EQ31X2MJEJ7W type=del size=1974983 2024-09-12T00:19:24.555 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.556+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~G6DJH4L77M5T.0 size=1048576 2024-09-12T00:19:24.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.557+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~G6DJH4L77M5T.1 size=1048576 2024-09-12T00:19:24.557 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.558+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~G6DJH4L77M5T.2 size=887118 2024-09-12T00:19:24.559 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.561+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=G6DJH4L77M5T tag=WKID9M8XBW77 type=write size=4032846 2024-09-12T00:19:24.561 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.562+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=66QLVB650VM6 type=del size=1637628 2024-09-12T00:19:24.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.563+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~8QX85L30Z230.0 size=1048576 2024-09-12T00:19:24.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.565+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~8QX85L30Z230.1 size=532285 2024-09-12T00:19:24.566 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.568+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=8QX85L30Z230 tag=LQP8HXF57JN1 type=write size=2629437 2024-09-12T00:19:24.567 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.569+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=QCLX8NC473V3 type=del size=2332161 2024-09-12T00:19:24.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.570+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~FGBYNE479FL4.0 size=1048576 2024-09-12T00:19:24.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.570+0000 7f682945b780 1 < canceled part key=_multipart_BI3KCKV4CRWR.2~FGBYNE479FL4.1 size=1048576 2024-09-12T00:19:24.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.571+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~FGBYNE479FL4.2 size=401202 2024-09-12T00:19:24.572 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.574+0000 7f682945b780 1 < canceled multipart upload key=BI3KCKV4CRWR upload=FGBYNE479FL4 tag=QEUKD01MA62P type=write size=3546930 2024-09-12T00:19:24.575 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.577+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~ANDSE9DQPYFT.0 size=688819 2024-09-12T00:19:24.575 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.577+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=ANDSE9DQPYFT tag=460MGPTI3N15 type=write size=1737395 2024-09-12T00:19:24.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.578+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=7TETC5V1W8LA type=del 2024-09-12T00:19:24.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.580+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=5ZIQZW7KNB2X type=del size=1210117 2024-09-12T00:19:24.581 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.581+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~IC4O8137SPJR.0 size=1048576 2024-09-12T00:19:24.581 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.583+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~IC4O8137SPJR.1 size=737695 2024-09-12T00:19:24.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.585+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=IC4O8137SPJR tag=OQP5ZJXFC2WQ type=write size=2834847 2024-09-12T00:19:24.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.589+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~1D7I9PTJGVA3.0 size=558365 2024-09-12T00:19:24.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.589+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=1D7I9PTJGVA3 tag=KCTQVIKWLCL6 type=write size=1606941 2024-09-12T00:19:24.590 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.592+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=O425SM8UHH9F type=del 2024-09-12T00:19:24.591 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.593+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=XY5721LG9MEY type=del size=3842032 2024-09-12T00:19:24.593 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.594+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=PXJ0MQZMDYH4 type=del 2024-09-12T00:19:24.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.596+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=Y3UV71RKLXG9 type=del size=2861906 2024-09-12T00:19:24.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.597+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~KWM49883XZ9P.0 size=1048576 2024-09-12T00:19:24.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.597+0000 7f682945b780 1 < canceled part key=_multipart_17S1X3WXCNAR.2~KWM49883XZ9P.1 size=1048576 2024-09-12T00:19:24.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.598+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~KWM49883XZ9P.2 size=585765 2024-09-12T00:19:24.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.600+0000 7f682945b780 1 < canceled multipart upload key=17S1X3WXCNAR upload=KWM49883XZ9P tag=MWO5BPUUHXQO type=write size=3731493 2024-09-12T00:19:24.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.602+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=LW70UAV3RL31 type=write size=6275 2024-09-12T00:19:24.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.602+0000 7f682945b780 1 < canceled part key=_multipart_17S1X3WXCNAR.2~Q3Z1P7TBY67M.0 size=336734 2024-09-12T00:19:24.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.604+0000 7f682945b780 1 < canceled multipart upload key=17S1X3WXCNAR upload=Q3Z1P7TBY67M tag=6VHPQDLVVY7X type=write size=1385310 2024-09-12T00:19:24.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.606+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=ZJUOEKPX8UP0 type=del size=1333094 2024-09-12T00:19:24.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.607+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~LS8JCY8L64WH.0 size=1048576 2024-09-12T00:19:24.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.609+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~LS8JCY8L64WH.1 size=1048576 2024-09-12T00:19:24.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.610+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~LS8JCY8L64WH.2 size=24446 2024-09-12T00:19:24.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.613+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=LS8JCY8L64WH tag=DGXVUK51WSJN type=write size=3170174 2024-09-12T00:19:24.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.614+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=P50AVH8KX9DY type=write size=1043810 2024-09-12T00:19:24.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.616+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=GE71BU7RQQZK type=del 2024-09-12T00:19:24.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.618+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~3D6A41QD26RC.0 size=1048576 2024-09-12T00:19:24.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.620+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~3D6A41QD26RC.1 size=1048576 2024-09-12T00:19:24.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.621+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~3D6A41QD26RC.2 size=1883 2024-09-12T00:19:24.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.621+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=3D6A41QD26RC tag=CP7EO53OHBCA type=write size=3147611 2024-09-12T00:19:24.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.622+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~GRSX61XQD1XC.0 size=729473 2024-09-12T00:19:24.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.625+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=GRSX61XQD1XC tag=BLEVTC1CFIOR type=write size=1778049 2024-09-12T00:19:24.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.627+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=ZY63QPGHBJ5N type=del size=1242564 2024-09-12T00:19:24.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.627+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~7LFQ3KRMIX8A.0 size=1048576 2024-09-12T00:19:24.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.628+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~7LFQ3KRMIX8A.1 size=688032 2024-09-12T00:19:24.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.631+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=7LFQ3KRMIX8A tag=AYIV1XCQ7ZS2 type=write size=2785184 2024-09-12T00:19:24.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.633+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~KFXKO2A1ORLE.0 size=284182 2024-09-12T00:19:24.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.633+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=KFXKO2A1ORLE tag=X939C2Z0XPTL type=write size=1332758 2024-09-12T00:19:24.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.633+0000 7f682945b780 1 < canceled part key=_multipart_BI3KCKV4CRWR.2~Y30BA60RUQO5.0 size=133329 2024-09-12T00:19:24.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.635+0000 7f682945b780 1 < canceled multipart upload key=BI3KCKV4CRWR upload=Y30BA60RUQO5 tag=1AUW2LU5HVFM type=write size=1181905 2024-09-12T00:19:24.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.637+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=FLZ1MFU77NWJ type=write size=663717 2024-09-12T00:19:24.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.639+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=JWUV3JXO49RP type=del 2024-09-12T00:19:24.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.641+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=RURLB3FHAK0P type=write size=107298 2024-09-12T00:19:24.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.644+0000 7f682945b780 1 < suggested update operation key=AZKLWMQ818SW tag=EQ31X2MJEJ7W type=del size=1974983 2024-09-12T00:19:24.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.646+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~NLEGA92X807P.0 size=849187 2024-09-12T00:19:24.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.646+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=NLEGA92X807P tag=FNEB5TV11DPR type=write size=1897763 2024-09-12T00:19:24.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.648+0000 7f682945b780 1 < completed delete operation key=8D9UC8FJ16UK tag=66QLVB650VM6 type=del 2024-09-12T00:19:24.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.650+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~SU45RONSPKX9.0 size=233250 2024-09-12T00:19:24.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.650+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=SU45RONSPKX9 tag=4B5D4GJWMZI6 type=write size=1281826 2024-09-12T00:19:24.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.652+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=QCLX8NC473V3 type=del 2024-09-12T00:19:24.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.654+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~6TR2WHEACJPT.0 size=449074 2024-09-12T00:19:24.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.654+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=6TR2WHEACJPT tag=AV6B6RNPC1SX type=write size=1497650 2024-09-12T00:19:24.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.655+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~ANDSE9DQPYFT.0 size=688819 2024-09-12T00:19:24.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.658+0000 7f682945b780 1 < completed multipart upload key=6DUQKU3R1RL8 upload=ANDSE9DQPYFT tag=460MGPTI3N15 type=write size=1737395 2024-09-12T00:19:24.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.659+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=GUP4WKE9ET5S type=del size=3263964 2024-09-12T00:19:24.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.660+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=5ZIQZW7KNB2X type=del 2024-09-12T00:19:24.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.662+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=2EU6X9S27E1Y type=del size=2677918 2024-09-12T00:19:24.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.663+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~1D7I9PTJGVA3.0 size=558365 2024-09-12T00:19:24.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.666+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=1D7I9PTJGVA3 tag=KCTQVIKWLCL6 type=write size=1606941 2024-09-12T00:19:24.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.667+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=0ZNPG4BKDHHA type=del size=127191 2024-09-12T00:19:24.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.668+0000 7f682945b780 -1 < failed to complete operation key=AZKLWMQ818SW tag=XY5721LG9MEY type=del size=3842032: (22) Invalid argument 2024-09-12T00:19:24.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.670+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=WBAQJEQR6118 type=write size=216790 2024-09-12T00:19:24.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.671+0000 7f682945b780 1 < canceled operation key=17S1X3WXCNAR tag=Y3UV71RKLXG9 type=del size=2861906 2024-09-12T00:19:24.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.673+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=3DN6514J2W9H type=del size=1310158 2024-09-12T00:19:24.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.674+0000 7f682945b780 1 < completed write operation key=1RAFARG1JXFQ tag=LW70UAV3RL31 type=write size=6275 2024-09-12T00:19:24.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.677+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~F7BKR7A0ZJB8.0 size=1017237 2024-09-12T00:19:24.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.677+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=F7BKR7A0ZJB8 tag=WNYBXVY6IHEL type=write size=2065813 2024-09-12T00:19:24.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.678+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=ZJUOEKPX8UP0 type=del 2024-09-12T00:19:24.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.680+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=9MW8HPXTY5UQ type=del size=1282201 2024-09-12T00:19:24.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.681+0000 7f682945b780 1 < completed write operation key=EYHGJ82COSE9 tag=P50AVH8KX9DY type=write size=1043810 2024-09-12T00:19:24.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.683+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=LOTWH5L96K37 type=del size=1075259 2024-09-12T00:19:24.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.684+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~3D6A41QD26RC.0 size=1048576 2024-09-12T00:19:24.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.685+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~3D6A41QD26RC.1 size=1048576 2024-09-12T00:19:24.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.686+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~3D6A41QD26RC.2 size=1883 2024-09-12T00:19:24.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.689+0000 7f682945b780 1 < completed multipart upload key=6DUQKU3R1RL8 upload=3D6A41QD26RC tag=CP7EO53OHBCA type=write size=3147611 2024-09-12T00:19:24.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.691+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~XR434JX17S1F.0 size=1048576 2024-09-12T00:19:24.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.693+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~XR434JX17S1F.1 size=1048576 2024-09-12T00:19:24.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.695+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~XR434JX17S1F.2 size=198649 2024-09-12T00:19:24.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.695+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=XR434JX17S1F tag=5IE83ASTXVUV type=write size=3344377 2024-09-12T00:19:24.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.696+0000 7f682945b780 1 < canceled operation key=G0ONSUVW4M7R tag=ZY63QPGHBJ5N type=del size=1242564 2024-09-12T00:19:24.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.699+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~31YY3H5506GZ.0 size=522961 2024-09-12T00:19:24.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.699+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=31YY3H5506GZ tag=2GCYQCUMNUN5 type=write size=1571537 2024-09-12T00:19:24.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.699+0000 7f682945b780 1 < canceled part key=_multipart_CE5EBY7EGY4Z.2~KFXKO2A1ORLE.0 size=284182 2024-09-12T00:19:24.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.702+0000 7f682945b780 1 < canceled multipart upload key=CE5EBY7EGY4Z upload=KFXKO2A1ORLE tag=X939C2Z0XPTL type=write size=1332758 2024-09-12T00:19:24.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.704+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~LTXVWVUX3UDT.0 size=1048576 2024-09-12T00:19:24.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.706+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~LTXVWVUX3UDT.1 size=780098 2024-09-12T00:19:24.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.706+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=LTXVWVUX3UDT tag=E9LTQ3W8892F type=write size=2877250 2024-09-12T00:19:24.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.707+0000 7f682945b780 1 < completed write operation key=R7V03ML1H80V tag=FLZ1MFU77NWJ type=write size=663717 2024-09-12T00:19:24.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.709+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=3ATQQ1F0EF7O type=write size=844462 2024-09-12T00:19:24.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.713+0000 7f682945b780 1 < suggested remove operation key=IUPAGGPATJB4 tag=RURLB3FHAK0P type=write 2024-09-12T00:19:24.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.714+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=9FN3A4MDEQZT type=del size=1207869 2024-09-12T00:19:24.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.716+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~NLEGA92X807P.0 size=849187 2024-09-12T00:19:24.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.719+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=NLEGA92X807P tag=FNEB5TV11DPR type=write size=1897763 2024-09-12T00:19:24.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.723+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~KLAV3PIYIZIY.0 size=1036249 2024-09-12T00:19:24.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.723+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=KLAV3PIYIZIY tag=8GO8O8518VIL type=write size=2084825 2024-09-12T00:19:24.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.724+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~SU45RONSPKX9.0 size=233250 2024-09-12T00:19:24.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.726+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=SU45RONSPKX9 tag=4B5D4GJWMZI6 type=write size=1281826 2024-09-12T00:19:24.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.730+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~EIW091LB9JC3.0 size=364612 2024-09-12T00:19:24.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.730+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=EIW091LB9JC3 tag=U3RWW91805GD type=write size=1413188 2024-09-12T00:19:24.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.732+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~6TR2WHEACJPT.0 size=449074 2024-09-12T00:19:24.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.734+0000 7f682945b780 1 < completed multipart upload key=CT2L8L3849IN upload=6TR2WHEACJPT tag=AV6B6RNPC1SX type=write size=1497650 2024-09-12T00:19:24.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.738+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~V1HRDBO2TWBH.0 size=1048576 2024-09-12T00:19:24.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.739+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~V1HRDBO2TWBH.1 size=807748 2024-09-12T00:19:24.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.739+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=V1HRDBO2TWBH tag=R5JSPTUHSJZP type=write size=2904900 2024-09-12T00:19:24.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.740+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=GUP4WKE9ET5S type=del 2024-09-12T00:19:24.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.742+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~RET4U4Y7NBVW.0 size=1048576 2024-09-12T00:19:24.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.744+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~RET4U4Y7NBVW.1 size=197730 2024-09-12T00:19:24.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.744+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=RET4U4Y7NBVW tag=XBF90ZWW9E3D type=write size=2294882 2024-09-12T00:19:24.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.745+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=2EU6X9S27E1Y type=del 2024-09-12T00:19:24.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.746+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=U23EVQP8AUZ7 type=del size=3526749 2024-09-12T00:19:24.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.748+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=0ZNPG4BKDHHA type=del 2024-09-12T00:19:24.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.749+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=5M3MRF8H77KL type=write size=1018708 2024-09-12T00:19:24.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.751+0000 7f682945b780 1 < canceled operation key=R7V03ML1H80V tag=WBAQJEQR6118 type=write size=216790 2024-09-12T00:19:24.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.752+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=S7SFDZIIVYXV type=del size=174333 2024-09-12T00:19:24.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.756+0000 7f682945b780 1 < suggested remove operation key=38JJBFDTIYSU tag=3DN6514J2W9H type=del 2024-09-12T00:19:24.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.757+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=O47274TZE5E3 type=del size=751403 2024-09-12T00:19:24.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.757+0000 7f682945b780 1 < canceled part key=_multipart_P56VIP3WIOJL.2~F7BKR7A0ZJB8.0 size=1017237 2024-09-12T00:19:24.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.760+0000 7f682945b780 1 < canceled multipart upload key=P56VIP3WIOJL upload=F7BKR7A0ZJB8 tag=WNYBXVY6IHEL type=write size=2065813 2024-09-12T00:19:24.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.762+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~WAY4EAABEBVE.0 size=1048576 2024-09-12T00:19:24.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.763+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~WAY4EAABEBVE.1 size=303305 2024-09-12T00:19:24.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.763+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=WAY4EAABEBVE tag=XZATUM3RNVCI type=write size=2400457 2024-09-12T00:19:24.763 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.765+0000 7f682945b780 1 < canceled operation key=17S1X3WXCNAR tag=9MW8HPXTY5UQ type=del size=1282201 2024-09-12T00:19:24.765 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.767+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~MLPNQM3IXLJN.0 size=1048576 2024-09-12T00:19:24.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.768+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~MLPNQM3IXLJN.1 size=502509 2024-09-12T00:19:24.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.768+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=MLPNQM3IXLJN tag=T69X4MBA0V1G type=write size=2599661 2024-09-12T00:19:24.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.769+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=LOTWH5L96K37 type=del 2024-09-12T00:19:24.770 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.772+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~V88MCWOXC6B8.0 size=1048576 2024-09-12T00:19:24.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.773+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~V88MCWOXC6B8.1 size=1048576 2024-09-12T00:19:24.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.774+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~V88MCWOXC6B8.2 size=968280 2024-09-12T00:19:24.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.774+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=V88MCWOXC6B8 tag=IL9FFQ95AFA4 type=write size=4114008 2024-09-12T00:19:24.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.774+0000 7f682945b780 1 < canceled part key=_multipart_1RAFARG1JXFQ.2~XR434JX17S1F.0 size=1048576 2024-09-12T00:19:24.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.774+0000 7f682945b780 1 < canceled part key=_multipart_1RAFARG1JXFQ.2~XR434JX17S1F.1 size=1048576 2024-09-12T00:19:24.774 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.775+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~XR434JX17S1F.2 size=198649 2024-09-12T00:19:24.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.777+0000 7f682945b780 1 < canceled multipart upload key=1RAFARG1JXFQ upload=XR434JX17S1F tag=5IE83ASTXVUV type=write size=3344377 2024-09-12T00:19:24.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.779+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=4OQ3LPB5YZL7 type=del size=973712 2024-09-12T00:19:24.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.780+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~31YY3H5506GZ.0 size=522961 2024-09-12T00:19:24.781 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.782+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=31YY3H5506GZ tag=2GCYQCUMNUN5 type=write size=1571537 2024-09-12T00:19:24.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.784+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=45TZTCS2GISJ type=del size=2531524 2024-09-12T00:19:24.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.785+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~LTXVWVUX3UDT.0 size=1048576 2024-09-12T00:19:24.785 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.787+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~LTXVWVUX3UDT.1 size=780098 2024-09-12T00:19:24.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.790+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=LTXVWVUX3UDT tag=E9LTQ3W8892F type=write size=2877250 2024-09-12T00:19:24.789 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.791+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=KZODD9W8L77M type=del size=2455333 2024-09-12T00:19:24.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.792+0000 7f682945b780 1 < completed write operation key=D06ZUP2ZXX42 tag=3ATQQ1F0EF7O type=write size=844462 2024-09-12T00:19:24.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.796+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~CHSG15TIVZ31.0 size=1048576 2024-09-12T00:19:24.795 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.797+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~CHSG15TIVZ31.1 size=1048576 2024-09-12T00:19:24.796 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.798+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~CHSG15TIVZ31.2 size=997419 2024-09-12T00:19:24.796 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.798+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=CHSG15TIVZ31 tag=DIBQETHJSHL6 type=write size=4143147 2024-09-12T00:19:24.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.800+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=9FN3A4MDEQZT type=del 2024-09-12T00:19:24.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.800+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=ERJ6N3XJXTEV type=del size=3463690 2024-09-12T00:19:24.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.802+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~KLAV3PIYIZIY.0 size=1036249 2024-09-12T00:19:24.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.804+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=KLAV3PIYIZIY tag=8GO8O8518VIL type=write size=2084825 2024-09-12T00:19:24.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.807+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~4YFP7W5RE1VA.0 size=1048576 2024-09-12T00:19:24.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.809+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~4YFP7W5RE1VA.1 size=322022 2024-09-12T00:19:24.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.809+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=4YFP7W5RE1VA tag=9YRKK4T44UBH type=write size=2419174 2024-09-12T00:19:24.808 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.810+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~EIW091LB9JC3.0 size=364612 2024-09-12T00:19:24.811 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.813+0000 7f682945b780 1 < completed multipart upload key=6DUQKU3R1RL8 upload=EIW091LB9JC3 tag=U3RWW91805GD type=write size=1413188 2024-09-12T00:19:24.813 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.815+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~DURQKZB5P1E9.0 size=1048576 2024-09-12T00:19:24.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.816+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~DURQKZB5P1E9.1 size=370666 2024-09-12T00:19:24.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.816+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=DURQKZB5P1E9 tag=M15V4BPEK7GW type=write size=2467818 2024-09-12T00:19:24.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.817+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~V1HRDBO2TWBH.0 size=1048576 2024-09-12T00:19:24.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.818+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~V1HRDBO2TWBH.1 size=807748 2024-09-12T00:19:24.819 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.821+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=V1HRDBO2TWBH tag=R5JSPTUHSJZP type=write size=2904900 2024-09-12T00:19:24.820 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.822+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=6TPN38M1617J type=del size=1936169 2024-09-12T00:19:24.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.823+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~RET4U4Y7NBVW.0 size=1048576 2024-09-12T00:19:24.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.824+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~RET4U4Y7NBVW.1 size=197730 2024-09-12T00:19:24.825 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.827+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=RET4U4Y7NBVW tag=XBF90ZWW9E3D type=write size=2294882 2024-09-12T00:19:24.827 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.828+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=OFI1EUPV0SPG type=del size=466908 2024-09-12T00:19:24.830 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.831+0000 7f682945b780 1 < suggested remove operation key=IUPAGGPATJB4 tag=U23EVQP8AUZ7 type=del 2024-09-12T00:19:24.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.834+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~W0QZ81B3U6EE.0 size=1048576 2024-09-12T00:19:24.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.835+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~W0QZ81B3U6EE.1 size=700697 2024-09-12T00:19:24.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.835+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=W0QZ81B3U6EE tag=1R3RT92P1ATR type=write size=2797849 2024-09-12T00:19:24.835 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.836+0000 7f682945b780 1 < completed write operation key=D06ZUP2ZXX42 tag=5M3MRF8H77KL type=write size=1018708 2024-09-12T00:19:24.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.838+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=PQQEJ86T4K17 type=del size=3995582 2024-09-12T00:19:24.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.839+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=S7SFDZIIVYXV type=del 2024-09-12T00:19:24.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.843+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~2DUOJS9H4DB8.0 size=781590 2024-09-12T00:19:24.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.843+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=2DUOJS9H4DB8 tag=6SS887A9K54U type=write size=1830166 2024-09-12T00:19:24.842 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.843+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=O47274TZE5E3 type=del 2024-09-12T00:19:24.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.847+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~W1S31RKQQC2N.0 size=1048576 2024-09-12T00:19:24.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.848+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~W1S31RKQQC2N.1 size=858681 2024-09-12T00:19:24.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.848+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=W1S31RKQQC2N tag=2S7262MVFULO type=write size=2955833 2024-09-12T00:19:24.848 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.849+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~WAY4EAABEBVE.0 size=1048576 2024-09-12T00:19:24.849 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.850+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~WAY4EAABEBVE.1 size=303305 2024-09-12T00:19:24.851 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.852+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=WAY4EAABEBVE tag=XZATUM3RNVCI type=write size=2400457 2024-09-12T00:19:24.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.855+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~SZ62DXK60OA8.0 size=1048576 2024-09-12T00:19:24.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.856+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~SZ62DXK60OA8.1 size=1048576 2024-09-12T00:19:24.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.857+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~SZ62DXK60OA8.2 size=813996 2024-09-12T00:19:24.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.857+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=SZ62DXK60OA8 tag=G59O41IUQLU2 type=write size=3959724 2024-09-12T00:19:24.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.857+0000 7f682945b780 1 < canceled part key=_multipart_G0ONSUVW4M7R.2~MLPNQM3IXLJN.0 size=1048576 2024-09-12T00:19:24.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.857+0000 7f682945b780 1 < canceled part key=_multipart_G0ONSUVW4M7R.2~MLPNQM3IXLJN.1 size=502509 2024-09-12T00:19:24.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.859+0000 7f682945b780 1 < canceled multipart upload key=G0ONSUVW4M7R upload=MLPNQM3IXLJN tag=T69X4MBA0V1G type=write size=2599661 2024-09-12T00:19:24.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.863+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=OTY40XH3S959 type=del size=3666595 2024-09-12T00:19:24.862 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.864+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~V88MCWOXC6B8.0 size=1048576 2024-09-12T00:19:24.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.866+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~V88MCWOXC6B8.1 size=1048576 2024-09-12T00:19:24.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.866+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~V88MCWOXC6B8.2 size=968280 2024-09-12T00:19:24.867 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.869+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=V88MCWOXC6B8 tag=IL9FFQ95AFA4 type=write size=4114008 2024-09-12T00:19:24.870 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.872+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~QVNP0A2XTXS8.0 size=1048576 2024-09-12T00:19:24.871 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.873+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~QVNP0A2XTXS8.1 size=1048576 2024-09-12T00:19:24.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.874+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~QVNP0A2XTXS8.2 size=111395 2024-09-12T00:19:24.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.874+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=QVNP0A2XTXS8 tag=CBNWK5KMU2T9 type=write size=3257123 2024-09-12T00:19:24.875 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.877+0000 7f682945b780 1 < suggested update operation key=Z7408WO050VI tag=4OQ3LPB5YZL7 type=del size=973712 2024-09-12T00:19:24.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.879+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~DB9X4TRQ0U2X.0 size=1048576 2024-09-12T00:19:24.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.880+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~DB9X4TRQ0U2X.1 size=636584 2024-09-12T00:19:24.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.880+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=DB9X4TRQ0U2X tag=LV4FEEBUPC57 type=write size=2733736 2024-09-12T00:19:24.880 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.882+0000 7f682945b780 1 < completed delete operation key=8D9UC8FJ16UK tag=45TZTCS2GISJ type=del 2024-09-12T00:19:24.882 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.883+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=0CZGMZGIP6O2 type=del size=1325254 2024-09-12T00:19:24.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.885+0000 7f682945b780 1 < canceled operation key=COUJXCOSVPDS tag=KZODD9W8L77M type=del size=2455333 2024-09-12T00:19:24.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.886+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=CCMIRUYU3MQX type=write size=638682 2024-09-12T00:19:24.886 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.889+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~CHSG15TIVZ31.0 size=1048576 2024-09-12T00:19:24.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.889+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~CHSG15TIVZ31.1 size=1048576 2024-09-12T00:19:24.889 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.891+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~CHSG15TIVZ31.2 size=997419 2024-09-12T00:19:24.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.894+0000 7f682945b780 1 < completed multipart upload key=8D9UC8FJ16UK upload=CHSG15TIVZ31 tag=DIBQETHJSHL6 type=write size=4143147 2024-09-12T00:19:24.893 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.895+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=G2WZEWC25MJD type=del size=68662 2024-09-12T00:19:24.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.896+0000 7f682945b780 1 < completed delete operation key=38JJBFDTIYSU tag=ERJ6N3XJXTEV type=del 2024-09-12T00:19:24.896 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.898+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=22Z9FE05ZDIT type=del size=3236344 2024-09-12T00:19:24.897 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.898+0000 7f682945b780 1 < canceled part key=_multipart_JAVE3HR52R5C.2~4YFP7W5RE1VA.0 size=1048576 2024-09-12T00:19:24.898 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.899+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~4YFP7W5RE1VA.1 size=322022 2024-09-12T00:19:24.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.901+0000 7f682945b780 1 < canceled multipart upload key=JAVE3HR52R5C upload=4YFP7W5RE1VA tag=9YRKK4T44UBH type=write size=2419174 2024-09-12T00:19:24.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.903+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=SWFBA5XXGVG0 type=del size=38391 2024-09-12T00:19:24.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.905+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~DURQKZB5P1E9.0 size=1048576 2024-09-12T00:19:24.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.906+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~DURQKZB5P1E9.1 size=370666 2024-09-12T00:19:24.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.909+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=DURQKZB5P1E9 tag=M15V4BPEK7GW type=write size=2467818 2024-09-12T00:19:24.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.910+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=DRLEGG32L4LC type=write size=962311 2024-09-12T00:19:24.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.912+0000 7f682945b780 1 < completed delete operation key=R7V03ML1H80V tag=6TPN38M1617J type=del 2024-09-12T00:19:24.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.913+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=SYCS2ZVIK01O type=del size=1589291 2024-09-12T00:19:24.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.915+0000 7f682945b780 1 < canceled operation key=SGWTWN8RTKDD tag=OFI1EUPV0SPG type=del size=466908 2024-09-12T00:19:24.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.919+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~GDH8WM2S30GO.0 size=902401 2024-09-12T00:19:24.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.919+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=GDH8WM2S30GO tag=OWGSQE2KF5R8 type=write size=1950977 2024-09-12T00:19:24.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.921+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~W0QZ81B3U6EE.0 size=1048576 2024-09-12T00:19:24.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.922+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~W0QZ81B3U6EE.1 size=700697 2024-09-12T00:19:24.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.924+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=W0QZ81B3U6EE tag=1R3RT92P1ATR type=write size=2797849 2024-09-12T00:19:24.925 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.927+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~K1V0TWM8H84S.0 size=1048576 2024-09-12T00:19:24.927 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.928+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~K1V0TWM8H84S.1 size=1048576 2024-09-12T00:19:24.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.930+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~K1V0TWM8H84S.2 size=471938 2024-09-12T00:19:24.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.930+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=K1V0TWM8H84S tag=INECVMXAPTLY type=write size=3617666 2024-09-12T00:19:24.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.931+0000 7f682945b780 1 < canceled operation key=JAVE3HR52R5C tag=PQQEJ86T4K17 type=del size=3995582 2024-09-12T00:19:24.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.932+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=B3SJ3XHHWJNN type=del size=2077202 2024-09-12T00:19:24.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.934+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~2DUOJS9H4DB8.0 size=781590 2024-09-12T00:19:24.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.937+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=2DUOJS9H4DB8 tag=6SS887A9K54U type=write size=1830166 2024-09-12T00:19:24.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.939+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~FL328NB5CQBK.0 size=1048576 2024-09-12T00:19:24.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.941+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~FL328NB5CQBK.1 size=919776 2024-09-12T00:19:24.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.941+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=FL328NB5CQBK tag=4SY0WQ8NMLE6 type=write size=3016928 2024-09-12T00:19:24.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.942+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~W1S31RKQQC2N.0 size=1048576 2024-09-12T00:19:24.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.942+0000 7f682945b780 1 < canceled part key=_multipart_D06ZUP2ZXX42.2~W1S31RKQQC2N.1 size=858681 2024-09-12T00:19:24.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.945+0000 7f682945b780 1 < canceled multipart upload key=D06ZUP2ZXX42 upload=W1S31RKQQC2N tag=2S7262MVFULO type=write size=2955833 2024-09-12T00:19:24.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.946+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=1174EIU2E9Y7 type=del size=3450286 2024-09-12T00:19:24.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.948+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~SZ62DXK60OA8.0 size=1048576 2024-09-12T00:19:24.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.949+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~SZ62DXK60OA8.1 size=1048576 2024-09-12T00:19:24.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.950+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~SZ62DXK60OA8.2 size=813996 2024-09-12T00:19:24.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.952+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=SZ62DXK60OA8 tag=G59O41IUQLU2 type=write size=3959724 2024-09-12T00:19:24.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.954+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=8KTSWXADDFIS type=write size=180730 2024-09-12T00:19:24.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.955+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=OTY40XH3S959 type=del 2024-09-12T00:19:24.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.958+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~GBJ34H3B5LFF.0 size=1048576 2024-09-12T00:19:24.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.959+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~GBJ34H3B5LFF.1 size=305702 2024-09-12T00:19:24.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.959+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=GBJ34H3B5LFF tag=T3GS9U02SOYK type=write size=2402854 2024-09-12T00:19:24.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.961+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~QVNP0A2XTXS8.0 size=1048576 2024-09-12T00:19:24.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.962+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~QVNP0A2XTXS8.1 size=1048576 2024-09-12T00:19:24.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.963+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~QVNP0A2XTXS8.2 size=111395 2024-09-12T00:19:24.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.965+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=QVNP0A2XTXS8 tag=CBNWK5KMU2T9 type=write size=3257123 2024-09-12T00:19:24.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.967+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=AW6SR1BLRUWS type=del size=3906138 2024-09-12T00:19:24.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.968+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~DB9X4TRQ0U2X.0 size=1048576 2024-09-12T00:19:24.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.969+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~DB9X4TRQ0U2X.1 size=636584 2024-09-12T00:19:24.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.972+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=DB9X4TRQ0U2X tag=LV4FEEBUPC57 type=write size=2733736 2024-09-12T00:19:24.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.975+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~8JFHOUXRBQ1A.0 size=1048576 2024-09-12T00:19:24.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.976+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~8JFHOUXRBQ1A.1 size=1048576 2024-09-12T00:19:24.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.977+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~8JFHOUXRBQ1A.2 size=619043 2024-09-12T00:19:24.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.977+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=8JFHOUXRBQ1A tag=BVRPK1XNYZ28 type=write size=3764771 2024-09-12T00:19:24.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.978+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=0CZGMZGIP6O2 type=del 2024-09-12T00:19:24.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.981+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~7QECMNHHTO1H.0 size=1048576 2024-09-12T00:19:24.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.982+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~7QECMNHHTO1H.1 size=1048576 2024-09-12T00:19:24.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.983+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~7QECMNHHTO1H.2 size=1013914 2024-09-12T00:19:24.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.983+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=7QECMNHHTO1H tag=Z7W9COQ5OYFB type=write size=4159642 2024-09-12T00:19:24.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.985+0000 7f682945b780 1 < completed write operation key=Z7408WO050VI tag=CCMIRUYU3MQX type=write size=638682 2024-09-12T00:19:24.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.986+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=BL28CV8I2ZQ1 type=del size=615477 2024-09-12T00:19:24.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.987+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=G2WZEWC25MJD type=del 2024-09-12T00:19:24.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.990+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~DJA2Z7GH4ZSK.0 size=784614 2024-09-12T00:19:24.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.990+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=DJA2Z7GH4ZSK tag=1XBH8PJWZCO7 type=write size=1833190 2024-09-12T00:19:24.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.992+0000 7f682945b780 1 < completed delete operation key=R7V03ML1H80V tag=22Z9FE05ZDIT type=del 2024-09-12T00:19:24.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.993+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=242VX4MJZQC0 type=del size=3073176 2024-09-12T00:19:24.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.995+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=SWFBA5XXGVG0 type=del 2024-09-12T00:19:24.994 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:24.996+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=BVBA0M0DODYR type=write size=679162 2024-09-12T00:19:24.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.000+0000 7f682945b780 1 < suggested update operation key=AZKLWMQ818SW tag=DRLEGG32L4LC type=write size=962311 2024-09-12T00:19:25.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.003+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~2BNM7FVC8GB5.0 size=1048576 2024-09-12T00:19:25.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.004+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~2BNM7FVC8GB5.1 size=1048576 2024-09-12T00:19:25.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.005+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~2BNM7FVC8GB5.2 size=94843 2024-09-12T00:19:25.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.005+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=2BNM7FVC8GB5 tag=176KVN7WAJ64 type=write size=3240571 2024-09-12T00:19:25.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.006+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=SYCS2ZVIK01O type=del 2024-09-12T00:19:25.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.007+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=FOD7HZSWN6G8 type=del size=60359 2024-09-12T00:19:25.008 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.009+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~GDH8WM2S30GO.0 size=902401 2024-09-12T00:19:25.010 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.011+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=GDH8WM2S30GO tag=OWGSQE2KF5R8 type=write size=1950977 2024-09-12T00:19:25.012 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.014+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~2K8VPM9K65FL.0 size=1048576 2024-09-12T00:19:25.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.016+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~2K8VPM9K65FL.1 size=1048576 2024-09-12T00:19:25.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.017+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~2K8VPM9K65FL.2 size=351219 2024-09-12T00:19:25.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.017+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=2K8VPM9K65FL tag=MTE2YD7MMZO9 type=write size=3496947 2024-09-12T00:19:25.016 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.018+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~K1V0TWM8H84S.0 size=1048576 2024-09-12T00:19:25.017 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.019+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~K1V0TWM8H84S.1 size=1048576 2024-09-12T00:19:25.018 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.020+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~K1V0TWM8H84S.2 size=471938 2024-09-12T00:19:25.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.022+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=K1V0TWM8H84S tag=INECVMXAPTLY type=write size=3617666 2024-09-12T00:19:25.022 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.024+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=BU5ZS47310L3 type=del size=1566913 2024-09-12T00:19:25.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.025+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=B3SJ3XHHWJNN type=del 2024-09-12T00:19:25.025 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.027+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=B9N8DZVC0E74 type=write size=203264 2024-09-12T00:19:25.026 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.028+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~FL328NB5CQBK.0 size=1048576 2024-09-12T00:19:25.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.029+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~FL328NB5CQBK.1 size=919776 2024-09-12T00:19:25.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.031+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=FL328NB5CQBK tag=4SY0WQ8NMLE6 type=write size=3016928 2024-09-12T00:19:25.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.033+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=K8QSIFEGCE40 type=del size=3474695 2024-09-12T00:19:25.035 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.036+0000 7f682945b780 1 < suggested remove operation key=P56VIP3WIOJL tag=1174EIU2E9Y7 type=del 2024-09-12T00:19:25.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.040+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~SQWMP1JK6VLM.0 size=1048576 2024-09-12T00:19:25.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.040+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~SQWMP1JK6VLM.1 size=201211 2024-09-12T00:19:25.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.040+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=SQWMP1JK6VLM tag=SE2CKVCQ6K6L type=write size=2298363 2024-09-12T00:19:25.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.042+0000 7f682945b780 1 < completed write operation key=TGOBZH6DZK71 tag=8KTSWXADDFIS type=write size=180730 2024-09-12T00:19:25.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.043+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=NRUJD0BKHBB6 type=del size=2378682 2024-09-12T00:19:25.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.043+0000 7f682945b780 1 < canceled part key=_multipart_CE5EBY7EGY4Z.2~GBJ34H3B5LFF.0 size=1048576 2024-09-12T00:19:25.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.044+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~GBJ34H3B5LFF.1 size=305702 2024-09-12T00:19:25.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.047+0000 7f682945b780 1 < canceled multipart upload key=CE5EBY7EGY4Z upload=GBJ34H3B5LFF tag=T3GS9U02SOYK type=write size=2402854 2024-09-12T00:19:25.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.048+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=G6989LG3JCCO type=del size=1788464 2024-09-12T00:19:25.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.049+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=AW6SR1BLRUWS type=del 2024-09-12T00:19:25.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.053+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~634CUQKABWT0.0 size=1048576 2024-09-12T00:19:25.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.054+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~634CUQKABWT0.1 size=1048576 2024-09-12T00:19:25.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.055+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~634CUQKABWT0.2 size=561133 2024-09-12T00:19:25.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.055+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=634CUQKABWT0 tag=MTA0KQHI77BV type=write size=3706861 2024-09-12T00:19:25.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.055+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~8JFHOUXRBQ1A.0 size=1048576 2024-09-12T00:19:25.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.057+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~8JFHOUXRBQ1A.1 size=1048576 2024-09-12T00:19:25.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.058+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~8JFHOUXRBQ1A.2 size=619043 2024-09-12T00:19:25.058 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.060+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=8JFHOUXRBQ1A tag=BVRPK1XNYZ28 type=write size=3764771 2024-09-12T00:19:25.061 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.062+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~WU9VDIT3ONU2.0 size=1048576 2024-09-12T00:19:25.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.063+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~WU9VDIT3ONU2.1 size=852369 2024-09-12T00:19:25.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.063+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=WU9VDIT3ONU2 tag=0FS056DW8Y3F type=write size=2949521 2024-09-12T00:19:25.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.065+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~7QECMNHHTO1H.0 size=1048576 2024-09-12T00:19:25.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.067+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~7QECMNHHTO1H.1 size=1048576 2024-09-12T00:19:25.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.067+0000 7f682945b780 1 < canceled part key=_multipart_Z7408WO050VI.2~7QECMNHHTO1H.2 size=1013914 2024-09-12T00:19:25.067 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.069+0000 7f682945b780 1 < canceled multipart upload key=Z7408WO050VI upload=7QECMNHHTO1H tag=Z7W9COQ5OYFB type=write size=4159642 2024-09-12T00:19:25.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.070+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=2X1XLSSNXAOW type=del size=3381807 2024-09-12T00:19:25.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.072+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=BL28CV8I2ZQ1 type=del 2024-09-12T00:19:25.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.074+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~JRK3WTJXHNBG.0 size=1048576 2024-09-12T00:19:25.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.075+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~JRK3WTJXHNBG.1 size=1048576 2024-09-12T00:19:25.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.076+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~JRK3WTJXHNBG.2 size=877142 2024-09-12T00:19:25.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.076+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=JRK3WTJXHNBG tag=TMUWSKPAMN9T type=write size=4022870 2024-09-12T00:19:25.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.078+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~DJA2Z7GH4ZSK.0 size=784614 2024-09-12T00:19:25.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.079+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=DJA2Z7GH4ZSK tag=1XBH8PJWZCO7 type=write size=1833190 2024-09-12T00:19:25.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.081+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=CZI8WXGPTRTD type=del size=2926201 2024-09-12T00:19:25.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.083+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=242VX4MJZQC0 type=del 2024-09-12T00:19:25.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.086+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~8RNEFF7KNA73.0 size=1048576 2024-09-12T00:19:25.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.088+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~8RNEFF7KNA73.1 size=429999 2024-09-12T00:19:25.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.088+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=8RNEFF7KNA73 tag=6ZCSLG1A6ZIJ type=write size=2527151 2024-09-12T00:19:25.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.090+0000 7f682945b780 1 < completed write operation key=CE5EBY7EGY4Z tag=BVBA0M0DODYR type=write size=679162 2024-09-12T00:19:25.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.090+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=ZY02UTQTSAAY type=del size=2539021 2024-09-12T00:19:25.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.093+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~2BNM7FVC8GB5.0 size=1048576 2024-09-12T00:19:25.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.094+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~2BNM7FVC8GB5.1 size=1048576 2024-09-12T00:19:25.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.094+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~2BNM7FVC8GB5.2 size=94843 2024-09-12T00:19:25.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.097+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=2BNM7FVC8GB5 tag=176KVN7WAJ64 type=write size=3240571 2024-09-12T00:19:25.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.098+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=X3S02N694LV0 type=write size=578770 2024-09-12T00:19:25.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.099+0000 7f682945b780 1 < completed delete operation key=COUJXCOSVPDS tag=FOD7HZSWN6G8 type=del 2024-09-12T00:19:25.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.101+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=AFA7FE3AE87D type=del size=3515941 2024-09-12T00:19:25.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.103+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~2K8VPM9K65FL.0 size=1048576 2024-09-12T00:19:25.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.104+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~2K8VPM9K65FL.1 size=1048576 2024-09-12T00:19:25.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.106+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~2K8VPM9K65FL.2 size=351219 2024-09-12T00:19:25.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.108+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=2K8VPM9K65FL tag=MTE2YD7MMZO9 type=write size=3496947 2024-09-12T00:19:25.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.110+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~PWMERMW803N2.0 size=1048576 2024-09-12T00:19:25.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.111+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~PWMERMW803N2.1 size=1048576 2024-09-12T00:19:25.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.112+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~PWMERMW803N2.2 size=103862 2024-09-12T00:19:25.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.112+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=PWMERMW803N2 tag=VZ5YD73HCRRA type=write size=3249590 2024-09-12T00:19:25.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.114+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=BU5ZS47310L3 type=del 2024-09-12T00:19:25.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.115+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=FU3XMZEWRJXW type=del size=3081978 2024-09-12T00:19:25.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.116+0000 7f682945b780 1 < completed write operation key=7RRJO383D8TH tag=B9N8DZVC0E74 type=write size=203264 2024-09-12T00:19:25.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.120+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~FMS0LZLXDIKP.0 size=546009 2024-09-12T00:19:25.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.120+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=FMS0LZLXDIKP tag=UKLQZEOFRK1Y type=write size=1594585 2024-09-12T00:19:25.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.122+0000 7f682945b780 1 < suggested update operation key=TGOBZH6DZK71 tag=K8QSIFEGCE40 type=del size=3474695 2024-09-12T00:19:25.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.123+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=GOGP0VV78099 type=del size=2643600 2024-09-12T00:19:25.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.125+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~SQWMP1JK6VLM.0 size=1048576 2024-09-12T00:19:25.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.126+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~SQWMP1JK6VLM.1 size=201211 2024-09-12T00:19:25.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.128+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=SQWMP1JK6VLM tag=SE2CKVCQ6K6L type=write size=2298363 2024-09-12T00:19:25.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.132+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~WHYX38DEW427.0 size=1048576 2024-09-12T00:19:25.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.133+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~WHYX38DEW427.1 size=444608 2024-09-12T00:19:25.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.133+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=WHYX38DEW427 tag=93L6R3CM1RNP type=write size=2541760 2024-09-12T00:19:25.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.136+0000 7f682945b780 1 < suggested update operation key=R2OAUUKLV7OK tag=NRUJD0BKHBB6 type=del size=2378682 2024-09-12T00:19:25.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.137+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=LPIRS29I7PRY type=del size=1538349 2024-09-12T00:19:25.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.140+0000 7f682945b780 1 < suggested remove operation key=TGOBZH6DZK71 tag=G6989LG3JCCO type=del 2024-09-12T00:19:25.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.141+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=ASAFXJWQUWZJ type=write size=564990 2024-09-12T00:19:25.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.143+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~634CUQKABWT0.0 size=1048576 2024-09-12T00:19:25.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.144+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~634CUQKABWT0.1 size=1048576 2024-09-12T00:19:25.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.145+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~634CUQKABWT0.2 size=561133 2024-09-12T00:19:25.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.148+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=634CUQKABWT0 tag=MTA0KQHI77BV type=write size=3706861 2024-09-12T00:19:25.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.149+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=3923BBA108M3 type=write size=604589 2024-09-12T00:19:25.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.151+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~WU9VDIT3ONU2.0 size=1048576 2024-09-12T00:19:25.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.152+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~WU9VDIT3ONU2.1 size=852369 2024-09-12T00:19:25.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.155+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=WU9VDIT3ONU2 tag=0FS056DW8Y3F type=write size=2949521 2024-09-12T00:19:25.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.157+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=RLENV70ARL8U type=del size=2033515 2024-09-12T00:19:25.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.158+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=2X1XLSSNXAOW type=del 2024-09-12T00:19:25.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.160+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=U3CQ38TRLNMU type=write size=880178 2024-09-12T00:19:25.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.160+0000 7f682945b780 1 < canceled part key=_multipart_AZKLWMQ818SW.2~JRK3WTJXHNBG.0 size=1048576 2024-09-12T00:19:25.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.161+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~JRK3WTJXHNBG.1 size=1048576 2024-09-12T00:19:25.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.162+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~JRK3WTJXHNBG.2 size=877142 2024-09-12T00:19:25.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.165+0000 7f682945b780 1 < canceled multipart upload key=AZKLWMQ818SW upload=JRK3WTJXHNBG tag=TMUWSKPAMN9T type=write size=4022870 2024-09-12T00:19:25.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.167+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~MAJRQRTPJ9A4.0 size=1048576 2024-09-12T00:19:25.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.169+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~MAJRQRTPJ9A4.1 size=647308 2024-09-12T00:19:25.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.169+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=MAJRQRTPJ9A4 tag=PLIK3G51V546 type=write size=2744460 2024-09-12T00:19:25.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.169+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=CZI8WXGPTRTD type=del 2024-09-12T00:19:25.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.171+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=PR4TL0P464P2 type=write size=130921 2024-09-12T00:19:25.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.172+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~8RNEFF7KNA73.0 size=1048576 2024-09-12T00:19:25.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.173+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~8RNEFF7KNA73.1 size=429999 2024-09-12T00:19:25.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.176+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=8RNEFF7KNA73 tag=6ZCSLG1A6ZIJ type=write size=2527151 2024-09-12T00:19:25.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.177+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=57H4U7AGFL53 type=del size=2569194 2024-09-12T00:19:25.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.178+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=ZY02UTQTSAAY type=del 2024-09-12T00:19:25.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.181+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~4JZF1KNCSXK7.0 size=536950 2024-09-12T00:19:25.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.181+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=4JZF1KNCSXK7 tag=HFQWBJCJIT77 type=write size=1585526 2024-09-12T00:19:25.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.182+0000 7f682945b780 1 < completed write operation key=BMTPXZ1OA2TZ tag=X3S02N694LV0 type=write size=578770 2024-09-12T00:19:25.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.183+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=BAW1FWASQKOM type=del size=1838251 2024-09-12T00:19:25.183 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.184+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=AFA7FE3AE87D type=del 2024-09-12T00:19:25.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.186+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=GSVESXYX07IS type=write size=643115 2024-09-12T00:19:25.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.187+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~PWMERMW803N2.0 size=1048576 2024-09-12T00:19:25.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.188+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~PWMERMW803N2.1 size=1048576 2024-09-12T00:19:25.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.189+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~PWMERMW803N2.2 size=103862 2024-09-12T00:19:25.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.191+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=PWMERMW803N2 tag=VZ5YD73HCRRA type=write size=3249590 2024-09-12T00:19:25.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.193+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=6Z60G2U1YB1L type=del size=3643766 2024-09-12T00:19:25.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.195+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=FU3XMZEWRJXW type=del 2024-09-12T00:19:25.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.196+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=262YRTROVAA4 type=del size=239723 2024-09-12T00:19:25.195 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.197+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~FMS0LZLXDIKP.0 size=546009 2024-09-12T00:19:25.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.199+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=FMS0LZLXDIKP tag=UKLQZEOFRK1Y type=write size=1594585 2024-09-12T00:19:25.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.202+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~7QSGIEIKDRBS.0 size=577670 2024-09-12T00:19:25.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.202+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=7QSGIEIKDRBS tag=8093A29M43X0 type=write size=1626246 2024-09-12T00:19:25.202 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.203+0000 7f682945b780 1 < completed delete operation key=R7V03ML1H80V tag=GOGP0VV78099 type=del 2024-09-12T00:19:25.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.205+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=BGFVOIEES4Y4 type=write size=468881 2024-09-12T00:19:25.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.206+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~WHYX38DEW427.0 size=1048576 2024-09-12T00:19:25.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.208+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~WHYX38DEW427.1 size=444608 2024-09-12T00:19:25.211 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.211+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=WHYX38DEW427 tag=93L6R3CM1RNP type=write size=2541760 2024-09-12T00:19:25.211 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.213+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~9ERA6U1PEBFD.0 size=1048576 2024-09-12T00:19:25.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.214+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~9ERA6U1PEBFD.1 size=1048576 2024-09-12T00:19:25.213 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.215+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~9ERA6U1PEBFD.2 size=86683 2024-09-12T00:19:25.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.215+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=9ERA6U1PEBFD tag=85LECZ1LOG58 type=write size=3232411 2024-09-12T00:19:25.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.217+0000 7f682945b780 1 < suggested remove operation key=6DUQKU3R1RL8 tag=LPIRS29I7PRY type=del 2024-09-12T00:19:25.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.219+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=FHI4UAOOTWPH type=del size=2635994 2024-09-12T00:19:25.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.220+0000 7f682945b780 1 < canceled operation key=D06ZUP2ZXX42 tag=ASAFXJWQUWZJ type=write size=564990 2024-09-12T00:19:25.221 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.223+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~UQEIV3NYKQS6.0 size=1048576 2024-09-12T00:19:25.222 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.224+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~UQEIV3NYKQS6.1 size=1048576 2024-09-12T00:19:25.223 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.225+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~UQEIV3NYKQS6.2 size=922112 2024-09-12T00:19:25.223 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.225+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=UQEIV3NYKQS6 tag=N9QZ0VTA3QFP type=write size=4067840 2024-09-12T00:19:25.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.226+0000 7f682945b780 1 < completed write operation key=BFY578HP8GAW tag=3923BBA108M3 type=write size=604589 2024-09-12T00:19:25.226 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.228+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=AIKR4RF8NYFV type=del size=3494549 2024-09-12T00:19:25.228 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.229+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=RLENV70ARL8U type=del 2024-09-12T00:19:25.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.231+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=HPOL5ORH0OIR type=del size=670207 2024-09-12T00:19:25.231 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.232+0000 7f682945b780 1 < completed write operation key=38JJBFDTIYSU tag=U3CQ38TRLNMU type=write size=880178 2024-09-12T00:19:25.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.235+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~1G0CDD1NVX1T.0 size=1048576 2024-09-12T00:19:25.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.236+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~1G0CDD1NVX1T.1 size=1048576 2024-09-12T00:19:25.235 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.237+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~1G0CDD1NVX1T.2 size=484928 2024-09-12T00:19:25.236 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.237+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=1G0CDD1NVX1T tag=AL78WEEKKSYY type=write size=3630656 2024-09-12T00:19:25.237 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.238+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~MAJRQRTPJ9A4.0 size=1048576 2024-09-12T00:19:25.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.239+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~MAJRQRTPJ9A4.1 size=647308 2024-09-12T00:19:25.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.242+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=MAJRQRTPJ9A4 tag=PLIK3G51V546 type=write size=2744460 2024-09-12T00:19:25.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.243+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=992WY11Q2KYP type=write size=1036163 2024-09-12T00:19:25.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.245+0000 7f682945b780 1 < completed write operation key=BFY578HP8GAW tag=PR4TL0P464P2 type=write size=130921 2024-09-12T00:19:25.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.247+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~HEJG9C6B11EB.0 size=1031171 2024-09-12T00:19:25.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.247+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=HEJG9C6B11EB tag=SWYZT1DBPUZZ type=write size=2079747 2024-09-12T00:19:25.247 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.248+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=57H4U7AGFL53 type=del 2024-09-12T00:19:25.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.250+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~5F0TCFZE7QNL.0 size=611664 2024-09-12T00:19:25.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.250+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=5F0TCFZE7QNL tag=84T4X14QEE0U type=write size=1660240 2024-09-12T00:19:25.250 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.252+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~4JZF1KNCSXK7.0 size=536950 2024-09-12T00:19:25.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.254+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=4JZF1KNCSXK7 tag=HFQWBJCJIT77 type=write size=1585526 2024-09-12T00:19:25.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.256+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=QO1YBQTRK436 type=write size=117693 2024-09-12T00:19:25.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.257+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=BAW1FWASQKOM type=del 2024-09-12T00:19:25.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.258+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=PJIRWG7Z5J3W type=del size=906318 2024-09-12T00:19:25.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.261+0000 7f682945b780 1 < completed write operation key=1RAFARG1JXFQ tag=GSVESXYX07IS type=write size=643115 2024-09-12T00:19:25.262 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.264+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=AD8FICQPNK2M type=write size=812500 2024-09-12T00:19:25.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.266+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=6Z60G2U1YB1L type=del 2024-09-12T00:19:25.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.268+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~2VKUDGNPUZMX.0 size=1048576 2024-09-12T00:19:25.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.269+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~2VKUDGNPUZMX.1 size=1048576 2024-09-12T00:19:25.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.270+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~2VKUDGNPUZMX.2 size=805822 2024-09-12T00:19:25.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.270+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=2VKUDGNPUZMX tag=IG6P6NGSIBE5 type=write size=3951550 2024-09-12T00:19:25.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.271+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=262YRTROVAA4 type=del 2024-09-12T00:19:25.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.275+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~4A9YZMKERL1F.0 size=847069 2024-09-12T00:19:25.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.275+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=4A9YZMKERL1F tag=G6G0B83Y96QE type=write size=1895645 2024-09-12T00:19:25.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.275+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~7QSGIEIKDRBS.0 size=577670 2024-09-12T00:19:25.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.278+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=7QSGIEIKDRBS tag=8093A29M43X0 type=write size=1626246 2024-09-12T00:19:25.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.279+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=31K81XGHK4XT type=del size=1724252 2024-09-12T00:19:25.279 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.280+0000 7f682945b780 1 < completed write operation key=IYYTX8TCLF30 tag=BGFVOIEES4Y4 type=write size=468881 2024-09-12T00:19:25.280 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.282+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=G5OW400JAYUD type=del size=3230019 2024-09-12T00:19:25.282 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.283+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~9ERA6U1PEBFD.0 size=1048576 2024-09-12T00:19:25.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.284+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~9ERA6U1PEBFD.1 size=1048576 2024-09-12T00:19:25.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.286+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~9ERA6U1PEBFD.2 size=86683 2024-09-12T00:19:25.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.288+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=9ERA6U1PEBFD tag=85LECZ1LOG58 type=write size=3232411 2024-09-12T00:19:25.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.291+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~P6BSGSK2OGU3.0 size=67173 2024-09-12T00:19:25.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.291+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=P6BSGSK2OGU3 tag=G8I61DUOSKPF type=write size=1115749 2024-09-12T00:19:25.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.293+0000 7f682945b780 1 < suggested update operation key=BV3D543J63H1 tag=FHI4UAOOTWPH type=del size=2635994 2024-09-12T00:19:25.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.297+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~R7P6RPGUHWSV.0 size=277935 2024-09-12T00:19:25.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.297+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=R7P6RPGUHWSV tag=H8PSFMNZ68SI type=write size=1326511 2024-09-12T00:19:25.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.297+0000 7f682945b780 1 < canceled part key=_multipart_1RAFARG1JXFQ.2~UQEIV3NYKQS6.0 size=1048576 2024-09-12T00:19:25.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.297+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~UQEIV3NYKQS6.1 size=1048576 2024-09-12T00:19:25.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.299+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~UQEIV3NYKQS6.2 size=922112 2024-09-12T00:19:25.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.301+0000 7f682945b780 1 < canceled multipart upload key=1RAFARG1JXFQ upload=UQEIV3NYKQS6 tag=N9QZ0VTA3QFP type=write size=4067840 2024-09-12T00:19:25.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.304+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~NH8YEL9UDNDO.0 size=1048576 2024-09-12T00:19:25.304 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.305+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~NH8YEL9UDNDO.1 size=711059 2024-09-12T00:19:25.304 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.305+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=NH8YEL9UDNDO tag=R8APSHFFC84H type=write size=2808211 2024-09-12T00:19:25.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.307+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=AIKR4RF8NYFV type=del 2024-09-12T00:19:25.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.308+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=U4AZZIJVFTGX type=write size=387642 2024-09-12T00:19:25.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.310+0000 7f682945b780 1 < suggested remove operation key=G0ONSUVW4M7R tag=HPOL5ORH0OIR type=del 2024-09-12T00:19:25.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.313+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=FGB8VAH7TD8E type=del size=3522017 2024-09-12T00:19:25.312 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.313+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~1G0CDD1NVX1T.0 size=1048576 2024-09-12T00:19:25.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.315+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~1G0CDD1NVX1T.1 size=1048576 2024-09-12T00:19:25.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.316+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~1G0CDD1NVX1T.2 size=484928 2024-09-12T00:19:25.317 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.319+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=1G0CDD1NVX1T tag=AL78WEEKKSYY type=write size=3630656 2024-09-12T00:19:25.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.320+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~0PSYBYOC7FLE.0 size=1048576 2024-09-12T00:19:25.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.321+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~0PSYBYOC7FLE.1 size=697614 2024-09-12T00:19:25.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.321+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=0PSYBYOC7FLE tag=6NQXGHF83O9D type=write size=2794766 2024-09-12T00:19:25.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.323+0000 7f682945b780 1 < canceled operation key=IYYTX8TCLF30 tag=992WY11Q2KYP type=write size=1036163 2024-09-12T00:19:25.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.324+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=5O24RFVQL7CE type=del size=2245531 2024-09-12T00:19:25.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.326+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~HEJG9C6B11EB.0 size=1031171 2024-09-12T00:19:25.328 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.328+0000 7f682945b780 1 < completed multipart upload key=CT2L8L3849IN upload=HEJG9C6B11EB tag=SWYZT1DBPUZZ type=write size=2079747 2024-09-12T00:19:25.329 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.330+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~WTIYEB8YYQ5C.0 size=1048576 2024-09-12T00:19:25.330 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.331+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~WTIYEB8YYQ5C.1 size=1048576 2024-09-12T00:19:25.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.332+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~WTIYEB8YYQ5C.2 size=332107 2024-09-12T00:19:25.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.332+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=WTIYEB8YYQ5C tag=DNNK65XW1WWY type=write size=3477835 2024-09-12T00:19:25.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.334+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~5F0TCFZE7QNL.0 size=611664 2024-09-12T00:19:25.336 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.336+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=5F0TCFZE7QNL tag=84T4X14QEE0U type=write size=1660240 2024-09-12T00:19:25.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.339+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~LH46GYV3UW92.0 size=623712 2024-09-12T00:19:25.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.339+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=LH46GYV3UW92 tag=YYJCW6WVK69X type=write size=1672288 2024-09-12T00:19:25.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.340+0000 7f682945b780 1 < completed write operation key=EYHGJ82COSE9 tag=QO1YBQTRK436 type=write size=117693 2024-09-12T00:19:25.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.341+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=R4KSCEPLSM2G type=del size=3793436 2024-09-12T00:19:25.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.343+0000 7f682945b780 1 < completed delete operation key=R7V03ML1H80V tag=PJIRWG7Z5J3W type=del 2024-09-12T00:19:25.343 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.344+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=PJWG2ZKE02Y4 type=del size=541627 2024-09-12T00:19:25.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.347+0000 7f682945b780 1 < suggested update operation key=3JFMN39G6TTF tag=AD8FICQPNK2M type=write size=812500 2024-09-12T00:19:25.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.348+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=I1QIFBOCBE7T type=del size=982884 2024-09-12T00:19:25.348 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.350+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~2VKUDGNPUZMX.0 size=1048576 2024-09-12T00:19:25.350 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.351+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~2VKUDGNPUZMX.1 size=1048576 2024-09-12T00:19:25.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.352+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~2VKUDGNPUZMX.2 size=805822 2024-09-12T00:19:25.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.356+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=2VKUDGNPUZMX tag=IG6P6NGSIBE5 type=write size=3951550 2024-09-12T00:19:25.355 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.357+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=69DXLVP3G7JK type=del size=4135729 2024-09-12T00:19:25.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.358+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~4A9YZMKERL1F.0 size=847069 2024-09-12T00:19:25.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.361+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=4A9YZMKERL1F tag=G6G0B83Y96QE type=write size=1895645 2024-09-12T00:19:25.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.364+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~RGWSPJYC431S.0 size=166185 2024-09-12T00:19:25.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.364+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=RGWSPJYC431S tag=LALI2LUXA0HI type=write size=1214761 2024-09-12T00:19:25.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.367+0000 7f682945b780 1 < suggested update operation key=6DUQKU3R1RL8 tag=31K81XGHK4XT type=del size=1724252 2024-09-12T00:19:25.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.369+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=NQLX2ZJ23G8R type=del size=1694934 2024-09-12T00:19:25.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.370+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=G5OW400JAYUD type=del 2024-09-12T00:19:25.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.372+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=HD1PZLOU15QO type=del size=1157220 2024-09-12T00:19:25.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.372+0000 7f682945b780 1 < canceled part key=_multipart_COUJXCOSVPDS.2~P6BSGSK2OGU3.0 size=67173 2024-09-12T00:19:25.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.375+0000 7f682945b780 1 < canceled multipart upload key=COUJXCOSVPDS upload=P6BSGSK2OGU3 tag=G8I61DUOSKPF type=write size=1115749 2024-09-12T00:19:25.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.377+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~GCOQES201P1T.0 size=1048576 2024-09-12T00:19:25.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.379+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~GCOQES201P1T.1 size=752186 2024-09-12T00:19:25.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.379+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=GCOQES201P1T tag=0UG5T26SGO26 type=write size=2849338 2024-09-12T00:19:25.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.380+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~R7P6RPGUHWSV.0 size=277935 2024-09-12T00:19:25.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.382+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=R7P6RPGUHWSV tag=H8PSFMNZ68SI type=write size=1326511 2024-09-12T00:19:25.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.384+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~UHHJJB6Y0UC3.0 size=505452 2024-09-12T00:19:25.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.384+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=UHHJJB6Y0UC3 tag=N54625CIG0ZI type=write size=1554028 2024-09-12T00:19:25.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.385+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~NH8YEL9UDNDO.0 size=1048576 2024-09-12T00:19:25.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.386+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~NH8YEL9UDNDO.1 size=711059 2024-09-12T00:19:25.387 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.389+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=NH8YEL9UDNDO tag=R8APSHFFC84H type=write size=2808211 2024-09-12T00:19:25.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.392+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~199JU7L12YKL.0 size=243541 2024-09-12T00:19:25.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.392+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=199JU7L12YKL tag=U5ZIU5D2UBRQ type=write size=1292117 2024-09-12T00:19:25.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.395+0000 7f682945b780 1 < completed write operation key=38JJBFDTIYSU tag=U4AZZIJVFTGX type=write size=387642 2024-09-12T00:19:25.394 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.396+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=3GFNJSQAS1LN type=del size=2404775 2024-09-12T00:19:25.396 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.397+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=FGB8VAH7TD8E type=del 2024-09-12T00:19:25.398 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.400+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=F8DXIMNAVJGG type=del size=1353040 2024-09-12T00:19:25.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.401+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~0PSYBYOC7FLE.0 size=1048576 2024-09-12T00:19:25.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.402+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~0PSYBYOC7FLE.1 size=697614 2024-09-12T00:19:25.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.405+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=0PSYBYOC7FLE tag=6NQXGHF83O9D type=write size=2794766 2024-09-12T00:19:25.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.406+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=QI0RCQ8K3MHI type=del size=269261 2024-09-12T00:19:25.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.407+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=5O24RFVQL7CE type=del 2024-09-12T00:19:25.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.408+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=GRU8NU24N2QV type=write size=749323 2024-09-12T00:19:25.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.410+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~WTIYEB8YYQ5C.0 size=1048576 2024-09-12T00:19:25.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.411+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~WTIYEB8YYQ5C.1 size=1048576 2024-09-12T00:19:25.411 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.412+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~WTIYEB8YYQ5C.2 size=332107 2024-09-12T00:19:25.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.415+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=WTIYEB8YYQ5C tag=DNNK65XW1WWY type=write size=3477835 2024-09-12T00:19:25.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.418+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~JM1NYWH6JSS6.0 size=1048576 2024-09-12T00:19:25.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.420+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~JM1NYWH6JSS6.1 size=1048576 2024-09-12T00:19:25.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.421+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~JM1NYWH6JSS6.2 size=950503 2024-09-12T00:19:25.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.421+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=JM1NYWH6JSS6 tag=8NEGY6VHXO9M type=write size=4096231 2024-09-12T00:19:25.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.421+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~LH46GYV3UW92.0 size=623712 2024-09-12T00:19:25.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.424+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=LH46GYV3UW92 tag=YYJCW6WVK69X type=write size=1672288 2024-09-12T00:19:25.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.425+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=QJU81PPVHJ1Q type=del size=3905571 2024-09-12T00:19:25.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.427+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=R4KSCEPLSM2G type=del 2024-09-12T00:19:25.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.429+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~UD9PRM9NF68L.0 size=246983 2024-09-12T00:19:25.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.429+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=UD9PRM9NF68L tag=BGOWRF7AN84H type=write size=1295559 2024-09-12T00:19:25.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.432+0000 7f682945b780 1 < suggested remove operation key=BFY578HP8GAW tag=PJWG2ZKE02Y4 type=del 2024-09-12T00:19:25.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.435+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~KJCRXSK0R116.0 size=1023877 2024-09-12T00:19:25.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.435+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=KJCRXSK0R116 tag=U6IYQKY9FKG0 type=write size=2072453 2024-09-12T00:19:25.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.436+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=I1QIFBOCBE7T type=del 2024-09-12T00:19:25.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.439+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~HEB27DZJVYBT.0 size=1048576 2024-09-12T00:19:25.438 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.440+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~HEB27DZJVYBT.1 size=45179 2024-09-12T00:19:25.439 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.440+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=HEB27DZJVYBT tag=7T13EB8B6U2P type=write size=2142331 2024-09-12T00:19:25.440 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.441+0000 7f682945b780 -1 < failed to complete operation key=6DUQKU3R1RL8 tag=69DXLVP3G7JK type=del size=4135729: (22) Invalid argument 2024-09-12T00:19:25.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.444+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~R4B4NVB7PFDL.0 size=434924 2024-09-12T00:19:25.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.444+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=R4B4NVB7PFDL tag=2D4HB279GMMR type=write size=1483500 2024-09-12T00:19:25.444 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.446+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~RGWSPJYC431S.0 size=166185 2024-09-12T00:19:25.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.448+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=RGWSPJYC431S tag=LALI2LUXA0HI type=write size=1214761 2024-09-12T00:19:25.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.450+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=PYFFABVGNKS8 type=del size=2547449 2024-09-12T00:19:25.450 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.451+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=NQLX2ZJ23G8R type=del 2024-09-12T00:19:25.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.452+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=NG6Z9LV6J4WA type=del size=1642317 2024-09-12T00:19:25.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.454+0000 7f682945b780 1 < canceled operation key=38JJBFDTIYSU tag=HD1PZLOU15QO type=del size=1157220 2024-09-12T00:19:25.454 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.456+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=RF7ZF8QBOZGA type=del size=1594499 2024-09-12T00:19:25.455 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.457+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~GCOQES201P1T.0 size=1048576 2024-09-12T00:19:25.456 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.458+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~GCOQES201P1T.1 size=752186 2024-09-12T00:19:25.458 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.460+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=GCOQES201P1T tag=0UG5T26SGO26 type=write size=2849338 2024-09-12T00:19:25.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.462+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~IE62KUZQUTML.0 size=1048576 2024-09-12T00:19:25.462 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.463+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~IE62KUZQUTML.1 size=1048576 2024-09-12T00:19:25.463 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.464+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~IE62KUZQUTML.2 size=585005 2024-09-12T00:19:25.464 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.464+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=IE62KUZQUTML tag=MJDGPBP5A3LQ type=write size=3730733 2024-09-12T00:19:25.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.466+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~UHHJJB6Y0UC3.0 size=505452 2024-09-12T00:19:25.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.468+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=UHHJJB6Y0UC3 tag=N54625CIG0ZI type=write size=1554028 2024-09-12T00:19:25.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.471+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~IH0FARJTKFEJ.0 size=1048576 2024-09-12T00:19:25.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.472+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~IH0FARJTKFEJ.1 size=98087 2024-09-12T00:19:25.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.472+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=IH0FARJTKFEJ tag=ALK6BAM50PZY type=write size=2195239 2024-09-12T00:19:25.472 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.473+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~199JU7L12YKL.0 size=243541 2024-09-12T00:19:25.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.475+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=199JU7L12YKL tag=U5ZIU5D2UBRQ type=write size=1292117 2024-09-12T00:19:25.476 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.479+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~9LN7P0RAI7MP.0 size=450738 2024-09-12T00:19:25.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.479+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=9LN7P0RAI7MP tag=CRLT2LE386LH type=write size=1499314 2024-09-12T00:19:25.479 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.481+0000 7f682945b780 1 < suggested update operation key=COUJXCOSVPDS tag=3GFNJSQAS1LN type=del size=2404775 2024-09-12T00:19:25.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.483+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=3VH8T3TJ4U0C type=del size=4106594 2024-09-12T00:19:25.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.484+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=F8DXIMNAVJGG type=del 2024-09-12T00:19:25.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.486+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~ZXIKY9IKUE1Z.0 size=1048576 2024-09-12T00:19:25.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.487+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~ZXIKY9IKUE1Z.1 size=387512 2024-09-12T00:19:25.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.487+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=ZXIKY9IKUE1Z tag=X0SRW0NHM0BB type=write size=2484664 2024-09-12T00:19:25.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.489+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=QI0RCQ8K3MHI type=del 2024-09-12T00:19:25.488 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.490+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=CS530MGZOUJ3 type=del size=1976008 2024-09-12T00:19:25.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.491+0000 7f682945b780 1 < completed write operation key=1RAFARG1JXFQ tag=GRU8NU24N2QV type=write size=749323 2024-09-12T00:19:25.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.494+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~XF928AWBHER1.0 size=268598 2024-09-12T00:19:25.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.494+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=XF928AWBHER1 tag=4UD9AR5U4UQU type=write size=1317174 2024-09-12T00:19:25.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.495+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~JM1NYWH6JSS6.0 size=1048576 2024-09-12T00:19:25.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.495+0000 7f682945b780 1 < canceled part key=_multipart_COUJXCOSVPDS.2~JM1NYWH6JSS6.1 size=1048576 2024-09-12T00:19:25.495 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.496+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~JM1NYWH6JSS6.2 size=950503 2024-09-12T00:19:25.497 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.499+0000 7f682945b780 1 < canceled multipart upload key=COUJXCOSVPDS upload=JM1NYWH6JSS6 tag=8NEGY6VHXO9M type=write size=4096231 2024-09-12T00:19:25.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.502+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~1HIID2R8CNCV.0 size=1048576 2024-09-12T00:19:25.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.503+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~1HIID2R8CNCV.1 size=1048576 2024-09-12T00:19:25.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.503+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~1HIID2R8CNCV.2 size=475320 2024-09-12T00:19:25.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.503+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=1HIID2R8CNCV tag=5GG53JVOYFYL type=write size=3621048 2024-09-12T00:19:25.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.506+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=QJU81PPVHJ1Q type=del 2024-09-12T00:19:25.507 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.508+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~HDWPA26GUZ35.0 size=1048576 2024-09-12T00:19:25.507 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.509+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~HDWPA26GUZ35.1 size=869637 2024-09-12T00:19:25.508 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.509+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=HDWPA26GUZ35 tag=UYWG17CEC2R0 type=write size=2966789 2024-09-12T00:19:25.508 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.509+0000 7f682945b780 1 < canceled part key=_multipart_COUJXCOSVPDS.2~UD9PRM9NF68L.0 size=246983 2024-09-12T00:19:25.510 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.511+0000 7f682945b780 1 < canceled multipart upload key=COUJXCOSVPDS upload=UD9PRM9NF68L tag=BGOWRF7AN84H type=write size=1295559 2024-09-12T00:19:25.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.513+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=YY3WZSE3QXQG type=del size=251556 2024-09-12T00:19:25.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.513+0000 7f682945b780 1 < canceled part key=_multipart_TGOBZH6DZK71.2~KJCRXSK0R116.0 size=1023877 2024-09-12T00:19:25.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.516+0000 7f682945b780 1 < canceled multipart upload key=TGOBZH6DZK71 upload=KJCRXSK0R116 tag=U6IYQKY9FKG0 type=write size=2072453 2024-09-12T00:19:25.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.517+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=NTO0C17VPWL0 type=del size=1312052 2024-09-12T00:19:25.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.518+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~HEB27DZJVYBT.0 size=1048576 2024-09-12T00:19:25.518 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.519+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~HEB27DZJVYBT.1 size=45179 2024-09-12T00:19:25.520 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.522+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=HEB27DZJVYBT tag=7T13EB8B6U2P type=write size=2142331 2024-09-12T00:19:25.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.523+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=R9XPN6R7JPAB type=del size=3339951 2024-09-12T00:19:25.524 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.526+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~R4B4NVB7PFDL.0 size=434924 2024-09-12T00:19:25.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.528+0000 7f682945b780 1 < completed multipart upload key=6DUQKU3R1RL8 upload=R4B4NVB7PFDL tag=2D4HB279GMMR type=write size=1483500 2024-09-12T00:19:25.529 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.531+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~FXKMWJQY6LEA.0 size=1048576 2024-09-12T00:19:25.530 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.532+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~FXKMWJQY6LEA.1 size=313108 2024-09-12T00:19:25.530 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.532+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=FXKMWJQY6LEA tag=STFMGWDG0S77 type=write size=2410260 2024-09-12T00:19:25.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.535+0000 7f682945b780 1 < suggested remove operation key=8D9UC8FJ16UK tag=PYFFABVGNKS8 type=del 2024-09-12T00:19:25.534 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.536+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=GZWH617U57QW type=del size=3420041 2024-09-12T00:19:25.536 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.537+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=NG6Z9LV6J4WA type=del 2024-09-12T00:19:25.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.541+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~BZA4SDR296UA.0 size=473396 2024-09-12T00:19:25.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.541+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=BZA4SDR296UA tag=PQEVYPE3VDRI type=write size=1521972 2024-09-12T00:19:25.540 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.541+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=RF7ZF8QBOZGA type=del 2024-09-12T00:19:25.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.543+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=DNJAGFT7U0P6 type=del size=1492928 2024-09-12T00:19:25.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.544+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~IE62KUZQUTML.0 size=1048576 2024-09-12T00:19:25.544 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.545+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~IE62KUZQUTML.1 size=1048576 2024-09-12T00:19:25.545 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.547+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~IE62KUZQUTML.2 size=585005 2024-09-12T00:19:25.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.550+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=IE62KUZQUTML tag=MJDGPBP5A3LQ type=write size=3730733 2024-09-12T00:19:25.549 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.550+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=4EEE35LA8FYE type=del size=1043121 2024-09-12T00:19:25.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.552+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~IH0FARJTKFEJ.0 size=1048576 2024-09-12T00:19:25.552 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.553+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~IH0FARJTKFEJ.1 size=98087 2024-09-12T00:19:25.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.556+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=IH0FARJTKFEJ tag=ALK6BAM50PZY type=write size=2195239 2024-09-12T00:19:25.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.557+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=MH3FLVXE170W type=del size=2399700 2024-09-12T00:19:25.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.557+0000 7f682945b780 1 < canceled part key=_multipart_Y65K9I6K41X5.2~9LN7P0RAI7MP.0 size=450738 2024-09-12T00:19:25.558 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.560+0000 7f682945b780 1 < canceled multipart upload key=Y65K9I6K41X5 upload=9LN7P0RAI7MP tag=CRLT2LE386LH type=write size=1499314 2024-09-12T00:19:25.561 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.562+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~AE1JKZKZSGT3.0 size=101704 2024-09-12T00:19:25.561 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.562+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=AE1JKZKZSGT3 tag=RUSCBZ450289 type=write size=1150280 2024-09-12T00:19:25.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.566+0000 7f682945b780 1 < suggested remove operation key=G0ONSUVW4M7R tag=3VH8T3TJ4U0C type=del 2024-09-12T00:19:25.565 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.567+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=5Y7TQB0CKA7W type=del size=3538870 2024-09-12T00:19:25.567 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.568+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~ZXIKY9IKUE1Z.0 size=1048576 2024-09-12T00:19:25.567 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.568+0000 7f682945b780 1 < canceled part key=_multipart_Z7408WO050VI.2~ZXIKY9IKUE1Z.1 size=387512 2024-09-12T00:19:25.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.570+0000 7f682945b780 1 < canceled multipart upload key=Z7408WO050VI upload=ZXIKY9IKUE1Z tag=X0SRW0NHM0BB type=write size=2484664 2024-09-12T00:19:25.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.572+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=5CRZO657JZLA type=del size=2353689 2024-09-12T00:19:25.572 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.574+0000 7f682945b780 1 < canceled operation key=Y65K9I6K41X5 tag=CS530MGZOUJ3 type=del size=1976008 2024-09-12T00:19:25.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.576+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~H90ALRWALDJ9.0 size=390577 2024-09-12T00:19:25.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.576+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=H90ALRWALDJ9 tag=HYENX9H652CN type=write size=1439153 2024-09-12T00:19:25.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.578+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~XF928AWBHER1.0 size=268598 2024-09-12T00:19:25.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.579+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=XF928AWBHER1 tag=4UD9AR5U4UQU type=write size=1317174 2024-09-12T00:19:25.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.581+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=31RFUSPLGFVR type=del size=109594 2024-09-12T00:19:25.581 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.582+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~1HIID2R8CNCV.0 size=1048576 2024-09-12T00:19:25.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.584+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~1HIID2R8CNCV.1 size=1048576 2024-09-12T00:19:25.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.585+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~1HIID2R8CNCV.2 size=475320 2024-09-12T00:19:25.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.587+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=1HIID2R8CNCV tag=5GG53JVOYFYL type=write size=3621048 2024-09-12T00:19:25.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.588+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=PZ2ONGQBWFI7 type=del size=1932522 2024-09-12T00:19:25.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.591+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~HDWPA26GUZ35.0 size=1048576 2024-09-12T00:19:25.590 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.591+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~HDWPA26GUZ35.1 size=869637 2024-09-12T00:19:25.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.594+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=HDWPA26GUZ35 tag=UYWG17CEC2R0 type=write size=2966789 2024-09-12T00:19:25.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.597+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~VDGFMJZ8YHFB.0 size=1048576 2024-09-12T00:19:25.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.597+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~VDGFMJZ8YHFB.1 size=830532 2024-09-12T00:19:25.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.597+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=VDGFMJZ8YHFB tag=9GI2646LHNN0 type=write size=2927684 2024-09-12T00:19:25.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.600+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=YY3WZSE3QXQG type=del 2024-09-12T00:19:25.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.601+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~PJYJVTR1WL68.0 size=1048576 2024-09-12T00:19:25.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.603+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~PJYJVTR1WL68.1 size=1048576 2024-09-12T00:19:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.604+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~PJYJVTR1WL68.2 size=460535 2024-09-12T00:19:25.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.604+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=PJYJVTR1WL68 tag=6CKRSF798DMC type=write size=3606263 2024-09-12T00:19:25.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.605+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=NTO0C17VPWL0 type=del 2024-09-12T00:19:25.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.607+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=GM39ZEGTGD8Z type=del size=2447496 2024-09-12T00:19:25.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.610+0000 7f682945b780 1 < suggested remove operation key=BMTPXZ1OA2TZ tag=R9XPN6R7JPAB type=del 2024-09-12T00:19:25.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.612+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~HL05E6ITR283.0 size=1048576 2024-09-12T00:19:25.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.614+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~HL05E6ITR283.1 size=43227 2024-09-12T00:19:25.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.614+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=HL05E6ITR283 tag=RASJSR3AXT9F type=write size=2140379 2024-09-12T00:19:25.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.615+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~FXKMWJQY6LEA.0 size=1048576 2024-09-12T00:19:25.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.616+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~FXKMWJQY6LEA.1 size=313108 2024-09-12T00:19:25.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.618+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=FXKMWJQY6LEA tag=STFMGWDG0S77 type=write size=2410260 2024-09-12T00:19:25.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.620+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=8GW98S2J03E0 type=del size=2240650 2024-09-12T00:19:25.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.621+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=GZWH617U57QW type=del 2024-09-12T00:19:25.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.624+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~AE9GM1V60Q2M.0 size=1048576 2024-09-12T00:19:25.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.625+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~AE9GM1V60Q2M.1 size=1048576 2024-09-12T00:19:25.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.627+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~AE9GM1V60Q2M.2 size=484663 2024-09-12T00:19:25.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.627+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=AE9GM1V60Q2M tag=17IFIICOIR9E type=write size=3630391 2024-09-12T00:19:25.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.627+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~BZA4SDR296UA.0 size=473396 2024-09-12T00:19:25.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.631+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=BZA4SDR296UA tag=PQEVYPE3VDRI type=write size=1521972 2024-09-12T00:19:25.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.631+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=IMTIFWCGWNDH type=del size=788641 2024-09-12T00:19:25.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.633+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=DNJAGFT7U0P6 type=del 2024-09-12T00:19:25.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.635+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~I0M936OF4616.0 size=175935 2024-09-12T00:19:25.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.635+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=I0M936OF4616 tag=VGF5321DTZRL type=write size=1224511 2024-09-12T00:19:25.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.638+0000 7f682945b780 1 < suggested update operation key=IUPAGGPATJB4 tag=4EEE35LA8FYE type=del size=1043121 2024-09-12T00:19:25.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.640+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=P29P5MBO2HXY type=del size=794095 2024-09-12T00:19:25.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.641+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=MH3FLVXE170W type=del 2024-09-12T00:19:25.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.643+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=K0BIRQGDH0EI type=del size=2456492 2024-09-12T00:19:25.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.644+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~AE1JKZKZSGT3.0 size=101704 2024-09-12T00:19:25.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.647+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=AE1JKZKZSGT3 tag=RUSCBZ450289 type=write size=1150280 2024-09-12T00:19:25.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.649+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=3V7NMMONA3M3 type=del size=3792582 2024-09-12T00:19:25.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.651+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=5Y7TQB0CKA7W type=del 2024-09-12T00:19:25.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.653+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~DFEQO7B9XIO6.0 size=1007942 2024-09-12T00:19:25.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.653+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=DFEQO7B9XIO6 tag=21MTZQE9QAYK type=write size=2056518 2024-09-12T00:19:25.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.654+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=5CRZO657JZLA type=del 2024-09-12T00:19:25.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.656+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=9P6II8FVFTA0 type=del size=2018281 2024-09-12T00:19:25.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.657+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~H90ALRWALDJ9.0 size=390577 2024-09-12T00:19:25.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.661+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=H90ALRWALDJ9 tag=HYENX9H652CN type=write size=1439153 2024-09-12T00:19:25.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.663+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=EUZ3Z0CU5EWJ type=del size=486768 2024-09-12T00:19:25.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.665+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=31RFUSPLGFVR type=del 2024-09-12T00:19:25.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.666+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=TRUR4CBWL8OS type=del size=144222 2024-09-12T00:19:25.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.668+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=PZ2ONGQBWFI7 type=del 2024-09-12T00:19:25.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.670+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~28URMC2GL8QR.0 size=20080 2024-09-12T00:19:25.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.670+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=28URMC2GL8QR tag=SCO4E98WGUHF type=write size=1068656 2024-09-12T00:19:25.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.672+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~VDGFMJZ8YHFB.0 size=1048576 2024-09-12T00:19:25.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.674+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~VDGFMJZ8YHFB.1 size=830532 2024-09-12T00:19:25.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.677+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=VDGFMJZ8YHFB tag=9GI2646LHNN0 type=write size=2927684 2024-09-12T00:19:25.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.678+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=YKGU8KT81KV6 type=del size=655594 2024-09-12T00:19:25.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.679+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~PJYJVTR1WL68.0 size=1048576 2024-09-12T00:19:25.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.681+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~PJYJVTR1WL68.1 size=1048576 2024-09-12T00:19:25.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.682+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~PJYJVTR1WL68.2 size=460535 2024-09-12T00:19:25.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.684+0000 7f682945b780 1 < completed multipart upload key=6DUQKU3R1RL8 upload=PJYJVTR1WL68 tag=6CKRSF798DMC type=write size=3606263 2024-09-12T00:19:25.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.685+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=DQK0ILY8FGVI type=del size=550417 2024-09-12T00:19:25.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.688+0000 7f682945b780 1 < suggested remove operation key=AZKLWMQ818SW tag=GM39ZEGTGD8Z type=del 2024-09-12T00:19:25.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.689+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=4DNDY6DFS9M4 type=del size=829188 2024-09-12T00:19:25.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.690+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~HL05E6ITR283.0 size=1048576 2024-09-12T00:19:25.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.691+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~HL05E6ITR283.1 size=43227 2024-09-12T00:19:25.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.694+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=HL05E6ITR283 tag=RASJSR3AXT9F type=write size=2140379 2024-09-12T00:19:25.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.695+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=SQD2HNRQXT72 type=del size=91927 2024-09-12T00:19:25.695 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.697+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=8GW98S2J03E0 type=del 2024-09-12T00:19:25.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.699+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~TFF2SU6867GC.0 size=934358 2024-09-12T00:19:25.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.699+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=TFF2SU6867GC tag=K9FNKXGX7ZYL type=write size=1982934 2024-09-12T00:19:25.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.701+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~AE9GM1V60Q2M.0 size=1048576 2024-09-12T00:19:25.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.702+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~AE9GM1V60Q2M.1 size=1048576 2024-09-12T00:19:25.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.703+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~AE9GM1V60Q2M.2 size=484663 2024-09-12T00:19:25.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.706+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=AE9GM1V60Q2M tag=17IFIICOIR9E type=write size=3630391 2024-09-12T00:19:25.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.707+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=YE86JB0C7QKT type=write size=186605 2024-09-12T00:19:25.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.710+0000 7f682945b780 1 < suggested remove operation key=BK212Z99RM7F tag=IMTIFWCGWNDH type=del 2024-09-12T00:19:25.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.711+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=E1JTSDJK1ODI type=del size=1696647 2024-09-12T00:19:25.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.712+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~I0M936OF4616.0 size=175935 2024-09-12T00:19:25.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.715+0000 7f682945b780 1 < completed multipart upload key=8D9UC8FJ16UK upload=I0M936OF4616 tag=VGF5321DTZRL type=write size=1224511 2024-09-12T00:19:25.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.716+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=RA04XTZOUHWL type=del size=3565753 2024-09-12T00:19:25.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.718+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=P29P5MBO2HXY type=del 2024-09-12T00:19:25.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.719+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=X3CH4RVLGTWI type=del size=2054857 2024-09-12T00:19:25.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.720+0000 7f682945b780 1 < completed delete operation key=COUJXCOSVPDS tag=K0BIRQGDH0EI type=del 2024-09-12T00:19:25.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.722+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=Y5M6CCFWIKQP type=del size=1105337 2024-09-12T00:19:25.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.723+0000 7f682945b780 -1 < failed to complete operation key=BK212Z99RM7F tag=3V7NMMONA3M3 type=del size=3792582: (22) Invalid argument 2024-09-12T00:19:25.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.724+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=ZEZ2O1V5W0H5 type=write size=170829 2024-09-12T00:19:25.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.726+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~DFEQO7B9XIO6.0 size=1007942 2024-09-12T00:19:25.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.728+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=DFEQO7B9XIO6 tag=21MTZQE9QAYK type=write size=2056518 2024-09-12T00:19:25.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.730+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=CK6IY7W44GET type=del size=1123395 2024-09-12T00:19:25.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.732+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=9P6II8FVFTA0 type=del 2024-09-12T00:19:25.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.734+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~V9R68BL2I31U.0 size=1048576 2024-09-12T00:19:25.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.736+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~V9R68BL2I31U.1 size=868436 2024-09-12T00:19:25.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.736+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=V9R68BL2I31U tag=90423I9H1WNO type=write size=2965588 2024-09-12T00:19:25.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.739+0000 7f682945b780 1 < suggested remove operation key=SGWTWN8RTKDD tag=EUZ3Z0CU5EWJ type=del 2024-09-12T00:19:25.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.740+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=ZE12HKTZQL3Z type=del size=2153285 2024-09-12T00:19:25.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.742+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=TRUR4CBWL8OS type=del 2024-09-12T00:19:25.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.745+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~XL1Y1S3O5JLM.0 size=1048576 2024-09-12T00:19:25.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.746+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~XL1Y1S3O5JLM.1 size=1048576 2024-09-12T00:19:25.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.747+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~XL1Y1S3O5JLM.2 size=166851 2024-09-12T00:19:25.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.747+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=XL1Y1S3O5JLM tag=ET9GWTXJBCBZ type=write size=3312579 2024-09-12T00:19:25.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.748+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~28URMC2GL8QR.0 size=20080 2024-09-12T00:19:25.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.751+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=28URMC2GL8QR tag=SCO4E98WGUHF type=write size=1068656 2024-09-12T00:19:25.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.752+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=WK4YCR1U6WID type=del size=1126905 2024-09-12T00:19:25.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.754+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=YKGU8KT81KV6 type=del 2024-09-12T00:19:25.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.756+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~08A63M0LJHFK.0 size=1048576 2024-09-12T00:19:25.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.757+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~08A63M0LJHFK.1 size=697468 2024-09-12T00:19:25.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.757+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=08A63M0LJHFK tag=6ZYCJADXVS13 type=write size=2794620 2024-09-12T00:19:25.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.759+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=DQK0ILY8FGVI type=del 2024-09-12T00:19:25.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.761+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~15Y78HOYL3I1.0 size=1048576 2024-09-12T00:19:25.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.762+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~15Y78HOYL3I1.1 size=1048576 2024-09-12T00:19:25.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.763+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~15Y78HOYL3I1.2 size=682029 2024-09-12T00:19:25.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.763+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=15Y78HOYL3I1 tag=U0B7N37V4TPT type=write size=3827757 2024-09-12T00:19:25.765 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.767+0000 7f682945b780 1 < suggested remove operation key=AZKLWMQ818SW tag=4DNDY6DFS9M4 type=del 2024-09-12T00:19:25.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.768+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=A396SIXUOT90 type=del size=4010651 2024-09-12T00:19:25.767 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.769+0000 7f682945b780 1 < completed delete operation key=COUJXCOSVPDS tag=SQD2HNRQXT72 type=del 2024-09-12T00:19:25.770 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.772+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~PO18OL0GIQZW.0 size=949785 2024-09-12T00:19:25.770 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.772+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=PO18OL0GIQZW tag=9MU8EEUDOSIP type=write size=1998361 2024-09-12T00:19:25.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.773+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~TFF2SU6867GC.0 size=934358 2024-09-12T00:19:25.774 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.776+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=TFF2SU6867GC tag=K9FNKXGX7ZYL type=write size=1982934 2024-09-12T00:19:25.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.779+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~DTN23IOW58WY.0 size=1048576 2024-09-12T00:19:25.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.780+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~DTN23IOW58WY.1 size=1048576 2024-09-12T00:19:25.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.781+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~DTN23IOW58WY.2 size=83973 2024-09-12T00:19:25.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.781+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=DTN23IOW58WY tag=A786ZHGO2URR type=write size=3229701 2024-09-12T00:19:25.781 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.782+0000 7f682945b780 1 < completed write operation key=922B2PPJFX2Z tag=YE86JB0C7QKT type=write size=186605 2024-09-12T00:19:25.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.785+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~GP08DJ4M9DAX.0 size=1048576 2024-09-12T00:19:25.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.786+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~GP08DJ4M9DAX.1 size=1048576 2024-09-12T00:19:25.785 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.787+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~GP08DJ4M9DAX.2 size=833617 2024-09-12T00:19:25.785 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.787+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=GP08DJ4M9DAX tag=XMSZZGVNAAHR type=write size=3979345 2024-09-12T00:19:25.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.788+0000 7f682945b780 1 < completed delete operation key=38JJBFDTIYSU tag=E1JTSDJK1ODI type=del 2024-09-12T00:19:25.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.791+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=KHBO0Q14OIL1 type=del size=2930359 2024-09-12T00:19:25.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.791+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=RA04XTZOUHWL type=del 2024-09-12T00:19:25.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.793+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=13C0JNGHQ3OT type=del size=1492311 2024-09-12T00:19:25.795 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.796+0000 7f682945b780 1 < suggested update operation key=CT2L8L3849IN tag=X3CH4RVLGTWI type=del size=2054857 2024-09-12T00:19:25.796 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.798+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=PAEN2HIQZ65T type=write size=84199 2024-09-12T00:19:25.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.799+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=Y5M6CCFWIKQP type=del 2024-09-12T00:19:25.800 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.802+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~34HBH24E48UI.0 size=1048576 2024-09-12T00:19:25.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.803+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~34HBH24E48UI.1 size=659834 2024-09-12T00:19:25.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.803+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=34HBH24E48UI tag=GYVFPUDN8578 type=write size=2756986 2024-09-12T00:19:25.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.804+0000 7f682945b780 1 < completed write operation key=JAVE3HR52R5C tag=ZEZ2O1V5W0H5 type=write size=170829 2024-09-12T00:19:25.805 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.805+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=E7922BYOTN1Z type=write size=908595 2024-09-12T00:19:25.805 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.807+0000 7f682945b780 -1 < failed to complete operation key=SGWTWN8RTKDD tag=CK6IY7W44GET type=del size=1123395: (22) Invalid argument 2024-09-12T00:19:25.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.808+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=TZI0LVOK8QF7 type=del size=1225025 2024-09-12T00:19:25.808 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.810+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~V9R68BL2I31U.0 size=1048576 2024-09-12T00:19:25.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.812+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~V9R68BL2I31U.1 size=868436 2024-09-12T00:19:25.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.814+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=V9R68BL2I31U tag=90423I9H1WNO type=write size=2965588 2024-09-12T00:19:25.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.815+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=TR20PFSZZ165 type=del size=2016366 2024-09-12T00:19:25.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.817+0000 7f682945b780 1 < canceled operation key=38JJBFDTIYSU tag=ZE12HKTZQL3Z type=del size=2153285 2024-09-12T00:19:25.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.818+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=6UEZ0GAEV8X5 type=del size=2303994 2024-09-12T00:19:25.819 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.820+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~XL1Y1S3O5JLM.0 size=1048576 2024-09-12T00:19:25.820 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.822+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~XL1Y1S3O5JLM.1 size=1048576 2024-09-12T00:19:25.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.824+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~XL1Y1S3O5JLM.2 size=166851 2024-09-12T00:19:25.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.826+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=XL1Y1S3O5JLM tag=ET9GWTXJBCBZ type=write size=3312579 2024-09-12T00:19:25.827 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.828+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~EU25PN2SZFVQ.0 size=1048576 2024-09-12T00:19:25.828 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.829+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~EU25PN2SZFVQ.1 size=1048576 2024-09-12T00:19:25.829 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.831+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~EU25PN2SZFVQ.2 size=291180 2024-09-12T00:19:25.829 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.831+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=EU25PN2SZFVQ tag=81FNF2ZRRTCP type=write size=3436908 2024-09-12T00:19:25.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.833+0000 7f682945b780 1 < suggested update operation key=3JFMN39G6TTF tag=WK4YCR1U6WID type=del size=1126905 2024-09-12T00:19:25.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.835+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=80YW48BS3O7O type=del size=3345131 2024-09-12T00:19:25.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.835+0000 7f682945b780 1 < canceled part key=_multipart_17S1X3WXCNAR.2~08A63M0LJHFK.0 size=1048576 2024-09-12T00:19:25.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.836+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~08A63M0LJHFK.1 size=697468 2024-09-12T00:19:25.837 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.838+0000 7f682945b780 1 < canceled multipart upload key=17S1X3WXCNAR upload=08A63M0LJHFK tag=6ZYCJADXVS13 type=write size=2794620 2024-09-12T00:19:25.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.839+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=KEWVONJLCYS6 type=write size=950151 2024-09-12T00:19:25.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.841+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~15Y78HOYL3I1.0 size=1048576 2024-09-12T00:19:25.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.842+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~15Y78HOYL3I1.1 size=1048576 2024-09-12T00:19:25.842 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.843+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~15Y78HOYL3I1.2 size=682029 2024-09-12T00:19:25.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.846+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=15Y78HOYL3I1 tag=U0B7N37V4TPT type=write size=3827757 2024-09-12T00:19:25.847 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.848+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~IEJQWY4KJM38.0 size=1048576 2024-09-12T00:19:25.848 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.849+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~IEJQWY4KJM38.1 size=316855 2024-09-12T00:19:25.848 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.849+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=IEJQWY4KJM38 tag=IOJ8BR5L75RN type=write size=2414007 2024-09-12T00:19:25.851 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.852+0000 7f682945b780 1 < suggested remove operation key=EYHGJ82COSE9 tag=A396SIXUOT90 type=del 2024-09-12T00:19:25.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.855+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=WE27ZTN1DWHI type=del size=2736015 2024-09-12T00:19:25.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.855+0000 7f682945b780 1 < canceled part key=_multipart_R2OAUUKLV7OK.2~PO18OL0GIQZW.0 size=949785 2024-09-12T00:19:25.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.857+0000 7f682945b780 1 < canceled multipart upload key=R2OAUUKLV7OK upload=PO18OL0GIQZW tag=9MU8EEUDOSIP type=write size=1998361 2024-09-12T00:19:25.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.858+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=TJTBFY0VUK11 type=del size=43788 2024-09-12T00:19:25.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.859+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~DTN23IOW58WY.0 size=1048576 2024-09-12T00:19:25.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.860+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~DTN23IOW58WY.1 size=1048576 2024-09-12T00:19:25.860 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.862+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~DTN23IOW58WY.2 size=83973 2024-09-12T00:19:25.862 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.865+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=DTN23IOW58WY tag=A786ZHGO2URR type=write size=3229701 2024-09-12T00:19:25.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.865+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=J38YMRECGXLL type=del size=2518634 2024-09-12T00:19:25.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.867+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~GP08DJ4M9DAX.0 size=1048576 2024-09-12T00:19:25.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.869+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~GP08DJ4M9DAX.1 size=1048576 2024-09-12T00:19:25.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.870+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~GP08DJ4M9DAX.2 size=833617 2024-09-12T00:19:25.870 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.871+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=GP08DJ4M9DAX tag=XMSZZGVNAAHR type=write size=3979345 2024-09-12T00:19:25.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.875+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~SKZB08OYYH9Y.0 size=846517 2024-09-12T00:19:25.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.875+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=SKZB08OYYH9Y tag=HQ3R8TSSJKQX type=write size=1895093 2024-09-12T00:19:25.874 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.875+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=KHBO0Q14OIL1 type=del 2024-09-12T00:19:25.876 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.878+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~6Q1V9C1JEXS9.0 size=1048576 2024-09-12T00:19:25.877 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.879+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~6Q1V9C1JEXS9.1 size=704770 2024-09-12T00:19:25.877 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.879+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=6Q1V9C1JEXS9 tag=9FHC1KWS2677 type=write size=2801922 2024-09-12T00:19:25.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.880+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=13C0JNGHQ3OT type=del 2024-09-12T00:19:25.881 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.883+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~WCOPF9M053CJ.0 size=1048576 2024-09-12T00:19:25.882 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.884+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~WCOPF9M053CJ.1 size=890114 2024-09-12T00:19:25.882 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.884+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=WCOPF9M053CJ tag=VKHFJ08I1242 type=write size=2987266 2024-09-12T00:19:25.884 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.885+0000 7f682945b780 1 < completed write operation key=BFY578HP8GAW tag=PAEN2HIQZ65T type=write size=84199 2024-09-12T00:19:25.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.886+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=ATFWX46C5Y2Q type=del size=860547 2024-09-12T00:19:25.886 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.888+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~34HBH24E48UI.0 size=1048576 2024-09-12T00:19:25.887 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.889+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~34HBH24E48UI.1 size=659834 2024-09-12T00:19:25.890 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.891+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=34HBH24E48UI tag=GYVFPUDN8578 type=write size=2756986 2024-09-12T00:19:25.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.894+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~2GDV6JLZQ1MK.0 size=772671 2024-09-12T00:19:25.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.894+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=2GDV6JLZQ1MK tag=XX8ITXRBXNIH type=write size=1821247 2024-09-12T00:19:25.893 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.895+0000 7f682945b780 1 < completed write operation key=IYYTX8TCLF30 tag=E7922BYOTN1Z type=write size=908595 2024-09-12T00:19:25.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.896+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=FXJQOT384UUR type=write size=87523 2024-09-12T00:19:25.896 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.898+0000 7f682945b780 1 < canceled operation key=IYYTX8TCLF30 tag=TZI0LVOK8QF7 type=del size=1225025 2024-09-12T00:19:25.899 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.900+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~J2PXFHEOLLS1.0 size=1048576 2024-09-12T00:19:25.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.902+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~J2PXFHEOLLS1.1 size=1048576 2024-09-12T00:19:25.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.903+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~J2PXFHEOLLS1.2 size=943593 2024-09-12T00:19:25.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.903+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=J2PXFHEOLLS1 tag=LUYTDDXJS0C1 type=write size=4089321 2024-09-12T00:19:25.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.904+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=TR20PFSZZ165 type=del 2024-09-12T00:19:25.905 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.906+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~64MFSEYIHISQ.0 size=143152 2024-09-12T00:19:25.905 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.906+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=64MFSEYIHISQ tag=TYP5RVYF6D86 type=write size=1191728 2024-09-12T00:19:25.906 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.908+0000 7f682945b780 1 < canceled operation key=COUJXCOSVPDS tag=6UEZ0GAEV8X5 type=del size=2303994 2024-09-12T00:19:25.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.909+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=KK96CSI2ZRWA type=del size=466540 2024-09-12T00:19:25.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.911+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~EU25PN2SZFVQ.0 size=1048576 2024-09-12T00:19:25.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.912+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~EU25PN2SZFVQ.1 size=1048576 2024-09-12T00:19:25.911 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.913+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~EU25PN2SZFVQ.2 size=291180 2024-09-12T00:19:25.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.915+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=EU25PN2SZFVQ tag=81FNF2ZRRTCP type=write size=3436908 2024-09-12T00:19:25.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.917+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=AJIRAIRAQTBY type=write size=40349 2024-09-12T00:19:25.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.918+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=80YW48BS3O7O type=del 2024-09-12T00:19:25.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.921+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~IKJOWBIHYTDZ.0 size=1048576 2024-09-12T00:19:25.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.923+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~IKJOWBIHYTDZ.1 size=1048576 2024-09-12T00:19:25.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.924+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~IKJOWBIHYTDZ.2 size=39492 2024-09-12T00:19:25.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.924+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=IKJOWBIHYTDZ tag=ZALKYA69WGJ3 type=write size=3185220 2024-09-12T00:19:25.925 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.927+0000 7f682945b780 1 < completed write operation key=Y65K9I6K41X5 tag=KEWVONJLCYS6 type=write size=950151 2024-09-12T00:19:25.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.929+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~8ZHQ45XTRRXL.0 size=234112 2024-09-12T00:19:25.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.929+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=8ZHQ45XTRRXL tag=CBG3KY99CKYM type=write size=1282688 2024-09-12T00:19:25.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.931+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~IEJQWY4KJM38.0 size=1048576 2024-09-12T00:19:25.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.932+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~IEJQWY4KJM38.1 size=316855 2024-09-12T00:19:25.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.934+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=IEJQWY4KJM38 tag=IOJ8BR5L75RN type=write size=2414007 2024-09-12T00:19:25.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.935+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=W0BJ9XQIE4VU type=del size=1190149 2024-09-12T00:19:25.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.937+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=WE27ZTN1DWHI type=del 2024-09-12T00:19:25.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.939+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=0IDA4E6ZETSF type=del size=2002189 2024-09-12T00:19:25.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.940+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=TJTBFY0VUK11 type=del 2024-09-12T00:19:25.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.943+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~44M3ZOVXOV4E.0 size=1048576 2024-09-12T00:19:25.942 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.944+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~44M3ZOVXOV4E.1 size=1048576 2024-09-12T00:19:25.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.945+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~44M3ZOVXOV4E.2 size=953874 2024-09-12T00:19:25.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.945+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=44M3ZOVXOV4E tag=7IHI5X3C96PF type=write size=4099602 2024-09-12T00:19:25.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.946+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=J38YMRECGXLL type=del 2024-09-12T00:19:25.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.948+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=E3VUPFX5I6TR type=del size=3979694 2024-09-12T00:19:25.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.949+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~SKZB08OYYH9Y.0 size=846517 2024-09-12T00:19:25.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.952+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=SKZB08OYYH9Y tag=HQ3R8TSSJKQX type=write size=1895093 2024-09-12T00:19:25.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.954+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=GNGLTU9Z120W type=del size=284211 2024-09-12T00:19:25.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.955+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~6Q1V9C1JEXS9.0 size=1048576 2024-09-12T00:19:25.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.956+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~6Q1V9C1JEXS9.1 size=704770 2024-09-12T00:19:25.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.959+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=6Q1V9C1JEXS9 tag=9FHC1KWS2677 type=write size=2801922 2024-09-12T00:19:25.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.962+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~Z44H2WMTW2I2.0 size=1048576 2024-09-12T00:19:25.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.963+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~Z44H2WMTW2I2.1 size=1048576 2024-09-12T00:19:25.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.964+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~Z44H2WMTW2I2.2 size=175418 2024-09-12T00:19:25.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.964+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=Z44H2WMTW2I2 tag=VSX8K1HS98HU type=write size=3321146 2024-09-12T00:19:25.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.965+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~WCOPF9M053CJ.0 size=1048576 2024-09-12T00:19:25.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.966+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~WCOPF9M053CJ.1 size=890114 2024-09-12T00:19:25.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.969+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=WCOPF9M053CJ tag=VKHFJ08I1242 type=write size=2987266 2024-09-12T00:19:25.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.970+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=UIDCW3EQHAX8 type=del size=3629151 2024-09-12T00:19:25.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.971+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=ATFWX46C5Y2Q type=del 2024-09-12T00:19:25.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.973+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=NXXB32YIK4TR type=del size=2487567 2024-09-12T00:19:25.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.974+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~2GDV6JLZQ1MK.0 size=772671 2024-09-12T00:19:25.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.976+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=2GDV6JLZQ1MK tag=XX8ITXRBXNIH type=write size=1821247 2024-09-12T00:19:25.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.979+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~AM17I8D6O8DL.0 size=1048576 2024-09-12T00:19:25.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.980+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~AM17I8D6O8DL.1 size=914161 2024-09-12T00:19:25.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.980+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=AM17I8D6O8DL tag=SDN1HLIG6PWS type=write size=3011313 2024-09-12T00:19:25.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.981+0000 7f682945b780 1 < canceled operation key=G0ONSUVW4M7R tag=FXJQOT384UUR type=write size=87523 2024-09-12T00:19:25.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.984+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~21DEY6XQP7VS.0 size=1048576 2024-09-12T00:19:25.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.985+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~21DEY6XQP7VS.1 size=636003 2024-09-12T00:19:25.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.985+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=21DEY6XQP7VS tag=3I187XBM64EE type=write size=2733155 2024-09-12T00:19:25.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.986+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~J2PXFHEOLLS1.0 size=1048576 2024-09-12T00:19:25.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.987+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~J2PXFHEOLLS1.1 size=1048576 2024-09-12T00:19:25.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.987+0000 7f682945b780 1 < canceled part key=_multipart_R2OAUUKLV7OK.2~J2PXFHEOLLS1.2 size=943593 2024-09-12T00:19:25.988 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.990+0000 7f682945b780 1 < canceled multipart upload key=R2OAUUKLV7OK upload=J2PXFHEOLLS1 tag=LUYTDDXJS0C1 type=write size=4089321 2024-09-12T00:19:25.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.991+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=T85YYP3FCKCH type=del size=2018939 2024-09-12T00:19:25.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.993+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~64MFSEYIHISQ.0 size=143152 2024-09-12T00:19:25.994 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.995+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=64MFSEYIHISQ tag=TYP5RVYF6D86 type=write size=1191728 2024-09-12T00:19:25.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.998+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~BQ2I7ACBIT8T.0 size=1048576 2024-09-12T00:19:25.997 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.999+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~BQ2I7ACBIT8T.1 size=480570 2024-09-12T00:19:25.997 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:25.999+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=BQ2I7ACBIT8T tag=6JY0EESZAHW9 type=write size=2577722 2024-09-12T00:19:25.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.000+0000 7f682945b780 1 < canceled operation key=D06ZUP2ZXX42 tag=KK96CSI2ZRWA type=del size=466540 2024-09-12T00:19:26.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.001+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=1HSZN1RLL3Y8 type=del size=2641103 2024-09-12T00:19:26.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.003+0000 7f682945b780 1 < completed write operation key=TYNSP8BHYO65 tag=AJIRAIRAQTBY type=write size=40349 2024-09-12T00:19:26.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.005+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~2BPVK0171NM6.0 size=704943 2024-09-12T00:19:26.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.005+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=2BPVK0171NM6 tag=R9J0RF7PVT9P type=write size=1753519 2024-09-12T00:19:26.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.007+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~IKJOWBIHYTDZ.0 size=1048576 2024-09-12T00:19:26.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.008+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~IKJOWBIHYTDZ.1 size=1048576 2024-09-12T00:19:26.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.010+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~IKJOWBIHYTDZ.2 size=39492 2024-09-12T00:19:26.010 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.011+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=IKJOWBIHYTDZ tag=ZALKYA69WGJ3 type=write size=3185220 2024-09-12T00:19:26.012 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.014+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~OT76NEKJW564.0 size=1048576 2024-09-12T00:19:26.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.015+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~OT76NEKJW564.1 size=1048576 2024-09-12T00:19:26.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.016+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~OT76NEKJW564.2 size=143789 2024-09-12T00:19:26.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.016+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=OT76NEKJW564 tag=HUL4Q9ON10RR type=write size=3289517 2024-09-12T00:19:26.016 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.018+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~8ZHQ45XTRRXL.0 size=234112 2024-09-12T00:19:26.018 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.020+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=8ZHQ45XTRRXL tag=CBG3KY99CKYM type=write size=1282688 2024-09-12T00:19:26.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.021+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=FM4SEFOW43BG type=del size=4036790 2024-09-12T00:19:26.022 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.025+0000 7f682945b780 1 < suggested remove operation key=922B2PPJFX2Z tag=W0BJ9XQIE4VU type=del 2024-09-12T00:19:26.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.026+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=8AIAITU55F27 type=del size=1716024 2024-09-12T00:19:26.026 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.027+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=0IDA4E6ZETSF type=del 2024-09-12T00:19:26.027 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.029+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=UHS6IE0QBE62 type=del size=3772862 2024-09-12T00:19:26.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.030+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~44M3ZOVXOV4E.0 size=1048576 2024-09-12T00:19:26.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.031+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~44M3ZOVXOV4E.1 size=1048576 2024-09-12T00:19:26.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.033+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~44M3ZOVXOV4E.2 size=953874 2024-09-12T00:19:26.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.035+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=44M3ZOVXOV4E tag=7IHI5X3C96PF type=write size=4099602 2024-09-12T00:19:26.035 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.037+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=EPZ50KMVALG7 type=del size=1324526 2024-09-12T00:19:26.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.040+0000 7f682945b780 1 < suggested update operation key=TYNSP8BHYO65 tag=E3VUPFX5I6TR type=del size=3979694 2024-09-12T00:19:26.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.041+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=9AKS7U3Q23LN type=del size=478064 2024-09-12T00:19:26.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.043+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=GNGLTU9Z120W type=del 2024-09-12T00:19:26.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.045+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=M71ZUCNQWK2G type=del size=2116774 2024-09-12T00:19:26.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.047+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~Z44H2WMTW2I2.0 size=1048576 2024-09-12T00:19:26.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.047+0000 7f682945b780 1 < canceled part key=_multipart_3JFMN39G6TTF.2~Z44H2WMTW2I2.1 size=1048576 2024-09-12T00:19:26.046 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.048+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~Z44H2WMTW2I2.2 size=175418 2024-09-12T00:19:26.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.051+0000 7f682945b780 1 < canceled multipart upload key=3JFMN39G6TTF upload=Z44H2WMTW2I2 tag=VSX8K1HS98HU type=write size=3321146 2024-09-12T00:19:26.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.054+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~XILAF5HXO5OR.0 size=623588 2024-09-12T00:19:26.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.054+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=XILAF5HXO5OR tag=P5BYGSU0AWLJ type=write size=1672164 2024-09-12T00:19:26.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.055+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=UIDCW3EQHAX8 type=del 2024-09-12T00:19:26.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.057+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=0FVUEDT3S73N type=del size=1561865 2024-09-12T00:19:26.057 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.058+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=NXXB32YIK4TR type=del 2024-09-12T00:19:26.060 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.062+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~3PGONQSX13D0.0 size=1048576 2024-09-12T00:19:26.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.064+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~3PGONQSX13D0.1 size=346845 2024-09-12T00:19:26.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.064+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=3PGONQSX13D0 tag=RE1Y5HO2W7PE type=write size=2443997 2024-09-12T00:19:26.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.066+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~AM17I8D6O8DL.0 size=1048576 2024-09-12T00:19:26.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.066+0000 7f682945b780 1 < canceled part key=_multipart_BI3KCKV4CRWR.2~AM17I8D6O8DL.1 size=914161 2024-09-12T00:19:26.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.068+0000 7f682945b780 1 < canceled multipart upload key=BI3KCKV4CRWR upload=AM17I8D6O8DL tag=SDN1HLIG6PWS type=write size=3011313 2024-09-12T00:19:26.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.069+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=OZCWFRILSM7O type=write size=106549 2024-09-12T00:19:26.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.071+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~21DEY6XQP7VS.0 size=1048576 2024-09-12T00:19:26.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.072+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~21DEY6XQP7VS.1 size=636003 2024-09-12T00:19:26.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.074+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=21DEY6XQP7VS tag=3I187XBM64EE type=write size=2733155 2024-09-12T00:19:26.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.075+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=G8D4RWLFVZQA type=write size=921747 2024-09-12T00:19:26.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.077+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=T85YYP3FCKCH type=del 2024-09-12T00:19:26.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.078+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=O9CC1U2YTW1V type=del size=2871274 2024-09-12T00:19:26.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.079+0000 7f682945b780 1 < canceled part key=_multipart_IUPAGGPATJB4.2~BQ2I7ACBIT8T.0 size=1048576 2024-09-12T00:19:26.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.080+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~BQ2I7ACBIT8T.1 size=480570 2024-09-12T00:19:26.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.082+0000 7f682945b780 1 < canceled multipart upload key=IUPAGGPATJB4 upload=BQ2I7ACBIT8T tag=6JY0EESZAHW9 type=write size=2577722 2024-09-12T00:19:26.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.083+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=UXM3CEAJSAME type=del size=2176250 2024-09-12T00:19:26.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.085+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=1HSZN1RLL3Y8 type=del 2024-09-12T00:19:26.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.086+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=R33O3TK508WQ type=write size=844178 2024-09-12T00:19:26.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.086+0000 7f682945b780 1 < canceled part key=_multipart_JAVE3HR52R5C.2~2BPVK0171NM6.0 size=704943 2024-09-12T00:19:26.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.088+0000 7f682945b780 1 < canceled multipart upload key=JAVE3HR52R5C upload=2BPVK0171NM6 tag=R9J0RF7PVT9P type=write size=1753519 2024-09-12T00:19:26.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.091+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~M2YY76KHXLJM.0 size=636234 2024-09-12T00:19:26.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.091+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=M2YY76KHXLJM tag=Z85NOKMRM3JQ type=write size=1684810 2024-09-12T00:19:26.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.091+0000 7f682945b780 1 < canceled part key=_multipart_EYHGJ82COSE9.2~OT76NEKJW564.0 size=1048576 2024-09-12T00:19:26.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.092+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~OT76NEKJW564.1 size=1048576 2024-09-12T00:19:26.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.094+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~OT76NEKJW564.2 size=143789 2024-09-12T00:19:26.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.096+0000 7f682945b780 1 < canceled multipart upload key=EYHGJ82COSE9 upload=OT76NEKJW564 tag=HUL4Q9ON10RR type=write size=3289517 2024-09-12T00:19:26.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.098+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~X9CAMR90I3YZ.0 size=1048576 2024-09-12T00:19:26.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.099+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~X9CAMR90I3YZ.1 size=1048576 2024-09-12T00:19:26.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.100+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~X9CAMR90I3YZ.2 size=659150 2024-09-12T00:19:26.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.100+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=X9CAMR90I3YZ tag=1Z83GRS6YYSY type=write size=3804878 2024-09-12T00:19:26.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.102+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=FM4SEFOW43BG type=del 2024-09-12T00:19:26.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.103+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=STAFKKJ232JE type=write size=689729 2024-09-12T00:19:26.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.105+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=8AIAITU55F27 type=del 2024-09-12T00:19:26.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.107+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~TSRKGDYT2QOG.0 size=1048576 2024-09-12T00:19:26.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.108+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~TSRKGDYT2QOG.1 size=1048576 2024-09-12T00:19:26.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.109+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~TSRKGDYT2QOG.2 size=396281 2024-09-12T00:19:26.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.109+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=TSRKGDYT2QOG tag=D6QXHCLV97UP type=write size=3542009 2024-09-12T00:19:26.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.111+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=UHS6IE0QBE62 type=del 2024-09-12T00:19:26.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.112+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=LMQ47OEHRDNV type=del size=292147 2024-09-12T00:19:26.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.113+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=EPZ50KMVALG7 type=del 2024-09-12T00:19:26.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.116+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~TFY7INEP4ZUM.0 size=1048576 2024-09-12T00:19:26.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.117+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~TFY7INEP4ZUM.1 size=510114 2024-09-12T00:19:26.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.117+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=TFY7INEP4ZUM tag=R86H7X0C2UKB type=write size=2607266 2024-09-12T00:19:26.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.322+0000 7f682945b780 1 < suggested update operation key=Z7408WO050VI tag=9AKS7U3Q23LN type=del size=478064 2024-09-12T00:19:26.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.323+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=4GKIAW7RDX1I type=del size=99663 2024-09-12T00:19:26.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.324+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=M71ZUCNQWK2G type=del 2024-09-12T00:19:26.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.326+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=RSO31JUHFQKN type=del size=2080907 2024-09-12T00:19:26.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.327+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~XILAF5HXO5OR.0 size=623588 2024-09-12T00:19:26.328 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.329+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=XILAF5HXO5OR tag=P5BYGSU0AWLJ type=write size=1672164 2024-09-12T00:19:26.330 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.332+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~LNVQWKSB7UHL.0 size=428721 2024-09-12T00:19:26.330 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.332+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=LNVQWKSB7UHL tag=YYUYDFMKDWUU type=write size=1477297 2024-09-12T00:19:26.333 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.335+0000 7f682945b780 1 < suggested update operation key=JAVE3HR52R5C tag=0FVUEDT3S73N type=del size=1561865 2024-09-12T00:19:26.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.337+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~NOTAXX0468TA.0 size=266643 2024-09-12T00:19:26.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.337+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=NOTAXX0468TA tag=5QVCILAA9UKJ type=write size=1315219 2024-09-12T00:19:26.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.338+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~3PGONQSX13D0.0 size=1048576 2024-09-12T00:19:26.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.339+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~3PGONQSX13D0.1 size=346845 2024-09-12T00:19:26.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.341+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=3PGONQSX13D0 tag=RE1Y5HO2W7PE type=write size=2443997 2024-09-12T00:19:26.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.343+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=B5R4J5LRX0JD type=del size=512093 2024-09-12T00:19:26.343 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.345+0000 7f682945b780 1 < canceled operation key=P56VIP3WIOJL tag=OZCWFRILSM7O type=write size=106549 2024-09-12T00:19:26.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.346+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=5XEYFDYUBVO0 type=write size=984273 2024-09-12T00:19:26.346 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.348+0000 7f682945b780 1 < completed write operation key=AZKLWMQ818SW tag=G8D4RWLFVZQA type=write size=921747 2024-09-12T00:19:26.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.351+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~XUQ300NNQYS5.0 size=1048576 2024-09-12T00:19:26.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.352+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~XUQ300NNQYS5.1 size=1048576 2024-09-12T00:19:26.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.354+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~XUQ300NNQYS5.2 size=436922 2024-09-12T00:19:26.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.354+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=XUQ300NNQYS5 tag=KMRYQJW3Q4P9 type=write size=3582650 2024-09-12T00:19:26.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.355+0000 7f682945b780 1 < canceled operation key=IYYTX8TCLF30 tag=O9CC1U2YTW1V type=del size=2871274 2024-09-12T00:19:26.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.357+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=OG3V20U9GNXM type=del size=3286968 2024-09-12T00:19:26.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.359+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=UXM3CEAJSAME type=del 2024-09-12T00:19:26.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.362+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~HTTR7LE0YLN6.0 size=1048576 2024-09-12T00:19:26.361 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.363+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~HTTR7LE0YLN6.1 size=1048576 2024-09-12T00:19:26.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.364+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~HTTR7LE0YLN6.2 size=450556 2024-09-12T00:19:26.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.364+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=HTTR7LE0YLN6 tag=S9O59UHHKNW7 type=write size=3596284 2024-09-12T00:19:26.364 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.365+0000 7f682945b780 1 < completed write operation key=17S1X3WXCNAR tag=R33O3TK508WQ type=write size=844178 2024-09-12T00:19:26.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.368+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=SWHII8QMBLOW type=del size=1780980 2024-09-12T00:19:26.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.369+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~M2YY76KHXLJM.0 size=636234 2024-09-12T00:19:26.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.373+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=M2YY76KHXLJM tag=Z85NOKMRM3JQ type=write size=1684810 2024-09-12T00:19:26.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.374+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=NPVHEXQ01XWG type=del size=2632684 2024-09-12T00:19:26.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.376+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~X9CAMR90I3YZ.0 size=1048576 2024-09-12T00:19:26.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.377+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~X9CAMR90I3YZ.1 size=1048576 2024-09-12T00:19:26.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.379+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~X9CAMR90I3YZ.2 size=659150 2024-09-12T00:19:26.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.382+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=X9CAMR90I3YZ tag=1Z83GRS6YYSY type=write size=3804878 2024-09-12T00:19:26.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.383+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=LCX9LF4EEW0K type=write size=182766 2024-09-12T00:19:26.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.385+0000 7f682945b780 1 < completed write operation key=P56VIP3WIOJL tag=STAFKKJ232JE type=write size=689729 2024-09-12T00:19:26.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.386+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=Q5Z6P1H7XK5U type=del size=2511943 2024-09-12T00:19:26.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.388+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~TSRKGDYT2QOG.0 size=1048576 2024-09-12T00:19:26.387 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.389+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~TSRKGDYT2QOG.1 size=1048576 2024-09-12T00:19:26.388 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.390+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~TSRKGDYT2QOG.2 size=396281 2024-09-12T00:19:26.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.393+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=TSRKGDYT2QOG tag=D6QXHCLV97UP type=write size=3542009 2024-09-12T00:19:26.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.395+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=7BUF805DQMVF type=del size=3936678 2024-09-12T00:19:26.395 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.397+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=LMQ47OEHRDNV type=del 2024-09-12T00:19:26.396 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.398+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=OEEKL9NBY706 type=del size=1794679 2024-09-12T00:19:26.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.400+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~TFY7INEP4ZUM.0 size=1048576 2024-09-12T00:19:26.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.402+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~TFY7INEP4ZUM.1 size=510114 2024-09-12T00:19:26.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.404+0000 7f682945b780 1 < completed multipart upload key=CT2L8L3849IN upload=TFY7INEP4ZUM tag=R86H7X0C2UKB type=write size=2607266 2024-09-12T00:19:26.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.405+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=2I6RLGNDE09Y type=del size=851593 2024-09-12T00:19:26.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.407+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=4GKIAW7RDX1I type=del 2024-09-12T00:19:26.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.409+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~09O0TQ0A20JR.0 size=1048576 2024-09-12T00:19:26.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.410+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~09O0TQ0A20JR.1 size=1048576 2024-09-12T00:19:26.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.412+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~09O0TQ0A20JR.2 size=328888 2024-09-12T00:19:26.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.412+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=09O0TQ0A20JR tag=H61XF1R9ABHF type=write size=3474616 2024-09-12T00:19:26.411 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.413+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=RSO31JUHFQKN type=del 2024-09-12T00:19:26.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.415+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=B2QD1F4RT78L type=del size=854047 2024-09-12T00:19:26.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.416+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~LNVQWKSB7UHL.0 size=428721 2024-09-12T00:19:26.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.419+0000 7f682945b780 1 < completed multipart upload key=6DUQKU3R1RL8 upload=LNVQWKSB7UHL tag=YYUYDFMKDWUU type=write size=1477297 2024-09-12T00:19:26.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.421+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=MNU5CBT54AFS type=write size=485408 2024-09-12T00:19:26.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.422+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~NOTAXX0468TA.0 size=266643 2024-09-12T00:19:26.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.424+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=NOTAXX0468TA tag=5QVCILAA9UKJ type=write size=1315219 2024-09-12T00:19:26.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.427+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~29OWGNRCAZC6.0 size=1048576 2024-09-12T00:19:26.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.428+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~29OWGNRCAZC6.1 size=951530 2024-09-12T00:19:26.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.428+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=29OWGNRCAZC6 tag=7P0XIFF59DMF type=write size=3048682 2024-09-12T00:19:26.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.429+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=B5R4J5LRX0JD type=del 2024-09-12T00:19:26.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.432+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~3N4F6LAF5DV0.0 size=1048576 2024-09-12T00:19:26.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.433+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~3N4F6LAF5DV0.1 size=955694 2024-09-12T00:19:26.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.433+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=3N4F6LAF5DV0 tag=QWVCPA8EMBFY type=write size=3052846 2024-09-12T00:19:26.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.436+0000 7f682945b780 1 < suggested update operation key=G0ONSUVW4M7R tag=5XEYFDYUBVO0 type=write size=984273 2024-09-12T00:19:26.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.438+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~FGN77TETEPYN.0 size=449303 2024-09-12T00:19:26.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.438+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=FGN77TETEPYN tag=MXKBA8J8V5H7 type=write size=1497879 2024-09-12T00:19:26.438 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.439+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~XUQ300NNQYS5.0 size=1048576 2024-09-12T00:19:26.439 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.441+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~XUQ300NNQYS5.1 size=1048576 2024-09-12T00:19:26.440 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.442+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~XUQ300NNQYS5.2 size=436922 2024-09-12T00:19:26.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.444+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=XUQ300NNQYS5 tag=KMRYQJW3Q4P9 type=write size=3582650 2024-09-12T00:19:26.445 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.447+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~ZEPQQPTWRGJA.0 size=934204 2024-09-12T00:19:26.445 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.447+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=ZEPQQPTWRGJA tag=FA6LWGF29MAX type=write size=1982780 2024-09-12T00:19:26.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.448+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=OG3V20U9GNXM type=del 2024-09-12T00:19:26.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.451+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~TQPQJAEQDWRS.0 size=1048576 2024-09-12T00:19:26.450 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.452+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~TQPQJAEQDWRS.1 size=1048576 2024-09-12T00:19:26.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.453+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~TQPQJAEQDWRS.2 size=758740 2024-09-12T00:19:26.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.453+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=TQPQJAEQDWRS tag=PF8BGRADORFO type=write size=3904468 2024-09-12T00:19:26.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.453+0000 7f682945b780 1 < canceled part key=_multipart_EYHGJ82COSE9.2~HTTR7LE0YLN6.0 size=1048576 2024-09-12T00:19:26.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.453+0000 7f682945b780 1 < canceled part key=_multipart_EYHGJ82COSE9.2~HTTR7LE0YLN6.1 size=1048576 2024-09-12T00:19:26.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.454+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~HTTR7LE0YLN6.2 size=450556 2024-09-12T00:19:26.455 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.457+0000 7f682945b780 1 < canceled multipart upload key=EYHGJ82COSE9 upload=HTTR7LE0YLN6 tag=S9O59UHHKNW7 type=write size=3596284 2024-09-12T00:19:26.457 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.458+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=8VMNT2SDL9TQ type=del size=221298 2024-09-12T00:19:26.458 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.460+0000 7f682945b780 1 < canceled operation key=AZKLWMQ818SW tag=SWHII8QMBLOW type=del size=1780980 2024-09-12T00:19:26.460 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.462+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=QIZN7SU56SE3 type=del size=145550 2024-09-12T00:19:26.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.463+0000 7f682945b780 1 < canceled operation key=COUJXCOSVPDS tag=NPVHEXQ01XWG type=del size=2632684 2024-09-12T00:19:26.462 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.464+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=JH171FGMK1UR type=del size=2690348 2024-09-12T00:19:26.464 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.465+0000 7f682945b780 1 < completed write operation key=TGOBZH6DZK71 tag=LCX9LF4EEW0K type=write size=182766 2024-09-12T00:19:26.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.467+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=33Y6URHW1KPZ type=del size=2898263 2024-09-12T00:19:26.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.468+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=Q5Z6P1H7XK5U type=del 2024-09-12T00:19:26.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.471+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~I7A31Z5EEOL7.0 size=1048576 2024-09-12T00:19:26.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.472+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~I7A31Z5EEOL7.1 size=1031076 2024-09-12T00:19:26.471 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.472+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=I7A31Z5EEOL7 tag=0A09CWLQ30OB type=write size=3128228 2024-09-12T00:19:26.472 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.473+0000 7f682945b780 -1 < failed to complete operation key=G0ONSUVW4M7R tag=7BUF805DQMVF type=del size=3936678: (22) Invalid argument 2024-09-12T00:19:26.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.477+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~RW5ZPLAHLQW1.0 size=35579 2024-09-12T00:19:26.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.477+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=RW5ZPLAHLQW1 tag=X35JILCLB225 type=write size=1084155 2024-09-12T00:19:26.476 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.477+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=OEEKL9NBY706 type=del 2024-09-12T00:19:26.478 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.480+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~BIATM1TI55QV.0 size=1048576 2024-09-12T00:19:26.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.481+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~BIATM1TI55QV.1 size=1048576 2024-09-12T00:19:26.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.482+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~BIATM1TI55QV.2 size=668758 2024-09-12T00:19:26.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.482+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=BIATM1TI55QV tag=TAELSKKLUW0K type=write size=3814486 2024-09-12T00:19:26.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.485+0000 7f682945b780 1 < suggested update operation key=3JFMN39G6TTF tag=2I6RLGNDE09Y type=del size=851593 2024-09-12T00:19:26.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.486+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=NORI7IT7TNUJ type=del size=1430576 2024-09-12T00:19:26.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.488+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~09O0TQ0A20JR.0 size=1048576 2024-09-12T00:19:26.488 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.489+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~09O0TQ0A20JR.1 size=1048576 2024-09-12T00:19:26.489 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.490+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~09O0TQ0A20JR.2 size=328888 2024-09-12T00:19:26.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.493+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=09O0TQ0A20JR tag=H61XF1R9ABHF type=write size=3474616 2024-09-12T00:19:26.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.494+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=TKWFDIZI1ZLC type=del size=165182 2024-09-12T00:19:26.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.496+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=B2QD1F4RT78L type=del 2024-09-12T00:19:26.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.498+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=F4LOC7XNL4IX type=del size=682454 2024-09-12T00:19:26.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.499+0000 7f682945b780 1 < completed write operation key=TGOBZH6DZK71 tag=MNU5CBT54AFS type=write size=485408 2024-09-12T00:19:26.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.502+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~FFDZQN60HUUA.0 size=817872 2024-09-12T00:19:26.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.502+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=FFDZQN60HUUA tag=4RMBTAX1665W type=write size=1866448 2024-09-12T00:19:26.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.504+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~29OWGNRCAZC6.0 size=1048576 2024-09-12T00:19:26.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.505+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~29OWGNRCAZC6.1 size=951530 2024-09-12T00:19:26.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.507+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=29OWGNRCAZC6 tag=7P0XIFF59DMF type=write size=3048682 2024-09-12T00:19:26.507 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.508+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=57KMTCVGP69H type=del size=1325244 2024-09-12T00:19:26.507 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.509+0000 7f682945b780 1 < canceled part key=_multipart_CE5EBY7EGY4Z.2~3N4F6LAF5DV0.0 size=1048576 2024-09-12T00:19:26.508 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.511+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~3N4F6LAF5DV0.1 size=955694 2024-09-12T00:19:26.511 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.513+0000 7f682945b780 1 < canceled multipart upload key=CE5EBY7EGY4Z upload=3N4F6LAF5DV0 tag=QWVCPA8EMBFY type=write size=3052846 2024-09-12T00:19:26.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.514+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=87HGIKF3WI44 type=del size=1461411 2024-09-12T00:19:26.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.516+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~FGN77TETEPYN.0 size=449303 2024-09-12T00:19:26.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.519+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=FGN77TETEPYN tag=MXKBA8J8V5H7 type=write size=1497879 2024-09-12T00:19:26.519 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.520+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=X4H9WPUVXVMV type=del size=1552705 2024-09-12T00:19:26.521 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.522+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~ZEPQQPTWRGJA.0 size=934204 2024-09-12T00:19:26.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.525+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=ZEPQQPTWRGJA tag=FA6LWGF29MAX type=write size=1982780 2024-09-12T00:19:26.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.526+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=IJ7GUI7NWI9W type=del size=3025464 2024-09-12T00:19:26.526 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.528+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~TQPQJAEQDWRS.0 size=1048576 2024-09-12T00:19:26.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.529+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~TQPQJAEQDWRS.1 size=1048576 2024-09-12T00:19:26.528 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.530+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~TQPQJAEQDWRS.2 size=758740 2024-09-12T00:19:26.531 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.532+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=TQPQJAEQDWRS tag=PF8BGRADORFO type=write size=3904468 2024-09-12T00:19:26.535 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.537+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~O3WMTSAHDMDH.0 size=1048576 2024-09-12T00:19:26.536 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.537+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~O3WMTSAHDMDH.1 size=1048576 2024-09-12T00:19:26.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.539+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~O3WMTSAHDMDH.2 size=593711 2024-09-12T00:19:26.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.539+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=O3WMTSAHDMDH tag=P3YB0P39QD1G type=write size=3739439 2024-09-12T00:19:26.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.540+0000 7f682945b780 1 < canceled operation key=D06ZUP2ZXX42 tag=8VMNT2SDL9TQ type=del size=221298 2024-09-12T00:19:26.540 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.541+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=LZBANB7LO460 type=del size=4179405 2024-09-12T00:19:26.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.543+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=QIZN7SU56SE3 type=del 2024-09-12T00:19:26.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.545+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=T5TUFMLOZK0O type=del size=890241 2024-09-12T00:19:26.546 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.548+0000 7f682945b780 1 < completed delete operation key=COUJXCOSVPDS tag=JH171FGMK1UR type=del 2024-09-12T00:19:26.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.549+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=9FY6M77OV592 type=del size=1059900 2024-09-12T00:19:26.549 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.551+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=33Y6URHW1KPZ type=del 2024-09-12T00:19:26.551 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.552+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=0L2U3QYYCQ2E type=del size=2583074 2024-09-12T00:19:26.552 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.554+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~I7A31Z5EEOL7.0 size=1048576 2024-09-12T00:19:26.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.555+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~I7A31Z5EEOL7.1 size=1031076 2024-09-12T00:19:26.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.557+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=I7A31Z5EEOL7 tag=0A09CWLQ30OB type=write size=3128228 2024-09-12T00:19:26.561 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.560+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~AV13G500EGA4.0 size=1048576 2024-09-12T00:19:26.561 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.561+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~AV13G500EGA4.1 size=602858 2024-09-12T00:19:26.561 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.561+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=AV13G500EGA4 tag=BU26L297WMOI type=write size=2700010 2024-09-12T00:19:26.561 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.562+0000 7f682945b780 1 < canceled part key=_multipart_3JFMN39G6TTF.2~RW5ZPLAHLQW1.0 size=35579 2024-09-12T00:19:26.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.564+0000 7f682945b780 1 < canceled multipart upload key=3JFMN39G6TTF upload=RW5ZPLAHLQW1 tag=X35JILCLB225 type=write size=1084155 2024-09-12T00:19:26.565 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.566+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~ATR1K0ZFU2K7.0 size=1048576 2024-09-12T00:19:26.566 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.567+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~ATR1K0ZFU2K7.1 size=150977 2024-09-12T00:19:26.566 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.567+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=ATR1K0ZFU2K7 tag=MUEDJE4G2TQZ type=write size=2248129 2024-09-12T00:19:26.567 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.569+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~BIATM1TI55QV.0 size=1048576 2024-09-12T00:19:26.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.571+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~BIATM1TI55QV.1 size=1048576 2024-09-12T00:19:26.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.571+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~BIATM1TI55QV.2 size=668758 2024-09-12T00:19:26.572 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.574+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=BIATM1TI55QV tag=TAELSKKLUW0K type=write size=3814486 2024-09-12T00:19:26.575 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.576+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~NI1332HQMR3W.0 size=1048576 2024-09-12T00:19:26.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.577+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~NI1332HQMR3W.1 size=1018193 2024-09-12T00:19:26.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.577+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=NI1332HQMR3W tag=5WSJ6STHZ4VY type=write size=3115345 2024-09-12T00:19:26.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.580+0000 7f682945b780 1 < suggested update operation key=3JFMN39G6TTF tag=NORI7IT7TNUJ type=del size=1430576 2024-09-12T00:19:26.580 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.582+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=8APNZPVXAS5X type=write size=1020280 2024-09-12T00:19:26.581 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.583+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=TKWFDIZI1ZLC type=del 2024-09-12T00:19:26.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.585+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~CN9D8ZSZXWAW.0 size=812949 2024-09-12T00:19:26.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.585+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=CN9D8ZSZXWAW tag=M0LAPA85M4HA type=write size=1861525 2024-09-12T00:19:26.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.587+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=F4LOC7XNL4IX type=del 2024-09-12T00:19:26.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.590+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~MNYXR25551HX.0 size=682964 2024-09-12T00:19:26.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.590+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=MNYXR25551HX tag=3U7U6S3NZENU type=write size=1731540 2024-09-12T00:19:26.589 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.591+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~FFDZQN60HUUA.0 size=817872 2024-09-12T00:19:26.591 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.593+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=FFDZQN60HUUA tag=4RMBTAX1665W type=write size=1866448 2024-09-12T00:19:26.593 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.594+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=XQ29461W2Z0K type=del size=2572962 2024-09-12T00:19:26.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.596+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=57KMTCVGP69H type=del 2024-09-12T00:19:26.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.599+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~JF8JEX7M0D6W.0 size=1048576 2024-09-12T00:19:26.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.600+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~JF8JEX7M0D6W.1 size=473638 2024-09-12T00:19:26.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.600+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=JF8JEX7M0D6W tag=AEGOGYCFTS2O type=write size=2570790 2024-09-12T00:19:26.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.603+0000 7f682945b780 1 < suggested remove operation key=8D9UC8FJ16UK tag=87HGIKF3WI44 type=del 2024-09-12T00:19:26.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.604+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=3IOID25YRSQJ type=write size=333425 2024-09-12T00:19:26.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.606+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=X4H9WPUVXVMV type=del 2024-09-12T00:19:26.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.607+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=SRF1PE56ASJS type=del size=2668233 2024-09-12T00:19:26.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.609+0000 7f682945b780 1 < completed delete operation key=COUJXCOSVPDS tag=IJ7GUI7NWI9W type=del 2024-09-12T00:19:26.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.612+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~DJVJYMQXGND8.0 size=850170 2024-09-12T00:19:26.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.612+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=DJVJYMQXGND8 tag=CGV7UVJP1QDN type=write size=1898746 2024-09-12T00:19:26.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.614+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~O3WMTSAHDMDH.0 size=1048576 2024-09-12T00:19:26.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.615+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~O3WMTSAHDMDH.1 size=1048576 2024-09-12T00:19:26.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.616+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~O3WMTSAHDMDH.2 size=593711 2024-09-12T00:19:26.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.619+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=O3WMTSAHDMDH tag=P3YB0P39QD1G type=write size=3739439 2024-09-12T00:19:26.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.620+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=OJBSINIWGCFP type=write size=939891 2024-09-12T00:19:26.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.621+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=LZBANB7LO460 type=del 2024-09-12T00:19:26.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.624+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~015OGEKV3UQB.0 size=1048576 2024-09-12T00:19:26.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.625+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~015OGEKV3UQB.1 size=1048576 2024-09-12T00:19:26.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.626+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~015OGEKV3UQB.2 size=10805 2024-09-12T00:19:26.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.626+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=015OGEKV3UQB tag=H8R1AIMH0X0K type=write size=3156533 2024-09-12T00:19:26.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.627+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=T5TUFMLOZK0O type=del 2024-09-12T00:19:26.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.629+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=PTSJ6LPN1HJR type=del size=2111113 2024-09-12T00:19:26.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.630+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=9FY6M77OV592 type=del 2024-09-12T00:19:26.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.634+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~71PNM4V6QKLG.0 size=511085 2024-09-12T00:19:26.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.634+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=71PNM4V6QKLG tag=NXEYEZK5W65A type=write size=1559661 2024-09-12T00:19:26.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.634+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=0L2U3QYYCQ2E type=del 2024-09-12T00:19:26.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.637+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=LRXANX297OTK type=del size=3564299 2024-09-12T00:19:26.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.637+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~AV13G500EGA4.0 size=1048576 2024-09-12T00:19:26.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.639+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~AV13G500EGA4.1 size=602858 2024-09-12T00:19:26.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.641+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=AV13G500EGA4 tag=BU26L297WMOI type=write size=2700010 2024-09-12T00:19:26.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.642+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=755NDI0HSQXT type=del size=3720740 2024-09-12T00:19:26.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.644+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~ATR1K0ZFU2K7.0 size=1048576 2024-09-12T00:19:26.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.645+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~ATR1K0ZFU2K7.1 size=150977 2024-09-12T00:19:26.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.647+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=ATR1K0ZFU2K7 tag=MUEDJE4G2TQZ type=write size=2248129 2024-09-12T00:19:26.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.650+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=NGP610TK9MIL type=del size=2053976 2024-09-12T00:19:26.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.651+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~NI1332HQMR3W.0 size=1048576 2024-09-12T00:19:26.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.652+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~NI1332HQMR3W.1 size=1018193 2024-09-12T00:19:26.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.654+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=NI1332HQMR3W tag=5WSJ6STHZ4VY type=write size=3115345 2024-09-12T00:19:26.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.657+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~EG6ODX0NZSC1.0 size=1048576 2024-09-12T00:19:26.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.658+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~EG6ODX0NZSC1.1 size=104923 2024-09-12T00:19:26.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.658+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=EG6ODX0NZSC1 tag=6G68HZ34Y5QY type=write size=2202075 2024-09-12T00:19:26.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.659+0000 7f682945b780 1 < completed write operation key=Z7408WO050VI tag=8APNZPVXAS5X type=write size=1020280 2024-09-12T00:19:26.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.660+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=5JLELJAKOCXF type=del size=2107151 2024-09-12T00:19:26.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.661+0000 7f682945b780 1 < canceled part key=_multipart_BV3D543J63H1.2~CN9D8ZSZXWAW.0 size=812949 2024-09-12T00:19:26.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.663+0000 7f682945b780 1 < canceled multipart upload key=BV3D543J63H1 upload=CN9D8ZSZXWAW tag=M0LAPA85M4HA type=write size=1861525 2024-09-12T00:19:26.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.664+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=X47R2XJFLDEG type=del size=1481458 2024-09-12T00:19:26.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.666+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~MNYXR25551HX.0 size=682964 2024-09-12T00:19:26.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.668+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=MNYXR25551HX tag=3U7U6S3NZENU type=write size=1731540 2024-09-12T00:19:26.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.671+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=X0SVXA21VCU3 type=write size=399815 2024-09-12T00:19:26.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.672+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=XQ29461W2Z0K type=del 2024-09-12T00:19:26.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.676+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~P4CB18LPOD0R.0 size=1048576 2024-09-12T00:19:26.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.677+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~P4CB18LPOD0R.1 size=180431 2024-09-12T00:19:26.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.677+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=P4CB18LPOD0R tag=9VGG87F7F75O type=write size=2277583 2024-09-12T00:19:26.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.677+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~JF8JEX7M0D6W.0 size=1048576 2024-09-12T00:19:26.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.678+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~JF8JEX7M0D6W.1 size=473638 2024-09-12T00:19:26.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.682+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=JF8JEX7M0D6W tag=AEGOGYCFTS2O type=write size=2570790 2024-09-12T00:19:26.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.684+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~4FDUCA8Q6MYR.0 size=1048576 2024-09-12T00:19:26.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.685+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~4FDUCA8Q6MYR.1 size=1048576 2024-09-12T00:19:26.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.686+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~4FDUCA8Q6MYR.2 size=31521 2024-09-12T00:19:26.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.686+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=4FDUCA8Q6MYR tag=FA3SWPNLB1SG type=write size=3177249 2024-09-12T00:19:26.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.687+0000 7f682945b780 1 < completed write operation key=9Q4HFV4F2KE2 tag=3IOID25YRSQJ type=write size=333425 2024-09-12T00:19:26.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.689+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~J0Q2JX04E082.0 size=505154 2024-09-12T00:19:26.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.689+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=J0Q2JX04E082 tag=JSQ8OYCKRUI1 type=write size=1553730 2024-09-12T00:19:26.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.691+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=SRF1PE56ASJS type=del 2024-09-12T00:19:26.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.692+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=0J48WEMYC3O2 type=write size=748162 2024-09-12T00:19:26.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.694+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~DJVJYMQXGND8.0 size=850170 2024-09-12T00:19:26.695 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.696+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=DJVJYMQXGND8 tag=CGV7UVJP1QDN type=write size=1898746 2024-09-12T00:19:26.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.698+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~W9KWYB2SXO4P.0 size=1048576 2024-09-12T00:19:26.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.700+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~W9KWYB2SXO4P.1 size=1023832 2024-09-12T00:19:26.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.700+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=W9KWYB2SXO4P tag=FFAPYB2WNN72 type=write size=3120984 2024-09-12T00:19:26.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.701+0000 7f682945b780 1 < completed write operation key=G0ONSUVW4M7R tag=OJBSINIWGCFP type=write size=939891 2024-09-12T00:19:26.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.704+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=0OFBPVLZH54M type=write size=775016 2024-09-12T00:19:26.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.705+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~015OGEKV3UQB.0 size=1048576 2024-09-12T00:19:26.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.706+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~015OGEKV3UQB.1 size=1048576 2024-09-12T00:19:26.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.707+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~015OGEKV3UQB.2 size=10805 2024-09-12T00:19:26.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.710+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=015OGEKV3UQB tag=H8R1AIMH0X0K type=write size=3156533 2024-09-12T00:19:26.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.712+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~WVJ295WUUMFN.0 size=1048576 2024-09-12T00:19:26.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.713+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~WVJ295WUUMFN.1 size=1048576 2024-09-12T00:19:26.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.714+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~WVJ295WUUMFN.2 size=988132 2024-09-12T00:19:26.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.714+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=WVJ295WUUMFN tag=S45VFWPPA3R3 type=write size=4133860 2024-09-12T00:19:26.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.716+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=PTSJ6LPN1HJR type=del 2024-09-12T00:19:26.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.718+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=250XG2CUU5P7 type=del size=22287 2024-09-12T00:19:26.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.718+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~71PNM4V6QKLG.0 size=511085 2024-09-12T00:19:26.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.721+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=71PNM4V6QKLG tag=NXEYEZK5W65A type=write size=1559661 2024-09-12T00:19:26.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.722+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=G89BFHRBZ6J0 type=del size=2202437 2024-09-12T00:19:26.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.726+0000 7f682945b780 1 < suggested update operation key=R2OAUUKLV7OK tag=LRXANX297OTK type=del size=3564299 2024-09-12T00:19:26.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.728+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~C6YG11JL0F4S.0 size=1048576 2024-09-12T00:19:26.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.729+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~C6YG11JL0F4S.1 size=1048576 2024-09-12T00:19:26.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.730+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~C6YG11JL0F4S.2 size=933590 2024-09-12T00:19:26.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.730+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=C6YG11JL0F4S tag=QL10LL5I715K type=write size=4079318 2024-09-12T00:19:26.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.731+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=755NDI0HSQXT type=del 2024-09-12T00:19:26.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.732+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=M5LMXTXBO6PY type=del size=851753 2024-09-12T00:19:26.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.734+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=NGP610TK9MIL type=del 2024-09-12T00:19:26.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.736+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~24D6VM1U2G18.0 size=1048576 2024-09-12T00:19:26.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.737+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~24D6VM1U2G18.1 size=1035909 2024-09-12T00:19:26.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.737+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=24D6VM1U2G18 tag=1V1902TKJIP3 type=write size=3133061 2024-09-12T00:19:26.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.740+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~EG6ODX0NZSC1.0 size=1048576 2024-09-12T00:19:26.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.740+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~EG6ODX0NZSC1.1 size=104923 2024-09-12T00:19:26.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.743+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=EG6ODX0NZSC1 tag=6G68HZ34Y5QY type=write size=2202075 2024-09-12T00:19:26.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.744+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=27ZYXCGW2ZNP type=del size=2252192 2024-09-12T00:19:26.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.748+0000 7f682945b780 1 < suggested update operation key=1RAFARG1JXFQ tag=5JLELJAKOCXF type=del size=2107151 2024-09-12T00:19:26.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.748+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=IDTZ63062JKI type=del size=78800 2024-09-12T00:19:26.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.753+0000 7f682945b780 1 < suggested update operation key=IYYTX8TCLF30 tag=X47R2XJFLDEG type=del size=1481458 2024-09-12T00:19:26.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.753+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=JNZG5L16039X type=write size=47991 2024-09-12T00:19:26.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.756+0000 7f682945b780 1 < completed write operation key=CE5EBY7EGY4Z tag=X0SVXA21VCU3 type=write size=399815 2024-09-12T00:19:26.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.756+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=OWDTSMNW379V type=del size=2837354 2024-09-12T00:19:26.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.758+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~P4CB18LPOD0R.0 size=1048576 2024-09-12T00:19:26.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.759+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~P4CB18LPOD0R.1 size=180431 2024-09-12T00:19:26.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.762+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=P4CB18LPOD0R tag=9VGG87F7F75O type=write size=2277583 2024-09-12T00:19:26.765 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.763+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=SLY0FLG5R00X type=del size=1449559 2024-09-12T00:19:26.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.764+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~4FDUCA8Q6MYR.0 size=1048576 2024-09-12T00:19:26.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.765+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~4FDUCA8Q6MYR.1 size=1048576 2024-09-12T00:19:26.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.767+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~4FDUCA8Q6MYR.2 size=31521 2024-09-12T00:19:26.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.770+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=4FDUCA8Q6MYR tag=FA3SWPNLB1SG type=write size=3177249 2024-09-12T00:19:26.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.770+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=O0I37O62D0KL type=write size=347844 2024-09-12T00:19:26.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.772+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~J0Q2JX04E082.0 size=505154 2024-09-12T00:19:26.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.775+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=J0Q2JX04E082 tag=JSQ8OYCKRUI1 type=write size=1553730 2024-09-12T00:19:26.774 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.776+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=U6LP1ZSB3HPC type=write size=770504 2024-09-12T00:19:26.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.777+0000 7f682945b780 1 < completed write operation key=AZKLWMQ818SW tag=0J48WEMYC3O2 type=write size=748162 2024-09-12T00:19:26.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.779+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=SZQH776X1W4T type=del size=47486 2024-09-12T00:19:26.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.780+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~W9KWYB2SXO4P.0 size=1048576 2024-09-12T00:19:26.780 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.781+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~W9KWYB2SXO4P.1 size=1023832 2024-09-12T00:19:26.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.784+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=W9KWYB2SXO4P tag=FFAPYB2WNN72 type=write size=3120984 2024-09-12T00:19:26.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.785+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=WAZ39SI9DGZP type=write size=357374 2024-09-12T00:19:26.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.789+0000 7f682945b780 1 < suggested remove operation key=CE5EBY7EGY4Z tag=0OFBPVLZH54M type=write 2024-09-12T00:19:26.789 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.790+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=VHT5C7LBYFYP type=write size=861915 2024-09-12T00:19:26.789 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.790+0000 7f682945b780 1 < canceled part key=_multipart_G0ONSUVW4M7R.2~WVJ295WUUMFN.0 size=1048576 2024-09-12T00:19:26.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.792+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~WVJ295WUUMFN.1 size=1048576 2024-09-12T00:19:26.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.793+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~WVJ295WUUMFN.2 size=988132 2024-09-12T00:19:26.793 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.795+0000 7f682945b780 1 < canceled multipart upload key=G0ONSUVW4M7R upload=WVJ295WUUMFN tag=S45VFWPPA3R3 type=write size=4133860 2024-09-12T00:19:26.796 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.797+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~84EB6O8U22B0.0 size=1048576 2024-09-12T00:19:26.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.799+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~84EB6O8U22B0.1 size=1048576 2024-09-12T00:19:26.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.800+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~84EB6O8U22B0.2 size=737365 2024-09-12T00:19:26.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.800+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=84EB6O8U22B0 tag=PGOF6DOE93AD type=write size=3883093 2024-09-12T00:19:26.800 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.801+0000 7f682945b780 1 < completed delete operation key=R7V03ML1H80V tag=250XG2CUU5P7 type=del 2024-09-12T00:19:26.804 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.806+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~BM89G0O3PH06.0 size=357513 2024-09-12T00:19:26.804 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.806+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=BM89G0O3PH06 tag=ZTT67KFU36ZC type=write size=1406089 2024-09-12T00:19:26.805 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.807+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=G89BFHRBZ6J0 type=del 2024-09-12T00:19:26.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.808+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=629WGN0ASO71 type=del size=1229342 2024-09-12T00:19:26.808 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.810+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~C6YG11JL0F4S.0 size=1048576 2024-09-12T00:19:26.808 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.810+0000 7f682945b780 1 < canceled part key=_multipart_Y65K9I6K41X5.2~C6YG11JL0F4S.1 size=1048576 2024-09-12T00:19:26.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.812+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~C6YG11JL0F4S.2 size=933590 2024-09-12T00:19:26.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.813+0000 7f682945b780 1 < canceled multipart upload key=Y65K9I6K41X5 upload=C6YG11JL0F4S tag=QL10LL5I715K type=write size=4079318 2024-09-12T00:19:26.813 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.815+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=MHSED7TZG6NT type=del size=2058561 2024-09-12T00:19:26.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.816+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=M5LMXTXBO6PY type=del 2024-09-12T00:19:26.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.818+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=CJOUM6GQTIOC type=del size=2176493 2024-09-12T00:19:26.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.819+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~24D6VM1U2G18.0 size=1048576 2024-09-12T00:19:26.819 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.820+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~24D6VM1U2G18.1 size=1035909 2024-09-12T00:19:26.821 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.823+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=24D6VM1U2G18 tag=1V1902TKJIP3 type=write size=3133061 2024-09-12T00:19:26.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.824+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=YGFFQJBWQ955 type=del size=724654 2024-09-12T00:19:26.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.826+0000 7f682945b780 1 < canceled operation key=9Q4HFV4F2KE2 tag=27ZYXCGW2ZNP type=del size=2252192 2024-09-12T00:19:26.825 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.827+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=NXB2HMLV0BJW type=del size=2790896 2024-09-12T00:19:26.827 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.829+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=IDTZ63062JKI type=del 2024-09-12T00:19:26.828 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.830+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=Z70JNFA0STJ6 type=del size=3110650 2024-09-12T00:19:26.830 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.831+0000 7f682945b780 1 < completed write operation key=JAVE3HR52R5C tag=JNZG5L16039X type=write size=47991 2024-09-12T00:19:26.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.834+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~2OZQ16O1K2KV.0 size=1048576 2024-09-12T00:19:26.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.836+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~2OZQ16O1K2KV.1 size=294744 2024-09-12T00:19:26.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.836+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=2OZQ16O1K2KV tag=6BTLA2ECODS0 type=write size=2391896 2024-09-12T00:19:26.835 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.836+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=OWDTSMNW379V type=del 2024-09-12T00:19:26.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.839+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=5NBFHUE0UZ19 type=del size=4132928 2024-09-12T00:19:26.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.839+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=SLY0FLG5R00X type=del 2024-09-12T00:19:26.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.841+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=UQAZREFPWOJ2 type=del size=638020 2024-09-12T00:19:26.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.842+0000 7f682945b780 1 < completed write operation key=P56VIP3WIOJL tag=O0I37O62D0KL type=write size=347844 2024-09-12T00:19:26.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.846+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~DDDV3RH9C4SQ.0 size=1048576 2024-09-12T00:19:26.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.846+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~DDDV3RH9C4SQ.1 size=364485 2024-09-12T00:19:26.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.846+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=DDDV3RH9C4SQ tag=EQJSI68UOEQZ type=write size=2461637 2024-09-12T00:19:26.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.848+0000 7f682945b780 1 < completed write operation key=BK212Z99RM7F tag=U6LP1ZSB3HPC type=write size=770504 2024-09-12T00:19:26.848 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.850+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=2N7FD6PTN0EK type=del size=1553769 2024-09-12T00:19:26.849 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.851+0000 7f682945b780 -1 < failed to complete operation key=CE5EBY7EGY4Z tag=SZQH776X1W4T type=del size=47486: (22) Invalid argument 2024-09-12T00:19:26.851 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.853+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~H9THUR8REN3M.0 size=405768 2024-09-12T00:19:26.852 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.853+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=H9THUR8REN3M tag=T2PPRT2M7W1J type=write size=1454344 2024-09-12T00:19:26.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.854+0000 7f682945b780 1 < completed write operation key=BMTPXZ1OA2TZ tag=WAZ39SI9DGZP type=write size=357374 2024-09-12T00:19:26.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.856+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=2Q632EJ9H4L9 type=del size=1351215 2024-09-12T00:19:26.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.857+0000 7f682945b780 1 < completed write operation key=R2OAUUKLV7OK tag=VHT5C7LBYFYP type=write size=861915 2024-09-12T00:19:26.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.860+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=VW54159PFDV6 type=del size=1824702 2024-09-12T00:19:26.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.861+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~84EB6O8U22B0.0 size=1048576 2024-09-12T00:19:26.860 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.863+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~84EB6O8U22B0.1 size=1048576 2024-09-12T00:19:26.860 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.863+0000 7f682945b780 1 < canceled part key=_multipart_7RRJO383D8TH.2~84EB6O8U22B0.2 size=737365 2024-09-12T00:19:26.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.865+0000 7f682945b780 1 < canceled multipart upload key=7RRJO383D8TH upload=84EB6O8U22B0 tag=PGOF6DOE93AD type=write size=3883093 2024-09-12T00:19:26.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.867+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~CWFH9492YZMM.0 size=1048576 2024-09-12T00:19:26.867 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.868+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~CWFH9492YZMM.1 size=1048576 2024-09-12T00:19:26.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.870+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~CWFH9492YZMM.2 size=706275 2024-09-12T00:19:26.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.870+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=CWFH9492YZMM tag=LISLRF2T48ZT type=write size=3852003 2024-09-12T00:19:26.870 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.871+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~BM89G0O3PH06.0 size=357513 2024-09-12T00:19:26.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.873+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=BM89G0O3PH06 tag=ZTT67KFU36ZC type=write size=1406089 2024-09-12T00:19:26.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.874+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=ESKZIPFBOCZ5 type=del size=2994121 2024-09-12T00:19:26.875 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.875+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=629WGN0ASO71 type=del 2024-09-12T00:19:26.876 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.877+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=FSCH1JPZCXJA type=del size=4168526 2024-09-12T00:19:26.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.878+0000 7f682945b780 1 < canceled operation key=8D9UC8FJ16UK tag=MHSED7TZG6NT type=del size=2058561 2024-09-12T00:19:26.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.880+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=HWJFIBEMG9AB type=del size=4109268 2024-09-12T00:19:26.881 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.881+0000 7f682945b780 1 < canceled operation key=D06ZUP2ZXX42 tag=CJOUM6GQTIOC type=del size=2176493 2024-09-12T00:19:26.882 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.883+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=I8H1LOIH8WJS type=del size=1273753 2024-09-12T00:19:26.884 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.885+0000 7f682945b780 1 < canceled operation key=8D9UC8FJ16UK tag=YGFFQJBWQ955 type=del size=724654 2024-09-12T00:19:26.886 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.886+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=WV02EN3OPZ53 type=del size=3906647 2024-09-12T00:19:26.887 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.888+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=NXB2HMLV0BJW type=del 2024-09-12T00:19:26.890 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.891+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~6V01ZLUH14VN.0 size=1048576 2024-09-12T00:19:26.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.892+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~6V01ZLUH14VN.1 size=1048576 2024-09-12T00:19:26.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.893+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~6V01ZLUH14VN.2 size=995487 2024-09-12T00:19:26.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.893+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=6V01ZLUH14VN tag=15R9AJ516G70 type=write size=4141215 2024-09-12T00:19:26.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.894+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=Z70JNFA0STJ6 type=del 2024-09-12T00:19:26.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.896+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=S5VMA3YUS51C type=del size=125820 2024-09-12T00:19:26.897 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.897+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~2OZQ16O1K2KV.0 size=1048576 2024-09-12T00:19:26.898 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.898+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~2OZQ16O1K2KV.1 size=294744 2024-09-12T00:19:26.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.900+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=2OZQ16O1K2KV tag=6BTLA2ECODS0 type=write size=2391896 2024-09-12T00:19:26.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.902+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=QOPF7HH5DYPX type=del size=3534305 2024-09-12T00:19:26.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.903+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=5NBFHUE0UZ19 type=del 2024-09-12T00:19:26.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.905+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=9IQ0UAQFRIX7 type=del size=2259619 2024-09-12T00:19:26.905 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.906+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=UQAZREFPWOJ2 type=del 2024-09-12T00:19:26.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.907+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=R5PKJXU73HC0 type=del size=1701406 2024-09-12T00:19:26.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.909+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~DDDV3RH9C4SQ.0 size=1048576 2024-09-12T00:19:26.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.910+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~DDDV3RH9C4SQ.1 size=364485 2024-09-12T00:19:26.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.913+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=DDDV3RH9C4SQ tag=EQJSI68UOEQZ type=write size=2461637 2024-09-12T00:19:26.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.914+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=I10Q7SBMHCMN type=write size=864985 2024-09-12T00:19:26.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.915+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=2N7FD6PTN0EK type=del 2024-09-12T00:19:26.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.917+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=6XH2R2QM7786 type=del size=1125932 2024-09-12T00:19:26.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.918+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~H9THUR8REN3M.0 size=405768 2024-09-12T00:19:26.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.921+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=H9THUR8REN3M tag=T2PPRT2M7W1J type=write size=1454344 2024-09-12T00:19:26.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.922+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=R0F6XJ5VKJAY type=del size=1703822 2024-09-12T00:19:26.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.923+0000 7f682945b780 1 < canceled operation key=922B2PPJFX2Z tag=2Q632EJ9H4L9 type=del size=1351215 2024-09-12T00:19:26.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.925+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=3Y0K1L2DQIOE type=del size=3669797 2024-09-12T00:19:26.926 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.926+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=VW54159PFDV6 type=del 2024-09-12T00:19:26.927 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.928+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=SUHTP2FW01Y7 type=write size=1033567 2024-09-12T00:19:26.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.929+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~CWFH9492YZMM.0 size=1048576 2024-09-12T00:19:26.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.930+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~CWFH9492YZMM.1 size=1048576 2024-09-12T00:19:26.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.931+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~CWFH9492YZMM.2 size=706275 2024-09-12T00:19:26.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.934+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=CWFH9492YZMM tag=LISLRF2T48ZT type=write size=3852003 2024-09-12T00:19:26.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.935+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=LG5FFJIGBIEV type=del size=2536616 2024-09-12T00:19:26.936 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.936+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=ESKZIPFBOCZ5 type=del 2024-09-12T00:19:26.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.941+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~N6KOHIK4409M.0 size=808963 2024-09-12T00:19:26.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.941+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=N6KOHIK4409M tag=U1JVR9U60T1V type=write size=1857539 2024-09-12T00:19:26.942 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.943+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=FSCH1JPZCXJA type=del 2024-09-12T00:19:26.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.945+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~3BBX4J36OQM5.0 size=1048576 2024-09-12T00:19:26.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.946+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~3BBX4J36OQM5.1 size=1048576 2024-09-12T00:19:26.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.947+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~3BBX4J36OQM5.2 size=26727 2024-09-12T00:19:26.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.947+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=3BBX4J36OQM5 tag=F2QKYHUY0XJ6 type=write size=3172455 2024-09-12T00:19:26.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.949+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=HWJFIBEMG9AB type=del 2024-09-12T00:19:26.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.951+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~14IDFNMMXQWP.0 size=305253 2024-09-12T00:19:26.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.951+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=14IDFNMMXQWP tag=NSN2ZWZ73L57 type=write size=1353829 2024-09-12T00:19:26.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.953+0000 7f682945b780 1 < completed delete operation key=COUJXCOSVPDS tag=I8H1LOIH8WJS type=del 2024-09-12T00:19:26.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.954+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=5T0EEWYIIA74 type=write size=635263 2024-09-12T00:19:26.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.956+0000 7f682945b780 1 < completed delete operation key=COUJXCOSVPDS tag=WV02EN3OPZ53 type=del 2024-09-12T00:19:26.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.958+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~HOCJEMKOIX64.0 size=255517 2024-09-12T00:19:26.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.958+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=HOCJEMKOIX64 tag=N130K5NBTB86 type=write size=1304093 2024-09-12T00:19:26.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.959+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~6V01ZLUH14VN.0 size=1048576 2024-09-12T00:19:26.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.961+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~6V01ZLUH14VN.1 size=1048576 2024-09-12T00:19:26.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.962+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~6V01ZLUH14VN.2 size=995487 2024-09-12T00:19:26.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.964+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=6V01ZLUH14VN tag=15R9AJ516G70 type=write size=4141215 2024-09-12T00:19:26.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.965+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=A3N3LQUTIDCN type=write size=135662 2024-09-12T00:19:26.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.967+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=S5VMA3YUS51C type=del 2024-09-12T00:19:26.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.968+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=NOHVY0OF8FN3 type=write size=370635 2024-09-12T00:19:26.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.971+0000 7f682945b780 1 < suggested remove operation key=38JJBFDTIYSU tag=QOPF7HH5DYPX type=del 2024-09-12T00:19:26.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.974+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~WISJAZUEX72B.0 size=1048576 2024-09-12T00:19:26.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.975+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~WISJAZUEX72B.1 size=1048576 2024-09-12T00:19:26.976 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.976+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~WISJAZUEX72B.2 size=63801 2024-09-12T00:19:26.976 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.976+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=WISJAZUEX72B tag=X03OX5ZFSF88 type=write size=3209529 2024-09-12T00:19:26.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.978+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=9IQ0UAQFRIX7 type=del 2024-09-12T00:19:26.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.981+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~X3BN8EA1I33S.0 size=1048576 2024-09-12T00:19:26.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.982+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~X3BN8EA1I33S.1 size=1048576 2024-09-12T00:19:26.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.983+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~X3BN8EA1I33S.2 size=120681 2024-09-12T00:19:26.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.983+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=X3BN8EA1I33S tag=WAWFACM36OK6 type=write size=3266409 2024-09-12T00:19:26.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.986+0000 7f682945b780 1 < suggested remove operation key=3JFMN39G6TTF tag=R5PKJXU73HC0 type=del 2024-09-12T00:19:26.987 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.988+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=RFHO2W3JWNN0 type=del size=1008160 2024-09-12T00:19:26.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.989+0000 7f682945b780 1 < completed write operation key=CE5EBY7EGY4Z tag=I10Q7SBMHCMN type=write size=864985 2024-09-12T00:19:26.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.992+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=9XZ0MNF5WAV3 type=del size=3014475 2024-09-12T00:19:26.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.993+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=6XH2R2QM7786 type=del 2024-09-12T00:19:26.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.995+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~73L0O3OQBF2L.0 size=1048576 2024-09-12T00:19:26.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.997+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~73L0O3OQBF2L.1 size=178907 2024-09-12T00:19:26.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.997+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=73L0O3OQBF2L tag=Y6VWCM8DUP2B type=write size=2276059 2024-09-12T00:19:26.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:26.998+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=R0F6XJ5VKJAY type=del 2024-09-12T00:19:27.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.002+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~2QGR5H8KSEZS.0 size=1048576 2024-09-12T00:19:27.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.003+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~2QGR5H8KSEZS.1 size=6670 2024-09-12T00:19:27.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.003+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=2QGR5H8KSEZS tag=EKHKVEXWQ9GK type=write size=2103822 2024-09-12T00:19:27.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.004+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=3Y0K1L2DQIOE type=del 2024-09-12T00:19:27.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.006+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~IMG8M02MIPDH.0 size=1048576 2024-09-12T00:19:27.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.007+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~IMG8M02MIPDH.1 size=1048576 2024-09-12T00:19:27.008 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.009+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~IMG8M02MIPDH.2 size=151992 2024-09-12T00:19:27.008 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.009+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=IMG8M02MIPDH tag=8FS1ZF4JV43Q type=write size=3297720 2024-09-12T00:19:27.010 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.010+0000 7f682945b780 1 < completed write operation key=R7V03ML1H80V tag=SUHTP2FW01Y7 type=write size=1033567 2024-09-12T00:19:27.012 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.012+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=PTHI1YD1GJVC type=del size=149377 2024-09-12T00:19:27.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.013+0000 7f682945b780 -1 < failed to complete operation key=38JJBFDTIYSU tag=LG5FFJIGBIEV type=del size=2536616: (22) Invalid argument 2024-09-12T00:19:27.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.015+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=UMQMF1WN09K7 type=del size=2070274 2024-09-12T00:19:27.016 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.016+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~N6KOHIK4409M.0 size=808963 2024-09-12T00:19:27.018 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.020+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=N6KOHIK4409M tag=U1JVR9U60T1V type=write size=1857539 2024-09-12T00:19:27.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.020+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=5OP70ITAZSMR type=del size=2792050 2024-09-12T00:19:27.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.022+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~3BBX4J36OQM5.0 size=1048576 2024-09-12T00:19:27.023 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.023+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~3BBX4J36OQM5.1 size=1048576 2024-09-12T00:19:27.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.025+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~3BBX4J36OQM5.2 size=26727 2024-09-12T00:19:27.027 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.027+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=3BBX4J36OQM5 tag=F2QKYHUY0XJ6 type=write size=3172455 2024-09-12T00:19:27.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.029+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=I5FE242DFOGD type=del size=1860847 2024-09-12T00:19:27.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.029+0000 7f682945b780 1 < canceled part key=_multipart_6DUQKU3R1RL8.2~14IDFNMMXQWP.0 size=305253 2024-09-12T00:19:27.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.031+0000 7f682945b780 1 < canceled multipart upload key=6DUQKU3R1RL8 upload=14IDFNMMXQWP tag=NSN2ZWZ73L57 type=write size=1353829 2024-09-12T00:19:27.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.033+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=RGH6L42O9M29 type=del size=3593982 2024-09-12T00:19:27.034 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.034+0000 7f682945b780 1 < completed write operation key=BI3KCKV4CRWR tag=5T0EEWYIIA74 type=write size=635263 2024-09-12T00:19:27.035 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.036+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=XOOC3C69HH3R type=del size=2510039 2024-09-12T00:19:27.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.037+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~HOCJEMKOIX64.0 size=255517 2024-09-12T00:19:27.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.040+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=HOCJEMKOIX64 tag=N130K5NBTB86 type=write size=1304093 2024-09-12T00:19:27.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.041+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=L513I2SEAG15 type=del size=2627995 2024-09-12T00:19:27.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.045+0000 7f682945b780 1 < canceled operation key=G0ONSUVW4M7R tag=A3N3LQUTIDCN type=write size=135662 2024-09-12T00:19:27.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.046+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=2CV549Z9HQYS type=del size=2422861 2024-09-12T00:19:27.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.047+0000 7f682945b780 1 < completed write operation key=AZKLWMQ818SW tag=NOHVY0OF8FN3 type=write size=370635 2024-09-12T00:19:27.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.049+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=HQS1SEBK1J9G type=write size=754765 2024-09-12T00:19:27.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.050+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~WISJAZUEX72B.0 size=1048576 2024-09-12T00:19:27.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.052+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~WISJAZUEX72B.1 size=1048576 2024-09-12T00:19:27.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.053+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~WISJAZUEX72B.2 size=63801 2024-09-12T00:19:27.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.056+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=WISJAZUEX72B tag=X03OX5ZFSF88 type=write size=3209529 2024-09-12T00:19:27.057 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.058+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~ISULLDLJQL4C.0 size=1048576 2024-09-12T00:19:27.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.060+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~ISULLDLJQL4C.1 size=204492 2024-09-12T00:19:27.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.060+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=ISULLDLJQL4C tag=8V20LB8TKQKT type=write size=2301644 2024-09-12T00:19:27.060 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.061+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~X3BN8EA1I33S.0 size=1048576 2024-09-12T00:19:27.061 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.062+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~X3BN8EA1I33S.1 size=1048576 2024-09-12T00:19:27.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.063+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~X3BN8EA1I33S.2 size=120681 2024-09-12T00:19:27.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.065+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=X3BN8EA1I33S tag=WAWFACM36OK6 type=write size=3266409 2024-09-12T00:19:27.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.066+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=HZO2SQKF37KI type=del size=2511052 2024-09-12T00:19:27.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.068+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=RFHO2W3JWNN0 type=del 2024-09-12T00:19:27.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.070+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=9AI2V36MK9KO type=del size=4113310 2024-09-12T00:19:27.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.073+0000 7f682945b780 1 < suggested remove operation key=Y65K9I6K41X5 tag=9XZ0MNF5WAV3 type=del 2024-09-12T00:19:27.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.076+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~74LU73UFU4ZX.0 size=722740 2024-09-12T00:19:27.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.076+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=74LU73UFU4ZX tag=FX0V6P0C60U5 type=write size=1771316 2024-09-12T00:19:27.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.077+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~73L0O3OQBF2L.0 size=1048576 2024-09-12T00:19:27.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.078+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~73L0O3OQBF2L.1 size=178907 2024-09-12T00:19:27.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.082+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=73L0O3OQBF2L tag=Y6VWCM8DUP2B type=write size=2276059 2024-09-12T00:19:27.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.083+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=1BNP72O9QL7Y type=del size=1315465 2024-09-12T00:19:27.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.085+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~2QGR5H8KSEZS.0 size=1048576 2024-09-12T00:19:27.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.086+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~2QGR5H8KSEZS.1 size=6670 2024-09-12T00:19:27.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.088+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=2QGR5H8KSEZS tag=EKHKVEXWQ9GK type=write size=2103822 2024-09-12T00:19:27.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.089+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=X22G4IZ9YPO2 type=del size=897429 2024-09-12T00:19:27.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.090+0000 7f682945b780 1 < canceled part key=_multipart_3JFMN39G6TTF.2~IMG8M02MIPDH.0 size=1048576 2024-09-12T00:19:27.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.091+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~IMG8M02MIPDH.1 size=1048576 2024-09-12T00:19:27.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.092+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~IMG8M02MIPDH.2 size=151992 2024-09-12T00:19:27.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.094+0000 7f682945b780 1 < canceled multipart upload key=3JFMN39G6TTF upload=IMG8M02MIPDH tag=8FS1ZF4JV43Q type=write size=3297720 2024-09-12T00:19:27.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.096+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=S1EE1YR28HMF type=del size=3202250 2024-09-12T00:19:27.096 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.097+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=PTHI1YD1GJVC type=del 2024-09-12T00:19:27.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.098+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=A5XF8D8NHLG3 type=del size=2634002 2024-09-12T00:19:27.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.100+0000 7f682945b780 1 < canceled operation key=1RAFARG1JXFQ tag=UMQMF1WN09K7 type=del size=2070274 2024-09-12T00:19:27.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.101+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=YLQM76AFTFYK type=del size=2147523 2024-09-12T00:19:27.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.102+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=5OP70ITAZSMR type=del 2024-09-12T00:19:27.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.106+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~K3QFLEED3DC5.0 size=856769 2024-09-12T00:19:27.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.106+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=K3QFLEED3DC5 tag=ZXK4UTROJJNE type=write size=1905345 2024-09-12T00:19:27.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.106+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=I5FE242DFOGD type=del 2024-09-12T00:19:27.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.108+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=GI403S82C312 type=write size=412241 2024-09-12T00:19:27.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.109+0000 7f682945b780 -1 < failed to complete operation key=Y65K9I6K41X5 tag=RGH6L42O9M29 type=del size=3593982: (22) Invalid argument 2024-09-12T00:19:27.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.111+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=1056RTZMPF7G type=write size=27685 2024-09-12T00:19:27.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.112+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=XOOC3C69HH3R type=del 2024-09-12T00:19:27.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.113+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=WICZ28WFIPL3 type=del size=3797027 2024-09-12T00:19:27.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.114+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=L513I2SEAG15 type=del 2024-09-12T00:19:27.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.116+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=27TV304CBF1I type=del size=3544333 2024-09-12T00:19:27.116 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.117+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=2CV549Z9HQYS type=del 2024-09-12T00:19:27.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.119+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~CJPSCEMQKJ80.0 size=924603 2024-09-12T00:19:27.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.119+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=CJPSCEMQKJ80 tag=SK8SHRHUKRWD type=write size=1973179 2024-09-12T00:19:27.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.122+0000 7f682945b780 1 < suggested remove operation key=BFY578HP8GAW tag=HQS1SEBK1J9G type=write 2024-09-12T00:19:27.123 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.123+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=GKSC2I6QKMK7 type=write size=905761 2024-09-12T00:19:27.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.125+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~ISULLDLJQL4C.0 size=1048576 2024-09-12T00:19:27.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.126+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~ISULLDLJQL4C.1 size=204492 2024-09-12T00:19:27.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.128+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=ISULLDLJQL4C tag=8V20LB8TKQKT type=write size=2301644 2024-09-12T00:19:27.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.131+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~IM1HOXE46ZS3.0 size=944490 2024-09-12T00:19:27.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.131+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=IM1HOXE46ZS3 tag=30KFDDJMDGP7 type=write size=1993066 2024-09-12T00:19:27.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.132+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=HZO2SQKF37KI type=del 2024-09-12T00:19:27.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.136+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~8WCO7Y2C5F17.0 size=1048576 2024-09-12T00:19:27.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.137+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~8WCO7Y2C5F17.1 size=1048576 2024-09-12T00:19:27.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.138+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~8WCO7Y2C5F17.2 size=709772 2024-09-12T00:19:27.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.138+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=8WCO7Y2C5F17 tag=IFST5AT1YN37 type=write size=3855500 2024-09-12T00:19:27.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.141+0000 7f682945b780 1 < suggested remove operation key=R7V03ML1H80V tag=9AI2V36MK9KO type=del 2024-09-12T00:19:27.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.143+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~2Q7WB4AGVICR.0 size=1048576 2024-09-12T00:19:27.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.144+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~2Q7WB4AGVICR.1 size=1048576 2024-09-12T00:19:27.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.145+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~2Q7WB4AGVICR.2 size=811570 2024-09-12T00:19:27.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.145+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=2Q7WB4AGVICR tag=SK3UFZ9KIS5B type=write size=3957298 2024-09-12T00:19:27.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.147+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~74LU73UFU4ZX.0 size=722740 2024-09-12T00:19:27.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.150+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=74LU73UFU4ZX tag=FX0V6P0C60U5 type=write size=1771316 2024-09-12T00:19:27.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.152+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~Y20D6Q909KGB.0 size=356386 2024-09-12T00:19:27.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.152+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=Y20D6Q909KGB tag=9VOKCECGBNER type=write size=1404962 2024-09-12T00:19:27.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.154+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=1BNP72O9QL7Y type=del 2024-09-12T00:19:27.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.155+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=7IPB3T09TD1N type=del size=2614501 2024-09-12T00:19:27.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.158+0000 7f682945b780 1 < suggested update operation key=IYYTX8TCLF30 tag=X22G4IZ9YPO2 type=del size=897429 2024-09-12T00:19:27.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.161+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~MCZSIA1BM0ME.0 size=1048576 2024-09-12T00:19:27.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.162+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~MCZSIA1BM0ME.1 size=645718 2024-09-12T00:19:27.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.162+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=MCZSIA1BM0ME tag=PRSQVYK59RY6 type=write size=2742870 2024-09-12T00:19:27.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.163+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=S1EE1YR28HMF type=del 2024-09-12T00:19:27.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.165+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~QP3I5QKGL94Q.0 size=1048576 2024-09-12T00:19:27.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.167+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~QP3I5QKGL94Q.1 size=1048576 2024-09-12T00:19:27.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.168+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~QP3I5QKGL94Q.2 size=495575 2024-09-12T00:19:27.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.168+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=QP3I5QKGL94Q tag=RDLBRRNSRFQQ type=write size=3641303 2024-09-12T00:19:27.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.169+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=A5XF8D8NHLG3 type=del 2024-09-12T00:19:27.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.170+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=2WJM0HSYO2EI type=del size=1138786 2024-09-12T00:19:27.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.172+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=YLQM76AFTFYK type=del 2024-09-12T00:19:27.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.174+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~CXNIX5LRG0DT.0 size=974413 2024-09-12T00:19:27.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.174+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=CXNIX5LRG0DT tag=0QDF3IMXB6KE type=write size=2022989 2024-09-12T00:19:27.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.176+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~K3QFLEED3DC5.0 size=856769 2024-09-12T00:19:27.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.178+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=K3QFLEED3DC5 tag=ZXK4UTROJJNE type=write size=1905345 2024-09-12T00:19:27.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.179+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=5L71FZN98YGM type=del size=3288098 2024-09-12T00:19:27.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.181+0000 7f682945b780 1 < canceled operation key=JAVE3HR52R5C tag=GI403S82C312 type=write size=412241 2024-09-12T00:19:27.183 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.183+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~6TFW6T2M4DHI.0 size=1048576 2024-09-12T00:19:27.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.185+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~6TFW6T2M4DHI.1 size=1048576 2024-09-12T00:19:27.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.186+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~6TFW6T2M4DHI.2 size=103593 2024-09-12T00:19:27.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.186+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=6TFW6T2M4DHI tag=H71DJWMDYVNE type=write size=3249321 2024-09-12T00:19:27.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.187+0000 7f682945b780 1 < completed write operation key=COUJXCOSVPDS tag=1056RTZMPF7G type=write size=27685 2024-09-12T00:19:27.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.190+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~F737S6YO7UA6.0 size=1048576 2024-09-12T00:19:27.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.191+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~F737S6YO7UA6.1 size=1048576 2024-09-12T00:19:27.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.193+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~F737S6YO7UA6.2 size=87679 2024-09-12T00:19:27.192 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.193+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=F737S6YO7UA6 tag=TRR2BTY4AGWP type=write size=3233407 2024-09-12T00:19:27.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.195+0000 7f682945b780 1 < suggested remove operation key=BV3D543J63H1 tag=WICZ28WFIPL3 type=del 2024-09-12T00:19:27.195 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.197+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=L19LA54CJ29C type=del size=2381704 2024-09-12T00:19:27.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.197+0000 7f682945b780 -1 < failed to complete operation key=BFY578HP8GAW tag=27TV304CBF1I type=del size=3544333: (22) Invalid argument 2024-09-12T00:19:27.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.199+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=ETX1PP40HGZ8 type=del size=2933743 2024-09-12T00:19:27.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.200+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~CJPSCEMQKJ80.0 size=924603 2024-09-12T00:19:27.202 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.202+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=CJPSCEMQKJ80 tag=SK8SHRHUKRWD type=write size=1973179 2024-09-12T00:19:27.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.204+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=MJRN3BF40KJC type=write size=338395 2024-09-12T00:19:27.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.206+0000 7f682945b780 1 < completed write operation key=TGOBZH6DZK71 tag=GKSC2I6QKMK7 type=write size=905761 2024-09-12T00:19:27.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.207+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=5WHWZ4YSJIXL type=del size=1034547 2024-09-12T00:19:27.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.208+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~IM1HOXE46ZS3.0 size=944490 2024-09-12T00:19:27.211 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.211+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=IM1HOXE46ZS3 tag=30KFDDJMDGP7 type=write size=1993066 2024-09-12T00:19:27.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.213+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=I70NQBOS4HME type=del size=2040091 2024-09-12T00:19:27.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.214+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~8WCO7Y2C5F17.0 size=1048576 2024-09-12T00:19:27.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.215+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~8WCO7Y2C5F17.1 size=1048576 2024-09-12T00:19:27.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.216+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~8WCO7Y2C5F17.2 size=709772 2024-09-12T00:19:27.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.219+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=8WCO7Y2C5F17 tag=IFST5AT1YN37 type=write size=3855500 2024-09-12T00:19:27.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.220+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=8X3MQEQFL4XC type=del size=2124059 2024-09-12T00:19:27.221 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.221+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~2Q7WB4AGVICR.0 size=1048576 2024-09-12T00:19:27.221 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.221+0000 7f682945b780 1 < canceled part key=_multipart_JAVE3HR52R5C.2~2Q7WB4AGVICR.1 size=1048576 2024-09-12T00:19:27.222 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.223+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~2Q7WB4AGVICR.2 size=811570 2024-09-12T00:19:27.224 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.225+0000 7f682945b780 1 < canceled multipart upload key=JAVE3HR52R5C upload=2Q7WB4AGVICR tag=SK3UFZ9KIS5B type=write size=3957298 2024-09-12T00:19:27.228 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.228+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~3710RRCYXJK7.0 size=656974 2024-09-12T00:19:27.228 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.228+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=3710RRCYXJK7 tag=6O302K5XYU35 type=write size=1705550 2024-09-12T00:19:27.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.230+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~Y20D6Q909KGB.0 size=356386 2024-09-12T00:19:27.231 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.232+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=Y20D6Q909KGB tag=9VOKCECGBNER type=write size=1404962 2024-09-12T00:19:27.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.233+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=O5BJ707RF0YR type=del size=2585086 2024-09-12T00:19:27.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.234+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=7IPB3T09TD1N type=del 2024-09-12T00:19:27.237 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.237+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~OCR6JQJLZAAF.0 size=1048576 2024-09-12T00:19:27.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.238+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~OCR6JQJLZAAF.1 size=624327 2024-09-12T00:19:27.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.238+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=OCR6JQJLZAAF tag=E9TP8TWDDQRQ type=write size=2721479 2024-09-12T00:19:27.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.240+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~MCZSIA1BM0ME.0 size=1048576 2024-09-12T00:19:27.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.241+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~MCZSIA1BM0ME.1 size=645718 2024-09-12T00:19:27.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.243+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=MCZSIA1BM0ME tag=PRSQVYK59RY6 type=write size=2742870 2024-09-12T00:19:27.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.245+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~1N9EZHZKVAP0.0 size=654506 2024-09-12T00:19:27.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.245+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=1N9EZHZKVAP0 tag=ZR2A82VYW2GJ type=write size=1703082 2024-09-12T00:19:27.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.246+0000 7f682945b780 1 < canceled part key=_multipart_8D9UC8FJ16UK.2~QP3I5QKGL94Q.0 size=1048576 2024-09-12T00:19:27.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.247+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~QP3I5QKGL94Q.1 size=1048576 2024-09-12T00:19:27.247 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.248+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~QP3I5QKGL94Q.2 size=495575 2024-09-12T00:19:27.250 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.251+0000 7f682945b780 1 < canceled multipart upload key=8D9UC8FJ16UK upload=QP3I5QKGL94Q tag=RDLBRRNSRFQQ type=write size=3641303 2024-09-12T00:19:27.251 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.252+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=QXUPPBO4XCQE type=write size=466496 2024-09-12T00:19:27.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.253+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=2WJM0HSYO2EI type=del 2024-09-12T00:19:27.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.256+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~C8V10HTFGW8Y.0 size=1048576 2024-09-12T00:19:27.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.257+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~C8V10HTFGW8Y.1 size=1003839 2024-09-12T00:19:27.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.257+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=C8V10HTFGW8Y tag=M321CPZUW7GY type=write size=3100991 2024-09-12T00:19:27.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.259+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~CXNIX5LRG0DT.0 size=974413 2024-09-12T00:19:27.261 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.262+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=CXNIX5LRG0DT tag=0QDF3IMXB6KE type=write size=2022989 2024-09-12T00:19:27.263 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.264+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~F0LRP0UNW92C.0 size=1048576 2024-09-12T00:19:27.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.265+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~F0LRP0UNW92C.1 size=333338 2024-09-12T00:19:27.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.265+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=F0LRP0UNW92C tag=IR2TBDQRWM4M type=write size=2430490 2024-09-12T00:19:27.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.269+0000 7f682945b780 1 < suggested update operation key=38JJBFDTIYSU tag=5L71FZN98YGM type=del size=3288098 2024-09-12T00:19:27.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.271+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~Z2RZD0R6HIEI.0 size=1048576 2024-09-12T00:19:27.271 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.272+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~Z2RZD0R6HIEI.1 size=1048576 2024-09-12T00:19:27.272 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.273+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~Z2RZD0R6HIEI.2 size=191061 2024-09-12T00:19:27.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.273+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=Z2RZD0R6HIEI tag=B5KRWDXBGCMP type=write size=3336789 2024-09-12T00:19:27.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.274+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~6TFW6T2M4DHI.0 size=1048576 2024-09-12T00:19:27.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.276+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~6TFW6T2M4DHI.1 size=1048576 2024-09-12T00:19:27.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.276+0000 7f682945b780 1 < canceled part key=_multipart_TYNSP8BHYO65.2~6TFW6T2M4DHI.2 size=103593 2024-09-12T00:19:27.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.278+0000 7f682945b780 1 < canceled multipart upload key=TYNSP8BHYO65 upload=6TFW6T2M4DHI tag=H71DJWMDYVNE type=write size=3249321 2024-09-12T00:19:27.279 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.279+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=PIYDU91FA082 type=del size=2103328 2024-09-12T00:19:27.280 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.281+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~F737S6YO7UA6.0 size=1048576 2024-09-12T00:19:27.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.282+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~F737S6YO7UA6.1 size=1048576 2024-09-12T00:19:27.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.283+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~F737S6YO7UA6.2 size=87679 2024-09-12T00:19:27.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.286+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=F737S6YO7UA6 tag=TRR2BTY4AGWP type=write size=3233407 2024-09-12T00:19:27.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.287+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=SXB5UGFRG14U type=del size=121975 2024-09-12T00:19:27.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.289+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=L19LA54CJ29C type=del 2024-09-12T00:19:27.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.292+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~JDLQY79S0O04.0 size=1048576 2024-09-12T00:19:27.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.293+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~JDLQY79S0O04.1 size=860753 2024-09-12T00:19:27.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.293+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=JDLQY79S0O04 tag=CAKASOVECCU6 type=write size=2957905 2024-09-12T00:19:27.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.294+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=ETX1PP40HGZ8 type=del 2024-09-12T00:19:27.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.296+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=LKBXSPSPQBFI type=del size=3802590 2024-09-12T00:19:27.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.298+0000 7f682945b780 1 < completed write operation key=922B2PPJFX2Z tag=MJRN3BF40KJC type=write size=338395 2024-09-12T00:19:27.300 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.300+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~0LRXXAGZXG7S.0 size=1048576 2024-09-12T00:19:27.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.301+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~0LRXXAGZXG7S.1 size=1048576 2024-09-12T00:19:27.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.302+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~0LRXXAGZXG7S.2 size=552441 2024-09-12T00:19:27.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.302+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=0LRXXAGZXG7S tag=PUVG9VJ6XKDT type=write size=3698169 2024-09-12T00:19:27.303 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.304+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=5WHWZ4YSJIXL type=del 2024-09-12T00:19:27.304 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.305+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=AB43QLZA1EI5 type=write size=100717 2024-09-12T00:19:27.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.306+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=I70NQBOS4HME type=del 2024-09-12T00:19:27.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.309+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~25EDN85L3YCK.0 size=363316 2024-09-12T00:19:27.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.309+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=25EDN85L3YCK tag=0W194OXR0W83 type=write size=1411892 2024-09-12T00:19:27.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.310+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=8X3MQEQFL4XC type=del 2024-09-12T00:19:27.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.311+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=87N4XAB32TR1 type=write size=298392 2024-09-12T00:19:27.312 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.313+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~3710RRCYXJK7.0 size=656974 2024-09-12T00:19:27.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.315+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=3710RRCYXJK7 tag=6O302K5XYU35 type=write size=1705550 2024-09-12T00:19:27.317 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.319+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~X33OZTT2NEF2.0 size=1048576 2024-09-12T00:19:27.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.319+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~X33OZTT2NEF2.1 size=1048576 2024-09-12T00:19:27.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.320+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~X33OZTT2NEF2.2 size=57434 2024-09-12T00:19:27.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.320+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=X33OZTT2NEF2 tag=C7BSJCZU4N3Z type=write size=3203162 2024-09-12T00:19:27.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.322+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=O5BJ707RF0YR type=del 2024-09-12T00:19:27.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.323+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=3QWADGGNB9E7 type=write size=1048002 2024-09-12T00:19:27.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.324+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~OCR6JQJLZAAF.0 size=1048576 2024-09-12T00:19:27.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.326+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~OCR6JQJLZAAF.1 size=624327 2024-09-12T00:19:27.328 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.328+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=OCR6JQJLZAAF tag=E9TP8TWDDQRQ type=write size=2721479 2024-09-12T00:19:27.330 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.331+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~BWLU97PVWIS4.0 size=810377 2024-09-12T00:19:27.330 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.331+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=BWLU97PVWIS4 tag=VSCRIZJEQUGK type=write size=1858953 2024-09-12T00:19:27.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.332+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~1N9EZHZKVAP0.0 size=654506 2024-09-12T00:19:27.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.335+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=1N9EZHZKVAP0 tag=ZR2A82VYW2GJ type=write size=1703082 2024-09-12T00:19:27.336 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.336+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=FOVMH9LBFFCK type=write size=135461 2024-09-12T00:19:27.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.338+0000 7f682945b780 1 < completed write operation key=Z7408WO050VI tag=QXUPPBO4XCQE type=write size=466496 2024-09-12T00:19:27.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.340+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~00VMYVLYYV5R.0 size=110199 2024-09-12T00:19:27.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.340+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=00VMYVLYYV5R tag=F33FEBKN5VFN type=write size=1158775 2024-09-12T00:19:27.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.343+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~C8V10HTFGW8Y.0 size=1048576 2024-09-12T00:19:27.343 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.344+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~C8V10HTFGW8Y.1 size=1003839 2024-09-12T00:19:27.346 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.346+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=C8V10HTFGW8Y tag=M321CPZUW7GY type=write size=3100991 2024-09-12T00:19:27.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.348+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=2VEA1SU4FEL1 type=del size=2625517 2024-09-12T00:19:27.349 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.349+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~F0LRP0UNW92C.0 size=1048576 2024-09-12T00:19:27.350 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.350+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~F0LRP0UNW92C.1 size=333338 2024-09-12T00:19:27.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.352+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=F0LRP0UNW92C tag=IR2TBDQRWM4M type=write size=2430490 2024-09-12T00:19:27.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.355+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=X2YDEOP0EZ6U type=del size=2763163 2024-09-12T00:19:27.355 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.355+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~Z2RZD0R6HIEI.0 size=1048576 2024-09-12T00:19:27.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.356+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~Z2RZD0R6HIEI.1 size=1048576 2024-09-12T00:19:27.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.358+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~Z2RZD0R6HIEI.2 size=191061 2024-09-12T00:19:27.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.360+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=Z2RZD0R6HIEI tag=B5KRWDXBGCMP type=write size=3336789 2024-09-12T00:19:27.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.363+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~IT0924562JKI.0 size=90631 2024-09-12T00:19:27.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.363+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=IT0924562JKI tag=SU4M1SKI6PNE type=write size=1139207 2024-09-12T00:19:27.364 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.365+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=PIYDU91FA082 type=del 2024-09-12T00:19:27.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.367+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~7M2ZA9WD1SSP.0 size=1048576 2024-09-12T00:19:27.368 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.368+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~7M2ZA9WD1SSP.1 size=827997 2024-09-12T00:19:27.368 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.368+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=7M2ZA9WD1SSP tag=36HW95ISFSBW type=write size=2925149 2024-09-12T00:19:27.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.371+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=SXB5UGFRG14U type=del 2024-09-12T00:19:27.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.374+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~47FL6HMNLXMT.0 size=1048576 2024-09-12T00:19:27.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.375+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~47FL6HMNLXMT.1 size=1048576 2024-09-12T00:19:27.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.376+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~47FL6HMNLXMT.2 size=158084 2024-09-12T00:19:27.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.376+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=47FL6HMNLXMT tag=W64LJ0EZZK47 type=write size=3303812 2024-09-12T00:19:27.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.377+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~JDLQY79S0O04.0 size=1048576 2024-09-12T00:19:27.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.378+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~JDLQY79S0O04.1 size=860753 2024-09-12T00:19:27.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.381+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=JDLQY79S0O04 tag=CAKASOVECCU6 type=write size=2957905 2024-09-12T00:19:27.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.383+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~1R0KD1XMQDQ7.0 size=1048576 2024-09-12T00:19:27.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.385+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~1R0KD1XMQDQ7.1 size=1048576 2024-09-12T00:19:27.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.386+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~1R0KD1XMQDQ7.2 size=1030522 2024-09-12T00:19:27.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.386+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=1R0KD1XMQDQ7 tag=8WUA7O8AL2FA type=write size=4176250 2024-09-12T00:19:27.387 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.388+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=LKBXSPSPQBFI type=del 2024-09-12T00:19:27.388 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.389+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=PI1Z5O9J5DDW type=write size=48049 2024-09-12T00:19:27.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.390+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~0LRXXAGZXG7S.0 size=1048576 2024-09-12T00:19:27.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.391+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~0LRXXAGZXG7S.1 size=1048576 2024-09-12T00:19:27.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.392+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~0LRXXAGZXG7S.2 size=552441 2024-09-12T00:19:27.395 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.395+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=0LRXXAGZXG7S tag=PUVG9VJ6XKDT type=write size=3698169 2024-09-12T00:19:27.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.398+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~X9FDG3STWBA4.0 size=468507 2024-09-12T00:19:27.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.398+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=X9FDG3STWBA4 tag=Z2XH2OIU8V90 type=write size=1517083 2024-09-12T00:19:27.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.401+0000 7f682945b780 1 < suggested remove operation key=Y65K9I6K41X5 tag=AB43QLZA1EI5 type=write 2024-09-12T00:19:27.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.403+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=4EAFRNCG4SR4 type=write size=861457 2024-09-12T00:19:27.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.404+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~25EDN85L3YCK.0 size=363316 2024-09-12T00:19:27.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.407+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=25EDN85L3YCK tag=0W194OXR0W83 type=write size=1411892 2024-09-12T00:19:27.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.407+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=RT3ZRZ2Y82B9 type=write size=430349 2024-09-12T00:19:27.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.409+0000 7f682945b780 1 < canceled operation key=R2OAUUKLV7OK tag=87N4XAB32TR1 type=write size=298392 2024-09-12T00:19:27.411 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.412+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~L11YQB76JEYZ.0 size=1048576 2024-09-12T00:19:27.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.413+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~L11YQB76JEYZ.1 size=1048576 2024-09-12T00:19:27.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.414+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~L11YQB76JEYZ.2 size=679265 2024-09-12T00:19:27.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.414+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=L11YQB76JEYZ tag=S3AM671O0NM6 type=write size=3824993 2024-09-12T00:19:27.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.415+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~X33OZTT2NEF2.0 size=1048576 2024-09-12T00:19:27.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.416+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~X33OZTT2NEF2.1 size=1048576 2024-09-12T00:19:27.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.416+0000 7f682945b780 1 < canceled part key=_multipart_6DUQKU3R1RL8.2~X33OZTT2NEF2.2 size=57434 2024-09-12T00:19:27.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.419+0000 7f682945b780 1 < canceled multipart upload key=6DUQKU3R1RL8 upload=X33OZTT2NEF2 tag=C7BSJCZU4N3Z type=write size=3203162 2024-09-12T00:19:27.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.421+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~IMSU8775MCWO.0 size=20802 2024-09-12T00:19:27.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.421+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=IMSU8775MCWO tag=TU8ME1ZLT1NI type=write size=1069378 2024-09-12T00:19:27.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.423+0000 7f682945b780 1 < completed write operation key=3JFMN39G6TTF tag=3QWADGGNB9E7 type=write size=1048002 2024-09-12T00:19:27.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.425+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~U2YTHLB4HAT4.0 size=1048576 2024-09-12T00:19:27.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.426+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~U2YTHLB4HAT4.1 size=757538 2024-09-12T00:19:27.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.426+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=U2YTHLB4HAT4 tag=243KGB2M71MV type=write size=2854690 2024-09-12T00:19:27.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.428+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~BWLU97PVWIS4.0 size=810377 2024-09-12T00:19:27.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.430+0000 7f682945b780 1 < completed multipart upload key=8D9UC8FJ16UK upload=BWLU97PVWIS4 tag=VSCRIZJEQUGK type=write size=1858953 2024-09-12T00:19:27.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.434+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~JIXTLGLLBZEY.0 size=1048576 2024-09-12T00:19:27.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.434+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~JIXTLGLLBZEY.1 size=46439 2024-09-12T00:19:27.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.434+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=JIXTLGLLBZEY tag=RHVX98RN6343 type=write size=2143591 2024-09-12T00:19:27.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.435+0000 7f682945b780 -1 < failed to complete operation key=Y65K9I6K41X5 tag=FOVMH9LBFFCK type=write size=135461: (22) Invalid argument 2024-09-12T00:19:27.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.437+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=CWRS9QHYK7IP type=del size=2997918 2024-09-12T00:19:27.438 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.438+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~00VMYVLYYV5R.0 size=110199 2024-09-12T00:19:27.440 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.440+0000 7f682945b780 1 < completed multipart upload key=CT2L8L3849IN upload=00VMYVLYYV5R tag=F33FEBKN5VFN type=write size=1158775 2024-09-12T00:19:27.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.444+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~ZTZEXMCE9PM1.0 size=382316 2024-09-12T00:19:27.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.444+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=ZTZEXMCE9PM1 tag=1NHSKFRLGOTF type=write size=1430892 2024-09-12T00:19:27.444 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.445+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=2VEA1SU4FEL1 type=del 2024-09-12T00:19:27.445 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.446+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=XUZTF9M8UQUT type=del size=3818391 2024-09-12T00:19:27.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.447+0000 7f682945b780 1 < completed delete operation key=COUJXCOSVPDS tag=X2YDEOP0EZ6U type=del 2024-09-12T00:19:27.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.450+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~ZMCPGC9PADGB.0 size=1048576 2024-09-12T00:19:27.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.451+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~ZMCPGC9PADGB.1 size=1048576 2024-09-12T00:19:27.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.453+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~ZMCPGC9PADGB.2 size=653144 2024-09-12T00:19:27.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.453+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=ZMCPGC9PADGB tag=0E6GCS0AYWI1 type=write size=3798872 2024-09-12T00:19:27.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.454+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~IT0924562JKI.0 size=90631 2024-09-12T00:19:27.456 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.456+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=IT0924562JKI tag=SU4M1SKI6PNE type=write size=1139207 2024-09-12T00:19:27.457 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.458+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=97TZWB5CHEXI type=del size=877069 2024-09-12T00:19:27.459 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.459+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~7M2ZA9WD1SSP.0 size=1048576 2024-09-12T00:19:27.460 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.462+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~7M2ZA9WD1SSP.1 size=827997 2024-09-12T00:19:27.463 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.463+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=7M2ZA9WD1SSP tag=36HW95ISFSBW type=write size=2925149 2024-09-12T00:19:27.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.465+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=3XQOG0T1S50O type=del size=1918877 2024-09-12T00:19:27.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.466+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~47FL6HMNLXMT.0 size=1048576 2024-09-12T00:19:27.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.468+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~47FL6HMNLXMT.1 size=1048576 2024-09-12T00:19:27.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.468+0000 7f682945b780 1 < canceled part key=_multipart_CT2L8L3849IN.2~47FL6HMNLXMT.2 size=158084 2024-09-12T00:19:27.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.471+0000 7f682945b780 1 < canceled multipart upload key=CT2L8L3849IN upload=47FL6HMNLXMT tag=W64LJ0EZZK47 type=write size=3303812 2024-09-12T00:19:27.471 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.472+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=7692GJ3NRN49 type=del size=1944038 2024-09-12T00:19:27.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.473+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~1R0KD1XMQDQ7.0 size=1048576 2024-09-12T00:19:27.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.476+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~1R0KD1XMQDQ7.1 size=1048576 2024-09-12T00:19:27.476 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.477+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~1R0KD1XMQDQ7.2 size=1030522 2024-09-12T00:19:27.478 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.479+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=1R0KD1XMQDQ7 tag=8WUA7O8AL2FA type=write size=4176250 2024-09-12T00:19:27.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.481+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~T1MYAEDDFAP7.0 size=1048576 2024-09-12T00:19:27.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.482+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~T1MYAEDDFAP7.1 size=636994 2024-09-12T00:19:27.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.483+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=T1MYAEDDFAP7 tag=IU4RL2V6Z86V type=write size=2734146 2024-09-12T00:19:27.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.484+0000 7f682945b780 1 < completed write operation key=IYYTX8TCLF30 tag=PI1Z5O9J5DDW type=write size=48049 2024-09-12T00:19:27.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.486+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=6N1QK3YGUXY4 type=del size=3568994 2024-09-12T00:19:27.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.487+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~X9FDG3STWBA4.0 size=468507 2024-09-12T00:19:27.488 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.489+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=X9FDG3STWBA4 tag=Z2XH2OIU8V90 type=write size=1517083 2024-09-12T00:19:27.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.490+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=YY08DME0DNT7 type=write size=707072 2024-09-12T00:19:27.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.491+0000 7f682945b780 1 < completed write operation key=CT2L8L3849IN tag=4EAFRNCG4SR4 type=write size=861457 2024-09-12T00:19:27.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.493+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=YZ0WUK4HC4ZZ type=del size=2421394 2024-09-12T00:19:27.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.494+0000 7f682945b780 1 < completed write operation key=BK212Z99RM7F tag=RT3ZRZ2Y82B9 type=write size=430349 2024-09-12T00:19:27.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.498+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~H26D2US1TO2B.0 size=131225 2024-09-12T00:19:27.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.498+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=H26D2US1TO2B tag=HRP0I8IN0MWJ type=write size=1179801 2024-09-12T00:19:27.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.500+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~L11YQB76JEYZ.0 size=1048576 2024-09-12T00:19:27.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.501+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~L11YQB76JEYZ.1 size=1048576 2024-09-12T00:19:27.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.502+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~L11YQB76JEYZ.2 size=679265 2024-09-12T00:19:27.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.504+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=L11YQB76JEYZ tag=S3AM671O0NM6 type=write size=3824993 2024-09-12T00:19:27.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.507+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~OJNYHH6QLMMG.0 size=623787 2024-09-12T00:19:27.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.507+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=OJNYHH6QLMMG tag=O16RG5PE3GJG type=write size=1672363 2024-09-12T00:19:27.508 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.508+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~IMSU8775MCWO.0 size=20802 2024-09-12T00:19:27.510 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.512+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=IMSU8775MCWO tag=TU8ME1ZLT1NI type=write size=1069378 2024-09-12T00:19:27.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.515+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~BP62FZYGJ70E.0 size=1048576 2024-09-12T00:19:27.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.516+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~BP62FZYGJ70E.1 size=1048576 2024-09-12T00:19:27.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.517+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~BP62FZYGJ70E.2 size=458521 2024-09-12T00:19:27.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.517+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=BP62FZYGJ70E tag=D8L59WIA0TBK type=write size=3604249 2024-09-12T00:19:27.518 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.518+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~U2YTHLB4HAT4.0 size=1048576 2024-09-12T00:19:27.519 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.519+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~U2YTHLB4HAT4.1 size=757538 2024-09-12T00:19:27.521 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.522+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=U2YTHLB4HAT4 tag=243KGB2M71MV type=write size=2854690 2024-09-12T00:19:27.524 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.525+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~2N3S0QMC7ZON.0 size=1048576 2024-09-12T00:19:27.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.525+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~2N3S0QMC7ZON.1 size=781906 2024-09-12T00:19:27.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.525+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=2N3S0QMC7ZON tag=RFG4RZJX2SCN type=write size=2879058 2024-09-12T00:19:27.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.528+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~JIXTLGLLBZEY.0 size=1048576 2024-09-12T00:19:27.528 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.528+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~JIXTLGLLBZEY.1 size=46439 2024-09-12T00:19:27.530 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.531+0000 7f682945b780 1 < completed multipart upload key=6DUQKU3R1RL8 upload=JIXTLGLLBZEY tag=RHVX98RN6343 type=write size=2143591 2024-09-12T00:19:27.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.533+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=U9YNUBL8UD9O type=del size=2369768 2024-09-12T00:19:27.534 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.534+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=CWRS9QHYK7IP type=del 2024-09-12T00:19:27.536 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.537+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~AC44RA5OM47R.0 size=1048576 2024-09-12T00:19:27.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.538+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~AC44RA5OM47R.1 size=274875 2024-09-12T00:19:27.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.538+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=AC44RA5OM47R tag=H5PLFYBYVH14 type=write size=2372027 2024-09-12T00:19:27.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.539+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~ZTZEXMCE9PM1.0 size=382316 2024-09-12T00:19:27.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.543+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=ZTZEXMCE9PM1 tag=1NHSKFRLGOTF type=write size=1430892 2024-09-12T00:19:27.544 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.545+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~5BMY7TN6BBZ3.0 size=1048576 2024-09-12T00:19:27.545 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.546+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~5BMY7TN6BBZ3.1 size=1048576 2024-09-12T00:19:27.546 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.548+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~5BMY7TN6BBZ3.2 size=613723 2024-09-12T00:19:27.546 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.548+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=5BMY7TN6BBZ3 tag=ZXYUBWGW6PU7 type=write size=3759451 2024-09-12T00:19:27.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.549+0000 7f682945b780 1 < canceled operation key=Y65K9I6K41X5 tag=XUZTF9M8UQUT type=del size=3818391 2024-09-12T00:19:27.551 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.552+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~EVRJL4MNUBNW.0 size=1048576 2024-09-12T00:19:27.552 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.553+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~EVRJL4MNUBNW.1 size=1048576 2024-09-12T00:19:27.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.554+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~EVRJL4MNUBNW.2 size=474315 2024-09-12T00:19:27.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.554+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=EVRJL4MNUBNW tag=80AB72YRGT0Z type=write size=3620043 2024-09-12T00:19:27.555 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.555+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~ZMCPGC9PADGB.0 size=1048576 2024-09-12T00:19:27.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.557+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~ZMCPGC9PADGB.1 size=1048576 2024-09-12T00:19:27.557 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.557+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~ZMCPGC9PADGB.2 size=653144 2024-09-12T00:19:27.559 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.560+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=ZMCPGC9PADGB tag=0E6GCS0AYWI1 type=write size=3798872 2024-09-12T00:19:27.560 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.561+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=3XSI5IPKQ5VB type=write size=703519 2024-09-12T00:19:27.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.562+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=97TZWB5CHEXI type=del 2024-09-12T00:19:27.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.564+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=KX7R9VTG2Y1Q type=del size=3434678 2024-09-12T00:19:27.566 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.566+0000 7f682945b780 1 < suggested remove operation key=7RRJO383D8TH tag=3XQOG0T1S50O type=del 2024-09-12T00:19:27.567 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.569+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=EWRV1RBV5ONX type=del size=3008535 2024-09-12T00:19:27.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.569+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=7692GJ3NRN49 type=del 2024-09-12T00:19:27.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.571+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=QMX440YYXMOU type=del size=1320599 2024-09-12T00:19:27.572 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.572+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~T1MYAEDDFAP7.0 size=1048576 2024-09-12T00:19:27.573 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.574+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~T1MYAEDDFAP7.1 size=636994 2024-09-12T00:19:27.575 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.576+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=T1MYAEDDFAP7 tag=IU4RL2V6Z86V type=write size=2734146 2024-09-12T00:19:27.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.577+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=YT462H2SJM2U type=del size=1862617 2024-09-12T00:19:27.580 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.581+0000 7f682945b780 1 < suggested update operation key=9Q4HFV4F2KE2 tag=6N1QK3YGUXY4 type=del size=3568994 2024-09-12T00:19:27.581 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.582+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=TIRXCS2HJ30I type=write size=812100 2024-09-12T00:19:27.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.583+0000 7f682945b780 1 < completed write operation key=BK212Z99RM7F tag=YY08DME0DNT7 type=write size=707072 2024-09-12T00:19:27.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.584+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=1CMYXA17C83C type=del size=1752487 2024-09-12T00:19:27.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.586+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=YZ0WUK4HC4ZZ type=del 2024-09-12T00:19:27.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.589+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~Z563029ZKV9S.0 size=688465 2024-09-12T00:19:27.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.589+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=Z563029ZKV9S tag=S1OFP66YEI12 type=write size=1737041 2024-09-12T00:19:27.590 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.591+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~H26D2US1TO2B.0 size=131225 2024-09-12T00:19:27.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.592+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=H26D2US1TO2B tag=HRP0I8IN0MWJ type=write size=1179801 2024-09-12T00:19:27.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.595+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~FFSTS3V19C5D.0 size=1048576 2024-09-12T00:19:27.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.596+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~FFSTS3V19C5D.1 size=4210 2024-09-12T00:19:27.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.596+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=FFSTS3V19C5D tag=2OMJ8PIBE85B type=write size=2101362 2024-09-12T00:19:27.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.597+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~OJNYHH6QLMMG.0 size=623787 2024-09-12T00:19:27.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.599+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=OJNYHH6QLMMG tag=O16RG5PE3GJG type=write size=1672363 2024-09-12T00:19:27.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.602+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=CYEAT250RICG type=del size=872705 2024-09-12T00:19:27.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.602+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~BP62FZYGJ70E.0 size=1048576 2024-09-12T00:19:27.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.603+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~BP62FZYGJ70E.1 size=1048576 2024-09-12T00:19:27.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.604+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~BP62FZYGJ70E.2 size=458521 2024-09-12T00:19:27.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.608+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=BP62FZYGJ70E tag=D8L59WIA0TBK type=write size=3604249 2024-09-12T00:19:27.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.612+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~HFKC1H5P7OTG.0 size=393646 2024-09-12T00:19:27.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.612+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=HFKC1H5P7OTG tag=FINXI3ZZ3DXM type=write size=1442222 2024-09-12T00:19:27.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.613+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~2N3S0QMC7ZON.0 size=1048576 2024-09-12T00:19:27.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.614+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~2N3S0QMC7ZON.1 size=781906 2024-09-12T00:19:27.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.616+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=2N3S0QMC7ZON tag=RFG4RZJX2SCN type=write size=2879058 2024-09-12T00:19:27.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.619+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~WAH8LRGSDCS0.0 size=1048576 2024-09-12T00:19:27.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.620+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~WAH8LRGSDCS0.1 size=1048576 2024-09-12T00:19:27.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.621+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~WAH8LRGSDCS0.2 size=19073 2024-09-12T00:19:27.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.621+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=WAH8LRGSDCS0 tag=FZ3RPTWPSCNC type=write size=3164801 2024-09-12T00:19:27.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.622+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=U9YNUBL8UD9O type=del 2024-09-12T00:19:27.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.624+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=7FTB2N5CIF84 type=write size=830184 2024-09-12T00:19:27.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.626+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~AC44RA5OM47R.0 size=1048576 2024-09-12T00:19:27.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.626+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~AC44RA5OM47R.1 size=274875 2024-09-12T00:19:27.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.629+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=AC44RA5OM47R tag=H5PLFYBYVH14 type=write size=2372027 2024-09-12T00:19:27.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.630+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=0S2TVF3F2DOH type=del size=2798443 2024-09-12T00:19:27.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.632+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~5BMY7TN6BBZ3.0 size=1048576 2024-09-12T00:19:27.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.632+0000 7f682945b780 1 < canceled part key=_multipart_EYHGJ82COSE9.2~5BMY7TN6BBZ3.1 size=1048576 2024-09-12T00:19:27.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.634+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~5BMY7TN6BBZ3.2 size=613723 2024-09-12T00:19:27.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.635+0000 7f682945b780 1 < canceled multipart upload key=EYHGJ82COSE9 upload=5BMY7TN6BBZ3 tag=ZXYUBWGW6PU7 type=write size=3759451 2024-09-12T00:19:27.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.637+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=FSYOH25FHLZF type=del size=1324976 2024-09-12T00:19:27.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.638+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~EVRJL4MNUBNW.0 size=1048576 2024-09-12T00:19:27.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.639+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~EVRJL4MNUBNW.1 size=1048576 2024-09-12T00:19:27.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.640+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~EVRJL4MNUBNW.2 size=474315 2024-09-12T00:19:27.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.643+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=EVRJL4MNUBNW tag=80AB72YRGT0Z type=write size=3620043 2024-09-12T00:19:27.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.644+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=LOJBLDDGW4OT type=write size=201368 2024-09-12T00:19:27.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.645+0000 7f682945b780 1 < completed write operation key=BFY578HP8GAW tag=3XSI5IPKQ5VB type=write size=703519 2024-09-12T00:19:27.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.649+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~GE9CNMAXT86Z.0 size=1048576 2024-09-12T00:19:27.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.650+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~GE9CNMAXT86Z.1 size=15679 2024-09-12T00:19:27.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.650+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=GE9CNMAXT86Z tag=UVIWCS4L327H type=write size=2112831 2024-09-12T00:19:27.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.650+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=KX7R9VTG2Y1Q type=del 2024-09-12T00:19:27.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.653+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=GPSUMQYR5EYD type=del size=1760485 2024-09-12T00:19:27.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.654+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=EWRV1RBV5ONX type=del 2024-09-12T00:19:27.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.655+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=ZZ1IUO5D6F7M type=del size=3500005 2024-09-12T00:19:27.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.657+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=QMX440YYXMOU type=del 2024-09-12T00:19:27.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.658+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=ZMXG7ZVFVIRJ type=del size=3689557 2024-09-12T00:19:27.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.660+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=YT462H2SJM2U type=del 2024-09-12T00:19:27.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.661+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=RUZ8JZ5DVXLT type=del size=2868618 2024-09-12T00:19:27.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.663+0000 7f682945b780 1 < completed write operation key=JAVE3HR52R5C tag=TIRXCS2HJ30I type=write size=812100 2024-09-12T00:19:27.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.664+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=CJV0FRFC9ALE type=del size=1465751 2024-09-12T00:19:27.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.665+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=1CMYXA17C83C type=del 2024-09-12T00:19:27.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.667+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=SISSQWMUDV3A type=del size=858491 2024-09-12T00:19:27.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.668+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~Z563029ZKV9S.0 size=688465 2024-09-12T00:19:27.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.670+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=Z563029ZKV9S tag=S1OFP66YEI12 type=write size=1737041 2024-09-12T00:19:27.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.673+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~YHGDHGWHMEYN.0 size=1048576 2024-09-12T00:19:27.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.674+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~YHGDHGWHMEYN.1 size=719136 2024-09-12T00:19:27.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.674+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=YHGDHGWHMEYN tag=Z57F81R4TKN6 type=write size=2816288 2024-09-12T00:19:27.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.675+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~FFSTS3V19C5D.0 size=1048576 2024-09-12T00:19:27.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.677+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~FFSTS3V19C5D.1 size=4210 2024-09-12T00:19:27.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.678+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=FFSTS3V19C5D tag=2OMJ8PIBE85B type=write size=2101362 2024-09-12T00:19:27.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.680+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=MHS50QIDW6XX type=del size=3606854 2024-09-12T00:19:27.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.681+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=CYEAT250RICG type=del 2024-09-12T00:19:27.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.682+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=KAR4HEG6T45P type=del size=498038 2024-09-12T00:19:27.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.684+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~HFKC1H5P7OTG.0 size=393646 2024-09-12T00:19:27.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.686+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=HFKC1H5P7OTG tag=FINXI3ZZ3DXM type=write size=1442222 2024-09-12T00:19:27.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.688+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~FPFFH2EI8CIC.0 size=625557 2024-09-12T00:19:27.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.688+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=FPFFH2EI8CIC tag=6TM4Z5V90W2G type=write size=1674133 2024-09-12T00:19:27.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.690+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~WAH8LRGSDCS0.0 size=1048576 2024-09-12T00:19:27.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.690+0000 7f682945b780 1 < canceled part key=_multipart_3JFMN39G6TTF.2~WAH8LRGSDCS0.1 size=1048576 2024-09-12T00:19:27.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.691+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~WAH8LRGSDCS0.2 size=19073 2024-09-12T00:19:27.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.694+0000 7f682945b780 1 < canceled multipart upload key=3JFMN39G6TTF upload=WAH8LRGSDCS0 tag=FZ3RPTWPSCNC type=write size=3164801 2024-09-12T00:19:27.695 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.696+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~HNH537KUOPVI.0 size=1048576 2024-09-12T00:19:27.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.697+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~HNH537KUOPVI.1 size=130783 2024-09-12T00:19:27.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.697+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=HNH537KUOPVI tag=AREP5AK00JZT type=write size=2227935 2024-09-12T00:19:27.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.700+0000 7f682945b780 1 < suggested update operation key=8D9UC8FJ16UK tag=7FTB2N5CIF84 type=write size=830184 2024-09-12T00:19:27.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.701+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=EDLSCFR7DAZW type=del size=2149339 2024-09-12T00:19:27.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.703+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=0S2TVF3F2DOH type=del 2024-09-12T00:19:27.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.704+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=O0P3QFMVX62N type=del size=3667861 2024-09-12T00:19:27.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.705+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=FSYOH25FHLZF type=del 2024-09-12T00:19:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.707+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=KT2E9X24GADJ type=write size=861978 2024-09-12T00:19:27.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.710+0000 7f682945b780 1 < suggested remove operation key=9Q4HFV4F2KE2 tag=LOJBLDDGW4OT type=write 2024-09-12T00:19:27.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.711+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=VAISDJ3NU8EH type=del size=539035 2024-09-12T00:19:27.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.713+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~GE9CNMAXT86Z.0 size=1048576 2024-09-12T00:19:27.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.714+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~GE9CNMAXT86Z.1 size=15679 2024-09-12T00:19:27.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.716+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=GE9CNMAXT86Z tag=UVIWCS4L327H type=write size=2112831 2024-09-12T00:19:27.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.718+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~TN8TL48W2MUU.0 size=336072 2024-09-12T00:19:27.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.718+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=TN8TL48W2MUU tag=LGI68PLC18WM type=write size=1384648 2024-09-12T00:19:27.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.720+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=GPSUMQYR5EYD type=del 2024-09-12T00:19:27.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.721+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=P08UD8G5ZSPV type=del size=3768883 2024-09-12T00:19:27.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.723+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=ZZ1IUO5D6F7M type=del 2024-09-12T00:19:27.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.724+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=H1J5MFRBYN74 type=del size=2479620 2024-09-12T00:19:27.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.726+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=ZMXG7ZVFVIRJ type=del 2024-09-12T00:19:27.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.728+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~QSIU1X1XPS5F.0 size=1048576 2024-09-12T00:19:27.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.729+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~QSIU1X1XPS5F.1 size=9702 2024-09-12T00:19:27.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.729+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=QSIU1X1XPS5F tag=SFW21QQLGA3M type=write size=2106854 2024-09-12T00:19:27.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.731+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=RUZ8JZ5DVXLT type=del 2024-09-12T00:19:27.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.733+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~EEVR5BT1PMZJ.0 size=809615 2024-09-12T00:19:27.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.733+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=EEVR5BT1PMZJ tag=OJHR2088FQV9 type=write size=1858191 2024-09-12T00:19:27.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.735+0000 7f682945b780 1 < completed delete operation key=COUJXCOSVPDS tag=CJV0FRFC9ALE type=del 2024-09-12T00:19:27.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.737+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~BCQ880FRXZXH.0 size=1048576 2024-09-12T00:19:27.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.740+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~BCQ880FRXZXH.1 size=941892 2024-09-12T00:19:27.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.740+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=BCQ880FRXZXH tag=9LDHPJ0PG7I8 type=write size=3039044 2024-09-12T00:19:27.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.742+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=SISSQWMUDV3A type=del 2024-09-12T00:19:27.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.745+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=690AFP7OFNVE type=del size=3472297 2024-09-12T00:19:27.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.746+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~YHGDHGWHMEYN.0 size=1048576 2024-09-12T00:19:27.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.748+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~YHGDHGWHMEYN.1 size=719136 2024-09-12T00:19:27.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.751+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=YHGDHGWHMEYN tag=Z57F81R4TKN6 type=write size=2816288 2024-09-12T00:19:27.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.753+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~7S6MHODQVM5W.0 size=146490 2024-09-12T00:19:27.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.753+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=7S6MHODQVM5W tag=O1HN2JLFIOOC type=write size=1195066 2024-09-12T00:19:27.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.755+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=MHS50QIDW6XX type=del 2024-09-12T00:19:27.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.756+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=5IHX0NK1Q4JV type=del size=1331799 2024-09-12T00:19:27.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.759+0000 7f682945b780 1 < suggested remove operation key=SGWTWN8RTKDD tag=KAR4HEG6T45P type=del 2024-09-12T00:19:27.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.761+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=DH3HDQGKFUN9 type=del size=819484 2024-09-12T00:19:27.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.763+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~FPFFH2EI8CIC.0 size=625557 2024-09-12T00:19:27.765 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.765+0000 7f682945b780 1 < completed multipart upload key=D06ZUP2ZXX42 upload=FPFFH2EI8CIC tag=6TM4Z5V90W2G type=write size=1674133 2024-09-12T00:19:27.767 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.768+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~KLHNVNYQPDG9.0 size=1048576 2024-09-12T00:19:27.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.770+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~KLHNVNYQPDG9.1 size=795941 2024-09-12T00:19:27.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.770+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=KLHNVNYQPDG9 tag=UI4BC0T28U51 type=write size=2893093 2024-09-12T00:19:27.770 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.771+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~HNH537KUOPVI.0 size=1048576 2024-09-12T00:19:27.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.772+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~HNH537KUOPVI.1 size=130783 2024-09-12T00:19:27.774 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.775+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=HNH537KUOPVI tag=AREP5AK00JZT type=write size=2227935 2024-09-12T00:19:27.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.776+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=YN6P126LV2UZ type=del size=3565222 2024-09-12T00:19:27.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.777+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=EDLSCFR7DAZW type=del 2024-09-12T00:19:27.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.779+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=F1EZ3VT8FIY3 type=del size=415450 2024-09-12T00:19:27.780 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.780+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=O0P3QFMVX62N type=del 2024-09-12T00:19:27.781 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.782+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=5ZH3ADFHAUII type=del size=2514888 2024-09-12T00:19:27.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.783+0000 7f682945b780 1 < completed write operation key=D06ZUP2ZXX42 tag=KT2E9X24GADJ type=write size=861978 2024-09-12T00:19:27.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.785+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=NLPCYJ1LTZ4X type=del size=3306388 2024-09-12T00:19:27.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.788+0000 7f682945b780 1 < suggested update operation key=AZKLWMQ818SW tag=VAISDJ3NU8EH type=del size=539035 2024-09-12T00:19:27.789 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.789+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=3BNR47M4D9WY type=write size=712105 2024-09-12T00:19:27.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.792+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~TN8TL48W2MUU.0 size=336072 2024-09-12T00:19:27.793 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.793+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=TN8TL48W2MUU tag=LGI68PLC18WM type=write size=1384648 2024-09-12T00:19:27.795 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.796+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~00F0MFPGNYV8.0 size=1048576 2024-09-12T00:19:27.796 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.797+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~00F0MFPGNYV8.1 size=1048576 2024-09-12T00:19:27.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.798+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~00F0MFPGNYV8.2 size=743983 2024-09-12T00:19:27.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.798+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=00F0MFPGNYV8 tag=LBD3LA3HM23K type=write size=3889711 2024-09-12T00:19:27.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.799+0000 7f682945b780 1 < canceled operation key=7RRJO383D8TH tag=P08UD8G5ZSPV type=del size=3768883 2024-09-12T00:19:27.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.803+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~JZ3OHNJF1APO.0 size=1048576 2024-09-12T00:19:27.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.804+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~JZ3OHNJF1APO.1 size=1048576 2024-09-12T00:19:27.804 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.805+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~JZ3OHNJF1APO.2 size=197657 2024-09-12T00:19:27.804 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.805+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=JZ3OHNJF1APO tag=V0KHCEY37NQD type=write size=3343385 2024-09-12T00:19:27.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.808+0000 7f682945b780 1 < suggested update operation key=P56VIP3WIOJL tag=H1J5MFRBYN74 type=del size=2479620 2024-09-12T00:19:27.808 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.809+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=DWOKHX18R83P type=del size=4002520 2024-09-12T00:19:27.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.810+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~QSIU1X1XPS5F.0 size=1048576 2024-09-12T00:19:27.811 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.812+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~QSIU1X1XPS5F.1 size=9702 2024-09-12T00:19:27.813 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.814+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=QSIU1X1XPS5F tag=SFW21QQLGA3M type=write size=2106854 2024-09-12T00:19:27.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.816+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~9WG4UVZ5VI8Z.0 size=1048576 2024-09-12T00:19:27.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.817+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~9WG4UVZ5VI8Z.1 size=1048576 2024-09-12T00:19:27.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.818+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~9WG4UVZ5VI8Z.2 size=143775 2024-09-12T00:19:27.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.818+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=9WG4UVZ5VI8Z tag=2UV61Z3XZKS7 type=write size=3289503 2024-09-12T00:19:27.819 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.820+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~EEVR5BT1PMZJ.0 size=809615 2024-09-12T00:19:27.821 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.822+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=EEVR5BT1PMZJ tag=OJHR2088FQV9 type=write size=1858191 2024-09-12T00:19:27.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.823+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=ZGV26QYSJ8X0 type=del size=3077797 2024-09-12T00:19:27.825 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.826+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~BCQ880FRXZXH.0 size=1048576 2024-09-12T00:19:27.825 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.826+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~BCQ880FRXZXH.1 size=941892 2024-09-12T00:19:27.828 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.829+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=BCQ880FRXZXH tag=9LDHPJ0PG7I8 type=write size=3039044 2024-09-12T00:19:27.831 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.831+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~R1ZIGQWUECLP.0 size=1048576 2024-09-12T00:19:27.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.832+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~R1ZIGQWUECLP.1 size=810802 2024-09-12T00:19:27.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.832+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=R1ZIGQWUECLP tag=ZRY9RY9X5JFA type=write size=2907954 2024-09-12T00:19:27.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.834+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=690AFP7OFNVE type=del 2024-09-12T00:19:27.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.836+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~HX6WMTVTVBAX.0 size=1048576 2024-09-12T00:19:27.837 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.837+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~HX6WMTVTVBAX.1 size=1048576 2024-09-12T00:19:27.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.839+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~HX6WMTVTVBAX.2 size=401392 2024-09-12T00:19:27.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.839+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=HX6WMTVTVBAX tag=0V8TKHV1HN2M type=write size=3547120 2024-09-12T00:19:27.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.840+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~7S6MHODQVM5W.0 size=146490 2024-09-12T00:19:27.842 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.842+0000 7f682945b780 1 < completed multipart upload key=D06ZUP2ZXX42 upload=7S6MHODQVM5W tag=O1HN2JLFIOOC type=write size=1195066 2024-09-12T00:19:27.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.845+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~9AG1UESU9V79.0 size=1048576 2024-09-12T00:19:27.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.846+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~9AG1UESU9V79.1 size=1048576 2024-09-12T00:19:27.847 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.848+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~9AG1UESU9V79.2 size=588489 2024-09-12T00:19:27.847 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.848+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=9AG1UESU9V79 tag=XCOK67QTRHI3 type=write size=3734217 2024-09-12T00:19:27.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.850+0000 7f682945b780 1 < suggested update operation key=R2OAUUKLV7OK tag=5IHX0NK1Q4JV type=del size=1331799 2024-09-12T00:19:27.851 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.853+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=YO16ZZO3FJQR type=del size=2267258 2024-09-12T00:19:27.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.854+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=DH3HDQGKFUN9 type=del 2024-09-12T00:19:27.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.856+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~001A5VF07ZDW.0 size=1048576 2024-09-12T00:19:27.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.857+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~001A5VF07ZDW.1 size=1048576 2024-09-12T00:19:27.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.859+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~001A5VF07ZDW.2 size=203645 2024-09-12T00:19:27.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.859+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=001A5VF07ZDW tag=E3ZT1WEQM9B3 type=write size=3349373 2024-09-12T00:19:27.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.859+0000 7f682945b780 1 < canceled part key=_multipart_922B2PPJFX2Z.2~KLHNVNYQPDG9.0 size=1048576 2024-09-12T00:19:27.860 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.860+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~KLHNVNYQPDG9.1 size=795941 2024-09-12T00:19:27.862 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.862+0000 7f682945b780 1 < canceled multipart upload key=922B2PPJFX2Z upload=KLHNVNYQPDG9 tag=UI4BC0T28U51 type=write size=2893093 2024-09-12T00:19:27.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.865+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~5CJWX2KHNA1R.0 size=933423 2024-09-12T00:19:27.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.865+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=5CJWX2KHNA1R tag=FK0W2IAVSFR0 type=write size=1981999 2024-09-12T00:19:27.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.866+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=YN6P126LV2UZ type=del 2024-09-12T00:19:27.867 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.867+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=DCCA2JSIDM6G type=del size=886098 2024-09-12T00:19:27.869 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.869+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=F1EZ3VT8FIY3 type=del 2024-09-12T00:19:27.870 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.871+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=QVW2CT6CNK3C type=write size=906513 2024-09-12T00:19:27.871 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.872+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=5ZH3ADFHAUII type=del 2024-09-12T00:19:27.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.874+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=CNF70YG33JQK type=write size=480582 2024-09-12T00:19:27.875 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.876+0000 7f682945b780 -1 < failed to complete operation key=R2OAUUKLV7OK tag=NLPCYJ1LTZ4X type=del size=3306388: (22) Invalid argument 2024-09-12T00:19:27.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.878+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=3068HITFQ4R8 type=del size=1348655 2024-09-12T00:19:27.880 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.880+0000 7f682945b780 1 < completed write operation key=Y65K9I6K41X5 tag=3BNR47M4D9WY type=write size=712105 2024-09-12T00:19:27.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.884+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~PO01O6HIKSBS.0 size=345023 2024-09-12T00:19:27.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.884+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=PO01O6HIKSBS tag=E2JCJDPV3JXH type=write size=1393599 2024-09-12T00:19:27.884 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.885+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~00F0MFPGNYV8.0 size=1048576 2024-09-12T00:19:27.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.886+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~00F0MFPGNYV8.1 size=1048576 2024-09-12T00:19:27.886 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.887+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~00F0MFPGNYV8.2 size=743983 2024-09-12T00:19:27.889 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.889+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=00F0MFPGNYV8 tag=LBD3LA3HM23K type=write size=3889711 2024-09-12T00:19:27.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.891+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=VCSYA0E57QZR type=del size=2816211 2024-09-12T00:19:27.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.893+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~JZ3OHNJF1APO.0 size=1048576 2024-09-12T00:19:27.893 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.894+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~JZ3OHNJF1APO.1 size=1048576 2024-09-12T00:19:27.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.894+0000 7f682945b780 1 < canceled part key=_multipart_17S1X3WXCNAR.2~JZ3OHNJF1APO.2 size=197657 2024-09-12T00:19:27.896 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.896+0000 7f682945b780 1 < canceled multipart upload key=17S1X3WXCNAR upload=JZ3OHNJF1APO tag=V0KHCEY37NQD type=write size=3343385 2024-09-12T00:19:27.897 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.898+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=DTR340U9HMIO type=del size=973169 2024-09-12T00:19:27.899 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.899+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=DWOKHX18R83P type=del 2024-09-12T00:19:27.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.901+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=CXMM8OTWJ1Z7 type=del size=3933583 2024-09-12T00:19:27.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.903+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~9WG4UVZ5VI8Z.0 size=1048576 2024-09-12T00:19:27.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.904+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~9WG4UVZ5VI8Z.1 size=1048576 2024-09-12T00:19:27.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.905+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~9WG4UVZ5VI8Z.2 size=143775 2024-09-12T00:19:27.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.907+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=9WG4UVZ5VI8Z tag=2UV61Z3XZKS7 type=write size=3289503 2024-09-12T00:19:27.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.908+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=4K8I0AV8A2IY type=write size=320462 2024-09-12T00:19:27.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.910+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=ZGV26QYSJ8X0 type=del 2024-09-12T00:19:27.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.912+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~XL55B1L61FZ2.0 size=606985 2024-09-12T00:19:27.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.912+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=XL55B1L61FZ2 tag=FWD5M82BDS7Z type=write size=1655561 2024-09-12T00:19:27.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.912+0000 7f682945b780 1 < canceled part key=_multipart_1RAFARG1JXFQ.2~R1ZIGQWUECLP.0 size=1048576 2024-09-12T00:19:27.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.913+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~R1ZIGQWUECLP.1 size=810802 2024-09-12T00:19:27.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.916+0000 7f682945b780 1 < canceled multipart upload key=1RAFARG1JXFQ upload=R1ZIGQWUECLP tag=ZRY9RY9X5JFA type=write size=2907954 2024-09-12T00:19:27.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.917+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=PP0KI8O7JP53 type=del size=2235212 2024-09-12T00:19:27.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.919+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~HX6WMTVTVBAX.0 size=1048576 2024-09-12T00:19:27.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.920+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~HX6WMTVTVBAX.1 size=1048576 2024-09-12T00:19:27.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.921+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~HX6WMTVTVBAX.2 size=401392 2024-09-12T00:19:27.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.924+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=HX6WMTVTVBAX tag=0V8TKHV1HN2M type=write size=3547120 2024-09-12T00:19:27.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.925+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=2YJS222JYF66 type=del size=523201 2024-09-12T00:19:27.926 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.926+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~9AG1UESU9V79.0 size=1048576 2024-09-12T00:19:27.927 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.928+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~9AG1UESU9V79.1 size=1048576 2024-09-12T00:19:27.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.929+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~9AG1UESU9V79.2 size=588489 2024-09-12T00:19:27.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.931+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=9AG1UESU9V79 tag=XCOK67QTRHI3 type=write size=3734217 2024-09-12T00:19:27.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.932+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=9RC9GNHWJ622 type=del size=4076198 2024-09-12T00:19:27.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.934+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=YO16ZZO3FJQR type=del 2024-09-12T00:19:27.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.935+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=6H87GKAHL7L7 type=del size=2917557 2024-09-12T00:19:27.936 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.936+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~001A5VF07ZDW.0 size=1048576 2024-09-12T00:19:27.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.938+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~001A5VF07ZDW.1 size=1048576 2024-09-12T00:19:27.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.939+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~001A5VF07ZDW.2 size=203645 2024-09-12T00:19:27.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.941+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=001A5VF07ZDW tag=E3ZT1WEQM9B3 type=write size=3349373 2024-09-12T00:19:27.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.943+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~PISL53NQELG9.0 size=1048576 2024-09-12T00:19:27.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.944+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~PISL53NQELG9.1 size=787849 2024-09-12T00:19:27.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.945+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=PISL53NQELG9 tag=TDUUXW2XJAPZ type=write size=2885001 2024-09-12T00:19:27.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.946+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~5CJWX2KHNA1R.0 size=933423 2024-09-12T00:19:27.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.949+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=5CJWX2KHNA1R tag=FK0W2IAVSFR0 type=write size=1981999 2024-09-12T00:19:27.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.950+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=G0X001QZAHCZ type=del size=79627 2024-09-12T00:19:27.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.952+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=DCCA2JSIDM6G type=del 2024-09-12T00:19:27.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.953+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=1O4272H7HAHN type=del size=1704433 2024-09-12T00:19:27.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.955+0000 7f682945b780 1 < completed write operation key=1RAFARG1JXFQ tag=QVW2CT6CNK3C type=write size=906513 2024-09-12T00:19:27.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.958+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~GXGB417NQWEG.0 size=373758 2024-09-12T00:19:27.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.958+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=GXGB417NQWEG tag=U6ZCPY2TCDEL type=write size=1422334 2024-09-12T00:19:27.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.960+0000 7f682945b780 1 < completed write operation key=G0ONSUVW4M7R tag=CNF70YG33JQK type=write size=480582 2024-09-12T00:19:27.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.961+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=246WEM62T9CZ type=write size=4240 2024-09-12T00:19:27.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.963+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=3068HITFQ4R8 type=del 2024-09-12T00:19:27.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.965+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=IDYN106S0QGI type=del size=3093477 2024-09-12T00:19:27.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.966+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~PO01O6HIKSBS.0 size=345023 2024-09-12T00:19:27.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.969+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=PO01O6HIKSBS tag=E2JCJDPV3JXH type=write size=1393599 2024-09-12T00:19:27.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.972+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~Y49IV4LL4XZL.0 size=874693 2024-09-12T00:19:27.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.972+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=Y49IV4LL4XZL tag=COK8G8Y3JRDI type=write size=1923269 2024-09-12T00:19:27.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.973+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=VCSYA0E57QZR type=del 2024-09-12T00:19:27.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.975+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=FSBW5EQVSZAB type=write size=233695 2024-09-12T00:19:27.976 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.976+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=DTR340U9HMIO type=del 2024-09-12T00:19:27.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.978+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=FWSGUN1U1O02 type=write size=639814 2024-09-12T00:19:27.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.979+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=CXMM8OTWJ1Z7 type=del 2024-09-12T00:19:27.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.982+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~H1Z4AV018OA0.0 size=1027001 2024-09-12T00:19:27.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.982+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=H1Z4AV018OA0 tag=ZVQRAW5PBJPY type=write size=2075577 2024-09-12T00:19:27.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.983+0000 7f682945b780 1 < completed write operation key=COUJXCOSVPDS tag=4K8I0AV8A2IY type=write size=320462 2024-09-12T00:19:27.984 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.985+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=IGMOXJU765VC type=del size=385712 2024-09-12T00:19:27.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.986+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~XL55B1L61FZ2.0 size=606985 2024-09-12T00:19:27.988 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.988+0000 7f682945b780 1 < completed multipart upload key=D06ZUP2ZXX42 upload=XL55B1L61FZ2 tag=FWD5M82BDS7Z type=write size=1655561 2024-09-12T00:19:27.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.990+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=1SORM5Y0MXP7 type=del size=1790865 2024-09-12T00:19:27.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.992+0000 7f682945b780 1 < suggested update operation key=8D9UC8FJ16UK tag=PP0KI8O7JP53 type=del size=2235212 2024-09-12T00:19:27.994 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.995+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~3V7IK8054NUC.0 size=1048576 2024-09-12T00:19:27.995 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.997+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~3V7IK8054NUC.1 size=430792 2024-09-12T00:19:27.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.997+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=3V7IK8054NUC tag=OHKF9PTUYDRW type=write size=2527944 2024-09-12T00:19:27.997 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.997+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=2YJS222JYF66 type=del 2024-09-12T00:19:27.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:27.999+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=Q3JP31YE1SR5 type=del size=3566425 2024-09-12T00:19:28.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.001+0000 7f682945b780 1 < suggested update operation key=BV3D543J63H1 tag=9RC9GNHWJ622 type=del size=4076198 2024-09-12T00:19:28.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.004+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~X58J2K8BVIDI.0 size=1048576 2024-09-12T00:19:28.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.005+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~X58J2K8BVIDI.1 size=986277 2024-09-12T00:19:28.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.005+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=X58J2K8BVIDI tag=TZJJLBS52B2S type=write size=3083429 2024-09-12T00:19:28.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.006+0000 7f682945b780 -1 < failed to complete operation key=8D9UC8FJ16UK tag=6H87GKAHL7L7 type=del size=2917557: (22) Invalid argument 2024-09-12T00:19:28.008 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.009+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~RFLGDS7F2N8Q.0 size=1048576 2024-09-12T00:19:28.009 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.009+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~RFLGDS7F2N8Q.1 size=654391 2024-09-12T00:19:28.009 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.009+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=RFLGDS7F2N8Q tag=TSJBDTNS87TO type=write size=2751543 2024-09-12T00:19:28.010 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.011+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~PISL53NQELG9.0 size=1048576 2024-09-12T00:19:28.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.014+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~PISL53NQELG9.1 size=787849 2024-09-12T00:19:28.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.015+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=PISL53NQELG9 tag=TDUUXW2XJAPZ type=write size=2885001 2024-09-12T00:19:28.016 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.016+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=3A3QZ2KF72X5 type=del size=3662982 2024-09-12T00:19:28.019 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.019+0000 7f682945b780 1 < suggested remove operation key=3JFMN39G6TTF tag=G0X001QZAHCZ type=del 2024-09-12T00:19:28.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.021+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=BFQCCH7QFARA type=del size=3211390 2024-09-12T00:19:28.023 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.023+0000 7f682945b780 1 < suggested remove operation key=TYNSP8BHYO65 tag=1O4272H7HAHN type=del 2024-09-12T00:19:28.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.025+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=JOJ5YX0R7Y5S type=del size=4042565 2024-09-12T00:19:28.026 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.026+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~GXGB417NQWEG.0 size=373758 2024-09-12T00:19:28.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.029+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=GXGB417NQWEG tag=U6ZCPY2TCDEL type=write size=1422334 2024-09-12T00:19:28.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.030+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=6DYP23ZDN6SI type=del size=1519651 2024-09-12T00:19:28.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.032+0000 7f682945b780 1 < completed write operation key=R2OAUUKLV7OK tag=246WEM62T9CZ type=write size=4240 2024-09-12T00:19:28.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.032+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=5RTSN3U1BUT4 type=del size=746375 2024-09-12T00:19:28.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.034+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=IDYN106S0QGI type=del 2024-09-12T00:19:28.035 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.035+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=W7P3L6ICB6AC type=del size=1352901 2024-09-12T00:19:28.036 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.037+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~Y49IV4LL4XZL.0 size=874693 2024-09-12T00:19:28.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.039+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=Y49IV4LL4XZL tag=COK8G8Y3JRDI type=write size=1923269 2024-09-12T00:19:28.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.040+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=I9WF8Z0UKWJH type=write size=453635 2024-09-12T00:19:28.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.043+0000 7f682945b780 1 < suggested remove operation key=IUPAGGPATJB4 tag=FSBW5EQVSZAB type=write 2024-09-12T00:19:28.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.044+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=5LC5BUD8LUI7 type=del size=2830525 2024-09-12T00:19:28.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.046+0000 7f682945b780 1 < canceled operation key=6DUQKU3R1RL8 tag=FWSGUN1U1O02 type=write size=639814 2024-09-12T00:19:28.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.049+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~TT4R1PWRXCW9.0 size=1048576 2024-09-12T00:19:28.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.049+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~TT4R1PWRXCW9.1 size=471641 2024-09-12T00:19:28.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.049+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=TT4R1PWRXCW9 tag=ISAEMZWJQQ28 type=write size=2568793 2024-09-12T00:19:28.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.051+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~H1Z4AV018OA0.0 size=1027001 2024-09-12T00:19:28.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.054+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=H1Z4AV018OA0 tag=ZVQRAW5PBJPY type=write size=2075577 2024-09-12T00:19:28.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.055+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=6UD7LYTKKNWM type=del size=2889952 2024-09-12T00:19:28.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.056+0000 7f682945b780 -1 < failed to complete operation key=TYNSP8BHYO65 tag=IGMOXJU765VC type=del size=385712: (22) Invalid argument 2024-09-12T00:19:28.057 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.058+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=HJE59JPVGN07 type=del size=2257258 2024-09-12T00:19:28.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.059+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=1SORM5Y0MXP7 type=del 2024-09-12T00:19:28.060 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.061+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=6RSRJFIGKENC type=write size=654229 2024-09-12T00:19:28.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.062+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~3V7IK8054NUC.0 size=1048576 2024-09-12T00:19:28.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.064+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~3V7IK8054NUC.1 size=430792 2024-09-12T00:19:28.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.066+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=3V7IK8054NUC tag=OHKF9PTUYDRW type=write size=2527944 2024-09-12T00:19:28.067 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.067+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=31Q5V83LP87Q type=del size=683090 2024-09-12T00:19:28.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.069+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=Q3JP31YE1SR5 type=del 2024-09-12T00:19:28.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.071+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~RYVIBFO5X0AI.0 size=974091 2024-09-12T00:19:28.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.071+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=RYVIBFO5X0AI tag=OROF6PP8DWEY type=write size=2022667 2024-09-12T00:19:28.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.073+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~X58J2K8BVIDI.0 size=1048576 2024-09-12T00:19:28.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.073+0000 7f682945b780 1 < canceled part key=_multipart_8D9UC8FJ16UK.2~X58J2K8BVIDI.1 size=986277 2024-09-12T00:19:28.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.076+0000 7f682945b780 1 < canceled multipart upload key=8D9UC8FJ16UK upload=X58J2K8BVIDI tag=TZJJLBS52B2S type=write size=3083429 2024-09-12T00:19:28.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.076+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=RYBQ27ARSX6B type=del size=1764666 2024-09-12T00:19:28.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.078+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~RFLGDS7F2N8Q.0 size=1048576 2024-09-12T00:19:28.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.079+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~RFLGDS7F2N8Q.1 size=654391 2024-09-12T00:19:28.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.082+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=RFLGDS7F2N8Q tag=TSJBDTNS87TO type=write size=2751543 2024-09-12T00:19:28.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.082+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=CVOR5YN1V3F0 type=del size=2779417 2024-09-12T00:19:28.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.084+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=3A3QZ2KF72X5 type=del 2024-09-12T00:19:28.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.086+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=8WBWAC9C49IV type=write size=594327 2024-09-12T00:19:28.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.087+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=BFQCCH7QFARA type=del 2024-09-12T00:19:28.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.090+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~ISYFXKKHTMMP.0 size=1008664 2024-09-12T00:19:28.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.090+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=ISYFXKKHTMMP tag=85479AO8LX6C type=write size=2057240 2024-09-12T00:19:28.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.091+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=JOJ5YX0R7Y5S type=del 2024-09-12T00:19:28.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.093+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=546X9EZ94EYE type=write size=168378 2024-09-12T00:19:28.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.094+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=6DYP23ZDN6SI type=del 2024-09-12T00:19:28.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.096+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=7IL1NM4TAYX2 type=write size=191254 2024-09-12T00:19:28.096 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.097+0000 7f682945b780 -1 < failed to complete operation key=IUPAGGPATJB4 tag=5RTSN3U1BUT4 type=del size=746375: (22) Invalid argument 2024-09-12T00:19:28.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.100+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~K1AR0EWZH8DS.0 size=138935 2024-09-12T00:19:28.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.100+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=K1AR0EWZH8DS tag=HNQ9G8IPEEX8 type=write size=1187511 2024-09-12T00:19:28.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.103+0000 7f682945b780 1 < suggested update operation key=8D9UC8FJ16UK tag=W7P3L6ICB6AC type=del size=1352901 2024-09-12T00:19:28.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.106+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~C1KLHXYKGIU6.0 size=1048576 2024-09-12T00:19:28.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.107+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~C1KLHXYKGIU6.1 size=845874 2024-09-12T00:19:28.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.107+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=C1KLHXYKGIU6 tag=A15N3J8ZDDJX type=write size=2943026 2024-09-12T00:19:28.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.108+0000 7f682945b780 1 < completed write operation key=BV3D543J63H1 tag=I9WF8Z0UKWJH type=write size=453635 2024-09-12T00:19:28.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.110+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~62SCM3VXI66P.0 size=1048576 2024-09-12T00:19:28.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.111+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~62SCM3VXI66P.1 size=892209 2024-09-12T00:19:28.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.111+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=62SCM3VXI66P tag=Z9ONL7C56E6N type=write size=2989361 2024-09-12T00:19:28.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.114+0000 7f682945b780 1 < suggested remove operation key=AZKLWMQ818SW tag=5LC5BUD8LUI7 type=del 2024-09-12T00:19:28.116 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.117+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~TI9ORER3DYPY.0 size=1048576 2024-09-12T00:19:28.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.118+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~TI9ORER3DYPY.1 size=1048576 2024-09-12T00:19:28.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.119+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~TI9ORER3DYPY.2 size=231334 2024-09-12T00:19:28.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.119+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=TI9ORER3DYPY tag=ECHNS6VXVKJU type=write size=3377062 2024-09-12T00:19:28.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.120+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~TT4R1PWRXCW9.0 size=1048576 2024-09-12T00:19:28.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.121+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~TT4R1PWRXCW9.1 size=471641 2024-09-12T00:19:28.123 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.124+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=TT4R1PWRXCW9 tag=ISAEMZWJQQ28 type=write size=2568793 2024-09-12T00:19:28.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.125+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=6094FNVBWURO type=del size=814815 2024-09-12T00:19:28.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.126+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=6UD7LYTKKNWM type=del 2024-09-12T00:19:28.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.128+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=887GI5FF4OLM type=del size=3828042 2024-09-12T00:19:28.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.130+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=HJE59JPVGN07 type=del 2024-09-12T00:19:28.133 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.131+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=6G3UH0FBA8VL type=del size=36115 2024-09-12T00:19:28.133 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.132+0000 7f682945b780 1 < completed write operation key=TYNSP8BHYO65 tag=6RSRJFIGKENC type=write size=654229 2024-09-12T00:19:28.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.135+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~IYURJ6MGDAIA.0 size=1048576 2024-09-12T00:19:28.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.136+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~IYURJ6MGDAIA.1 size=1048576 2024-09-12T00:19:28.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.137+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~IYURJ6MGDAIA.2 size=374746 2024-09-12T00:19:28.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.137+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=IYURJ6MGDAIA tag=AQNNURRJUEC7 type=write size=3520474 2024-09-12T00:19:28.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.138+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=31Q5V83LP87Q type=del 2024-09-12T00:19:28.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.140+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=506Q2JU2GNV7 type=del size=2593797 2024-09-12T00:19:28.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.141+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~RYVIBFO5X0AI.0 size=974091 2024-09-12T00:19:28.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.143+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=RYVIBFO5X0AI tag=OROF6PP8DWEY type=write size=2022667 2024-09-12T00:19:28.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.146+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=TYLA2CL80YKY type=write size=861954 2024-09-12T00:19:28.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.149+0000 7f682945b780 1 < suggested update operation key=8D9UC8FJ16UK tag=RYBQ27ARSX6B type=del size=1764666 2024-09-12T00:19:28.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.152+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~HRK755ITEDEB.0 size=1048576 2024-09-12T00:19:28.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.154+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~HRK755ITEDEB.1 size=1048576 2024-09-12T00:19:28.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.154+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~HRK755ITEDEB.2 size=971647 2024-09-12T00:19:28.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.154+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=HRK755ITEDEB tag=RM7MZKE8L59S type=write size=4117375 2024-09-12T00:19:28.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.155+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=CVOR5YN1V3F0 type=del 2024-09-12T00:19:28.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.157+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=KISWRSF95866 type=del size=166758 2024-09-12T00:19:28.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.159+0000 7f682945b780 1 < completed write operation key=IUPAGGPATJB4 tag=8WBWAC9C49IV type=write size=594327 2024-09-12T00:19:28.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.160+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=3QMV2U2QT3NI type=del size=3347867 2024-09-12T00:19:28.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.160+0000 7f682945b780 1 < canceled part key=_multipart_9Q4HFV4F2KE2.2~ISYFXKKHTMMP.0 size=1008664 2024-09-12T00:19:28.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.162+0000 7f682945b780 1 < canceled multipart upload key=9Q4HFV4F2KE2 upload=ISYFXKKHTMMP tag=85479AO8LX6C type=write size=2057240 2024-09-12T00:19:28.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.164+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=HZICFLU50DW7 type=del size=1470976 2024-09-12T00:19:28.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.165+0000 7f682945b780 1 < completed write operation key=IYYTX8TCLF30 tag=546X9EZ94EYE type=write size=168378 2024-09-12T00:19:28.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.169+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~LCDDZEMCQ5AU.0 size=1048576 2024-09-12T00:19:28.169 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.169+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~LCDDZEMCQ5AU.1 size=381470 2024-09-12T00:19:28.169 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.169+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=LCDDZEMCQ5AU tag=B03VHDONYWWP type=write size=2478622 2024-09-12T00:19:28.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.171+0000 7f682945b780 1 < completed write operation key=IYYTX8TCLF30 tag=7IL1NM4TAYX2 type=write size=191254 2024-09-12T00:19:28.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.172+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=DZ3XU67YM14D type=del size=855451 2024-09-12T00:19:28.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.174+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~K1AR0EWZH8DS.0 size=138935 2024-09-12T00:19:28.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.176+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=K1AR0EWZH8DS tag=HNQ9G8IPEEX8 type=write size=1187511 2024-09-12T00:19:28.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.177+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=UC7HFLMYHW14 type=del size=1574296 2024-09-12T00:19:28.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.178+0000 7f682945b780 1 < canceled part key=_multipart_AZKLWMQ818SW.2~C1KLHXYKGIU6.0 size=1048576 2024-09-12T00:19:28.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.179+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~C1KLHXYKGIU6.1 size=845874 2024-09-12T00:19:28.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.181+0000 7f682945b780 1 < canceled multipart upload key=AZKLWMQ818SW upload=C1KLHXYKGIU6 tag=A15N3J8ZDDJX type=write size=2943026 2024-09-12T00:19:28.183 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.184+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~3OIWHMCD7603.0 size=1048576 2024-09-12T00:19:28.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.185+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~3OIWHMCD7603.1 size=1048576 2024-09-12T00:19:28.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.186+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~3OIWHMCD7603.2 size=772665 2024-09-12T00:19:28.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.186+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=3OIWHMCD7603 tag=JMJR5ODI7C2B type=write size=3918393 2024-09-12T00:19:28.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.187+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~62SCM3VXI66P.0 size=1048576 2024-09-12T00:19:28.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.189+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~62SCM3VXI66P.1 size=892209 2024-09-12T00:19:28.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.191+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=62SCM3VXI66P tag=Z9ONL7C56E6N type=write size=2989361 2024-09-12T00:19:28.192 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.192+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=Y05TD8UD0K38 type=del size=3989869 2024-09-12T00:19:28.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.195+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~TI9ORER3DYPY.0 size=1048576 2024-09-12T00:19:28.195 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.195+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~TI9ORER3DYPY.1 size=1048576 2024-09-12T00:19:28.196 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.196+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~TI9ORER3DYPY.2 size=231334 2024-09-12T00:19:28.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.199+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=TI9ORER3DYPY tag=ECHNS6VXVKJU type=write size=3377062 2024-09-12T00:19:28.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.201+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~DBT81EHQFKXB.0 size=768861 2024-09-12T00:19:28.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.201+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=DBT81EHQFKXB tag=A32D4M2HBIPO type=write size=1817437 2024-09-12T00:19:28.202 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.202+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=6094FNVBWURO type=del 2024-09-12T00:19:28.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.203+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=LP0QKLK525FL type=write size=555600 2024-09-12T00:19:28.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.205+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=887GI5FF4OLM type=del 2024-09-12T00:19:28.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.207+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~HMMFLLVX2MBC.0 size=233473 2024-09-12T00:19:28.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.207+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=HMMFLLVX2MBC tag=HH457QNE5J65 type=write size=1282049 2024-09-12T00:19:28.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.210+0000 7f682945b780 1 < suggested remove operation key=TYNSP8BHYO65 tag=6G3UH0FBA8VL type=del 2024-09-12T00:19:28.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.212+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~G8X32B4WAJNT.0 size=1048576 2024-09-12T00:19:28.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.213+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~G8X32B4WAJNT.1 size=1048576 2024-09-12T00:19:28.213 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.214+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~G8X32B4WAJNT.2 size=261445 2024-09-12T00:19:28.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.214+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=G8X32B4WAJNT tag=5L7OTWXZYKJ2 type=write size=3407173 2024-09-12T00:19:28.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.216+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~IYURJ6MGDAIA.0 size=1048576 2024-09-12T00:19:28.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.217+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~IYURJ6MGDAIA.1 size=1048576 2024-09-12T00:19:28.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.218+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~IYURJ6MGDAIA.2 size=374746 2024-09-12T00:19:28.220 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.221+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=IYURJ6MGDAIA tag=AQNNURRJUEC7 type=write size=3520474 2024-09-12T00:19:28.221 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.222+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=B5DTSZQ41JO7 type=del size=1107963 2024-09-12T00:19:28.223 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.223+0000 7f682945b780 1 < canceled operation key=IYYTX8TCLF30 tag=506Q2JU2GNV7 type=del size=2593797 2024-09-12T00:19:28.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.226+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~V9KSSPVFFS5B.0 size=1048576 2024-09-12T00:19:28.227 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.227+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~V9KSSPVFFS5B.1 size=397972 2024-09-12T00:19:28.227 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.227+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=V9KSSPVFFS5B tag=N7RDDVH5AO7O type=write size=2495124 2024-09-12T00:19:28.228 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.229+0000 7f682945b780 1 < completed write operation key=38JJBFDTIYSU tag=TYLA2CL80YKY type=write size=861954 2024-09-12T00:19:28.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.230+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=8SRUHAWIGKLI type=del size=2710135 2024-09-12T00:19:28.231 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.231+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~HRK755ITEDEB.0 size=1048576 2024-09-12T00:19:28.232 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.233+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~HRK755ITEDEB.1 size=1048576 2024-09-12T00:19:28.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.234+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~HRK755ITEDEB.2 size=971647 2024-09-12T00:19:28.236 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.237+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=HRK755ITEDEB tag=RM7MZKE8L59S type=write size=4117375 2024-09-12T00:19:28.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.239+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~J9INTTOWARJ1.0 size=864602 2024-09-12T00:19:28.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.239+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=J9INTTOWARJ1 tag=GN0KFTSLH6KY type=write size=1913178 2024-09-12T00:19:28.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.241+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=KISWRSF95866 type=del 2024-09-12T00:19:28.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.243+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~HTY2G3RGIK24.0 size=1048576 2024-09-12T00:19:28.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.244+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~HTY2G3RGIK24.1 size=669848 2024-09-12T00:19:28.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.244+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=HTY2G3RGIK24 tag=VH52A8BIQBJR type=write size=2767000 2024-09-12T00:19:28.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.246+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=3QMV2U2QT3NI type=del 2024-09-12T00:19:28.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.249+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~UNHYX19VLGH1.0 size=1048576 2024-09-12T00:19:28.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.250+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~UNHYX19VLGH1.1 size=1048576 2024-09-12T00:19:28.250 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.251+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~UNHYX19VLGH1.2 size=306529 2024-09-12T00:19:28.250 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.251+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=UNHYX19VLGH1 tag=64BYZ05YVB2E type=write size=3452257 2024-09-12T00:19:28.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.252+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=HZICFLU50DW7 type=del 2024-09-12T00:19:28.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.254+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=NOSO5MKMYGYY type=del size=2184010 2024-09-12T00:19:28.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.256+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~LCDDZEMCQ5AU.0 size=1048576 2024-09-12T00:19:28.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.257+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~LCDDZEMCQ5AU.1 size=381470 2024-09-12T00:19:28.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.260+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=LCDDZEMCQ5AU tag=B03VHDONYWWP type=write size=2478622 2024-09-12T00:19:28.260 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.260+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=QVMVYX19U8S7 type=write size=583008 2024-09-12T00:19:28.261 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.262+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=DZ3XU67YM14D type=del 2024-09-12T00:19:28.263 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.263+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=6X75JDW78T1Y type=del size=1162727 2024-09-12T00:19:28.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.265+0000 7f682945b780 1 < canceled operation key=COUJXCOSVPDS tag=UC7HFLMYHW14 type=del size=1574296 2024-09-12T00:19:28.266 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.267+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=UFY9MTHF1QMX type=del size=910829 2024-09-12T00:19:28.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.269+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~3OIWHMCD7603.0 size=1048576 2024-09-12T00:19:28.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.271+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~3OIWHMCD7603.1 size=1048576 2024-09-12T00:19:28.271 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.272+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~3OIWHMCD7603.2 size=772665 2024-09-12T00:19:28.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.274+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=3OIWHMCD7603 tag=JMJR5ODI7C2B type=write size=3918393 2024-09-12T00:19:28.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.277+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~RXGFFK7THYLG.0 size=1048576 2024-09-12T00:19:28.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.279+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~RXGFFK7THYLG.1 size=1048576 2024-09-12T00:19:28.279 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.280+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~RXGFFK7THYLG.2 size=17898 2024-09-12T00:19:28.279 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.280+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=RXGFFK7THYLG tag=HINBATQGDOAV type=write size=3163626 2024-09-12T00:19:28.282 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.282+0000 7f682945b780 1 < suggested remove operation key=8D9UC8FJ16UK tag=Y05TD8UD0K38 type=del 2024-09-12T00:19:28.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.285+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~OR23A4SOWP3Y.0 size=1048576 2024-09-12T00:19:28.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.286+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~OR23A4SOWP3Y.1 size=919246 2024-09-12T00:19:28.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.286+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=OR23A4SOWP3Y tag=IGQTGIBZZWQJ type=write size=3016398 2024-09-12T00:19:28.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.287+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~DBT81EHQFKXB.0 size=768861 2024-09-12T00:19:28.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.289+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=DBT81EHQFKXB tag=A32D4M2HBIPO type=write size=1817437 2024-09-12T00:19:28.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.292+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~P6URCQ93V14Q.0 size=1048576 2024-09-12T00:19:28.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.293+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~P6URCQ93V14Q.1 size=691727 2024-09-12T00:19:28.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.293+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=P6URCQ93V14Q tag=I664QLEKI7KJ type=write size=2788879 2024-09-12T00:19:28.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.296+0000 7f682945b780 1 < completed write operation key=7RRJO383D8TH tag=LP0QKLK525FL type=write size=555600 2024-09-12T00:19:28.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.297+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=J91DUI2N4K7R type=del size=1053821 2024-09-12T00:19:28.298 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.298+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~HMMFLLVX2MBC.0 size=233473 2024-09-12T00:19:28.300 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.301+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=HMMFLLVX2MBC tag=HH457QNE5J65 type=write size=1282049 2024-09-12T00:19:28.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.302+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=B1331TDV16QV type=del size=1251341 2024-09-12T00:19:28.303 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.304+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~G8X32B4WAJNT.0 size=1048576 2024-09-12T00:19:28.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.305+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~G8X32B4WAJNT.1 size=1048576 2024-09-12T00:19:28.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.307+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~G8X32B4WAJNT.2 size=261445 2024-09-12T00:19:28.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.310+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=G8X32B4WAJNT tag=5L7OTWXZYKJ2 type=write size=3407173 2024-09-12T00:19:28.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.312+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~XE3TMPCV8E0U.0 size=1048576 2024-09-12T00:19:28.312 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.314+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~XE3TMPCV8E0U.1 size=1048576 2024-09-12T00:19:28.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.314+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~XE3TMPCV8E0U.2 size=321035 2024-09-12T00:19:28.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.314+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=XE3TMPCV8E0U tag=SXWEHS8CEJUV type=write size=3466763 2024-09-12T00:19:28.315 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.315+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=B5DTSZQ41JO7 type=del 2024-09-12T00:19:28.316 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.317+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=8OFX15QKPQXM type=del size=2838077 2024-09-12T00:19:28.318 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.318+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~V9KSSPVFFS5B.0 size=1048576 2024-09-12T00:19:28.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.319+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~V9KSSPVFFS5B.1 size=397972 2024-09-12T00:19:28.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.322+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=V9KSSPVFFS5B tag=N7RDDVH5AO7O type=write size=2495124 2024-09-12T00:19:28.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.323+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=G8S38U5CU08S type=del size=2195252 2024-09-12T00:19:28.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.325+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=8SRUHAWIGKLI type=del 2024-09-12T00:19:28.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.326+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=EBVAZFPRL0XX type=del size=4154264 2024-09-12T00:19:28.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.328+0000 7f682945b780 1 < canceled part key=_multipart_EYHGJ82COSE9.2~J9INTTOWARJ1.0 size=864602 2024-09-12T00:19:28.329 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.330+0000 7f682945b780 1 < canceled multipart upload key=EYHGJ82COSE9 upload=J9INTTOWARJ1 tag=GN0KFTSLH6KY type=write size=1913178 2024-09-12T00:19:28.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.332+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~WEQSDDIENKXR.0 size=1048576 2024-09-12T00:19:28.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.333+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~WEQSDDIENKXR.1 size=73174 2024-09-12T00:19:28.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.333+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=WEQSDDIENKXR tag=1PPQ94NWLB3Z type=write size=2170326 2024-09-12T00:19:28.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.334+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~HTY2G3RGIK24.0 size=1048576 2024-09-12T00:19:28.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.335+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~HTY2G3RGIK24.1 size=669848 2024-09-12T00:19:28.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.338+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=HTY2G3RGIK24 tag=VH52A8BIQBJR type=write size=2767000 2024-09-12T00:19:28.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.340+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~0TMB12YSQHAP.0 size=1048576 2024-09-12T00:19:28.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.341+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~0TMB12YSQHAP.1 size=1048576 2024-09-12T00:19:28.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.343+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~0TMB12YSQHAP.2 size=518370 2024-09-12T00:19:28.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.343+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=0TMB12YSQHAP tag=69VHQI88SSRS type=write size=3664098 2024-09-12T00:19:28.344 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.344+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~UNHYX19VLGH1.0 size=1048576 2024-09-12T00:19:28.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.345+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~UNHYX19VLGH1.1 size=1048576 2024-09-12T00:19:28.346 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.346+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~UNHYX19VLGH1.2 size=306529 2024-09-12T00:19:28.348 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.349+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=UNHYX19VLGH1 tag=64BYZ05YVB2E type=write size=3452257 2024-09-12T00:19:28.350 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.350+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=ARRFFF29WFZM type=del size=2503333 2024-09-12T00:19:28.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.352+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=NOSO5MKMYGYY type=del 2024-09-12T00:19:28.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.353+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=PL5RAOO511SO type=del size=569765 2024-09-12T00:19:28.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.355+0000 7f682945b780 1 < completed write operation key=AZKLWMQ818SW tag=QVMVYX19U8S7 type=write size=583008 2024-09-12T00:19:28.355 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.356+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=3UB4JTJXM6QE type=del size=878172 2024-09-12T00:19:28.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.358+0000 7f682945b780 1 < canceled operation key=EYHGJ82COSE9 tag=6X75JDW78T1Y type=del size=1162727 2024-09-12T00:19:28.358 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.359+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=LADPQMMSBANN type=del size=572659 2024-09-12T00:19:28.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.361+0000 7f682945b780 1 < suggested remove operation key=R2OAUUKLV7OK tag=UFY9MTHF1QMX type=del 2024-09-12T00:19:28.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.362+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=HFHW3RK6WW3A type=del size=2284181 2024-09-12T00:19:28.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.363+0000 7f682945b780 1 < canceled part key=_multipart_BI3KCKV4CRWR.2~RXGFFK7THYLG.0 size=1048576 2024-09-12T00:19:28.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.364+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~RXGFFK7THYLG.1 size=1048576 2024-09-12T00:19:28.364 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.365+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~RXGFFK7THYLG.2 size=17898 2024-09-12T00:19:28.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.367+0000 7f682945b780 1 < canceled multipart upload key=BI3KCKV4CRWR upload=RXGFFK7THYLG tag=HINBATQGDOAV type=write size=3163626 2024-09-12T00:19:28.368 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.368+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=E6ZZZO0Q0HU2 type=del size=281765 2024-09-12T00:19:28.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.369+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~OR23A4SOWP3Y.0 size=1048576 2024-09-12T00:19:28.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.371+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~OR23A4SOWP3Y.1 size=919246 2024-09-12T00:19:28.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.373+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=OR23A4SOWP3Y tag=IGQTGIBZZWQJ type=write size=3016398 2024-09-12T00:19:28.375 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.375+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~ABXOAZ0AWJS5.0 size=1048576 2024-09-12T00:19:28.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.376+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~ABXOAZ0AWJS5.1 size=619386 2024-09-12T00:19:28.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.376+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=ABXOAZ0AWJS5 tag=R2Y0FP84FUCA type=write size=2716538 2024-09-12T00:19:28.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.379+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~P6URCQ93V14Q.0 size=1048576 2024-09-12T00:19:28.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.379+0000 7f682945b780 1 < canceled part key=_multipart_BI3KCKV4CRWR.2~P6URCQ93V14Q.1 size=691727 2024-09-12T00:19:28.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.381+0000 7f682945b780 1 < canceled multipart upload key=BI3KCKV4CRWR upload=P6URCQ93V14Q tag=I664QLEKI7KJ type=write size=2788879 2024-09-12T00:19:28.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.382+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=484MIY1L0KM0 type=del size=3880161 2024-09-12T00:19:28.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.383+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=J91DUI2N4K7R type=del 2024-09-12T00:19:28.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.385+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=8IPZZZFMUMU3 type=del size=1013434 2024-09-12T00:19:28.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.386+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=B1331TDV16QV type=del 2024-09-12T00:19:28.388 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.389+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~71GMZXHLWD2L.0 size=1015290 2024-09-12T00:19:28.388 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.389+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=71GMZXHLWD2L tag=AE36XE54EBZ6 type=write size=2063866 2024-09-12T00:19:28.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.390+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~XE3TMPCV8E0U.0 size=1048576 2024-09-12T00:19:28.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.391+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~XE3TMPCV8E0U.1 size=1048576 2024-09-12T00:19:28.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.392+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~XE3TMPCV8E0U.2 size=321035 2024-09-12T00:19:28.394 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.395+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=XE3TMPCV8E0U tag=SXWEHS8CEJUV type=write size=3466763 2024-09-12T00:19:28.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.398+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~7RDII3Z8NP6K.0 size=160219 2024-09-12T00:19:28.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.398+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=7RDII3Z8NP6K tag=MXX873D9JYQJ type=write size=1208795 2024-09-12T00:19:28.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.400+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=8OFX15QKPQXM type=del 2024-09-12T00:19:28.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.401+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=B8BMJJZHEKQP type=del size=3894574 2024-09-12T00:19:28.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.402+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=G8S38U5CU08S type=del 2024-09-12T00:19:28.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.403+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=UA7O1L1AELFS type=del size=1189710 2024-09-12T00:19:28.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.405+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=EBVAZFPRL0XX type=del 2024-09-12T00:19:28.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.408+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~91TFZW7KURGA.0 size=1048576 2024-09-12T00:19:28.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.410+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~91TFZW7KURGA.1 size=1048576 2024-09-12T00:19:28.411 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.412+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~91TFZW7KURGA.2 size=379361 2024-09-12T00:19:28.411 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.412+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=91TFZW7KURGA tag=GYWSUUFG92FU type=write size=3525089 2024-09-12T00:19:28.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.412+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~WEQSDDIENKXR.0 size=1048576 2024-09-12T00:19:28.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.414+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~WEQSDDIENKXR.1 size=73174 2024-09-12T00:19:28.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.416+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=WEQSDDIENKXR tag=1PPQ94NWLB3Z type=write size=2170326 2024-09-12T00:19:28.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.417+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=CSG3N46KPSUO type=del size=1624684 2024-09-12T00:19:28.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.419+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~0TMB12YSQHAP.0 size=1048576 2024-09-12T00:19:28.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.420+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~0TMB12YSQHAP.1 size=1048576 2024-09-12T00:19:28.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.421+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~0TMB12YSQHAP.2 size=518370 2024-09-12T00:19:28.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.423+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=0TMB12YSQHAP tag=69VHQI88SSRS type=write size=3664098 2024-09-12T00:19:28.424 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.425+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=JTGVYYMBLI94 type=del size=3599168 2024-09-12T00:19:28.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.427+0000 7f682945b780 1 < canceled operation key=D06ZUP2ZXX42 tag=ARRFFF29WFZM type=del size=2503333 2024-09-12T00:19:28.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.428+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=XGM0PKVYU1N8 type=del size=2954526 2024-09-12T00:19:28.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.429+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=PL5RAOO511SO type=del 2024-09-12T00:19:28.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.432+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~OQ3R9JPPYLWP.0 size=1048576 2024-09-12T00:19:28.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.433+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~OQ3R9JPPYLWP.1 size=565611 2024-09-12T00:19:28.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.433+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=OQ3R9JPPYLWP tag=922F492UMV3K type=write size=2662763 2024-09-12T00:19:28.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.435+0000 7f682945b780 1 < suggested update operation key=BFY578HP8GAW tag=3UB4JTJXM6QE type=del size=878172 2024-09-12T00:19:28.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.438+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~0Z5041BY7DDD.0 size=608807 2024-09-12T00:19:28.438 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.438+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=0Z5041BY7DDD tag=370V31HBK9M8 type=write size=1657383 2024-09-12T00:19:28.439 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.439+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=LADPQMMSBANN type=del 2024-09-12T00:19:28.440 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.441+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=3YCFOKDGKG8X type=del size=2843696 2024-09-12T00:19:28.442 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.442+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=HFHW3RK6WW3A type=del 2024-09-12T00:19:28.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.444+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=4P2XIC180PN4 type=write size=669169 2024-09-12T00:19:28.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.446+0000 7f682945b780 1 < suggested update operation key=JAVE3HR52R5C tag=E6ZZZO0Q0HU2 type=del size=281765 2024-09-12T00:19:28.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.448+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=FE0ZWV1ZRA3W type=del size=2811569 2024-09-12T00:19:28.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.449+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~ABXOAZ0AWJS5.0 size=1048576 2024-09-12T00:19:28.450 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.451+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~ABXOAZ0AWJS5.1 size=619386 2024-09-12T00:19:28.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.453+0000 7f682945b780 1 < completed multipart upload key=BK212Z99RM7F upload=ABXOAZ0AWJS5 tag=R2Y0FP84FUCA type=write size=2716538 2024-09-12T00:19:28.454 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.456+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=XYGXIP3U5078 type=del size=2086589 2024-09-12T00:19:28.456 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.457+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=484MIY1L0KM0 type=del 2024-09-12T00:19:28.458 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.458+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=9E75Z1GKU6I2 type=del size=1334534 2024-09-12T00:19:28.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.461+0000 7f682945b780 1 < suggested update operation key=EYHGJ82COSE9 tag=8IPZZZFMUMU3 type=del size=1013434 2024-09-12T00:19:28.462 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.463+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=RBDV6VIDRNKN type=del size=2980464 2024-09-12T00:19:28.464 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.464+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~71GMZXHLWD2L.0 size=1015290 2024-09-12T00:19:28.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.467+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=71GMZXHLWD2L tag=AE36XE54EBZ6 type=write size=2063866 2024-09-12T00:19:28.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.470+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~UOH07ZQL346R.0 size=1048576 2024-09-12T00:19:28.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.471+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~UOH07ZQL346R.1 size=687985 2024-09-12T00:19:28.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.471+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=UOH07ZQL346R tag=LDQHZGXG8HHF type=write size=2785137 2024-09-12T00:19:28.471 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.472+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~7RDII3Z8NP6K.0 size=160219 2024-09-12T00:19:28.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.474+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=7RDII3Z8NP6K tag=MXX873D9JYQJ type=write size=1208795 2024-09-12T00:19:28.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.476+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=L7L4CKXG2ZXW type=del size=932114 2024-09-12T00:19:28.476 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.476+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=B8BMJJZHEKQP type=del 2024-09-12T00:19:28.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.478+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=15B4POF5PTQU type=write size=531092 2024-09-12T00:19:28.479 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.479+0000 7f682945b780 -1 < failed to complete operation key=EYHGJ82COSE9 tag=UA7O1L1AELFS type=del size=1189710: (22) Invalid argument 2024-09-12T00:19:28.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.482+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~16TOAAHNZA0S.0 size=1048576 2024-09-12T00:19:28.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.483+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~16TOAAHNZA0S.1 size=1048576 2024-09-12T00:19:28.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.484+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~16TOAAHNZA0S.2 size=336068 2024-09-12T00:19:28.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.484+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=16TOAAHNZA0S tag=GX2YVE98MU7Y type=write size=3481796 2024-09-12T00:19:28.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.486+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~91TFZW7KURGA.0 size=1048576 2024-09-12T00:19:28.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.486+0000 7f682945b780 1 < canceled part key=_multipart_TGOBZH6DZK71.2~91TFZW7KURGA.1 size=1048576 2024-09-12T00:19:28.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.487+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~91TFZW7KURGA.2 size=379361 2024-09-12T00:19:28.488 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.488+0000 7f682945b780 1 < canceled multipart upload key=TGOBZH6DZK71 upload=91TFZW7KURGA tag=GYWSUUFG92FU type=write size=3525089 2024-09-12T00:19:28.489 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.490+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=EKOKNUGM3VHR type=del size=1350776 2024-09-12T00:19:28.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.493+0000 7f682945b780 1 < suggested update operation key=COUJXCOSVPDS tag=CSG3N46KPSUO type=del size=1624684 2024-09-12T00:19:28.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.494+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=CA53FK2E5Q00 type=del size=185765 2024-09-12T00:19:28.495 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.495+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=JTGVYYMBLI94 type=del 2024-09-12T00:19:28.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.497+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=L8Y4RKH50BYP type=write size=663113 2024-09-12T00:19:28.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.499+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=XGM0PKVYU1N8 type=del 2024-09-12T00:19:28.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.501+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~SRZRPKNOCV1I.0 size=821940 2024-09-12T00:19:28.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.501+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=SRZRPKNOCV1I tag=W1UDPLD43NTF type=write size=1870516 2024-09-12T00:19:28.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.502+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~OQ3R9JPPYLWP.0 size=1048576 2024-09-12T00:19:28.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.503+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~OQ3R9JPPYLWP.1 size=565611 2024-09-12T00:19:28.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.506+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=OQ3R9JPPYLWP tag=922F492UMV3K type=write size=2662763 2024-09-12T00:19:28.507 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.508+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~TNRO4JT3FOKS.0 size=930613 2024-09-12T00:19:28.507 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.508+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=TNRO4JT3FOKS tag=1BSKGXB7F85M type=write size=1979189 2024-09-12T00:19:28.509 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.510+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~0Z5041BY7DDD.0 size=608807 2024-09-12T00:19:28.511 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.511+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=0Z5041BY7DDD tag=370V31HBK9M8 type=write size=1657383 2024-09-12T00:19:28.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.513+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=QPFJO3X8W3UW type=del size=811799 2024-09-12T00:19:28.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.515+0000 7f682945b780 1 < completed delete operation key=Z7408WO050VI tag=3YCFOKDGKG8X type=del 2024-09-12T00:19:28.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.516+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=D5W3UV25ERQ0 type=del size=4095065 2024-09-12T00:19:28.518 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.519+0000 7f682945b780 1 < suggested remove operation key=BFY578HP8GAW tag=4P2XIC180PN4 type=write 2024-09-12T00:19:28.520 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.520+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=6EGXXZ2XQFZ7 type=del size=2305590 2024-09-12T00:19:28.521 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.522+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=FE0ZWV1ZRA3W type=del 2024-09-12T00:19:28.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.524+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=GWTSQMTWMVT9 type=write size=692597 2024-09-12T00:19:28.524 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.524+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=XYGXIP3U5078 type=del 2024-09-12T00:19:28.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.527+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=C4K09YVA8BIG type=del size=960471 2024-09-12T00:19:28.528 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.529+0000 7f682945b780 1 < suggested update operation key=Y65K9I6K41X5 tag=9E75Z1GKU6I2 type=del size=1334534 2024-09-12T00:19:28.529 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.530+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=DOKQ4DCLG31L type=del size=2356580 2024-09-12T00:19:28.531 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.531+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=RBDV6VIDRNKN type=del 2024-09-12T00:19:28.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.533+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=Q0E31L5V2VUO type=del size=1908718 2024-09-12T00:19:28.534 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.534+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~UOH07ZQL346R.0 size=1048576 2024-09-12T00:19:28.535 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.535+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~UOH07ZQL346R.1 size=687985 2024-09-12T00:19:28.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.538+0000 7f682945b780 1 < completed multipart upload key=3JFMN39G6TTF upload=UOH07ZQL346R tag=LDQHZGXG8HHF type=write size=2785137 2024-09-12T00:19:28.540 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.540+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~1NL2EN1OKYE8.0 size=645405 2024-09-12T00:19:28.540 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.540+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=1NL2EN1OKYE8 tag=TKZX0PIPSA20 type=write size=1693981 2024-09-12T00:19:28.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.543+0000 7f682945b780 -1 < failed to complete operation key=BFY578HP8GAW tag=L7L4CKXG2ZXW type=del size=932114: (22) Invalid argument 2024-09-12T00:19:28.544 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.545+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=PQ8F3UXP21S6 type=del size=2490781 2024-09-12T00:19:28.546 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.546+0000 7f682945b780 1 < completed write operation key=SGWTWN8RTKDD tag=15B4POF5PTQU type=write size=531092 2024-09-12T00:19:28.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.548+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~XCGK3AOZL3WF.0 size=1048576 2024-09-12T00:19:28.549 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.549+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~XCGK3AOZL3WF.1 size=1048576 2024-09-12T00:19:28.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.551+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~XCGK3AOZL3WF.2 size=746280 2024-09-12T00:19:28.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.551+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=XCGK3AOZL3WF tag=ZGKM613E6RUM type=write size=3892008 2024-09-12T00:19:28.552 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.552+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~16TOAAHNZA0S.0 size=1048576 2024-09-12T00:19:28.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.553+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~16TOAAHNZA0S.1 size=1048576 2024-09-12T00:19:28.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.554+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~16TOAAHNZA0S.2 size=336068 2024-09-12T00:19:28.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.556+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=16TOAAHNZA0S tag=GX2YVE98MU7Y type=write size=3481796 2024-09-12T00:19:28.558 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.559+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~PO2AD2O6080M.0 size=1048576 2024-09-12T00:19:28.559 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.560+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~PO2AD2O6080M.1 size=394343 2024-09-12T00:19:28.559 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.560+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=PO2AD2O6080M tag=CU3LRIIMI1I5 type=write size=2491495 2024-09-12T00:19:28.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.562+0000 7f682945b780 1 < suggested update operation key=17S1X3WXCNAR tag=EKOKNUGM3VHR type=del size=1350776 2024-09-12T00:19:28.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.564+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=D264F00ZVCZK type=del size=3563095 2024-09-12T00:19:28.565 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.565+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=CA53FK2E5Q00 type=del 2024-09-12T00:19:28.566 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.566+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=NLLB23277ZT5 type=del size=2936327 2024-09-12T00:19:28.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.568+0000 7f682945b780 1 < suggested update operation key=1RAFARG1JXFQ tag=L8Y4RKH50BYP type=write size=663113 2024-09-12T00:19:28.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.571+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=0DFIY2SNJ5AO type=write size=191267 2024-09-12T00:19:28.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.571+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~SRZRPKNOCV1I.0 size=821940 2024-09-12T00:19:28.573 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.574+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=SRZRPKNOCV1I tag=W1UDPLD43NTF type=write size=1870516 2024-09-12T00:19:28.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.577+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~UK5C5UZ0B1B9.0 size=1048576 2024-09-12T00:19:28.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.578+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~UK5C5UZ0B1B9.1 size=1048576 2024-09-12T00:19:28.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.578+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~UK5C5UZ0B1B9.2 size=163366 2024-09-12T00:19:28.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.578+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=UK5C5UZ0B1B9 tag=L9MUDCPYXCMO type=write size=3309094 2024-09-12T00:19:28.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.580+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~TNRO4JT3FOKS.0 size=930613 2024-09-12T00:19:28.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.583+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=TNRO4JT3FOKS tag=1BSKGXB7F85M type=write size=1979189 2024-09-12T00:19:28.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.584+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=0ZJILZS0VSM0 type=del size=2974509 2024-09-12T00:19:28.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.585+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=QPFJO3X8W3UW type=del 2024-09-12T00:19:28.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.588+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~2EVJ158KQ480.0 size=1048576 2024-09-12T00:19:28.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.589+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~2EVJ158KQ480.1 size=1044632 2024-09-12T00:19:28.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.589+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=2EVJ158KQ480 tag=25XC7SGDCAWI type=write size=3141784 2024-09-12T00:19:28.590 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.590+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=D5W3UV25ERQ0 type=del 2024-09-12T00:19:28.591 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.592+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=NVVO29N6MVDD type=del size=4109979 2024-09-12T00:19:28.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.593+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=6EGXXZ2XQFZ7 type=del 2024-09-12T00:19:28.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.595+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~QDW3MCRMY4WP.0 size=254149 2024-09-12T00:19:28.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.595+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=QDW3MCRMY4WP tag=JBPALJ8T6U3I type=write size=1302725 2024-09-12T00:19:28.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.596+0000 7f682945b780 1 < completed write operation key=AZKLWMQ818SW tag=GWTSQMTWMVT9 type=write size=692597 2024-09-12T00:19:28.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.598+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=9F1B34Q4TFUH type=del size=4125171 2024-09-12T00:19:28.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.599+0000 7f682945b780 -1 < failed to complete operation key=17S1X3WXCNAR tag=C4K09YVA8BIG type=del size=960471: (22) Invalid argument 2024-09-12T00:19:28.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.600+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=9T1BBNE7NE9O type=del size=3536835 2024-09-12T00:19:28.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.602+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=DOKQ4DCLG31L type=del 2024-09-12T00:19:28.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.603+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=4OZ91HXS8PMD type=del size=1106528 2024-09-12T00:19:28.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.605+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=Q0E31L5V2VUO type=del 2024-09-12T00:19:28.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.607+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~6WAG3OS4ZNK6.0 size=1048576 2024-09-12T00:19:28.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.608+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~6WAG3OS4ZNK6.1 size=908855 2024-09-12T00:19:28.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.608+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=6WAG3OS4ZNK6 tag=35R4GHRYNH3S type=write size=3006007 2024-09-12T00:19:28.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.609+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~1NL2EN1OKYE8.0 size=645405 2024-09-12T00:19:28.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.612+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=1NL2EN1OKYE8 tag=TKZX0PIPSA20 type=write size=1693981 2024-09-12T00:19:28.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.614+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~V3GNGAPU2S11.0 size=1048576 2024-09-12T00:19:28.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.615+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~V3GNGAPU2S11.1 size=677864 2024-09-12T00:19:28.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.615+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=V3GNGAPU2S11 tag=4OHBFP0JRK5O type=write size=2775016 2024-09-12T00:19:28.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.616+0000 7f682945b780 1 < canceled operation key=7RRJO383D8TH tag=PQ8F3UXP21S6 type=del size=2490781 2024-09-12T00:19:28.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.618+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~TGSQVFJ6Q933.0 size=1048576 2024-09-12T00:19:28.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.619+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~TGSQVFJ6Q933.1 size=1048576 2024-09-12T00:19:28.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.620+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~TGSQVFJ6Q933.2 size=749014 2024-09-12T00:19:28.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.620+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=TGSQVFJ6Q933 tag=45ELU4OC2339 type=write size=3894742 2024-09-12T00:19:28.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.622+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~XCGK3AOZL3WF.0 size=1048576 2024-09-12T00:19:28.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.623+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~XCGK3AOZL3WF.1 size=1048576 2024-09-12T00:19:28.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.624+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~XCGK3AOZL3WF.2 size=746280 2024-09-12T00:19:28.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.626+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=XCGK3AOZL3WF tag=ZGKM613E6RUM type=write size=3892008 2024-09-12T00:19:28.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.629+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~2U11JRSHBNH7.0 size=1048576 2024-09-12T00:19:28.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.630+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~2U11JRSHBNH7.1 size=1048576 2024-09-12T00:19:28.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.631+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~2U11JRSHBNH7.2 size=644059 2024-09-12T00:19:28.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.631+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=2U11JRSHBNH7 tag=8APVDFV4V8TK type=write size=3789787 2024-09-12T00:19:28.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.632+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~PO2AD2O6080M.0 size=1048576 2024-09-12T00:19:28.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.633+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~PO2AD2O6080M.1 size=394343 2024-09-12T00:19:28.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.638+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=PO2AD2O6080M tag=CU3LRIIMI1I5 type=write size=2491495 2024-09-12T00:19:28.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.640+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~G9NN0BR9JY1Z.0 size=1048576 2024-09-12T00:19:28.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.641+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~G9NN0BR9JY1Z.1 size=796710 2024-09-12T00:19:28.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.641+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=G9NN0BR9JY1Z tag=3HX5CB849264 type=write size=2893862 2024-09-12T00:19:28.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.642+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=D264F00ZVCZK type=del 2024-09-12T00:19:28.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.644+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=KEKITN25XFOU type=del size=1942488 2024-09-12T00:19:28.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.646+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=NLLB23277ZT5 type=del 2024-09-12T00:19:28.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.646+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=77D1FR8JHK8N type=del size=450532 2024-09-12T00:19:28.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.648+0000 7f682945b780 1 < completed write operation key=38JJBFDTIYSU tag=0DFIY2SNJ5AO type=write size=191267 2024-09-12T00:19:28.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.650+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~CV71DZXJ72AX.0 size=406111 2024-09-12T00:19:28.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.650+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=CV71DZXJ72AX tag=MCYWJQXMWMMU type=write size=1454687 2024-09-12T00:19:28.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.652+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~UK5C5UZ0B1B9.0 size=1048576 2024-09-12T00:19:28.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.653+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~UK5C5UZ0B1B9.1 size=1048576 2024-09-12T00:19:28.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.655+0000 7f682945b780 1 < completed part key=_multipart_922B2PPJFX2Z.2~UK5C5UZ0B1B9.2 size=163366 2024-09-12T00:19:28.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.656+0000 7f682945b780 1 < completed multipart upload key=922B2PPJFX2Z upload=UK5C5UZ0B1B9 tag=L9MUDCPYXCMO type=write size=3309094 2024-09-12T00:19:28.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.658+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=2G5KQWGTWEKL type=write size=961057 2024-09-12T00:19:28.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.659+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=0ZJILZS0VSM0 type=del 2024-09-12T00:19:28.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.660+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=LZRGGCS2OFHW type=del size=2293342 2024-09-12T00:19:28.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.661+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~2EVJ158KQ480.0 size=1048576 2024-09-12T00:19:28.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.663+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~2EVJ158KQ480.1 size=1044632 2024-09-12T00:19:28.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.665+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=2EVJ158KQ480 tag=25XC7SGDCAWI type=write size=3141784 2024-09-12T00:19:28.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.666+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=U55ORWN2HKHV type=del size=1033762 2024-09-12T00:19:28.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.671+0000 7f682945b780 1 < suggested remove operation key=EYHGJ82COSE9 tag=NVVO29N6MVDD type=del 2024-09-12T00:19:28.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.672+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=WJTN1E07O7KY type=del size=3570329 2024-09-12T00:19:28.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.673+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~QDW3MCRMY4WP.0 size=254149 2024-09-12T00:19:28.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.676+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=QDW3MCRMY4WP tag=JBPALJ8T6U3I type=write size=1302725 2024-09-12T00:19:28.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.678+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~ZIRGST37638J.0 size=1048576 2024-09-12T00:19:28.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.679+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~ZIRGST37638J.1 size=1048576 2024-09-12T00:19:28.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.680+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~ZIRGST37638J.2 size=494534 2024-09-12T00:19:28.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.680+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=ZIRGST37638J tag=9G09ORW32HRU type=write size=3640262 2024-09-12T00:19:28.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.681+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=9F1B34Q4TFUH type=del 2024-09-12T00:19:28.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.682+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=DJQJ8BHHNRZD type=write size=16409 2024-09-12T00:19:28.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.684+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=9T1BBNE7NE9O type=del 2024-09-12T00:19:28.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.686+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~2X68XNK43TWK.0 size=1048576 2024-09-12T00:19:28.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.687+0000 7f682945b780 1 > prepared part key=_multipart_BK212Z99RM7F.2~2X68XNK43TWK.1 size=815936 2024-09-12T00:19:28.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.687+0000 7f682945b780 1 > prepared multipart upload key=BK212Z99RM7F upload=2X68XNK43TWK tag=PRV0W7JS3IY2 type=write size=2913088 2024-09-12T00:19:28.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.690+0000 7f682945b780 1 < suggested remove operation key=9Q4HFV4F2KE2 tag=4OZ91HXS8PMD type=del 2024-09-12T00:19:28.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.692+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~T1M4BAF7O78C.0 size=1048576 2024-09-12T00:19:28.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.693+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~T1M4BAF7O78C.1 size=616639 2024-09-12T00:19:28.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.693+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=T1M4BAF7O78C tag=PI7OUW1HB58G type=write size=2713791 2024-09-12T00:19:28.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.694+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~6WAG3OS4ZNK6.0 size=1048576 2024-09-12T00:19:28.695 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.696+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~6WAG3OS4ZNK6.1 size=908855 2024-09-12T00:19:28.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.698+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=6WAG3OS4ZNK6 tag=35R4GHRYNH3S type=write size=3006007 2024-09-12T00:19:28.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.699+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=IAURODXV89Y2 type=write size=703604 2024-09-12T00:19:28.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.701+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~V3GNGAPU2S11.0 size=1048576 2024-09-12T00:19:28.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.702+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~V3GNGAPU2S11.1 size=677864 2024-09-12T00:19:28.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.704+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=V3GNGAPU2S11 tag=4OHBFP0JRK5O type=write size=2775016 2024-09-12T00:19:28.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.706+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=BGMQOCXYC6PS type=del size=1441358 2024-09-12T00:19:28.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.707+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~TGSQVFJ6Q933.0 size=1048576 2024-09-12T00:19:28.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.709+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~TGSQVFJ6Q933.1 size=1048576 2024-09-12T00:19:28.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.710+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~TGSQVFJ6Q933.2 size=749014 2024-09-12T00:19:28.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.712+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=TGSQVFJ6Q933 tag=45ELU4OC2339 type=write size=3894742 2024-09-12T00:19:28.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.713+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=BFILQQ8TWFXY type=del size=2736320 2024-09-12T00:19:28.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.715+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~2U11JRSHBNH7.0 size=1048576 2024-09-12T00:19:28.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.716+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~2U11JRSHBNH7.1 size=1048576 2024-09-12T00:19:28.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.717+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~2U11JRSHBNH7.2 size=644059 2024-09-12T00:19:28.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.719+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=2U11JRSHBNH7 tag=8APVDFV4V8TK type=write size=3789787 2024-09-12T00:19:28.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.722+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~UAMOAL1MPEYJ.0 size=1048576 2024-09-12T00:19:28.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.723+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~UAMOAL1MPEYJ.1 size=333667 2024-09-12T00:19:28.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.723+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=UAMOAL1MPEYJ tag=2GU9QI90I890 type=write size=2430819 2024-09-12T00:19:28.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.725+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~G9NN0BR9JY1Z.0 size=1048576 2024-09-12T00:19:28.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.726+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~G9NN0BR9JY1Z.1 size=796710 2024-09-12T00:19:28.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.728+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=G9NN0BR9JY1Z tag=3HX5CB849264 type=write size=2893862 2024-09-12T00:19:28.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.730+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=A5843LJYKN4D type=del size=2869839 2024-09-12T00:19:28.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.734+0000 7f682945b780 1 < suggested remove operation key=Y65K9I6K41X5 tag=KEKITN25XFOU type=del 2024-09-12T00:19:28.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.737+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~WICJLTHE76MQ.0 size=1048576 2024-09-12T00:19:28.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.737+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~WICJLTHE76MQ.1 size=1048576 2024-09-12T00:19:28.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.738+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~WICJLTHE76MQ.2 size=680174 2024-09-12T00:19:28.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.738+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=WICJLTHE76MQ tag=W1YYG95OOHL4 type=write size=3825902 2024-09-12T00:19:28.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.740+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=77D1FR8JHK8N type=del 2024-09-12T00:19:28.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.741+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=06IJ923GYZK3 type=del size=2864305 2024-09-12T00:19:28.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.742+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~CV71DZXJ72AX.0 size=406111 2024-09-12T00:19:28.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.746+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=CV71DZXJ72AX tag=MCYWJQXMWMMU type=write size=1454687 2024-09-12T00:19:28.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.747+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=8U9OGJUZPAWD type=write size=820257 2024-09-12T00:19:28.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.748+0000 7f682945b780 -1 < failed to complete operation key=EYHGJ82COSE9 tag=2G5KQWGTWEKL type=write size=961057: (22) Invalid argument 2024-09-12T00:19:28.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.749+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=KY2Y593CVZM1 type=write size=609331 2024-09-12T00:19:28.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.751+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=LZRGGCS2OFHW type=del 2024-09-12T00:19:28.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.752+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=5LIX22ONN104 type=del size=1063219 2024-09-12T00:19:28.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.755+0000 7f682945b780 1 < suggested update operation key=Z7408WO050VI tag=U55ORWN2HKHV type=del size=1033762 2024-09-12T00:19:28.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.758+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~L9NN51KDVPDM.0 size=1048576 2024-09-12T00:19:28.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.759+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~L9NN51KDVPDM.1 size=868059 2024-09-12T00:19:28.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.759+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=L9NN51KDVPDM tag=JDCHHJSC19L9 type=write size=2965211 2024-09-12T00:19:28.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.760+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=WJTN1E07O7KY type=del 2024-09-12T00:19:28.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.763+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~6O7LAPJJI42K.0 size=528716 2024-09-12T00:19:28.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.763+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=6O7LAPJJI42K tag=YDHUFPJMJK9C type=write size=1577292 2024-09-12T00:19:28.763 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.763+0000 7f682945b780 1 < canceled part key=_multipart_D06ZUP2ZXX42.2~ZIRGST37638J.0 size=1048576 2024-09-12T00:19:28.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.764+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~ZIRGST37638J.1 size=1048576 2024-09-12T00:19:28.765 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.765+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~ZIRGST37638J.2 size=494534 2024-09-12T00:19:28.767 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.768+0000 7f682945b780 1 < canceled multipart upload key=D06ZUP2ZXX42 upload=ZIRGST37638J tag=9G09ORW32HRU type=write size=3640262 2024-09-12T00:19:28.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.770+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=4SIHSJ4G8RPE type=del size=1017873 2024-09-12T00:19:28.770 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.771+0000 7f682945b780 1 < completed write operation key=TGOBZH6DZK71 tag=DJQJ8BHHNRZD type=write size=16409 2024-09-12T00:19:28.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.773+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=2VY0CCJLTO2X type=del size=3248904 2024-09-12T00:19:28.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.774+0000 7f682945b780 1 < completed part key=_multipart_BK212Z99RM7F.2~2X68XNK43TWK.0 size=1048576 2024-09-12T00:19:28.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.774+0000 7f682945b780 1 < canceled part key=_multipart_BK212Z99RM7F.2~2X68XNK43TWK.1 size=815936 2024-09-12T00:19:28.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.777+0000 7f682945b780 1 < canceled multipart upload key=BK212Z99RM7F upload=2X68XNK43TWK tag=PRV0W7JS3IY2 type=write size=2913088 2024-09-12T00:19:28.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.778+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=EK8KDZNHVLF8 type=del size=89374 2024-09-12T00:19:28.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.779+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~T1M4BAF7O78C.0 size=1048576 2024-09-12T00:19:28.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.780+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~T1M4BAF7O78C.1 size=616639 2024-09-12T00:19:28.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.782+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=T1M4BAF7O78C tag=PI7OUW1HB58G type=write size=2713791 2024-09-12T00:19:28.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.784+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=0W2XN8F22YV7 type=del size=2512462 2024-09-12T00:19:28.785 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.785+0000 7f682945b780 1 < canceled operation key=COUJXCOSVPDS tag=IAURODXV89Y2 type=write size=703604 2024-09-12T00:19:28.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.788+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~FD5OF25E7ED7.0 size=1048576 2024-09-12T00:19:28.789 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.789+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~FD5OF25E7ED7.1 size=333983 2024-09-12T00:19:28.789 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.789+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=FD5OF25E7ED7 tag=WHYB5YP681WH type=write size=2431135 2024-09-12T00:19:28.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.791+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=BGMQOCXYC6PS type=del 2024-09-12T00:19:28.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.792+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=X1GWBDMJDNYB type=del size=3118374 2024-09-12T00:19:28.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.796+0000 7f682945b780 1 < suggested remove operation key=CT2L8L3849IN tag=BFILQQ8TWFXY type=del 2024-09-12T00:19:28.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.799+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~BZ36961JQED5.0 size=1048576 2024-09-12T00:19:28.800 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.800+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~BZ36961JQED5.1 size=1048576 2024-09-12T00:19:28.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.801+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~BZ36961JQED5.2 size=1027372 2024-09-12T00:19:28.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.801+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=BZ36961JQED5 tag=593CK6M0ITK1 type=write size=4173100 2024-09-12T00:19:28.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.803+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~UAMOAL1MPEYJ.0 size=1048576 2024-09-12T00:19:28.804 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.805+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~UAMOAL1MPEYJ.1 size=333667 2024-09-12T00:19:28.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.807+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=UAMOAL1MPEYJ tag=2GU9QI90I890 type=write size=2430819 2024-09-12T00:19:28.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.809+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~SVH6GPKHSF3E.0 size=1048576 2024-09-12T00:19:28.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.810+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~SVH6GPKHSF3E.1 size=1048576 2024-09-12T00:19:28.811 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.812+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~SVH6GPKHSF3E.2 size=29110 2024-09-12T00:19:28.811 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.812+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=SVH6GPKHSF3E tag=T9BFXR6GLM5J type=write size=3174838 2024-09-12T00:19:28.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.813+0000 7f682945b780 1 < canceled operation key=P56VIP3WIOJL tag=A5843LJYKN4D type=del size=2869839 2024-09-12T00:19:28.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.814+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=B61JP5P5B8MN type=del size=2092663 2024-09-12T00:19:28.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.816+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~WICJLTHE76MQ.0 size=1048576 2024-09-12T00:19:28.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.817+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~WICJLTHE76MQ.1 size=1048576 2024-09-12T00:19:28.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.818+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~WICJLTHE76MQ.2 size=680174 2024-09-12T00:19:28.820 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.820+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=WICJLTHE76MQ tag=W1YYG95OOHL4 type=write size=3825902 2024-09-12T00:19:28.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.823+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~YDSH6KV8YYSU.0 size=1048576 2024-09-12T00:19:28.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.824+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~YDSH6KV8YYSU.1 size=1048576 2024-09-12T00:19:28.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.825+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~YDSH6KV8YYSU.2 size=553711 2024-09-12T00:19:28.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.825+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=YDSH6KV8YYSU tag=SO8UQ83AO5TK type=write size=3699439 2024-09-12T00:19:28.825 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.826+0000 7f682945b780 1 < canceled operation key=SGWTWN8RTKDD tag=06IJ923GYZK3 type=del size=2864305 2024-09-12T00:19:28.828 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.828+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~FPB76EK0LU1S.0 size=1048576 2024-09-12T00:19:28.829 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.830+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~FPB76EK0LU1S.1 size=545325 2024-09-12T00:19:28.829 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.830+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=FPB76EK0LU1S tag=5W2JN905G6GC type=write size=2642477 2024-09-12T00:19:28.831 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.831+0000 7f682945b780 1 < completed write operation key=BMTPXZ1OA2TZ tag=8U9OGJUZPAWD type=write size=820257 2024-09-12T00:19:28.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.836+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~24SP51OHBKXZ.0 size=1048576 2024-09-12T00:19:28.835 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.836+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~24SP51OHBKXZ.1 size=1048576 2024-09-12T00:19:28.837 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.838+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~24SP51OHBKXZ.2 size=922847 2024-09-12T00:19:28.837 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.838+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=24SP51OHBKXZ tag=QUUZGDEZZP8R type=write size=4068575 2024-09-12T00:19:28.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.839+0000 7f682945b780 1 < completed write operation key=TGOBZH6DZK71 tag=KY2Y593CVZM1 type=write size=609331 2024-09-12T00:19:28.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.841+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~1GGHR6K6YU45.0 size=850145 2024-09-12T00:19:28.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.841+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=1GGHR6K6YU45 tag=6KRN0S1CT071 type=write size=1898721 2024-09-12T00:19:28.842 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.843+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=5LIX22ONN104 type=del 2024-09-12T00:19:28.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.845+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~76SMQEG0OCT3.0 size=738659 2024-09-12T00:19:28.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.845+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=76SMQEG0OCT3 tag=9ZRHZ4UDGIJY type=write size=1787235 2024-09-12T00:19:28.846 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.847+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~L9NN51KDVPDM.0 size=1048576 2024-09-12T00:19:28.847 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.848+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~L9NN51KDVPDM.1 size=868059 2024-09-12T00:19:28.849 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.850+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=L9NN51KDVPDM tag=JDCHHJSC19L9 type=write size=2965211 2024-09-12T00:19:28.852 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.852+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~QGX43BO2F4VG.0 size=1048576 2024-09-12T00:19:28.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.853+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~QGX43BO2F4VG.1 size=1048576 2024-09-12T00:19:28.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.854+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~QGX43BO2F4VG.2 size=992359 2024-09-12T00:19:28.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.854+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=QGX43BO2F4VG tag=QU8HLWQ0INXN type=write size=4138087 2024-09-12T00:19:28.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.857+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~6O7LAPJJI42K.0 size=528716 2024-09-12T00:19:28.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.858+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=6O7LAPJJI42K tag=YDHUFPJMJK9C type=write size=1577292 2024-09-12T00:19:28.860 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.861+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~099I2OOI6AFA.0 size=1048576 2024-09-12T00:19:28.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.862+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~099I2OOI6AFA.1 size=103361 2024-09-12T00:19:28.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.862+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=099I2OOI6AFA tag=GRKXPF7U0FT1 type=write size=2200513 2024-09-12T00:19:28.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.863+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=4SIHSJ4G8RPE type=del 2024-09-12T00:19:28.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.864+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=KKWXA4Y5BKFR type=del size=3962231 2024-09-12T00:19:28.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.866+0000 7f682945b780 1 < canceled operation key=D06ZUP2ZXX42 tag=2VY0CCJLTO2X type=del size=3248904 2024-09-12T00:19:28.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.868+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~YGCEQZ4PCE49.0 size=498982 2024-09-12T00:19:28.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.868+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=YGCEQZ4PCE49 tag=IW00QYPKZAOZ type=write size=1547558 2024-09-12T00:19:28.870 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.872+0000 7f682945b780 1 < suggested update operation key=BFY578HP8GAW tag=EK8KDZNHVLF8 type=del size=89374 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.874+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~46VMNDTBANJ1.0 size=912300 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.874+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=46VMNDTBANJ1 tag=K2U1BK1O3CTX type=write size=1960876 2024-09-12T00:19:28.874 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.875+0000 7f682945b780 1 < canceled operation key=3JFMN39G6TTF tag=0W2XN8F22YV7 type=del size=2512462 2024-09-12T00:19:28.877 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.878+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~8CB9AXP78PP0.0 size=40286 2024-09-12T00:19:28.877 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.878+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=8CB9AXP78PP0 tag=5DH0QEVEHS6E type=write size=1088862 2024-09-12T00:19:28.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.879+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~FD5OF25E7ED7.0 size=1048576 2024-09-12T00:19:28.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.879+0000 7f682945b780 1 < canceled part key=_multipart_Z7408WO050VI.2~FD5OF25E7ED7.1 size=333983 2024-09-12T00:19:28.881 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.882+0000 7f682945b780 1 < canceled multipart upload key=Z7408WO050VI upload=FD5OF25E7ED7 tag=WHYB5YP681WH type=write size=2431135 2024-09-12T00:19:28.884 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.885+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~DN5KP0L1XK4H.0 size=1048576 2024-09-12T00:19:28.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.886+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~DN5KP0L1XK4H.1 size=1048576 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.886+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~DN5KP0L1XK4H.2 size=496163 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.886+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=DN5KP0L1XK4H tag=46DR8ZJ17D4T type=write size=3641891 2024-09-12T00:19:28.887 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.888+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=X1GWBDMJDNYB type=del 2024-09-12T00:19:28.890 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.891+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~R7ZZMRJ5Q38Q.0 size=1025356 2024-09-12T00:19:28.890 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.891+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=R7ZZMRJ5Q38Q tag=CGSIQ8SCJOJI type=write size=2073932 2024-09-12T00:19:28.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.892+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~BZ36961JQED5.0 size=1048576 2024-09-12T00:19:28.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.893+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~BZ36961JQED5.1 size=1048576 2024-09-12T00:19:28.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.894+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~BZ36961JQED5.2 size=1027372 2024-09-12T00:19:28.896 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.897+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=BZ36961JQED5 tag=593CK6M0ITK1 type=write size=4173100 2024-09-12T00:19:28.899 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.900+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~TW31AMNJQSO0.0 size=1048576 2024-09-12T00:19:28.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.900+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~TW31AMNJQSO0.1 size=1048576 2024-09-12T00:19:28.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.902+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~TW31AMNJQSO0.2 size=838360 2024-09-12T00:19:28.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.902+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=TW31AMNJQSO0 tag=9GQHOHQ70TIA type=write size=3984088 2024-09-12T00:19:28.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.903+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~SVH6GPKHSF3E.0 size=1048576 2024-09-12T00:19:28.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.904+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~SVH6GPKHSF3E.1 size=1048576 2024-09-12T00:19:28.905 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.905+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~SVH6GPKHSF3E.2 size=29110 2024-09-12T00:19:28.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.909+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=SVH6GPKHSF3E tag=T9BFXR6GLM5J type=write size=3174838 2024-09-12T00:19:28.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.909+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=Z0M77GKTPR3P type=del size=1633193 2024-09-12T00:19:28.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.911+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=B61JP5P5B8MN type=del 2024-09-12T00:19:28.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.912+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=PKQCFB7E5LZD type=del size=3495652 2024-09-12T00:19:28.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.912+0000 7f682945b780 1 < canceled part key=_multipart_7RRJO383D8TH.2~YDSH6KV8YYSU.0 size=1048576 2024-09-12T00:19:28.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.914+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~YDSH6KV8YYSU.1 size=1048576 2024-09-12T00:19:28.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.916+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~YDSH6KV8YYSU.2 size=553711 2024-09-12T00:19:28.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.917+0000 7f682945b780 1 < canceled multipart upload key=7RRJO383D8TH upload=YDSH6KV8YYSU tag=SO8UQ83AO5TK type=write size=3699439 2024-09-12T00:19:28.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.920+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~0P1AVRUOP2M7.0 size=1048576 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.921+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~0P1AVRUOP2M7.1 size=795007 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.921+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=0P1AVRUOP2M7 tag=UWZOOBUS9RD8 type=write size=2892159 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.922+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~FPB76EK0LU1S.0 size=1048576 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.922+0000 7f682945b780 1 < canceled part key=_multipart_JAVE3HR52R5C.2~FPB76EK0LU1S.1 size=545325 2024-09-12T00:19:28.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.925+0000 7f682945b780 1 < canceled multipart upload key=JAVE3HR52R5C upload=FPB76EK0LU1S tag=5W2JN905G6GC type=write size=2642477 2024-09-12T00:19:28.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.929+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~KW61HZEGHHZN.0 size=1048576 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.929+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~KW61HZEGHHZN.1 size=921369 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.929+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=KW61HZEGHHZN tag=3IU704LG7EVR type=write size=3018521 2024-09-12T00:19:28.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.931+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~24SP51OHBKXZ.0 size=1048576 2024-09-12T00:19:28.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.932+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~24SP51OHBKXZ.1 size=1048576 2024-09-12T00:19:28.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.932+0000 7f682945b780 1 < canceled part key=_multipart_17S1X3WXCNAR.2~24SP51OHBKXZ.2 size=922847 2024-09-12T00:19:28.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.934+0000 7f682945b780 1 < canceled multipart upload key=17S1X3WXCNAR upload=24SP51OHBKXZ tag=QUUZGDEZZP8R type=write size=4068575 2024-09-12T00:19:28.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.937+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~ABE0D0U0PON1.0 size=1048576 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.938+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~ABE0D0U0PON1.1 size=196491 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.938+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=ABE0D0U0PON1 tag=FC2HH3CEJ1Q9 type=write size=2293643 2024-09-12T00:19:28.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.940+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~1GGHR6K6YU45.0 size=850145 2024-09-12T00:19:28.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.942+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=1GGHR6K6YU45 tag=6KRN0S1CT071 type=write size=1898721 2024-09-12T00:19:28.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.945+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~6OB4G1MYFYNN.0 size=1048576 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.946+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~6OB4G1MYFYNN.1 size=835295 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.946+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=6OB4G1MYFYNN tag=M8S7W5QRVFF8 type=write size=2932447 2024-09-12T00:19:28.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.947+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~76SMQEG0OCT3.0 size=738659 2024-09-12T00:19:28.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.949+0000 7f682945b780 1 < completed multipart upload key=8D9UC8FJ16UK upload=76SMQEG0OCT3 tag=9ZRHZ4UDGIJY type=write size=1787235 2024-09-12T00:19:28.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.951+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=HS7R14LWN16I type=del size=322510 2024-09-12T00:19:28.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.953+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~QGX43BO2F4VG.0 size=1048576 2024-09-12T00:19:28.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.954+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~QGX43BO2F4VG.1 size=1048576 2024-09-12T00:19:28.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.955+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~QGX43BO2F4VG.2 size=992359 2024-09-12T00:19:28.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.957+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=QGX43BO2F4VG tag=QU8HLWQ0INXN type=write size=4138087 2024-09-12T00:19:28.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.959+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=KROAQT22RLQY type=del size=29668 2024-09-12T00:19:28.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.961+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~099I2OOI6AFA.0 size=1048576 2024-09-12T00:19:28.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.962+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~099I2OOI6AFA.1 size=103361 2024-09-12T00:19:28.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.964+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=099I2OOI6AFA tag=GRKXPF7U0FT1 type=write size=2200513 2024-09-12T00:19:28.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.967+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~FN2FFJSFFQF3.0 size=1048576 2024-09-12T00:19:28.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.968+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~FN2FFJSFFQF3.1 size=1048576 2024-09-12T00:19:28.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.969+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~FN2FFJSFFQF3.2 size=337560 2024-09-12T00:19:28.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.969+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=FN2FFJSFFQF3 tag=MGJGAU3HP7O1 type=write size=3483288 2024-09-12T00:19:28.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.971+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=KKWXA4Y5BKFR type=del 2024-09-12T00:19:28.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.972+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=0TTLLSSXFGAX type=del size=3723242 2024-09-12T00:19:28.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.973+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~YGCEQZ4PCE49.0 size=498982 2024-09-12T00:19:28.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.976+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=YGCEQZ4PCE49 tag=IW00QYPKZAOZ type=write size=1547558 2024-09-12T00:19:28.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.978+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=JG2XCQ2MY671 type=del size=2074769 2024-09-12T00:19:28.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.979+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~46VMNDTBANJ1.0 size=912300 2024-09-12T00:19:28.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.981+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=46VMNDTBANJ1 tag=K2U1BK1O3CTX type=write size=1960876 2024-09-12T00:19:28.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.982+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=YMRU7CWE1ZV2 type=del size=2753729 2024-09-12T00:19:28.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.983+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~8CB9AXP78PP0.0 size=40286 2024-09-12T00:19:28.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.986+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=8CB9AXP78PP0 tag=5DH0QEVEHS6E type=write size=1088862 2024-09-12T00:19:28.988 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.989+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~HVECN0IDB3RI.0 size=1048576 2024-09-12T00:19:28.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.989+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~HVECN0IDB3RI.1 size=608620 2024-09-12T00:19:28.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.989+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=HVECN0IDB3RI tag=T019XWUSFSM7 type=write size=2705772 2024-09-12T00:19:28.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.991+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~DN5KP0L1XK4H.0 size=1048576 2024-09-12T00:19:28.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.992+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~DN5KP0L1XK4H.1 size=1048576 2024-09-12T00:19:28.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.994+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~DN5KP0L1XK4H.2 size=496163 2024-09-12T00:19:28.995 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.997+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=DN5KP0L1XK4H tag=46DR8ZJ17D4T type=write size=3641891 2024-09-12T00:19:28.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:28.999+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~6FU0FWJSJPQY.0 size=1048576 2024-09-12T00:19:28.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.000+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~6FU0FWJSJPQY.1 size=1048576 2024-09-12T00:19:29.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.001+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~6FU0FWJSJPQY.2 size=25290 2024-09-12T00:19:29.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.001+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=6FU0FWJSJPQY tag=4J4P1LUXM8LJ type=write size=3171018 2024-09-12T00:19:29.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.002+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~R7ZZMRJ5Q38Q.0 size=1025356 2024-09-12T00:19:29.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.004+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=R7ZZMRJ5Q38Q tag=CGSIQ8SCJOJI type=write size=2073932 2024-09-12T00:19:29.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.007+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~OUT7SDS5QZBS.0 size=1048576 2024-09-12T00:19:29.008 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.009+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~OUT7SDS5QZBS.1 size=448899 2024-09-12T00:19:29.008 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.009+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=OUT7SDS5QZBS tag=LFZGE130ZLXY type=write size=2546051 2024-09-12T00:19:29.012 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.010+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~TW31AMNJQSO0.0 size=1048576 2024-09-12T00:19:29.012 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.011+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~TW31AMNJQSO0.1 size=1048576 2024-09-12T00:19:29.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.012+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~TW31AMNJQSO0.2 size=838360 2024-09-12T00:19:29.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.015+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=TW31AMNJQSO0 tag=9GQHOHQ70TIA type=write size=3984088 2024-09-12T00:19:29.016 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.016+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=Q5Y8B0L8E5H2 type=del size=2557834 2024-09-12T00:19:29.017 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.017+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=Z0M77GKTPR3P type=del 2024-09-12T00:19:29.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.020+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~MKIEYALL0MK9.0 size=1048576 2024-09-12T00:19:29.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.021+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~MKIEYALL0MK9.1 size=973822 2024-09-12T00:19:29.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.021+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=MKIEYALL0MK9 tag=Y07REXZZX85V type=write size=3070974 2024-09-12T00:19:29.022 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.022+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=PKQCFB7E5LZD type=del 2024-09-12T00:19:29.023 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.023+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=CDR19VZNBK8Z type=write size=327175 2024-09-12T00:19:29.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.025+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~0P1AVRUOP2M7.0 size=1048576 2024-09-12T00:19:29.026 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.026+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~0P1AVRUOP2M7.1 size=795007 2024-09-12T00:19:29.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.029+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=0P1AVRUOP2M7 tag=UWZOOBUS9RD8 type=write size=2892159 2024-09-12T00:19:29.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.031+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~VG2AMY5SMUZE.0 size=1048576 2024-09-12T00:19:29.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.032+0000 7f682945b780 1 > prepared part key=_multipart_P56VIP3WIOJL.2~VG2AMY5SMUZE.1 size=1022809 2024-09-12T00:19:29.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.032+0000 7f682945b780 1 > prepared multipart upload key=P56VIP3WIOJL upload=VG2AMY5SMUZE tag=263RAYHLPIDQ type=write size=3119961 2024-09-12T00:19:29.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.034+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~KW61HZEGHHZN.0 size=1048576 2024-09-12T00:19:29.034 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.035+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~KW61HZEGHHZN.1 size=921369 2024-09-12T00:19:29.036 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.037+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=KW61HZEGHHZN tag=3IU704LG7EVR type=write size=3018521 2024-09-12T00:19:29.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.038+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=I852PMF3JHIX type=del size=3286972 2024-09-12T00:19:29.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.040+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~ABE0D0U0PON1.0 size=1048576 2024-09-12T00:19:29.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.042+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~ABE0D0U0PON1.1 size=196491 2024-09-12T00:19:29.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.044+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=ABE0D0U0PON1 tag=FC2HH3CEJ1Q9 type=write size=2293643 2024-09-12T00:19:29.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.045+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=X9PACZSMK43G type=del size=2532991 2024-09-12T00:19:29.046 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.046+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~6OB4G1MYFYNN.0 size=1048576 2024-09-12T00:19:29.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.047+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~6OB4G1MYFYNN.1 size=835295 2024-09-12T00:19:29.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.049+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=6OB4G1MYFYNN tag=M8S7W5QRVFF8 type=write size=2932447 2024-09-12T00:19:29.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.053+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~H7E7607PVUBV.0 size=772755 2024-09-12T00:19:29.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.053+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=H7E7607PVUBV tag=9BX0QL1NIJFK type=write size=1821331 2024-09-12T00:19:29.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.054+0000 7f682945b780 1 < canceled operation key=R2OAUUKLV7OK tag=HS7R14LWN16I type=del size=322510 2024-09-12T00:19:29.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.057+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=UZ59PDERGOWR type=del size=1577162 2024-09-12T00:19:29.058 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.058+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=KROAQT22RLQY type=del 2024-09-12T00:19:29.060 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.061+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~V695LH30DWL4.0 size=1048576 2024-09-12T00:19:29.061 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.062+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~V695LH30DWL4.1 size=1048576 2024-09-12T00:19:29.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.063+0000 7f682945b780 1 > prepared part key=_multipart_6DUQKU3R1RL8.2~V695LH30DWL4.2 size=932069 2024-09-12T00:19:29.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.063+0000 7f682945b780 1 > prepared multipart upload key=6DUQKU3R1RL8 upload=V695LH30DWL4 tag=Y32I00ZDXYEA type=write size=4077797 2024-09-12T00:19:29.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.064+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~FN2FFJSFFQF3.0 size=1048576 2024-09-12T00:19:29.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.065+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~FN2FFJSFFQF3.1 size=1048576 2024-09-12T00:19:29.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.066+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~FN2FFJSFFQF3.2 size=337560 2024-09-12T00:19:29.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.068+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=FN2FFJSFFQF3 tag=MGJGAU3HP7O1 type=write size=3483288 2024-09-12T00:19:29.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.071+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~5DHKC18X01ZO.0 size=604064 2024-09-12T00:19:29.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.071+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=5DHKC18X01ZO tag=OBF1PSC3JGWL type=write size=1652640 2024-09-12T00:19:29.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.072+0000 7f682945b780 1 < completed delete operation key=IYYTX8TCLF30 tag=0TTLLSSXFGAX type=del 2024-09-12T00:19:29.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.074+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=TBRCLLB6DEIE type=write size=182666 2024-09-12T00:19:29.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.075+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=JG2XCQ2MY671 type=del 2024-09-12T00:19:29.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.077+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=HN6IJHJM9NG7 type=del size=3215455 2024-09-12T00:19:29.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.079+0000 7f682945b780 1 < completed delete operation key=8D9UC8FJ16UK tag=YMRU7CWE1ZV2 type=del 2024-09-12T00:19:29.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.080+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=5L44OAY0SHIE type=del size=2853389 2024-09-12T00:19:29.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.081+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~HVECN0IDB3RI.0 size=1048576 2024-09-12T00:19:29.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.082+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~HVECN0IDB3RI.1 size=608620 2024-09-12T00:19:29.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.084+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=HVECN0IDB3RI tag=T019XWUSFSM7 type=write size=2705772 2024-09-12T00:19:29.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.086+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=BY2Q1JNP93G2 type=write size=686710 2024-09-12T00:19:29.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.087+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~6FU0FWJSJPQY.0 size=1048576 2024-09-12T00:19:29.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.088+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~6FU0FWJSJPQY.1 size=1048576 2024-09-12T00:19:29.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.089+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~6FU0FWJSJPQY.2 size=25290 2024-09-12T00:19:29.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.091+0000 7f682945b780 1 < completed multipart upload key=6DUQKU3R1RL8 upload=6FU0FWJSJPQY tag=4J4P1LUXM8LJ type=write size=3171018 2024-09-12T00:19:29.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.093+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=Y7SJVMYZDZCH type=del size=3041412 2024-09-12T00:19:29.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.094+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~OUT7SDS5QZBS.0 size=1048576 2024-09-12T00:19:29.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.095+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~OUT7SDS5QZBS.1 size=448899 2024-09-12T00:19:29.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.098+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=OUT7SDS5QZBS tag=LFZGE130ZLXY type=write size=2546051 2024-09-12T00:19:29.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.099+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=PD2JFQ6RTS33 type=del size=1699052 2024-09-12T00:19:29.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.101+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=Q5Y8B0L8E5H2 type=del 2024-09-12T00:19:29.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.102+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=ACWVMG5E93F9 type=del size=3015545 2024-09-12T00:19:29.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.105+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~MKIEYALL0MK9.0 size=1048576 2024-09-12T00:19:29.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.105+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~MKIEYALL0MK9.1 size=973822 2024-09-12T00:19:29.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.108+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=MKIEYALL0MK9 tag=Y07REXZZX85V type=write size=3070974 2024-09-12T00:19:29.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.108+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=96B63524RY25 type=del size=2099330 2024-09-12T00:19:29.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.110+0000 7f682945b780 1 < completed write operation key=6DUQKU3R1RL8 tag=CDR19VZNBK8Z type=write size=327175 2024-09-12T00:19:29.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.113+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~AQKACX17CV74.0 size=1048576 2024-09-12T00:19:29.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.114+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~AQKACX17CV74.1 size=375660 2024-09-12T00:19:29.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.114+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=AQKACX17CV74 tag=TZKPGCBC249G type=write size=2472812 2024-09-12T00:19:29.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.116+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~VG2AMY5SMUZE.0 size=1048576 2024-09-12T00:19:29.116 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.117+0000 7f682945b780 1 < completed part key=_multipart_P56VIP3WIOJL.2~VG2AMY5SMUZE.1 size=1022809 2024-09-12T00:19:29.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.119+0000 7f682945b780 1 < completed multipart upload key=P56VIP3WIOJL upload=VG2AMY5SMUZE tag=263RAYHLPIDQ type=write size=3119961 2024-09-12T00:19:29.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.121+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=Y66Q28V6FS7K type=del size=342757 2024-09-12T00:19:29.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.123+0000 7f682945b780 1 < completed delete operation key=8D9UC8FJ16UK tag=I852PMF3JHIX type=del 2024-09-12T00:19:29.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.124+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=WRFE9MVYYQGH type=write size=1012691 2024-09-12T00:19:29.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.126+0000 7f682945b780 1 < canceled operation key=7RRJO383D8TH tag=X9PACZSMK43G type=del size=2532991 2024-09-12T00:19:29.128 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.128+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~S83424RFPPO3.0 size=1048576 2024-09-12T00:19:29.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.130+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~S83424RFPPO3.1 size=1048576 2024-09-12T00:19:29.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.131+0000 7f682945b780 1 > prepared part key=_multipart_CE5EBY7EGY4Z.2~S83424RFPPO3.2 size=293293 2024-09-12T00:19:29.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.131+0000 7f682945b780 1 > prepared multipart upload key=CE5EBY7EGY4Z upload=S83424RFPPO3 tag=H94D3MJKYDXL type=write size=3439021 2024-09-12T00:19:29.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.133+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~H7E7607PVUBV.0 size=772755 2024-09-12T00:19:29.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.135+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=H7E7607PVUBV tag=9BX0QL1NIJFK type=write size=1821331 2024-09-12T00:19:29.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.136+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=Z91QL6HTR0I0 type=write size=494485 2024-09-12T00:19:29.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.138+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=UZ59PDERGOWR type=del 2024-09-12T00:19:29.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.139+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=N2B32NL7COCL type=del size=831700 2024-09-12T00:19:29.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.141+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~V695LH30DWL4.0 size=1048576 2024-09-12T00:19:29.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.142+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~V695LH30DWL4.1 size=1048576 2024-09-12T00:19:29.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.143+0000 7f682945b780 1 < completed part key=_multipart_6DUQKU3R1RL8.2~V695LH30DWL4.2 size=932069 2024-09-12T00:19:29.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.145+0000 7f682945b780 1 < completed multipart upload key=6DUQKU3R1RL8 upload=V695LH30DWL4 tag=Y32I00ZDXYEA type=write size=4077797 2024-09-12T00:19:29.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.147+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=75373Q9XHPG8 type=del size=281592 2024-09-12T00:19:29.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.148+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~5DHKC18X01ZO.0 size=604064 2024-09-12T00:19:29.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.150+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=5DHKC18X01ZO tag=OBF1PSC3JGWL type=write size=1652640 2024-09-12T00:19:29.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.151+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=W364OSDAT642 type=del size=1221832 2024-09-12T00:19:29.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.153+0000 7f682945b780 1 < completed write operation key=1RAFARG1JXFQ tag=TBRCLLB6DEIE type=write size=182666 2024-09-12T00:19:29.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.155+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=POIWU1O7YQS3 type=del size=2467122 2024-09-12T00:19:29.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.156+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=HN6IJHJM9NG7 type=del 2024-09-12T00:19:29.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.158+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=LXL7NNJQ7K4J type=del size=2454250 2024-09-12T00:19:29.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.160+0000 7f682945b780 1 < suggested remove operation key=D06ZUP2ZXX42 tag=5L44OAY0SHIE type=del 2024-09-12T00:19:29.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.163+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~O2DL3YXVYED6.0 size=1048576 2024-09-12T00:19:29.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.164+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~O2DL3YXVYED6.1 size=537475 2024-09-12T00:19:29.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.164+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=O2DL3YXVYED6 tag=F0CJPPE5K16K type=write size=2634627 2024-09-12T00:19:29.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.165+0000 7f682945b780 1 < completed write operation key=BK212Z99RM7F tag=BY2Q1JNP93G2 type=write size=686710 2024-09-12T00:19:29.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.167+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=LHHMAVQK7RRY type=write size=223935 2024-09-12T00:19:29.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.168+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=Y7SJVMYZDZCH type=del 2024-09-12T00:19:29.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.172+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~HGDPO4FJ33KA.0 size=1048576 2024-09-12T00:19:29.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.172+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~HGDPO4FJ33KA.1 size=1048576 2024-09-12T00:19:29.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.174+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~HGDPO4FJ33KA.2 size=1044589 2024-09-12T00:19:29.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.174+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=HGDPO4FJ33KA tag=BYUOUUNBKQ9S type=write size=4190317 2024-09-12T00:19:29.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.178+0000 7f682945b780 1 < suggested remove operation key=R2OAUUKLV7OK tag=PD2JFQ6RTS33 type=del 2024-09-12T00:19:29.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.180+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~NSLBQZQ03V1S.0 size=1048576 2024-09-12T00:19:29.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.181+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~NSLBQZQ03V1S.1 size=1048576 2024-09-12T00:19:29.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.182+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~NSLBQZQ03V1S.2 size=683317 2024-09-12T00:19:29.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.182+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=NSLBQZQ03V1S tag=3OWQX8QR6X6Y type=write size=3829045 2024-09-12T00:19:29.183 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.183+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=ACWVMG5E93F9 type=del 2024-09-12T00:19:29.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.185+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=WE1J0N3NA6B6 type=del size=3462246 2024-09-12T00:19:29.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.186+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=96B63524RY25 type=del 2024-09-12T00:19:29.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.187+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=IISHVCO91677 type=write size=426495 2024-09-12T00:19:29.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.191+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~AQKACX17CV74.0 size=1048576 2024-09-12T00:19:29.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.192+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~AQKACX17CV74.1 size=375660 2024-09-12T00:19:29.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.194+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=AQKACX17CV74 tag=TZKPGCBC249G type=write size=2472812 2024-09-12T00:19:29.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.195+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=NVYEN14IOZMH type=del size=4189182 2024-09-12T00:19:29.196 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.197+0000 7f682945b780 1 < completed delete operation key=38JJBFDTIYSU tag=Y66Q28V6FS7K type=del 2024-09-12T00:19:29.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.198+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=APUWCRCMZZQH type=del size=1867576 2024-09-12T00:19:29.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.199+0000 7f682945b780 1 < completed write operation key=1RAFARG1JXFQ tag=WRFE9MVYYQGH type=write size=1012691 2024-09-12T00:19:29.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.201+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=EUQFHRWIOXT0 type=del size=1025337 2024-09-12T00:19:29.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.202+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~S83424RFPPO3.0 size=1048576 2024-09-12T00:19:29.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.203+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~S83424RFPPO3.1 size=1048576 2024-09-12T00:19:29.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.204+0000 7f682945b780 1 < completed part key=_multipart_CE5EBY7EGY4Z.2~S83424RFPPO3.2 size=293293 2024-09-12T00:19:29.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.206+0000 7f682945b780 1 < completed multipart upload key=CE5EBY7EGY4Z upload=S83424RFPPO3 tag=H94D3MJKYDXL type=write size=3439021 2024-09-12T00:19:29.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.209+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~FMKZ41BI62U5.0 size=1048576 2024-09-12T00:19:29.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.210+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~FMKZ41BI62U5.1 size=1048576 2024-09-12T00:19:29.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.211+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~FMKZ41BI62U5.2 size=21694 2024-09-12T00:19:29.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.211+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=FMKZ41BI62U5 tag=96NCF6C80ORP type=write size=3167422 2024-09-12T00:19:29.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.212+0000 7f682945b780 1 < completed write operation key=17S1X3WXCNAR tag=Z91QL6HTR0I0 type=write size=494485 2024-09-12T00:19:29.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.213+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=MS60R1RCLH5U type=del size=1657161 2024-09-12T00:19:29.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.215+0000 7f682945b780 1 < completed delete operation key=BI3KCKV4CRWR tag=N2B32NL7COCL type=del 2024-09-12T00:19:29.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.217+0000 7f682945b780 1 > prepared part key=_multipart_R2OAUUKLV7OK.2~AKS7SOZJ5JDT.0 size=756172 2024-09-12T00:19:29.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.217+0000 7f682945b780 1 > prepared multipart upload key=R2OAUUKLV7OK upload=AKS7SOZJ5JDT tag=YNZSF7W54CT5 type=write size=1804748 2024-09-12T00:19:29.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.218+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=75373Q9XHPG8 type=del 2024-09-12T00:19:29.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.220+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=7XFA3OVZ6OP0 type=write size=849006 2024-09-12T00:19:29.221 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.221+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=W364OSDAT642 type=del 2024-09-12T00:19:29.223 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.223+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~FUH7CTH3JL55.0 size=1048576 2024-09-12T00:19:29.224 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.225+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~FUH7CTH3JL55.1 size=586183 2024-09-12T00:19:29.224 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.225+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=FUH7CTH3JL55 tag=NHLVBONBWD09 type=write size=2683335 2024-09-12T00:19:29.226 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.226+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=POIWU1O7YQS3 type=del 2024-09-12T00:19:29.228 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.228+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~CLV3KNTQQADV.0 size=792548 2024-09-12T00:19:29.228 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.228+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=CLV3KNTQQADV tag=TC40OPSVW74G type=write size=1841124 2024-09-12T00:19:29.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.229+0000 7f682945b780 -1 < no bi entry to suggest for operation key=D06ZUP2ZXX42 tag=LXL7NNJQ7K4J type=del size=2454250: (2) No such file or directory 2024-09-12T00:19:29.231 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.231+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~C1WPIMO69T3W.0 size=1048576 2024-09-12T00:19:29.232 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.233+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~C1WPIMO69T3W.1 size=1048576 2024-09-12T00:19:29.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.234+0000 7f682945b780 1 > prepared part key=_multipart_CT2L8L3849IN.2~C1WPIMO69T3W.2 size=573902 2024-09-12T00:19:29.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.234+0000 7f682945b780 1 > prepared multipart upload key=CT2L8L3849IN upload=C1WPIMO69T3W tag=R95V79CWVH4X type=write size=3719630 2024-09-12T00:19:29.235 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.235+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~O2DL3YXVYED6.0 size=1048576 2024-09-12T00:19:29.236 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.236+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~O2DL3YXVYED6.1 size=537475 2024-09-12T00:19:29.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.239+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=O2DL3YXVYED6 tag=F0CJPPE5K16K type=write size=2634627 2024-09-12T00:19:29.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.241+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~SGGMFNQIAFL2.0 size=1048576 2024-09-12T00:19:29.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.242+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~SGGMFNQIAFL2.1 size=178760 2024-09-12T00:19:29.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.242+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=SGGMFNQIAFL2 tag=D9CH6G13IS7Z type=write size=2275912 2024-09-12T00:19:29.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.244+0000 7f682945b780 1 < completed write operation key=BMTPXZ1OA2TZ tag=LHHMAVQK7RRY type=write size=223935 2024-09-12T00:19:29.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.245+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=ATZNH4G7KY8Y type=del size=1275349 2024-09-12T00:19:29.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.246+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~HGDPO4FJ33KA.0 size=1048576 2024-09-12T00:19:29.247 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.247+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~HGDPO4FJ33KA.1 size=1048576 2024-09-12T00:19:29.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.248+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~HGDPO4FJ33KA.2 size=1044589 2024-09-12T00:19:29.250 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.251+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=HGDPO4FJ33KA tag=BYUOUUNBKQ9S type=write size=4190317 2024-09-12T00:19:29.251 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.252+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=H89Y854G54UP type=write size=466153 2024-09-12T00:19:29.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.253+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~NSLBQZQ03V1S.0 size=1048576 2024-09-12T00:19:29.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.255+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~NSLBQZQ03V1S.1 size=1048576 2024-09-12T00:19:29.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.256+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~NSLBQZQ03V1S.2 size=683317 2024-09-12T00:19:29.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.258+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=NSLBQZQ03V1S tag=3OWQX8QR6X6Y type=write size=3829045 2024-09-12T00:19:29.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.259+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=R1COF63GBWQG type=del size=993744 2024-09-12T00:19:29.262 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.262+0000 7f682945b780 1 < suggested remove operation key=6DUQKU3R1RL8 tag=WE1J0N3NA6B6 type=del 2024-09-12T00:19:29.263 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.264+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=U3CP40XIQODO type=del size=2405134 2024-09-12T00:19:29.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.265+0000 7f682945b780 1 < completed write operation key=Y65K9I6K41X5 tag=IISHVCO91677 type=write size=426495 2024-09-12T00:19:29.266 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.266+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=EUKFRXGD94ZA type=del size=3307523 2024-09-12T00:19:29.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.268+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=NVYEN14IOZMH type=del 2024-09-12T00:19:29.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.269+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=40C26ZIDQPVU type=del size=3406514 2024-09-12T00:19:29.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.271+0000 7f682945b780 1 < completed delete operation key=7RRJO383D8TH tag=APUWCRCMZZQH type=del 2024-09-12T00:19:29.272 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.272+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=YDVOGIHB25OV type=del size=3991353 2024-09-12T00:19:29.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.274+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=EUQFHRWIOXT0 type=del 2024-09-12T00:19:29.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.275+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=ZWB1464HJ0VK type=del size=1060325 2024-09-12T00:19:29.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.278+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~FMKZ41BI62U5.0 size=1048576 2024-09-12T00:19:29.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.278+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~FMKZ41BI62U5.1 size=1048576 2024-09-12T00:19:29.279 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.279+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~FMKZ41BI62U5.2 size=21694 2024-09-12T00:19:29.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.282+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=FMKZ41BI62U5 tag=96NCF6C80ORP type=write size=3167422 2024-09-12T00:19:29.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.283+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=JX8HK13V6X52 type=del size=120053 2024-09-12T00:19:29.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.286+0000 7f682945b780 1 < suggested update operation key=R2OAUUKLV7OK tag=MS60R1RCLH5U type=del size=1657161 2024-09-12T00:19:29.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.287+0000 7f682945b780 1 > prepared operation key=1RAFARG1JXFQ tag=0CW7KUYT84YZ type=del size=3771367 2024-09-12T00:19:29.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.289+0000 7f682945b780 1 < completed part key=_multipart_R2OAUUKLV7OK.2~AKS7SOZJ5JDT.0 size=756172 2024-09-12T00:19:29.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.291+0000 7f682945b780 1 < completed multipart upload key=R2OAUUKLV7OK upload=AKS7SOZJ5JDT tag=YNZSF7W54CT5 type=write size=1804748 2024-09-12T00:19:29.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.292+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=QSU0ZJC0ER2I type=write size=581055 2024-09-12T00:19:29.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.294+0000 7f682945b780 1 < completed write operation key=17S1X3WXCNAR tag=7XFA3OVZ6OP0 type=write size=849006 2024-09-12T00:19:29.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.295+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=8VPD2B7GX7LX type=del size=1175086 2024-09-12T00:19:29.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.296+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~FUH7CTH3JL55.0 size=1048576 2024-09-12T00:19:29.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.296+0000 7f682945b780 1 < canceled part key=_multipart_JAVE3HR52R5C.2~FUH7CTH3JL55.1 size=586183 2024-09-12T00:19:29.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.300+0000 7f682945b780 1 < canceled multipart upload key=JAVE3HR52R5C upload=FUH7CTH3JL55 tag=NHLVBONBWD09 type=write size=2683335 2024-09-12T00:19:29.300 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.301+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=5LOHEO468MPC type=del size=2341099 2024-09-12T00:19:29.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.302+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~CLV3KNTQQADV.0 size=792548 2024-09-12T00:19:29.304 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.305+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=CLV3KNTQQADV tag=TC40OPSVW74G type=write size=1841124 2024-09-12T00:19:29.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.306+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=E0YYQB0QIRKW type=write size=54242 2024-09-12T00:19:29.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.307+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~C1WPIMO69T3W.0 size=1048576 2024-09-12T00:19:29.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.308+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~C1WPIMO69T3W.1 size=1048576 2024-09-12T00:19:29.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.310+0000 7f682945b780 1 < completed part key=_multipart_CT2L8L3849IN.2~C1WPIMO69T3W.2 size=573902 2024-09-12T00:19:29.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.312+0000 7f682945b780 1 < completed multipart upload key=CT2L8L3849IN upload=C1WPIMO69T3W tag=R95V79CWVH4X type=write size=3719630 2024-09-12T00:19:29.312 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.313+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=2TJNBSCTHBV4 type=del size=481947 2024-09-12T00:19:29.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.314+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~SGGMFNQIAFL2.0 size=1048576 2024-09-12T00:19:29.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.314+0000 7f682945b780 1 < canceled part key=_multipart_Y65K9I6K41X5.2~SGGMFNQIAFL2.1 size=178760 2024-09-12T00:19:29.316 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.317+0000 7f682945b780 1 < canceled multipart upload key=Y65K9I6K41X5 upload=SGGMFNQIAFL2 tag=D9CH6G13IS7Z type=write size=2275912 2024-09-12T00:19:29.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.322+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~UB7EDHNMBAF0.0 size=1048576 2024-09-12T00:19:29.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.322+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~UB7EDHNMBAF0.1 size=1025867 2024-09-12T00:19:29.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.322+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=UB7EDHNMBAF0 tag=REP4PXXEKLKR type=write size=3123019 2024-09-12T00:19:29.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.323+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=ATZNH4G7KY8Y type=del 2024-09-12T00:19:29.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.325+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=RMGU22YZA1ZV type=del size=55308 2024-09-12T00:19:29.328 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.328+0000 7f682945b780 1 < suggested update operation key=IUPAGGPATJB4 tag=H89Y854G54UP type=write size=466153 2024-09-12T00:19:29.329 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.330+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=HNP03T75RF54 type=del size=1004281 2024-09-12T00:19:29.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.331+0000 7f682945b780 1 < completed delete operation key=8D9UC8FJ16UK tag=R1COF63GBWQG type=del 2024-09-12T00:19:29.333 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.335+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~489GV4G32B86.0 size=549158 2024-09-12T00:19:29.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.335+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=489GV4G32B86 tag=IS2H92S8KLV9 type=write size=1597734 2024-09-12T00:19:29.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.336+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=U3CP40XIQODO type=del 2024-09-12T00:19:29.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.338+0000 7f682945b780 1 > prepared operation key=CT2L8L3849IN tag=LUDL59F15O4Q type=write size=602217 2024-09-12T00:19:29.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.339+0000 7f682945b780 1 < completed delete operation key=CT2L8L3849IN tag=EUKFRXGD94ZA type=del 2024-09-12T00:19:29.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.342+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~11QCQ1NTJG5O.0 size=1048576 2024-09-12T00:19:29.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.343+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~11QCQ1NTJG5O.1 size=306432 2024-09-12T00:19:29.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.343+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=11QCQ1NTJG5O tag=W1P8CUZMS774 type=write size=2403584 2024-09-12T00:19:29.343 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.344+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=40C26ZIDQPVU type=del 2024-09-12T00:19:29.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.346+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=NC5ERGPUNJ4J type=del size=3297482 2024-09-12T00:19:29.346 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.347+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=YDVOGIHB25OV type=del 2024-09-12T00:19:29.349 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.349+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~O39400YS30K9.0 size=1048576 2024-09-12T00:19:29.350 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.351+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~O39400YS30K9.1 size=958298 2024-09-12T00:19:29.350 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.351+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=O39400YS30K9 tag=K4MZNR9Z53GA type=write size=3055450 2024-09-12T00:19:29.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.352+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=ZWB1464HJ0VK type=del 2024-09-12T00:19:29.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.355+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~VYBKBXOOGI2A.0 size=169829 2024-09-12T00:19:29.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.355+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=VYBKBXOOGI2A tag=KUY141SQ5A29 type=write size=1218405 2024-09-12T00:19:29.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.356+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=JX8HK13V6X52 type=del 2024-09-12T00:19:29.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.358+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=2ZC31VCPNT09 type=del size=1399340 2024-09-12T00:19:29.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.359+0000 7f682945b780 1 < completed delete operation key=1RAFARG1JXFQ tag=0CW7KUYT84YZ type=del 2024-09-12T00:19:29.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.362+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~UVK1UOAWZEH6.0 size=1048576 2024-09-12T00:19:29.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.363+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~UVK1UOAWZEH6.1 size=1048576 2024-09-12T00:19:29.364 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.364+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~UVK1UOAWZEH6.2 size=1042190 2024-09-12T00:19:29.364 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.364+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=UVK1UOAWZEH6 tag=X3I6GD0X1ZMN type=write size=4187918 2024-09-12T00:19:29.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.366+0000 7f682945b780 1 < completed write operation key=6DUQKU3R1RL8 tag=QSU0ZJC0ER2I type=write size=581055 2024-09-12T00:19:29.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.368+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=HNRVUBXE0U67 type=del size=291732 2024-09-12T00:19:29.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.369+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=8VPD2B7GX7LX type=del 2024-09-12T00:19:29.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.372+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~IMKM8FH0RQRP.0 size=1048576 2024-09-12T00:19:29.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.374+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~IMKM8FH0RQRP.1 size=1048576 2024-09-12T00:19:29.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.376+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~IMKM8FH0RQRP.2 size=560075 2024-09-12T00:19:29.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.376+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=IMKM8FH0RQRP tag=2BCOKHVFQWCT type=write size=3705803 2024-09-12T00:19:29.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.377+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=5LOHEO468MPC type=del 2024-09-12T00:19:29.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.378+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=ETJP50K6X711 type=del size=255294 2024-09-12T00:19:29.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.380+0000 7f682945b780 1 < completed write operation key=BV3D543J63H1 tag=E0YYQB0QIRKW type=write size=54242 2024-09-12T00:19:29.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.381+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=U6IVVXA6BHUP type=del size=2045299 2024-09-12T00:19:29.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.383+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=2TJNBSCTHBV4 type=del 2024-09-12T00:19:29.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.386+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~E4WTSW6NDQN0.0 size=1048576 2024-09-12T00:19:29.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.387+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~E4WTSW6NDQN0.1 size=692025 2024-09-12T00:19:29.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.387+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=E4WTSW6NDQN0 tag=C2IODB5CQ6GA type=write size=2789177 2024-09-12T00:19:29.388 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.388+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~UB7EDHNMBAF0.0 size=1048576 2024-09-12T00:19:29.389 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.390+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~UB7EDHNMBAF0.1 size=1025867 2024-09-12T00:19:29.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.392+0000 7f682945b780 1 < completed multipart upload key=D06ZUP2ZXX42 upload=UB7EDHNMBAF0 tag=REP4PXXEKLKR type=write size=3123019 2024-09-12T00:19:29.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.394+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=OS1N6RLJLZ0P type=write size=118418 2024-09-12T00:19:29.395 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.395+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=RMGU22YZA1ZV type=del 2024-09-12T00:19:29.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.398+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~ID3U475ZPF9W.0 size=112767 2024-09-12T00:19:29.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.398+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=ID3U475ZPF9W tag=6E7SKSL58A8Z type=write size=1161343 2024-09-12T00:19:29.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.399+0000 7f682945b780 1 < completed delete operation key=R7V03ML1H80V tag=HNP03T75RF54 type=del 2024-09-12T00:19:29.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.402+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=UD9FQHBWKRWG type=del size=3642381 2024-09-12T00:19:29.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.403+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~489GV4G32B86.0 size=549158 2024-09-12T00:19:29.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.406+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=489GV4G32B86 tag=IS2H92S8KLV9 type=write size=1597734 2024-09-12T00:19:29.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.407+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~AATOOG60FKLN.0 size=1048576 2024-09-12T00:19:29.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.409+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~AATOOG60FKLN.1 size=1048576 2024-09-12T00:19:29.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.411+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~AATOOG60FKLN.2 size=129352 2024-09-12T00:19:29.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.411+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=AATOOG60FKLN tag=TAHBE54TFUF0 type=write size=3275080 2024-09-12T00:19:29.411 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.411+0000 7f682945b780 1 < completed write operation key=CT2L8L3849IN tag=LUDL59F15O4Q type=write size=602217 2024-09-12T00:19:29.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.413+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=MQT6IULLV1WT type=write size=176257 2024-09-12T00:19:29.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.414+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~11QCQ1NTJG5O.0 size=1048576 2024-09-12T00:19:29.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.415+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~11QCQ1NTJG5O.1 size=306432 2024-09-12T00:19:29.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.417+0000 7f682945b780 1 < completed multipart upload key=D06ZUP2ZXX42 upload=11QCQ1NTJG5O tag=W1P8CUZMS774 type=write size=2403584 2024-09-12T00:19:29.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.419+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=QGV4E8ENABGQ type=write size=515865 2024-09-12T00:19:29.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.420+0000 7f682945b780 1 < canceled operation key=Y65K9I6K41X5 tag=NC5ERGPUNJ4J type=del size=3297482 2024-09-12T00:19:29.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.421+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=J0X7OAGNNX0P type=del size=2030963 2024-09-12T00:19:29.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.423+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~O39400YS30K9.0 size=1048576 2024-09-12T00:19:29.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.424+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~O39400YS30K9.1 size=958298 2024-09-12T00:19:29.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.427+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=O39400YS30K9 tag=K4MZNR9Z53GA type=write size=3055450 2024-09-12T00:19:29.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.429+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~USVRH7R3QLSC.0 size=156077 2024-09-12T00:19:29.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.429+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=USVRH7R3QLSC tag=SO14SD58MAJF type=write size=1204653 2024-09-12T00:19:29.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.430+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~VYBKBXOOGI2A.0 size=169829 2024-09-12T00:19:29.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.432+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=VYBKBXOOGI2A tag=KUY141SQ5A29 type=write size=1218405 2024-09-12T00:19:29.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.433+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=ZLV3CLHXDSMZ type=del size=870852 2024-09-12T00:19:29.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.435+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=2ZC31VCPNT09 type=del 2024-09-12T00:19:29.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.436+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=ET6681WXDCWC type=del size=2661866 2024-09-12T00:19:29.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.438+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~UVK1UOAWZEH6.0 size=1048576 2024-09-12T00:19:29.438 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.439+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~UVK1UOAWZEH6.1 size=1048576 2024-09-12T00:19:29.439 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.441+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~UVK1UOAWZEH6.2 size=1042190 2024-09-12T00:19:29.442 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.442+0000 7f682945b780 1 < completed multipart upload key=AZKLWMQ818SW upload=UVK1UOAWZEH6 tag=X3I6GD0X1ZMN type=write size=4187918 2024-09-12T00:19:29.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.443+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=JNRH0RYV5OOO type=del size=287119 2024-09-12T00:19:29.445 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.446+0000 7f682945b780 1 < suggested remove operation key=SGWTWN8RTKDD tag=HNRVUBXE0U67 type=del 2024-09-12T00:19:29.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.447+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=J68X9TZ7UUTW type=write size=637019 2024-09-12T00:19:29.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.449+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~IMKM8FH0RQRP.0 size=1048576 2024-09-12T00:19:29.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.450+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~IMKM8FH0RQRP.1 size=1048576 2024-09-12T00:19:29.450 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.451+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~IMKM8FH0RQRP.2 size=560075 2024-09-12T00:19:29.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.453+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=IMKM8FH0RQRP tag=2BCOKHVFQWCT type=write size=3705803 2024-09-12T00:19:29.455 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.456+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=YHV5TQWAVQXR type=del size=192891 2024-09-12T00:19:29.457 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.457+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=ETJP50K6X711 type=del 2024-09-12T00:19:29.458 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.459+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=PUSYJX3Y9OJZ type=del size=463632 2024-09-12T00:19:29.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.461+0000 7f682945b780 1 < suggested update operation key=Y65K9I6K41X5 tag=U6IVVXA6BHUP type=del size=2045299 2024-09-12T00:19:29.463 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.464+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~UKMU10PY2AF5.0 size=1048576 2024-09-12T00:19:29.464 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.465+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~UKMU10PY2AF5.1 size=1026192 2024-09-12T00:19:29.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.465+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=UKMU10PY2AF5 tag=PV038Y5FVIBW type=write size=3123344 2024-09-12T00:19:29.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.466+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~E4WTSW6NDQN0.0 size=1048576 2024-09-12T00:19:29.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.467+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~E4WTSW6NDQN0.1 size=692025 2024-09-12T00:19:29.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.470+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=E4WTSW6NDQN0 tag=C2IODB5CQ6GA type=write size=2789177 2024-09-12T00:19:29.472 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.472+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~UVJ3G9NUASQP.0 size=1048576 2024-09-12T00:19:29.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.474+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~UVJ3G9NUASQP.1 size=1048576 2024-09-12T00:19:29.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.475+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~UVJ3G9NUASQP.2 size=401276 2024-09-12T00:19:29.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.475+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=UVJ3G9NUASQP tag=ACQSVHIPYPFB type=write size=3547004 2024-09-12T00:19:29.476 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.476+0000 7f682945b780 1 < completed write operation key=BI3KCKV4CRWR tag=OS1N6RLJLZ0P type=write size=118418 2024-09-12T00:19:29.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.478+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=L4Y0CFH3693C type=write size=618739 2024-09-12T00:19:29.479 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.480+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~ID3U475ZPF9W.0 size=112767 2024-09-12T00:19:29.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.482+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=ID3U475ZPF9W tag=6E7SKSL58A8Z type=write size=1161343 2024-09-12T00:19:29.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.484+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=1CPLZPQTGG62 type=del size=806286 2024-09-12T00:19:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.486+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=UD9FQHBWKRWG type=del 2024-09-12T00:19:29.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.487+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=F6SDE1RU14OF type=write size=869075 2024-09-12T00:19:29.488 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.489+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~AATOOG60FKLN.0 size=1048576 2024-09-12T00:19:29.489 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.490+0000 7f682945b780 1 < completed part key=_multipart_AZKLWMQ818SW.2~AATOOG60FKLN.1 size=1048576 2024-09-12T00:19:29.489 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.490+0000 7f682945b780 1 < canceled part key=_multipart_AZKLWMQ818SW.2~AATOOG60FKLN.2 size=129352 2024-09-12T00:19:29.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.492+0000 7f682945b780 1 < canceled multipart upload key=AZKLWMQ818SW upload=AATOOG60FKLN tag=TAHBE54TFUF0 type=write size=3275080 2024-09-12T00:19:29.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.494+0000 7f682945b780 1 > prepared operation key=R2OAUUKLV7OK tag=HIY7FWSBZX5O type=del size=658213 2024-09-12T00:19:29.495 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.495+0000 7f682945b780 1 < completed write operation key=9Q4HFV4F2KE2 tag=MQT6IULLV1WT type=write size=176257 2024-09-12T00:19:29.497 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.498+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~0BSMTGPM6N84.0 size=1048576 2024-09-12T00:19:29.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.499+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~0BSMTGPM6N84.1 size=477578 2024-09-12T00:19:29.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.499+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=0BSMTGPM6N84 tag=IE1I6LF4427T type=write size=2574730 2024-09-12T00:19:29.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.500+0000 7f682945b780 1 < canceled operation key=JAVE3HR52R5C tag=QGV4E8ENABGQ type=write size=515865 2024-09-12T00:19:29.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.501+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=KABC3Z2A0FWO type=del size=1540910 2024-09-12T00:19:29.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.503+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=J0X7OAGNNX0P type=del 2024-09-12T00:19:29.504 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.504+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=PP3JQ10Y21J1 type=del size=3370909 2024-09-12T00:19:29.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.506+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~USVRH7R3QLSC.0 size=156077 2024-09-12T00:19:29.507 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.509+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=USVRH7R3QLSC tag=SO14SD58MAJF type=write size=1204653 2024-09-12T00:19:29.509 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.509+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=7G8UZLH4XB1W type=del size=4006424 2024-09-12T00:19:29.510 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.511+0000 7f682945b780 1 < completed delete operation key=38JJBFDTIYSU tag=ZLV3CLHXDSMZ type=del 2024-09-12T00:19:29.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.512+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=T0FMLF32KV3D type=del size=3109783 2024-09-12T00:19:29.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.514+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=ET6681WXDCWC type=del 2024-09-12T00:19:29.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.517+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~YWR4QUX2VU0B.0 size=1048576 2024-09-12T00:19:29.517 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.518+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~YWR4QUX2VU0B.1 size=1048576 2024-09-12T00:19:29.518 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.519+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~YWR4QUX2VU0B.2 size=564994 2024-09-12T00:19:29.518 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.519+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=YWR4QUX2VU0B tag=LH0L9DKCI0JL type=write size=3710722 2024-09-12T00:19:29.521 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.522+0000 7f682945b780 1 < suggested update operation key=COUJXCOSVPDS tag=JNRH0RYV5OOO type=del size=287119 2024-09-12T00:19:29.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.523+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=V9NXAX9V9B87 type=del size=2572711 2024-09-12T00:19:29.524 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.525+0000 7f682945b780 1 < completed write operation key=IUPAGGPATJB4 tag=J68X9TZ7UUTW type=write size=637019 2024-09-12T00:19:29.526 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.526+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=SO16HZX4D6EG type=del size=3836531 2024-09-12T00:19:29.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.528+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=YHV5TQWAVQXR type=del 2024-09-12T00:19:29.529 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.530+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=FVE61YQUGQSC type=del size=2309065 2024-09-12T00:19:29.530 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.531+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=PUSYJX3Y9OJZ type=del 2024-09-12T00:19:29.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.533+0000 7f682945b780 1 > prepared part key=_multipart_AZKLWMQ818SW.2~U6SIYET6ZU9A.0 size=378246 2024-09-12T00:19:29.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.533+0000 7f682945b780 1 > prepared multipart upload key=AZKLWMQ818SW upload=U6SIYET6ZU9A tag=DROB332QP1N1 type=write size=1426822 2024-09-12T00:19:29.534 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.535+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~UKMU10PY2AF5.0 size=1048576 2024-09-12T00:19:29.535 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.536+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~UKMU10PY2AF5.1 size=1026192 2024-09-12T00:19:29.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.538+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=UKMU10PY2AF5 tag=PV038Y5FVIBW type=write size=3123344 2024-09-12T00:19:29.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.540+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=ME0N7PN8OD1S type=del size=959046 2024-09-12T00:19:29.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.541+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~UVJ3G9NUASQP.0 size=1048576 2024-09-12T00:19:29.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.541+0000 7f682945b780 1 < canceled part key=_multipart_JAVE3HR52R5C.2~UVJ3G9NUASQP.1 size=1048576 2024-09-12T00:19:29.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.542+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~UVJ3G9NUASQP.2 size=401276 2024-09-12T00:19:29.544 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.544+0000 7f682945b780 1 < canceled multipart upload key=JAVE3HR52R5C upload=UVJ3G9NUASQP tag=ACQSVHIPYPFB type=write size=3547004 2024-09-12T00:19:29.545 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.546+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=918DLRCJC6WM type=del size=2279806 2024-09-12T00:19:29.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.547+0000 7f682945b780 1 < completed write operation key=TGOBZH6DZK71 tag=L4Y0CFH3693C type=write size=618739 2024-09-12T00:19:29.549 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.549+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~8P25E7OJ7XF7.0 size=587027 2024-09-12T00:19:29.549 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.549+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=8P25E7OJ7XF7 tag=9H4OB0LGW336 type=write size=1635603 2024-09-12T00:19:29.552 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.552+0000 7f682945b780 1 < suggested remove operation key=SGWTWN8RTKDD tag=1CPLZPQTGG62 type=del 2024-09-12T00:19:29.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.554+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=OVE8OW43DBSO type=del size=1370888 2024-09-12T00:19:29.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.555+0000 7f682945b780 1 < completed write operation key=6DUQKU3R1RL8 tag=F6SDE1RU14OF type=write size=869075 2024-09-12T00:19:29.557 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.557+0000 7f682945b780 1 > prepared part key=_multipart_7RRJO383D8TH.2~D4P7HEF35BPQ.0 size=624700 2024-09-12T00:19:29.557 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.557+0000 7f682945b780 1 > prepared multipart upload key=7RRJO383D8TH upload=D4P7HEF35BPQ tag=34F0E65ZTWFD type=write size=1673276 2024-09-12T00:19:29.558 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.559+0000 7f682945b780 1 < completed delete operation key=R2OAUUKLV7OK tag=HIY7FWSBZX5O type=del 2024-09-12T00:19:29.561 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.562+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~N40LVT7TL32E.0 size=1048576 2024-09-12T00:19:29.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.562+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~N40LVT7TL32E.1 size=721872 2024-09-12T00:19:29.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.562+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=N40LVT7TL32E tag=2CQ29WTBCE46 type=write size=2819024 2024-09-12T00:19:29.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.563+0000 7f682945b780 1 < canceled part key=_multipart_SGWTWN8RTKDD.2~0BSMTGPM6N84.0 size=1048576 2024-09-12T00:19:29.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.564+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~0BSMTGPM6N84.1 size=477578 2024-09-12T00:19:29.565 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.566+0000 7f682945b780 1 < canceled multipart upload key=SGWTWN8RTKDD upload=0BSMTGPM6N84 tag=IE1I6LF4427T type=write size=2574730 2024-09-12T00:19:29.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.569+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~7A3JS4FZLU74.0 size=1048576 2024-09-12T00:19:29.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.570+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~7A3JS4FZLU74.1 size=85217 2024-09-12T00:19:29.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.570+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=7A3JS4FZLU74 tag=SWI347J7NFY7 type=write size=2182369 2024-09-12T00:19:29.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.571+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=KABC3Z2A0FWO type=del 2024-09-12T00:19:29.572 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.573+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=8G5G08DTSHBC type=del size=3053644 2024-09-12T00:19:29.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.574+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=PP3JQ10Y21J1 type=del 2024-09-12T00:19:29.575 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.577+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=4LKGNKDAYSEZ type=del size=4168610 2024-09-12T00:19:29.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.577+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=7G8UZLH4XB1W type=del 2024-09-12T00:19:29.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.579+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=5EKI7R3S5J9U type=del size=2406950 2024-09-12T00:19:29.580 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.580+0000 7f682945b780 1 < canceled operation key=38JJBFDTIYSU tag=T0FMLF32KV3D type=del size=3109783 2024-09-12T00:19:29.581 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.582+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=Y5LTHPTWXSIG type=del size=146377 2024-09-12T00:19:29.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.583+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~YWR4QUX2VU0B.0 size=1048576 2024-09-12T00:19:29.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.584+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~YWR4QUX2VU0B.1 size=1048576 2024-09-12T00:19:29.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.585+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~YWR4QUX2VU0B.2 size=564994 2024-09-12T00:19:29.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.588+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=YWR4QUX2VU0B tag=LH0L9DKCI0JL type=write size=3710722 2024-09-12T00:19:29.590 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.591+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=0XJ6TG8WSJTL type=del size=814042 2024-09-12T00:19:29.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.593+0000 7f682945b780 -1 < failed to complete operation key=SGWTWN8RTKDD tag=V9NXAX9V9B87 type=del size=2572711: (22) Invalid argument 2024-09-12T00:19:29.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.595+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~OXBYEO5CSFUT.0 size=1048576 2024-09-12T00:19:29.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.596+0000 7f682945b780 1 > prepared part key=_multipart_G0ONSUVW4M7R.2~OXBYEO5CSFUT.1 size=449224 2024-09-12T00:19:29.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.596+0000 7f682945b780 1 > prepared multipart upload key=G0ONSUVW4M7R upload=OXBYEO5CSFUT tag=BZ7KAGLB6SPF type=write size=2546376 2024-09-12T00:19:29.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.597+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=SO16HZX4D6EG type=del 2024-09-12T00:19:29.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.599+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=DK0Y6FR2ERN0 type=del size=3685892 2024-09-12T00:19:29.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.600+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=FVE61YQUGQSC type=del 2024-09-12T00:19:29.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.603+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~XEXQU8N4DID8.0 size=222678 2024-09-12T00:19:29.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.603+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=XEXQU8N4DID8 tag=RS442CUJAI6K type=write size=1271254 2024-09-12T00:19:29.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.603+0000 7f682945b780 1 < canceled part key=_multipart_AZKLWMQ818SW.2~U6SIYET6ZU9A.0 size=378246 2024-09-12T00:19:29.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.605+0000 7f682945b780 1 < canceled multipart upload key=AZKLWMQ818SW upload=U6SIYET6ZU9A tag=DROB332QP1N1 type=write size=1426822 2024-09-12T00:19:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.608+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~VXH8AJNTENJ2.0 size=1048576 2024-09-12T00:19:29.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.609+0000 7f682945b780 1 > prepared part key=_multipart_1RAFARG1JXFQ.2~VXH8AJNTENJ2.1 size=359987 2024-09-12T00:19:29.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.609+0000 7f682945b780 1 > prepared multipart upload key=1RAFARG1JXFQ upload=VXH8AJNTENJ2 tag=OS1QFBGSCYTN type=write size=2457139 2024-09-12T00:19:29.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.610+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=ME0N7PN8OD1S type=del 2024-09-12T00:19:29.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.612+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=XGLEFDIGT84V type=del size=2097948 2024-09-12T00:19:29.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.615+0000 7f682945b780 1 < suggested remove operation key=Y65K9I6K41X5 tag=918DLRCJC6WM type=del 2024-09-12T00:19:29.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.616+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=8Y9DXJE985XC type=del size=3762062 2024-09-12T00:19:29.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.617+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~8P25E7OJ7XF7.0 size=587027 2024-09-12T00:19:29.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.619+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=8P25E7OJ7XF7 tag=9H4OB0LGW336 type=write size=1635603 2024-09-12T00:19:29.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.620+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=NC0JS3B10GZ0 type=del size=609317 2024-09-12T00:19:29.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.622+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=OVE8OW43DBSO type=del 2024-09-12T00:19:29.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.623+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=JXDTNXF2980U type=write size=711321 2024-09-12T00:19:29.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.624+0000 7f682945b780 1 < completed part key=_multipart_7RRJO383D8TH.2~D4P7HEF35BPQ.0 size=624700 2024-09-12T00:19:29.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.626+0000 7f682945b780 1 < completed multipart upload key=7RRJO383D8TH upload=D4P7HEF35BPQ tag=34F0E65ZTWFD type=write size=1673276 2024-09-12T00:19:29.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.628+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=8YKYSU0PV4UL type=del size=849727 2024-09-12T00:19:29.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.630+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~N40LVT7TL32E.0 size=1048576 2024-09-12T00:19:29.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.631+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~N40LVT7TL32E.1 size=721872 2024-09-12T00:19:29.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.633+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=N40LVT7TL32E tag=2CQ29WTBCE46 type=write size=2819024 2024-09-12T00:19:29.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.635+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=RCDLRN9R3ZMS type=del size=317378 2024-09-12T00:19:29.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.636+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~7A3JS4FZLU74.0 size=1048576 2024-09-12T00:19:29.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.637+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~7A3JS4FZLU74.1 size=85217 2024-09-12T00:19:29.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.640+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=7A3JS4FZLU74 tag=SWI347J7NFY7 type=write size=2182369 2024-09-12T00:19:29.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.641+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=IBZCL64HGUKB type=del size=2500808 2024-09-12T00:19:29.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.643+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=8G5G08DTSHBC type=del 2024-09-12T00:19:29.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.644+0000 7f682945b780 1 > prepared operation key=6DUQKU3R1RL8 tag=Z5UGSVGFAO23 type=del size=903368 2024-09-12T00:19:29.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.646+0000 7f682945b780 1 < completed delete operation key=BMTPXZ1OA2TZ tag=4LKGNKDAYSEZ type=del 2024-09-12T00:19:29.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.649+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~20C2WNGRI3K3.0 size=432200 2024-09-12T00:19:29.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.649+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=20C2WNGRI3K3 tag=SPFUCUXIXRYH type=write size=1480776 2024-09-12T00:19:29.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.650+0000 7f682945b780 1 < canceled operation key=BK212Z99RM7F tag=5EKI7R3S5J9U type=del size=2406950 2024-09-12T00:19:29.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.652+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~QDFE26MF7JGQ.0 size=1048576 2024-09-12T00:19:29.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.653+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~QDFE26MF7JGQ.1 size=932477 2024-09-12T00:19:29.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.653+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=QDFE26MF7JGQ tag=P7RCAA6PDCPC type=write size=3029629 2024-09-12T00:19:29.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.655+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=Y5LTHPTWXSIG type=del 2024-09-12T00:19:29.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.656+0000 7f682945b780 1 > prepared operation key=3JFMN39G6TTF tag=VZZY2R9F0S21 type=write size=931687 2024-09-12T00:19:29.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.658+0000 7f682945b780 -1 < failed to complete operation key=Y65K9I6K41X5 tag=0XJ6TG8WSJTL type=del size=814042: (22) Invalid argument 2024-09-12T00:19:29.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.660+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~O8DHCRAX2ZUF.0 size=1048576 2024-09-12T00:19:29.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.662+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~O8DHCRAX2ZUF.1 size=1048576 2024-09-12T00:19:29.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.663+0000 7f682945b780 1 > prepared part key=_multipart_SGWTWN8RTKDD.2~O8DHCRAX2ZUF.2 size=69310 2024-09-12T00:19:29.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.663+0000 7f682945b780 1 > prepared multipart upload key=SGWTWN8RTKDD upload=O8DHCRAX2ZUF tag=33GA2UK9W7OA type=write size=3215038 2024-09-12T00:19:29.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.665+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~OXBYEO5CSFUT.0 size=1048576 2024-09-12T00:19:29.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.665+0000 7f682945b780 1 < completed part key=_multipart_G0ONSUVW4M7R.2~OXBYEO5CSFUT.1 size=449224 2024-09-12T00:19:29.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.668+0000 7f682945b780 1 < completed multipart upload key=G0ONSUVW4M7R upload=OXBYEO5CSFUT tag=BZ7KAGLB6SPF type=write size=2546376 2024-09-12T00:19:29.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.669+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=6LXC6IK2UNEM type=write size=339744 2024-09-12T00:19:29.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.670+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=DK0Y6FR2ERN0 type=del 2024-09-12T00:19:29.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.672+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=BATR7VXOVMF7 type=del size=3260762 2024-09-12T00:19:29.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.673+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~XEXQU8N4DID8.0 size=222678 2024-09-12T00:19:29.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.676+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=XEXQU8N4DID8 tag=RS442CUJAI6K type=write size=1271254 2024-09-12T00:19:29.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.679+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~QNQLG61AMXNM.0 size=1048576 2024-09-12T00:19:29.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.679+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~QNQLG61AMXNM.1 size=42144 2024-09-12T00:19:29.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.679+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=QNQLG61AMXNM tag=YN30AKU90YN0 type=write size=2139296 2024-09-12T00:19:29.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.682+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~VXH8AJNTENJ2.0 size=1048576 2024-09-12T00:19:29.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.682+0000 7f682945b780 1 < completed part key=_multipart_1RAFARG1JXFQ.2~VXH8AJNTENJ2.1 size=359987 2024-09-12T00:19:29.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.685+0000 7f682945b780 1 < completed multipart upload key=1RAFARG1JXFQ upload=VXH8AJNTENJ2 tag=OS1QFBGSCYTN type=write size=2457139 2024-09-12T00:19:29.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.687+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~A45QRYA71OCK.0 size=1048576 2024-09-12T00:19:29.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.689+0000 7f682945b780 1 > prepared part key=_multipart_IYYTX8TCLF30.2~A45QRYA71OCK.1 size=435814 2024-09-12T00:19:29.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.689+0000 7f682945b780 1 > prepared multipart upload key=IYYTX8TCLF30 upload=A45QRYA71OCK tag=NJJVCPOTY3JV type=write size=2532966 2024-09-12T00:19:29.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.690+0000 7f682945b780 1 < canceled operation key=9Q4HFV4F2KE2 tag=XGLEFDIGT84V type=del size=2097948 2024-09-12T00:19:29.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.692+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~3IUSG7XL1FHF.0 size=1048576 2024-09-12T00:19:29.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.693+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~3IUSG7XL1FHF.1 size=1025406 2024-09-12T00:19:29.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.693+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=3IUSG7XL1FHF tag=T8TFR2SLQADD type=write size=3122558 2024-09-12T00:19:29.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.695+0000 7f682945b780 1 < completed delete operation key=922B2PPJFX2Z tag=8Y9DXJE985XC type=del 2024-09-12T00:19:29.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.696+0000 7f682945b780 1 > prepared operation key=8D9UC8FJ16UK tag=V8V67PML8ON5 type=del size=2515774 2024-09-12T00:19:29.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.698+0000 7f682945b780 1 < suggested remove operation key=17S1X3WXCNAR tag=NC0JS3B10GZ0 type=del 2024-09-12T00:19:29.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.702+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~67LAW5NITYTZ.0 size=1048576 2024-09-12T00:19:29.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.702+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~67LAW5NITYTZ.1 size=501341 2024-09-12T00:19:29.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.702+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=67LAW5NITYTZ tag=232AZBD094OL type=write size=2598493 2024-09-12T00:19:29.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.703+0000 7f682945b780 1 < canceled operation key=7RRJO383D8TH tag=JXDTNXF2980U type=write size=711321 2024-09-12T00:19:29.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.706+0000 7f682945b780 1 > prepared part key=_multipart_8D9UC8FJ16UK.2~4VZU4L2FCB1Y.0 size=193249 2024-09-12T00:19:29.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.706+0000 7f682945b780 1 > prepared multipart upload key=8D9UC8FJ16UK upload=4VZU4L2FCB1Y tag=1U9VREBJJ8VS type=write size=1241825 2024-09-12T00:19:29.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.707+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=8YKYSU0PV4UL type=del 2024-09-12T00:19:29.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.709+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~3T9SC2YG1Z0G.0 size=1048576 2024-09-12T00:19:29.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.710+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~3T9SC2YG1Z0G.1 size=733906 2024-09-12T00:19:29.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.710+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=3T9SC2YG1Z0G tag=5EQ6H98MAWX4 type=write size=2831058 2024-09-12T00:19:29.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.714+0000 7f682945b780 1 < suggested update operation key=8D9UC8FJ16UK tag=RCDLRN9R3ZMS type=del size=317378 2024-09-12T00:19:29.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.715+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~D2GRDFV1Z0EH.0 size=1048576 2024-09-12T00:19:29.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.716+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~D2GRDFV1Z0EH.1 size=770498 2024-09-12T00:19:29.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.716+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=D2GRDFV1Z0EH tag=A4C5N46ZDNK9 type=write size=2867650 2024-09-12T00:19:29.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.718+0000 7f682945b780 1 < completed delete operation key=3JFMN39G6TTF tag=IBZCL64HGUKB type=del 2024-09-12T00:19:29.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.720+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=LS296T7ZLS46 type=del size=2845112 2024-09-12T00:19:29.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.721+0000 7f682945b780 1 < completed delete operation key=6DUQKU3R1RL8 tag=Z5UGSVGFAO23 type=del 2024-09-12T00:19:29.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.723+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=9ASA702ANRGZ type=write size=646039 2024-09-12T00:19:29.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.724+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~20C2WNGRI3K3.0 size=432200 2024-09-12T00:19:29.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.727+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=20C2WNGRI3K3 tag=SPFUCUXIXRYH type=write size=1480776 2024-09-12T00:19:29.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.728+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=S4IHRUL8UYYB type=del size=1071981 2024-09-12T00:19:29.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.729+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~QDFE26MF7JGQ.0 size=1048576 2024-09-12T00:19:29.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.729+0000 7f682945b780 1 < canceled part key=_multipart_JAVE3HR52R5C.2~QDFE26MF7JGQ.1 size=932477 2024-09-12T00:19:29.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.731+0000 7f682945b780 1 < canceled multipart upload key=JAVE3HR52R5C upload=QDFE26MF7JGQ tag=P7RCAA6PDCPC type=write size=3029629 2024-09-12T00:19:29.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.733+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=I6V0ETFR5XIS type=del size=1813494 2024-09-12T00:19:29.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.734+0000 7f682945b780 1 < completed write operation key=3JFMN39G6TTF tag=VZZY2R9F0S21 type=write size=931687 2024-09-12T00:19:29.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.737+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~HA14VVGBZP8O.0 size=1048576 2024-09-12T00:19:29.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.738+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~HA14VVGBZP8O.1 size=1048576 2024-09-12T00:19:29.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.740+0000 7f682945b780 1 > prepared part key=_multipart_9Q4HFV4F2KE2.2~HA14VVGBZP8O.2 size=567141 2024-09-12T00:19:29.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.740+0000 7f682945b780 1 > prepared multipart upload key=9Q4HFV4F2KE2 upload=HA14VVGBZP8O tag=57ZLJBRRFS4L type=write size=3712869 2024-09-12T00:19:29.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.740+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~O8DHCRAX2ZUF.0 size=1048576 2024-09-12T00:19:29.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.742+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~O8DHCRAX2ZUF.1 size=1048576 2024-09-12T00:19:29.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.742+0000 7f682945b780 1 < completed part key=_multipart_SGWTWN8RTKDD.2~O8DHCRAX2ZUF.2 size=69310 2024-09-12T00:19:29.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.745+0000 7f682945b780 1 < completed multipart upload key=SGWTWN8RTKDD upload=O8DHCRAX2ZUF tag=33GA2UK9W7OA type=write size=3215038 2024-09-12T00:19:29.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.746+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=AK9Z7T1881YF type=del size=3583016 2024-09-12T00:19:29.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.748+0000 7f682945b780 1 < completed write operation key=BV3D543J63H1 tag=6LXC6IK2UNEM type=write size=339744 2024-09-12T00:19:29.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.750+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=TYOB377ETBQ5 type=del size=2857746 2024-09-12T00:19:29.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.750+0000 7f682945b780 -1 < failed to complete operation key=8D9UC8FJ16UK tag=BATR7VXOVMF7 type=del size=3260762: (22) Invalid argument 2024-09-12T00:19:29.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.753+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~E15VD3QHUJF7.0 size=1048576 2024-09-12T00:19:29.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.754+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~E15VD3QHUJF7.1 size=1048576 2024-09-12T00:19:29.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.756+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~E15VD3QHUJF7.2 size=359712 2024-09-12T00:19:29.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.756+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=E15VD3QHUJF7 tag=LVPYD0YHW27C type=write size=3505440 2024-09-12T00:19:29.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.757+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~QNQLG61AMXNM.0 size=1048576 2024-09-12T00:19:29.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.757+0000 7f682945b780 1 < canceled part key=_multipart_EYHGJ82COSE9.2~QNQLG61AMXNM.1 size=42144 2024-09-12T00:19:29.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.760+0000 7f682945b780 1 < canceled multipart upload key=EYHGJ82COSE9 upload=QNQLG61AMXNM tag=YN30AKU90YN0 type=write size=2139296 2024-09-12T00:19:29.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.760+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=71UX1OW896RB type=del size=2330907 2024-09-12T00:19:29.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.762+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~A45QRYA71OCK.0 size=1048576 2024-09-12T00:19:29.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.763+0000 7f682945b780 1 < completed part key=_multipart_IYYTX8TCLF30.2~A45QRYA71OCK.1 size=435814 2024-09-12T00:19:29.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.765+0000 7f682945b780 1 < completed multipart upload key=IYYTX8TCLF30 upload=A45QRYA71OCK tag=NJJVCPOTY3JV type=write size=2532966 2024-09-12T00:19:29.767 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.767+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~DBVC30V6HZ9Y.0 size=1048576 2024-09-12T00:19:29.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.768+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~DBVC30V6HZ9Y.1 size=82967 2024-09-12T00:19:29.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.768+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=DBVC30V6HZ9Y tag=QF6LIIMHY6AN type=write size=2180119 2024-09-12T00:19:29.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.770+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~3IUSG7XL1FHF.0 size=1048576 2024-09-12T00:19:29.770 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.771+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~3IUSG7XL1FHF.1 size=1025406 2024-09-12T00:19:29.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.773+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=3IUSG7XL1FHF tag=T8TFR2SLQADD type=write size=3122558 2024-09-12T00:19:29.774 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.774+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=2RQ7Q35G0MYR type=del size=2996011 2024-09-12T00:19:29.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.776+0000 7f682945b780 -1 < failed to complete operation key=8D9UC8FJ16UK tag=V8V67PML8ON5 type=del size=2515774: (22) Invalid argument 2024-09-12T00:19:29.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.778+0000 7f682945b780 1 > prepared part key=_multipart_BV3D543J63H1.2~6S6QKP0UYBZK.0 size=800467 2024-09-12T00:19:29.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.778+0000 7f682945b780 1 > prepared multipart upload key=BV3D543J63H1 upload=6S6QKP0UYBZK tag=QUEWIRFEX3N5 type=write size=1849043 2024-09-12T00:19:29.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.780+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~67LAW5NITYTZ.0 size=1048576 2024-09-12T00:19:29.780 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.781+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~67LAW5NITYTZ.1 size=501341 2024-09-12T00:19:29.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.783+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=67LAW5NITYTZ tag=232AZBD094OL type=write size=2598493 2024-09-12T00:19:29.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.784+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=OP4095YCC80E type=del size=2436733 2024-09-12T00:19:29.785 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.786+0000 7f682945b780 1 < completed part key=_multipart_8D9UC8FJ16UK.2~4VZU4L2FCB1Y.0 size=193249 2024-09-12T00:19:29.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.788+0000 7f682945b780 1 < completed multipart upload key=8D9UC8FJ16UK upload=4VZU4L2FCB1Y tag=1U9VREBJJ8VS type=write size=1241825 2024-09-12T00:19:29.789 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.790+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=JV7VTL6URF06 type=del size=3041947 2024-09-12T00:19:29.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.791+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~3T9SC2YG1Z0G.0 size=1048576 2024-09-12T00:19:29.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.793+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~3T9SC2YG1Z0G.1 size=733906 2024-09-12T00:19:29.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.795+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=3T9SC2YG1Z0G tag=5EQ6H98MAWX4 type=write size=2831058 2024-09-12T00:19:29.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.798+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~A2BBDVG63E06.0 size=1048576 2024-09-12T00:19:29.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.798+0000 7f682945b780 1 > prepared part key=_multipart_JAVE3HR52R5C.2~A2BBDVG63E06.1 size=294086 2024-09-12T00:19:29.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.798+0000 7f682945b780 1 > prepared multipart upload key=JAVE3HR52R5C upload=A2BBDVG63E06 tag=OYTL9WWUH4PQ type=write size=2391238 2024-09-12T00:19:29.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.800+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~D2GRDFV1Z0EH.0 size=1048576 2024-09-12T00:19:29.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.801+0000 7f682945b780 1 < completed part key=_multipart_R7V03ML1H80V.2~D2GRDFV1Z0EH.1 size=770498 2024-09-12T00:19:29.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.804+0000 7f682945b780 1 < completed multipart upload key=R7V03ML1H80V upload=D2GRDFV1Z0EH tag=A4C5N46ZDNK9 type=write size=2867650 2024-09-12T00:19:29.804 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.805+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=LB1IBALDIGUU type=del size=3687910 2024-09-12T00:19:29.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.806+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=LS296T7ZLS46 type=del 2024-09-12T00:19:29.808 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.809+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~F19D4OKGZXJ2.0 size=1048576 2024-09-12T00:19:29.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.810+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~F19D4OKGZXJ2.1 size=152409 2024-09-12T00:19:29.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.810+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=F19D4OKGZXJ2 tag=79CAXG4DSHI6 type=write size=2249561 2024-09-12T00:19:29.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.811+0000 7f682945b780 1 < completed write operation key=9Q4HFV4F2KE2 tag=9ASA702ANRGZ type=write size=646039 2024-09-12T00:19:29.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.812+0000 7f682945b780 1 > prepared operation key=BMTPXZ1OA2TZ tag=8ZYX0T58B51M type=write size=245856 2024-09-12T00:19:29.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.815+0000 7f682945b780 1 < suggested remove operation key=IUPAGGPATJB4 tag=S4IHRUL8UYYB type=del 2024-09-12T00:19:29.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.817+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=LWRL4G28O0LN type=del size=2172129 2024-09-12T00:19:29.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.818+0000 7f682945b780 1 < completed delete operation key=38JJBFDTIYSU tag=I6V0ETFR5XIS type=del 2024-09-12T00:19:29.819 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.820+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=1TGHMNTY29WL type=del size=3382558 2024-09-12T00:19:29.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.822+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~HA14VVGBZP8O.0 size=1048576 2024-09-12T00:19:29.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.824+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~HA14VVGBZP8O.1 size=1048576 2024-09-12T00:19:29.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.825+0000 7f682945b780 1 < completed part key=_multipart_9Q4HFV4F2KE2.2~HA14VVGBZP8O.2 size=567141 2024-09-12T00:19:29.828 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.827+0000 7f682945b780 1 < completed multipart upload key=9Q4HFV4F2KE2 upload=HA14VVGBZP8O tag=57ZLJBRRFS4L type=write size=3712869 2024-09-12T00:19:29.829 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.828+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=NJJLDE1XJ491 type=del size=1514570 2024-09-12T00:19:29.830 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.832+0000 7f682945b780 1 < suggested update operation key=9Q4HFV4F2KE2 tag=AK9Z7T1881YF type=del size=3583016 2024-09-12T00:19:29.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.832+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=9BA84M23OS6N type=del size=4071711 2024-09-12T00:19:29.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.835+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=TYOB377ETBQ5 type=del 2024-09-12T00:19:29.835 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.836+0000 7f682945b780 1 > prepared operation key=IYYTX8TCLF30 tag=6SBEWJL8VG05 type=del size=2291708 2024-09-12T00:19:29.837 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.837+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~E15VD3QHUJF7.0 size=1048576 2024-09-12T00:19:29.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.839+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~E15VD3QHUJF7.1 size=1048576 2024-09-12T00:19:29.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.839+0000 7f682945b780 1 < canceled part key=_multipart_TYNSP8BHYO65.2~E15VD3QHUJF7.2 size=359712 2024-09-12T00:19:29.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.841+0000 7f682945b780 1 < canceled multipart upload key=TYNSP8BHYO65 upload=E15VD3QHUJF7 tag=LVPYD0YHW27C type=write size=3505440 2024-09-12T00:19:29.843 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.844+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~A0O9BL9TCVGP.0 size=400915 2024-09-12T00:19:29.843 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.844+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=A0O9BL9TCVGP tag=ZRBZSC5S8B6K type=write size=1449491 2024-09-12T00:19:29.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.845+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=71UX1OW896RB type=del 2024-09-12T00:19:29.847 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.847+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~EPYCCBIAT14E.0 size=1048576 2024-09-12T00:19:29.849 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.850+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~EPYCCBIAT14E.1 size=285896 2024-09-12T00:19:29.849 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.850+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=EPYCCBIAT14E tag=SLVJSBK32MDP type=write size=2383048 2024-09-12T00:19:29.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.850+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~DBVC30V6HZ9Y.0 size=1048576 2024-09-12T00:19:29.851 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.852+0000 7f682945b780 1 < completed part key=_multipart_TGOBZH6DZK71.2~DBVC30V6HZ9Y.1 size=82967 2024-09-12T00:19:29.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.856+0000 7f682945b780 1 < completed multipart upload key=TGOBZH6DZK71 upload=DBVC30V6HZ9Y tag=QF6LIIMHY6AN type=write size=2180119 2024-09-12T00:19:29.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.859+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~I10AI1X9PK24.0 size=1048576 2024-09-12T00:19:29.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.861+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~I10AI1X9PK24.1 size=513644 2024-09-12T00:19:29.860 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.861+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=I10AI1X9PK24 tag=75F5KQ0WIZOO type=write size=2610796 2024-09-12T00:19:29.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.864+0000 7f682945b780 1 < suggested remove operation key=IYYTX8TCLF30 tag=2RQ7Q35G0MYR type=del 2024-09-12T00:19:29.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.865+0000 7f682945b780 1 > prepared operation key=JAVE3HR52R5C tag=63TG6OCQ0XI1 type=del size=1500163 2024-09-12T00:19:29.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.867+0000 7f682945b780 1 < completed part key=_multipart_BV3D543J63H1.2~6S6QKP0UYBZK.0 size=800467 2024-09-12T00:19:29.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.869+0000 7f682945b780 1 < completed multipart upload key=BV3D543J63H1 upload=6S6QKP0UYBZK tag=QUEWIRFEX3N5 type=write size=1849043 2024-09-12T00:19:29.871 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.872+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~WRV81WXDO7XW.0 size=1048576 2024-09-12T00:19:29.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.873+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~WRV81WXDO7XW.1 size=928645 2024-09-12T00:19:29.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.873+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=WRV81WXDO7XW tag=1HM0XPVYQ0OP type=write size=3025797 2024-09-12T00:19:29.874 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.874+0000 7f682945b780 1 < completed delete operation key=EYHGJ82COSE9 tag=OP4095YCC80E type=del 2024-09-12T00:19:29.876 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.876+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=ZY34S26Y3FD6 type=write size=373966 2024-09-12T00:19:29.877 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.878+0000 7f682945b780 1 < completed delete operation key=Y65K9I6K41X5 tag=JV7VTL6URF06 type=del 2024-09-12T00:19:29.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.880+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=0HOB78G4O6I4 type=write size=861864 2024-09-12T00:19:29.881 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.881+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~A2BBDVG63E06.0 size=1048576 2024-09-12T00:19:29.882 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.883+0000 7f682945b780 1 < completed part key=_multipart_JAVE3HR52R5C.2~A2BBDVG63E06.1 size=294086 2024-09-12T00:19:29.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.886+0000 7f682945b780 1 < completed multipart upload key=JAVE3HR52R5C upload=A2BBDVG63E06 tag=OYTL9WWUH4PQ type=write size=2391238 2024-09-12T00:19:29.886 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.887+0000 7f682945b780 1 > prepared operation key=7RRJO383D8TH tag=DEGNEJNZVAH4 type=del size=3188341 2024-09-12T00:19:29.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.889+0000 7f682945b780 1 < canceled operation key=TGOBZH6DZK71 tag=LB1IBALDIGUU type=del size=3687910 2024-09-12T00:19:29.890 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.890+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=FYEDXG5H53BA type=del size=295405 2024-09-12T00:19:29.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.893+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~F19D4OKGZXJ2.0 size=1048576 2024-09-12T00:19:29.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.893+0000 7f682945b780 1 < completed part key=_multipart_BMTPXZ1OA2TZ.2~F19D4OKGZXJ2.1 size=152409 2024-09-12T00:19:29.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.895+0000 7f682945b780 1 < completed multipart upload key=BMTPXZ1OA2TZ upload=F19D4OKGZXJ2 tag=79CAXG4DSHI6 type=write size=2249561 2024-09-12T00:19:29.897 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.897+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~T9DFL1JUNKHX.0 size=1048576 2024-09-12T00:19:29.898 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.899+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~T9DFL1JUNKHX.1 size=1048576 2024-09-12T00:19:29.899 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.900+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~T9DFL1JUNKHX.2 size=643515 2024-09-12T00:19:29.899 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.900+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=T9DFL1JUNKHX tag=5T5JUB3PW4D8 type=write size=3789243 2024-09-12T00:19:29.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.903+0000 7f682945b780 1 < suggested remove operation key=BMTPXZ1OA2TZ tag=8ZYX0T58B51M type=write 2024-09-12T00:19:29.905 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.905+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~394TO6FY9NYA.0 size=98942 2024-09-12T00:19:29.905 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.905+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=394TO6FY9NYA tag=ABJL43CU6ONZ type=write size=1147518 2024-09-12T00:19:29.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.909+0000 7f682945b780 1 < suggested remove operation key=R7V03ML1H80V tag=LWRL4G28O0LN type=del 2024-09-12T00:19:29.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.910+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=645X34RDBLN3 type=del size=3194918 2024-09-12T00:19:29.911 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.912+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=1TGHMNTY29WL type=del 2024-09-12T00:19:29.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.914+0000 7f682945b780 1 > prepared operation key=Y65K9I6K41X5 tag=PWTF57MLAP0N type=del size=811778 2024-09-12T00:19:29.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.915+0000 7f682945b780 1 < completed delete operation key=IUPAGGPATJB4 tag=NJJLDE1XJ491 type=del 2024-09-12T00:19:29.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.918+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~LGWJX1H8Q1PJ.0 size=1048576 2024-09-12T00:19:29.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.919+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~LGWJX1H8Q1PJ.1 size=1048576 2024-09-12T00:19:29.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.920+0000 7f682945b780 1 > prepared part key=_multipart_IUPAGGPATJB4.2~LGWJX1H8Q1PJ.2 size=850157 2024-09-12T00:19:29.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.920+0000 7f682945b780 1 > prepared multipart upload key=IUPAGGPATJB4 upload=LGWJX1H8Q1PJ tag=9GLZNSHIBYEI type=write size=3995885 2024-09-12T00:19:29.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.921+0000 7f682945b780 -1 < failed to complete operation key=R7V03ML1H80V tag=9BA84M23OS6N type=del size=4071711: (22) Invalid argument 2024-09-12T00:19:29.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.923+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=FG3LAVFDU570 type=del size=615746 2024-09-12T00:19:29.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.924+0000 7f682945b780 -1 < failed to complete operation key=IYYTX8TCLF30 tag=6SBEWJL8VG05 type=del size=2291708: (22) Invalid argument 2024-09-12T00:19:29.925 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.926+0000 7f682945b780 1 > prepared operation key=D06ZUP2ZXX42 tag=LST6194SPM27 type=del size=1090384 2024-09-12T00:19:29.927 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.928+0000 7f682945b780 1 < completed part key=_multipart_D06ZUP2ZXX42.2~A0O9BL9TCVGP.0 size=400915 2024-09-12T00:19:29.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.929+0000 7f682945b780 1 < completed multipart upload key=D06ZUP2ZXX42 upload=A0O9BL9TCVGP tag=ZRBZSC5S8B6K type=write size=1449491 2024-09-12T00:19:29.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.932+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~FS91G7AU2AOW.0 size=185793 2024-09-12T00:19:29.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.932+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=FS91G7AU2AOW tag=J3V5Y8593EOE type=write size=1234369 2024-09-12T00:19:29.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.933+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~EPYCCBIAT14E.0 size=1048576 2024-09-12T00:19:29.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.934+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~EPYCCBIAT14E.1 size=285896 2024-09-12T00:19:29.936 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.937+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=EPYCCBIAT14E tag=SLVJSBK32MDP type=write size=2383048 2024-09-12T00:19:29.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.938+0000 7f682945b780 1 > prepared operation key=TGOBZH6DZK71 tag=ANW9V74LI8YT type=del size=90188 2024-09-12T00:19:29.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.940+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~I10AI1X9PK24.0 size=1048576 2024-09-12T00:19:29.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.942+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~I10AI1X9PK24.1 size=513644 2024-09-12T00:19:29.942 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.944+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=I10AI1X9PK24 tag=75F5KQ0WIZOO type=write size=2610796 2024-09-12T00:19:29.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.946+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~4EX8SRUXJ205.0 size=1048576 2024-09-12T00:19:29.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.947+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~4EX8SRUXJ205.1 size=1048576 2024-09-12T00:19:29.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.948+0000 7f682945b780 1 > prepared part key=_multipart_3JFMN39G6TTF.2~4EX8SRUXJ205.2 size=732170 2024-09-12T00:19:29.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.948+0000 7f682945b780 1 > prepared multipart upload key=3JFMN39G6TTF upload=4EX8SRUXJ205 tag=OV0P829YDUKB type=write size=3877898 2024-09-12T00:19:29.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.949+0000 7f682945b780 1 < completed delete operation key=JAVE3HR52R5C tag=63TG6OCQ0XI1 type=del 2024-09-12T00:19:29.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.951+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~GJWDHQNA4000.0 size=1048576 2024-09-12T00:19:29.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.952+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~GJWDHQNA4000.1 size=1048576 2024-09-12T00:19:29.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.954+0000 7f682945b780 1 > prepared part key=_multipart_COUJXCOSVPDS.2~GJWDHQNA4000.2 size=663145 2024-09-12T00:19:29.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.954+0000 7f682945b780 1 > prepared multipart upload key=COUJXCOSVPDS upload=GJWDHQNA4000 tag=VS3MI8ABSYRS type=write size=3808873 2024-09-12T00:19:29.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.955+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~WRV81WXDO7XW.0 size=1048576 2024-09-12T00:19:29.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.956+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~WRV81WXDO7XW.1 size=928645 2024-09-12T00:19:29.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.959+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=WRV81WXDO7XW tag=1HM0XPVYQ0OP type=write size=3025797 2024-09-12T00:19:29.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.961+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=7WMK4ZZBI60A type=del size=129471 2024-09-12T00:19:29.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.961+0000 7f682945b780 1 < completed write operation key=G0ONSUVW4M7R tag=ZY34S26Y3FD6 type=write size=373966 2024-09-12T00:19:29.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.964+0000 7f682945b780 1 > prepared part key=_multipart_TGOBZH6DZK71.2~W8LCVF1ZTT4O.0 size=798860 2024-09-12T00:19:29.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.964+0000 7f682945b780 1 > prepared multipart upload key=TGOBZH6DZK71 upload=W8LCVF1ZTT4O tag=WKBV7NQR09O0 type=write size=1847436 2024-09-12T00:19:29.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.965+0000 7f682945b780 1 < completed write operation key=TGOBZH6DZK71 tag=0HOB78G4O6I4 type=write size=861864 2024-09-12T00:19:29.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.968+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~ZJPNX1JF9SDQ.0 size=1048576 2024-09-12T00:19:29.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.969+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~ZJPNX1JF9SDQ.1 size=1048576 2024-09-12T00:19:29.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.970+0000 7f682945b780 1 > prepared part key=_multipart_Y65K9I6K41X5.2~ZJPNX1JF9SDQ.2 size=352416 2024-09-12T00:19:29.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.970+0000 7f682945b780 1 > prepared multipart upload key=Y65K9I6K41X5 upload=ZJPNX1JF9SDQ tag=GSFSSTW7H3G5 type=write size=3498144 2024-09-12T00:19:29.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.971+0000 7f682945b780 1 < canceled operation key=7RRJO383D8TH tag=DEGNEJNZVAH4 type=del size=3188341 2024-09-12T00:19:29.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.973+0000 7f682945b780 1 > prepared operation key=BV3D543J63H1 tag=122S07VOTECS type=del size=2314164 2024-09-12T00:19:29.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.974+0000 7f682945b780 1 < completed delete operation key=COUJXCOSVPDS tag=FYEDXG5H53BA type=del 2024-09-12T00:19:29.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.976+0000 7f682945b780 1 > prepared operation key=R7V03ML1H80V tag=KRBJKDSORSA0 type=write size=649725 2024-09-12T00:19:29.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.977+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~T9DFL1JUNKHX.0 size=1048576 2024-09-12T00:19:29.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.977+0000 7f682945b780 1 < canceled part key=_multipart_COUJXCOSVPDS.2~T9DFL1JUNKHX.1 size=1048576 2024-09-12T00:19:29.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.978+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~T9DFL1JUNKHX.2 size=643515 2024-09-12T00:19:29.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.981+0000 7f682945b780 1 < canceled multipart upload key=COUJXCOSVPDS upload=T9DFL1JUNKHX tag=5T5JUB3PW4D8 type=write size=3789243 2024-09-12T00:19:29.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.982+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=E18GFGD1VJV8 type=del size=2747718 2024-09-12T00:19:29.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.983+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~394TO6FY9NYA.0 size=98942 2024-09-12T00:19:29.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.987+0000 7f682945b780 1 < completed multipart upload key=IUPAGGPATJB4 upload=394TO6FY9NYA tag=ABJL43CU6ONZ type=write size=1147518 2024-09-12T00:19:29.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.989+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~1S2U3DFSOVZO.0 size=832399 2024-09-12T00:19:29.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.989+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=1S2U3DFSOVZO tag=WFEV464M21NA type=write size=1880975 2024-09-12T00:19:29.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.991+0000 7f682945b780 1 < completed delete operation key=TYNSP8BHYO65 tag=645X34RDBLN3 type=del 2024-09-12T00:19:29.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.994+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~W9U5SICVCRBN.0 size=1048576 2024-09-12T00:19:29.994 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.995+0000 7f682945b780 1 > prepared part key=_multipart_EYHGJ82COSE9.2~W9U5SICVCRBN.1 size=8232 2024-09-12T00:19:29.994 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.995+0000 7f682945b780 1 > prepared multipart upload key=EYHGJ82COSE9 upload=W9U5SICVCRBN tag=9SQ6CMEFCS0H type=write size=2105384 2024-09-12T00:19:29.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.996+0000 7f682945b780 1 < canceled operation key=Y65K9I6K41X5 tag=PWTF57MLAP0N type=del size=811778 2024-09-12T00:19:29.997 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.998+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=29V28H9SNHU3 type=del size=1059212 2024-09-12T00:19:29.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.998+0000 7f682945b780 1 < canceled part key=_multipart_IUPAGGPATJB4.2~LGWJX1H8Q1PJ.0 size=1048576 2024-09-12T00:19:29.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:29.999+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~LGWJX1H8Q1PJ.1 size=1048576 2024-09-12T00:19:30.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.001+0000 7f682945b780 1 < completed part key=_multipart_IUPAGGPATJB4.2~LGWJX1H8Q1PJ.2 size=850157 2024-09-12T00:19:30.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.003+0000 7f682945b780 1 < canceled multipart upload key=IUPAGGPATJB4 upload=LGWJX1H8Q1PJ tag=9GLZNSHIBYEI type=write size=3995885 2024-09-12T00:19:30.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.005+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~LEWH4P58OGEF.0 size=1048576 2024-09-12T00:19:30.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.007+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~LEWH4P58OGEF.1 size=1048576 2024-09-12T00:19:30.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.008+0000 7f682945b780 1 > prepared part key=_multipart_TYNSP8BHYO65.2~LEWH4P58OGEF.2 size=453232 2024-09-12T00:19:30.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.008+0000 7f682945b780 1 > prepared multipart upload key=TYNSP8BHYO65 upload=LEWH4P58OGEF tag=WSHSPS7NPSQT type=write size=3598960 2024-09-12T00:19:30.010 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.010+0000 7f682945b780 1 < suggested remove operation key=EYHGJ82COSE9 tag=FG3LAVFDU570 type=del 2024-09-12T00:19:30.011 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.012+0000 7f682945b780 1 > prepared operation key=TYNSP8BHYO65 tag=I1TJTGGIC1DW type=write size=749480 2024-09-12T00:19:30.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.013+0000 7f682945b780 1 < completed delete operation key=D06ZUP2ZXX42 tag=LST6194SPM27 type=del 2024-09-12T00:19:30.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.015+0000 7f682945b780 1 > prepared operation key=38JJBFDTIYSU tag=5O114QDPKYR0 type=del size=1847826 2024-09-12T00:19:30.016 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.016+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~FS91G7AU2AOW.0 size=185793 2024-09-12T00:19:30.018 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.019+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=FS91G7AU2AOW tag=J3V5Y8593EOE type=write size=1234369 2024-09-12T00:19:30.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.022+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~Q56A73LCU4QE.0 size=715071 2024-09-12T00:19:30.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.022+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=Q56A73LCU4QE tag=GEJCKRU15WW2 type=write size=1763647 2024-09-12T00:19:30.023 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.024+0000 7f682945b780 1 < completed delete operation key=TGOBZH6DZK71 tag=ANW9V74LI8YT type=del 2024-09-12T00:19:30.026 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.027+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~IAUBE4ZQYM35.0 size=1048576 2024-09-12T00:19:30.027 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.028+0000 7f682945b780 1 > prepared part key=_multipart_38JJBFDTIYSU.2~IAUBE4ZQYM35.1 size=720125 2024-09-12T00:19:30.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.028+0000 7f682945b780 1 > prepared multipart upload key=38JJBFDTIYSU upload=IAUBE4ZQYM35 tag=MQ24T55HWSPY type=write size=2817277 2024-09-12T00:19:30.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.028+0000 7f682945b780 1 < canceled part key=_multipart_3JFMN39G6TTF.2~4EX8SRUXJ205.0 size=1048576 2024-09-12T00:19:30.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.030+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~4EX8SRUXJ205.1 size=1048576 2024-09-12T00:19:30.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.032+0000 7f682945b780 1 < completed part key=_multipart_3JFMN39G6TTF.2~4EX8SRUXJ205.2 size=732170 2024-09-12T00:19:30.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.033+0000 7f682945b780 1 < canceled multipart upload key=3JFMN39G6TTF upload=4EX8SRUXJ205 tag=OV0P829YDUKB type=write size=3877898 2024-09-12T00:19:30.036 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.035+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=FMHTWQMFI2YF type=del size=2912059 2024-09-12T00:19:30.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.037+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~GJWDHQNA4000.0 size=1048576 2024-09-12T00:19:30.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.038+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~GJWDHQNA4000.1 size=1048576 2024-09-12T00:19:30.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.039+0000 7f682945b780 1 < completed part key=_multipart_COUJXCOSVPDS.2~GJWDHQNA4000.2 size=663145 2024-09-12T00:19:30.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.042+0000 7f682945b780 1 < completed multipart upload key=COUJXCOSVPDS upload=GJWDHQNA4000 tag=VS3MI8ABSYRS type=write size=3808873 2024-09-12T00:19:30.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.044+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~7GIDY2T4TOX1.0 size=1048576 2024-09-12T00:19:30.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.045+0000 7f682945b780 1 > prepared part key=_multipart_Z7408WO050VI.2~7GIDY2T4TOX1.1 size=610707 2024-09-12T00:19:30.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.045+0000 7f682945b780 1 > prepared multipart upload key=Z7408WO050VI upload=7GIDY2T4TOX1 tag=Z01DR0UBUJMG type=write size=2707859 2024-09-12T00:19:30.046 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.046+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=7WMK4ZZBI60A type=del 2024-09-12T00:19:30.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.050+0000 7f682945b780 1 > prepared part key=_multipart_BFY578HP8GAW.2~8LBHLK48MJUX.0 size=70893 2024-09-12T00:19:30.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.050+0000 7f682945b780 1 > prepared multipart upload key=BFY578HP8GAW upload=8LBHLK48MJUX tag=LTQIZGQRKOO1 type=write size=1119469 2024-09-12T00:19:30.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.050+0000 7f682945b780 1 < canceled part key=_multipart_TGOBZH6DZK71.2~W8LCVF1ZTT4O.0 size=798860 2024-09-12T00:19:30.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.053+0000 7f682945b780 1 < canceled multipart upload key=TGOBZH6DZK71 upload=W8LCVF1ZTT4O tag=WKBV7NQR09O0 type=write size=1847436 2024-09-12T00:19:30.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.054+0000 7f682945b780 1 > prepared operation key=CE5EBY7EGY4Z tag=JVKH00MTGI45 type=del size=4099424 2024-09-12T00:19:30.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.055+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~ZJPNX1JF9SDQ.0 size=1048576 2024-09-12T00:19:30.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.056+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~ZJPNX1JF9SDQ.1 size=1048576 2024-09-12T00:19:30.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.057+0000 7f682945b780 1 < completed part key=_multipart_Y65K9I6K41X5.2~ZJPNX1JF9SDQ.2 size=352416 2024-09-12T00:19:30.058 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.059+0000 7f682945b780 1 < completed multipart upload key=Y65K9I6K41X5 upload=ZJPNX1JF9SDQ tag=GSFSSTW7H3G5 type=write size=3498144 2024-09-12T00:19:30.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.060+0000 7f682945b780 1 > prepared operation key=P56VIP3WIOJL tag=7BIZ232NY7LX type=del size=2479639 2024-09-12T00:19:30.061 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.061+0000 7f682945b780 1 < completed delete operation key=BV3D543J63H1 tag=122S07VOTECS type=del 2024-09-12T00:19:30.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.063+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=1HTB14RXYDR2 type=del size=476674 2024-09-12T00:19:30.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.064+0000 7f682945b780 1 < completed write operation key=R7V03ML1H80V tag=KRBJKDSORSA0 type=write size=649725 2024-09-12T00:19:30.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.066+0000 7f682945b780 1 > prepared operation key=BI3KCKV4CRWR tag=1UNTG8MM6RG6 type=del size=1922974 2024-09-12T00:19:30.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.067+0000 7f682945b780 1 < completed delete operation key=BFY578HP8GAW tag=E18GFGD1VJV8 type=del 2024-09-12T00:19:30.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.069+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~C5140GB1OAXI.0 size=212689 2024-09-12T00:19:30.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.069+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=C5140GB1OAXI tag=C16VNDDL58WT type=write size=1261265 2024-09-12T00:19:30.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.071+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~1S2U3DFSOVZO.0 size=832399 2024-09-12T00:19:30.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.074+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=1S2U3DFSOVZO tag=WFEV464M21NA type=write size=1880975 2024-09-12T00:19:30.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.075+0000 7f682945b780 1 > prepared operation key=BK212Z99RM7F tag=1KGI6QNWCG58 type=del size=1552265 2024-09-12T00:19:30.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.076+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~W9U5SICVCRBN.0 size=1048576 2024-09-12T00:19:30.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.077+0000 7f682945b780 1 < completed part key=_multipart_EYHGJ82COSE9.2~W9U5SICVCRBN.1 size=8232 2024-09-12T00:19:30.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.080+0000 7f682945b780 1 < completed multipart upload key=EYHGJ82COSE9 upload=W9U5SICVCRBN tag=9SQ6CMEFCS0H type=write size=2105384 2024-09-12T00:19:30.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.081+0000 7f682945b780 1 > prepared operation key=SGWTWN8RTKDD tag=K6VPKRD36KGX type=del size=3192323 2024-09-12T00:19:30.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.084+0000 7f682945b780 1 < completed delete operation key=9Q4HFV4F2KE2 tag=29V28H9SNHU3 type=del 2024-09-12T00:19:30.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.084+0000 7f682945b780 1 > prepared operation key=G0ONSUVW4M7R tag=RLGFMJO67H5H type=del size=3465039 2024-09-12T00:19:30.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.086+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~LEWH4P58OGEF.0 size=1048576 2024-09-12T00:19:30.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.087+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~LEWH4P58OGEF.1 size=1048576 2024-09-12T00:19:30.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.088+0000 7f682945b780 1 < completed part key=_multipart_TYNSP8BHYO65.2~LEWH4P58OGEF.2 size=453232 2024-09-12T00:19:30.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.091+0000 7f682945b780 1 < completed multipart upload key=TYNSP8BHYO65 upload=LEWH4P58OGEF tag=WSHSPS7NPSQT type=write size=3598960 2024-09-12T00:19:30.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.093+0000 7f682945b780 1 > prepared operation key=17S1X3WXCNAR tag=XBCRAVRLVZVX type=del size=1593510 2024-09-12T00:19:30.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.094+0000 7f682945b780 1 < completed write operation key=TYNSP8BHYO65 tag=I1TJTGGIC1DW type=write size=749480 2024-09-12T00:19:30.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.096+0000 7f682945b780 1 > prepared operation key=BFY578HP8GAW tag=0O4REPN4MWCU type=del size=3501007 2024-09-12T00:19:30.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.098+0000 7f682945b780 1 < completed delete operation key=38JJBFDTIYSU tag=5O114QDPKYR0 type=del 2024-09-12T00:19:30.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.101+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~44YH7OCU6AX2.0 size=1048576 2024-09-12T00:19:30.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.101+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~44YH7OCU6AX2.1 size=1048576 2024-09-12T00:19:30.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.104+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~44YH7OCU6AX2.2 size=180864 2024-09-12T00:19:30.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.104+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=44YH7OCU6AX2 tag=0R99KTCIPQXS type=write size=3326592 2024-09-12T00:19:30.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.105+0000 7f682945b780 1 < completed part key=_multipart_17S1X3WXCNAR.2~Q56A73LCU4QE.0 size=715071 2024-09-12T00:19:30.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.108+0000 7f682945b780 1 < completed multipart upload key=17S1X3WXCNAR upload=Q56A73LCU4QE tag=GEJCKRU15WW2 type=write size=1763647 2024-09-12T00:19:30.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.109+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=LNB7VPS9787N type=del size=1946432 2024-09-12T00:19:30.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.110+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~IAUBE4ZQYM35.0 size=1048576 2024-09-12T00:19:30.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.112+0000 7f682945b780 1 < completed part key=_multipart_38JJBFDTIYSU.2~IAUBE4ZQYM35.1 size=720125 2024-09-12T00:19:30.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.114+0000 7f682945b780 1 < completed multipart upload key=38JJBFDTIYSU upload=IAUBE4ZQYM35 tag=MQ24T55HWSPY type=write size=2817277 2024-09-12T00:19:30.116 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.118+0000 7f682945b780 1 > prepared part key=_multipart_922B2PPJFX2Z.2~H4KEP1QCLU0Q.0 size=524520 2024-09-12T00:19:30.116 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.118+0000 7f682945b780 1 > prepared multipart upload key=922B2PPJFX2Z upload=H4KEP1QCLU0Q tag=NFJ467C1VOKO type=write size=1573096 2024-09-12T00:19:30.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.119+0000 7f682945b780 1 < suggested remove operation key=BI3KCKV4CRWR tag=FMHTWQMFI2YF type=del 2024-09-12T00:19:30.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.123+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~9RKIM681DDKZ.0 size=1048576 2024-09-12T00:19:30.123 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.125+0000 7f682945b780 1 > prepared part key=_multipart_BMTPXZ1OA2TZ.2~9RKIM681DDKZ.1 size=986720 2024-09-12T00:19:30.123 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.125+0000 7f682945b780 1 > prepared multipart upload key=BMTPXZ1OA2TZ upload=9RKIM681DDKZ tag=PDE7MQXZH2YZ type=write size=3083872 2024-09-12T00:19:30.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.126+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~7GIDY2T4TOX1.0 size=1048576 2024-09-12T00:19:30.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.126+0000 7f682945b780 1 < completed part key=_multipart_Z7408WO050VI.2~7GIDY2T4TOX1.1 size=610707 2024-09-12T00:19:30.128 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.129+0000 7f682945b780 1 < completed multipart upload key=Z7408WO050VI upload=7GIDY2T4TOX1 tag=Z01DR0UBUJMG type=write size=2707859 2024-09-12T00:19:30.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.130+0000 7f682945b780 1 > prepared operation key=AZKLWMQ818SW tag=2MHOZL58NLFG type=del size=2398417 2024-09-12T00:19:30.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.132+0000 7f682945b780 1 < completed part key=_multipart_BFY578HP8GAW.2~8LBHLK48MJUX.0 size=70893 2024-09-12T00:19:30.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.134+0000 7f682945b780 1 < completed multipart upload key=BFY578HP8GAW upload=8LBHLK48MJUX tag=LTQIZGQRKOO1 type=write size=1119469 2024-09-12T00:19:30.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.136+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=LP8XG4TR7JOW type=del size=1228709 2024-09-12T00:19:30.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.137+0000 7f682945b780 1 < completed delete operation key=CE5EBY7EGY4Z tag=JVKH00MTGI45 type=del 2024-09-12T00:19:30.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.140+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~WBV9HJWRJNSZ.0 size=1048576 2024-09-12T00:19:30.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.141+0000 7f682945b780 1 > prepared part key=_multipart_D06ZUP2ZXX42.2~WBV9HJWRJNSZ.1 size=429471 2024-09-12T00:19:30.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.141+0000 7f682945b780 1 > prepared multipart upload key=D06ZUP2ZXX42 upload=WBV9HJWRJNSZ tag=XCVTRJQLESVF type=write size=2526623 2024-09-12T00:19:30.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.143+0000 7f682945b780 1 < completed delete operation key=P56VIP3WIOJL tag=7BIZ232NY7LX type=del 2024-09-12T00:19:30.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.145+0000 7f682945b780 1 > prepared part key=_multipart_17S1X3WXCNAR.2~3LSMYUZ5LKTX.0 size=196105 2024-09-12T00:19:30.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.145+0000 7f682945b780 1 > prepared multipart upload key=17S1X3WXCNAR upload=3LSMYUZ5LKTX tag=6C86LSSTFG90 type=write size=1244681 2024-09-12T00:19:30.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.146+0000 7f682945b780 1 < completed delete operation key=AZKLWMQ818SW tag=1HTB14RXYDR2 type=del 2024-09-12T00:19:30.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.148+0000 7f682945b780 1 > prepared operation key=922B2PPJFX2Z tag=Q5K3NQZIZB3A type=del size=3065354 2024-09-12T00:19:30.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.149+0000 7f682945b780 -1 < no bi entry to suggest for operation key=BI3KCKV4CRWR tag=1UNTG8MM6RG6 type=del size=1922974: (2) No such file or directory 2024-09-12T00:19:30.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.151+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~98SSSSVUNAZ8.0 size=1048576 2024-09-12T00:19:30.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.152+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~98SSSSVUNAZ8.1 size=1048576 2024-09-12T00:19:30.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.153+0000 7f682945b780 1 > prepared part key=_multipart_BI3KCKV4CRWR.2~98SSSSVUNAZ8.2 size=634161 2024-09-12T00:19:30.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.153+0000 7f682945b780 1 > prepared multipart upload key=BI3KCKV4CRWR upload=98SSSSVUNAZ8 tag=Q2QIF6KPKB90 type=write size=3779889 2024-09-12T00:19:30.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.156+0000 7f682945b780 1 < completed part key=_multipart_BI3KCKV4CRWR.2~C5140GB1OAXI.0 size=212689 2024-09-12T00:19:30.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.157+0000 7f682945b780 1 < completed multipart upload key=BI3KCKV4CRWR upload=C5140GB1OAXI tag=C16VNDDL58WT type=write size=1261265 2024-09-12T00:19:30.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.159+0000 7f682945b780 1 > prepared operation key=Z7408WO050VI tag=YYXA7ZGG8FJ7 type=del size=808350 2024-09-12T00:19:30.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.160+0000 7f682945b780 1 < completed delete operation key=BK212Z99RM7F tag=1KGI6QNWCG58 type=del 2024-09-12T00:19:30.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.163+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~A3AGGEWMH3WU.0 size=1048576 2024-09-12T00:19:30.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.164+0000 7f682945b780 1 > prepared part key=_multipart_R7V03ML1H80V.2~A3AGGEWMH3WU.1 size=447523 2024-09-12T00:19:30.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.164+0000 7f682945b780 1 > prepared multipart upload key=R7V03ML1H80V upload=A3AGGEWMH3WU tag=79B4EFD07Q18 type=write size=2544675 2024-09-12T00:19:30.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.165+0000 7f682945b780 1 < completed delete operation key=SGWTWN8RTKDD tag=K6VPKRD36KGX type=del 2024-09-12T00:19:30.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.167+0000 7f682945b780 1 > prepared operation key=IUPAGGPATJB4 tag=CVUQQ90XXT60 type=del size=193364 2024-09-12T00:19:30.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.168+0000 7f682945b780 1 < completed delete operation key=G0ONSUVW4M7R tag=RLGFMJO67H5H type=del 2024-09-12T00:19:30.169 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.169+0000 7f682945b780 1 > prepared operation key=9Q4HFV4F2KE2 tag=8ZLE2CWL1SHC type=del size=462471 2024-09-12T00:19:30.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.171+0000 7f682945b780 1 < completed delete operation key=17S1X3WXCNAR tag=XBCRAVRLVZVX type=del 2024-09-12T00:19:30.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.172+0000 7f682945b780 1 > prepared operation key=COUJXCOSVPDS tag=2LAJ6238CCM8 type=del size=2389492 2024-09-12T00:19:30.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.176+0000 7f682945b780 1 < suggested remove operation key=BFY578HP8GAW tag=0O4REPN4MWCU type=del 2024-09-12T00:19:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:19:30.177+0000 7f682945b780 1 > prepared operation key=EYHGJ82COSE9 tag=8AL3DSW4EUHV type=del size=2987180 2024-09-12T00:19:30.177 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] cls_rgw_stats.simulate (10971 ms) 2024-09-12T00:19:30.177 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 1 test from cls_rgw_stats (10971 ms total) 2024-09-12T00:19:30.177 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:19:30.177 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:19:30.225 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 1 test from 1 test suite ran. (12895 ms total) 2024-09-12T00:19:30.226 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 1 test. 2024-09-12T00:19:30.228 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:19:30.229 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:19:30.311 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T00:19:30.313 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T00:19:30.314 DEBUG:teuthology.orchestra.run.smithi133:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T00:19:30.399 INFO:tasks.workunit.client.0.smithi133.stdout:Running main() from gmock_main.cc 2024-09-12T00:19:30.399 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T00:19:30.399 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:19:32.226 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 31 tests from CmpOmap 2024-09-12T00:19:32.226 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T00:19:32.247 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (21 ms) 2024-09-12T00:19:32.247 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T00:19:32.251 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (5 ms) 2024-09-12T00:19:32.252 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T00:19:32.254 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (2 ms) 2024-09-12T00:19:32.254 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T00:19:32.258 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2024-09-12T00:19:32.258 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T00:19:32.264 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-09-12T00:19:32.264 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T00:19:32.270 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_vals_u64 (6 ms) 2024-09-12T00:19:32.270 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T00:19:32.273 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (4 ms) 2024-09-12T00:19:32.273 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T00:19:32.276 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (2 ms) 2024-09-12T00:19:32.276 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T00:19:32.279 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-12T00:19:32.279 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T00:19:32.283 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (3 ms) 2024-09-12T00:19:32.283 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T00:19:32.283 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T00:19:32.283 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T00:19:32.284 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2024-09-12T00:19:32.284 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T00:19:32.290 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (6 ms) 2024-09-12T00:19:32.290 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T00:19:32.297 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (8 ms) 2024-09-12T00:19:32.297 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T00:19:32.303 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (5 ms) 2024-09-12T00:19:32.303 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T00:19:32.309 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2024-09-12T00:19:32.309 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T00:19:32.317 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_set_vals_str (7 ms) 2024-09-12T00:19:32.317 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T00:19:32.324 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-12T00:19:32.324 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T00:19:32.326 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (2 ms) 2024-09-12T00:19:32.326 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T00:19:32.329 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (2 ms) 2024-09-12T00:19:32.329 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T00:19:32.330 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-12T00:19:32.330 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T00:19:32.331 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-12T00:19:32.331 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T00:19:32.337 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-09-12T00:19:32.337 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T00:19:32.343 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2024-09-12T00:19:32.343 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T00:19:32.351 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (8 ms) 2024-09-12T00:19:32.351 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T00:19:32.358 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (6 ms) 2024-09-12T00:19:32.358 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T00:19:32.360 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-12T00:19:32.360 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T00:19:32.362 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-12T00:19:32.363 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T00:19:32.363 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-12T00:19:32.363 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T00:19:32.364 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2024-09-12T00:19:32.364 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T00:19:32.372 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (8 ms) 2024-09-12T00:19:32.372 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 31 tests from CmpOmap (146 ms total) 2024-09-12T00:19:32.372 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:19:32.372 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:19:33.244 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 31 tests from 1 test suite ran. (2844 ms total) 2024-09-12T00:19:33.244 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 31 tests. 2024-09-12T00:19:33.247 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:19:33.247 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:19:33.290 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T00:19:33.291 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T00:19:33.291 DEBUG:teuthology.orchestra.run.smithi133:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T00:19:33.377 INFO:tasks.workunit.client.0.smithi133.stdout:Running main() from gmock_main.cc 2024-09-12T00:19:33.377 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:19:33.377 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:19:33.377 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T00:19:33.377 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T00:19:36.259 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2883 ms) 2024-09-12T00:19:36.259 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T00:19:39.279 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3020 ms) 2024-09-12T00:19:39.279 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T00:19:42.310 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.Reserve (3030 ms) 2024-09-12T00:19:42.310 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T00:19:45.316 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3007 ms) 2024-09-12T00:19:45.316 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T00:19:48.342 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.Commit (3026 ms) 2024-09-12T00:19:48.342 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T00:19:51.351 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.Stats (3009 ms) 2024-09-12T00:19:51.351 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T00:19:55.382 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4031 ms) 2024-09-12T00:19:55.383 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T00:19:58.417 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.Abort (3035 ms) 2024-09-12T00:19:58.417 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T00:20:01.424 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.ReserveError (3007 ms) 2024-09-12T00:20:01.424 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T00:20:04.453 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.CommitError (3029 ms) 2024-09-12T00:20:04.453 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T00:20:07.469 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.AbortError (3016 ms) 2024-09-12T00:20:07.469 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T00:20:10.490 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3020 ms) 2024-09-12T00:20:10.490 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T00:20:13.500 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3011 ms) 2024-09-12T00:20:13.500 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T00:20:16.529 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3029 ms) 2024-09-12T00:20:16.529 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T00:20:19.545 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3015 ms) 2024-09-12T00:20:19.549 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T00:20:22.563 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3019 ms) 2024-09-12T00:20:22.563 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T00:20:25.569 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3006 ms) 2024-09-12T00:20:25.569 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T00:20:28.597 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.Cleanup (3028 ms) 2024-09-12T00:20:28.597 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T00:20:39.633 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.MultiProducer (11036 ms) 2024-09-12T00:20:39.634 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T00:20:42.664 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3031 ms) 2024-09-12T00:20:42.664 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T00:20:56.507 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13843 ms) 2024-09-12T00:20:56.507 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T00:21:00.541 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4034 ms) 2024-09-12T00:21:00.542 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T00:21:05.565 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (5023 ms) 2024-09-12T00:21:05.565 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T00:21:10.595 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5031 ms) 2024-09-12T00:21:10.596 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 24 tests from TestCls2PCQueue (97219 ms total) 2024-09-12T00:21:10.596 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:21:10.596 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:21:10.596 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 24 tests from 1 test suite ran. (97219 ms total) 2024-09-12T00:21:10.596 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 24 tests. 2024-09-12T00:21:10.599 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:21:10.599 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:21:10.642 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T00:21:10.643 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T00:21:10.644 DEBUG:teuthology.orchestra.run.smithi133:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T00:21:10.736 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:10.736 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:10.737 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:21:10.737 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:21:12.610 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 4 tests from ClsAccount 2024-09-12T00:21:12.610 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ClsAccount.add 2024-09-12T00:21:12.634 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ClsAccount.add (24 ms) 2024-09-12T00:21:12.634 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ClsAccount.get 2024-09-12T00:21:12.639 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ClsAccount.get (6 ms) 2024-09-12T00:21:12.639 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ClsAccount.rm 2024-09-12T00:21:12.646 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ClsAccount.rm (7 ms) 2024-09-12T00:21:12.647 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] ClsAccount.list 2024-09-12T00:21:12.661 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] ClsAccount.list (14 ms) 2024-09-12T00:21:12.661 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 4 tests from ClsAccount (51 ms total) 2024-09-12T00:21:12.661 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:21:12.661 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:21:13.612 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 4 tests from 1 test suite ran. (2874 ms total) 2024-09-12T00:21:13.612 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 4 tests. 2024-09-12T00:21:13.616 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:21:13.616 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:21:13.659 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T00:21:13.661 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T00:21:13.661 DEBUG:teuthology.orchestra.run.smithi133:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T00:21:13.754 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:13.754 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:13.754 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T00:21:13.755 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:21:15.621 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T00:21:15.622 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T00:21:15.634 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] rgw_gc_log.init_existing_queue (13 ms) 2024-09-12T00:21:15.634 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T00:21:15.637 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-09-12T00:21:15.637 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T00:21:15.983 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (346 ms) 2024-09-12T00:21:15.983 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T00:21:15.984 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-12T00:21:15.984 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T00:21:15.988 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-12T00:21:15.988 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T00:21:15.990 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-12T00:21:15.990 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 6 tests from rgw_gc_log (369 ms total) 2024-09-12T00:21:15.990 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:21:15.990 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:21:16.629 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 6 tests from 1 test suite ran. (2874 ms total) 2024-09-12T00:21:16.629 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 6 tests. 2024-09-12T00:21:16.633 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:21:16.633 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:21:16.676 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T00:21:16.677 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T00:21:16.677 DEBUG:teuthology.orchestra.run.smithi133:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T00:21:16.773 INFO:tasks.workunit.client.0.smithi133.stdout:Running main() from gmock_main.cc 2024-09-12T00:21:16.773 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:21:16.774 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:21:16.774 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T00:21:16.774 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T00:21:16.774 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj 2024-09-12T00:21:16.774 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj 2024-09-12T00:21:16.774 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: _obj ns= i= 2024-09-12T00:21:16.774 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj 2024-09-12T00:21:16.774 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj 2024-09-12T00:21:16.774 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: _obj ns= i= 2024-09-12T00:21:16.774 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj 2024-09-12T00:21:16.774 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj 2024-09-12T00:21:16.774 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: _obj ns= i= 2024-09-12T00:21:16.774 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.774 INFO:tasks.workunit.client.0.smithi133.stdout: "obj1": { 2024-09-12T00:21:16.775 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.775 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.775 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.775 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.775 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.775 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.775 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.775 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.775 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.775 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.775 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.775 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.775 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.775 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.776 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.776 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.776 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.776 INFO:tasks.workunit.client.0.smithi133.stdout: "obj2": { 2024-09-12T00:21:16.776 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.776 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.776 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.776 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.776 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.776 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.776 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.776 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.776 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.777 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.777 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.777 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.777 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.777 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.777 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.777 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.777 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.777 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3": { 2024-09-12T00:21:16.777 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.777 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.777 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.777 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.777 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.777 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.778 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.778 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.778 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.778 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.778 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.778 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.778 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.778 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.778 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.778 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.778 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.778 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3-2": { 2024-09-12T00:21:16.778 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.778 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.779 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.779 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.779 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.779 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.779 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.779 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.779 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.779 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.779 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.779 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.779 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.779 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.779 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.779 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.780 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.780 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.780 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj 2024-09-12T00:21:16.780 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj 2024-09-12T00:21:16.780 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: _obj ns=ns i= 2024-09-12T00:21:16.780 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj 2024-09-12T00:21:16.780 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj 2024-09-12T00:21:16.780 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: _obj ns=ns i= 2024-09-12T00:21:16.780 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj 2024-09-12T00:21:16.780 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj 2024-09-12T00:21:16.780 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: _obj ns=ns i= 2024-09-12T00:21:16.780 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.780 INFO:tasks.workunit.client.0.smithi133.stdout: "obj1": { 2024-09-12T00:21:16.781 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.781 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.781 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.781 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.781 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.781 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.781 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.781 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.781 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.781 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.781 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.781 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.781 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.781 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.782 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.782 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.782 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.782 INFO:tasks.workunit.client.0.smithi133.stdout: "obj2": { 2024-09-12T00:21:16.782 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.782 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.782 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.782 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.782 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.782 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.782 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.782 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.782 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.782 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.783 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.783 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.783 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.783 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.783 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.783 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.783 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.783 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3": { 2024-09-12T00:21:16.783 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.783 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.783 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.783 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.783 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.784 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.784 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.784 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.784 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.784 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.784 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.784 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.784 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.784 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.784 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.784 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.784 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.784 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3-2": { 2024-09-12T00:21:16.784 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.784 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.785 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.785 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.785 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.785 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.785 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.785 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.785 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.785 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.785 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.785 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.785 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.785 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.785 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.785 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.786 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.786 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.786 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj[v1] 2024-09-12T00:21:16.786 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj[v1] 2024-09-12T00:21:16.786 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: _obj ns= i=v1 2024-09-12T00:21:16.786 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj[v1] 2024-09-12T00:21:16.786 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj[v1] 2024-09-12T00:21:16.786 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: _obj ns= i=v1 2024-09-12T00:21:16.786 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj[v1] 2024-09-12T00:21:16.786 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj[v1] 2024-09-12T00:21:16.786 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: _obj ns= i=v1 2024-09-12T00:21:16.786 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.786 INFO:tasks.workunit.client.0.smithi133.stdout: "obj1": { 2024-09-12T00:21:16.786 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.787 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.787 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.787 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.787 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.787 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.787 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.787 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.787 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.787 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.787 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.787 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.787 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.787 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "v1", 2024-09-12T00:21:16.787 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.788 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.788 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.788 INFO:tasks.workunit.client.0.smithi133.stdout: "obj2": { 2024-09-12T00:21:16.788 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.788 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.788 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.788 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.788 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.788 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.788 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.788 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.788 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.788 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.788 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.789 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.789 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.789 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "v1", 2024-09-12T00:21:16.789 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.789 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.789 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.789 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3": { 2024-09-12T00:21:16.789 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.789 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.789 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.789 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.789 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.789 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.789 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.789 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.790 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.790 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.790 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.790 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.790 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.790 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.790 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.790 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.790 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.790 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3-2": { 2024-09-12T00:21:16.790 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.790 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.790 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.790 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.791 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.791 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.791 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.791 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.791 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.791 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.791 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.791 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.791 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.791 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "v1", 2024-09-12T00:21:16.791 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.791 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.791 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.791 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.791 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj[v1] 2024-09-12T00:21:16.792 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj[v1] 2024-09-12T00:21:16.792 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:21:16.792 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj[v1] 2024-09-12T00:21:16.792 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj[v1] 2024-09-12T00:21:16.792 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:21:16.792 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj[v1] 2024-09-12T00:21:16.792 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: _obj[v1] 2024-09-12T00:21:16.792 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:21:16.792 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.792 INFO:tasks.workunit.client.0.smithi133.stdout: "obj1": { 2024-09-12T00:21:16.792 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.792 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.792 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.792 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.793 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.793 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.793 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.793 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.793 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.793 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.793 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.793 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.793 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.793 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "v1", 2024-09-12T00:21:16.793 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.793 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.793 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.793 INFO:tasks.workunit.client.0.smithi133.stdout: "obj2": { 2024-09-12T00:21:16.793 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.794 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.794 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.794 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.794 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.794 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.794 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.794 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.794 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.794 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.794 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.794 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.794 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.794 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "v1", 2024-09-12T00:21:16.794 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.794 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.795 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.795 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3": { 2024-09-12T00:21:16.795 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.795 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.795 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.795 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.795 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.795 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.795 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.796 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.796 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.796 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.796 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.796 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.796 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.796 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.796 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.796 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.796 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.796 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3-2": { 2024-09-12T00:21:16.796 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.796 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.797 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.797 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.797 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.797 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.797 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.797 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.797 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.797 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.797 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.797 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.797 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_obj", 2024-09-12T00:21:16.797 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "v1", 2024-09-12T00:21:16.797 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.797 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.798 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.798 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.798 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T00:21:16.798 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T00:21:16.798 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj 2024-09-12T00:21:16.798 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj 2024-09-12T00:21:16.798 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: obj ns= i= 2024-09-12T00:21:16.798 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj 2024-09-12T00:21:16.798 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj 2024-09-12T00:21:16.798 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: obj ns= i= 2024-09-12T00:21:16.798 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj 2024-09-12T00:21:16.798 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj 2024-09-12T00:21:16.798 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: obj ns= i= 2024-09-12T00:21:16.798 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.799 INFO:tasks.workunit.client.0.smithi133.stdout: "obj1": { 2024-09-12T00:21:16.799 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.799 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.799 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.799 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.799 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.799 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.799 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.799 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.799 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.799 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.799 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.799 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.799 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.800 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.800 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.800 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.800 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.800 INFO:tasks.workunit.client.0.smithi133.stdout: "obj2": { 2024-09-12T00:21:16.800 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.800 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.800 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.800 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.800 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.800 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.800 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.800 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.801 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.801 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.801 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.801 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.801 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.801 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.801 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.801 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.801 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.801 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3": { 2024-09-12T00:21:16.801 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.801 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.801 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.801 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.801 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.802 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.802 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.802 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.802 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.802 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.802 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.802 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.802 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.802 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.802 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.802 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.802 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.802 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3-2": { 2024-09-12T00:21:16.802 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.802 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.803 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.803 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.803 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.803 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.803 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.803 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.803 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.803 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.803 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.803 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.803 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.803 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.803 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.803 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.804 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.804 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.804 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj 2024-09-12T00:21:16.804 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj 2024-09-12T00:21:16.804 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: obj ns=ns i= 2024-09-12T00:21:16.804 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj 2024-09-12T00:21:16.804 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj 2024-09-12T00:21:16.804 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: obj ns=ns i= 2024-09-12T00:21:16.804 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj 2024-09-12T00:21:16.804 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj 2024-09-12T00:21:16.804 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: obj ns=ns i= 2024-09-12T00:21:16.804 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.804 INFO:tasks.workunit.client.0.smithi133.stdout: "obj1": { 2024-09-12T00:21:16.805 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.805 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.805 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.805 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.805 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.805 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.805 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.805 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.805 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.805 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.805 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.805 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.805 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.805 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.805 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.806 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.806 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.806 INFO:tasks.workunit.client.0.smithi133.stdout: "obj2": { 2024-09-12T00:21:16.806 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.806 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.806 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.806 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.806 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.806 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.806 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.806 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.806 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.806 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.806 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.806 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.807 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.807 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.807 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.807 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.807 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.807 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3": { 2024-09-12T00:21:16.807 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.807 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.807 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.807 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.807 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.807 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.807 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.807 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.808 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.808 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.808 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.808 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.808 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.808 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.808 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.808 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.808 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.808 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3-2": { 2024-09-12T00:21:16.808 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.808 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.808 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.808 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.809 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.809 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.809 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.809 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.809 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.809 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.809 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.809 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.809 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.809 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.809 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.809 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.809 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.809 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.810 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj[v1] 2024-09-12T00:21:16.810 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj[v1] 2024-09-12T00:21:16.810 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: obj ns= i=v1 2024-09-12T00:21:16.810 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj[v1] 2024-09-12T00:21:16.810 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj[v1] 2024-09-12T00:21:16.810 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: obj ns= i=v1 2024-09-12T00:21:16.810 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj[v1] 2024-09-12T00:21:16.810 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj[v1] 2024-09-12T00:21:16.810 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: obj ns= i=v1 2024-09-12T00:21:16.810 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.810 INFO:tasks.workunit.client.0.smithi133.stdout: "obj1": { 2024-09-12T00:21:16.810 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.810 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.810 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.810 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.811 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.811 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.811 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.811 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.811 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.811 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.811 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.811 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.811 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.811 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "v1", 2024-09-12T00:21:16.811 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.811 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.811 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.811 INFO:tasks.workunit.client.0.smithi133.stdout: "obj2": { 2024-09-12T00:21:16.811 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.812 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.812 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.812 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.812 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.812 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.812 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.812 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.812 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.812 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.812 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.812 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.812 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.812 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "v1", 2024-09-12T00:21:16.812 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.813 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.813 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.813 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3": { 2024-09-12T00:21:16.813 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.813 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.813 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.813 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.813 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.813 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.813 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.813 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.813 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.813 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.813 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.814 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.814 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.814 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.814 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.814 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.814 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.814 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3-2": { 2024-09-12T00:21:16.814 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.814 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.814 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.814 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.814 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.814 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.815 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.815 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.815 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.815 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.815 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.815 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.815 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.815 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "v1", 2024-09-12T00:21:16.815 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.815 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.815 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.815 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.815 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj[v1] 2024-09-12T00:21:16.815 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj[v1] 2024-09-12T00:21:16.815 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:21:16.816 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj[v1] 2024-09-12T00:21:16.816 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj[v1] 2024-09-12T00:21:16.816 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:21:16.816 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj[v1] 2024-09-12T00:21:16.816 INFO:tasks.workunit.client.0.smithi133.stdout:parsed: obj[v1] 2024-09-12T00:21:16.816 INFO:tasks.workunit.client.0.smithi133.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:21:16.816 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.816 INFO:tasks.workunit.client.0.smithi133.stdout: "obj1": { 2024-09-12T00:21:16.816 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.816 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.816 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.816 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.816 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.816 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.817 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.817 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.817 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.817 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.817 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.817 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.817 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.817 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "v1", 2024-09-12T00:21:16.817 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.817 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.817 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.817 INFO:tasks.workunit.client.0.smithi133.stdout: "obj2": { 2024-09-12T00:21:16.817 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.817 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.817 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.818 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.818 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.818 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.818 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.818 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.818 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.818 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.818 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.818 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.818 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.818 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "v1", 2024-09-12T00:21:16.818 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.818 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.818 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.819 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3": { 2024-09-12T00:21:16.819 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.819 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.819 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.819 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.819 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.819 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.819 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.819 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.819 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.819 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.819 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.819 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.819 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.819 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.820 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.820 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.820 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.820 INFO:tasks.workunit.client.0.smithi133.stdout: "obj3-2": { 2024-09-12T00:21:16.820 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.820 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.820 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.820 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.820 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.820 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.820 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.820 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.820 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.820 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.821 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.821 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.821 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "obj", 2024-09-12T00:21:16.821 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "v1", 2024-09-12T00:21:16.821 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.821 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.821 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.821 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.821 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T00:21:16.821 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T00:21:16.821 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.821 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.821 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.821 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.822 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.822 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.822 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.822 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.822 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.822 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.822 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.822 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.822 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.822 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.822 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.822 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.822 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.822 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.822 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.823 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.823 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.823 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.823 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.823 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.823 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.823 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.823 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.823 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.823 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.823 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.823 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.823 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.823 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.823 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.824 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.824 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": "default-placement.data", 2024-09-12T00:21:16.824 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker_myobj", 2024-09-12T00:21:16.824 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.824 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.824 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.824 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.824 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.824 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.824 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.824 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.824 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.824 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.825 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.825 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.825 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.825 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.825 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.825 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.825 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.825 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.825 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.825 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.825 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.825 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.825 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.825 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.826 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.826 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.826 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.826 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.826 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.826 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.826 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.826 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.826 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.826 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.826 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.826 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.826 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.826 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.827 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.827 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.827 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.827 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.827 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.827 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.827 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.827 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.827 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.827 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.827 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.827 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.827 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.828 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.828 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.828 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.828 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.828 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.828 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.828 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.828 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.828 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker_myobj", 2024-09-12T00:21:16.828 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.828 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.828 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.828 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.828 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.829 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.829 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.829 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.829 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.829 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.829 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.829 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.829 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.829 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.829 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.829 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.829 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.829 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.830 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.830 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.830 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.830 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.830 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.830 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.830 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.830 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.830 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.830 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.830 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.830 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.830 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.830 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.830 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.831 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.831 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.831 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.831 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.831 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.831 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.831 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.831 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.831 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.831 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.831 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.831 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.831 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.831 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.832 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.832 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.832 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.832 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.832 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.832 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.832 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.832 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.832 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.832 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.832 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.832 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": "default-placement.data", 2024-09-12T00:21:16.832 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:21:16.832 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.833 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.833 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.833 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.833 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.833 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.833 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.833 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.833 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.833 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.833 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.833 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.833 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.833 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.834 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.834 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.834 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.834 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.834 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.834 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.834 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.834 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.834 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.834 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.834 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.834 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.834 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.834 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.835 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.835 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.835 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.835 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.835 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.835 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.835 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.835 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.835 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.835 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.835 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.835 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.835 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.835 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.836 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.836 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.836 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.836 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.836 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.836 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.836 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.836 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.836 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.836 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.836 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.836 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.836 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.836 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.836 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.837 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.837 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.837 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:21:16.837 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.837 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.837 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.837 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.837 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.837 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.837 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.837 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.837 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.837 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.837 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.837 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.838 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.838 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.838 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.838 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.838 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.838 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.838 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.838 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.838 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.838 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.838 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.838 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.838 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.839 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.839 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.839 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.839 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.839 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.839 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.839 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.839 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.839 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.839 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.839 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.839 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.839 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.839 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.840 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.840 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.840 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.840 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.840 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.840 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.840 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.840 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.840 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.840 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.840 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.840 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.840 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.840 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.841 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.841 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.841 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.841 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.841 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.841 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": "default-placement.data", 2024-09-12T00:21:16.841 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:21:16.841 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.841 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.841 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.841 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.841 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.841 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.841 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.842 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.842 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.842 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.842 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.842 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.842 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.842 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.842 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.842 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.842 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.842 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.842 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.842 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.842 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.842 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.843 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.843 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.843 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.843 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.843 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.843 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.843 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.843 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.843 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.843 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.843 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.843 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.843 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.843 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.843 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.844 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.844 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.844 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.844 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.844 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.844 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.844 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.844 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.844 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.844 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.844 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.844 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.844 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.844 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.845 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.845 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.845 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.845 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.845 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.845 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.845 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.845 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.845 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:21:16.845 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.845 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.845 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.845 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.845 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.845 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.846 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.846 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.846 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.846 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.846 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.846 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.846 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.846 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.846 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.846 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.846 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.846 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.846 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.846 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.847 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.847 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.847 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.847 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.847 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.847 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.847 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.847 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.847 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.847 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.847 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.847 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.847 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.847 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.847 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.848 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.848 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.848 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.848 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.848 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.848 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.848 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.848 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.848 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.848 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.848 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.848 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.848 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.848 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.848 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.849 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.849 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.849 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.849 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.849 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.849 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.849 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.849 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.849 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": "default-placement.data", 2024-09-12T00:21:16.849 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:21:16.849 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.849 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.849 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.849 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.850 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.850 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.850 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.850 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.850 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.850 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.850 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.850 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.850 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.850 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.850 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.850 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.850 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.850 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.851 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.851 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.851 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.851 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.851 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.851 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.851 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.851 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.851 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.851 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.851 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.851 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.851 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.852 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.852 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.852 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.852 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.852 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.852 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.852 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.852 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.852 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.852 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.852 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.852 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.852 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.852 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.853 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.853 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.853 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.853 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.853 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.853 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.853 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.853 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.853 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.853 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.853 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.853 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.853 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.853 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.854 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:21:16.854 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.854 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.854 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.854 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.854 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.854 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.854 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.854 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.854 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.854 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.854 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.854 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.855 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.855 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.855 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.855 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.855 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.855 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.855 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.855 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.855 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.855 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.855 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.855 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.855 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.855 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.856 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.856 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.856 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.856 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.856 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.856 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.856 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.856 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.856 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.856 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.856 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.856 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.856 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.856 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.856 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.857 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.857 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.857 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.857 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.857 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.857 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.857 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.857 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.857 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.857 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.857 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.857 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.857 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.858 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.858 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.858 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.858 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.858 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": "default-placement.data", 2024-09-12T00:21:16.858 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker___myobj", 2024-09-12T00:21:16.858 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj" 2024-09-12T00:21:16.858 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.858 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.858 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.858 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.858 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.858 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.858 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.858 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.859 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.859 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.859 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.859 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.859 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.859 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.859 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.859 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.859 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.859 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.859 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.859 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.859 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.860 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.860 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.860 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.860 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.860 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.860 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.860 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.860 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.860 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.860 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.860 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.860 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.860 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.860 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.860 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.861 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.861 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.861 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.861 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.861 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.861 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.861 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.861 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.861 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.861 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.861 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.861 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.861 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.861 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.862 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.862 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.862 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.862 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.862 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.862 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.862 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.862 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.862 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker___myobj", 2024-09-12T00:21:16.862 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj" 2024-09-12T00:21:16.862 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.862 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.862 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.862 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.863 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.863 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.863 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.863 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.863 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.863 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.863 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.863 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.863 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.863 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.863 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.863 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.863 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.863 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.864 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.864 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.864 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.864 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.864 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.864 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.864 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.864 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.864 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.864 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.864 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.864 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.865 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.865 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.865 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.865 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.865 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.865 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.865 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.865 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.865 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.865 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.865 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.865 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.865 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.865 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": "default-placement.data", 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:21:16.866 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.867 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.867 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.867 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.867 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.867 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.867 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.867 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.867 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.867 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.867 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.867 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.867 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.867 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.867 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.868 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.868 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.868 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.868 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.868 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.868 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.868 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.868 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.868 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.868 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.868 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.868 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.868 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.868 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.869 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.869 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.869 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.869 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.869 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.869 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.869 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.869 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.869 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.869 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.869 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.869 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.869 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.869 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.870 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.870 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.870 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.870 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.870 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.870 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.870 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.870 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.870 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.870 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.870 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.870 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.870 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.870 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.870 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.871 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.871 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:21:16.871 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.871 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.871 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.871 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.871 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.871 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.871 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.871 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.871 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.871 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.871 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.871 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.871 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.872 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.872 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.872 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.872 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.872 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.872 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.872 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.872 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.872 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.872 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.872 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.872 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.872 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.872 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.872 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.873 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.873 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.873 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.873 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.873 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.873 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.873 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.873 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.873 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.873 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.873 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.873 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.873 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.873 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.874 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.874 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.874 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.874 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.874 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.874 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.874 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.874 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.874 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.874 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.874 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.874 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.874 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.874 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.875 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.875 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.875 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": "default-placement.data", 2024-09-12T00:21:16.875 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:21:16.875 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj" 2024-09-12T00:21:16.875 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.875 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.875 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.875 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.875 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.875 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.875 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.875 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.875 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.876 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.876 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.876 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.876 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.876 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.876 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.876 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.876 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.876 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.876 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.876 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.876 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.876 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.876 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.876 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.877 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.877 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.877 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.877 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.877 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.877 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.877 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.877 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.877 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.877 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.877 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.877 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.877 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.878 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.878 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.878 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.878 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.878 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.878 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.878 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.878 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.878 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.878 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.878 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.878 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.878 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.879 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.879 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.879 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.879 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.879 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.879 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.879 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.879 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.879 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:21:16.879 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj" 2024-09-12T00:21:16.879 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.879 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.879 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.879 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.880 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.880 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.880 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.880 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.880 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.880 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.880 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.880 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.880 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.880 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.880 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.880 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.880 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.880 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.881 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.881 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.881 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.881 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.881 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.881 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.881 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.881 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.881 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.881 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.881 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.881 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.881 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.881 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.882 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.882 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.882 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.882 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.882 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.882 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.882 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.882 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.882 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.882 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.882 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.882 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.882 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.882 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.882 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.883 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.883 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.883 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.883 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.883 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.883 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.883 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.883 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.883 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.883 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.883 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": "default-placement.data", 2024-09-12T00:21:16.883 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:21:16.883 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.884 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.884 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.884 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.884 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.884 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.884 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.884 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.884 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.884 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.884 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.884 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.884 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.884 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.884 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.885 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.885 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.885 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.885 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.885 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.885 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.885 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.885 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.885 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.885 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.885 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.885 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.885 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.885 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.886 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.886 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.886 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.886 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.886 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.886 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.886 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.886 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.886 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.886 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.886 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.886 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.886 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.886 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.886 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.887 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.887 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.887 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.887 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.887 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.887 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.887 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.887 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.887 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.887 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.887 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.887 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.887 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.887 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.887 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.888 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:21:16.888 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.888 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.888 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.888 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.888 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.888 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.888 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.888 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.888 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.888 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.888 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.888 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.888 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.889 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.889 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.889 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.889 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.889 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.889 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.889 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.889 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.889 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.889 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.889 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.889 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.889 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.889 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.890 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.890 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.890 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.890 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.890 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.890 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.890 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.890 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.890 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.890 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.890 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.890 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.890 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.890 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.890 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.891 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.891 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.891 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.891 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.891 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.891 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.891 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.891 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.891 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.891 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.891 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.891 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.891 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.891 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.892 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.892 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.892 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": "default-placement.data", 2024-09-12T00:21:16.892 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker___myobj_", 2024-09-12T00:21:16.892 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj_" 2024-09-12T00:21:16.892 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.892 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.892 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.892 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.892 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.892 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.892 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.892 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.892 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.893 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.893 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.893 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.893 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.893 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.893 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.893 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.893 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.893 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.893 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.893 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.893 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.893 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.893 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.893 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.894 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.894 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.894 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.894 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.894 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.894 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.894 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.894 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.894 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.894 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.894 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.894 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.894 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.894 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.894 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.895 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.895 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.895 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.895 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.895 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.895 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.895 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.895 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.895 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.895 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.895 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.895 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.895 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.895 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.896 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.896 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.896 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.896 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.896 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.896 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker___myobj_", 2024-09-12T00:21:16.896 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj_" 2024-09-12T00:21:16.896 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.896 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.896 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.896 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.896 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.896 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.896 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.897 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.897 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.897 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.897 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.897 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.897 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.897 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.897 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.897 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.897 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.897 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.897 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.897 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.897 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.898 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.898 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.898 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.898 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.898 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.898 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.898 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.898 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.898 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.898 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.898 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.898 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.898 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.898 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.898 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.899 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.900 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.900 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.900 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.900 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.900 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.900 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.900 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": "default-placement.data", 2024-09-12T00:21:16.900 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:21:16.900 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.900 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.900 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.900 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.900 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.900 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.900 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.901 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.901 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.901 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.901 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.901 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.901 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.901 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.901 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.901 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.901 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.901 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.901 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.901 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.901 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.902 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.902 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.902 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.902 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.902 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.902 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.902 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.902 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.902 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.902 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.902 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.902 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.902 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.902 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.903 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.903 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.903 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.903 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.903 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.903 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.903 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.903 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.903 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.903 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.903 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.903 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.903 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.903 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.904 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.904 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.904 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.904 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.904 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.904 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.904 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.904 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.904 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.904 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.904 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:21:16.904 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.904 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.904 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.905 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.905 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.905 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.905 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.905 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.905 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.905 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.905 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.905 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.905 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.905 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.905 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.905 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.905 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.905 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.906 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.906 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.906 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.906 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.906 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.906 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.906 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.906 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.906 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.906 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.906 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.906 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.906 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.906 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.907 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.907 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.907 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.907 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.907 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.907 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.907 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.907 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.907 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.907 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.907 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.907 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.907 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.907 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.907 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.908 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.908 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.908 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.908 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.908 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.908 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.908 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.908 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.908 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.908 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.908 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.908 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": "default-placement.data", 2024-09-12T00:21:16.908 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:21:16.908 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj_" 2024-09-12T00:21:16.909 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.909 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.909 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.909 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.909 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.909 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.909 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.909 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.909 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.909 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.909 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.909 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.909 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.909 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.910 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.910 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.910 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.910 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.910 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.910 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.910 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.910 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.910 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.910 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.910 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.910 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.912 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.912 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.912 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.912 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.912 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.912 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.912 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.912 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.912 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.912 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.912 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.912 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.912 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.912 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.913 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.913 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.913 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.913 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.913 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.913 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.913 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.913 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.913 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.913 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.913 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.913 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.913 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.913 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.914 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.914 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.914 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.914 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.914 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:21:16.914 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj_" 2024-09-12T00:21:16.914 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.914 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.914 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.914 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.914 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.914 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.914 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.914 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.914 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.915 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.915 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.915 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.915 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.915 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.915 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.915 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.915 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.915 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.915 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.915 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.915 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.915 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.916 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.916 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.916 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.916 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.916 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.916 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.916 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.916 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.916 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.916 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.916 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.916 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.916 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.916 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.917 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.917 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.917 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.917 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.917 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.917 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.917 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.917 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.917 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.917 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.917 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.917 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.917 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.917 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.917 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.918 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.918 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.918 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.918 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.918 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.918 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.918 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": "default-placement.data", 2024-09-12T00:21:16.918 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:21:16.918 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.918 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.918 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.918 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.918 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.918 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.919 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "test", 2024-09-12T00:21:16.919 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.919 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.919 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.919 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.919 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": "", 2024-09-12T00:21:16.919 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.919 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": "" 2024-09-12T00:21:16.919 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.919 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.919 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.919 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.919 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.919 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.920 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.920 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.920 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.920 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.920 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.920 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.920 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.920 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.920 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.920 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.920 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.920 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.920 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.920 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.921 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.921 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.921 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.921 INFO:tasks.workunit.client.0.smithi133.stdout: "obj": { 2024-09-12T00:21:16.921 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.921 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.921 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.921 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.921 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.921 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.921 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.921 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.921 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.922 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.922 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.922 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.922 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.922 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.922 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.922 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.922 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.922 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.922 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.922 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.922 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.922 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:21:16.922 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.922 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.923 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.923 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.923 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.923 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.923 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.923 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.923 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.923 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.923 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.923 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.923 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.923 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.923 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.923 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.924 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.924 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.924 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.924 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.924 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.924 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.924 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.924 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-12T00:21:16.924 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T00:21:16.924 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.924 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.924 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.924 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker_myobj", 2024-09-12T00:21:16.924 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.924 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.925 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.925 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.925 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.925 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.925 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.925 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.925 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.925 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.925 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.925 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.925 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.925 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.925 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.925 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.925 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.926 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.926 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.926 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.926 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.926 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.926 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.926 INFO:tasks.workunit.client.0.smithi133.stdout:raw=.data-pool:marker_myobj 2024-09-12T00:21:16.926 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.926 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj2": { 2024-09-12T00:21:16.926 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.926 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker_myobj", 2024-09-12T00:21:16.926 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.926 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.926 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.927 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.927 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj2": { 2024-09-12T00:21:16.927 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.927 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.927 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.927 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.927 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.927 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.927 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.927 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.927 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.927 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.927 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.928 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.928 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.928 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.928 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.928 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.928 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.928 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.928 INFO:tasks.workunit.client.0.smithi133.stdout:raw2=.data-pool:marker_myobj 2024-09-12T00:21:16.928 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.928 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.928 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.928 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:21:16.928 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.928 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.928 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.929 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.929 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.929 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.929 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.929 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.929 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.929 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.929 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.929 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.929 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.929 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.929 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.929 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.929 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.930 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.930 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.930 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.930 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.930 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.930 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.930 INFO:tasks.workunit.client.0.smithi133.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T00:21:16.930 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.930 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj2": { 2024-09-12T00:21:16.930 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.930 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:21:16.930 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.930 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.930 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.930 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.931 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj2": { 2024-09-12T00:21:16.931 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.931 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.931 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.931 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.931 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.931 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.931 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.931 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.931 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.931 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.931 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.931 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.931 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.932 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.932 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.932 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.932 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.932 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.932 INFO:tasks.workunit.client.0.smithi133.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T00:21:16.932 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.932 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.932 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.932 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:21:16.932 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.932 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.932 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.932 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.932 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.933 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.933 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.933 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.933 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.933 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.933 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.933 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.933 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.933 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.933 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.933 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.933 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.933 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.933 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.934 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.934 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.934 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.934 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.934 INFO:tasks.workunit.client.0.smithi133.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T00:21:16.934 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.934 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj2": { 2024-09-12T00:21:16.934 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.934 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:21:16.934 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.934 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.934 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.934 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.934 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj2": { 2024-09-12T00:21:16.935 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.935 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.935 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.935 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.935 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.935 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.935 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.935 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.935 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.935 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.935 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.935 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.935 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.935 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.935 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.936 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.936 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.936 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.936 INFO:tasks.workunit.client.0.smithi133.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T00:21:16.936 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.936 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.936 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.936 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:21:16.936 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.936 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.936 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.936 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.936 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.936 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.937 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.937 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.937 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.937 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.937 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.937 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.937 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.937 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.937 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.937 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.937 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.937 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.937 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.937 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.938 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.938 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.938 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.938 INFO:tasks.workunit.client.0.smithi133.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T00:21:16.938 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.938 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj2": { 2024-09-12T00:21:16.938 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.938 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:21:16.938 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.938 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.938 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.938 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.938 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj2": { 2024-09-12T00:21:16.938 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.939 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.939 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.939 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.939 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.939 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.939 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.939 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.939 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.939 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.939 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.939 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.939 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "myobj", 2024-09-12T00:21:16.939 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.939 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.940 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.940 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.940 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.940 INFO:tasks.workunit.client.0.smithi133.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T00:21:16.940 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.940 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.940 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.940 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker___myobj", 2024-09-12T00:21:16.940 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj" 2024-09-12T00:21:16.940 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.940 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.940 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.940 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.940 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.941 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.941 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.941 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.941 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.941 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.941 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.941 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.941 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.941 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.941 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.941 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.941 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.941 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.941 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.942 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.942 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.942 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.942 INFO:tasks.workunit.client.0.smithi133.stdout:raw=.data-pool:marker___myobj 2024-09-12T00:21:16.942 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.942 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj2": { 2024-09-12T00:21:16.942 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.942 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker___myobj", 2024-09-12T00:21:16.942 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj" 2024-09-12T00:21:16.942 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.942 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.942 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.942 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj2": { 2024-09-12T00:21:16.942 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.943 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.943 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.943 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.943 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.943 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.943 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.943 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.943 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.943 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.943 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.943 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.943 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.943 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.943 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.943 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.944 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.944 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.944 INFO:tasks.workunit.client.0.smithi133.stdout:raw2=.data-pool:marker___myobj 2024-09-12T00:21:16.944 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.944 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.944 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.944 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:21:16.944 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.944 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.944 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.944 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.944 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.944 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.944 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.945 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.945 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.945 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.945 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.945 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.945 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.945 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.945 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.945 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.945 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.945 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.945 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.945 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.945 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.946 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.946 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.946 INFO:tasks.workunit.client.0.smithi133.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T00:21:16.946 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.946 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj2": { 2024-09-12T00:21:16.946 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.946 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:21:16.946 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.946 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.946 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.946 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.946 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj2": { 2024-09-12T00:21:16.946 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.946 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.947 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.947 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.947 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.947 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.947 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.947 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.947 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.947 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.947 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.947 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.947 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.947 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.947 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.947 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.948 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.948 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.948 INFO:tasks.workunit.client.0.smithi133.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T00:21:16.948 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.948 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.948 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.948 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:21:16.948 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj" 2024-09-12T00:21:16.948 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.948 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.948 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.948 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.948 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.948 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.949 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.949 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.949 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.949 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.949 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.949 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.949 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.949 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.949 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.949 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.949 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.949 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.949 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.949 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.950 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.950 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.950 INFO:tasks.workunit.client.0.smithi133.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T00:21:16.950 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.950 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj2": { 2024-09-12T00:21:16.950 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.950 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:21:16.950 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj" 2024-09-12T00:21:16.950 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.950 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.950 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.950 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj2": { 2024-09-12T00:21:16.950 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.950 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.950 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.951 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.951 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.951 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.951 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.951 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.951 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.951 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.951 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.951 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.951 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.951 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.951 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.951 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.952 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.952 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.952 INFO:tasks.workunit.client.0.smithi133.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T00:21:16.952 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.952 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.952 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.952 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:21:16.952 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.952 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.952 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.952 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.952 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.952 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.953 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.953 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.953 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.953 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.953 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.953 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.953 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.953 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.953 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.953 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.953 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.953 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.953 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.953 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.954 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.954 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.954 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.954 INFO:tasks.workunit.client.0.smithi133.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T00:21:16.954 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.954 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj2": { 2024-09-12T00:21:16.954 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.954 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:21:16.954 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.954 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.954 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.954 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.954 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj2": { 2024-09-12T00:21:16.954 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.955 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.955 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.955 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.955 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.955 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.955 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.955 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.955 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.955 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.955 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.955 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.955 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj", 2024-09-12T00:21:16.955 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.955 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.955 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.956 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.956 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.956 INFO:tasks.workunit.client.0.smithi133.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T00:21:16.956 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.956 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.956 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.956 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker___myobj_", 2024-09-12T00:21:16.956 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj_" 2024-09-12T00:21:16.956 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.956 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.956 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.956 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.956 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.956 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.957 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.957 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.957 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.957 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.957 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.957 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.957 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.957 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.957 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.957 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.957 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.957 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.957 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.958 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.958 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.958 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.958 INFO:tasks.workunit.client.0.smithi133.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T00:21:16.958 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.958 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj2": { 2024-09-12T00:21:16.958 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.958 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker___myobj_", 2024-09-12T00:21:16.958 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj_" 2024-09-12T00:21:16.958 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.958 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.958 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.958 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj2": { 2024-09-12T00:21:16.958 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.958 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.959 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.959 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.959 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.959 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.959 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.959 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.959 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.959 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.959 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.959 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.959 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.959 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.959 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.960 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.960 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.960 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.960 INFO:tasks.workunit.client.0.smithi133.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T00:21:16.960 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.960 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.960 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.960 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:21:16.960 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.960 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.960 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.960 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.960 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.961 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.961 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.961 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.961 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.961 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.961 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.961 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.961 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.961 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.961 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.961 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.961 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.961 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.961 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.962 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.962 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.962 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.962 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.962 INFO:tasks.workunit.client.0.smithi133.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T00:21:16.962 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.962 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj2": { 2024-09-12T00:21:16.962 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.962 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:21:16.962 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.962 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.962 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.962 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.962 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj2": { 2024-09-12T00:21:16.963 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.963 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.963 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.963 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.963 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.963 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.963 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.963 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.963 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.963 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.963 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.963 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.963 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.963 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "", 2024-09-12T00:21:16.964 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.964 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.964 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.964 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.964 INFO:tasks.workunit.client.0.smithi133.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T00:21:16.964 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.964 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.964 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.964 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:21:16.964 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj_" 2024-09-12T00:21:16.964 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.964 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.964 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.965 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.965 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.965 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.965 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.965 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.965 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.965 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.965 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.965 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.965 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.965 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.965 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.965 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.966 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.966 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.966 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.966 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.966 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.966 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.966 INFO:tasks.workunit.client.0.smithi133.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T00:21:16.966 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.966 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj2": { 2024-09-12T00:21:16.966 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.966 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:21:16.966 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "marker__myobj_" 2024-09-12T00:21:16.966 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.966 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.967 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.967 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj2": { 2024-09-12T00:21:16.967 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.967 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.967 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.967 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.967 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.967 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.967 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.967 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.967 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.967 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.967 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.967 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.967 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.968 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.968 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "" 2024-09-12T00:21:16.968 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.968 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.968 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.968 INFO:tasks.workunit.client.0.smithi133.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T00:21:16.968 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.968 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj": { 2024-09-12T00:21:16.968 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.968 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:21:16.968 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.968 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.968 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.968 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.968 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj": { 2024-09-12T00:21:16.969 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.969 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.969 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.969 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.969 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.969 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.969 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.969 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.969 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.969 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.969 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.969 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.969 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.969 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.970 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.970 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.970 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.970 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.970 INFO:tasks.workunit.client.0.smithi133.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:21:16.970 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.970 INFO:tasks.workunit.client.0.smithi133.stdout: "raw_obj2": { 2024-09-12T00:21:16.970 INFO:tasks.workunit.client.0.smithi133.stdout: "pool": ".data-pool", 2024-09-12T00:21:16.970 INFO:tasks.workunit.client.0.smithi133.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:21:16.970 INFO:tasks.workunit.client.0.smithi133.stdout: "loc": "" 2024-09-12T00:21:16.970 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.970 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.970 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:16.970 INFO:tasks.workunit.client.0.smithi133.stdout: "new_obj2": { 2024-09-12T00:21:16.970 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket": { 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "ebtest", 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: "marker": "marker", 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_id": "bucket-id", 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: "tenant": "", 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: "explicit_placement": { 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: "data_pool": ".data-pool", 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: "data_extra_pool": "", 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: "index_pool": ".index-pool" 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: "key": { 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: "name": "_myobj_", 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: "instance": "inst", 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: "ns": "ns" 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.971 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:16.972 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:16.972 INFO:tasks.workunit.client.0.smithi133.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:21:16.972 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T00:21:16.972 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 4 tests from TestRGWObj (0 ms total) 2024-09-12T00:21:16.972 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:21:16.972 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:21:16.972 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 4 tests from 1 test suite ran. (0 ms total) 2024-09-12T00:21:16.972 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 4 tests. 2024-09-12T00:21:16.972 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:21:16.972 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:21:17.012 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T00:21:17.013 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T00:21:17.013 DEBUG:teuthology.orchestra.run.smithi133:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T00:21:17.147 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:17.147 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:17.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.185+0000 7f6049746800 20 rados->read ofs=0 len=0 2024-09-12T00:21:17.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.187+0000 7f6049746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:17.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.187+0000 7f6049746800 20 realm 2024-09-12T00:21:17.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.187+0000 7f6049746800 20 rados->read ofs=0 len=0 2024-09-12T00:21:17.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.187+0000 7f6049746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:17.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.187+0000 7f6049746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:17.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.187+0000 7f6049746800 20 rados->read ofs=0 len=0 2024-09-12T00:21:17.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.187+0000 7f6049746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:17.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.187+0000 7f6049746800 20 rados->read ofs=0 len=0 2024-09-12T00:21:17.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.188+0000 7f6049746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:17.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.188+0000 7f6049746800 20 rados->read ofs=0 len=0 2024-09-12T00:21:17.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.189+0000 7f6049746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:17.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.189+0000 7f6049746800 20 searching for the correct realm 2024-09-12T00:21:17.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.192+0000 7f6047a38640 0 -- 172.21.15.133:0/737742025 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f60400489d0 msgr2=0x7f60400768a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:17.395 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.397+0000 7f6047237640 0 -- 172.21.15.133:0/737742025 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x5570726d31a0 msgr2=0x5570726d5660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:17.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:21:17.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:21:17.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:17.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:17.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:17.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:17.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 20 rados->read ofs=0 len=0 2024-09-12T00:21:17.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:17.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 20 rados->read ofs=0 len=0 2024-09-12T00:21:17.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:17.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 20 rados->read ofs=0 len=0 2024-09-12T00:21:17.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:17.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 20 zone default found 2024-09-12T00:21:17.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 4 Realm: () 2024-09-12T00:21:17.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:21:17.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:21:17.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:17.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 20 zonegroup default 2024-09-12T00:21:17.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.402+0000 7f6049746800 20 rados->read ofs=0 len=0 2024-09-12T00:21:17.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.403+0000 7f6049746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:17.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.403+0000 7f6049746800 20 rados->read ofs=0 len=0 2024-09-12T00:21:17.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.403+0000 7f6049746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:17.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.403+0000 7f6049746800 20 rados->read ofs=0 len=0 2024-09-12T00:21:17.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.403+0000 7f6049746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:17.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.403+0000 7f6049746800 20 started sync module instance, tier type = 2024-09-12T00:21:17.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.403+0000 7f6049746800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:21:17.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.413+0000 7f6049746800 20 add_watcher() i=0 2024-09-12T00:21:17.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.413+0000 7f6049746800 20 add_watcher() i=1 2024-09-12T00:21:17.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.413+0000 7f6049746800 20 add_watcher() i=2 2024-09-12T00:21:17.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.413+0000 7f6049746800 20 add_watcher() i=3 2024-09-12T00:21:17.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.413+0000 7f6049746800 20 add_watcher() i=4 2024-09-12T00:21:17.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.413+0000 7f6049746800 20 add_watcher() i=5 2024-09-12T00:21:17.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.413+0000 7f6049746800 20 add_watcher() i=6 2024-09-12T00:21:17.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.415+0000 7f6049746800 20 add_watcher() i=7 2024-09-12T00:21:17.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.415+0000 7f6049746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:17.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.417+0000 7f5efdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:17.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.417+0000 7f6049746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:17.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.417+0000 7f6049746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:17.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.417+0000 7f6049746800 5 note: GC not initialized 2024-09-12T00:21:17.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.418+0000 7f5efcfe1640 20 reqs_thread_entry: start 2024-09-12T00:21:17.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.418+0000 7f6049746800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:17.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.418+0000 7f6049746800 20 Filter name: none 2024-09-12T00:21:17.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.418+0000 7f5e767fc640 20 reqs_thread_entry: start 2024-09-12T00:21:17.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.418+0000 7f6049746800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T00:21:17.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.418+0000 7f6049746800 20 rados->read ofs=0 len=0 2024-09-12T00:21:17.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.418+0000 7f6049746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:17.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.418+0000 7f6049746800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T00:21:17.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.418+0000 7f6049746800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:21:17.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.418+0000 7f6049746800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T00:21:17.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.418+0000 7f6049746800 20 rados->read ofs=0 len=0 2024-09-12T00:21:17.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.419+0000 7f6049746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:17.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.419+0000 7f6049746800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T00:21:17.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.419+0000 7f6049746800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:21:17.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.419+0000 7f6049746800 10 cache get: name=default.rgw.meta+users.keys+2P8Dn1n3DG/QEw0V/edKtS8r7jY= : miss 2024-09-12T00:21:17.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.419+0000 7f6049746800 20 rados->read ofs=0 len=0 2024-09-12T00:21:17.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.419+0000 7f6049746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:17.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.419+0000 7f6049746800 10 cache put: name=default.rgw.meta+users.keys+2P8Dn1n3DG/QEw0V/edKtS8r7jY= info.flags=0x0 2024-09-12T00:21:17.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.419+0000 7f6049746800 10 adding default.rgw.meta+users.keys+2P8Dn1n3DG/QEw0V/edKtS8r7jY= to cache LRU end 2024-09-12T00:21:17.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.419+0000 7f6049746800 10 cache get: name=default.rgw.meta+users.keys+2P8Dn1n3DG/QEw0V/edKtS8r7jY= : hit (negative entry) 2024-09-12T00:21:17.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.419+0000 7f6049746800 10 cache get: name=default.rgw.meta+users.keys+2P8Dn1n3DG/QEw0V/edKtS8r7jY= : hit (negative entry) 2024-09-12T00:21:17.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.420+0000 7f6049746800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:21:17.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.420+0000 7f6049746800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:21:17.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.420+0000 7f6049746800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T00:21:17.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.420+0000 7f5f2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791298 cookie 93941444511536 notifier 5372 bl.length()=697 2024-09-12T00:21:17.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.420+0000 7f5f2affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:21:17.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.420+0000 7f5f2affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:21:17.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.424+0000 7f6049746800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:21:17.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.424+0000 7f6049746800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:21:17.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.424+0000 7f6049746800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T00:21:17.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.424+0000 7f5f2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791300 cookie 93941444510480 notifier 5372 bl.length()=194 2024-09-12T00:21:17.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.424+0000 7f5f2affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:21:17.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.424+0000 7f5f2affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:21:17.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.427+0000 7f6049746800 10 cache put: name=default.rgw.meta+users.keys+2P8Dn1n3DG/QEw0V/edKtS8r7jY= info.flags=0x7 2024-09-12T00:21:17.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.427+0000 7f6049746800 10 moving default.rgw.meta+users.keys+2P8Dn1n3DG/QEw0V/edKtS8r7jY= to cache LRU end 2024-09-12T00:21:17.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.427+0000 7f6049746800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:2P8Dn1n3DG/QEw0V/edKtS8r7jY=, ofs0, ns] 2024-09-12T00:21:17.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.427+0000 7f5f2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791298 cookie 93941444526224 notifier 5372 bl.length()=203 2024-09-12T00:21:17.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.427+0000 7f5f2a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+2P8Dn1n3DG/QEw0V/edKtS8r7jY= info.flags=0x7 2024-09-12T00:21:17.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.427+0000 7f5f2a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+2P8Dn1n3DG/QEw0V/edKtS8r7jY= to cache LRU end 2024-09-12T00:21:17.427 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:21:17.427 INFO:tasks.workunit.client.0.smithi133.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T00:21:17.427 INFO:tasks.workunit.client.0.smithi133.stdout: "display_name": "librgw test user", 2024-09-12T00:21:17.427 INFO:tasks.workunit.client.0.smithi133.stdout: "email": "librgw@example.com", 2024-09-12T00:21:17.427 INFO:tasks.workunit.client.0.smithi133.stdout: "suspended": 0, 2024-09-12T00:21:17.427 INFO:tasks.workunit.client.0.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:21:17.427 INFO:tasks.workunit.client.0.smithi133.stdout: "subusers": [], 2024-09-12T00:21:17.428 INFO:tasks.workunit.client.0.smithi133.stdout: "keys": [ 2024-09-12T00:21:17.428 INFO:tasks.workunit.client.0.smithi133.stdout: { 2024-09-12T00:21:17.428 INFO:tasks.workunit.client.0.smithi133.stdout: "user": "ceph-test-librgw-file", 2024-09-12T00:21:17.428 INFO:tasks.workunit.client.0.smithi133.stdout: "access_key": "2P8Dn1n3DG/QEw0V/edKtS8r7jY=", 2024-09-12T00:21:17.428 INFO:tasks.workunit.client.0.smithi133.stdout: "secret_key": "f5y/L31/y+WcZX+OKy5asYDmVyqbtAH1azyuCKG8AJV+8MrX4YB7Rw==", 2024-09-12T00:21:17.428 INFO:tasks.workunit.client.0.smithi133.stdout: "active": true, 2024-09-12T00:21:17.428 INFO:tasks.workunit.client.0.smithi133.stdout: "create_date": "2024-09-12T00:21:17.420258Z" 2024-09-12T00:21:17.428 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:21:17.428 INFO:tasks.workunit.client.0.smithi133.stdout: ], 2024-09-12T00:21:17.428 INFO:tasks.workunit.client.0.smithi133.stdout: "swift_keys": [], 2024-09-12T00:21:17.428 INFO:tasks.workunit.client.0.smithi133.stdout: "caps": [], 2024-09-12T00:21:17.428 INFO:tasks.workunit.client.0.smithi133.stdout: "op_mask": "read, write, delete", 2024-09-12T00:21:17.428 INFO:tasks.workunit.client.0.smithi133.stdout: "default_placement": "", 2024-09-12T00:21:17.429 INFO:tasks.workunit.client.0.smithi133.stdout: "default_storage_class": "", 2024-09-12T00:21:17.429 INFO:tasks.workunit.client.0.smithi133.stdout: "placement_tags": [], 2024-09-12T00:21:17.429 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_quota": { 2024-09-12T00:21:17.429 INFO:tasks.workunit.client.0.smithi133.stdout: "enabled": false, 2024-09-12T00:21:17.429 INFO:tasks.workunit.client.0.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:21:17.429 INFO:tasks.workunit.client.0.smithi133.stdout: "max_size": -1, 2024-09-12T00:21:17.429 INFO:tasks.workunit.client.0.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:21:17.429 INFO:tasks.workunit.client.0.smithi133.stdout: "max_objects": -1 2024-09-12T00:21:17.429 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:17.429 INFO:tasks.workunit.client.0.smithi133.stdout: "user_quota": { 2024-09-12T00:21:17.429 INFO:tasks.workunit.client.0.smithi133.stdout: "enabled": false, 2024-09-12T00:21:17.429 INFO:tasks.workunit.client.0.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:21:17.429 INFO:tasks.workunit.client.0.smithi133.stdout: "max_size": -1, 2024-09-12T00:21:17.429 INFO:tasks.workunit.client.0.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:21:17.430 INFO:tasks.workunit.client.0.smithi133.stdout: "max_objects": -1 2024-09-12T00:21:17.430 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:21:17.430 INFO:tasks.workunit.client.0.smithi133.stdout: "temp_url_keys": [], 2024-09-12T00:21:17.430 INFO:tasks.workunit.client.0.smithi133.stdout: "type": "rgw", 2024-09-12T00:21:17.430 INFO:tasks.workunit.client.0.smithi133.stdout: "mfa_ids": [], 2024-09-12T00:21:17.430 INFO:tasks.workunit.client.0.smithi133.stdout: "account_id": "", 2024-09-12T00:21:17.430 INFO:tasks.workunit.client.0.smithi133.stdout: "path": "/", 2024-09-12T00:21:17.430 INFO:tasks.workunit.client.0.smithi133.stdout: "create_date": "2024-09-12T00:21:17.420235Z", 2024-09-12T00:21:17.430 INFO:tasks.workunit.client.0.smithi133.stdout: "tags": [], 2024-09-12T00:21:17.430 INFO:tasks.workunit.client.0.smithi133.stdout: "group_ids": [] 2024-09-12T00:21:17.430 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:21:17.430 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:21:17.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.429+0000 7f5efdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:17.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.432+0000 7f6049746800 20 remove_watcher() i=0 2024-09-12T00:21:17.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.432+0000 7f6049746800 2 removed watcher, disabling cache 2024-09-12T00:21:17.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.433+0000 7f6049746800 20 remove_watcher() i=1 2024-09-12T00:21:17.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.434+0000 7f6049746800 20 remove_watcher() i=2 2024-09-12T00:21:17.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.435+0000 7f6049746800 20 remove_watcher() i=3 2024-09-12T00:21:17.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.436+0000 7f6049746800 20 remove_watcher() i=4 2024-09-12T00:21:17.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.437+0000 7f6049746800 20 remove_watcher() i=5 2024-09-12T00:21:17.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.438+0000 7f6049746800 20 remove_watcher() i=6 2024-09-12T00:21:17.438 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:17.439+0000 7f6049746800 20 remove_watcher() i=7 2024-09-12T00:21:17.448 INFO:tasks.workunit.client.0.smithi133.stdout:phase 1.1 2024-09-12T00:21:17.470 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:21:17.470 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:21:17.470 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:21:17.470 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:21:17.481 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:17.481 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:18.061 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.INIT (591 ms) 2024-09-12T00:21:18.061 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:21:18.062 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:21:18.062 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:21:18.062 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:21:18.062 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:21:18.072 INFO:tasks.workunit.client.0.smithi133.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T00:21:18.076 INFO:tasks.workunit.client.0.smithi133.stdout:creating: nfsroot:foo/f1 2024-09-12T00:21:18.079 INFO:tasks.workunit.client.0.smithi133.stdout:creating: nfsroot:foo/f2 2024-09-12T00:21:18.082 INFO:tasks.workunit.client.0.smithi133.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T00:21:18.085 INFO:tasks.workunit.client.0.smithi133.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T00:21:18.088 INFO:tasks.workunit.client.0.smithi133.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T00:21:18.091 INFO:tasks.workunit.client.0.smithi133.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T00:21:18.094 INFO:tasks.workunit.client.0.smithi133.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T00:21:18.097 INFO:tasks.workunit.client.0.smithi133.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T00:21:18.100 INFO:tasks.workunit.client.0.smithi133.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T00:21:18.103 INFO:tasks.workunit.client.0.smithi133.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T00:21:18.105 INFO:tasks.workunit.client.0.smithi133.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T00:21:18.109 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SETUP_HIER1 (47 ms) 2024-09-12T00:21:18.109 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:21:18.206 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SETUP_DIRS1 (97 ms) 2024-09-12T00:21:18.207 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:21:18.207 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:21:18.207 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:21:18.221 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (15 ms) 2024-09-12T00:21:18.221 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:21:18.262 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (41 ms) 2024-09-12T00:21:18.262 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:21:18.262 INFO:tasks.workunit.client.0.smithi133.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T00:21:18.269 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-09-12T00:21:18.269 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:21:18.269 INFO:tasks.workunit.client.0.smithi133.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T00:21:18.275 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (5 ms) 2024-09-12T00:21:18.275 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:21:18.275 INFO:tasks.workunit.client.0.smithi133.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:21:18.275 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:21:18.275 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:21:18.275 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:21:18.275 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:21:18.275 INFO:tasks.workunit.client.0.smithi133.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:21:18.275 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:21:18.276 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:21:18.276 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:21:18.276 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:21:18.276 INFO:tasks.workunit.client.0.smithi133.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:21:18.276 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:21:18.276 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:21:18.276 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:21:18.276 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:21:18.276 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (1 ms) 2024-09-12T00:21:18.276 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:21:18.276 INFO:tasks.workunit.client.0.smithi133.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:21:18.276 INFO:tasks.workunit.client.0.smithi133.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:21:18.277 INFO:tasks.workunit.client.0.smithi133.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:21:18.277 INFO:tasks.workunit.client.0.smithi133.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:21:18.277 INFO:tasks.workunit.client.0.smithi133.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:21:18.277 INFO:tasks.workunit.client.0.smithi133.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:21:18.278 INFO:tasks.workunit.client.0.smithi133.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:21:18.279 INFO:tasks.workunit.client.0.smithi133.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:21:18.279 INFO:tasks.workunit.client.0.smithi133.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:21:18.280 INFO:tasks.workunit.client.0.smithi133.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:21:18.280 INFO:tasks.workunit.client.0.smithi133.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:21:18.280 INFO:tasks.workunit.client.0.smithi133.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:21:18.281 INFO:tasks.workunit.client.0.smithi133.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:21:18.282 INFO:tasks.workunit.client.0.smithi133.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:21:18.283 INFO:tasks.workunit.client.0.smithi133.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:21:18.283 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.READ_DIRS1 (8 ms) 2024-09-12T00:21:18.283 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:21:18.456 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.READF_SETUP1 (173 ms) 2024-09-12T00:21:18.456 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:21:18.456 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:21:18.456 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:21:18.456 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:21:18.456 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:21:18.456 INFO:tasks.workunit.client.0.smithi133.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:21:18.456 INFO:tasks.workunit.client.0.smithi133.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:21:18.456 INFO:tasks.workunit.client.0.smithi133.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:21:18.456 INFO:tasks.workunit.client.0.smithi133.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:21:18.457 INFO:tasks.workunit.client.0.smithi133.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:21:18.457 INFO:tasks.workunit.client.0.smithi133.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:21:18.457 INFO:tasks.workunit.client.0.smithi133.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:21:18.457 INFO:tasks.workunit.client.0.smithi133.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:21:18.457 INFO:tasks.workunit.client.0.smithi133.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:21:18.457 INFO:tasks.workunit.client.0.smithi133.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:21:18.457 INFO:tasks.workunit.client.0.smithi133.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:21:18.457 INFO:tasks.workunit.client.0.smithi133.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:21:18.457 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:21:18.457 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:21:18.463 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:21:18.464 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:21:18.466 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:21:18.468 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:21:18.470 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:21:18.471 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:21:18.471 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:21:18.472 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:21:18.473 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:21:18.473 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:21:18.474 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:21:18.475 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:21:18.475 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:21:18.476 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:21:18.476 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:21:18.476 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:21:18.476 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.HIER1 (19 ms) 2024-09-12T00:21:18.476 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:21:18.476 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:21:18.476 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:21:18.476 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:21:18.476 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:21:18.476 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:21:18.476 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:21:18.476 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:21:18.476 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:21:18.477 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:21:18.477 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:21:18.477 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:21:18.477 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:21:18.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:18.477+0000 7fc9fdf278c0 -1 shutting down 2024-09-12T00:21:18.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:18.478+0000 7fc8d5ebd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66570, si_uid : 1000, si_addr0x3e80001040a, si_status0 2024-09-12T00:21:48.421 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SHUTDOWN (29944 ms) 2024-09-12T00:21:48.421 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 24 tests from LibRGW (30950 ms total) 2024-09-12T00:21:48.421 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:21:48.421 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:21:48.421 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 24 tests from 1 test suite ran. (30950 ms total) 2024-09-12T00:21:48.421 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 24 tests. 2024-09-12T00:21:48.427 INFO:tasks.workunit.client.0.smithi133.stdout:phase 1.2 2024-09-12T00:21:48.450 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:21:48.451 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:21:48.451 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:21:48.451 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:21:48.459 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:48.459 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:49.038 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.INIT (587 ms) 2024-09-12T00:21:49.038 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:21:49.040 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:21:49.040 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:21:49.041 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:21:49.041 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:21:49.041 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T00:21:49.041 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:21:49.041 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T00:21:49.041 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:21:49.041 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:21:49.041 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:21:49.041 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:21:49.041 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:21:49.041 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:21:49.041 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:21:49.041 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:21:49.042 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:21:49.042 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:21:49.042 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:21:49.042 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:21:49.042 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:21:49.042 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T00:21:49.042 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:21:49.042 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:21:49.042 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:21:49.042 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:21:49.042 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:21:49.042 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:21:49.042 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:21:49.042 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:21:49.043 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:21:49.043 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T00:21:49.043 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:21:49.043 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:21:49.043 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:21:49.043 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:21:49.043 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:21:49.043 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:21:49.043 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:21:49.043 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:21:49.043 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:21:49.043 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:21:49.043 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:21:49.044 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:21:49.044 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:21:49.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:49.041+0000 7f3d53d3b8c0 -1 shutting down 2024-09-12T00:21:49.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:21:49.042+0000 7f3c2bd3c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67191, si_uid : 1000, si_addr0x3e800010677, si_status0 2024-09-12T00:22:19.182 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SHUTDOWN (30142 ms) 2024-09-12T00:22:19.183 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 24 tests from LibRGW (30731 ms total) 2024-09-12T00:22:19.183 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:22:19.183 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:22:19.183 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 24 tests from 1 test suite ran. (30731 ms total) 2024-09-12T00:22:19.183 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 24 tests. 2024-09-12T00:22:19.188 INFO:tasks.workunit.client.0.smithi133.stdout:phase 1.3 2024-09-12T00:22:19.213 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:22:19.213 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:22:19.213 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:22:19.213 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:22:19.223 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:19.223 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:19.812 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.INIT (599 ms) 2024-09-12T00:22:19.812 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:22:19.813 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:22:19.813 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:22:19.813 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:22:19.813 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:22:19.818 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-09-12T00:22:19.818 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:22:19.878 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SETUP_DIRS1 (59 ms) 2024-09-12T00:22:19.878 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:22:19.878 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:22:19.878 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:22:19.878 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:22:19.878 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:22:19.878 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:22:19.878 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:22:19.878 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:22:19.878 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:22:19.878 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:22:19.879 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:22:19.879 INFO:tasks.workunit.client.0.smithi133.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:22:19.879 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:22:19.879 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:22:19.879 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:22:19.879 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:22:19.879 INFO:tasks.workunit.client.0.smithi133.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:22:19.879 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:22:19.879 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:22:19.879 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:22:19.879 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:22:19.879 INFO:tasks.workunit.client.0.smithi133.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:22:19.879 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:22:19.879 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:22:19.880 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:22:19.880 INFO:tasks.workunit.client.0.smithi133.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:22:19.880 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:22:19.880 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:22:19.880 INFO:tasks.workunit.client.0.smithi133.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:22:19.880 INFO:tasks.workunit.client.0.smithi133.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:22:19.880 INFO:tasks.workunit.client.0.smithi133.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:22:19.880 INFO:tasks.workunit.client.0.smithi133.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:22:19.881 INFO:tasks.workunit.client.0.smithi133.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:22:19.881 INFO:tasks.workunit.client.0.smithi133.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:22:19.881 INFO:tasks.workunit.client.0.smithi133.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:22:19.882 INFO:tasks.workunit.client.0.smithi133.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:22:19.882 INFO:tasks.workunit.client.0.smithi133.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:22:19.884 INFO:tasks.workunit.client.0.smithi133.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:22:19.884 INFO:tasks.workunit.client.0.smithi133.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:22:19.884 INFO:tasks.workunit.client.0.smithi133.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:22:19.885 INFO:tasks.workunit.client.0.smithi133.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:22:19.885 INFO:tasks.workunit.client.0.smithi133.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:22:19.886 INFO:tasks.workunit.client.0.smithi133.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:22:19.886 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.READ_DIRS1 (8 ms) 2024-09-12T00:22:19.886 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:22:19.886 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:22:19.886 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:22:19.886 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:22:19.887 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:22:19.887 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:22:19.887 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:22:19.887 INFO:tasks.workunit.client.0.smithi133.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:22:19.887 INFO:tasks.workunit.client.0.smithi133.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:22:19.887 INFO:tasks.workunit.client.0.smithi133.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:22:19.887 INFO:tasks.workunit.client.0.smithi133.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:22:19.887 INFO:tasks.workunit.client.0.smithi133.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:22:19.887 INFO:tasks.workunit.client.0.smithi133.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:22:19.887 INFO:tasks.workunit.client.0.smithi133.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:22:19.887 INFO:tasks.workunit.client.0.smithi133.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:22:19.887 INFO:tasks.workunit.client.0.smithi133.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:22:19.887 INFO:tasks.workunit.client.0.smithi133.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:22:19.887 INFO:tasks.workunit.client.0.smithi133.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:22:19.887 INFO:tasks.workunit.client.0.smithi133.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:22:19.888 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:22:19.888 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:22:19.893 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:22:19.893 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:22:19.895 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:22:19.896 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:22:19.899 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:22:19.899 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:22:19.900 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:22:19.900 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:22:19.901 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:22:19.901 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:22:19.902 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:22:19.903 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:22:19.904 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:22:19.904 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:22:19.904 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:22:19.904 INFO:tasks.workunit.client.0.smithi133.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:22:19.904 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.HIER1 (17 ms) 2024-09-12T00:22:19.904 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:22:19.904 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:22:19.904 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:22:19.904 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:22:19.904 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:22:19.904 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:22:19.904 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:22:19.904 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:22:19.905 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:22:19.905 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:22:19.905 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:22:19.905 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:22:19.905 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:22:19.905 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:22:19.904+0000 7f507d3528c0 -1 shutting down 2024-09-12T00:22:19.905 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:22:19.905+0000 7f4f57091640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67810, si_uid : 1000, si_addr0x3e8000108e2, si_status0 2024-09-12T00:22:50.062 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SHUTDOWN (30159 ms) 2024-09-12T00:22:50.063 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 24 tests from LibRGW (30849 ms total) 2024-09-12T00:22:50.063 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:22:50.063 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:22:50.063 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 24 tests from 1 test suite ran. (30849 ms total) 2024-09-12T00:22:50.063 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 24 tests. 2024-09-12T00:22:50.068 INFO:tasks.workunit.client.0.smithi133.stdout:phase 2.1 2024-09-12T00:22:50.092 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:22:50.093 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:22:50.093 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:22:50.093 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:22:50.102 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:50.102 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:50.507 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.INIT (414 ms) 2024-09-12T00:22:50.507 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:22:50.508 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:22:50.508 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:22:50.521 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-09-12T00:22:50.521 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:22:50.521 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:22:50.521 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:22:50.527 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave0 2024-09-12T00:22:50.536 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave1 2024-09-12T00:22:50.545 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave2 2024-09-12T00:22:50.553 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave3 2024-09-12T00:22:50.562 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave4 2024-09-12T00:22:50.571 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave5 2024-09-12T00:22:50.580 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave6 2024-09-12T00:22:50.589 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave7 2024-09-12T00:22:50.598 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave8 2024-09-12T00:22:50.606 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave9 2024-09-12T00:22:50.606 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (88 ms) 2024-09-12T00:22:50.606 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:22:50.776 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (170 ms) 2024-09-12T00:22:50.776 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:22:50.776 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:22:50.776 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:22:50.776 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:22:50.776 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:22:50.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:22:50.777+0000 7fa81132b8c0 -1 shutting down 2024-09-12T00:22:50.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:22:50.778+0000 7fa6e92a4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68431, si_uid : 1000, si_addr0x3e800010b4f, si_status0 2024-09-12T00:23:20.882 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SHUTDOWN (30105 ms) 2024-09-12T00:23:20.882 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 9 tests from LibRGW (30788 ms total) 2024-09-12T00:23:20.882 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:23:20.882 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:23:20.882 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 9 tests from 1 test suite ran. (30788 ms total) 2024-09-12T00:23:20.882 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 9 tests. 2024-09-12T00:23:20.887 INFO:tasks.workunit.client.0.smithi133.stdout:phase 2.2 2024-09-12T00:23:20.912 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:23:20.913 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:23:20.913 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:23:20.913 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:23:20.922 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:20.922 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:21.544 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.INIT (631 ms) 2024-09-12T00:23:21.544 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:23:21.545 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:23:21.545 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:23:21.545 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:23:21.545 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:23:21.565 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.DELETE_BUCKET (20 ms) 2024-09-12T00:23:21.565 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:23:21.574 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave0 2024-09-12T00:23:21.583 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave1 2024-09-12T00:23:21.591 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave2 2024-09-12T00:23:21.600 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave3 2024-09-12T00:23:21.610 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave4 2024-09-12T00:23:21.620 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave5 2024-09-12T00:23:21.629 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave6 2024-09-12T00:23:21.638 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave7 2024-09-12T00:23:21.648 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave8 2024-09-12T00:23:21.654 INFO:tasks.workunit.client.0.smithi133.stdout:created: sorrydave9 2024-09-12T00:23:21.655 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (90 ms) 2024-09-12T00:23:21.655 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:23:21.824 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (169 ms) 2024-09-12T00:23:21.824 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:23:21.825 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:23:21.825 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:23:21.825 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:23:21.825 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:23:21.825 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:23:21.825+0000 7fe80f6538c0 -1 shutting down 2024-09-12T00:23:21.825 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:23:21.826+0000 7fe6e9392640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69051, si_uid : 1000, si_addr0x3e800010dbb, si_status0 2024-09-12T00:23:51.936 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SHUTDOWN (30110 ms) 2024-09-12T00:23:51.936 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 9 tests from LibRGW (31022 ms total) 2024-09-12T00:23:51.936 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:23:51.936 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:23:51.936 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 9 tests from 1 test suite ran. (31022 ms total) 2024-09-12T00:23:51.936 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 9 tests. 2024-09-12T00:23:51.941 INFO:tasks.workunit.client.0.smithi133.stdout:phase 3.1 2024-09-12T00:23:52.262 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:23:52.262 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:23:52.262 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:23:52.262 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:23:52.271 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:52.271 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:52.681 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.INIT (420 ms) 2024-09-12T00:23:52.682 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:23:52.682 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:23:52.682 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:23:52.692 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CREATE_BUCKET (9 ms) 2024-09-12T00:23:52.692 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:23:52.695 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T00:23:52.695 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:23:52.696 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-09-12T00:23:52.697 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:23:52.749 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.LARGE1 (52 ms) 2024-09-12T00:23:52.749 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:23:52.797 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.LARGE2 (48 ms) 2024-09-12T00:23:52.797 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:23:52.797 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:23:52.797 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:23:52.798 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:23:52.798 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:23:52.798 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:23:52.798 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:23:52.798 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:23:52.798 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:23:52.798 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:23:52.798 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:23:52.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:23:52.799+0000 7f72311688c0 -1 shutting down 2024-09-12T00:23:52.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:23:52.800+0000 7f7109165640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69670, si_uid : 1000, si_addr0x3e800011026, si_status0 2024-09-12T00:24:22.922 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SHUTDOWN (30124 ms) 2024-09-12T00:24:22.922 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 13 tests from LibRGW (30659 ms total) 2024-09-12T00:24:22.922 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:24:22.922 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:24:22.922 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 13 tests from 1 test suite ran. (30659 ms total) 2024-09-12T00:24:22.922 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 13 tests. 2024-09-12T00:24:22.929 INFO:tasks.workunit.client.0.smithi133.stdout:phase 3.2 2024-09-12T00:24:23.245 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:24:23.254 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:23.254 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:23.630 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.INIT (385 ms) 2024-09-12T00:24:23.631 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:24:23.631 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:24:23.631 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:24:23.631 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:24:23.632 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:24:23.637 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T00:24:23.637 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:24:23.640 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T00:24:23.641 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:24:23.698 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.LARGE1 (57 ms) 2024-09-12T00:24:23.698 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:24:23.698 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T00:24:23.698 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:24:23.698 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:24:23.699 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:24:23.703 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-12T00:24:23.703 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:24:23.721 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.DELETE_BUCKET (18 ms) 2024-09-12T00:24:23.721 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:24:23.721 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:24:23.721 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:24:23.721 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:24:23.721 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:24:23.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:24:23.722+0000 7f95830c38c0 -1 shutting down 2024-09-12T00:24:23.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:24:23.723+0000 7f945a01c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70290, si_uid : 1000, si_addr0x3e800011292, si_status0 2024-09-12T00:24:53.982 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SHUTDOWN (30260 ms) 2024-09-12T00:24:53.982 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 13 tests from LibRGW (30735 ms total) 2024-09-12T00:24:53.982 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:24:53.982 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:24:53.982 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 13 tests from 1 test suite ran. (30735 ms total) 2024-09-12T00:24:53.982 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 13 tests. 2024-09-12T00:24:53.989 INFO:tasks.workunit.client.0.smithi133.stdout:phase 4.1 2024-09-12T00:24:54.013 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:24:54.013 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:24:54.013 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:24:54.014 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:24:54.014 INFO:tasks.workunit.client.0.smithi133.stdout:read i1: 64001 2024-09-12T00:24:54.014 INFO:tasks.workunit.client.0.smithi133.stdout:read s1: blunderbuss 2024-09-12T00:24:54.014 INFO:tasks.workunit.client.0.smithi133.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:24:54.014 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:24:54.024 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:54.025 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:54.407 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.INIT (393 ms) 2024-09-12T00:24:54.407 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:24:54.407 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:24:54.408 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:24:54.425 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (17 ms) 2024-09-12T00:24:54.425 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:24:54.963 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_0 2024-09-12T00:24:54.964 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_1 2024-09-12T00:24:54.964 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_2 2024-09-12T00:24:54.964 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_3 2024-09-12T00:24:54.964 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_4 2024-09-12T00:24:54.964 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_5 2024-09-12T00:24:54.964 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_6 2024-09-12T00:24:54.964 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_7 2024-09-12T00:24:54.964 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_8 2024-09-12T00:24:54.964 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_9 2024-09-12T00:24:54.964 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_10 2024-09-12T00:24:54.964 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_11 2024-09-12T00:24:54.964 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_12 2024-09-12T00:24:54.965 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_13 2024-09-12T00:24:54.965 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_14 2024-09-12T00:24:54.965 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_15 2024-09-12T00:24:54.965 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_16 2024-09-12T00:24:54.965 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_17 2024-09-12T00:24:54.965 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_18 2024-09-12T00:24:54.965 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_19 2024-09-12T00:24:54.965 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_20 2024-09-12T00:24:54.965 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_21 2024-09-12T00:24:54.965 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_22 2024-09-12T00:24:54.965 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_23 2024-09-12T00:24:54.965 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_24 2024-09-12T00:24:54.965 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_25 2024-09-12T00:24:54.966 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_26 2024-09-12T00:24:54.966 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_27 2024-09-12T00:24:54.966 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_28 2024-09-12T00:24:54.966 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_29 2024-09-12T00:24:54.966 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_30 2024-09-12T00:24:54.966 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_31 2024-09-12T00:24:54.966 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_32 2024-09-12T00:24:54.966 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_33 2024-09-12T00:24:54.966 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_34 2024-09-12T00:24:54.966 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_35 2024-09-12T00:24:54.966 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_36 2024-09-12T00:24:54.966 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_37 2024-09-12T00:24:54.966 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_38 2024-09-12T00:24:54.967 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_39 2024-09-12T00:24:54.967 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_40 2024-09-12T00:24:54.967 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_41 2024-09-12T00:24:54.967 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_42 2024-09-12T00:24:54.967 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_43 2024-09-12T00:24:54.967 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_44 2024-09-12T00:24:54.967 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_45 2024-09-12T00:24:54.967 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_46 2024-09-12T00:24:54.967 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_47 2024-09-12T00:24:54.967 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_48 2024-09-12T00:24:54.967 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_49 2024-09-12T00:24:54.967 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_50 2024-09-12T00:24:54.968 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_51 2024-09-12T00:24:54.968 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_52 2024-09-12T00:24:54.968 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_53 2024-09-12T00:24:54.968 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_54 2024-09-12T00:24:54.968 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_55 2024-09-12T00:24:54.968 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_56 2024-09-12T00:24:54.968 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_57 2024-09-12T00:24:54.968 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_58 2024-09-12T00:24:54.968 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_59 2024-09-12T00:24:54.968 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_60 2024-09-12T00:24:54.968 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_61 2024-09-12T00:24:54.968 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_62 2024-09-12T00:24:54.969 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_63 2024-09-12T00:24:54.969 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_64 2024-09-12T00:24:54.969 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_65 2024-09-12T00:24:54.969 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_66 2024-09-12T00:24:54.969 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_67 2024-09-12T00:24:54.969 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_68 2024-09-12T00:24:54.969 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_69 2024-09-12T00:24:54.969 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_70 2024-09-12T00:24:54.969 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_71 2024-09-12T00:24:54.969 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_72 2024-09-12T00:24:54.969 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_73 2024-09-12T00:24:54.969 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_74 2024-09-12T00:24:54.969 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_75 2024-09-12T00:24:54.970 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_76 2024-09-12T00:24:54.970 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_77 2024-09-12T00:24:54.970 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_78 2024-09-12T00:24:54.970 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_79 2024-09-12T00:24:54.970 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_80 2024-09-12T00:24:54.970 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_81 2024-09-12T00:24:54.970 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_82 2024-09-12T00:24:54.970 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_83 2024-09-12T00:24:54.970 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_84 2024-09-12T00:24:54.970 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_85 2024-09-12T00:24:54.970 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_86 2024-09-12T00:24:54.970 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_87 2024-09-12T00:24:54.971 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_88 2024-09-12T00:24:54.971 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_89 2024-09-12T00:24:54.971 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_90 2024-09-12T00:24:54.971 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_91 2024-09-12T00:24:54.971 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_92 2024-09-12T00:24:54.971 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_93 2024-09-12T00:24:54.971 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_94 2024-09-12T00:24:54.971 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_95 2024-09-12T00:24:54.971 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_96 2024-09-12T00:24:54.971 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_97 2024-09-12T00:24:54.971 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_98 2024-09-12T00:24:54.971 INFO:tasks.workunit.client.0.smithi133.stdout:created: dmarker:f_99 2024-09-12T00:24:54.971 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (539 ms) 2024-09-12T00:24:54.971 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:24:54.973 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T00:24:54.973 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T00:24:54.973 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:24:54.973 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:24:54.973 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:24:54.973 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:24:54.973 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:24:54.974 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:24:54.974 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:24:54.974 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:24:54.974 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:24:54.974 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:24:54.974 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:24:54.974 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:24:54.974 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:24:54.974 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:24:54.974 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:24:54.974 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:24:54.974 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:24:54.974 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:24:54.974 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:24:54.975 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:24:54.975 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:24:54.975 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:24:54.975 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:24:54.975 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:24:54.975 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:24:54.975 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:24:54.975 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:24:54.976 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:24:54.976 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:24:54.976 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:24:54.976 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:24:54.976 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:24:54.976 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:24:54.976 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:24:54.976 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:24:54.976 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:24:54.976 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:24:54.976 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:24:54.976 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:24:54.976 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:24:54.977 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:24:54.977 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:24:54.977 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:24:54.977 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:24:54.977 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:24:54.977 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:24:54.977 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:24:54.977 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:24:54.977 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:24:54.977 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:24:54.977 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:24:54.977 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:24:54.977 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:24:54.977 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:24:54.977 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:24:54.978 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:24:54.978 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:24:54.978 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:24:54.978 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:24:54.978 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:24:54.978 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:24:54.978 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:24:54.978 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:24:54.978 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:24:54.978 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:24:54.978 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:24:54.978 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:24:54.978 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:24:54.978 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:24:54.979 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:24:54.979 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:24:54.979 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:24:54.979 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:24:54.979 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:24:54.979 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:24:54.979 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:24:54.979 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:24:54.979 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:24:54.979 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:24:54.979 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:24:54.979 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:24:54.979 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:24:54.979 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:24:54.980 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:24:54.980 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:24:54.980 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:24:54.980 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:24:54.980 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:24:54.980 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:24:54.980 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:24:54.980 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:24:54.980 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:24:54.980 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:24:54.980 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:24:54.980 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:24:54.980 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:24:54.980 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:24:54.981 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:24:54.981 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:24:54.981 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:24:54.981 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_READDIR (3 ms) 2024-09-12T00:24:54.981 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:24:54.981 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:24:54.981 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:24:54.981 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:24:54.981 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:24:54.981 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:24:54.981 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:24:54.981 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:24:54.981 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:24:54.981 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:24:54.982 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:24:54.982 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:24:54.982 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:24:54.982 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:24:54.982 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:24:54.982 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:24:54.982 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:24:54.982 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:24:54.982 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:24:54.982 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:24:54.982 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:24:54.982 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:24:54.982 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:24:54.982 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:24:54.983 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:24:54.984 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:24:54.984 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:24:54.984 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:24:54.984 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:24:54.984 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:24:54.984 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:24:54.984 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:24:54.984 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:24:54.984 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:24:54.984 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:24:54.984 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:24:54.984 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:24:54.984 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:24:54.984 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:24:54.984 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:24:54.985 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:24:54.985 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:24:54.985 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:24:54.985 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:24:54.985 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:24:54.985 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:24:54.985 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:24:54.985 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:24:54.985 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:24:54.985 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:24:54.985 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:24:54.985 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:24:54.985 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:24:54.985 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:24:54.986 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:24:54.987 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:24:54.987 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:24:54.987 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:24:54.987 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:24:54.987 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:24:54.987 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:24:54.987 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:24:54.987 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:24:54.987 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:24:54.987 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:24:54.987 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:24:54.987 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:24:54.987 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:24:54.987 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:24:54.987 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:24:54.988 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:24:54.988 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-12T00:24:54.988 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:24:54.988 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:24:54.988 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:24:54.988 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:24:54.988 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:24:54.988 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:24:54.988 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:24:54.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:24:54.971+0000 7fab852878c0 -1 shutting down 2024-09-12T00:24:54.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:24:54.972+0000 7faa5efc6640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70909, si_uid : 1000, si_addr0x3e8000114fd, si_status0 2024-09-12T00:25:24.804 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SHUTDOWN (29834 ms) 2024-09-12T00:25:24.805 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 11 tests from LibRGW (30789 ms total) 2024-09-12T00:25:24.805 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:25:24.805 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:25:24.805 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 11 tests from 1 test suite ran. (30789 ms total) 2024-09-12T00:25:24.805 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 11 tests. 2024-09-12T00:25:24.810 INFO:tasks.workunit.client.0.smithi133.stdout:phase 4.2 2024-09-12T00:25:24.835 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:25:24.835 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:25:24.835 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:25:24.835 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:25:24.835 INFO:tasks.workunit.client.0.smithi133.stdout:read i1: 64001 2024-09-12T00:25:24.835 INFO:tasks.workunit.client.0.smithi133.stdout:read s1: blunderbuss 2024-09-12T00:25:24.835 INFO:tasks.workunit.client.0.smithi133.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:25:24.835 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:25:24.843 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:24.843 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:25.433 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.INIT (598 ms) 2024-09-12T00:25:25.433 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:25:25.433 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:25:25.433 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:25:25.443 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (9 ms) 2024-09-12T00:25:25.443 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:25:25.443 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:25:25.443 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:25:25.443 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:25:25.443 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:25:25.447 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:25:25.448 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:25:25.448 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:25:25.448 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:25:25.448 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:25:25.448 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:25:25.448 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:25:25.448 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:25:25.448 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:25:25.448 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:25:25.448 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:25:25.448 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:25:25.448 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:25:25.449 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:25:25.449 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:25:25.449 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:25:25.449 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:25:25.449 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:25:25.449 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:25:25.449 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:25:25.449 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:25:25.449 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:25:25.449 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:25:25.449 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:25:25.449 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:25:25.450 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:25:25.450 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:25:25.450 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:25:25.450 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:25:25.450 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:25:25.450 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:25:25.450 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:25:25.450 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:25:25.450 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:25:25.450 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:25:25.450 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:25:25.450 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:25:25.450 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:25:25.450 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:25:25.451 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:25:25.451 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:25:25.451 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:25:25.451 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:25:25.451 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:25:25.451 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:25:25.451 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:25:25.451 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:25:25.451 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:25:25.451 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:25:25.451 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:25:25.451 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:25:25.451 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:25:25.451 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:25:25.451 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:25:25.452 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:25:25.452 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:25:25.452 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:25:25.452 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:25:25.452 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:25:25.452 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:25:25.452 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:25:25.452 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:25:25.452 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:25:25.452 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:25:25.452 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:25:25.452 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:25:25.452 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:25:25.453 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:25:25.453 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:25:25.453 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:25:25.453 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:25:25.453 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:25:25.453 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:25:25.453 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:25:25.453 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:25:25.453 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:25:25.453 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:25:25.453 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:25:25.453 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:25:25.453 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:25:25.453 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:25:25.454 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:25:25.454 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:25:25.454 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:25:25.454 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:25:25.454 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:25:25.454 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:25:25.454 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:25:25.454 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:25:25.454 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:25:25.455 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:25:25.455 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:25:25.455 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:25:25.455 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:25:25.455 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:25:25.455 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:25:25.455 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:25:25.455 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:25:25.455 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:25:25.455 INFO:tasks.workunit.client.0.smithi133.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:25:25.455 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-09-12T00:25:25.455 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:25:25.455 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:25:25.455 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:25:25.456 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:25:25.456 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:25:25.456 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:25:25.456 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:25:25.456 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:25:25.449+0000 7f5820ac58c0 -1 shutting down 2024-09-12T00:25:25.456 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:25:25.450+0000 7f56f7a04640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71529, si_uid : 1000, si_addr0x3e800011769, si_status0 2024-09-12T00:25:55.526 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SHUTDOWN (30078 ms) 2024-09-12T00:25:55.527 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 11 tests from LibRGW (30691 ms total) 2024-09-12T00:25:55.527 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:25:55.527 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:25:55.527 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 11 tests from 1 test suite ran. (30691 ms total) 2024-09-12T00:25:55.527 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 11 tests. 2024-09-12T00:25:55.532 INFO:tasks.workunit.client.0.smithi133.stdout:phase 5.1 2024-09-12T00:25:55.565 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:25:55.565 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:25:55.565 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:25:55.565 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:25:55.575 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:55.575 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:55.951 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.INIT (386 ms) 2024-09-12T00:25:55.951 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:25:55.951 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:25:55.952 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:25:55.961 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-09-12T00:25:55.961 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:25:55.965 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-12T00:25:55.965 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:25:55.965 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:25:55.965 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:25:55.966 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T00:25:55.966 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:25:55.966 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:25:55.966 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:25:55.971 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.PUT_OBJECT (5 ms) 2024-09-12T00:25:55.971 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:25:55.976 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.GET_OBJECT (4 ms) 2024-09-12T00:25:55.976 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:25:55.976 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:25:55.976 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:25:55.976 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:25:55.976 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:25:55.976 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:25:55.977 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:25:55.977 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:25:55.977 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:25:55.977 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:25:55.977 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:25:55.977 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:25:55.977 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:25:55.977 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:25:55.977 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:25:55.977 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:25:55.977 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:25:55.977 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:25:55.977 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:25:55.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:25:55.977+0000 7f1b978308c0 -1 shutting down 2024-09-12T00:25:55.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:25:55.979+0000 7f1a6cf2e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 72148, si_uid : 1000, si_addr0x3e8000119d4, si_status0 2024-09-12T00:26:26.013 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SHUTDOWN (30037 ms) 2024-09-12T00:26:26.014 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 19 tests from LibRGW (30448 ms total) 2024-09-12T00:26:26.014 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:26:26.014 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:26:26.014 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 19 tests from 1 test suite ran. (30448 ms total) 2024-09-12T00:26:26.014 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 19 tests. 2024-09-12T00:26:26.019 INFO:tasks.workunit.client.0.smithi133.stdout:phase 5.2 2024-09-12T00:26:26.052 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:26:26.052 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:26:26.052 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:26:26.052 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:26:26.059 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:26.059 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:26.437 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.INIT (386 ms) 2024-09-12T00:26:26.438 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:26:26.438 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:26:26.438 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:26:26.438 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:26:26.439 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:26:26.444 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T00:26:26.444 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:26:26.444 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:26:26.444 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:26:26.445 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T00:26:26.445 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:26:26.445 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:26:26.445 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:26:26.445 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T00:26:26.445 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:26:26.445 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T00:26:26.445 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:26:26.445 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:26:26.445 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:26:26.445 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:26:26.445 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:26:26.446 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:26:26.446 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:26:26.446 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:26:26.446 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:26:26.446 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:26:26.446 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:26:26.449 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-12T00:26:26.449 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:26:26.468 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.DELETE_BUCKET (18 ms) 2024-09-12T00:26:26.468 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:26:26.468 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:26:26.468 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:26:26.468 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:26:26.468 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:26:26.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:26:26.469+0000 7f207d5228c0 -1 shutting down 2024-09-12T00:26:26.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:26:26.470+0000 7f1f55524640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 72767, si_uid : 1000, si_addr0x3e800011c3f, si_status0 2024-09-12T00:26:56.585 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SHUTDOWN (30117 ms) 2024-09-12T00:26:56.585 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 19 tests from LibRGW (30533 ms total) 2024-09-12T00:26:56.586 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:26:56.586 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:26:56.586 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 19 tests from 1 test suite ran. (30533 ms total) 2024-09-12T00:26:56.586 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 19 tests. 2024-09-12T00:26:56.591 INFO:tasks.workunit.client.0.smithi133.stdout:phase 6.1 2024-09-12T00:26:56.617 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:26:56.617 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment set-up. 2024-09-12T00:26:56.617 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 10 tests from LibRGW 2024-09-12T00:26:56.617 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:26:56.624 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:56.624 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:57.619 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.INIT (1002 ms) 2024-09-12T00:26:57.619 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:26:57.619 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:26:57.619 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T00:26:57.642 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CREATE_BUCKETS (23 ms) 2024-09-12T00:26:57.643 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T00:26:57.650 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (7 ms) 2024-09-12T00:26:57.650 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T00:26:57.670 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.TOPDIR_RENAME (20 ms) 2024-09-12T00:26:57.670 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T00:26:57.693 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SUBDIR_RENAME (23 ms) 2024-09-12T00:26:57.693 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T00:26:57.716 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (23 ms) 2024-09-12T00:26:57.716 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:26:57.716 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:26:57.716 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:26:57.716 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:26:57.716 INFO:tasks.workunit.client.0.smithi133.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:26:57.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:26:57.716+0000 7f380a4318c0 -1 shutting down 2024-09-12T00:26:57.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:26:57.717+0000 7f36df90f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 73386, si_uid : 1000, si_addr0x3e800011eaa, si_status0 2024-09-12T00:27:27.896 INFO:tasks.workunit.client.0.smithi133.stdout:[ OK ] LibRGW.SHUTDOWN (30179 ms) 2024-09-12T00:27:27.896 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] 10 tests from LibRGW (31278 ms total) 2024-09-12T00:27:27.896 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:27:27.896 INFO:tasks.workunit.client.0.smithi133.stdout:[----------] Global test environment tear-down 2024-09-12T00:27:27.896 INFO:tasks.workunit.client.0.smithi133.stdout:[==========] 10 tests from 1 test suite ran. (31278 ms total) 2024-09-12T00:27:27.897 INFO:tasks.workunit.client.0.smithi133.stdout:[ PASSED ] 10 tests. 2024-09-12T00:27:27.902 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:27:27.903 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:27:27.947 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T00:27:27.949 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T00:27:27.949 DEBUG:teuthology.orchestra.run.smithi133:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T00:27:28.024 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -z ']' 2024-09-12T00:27:28.024 INFO:tasks.workunit.client.0.smithi133.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:27:28.024 INFO:tasks.workunit.client.0.smithi133.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:27:28.024 INFO:tasks.workunit.client.0.smithi133.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:27:28.024 INFO:tasks.workunit.client.0.smithi133.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:27:28.024 INFO:tasks.workunit.client.0.smithi133.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-12T00:27:28.062 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:28.062 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:28.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.103+0000 7fcbec80f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:28.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.104+0000 7fcbec80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:28.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.104+0000 7fcbec80f800 20 realm 2024-09-12T00:27:28.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.104+0000 7fcbec80f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:28.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.105+0000 7fcbec80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:28.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.105+0000 7fcbec80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:28.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.105+0000 7fcbec80f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:28.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.105+0000 7fcbec80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:28.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.105+0000 7fcbec80f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:28.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.106+0000 7fcbec80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:28.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.106+0000 7fcbec80f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:28.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.107+0000 7fcbec80f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:28.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.107+0000 7fcbec80f800 20 searching for the correct realm 2024-09-12T00:27:28.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.110+0000 7fcbeaafa640 0 -- 172.21.15.133:0/1132298085 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x562176434cd0 msgr2=0x5621764370e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:28.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.113+0000 7fcbe9af8640 0 -- 172.21.15.133:0/1132298085 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fcbdc031450 msgr2=0x7fcbdc0318d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:28.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.320+0000 7fcbec80f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:27:28.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.320+0000 7fcbec80f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:27:28.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.320+0000 7fcbec80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:28.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.320+0000 7fcbec80f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:28.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.320+0000 7fcbec80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:28.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.320+0000 7fcbec80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:28.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.320+0000 7fcbec80f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:28.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.321+0000 7fcbec80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:28.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.321+0000 7fcbec80f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:28.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.321+0000 7fcbec80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:28.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.321+0000 7fcbec80f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:28.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.321+0000 7fcbec80f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:28.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.321+0000 7fcbec80f800 20 zone default found 2024-09-12T00:27:28.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.321+0000 7fcbec80f800 4 Realm: () 2024-09-12T00:27:28.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.321+0000 7fcbec80f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:27:28.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.321+0000 7fcbec80f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:27:28.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.321+0000 7fcbec80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:28.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.321+0000 7fcbec80f800 20 zonegroup default 2024-09-12T00:27:28.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.321+0000 7fcbec80f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:28.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.322+0000 7fcbec80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:28.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.322+0000 7fcbec80f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:28.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.322+0000 7fcbec80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:28.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.322+0000 7fcbec80f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:28.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.322+0000 7fcbec80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:28.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.322+0000 7fcbec80f800 20 started sync module instance, tier type = 2024-09-12T00:27:28.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.322+0000 7fcbec80f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:27:28.330 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.332+0000 7fcbec80f800 20 add_watcher() i=0 2024-09-12T00:27:28.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.332+0000 7fcbec80f800 20 add_watcher() i=1 2024-09-12T00:27:28.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.332+0000 7fcbec80f800 20 add_watcher() i=2 2024-09-12T00:27:28.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.332+0000 7fcbec80f800 20 add_watcher() i=3 2024-09-12T00:27:28.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.332+0000 7fcbec80f800 20 add_watcher() i=4 2024-09-12T00:27:28.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.332+0000 7fcbec80f800 20 add_watcher() i=5 2024-09-12T00:27:28.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.332+0000 7fcbec80f800 20 add_watcher() i=6 2024-09-12T00:27:28.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.333+0000 7fcbec80f800 20 add_watcher() i=7 2024-09-12T00:27:28.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.333+0000 7fcbec80f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:28.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.335+0000 7fcaa0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:28.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.336+0000 7fcbec80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:28.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.336+0000 7fcbec80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:28.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.336+0000 7fcbec80f800 5 note: GC not initialized 2024-09-12T00:27:28.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.336+0000 7fca1b7fe640 20 reqs_thread_entry: start 2024-09-12T00:27:28.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.336+0000 7fcbec80f800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:28.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.336+0000 7fcbec80f800 20 Filter name: none 2024-09-12T00:27:28.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.336+0000 7fca197fa640 20 reqs_thread_entry: start 2024-09-12T00:27:28.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.336+0000 7fcbec80f800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T00:27:28.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.336+0000 7fcbec80f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:28.336 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.337+0000 7fcbec80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:28.336 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.337+0000 7fcbec80f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T00:27:28.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.337+0000 7fcbec80f800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:27:28.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.337+0000 7fcbec80f800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T00:27:28.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.337+0000 7fcbec80f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:28.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.337+0000 7fcbec80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:28.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.337+0000 7fcbec80f800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T00:27:28.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.337+0000 7fcbec80f800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:27:28.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.337+0000 7fcbec80f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T00:27:28.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.337+0000 7fcbec80f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:28.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.338+0000 7fcbec80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:28.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.338+0000 7fcbec80f800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T00:27:28.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.338+0000 7fcbec80f800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:27:28.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.338+0000 7fcbec80f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:27:28.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.338+0000 7fcbec80f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:27:28.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.339+0000 7fcbec80f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:27:28.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.339+0000 7fcbec80f800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:27:28.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.339+0000 7fcbec80f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T00:27:28.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.340+0000 7fcacdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791324 cookie 94701718069216 notifier 5594 bl.length()=677 2024-09-12T00:27:28.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.340+0000 7fcacdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:27:28.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.340+0000 7fcacdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:27:28.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.343+0000 7fcbec80f800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:27:28.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.343+0000 7fcbec80f800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:27:28.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.343+0000 7fcbec80f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T00:27:28.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.343+0000 7fcacdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791351 cookie 94701718051952 notifier 5594 bl.length()=187 2024-09-12T00:27:28.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.343+0000 7fcacdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:27:28.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.343+0000 7fcacdffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:27:28.344 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.346+0000 7fcbec80f800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:27:28.344 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.346+0000 7fcbec80f800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:27:28.344 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.346+0000 7fcbec80f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T00:27:28.344 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.346+0000 7fcacdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791352 cookie 94701718051952 notifier 5594 bl.length()=197 2024-09-12T00:27:28.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.346+0000 7fcacdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:27:28.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.346+0000 7fcacdffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:27:28.345 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:27:28.345 INFO:tasks.workunit.client.0.smithi133.stdout: "user_id": "ceph-test-maven", 2024-09-12T00:27:28.345 INFO:tasks.workunit.client.0.smithi133.stdout: "display_name": "maven test user", 2024-09-12T00:27:28.346 INFO:tasks.workunit.client.0.smithi133.stdout: "email": "sigv4@example.com", 2024-09-12T00:27:28.346 INFO:tasks.workunit.client.0.smithi133.stdout: "suspended": 0, 2024-09-12T00:27:28.346 INFO:tasks.workunit.client.0.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:27:28.346 INFO:tasks.workunit.client.0.smithi133.stdout: "subusers": [], 2024-09-12T00:27:28.346 INFO:tasks.workunit.client.0.smithi133.stdout: "keys": [ 2024-09-12T00:27:28.346 INFO:tasks.workunit.client.0.smithi133.stdout: { 2024-09-12T00:27:28.346 INFO:tasks.workunit.client.0.smithi133.stdout: "user": "ceph-test-maven", 2024-09-12T00:27:28.346 INFO:tasks.workunit.client.0.smithi133.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T00:27:28.346 INFO:tasks.workunit.client.0.smithi133.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T00:27:28.346 INFO:tasks.workunit.client.0.smithi133.stdout: "active": true, 2024-09-12T00:27:28.346 INFO:tasks.workunit.client.0.smithi133.stdout: "create_date": "2024-09-12T00:27:28.339046Z" 2024-09-12T00:27:28.347 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:27:28.347 INFO:tasks.workunit.client.0.smithi133.stdout: ], 2024-09-12T00:27:28.347 INFO:tasks.workunit.client.0.smithi133.stdout: "swift_keys": [], 2024-09-12T00:27:28.347 INFO:tasks.workunit.client.0.smithi133.stdout: "caps": [], 2024-09-12T00:27:28.347 INFO:tasks.workunit.client.0.smithi133.stdout: "op_mask": "read, write, delete", 2024-09-12T00:27:28.347 INFO:tasks.workunit.client.0.smithi133.stdout: "default_placement": "", 2024-09-12T00:27:28.347 INFO:tasks.workunit.client.0.smithi133.stdout: "default_storage_class": "", 2024-09-12T00:27:28.347 INFO:tasks.workunit.client.0.smithi133.stdout: "placement_tags": [], 2024-09-12T00:27:28.347 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_quota": { 2024-09-12T00:27:28.347 INFO:tasks.workunit.client.0.smithi133.stdout: "enabled": false, 2024-09-12T00:27:28.347 INFO:tasks.workunit.client.0.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:27:28.347 INFO:tasks.workunit.client.0.smithi133.stdout: "max_size": -1, 2024-09-12T00:27:28.348 INFO:tasks.workunit.client.0.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:27:28.348 INFO:tasks.workunit.client.0.smithi133.stdout: "max_objects": -1 2024-09-12T00:27:28.348 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:27:28.348 INFO:tasks.workunit.client.0.smithi133.stdout: "user_quota": { 2024-09-12T00:27:28.348 INFO:tasks.workunit.client.0.smithi133.stdout: "enabled": false, 2024-09-12T00:27:28.348 INFO:tasks.workunit.client.0.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:27:28.348 INFO:tasks.workunit.client.0.smithi133.stdout: "max_size": -1, 2024-09-12T00:27:28.348 INFO:tasks.workunit.client.0.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:27:28.349 INFO:tasks.workunit.client.0.smithi133.stdout: "max_objects": -1 2024-09-12T00:27:28.349 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:27:28.351 INFO:tasks.workunit.client.0.smithi133.stdout: "temp_url_keys": [], 2024-09-12T00:27:28.351 INFO:tasks.workunit.client.0.smithi133.stdout: "type": "rgw", 2024-09-12T00:27:28.351 INFO:tasks.workunit.client.0.smithi133.stdout: "mfa_ids": [], 2024-09-12T00:27:28.351 INFO:tasks.workunit.client.0.smithi133.stdout: "account_id": "", 2024-09-12T00:27:28.351 INFO:tasks.workunit.client.0.smithi133.stdout: "path": "/", 2024-09-12T00:27:28.351 INFO:tasks.workunit.client.0.smithi133.stdout: "create_date": "2024-09-12T00:27:28.339033Z", 2024-09-12T00:27:28.351 INFO:tasks.workunit.client.0.smithi133.stdout: "tags": [], 2024-09-12T00:27:28.351 INFO:tasks.workunit.client.0.smithi133.stdout: "group_ids": [] 2024-09-12T00:27:28.351 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:27:28.351 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:27:28.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.348+0000 7fcaa0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:28.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.350+0000 7fcbec80f800 20 remove_watcher() i=0 2024-09-12T00:27:28.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.350+0000 7fcbec80f800 2 removed watcher, disabling cache 2024-09-12T00:27:28.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.351+0000 7fcbec80f800 20 remove_watcher() i=1 2024-09-12T00:27:28.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.352+0000 7fcbec80f800 20 remove_watcher() i=2 2024-09-12T00:27:28.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.353+0000 7fcbec80f800 20 remove_watcher() i=3 2024-09-12T00:27:28.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.354+0000 7fcbec80f800 20 remove_watcher() i=4 2024-09-12T00:27:28.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.355+0000 7fcbec80f800 20 remove_watcher() i=5 2024-09-12T00:27:28.355 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.357+0000 7fcbec80f800 20 remove_watcher() i=6 2024-09-12T00:27:28.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:27:28.358+0000 7fcbec80f800 20 remove_watcher() i=7 2024-09-12T00:27:28.366 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -z ']' 2024-09-12T00:27:28.367 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-12T00:27:28.367 INFO:tasks.workunit.client.0.smithi133.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-12T00:27:28.367 INFO:tasks.workunit.client.0.smithi133.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi133.front.sepia.ceph.com:80 2024-09-12T00:27:28.368 INFO:tasks.workunit.client.0.smithi133.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi133.front.sepia.ceph.com:80 2024-09-12T00:27:28.368 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-12T00:27:28.368 INFO:tasks.workunit.client.0.smithi133.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T00:27:28.368 INFO:tasks.workunit.client.0.smithi133.stderr:+ ./mvnw clean package 2024-09-12T00:27:28.380 INFO:tasks.workunit.client.0.smithi133.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:27:29.861 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Scanning for projects... 2024-09-12T00:27:29.969 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T00:27:30.049 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 67 kB/s) 2024-09-12T00:27:30.060 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T00:27:30.101 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 32/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.0 MB/s) 2024-09-12T00:27:30.107 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T00:27:30.138 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/77 kB Progress (1): 32/77 kB Progress (1): 49/77 kB Progress (1): 65/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 2.5 MB/s) 2024-09-12T00:27:30.159 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:27:30.159 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:27:30.159 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:27:30.159 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] from pom.xml 2024-09-12T00:27:30.159 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:27:30.161 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T00:27:30.182 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 253 kB/s) 2024-09-12T00:27:30.188 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T00:27:30.204 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-12T00:27:30.207 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T00:27:30.223 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-09-12T00:27:30.228 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T00:27:30.243 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.3 MB/s) 2024-09-12T00:27:30.254 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T00:27:30.271 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.1 MB/s) 2024-09-12T00:27:30.278 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T00:27:30.295 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 510 kB/s) 2024-09-12T00:27:30.297 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T00:27:30.314 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 506 kB/s) 2024-09-12T00:27:30.316 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T00:27:30.333 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/48 kB Progress (1): 32/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.7 MB/s) 2024-09-12T00:27:30.337 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T00:27:30.353 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.2 MB/s) 2024-09-12T00:27:30.358 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T00:27:30.377 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.6 MB/s) 2024-09-12T00:27:30.381 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T00:27:30.398 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 577 kB/s) 2024-09-12T00:27:30.404 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T00:27:30.422 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.9 MB/s) 2024-09-12T00:27:30.427 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T00:27:30.448 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 253 kB/s) 2024-09-12T00:27:30.451 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T00:27:30.468 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.3 MB/s) 2024-09-12T00:27:30.471 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T00:27:30.494 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 15/50 kB Progress (1): 18/50 kB Progress (1): 22/50 kB Progress (1): 26/50 kB Progress (1): 30/50 kB Progress (1): 34/50 kB Progress (1): 38/50 kB Progress (1): 41/50 kB Progress (1): 45/50 kB Progress (1): 48/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.2 MB/s) 2024-09-12T00:27:30.499 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T00:27:30.518 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 15/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.2 MB/s) 2024-09-12T00:27:30.526 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T00:27:30.543 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 352 kB/s) 2024-09-12T00:27:30.548 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T00:27:30.571 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 1.8 MB/s) 2024-09-12T00:27:30.579 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T00:27:30.598 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 338 kB/s) 2024-09-12T00:27:30.601 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T00:27:30.620 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 521 kB/s) 2024-09-12T00:27:30.622 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T00:27:30.639 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/46 kB Progress (1): 32/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.7 MB/s) 2024-09-12T00:27:30.644 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T00:27:30.659 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-09-12T00:27:30.664 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T00:27:30.681 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.6 MB/s) 2024-09-12T00:27:30.694 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T00:27:30.711 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 358 kB/s) 2024-09-12T00:27:30.713 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T00:27:30.732 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.1 MB/s) 2024-09-12T00:27:30.736 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T00:27:30.754 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.2 MB/s) 2024-09-12T00:27:30.761 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T00:27:30.777 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 236 kB/s) 2024-09-12T00:27:30.779 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T00:27:30.796 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 91 kB/s) 2024-09-12T00:27:30.798 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T00:27:30.814 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 139 kB/s) 2024-09-12T00:27:30.818 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T00:27:30.835 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 214 kB/s) 2024-09-12T00:27:30.839 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T00:27:30.857 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 179 kB/s) 2024-09-12T00:27:30.861 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T00:27:30.878 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 645 kB/s) 2024-09-12T00:27:30.882 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T00:27:30.897 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 105 kB/s) 2024-09-12T00:27:30.901 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T00:27:30.918 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 212 kB/s) 2024-09-12T00:27:30.922 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T00:27:30.938 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 289 kB/s) 2024-09-12T00:27:30.941 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T00:27:30.959 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 68 kB/s) 2024-09-12T00:27:30.961 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T00:27:30.976 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 240 kB/s) 2024-09-12T00:27:30.978 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T00:27:30.992 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 920 kB/s) 2024-09-12T00:27:30.995 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T00:27:31.011 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 245 kB/s) 2024-09-12T00:27:31.014 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T00:27:31.030 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 163 kB/s) 2024-09-12T00:27:31.033 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T00:27:31.048 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 194 kB/s) 2024-09-12T00:27:31.051 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T00:27:31.068 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 436 kB/s) 2024-09-12T00:27:31.072 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T00:27:31.087 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 341 kB/s) 2024-09-12T00:27:31.090 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T00:27:31.105 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 233 kB/s) 2024-09-12T00:27:31.110 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T00:27:31.128 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 258 kB/s) 2024-09-12T00:27:31.129 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T00:27:31.146 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 150 kB/s) 2024-09-12T00:27:31.149 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T00:27:31.164 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 402 kB/s) 2024-09-12T00:27:31.168 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T00:27:31.184 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 379 kB/s) 2024-09-12T00:27:31.188 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T00:27:31.205 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 165 kB/s) 2024-09-12T00:27:31.209 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T00:27:31.226 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 204 kB/s) 2024-09-12T00:27:31.230 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T00:27:31.245 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 272 kB/s) 2024-09-12T00:27:31.246 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T00:27:31.262 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 111 kB/s) 2024-09-12T00:27:31.265 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T00:27:31.280 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 441 kB/s) 2024-09-12T00:27:31.282 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T00:27:31.296 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.1 MB/s) 2024-09-12T00:27:31.299 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T00:27:31.314 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.2 MB/s) 2024-09-12T00:27:31.317 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T00:27:31.331 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-12T00:27:31.335 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T00:27:31.349 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 355 kB/s) 2024-09-12T00:27:31.352 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T00:27:31.368 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 878 kB/s) 2024-09-12T00:27:31.370 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T00:27:31.386 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 822 kB/s) 2024-09-12T00:27:31.388 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T00:27:31.405 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/68 kB Progress (1): 32/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.0 MB/s) 2024-09-12T00:27:31.410 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T00:27:31.425 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.0 MB/s) 2024-09-12T00:27:31.429 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T00:27:31.443 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-12T00:27:31.445 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T00:27:31.461 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-12T00:27:31.464 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T00:27:31.479 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.3 MB/s) 2024-09-12T00:27:31.482 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T00:27:31.498 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.2 MB/s) 2024-09-12T00:27:31.501 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T00:27:31.524 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.2 MB/s) 2024-09-12T00:27:31.529 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T00:27:31.545 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 240 kB/s) 2024-09-12T00:27:31.547 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T00:27:31.562 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-12T00:27:31.564 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T00:27:31.581 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-12T00:27:31.583 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T00:27:31.601 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 177 kB/s) 2024-09-12T00:27:31.602 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T00:27:31.620 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 120 kB/s) 2024-09-12T00:27:31.622 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T00:27:31.637 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 177 kB/s) 2024-09-12T00:27:31.640 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T00:27:31.667 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 54 kB/s) 2024-09-12T00:27:31.669 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T00:27:31.687 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 177 kB/s) 2024-09-12T00:27:31.689 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T00:27:31.704 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T00:27:31.706 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T00:27:31.726 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 153 kB/s) 2024-09-12T00:27:31.729 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T00:27:31.748 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 54 kB/s) 2024-09-12T00:27:31.751 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T00:27:31.766 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 69 kB/s) 2024-09-12T00:27:31.768 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T00:27:31.785 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 191 kB/s) 2024-09-12T00:27:31.787 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T00:27:31.808 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 138 kB/s) 2024-09-12T00:27:31.810 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T00:27:31.828 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-12T00:27:31.831 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T00:27:31.861 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 111 kB/s) 2024-09-12T00:27:31.864 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T00:27:31.887 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 126 kB/s) 2024-09-12T00:27:31.910 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T00:27:32.005 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 35 MB/s) 2024-09-12T00:27:32.006 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T00:27:32.006 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T00:27:32.007 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T00:27:32.007 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T00:27:32.007 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T00:27:32.025 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 2.0 MB/s) 2024-09-12T00:27:32.025 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T00:27:32.042 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 446 kB/s) 2024-09-12T00:27:32.042 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T00:27:32.053 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (1): 5.5/16 kB Progress (1): 6.9/16 kB Progress (1): 8.3/16 kB Progress (1): 9.7/16 kB Progress (1): 11/16 kB Progress (1): 12/16 kB Progress (1): 14/16 kB Progress (1): 15/16 kB Progress (1): 16 kB Progress (2): 16 kB | 1.4/49 kB Progress (2): 16 kB | 2.8/49 kB Progress (2): 16 kB | 4.1/49 kB Progress (2): 16 kB | 5.5/49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 359 kB/s) 2024-09-12T00:27:32.053 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.9/49 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T00:27:32.065 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 6.9/49 kB | 16/71 kB Progress (2): 8.3/49 kB | 16/71 kB Progress (2): 9.7/49 kB | 16/71 kB Progress (2): 11/49 kB | 16/71 kB Progress (2): 12/49 kB | 16/71 kB Progress (2): 14/49 kB | 16/71 kB Progress (2): 15/49 kB | 16/71 kB Progress (2): 16/49 kB | 16/71 kB Progress (2): 17/49 kB | 16/71 kB Progress (2): 19/49 kB | 16/71 kB Progress (2): 20/49 kB | 16/71 kB Progress (2): 21/49 kB | 16/71 kB Progress (2): 23/49 kB | 16/71 kB Progress (2): 24/49 kB | 16/71 kB Progress (2): 25/49 kB | 16/71 kB Progress (2): 27/49 kB | 16/71 kB Progress (2): 28/49 kB | 16/71 kB Progress (2): 30/49 kB | 16/71 kB Progress (3): 30/49 kB | 16/71 kB | 16/98 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 16/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 33/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 49/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 66/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 82/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 98/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 115/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 131/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 147/782 kB Progress (4): 30/49 kB | 16/71 kB | 16/98 kB | 164/782 kB Progress (4): 30/49 kB | 33/71 kB | 16/98 kB | 164/782 kB Progress (4): 31/49 kB | 33/71 kB | 16/98 kB | 164/782 kB Progress (4): 31/49 kB | 33/71 kB | 16/98 kB | 180/782 kB Progress (4): 32/49 kB | 33/71 kB | 16/98 kB | 180/782 kB Progress (4): 34/49 kB | 33/71 kB | 16/98 kB | 180/782 kB Progress (4): 35/49 kB | 33/71 kB | 16/98 kB | 180/782 kB Progress (4): 36/49 kB | 33/71 kB | 16/98 kB | 180/782 kB Progress (4): 38/49 kB | 33/71 kB | 16/98 kB | 180/782 kB Progress (4): 38/49 kB | 33/71 kB | 16/98 kB | 197/782 kB Progress (4): 39/49 kB | 33/71 kB | 16/98 kB | 197/782 kB Progress (4): 41/49 kB | 33/71 kB | 16/98 kB | 197/782 kB Progress (4): 42/49 kB | 33/71 kB | 16/98 kB | 197/782 kB Progress (4): 43/49 kB | 33/71 kB | 16/98 kB | 197/782 kB Progress (4): 43/49 kB | 33/71 kB | 16/98 kB | 213/782 kB Progress (4): 45/49 kB | 33/71 kB | 16/98 kB | 213/782 kB Progress (4): 45/49 kB | 33/71 kB | 16/98 kB | 229/782 kB Progress (4): 45/49 kB | 33/71 kB | 33/98 kB | 229/782 kB Progress (4): 45/49 kB | 33/71 kB | 33/98 kB | 246/782 kB Progress (4): 46/49 kB | 33/71 kB | 33/98 kB | 246/782 kB Progress (4): 48/49 kB | 33/71 kB | 33/98 kB | 246/782 kB Progress (4): 49/49 kB | 33/71 kB | 33/98 kB | 246/782 kB Progress (4): 49 kB | 33/71 kB | 33/98 kB | 246/782 kB Progress (4): 49 kB | 33/71 kB | 33/98 kB | 262/782 kB Progress (4): 49 kB | 33/71 kB | 33/98 kB | 279/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 849 kB/s) 2024-09-12T00:27:32.065 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (3): 49/71 kB | 33/98 kB | 279/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T00:27:32.068 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (3): 49/71 kB | 33/98 kB | 295/782 kB Progress (3): 49/71 kB | 33/98 kB | 311/782 kB Progress (3): 49/71 kB | 33/98 kB | 328/782 kB Progress (4): 49/71 kB | 33/98 kB | 328/782 kB | 1.4/11 kB Progress (4): 49/71 kB | 33/98 kB | 344/782 kB | 1.4/11 kB Progress (4): 49/71 kB | 33/98 kB | 344/782 kB | 2.8/11 kB Progress (4): 49/71 kB | 33/98 kB | 344/782 kB | 4.1/11 kB Progress (4): 49/71 kB | 33/98 kB | 360/782 kB | 4.1/11 kB Progress (4): 49/71 kB | 33/98 kB | 377/782 kB | 4.1/11 kB Progress (4): 49/71 kB | 33/98 kB | 377/782 kB | 5.5/11 kB Progress (4): 49/71 kB | 33/98 kB | 377/782 kB | 6.9/11 kB Progress (4): 49/71 kB | 33/98 kB | 393/782 kB | 6.9/11 kB Progress (4): 49/71 kB | 33/98 kB | 393/782 kB | 8.3/11 kB Progress (4): 49/71 kB | 49/98 kB | 393/782 kB | 8.3/11 kB Progress (4): 49/71 kB | 49/98 kB | 393/782 kB | 9.7/11 kB Progress (4): 49/71 kB | 49/98 kB | 410/782 kB | 9.7/11 kB Progress (4): 49/71 kB | 49/98 kB | 426/782 kB | 9.7/11 kB Progress (4): 49/71 kB | 49/98 kB | 426/782 kB | 11/11 kB Progress (4): 49/71 kB | 49/98 kB | 442/782 kB | 11/11 kB Progress (4): 49/71 kB | 49/98 kB | 442/782 kB | 11 kB Progress (4): 49/71 kB | 49/98 kB | 459/782 kB | 11 kB Progress (4): 49/71 kB | 49/98 kB | 475/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 189 kB/s) 2024-09-12T00:27:32.068 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (3): 49/71 kB | 49/98 kB | 492/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T00:27:32.074 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (3): 49/71 kB | 49/98 kB | 508/782 kB Progress (3): 49/71 kB | 49/98 kB | 524/782 kB Progress (3): 49/71 kB | 49/98 kB | 541/782 kB Progress (3): 49/71 kB | 49/98 kB | 557/782 kB Progress (3): 49/71 kB | 49/98 kB | 573/782 kB Progress (3): 49/71 kB | 49/98 kB | 585/782 kB Progress (3): 49/71 kB | 49/98 kB | 601/782 kB Progress (3): 49/71 kB | 49/98 kB | 617/782 kB Progress (3): 49/71 kB | 49/98 kB | 634/782 kB Progress (3): 49/71 kB | 49/98 kB | 650/782 kB Progress (3): 49/71 kB | 49/98 kB | 667/782 kB Progress (3): 49/71 kB | 49/98 kB | 683/782 kB Progress (3): 49/71 kB | 49/98 kB | 699/782 kB Progress (3): 65/71 kB | 49/98 kB | 699/782 kB Progress (3): 71 kB | 49/98 kB | 699/782 kB Progress (3): 71 kB | 49/98 kB | 716/782 kB Progress (3): 71 kB | 49/98 kB | 732/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.0 MB/s) 2024-09-12T00:27:32.074 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T00:27:32.076 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 49/98 kB | 749/782 kB Progress (2): 49/98 kB | 765/782 kB Progress (2): 66/98 kB | 765/782 kB Progress (2): 66/98 kB | 781/782 kB Progress (2): 66/98 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-12T00:27:32.076 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T00:27:32.080 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 82/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.3 MB/s) 2024-09-12T00:27:32.080 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T00:27:32.089 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.4/30 kB Progress (1): 2.8/30 kB Progress (2): 2.8/30 kB | 16/205 kB Progress (2): 4.1/30 kB | 16/205 kB Progress (2): 5.5/30 kB | 16/205 kB Progress (2): 6.9/30 kB | 16/205 kB Progress (2): 8.3/30 kB | 16/205 kB Progress (2): 9.7/30 kB | 16/205 kB Progress (2): 11/30 kB | 16/205 kB Progress (2): 12/30 kB | 16/205 kB Progress (2): 14/30 kB | 16/205 kB Progress (2): 14/30 kB | 32/205 kB Progress (2): 15/30 kB | 32/205 kB Progress (2): 17/30 kB | 32/205 kB Progress (2): 18/30 kB | 32/205 kB Progress (2): 19/30 kB | 32/205 kB Progress (2): 21/30 kB | 32/205 kB Progress (2): 21/30 kB | 49/205 kB Progress (2): 22/30 kB | 49/205 kB Progress (2): 23/30 kB | 49/205 kB Progress (2): 25/30 kB | 49/205 kB Progress (2): 26/30 kB | 49/205 kB Progress (2): 28/30 kB | 49/205 kB Progress (2): 29/30 kB | 49/205 kB Progress (2): 30 kB | 49/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 373 kB/s) 2024-09-12T00:27:32.089 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T00:27:32.096 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 49/205 kB | 16/81 kB Progress (2): 49/205 kB | 33/81 kB Progress (2): 49/205 kB | 49/81 kB Progress (3): 49/205 kB | 49/81 kB | 16/798 kB Progress (3): 49/205 kB | 49/81 kB | 33/798 kB Progress (3): 49/205 kB | 66/81 kB | 33/798 kB Progress (3): 49/205 kB | 66/81 kB | 49/798 kB Progress (3): 49/205 kB | 66/81 kB | 66/798 kB Progress (3): 65/205 kB | 66/81 kB | 66/798 kB Progress (4): 65/205 kB | 66/81 kB | 66/798 kB | 13 kB Progress (4): 65/205 kB | 66/81 kB | 82/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 152 kB/s) 2024-09-12T00:27:32.096 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (3): 65/205 kB | 66/81 kB | 98/798 kB Progress (3): 81/205 kB | 66/81 kB | 98/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T00:27:32.102 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (3): 81/205 kB | 66/81 kB | 115/798 kB Progress (3): 81/205 kB | 66/81 kB | 131/798 kB Progress (3): 98/205 kB | 66/81 kB | 131/798 kB Progress (3): 98/205 kB | 66/81 kB | 147/798 kB Progress (3): 98/205 kB | 66/81 kB | 164/798 kB Progress (3): 98/205 kB | 66/81 kB | 180/798 kB Progress (3): 114/205 kB | 66/81 kB | 180/798 kB Progress (3): 114/205 kB | 66/81 kB | 197/798 kB Progress (3): 114/205 kB | 66/81 kB | 213/798 kB Progress (3): 130/205 kB | 66/81 kB | 213/798 kB Progress (3): 130/205 kB | 66/81 kB | 229/798 kB Progress (3): 130/205 kB | 66/81 kB | 246/798 kB Progress (3): 130/205 kB | 66/81 kB | 256/798 kB Progress (3): 147/205 kB | 66/81 kB | 256/798 kB Progress (3): 147/205 kB | 66/81 kB | 272/798 kB Progress (3): 147/205 kB | 66/81 kB | 289/798 kB Progress (3): 147/205 kB | 66/81 kB | 305/798 kB Progress (3): 163/205 kB | 66/81 kB | 305/798 kB Progress (3): 163/205 kB | 66/81 kB | 321/798 kB Progress (3): 180/205 kB | 66/81 kB | 321/798 kB Progress (3): 180/205 kB | 81 kB | 321/798 kB Progress (3): 180/205 kB | 81 kB | 338/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 864 kB/s) 2024-09-12T00:27:32.102 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 180/205 kB | 354/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T00:27:32.108 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 180/205 kB | 370/798 kB Progress (2): 180/205 kB | 387/798 kB Progress (2): 180/205 kB | 403/798 kB Progress (2): 180/205 kB | 420/798 kB Progress (2): 180/205 kB | 436/798 kB Progress (2): 180/205 kB | 452/798 kB Progress (2): 180/205 kB | 469/798 kB Progress (2): 180/205 kB | 485/798 kB Progress (2): 180/205 kB | 502/798 kB Progress (2): 180/205 kB | 518/798 kB Progress (2): 180/205 kB | 534/798 kB Progress (2): 180/205 kB | 551/798 kB Progress (2): 180/205 kB | 567/798 kB Progress (3): 180/205 kB | 567/798 kB | 16/182 kB Progress (3): 180/205 kB | 583/798 kB | 16/182 kB Progress (3): 196/205 kB | 583/798 kB | 16/182 kB Progress (3): 205 kB | 583/798 kB | 16/182 kB Progress (3): 205 kB | 600/798 kB | 16/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.0 MB/s) 2024-09-12T00:27:32.108 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 616/798 kB | 16/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T00:27:32.113 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 616/798 kB | 32/182 kB Progress (2): 633/798 kB | 32/182 kB Progress (2): 649/798 kB | 32/182 kB Progress (2): 665/798 kB | 32/182 kB Progress (2): 665/798 kB | 49/182 kB Progress (2): 682/798 kB | 49/182 kB Progress (2): 698/798 kB | 49/182 kB Progress (2): 715/798 kB | 49/182 kB Progress (3): 715/798 kB | 49/182 kB | 16/151 kB Progress (3): 731/798 kB | 49/182 kB | 16/151 kB Progress (3): 731/798 kB | 49/182 kB | 32/151 kB Progress (3): 747/798 kB | 49/182 kB | 32/151 kB Progress (3): 747/798 kB | 65/182 kB | 32/151 kB Progress (3): 764/798 kB | 65/182 kB | 32/151 kB Progress (3): 764/798 kB | 65/182 kB | 49/151 kB Progress (3): 780/798 kB | 65/182 kB | 49/151 kB Progress (3): 796/798 kB | 65/182 kB | 49/151 kB Progress (3): 798 kB | 65/182 kB | 49/151 kB Progress (3): 798 kB | 65/182 kB | 65/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 7.7 MB/s) 2024-09-12T00:27:32.113 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T00:27:32.119 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 65/182 kB | 81/151 kB Progress (2): 65/182 kB | 98/151 kB Progress (3): 65/182 kB | 98/151 kB | 16/27 kB Progress (3): 81/182 kB | 98/151 kB | 16/27 kB Progress (3): 81/182 kB | 98/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 248 kB/s) 2024-09-12T00:27:32.119 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 98/182 kB | 98/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T00:27:32.124 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 114/182 kB | 98/151 kB Progress (2): 131/182 kB | 98/151 kB Progress (2): 147/182 kB | 98/151 kB Progress (2): 147/182 kB | 114/151 kB Progress (2): 147/182 kB | 130/151 kB Progress (2): 163/182 kB | 130/151 kB Progress (2): 163/182 kB | 147/151 kB Progress (2): 163/182 kB | 151 kB Progress (2): 180/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.3 MB/s) 2024-09-12T00:27:32.124 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T00:27:32.125 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.6 MB/s) 2024-09-12T00:27:32.125 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T00:27:32.126 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 257 kB/s) 2024-09-12T00:27:32.126 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T00:27:32.136 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/385 kB Progress (1): 33/385 kB Progress (1): 49/385 kB Progress (1): 65/385 kB Progress (1): 81/385 kB Progress (1): 98/385 kB Progress (1): 114/385 kB Progress (1): 131/385 kB Progress (1): 147/385 kB Progress (1): 163/385 kB Progress (1): 180/385 kB Progress (1): 196/385 kB Progress (1): 212/385 kB Progress (1): 229/385 kB Progress (1): 245/385 kB Progress (1): 262/385 kB Progress (1): 278/385 kB Progress (1): 294/385 kB Progress (1): 311/385 kB Progress (1): 327/385 kB Progress (2): 327/385 kB | 13 kB Progress (2): 343/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 104 kB/s) 2024-09-12T00:27:32.136 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 360/385 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T00:27:32.137 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 376/385 kB Progress (1): 385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.0 MB/s) 2024-09-12T00:27:32.137 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T00:27:32.141 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/75 kB Progress (1): 32/75 kB Progress (1): 49/75 kB Progress (1): 65/75 kB Progress (1): 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 565 kB/s) 2024-09-12T00:27:32.141 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T00:27:32.159 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/780 kB Progress (1): 33/780 kB Progress (1): 49/780 kB Progress (1): 66/780 kB Progress (1): 82/780 kB Progress (2): 82/780 kB | 16/329 kB Progress (2): 82/780 kB | 32/329 kB Progress (2): 98/780 kB | 32/329 kB Progress (2): 98/780 kB | 49/329 kB Progress (2): 115/780 kB | 49/329 kB Progress (2): 115/780 kB | 65/329 kB Progress (2): 115/780 kB | 81/329 kB Progress (2): 115/780 kB | 98/329 kB Progress (2): 131/780 kB | 98/329 kB Progress (2): 131/780 kB | 114/329 kB Progress (2): 147/780 kB | 114/329 kB Progress (2): 164/780 kB | 114/329 kB Progress (2): 164/780 kB | 130/329 kB Progress (2): 180/780 kB | 130/329 kB Progress (2): 180/780 kB | 147/329 kB Progress (2): 197/780 kB | 147/329 kB Progress (2): 197/780 kB | 163/329 kB Progress (2): 213/780 kB | 163/329 kB Progress (2): 213/780 kB | 180/329 kB Progress (2): 229/780 kB | 180/329 kB Progress (2): 229/780 kB | 196/329 kB Progress (2): 229/780 kB | 212/329 kB Progress (2): 246/780 kB | 212/329 kB Progress (2): 256/780 kB | 212/329 kB Progress (2): 256/780 kB | 229/329 kB Progress (2): 256/780 kB | 245/329 kB Progress (2): 256/780 kB | 262/329 kB Progress (3): 256/780 kB | 262/329 kB | 16/501 kB Progress (3): 256/780 kB | 262/329 kB | 32/501 kB Progress (3): 256/780 kB | 262/329 kB | 49/501 kB Progress (4): 256/780 kB | 262/329 kB | 49/501 kB | 16/354 kB Progress (4): 272/780 kB | 262/329 kB | 49/501 kB | 16/354 kB Progress (4): 272/780 kB | 262/329 kB | 49/501 kB | 33/354 kB Progress (4): 289/780 kB | 262/329 kB | 49/501 kB | 33/354 kB Progress (4): 289/780 kB | 262/329 kB | 65/501 kB | 33/354 kB Progress (4): 289/780 kB | 262/329 kB | 65/501 kB | 49/354 kB Progress (4): 289/780 kB | 262/329 kB | 81/501 kB | 49/354 kB Progress (4): 305/780 kB | 262/329 kB | 81/501 kB | 49/354 kB Progress (4): 305/780 kB | 262/329 kB | 81/501 kB | 62/354 kB Progress (4): 305/780 kB | 278/329 kB | 81/501 kB | 62/354 kB Progress (4): 305/780 kB | 278/329 kB | 98/501 kB | 62/354 kB Progress (4): 321/780 kB | 278/329 kB | 98/501 kB | 62/354 kB Progress (4): 321/780 kB | 294/329 kB | 98/501 kB | 62/354 kB Progress (4): 321/780 kB | 294/329 kB | 98/501 kB | 78/354 kB Progress (4): 321/780 kB | 311/329 kB | 98/501 kB | 78/354 kB Progress (4): 338/780 kB | 311/329 kB | 98/501 kB | 78/354 kB Progress (4): 338/780 kB | 311/329 kB | 98/501 kB | 94/354 kB Progress (4): 338/780 kB | 327/329 kB | 98/501 kB | 94/354 kB Progress (4): 338/780 kB | 329 kB | 98/501 kB | 94/354 kB Progress (4): 338/780 kB | 329 kB | 114/501 kB | 94/354 kB Progress (4): 354/780 kB | 329 kB | 114/501 kB | 94/354 kB Progress (4): 354/780 kB | 329 kB | 114/501 kB | 111/354 kB Progress (4): 354/780 kB | 329 kB | 131/501 kB | 111/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.2 MB/s) 2024-09-12T00:27:32.159 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (3): 370/780 kB | 131/501 kB | 111/354 kB Progress (3): 370/780 kB | 131/501 kB | 127/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T00:27:32.159 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (3): 387/780 kB | 131/501 kB | 127/354 kB Progress (3): 387/780 kB | 131/501 kB | 143/354 kB Progress (3): 387/780 kB | 147/501 kB | 143/354 kB Progress (3): 403/780 kB | 147/501 kB | 143/354 kB Progress (3): 403/780 kB | 147/501 kB | 160/354 kB Progress (3): 420/780 kB | 147/501 kB | 160/354 kB Progress (3): 420/780 kB | 147/501 kB | 176/354 kB Progress (4): 420/780 kB | 147/501 kB | 176/354 kB | 16/41 kB Progress (4): 436/780 kB | 147/501 kB | 176/354 kB | 16/41 kB Progress (4): 436/780 kB | 147/501 kB | 193/354 kB | 16/41 kB Progress (4): 436/780 kB | 147/501 kB | 193/354 kB | 32/41 kB Progress (4): 452/780 kB | 147/501 kB | 193/354 kB | 32/41 kB Progress (4): 452/780 kB | 147/501 kB | 209/354 kB | 32/41 kB Progress (4): 452/780 kB | 147/501 kB | 209/354 kB | 41 kB Progress (4): 452/780 kB | 147/501 kB | 225/354 kB | 41 kB Progress (4): 469/780 kB | 147/501 kB | 225/354 kB | 41 kB Progress (4): 469/780 kB | 147/501 kB | 230/354 kB | 41 kB Progress (4): 485/780 kB | 147/501 kB | 230/354 kB | 41 kB Progress (4): 485/780 kB | 147/501 kB | 246/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 274 kB/s) 2024-09-12T00:27:32.160 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T00:27:32.162 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (3): 485/780 kB | 147/501 kB | 258/354 kB Progress (3): 502/780 kB | 147/501 kB | 258/354 kB Progress (3): 502/780 kB | 147/501 kB | 275/354 kB Progress (3): 518/780 kB | 147/501 kB | 275/354 kB Progress (3): 518/780 kB | 147/501 kB | 291/354 kB Progress (3): 534/780 kB | 147/501 kB | 291/354 kB Progress (3): 534/780 kB | 147/501 kB | 307/354 kB Progress (3): 551/780 kB | 147/501 kB | 307/354 kB Progress (3): 551/780 kB | 147/501 kB | 324/354 kB Progress (3): 567/780 kB | 147/501 kB | 324/354 kB Progress (3): 567/780 kB | 147/501 kB | 340/354 kB Progress (3): 583/780 kB | 147/501 kB | 340/354 kB Progress (3): 583/780 kB | 147/501 kB | 354 kB Progress (3): 600/780 kB | 147/501 kB | 354 kB Progress (3): 616/780 kB | 147/501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.3 MB/s) 2024-09-12T00:27:32.162 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T00:27:32.166 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 633/780 kB | 147/501 kB Progress (2): 649/780 kB | 147/501 kB Progress (2): 649/780 kB | 163/501 kB Progress (2): 658/780 kB | 163/501 kB Progress (2): 674/780 kB | 163/501 kB Progress (2): 674/780 kB | 180/501 kB Progress (2): 674/780 kB | 196/501 kB Progress (2): 691/780 kB | 196/501 kB Progress (2): 707/780 kB | 196/501 kB Progress (2): 707/780 kB | 212/501 kB Progress (2): 723/780 kB | 212/501 kB Progress (2): 723/780 kB | 229/501 kB Progress (2): 740/780 kB | 229/501 kB Progress (2): 756/780 kB | 229/501 kB Progress (2): 756/780 kB | 245/501 kB Progress (2): 756/780 kB | 262/501 kB Progress (2): 772/780 kB | 262/501 kB Progress (2): 780 kB | 262/501 kB Progress (2): 780 kB | 278/501 kB Progress (2): 780 kB | 294/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.9 MB/s) 2024-09-12T00:27:32.166 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T00:27:32.171 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 311/501 kB Progress (1): 327/501 kB Progress (1): 344/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 393/501 kB Progress (1): 402/501 kB Progress (1): 418/501 kB Progress (1): 435/501 kB Progress (1): 451/501 kB Progress (2): 451/501 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 39 kB/s) 2024-09-12T00:27:32.171 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T00:27:32.186 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 468/501 kB Progress (2): 468/501 kB | 16/586 kB Progress (2): 484/501 kB | 16/586 kB Progress (3): 484/501 kB | 16/586 kB | 16/211 kB Progress (4): 484/501 kB | 16/586 kB | 16/211 kB | 14 kB Progress (4): 484/501 kB | 33/586 kB | 16/211 kB | 14 kB Progress (4): 500/501 kB | 33/586 kB | 16/211 kB | 14 kB Progress (4): 500/501 kB | 33/586 kB | 33/211 kB | 14 kB Progress (4): 501 kB | 33/586 kB | 33/211 kB | 14 kB Progress (4): 501 kB | 49/586 kB | 33/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 81 kB/s) 2024-09-12T00:27:32.186 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (3): 501 kB | 49/586 kB | 49/211 kB Progress (3): 501 kB | 66/586 kB | 49/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T00:27:32.187 INFO:tasks.workunit.client.0.smithi133.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.8 MB/s) 2024-09-12T00:27:32.187 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T00:27:32.190 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 66/586 kB | 66/211 kB Progress (2): 82/586 kB | 66/211 kB Progress (2): 98/586 kB | 66/211 kB Progress (2): 98/586 kB | 82/211 kB Progress (2): 115/586 kB | 82/211 kB Progress (2): 115/586 kB | 98/211 kB Progress (2): 131/586 kB | 98/211 kB Progress (2): 131/586 kB | 115/211 kB Progress (2): 147/586 kB | 115/211 kB Progress (2): 164/586 kB | 115/211 kB Progress (2): 164/586 kB | 131/211 kB Progress (2): 180/586 kB | 131/211 kB Progress (2): 180/586 kB | 147/211 kB Progress (2): 197/586 kB | 147/211 kB Progress (2): 213/586 kB | 147/211 kB Progress (2): 213/586 kB | 164/211 kB Progress (2): 229/586 kB | 164/211 kB Progress (2): 229/586 kB | 180/211 kB Progress (2): 246/586 kB | 180/211 kB Progress (2): 256/586 kB | 180/211 kB Progress (2): 256/586 kB | 197/211 kB Progress (2): 272/586 kB | 197/211 kB Progress (2): 272/586 kB | 211 kB Progress (2): 289/586 kB | 211 kB Progress (2): 305/586 kB | 211 kB Progress (2): 321/586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-12T00:27:32.190 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 338/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T00:27:32.193 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 354/586 kB Progress (1): 370/586 kB Progress (1): 387/586 kB Progress (1): 403/586 kB Progress (1): 420/586 kB Progress (1): 436/586 kB Progress (1): 452/586 kB Progress (1): 469/586 kB Progress (1): 485/586 kB Progress (1): 502/586 kB Progress (1): 518/586 kB Progress (1): 534/586 kB Progress (1): 551/586 kB Progress (1): 567/586 kB Progress (1): 583/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.2 MB/s) 2024-09-12T00:27:32.193 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T00:27:32.200 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/106 kB Progress (1): 33/106 kB Progress (1): 49/106 kB Progress (1): 66/106 kB Progress (2): 66/106 kB | 6.8 kB Progress (2): 82/106 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 36 kB/s) 2024-09-12T00:27:32.200 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 98/106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:27:32.201 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 553 kB/s) 2024-09-12T00:27:32.201 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T00:27:32.205 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (1): 98/245 kB Progress (1): 115/245 kB Progress (1): 131/245 kB Progress (1): 147/245 kB Progress (1): 164/245 kB Progress (1): 180/245 kB Progress (1): 197/245 kB Progress (1): 213/245 kB Progress (1): 229/245 kB Progress (1): 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-12T00:27:32.206 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T00:27:32.209 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/205 kB Progress (1): 33/205 kB Progress (1): 49/205 kB Progress (1): 66/205 kB Progress (2): 66/205 kB | 15 kB Progress (2): 82/205 kB | 15 kB Progress (2): 98/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 76 kB/s) 2024-09-12T00:27:32.209 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T00:27:32.211 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 115/205 kB Progress (1): 131/205 kB Progress (1): 147/205 kB Progress (1): 164/205 kB Progress (1): 180/205 kB Progress (1): 197/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.0 MB/s) 2024-09-12T00:27:32.211 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T00:27:32.216 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 79 kB/s) 2024-09-12T00:27:32.216 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T00:27:32.218 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 30 kB/s) 2024-09-12T00:27:32.221 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 106 kB/s) 2024-09-12T00:27:32.223 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 113 kB/s) 2024-09-12T00:27:32.228 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 79 kB/s) 2024-09-12T00:27:32.235 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/184 kB Progress (1): 32/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 817 kB/s) 2024-09-12T00:27:32.253 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:27:32.253 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T00:27:32.259 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T00:27:32.274 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 364 kB/s) 2024-09-12T00:27:32.276 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T00:27:32.292 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-12T00:27:32.294 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T00:27:32.310 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/43 kB Progress (1): 32/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.7 MB/s) 2024-09-12T00:27:32.313 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T00:27:32.328 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-12T00:27:32.332 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T00:27:32.358 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 98/153 kB Progress (1): 114/153 kB Progress (1): 130/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 6.1 MB/s) 2024-09-12T00:27:32.358 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T00:27:32.378 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/215 kB Progress (1): 32/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 80/215 kB Progress (1): 96/215 kB Progress (1): 112/215 kB Progress (1): 129/215 kB Progress (1): 145/215 kB Progress (1): 162/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 211/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 10 MB/s) 2024-09-12T00:27:32.425 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:27:32.425 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:27:32.428 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T00:27:32.443 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-12T00:27:32.444 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T00:27:32.459 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.5 MB/s) 2024-09-12T00:27:32.462 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T00:27:32.477 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 585 kB/s) 2024-09-12T00:27:32.480 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T00:27:32.495 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.6 MB/s) 2024-09-12T00:27:32.499 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T00:27:32.514 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 377 kB/s) 2024-09-12T00:27:32.516 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T00:27:32.529 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-12T00:27:32.533 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T00:27:32.548 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-12T00:27:32.550 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T00:27:32.564 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 183 kB/s) 2024-09-12T00:27:32.566 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T00:27:32.581 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 940 kB/s) 2024-09-12T00:27:32.583 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T00:27:32.597 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-12T00:27:32.600 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T00:27:32.613 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 597 kB/s) 2024-09-12T00:27:32.615 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T00:27:32.629 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-12T00:27:32.632 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T00:27:32.649 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 471 kB/s) 2024-09-12T00:27:32.652 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T00:27:32.666 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-12T00:27:32.672 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T00:27:32.686 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 340 kB/s) 2024-09-12T00:27:32.689 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T00:27:32.704 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-12T00:27:32.709 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T00:27:32.723 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-09-12T00:27:32.728 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T00:27:32.742 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-12T00:27:32.743 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T00:27:32.744 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T00:27:32.744 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T00:27:32.744 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T00:27:32.744 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T00:27:32.760 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 156 kB/s) 2024-09-12T00:27:32.760 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T00:27:32.762 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/269 kB Progress (2): 16/269 kB | 8.5 kB Progress (2): 33/269 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 499 kB/s) 2024-09-12T00:27:32.762 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T00:27:32.762 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 33/269 kB | 16/55 kB Progress (2): 49/269 kB | 16/55 kB Progress (2): 49/269 kB | 32/55 kB Progress (2): 66/269 kB | 32/55 kB Progress (2): 66/269 kB | 49/55 kB Progress (2): 66/269 kB | 55 kB Progress (2): 82/269 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.9 MB/s) 2024-09-12T00:27:32.764 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 98/269 kB Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 256/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-09-12T00:27:32.767 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/41 kB Progress (1): 32/41 kB Progress (1): 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 1.7 MB/s) 2024-09-12T00:27:32.778 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (1): 64/327 kB Progress (1): 81/327 kB Progress (1): 97/327 kB Progress (1): 113/327 kB Progress (1): 130/327 kB Progress (1): 146/327 kB Progress (1): 162/327 kB Progress (1): 179/327 kB Progress (1): 195/327 kB Progress (1): 212/327 kB Progress (1): 228/327 kB Progress (1): 244/327 kB Progress (1): 261/327 kB Progress (1): 277/327 kB Progress (1): 294/327 kB Progress (1): 310/327 kB Progress (1): 326/327 kB Progress (1): 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.3 MB/s) 2024-09-12T00:27:32.787 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/587 kB Progress (1): 32/587 kB Progress (1): 49/587 kB Progress (1): 65/587 kB Progress (1): 81/587 kB Progress (1): 98/587 kB Progress (1): 114/587 kB Progress (1): 130/587 kB Progress (1): 147/587 kB Progress (1): 163/587 kB Progress (1): 180/587 kB Progress (1): 196/587 kB Progress (1): 212/587 kB Progress (1): 229/587 kB Progress (1): 245/587 kB Progress (1): 262/587 kB Progress (1): 278/587 kB Progress (1): 294/587 kB Progress (1): 311/587 kB Progress (1): 327/587 kB Progress (1): 343/587 kB Progress (1): 360/587 kB Progress (1): 376/587 kB Progress (1): 393/587 kB Progress (1): 402/587 kB Progress (1): 418/587 kB Progress (1): 435/587 kB Progress (1): 451/587 kB Progress (1): 468/587 kB Progress (1): 484/587 kB Progress (1): 500/587 kB Progress (1): 517/587 kB Progress (1): 533/587 kB Progress (1): 549/587 kB Progress (1): 566/587 kB Progress (1): 582/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 13 MB/s) 2024-09-12T00:27:32.818 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:27:32.818 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:27:32.819 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:27:32.823 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T00:27:32.840 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 279 kB/s) 2024-09-12T00:27:32.842 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T00:27:32.858 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 397 kB/s) 2024-09-12T00:27:32.860 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T00:27:32.877 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 15/33 kB Progress (1): 31/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 1.8 MB/s) 2024-09-12T00:27:32.879 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T00:27:32.898 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 735 kB/s) 2024-09-12T00:27:32.902 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T00:27:32.917 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-12T00:27:32.919 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T00:27:32.933 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-12T00:27:32.935 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T00:27:32.953 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.0 MB/s) 2024-09-12T00:27:32.956 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T00:27:32.971 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 355 kB/s) 2024-09-12T00:27:32.972 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T00:27:32.987 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-12T00:27:32.989 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T00:27:33.012 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 108 kB/s) 2024-09-12T00:27:33.013 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T00:27:33.029 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 664 kB/s) 2024-09-12T00:27:33.031 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T00:27:33.046 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-12T00:27:33.049 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T00:27:33.064 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 438 kB/s) 2024-09-12T00:27:33.066 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T00:27:33.084 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 56 kB/s) 2024-09-12T00:27:33.086 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T00:27:33.101 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-09-12T00:27:33.104 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T00:27:33.119 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-12T00:27:33.121 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T00:27:33.136 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 375 kB/s) 2024-09-12T00:27:33.139 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T00:27:33.153 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-12T00:27:33.156 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T00:27:33.172 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 51 kB/s) 2024-09-12T00:27:33.174 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T00:27:33.190 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 377 kB/s) 2024-09-12T00:27:33.192 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T00:27:33.210 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.4 MB/s) 2024-09-12T00:27:33.212 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T00:27:33.227 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-12T00:27:33.228 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T00:27:33.242 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 102 kB/s) 2024-09-12T00:27:33.249 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T00:27:33.264 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 903 kB/s) 2024-09-12T00:27:33.265 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T00:27:33.265 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T00:27:33.265 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T00:27:33.265 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T00:27:33.265 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T00:27:33.278 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-12T00:27:33.278 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T00:27:33.281 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/334 kB Progress (1): 33/334 kB Progress (1): 49/334 kB Progress (1): 65/334 kB Progress (1): 81/334 kB Progress (2): 81/334 kB | 16/55 kB Progress (2): 97/334 kB | 16/55 kB Progress (2): 97/334 kB | 32/55 kB Progress (2): 114/334 kB | 32/55 kB Progress (2): 114/334 kB | 49/55 kB Progress (2): 130/334 kB | 49/55 kB Progress (2): 130/334 kB | 55 kB Progress (2): 146/334 kB | 55 kB Progress (2): 163/334 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.4 MB/s) 2024-09-12T00:27:33.281 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T00:27:33.282 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 163/334 kB | 16/27 kB Progress (2): 179/334 kB | 16/27 kB Progress (2): 179/334 kB | 27 kB Progress (2): 196/334 kB | 27 kB Progress (3): 196/334 kB | 27 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.6 MB/s) 2024-09-12T00:27:33.282 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T00:27:33.284 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 212/334 kB | 16/122 kB Progress (2): 212/334 kB | 32/122 kB Progress (2): 228/334 kB | 32/122 kB Progress (2): 228/334 kB | 49/122 kB Progress (2): 245/334 kB | 49/122 kB Progress (2): 245/334 kB | 65/122 kB Progress (2): 261/334 kB | 65/122 kB Progress (2): 261/334 kB | 81/122 kB Progress (2): 278/334 kB | 81/122 kB Progress (2): 278/334 kB | 98/122 kB Progress (2): 294/334 kB | 98/122 kB Progress (2): 294/334 kB | 114/122 kB Progress (2): 294/334 kB | 122 kB Progress (2): 310/334 kB | 122 kB Progress (2): 327/334 kB | 122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.4 MB/s) 2024-09-12T00:27:33.285 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 17 MB/s) 2024-09-12T00:27:33.296 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.7 kB Progress (2): 4.7 kB | 16/23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 150 kB/s) 2024-09-12T00:27:33.296 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 735 kB/s) 2024-09-12T00:27:33.302 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 256/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.2 MB/s) 2024-09-12T00:27:33.359 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T00:27:33.360 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T00:27:34.010 INFO:tasks.workunit.client.0.smithi133.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:27:34.010 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:27:34.010 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:27:34.013 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:27:34.014 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:27:34.014 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:27:34.020 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T00:27:34.020 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T00:27:34.230 INFO:tasks.workunit.client.0.smithi133.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:27:34.230 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:27:34.230 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:27:34.236 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T00:27:34.250 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 446 kB/s) 2024-09-12T00:27:34.254 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T00:27:34.270 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 221 kB/s) 2024-09-12T00:27:34.275 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T00:27:34.294 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 172 kB/s) 2024-09-12T00:27:34.297 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T00:27:34.313 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-12T00:27:34.317 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T00:27:34.332 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-12T00:27:34.335 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T00:27:34.351 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 278 kB/s) 2024-09-12T00:27:34.355 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T00:27:34.374 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 93 kB/s) 2024-09-12T00:27:34.377 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T00:27:34.393 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 137 kB/s) 2024-09-12T00:27:34.395 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T00:27:34.411 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 15/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.9 MB/s) 2024-09-12T00:27:34.413 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T00:27:34.429 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T00:27:34.431 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T00:27:34.447 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 387 kB/s) 2024-09-12T00:27:34.450 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T00:27:34.467 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 138 kB/s) 2024-09-12T00:27:34.468 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T00:27:34.484 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.4 MB/s) 2024-09-12T00:27:34.487 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T00:27:34.502 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 15/37 kB Progress (1): 31/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.3 MB/s) 2024-09-12T00:27:34.504 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T00:27:34.519 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-12T00:27:34.523 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T00:27:34.538 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 577 kB/s) 2024-09-12T00:27:34.539 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T00:27:34.555 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.7 MB/s) 2024-09-12T00:27:34.558 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T00:27:34.574 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 504 kB/s) 2024-09-12T00:27:34.577 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T00:27:34.591 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-12T00:27:34.594 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T00:27:34.611 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 153 kB/s) 2024-09-12T00:27:34.613 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T00:27:34.628 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-12T00:27:34.629 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T00:27:34.644 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 204 kB/s) 2024-09-12T00:27:34.645 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T00:27:34.660 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-12T00:27:34.661 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T00:27:34.675 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-12T00:27:34.677 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T00:27:34.691 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 1.0 MB/s) 2024-09-12T00:27:34.693 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T00:27:34.707 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-12T00:27:34.708 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T00:27:34.722 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-12T00:27:34.723 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T00:27:34.737 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-12T00:27:34.739 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T00:27:34.754 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 138 kB/s) 2024-09-12T00:27:34.756 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T00:27:34.776 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 117 kB/s) 2024-09-12T00:27:34.779 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T00:27:34.794 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 189 kB/s) 2024-09-12T00:27:34.797 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T00:27:34.815 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 880 kB/s) 2024-09-12T00:27:34.817 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T00:27:34.833 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 853 kB/s) 2024-09-12T00:27:34.836 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T00:27:34.853 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 840 kB/s) 2024-09-12T00:27:34.854 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T00:27:34.869 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-12T00:27:34.871 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T00:27:34.887 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 392 kB/s) 2024-09-12T00:27:34.888 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T00:27:34.906 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.9 MB/s) 2024-09-12T00:27:34.908 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T00:27:34.923 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-12T00:27:34.925 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T00:27:34.941 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 925 kB/s) 2024-09-12T00:27:34.943 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T00:27:34.959 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 47 kB/s) 2024-09-12T00:27:34.961 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T00:27:34.975 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 320 kB/s) 2024-09-12T00:27:34.977 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T00:27:34.993 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 527 kB/s) 2024-09-12T00:27:34.995 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T00:27:35.009 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 200 kB/s) 2024-09-12T00:27:35.013 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T00:27:35.026 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-12T00:27:35.029 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T00:27:35.044 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 137 kB/s) 2024-09-12T00:27:35.047 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T00:27:35.064 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 193 kB/s) 2024-09-12T00:27:35.068 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T00:27:35.085 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 608 kB/s) 2024-09-12T00:27:35.087 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T00:27:35.104 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 793 kB/s) 2024-09-12T00:27:35.106 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T00:27:35.120 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-12T00:27:35.122 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T00:27:35.137 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-12T00:27:35.138 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T00:27:35.154 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 359 kB/s) 2024-09-12T00:27:35.156 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T00:27:35.170 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 489 kB/s) 2024-09-12T00:27:35.171 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T00:27:35.185 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 371 kB/s) 2024-09-12T00:27:35.187 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T00:27:35.202 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 457 kB/s) 2024-09-12T00:27:35.205 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T00:27:35.222 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.2 MB/s) 2024-09-12T00:27:35.224 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T00:27:35.245 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 3.7 MB/s) 2024-09-12T00:27:35.249 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T00:27:35.265 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 15/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.4 MB/s) 2024-09-12T00:27:35.268 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T00:27:35.283 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 377 kB/s) 2024-09-12T00:27:35.285 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T00:27:35.300 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 285 kB/s) 2024-09-12T00:27:35.301 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T00:27:35.316 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 213 kB/s) 2024-09-12T00:27:35.317 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T00:27:35.335 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.6 MB/s) 2024-09-12T00:27:35.337 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T00:27:35.353 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 158 kB/s) 2024-09-12T00:27:35.359 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T00:27:35.381 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/308 kB Progress (1): 32/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 81/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 130/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 212/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 14 MB/s) 2024-09-12T00:27:35.382 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T00:27:35.382 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T00:27:35.382 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T00:27:35.382 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T00:27:35.382 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T00:27:35.399 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 8.2 kB Progress (2): 8.2 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 481 kB/s) 2024-09-12T00:27:35.399 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T00:27:35.403 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 33/118 kB Progress (2): 33/118 kB | 16/171 kB Progress (2): 49/118 kB | 16/171 kB Progress (2): 49/118 kB | 33/171 kB Progress (2): 66/118 kB | 33/171 kB Progress (2): 66/118 kB | 37/171 kB Progress (2): 82/118 kB | 37/171 kB Progress (2): 82/118 kB | 53/171 kB Progress (2): 98/118 kB | 53/171 kB Progress (2): 98/118 kB | 69/171 kB Progress (2): 115/118 kB | 69/171 kB Progress (3): 115/118 kB | 69/171 kB | 16/26 kB Progress (3): 115/118 kB | 86/171 kB | 16/26 kB Progress (3): 118 kB | 86/171 kB | 16/26 kB Progress (3): 118 kB | 86/171 kB | 26 kB Progress (4): 118 kB | 86/171 kB | 26 kB | 14 kB Progress (4): 118 kB | 102/171 kB | 26 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.3 MB/s) 2024-09-12T00:27:35.403 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T00:27:35.403 INFO:tasks.workunit.client.0.smithi133.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 679 kB/s) 2024-09-12T00:27:35.403 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 118 kB | 118/171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.9 MB/s) 2024-09-12T00:27:35.404 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T00:27:35.404 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T00:27:35.404 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 135/171 kB Progress (1): 151/171 kB Progress (1): 168/171 kB Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 7.8 MB/s) 2024-09-12T00:27:35.404 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T00:27:35.418 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (1): 49/146 kB Progress (1): 66/146 kB Progress (1): 82/146 kB Progress (2): 82/146 kB | 16/136 kB Progress (2): 98/146 kB | 16/136 kB Progress (2): 98/146 kB | 33/136 kB Progress (2): 115/146 kB | 33/136 kB Progress (2): 115/146 kB | 49/136 kB Progress (3): 115/146 kB | 49/136 kB | 16/58 kB Progress (3): 131/146 kB | 49/136 kB | 16/58 kB Progress (3): 131/146 kB | 65/136 kB | 16/58 kB Progress (3): 131/146 kB | 65/136 kB | 33/58 kB Progress (4): 131/146 kB | 65/136 kB | 33/58 kB | 16/61 kB Progress (4): 146 kB | 65/136 kB | 33/58 kB | 16/61 kB Progress (4): 146 kB | 65/136 kB | 49/58 kB | 16/61 kB Progress (4): 146 kB | 81/136 kB | 49/58 kB | 16/61 kB Progress (4): 146 kB | 81/136 kB | 58 kB | 16/61 kB Progress (4): 146 kB | 81/136 kB | 58 kB | 32/61 kB Progress (4): 146 kB | 98/136 kB | 58 kB | 32/61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.2 MB/s) 2024-09-12T00:27:35.418 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (3): 98/136 kB | 58 kB | 49/61 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T00:27:35.418 INFO:tasks.workunit.client.0.smithi133.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.6 MB/s) 2024-09-12T00:27:35.418 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T00:27:35.418 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 114/136 kB | 49/61 kB Progress (2): 114/136 kB | 61 kB Progress (2): 130/136 kB | 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.7 MB/s) 2024-09-12T00:27:35.418 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.8 MB/s) 2024-09-12T00:27:35.426 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/501 kB Progress (1): 33/501 kB Progress (1): 49/501 kB Progress (1): 66/501 kB Progress (1): 82/501 kB Progress (1): 98/501 kB Progress (1): 115/501 kB Progress (1): 131/501 kB Progress (1): 147/501 kB Progress (1): 164/501 kB Progress (1): 180/501 kB Progress (1): 197/501 kB Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 262/501 kB Progress (1): 279/501 kB Progress (1): 295/501 kB Progress (1): 311/501 kB Progress (1): 328/501 kB Progress (1): 344/501 kB Progress (1): 360/501 kB Progress (1): 377/501 kB Progress (1): 393/501 kB Progress (1): 410/501 kB Progress (1): 426/501 kB Progress (1): 442/501 kB Progress (1): 459/501 kB Progress (1): 475/501 kB Progress (1): 492/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 11 MB/s) 2024-09-12T00:27:35.432 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.5 MB/s) 2024-09-12T00:27:35.476 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 26 MB/s) 2024-09-12T00:27:35.545 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:27:35.545 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T00:27:35.549 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T00:27:35.565 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 299 kB/s) 2024-09-12T00:27:35.567 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T00:27:35.582 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 306 kB/s) 2024-09-12T00:27:35.584 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T00:27:35.599 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-12T00:27:35.602 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T00:27:35.618 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-12T00:27:35.621 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T00:27:35.636 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 345 kB/s) 2024-09-12T00:27:35.638 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T00:27:35.653 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 261 kB/s) 2024-09-12T00:27:35.655 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T00:27:35.670 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 401 kB/s) 2024-09-12T00:27:35.672 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T00:27:35.687 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 417 kB/s) 2024-09-12T00:27:35.689 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T00:27:35.703 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-12T00:27:35.707 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T00:27:35.722 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 969 kB/s) 2024-09-12T00:27:35.724 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T00:27:35.738 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 136 kB/s) 2024-09-12T00:27:35.740 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T00:27:35.755 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 548 kB/s) 2024-09-12T00:27:35.757 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T00:27:35.771 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-12T00:27:35.778 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T00:27:35.794 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.1 MB/s) 2024-09-12T00:27:35.795 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T00:27:35.795 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T00:27:35.795 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T00:27:35.796 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T00:27:35.796 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T00:27:35.811 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 16/58 kB Progress (2): 33/79 kB | 16/58 kB Progress (2): 49/79 kB | 16/58 kB Progress (2): 49/79 kB | 33/58 kB Progress (3): 49/79 kB | 33/58 kB | 0/1.0 MB Progress (3): 66/79 kB | 33/58 kB | 0/1.0 MB Progress (3): 66/79 kB | 49/58 kB | 0/1.0 MB Progress (3): 66/79 kB | 49/58 kB | 0/1.0 MB Progress (4): 66/79 kB | 49/58 kB | 0/1.0 MB | 16/26 kB Progress (4): 66/79 kB | 58 kB | 0/1.0 MB | 16/26 kB Progress (4): 79 kB | 58 kB | 0/1.0 MB | 16/26 kB Progress (4): 79 kB | 58 kB | 0/1.0 MB | 26 kB Progress (4): 79 kB | 58 kB | 0/1.0 MB | 26 kB Progress (4): 79 kB | 58 kB | 0.1/1.0 MB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.6 MB/s) 2024-09-12T00:27:35.812 INFO:tasks.workunit.client.0.smithi133.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.9 MB/s) 2024-09-12T00:27:35.812 INFO:tasks.workunit.client.0.smithi133.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.7 MB/s) 2024-09-12T00:27:35.812 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T00:27:35.812 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T00:27:35.818 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (2): 0.1/1.0 MB | 16/211 kB Progress (2): 0.1/1.0 MB | 16/211 kB Progress (2): 0.2/1.0 MB | 16/211 kB Progress (2): 0.2/1.0 MB | 32/211 kB Progress (2): 0.2/1.0 MB | 32/211 kB Progress (2): 0.2/1.0 MB | 49/211 kB Progress (2): 0.2/1.0 MB | 49/211 kB Progress (2): 0.2/1.0 MB | 65/211 kB Progress (2): 0.2/1.0 MB | 65/211 kB Progress (2): 0.2/1.0 MB | 81/211 kB Progress (2): 0.2/1.0 MB | 81/211 kB Progress (2): 0.2/1.0 MB | 98/211 kB Progress (2): 0.2/1.0 MB | 98/211 kB Progress (2): 0.2/1.0 MB | 114/211 kB Progress (2): 0.3/1.0 MB | 114/211 kB Progress (2): 0.3/1.0 MB | 130/211 kB Progress (2): 0.3/1.0 MB | 130/211 kB Progress (2): 0.3/1.0 MB | 147/211 kB Progress (2): 0.3/1.0 MB | 147/211 kB Progress (2): 0.3/1.0 MB | 163/211 kB Progress (2): 0.3/1.0 MB | 163/211 kB Progress (2): 0.3/1.0 MB | 180/211 kB Progress (2): 0.3/1.0 MB | 180/211 kB Progress (2): 0.3/1.0 MB | 196/211 kB Progress (2): 0.3/1.0 MB | 196/211 kB Progress (2): 0.3/1.0 MB | 211 kB Progress (2): 0.4/1.0 MB | 211 kB Progress (2): 0.4/1.0 MB | 211 kB Progress (2): 0.4/1.0 MB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 9.2 MB/s) 2024-09-12T00:27:35.829 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (2): 0.8/1.0 MB | 16/267 kB Progress (2): 0.8/1.0 MB | 16/267 kB Progress (2): 0.8/1.0 MB | 33/267 kB Progress (3): 0.8/1.0 MB | 33/267 kB | 15/116 kB Progress (3): 0.8/1.0 MB | 33/267 kB | 15/116 kB Progress (3): 0.8/1.0 MB | 49/267 kB | 15/116 kB Progress (3): 0.8/1.0 MB | 49/267 kB | 31/116 kB Progress (3): 0.9/1.0 MB | 49/267 kB | 31/116 kB Progress (3): 0.9/1.0 MB | 66/267 kB | 31/116 kB Progress (3): 0.9/1.0 MB | 66/267 kB | 48/116 kB Progress (3): 0.9/1.0 MB | 66/267 kB | 48/116 kB Progress (3): 0.9/1.0 MB | 66/267 kB | 64/116 kB Progress (3): 0.9/1.0 MB | 82/267 kB | 64/116 kB Progress (3): 0.9/1.0 MB | 82/267 kB | 78/116 kB Progress (3): 0.9/1.0 MB | 82/267 kB | 78/116 kB Progress (3): 0.9/1.0 MB | 98/267 kB | 78/116 kB Progress (3): 0.9/1.0 MB | 98/267 kB | 95/116 kB Progress (3): 0.9/1.0 MB | 98/267 kB | 95/116 kB Progress (3): 0.9/1.0 MB | 115/267 kB | 95/116 kB Progress (3): 0.9/1.0 MB | 115/267 kB | 111/116 kB Progress (3): 0.9/1.0 MB | 115/267 kB | 116 kB Progress (3): 0.9/1.0 MB | 115/267 kB | 116 kB Progress (3): 0.9/1.0 MB | 131/267 kB | 116 kB Progress (3): 0.9/1.0 MB | 131/267 kB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.4 MB/s) 2024-09-12T00:27:35.831 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 0.9/1.0 MB | 147/267 kB Progress (2): 1.0/1.0 MB | 147/267 kB Progress (2): 1.0/1.0 MB | 164/267 kB Progress (2): 1.0/1.0 MB | 164/267 kB Progress (2): 1.0/1.0 MB | 164/267 kB Progress (2): 1.0/1.0 MB | 180/267 kB Progress (2): 1.0/1.0 MB | 180/267 kB Progress (2): 1.0/1.0 MB | 197/267 kB Progress (2): 1.0 MB | 197/267 kB Progress (2): 1.0 MB | 213/267 kB Progress (2): 1.0 MB | 229/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 29 MB/s) 2024-09-12T00:27:35.832 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 246/267 kB Progress (1): 256/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.2 MB/s) 2024-09-12T00:27:35.964 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T00:27:36.003 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:27:36.003 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:27:36.003 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:27:36.004 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Total time: 6.175 s 2024-09-12T00:27:36.004 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Finished at: 2024-09-12T00:27:36Z 2024-09-12T00:27:36.004 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:27:36.017 INFO:tasks.workunit.client.0.smithi133.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T00:27:36.026 INFO:tasks.workunit.client.0.smithi133.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:27:36.993 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Scanning for projects... 2024-09-12T00:27:37.065 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:27:37.065 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:27:37.066 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:27:37.066 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] from pom.xml 2024-09-12T00:27:37.066 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:27:37.305 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:27:37.305 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:27:37.391 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:27:37.392 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:27:37.392 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:27:37.478 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:27:37.478 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:27:37.478 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:27:37.480 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:27:37.480 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:27:37.480 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:27:37.485 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:27:37.485 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:27:37.485 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:27:37.686 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T00:27:37.912 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T00:27:38.105 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 24 kB/s) 2024-09-12T00:27:38.113 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T00:27:38.132 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 137 kB/s) 2024-09-12T00:27:38.137 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T00:27:38.154 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-12T00:27:38.158 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T00:27:38.174 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 178 kB/s) 2024-09-12T00:27:38.177 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T00:27:38.193 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 188 kB/s) 2024-09-12T00:27:38.196 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T00:27:38.213 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 99 kB/s) 2024-09-12T00:27:38.215 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T00:27:38.233 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 149 kB/s) 2024-09-12T00:27:38.238 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T00:27:38.274 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 776 kB/s) 2024-09-12T00:27:38.275 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T00:27:38.275 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T00:27:38.276 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T00:27:38.276 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T00:27:38.278 INFO:tasks.workunit.client.0.smithi133.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T00:27:38.301 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 650 kB/s) 2024-09-12T00:27:38.330 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 1.4/169 kB Progress (1): 2.8/169 kB Progress (1): 4.1/169 kB Progress (1): 5.5/169 kB Progress (1): 6.9/169 kB Progress (2): 6.9/169 kB | 16/103 kB Progress (2): 8.3/169 kB | 16/103 kB Progress (3): 8.3/169 kB | 16/103 kB | 1.4/7.7 kB Progress (3): 9.7/169 kB | 16/103 kB | 1.4/7.7 kB Progress (3): 9.7/169 kB | 16/103 kB | 2.8/7.7 kB Progress (3): 11/169 kB | 16/103 kB | 2.8/7.7 kB Progress (3): 11/169 kB | 16/103 kB | 4.1/7.7 kB Progress (3): 12/169 kB | 16/103 kB | 4.1/7.7 kB Progress (3): 12/169 kB | 16/103 kB | 5.5/7.7 kB Progress (4): 12/169 kB | 16/103 kB | 5.5/7.7 kB | 16/189 kB Progress (4): 12/169 kB | 16/103 kB | 6.9/7.7 kB | 16/189 kB Progress (4): 14/169 kB | 16/103 kB | 6.9/7.7 kB | 16/189 kB Progress (4): 14/169 kB | 16/103 kB | 7.7 kB | 16/189 kB Progress (4): 15/169 kB | 16/103 kB | 7.7 kB | 16/189 kB Progress (4): 16/169 kB | 16/103 kB | 7.7 kB | 16/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 142 kB/s) 2024-09-12T00:27:38.356 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (3): 32/169 kB | 16/103 kB | 16/189 kB Progress (3): 32/169 kB | 33/103 kB | 16/189 kB Progress (3): 32/169 kB | 33/103 kB | 33/189 kB Progress (3): 49/169 kB | 33/103 kB | 33/189 kB Progress (3): 49/169 kB | 49/103 kB | 33/189 kB Progress (3): 49/169 kB | 49/103 kB | 49/189 kB Progress (3): 65/169 kB | 49/103 kB | 49/189 kB Progress (3): 65/169 kB | 66/103 kB | 49/189 kB Progress (3): 65/169 kB | 66/103 kB | 66/189 kB Progress (3): 81/169 kB | 66/103 kB | 66/189 kB Progress (3): 81/169 kB | 82/103 kB | 66/189 kB Progress (3): 81/169 kB | 82/103 kB | 82/189 kB Progress (3): 98/169 kB | 82/103 kB | 82/189 kB Progress (3): 98/169 kB | 98/103 kB | 82/189 kB Progress (3): 98/169 kB | 98/103 kB | 98/189 kB Progress (3): 114/169 kB | 98/103 kB | 98/189 kB Progress (3): 114/169 kB | 103 kB | 98/189 kB Progress (3): 114/169 kB | 103 kB | 115/189 kB Progress (3): 130/169 kB | 103 kB | 115/189 kB Progress (3): 130/169 kB | 103 kB | 131/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-12T00:27:38.360 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (2): 147/169 kB | 131/189 kB Progress (2): 163/169 kB | 131/189 kB Progress (2): 169 kB | 131/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 2.0 MB/s) 2024-09-12T00:27:38.363 INFO:tasks.workunit.client.0.smithi133.stdout:Progress (1): 147/189 kB Progress (1): 164/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.2 MB/s) 2024-09-12T00:27:38.380 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:27:38.380 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:27:38.380 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] T E S T S 2024-09-12T00:27:38.380 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:27:38.848 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T00:27:38.965 INFO:tasks.workunit.client.0.smithi133.stdout:PutObjects.java: starting test run: 2024-09-12T00:27:38.965 INFO:tasks.workunit.client.0.smithi133.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:27:38.965 INFO:tasks.workunit.client.0.smithi133.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:27:38.965 INFO:tasks.workunit.client.0.smithi133.stdout: EndpointUrl=http://smithi133.front.sepia.ceph.com:80 2024-09-12T00:27:38.965 INFO:tasks.workunit.client.0.smithi133.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T00:27:39.063 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: Environment Variables Read 2024-09-12T00:27:39.365 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: S3 Client Initialized 2024-09-12T00:27:39.365 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: Generating File 2024-09-12T00:27:39.365 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: File Generated 2024-09-12T00:27:39.365 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: Generating File 2024-09-12T00:27:39.365 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: File Generated 2024-09-12T00:27:39.365 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: Generating File 2024-09-12T00:27:39.365 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: File Generated 2024-09-12T00:27:39.365 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: Generating File 2024-09-12T00:27:39.365 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: File Generated 2024-09-12T00:27:39.365 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: Generating File 2024-09-12T00:27:39.365 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: File Generated 2024-09-12T00:27:39.365 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: Generating File 2024-09-12T00:27:39.366 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: File Generated 2024-09-12T00:27:39.366 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: Generated Big Files 2024-09-12T00:27:39.621 INFO:tasks.workunit.client.0.smithi133.stdout:HeadBucketResponse() 2024-09-12T00:27:39.622 INFO:tasks.workunit.client.0.smithi133.stdout:sheik is ready 2024-09-12T00:27:39.622 INFO:tasks.workunit.client.0.smithi133.stdout:DEBUG: Test Bucket Created 2024-09-12T00:27:39.663 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T00:27:39.864 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T00:27:39.964 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T00:27:40.164 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T00:27:40.364 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T00:27:40.465 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T00:27:40.665 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T00:27:40.865 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T00:27:41.166 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T00:27:41.466 INFO:tasks.workunit.client.0.smithi133.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T00:27:44.273 INFO:tasks.workunit.client.0.smithi133.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T00:27:48.377 INFO:tasks.workunit.client.0.smithi133.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T00:28:10.097 INFO:tasks.workunit.client.0.smithi133.stdout:arg: file-0b 2024-09-12T00:28:10.098 INFO:tasks.workunit.client.0.smithi133.stdout:arg: file-8b 2024-09-12T00:28:10.098 INFO:tasks.workunit.client.0.smithi133.stdout:arg: file-200b 2024-09-12T00:28:10.099 INFO:tasks.workunit.client.0.smithi133.stdout:arg: file-21983b 2024-09-12T00:28:10.100 INFO:tasks.workunit.client.0.smithi133.stdout:arg: file-5519b 2024-09-12T00:28:10.101 INFO:tasks.workunit.client.0.smithi133.stdout:arg: file-204329b 2024-09-12T00:28:10.102 INFO:tasks.workunit.client.0.smithi133.stdout:arg: file-256k 2024-09-12T00:28:10.103 INFO:tasks.workunit.client.0.smithi133.stdout:arg: file-1m 2024-09-12T00:28:10.104 INFO:tasks.workunit.client.0.smithi133.stdout:arg: file-1038757b 2024-09-12T00:28:10.205 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T00:28:10.205 INFO:tasks.workunit.client.0.smithi133.stdout:PutObjectResponse 2024-09-12T00:28:10.305 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T00:28:10.305 INFO:tasks.workunit.client.0.smithi133.stdout:PutObjectResponse 2024-09-12T00:28:10.405 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T00:28:10.480 INFO:tasks.workunit.client.0.smithi133.stdout:PutObjectResponse 2024-09-12T00:28:10.505 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T00:28:10.605 INFO:tasks.workunit.client.0.smithi133.stdout:PutObjectResponse 2024-09-12T00:28:10.705 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T00:28:10.706 INFO:tasks.workunit.client.0.smithi133.stdout:PutObjectResponse 2024-09-12T00:28:10.806 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T00:28:10.906 INFO:tasks.workunit.client.0.smithi133.stdout:PutObjectResponse 2024-09-12T00:28:11.006 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T00:28:11.104 INFO:tasks.workunit.client.0.smithi133.stdout:PutObjectResponse 2024-09-12T00:28:11.106 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T00:28:11.506 INFO:tasks.workunit.client.0.smithi133.stdout:PutObjectResponse 2024-09-12T00:28:11.607 INFO:tasks.workunit.client.0.smithi133.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T00:28:12.007 INFO:tasks.workunit.client.0.smithi133.stdout:PutObjectResponse 2024-09-12T00:28:12.107 INFO:tasks.workunit.client.0.smithi133.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T00:28:13.809 INFO:tasks.workunit.client.0.smithi133.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T00:28:17.017 INFO:tasks.workunit.client.0.smithi133.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T00:28:44.016 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 65.16 s -- in io.ceph.jcksum.PutObjects 2024-09-12T00:28:44.036 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:28:44.036 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Results: 2024-09-12T00:28:44.036 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:28:44.036 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T00:28:44.037 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] 2024-09-12T00:28:44.038 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:28:44.038 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:28:44.038 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:28:44.039 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Total time: 01:07 min 2024-09-12T00:28:44.039 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] Finished at: 2024-09-12T00:28:44Z 2024-09-12T00:28:44.039 INFO:tasks.workunit.client.0.smithi133.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:28:44.065 INFO:tasks.workunit.client.0.smithi133.stderr:+ exit 2024-09-12T00:28:44.066 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:28:44.067 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:28:44.144 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T00:28:44.144 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:28:44.516 DEBUG:teuthology.parallel:result is None 2024-09-12T00:28:44.517 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:28:44.555 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:28:44.555 DEBUG:teuthology.orchestra.run.smithi133:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:28:44.625 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:28:44.625 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:28:44.772 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:28:44.772 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:28:44.772 DEBUG:teuthology.orchestra.run.smithi133:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:28:44.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:28:44.801 INFO:teuthology.orchestra.run.smithi133.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:28:44.802 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:28:44.871 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:28:44.871 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:28:44.940 INFO:tasks.workunit:timeout=3h 2024-09-12T00:28:44.940 INFO:tasks.workunit:cleanup=True 2024-09-12T00:28:44.941 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:28:45.010 INFO:tasks.workunit.client.0.smithi133.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:29:29.454 INFO:tasks.workunit.client.0.smithi133.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:29:29.455 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:29:29.455 INFO:tasks.workunit.client.0.smithi133.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:29:29.455 INFO:tasks.workunit.client.0.smithi133.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:29:29.455 INFO:tasks.workunit.client.0.smithi133.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:29:29.455 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:29:29.455 INFO:tasks.workunit.client.0.smithi133.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:29:29.455 INFO:tasks.workunit.client.0.smithi133.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:29:29.455 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:29:29.455 INFO:tasks.workunit.client.0.smithi133.stderr: git switch -c 2024-09-12T00:29:29.455 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:29:29.456 INFO:tasks.workunit.client.0.smithi133.stderr:Or undo this operation with: 2024-09-12T00:29:29.456 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:29:29.456 INFO:tasks.workunit.client.0.smithi133.stderr: git switch - 2024-09-12T00:29:29.456 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:29:29.456 INFO:tasks.workunit.client.0.smithi133.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:29:29.456 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:29:29.456 INFO:tasks.workunit.client.0.smithi133.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:29:29.459 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:29:29.530 INFO:tasks.workunit.client.0.smithi133.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:29:29.551 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:29:29.551 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:29:29.580 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:29:29.629 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:29:29.668 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:29:29.669 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:29:29.669 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:29:29.707 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:29:29.711 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:29:29.711 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:29:29.783 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T00:29:29.784 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T00:29:29.784 DEBUG:teuthology.orchestra.run.smithi133:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T00:29:29.865 INFO:tasks.workunit.client.0.smithi133.stdout:INFO: fully qualified domain name: smithi133.front.sepia.ceph.com 2024-09-12T00:29:29.865 INFO:tasks.workunit.client.0.smithi133.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T00:29:29.865 INFO:tasks.workunit.client.0.smithi133.stdout:== TESTING VERSIONED BUCKET == 2024-09-12T00:29:32.416 INFO:tasks.workunit.client.0.smithi133.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:29:32.599 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting pip 2024-09-12T00:29:32.604 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:29:32.649 INFO:tasks.workunit.client.0.smithi133.stdout:Installing collected packages: pip 2024-09-12T00:29:32.649 INFO:tasks.workunit.client.0.smithi133.stdout: Attempting uninstall: pip 2024-09-12T00:29:32.649 INFO:tasks.workunit.client.0.smithi133.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:29:32.803 INFO:tasks.workunit.client.0.smithi133.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:29:32.808 INFO:tasks.workunit.client.0.smithi133.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:29:33.539 INFO:tasks.workunit.client.0.smithi133.stdout:Successfully installed pip-24.2 2024-09-12T00:29:34.367 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting boto3 2024-09-12T00:29:34.369 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:29:34.902 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:29:34.903 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:29:34.950 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:29:34.952 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:29:35.004 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:29:35.006 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:29:35.056 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:29:35.057 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:29:35.133 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:29:35.134 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:29:35.278 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:29:35.279 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:29:35.283 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:29:35.285 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:29:35.294 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:29:35.295 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:29:35.297 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:29:35.298 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:29:35.299 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:29:35.373 INFO:tasks.workunit.client.0.smithi133.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:29:36.399 INFO:tasks.workunit.client.0.smithi133.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:29:36.840 INFO:tasks.workunit.client.0.smithi133.stdout:INFO: creating user 2024-09-12T00:29:37.157 INFO:tasks.workunit.client.0.smithi133.stdout:{ 2024-09-12T00:29:37.157 INFO:tasks.workunit.client.0.smithi133.stdout: "user_id": "testid", 2024-09-12T00:29:37.157 INFO:tasks.workunit.client.0.smithi133.stdout: "display_name": "M. Tester", 2024-09-12T00:29:37.157 INFO:tasks.workunit.client.0.smithi133.stdout: "email": "tester@ceph.com", 2024-09-12T00:29:37.157 INFO:tasks.workunit.client.0.smithi133.stdout: "suspended": 0, 2024-09-12T00:29:37.157 INFO:tasks.workunit.client.0.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:29:37.157 INFO:tasks.workunit.client.0.smithi133.stdout: "subusers": [], 2024-09-12T00:29:37.157 INFO:tasks.workunit.client.0.smithi133.stdout: "keys": [ 2024-09-12T00:29:37.157 INFO:tasks.workunit.client.0.smithi133.stdout: { 2024-09-12T00:29:37.157 INFO:tasks.workunit.client.0.smithi133.stdout: "user": "testid", 2024-09-12T00:29:37.157 INFO:tasks.workunit.client.0.smithi133.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: "active": true, 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: "create_date": "2024-09-12T00:29:37.148280Z" 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: } 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: ], 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: "swift_keys": [], 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: "caps": [], 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: "op_mask": "read, write, delete", 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: "default_placement": "", 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: "default_storage_class": "", 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: "placement_tags": [], 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: "bucket_quota": { 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: "enabled": false, 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: "max_size": -1, 2024-09-12T00:29:37.158 INFO:tasks.workunit.client.0.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:29:37.159 INFO:tasks.workunit.client.0.smithi133.stdout: "max_objects": -1 2024-09-12T00:29:37.159 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:29:37.159 INFO:tasks.workunit.client.0.smithi133.stdout: "user_quota": { 2024-09-12T00:29:37.159 INFO:tasks.workunit.client.0.smithi133.stdout: "enabled": false, 2024-09-12T00:29:37.159 INFO:tasks.workunit.client.0.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:29:37.159 INFO:tasks.workunit.client.0.smithi133.stdout: "max_size": -1, 2024-09-12T00:29:37.159 INFO:tasks.workunit.client.0.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:29:37.159 INFO:tasks.workunit.client.0.smithi133.stdout: "max_objects": -1 2024-09-12T00:29:37.159 INFO:tasks.workunit.client.0.smithi133.stdout: }, 2024-09-12T00:29:37.159 INFO:tasks.workunit.client.0.smithi133.stdout: "temp_url_keys": [], 2024-09-12T00:29:37.159 INFO:tasks.workunit.client.0.smithi133.stdout: "type": "rgw", 2024-09-12T00:29:37.159 INFO:tasks.workunit.client.0.smithi133.stdout: "mfa_ids": [], 2024-09-12T00:29:37.159 INFO:tasks.workunit.client.0.smithi133.stdout: "account_id": "", 2024-09-12T00:29:37.160 INFO:tasks.workunit.client.0.smithi133.stdout: "path": "/", 2024-09-12T00:29:37.160 INFO:tasks.workunit.client.0.smithi133.stdout: "create_date": "2024-09-12T00:29:37.148269Z", 2024-09-12T00:29:37.160 INFO:tasks.workunit.client.0.smithi133.stdout: "tags": [], 2024-09-12T00:29:37.160 INFO:tasks.workunit.client.0.smithi133.stdout: "group_ids": [] 2024-09-12T00:29:37.160 INFO:tasks.workunit.client.0.smithi133.stdout:} 2024-09-12T00:29:37.160 INFO:tasks.workunit.client.0.smithi133.stdout: 2024-09-12T00:29:37.459 INFO:tasks.workunit.client.0.smithi133.stderr:5+0 records in 2024-09-12T00:29:37.460 INFO:tasks.workunit.client.0.smithi133.stderr:5+0 records out 2024-09-12T00:29:37.460 INFO:tasks.workunit.client.0.smithi133.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0147386 s, 356 MB/s 2024-09-12T00:29:46.783 INFO:tasks.workunit.client.0.smithi133.stdout:bucket nams is reupload-bkt-118067 2024-09-12T00:29:46.783 INFO:tasks.workunit.client.0.smithi133.stdout:endpoint is http://smithi133.front.sepia.ceph.com:80 2024-09-12T00:29:46.783 INFO:tasks.workunit.client.0.smithi133.stdout:start UploadId=2~rQtULtAzPr3brJm8aQLeXu7LlN_1okm 2024-09-12T00:29:46.783 INFO:tasks.workunit.client.0.smithi133.stdout:phase 1 uploaded part {'ETag': '"7a23e729c06a03da6c20aa57d1cff84e"', 'PartNumber': 1} 2024-09-12T00:29:46.783 INFO:tasks.workunit.client.0.smithi133.stdout:phase 1 uploaded part {'ETag': '"7a23e729c06a03da6c20aa57d1cff84e"', 'PartNumber': 2} 2024-09-12T00:29:46.783 INFO:tasks.workunit.client.0.smithi133.stdout:phase 2 uploaded part {'ETag': '"7a23e729c06a03da6c20aa57d1cff84e"', 'PartNumber': 1} 2024-09-12T00:29:46.783 INFO:tasks.workunit.client.0.smithi133.stdout:phase 2 uploaded part {'ETag': '"7a23e729c06a03da6c20aa57d1cff84e"', 'PartNumber': 1} 2024-09-12T00:29:46.783 INFO:tasks.workunit.client.0.smithi133.stdout:phase 2 uploaded part {'ETag': '"7a23e729c06a03da6c20aa57d1cff84e"', 'PartNumber': 1} 2024-09-12T00:29:46.783 INFO:tasks.workunit.client.0.smithi133.stdout:phase 2 uploaded part {'ETag': '"7a23e729c06a03da6c20aa57d1cff84e"', 'PartNumber': 1} 2024-09-12T00:29:46.783 INFO:tasks.workunit.client.0.smithi133.stdout:phase 2 uploaded part {'ETag': '"7a23e729c06a03da6c20aa57d1cff84e"', 'PartNumber': 1} 2024-09-12T00:29:46.784 INFO:tasks.workunit.client.0.smithi133.stdout:phase 2 uploaded part {'ETag': '"7a23e729c06a03da6c20aa57d1cff84e"', 'PartNumber': 1} 2024-09-12T00:29:46.784 INFO:tasks.workunit.client.0.smithi133.stdout:phase 2 uploaded part {'ETag': '"7a23e729c06a03da6c20aa57d1cff84e"', 'PartNumber': 1} 2024-09-12T00:29:46.784 INFO:tasks.workunit.client.0.smithi133.stdout:phase 2 uploaded part {'ETag': '"7a23e729c06a03da6c20aa57d1cff84e"', 'PartNumber': 1} 2024-09-12T00:29:46.784 INFO:tasks.workunit.client.0.smithi133.stdout:phase 2 uploaded part {'ETag': '"7a23e729c06a03da6c20aa57d1cff84e"', 'PartNumber': 1} 2024-09-12T00:29:46.784 INFO:tasks.workunit.client.0.smithi133.stdout:phase 2 uploaded part {'ETag': '"7a23e729c06a03da6c20aa57d1cff84e"', 'PartNumber': 1} 2024-09-12T00:29:46.784 INFO:tasks.workunit.client.0.smithi133.stdout:phase 2 uploaded part {'ETag': '"7a23e729c06a03da6c20aa57d1cff84e"', 'PartNumber': 1} 2024-09-12T00:29:46.784 INFO:tasks.workunit.client.0.smithi133.stdout:completing multipart upload, parts=[{'ETag': '"7a23e729c06a03da6c20aa57d1cff84e"', 'PartNumber': 1}, {'ETag': '"7a23e729c06a03da6c20aa57d1cff84e"', 'PartNumber': 2}] 2024-09-12T00:29:48.225 INFO:tasks.workunit.client.0.smithi133.stdout:radosgw-admin bucket radoslist: 2024-09-12T00:29:48.226 INFO:tasks.workunit.client.0.smithi133.stdout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4__:LElb1Ulca3YfF96dakhZTohvUdez9Sr_mpu_test4 2024-09-12T00:29:48.226 INFO:tasks.workunit.client.0.smithi133.stdout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4_mpu_test4 2024-09-12T00:29:48.226 INFO:tasks.workunit.client.0.smithi133.stdout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4__multipart_mpu_test4.2~rQtULtAzPr3brJm8aQLeXu7LlN_1okm.2 2024-09-12T00:29:48.226 INFO:tasks.workunit.client.0.smithi133.stdout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4__multipart_mpu_test4.sIxTyThmDZooM0yoZg0kZhsolz46lIg5.1 2024-09-12T00:29:48.226 INFO:tasks.workunit.client.0.smithi133.stdout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4__shadow_mpu_test4.2~rQtULtAzPr3brJm8aQLeXu7LlN_1okm.2_1 2024-09-12T00:29:48.226 INFO:tasks.workunit.client.0.smithi133.stdout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4__shadow_mpu_test4.sIxTyThmDZooM0yoZg0kZhsolz46lIg5.1_1 2024-09-12T00:29:48.286 INFO:tasks.workunit.client.0.smithi133.stdout:rados ls: 2024-09-12T00:29:48.286 INFO:tasks.workunit.client.0.smithi133.stdout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4__:LElb1Ulca3YfF96dakhZTohvUdez9Sr_mpu_test4 2024-09-12T00:29:48.286 INFO:tasks.workunit.client.0.smithi133.stdout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4_mpu_test4 2024-09-12T00:29:48.287 INFO:tasks.workunit.client.0.smithi133.stdout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4__multipart_mpu_test4.2~rQtULtAzPr3brJm8aQLeXu7LlN_1okm.2 2024-09-12T00:29:48.287 INFO:tasks.workunit.client.0.smithi133.stdout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4__multipart_mpu_test4.sIxTyThmDZooM0yoZg0kZhsolz46lIg5.1 2024-09-12T00:29:48.287 INFO:tasks.workunit.client.0.smithi133.stdout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4__shadow_mpu_test4.2~rQtULtAzPr3brJm8aQLeXu7LlN_1okm.2_1 2024-09-12T00:29:48.287 INFO:tasks.workunit.client.0.smithi133.stdout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4__shadow_mpu_test4.sIxTyThmDZooM0yoZg0kZhsolz46lIg5.1_1 2024-09-12T00:29:48.290 INFO:tasks.workunit.client.0.smithi133.stdout:== PASSED == 2024-09-12T00:29:48.290 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:29:48.291 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:29:48.369 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T00:29:48.369 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:29:48.745 DEBUG:teuthology.parallel:result is None 2024-09-12T00:29:48.745 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:29:48.784 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:29:48.784 DEBUG:teuthology.orchestra.run.smithi133:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:29:48.854 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:29:48.854 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T00:29:48.870 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T00:29:48.871 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T00:29:48.871 INFO:tasks.ragweed:Using branch 'wip-67986' for ragweed 2024-09-12T00:29:48.871 DEBUG:teuthology.orchestra.run.smithi133:> git clone -b wip-67986 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:29:48.924 INFO:teuthology.orchestra.run.smithi133.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T00:29:49.099 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T00:29:49.099 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T00:29:49.099 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key XOPKDOLDGRXNYRCERICP --secret WtSWNH4FN7t1/sGFj/Q5l4BX75DX90glGAW9mP8bvDO7IQGgj3fWOg== --email ragweed.client.0+test@test.test --system false 2024-09-12T00:29:49.208 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:49.208 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:49.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.244+0000 7f8b3d32e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.245+0000 7f8b3d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.245+0000 7f8b3d32e800 20 realm 2024-09-12T00:29:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.246+0000 7f8b3d32e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.246+0000 7f8b3d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.246+0000 7f8b3d32e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.246+0000 7f8b3d32e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.246+0000 7f8b3d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.246+0000 7f8b3d32e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.247+0000 7f8b3d32e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.247+0000 7f8b3d32e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.248+0000 7f8b3d32e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:49.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.248+0000 7f8b3d32e800 20 searching for the correct realm 2024-09-12T00:29:49.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.250+0000 7f8b39765640 0 -- 172.21.15.133:0/2169633439 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x55f7701a37c0 msgr2=0x55f7701a5bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.253+0000 7f8b38763640 0 -- 172.21.15.133:0/2169633439 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f8b28085060 msgr2=0x7f8b280e19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.460+0000 7f8b3d32e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 20 zone default found 2024-09-12T00:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 4 Realm: () 2024-09-12T00:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:29:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 20 zonegroup default 2024-09-12T00:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.461+0000 7f8b3d32e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.462+0000 7f8b3d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.462+0000 7f8b3d32e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.462+0000 7f8b3d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.462+0000 7f8b3d32e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.463+0000 7f8b3d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.463+0000 7f8b3d32e800 20 started sync module instance, tier type = 2024-09-12T00:29:49.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.463+0000 7f8b3d32e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:29:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.472+0000 7f8b3d32e800 20 add_watcher() i=0 2024-09-12T00:29:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.472+0000 7f8b3d32e800 20 add_watcher() i=1 2024-09-12T00:29:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.472+0000 7f8b3d32e800 20 add_watcher() i=2 2024-09-12T00:29:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.472+0000 7f8b3d32e800 20 add_watcher() i=3 2024-09-12T00:29:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.472+0000 7f8b3d32e800 20 add_watcher() i=4 2024-09-12T00:29:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.472+0000 7f8b3d32e800 20 add_watcher() i=5 2024-09-12T00:29:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.472+0000 7f8b3d32e800 20 add_watcher() i=6 2024-09-12T00:29:49.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.473+0000 7f8b3d32e800 20 add_watcher() i=7 2024-09-12T00:29:49.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.473+0000 7f8b3d32e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.475+0000 7f89ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.476+0000 7f8b3d32e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.476+0000 7f8b3d32e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.476+0000 7f8b3d32e800 5 note: GC not initialized 2024-09-12T00:29:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.476+0000 7f89ee7e4640 20 reqs_thread_entry: start 2024-09-12T00:29:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.476+0000 7f8b3d32e800 20 init_complete bucket index max shards: 1 2024-09-12T00:29:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.476+0000 7f8b3d32e800 20 Filter name: none 2024-09-12T00:29:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.476+0000 7f89e77fe640 20 reqs_thread_entry: start 2024-09-12T00:29:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.476+0000 7f8b3d32e800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:29:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.476+0000 7f8b3d32e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.477+0000 7f8b3d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.477+0000 7f8b3d32e800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T00:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.477+0000 7f8b3d32e800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.477+0000 7f8b3d32e800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T00:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.477+0000 7f8b3d32e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.477+0000 7f8b3d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.477+0000 7f8b3d32e800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T00:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.477+0000 7f8b3d32e800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.477+0000 7f8b3d32e800 10 cache get: name=default.rgw.meta+users.keys+XOPKDOLDGRXNYRCERICP : miss 2024-09-12T00:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.477+0000 7f8b3d32e800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.477+0000 7f8b3d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.477+0000 7f8b3d32e800 10 cache put: name=default.rgw.meta+users.keys+XOPKDOLDGRXNYRCERICP info.flags=0x0 2024-09-12T00:29:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.477+0000 7f8b3d32e800 10 adding default.rgw.meta+users.keys+XOPKDOLDGRXNYRCERICP to cache LRU end 2024-09-12T00:29:49.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.477+0000 7f8b3d32e800 10 cache get: name=default.rgw.meta+users.keys+XOPKDOLDGRXNYRCERICP : hit (negative entry) 2024-09-12T00:29:49.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.477+0000 7f8b3d32e800 10 cache get: name=default.rgw.meta+users.keys+XOPKDOLDGRXNYRCERICP : hit (negative entry) 2024-09-12T00:29:49.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.478+0000 7f8b3d32e800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:29:49.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.478+0000 7f8b3d32e800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:29:49.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.478+0000 7f8b3d32e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:29:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.479+0000 7f8a0ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693239 cookie 94521226085840 notifier 6000 bl.length()=675 2024-09-12T00:29:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.479+0000 7f8a0ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:29:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.479+0000 7f8a0ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:29:49.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.481+0000 7f8b3d32e800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:29:49.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.481+0000 7f8b3d32e800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:29:49.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.481+0000 7f8b3d32e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:29:49.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.482+0000 7f8a0ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693241 cookie 94521226080464 notifier 6000 bl.length()=202 2024-09-12T00:29:49.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.482+0000 7f8a0ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:29:49.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.482+0000 7f8a0ffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:29:49.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.484+0000 7f8b3d32e800 10 cache put: name=default.rgw.meta+users.keys+XOPKDOLDGRXNYRCERICP info.flags=0x7 2024-09-12T00:29:49.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.484+0000 7f8b3d32e800 10 moving default.rgw.meta+users.keys+XOPKDOLDGRXNYRCERICP to cache LRU end 2024-09-12T00:29:49.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.484+0000 7f8b3d32e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:XOPKDOLDGRXNYRCERICP, ofs0, ns] 2024-09-12T00:29:49.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.484+0000 7f8a0f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693198 cookie 94521226083184 notifier 6000 bl.length()=190 2024-09-12T00:29:49.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.485+0000 7f8a0f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XOPKDOLDGRXNYRCERICP info.flags=0x7 2024-09-12T00:29:49.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.485+0000 7f8a0f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XOPKDOLDGRXNYRCERICP to cache LRU end 2024-09-12T00:29:49.484 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T00:29:49.484 INFO:teuthology.orchestra.run.smithi133.stdout: "user_id": "ragweed.client.0", 2024-09-12T00:29:49.484 INFO:teuthology.orchestra.run.smithi133.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T00:29:49.484 INFO:teuthology.orchestra.run.smithi133.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T00:29:49.484 INFO:teuthology.orchestra.run.smithi133.stdout: "suspended": 0, 2024-09-12T00:29:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:29:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "subusers": [], 2024-09-12T00:29:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "keys": [ 2024-09-12T00:29:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-09-12T00:29:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "user": "ragweed.client.0", 2024-09-12T00:29:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "access_key": "XOPKDOLDGRXNYRCERICP", 2024-09-12T00:29:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "secret_key": "WtSWNH4FN7t1/sGFj/Q5l4BX75DX90glGAW9mP8bvDO7IQGgj3fWOg==", 2024-09-12T00:29:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "active": true, 2024-09-12T00:29:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:29:49.478613Z" 2024-09-12T00:29:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-09-12T00:29:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-09-12T00:29:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "swift_keys": [], 2024-09-12T00:29:49.485 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": [], 2024-09-12T00:29:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "op_mask": "read, write, delete", 2024-09-12T00:29:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "default_placement": "", 2024-09-12T00:29:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "default_storage_class": "", 2024-09-12T00:29:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "placement_tags": [], 2024-09-12T00:29:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "bucket_quota": { 2024-09-12T00:29:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:29:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:29:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:29:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:29:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:29:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:29:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "user_quota": { 2024-09-12T00:29:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:29:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:29:49.486 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:29:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:29:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:29:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:29:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: "temp_url_keys": [], 2024-09-12T00:29:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "rgw", 2024-09-12T00:29:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: "mfa_ids": [], 2024-09-12T00:29:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: "account_id": "", 2024-09-12T00:29:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/", 2024-09-12T00:29:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:29:49.478595Z", 2024-09-12T00:29:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2024-09-12T00:29:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: "group_ids": [] 2024-09-12T00:29:49.487 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T00:29:49.487 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:29:49.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.486+0000 7f89ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:49.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.489+0000 7f8b3d32e800 20 remove_watcher() i=0 2024-09-12T00:29:49.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.489+0000 7f8b3d32e800 2 removed watcher, disabling cache 2024-09-12T00:29:49.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.490+0000 7f8b3d32e800 20 remove_watcher() i=1 2024-09-12T00:29:49.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.491+0000 7f8b3d32e800 20 remove_watcher() i=2 2024-09-12T00:29:49.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.492+0000 7f8b3d32e800 20 remove_watcher() i=3 2024-09-12T00:29:49.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.493+0000 7f8b3d32e800 20 remove_watcher() i=4 2024-09-12T00:29:49.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.494+0000 7f8b3d32e800 20 remove_watcher() i=5 2024-09-12T00:29:49.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.495+0000 7f8b3d32e800 20 remove_watcher() i=6 2024-09-12T00:29:49.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.496+0000 7f8b3d32e800 20 remove_watcher() i=7 2024-09-12T00:29:49.506 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T00:29:49.506 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key VFYSWIYPVUIZHMBLIOTU --secret jOAKKKsY1Wad4bA1S/yUdnM3nhRW/5NrVuPptODCJfWPa8slyel8sQ== --email sysuser.client.0+test@test.test --system true 2024-09-12T00:29:49.573 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:49.573 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:49.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.609+0000 7f4d7bf35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.610+0000 7f4d7bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.610+0000 7f4d7bf35800 20 realm 2024-09-12T00:29:49.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.610+0000 7f4d7bf35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.610+0000 7f4d7bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.610+0000 7f4d7bf35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:49.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.610+0000 7f4d7bf35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.611+0000 7f4d7bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:49.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.611+0000 7f4d7bf35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.611+0000 7f4d7bf35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:49.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.611+0000 7f4d7bf35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:49.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.612+0000 7f4d7bf35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:49.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.612+0000 7f4d7bf35800 20 searching for the correct realm 2024-09-12T00:29:49.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.614+0000 7f4d774e3640 0 -- 172.21.15.133:0/3038903476 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f4d6008b420 msgr2=0x7f4d6008b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:49.820+0000 7f4d774e3640 0 -- 172.21.15.133:0/3038903476 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f4d68097150 msgr2=0x7f4d68097ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.028+0000 7f4d7bf35800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:29:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.028+0000 7f4d7bf35800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:29:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.028+0000 7f4d7bf35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.028+0000 7f4d7bf35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.028+0000 7f4d7bf35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.028+0000 7f4d7bf35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.028+0000 7f4d7bf35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.028+0000 7f4d7bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.028+0000 7f4d7bf35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.028+0000 7f4d7bf35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.028+0000 7f4d7bf35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.029+0000 7f4d7bf35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.029+0000 7f4d7bf35800 20 zone default found 2024-09-12T00:29:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.029+0000 7f4d7bf35800 4 Realm: () 2024-09-12T00:29:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.029+0000 7f4d7bf35800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:29:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.029+0000 7f4d7bf35800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:29:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.029+0000 7f4d7bf35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.029+0000 7f4d7bf35800 20 zonegroup default 2024-09-12T00:29:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.029+0000 7f4d7bf35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.029+0000 7f4d7bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.029+0000 7f4d7bf35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.029+0000 7f4d7bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.029+0000 7f4d7bf35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.030+0000 7f4d7bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.030+0000 7f4d7bf35800 20 started sync module instance, tier type = 2024-09-12T00:29:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.030+0000 7f4d7bf35800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:29:50.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.039+0000 7f4d7bf35800 20 add_watcher() i=0 2024-09-12T00:29:50.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.039+0000 7f4d7bf35800 20 add_watcher() i=1 2024-09-12T00:29:50.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.039+0000 7f4d7bf35800 20 add_watcher() i=2 2024-09-12T00:29:50.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.039+0000 7f4d7bf35800 20 add_watcher() i=3 2024-09-12T00:29:50.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.039+0000 7f4d7bf35800 20 add_watcher() i=4 2024-09-12T00:29:50.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.039+0000 7f4d7bf35800 20 add_watcher() i=5 2024-09-12T00:29:50.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.039+0000 7f4d7bf35800 20 add_watcher() i=6 2024-09-12T00:29:50.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.040+0000 7f4d7bf35800 20 add_watcher() i=7 2024-09-12T00:29:50.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.040+0000 7f4d7bf35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:50.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.043+0000 7f4c2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.043+0000 7f4d7bf35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.043+0000 7f4d7bf35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.043+0000 7f4d7bf35800 5 note: GC not initialized 2024-09-12T00:29:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.043+0000 7f4c2cfe1640 20 reqs_thread_entry: start 2024-09-12T00:29:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.043+0000 7f4d7bf35800 20 init_complete bucket index max shards: 1 2024-09-12T00:29:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.043+0000 7f4d7bf35800 20 Filter name: none 2024-09-12T00:29:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.043+0000 7f4ba67fc640 20 reqs_thread_entry: start 2024-09-12T00:29:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.043+0000 7f4d7bf35800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:29:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.043+0000 7f4d7bf35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.043+0000 7f4d7bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.043+0000 7f4d7bf35800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T00:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.043+0000 7f4d7bf35800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.044+0000 7f4d7bf35800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T00:29:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.044+0000 7f4d7bf35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.044+0000 7f4d7bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.044+0000 7f4d7bf35800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T00:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.044+0000 7f4d7bf35800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.044+0000 7f4d7bf35800 10 cache get: name=default.rgw.meta+users.keys+VFYSWIYPVUIZHMBLIOTU : miss 2024-09-12T00:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.044+0000 7f4d7bf35800 20 rados->read ofs=0 len=0 2024-09-12T00:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.044+0000 7f4d7bf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.044+0000 7f4d7bf35800 10 cache put: name=default.rgw.meta+users.keys+VFYSWIYPVUIZHMBLIOTU info.flags=0x0 2024-09-12T00:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.044+0000 7f4d7bf35800 10 adding default.rgw.meta+users.keys+VFYSWIYPVUIZHMBLIOTU to cache LRU end 2024-09-12T00:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.044+0000 7f4d7bf35800 10 cache get: name=default.rgw.meta+users.keys+VFYSWIYPVUIZHMBLIOTU : hit (negative entry) 2024-09-12T00:29:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.044+0000 7f4d7bf35800 10 cache get: name=default.rgw.meta+users.keys+VFYSWIYPVUIZHMBLIOTU : hit (negative entry) 2024-09-12T00:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.046+0000 7f4d7bf35800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.046+0000 7f4d7bf35800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.046+0000 7f4d7bf35800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.046+0000 7f4c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693242 cookie 94723973940080 notifier 6018 bl.length()=675 2024-09-12T00:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.046+0000 7f4c56ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:29:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.046+0000 7f4c56ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:29:50.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.049+0000 7f4d7bf35800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:29:50.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.049+0000 7f4d7bf35800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:29:50.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.049+0000 7f4d7bf35800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:29:50.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.049+0000 7f4c56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693240 cookie 94723973937104 notifier 6018 bl.length()=202 2024-09-12T00:29:50.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.049+0000 7f4c56ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:29:50.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.049+0000 7f4c56ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:29:50.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.052+0000 7f4d7bf35800 10 cache put: name=default.rgw.meta+users.keys+VFYSWIYPVUIZHMBLIOTU info.flags=0x7 2024-09-12T00:29:50.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.052+0000 7f4d7bf35800 10 moving default.rgw.meta+users.keys+VFYSWIYPVUIZHMBLIOTU to cache LRU end 2024-09-12T00:29:50.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.052+0000 7f4d7bf35800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:VFYSWIYPVUIZHMBLIOTU, ofs0, ns] 2024-09-12T00:29:50.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.052+0000 7f4c567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693243 cookie 94723973940080 notifier 6018 bl.length()=190 2024-09-12T00:29:50.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.052+0000 7f4c567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VFYSWIYPVUIZHMBLIOTU info.flags=0x7 2024-09-12T00:29:50.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.052+0000 7f4c567fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VFYSWIYPVUIZHMBLIOTU to cache LRU end 2024-09-12T00:29:50.051 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T00:29:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: "user_id": "sysuser.client.0", 2024-09-12T00:29:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T00:29:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T00:29:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: "suspended": 0, 2024-09-12T00:29:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:29:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: "subusers": [], 2024-09-12T00:29:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: "keys": [ 2024-09-12T00:29:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-09-12T00:29:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: "user": "sysuser.client.0", 2024-09-12T00:29:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: "access_key": "VFYSWIYPVUIZHMBLIOTU", 2024-09-12T00:29:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: "secret_key": "jOAKKKsY1Wad4bA1S/yUdnM3nhRW/5NrVuPptODCJfWPa8slyel8sQ==", 2024-09-12T00:29:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "active": true, 2024-09-12T00:29:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:29:50.045401Z" 2024-09-12T00:29:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-09-12T00:29:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-09-12T00:29:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "swift_keys": [], 2024-09-12T00:29:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": [], 2024-09-12T00:29:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "op_mask": "read, write, delete", 2024-09-12T00:29:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "system": true, 2024-09-12T00:29:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "default_placement": "", 2024-09-12T00:29:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "default_storage_class": "", 2024-09-12T00:29:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "placement_tags": [], 2024-09-12T00:29:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "bucket_quota": { 2024-09-12T00:29:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:29:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:29:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:29:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:29:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:29:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:29:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "user_quota": { 2024-09-12T00:29:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:29:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:29:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:29:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:29:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:29:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:29:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "temp_url_keys": [], 2024-09-12T00:29:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "rgw", 2024-09-12T00:29:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "mfa_ids": [], 2024-09-12T00:29:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "account_id": "", 2024-09-12T00:29:50.055 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/", 2024-09-12T00:29:50.055 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:29:50.045389Z", 2024-09-12T00:29:50.055 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2024-09-12T00:29:50.055 INFO:teuthology.orchestra.run.smithi133.stdout: "group_ids": [] 2024-09-12T00:29:50.055 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T00:29:50.055 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:29:50.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.054+0000 7f4c2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:50.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.056+0000 7f4d7bf35800 20 remove_watcher() i=0 2024-09-12T00:29:50.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.056+0000 7f4d7bf35800 2 removed watcher, disabling cache 2024-09-12T00:29:50.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.057+0000 7f4d7bf35800 20 remove_watcher() i=1 2024-09-12T00:29:50.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.058+0000 7f4d7bf35800 20 remove_watcher() i=2 2024-09-12T00:29:50.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.059+0000 7f4d7bf35800 20 remove_watcher() i=3 2024-09-12T00:29:50.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.060+0000 7f4d7bf35800 20 remove_watcher() i=4 2024-09-12T00:29:50.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.061+0000 7f4d7bf35800 20 remove_watcher() i=5 2024-09-12T00:29:50.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.063+0000 7f4d7bf35800 20 remove_watcher() i=6 2024-09-12T00:29:50.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:29:50.064+0000 7f4d7bf35800 20 remove_watcher() i=7 2024-09-12T00:29:50.075 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T00:29:50.075 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:29:50.075 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T00:29:50.103 INFO:tasks.ragweed:Configuring boto... 2024-09-12T00:29:50.104 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:29:50.104 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T00:29:50.173 DEBUG:teuthology.orchestra.run.smithi133:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T00:29:50.533 INFO:teuthology.orchestra.run.smithi133.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T00:29:50.701 INFO:teuthology.orchestra.run.smithi133.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T00:29:51.248 INFO:teuthology.orchestra.run.smithi133.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:29:57.385 INFO:teuthology.orchestra.run.smithi133.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T00:30:00.777 INFO:teuthology.orchestra.run.smithi133.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=b40882ff343b3787ab5ff291a59bcf8c7060765ab38ec76040e47e25e2cded4a,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-12T00:30:01.019 INFO:teuthology.orchestra.run.smithi133.stdout:py run-test-pre: PYTHONHASHSEED='1265124574' 2024-09-12T00:30:01.019 INFO:teuthology.orchestra.run.smithi133.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T00:30:01.019 INFO:teuthology.orchestra.run.smithi133.stdout:============================= test session starts ============================== 2024-09-12T00:30:01.020 INFO:teuthology.orchestra.run.smithi133.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T00:30:01.020 INFO:teuthology.orchestra.run.smithi133.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:30:01.020 INFO:teuthology.orchestra.run.smithi133.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:30:01.020 INFO:teuthology.orchestra.run.smithi133.stdout:configfile: pytest.ini 2024-09-12T00:30:01.065 INFO:teuthology.orchestra.run.smithi133.stdout:collecting ... collected 9 items 2024-09-12T00:30:01.066 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:30:03.127 INFO:teuthology.orchestra.run.smithi133.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T00:30:05.267 INFO:teuthology.orchestra.run.smithi133.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T00:30:07.122 INFO:teuthology.orchestra.run.smithi133.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T00:30:09.466 INFO:teuthology.orchestra.run.smithi133.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T00:30:13.140 INFO:teuthology.orchestra.run.smithi133.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T00:30:22.010 INFO:teuthology.orchestra.run.smithi133.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T00:30:26.479 INFO:teuthology.orchestra.run.smithi133.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T00:30:31.403 INFO:teuthology.orchestra.run.smithi133.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T00:30:40.407 INFO:teuthology.orchestra.run.smithi133.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T00:30:40.408 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:30:40.408 INFO:teuthology.orchestra.run.smithi133.stdout:=============================== warnings summary =============================== 2024-09-12T00:30:40.408 INFO:teuthology.orchestra.run.smithi133.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T00:30:40.408 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T00:30:40.408 INFO:teuthology.orchestra.run.smithi133.stdout: import imp 2024-09-12T00:30:40.408 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:30:40.408 INFO:teuthology.orchestra.run.smithi133.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T00:30:40.408 INFO:teuthology.orchestra.run.smithi133.stdout:======================== 9 passed, 1 warning in 39.44s ========================= 2024-09-12T00:30:40.439 INFO:teuthology.orchestra.run.smithi133.stdout:___________________________________ summary ____________________________________ 2024-09-12T00:30:40.439 INFO:teuthology.orchestra.run.smithi133.stdout: py: commands succeeded 2024-09-12T00:30:40.439 INFO:teuthology.orchestra.run.smithi133.stdout: congratulations :) 2024-09-12T00:30:40.457 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T00:30:40.458 DEBUG:teuthology.orchestra.run.smithi133:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T00:30:40.488 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T00:30:40.584 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:40.585 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:40.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:40.619+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:40.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:40.621+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:40.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:40.621+0000 7f1145735800 20 realm 2024-09-12T00:30:40.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:40.621+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:40.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:40.621+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:40.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:40.621+0000 7f1145735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:40.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:40.621+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:40.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:40.621+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:40.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:40.621+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:40.622+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:40.622+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:40.623+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:40.623+0000 7f1145735800 20 searching for the correct realm 2024-09-12T00:30:40.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:40.625+0000 7f1140ce3640 0 -- 172.21.15.133:0/3384149876 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f1138039b70 msgr2=0x7f1138020940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:40.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:40.831+0000 7f1140ce3640 0 -- 172.21.15.133:0/3384149876 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f113402d040 msgr2=0x7f113403b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.038+0000 7f1145735800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:30:41.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.038+0000 7f1145735800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:30:41.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.038+0000 7f1145735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:41.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.038+0000 7f1145735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:41.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.038+0000 7f1145735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:41.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.038+0000 7f1145735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:41.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.038+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.039+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.039+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.039+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:41.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.039+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.039+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:41.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.039+0000 7f1145735800 20 zone default found 2024-09-12T00:30:41.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.040+0000 7f1145735800 4 Realm: () 2024-09-12T00:30:41.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.040+0000 7f1145735800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:30:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.040+0000 7f1145735800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:30:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.040+0000 7f1145735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.040+0000 7f1145735800 20 zonegroup default 2024-09-12T00:30:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.040+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.040+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.040+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.040+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.040+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.041+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.041+0000 7f1145735800 20 started sync module instance, tier type = 2024-09-12T00:30:41.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.041+0000 7f1145735800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:30:41.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.051+0000 7f1145735800 20 add_watcher() i=0 2024-09-12T00:30:41.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.051+0000 7f1145735800 20 add_watcher() i=1 2024-09-12T00:30:41.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.051+0000 7f1145735800 20 add_watcher() i=2 2024-09-12T00:30:41.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.051+0000 7f1145735800 20 add_watcher() i=3 2024-09-12T00:30:41.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.051+0000 7f1145735800 20 add_watcher() i=4 2024-09-12T00:30:41.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.051+0000 7f1145735800 20 add_watcher() i=5 2024-09-12T00:30:41.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.051+0000 7f1145735800 20 add_watcher() i=6 2024-09-12T00:30:41.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.052+0000 7f1145735800 20 add_watcher() i=7 2024-09-12T00:30:41.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.052+0000 7f1145735800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:41.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.054+0000 7f0ff7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:41.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.054+0000 7f1145735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:41.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.054+0000 7f1145735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:41.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.090+0000 7f0ff6fe5640 20 reqs_thread_entry: start 2024-09-12T00:30:41.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.091+0000 7f1145735800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:41.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.091+0000 7f1145735800 20 Filter name: none 2024-09-12T00:30:41.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.091+0000 7f0ff4fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:41.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.091+0000 7f1145735800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:30:41.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.091+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.091+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:30:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.091+0000 7f1145735800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T00:30:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.091+0000 7f1145735800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:30:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.091+0000 7f1145735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.092+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5 : miss 2024-09-12T00:30:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.092+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.092+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T00:30:41.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.092+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5 info.flags=0x17 2024-09-12T00:30:41.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.092+0000 7f1145735800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5 to cache LRU end 2024-09-12T00:30:41.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.092+0000 7f1145735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:41.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.092+0000 7f1145735800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:30:41.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.092+0000 7f1145735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5 2024-09-12T00:30:41.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.093+0000 7f1145735800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T00:30:41.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.093+0000 7f1145735800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T00:30:41.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.093+0000 7f1145735800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T00:30:41.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.093+0000 7f1145735800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T00:30:41.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.093+0000 7f1145735800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T00:30:41.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.093+0000 7f1145735800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T00:30:41.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.093+0000 7f1145735800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T00:30:41.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.093+0000 7f1145735800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:30:41.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.093+0000 7f1145735800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T00:30:41.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.093+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x555e15523e08 s->prefetch_data=0 2024-09-12T00:30:41.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.093+0000 7f1145735800 10 manifest: total_size = 4963 2024-09-12T00:30:41.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.093+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5757522840118793306 2024-09-12T00:30:41.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.093+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x555e15523e08 s->prefetch_data=0 2024-09-12T00:30:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.093+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e15523e08 2024-09-12T00:30:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.094+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5.0 2024-09-12T00:30:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.096+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.096+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4963 stripe_ofs=4963 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.096+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5757522840118793306 2024-09-12T00:30:41.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.096+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.096+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.9Yb_rsVXbnmAwfT17MbvJ85mviUQrHg_0 2024-09-12T00:30:41.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.096+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:30:41.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.096+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.096+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5757522840118793306 2024-09-12T00:30:41.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.097+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T00:30:41.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.097+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x555e154ac2c8 s->prefetch_data=0 2024-09-12T00:30:41.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.098+0000 7f1145735800 10 manifest: total_size = 7638 2024-09-12T00:30:41.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.098+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1530065523985204880 2024-09-12T00:30:41.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.098+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x555e154ac2c8 s->prefetch_data=0 2024-09-12T00:30:41.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.098+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154ac2c8 2024-09-12T00:30:41.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.098+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5.0 2024-09-12T00:30:41.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.100+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.100+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=7638 stripe_ofs=7638 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.100+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1530065523985204880 2024-09-12T00:30:41.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.100+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.100+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.IfWOauh44qTXSXFgVz2FKYmakCpeRuj_0 2024-09-12T00:30:41.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.100+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:30:41.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.100+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.100+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1530065523985204880 2024-09-12T00:30:41.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.102+0000 7f1013fff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T00:30:41.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.102+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x555e154ac2a8 s->prefetch_data=0 2024-09-12T00:30:41.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.102+0000 7f1145735800 10 manifest: total_size = 7397 2024-09-12T00:30:41.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.102+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12284669044426321348 2024-09-12T00:30:41.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.102+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x555e154ac2a8 s->prefetch_data=0 2024-09-12T00:30:41.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.102+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154ac2a8 2024-09-12T00:30:41.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.102+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5.0 2024-09-12T00:30:41.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.106+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.106+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=7397 stripe_ofs=7397 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.106+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12284669044426321348 2024-09-12T00:30:41.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.106+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.106+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.0rYdvxHjANjvMM93I9uqKrL8r4DId8C_0 2024-09-12T00:30:41.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.106+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:30:41.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.106+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.106+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12284669044426321348 2024-09-12T00:30:41.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.107+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T00:30:41.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.107+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x555e155234f8 s->prefetch_data=0 2024-09-12T00:30:41.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.108+0000 7f1145735800 10 manifest: total_size = 4862 2024-09-12T00:30:41.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.108+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4652721994696224376 2024-09-12T00:30:41.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.108+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x555e155234f8 s->prefetch_data=0 2024-09-12T00:30:41.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.108+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e155234f8 2024-09-12T00:30:41.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.108+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5.0 2024-09-12T00:30:41.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.111+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.111+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4862 stripe_ofs=4862 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.112+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4652721994696224376 2024-09-12T00:30:41.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.112+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.112+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.o5tL5xlzvv8KHvLnnsw7XqsPeNjCzOo_0 2024-09-12T00:30:41.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.112+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:30:41.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.112+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.112+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4652721994696224376 2024-09-12T00:30:41.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.113+0000 7f1013fff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T00:30:41.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.113+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x555e155234f8 s->prefetch_data=0 2024-09-12T00:30:41.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.113+0000 7f1145735800 10 manifest: total_size = 7620 2024-09-12T00:30:41.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.113+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16899509571366899361 2024-09-12T00:30:41.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.113+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x555e155234f8 s->prefetch_data=0 2024-09-12T00:30:41.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.113+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e155234f8 2024-09-12T00:30:41.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.113+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5.0 2024-09-12T00:30:41.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.116+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.116+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=7620 stripe_ofs=7620 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.116+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16899509571366899361 2024-09-12T00:30:41.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.116+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.116+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.pa06x53BMdxjtO5jISeBc_os8uGVASc_0 2024-09-12T00:30:41.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.116+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:30:41.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.116+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.116+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16899509571366899361 2024-09-12T00:30:41.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.117+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x555e155234f8 s->prefetch_data=0 2024-09-12T00:30:41.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.118+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T00:30:41.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.118+0000 7f1145735800 10 manifest: total_size = 7715 2024-09-12T00:30:41.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.118+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10243045416702750617 2024-09-12T00:30:41.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.118+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x555e155234f8 s->prefetch_data=0 2024-09-12T00:30:41.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.118+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e155234f8 2024-09-12T00:30:41.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.118+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5.0 2024-09-12T00:30:41.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.120+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.120+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=7715 stripe_ofs=7715 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.120+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10243045416702750617 2024-09-12T00:30:41.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.120+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.120+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.wwL-Lkr4gMF9ksWRfrPzLvhDTL0nSeZ_0 2024-09-12T00:30:41.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.120+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:30:41.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.120+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.120+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10243045416702750617 2024-09-12T00:30:41.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.121+0000 7f1013fff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T00:30:41.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.121+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x555e155234f8 s->prefetch_data=0 2024-09-12T00:30:41.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.122+0000 7f1145735800 10 manifest: total_size = 7794 2024-09-12T00:30:41.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.122+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9329403142990424513 2024-09-12T00:30:41.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.122+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x555e155234f8 s->prefetch_data=0 2024-09-12T00:30:41.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.122+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e155234f8 2024-09-12T00:30:41.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.122+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5.0 2024-09-12T00:30:41.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.124+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.124+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=7794 stripe_ofs=7794 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.124+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9329403142990424513 2024-09-12T00:30:41.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.124+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.124+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.J8I043CoBER0uQcMgyCUGjiEQKMG6Ic_0 2024-09-12T00:30:41.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.124+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:30:41.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.124+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.124+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9329403142990424513 2024-09-12T00:30:41.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.125+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T00:30:41.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.125+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x555e155234f8 s->prefetch_data=0 2024-09-12T00:30:41.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.126+0000 7f1145735800 10 manifest: total_size = 5046 2024-09-12T00:30:41.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.126+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16667403786024111136 2024-09-12T00:30:41.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.126+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf8a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x555e155234f8 s->prefetch_data=0 2024-09-12T00:30:41.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.126+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e155234f8 2024-09-12T00:30:41.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.126+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5.0 2024-09-12T00:30:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.128+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.128+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5046 stripe_ofs=5046 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.128+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16667403786024111136 2024-09-12T00:30:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.128+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.128+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.lDMYvZG87z2XogDxtdg-BpckcSZhlVP_0 2024-09-12T00:30:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.128+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:30:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.128+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.128+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16667403786024111136 2024-09-12T00:30:41.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.129+0000 7f1013fff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:30:41.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.130+0000 7f1145735800 20 get_obj_state: octx=0x555e154a3e60 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x555e155234f8 s->prefetch_data=0 2024-09-12T00:30:41.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.130+0000 7f1145735800 10 manifest: total_size = 5411 2024-09-12T00:30:41.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.130+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7436775280713046528 2024-09-12T00:30:41.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.130+0000 7f1145735800 20 get_obj_state: octx=0x555e154a3e60 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x555e155234f8 s->prefetch_data=0 2024-09-12T00:30:41.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.130+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e155234f8 2024-09-12T00:30:41.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.130+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5.0 2024-09-12T00:30:41.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.132+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.132+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5411 stripe_ofs=5411 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.132+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7436775280713046528 2024-09-12T00:30:41.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.132+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.132+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.pBOgYi3wBjvdEJ4YW4_ch0NrZyEMaPh_0 2024-09-12T00:30:41.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.132+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:30:41.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.132+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.132+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7436775280713046528 2024-09-12T00:30:41.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.133+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T00:30:41.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.134+0000 7f1145735800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:30:41.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.134+0000 7f1145735800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:30:41.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.134+0000 7f1145735800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:30:41.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.134+0000 7f1145735800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:30:41.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.134+0000 7f1145735800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:30:41.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.134+0000 7f1145735800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:30:41.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.134+0000 7f1145735800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5])"; uploads.size()=0; is_truncated=0 2024-09-12T00:30:41.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.136+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T00:30:41.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.136+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.136+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T00:30:41.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.136+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T00:30:41.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.136+0000 7f1145735800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T00:30:41.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.137+0000 7f1145735800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T00:30:41.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.137+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T00:30:41.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.137+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496973 cookie 93862572226048 notifier 5756 bl.length()=162 2024-09-12T00:30:41.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.140+0000 7f1145735800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5 from cache 2024-09-12T00:30:41.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.140+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5, ofs0, ns] 2024-09-12T00:30:41.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.140+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497028 cookie 93862572230384 notifier 5756 bl.length()=219 2024-09-12T00:30:41.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.142+0000 7f1145735800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5 : miss 2024-09-12T00:30:41.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.142+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.143+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.143+0000 7f1145735800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5 info.flags=0x0 2024-09-12T00:30:41.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.143+0000 7f1145735800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5 to cache LRU end 2024-09-12T00:30:41.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.145+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12 : miss 2024-09-12T00:30:41.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.145+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.145+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T00:30:41.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.145+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12 info.flags=0x17 2024-09-12T00:30:41.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.145+0000 7f1145735800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12 to cache LRU end 2024-09-12T00:30:41.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.145+0000 7f1145735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:41.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.145+0000 7f1145735800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:30:41.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.145+0000 7f1145735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12 2024-09-12T00:30:41.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.146+0000 7f1145735800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:30:41.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.146+0000 7f1145735800 20 get_obj_state: octx=0x555e154a3e60 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x555e154a7b78 s->prefetch_data=0 2024-09-12T00:30:41.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.146+0000 7f1145735800 10 manifest: total_size = 886297 2024-09-12T00:30:41.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.146+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16613242334230809166 2024-09-12T00:30:41.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.146+0000 7f1145735800 20 get_obj_state: octx=0x555e154a3e60 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x555e154a7b78 s->prefetch_data=0 2024-09-12T00:30:41.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.146+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154a7b78 2024-09-12T00:30:41.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.146+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12.0 2024-09-12T00:30:41.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:30:41.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T00:30:41.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:30:41.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:30:41.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T00:30:41.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T00:30:41.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:30:41.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-09-12T00:30:41.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T00:30:41.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T00:30:41.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-09-12T00:30:41.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T00:30:41.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16613242334230809166 2024-09-12T00:30:41.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12__multipart_foo.2~XnzwfkrSOFeLzfU7C49mNLf3YdIEPm9.1 2024-09-12T00:30:41.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:30:41.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12__multipart_foo.2~XnzwfkrSOFeLzfU7C49mNLf3YdIEPm9.2 2024-09-12T00:30:41.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T00:30:41.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12__multipart_foo.2~XnzwfkrSOFeLzfU7C49mNLf3YdIEPm9.3 2024-09-12T00:30:41.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T00:30:41.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12__multipart_foo.2~XnzwfkrSOFeLzfU7C49mNLf3YdIEPm9.4 2024-09-12T00:30:41.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T00:30:41.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.148+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16613242334230809166 2024-09-12T00:30:41.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.149+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:30:41.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.150+0000 7f1145735800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:30:41.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.150+0000 7f1145735800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:30:41.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.150+0000 7f1145735800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:30:41.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.150+0000 7f1145735800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:30:41.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.150+0000 7f1145735800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:30:41.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.150+0000 7f1145735800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:30:41.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.150+0000 7f1145735800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12])"; uploads.size()=0; is_truncated=0 2024-09-12T00:30:41.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.152+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T00:30:41.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.152+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.152+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T00:30:41.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.152+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T00:30:41.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.152+0000 7f1145735800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T00:30:41.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.153+0000 7f1145735800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T00:30:41.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.153+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T00:30:41.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.153+0000 7f1024ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497029 cookie 93862572230384 notifier 5756 bl.length()=191 2024-09-12T00:30:41.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.156+0000 7f1145735800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12 from cache 2024-09-12T00:30:41.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.156+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12, ofs0, ns] 2024-09-12T00:30:41.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.156+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 93862572223840 notifier 5756 bl.length()=249 2024-09-12T00:30:41.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.159+0000 7f1145735800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12 : miss 2024-09-12T00:30:41.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.159+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.159+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.159+0000 7f1145735800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12 info.flags=0x0 2024-09-12T00:30:41.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.159+0000 7f1145735800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12 to cache LRU end 2024-09-12T00:30:41.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.161+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13 : miss 2024-09-12T00:30:41.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.161+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.162+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T00:30:41.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.162+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13 info.flags=0x17 2024-09-12T00:30:41.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.162+0000 7f1145735800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13 to cache LRU end 2024-09-12T00:30:41.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.162+0000 7f1145735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:41.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.162+0000 7f1145735800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:30:41.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.162+0000 7f1145735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13 2024-09-12T00:30:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.163+0000 7f1145735800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:30:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.163+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf9c0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x555e154b0288 s->prefetch_data=0 2024-09-12T00:30:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.163+0000 7f1145735800 10 manifest: total_size = 26081 2024-09-12T00:30:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.163+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3345736107636751087 2024-09-12T00:30:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.163+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf9c0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x555e154b0288 s->prefetch_data=0 2024-09-12T00:30:41.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.163+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0288 2024-09-12T00:30:41.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.163+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13.0 2024-09-12T00:30:41.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-12T00:30:41.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7672 2024-09-12T00:30:41.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7670 2024-09-12T00:30:41.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2024-09-12T00:30:41.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4201976 part_ofs=7672 rule->part_size=7670 2024-09-12T00:30:41.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=7672 2024-09-12T00:30:41.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-12T00:30:41.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4209646 part_ofs=15342 rule->part_size=7672 2024-09-12T00:30:41.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=23014 stripe_ofs=23014 part_ofs=23014 rule->part_size=3067 2024-09-12T00:30:41.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-12T00:30:41.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4217318 part_ofs=23014 rule->part_size=3067 2024-09-12T00:30:41.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=26081 stripe_ofs=26081 part_ofs=26081 rule->part_size=3067 2024-09-12T00:30:41.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3345736107636751087 2024-09-12T00:30:41.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13__multipart_foo.2~RCLKBPWNyni7JjgwSoZafLQ3MBTRPhU.1 2024-09-12T00:30:41.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:30:41.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13__multipart_foo.2~RCLKBPWNyni7JjgwSoZafLQ3MBTRPhU.2 2024-09-12T00:30:41.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:30:41.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13__multipart_foo.2~RCLKBPWNyni7JjgwSoZafLQ3MBTRPhU.3 2024-09-12T00:30:41.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:30:41.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13__multipart_foo.2~RCLKBPWNyni7JjgwSoZafLQ3MBTRPhU.4 2024-09-12T00:30:41.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:30:41.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.166+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3345736107636751087 2024-09-12T00:30:41.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.167+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:30:41.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.167+0000 7f1145735800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:30:41.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.167+0000 7f1145735800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:30:41.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.168+0000 7f1145735800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:30:41.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.168+0000 7f1145735800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:30:41.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.168+0000 7f1145735800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:30:41.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.168+0000 7f1145735800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:30:41.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.168+0000 7f1145735800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13])"; uploads.size()=0; is_truncated=0 2024-09-12T00:30:41.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.169+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T00:30:41.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.169+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.169+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T00:30:41.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.169+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T00:30:41.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.169+0000 7f1145735800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T00:30:41.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.170+0000 7f1145735800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T00:30:41.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.170+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T00:30:41.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.171+0000 7f1024ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497026 cookie 93862572185328 notifier 5756 bl.length()=198 2024-09-12T00:30:41.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.173+0000 7f1145735800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13 from cache 2024-09-12T00:30:41.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.173+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13, ofs0, ns] 2024-09-12T00:30:41.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.173+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497027 cookie 93862572185328 notifier 5756 bl.length()=256 2024-09-12T00:30:41.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.176+0000 7f1145735800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13 : miss 2024-09-12T00:30:41.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.176+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.176+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.176+0000 7f1145735800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13 info.flags=0x0 2024-09-12T00:30:41.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.176+0000 7f1145735800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13 to cache LRU end 2024-09-12T00:30:41.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.178+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11 : miss 2024-09-12T00:30:41.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.178+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.179+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T00:30:41.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.179+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11 info.flags=0x17 2024-09-12T00:30:41.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.179+0000 7f1145735800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11 to cache LRU end 2024-09-12T00:30:41.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.179+0000 7f1145735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:41.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.179+0000 7f1145735800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:30:41.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.179+0000 7f1145735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11 2024-09-12T00:30:41.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.179+0000 7f1145735800 10 cls_bucket_list_unordered: got foo[70OboETsTQxyObdBHAwjXnzAOT5Q-Qh] 2024-09-12T00:30:41.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.179+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11.0 2024-09-12T00:30:41.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.180+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024fc0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.180+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to vlreeynwna1erv92nbtlponjz81pwvbj 2024-09-12T00:30:41.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.180+0000 7f1145735800 20 get_obj_state_impl: setting s->olh_tag to 8264jb2fhcpuj4cyru67u4zhx2th88a7 2024-09-12T00:30:41.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.180+0000 7f1145735800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8264jb2fhcpuj4cyru67u4zhx2th88a7 2024-09-12T00:30:41.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.181+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11.0 2024-09-12T00:30:41.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.183+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11.0 2024-09-12T00:30:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.183+0000 7f1145735800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T00:30:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.183+0000 7f1145735800 20 olh_log_entry: epoch=3 op=3 key=foo[70OboETsTQxyObdBHAwjXnzAOT5Q-Qh] 2024-09-12T00:30:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.183+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024fc0 obj=test-client.0-r-test-multipart-index-versioning.1:_:70OboETsTQxyObdBHAwjXnzAOT5Q-Qh_foo state=0x555e154bbb38 s->prefetch_data=0 2024-09-12T00:30:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.183+0000 7f1145735800 10 manifest: total_size = 1667 2024-09-12T00:30:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.183+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14257137041477800436 2024-09-12T00:30:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.183+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024fc0 obj=test-client.0-r-test-multipart-index-versioning.1:_:70OboETsTQxyObdBHAwjXnzAOT5Q-Qh_foo state=0x555e154bbb38 s->prefetch_data=0 2024-09-12T00:30:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.183+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154bbb38 2024-09-12T00:30:41.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.183+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11.0 2024-09-12T00:30:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.185+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:30:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.185+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-12T00:30:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.185+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:30:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:30:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-12T00:30:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T00:30:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:30:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2024-09-12T00:30:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T00:30:41.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T00:30:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2024-09-12T00:30:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T00:30:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14257137041477800436 2024-09-12T00:30:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11__multipart_foo.2~rL-CMEWiti9aKTugfsGupgl5DrhyCiY.1 2024-09-12T00:30:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:30:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11__multipart_foo.2~rL-CMEWiti9aKTugfsGupgl5DrhyCiY.2 2024-09-12T00:30:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T00:30:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11__multipart_foo.2~rL-CMEWiti9aKTugfsGupgl5DrhyCiY.3 2024-09-12T00:30:41.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T00:30:41.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11__multipart_foo.2~rL-CMEWiti9aKTugfsGupgl5DrhyCiY.4 2024-09-12T00:30:41.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T00:30:41.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.186+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14257137041477800436 2024-09-12T00:30:41.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.187+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo[70OboETsTQxyObdBHAwjXnzAOT5Q-Qh] 2024-09-12T00:30:41.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.188+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024fc0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.189+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11.0 2024-09-12T00:30:41.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.190+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11.0 2024-09-12T00:30:41.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.190+0000 7f1145735800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:30:41.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.190+0000 7f1145735800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:30:41.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.191+0000 7f1145735800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:30:41.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.191+0000 7f1145735800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:30:41.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.191+0000 7f1145735800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:30:41.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.191+0000 7f1145735800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:30:41.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.191+0000 7f1145735800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11])"; uploads.size()=0; is_truncated=0 2024-09-12T00:30:41.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.193+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T00:30:41.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.193+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.193+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T00:30:41.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.193+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T00:30:41.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.193+0000 7f1145735800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T00:30:41.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.195+0000 7f1145735800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T00:30:41.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.195+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T00:30:41.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.195+0000 7f1024ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497028 cookie 93862572185328 notifier 5756 bl.length()=193 2024-09-12T00:30:41.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.197+0000 7f1145735800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11 from cache 2024-09-12T00:30:41.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.197+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11, ofs0, ns] 2024-09-12T00:30:41.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.197+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496974 cookie 93862572226048 notifier 5756 bl.length()=251 2024-09-12T00:30:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.200+0000 7f1145735800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11 : miss 2024-09-12T00:30:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.200+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.200+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.200+0000 7f1145735800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11 info.flags=0x0 2024-09-12T00:30:41.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.200+0000 7f1145735800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11 to cache LRU end 2024-09-12T00:30:41.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.202+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10 : miss 2024-09-12T00:30:41.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.202+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.203+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=449 2024-09-12T00:30:41.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.203+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10 info.flags=0x17 2024-09-12T00:30:41.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.203+0000 7f1145735800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10 to cache LRU end 2024-09-12T00:30:41.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.203+0000 7f1145735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:41.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.203+0000 7f1145735800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:30:41.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.203+0000 7f1145735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10 2024-09-12T00:30:41.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.203+0000 7f1145735800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:30:41.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.203+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0023f0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x555e154b1b98 s->prefetch_data=0 2024-09-12T00:30:41.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.203+0000 7f1145735800 10 manifest: total_size = 74198 2024-09-12T00:30:41.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.203+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2131088183065980155 2024-09-12T00:30:41.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.203+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0023f0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x555e154b1b98 s->prefetch_data=0 2024-09-12T00:30:41.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.203+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b1b98 2024-09-12T00:30:41.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.203+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10.0 2024-09-12T00:30:41.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:30:41.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-12T00:30:41.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:30:41.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:30:41.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-12T00:30:41.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T00:30:41.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:30:41.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-09-12T00:30:41.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T00:30:41.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T00:30:41.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-09-12T00:30:41.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T00:30:41.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2131088183065980155 2024-09-12T00:30:41.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10__multipart_foo.2~pHpOyd8cEylQjqSQO-Qc-1bQRlwQ156.1 2024-09-12T00:30:41.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:30:41.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10__multipart_foo.2~pHpOyd8cEylQjqSQO-Qc-1bQRlwQ156.2 2024-09-12T00:30:41.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:30:41.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10__multipart_foo.2~pHpOyd8cEylQjqSQO-Qc-1bQRlwQ156.3 2024-09-12T00:30:41.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:30:41.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10__multipart_foo.2~pHpOyd8cEylQjqSQO-Qc-1bQRlwQ156.4 2024-09-12T00:30:41.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:30:41.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.206+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2131088183065980155 2024-09-12T00:30:41.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.207+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:30:41.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.207+0000 7f1145735800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:30:41.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.207+0000 7f1145735800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:30:41.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.207+0000 7f1145735800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:30:41.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.207+0000 7f1145735800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:30:41.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.208+0000 7f1145735800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:30:41.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.208+0000 7f1145735800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:30:41.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.208+0000 7f1145735800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10])"; uploads.size()=0; is_truncated=0 2024-09-12T00:30:41.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.209+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T00:30:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.209+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.209+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=227 2024-09-12T00:30:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.209+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T00:30:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.209+0000 7f1145735800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T00:30:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.210+0000 7f1145735800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T00:30:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.210+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T00:30:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.210+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497030 cookie 93862572190688 notifier 5756 bl.length()=183 2024-09-12T00:30:41.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.213+0000 7f1145735800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10 from cache 2024-09-12T00:30:41.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.213+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10, ofs0, ns] 2024-09-12T00:30:41.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.213+0000 7f1024ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 93862572193008 notifier 5756 bl.length()=241 2024-09-12T00:30:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.216+0000 7f1145735800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10 : miss 2024-09-12T00:30:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.216+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.216+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.216+0000 7f1145735800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10 info.flags=0x0 2024-09-12T00:30:41.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.216+0000 7f1145735800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10 to cache LRU end 2024-09-12T00:30:41.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.218+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16 : miss 2024-09-12T00:30:41.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.218+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.218+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:30:41.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.218+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16 info.flags=0x17 2024-09-12T00:30:41.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.218+0000 7f1145735800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16 to cache LRU end 2024-09-12T00:30:41.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.218+0000 7f1145735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:41.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.218+0000 7f1145735800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:30:41.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.218+0000 7f1145735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16 2024-09-12T00:30:41.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:30:41.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:30:41.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:30:41.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:30:41.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:30:41.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:30:41.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:30:41.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:30:41.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:30:41.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:30:41.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:30:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:30:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 20 get_obj_state: octx=0x555e154aca80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 10 manifest: total_size = 5242880 2024-09-12T00:30:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8064800264743934664 2024-09-12T00:30:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 20 get_obj_state: octx=0x555e154aca80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.219+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16.0 2024-09-12T00:30:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.221+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.221+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.221+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.221+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.221+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8064800264743934664 2024-09-12T00:30:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.221+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.221+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.dS5rykLtH5IZ-oIsBBylGKPaZ7phD0F_0 2024-09-12T00:30:41.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.221+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:30:41.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.221+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.dS5rykLtH5IZ-oIsBBylGKPaZ7phD0F_1 2024-09-12T00:30:41.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.221+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T00:30:41.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.221+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.221+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8064800264743934664 2024-09-12T00:30:41.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.223+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:30:41.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.223+0000 7f1145735800 20 get_obj_state: octx=0x555e154aca80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.223+0000 7f1145735800 10 manifest: total_size = 5242880 2024-09-12T00:30:41.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.223+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7381272173716664678 2024-09-12T00:30:41.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.223+0000 7f1145735800 20 get_obj_state: octx=0x555e154aca80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.223+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.223+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16.0 2024-09-12T00:30:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.225+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.225+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.225+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.225+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.225+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7381272173716664678 2024-09-12T00:30:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.225+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.225+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.dS5rykLtH5IZ-oIsBBylGKPaZ7phD0F_0 2024-09-12T00:30:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.225+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:30:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.225+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.dS5rykLtH5IZ-oIsBBylGKPaZ7phD0F_1 2024-09-12T00:30:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.225+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T00:30:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.225+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.225+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7381272173716664678 2024-09-12T00:30:41.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.226+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:30:41.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.226+0000 7f1145735800 20 get_obj_state: octx=0x555e154aca80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.225 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.227+0000 7f1145735800 10 manifest: total_size = 5242880 2024-09-12T00:30:41.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.227+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to _YSpHda2ATjt5HS5kqnC5gYCRmnkt7me 2024-09-12T00:30:41.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.227+0000 7f1145735800 20 get_obj_state: octx=0x555e154aca80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.227+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.227+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16.0 2024-09-12T00:30:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.229+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.229+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.229+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.229+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.229+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: _YSpHda2ATjt5HS5kqnC5gYCRmnkt7me 2024-09-12T00:30:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.229+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.229+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.pwN7rv4ncB2FpOKe4otOfmwUcBqx7uB_0 2024-09-12T00:30:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.229+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:30:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.229+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.pwN7rv4ncB2FpOKe4otOfmwUcBqx7uB_1 2024-09-12T00:30:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.229+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:30:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.229+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.229+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _YSpHda2ATjt5HS5kqnC5gYCRmnkt7me 2024-09-12T00:30:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.230+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:30:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.230+0000 7f1145735800 20 get_obj_state: octx=0x555e154aca80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.231+0000 7f1145735800 10 manifest: total_size = 5242880 2024-09-12T00:30:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.231+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to _SMGZJ9NlZKZ3XlBBW6ABEMBsiKlLU0t 2024-09-12T00:30:41.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.231+0000 7f1145735800 20 get_obj_state: octx=0x555e154aca80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.231+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.231+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16.0 2024-09-12T00:30:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.233+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.233+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.233+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.233+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.233+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: _SMGZJ9NlZKZ3XlBBW6ABEMBsiKlLU0t 2024-09-12T00:30:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.233+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.233+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.9JJ8BHveJDtkOjv-xrwo8tqX8ML5_3N_0 2024-09-12T00:30:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.233+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:30:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.233+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.9JJ8BHveJDtkOjv-xrwo8tqX8ML5_3N_1 2024-09-12T00:30:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.233+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:30:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.233+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.233+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _SMGZJ9NlZKZ3XlBBW6ABEMBsiKlLU0t 2024-09-12T00:30:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.234+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:30:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.235+0000 7f1145735800 20 get_obj_state: octx=0x555e154aca80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.235+0000 7f1145735800 10 manifest: total_size = 5242880 2024-09-12T00:30:41.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.235+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16914219391120722299 2024-09-12T00:30:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.235+0000 7f1145735800 20 get_obj_state: octx=0x555e154aca80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.235+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.235+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16.0 2024-09-12T00:30:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.237+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.237+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.237+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.237+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.237+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16914219391120722299 2024-09-12T00:30:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.237+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.237+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.35Rw128e5WnR61U7Kzb6vD6w3UsGQsr_0 2024-09-12T00:30:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.237+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:30:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.237+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.35Rw128e5WnR61U7Kzb6vD6w3UsGQsr_1 2024-09-12T00:30:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.237+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T00:30:41.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.237+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.237+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16914219391120722299 2024-09-12T00:30:41.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.238+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:30:41.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.238+0000 7f1145735800 20 get_obj_state: octx=0x555e154aca80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.239+0000 7f1145735800 10 manifest: total_size = 5242880 2024-09-12T00:30:41.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.239+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to _u2cMmktziLv_xFLFqLaP_FGCuCZDbvN 2024-09-12T00:30:41.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.239+0000 7f1145735800 20 get_obj_state: octx=0x555e154aca80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.239+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.239+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16.0 2024-09-12T00:30:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.241+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.241+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.241+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.241+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.241+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: _u2cMmktziLv_xFLFqLaP_FGCuCZDbvN 2024-09-12T00:30:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.241+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.241+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.ZePIsvvRk2Ze6ZLmwu-6J9e2f3soAv0_0 2024-09-12T00:30:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.241+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:30:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.241+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.ZePIsvvRk2Ze6ZLmwu-6J9e2f3soAv0_1 2024-09-12T00:30:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.241+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:30:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.241+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.241+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _u2cMmktziLv_xFLFqLaP_FGCuCZDbvN 2024-09-12T00:30:41.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.242+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:30:41.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.242+0000 7f1145735800 20 get_obj_state: octx=0x7f113c004870 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.243+0000 7f1145735800 10 manifest: total_size = 5242880 2024-09-12T00:30:41.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.243+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16835165361772494982 2024-09-12T00:30:41.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.243+0000 7f1145735800 20 get_obj_state: octx=0x7f113c004870 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.243+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.243+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16.0 2024-09-12T00:30:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.245+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.245+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.245+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.245+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.245+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16835165361772494982 2024-09-12T00:30:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.245+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.245+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.35Rw128e5WnR61U7Kzb6vD6w3UsGQsr_0 2024-09-12T00:30:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.245+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:30:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.245+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.35Rw128e5WnR61U7Kzb6vD6w3UsGQsr_1 2024-09-12T00:30:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.245+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T00:30:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.245+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.245+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16835165361772494982 2024-09-12T00:30:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.246+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:30:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.246+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf9c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.247+0000 7f1145735800 10 manifest: total_size = 5242880 2024-09-12T00:30:41.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.247+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to _zcSHuUNK1jMJT6g7951lLT28w-RdtGC 2024-09-12T00:30:41.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.247+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf9c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.247+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.247+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16.0 2024-09-12T00:30:41.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.249+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.249+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.249+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.249+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.249+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: _zcSHuUNK1jMJT6g7951lLT28w-RdtGC 2024-09-12T00:30:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.249+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.249+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.wNpJ0SrQNnzhIF_5GN4zcDh1CB3mCHk_0 2024-09-12T00:30:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.249+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:30:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.249+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.wNpJ0SrQNnzhIF_5GN4zcDh1CB3mCHk_1 2024-09-12T00:30:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.249+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:30:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.249+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.249+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _zcSHuUNK1jMJT6g7951lLT28w-RdtGC 2024-09-12T00:30:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.250+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:30:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.250+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf9c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.251+0000 7f1145735800 10 manifest: total_size = 27197 2024-09-12T00:30:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.251+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18156474396096708581 2024-09-12T00:30:41.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.251+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0bf9c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.251+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.251+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16.0 2024-09-12T00:30:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.253+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.253+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.253+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18156474396096708581 2024-09-12T00:30:41.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.253+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.253+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.lVS-faxMZfcS8pgRKbItJDyX5VneK8j_0 2024-09-12T00:30:41.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.253+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:30:41.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.253+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.253+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18156474396096708581 2024-09-12T00:30:41.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.254+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:30:41.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.254+0000 7f1145735800 20 get_obj_state: octx=0x7f113c004870 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.254+0000 7f1145735800 10 manifest: total_size = 27197 2024-09-12T00:30:41.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.254+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to _gj6QdmiAH9E4iYkC7wIgjvthd5u92W8 2024-09-12T00:30:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.254+0000 7f1145735800 20 get_obj_state: octx=0x7f113c004870 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.254+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.254+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16.0 2024-09-12T00:30:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.257+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.257+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.257+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: _gj6QdmiAH9E4iYkC7wIgjvthd5u92W8 2024-09-12T00:30:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.257+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.257+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.SHsDqO4Q5Vk9lA7LiauxW-Kz7TMqpic_0 2024-09-12T00:30:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.257+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:30:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.257+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.257+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _gj6QdmiAH9E4iYkC7wIgjvthd5u92W8 2024-09-12T00:30:41.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.258+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:30:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.258+0000 7f1145735800 20 get_obj_state: octx=0x7f113c004870 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.258+0000 7f1145735800 10 manifest: total_size = 27197 2024-09-12T00:30:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.258+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to _b88QZv_CINSPaVMAReynZV0UYdKtOC5 2024-09-12T00:30:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.258+0000 7f1145735800 20 get_obj_state: octx=0x7f113c004870 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.258+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.258+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16.0 2024-09-12T00:30:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.261+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.261+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.261+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: _b88QZv_CINSPaVMAReynZV0UYdKtOC5 2024-09-12T00:30:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.261+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.261+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.3GzaNe6HxEkKyP9bTSoIZR-gNr0byr__0 2024-09-12T00:30:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.261+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:30:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.261+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.261+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _b88QZv_CINSPaVMAReynZV0UYdKtOC5 2024-09-12T00:30:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.262+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:30:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.262+0000 7f1145735800 20 get_obj_state: octx=0x7f113c004870 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.263+0000 7f1145735800 10 manifest: total_size = 27197 2024-09-12T00:30:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.263+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13396176621811548001 2024-09-12T00:30:41.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.263+0000 7f1145735800 20 get_obj_state: octx=0x7f113c004870 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.263+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.263+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16.0 2024-09-12T00:30:41.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.265+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.265+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=27197 stripe_ofs=27197 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.265+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13396176621811548001 2024-09-12T00:30:41.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.265+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.265+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.lVS-faxMZfcS8pgRKbItJDyX5VneK8j_0 2024-09-12T00:30:41.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.265+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:30:41.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.265+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.265+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13396176621811548001 2024-09-12T00:30:41.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.266+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:30:41.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.266+0000 7f1145735800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:30:41.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.266+0000 7f1145735800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:30:41.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.267+0000 7f1145735800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:30:41.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.267+0000 7f1145735800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:30:41.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.267+0000 7f1145735800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:30:41.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.267+0000 7f1145735800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:30:41.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.267+0000 7f1145735800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16])"; uploads.size()=0; is_truncated=0 2024-09-12T00:30:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.268+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T00:30:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.268+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.269+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T00:30:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.269+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T00:30:41.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.269+0000 7f1145735800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T00:30:41.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.270+0000 7f1145735800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T00:30:41.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.270+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T00:30:41.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.270+0000 7f1024ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497029 cookie 93862572185328 notifier 5756 bl.length()=189 2024-09-12T00:30:41.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.276+0000 7f1145735800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16 from cache 2024-09-12T00:30:41.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.276+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16, ofs0, ns] 2024-09-12T00:30:41.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.276+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496975 cookie 93862572226048 notifier 5756 bl.length()=247 2024-09-12T00:30:41.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.279+0000 7f1145735800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16 : miss 2024-09-12T00:30:41.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.279+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.279+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.279+0000 7f1145735800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16 info.flags=0x0 2024-09-12T00:30:41.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.279+0000 7f1145735800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16 to cache LRU end 2024-09-12T00:30:41.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.283+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17 : miss 2024-09-12T00:30:41.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.283+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.284+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:30:41.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.284+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17 info.flags=0x17 2024-09-12T00:30:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.284+0000 7f1145735800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17 to cache LRU end 2024-09-12T00:30:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.284+0000 7f1145735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.284+0000 7f1145735800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:30:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.284+0000 7f1145735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17 2024-09-12T00:30:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:30:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:30:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:30:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:30:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:30:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:30:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:30:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:30:41.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:30:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:30:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:30:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:30:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0023f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 10 manifest: total_size = 11534336 2024-09-12T00:30:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15561279657264820935 2024-09-12T00:30:41.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 20 get_obj_state: octx=0x7f113c0023f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.285+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17.0 2024-09-12T00:30:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:30:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:30:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15561279657264820935 2024-09-12T00:30:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.1 2024-09-12T00:30:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:30:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.1_1 2024-09-12T00:30:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-12T00:30:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.2 2024-09-12T00:30:41.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-12T00:30:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.2_1 2024-09-12T00:30:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-12T00:30:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.3 2024-09-12T00:30:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-12T00:30:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.288+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15561279657264820935 2024-09-12T00:30:41.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.289+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:30:41.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.289+0000 7f1145735800 20 get_obj_state: octx=0x7f113c05b500 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.290+0000 7f1145735800 10 manifest: total_size = 11534336 2024-09-12T00:30:41.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.290+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8739048697073155014 2024-09-12T00:30:41.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.290+0000 7f1145735800 20 get_obj_state: octx=0x7f113c05b500 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.290+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.290+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17.0 2024-09-12T00:30:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:30:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:30:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8739048697073155014 2024-09-12T00:30:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.1 2024-09-12T00:30:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:30:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.1_1 2024-09-12T00:30:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T00:30:41.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.2 2024-09-12T00:30:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T00:30:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.2_1 2024-09-12T00:30:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T00:30:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.3 2024-09-12T00:30:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T00:30:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.292+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8739048697073155014 2024-09-12T00:30:41.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.293+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:30:41.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.294+0000 7f1145735800 20 get_obj_state: octx=0x555e154abb00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.295+0000 7f1145735800 10 manifest: total_size = 11534336 2024-09-12T00:30:41.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.295+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to _twF7FYq1ii30GlxoOQHWp8Lt7aKTIiP 2024-09-12T00:30:41.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.295+0000 7f1145735800 20 get_obj_state: octx=0x555e154abb00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.295+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.295+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17.0 2024-09-12T00:30:41.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: _twF7FYq1ii30GlxoOQHWp8Lt7aKTIiP 2024-09-12T00:30:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.YaQg5p3IsNQaPs0wyXDZTYa5yHnSL2n_0 2024-09-12T00:30:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:30:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.YaQg5p3IsNQaPs0wyXDZTYa5yHnSL2n_1 2024-09-12T00:30:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:30:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.YaQg5p3IsNQaPs0wyXDZTYa5yHnSL2n_2 2024-09-12T00:30:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T00:30:41.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.297+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _twF7FYq1ii30GlxoOQHWp8Lt7aKTIiP 2024-09-12T00:30:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.298+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:30:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.298+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024de0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.298+0000 7f1145735800 10 manifest: total_size = 11534336 2024-09-12T00:30:41.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.298+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to _ZYLQW2Ikv4JqKpQKaZBsobyaI36j3NO 2024-09-12T00:30:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.298+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024de0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.298+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.298+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17.0 2024-09-12T00:30:41.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: _ZYLQW2Ikv4JqKpQKaZBsobyaI36j3NO 2024-09-12T00:30:41.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.L0uQCmWDDlUeB9eJbu6Gtzivp-6BbHW_0 2024-09-12T00:30:41.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:30:41.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.L0uQCmWDDlUeB9eJbu6Gtzivp-6BbHW_1 2024-09-12T00:30:41.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:30:41.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.L0uQCmWDDlUeB9eJbu6Gtzivp-6BbHW_2 2024-09-12T00:30:41.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T00:30:41.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.301+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _ZYLQW2Ikv4JqKpQKaZBsobyaI36j3NO 2024-09-12T00:30:41.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.304+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:30:41.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.304+0000 7f1145735800 20 get_obj_state: octx=0x555e154aa820 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.304+0000 7f1145735800 10 manifest: total_size = 11534336 2024-09-12T00:30:41.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.304+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18169384713550838427 2024-09-12T00:30:41.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.304+0000 7f1145735800 20 get_obj_state: octx=0x555e154aa820 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.304+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.304+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17.0 2024-09-12T00:30:41.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:30:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:30:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18169384713550838427 2024-09-12T00:30:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.1 2024-09-12T00:30:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:30:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.1_1 2024-09-12T00:30:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T00:30:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.2 2024-09-12T00:30:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T00:30:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.2_1 2024-09-12T00:30:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T00:30:41.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.3 2024-09-12T00:30:41.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T00:30:41.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.307+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18169384713550838427 2024-09-12T00:30:41.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.309+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:30:41.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.310+0000 7f1145735800 20 get_obj_state: octx=0x7f113c05b500 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.310+0000 7f1145735800 10 manifest: total_size = 11534336 2024-09-12T00:30:41.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.310+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to _RsQqYd6poNW1REWUvfBE-p3vj-tRUMm 2024-09-12T00:30:41.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.310+0000 7f1145735800 20 get_obj_state: octx=0x7f113c05b500 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.310+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.310+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17.0 2024-09-12T00:30:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: _RsQqYd6poNW1REWUvfBE-p3vj-tRUMm 2024-09-12T00:30:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.Yo_K28yTSOhQi9w8OeMD4vo1obMUKrx_0 2024-09-12T00:30:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:30:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.Yo_K28yTSOhQi9w8OeMD4vo1obMUKrx_1 2024-09-12T00:30:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:30:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.Yo_K28yTSOhQi9w8OeMD4vo1obMUKrx_2 2024-09-12T00:30:41.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T00:30:41.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.312+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _RsQqYd6poNW1REWUvfBE-p3vj-tRUMm 2024-09-12T00:30:41.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.313+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:30:41.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.313+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024de0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.314+0000 7f1145735800 10 manifest: total_size = 11534336 2024-09-12T00:30:41.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.314+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18355379725649062442 2024-09-12T00:30:41.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.314+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024de0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.314+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.314+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17.0 2024-09-12T00:30:41.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:30:41.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:30:41.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18355379725649062442 2024-09-12T00:30:41.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.1 2024-09-12T00:30:41.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:30:41.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.1_1 2024-09-12T00:30:41.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T00:30:41.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.2 2024-09-12T00:30:41.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T00:30:41.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.2_1 2024-09-12T00:30:41.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T00:30:41.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.3 2024-09-12T00:30:41.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T00:30:41.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.316+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18355379725649062442 2024-09-12T00:30:41.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.317+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:30:41.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.318+0000 7f1145735800 20 get_obj_state: octx=0x555e154b85d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.318+0000 7f1145735800 10 manifest: total_size = 11534336 2024-09-12T00:30:41.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.318+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to _0NwEG3Bxw3IH8rVx6R7AbPAfRRYeeH4 2024-09-12T00:30:41.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.318+0000 7f1145735800 20 get_obj_state: octx=0x555e154b85d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.318+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.318+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17.0 2024-09-12T00:30:41.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: _0NwEG3Bxw3IH8rVx6R7AbPAfRRYeeH4 2024-09-12T00:30:41.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.kCNN4IZHhyicmX4hTjMQI44uMke-N0y_0 2024-09-12T00:30:41.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:30:41.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.kCNN4IZHhyicmX4hTjMQI44uMke-N0y_1 2024-09-12T00:30:41.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:30:41.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.kCNN4IZHhyicmX4hTjMQI44uMke-N0y_2 2024-09-12T00:30:41.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T00:30:41.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.320+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _0NwEG3Bxw3IH8rVx6R7AbPAfRRYeeH4 2024-09-12T00:30:41.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.321+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:30:41.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.322+0000 7f1145735800 20 get_obj_state: octx=0x7f113c05b500 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.322+0000 7f1145735800 10 manifest: total_size = 11534336 2024-09-12T00:30:41.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.322+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11877829241141441864 2024-09-12T00:30:41.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.322+0000 7f1145735800 20 get_obj_state: octx=0x7f113c05b500 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.322+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.322+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17.0 2024-09-12T00:30:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:30:41.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:30:41.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11877829241141441864 2024-09-12T00:30:41.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.1 2024-09-12T00:30:41.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:30:41.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.1_1 2024-09-12T00:30:41.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-12T00:30:41.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.2 2024-09-12T00:30:41.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-12T00:30:41.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.2_1 2024-09-12T00:30:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1153 2024-09-12T00:30:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.3 2024-09-12T00:30:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1417 2024-09-12T00:30:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.324+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11877829241141441864 2024-09-12T00:30:41.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.325+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:30:41.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.325+0000 7f1145735800 20 get_obj_state: octx=0x555e154aae60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.326+0000 7f1145735800 10 manifest: total_size = 11534336 2024-09-12T00:30:41.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.326+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to _15qlzNMTsWnlZ6z3gLMr1FCmPvzwyeY 2024-09-12T00:30:41.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.326+0000 7f1145735800 20 get_obj_state: octx=0x555e154aae60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.326+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.326+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17.0 2024-09-12T00:30:41.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: _15qlzNMTsWnlZ6z3gLMr1FCmPvzwyeY 2024-09-12T00:30:41.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.1vZij-WBkO43PIpSFHqiW58r5FOkBhV_0 2024-09-12T00:30:41.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:30:41.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.1vZij-WBkO43PIpSFHqiW58r5FOkBhV_1 2024-09-12T00:30:41.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:30:41.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.1vZij-WBkO43PIpSFHqiW58r5FOkBhV_2 2024-09-12T00:30:41.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T00:30:41.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.328+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _15qlzNMTsWnlZ6z3gLMr1FCmPvzwyeY 2024-09-12T00:30:41.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.329+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:30:41.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.329+0000 7f1145735800 20 get_obj_state: octx=0x555e154aae60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.329+0000 7f1145735800 10 manifest: total_size = 11534336 2024-09-12T00:30:41.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.329+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to _RrdlT1noVzrbTB15RJ5ubi8cm_XsxJT 2024-09-12T00:30:41.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.329+0000 7f1145735800 20 get_obj_state: octx=0x555e154aae60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.329+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.329+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17.0 2024-09-12T00:30:41.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: _RrdlT1noVzrbTB15RJ5ubi8cm_XsxJT 2024-09-12T00:30:41.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.I9rIwUW-umRdHyyJsGaWT2gR9FlD-sG_0 2024-09-12T00:30:41.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:30:41.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.I9rIwUW-umRdHyyJsGaWT2gR9FlD-sG_1 2024-09-12T00:30:41.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:30:41.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.I9rIwUW-umRdHyyJsGaWT2gR9FlD-sG_2 2024-09-12T00:30:41.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T00:30:41.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.332+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _RrdlT1noVzrbTB15RJ5ubi8cm_XsxJT 2024-09-12T00:30:41.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.333+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:30:41.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.333+0000 7f1145735800 20 get_obj_state: octx=0x555e154aae60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.333+0000 7f1145735800 10 manifest: total_size = 11534336 2024-09-12T00:30:41.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.333+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10169134219292169755 2024-09-12T00:30:41.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.333+0000 7f1145735800 20 get_obj_state: octx=0x555e154aae60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x555e154b0218 s->prefetch_data=0 2024-09-12T00:30:41.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.333+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154b0218 2024-09-12T00:30:41.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.334+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17.0 2024-09-12T00:30:41.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:30:41.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:30:41.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10169134219292169755 2024-09-12T00:30:41.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.1 2024-09-12T00:30:41.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:30:41.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.1_1 2024-09-12T00:30:41.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-12T00:30:41.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.2 2024-09-12T00:30:41.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-12T00:30:41.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.2_1 2024-09-12T00:30:41.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1153 2024-09-12T00:30:41.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.3 2024-09-12T00:30:41.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1417 2024-09-12T00:30:41.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.336+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10169134219292169755 2024-09-12T00:30:41.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.337+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:30:41.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.337+0000 7f1145735800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:30:41.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.337+0000 7f1145735800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:30:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.337+0000 7f1145735800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:30:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.337+0000 7f1145735800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:30:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.337+0000 7f1145735800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:30:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.337+0000 7f1145735800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:30:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.337+0000 7f1145735800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17])"; uploads.size()=0; is_truncated=0 2024-09-12T00:30:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.339+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T00:30:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.339+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.339+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T00:30:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.339+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T00:30:41.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.339+0000 7f1145735800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T00:30:41.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.340+0000 7f1145735800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T00:30:41.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.340+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T00:30:41.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.340+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496978 cookie 93862572187968 notifier 5756 bl.length()=199 2024-09-12T00:30:41.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.343+0000 7f1145735800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17 from cache 2024-09-12T00:30:41.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.343+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17, ofs0, ns] 2024-09-12T00:30:41.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.344+0000 7f1024ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496979 cookie 93862572187968 notifier 5756 bl.length()=257 2024-09-12T00:30:41.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.346+0000 7f1145735800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17 : miss 2024-09-12T00:30:41.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.346+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.346+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.346+0000 7f1145735800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17 info.flags=0x0 2024-09-12T00:30:41.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.346+0000 7f1145735800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17 to cache LRU end 2024-09-12T00:30:41.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.348+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15 : miss 2024-09-12T00:30:41.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.348+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.349+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:30:41.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.349+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15 info.flags=0x17 2024-09-12T00:30:41.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.349+0000 7f1145735800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15 to cache LRU end 2024-09-12T00:30:41.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.349+0000 7f1145735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:41.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.349+0000 7f1145735800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:30:41.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.349+0000 7f1145735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15 2024-09-12T00:30:41.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.349+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:30:41.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.349+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:30:41.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.349+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:30:41.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.349+0000 7f1145735800 20 get_obj_state: octx=0x555e154b8b50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x555e154c0f98 s->prefetch_data=0 2024-09-12T00:30:41.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.350+0000 7f1145735800 10 manifest: total_size = 11534336 2024-09-12T00:30:41.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.350+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14178558814477457058 2024-09-12T00:30:41.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.350+0000 7f1145735800 20 get_obj_state: octx=0x555e154b8b50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x555e154c0f98 s->prefetch_data=0 2024-09-12T00:30:41.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.350+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154c0f98 2024-09-12T00:30:41.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.350+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15.0 2024-09-12T00:30:41.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:30:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:30:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14178558814477457058 2024-09-12T00:30:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-FROZEN.2~-yLdGTv4btq77xK5FiWLD6f6GcJhKnf.1 2024-09-12T00:30:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:30:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__shadow_foo-FROZEN.2~-yLdGTv4btq77xK5FiWLD6f6GcJhKnf.1_1 2024-09-12T00:30:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-12T00:30:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-FROZEN.2~-yLdGTv4btq77xK5FiWLD6f6GcJhKnf.2 2024-09-12T00:30:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-12T00:30:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__shadow_foo-FROZEN.2~-yLdGTv4btq77xK5FiWLD6f6GcJhKnf.2_1 2024-09-12T00:30:41.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-12T00:30:41.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-FROZEN.2~-yLdGTv4btq77xK5FiWLD6f6GcJhKnf.3 2024-09-12T00:30:41.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-12T00:30:41.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.352+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14178558814477457058 2024-09-12T00:30:41.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.353+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:30:41.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.353+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024860 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x555e154c0f98 s->prefetch_data=0 2024-09-12T00:30:41.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.354+0000 7f1145735800 10 manifest: total_size = 11534336 2024-09-12T00:30:41.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.354+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8371394538569112823 2024-09-12T00:30:41.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.354+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024860 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x555e154c0f98 s->prefetch_data=0 2024-09-12T00:30:41.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.354+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154c0f98 2024-09-12T00:30:41.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.354+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15.0 2024-09-12T00:30:41.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:30:41.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:30:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:30:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:30:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:30:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:30:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8371394538569112823 2024-09-12T00:30:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-LUKEWARM.2~WHuuw37x1jDBWj97OEF_2lYzVkuh5PK.1 2024-09-12T00:30:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:30:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__shadow_foo-LUKEWARM.2~WHuuw37x1jDBWj97OEF_2lYzVkuh5PK.1_1 2024-09-12T00:30:41.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T00:30:41.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-LUKEWARM.2~WHuuw37x1jDBWj97OEF_2lYzVkuh5PK.2 2024-09-12T00:30:41.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T00:30:41.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__shadow_foo-LUKEWARM.2~WHuuw37x1jDBWj97OEF_2lYzVkuh5PK.2_1 2024-09-12T00:30:41.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T00:30:41.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-LUKEWARM.2~WHuuw37x1jDBWj97OEF_2lYzVkuh5PK.3 2024-09-12T00:30:41.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T00:30:41.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.356+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8371394538569112823 2024-09-12T00:30:41.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.357+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:30:41.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.359+0000 7f1145735800 20 get_obj_state: octx=0x555e15523aa0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x555e154c0f98 s->prefetch_data=0 2024-09-12T00:30:41.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.359+0000 7f1145735800 10 manifest: total_size = 1087 2024-09-12T00:30:41.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.359+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.441489104616038382 2024-09-12T00:30:41.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.359+0000 7f1145735800 20 get_obj_state: octx=0x555e15523aa0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x555e154c0f98 s->prefetch_data=0 2024-09-12T00:30:41.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.359+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154c0f98 2024-09-12T00:30:41.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.359+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15.0 2024-09-12T00:30:41.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:30:41.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-12T00:30:41.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:30:41.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:30:41.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-12T00:30:41.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T00:30:41.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T00:30:41.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=55 2024-09-12T00:30:41.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T00:30:41.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.441489104616038382 2024-09-12T00:30:41.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-STANDARD.2~LOmRhTtdxsIYc9SzrAxJ7iJfK6zPXzd.1 2024-09-12T00:30:41.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 363 2024-09-12T00:30:41.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-STANDARD.2~LOmRhTtdxsIYc9SzrAxJ7iJfK6zPXzd.2 2024-09-12T00:30:41.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-12T00:30:41.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-STANDARD.2~LOmRhTtdxsIYc9SzrAxJ7iJfK6zPXzd.3 2024-09-12T00:30:41.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-12T00:30:41.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.362+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.441489104616038382 2024-09-12T00:30:41.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.363+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:30:41.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.363+0000 7f1145735800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:30:41.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.363+0000 7f1145735800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:30:41.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.363+0000 7f1145735800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:30:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.363+0000 7f1145735800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:30:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.363+0000 7f1145735800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:30:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.363+0000 7f1145735800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:30:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.363+0000 7f1145735800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15])"; uploads.size()=0; is_truncated=0 2024-09-12T00:30:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.365+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T00:30:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.365+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.365+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T00:30:41.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.365+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T00:30:41.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.365+0000 7f1145735800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T00:30:41.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.366+0000 7f1145735800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T00:30:41.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.366+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T00:30:41.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.366+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496995 cookie 93862572223840 notifier 5756 bl.length()=194 2024-09-12T00:30:41.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.369+0000 7f1145735800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15 from cache 2024-09-12T00:30:41.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.369+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15, ofs0, ns] 2024-09-12T00:30:41.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.369+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496980 cookie 93862572187968 notifier 5756 bl.length()=252 2024-09-12T00:30:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.371+0000 7f1145735800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15 : miss 2024-09-12T00:30:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.371+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.371+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.371+0000 7f1145735800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15 info.flags=0x0 2024-09-12T00:30:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.371+0000 7f1145735800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15 to cache LRU end 2024-09-12T00:30:41.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.374+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14 : miss 2024-09-12T00:30:41.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.374+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.374+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T00:30:41.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.374+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14 info.flags=0x17 2024-09-12T00:30:41.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.374+0000 7f1145735800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14 to cache LRU end 2024-09-12T00:30:41.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.374+0000 7f1145735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:41.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.374+0000 7f1145735800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:30:41.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.374+0000 7f1145735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14 2024-09-12T00:30:41.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.375+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:30:41.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.375+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:30:41.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.375+0000 7f1145735800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:30:41.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.375+0000 7f1145735800 20 get_obj_state: octx=0x555e154bf140 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x555e154bf4e8 s->prefetch_data=0 2024-09-12T00:30:41.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.375+0000 7f1145735800 10 manifest: total_size = 10485760 2024-09-12T00:30:41.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.375+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16144857130774582374 2024-09-12T00:30:41.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.375+0000 7f1145735800 20 get_obj_state: octx=0x555e154bf140 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x555e154bf4e8 s->prefetch_data=0 2024-09-12T00:30:41.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.375+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154bf4e8 2024-09-12T00:30:41.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.375+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14.0 2024-09-12T00:30:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16144857130774582374 2024-09-12T00:30:41.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14__shadow_.jgXk_uPqgVDqM0Everzyrpo-4Es8WLp_0 2024-09-12T00:30:41.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:30:41.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14__shadow_.jgXk_uPqgVDqM0Everzyrpo-4Es8WLp_1 2024-09-12T00:30:41.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T00:30:41.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14__shadow_.jgXk_uPqgVDqM0Everzyrpo-4Es8WLp_2 2024-09-12T00:30:41.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-09-12T00:30:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.378+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16144857130774582374 2024-09-12T00:30:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.379+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:30:41.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.381+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024860 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x555e154bf4e8 s->prefetch_data=0 2024-09-12T00:30:41.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.382+0000 7f1145735800 10 manifest: total_size = 10485760 2024-09-12T00:30:41.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.382+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5495384825731587366 2024-09-12T00:30:41.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.382+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024860 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x555e154bf4e8 s->prefetch_data=0 2024-09-12T00:30:41.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.382+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154bf4e8 2024-09-12T00:30:41.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.382+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14.0 2024-09-12T00:30:41.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5495384825731587366 2024-09-12T00:30:41.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14__shadow_.CWAo7IkBr1XLG9PuPFHWIKch3e5UGMb_0 2024-09-12T00:30:41.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:30:41.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14__shadow_.CWAo7IkBr1XLG9PuPFHWIKch3e5UGMb_1 2024-09-12T00:30:41.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:30:41.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14__shadow_.CWAo7IkBr1XLG9PuPFHWIKch3e5UGMb_2 2024-09-12T00:30:41.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2024-09-12T00:30:41.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.385+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5495384825731587366 2024-09-12T00:30:41.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.386+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:30:41.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.386+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024610 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x555e154bf4e8 s->prefetch_data=0 2024-09-12T00:30:41.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.386+0000 7f1145735800 10 manifest: total_size = 3306 2024-09-12T00:30:41.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.386+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12666281498458140962 2024-09-12T00:30:41.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.386+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024610 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x555e154bf4e8 s->prefetch_data=0 2024-09-12T00:30:41.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.386+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154bf4e8 2024-09-12T00:30:41.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.386+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14.0 2024-09-12T00:30:41.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.388+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.388+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=3306 stripe_ofs=3306 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.388+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12666281498458140962 2024-09-12T00:30:41.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.388+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.388+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14__shadow_.PY7YhWkdkMpBMb-TSpSMRik9zXZMGny_0 2024-09-12T00:30:41.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.388+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:30:41.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.388+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.388+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12666281498458140962 2024-09-12T00:30:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.390+0000 7f1013fff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:30:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.390+0000 7f1145735800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:30:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.390+0000 7f1145735800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:30:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.390+0000 7f1145735800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:30:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.390+0000 7f1145735800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:30:41.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.390+0000 7f1145735800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:30:41.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.390+0000 7f1145735800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:30:41.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.390+0000 7f1145735800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14])"; uploads.size()=0; is_truncated=0 2024-09-12T00:30:41.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.392+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T00:30:41.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.392+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.392+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T00:30:41.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.392+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T00:30:41.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.392+0000 7f1145735800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T00:30:41.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.393+0000 7f1145735800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T00:30:41.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.393+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T00:30:41.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.393+0000 7f1024ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497030 cookie 93862572185328 notifier 5756 bl.length()=184 2024-09-12T00:30:41.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.396+0000 7f1145735800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14 from cache 2024-09-12T00:30:41.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.396+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14, ofs0, ns] 2024-09-12T00:30:41.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.396+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497031 cookie 93862572185328 notifier 5756 bl.length()=242 2024-09-12T00:30:41.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.398+0000 7f1145735800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14 : miss 2024-09-12T00:30:41.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.399+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.399+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.399+0000 7f1145735800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14 info.flags=0x0 2024-09-12T00:30:41.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.399+0000 7f1145735800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14 to cache LRU end 2024-09-12T00:30:41.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.401+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7 : miss 2024-09-12T00:30:41.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.401+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:30:41.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7 info.flags=0x17 2024-09-12T00:30:41.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7 to cache LRU end 2024-09-12T00:30:41.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:41.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:30:41.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7 2024-09-12T00:30:41.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:30:41.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:30:41.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:30:41.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:30:41.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 20 get_obj_state: octx=0x555e154ab880 obj=test-client.0-r-test-small-obj-data.1:__ state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 10 manifest: total_size = 0 2024-09-12T00:30:41.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4921337961380311784 2024-09-12T00:30:41.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 20 get_obj_state: octx=0x555e154ab880 obj=test-client.0-r-test-small-obj-data.1:__ state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154a90f8 2024-09-12T00:30:41.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.402+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7.0 2024-09-12T00:30:41.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.405+0000 7f1145735800 20 get_obj_state: octx=0x555e154b8f00 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.405+0000 7f1145735800 10 manifest: total_size = 0 2024-09-12T00:30:41.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.405+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12317520690308159928 2024-09-12T00:30:41.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.405+0000 7f1145735800 20 get_obj_state: octx=0x555e154b8f00 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.405+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154a90f8 2024-09-12T00:30:41.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.405+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7.0 2024-09-12T00:30:41.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.406+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:30:41.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.407+0000 7f1145735800 20 get_obj_state: octx=0x7f113c07a890 obj=test-client.0-r-test-small-obj-data.1:___ state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.408+0000 7f1145735800 10 manifest: total_size = 0 2024-09-12T00:30:41.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.408+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4239611408483147527 2024-09-12T00:30:41.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.408+0000 7f1145735800 20 get_obj_state: octx=0x7f113c07a890 obj=test-client.0-r-test-small-obj-data.1:___ state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.408+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154a90f8 2024-09-12T00:30:41.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.408+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7.0 2024-09-12T00:30:41.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.409+0000 7f1013fff640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:30:41.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.410+0000 7f1145735800 20 get_obj_state: octx=0x555e154abff0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.411+0000 7f1145735800 10 manifest: total_size = 0 2024-09-12T00:30:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.411+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7286552278887876129 2024-09-12T00:30:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.411+0000 7f1145735800 20 get_obj_state: octx=0x555e154abff0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.411+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154a90f8 2024-09-12T00:30:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.411+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7.0 2024-09-12T00:30:41.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.411+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:30:41.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.413+0000 7f1145735800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:30:41.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.413+0000 7f1145735800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:30:41.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.414+0000 7f1013fff640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:30:41.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.414+0000 7f1145735800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:30:41.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.414+0000 7f1145735800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:30:41.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.414+0000 7f1145735800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:30:41.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.414+0000 7f1145735800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:30:41.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.414+0000 7f1145735800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7])"; uploads.size()=0; is_truncated=0 2024-09-12T00:30:41.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.415+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T00:30:41.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.415+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.416+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:30:41.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.416+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T00:30:41.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.416+0000 7f1145735800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T00:30:41.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.417+0000 7f1145735800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T00:30:41.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.417+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T00:30:41.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.417+0000 7f1024ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497031 cookie 93862572230384 notifier 5756 bl.length()=181 2024-09-12T00:30:41.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.419+0000 7f1145735800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7 from cache 2024-09-12T00:30:41.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.419+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7, ofs0, ns] 2024-09-12T00:30:41.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.420+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497032 cookie 93862572190688 notifier 5756 bl.length()=238 2024-09-12T00:30:41.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.422+0000 7f1145735800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7 : miss 2024-09-12T00:30:41.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.422+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.422+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.422+0000 7f1145735800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7 info.flags=0x0 2024-09-12T00:30:41.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.422+0000 7f1145735800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7 to cache LRU end 2024-09-12T00:30:41.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.425+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8 : miss 2024-09-12T00:30:41.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.425+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.425+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:30:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.425+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8 info.flags=0x17 2024-09-12T00:30:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.425+0000 7f1145735800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8 to cache LRU end 2024-09-12T00:30:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.425+0000 7f1145735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.425+0000 7f1145735800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:30:41.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.425+0000 7f1145735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8 2024-09-12T00:30:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.426+0000 7f1145735800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:30:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.426+0000 7f1145735800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:30:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.426+0000 7f1145735800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:30:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.426+0000 7f1145735800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:30:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.426+0000 7f1145735800 20 get_obj_state: octx=0x555e154a54c0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.426+0000 7f1145735800 10 manifest: total_size = 24595 2024-09-12T00:30:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.426+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4302274082272743010 2024-09-12T00:30:41.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.426+0000 7f1145735800 20 get_obj_state: octx=0x555e154a54c0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.426+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154a90f8 2024-09-12T00:30:41.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.426+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8.0 2024-09-12T00:30:41.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.429+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.429+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.429+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4302274082272743010 2024-09-12T00:30:41.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.429+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.429+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8__shadow_.LRNwxNAfUF0oPQ2AyHJrXnKw7L_ciaB_0 2024-09-12T00:30:41.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.429+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:30:41.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.429+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.429+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4302274082272743010 2024-09-12T00:30:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.430+0000 7f1013fff640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:30:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.430+0000 7f1145735800 20 get_obj_state: octx=0x7f113c05b500 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.431+0000 7f1145735800 10 manifest: total_size = 524288 2024-09-12T00:30:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.431+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11935203261270097221 2024-09-12T00:30:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.431+0000 7f1145735800 20 get_obj_state: octx=0x7f113c05b500 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.431+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154a90f8 2024-09-12T00:30:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.431+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8.0 2024-09-12T00:30:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.433+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.433+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.433+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11935203261270097221 2024-09-12T00:30:41.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.433+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.433+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8__shadow_.SeNPJLDsHQ01LUj-qcddQvrl3MNJf94_0 2024-09-12T00:30:41.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.433+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:30:41.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.433+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.433+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11935203261270097221 2024-09-12T00:30:41.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.434+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:30:41.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.434+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024de0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.434+0000 7f1145735800 10 manifest: total_size = 524288 2024-09-12T00:30:41.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.434+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13490213931473816435 2024-09-12T00:30:41.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.434+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024de0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.434+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154a90f8 2024-09-12T00:30:41.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.434+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8.0 2024-09-12T00:30:41.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.437+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.437+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.437+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13490213931473816435 2024-09-12T00:30:41.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.437+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.437+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8__shadow_.4_13PlF3k6CR8hRyBzE09PgafxJM9dS_0 2024-09-12T00:30:41.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.437+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:30:41.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.437+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.437+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13490213931473816435 2024-09-12T00:30:41.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.438+0000 7f1013fff640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:30:41.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.438+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024610 obj=test-client.0-r-test-small-obj-data.2:obj state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.438+0000 7f1145735800 10 manifest: total_size = 527 2024-09-12T00:30:41.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.438+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15462176321018590785 2024-09-12T00:30:41.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.438+0000 7f1145735800 20 get_obj_state: octx=0x7f1134024610 obj=test-client.0-r-test-small-obj-data.2:obj state=0x555e154a90f8 s->prefetch_data=0 2024-09-12T00:30:41.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.438+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154a90f8 2024-09-12T00:30:41.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.438+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8.0 2024-09-12T00:30:41.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.440+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.440+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.441+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15462176321018590785 2024-09-12T00:30:41.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.441+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.441+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8__shadow_.92-4EwbAbJKkNUOASYm48jJaLp8F37b_0 2024-09-12T00:30:41.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.441+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:30:41.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.441+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.441+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15462176321018590785 2024-09-12T00:30:41.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.442+0000 7f1145735800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:30:41.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.442+0000 7f1145735800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:30:41.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.442+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:30:41.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.442+0000 7f1145735800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:30:41.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.442+0000 7f1145735800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:30:41.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.442+0000 7f1145735800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:30:41.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.442+0000 7f1145735800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:30:41.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.442+0000 7f1145735800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8])"; uploads.size()=0; is_truncated=0 2024-09-12T00:30:41.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.443+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T00:30:41.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.443+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.444+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:30:41.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.444+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T00:30:41.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.444+0000 7f1145735800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T00:30:41.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.445+0000 7f1145735800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T00:30:41.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.445+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T00:30:41.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.445+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497033 cookie 93862572230384 notifier 5756 bl.length()=181 2024-09-12T00:30:41.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.448+0000 7f1145735800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8 from cache 2024-09-12T00:30:41.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.448+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8, ofs0, ns] 2024-09-12T00:30:41.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.448+0000 7f1024ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497034 cookie 93862572190688 notifier 5756 bl.length()=238 2024-09-12T00:30:41.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.450+0000 7f1145735800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8 : miss 2024-09-12T00:30:41.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.450+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.450+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.450+0000 7f1145735800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8 info.flags=0x0 2024-09-12T00:30:41.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.450+0000 7f1145735800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8 to cache LRU end 2024-09-12T00:30:41.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.452+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9 : miss 2024-09-12T00:30:41.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.452+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.453+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:30:41.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.453+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9 info.flags=0x17 2024-09-12T00:30:41.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.453+0000 7f1145735800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9 to cache LRU end 2024-09-12T00:30:41.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.453+0000 7f1145735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:41.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.453+0000 7f1145735800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:30:41.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.453+0000 7f1145735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9 2024-09-12T00:30:41.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.453+0000 7f1145735800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:30:41.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.453+0000 7f1145735800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:30:41.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.453+0000 7f1145735800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:30:41.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.453+0000 7f1145735800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:30:41.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.453+0000 7f1145735800 20 get_obj_state: octx=0x555e152851b0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x555e154bccc8 s->prefetch_data=0 2024-09-12T00:30:41.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.454+0000 7f1145735800 10 manifest: total_size = 1048576 2024-09-12T00:30:41.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.454+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7360621792179352604 2024-09-12T00:30:41.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.454+0000 7f1145735800 20 get_obj_state: octx=0x555e152851b0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x555e154bccc8 s->prefetch_data=0 2024-09-12T00:30:41.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.454+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154bccc8 2024-09-12T00:30:41.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.454+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9.0 2024-09-12T00:30:41.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.456+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.456+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.456+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7360621792179352604 2024-09-12T00:30:41.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.456+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.456+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9__shadow_.Av1ojUhSWwWytB2qis_BRaTLv_pFczP_0 2024-09-12T00:30:41.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.456+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:30:41.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.456+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.456+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7360621792179352604 2024-09-12T00:30:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.457+0000 7f1013fff640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:30:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.457+0000 7f1145735800 20 get_obj_state: octx=0x555e152851b0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x555e154bccc8 s->prefetch_data=0 2024-09-12T00:30:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.458+0000 7f1145735800 10 manifest: total_size = 4134 2024-09-12T00:30:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.458+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14834982602200619378 2024-09-12T00:30:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.458+0000 7f1145735800 20 get_obj_state: octx=0x555e152851b0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x555e154bccc8 s->prefetch_data=0 2024-09-12T00:30:41.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.458+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154bccc8 2024-09-12T00:30:41.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.458+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9.0 2024-09-12T00:30:41.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.460+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.460+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.460+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14834982602200619378 2024-09-12T00:30:41.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.460+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.460+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9__shadow_.Hc80lzODCD9yh3KQ3zfBwelPgBQrD59_0 2024-09-12T00:30:41.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.460+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:30:41.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.460+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.460+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14834982602200619378 2024-09-12T00:30:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.461+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:30:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.461+0000 7f1145735800 20 get_obj_state: octx=0x555e152851b0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x555e154bccc8 s->prefetch_data=0 2024-09-12T00:30:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.462+0000 7f1145735800 10 manifest: total_size = 55 2024-09-12T00:30:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.462+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7258241761086742034 2024-09-12T00:30:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.462+0000 7f1145735800 20 get_obj_state: octx=0x555e152851b0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x555e154bccc8 s->prefetch_data=0 2024-09-12T00:30:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.462+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154bccc8 2024-09-12T00:30:41.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.462+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9.0 2024-09-12T00:30:41.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.464+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.464+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.464+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7258241761086742034 2024-09-12T00:30:41.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.464+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.464+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9__shadow_.lX3BiT0iFQe7cKh6cQfDPm2nm7-io4Z_0 2024-09-12T00:30:41.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.464+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:30:41.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.464+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.464+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7258241761086742034 2024-09-12T00:30:41.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.465+0000 7f1013fff640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:30:41.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.465+0000 7f1145735800 20 get_obj_state: octx=0x7f113c05b500 obj=test-client.0-r-test-small-obj-data.3:obj state=0x555e154bccc8 s->prefetch_data=0 2024-09-12T00:30:41.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.466+0000 7f1145735800 10 manifest: total_size = 1048576 2024-09-12T00:30:41.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.466+0000 7f1145735800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8056015692947853713 2024-09-12T00:30:41.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.466+0000 7f1145735800 20 get_obj_state: octx=0x7f113c05b500 obj=test-client.0-r-test-small-obj-data.3:obj state=0x555e154bccc8 s->prefetch_data=0 2024-09-12T00:30:41.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.466+0000 7f1145735800 20 prepare_atomic_modification: state is not atomic. state=0x555e154bccc8 2024-09-12T00:30:41.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.466+0000 7f1145735800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9.0 2024-09-12T00:30:41.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.468+0000 7f1145735800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:30:41.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.468+0000 7f1145735800 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T00:30:41.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.468+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8056015692947853713 2024-09-12T00:30:41.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.468+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:30:41.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.468+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9__shadow_.X5xjzrrM536EKJRcy09fCwlTQn8vW-A_0 2024-09-12T00:30:41.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.468+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:30:41.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.468+0000 7f1145735800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:30:41.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.468+0000 7f1145735800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8056015692947853713 2024-09-12T00:30:41.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.469+0000 7f1024ff9640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:30:41.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.469+0000 7f1145735800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:30:41.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.469+0000 7f1145735800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:30:41.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.470+0000 7f1145735800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:30:41.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.470+0000 7f1145735800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:30:41.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.470+0000 7f1145735800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:30:41.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.470+0000 7f1145735800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:30:41.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.470+0000 7f1145735800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9])"; uploads.size()=0; is_truncated=0 2024-09-12T00:30:41.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.471+0000 7f1145735800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T00:30:41.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.471+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.472+0000 7f1145735800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:30:41.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.472+0000 7f1145735800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T00:30:41.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.472+0000 7f1145735800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T00:30:41.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.473+0000 7f1145735800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T00:30:41.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.473+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T00:30:41.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.473+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497035 cookie 93862572230384 notifier 5756 bl.length()=181 2024-09-12T00:30:41.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.475+0000 7f1145735800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9 from cache 2024-09-12T00:30:41.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.475+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9, ofs0, ns] 2024-09-12T00:30:41.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.476+0000 7f1024ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497036 cookie 93862572190688 notifier 5756 bl.length()=238 2024-09-12T00:30:41.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.478+0000 7f1145735800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9 : miss 2024-09-12T00:30:41.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.478+0000 7f1145735800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.478+0000 7f1145735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.478+0000 7f1145735800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9 info.flags=0x0 2024-09-12T00:30:41.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.478+0000 7f1145735800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9 to cache LRU end 2024-09-12T00:30:41.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.481+0000 7f1145735800 10 removing key index: XOPKDOLDGRXNYRCERICP 2024-09-12T00:30:41.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.482+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:XOPKDOLDGRXNYRCERICP, ofs0, ns] 2024-09-12T00:30:41.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.482+0000 7f1024ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496981 cookie 93862572187968 notifier 5756 bl.length()=170 2024-09-12T00:30:41.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.483+0000 7f1145735800 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T00:30:41.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.484+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:30:41.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.484+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497032 cookie 93862572185328 notifier 5756 bl.length()=182 2024-09-12T00:30:41.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.485+0000 7f1145735800 10 removing user buckets index 2024-09-12T00:30:41.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.486+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T00:30:41.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.487+0000 7f1013fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 93862572223840 notifier 5756 bl.length()=173 2024-09-12T00:30:41.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.488+0000 7f1145735800 10 removing user index: ragweed.client.0 2024-09-12T00:30:41.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.489+0000 7f1145735800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T00:30:41.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.489+0000 7f1145735800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:30:41.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.490+0000 7f1024ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 93862572190688 notifier 5756 bl.length()=165 2024-09-12T00:30:41.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.493+0000 7f0ff7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:41.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.495+0000 7f1145735800 20 remove_watcher() i=0 2024-09-12T00:30:41.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.495+0000 7f1145735800 2 removed watcher, disabling cache 2024-09-12T00:30:41.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.496+0000 7f1145735800 20 remove_watcher() i=1 2024-09-12T00:30:41.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.497+0000 7f1145735800 20 remove_watcher() i=2 2024-09-12T00:30:41.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.498+0000 7f1145735800 20 remove_watcher() i=3 2024-09-12T00:30:41.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.499+0000 7f1145735800 20 remove_watcher() i=4 2024-09-12T00:30:41.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.500+0000 7f1145735800 20 remove_watcher() i=5 2024-09-12T00:30:41.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.501+0000 7f1145735800 20 remove_watcher() i=6 2024-09-12T00:30:41.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.502+0000 7f1145735800 20 remove_watcher() i=7 2024-09-12T00:30:41.512 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T00:30:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:41.611 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:41.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.848+0000 7fd91c320800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.850+0000 7fd91c320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.850+0000 7fd91c320800 20 realm 2024-09-12T00:30:41.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.850+0000 7fd91c320800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.850+0000 7fd91c320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.850+0000 7fd91c320800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:41.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.850+0000 7fd91c320800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.850+0000 7fd91c320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:41.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.850+0000 7fd91c320800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.851+0000 7fd91c320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:41.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.851+0000 7fd91c320800 20 rados->read ofs=0 len=0 2024-09-12T00:30:41.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.852+0000 7fd91c320800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:41.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.852+0000 7fd91c320800 20 searching for the correct realm 2024-09-12T00:30:41.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:41.853+0000 7fd90f867640 0 -- 172.21.15.133:0/3966935336 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fd900024410 msgr2=0x7fd900024830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:42.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.058+0000 7fd90f867640 0 -- 172.21.15.133:0/3966935336 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fd908098b10 msgr2=0x7fd90803d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:42.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.266+0000 7fd91c320800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:30:42.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.266+0000 7fd91c320800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:30:42.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.266+0000 7fd91c320800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:42.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.266+0000 7fd91c320800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:42.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.266+0000 7fd91c320800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:42.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.266+0000 7fd91c320800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:42.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.266+0000 7fd91c320800 20 rados->read ofs=0 len=0 2024-09-12T00:30:42.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.266+0000 7fd91c320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:42.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.266+0000 7fd91c320800 20 rados->read ofs=0 len=0 2024-09-12T00:30:42.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.266+0000 7fd91c320800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:42.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.266+0000 7fd91c320800 20 rados->read ofs=0 len=0 2024-09-12T00:30:42.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.267+0000 7fd91c320800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:42.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.267+0000 7fd91c320800 20 zone default found 2024-09-12T00:30:42.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.267+0000 7fd91c320800 4 Realm: () 2024-09-12T00:30:42.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.267+0000 7fd91c320800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:30:42.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.267+0000 7fd91c320800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:30:42.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.267+0000 7fd91c320800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:42.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.267+0000 7fd91c320800 20 zonegroup default 2024-09-12T00:30:42.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.267+0000 7fd91c320800 20 rados->read ofs=0 len=0 2024-09-12T00:30:42.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.267+0000 7fd91c320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:42.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.267+0000 7fd91c320800 20 rados->read ofs=0 len=0 2024-09-12T00:30:42.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.268+0000 7fd91c320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:42.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.268+0000 7fd91c320800 20 rados->read ofs=0 len=0 2024-09-12T00:30:42.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.268+0000 7fd91c320800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:42.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.268+0000 7fd91c320800 20 started sync module instance, tier type = 2024-09-12T00:30:42.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.268+0000 7fd91c320800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:30:42.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.278+0000 7fd91c320800 20 add_watcher() i=0 2024-09-12T00:30:42.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.278+0000 7fd91c320800 20 add_watcher() i=1 2024-09-12T00:30:42.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.278+0000 7fd91c320800 20 add_watcher() i=2 2024-09-12T00:30:42.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.278+0000 7fd91c320800 20 add_watcher() i=3 2024-09-12T00:30:42.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.278+0000 7fd91c320800 20 add_watcher() i=4 2024-09-12T00:30:42.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.278+0000 7fd91c320800 20 add_watcher() i=5 2024-09-12T00:30:42.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.278+0000 7fd91c320800 20 add_watcher() i=6 2024-09-12T00:30:42.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.279+0000 7fd91c320800 20 add_watcher() i=7 2024-09-12T00:30:42.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.279+0000 7fd91c320800 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:42.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.281+0000 7fd7cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:42.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.281+0000 7fd91c320800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:42.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.281+0000 7fd91c320800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:42.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.323+0000 7fd7cdfdb640 20 reqs_thread_entry: start 2024-09-12T00:30:42.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.323+0000 7fd91c320800 20 init_complete bucket index max shards: 1 2024-09-12T00:30:42.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.323+0000 7fd91c320800 20 Filter name: none 2024-09-12T00:30:42.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.323+0000 7fd73f7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:42.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.323+0000 7fd91c320800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:30:42.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.323+0000 7fd91c320800 20 rados->read ofs=0 len=0 2024-09-12T00:30:42.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.323+0000 7fd91c320800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:30:42.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.323+0000 7fd91c320800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T00:30:42.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.323+0000 7fd91c320800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:30:42.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.323+0000 7fd91c320800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:42.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.324+0000 7fd91c320800 10 removing key index: VFYSWIYPVUIZHMBLIOTU 2024-09-12T00:30:42.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.325+0000 7fd91c320800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:VFYSWIYPVUIZHMBLIOTU, ofs0, ns] 2024-09-12T00:30:42.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.325+0000 7fd7ef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497033 cookie 94224807844528 notifier 5774 bl.length()=170 2024-09-12T00:30:42.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.326+0000 7fd91c320800 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T00:30:42.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.328+0000 7fd91c320800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:30:42.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.328+0000 7fd7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497038 cookie 94224807852384 notifier 5774 bl.length()=182 2024-09-12T00:30:42.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.329+0000 7fd91c320800 10 removing user buckets index 2024-09-12T00:30:42.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.330+0000 7fd91c320800 10 removing user index: sysuser.client.0 2024-09-12T00:30:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.332+0000 7fd91c320800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T00:30:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.332+0000 7fd91c320800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:30:42.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.332+0000 7fd7ef7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497034 cookie 94224807844528 notifier 5774 bl.length()=165 2024-09-12T00:30:42.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.334+0000 7fd7cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:42.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.337+0000 7fd91c320800 20 remove_watcher() i=0 2024-09-12T00:30:42.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.337+0000 7fd91c320800 2 removed watcher, disabling cache 2024-09-12T00:30:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.338+0000 7fd91c320800 20 remove_watcher() i=1 2024-09-12T00:30:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.340+0000 7fd91c320800 20 remove_watcher() i=2 2024-09-12T00:30:42.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.341+0000 7fd91c320800 20 remove_watcher() i=3 2024-09-12T00:30:42.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.342+0000 7fd91c320800 20 remove_watcher() i=4 2024-09-12T00:30:42.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.343+0000 7fd91c320800 20 remove_watcher() i=5 2024-09-12T00:30:42.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.344+0000 7fd91c320800 20 remove_watcher() i=6 2024-09-12T00:30:42.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:30:42.345+0000 7fd91c320800 20 remove_watcher() i=7 2024-09-12T00:30:42.354 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T00:30:42.355 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:30:42.436 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:30:42.448 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:30:42.448 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:30:42.449 DEBUG:teuthology.orchestra.run.smithi133:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:30:42.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:30:42.478 INFO:teuthology.orchestra.run.smithi133.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:30:42.478 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:30:42.547 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:30:42.548 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:30:42.616 INFO:tasks.workunit:timeout=3h 2024-09-12T00:30:42.616 INFO:tasks.workunit:cleanup=True 2024-09-12T00:30:42.616 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:30:42.687 INFO:tasks.workunit.client.0.smithi133.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:31:27.039 INFO:tasks.workunit.client.0.smithi133.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:31:27.040 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:27.040 INFO:tasks.workunit.client.0.smithi133.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:31:27.040 INFO:tasks.workunit.client.0.smithi133.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:31:27.040 INFO:tasks.workunit.client.0.smithi133.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:31:27.040 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:27.040 INFO:tasks.workunit.client.0.smithi133.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:31:27.040 INFO:tasks.workunit.client.0.smithi133.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:31:27.040 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:27.040 INFO:tasks.workunit.client.0.smithi133.stderr: git switch -c 2024-09-12T00:31:27.040 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:27.040 INFO:tasks.workunit.client.0.smithi133.stderr:Or undo this operation with: 2024-09-12T00:31:27.041 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:27.041 INFO:tasks.workunit.client.0.smithi133.stderr: git switch - 2024-09-12T00:31:27.041 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:27.041 INFO:tasks.workunit.client.0.smithi133.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:31:27.041 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:27.041 INFO:tasks.workunit.client.0.smithi133.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:31:27.044 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:31:27.113 INFO:tasks.workunit.client.0.smithi133.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:31:27.114 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:31:27.115 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:31:27.163 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:31:27.211 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:31:27.250 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:31:27.252 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:31:27.252 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:31:27.290 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:31:27.293 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:31:27.293 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:31:27.363 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T00:31:27.364 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T00:31:27.364 DEBUG:teuthology.orchestra.run.smithi133:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:31:27.437 INFO:tasks.workunit.client.0.smithi133.stderr:+ ulimit -c 0 2024-09-12T00:31:27.437 INFO:tasks.workunit.client.0.smithi133.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:31:27.437 INFO:tasks.workunit.client.0.smithi133.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:31:27.437 INFO:tasks.workunit.client.0.smithi133.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:31:29.704 INFO:tasks.workunit.client.0.smithi133.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:31:29.704 INFO:tasks.workunit.client.0.smithi133.stderr:++ deactivate nondestructive 2024-09-12T00:31:29.704 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T00:31:29.704 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T00:31:29.704 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:31:29.704 INFO:tasks.workunit.client.0.smithi133.stderr:++ hash -r 2024-09-12T00:31:29.704 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T00:31:29.705 INFO:tasks.workunit.client.0.smithi133.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:31:29.705 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:31:29.705 INFO:tasks.workunit.client.0.smithi133.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:31:29.705 INFO:tasks.workunit.client.0.smithi133.stderr:++ export VIRTUAL_ENV 2024-09-12T00:31:29.705 INFO:tasks.workunit.client.0.smithi133.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:31:29.705 INFO:tasks.workunit.client.0.smithi133.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:31:29.705 INFO:tasks.workunit.client.0.smithi133.stderr:++ export PATH 2024-09-12T00:31:29.705 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T00:31:29.705 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -z '' ']' 2024-09-12T00:31:29.705 INFO:tasks.workunit.client.0.smithi133.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:31:29.705 INFO:tasks.workunit.client.0.smithi133.stderr:++ PS1='(rgw) ' 2024-09-12T00:31:29.705 INFO:tasks.workunit.client.0.smithi133.stderr:++ export PS1 2024-09-12T00:31:29.706 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:31:29.706 INFO:tasks.workunit.client.0.smithi133.stderr:++ hash -r 2024-09-12T00:31:29.706 INFO:tasks.workunit.client.0.smithi133.stderr:+ pip install pip --upgrade 2024-09-12T00:31:29.933 INFO:tasks.workunit.client.0.smithi133.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:31:30.112 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting pip 2024-09-12T00:31:30.117 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:31:30.162 INFO:tasks.workunit.client.0.smithi133.stdout:Installing collected packages: pip 2024-09-12T00:31:30.162 INFO:tasks.workunit.client.0.smithi133.stdout: Attempting uninstall: pip 2024-09-12T00:31:30.162 INFO:tasks.workunit.client.0.smithi133.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:31:30.316 INFO:tasks.workunit.client.0.smithi133.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:31:30.322 INFO:tasks.workunit.client.0.smithi133.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:31:31.054 INFO:tasks.workunit.client.0.smithi133.stdout:Successfully installed pip-24.2 2024-09-12T00:31:31.103 INFO:tasks.workunit.client.0.smithi133.stderr:+ pip install boto3 2024-09-12T00:31:31.871 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting boto3 2024-09-12T00:31:31.872 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:31:32.409 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:31:32.410 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:31:32.466 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:31:32.467 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:31:32.520 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:31:32.521 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:31:32.571 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:31:32.572 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:31:32.648 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:31:32.649 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:31:32.796 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:31:32.797 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:31:32.799 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:31:32.800 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:31:32.810 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:31:32.811 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:31:32.812 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:31:32.813 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:31:32.815 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:31:32.888 INFO:tasks.workunit.client.0.smithi133.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:31:33.923 INFO:tasks.workunit.client.0.smithi133.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:31:34.038 INFO:tasks.workunit.client.0.smithi133.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T00:31:34.160 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T00:31:34.194 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:34.194 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:34.232 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.233+0000 7fe89d213800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.235+0000 7fe89d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:34.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.235+0000 7fe89d213800 20 realm 2024-09-12T00:31:34.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.235+0000 7fe89d213800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.235+0000 7fe89d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:34.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.235+0000 7fe89d213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:34.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.235+0000 7fe89d213800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.236+0000 7fe89d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:34.235 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.236+0000 7fe89d213800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.235 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.236+0000 7fe89d213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:34.235 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.236+0000 7fe89d213800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.235 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.237+0000 7fe89d213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:34.236 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.237+0000 7fe89d213800 20 searching for the correct realm 2024-09-12T00:31:34.237 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.239+0000 7fe893fff640 0 -- 172.21.15.133:0/2060570023 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fe88401f060 msgr2=0x7fe884089dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:34.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.445+0000 7fe893fff640 0 -- 172.21.15.133:0/2060570023 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fe88c07f040 msgr2=0x7fe88c07f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:34.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.652+0000 7fe89d213800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:34.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.652+0000 7fe89d213800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:34.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.652+0000 7fe89d213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:34.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.652+0000 7fe89d213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:34.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.652+0000 7fe89d213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:34.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.652+0000 7fe89d213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:34.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.652+0000 7fe89d213800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.653+0000 7fe89d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:34.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.653+0000 7fe89d213800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.653+0000 7fe89d213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:34.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.653+0000 7fe89d213800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.653+0000 7fe89d213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:34.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.653+0000 7fe89d213800 20 zone default found 2024-09-12T00:31:34.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.653+0000 7fe89d213800 4 Realm: () 2024-09-12T00:31:34.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.653+0000 7fe89d213800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:34.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.653+0000 7fe89d213800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:34.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.653+0000 7fe89d213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:34.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.653+0000 7fe89d213800 20 zonegroup default 2024-09-12T00:31:34.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.653+0000 7fe89d213800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.654+0000 7fe89d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:34.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.654+0000 7fe89d213800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.654+0000 7fe89d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:34.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.654+0000 7fe89d213800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.655+0000 7fe89d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:34.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.655+0000 7fe89d213800 20 started sync module instance, tier type = 2024-09-12T00:31:34.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.655+0000 7fe89d213800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:34.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.665+0000 7fe89d213800 20 add_watcher() i=0 2024-09-12T00:31:34.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.665+0000 7fe89d213800 20 add_watcher() i=1 2024-09-12T00:31:34.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.665+0000 7fe89d213800 20 add_watcher() i=2 2024-09-12T00:31:34.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.665+0000 7fe89d213800 20 add_watcher() i=3 2024-09-12T00:31:34.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.665+0000 7fe89d213800 20 add_watcher() i=4 2024-09-12T00:31:34.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.665+0000 7fe89d213800 20 add_watcher() i=5 2024-09-12T00:31:34.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.665+0000 7fe89d213800 20 add_watcher() i=6 2024-09-12T00:31:34.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.667+0000 7fe89d213800 20 add_watcher() i=7 2024-09-12T00:31:34.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.667+0000 7fe89d213800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:34.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.669+0000 7fe74f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:34.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.669+0000 7fe89d213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:34.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.669+0000 7fe89d213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:34.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.669+0000 7fe89d213800 5 note: GC not initialized 2024-09-12T00:31:34.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.670+0000 7fe74e7e4640 20 reqs_thread_entry: start 2024-09-12T00:31:34.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.670+0000 7fe89d213800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:34.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.670+0000 7fe89d213800 20 Filter name: none 2024-09-12T00:31:34.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.670+0000 7fe747fff640 20 reqs_thread_entry: start 2024-09-12T00:31:34.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.670+0000 7fe89d213800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T00:31:34.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.670+0000 7fe89d213800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.670+0000 7fe89d213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:34.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.670+0000 7fe89d213800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T00:31:34.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.670+0000 7fe89d213800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:31:34.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.670+0000 7fe89d213800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T00:31:34.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.670+0000 7fe89d213800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.671+0000 7fe89d213800 20 rados_obj.operate() r=0 bl.length=22 2024-09-12T00:31:34.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.671+0000 7fe89d213800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-12T00:31:34.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.671+0000 7fe89d213800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:31:34.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.671+0000 7fe89d213800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-12T00:31:34.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.671+0000 7fe89d213800 20 rados->read ofs=0 len=0 2024-09-12T00:31:34.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.672+0000 7fe89d213800 20 rados_obj.operate() r=0 bl.length=420 2024-09-12T00:31:34.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.672+0000 7fe89d213800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-12T00:31:34.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.672+0000 7fe89d213800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-12T00:31:34.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.672+0000 7fe89d213800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:34.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.672+0000 7fe89d213800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-12T00:31:34.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.672+0000 7fe89d213800 20 get_user_info_from_index found 0 xattrs 2024-09-12T00:31:34.672 INFO:tasks.workunit.client.0.smithi133.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-12T00:31:34.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.673+0000 7fe74f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:34.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.675+0000 7fe89d213800 20 remove_watcher() i=0 2024-09-12T00:31:34.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.675+0000 7fe89d213800 2 removed watcher, disabling cache 2024-09-12T00:31:34.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.676+0000 7fe89d213800 20 remove_watcher() i=1 2024-09-12T00:31:34.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.677+0000 7fe89d213800 20 remove_watcher() i=2 2024-09-12T00:31:34.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.678+0000 7fe89d213800 20 remove_watcher() i=3 2024-09-12T00:31:34.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.679+0000 7fe89d213800 20 remove_watcher() i=4 2024-09-12T00:31:34.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.681+0000 7fe89d213800 20 remove_watcher() i=5 2024-09-12T00:31:34.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.682+0000 7fe89d213800 20 remove_watcher() i=6 2024-09-12T00:31:34.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:34.683+0000 7fe89d213800 20 remove_watcher() i=7 2024-09-12T00:31:35.052 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard add 2024-09-12T00:31:35.052 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:35.053 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:31:35.082 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:35.083 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:35.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.322+0000 7fa22e126800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.324+0000 7fa22e126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.324+0000 7fa22e126800 20 realm 2024-09-12T00:31:35.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.324+0000 7fa22e126800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.324+0000 7fa22e126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.324+0000 7fa22e126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:35.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.324+0000 7fa22e126800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.325+0000 7fa22e126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.325+0000 7fa22e126800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.325+0000 7fa22e126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:35.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.325+0000 7fa22e126800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.326+0000 7fa22e126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:35.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.326+0000 7fa22e126800 20 searching for the correct realm 2024-09-12T00:31:35.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.328+0000 7fa223fff640 0 -- 172.21.15.133:0/2603415775 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fa2140634a0 msgr2=0x7fa214049ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:35.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.534+0000 7fa223fff640 0 -- 172.21.15.133:0/2603415775 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fa21c042a80 msgr2=0x7fa21c02e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:35.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.741+0000 7fa22e126800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:35.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.741+0000 7fa22e126800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:35.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.741+0000 7fa22e126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:35.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.741+0000 7fa22e126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:35.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.741+0000 7fa22e126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:35.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.741+0000 7fa22e126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:35.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.741+0000 7fa22e126800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.741+0000 7fa22e126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.741+0000 7fa22e126800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.742+0000 7fa22e126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:35.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.742+0000 7fa22e126800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.742+0000 7fa22e126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:35.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.742+0000 7fa22e126800 20 zone default found 2024-09-12T00:31:35.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.742+0000 7fa22e126800 4 Realm: () 2024-09-12T00:31:35.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.742+0000 7fa22e126800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:35.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.742+0000 7fa22e126800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:35.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.742+0000 7fa22e126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:35.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.742+0000 7fa22e126800 20 zonegroup default 2024-09-12T00:31:35.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.742+0000 7fa22e126800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.742+0000 7fa22e126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.742+0000 7fa22e126800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.743+0000 7fa22e126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.743+0000 7fa22e126800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.743+0000 7fa22e126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.743+0000 7fa22e126800 20 started sync module instance, tier type = 2024-09-12T00:31:35.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.743+0000 7fa22e126800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:35.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.753+0000 7fa22e126800 20 add_watcher() i=0 2024-09-12T00:31:35.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.753+0000 7fa22e126800 20 add_watcher() i=1 2024-09-12T00:31:35.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.753+0000 7fa22e126800 20 add_watcher() i=2 2024-09-12T00:31:35.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.753+0000 7fa22e126800 20 add_watcher() i=3 2024-09-12T00:31:35.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.753+0000 7fa22e126800 20 add_watcher() i=4 2024-09-12T00:31:35.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.753+0000 7fa22e126800 20 add_watcher() i=5 2024-09-12T00:31:35.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.753+0000 7fa22e126800 20 add_watcher() i=6 2024-09-12T00:31:35.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.754+0000 7fa22e126800 20 add_watcher() i=7 2024-09-12T00:31:35.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.754+0000 7fa22e126800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:35.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.756+0000 7fa0db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:35.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.756+0000 7fa22e126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:35.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.756+0000 7fa22e126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:35.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.756+0000 7fa22e126800 5 note: GC not initialized 2024-09-12T00:31:35.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.757+0000 7fa0da7fc640 20 reqs_thread_entry: start 2024-09-12T00:31:35.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.757+0000 7fa22e126800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:35.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.757+0000 7fa22e126800 20 Filter name: none 2024-09-12T00:31:35.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.757+0000 7fa04bfff640 20 reqs_thread_entry: start 2024-09-12T00:31:35.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.757+0000 7fa22e126800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.757+0000 7fa22e126800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:35.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.757+0000 7fa22e126800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.758+0000 7fa22e126800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:35.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.758+0000 7fa22e126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:35.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.758+0000 7fa22e126800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.758+0000 7fa22e126800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:35.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.758+0000 7fa22e126800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.759+0000 7fa22e126800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:35.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.759+0000 7fa22e126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:35.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.760+0000 7fa0db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:35.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.762+0000 7fa22e126800 20 remove_watcher() i=0 2024-09-12T00:31:35.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.762+0000 7fa22e126800 2 removed watcher, disabling cache 2024-09-12T00:31:35.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.763+0000 7fa22e126800 20 remove_watcher() i=1 2024-09-12T00:31:35.763 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.765+0000 7fa22e126800 20 remove_watcher() i=2 2024-09-12T00:31:35.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.766+0000 7fa22e126800 20 remove_watcher() i=3 2024-09-12T00:31:35.765 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.767+0000 7fa22e126800 20 remove_watcher() i=4 2024-09-12T00:31:35.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.768+0000 7fa22e126800 20 remove_watcher() i=5 2024-09-12T00:31:35.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.769+0000 7fa22e126800 20 remove_watcher() i=6 2024-09-12T00:31:35.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.770+0000 7fa22e126800 20 remove_watcher() i=7 2024-09-12T00:31:35.780 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:35.780 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:31:35.780 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: a-bucket id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T00:31:35.780 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:35.782 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-09-12T00:31:35.812 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:35.813 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:35.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.851+0000 7f4b80b40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.852 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.853+0000 7f4b80b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.852 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.853+0000 7f4b80b40800 20 realm 2024-09-12T00:31:35.852 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.853+0000 7f4b80b40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.852 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.854+0000 7f4b80b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.852 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.854+0000 7f4b80b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:35.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.854+0000 7f4b80b40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.854+0000 7f4b80b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:35.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.854+0000 7f4b80b40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.854+0000 7f4b80b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:35.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.855+0000 7f4b80b40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:35.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.855+0000 7f4b80b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:35.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.855+0000 7f4b80b40800 20 searching for the correct realm 2024-09-12T00:31:35.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.858+0000 7f4b7d0c1640 0 -- 172.21.15.133:0/2033309832 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x564a563b3780 msgr2=0x564a563b5b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:35.860 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:35.861+0000 7f4b77fff640 0 -- 172.21.15.133:0/2033309832 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f4b70089660 msgr2=0x7f4b7004c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:36.067 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.067+0000 7f4b80b40800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:36.067 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.067+0000 7f4b80b40800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:36.067 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.067+0000 7f4b80b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:36.067 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.067+0000 7f4b80b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:36.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.067+0000 7f4b80b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:36.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.067+0000 7f4b80b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:36.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.067+0000 7f4b80b40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.068+0000 7f4b80b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:36.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.068+0000 7f4b80b40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.068+0000 7f4b80b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:36.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.068+0000 7f4b80b40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.068+0000 7f4b80b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:36.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.068+0000 7f4b80b40800 20 zone default found 2024-09-12T00:31:36.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.068+0000 7f4b80b40800 4 Realm: () 2024-09-12T00:31:36.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.068+0000 7f4b80b40800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:36.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.068+0000 7f4b80b40800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:36.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.068+0000 7f4b80b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:36.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.068+0000 7f4b80b40800 20 zonegroup default 2024-09-12T00:31:36.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.068+0000 7f4b80b40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.069+0000 7f4b80b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:36.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.069+0000 7f4b80b40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.069+0000 7f4b80b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:36.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.069+0000 7f4b80b40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.069+0000 7f4b80b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:36.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.069+0000 7f4b80b40800 20 started sync module instance, tier type = 2024-09-12T00:31:36.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.069+0000 7f4b80b40800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:36.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.079+0000 7f4b80b40800 20 add_watcher() i=0 2024-09-12T00:31:36.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.079+0000 7f4b80b40800 20 add_watcher() i=1 2024-09-12T00:31:36.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.079+0000 7f4b80b40800 20 add_watcher() i=2 2024-09-12T00:31:36.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.079+0000 7f4b80b40800 20 add_watcher() i=3 2024-09-12T00:31:36.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.079+0000 7f4b80b40800 20 add_watcher() i=4 2024-09-12T00:31:36.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.079+0000 7f4b80b40800 20 add_watcher() i=5 2024-09-12T00:31:36.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.079+0000 7f4b80b40800 20 add_watcher() i=6 2024-09-12T00:31:36.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.080+0000 7f4b80b40800 20 add_watcher() i=7 2024-09-12T00:31:36.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.080+0000 7f4b80b40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:36.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.082+0000 7f4a337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:36.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.083+0000 7f4b80b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:36.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.083+0000 7f4b80b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:36.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.083+0000 7f4b80b40800 5 note: GC not initialized 2024-09-12T00:31:36.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.083+0000 7f4a327e4640 20 reqs_thread_entry: start 2024-09-12T00:31:36.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.083+0000 7f4b80b40800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:36.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.083+0000 7f4b80b40800 20 Filter name: none 2024-09-12T00:31:36.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.083+0000 7f4a2bfff640 20 reqs_thread_entry: start 2024-09-12T00:31:36.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.083+0000 7f4b80b40800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:31:36.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.083+0000 7f4b80b40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.084+0000 7f4b80b40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:36.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.084+0000 7f4b80b40800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:31:36.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.084+0000 7f4b80b40800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:31:36.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.084+0000 7f4b80b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:31:36.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.084+0000 7f4b80b40800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.084+0000 7f4b80b40800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:36.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.084+0000 7f4b80b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:36.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.084+0000 7f4b80b40800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:36.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.084+0000 7f4b80b40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:36.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.084+0000 7f4b80b40800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:36.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.084+0000 7f4b80b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:31:36.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.086+0000 7f4a337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:36.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.089+0000 7f4b80b40800 20 remove_watcher() i=0 2024-09-12T00:31:36.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.089+0000 7f4b80b40800 2 removed watcher, disabling cache 2024-09-12T00:31:36.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.090+0000 7f4b80b40800 20 remove_watcher() i=1 2024-09-12T00:31:36.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.091+0000 7f4b80b40800 20 remove_watcher() i=2 2024-09-12T00:31:36.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.092+0000 7f4b80b40800 20 remove_watcher() i=3 2024-09-12T00:31:36.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.093+0000 7f4b80b40800 20 remove_watcher() i=4 2024-09-12T00:31:36.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.094+0000 7f4b80b40800 20 remove_watcher() i=5 2024-09-12T00:31:36.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.095+0000 7f4b80b40800 20 remove_watcher() i=6 2024-09-12T00:31:36.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.096+0000 7f4b80b40800 20 remove_watcher() i=7 2024-09-12T00:31:36.108 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin reshard list 2024-09-12T00:31:36.134 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:36.135 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:36.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.173+0000 7f67dc323800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.175+0000 7f67dc323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:36.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.175+0000 7f67dc323800 20 realm 2024-09-12T00:31:36.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.175+0000 7f67dc323800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.175+0000 7f67dc323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:36.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.175+0000 7f67dc323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:36.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.175+0000 7f67dc323800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.175+0000 7f67dc323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:36.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.175+0000 7f67dc323800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.176+0000 7f67dc323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:36.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.176+0000 7f67dc323800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.177+0000 7f67dc323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:36.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.177+0000 7f67dc323800 20 searching for the correct realm 2024-09-12T00:31:36.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.180+0000 7f67d880d640 0 -- 172.21.15.133:0/3514186970 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f67d0080940 msgr2=0x7f67d008d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:36.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.386+0000 7f67d800c640 0 -- 172.21.15.133:0/3514186970 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x5564e91bea10 msgr2=0x5564e91c0e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:36.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.391+0000 7f67dc323800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:36.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.391+0000 7f67dc323800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:36.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.391+0000 7f67dc323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:36.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.391+0000 7f67dc323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:36.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.391+0000 7f67dc323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:36.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.391+0000 7f67dc323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:36.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.391+0000 7f67dc323800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.391+0000 7f67dc323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:36.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.391+0000 7f67dc323800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.391+0000 7f67dc323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:36.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.391+0000 7f67dc323800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.392+0000 7f67dc323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:36.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.392+0000 7f67dc323800 20 zone default found 2024-09-12T00:31:36.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.392+0000 7f67dc323800 4 Realm: () 2024-09-12T00:31:36.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.392+0000 7f67dc323800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:36.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.392+0000 7f67dc323800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:36.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.392+0000 7f67dc323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:36.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.392+0000 7f67dc323800 20 zonegroup default 2024-09-12T00:31:36.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.392+0000 7f67dc323800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.392+0000 7f67dc323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:36.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.392+0000 7f67dc323800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.392+0000 7f67dc323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:36.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.392+0000 7f67dc323800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.393+0000 7f67dc323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:36.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.393+0000 7f67dc323800 20 started sync module instance, tier type = 2024-09-12T00:31:36.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.393+0000 7f67dc323800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:36.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.403+0000 7f67dc323800 20 add_watcher() i=0 2024-09-12T00:31:36.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.403+0000 7f67dc323800 20 add_watcher() i=1 2024-09-12T00:31:36.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.403+0000 7f67dc323800 20 add_watcher() i=2 2024-09-12T00:31:36.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.403+0000 7f67dc323800 20 add_watcher() i=3 2024-09-12T00:31:36.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.403+0000 7f67dc323800 20 add_watcher() i=4 2024-09-12T00:31:36.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.403+0000 7f67dc323800 20 add_watcher() i=5 2024-09-12T00:31:36.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.403+0000 7f67dc323800 20 add_watcher() i=6 2024-09-12T00:31:36.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.404+0000 7f67dc323800 20 add_watcher() i=7 2024-09-12T00:31:36.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.404+0000 7f67dc323800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:36.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.406+0000 7f668efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:36.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.407+0000 7f67dc323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:36.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.407+0000 7f67dc323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:36.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.407+0000 7f67dc323800 5 note: GC not initialized 2024-09-12T00:31:36.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.407+0000 7f668dfe3640 20 reqs_thread_entry: start 2024-09-12T00:31:36.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.407+0000 7f67dc323800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:36.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.407+0000 7f67dc323800 20 Filter name: none 2024-09-12T00:31:36.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.407+0000 7f6686ffd640 20 reqs_thread_entry: start 2024-09-12T00:31:36.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.414+0000 7f668efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:36.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.416+0000 7f67dc323800 20 remove_watcher() i=0 2024-09-12T00:31:36.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.416+0000 7f67dc323800 2 removed watcher, disabling cache 2024-09-12T00:31:36.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.417+0000 7f67dc323800 20 remove_watcher() i=1 2024-09-12T00:31:36.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.418+0000 7f67dc323800 20 remove_watcher() i=2 2024-09-12T00:31:36.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.420+0000 7f67dc323800 20 remove_watcher() i=3 2024-09-12T00:31:36.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.421+0000 7f67dc323800 20 remove_watcher() i=4 2024-09-12T00:31:36.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.422+0000 7f67dc323800 20 remove_watcher() i=5 2024-09-12T00:31:36.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.423+0000 7f67dc323800 20 remove_watcher() i=6 2024-09-12T00:31:36.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.424+0000 7f67dc323800 20 remove_watcher() i=7 2024-09-12T00:31:36.434 INFO:tasks.workunit.client.0.smithi133.stderr:bucket name a-bucket 2024-09-12T00:31:36.434 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard process 2024-09-12T00:31:36.434 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:36.435 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin reshard process 2024-09-12T00:31:36.462 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:36.463 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:36.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.501+0000 7f368f346800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.503+0000 7f368f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:36.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.503+0000 7f368f346800 20 realm 2024-09-12T00:31:36.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.503+0000 7f368f346800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.503+0000 7f368f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:36.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.503+0000 7f368f346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:36.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.503+0000 7f368f346800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.503+0000 7f368f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:36.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.503+0000 7f368f346800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.504+0000 7f368f346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:36.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.504+0000 7f368f346800 20 rados->read ofs=0 len=0 2024-09-12T00:31:36.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.505+0000 7f368f346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:36.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.505+0000 7f368f346800 20 searching for the correct realm 2024-09-12T00:31:36.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.506+0000 7f3687fff640 0 -- 172.21.15.133:0/634727837 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f3678066710 msgr2=0x7f3678084c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:36.911 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:36.912+0000 7f368ce30640 0 -- 172.21.15.133:0/634727837 >> [v2:172.21.15.160:6818/507321805,v1:172.21.15.160:6819/507321805] conn(0x7f3678086200 msgr2=0x7f3678093a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:37.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.323+0000 7f368f346800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:37.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.323+0000 7f368f346800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:37.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.323+0000 7f368f346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:37.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.323+0000 7f368f346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:37.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.323+0000 7f368f346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:37.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.323+0000 7f368f346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:37.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.323+0000 7f368f346800 20 rados->read ofs=0 len=0 2024-09-12T00:31:37.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.323+0000 7f368f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:37.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.323+0000 7f368f346800 20 rados->read ofs=0 len=0 2024-09-12T00:31:37.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.323+0000 7f368f346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:37.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.323+0000 7f368f346800 20 rados->read ofs=0 len=0 2024-09-12T00:31:37.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.324+0000 7f368f346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:37.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.324+0000 7f368f346800 20 zone default found 2024-09-12T00:31:37.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.324+0000 7f368f346800 4 Realm: () 2024-09-12T00:31:37.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.324+0000 7f368f346800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:37.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.324+0000 7f368f346800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:37.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.324+0000 7f368f346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:37.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.324+0000 7f368f346800 20 zonegroup default 2024-09-12T00:31:37.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.324+0000 7f368f346800 20 rados->read ofs=0 len=0 2024-09-12T00:31:37.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.325+0000 7f368f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:37.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.325+0000 7f368f346800 20 rados->read ofs=0 len=0 2024-09-12T00:31:37.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.325+0000 7f368f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:37.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.325+0000 7f368f346800 20 rados->read ofs=0 len=0 2024-09-12T00:31:37.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.325+0000 7f368f346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:37.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.325+0000 7f368f346800 20 started sync module instance, tier type = 2024-09-12T00:31:37.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.325+0000 7f368f346800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:37.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.336+0000 7f368f346800 20 add_watcher() i=0 2024-09-12T00:31:37.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.336+0000 7f368f346800 20 add_watcher() i=1 2024-09-12T00:31:37.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.336+0000 7f368f346800 20 add_watcher() i=2 2024-09-12T00:31:37.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.336+0000 7f368f346800 20 add_watcher() i=3 2024-09-12T00:31:37.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.336+0000 7f368f346800 20 add_watcher() i=4 2024-09-12T00:31:37.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.336+0000 7f368f346800 20 add_watcher() i=5 2024-09-12T00:31:37.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.336+0000 7f368f346800 20 add_watcher() i=6 2024-09-12T00:31:37.336 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.338+0000 7f368f346800 20 add_watcher() i=7 2024-09-12T00:31:37.336 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.338+0000 7f368f346800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:37.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.340+0000 7f3542fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:37.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.340+0000 7f368f346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:37.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.340+0000 7f368f346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:37.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.340+0000 7f368f346800 5 note: GC not initialized 2024-09-12T00:31:37.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.340+0000 7f3541fe3640 20 reqs_thread_entry: start 2024-09-12T00:31:37.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.340+0000 7f368f346800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:37.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.341+0000 7f368f346800 20 Filter name: none 2024-09-12T00:31:37.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.341+0000 7f34b37fe640 20 reqs_thread_entry: start 2024-09-12T00:31:37.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.341+0000 7f368f346800 20 processing logshard = reshard.0000000000 2024-09-12T00:31:37.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.344+0000 7f368f346800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:31:37.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.344+0000 7f368f346800 20 processing logshard = reshard.0000000001 2024-09-12T00:31:37.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.346+0000 7f368f346800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:31:37.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.346+0000 7f368f346800 20 processing logshard = reshard.0000000002 2024-09-12T00:31:37.348 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.349+0000 7f368f346800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:31:37.348 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.349+0000 7f368f346800 20 processing logshard = reshard.0000000003 2024-09-12T00:31:37.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.352+0000 7f368f346800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:31:37.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.352+0000 7f368f346800 20 processing logshard = reshard.0000000004 2024-09-12T00:31:37.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.355+0000 7f368f346800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:31:37.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.355+0000 7f368f346800 20 processing logshard = reshard.0000000005 2024-09-12T00:31:37.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.358+0000 7f368f346800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:31:37.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.358+0000 7f368f346800 20 processing logshard = reshard.0000000006 2024-09-12T00:31:37.358 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.359+0000 7f368f346800 20 process_entry resharding a-bucket 2024-09-12T00:31:37.358 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.359+0000 7f368f346800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:31:37.358 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.359+0000 7f368f346800 20 rados->read ofs=0 len=0 2024-09-12T00:31:37.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.360+0000 7f368f346800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:37.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.360+0000 7f368f346800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:31:37.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.360+0000 7f368f346800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:31:37.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.360+0000 7f368f346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:31:37.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.360+0000 7f368f346800 20 rados->read ofs=0 len=0 2024-09-12T00:31:37.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.360+0000 7f368f346800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:37.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.360+0000 7f368f346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:37.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.360+0000 7f368f346800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:37.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.360+0000 7f368f346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:37.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.360+0000 7f368f346800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:37.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.360+0000 7f368f346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:31:37.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.366+0000 7f368f346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:37.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.366+0000 7f368f346800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:37.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.366+0000 7f368f346800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:37.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.366+0000 7f368f346800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:31:37.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.366+0000 7f3563fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497000 cookie 93920548589312 notifier 5864 bl.length()=911 2024-09-12T00:31:37.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.366+0000 7f3563fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:37.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.366+0000 7f3563fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:37.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.366+0000 7f3563fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:37.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.368+0000 7f368f346800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:31:37.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.368+0000 7f368f346800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:31:37.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.368+0000 7f368f346800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:31:37.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.368+0000 7f368f346800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:31:37.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.371+0000 7f368f346800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.1.0 2024-09-12T00:31:37.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.371+0000 7f368f346800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.1.0 2024-09-12T00:31:37.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.371+0000 7f368f346800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.1.1 2024-09-12T00:31:37.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.371+0000 7f368f346800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.1.1 2024-09-12T00:31:37.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.371+0000 7f368f346800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.0 2024-09-12T00:31:37.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.372+0000 7f368f346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:37.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.372+0000 7f368f346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:31:37.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.373+0000 7f368f346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:37.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.373+0000 7f368f346800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:37.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.373+0000 7f368f346800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:37.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.373+0000 7f368f346800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:31:37.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.373+0000 7f3563fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497001 cookie 93920548589312 notifier 5864 bl.length()=911 2024-09-12T00:31:37.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.373+0000 7f3563fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:37.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.373+0000 7f3563fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:37.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.373+0000 7f3563fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:37.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.375+0000 7f368f346800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:31:37.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.375+0000 7f368f346800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:31:37.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.375+0000 7f368f346800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:31:37.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.375+0000 7f368f346800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:31:37.375 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.376+0000 7f368f346800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.0 2024-09-12T00:31:37.375 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.377+0000 7f368f346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:37.375 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.377+0000 7f368f346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:31:37.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.378+0000 7f368f346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:37.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.378+0000 7f368f346800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:37.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.378+0000 7f368f346800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:37.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.378+0000 7f368f346800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:31:37.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.379+0000 7f35637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 93920548589312 notifier 5864 bl.length()=879 2024-09-12T00:31:37.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.379+0000 7f35637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:37.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.379+0000 7f35637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:37.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.379+0000 7f35637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:37.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.380+0000 7f368f346800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:31:37.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.380+0000 7f368f346800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:31:37.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.380+0000 7f368f346800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:31:37.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.380+0000 7f368f346800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:31:37.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.381+0000 7f368f346800 1 execute INFO: reshard of bucket "a-bucket" from 1 shards to 2 shards completed successfully 2024-09-12T00:31:37.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.382+0000 7f368f346800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:31:37.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.385+0000 7f368f346800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:31:37.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.385+0000 7f368f346800 20 processing logshard = reshard.0000000007 2024-09-12T00:31:37.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.388+0000 7f368f346800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:31:37.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.388+0000 7f368f346800 20 processing logshard = reshard.0000000008 2024-09-12T00:31:37.389 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.390+0000 7f368f346800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:31:37.389 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.390+0000 7f368f346800 20 processing logshard = reshard.0000000009 2024-09-12T00:31:37.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.393+0000 7f368f346800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:31:37.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.393+0000 7f368f346800 20 processing logshard = reshard.0000000010 2024-09-12T00:31:37.394 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.395+0000 7f368f346800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:31:37.394 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.395+0000 7f368f346800 20 processing logshard = reshard.0000000011 2024-09-12T00:31:37.396 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.398+0000 7f368f346800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:31:37.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.398+0000 7f368f346800 20 processing logshard = reshard.0000000012 2024-09-12T00:31:37.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.400+0000 7f368f346800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:31:37.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.400+0000 7f368f346800 20 processing logshard = reshard.0000000013 2024-09-12T00:31:37.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.403+0000 7f368f346800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:31:37.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.403+0000 7f368f346800 20 processing logshard = reshard.0000000014 2024-09-12T00:31:37.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.406+0000 7f368f346800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:31:37.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.406+0000 7f368f346800 20 processing logshard = reshard.0000000015 2024-09-12T00:31:37.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.408+0000 7f368f346800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:31:37.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.409+0000 7f3542fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:37.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.412+0000 7f368f346800 20 remove_watcher() i=0 2024-09-12T00:31:37.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.412+0000 7f368f346800 2 removed watcher, disabling cache 2024-09-12T00:31:37.411 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.413+0000 7f368f346800 20 remove_watcher() i=1 2024-09-12T00:31:37.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.414+0000 7f368f346800 20 remove_watcher() i=2 2024-09-12T00:31:37.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.415+0000 7f368f346800 20 remove_watcher() i=3 2024-09-12T00:31:37.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.416+0000 7f368f346800 20 remove_watcher() i=4 2024-09-12T00:31:37.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.417+0000 7f368f346800 20 remove_watcher() i=5 2024-09-12T00:31:37.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.418+0000 7f368f346800 20 remove_watcher() i=6 2024-09-12T00:31:37.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:37.420+0000 7f368f346800 20 remove_watcher() i=7 2024-09-12T00:31:42.437 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:31:42.470 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:42.470 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:42.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.513+0000 7fd987b46800 20 rados->read ofs=0 len=0 2024-09-12T00:31:42.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.516+0000 7fd987b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:42.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.516+0000 7fd987b46800 20 realm 2024-09-12T00:31:42.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.516+0000 7fd987b46800 20 rados->read ofs=0 len=0 2024-09-12T00:31:42.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.516+0000 7fd987b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:42.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.516+0000 7fd987b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:42.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.516+0000 7fd987b46800 20 rados->read ofs=0 len=0 2024-09-12T00:31:42.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.516+0000 7fd987b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:42.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.516+0000 7fd987b46800 20 rados->read ofs=0 len=0 2024-09-12T00:31:42.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.517+0000 7fd987b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:42.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.517+0000 7fd987b46800 20 rados->read ofs=0 len=0 2024-09-12T00:31:42.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.518+0000 7fd987b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:42.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.518+0000 7fd987b46800 20 searching for the correct realm 2024-09-12T00:31:42.519 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.520+0000 7fd984e36640 0 -- 172.21.15.133:0/3420086166 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fd97c035070 msgr2=0x7fd97c018400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:42.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.524+0000 7fd984e36640 0 -- 172.21.15.133:0/3420086166 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fd978018070 msgr2=0x7fd97805fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:42.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.733+0000 7fd987b46800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:42.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.733+0000 7fd987b46800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:42.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.733+0000 7fd987b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:42.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.733+0000 7fd987b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:42.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.733+0000 7fd987b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:42.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.733+0000 7fd987b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:42.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.733+0000 7fd987b46800 20 rados->read ofs=0 len=0 2024-09-12T00:31:42.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.733+0000 7fd987b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:42.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.733+0000 7fd987b46800 20 rados->read ofs=0 len=0 2024-09-12T00:31:42.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.733+0000 7fd987b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:42.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.733+0000 7fd987b46800 20 rados->read ofs=0 len=0 2024-09-12T00:31:42.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.734+0000 7fd987b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:42.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.734+0000 7fd987b46800 20 zone default found 2024-09-12T00:31:42.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.734+0000 7fd987b46800 4 Realm: () 2024-09-12T00:31:42.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.734+0000 7fd987b46800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:42.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.734+0000 7fd987b46800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:42.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.734+0000 7fd987b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:42.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.734+0000 7fd987b46800 20 zonegroup default 2024-09-12T00:31:42.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.734+0000 7fd987b46800 20 rados->read ofs=0 len=0 2024-09-12T00:31:42.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.734+0000 7fd987b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:42.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.734+0000 7fd987b46800 20 rados->read ofs=0 len=0 2024-09-12T00:31:42.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.734+0000 7fd987b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:42.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.734+0000 7fd987b46800 20 rados->read ofs=0 len=0 2024-09-12T00:31:42.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.735+0000 7fd987b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:42.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.735+0000 7fd987b46800 20 started sync module instance, tier type = 2024-09-12T00:31:42.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.735+0000 7fd987b46800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:42.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.745+0000 7fd987b46800 20 add_watcher() i=0 2024-09-12T00:31:42.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.745+0000 7fd987b46800 20 add_watcher() i=1 2024-09-12T00:31:42.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.745+0000 7fd987b46800 20 add_watcher() i=2 2024-09-12T00:31:42.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.745+0000 7fd987b46800 20 add_watcher() i=3 2024-09-12T00:31:42.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.745+0000 7fd987b46800 20 add_watcher() i=4 2024-09-12T00:31:42.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.745+0000 7fd987b46800 20 add_watcher() i=5 2024-09-12T00:31:42.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.745+0000 7fd987b46800 20 add_watcher() i=6 2024-09-12T00:31:42.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.746+0000 7fd987b46800 20 add_watcher() i=7 2024-09-12T00:31:42.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.746+0000 7fd987b46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:42.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.748+0000 7fd83b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:42.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.749+0000 7fd987b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:42.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.749+0000 7fd987b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:42.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.749+0000 7fd987b46800 5 note: GC not initialized 2024-09-12T00:31:42.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.749+0000 7fd83a7e4640 20 reqs_thread_entry: start 2024-09-12T00:31:42.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.749+0000 7fd987b46800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:42.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.749+0000 7fd987b46800 20 Filter name: none 2024-09-12T00:31:42.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.750+0000 7fd7abfff640 20 reqs_thread_entry: start 2024-09-12T00:31:42.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.750+0000 7fd987b46800 20 rados->read ofs=0 len=0 2024-09-12T00:31:42.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.750+0000 7fd987b46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:42.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.750+0000 7fd987b46800 20 rados->read ofs=0 len=0 2024-09-12T00:31:42.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.751+0000 7fd987b46800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:42.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.751+0000 7fd987b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:42.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.751+0000 7fd987b46800 20 rados->read ofs=0 len=0 2024-09-12T00:31:42.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.751+0000 7fd987b46800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:42.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.751+0000 7fd987b46800 20 rados->read ofs=0 len=0 2024-09-12T00:31:42.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.752+0000 7fd987b46800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:42.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.752+0000 7fd987b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:42.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.753+0000 7fd83b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:42.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.755+0000 7fd987b46800 20 remove_watcher() i=0 2024-09-12T00:31:42.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.755+0000 7fd987b46800 2 removed watcher, disabling cache 2024-09-12T00:31:42.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.756+0000 7fd987b46800 20 remove_watcher() i=1 2024-09-12T00:31:42.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.758+0000 7fd987b46800 20 remove_watcher() i=2 2024-09-12T00:31:42.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.759+0000 7fd987b46800 20 remove_watcher() i=3 2024-09-12T00:31:42.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.760+0000 7fd987b46800 20 remove_watcher() i=4 2024-09-12T00:31:42.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.761+0000 7fd987b46800 20 remove_watcher() i=5 2024-09-12T00:31:42.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.762+0000 7fd987b46800 20 remove_watcher() i=6 2024-09-12T00:31:42.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:42.763+0000 7fd987b46800 20 remove_watcher() i=7 2024-09-12T00:31:42.774 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:42.774 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:31:42.774 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: a-bucket id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:31:42.774 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:42.774 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard add non empty bucket 2024-09-12T00:31:42.774 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:43.088 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:31:43.116 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:43.117 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:43.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.155+0000 7f73d5136800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.157+0000 7f73d5136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:43.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.157+0000 7f73d5136800 20 realm 2024-09-12T00:31:43.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.157+0000 7f73d5136800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.157+0000 7f73d5136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:43.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.157+0000 7f73d5136800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:43.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.157+0000 7f73d5136800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.158+0000 7f73d5136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:43.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.158+0000 7f73d5136800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.158+0000 7f73d5136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:43.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.158+0000 7f73d5136800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.159+0000 7f73d5136800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:43.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.159+0000 7f73d5136800 20 searching for the correct realm 2024-09-12T00:31:43.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.161+0000 7f73cbfff640 0 -- 172.21.15.133:0/2842404755 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f73bc07d040 msgr2=0x7f73bc08b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:43.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.367+0000 7f73cbfff640 0 -- 172.21.15.133:0/2842404755 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f73c406a090 msgr2=0x7f73c40378c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:43.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.575+0000 7f73d5136800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:43.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.575+0000 7f73d5136800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:43.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.575+0000 7f73d5136800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:43.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.575+0000 7f73d5136800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:43.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.575+0000 7f73d5136800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:43.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.575+0000 7f73d5136800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:43.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.575+0000 7f73d5136800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.575+0000 7f73d5136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:43.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.575+0000 7f73d5136800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.576+0000 7f73d5136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:43.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.576+0000 7f73d5136800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.576+0000 7f73d5136800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:43.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.576+0000 7f73d5136800 20 zone default found 2024-09-12T00:31:43.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.576+0000 7f73d5136800 4 Realm: () 2024-09-12T00:31:43.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.576+0000 7f73d5136800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:43.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.576+0000 7f73d5136800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:43.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.576+0000 7f73d5136800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:43.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.576+0000 7f73d5136800 20 zonegroup default 2024-09-12T00:31:43.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.576+0000 7f73d5136800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.576+0000 7f73d5136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:43.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.576+0000 7f73d5136800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.576+0000 7f73d5136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:43.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.576+0000 7f73d5136800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.577+0000 7f73d5136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:43.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.577+0000 7f73d5136800 20 started sync module instance, tier type = 2024-09-12T00:31:43.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.577+0000 7f73d5136800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:43.586 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.587+0000 7f73d5136800 20 add_watcher() i=0 2024-09-12T00:31:43.586 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.587+0000 7f73d5136800 20 add_watcher() i=1 2024-09-12T00:31:43.586 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.587+0000 7f73d5136800 20 add_watcher() i=2 2024-09-12T00:31:43.586 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.587+0000 7f73d5136800 20 add_watcher() i=3 2024-09-12T00:31:43.586 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.587+0000 7f73d5136800 20 add_watcher() i=4 2024-09-12T00:31:43.586 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.587+0000 7f73d5136800 20 add_watcher() i=5 2024-09-12T00:31:43.586 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.587+0000 7f73d5136800 20 add_watcher() i=6 2024-09-12T00:31:43.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.588+0000 7f73d5136800 20 add_watcher() i=7 2024-09-12T00:31:43.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.588+0000 7f73d5136800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:43.590 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.591+0000 7f7286fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:43.590 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.591+0000 7f73d5136800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:43.590 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.591+0000 7f73d5136800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:43.591 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.591+0000 7f73d5136800 5 note: GC not initialized 2024-09-12T00:31:43.591 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.591+0000 7f7285fe3640 20 reqs_thread_entry: start 2024-09-12T00:31:43.591 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.591+0000 7f73d5136800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:43.591 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.592+0000 7f73d5136800 20 Filter name: none 2024-09-12T00:31:43.591 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.592+0000 7f71f77fe640 20 reqs_thread_entry: start 2024-09-12T00:31:43.591 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.592+0000 7f73d5136800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.591 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.592+0000 7f73d5136800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:43.591 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.592+0000 7f73d5136800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.592+0000 7f73d5136800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:43.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.592+0000 7f73d5136800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:43.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.592+0000 7f73d5136800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.593+0000 7f73d5136800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:43.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.593+0000 7f73d5136800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.593+0000 7f73d5136800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:43.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.593+0000 7f73d5136800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:43.593 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.594+0000 7f7286fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:43.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.597+0000 7f73d5136800 20 remove_watcher() i=0 2024-09-12T00:31:43.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.597+0000 7f73d5136800 2 removed watcher, disabling cache 2024-09-12T00:31:43.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.598+0000 7f73d5136800 20 remove_watcher() i=1 2024-09-12T00:31:43.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.599+0000 7f73d5136800 20 remove_watcher() i=2 2024-09-12T00:31:43.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.600+0000 7f73d5136800 20 remove_watcher() i=3 2024-09-12T00:31:43.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.601+0000 7f73d5136800 20 remove_watcher() i=4 2024-09-12T00:31:43.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.602+0000 7f73d5136800 20 remove_watcher() i=5 2024-09-12T00:31:43.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.603+0000 7f73d5136800 20 remove_watcher() i=6 2024-09-12T00:31:43.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.604+0000 7f73d5136800 20 remove_watcher() i=7 2024-09-12T00:31:43.613 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:43.614 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:31:43.614 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: a-bucket id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 num_objects: 8 size_kb: 1 num_shards: 2 2024-09-12T00:31:43.614 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:43.615 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-09-12T00:31:43.646 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:43.646 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:43.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.685+0000 7f24dc632800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.686+0000 7f24dc632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:43.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.686+0000 7f24dc632800 20 realm 2024-09-12T00:31:43.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.686+0000 7f24dc632800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.687+0000 7f24dc632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:43.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.687+0000 7f24dc632800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:43.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.687+0000 7f24dc632800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.687+0000 7f24dc632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:43.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.687+0000 7f24dc632800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.687+0000 7f24dc632800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:43.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.687+0000 7f24dc632800 20 rados->read ofs=0 len=0 2024-09-12T00:31:43.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.688+0000 7f24dc632800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:43.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.688+0000 7f24dc632800 20 searching for the correct realm 2024-09-12T00:31:43.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.690+0000 7f24d7152640 0 -- 172.21.15.133:0/4063280642 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f24cc033040 msgr2=0x7f24cc058440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:43.893 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:43.894+0000 7f24d7152640 0 -- 172.21.15.133:0/4063280642 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f24c800e070 msgr2=0x7f24c805f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:44.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.101+0000 7f24dc632800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:44.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.101+0000 7f24dc632800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:44.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.101+0000 7f24dc632800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:44.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.101+0000 7f24dc632800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:44.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.101+0000 7f24dc632800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:44.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.101+0000 7f24dc632800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:44.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.101+0000 7f24dc632800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.101+0000 7f24dc632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.101+0000 7f24dc632800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.102+0000 7f24dc632800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:44.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.102+0000 7f24dc632800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.102+0000 7f24dc632800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:44.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.102+0000 7f24dc632800 20 zone default found 2024-09-12T00:31:44.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.102+0000 7f24dc632800 4 Realm: () 2024-09-12T00:31:44.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.102+0000 7f24dc632800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:44.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.102+0000 7f24dc632800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:44.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.102+0000 7f24dc632800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:44.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.102+0000 7f24dc632800 20 zonegroup default 2024-09-12T00:31:44.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.102+0000 7f24dc632800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.102+0000 7f24dc632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.102+0000 7f24dc632800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.103+0000 7f24dc632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.103+0000 7f24dc632800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.103+0000 7f24dc632800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.103+0000 7f24dc632800 20 started sync module instance, tier type = 2024-09-12T00:31:44.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.103+0000 7f24dc632800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:44.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.114+0000 7f24dc632800 20 add_watcher() i=0 2024-09-12T00:31:44.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.114+0000 7f24dc632800 20 add_watcher() i=1 2024-09-12T00:31:44.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.114+0000 7f24dc632800 20 add_watcher() i=2 2024-09-12T00:31:44.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.114+0000 7f24dc632800 20 add_watcher() i=3 2024-09-12T00:31:44.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.114+0000 7f24dc632800 20 add_watcher() i=4 2024-09-12T00:31:44.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.114+0000 7f24dc632800 20 add_watcher() i=5 2024-09-12T00:31:44.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.114+0000 7f24dc632800 20 add_watcher() i=6 2024-09-12T00:31:44.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.115+0000 7f24dc632800 20 add_watcher() i=7 2024-09-12T00:31:44.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.115+0000 7f24dc632800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:44.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.117+0000 7f238dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:44.116 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.117+0000 7f24dc632800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:44.116 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.117+0000 7f24dc632800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:44.116 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.117+0000 7f24dc632800 5 note: GC not initialized 2024-09-12T00:31:44.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.117+0000 7f238cfe1640 20 reqs_thread_entry: start 2024-09-12T00:31:44.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.117+0000 7f24dc632800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:44.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.118+0000 7f24dc632800 20 Filter name: none 2024-09-12T00:31:44.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.118+0000 7f23067fc640 20 reqs_thread_entry: start 2024-09-12T00:31:44.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.118+0000 7f24dc632800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:31:44.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.118+0000 7f24dc632800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.118+0000 7f24dc632800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:44.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.118+0000 7f24dc632800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:31:44.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.118+0000 7f24dc632800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:31:44.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.118+0000 7f24dc632800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:31:44.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.118+0000 7f24dc632800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.119+0000 7f24dc632800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:44.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.119+0000 7f24dc632800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:44.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.119+0000 7f24dc632800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:44.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.119+0000 7f24dc632800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:44.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.119+0000 7f24dc632800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:44.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.119+0000 7f24dc632800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:31:44.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.120+0000 7f238dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:44.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.123+0000 7f24dc632800 20 remove_watcher() i=0 2024-09-12T00:31:44.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.123+0000 7f24dc632800 2 removed watcher, disabling cache 2024-09-12T00:31:44.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.124+0000 7f24dc632800 20 remove_watcher() i=1 2024-09-12T00:31:44.123 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.125+0000 7f24dc632800 20 remove_watcher() i=2 2024-09-12T00:31:44.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.126+0000 7f24dc632800 20 remove_watcher() i=3 2024-09-12T00:31:44.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.127+0000 7f24dc632800 20 remove_watcher() i=4 2024-09-12T00:31:44.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.128+0000 7f24dc632800 20 remove_watcher() i=5 2024-09-12T00:31:44.128 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.129+0000 7f24dc632800 20 remove_watcher() i=6 2024-09-12T00:31:44.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.130+0000 7f24dc632800 20 remove_watcher() i=7 2024-09-12T00:31:44.141 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin reshard list 2024-09-12T00:31:44.168 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:44.168 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:44.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.207+0000 7f750a1af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.208+0000 7f750a1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.208+0000 7f750a1af800 20 realm 2024-09-12T00:31:44.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.208+0000 7f750a1af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.209+0000 7f750a1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.209+0000 7f750a1af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:44.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.209+0000 7f750a1af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.209+0000 7f750a1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.209+0000 7f750a1af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.209+0000 7f750a1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:44.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.209+0000 7f750a1af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.210+0000 7f750a1af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:44.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.210+0000 7f750a1af800 20 searching for the correct realm 2024-09-12T00:31:44.211 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.212+0000 7f74fffff640 0 -- 172.21.15.133:0/3263121808 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f74f0013030 msgr2=0x7f74f0037030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:44.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.215+0000 7f74fffff640 0 -- 172.21.15.133:0/3263121808 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f74f80745b0 msgr2=0x7f74f8068a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:44.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.422+0000 7f750a1af800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:44.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.422+0000 7f750a1af800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:44.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.422+0000 7f750a1af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:44.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.422+0000 7f750a1af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:44.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.422+0000 7f750a1af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:44.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.422+0000 7f750a1af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:44.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.422+0000 7f750a1af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.422+0000 7f750a1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.422+0000 7f750a1af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.423+0000 7f750a1af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:44.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.423+0000 7f750a1af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.423+0000 7f750a1af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:44.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.423+0000 7f750a1af800 20 zone default found 2024-09-12T00:31:44.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.423+0000 7f750a1af800 4 Realm: () 2024-09-12T00:31:44.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.423+0000 7f750a1af800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:44.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.423+0000 7f750a1af800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:44.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.423+0000 7f750a1af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:44.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.423+0000 7f750a1af800 20 zonegroup default 2024-09-12T00:31:44.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.423+0000 7f750a1af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.423+0000 7f750a1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.423+0000 7f750a1af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.423+0000 7f750a1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.423+0000 7f750a1af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.424+0000 7f750a1af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.424+0000 7f750a1af800 20 started sync module instance, tier type = 2024-09-12T00:31:44.424 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.424+0000 7f750a1af800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:44.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.433+0000 7f750a1af800 20 add_watcher() i=0 2024-09-12T00:31:44.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.433+0000 7f750a1af800 20 add_watcher() i=1 2024-09-12T00:31:44.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.433+0000 7f750a1af800 20 add_watcher() i=2 2024-09-12T00:31:44.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.433+0000 7f750a1af800 20 add_watcher() i=3 2024-09-12T00:31:44.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.433+0000 7f750a1af800 20 add_watcher() i=4 2024-09-12T00:31:44.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.433+0000 7f750a1af800 20 add_watcher() i=5 2024-09-12T00:31:44.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.433+0000 7f750a1af800 20 add_watcher() i=6 2024-09-12T00:31:44.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.434+0000 7f750a1af800 20 add_watcher() i=7 2024-09-12T00:31:44.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.434+0000 7f750a1af800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:44.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.436+0000 7f73bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:44.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.436+0000 7f750a1af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:44.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.436+0000 7f750a1af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:44.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.436+0000 7f750a1af800 5 note: GC not initialized 2024-09-12T00:31:44.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.437+0000 7f73bcfe1640 20 reqs_thread_entry: start 2024-09-12T00:31:44.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.437+0000 7f750a1af800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:44.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.437+0000 7f750a1af800 20 Filter name: none 2024-09-12T00:31:44.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.437+0000 7f73367fc640 20 reqs_thread_entry: start 2024-09-12T00:31:44.441 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.443+0000 7f73bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:44.445 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.445+0000 7f750a1af800 20 remove_watcher() i=0 2024-09-12T00:31:44.445 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.445+0000 7f750a1af800 2 removed watcher, disabling cache 2024-09-12T00:31:44.445 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.446+0000 7f750a1af800 20 remove_watcher() i=1 2024-09-12T00:31:44.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.447+0000 7f750a1af800 20 remove_watcher() i=2 2024-09-12T00:31:44.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.449+0000 7f750a1af800 20 remove_watcher() i=3 2024-09-12T00:31:44.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.450+0000 7f750a1af800 20 remove_watcher() i=4 2024-09-12T00:31:44.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.451+0000 7f750a1af800 20 remove_watcher() i=5 2024-09-12T00:31:44.450 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.452+0000 7f750a1af800 20 remove_watcher() i=6 2024-09-12T00:31:44.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.453+0000 7f750a1af800 20 remove_watcher() i=7 2024-09-12T00:31:44.462 INFO:tasks.workunit.client.0.smithi133.stderr:bucket name a-bucket 2024-09-12T00:31:44.462 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard process non empty bucket 2024-09-12T00:31:44.462 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:44.463 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin reshard process 2024-09-12T00:31:44.490 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:44.490 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:44.528 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.529+0000 7fa22d20e800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.530 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.531+0000 7fa22d20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.530 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.531+0000 7fa22d20e800 20 realm 2024-09-12T00:31:44.530 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.531+0000 7fa22d20e800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.530 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.531+0000 7fa22d20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.530 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.531+0000 7fa22d20e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:44.531 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.531+0000 7fa22d20e800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.531 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.532+0000 7fa22d20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.531 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.532+0000 7fa22d20e800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.531 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.532+0000 7fa22d20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:44.531 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.532+0000 7fa22d20e800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.533+0000 7fa22d20e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:44.532 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.533+0000 7fa22d20e800 20 searching for the correct realm 2024-09-12T00:31:44.534 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.535+0000 7fa22916c640 0 -- 172.21.15.133:0/692909019 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x564f396337e0 msgr2=0x564f39635bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:44.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.539+0000 7fa22016a640 0 -- 172.21.15.133:0/692909019 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fa218025020 msgr2=0x7fa218069a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:44.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.746+0000 7fa22d20e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:44.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.746+0000 7fa22d20e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:44.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.746+0000 7fa22d20e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:44.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.746+0000 7fa22d20e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:44.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.746+0000 7fa22d20e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:44.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.746+0000 7fa22d20e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:44.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.746+0000 7fa22d20e800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.746+0000 7fa22d20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.746+0000 7fa22d20e800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.747+0000 7fa22d20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:44.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.747+0000 7fa22d20e800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.747+0000 7fa22d20e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:44.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.747+0000 7fa22d20e800 20 zone default found 2024-09-12T00:31:44.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.747+0000 7fa22d20e800 4 Realm: () 2024-09-12T00:31:44.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.747+0000 7fa22d20e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:44.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.747+0000 7fa22d20e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:44.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.747+0000 7fa22d20e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:44.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.747+0000 7fa22d20e800 20 zonegroup default 2024-09-12T00:31:44.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.747+0000 7fa22d20e800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.747+0000 7fa22d20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.747+0000 7fa22d20e800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.748+0000 7fa22d20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.748+0000 7fa22d20e800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.748+0000 7fa22d20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.748+0000 7fa22d20e800 20 started sync module instance, tier type = 2024-09-12T00:31:44.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.748+0000 7fa22d20e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:44.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.757+0000 7fa22d20e800 20 add_watcher() i=0 2024-09-12T00:31:44.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.757+0000 7fa22d20e800 20 add_watcher() i=1 2024-09-12T00:31:44.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.757+0000 7fa22d20e800 20 add_watcher() i=2 2024-09-12T00:31:44.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.757+0000 7fa22d20e800 20 add_watcher() i=3 2024-09-12T00:31:44.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.757+0000 7fa22d20e800 20 add_watcher() i=4 2024-09-12T00:31:44.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.757+0000 7fa22d20e800 20 add_watcher() i=5 2024-09-12T00:31:44.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.757+0000 7fa22d20e800 20 add_watcher() i=6 2024-09-12T00:31:44.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.759+0000 7fa22d20e800 20 add_watcher() i=7 2024-09-12T00:31:44.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.759+0000 7fa22d20e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:44.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.760+0000 7fa0defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:44.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.761+0000 7fa22d20e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:44.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.761+0000 7fa22d20e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:44.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.761+0000 7fa22d20e800 5 note: GC not initialized 2024-09-12T00:31:44.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.761+0000 7fa0ddfe3640 20 reqs_thread_entry: start 2024-09-12T00:31:44.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.761+0000 7fa22d20e800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:44.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.761+0000 7fa22d20e800 20 Filter name: none 2024-09-12T00:31:44.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.761+0000 7fa04f7fe640 20 reqs_thread_entry: start 2024-09-12T00:31:44.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.761+0000 7fa22d20e800 20 processing logshard = reshard.0000000000 2024-09-12T00:31:44.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.764+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:31:44.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.764+0000 7fa22d20e800 20 processing logshard = reshard.0000000001 2024-09-12T00:31:44.765 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.766+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:31:44.765 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.766+0000 7fa22d20e800 20 processing logshard = reshard.0000000002 2024-09-12T00:31:44.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.770+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:31:44.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.770+0000 7fa22d20e800 20 processing logshard = reshard.0000000003 2024-09-12T00:31:44.770 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.772+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:31:44.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.772+0000 7fa22d20e800 20 processing logshard = reshard.0000000004 2024-09-12T00:31:44.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.774+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:31:44.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.774+0000 7fa22d20e800 20 processing logshard = reshard.0000000005 2024-09-12T00:31:44.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.777+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:31:44.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.777+0000 7fa22d20e800 20 processing logshard = reshard.0000000006 2024-09-12T00:31:44.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.779+0000 7fa22d20e800 20 process_entry resharding a-bucket 2024-09-12T00:31:44.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.779+0000 7fa22d20e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:31:44.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.779+0000 7fa22d20e800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.779+0000 7fa22d20e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:44.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.779+0000 7fa22d20e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:31:44.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.779+0000 7fa22d20e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:31:44.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.779+0000 7fa22d20e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:31:44.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.779+0000 7fa22d20e800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.779+0000 7fa22d20e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:44.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.779+0000 7fa22d20e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:44.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.779+0000 7fa22d20e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:44.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.779+0000 7fa22d20e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:44.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.779+0000 7fa22d20e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:44.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.779+0000 7fa22d20e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:31:44.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.785+0000 7fa22d20e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:44.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.785+0000 7fa22d20e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:44.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.785+0000 7fa22d20e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:44.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.785+0000 7fa22d20e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:31:44.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.785+0000 7fa0ff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 94898265241200 notifier 6261 bl.length()=911 2024-09-12T00:31:44.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.785+0000 7fa0ff7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:44.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.785+0000 7fa0ff7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:44.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.785+0000 7fa0ff7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:44.785 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.787+0000 7fa22d20e800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:31:44.785 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.787+0000 7fa22d20e800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:31:44.785 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.787+0000 7fa22d20e800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:31:44.785 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.787+0000 7fa22d20e800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:31:44.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.789+0000 7fa22d20e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:31:44.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.789+0000 7fa22d20e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:31:44.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.789+0000 7fa22d20e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:31:44.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.789+0000 7fa22d20e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:31:44.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.789+0000 7fa22d20e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:31:44.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.789+0000 7fa22d20e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:31:44.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.789+0000 7fa22d20e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.1.0 2024-09-12T00:31:44.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.789+0000 7fa22d20e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.1.0 2024-09-12T00:31:44.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.789+0000 7fa22d20e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.1.1 2024-09-12T00:31:44.789 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.789+0000 7fa22d20e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.1.1 2024-09-12T00:31:44.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.792+0000 7fa22d20e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:44.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.792+0000 7fa22d20e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:31:44.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.793+0000 7fa22d20e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:44.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.793+0000 7fa22d20e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:44.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.793+0000 7fa22d20e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:44.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.793+0000 7fa22d20e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:31:44.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.794+0000 7fa0ff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 94898265241200 notifier 6261 bl.length()=911 2024-09-12T00:31:44.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.794+0000 7fa0ff7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:44.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.794+0000 7fa0ff7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:44.793 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.794+0000 7fa0ff7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:44.795 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.797+0000 7fa22d20e800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:31:44.795 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.797+0000 7fa22d20e800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:31:44.796 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.797+0000 7fa22d20e800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:31:44.796 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.797+0000 7fa22d20e800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:31:44.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.798+0000 7fa22d20e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.1.0 2024-09-12T00:31:44.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.798+0000 7fa22d20e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.1.0 2024-09-12T00:31:44.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.798+0000 7fa22d20e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.1.1 2024-09-12T00:31:44.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.798+0000 7fa22d20e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.1.1 2024-09-12T00:31:44.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.799+0000 7fa22d20e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:44.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.799+0000 7fa22d20e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:31:44.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.800+0000 7fa22d20e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:44.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.800+0000 7fa22d20e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:44.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.800+0000 7fa22d20e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:44.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.800+0000 7fa22d20e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:31:44.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.800+0000 7fa0ff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497005 cookie 94898265241200 notifier 6261 bl.length()=879 2024-09-12T00:31:44.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.800+0000 7fa0ff7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:31:44.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.800+0000 7fa0ff7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:31:44.800 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.800+0000 7fa0ff7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:31:44.800 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.802+0000 7fa22d20e800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:31:44.800 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.802+0000 7fa22d20e800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:31:44.800 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.802+0000 7fa22d20e800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:31:44.800 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.802+0000 7fa22d20e800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:31:44.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.803+0000 7fa22d20e800 1 execute INFO: reshard of bucket "a-bucket" from 2 shards to 3 shards completed successfully 2024-09-12T00:31:44.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.804+0000 7fa22d20e800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:31:44.805 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.806+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:31:44.805 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.806+0000 7fa22d20e800 20 processing logshard = reshard.0000000007 2024-09-12T00:31:44.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.811+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:31:44.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.811+0000 7fa22d20e800 20 processing logshard = reshard.0000000008 2024-09-12T00:31:44.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.814+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:31:44.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.814+0000 7fa22d20e800 20 processing logshard = reshard.0000000009 2024-09-12T00:31:44.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.816+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:31:44.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.816+0000 7fa22d20e800 20 processing logshard = reshard.0000000010 2024-09-12T00:31:44.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.819+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:31:44.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.819+0000 7fa22d20e800 20 processing logshard = reshard.0000000011 2024-09-12T00:31:44.820 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.821+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:31:44.820 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.821+0000 7fa22d20e800 20 processing logshard = reshard.0000000012 2024-09-12T00:31:44.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.823+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:31:44.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.823+0000 7fa22d20e800 20 processing logshard = reshard.0000000013 2024-09-12T00:31:44.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.826+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:31:44.825 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.826+0000 7fa22d20e800 20 processing logshard = reshard.0000000014 2024-09-12T00:31:44.827 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.829+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:31:44.827 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.829+0000 7fa22d20e800 20 processing logshard = reshard.0000000015 2024-09-12T00:31:44.829 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.831+0000 7fa22d20e800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:31:44.830 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.831+0000 7fa0defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:44.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.834+0000 7fa22d20e800 20 remove_watcher() i=0 2024-09-12T00:31:44.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.834+0000 7fa22d20e800 2 removed watcher, disabling cache 2024-09-12T00:31:44.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.835+0000 7fa22d20e800 20 remove_watcher() i=1 2024-09-12T00:31:44.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.836+0000 7fa22d20e800 20 remove_watcher() i=2 2024-09-12T00:31:44.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.837+0000 7fa22d20e800 20 remove_watcher() i=3 2024-09-12T00:31:44.837 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.838+0000 7fa22d20e800 20 remove_watcher() i=4 2024-09-12T00:31:44.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.839+0000 7fa22d20e800 20 remove_watcher() i=5 2024-09-12T00:31:44.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.840+0000 7fa22d20e800 20 remove_watcher() i=6 2024-09-12T00:31:44.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.841+0000 7fa22d20e800 20 remove_watcher() i=7 2024-09-12T00:31:44.853 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:31:44.881 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:44.882 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:44.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.920+0000 7fecaeb23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.921+0000 7fecaeb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.921+0000 7fecaeb23800 20 realm 2024-09-12T00:31:44.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.921+0000 7fecaeb23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.922+0000 7fecaeb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.922+0000 7fecaeb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:44.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.922+0000 7fecaeb23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.922+0000 7fecaeb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:44.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.922+0000 7fecaeb23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.923+0000 7fecaeb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:44.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.923+0000 7fecaeb23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:44.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.924+0000 7fecaeb23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:44.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.924+0000 7fecaeb23800 20 searching for the correct realm 2024-09-12T00:31:44.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.926+0000 7fecaa012640 0 -- 172.21.15.133:0/2017649054 >> [v2:172.21.15.133:6824/186004193,v1:172.21.15.133:6825/186004193] conn(0x558cc1dc1450 msgr2=0x558cc1dc3840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:44.927 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:44.929+0000 7fecaa813640 0 -- 172.21.15.133:0/2017649054 >> [v2:172.21.15.160:6818/507321805,v1:172.21.15.160:6819/507321805] conn(0x558cc1dc1450 msgr2=0x7fec94054950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:45.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.138+0000 7fecaeb23800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:45.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.138+0000 7fecaeb23800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:45.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.138+0000 7fecaeb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:45.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.138+0000 7fecaeb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:45.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.138+0000 7fecaeb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:45.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.138+0000 7fecaeb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:45.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.138+0000 7fecaeb23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:45.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.138+0000 7fecaeb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:45.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.138+0000 7fecaeb23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:45.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.138+0000 7fecaeb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:45.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.138+0000 7fecaeb23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:45.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.139+0000 7fecaeb23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:45.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.139+0000 7fecaeb23800 20 zone default found 2024-09-12T00:31:45.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.139+0000 7fecaeb23800 4 Realm: () 2024-09-12T00:31:45.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.139+0000 7fecaeb23800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:45.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.139+0000 7fecaeb23800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:45.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.139+0000 7fecaeb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:45.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.139+0000 7fecaeb23800 20 zonegroup default 2024-09-12T00:31:45.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.139+0000 7fecaeb23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:45.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.139+0000 7fecaeb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:45.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.139+0000 7fecaeb23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:45.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.140+0000 7fecaeb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:45.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.140+0000 7fecaeb23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:45.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.140+0000 7fecaeb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:45.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.140+0000 7fecaeb23800 20 started sync module instance, tier type = 2024-09-12T00:31:45.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.140+0000 7fecaeb23800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:45.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.149+0000 7fecaeb23800 20 add_watcher() i=0 2024-09-12T00:31:45.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.149+0000 7fecaeb23800 20 add_watcher() i=1 2024-09-12T00:31:45.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.149+0000 7fecaeb23800 20 add_watcher() i=2 2024-09-12T00:31:45.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.149+0000 7fecaeb23800 20 add_watcher() i=3 2024-09-12T00:31:45.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.149+0000 7fecaeb23800 20 add_watcher() i=4 2024-09-12T00:31:45.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.149+0000 7fecaeb23800 20 add_watcher() i=5 2024-09-12T00:31:45.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.149+0000 7fecaeb23800 20 add_watcher() i=6 2024-09-12T00:31:45.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.150+0000 7fecaeb23800 20 add_watcher() i=7 2024-09-12T00:31:45.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.150+0000 7fecaeb23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:45.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.152+0000 7feb617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:45.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.153+0000 7fecaeb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:45.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.153+0000 7fecaeb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:45.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.153+0000 7fecaeb23800 5 note: GC not initialized 2024-09-12T00:31:45.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.153+0000 7feadbfff640 20 reqs_thread_entry: start 2024-09-12T00:31:45.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.153+0000 7fecaeb23800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:45.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.153+0000 7fecaeb23800 20 Filter name: none 2024-09-12T00:31:45.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.153+0000 7fead9ffb640 20 reqs_thread_entry: start 2024-09-12T00:31:45.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.153+0000 7fecaeb23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:45.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.154+0000 7fecaeb23800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:45.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.154+0000 7fecaeb23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:45.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.154+0000 7fecaeb23800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:45.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.154+0000 7fecaeb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:45.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.154+0000 7fecaeb23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:45.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.154+0000 7fecaeb23800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:31:45.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.155+0000 7fecaeb23800 20 rados->read ofs=0 len=0 2024-09-12T00:31:45.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.155+0000 7fecaeb23800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:31:45.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.155+0000 7fecaeb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:45.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.156+0000 7feb617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:45.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.158+0000 7fecaeb23800 20 remove_watcher() i=0 2024-09-12T00:31:45.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.158+0000 7fecaeb23800 2 removed watcher, disabling cache 2024-09-12T00:31:45.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.159+0000 7fecaeb23800 20 remove_watcher() i=1 2024-09-12T00:31:45.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.160+0000 7fecaeb23800 20 remove_watcher() i=2 2024-09-12T00:31:45.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.161+0000 7fecaeb23800 20 remove_watcher() i=3 2024-09-12T00:31:45.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.162+0000 7fecaeb23800 20 remove_watcher() i=4 2024-09-12T00:31:45.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.163+0000 7fecaeb23800 20 remove_watcher() i=5 2024-09-12T00:31:45.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.164+0000 7fecaeb23800 20 remove_watcher() i=6 2024-09-12T00:31:45.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:45.165+0000 7fecaeb23800 20 remove_watcher() i=7 2024-09-12T00:31:45.174 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:45.175 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:31:45.175 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: a-bucket id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T00:31:45.175 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:45.175 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T00:31:45.175 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:46.007 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:31:46.035 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:46.036 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:46.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.074+0000 7f0499742800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.075+0000 7f0499742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:46.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.075+0000 7f0499742800 20 realm 2024-09-12T00:31:46.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.075+0000 7f0499742800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.076+0000 7f0499742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:46.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.076+0000 7f0499742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:46.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.076+0000 7f0499742800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.076+0000 7f0499742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:46.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.076+0000 7f0499742800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.076+0000 7f0499742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:46.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.076+0000 7f0499742800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.077+0000 7f0499742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:46.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.077+0000 7f0499742800 20 searching for the correct realm 2024-09-12T00:31:46.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.079+0000 7f048ffff640 0 -- 172.21.15.133:0/1691109111 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f048001f6a0 msgr2=0x7f048003a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:46.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.284+0000 7f048ffff640 0 -- 172.21.15.133:0/1691109111 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f0488056a50 msgr2=0x7f048804d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:46.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.491+0000 7f0499742800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:46.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.491+0000 7f0499742800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:46.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.491+0000 7f0499742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:46.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.491+0000 7f0499742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:46.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.491+0000 7f0499742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:46.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.491+0000 7f0499742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:46.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.491+0000 7f0499742800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.492+0000 7f0499742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:46.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.492+0000 7f0499742800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.492+0000 7f0499742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:46.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.492+0000 7f0499742800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.492+0000 7f0499742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:46.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.492+0000 7f0499742800 20 zone default found 2024-09-12T00:31:46.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.492+0000 7f0499742800 4 Realm: () 2024-09-12T00:31:46.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.492+0000 7f0499742800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:46.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.492+0000 7f0499742800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:46.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.492+0000 7f0499742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:46.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.492+0000 7f0499742800 20 zonegroup default 2024-09-12T00:31:46.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.492+0000 7f0499742800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.493+0000 7f0499742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:46.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.493+0000 7f0499742800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.493+0000 7f0499742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:46.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.493+0000 7f0499742800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.493+0000 7f0499742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:46.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.493+0000 7f0499742800 20 started sync module instance, tier type = 2024-09-12T00:31:46.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.493+0000 7f0499742800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:46.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.502+0000 7f0499742800 20 add_watcher() i=0 2024-09-12T00:31:46.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.502+0000 7f0499742800 20 add_watcher() i=1 2024-09-12T00:31:46.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.502+0000 7f0499742800 20 add_watcher() i=2 2024-09-12T00:31:46.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.502+0000 7f0499742800 20 add_watcher() i=3 2024-09-12T00:31:46.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.502+0000 7f0499742800 20 add_watcher() i=4 2024-09-12T00:31:46.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.502+0000 7f0499742800 20 add_watcher() i=5 2024-09-12T00:31:46.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.502+0000 7f0499742800 20 add_watcher() i=6 2024-09-12T00:31:46.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.503+0000 7f0499742800 20 add_watcher() i=7 2024-09-12T00:31:46.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.503+0000 7f0499742800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:46.504 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.505+0000 7f034bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:46.504 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.505+0000 7f0499742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:46.504 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.505+0000 7f0499742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:46.504 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.505+0000 7f0499742800 5 note: GC not initialized 2024-09-12T00:31:46.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.505+0000 7f034afe5640 20 reqs_thread_entry: start 2024-09-12T00:31:46.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.506+0000 7f0499742800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:46.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.506+0000 7f0499742800 20 Filter name: none 2024-09-12T00:31:46.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.506+0000 7f0348fe1640 20 reqs_thread_entry: start 2024-09-12T00:31:46.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.506+0000 7f0499742800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.506+0000 7f0499742800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:31:46.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.506+0000 7f0499742800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.507+0000 7f0499742800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:31:46.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.507+0000 7f0499742800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:46.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.507+0000 7f0499742800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.507+0000 7f0499742800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:31:46.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.507+0000 7f0499742800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.507+0000 7f0499742800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:31:46.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.507+0000 7f0499742800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:46.507 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.509+0000 7f034bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:46.509 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.511+0000 7f0499742800 20 remove_watcher() i=0 2024-09-12T00:31:46.509 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.511+0000 7f0499742800 2 removed watcher, disabling cache 2024-09-12T00:31:46.510 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.512+0000 7f0499742800 20 remove_watcher() i=1 2024-09-12T00:31:46.511 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.513+0000 7f0499742800 20 remove_watcher() i=2 2024-09-12T00:31:46.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.514+0000 7f0499742800 20 remove_watcher() i=3 2024-09-12T00:31:46.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.515+0000 7f0499742800 20 remove_watcher() i=4 2024-09-12T00:31:46.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.516+0000 7f0499742800 20 remove_watcher() i=5 2024-09-12T00:31:46.515 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.517+0000 7f0499742800 20 remove_watcher() i=6 2024-09-12T00:31:46.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.518+0000 7f0499742800 20 remove_watcher() i=7 2024-09-12T00:31:46.528 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:46.528 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:31:46.528 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-init-index id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:31:46.528 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:46.529 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T00:31:46.564 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:46.564 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:46.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.603+0000 7faf4bd35800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.604+0000 7faf4bd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:46.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.604+0000 7faf4bd35800 20 realm 2024-09-12T00:31:46.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.604+0000 7faf4bd35800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.604+0000 7faf4bd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:46.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.604+0000 7faf4bd35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:46.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.604+0000 7faf4bd35800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.605+0000 7faf4bd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:46.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.605+0000 7faf4bd35800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.605+0000 7faf4bd35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:46.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.605+0000 7faf4bd35800 20 rados->read ofs=0 len=0 2024-09-12T00:31:46.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.606+0000 7faf4bd35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:46.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.606+0000 7faf4bd35800 20 searching for the correct realm 2024-09-12T00:31:46.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.608+0000 7faf3ffff640 0 -- 172.21.15.133:0/3546100399 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7faf30017070 msgr2=0x7faf30060390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:46.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:46.813+0000 7faf3ffff640 0 -- 172.21.15.133:0/3546100399 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7faf3803e920 msgr2=0x7faf3802d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:47.019 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.019+0000 7faf4bd35800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:47.019 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.019+0000 7faf4bd35800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:47.019 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.019+0000 7faf4bd35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:47.019 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.019+0000 7faf4bd35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:47.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.019+0000 7faf4bd35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:47.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.019+0000 7faf4bd35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:47.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.019+0000 7faf4bd35800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.020+0000 7faf4bd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:47.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.020+0000 7faf4bd35800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.020+0000 7faf4bd35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:47.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.020+0000 7faf4bd35800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.020+0000 7faf4bd35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:47.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.020+0000 7faf4bd35800 20 zone default found 2024-09-12T00:31:47.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.020+0000 7faf4bd35800 4 Realm: () 2024-09-12T00:31:47.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.020+0000 7faf4bd35800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:47.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.020+0000 7faf4bd35800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:47.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.020+0000 7faf4bd35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:47.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.020+0000 7faf4bd35800 20 zonegroup default 2024-09-12T00:31:47.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.020+0000 7faf4bd35800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.021+0000 7faf4bd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:47.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.021+0000 7faf4bd35800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.021+0000 7faf4bd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:47.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.021+0000 7faf4bd35800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.021+0000 7faf4bd35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:47.022 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.021+0000 7faf4bd35800 20 started sync module instance, tier type = 2024-09-12T00:31:47.022 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.021+0000 7faf4bd35800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:47.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.030+0000 7faf4bd35800 20 add_watcher() i=0 2024-09-12T00:31:47.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.030+0000 7faf4bd35800 20 add_watcher() i=1 2024-09-12T00:31:47.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.030+0000 7faf4bd35800 20 add_watcher() i=2 2024-09-12T00:31:47.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.030+0000 7faf4bd35800 20 add_watcher() i=3 2024-09-12T00:31:47.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.030+0000 7faf4bd35800 20 add_watcher() i=4 2024-09-12T00:31:47.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.030+0000 7faf4bd35800 20 add_watcher() i=5 2024-09-12T00:31:47.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.030+0000 7faf4bd35800 20 add_watcher() i=6 2024-09-12T00:31:47.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.031+0000 7faf4bd35800 20 add_watcher() i=7 2024-09-12T00:31:47.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.031+0000 7faf4bd35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:47.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.033+0000 7fadfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:47.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.033+0000 7faf4bd35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:47.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.033+0000 7faf4bd35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:47.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.033+0000 7faf4bd35800 5 note: GC not initialized 2024-09-12T00:31:47.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.033+0000 7fadfcfe1640 20 reqs_thread_entry: start 2024-09-12T00:31:47.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.033+0000 7faf4bd35800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:47.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.033+0000 7faf4bd35800 20 Filter name: none 2024-09-12T00:31:47.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.034+0000 7fad767fc640 20 reqs_thread_entry: start 2024-09-12T00:31:47.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.034+0000 7faf4bd35800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:31:47.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.034+0000 7faf4bd35800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.034+0000 7faf4bd35800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:31:47.034 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.034+0000 7faf4bd35800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:31:47.034 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.034+0000 7faf4bd35800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:31:47.034 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.034+0000 7faf4bd35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 : miss 2024-09-12T00:31:47.034 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.034+0000 7faf4bd35800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.034 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.034+0000 7faf4bd35800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:31:47.034 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.034+0000 7faf4bd35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 info.flags=0x17 2024-09-12T00:31:47.034 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.034+0000 7faf4bd35800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 to cache LRU end 2024-09-12T00:31:47.034 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.034+0000 7faf4bd35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:47.034 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.034+0000 7faf4bd35800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:47.034 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.034+0000 7faf4bd35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 2024-09-12T00:31:47.035 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.036+0000 7faf4bd35800 -1 Injecting error=-5 at location=init_index 2024-09-12T00:31:47.035 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.036+0000 7faf4bd35800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T00:31:47.036 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.037+0000 7fadfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:47.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.039+0000 7faf4bd35800 20 remove_watcher() i=0 2024-09-12T00:31:47.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.039+0000 7faf4bd35800 2 removed watcher, disabling cache 2024-09-12T00:31:47.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.040+0000 7faf4bd35800 20 remove_watcher() i=1 2024-09-12T00:31:47.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.042+0000 7faf4bd35800 20 remove_watcher() i=2 2024-09-12T00:31:47.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.043+0000 7faf4bd35800 20 remove_watcher() i=3 2024-09-12T00:31:47.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.044+0000 7faf4bd35800 20 remove_watcher() i=4 2024-09-12T00:31:47.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.045+0000 7faf4bd35800 20 remove_watcher() i=5 2024-09-12T00:31:47.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.046+0000 7faf4bd35800 20 remove_watcher() i=6 2024-09-12T00:31:47.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.047+0000 7faf4bd35800 20 remove_watcher() i=7 2024-09-12T00:31:47.057 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:31:47.087 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:47.087 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:47.123 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.124+0000 7f092e924800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.126+0000 7f092e924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:47.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.126+0000 7f092e924800 20 realm 2024-09-12T00:31:47.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.126+0000 7f092e924800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.126+0000 7f092e924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:47.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.126+0000 7f092e924800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:47.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.126+0000 7f092e924800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.126+0000 7f092e924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:47.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.126+0000 7f092e924800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.127+0000 7f092e924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:47.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.127+0000 7f092e924800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.128+0000 7f092e924800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:47.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.128+0000 7f092e924800 20 searching for the correct realm 2024-09-12T00:31:47.128 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.130+0000 7f0929dd1640 0 -- 172.21.15.133:0/1123360981 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f0920007e20 msgr2=0x7f09200e3ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:47.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.335+0000 7f0929dd1640 0 -- 172.21.15.133:0/1123360981 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f091c033040 msgr2=0x7f091c025400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:47.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.542+0000 7f092e924800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:47.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.542+0000 7f092e924800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:47.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.542+0000 7f092e924800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:47.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.542+0000 7f092e924800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:47.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.542+0000 7f092e924800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:47.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.542+0000 7f092e924800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:47.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.542+0000 7f092e924800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.542+0000 7f092e924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:47.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.542+0000 7f092e924800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.542+0000 7f092e924800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:47.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.542+0000 7f092e924800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.543+0000 7f092e924800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:47.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.543+0000 7f092e924800 20 zone default found 2024-09-12T00:31:47.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.543+0000 7f092e924800 4 Realm: () 2024-09-12T00:31:47.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.543+0000 7f092e924800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:47.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.543+0000 7f092e924800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:47.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.543+0000 7f092e924800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:47.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.543+0000 7f092e924800 20 zonegroup default 2024-09-12T00:31:47.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.543+0000 7f092e924800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.543+0000 7f092e924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:47.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.543+0000 7f092e924800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.544+0000 7f092e924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:47.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.544+0000 7f092e924800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.544 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.544+0000 7f092e924800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:47.544 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.544+0000 7f092e924800 20 started sync module instance, tier type = 2024-09-12T00:31:47.544 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.544+0000 7f092e924800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:47.552 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.554+0000 7f092e924800 20 add_watcher() i=0 2024-09-12T00:31:47.552 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.554+0000 7f092e924800 20 add_watcher() i=1 2024-09-12T00:31:47.552 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.554+0000 7f092e924800 20 add_watcher() i=2 2024-09-12T00:31:47.552 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.554+0000 7f092e924800 20 add_watcher() i=3 2024-09-12T00:31:47.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.554+0000 7f092e924800 20 add_watcher() i=4 2024-09-12T00:31:47.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.554+0000 7f092e924800 20 add_watcher() i=5 2024-09-12T00:31:47.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.554+0000 7f092e924800 20 add_watcher() i=6 2024-09-12T00:31:47.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.555+0000 7f092e924800 20 add_watcher() i=7 2024-09-12T00:31:47.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.555+0000 7f092e924800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:47.555 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.557+0000 7f07e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:47.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.557+0000 7f092e924800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:47.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.557+0000 7f092e924800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:47.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.557+0000 7f092e924800 5 note: GC not initialized 2024-09-12T00:31:47.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.557+0000 7f075b7fe640 20 reqs_thread_entry: start 2024-09-12T00:31:47.557 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.557+0000 7f092e924800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:47.557 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.558+0000 7f092e924800 20 Filter name: none 2024-09-12T00:31:47.557 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.558+0000 7f07597fa640 20 reqs_thread_entry: start 2024-09-12T00:31:47.557 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.558+0000 7f092e924800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.558 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.558+0000 7f092e924800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:31:47.558 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.558+0000 7f092e924800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.558 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.559+0000 7f092e924800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:31:47.558 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.559+0000 7f092e924800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:47.558 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.559+0000 7f092e924800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.558 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.559+0000 7f092e924800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:31:47.558 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.559+0000 7f092e924800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.558 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.559+0000 7f092e924800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:31:47.559 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.559+0000 7f092e924800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:47.559 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.561+0000 7f07e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:47.561 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.563+0000 7f092e924800 20 remove_watcher() i=0 2024-09-12T00:31:47.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.563+0000 7f092e924800 2 removed watcher, disabling cache 2024-09-12T00:31:47.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.564+0000 7f092e924800 20 remove_watcher() i=1 2024-09-12T00:31:47.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.565+0000 7f092e924800 20 remove_watcher() i=2 2024-09-12T00:31:47.565 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.566+0000 7f092e924800 20 remove_watcher() i=3 2024-09-12T00:31:47.566 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.568+0000 7f092e924800 20 remove_watcher() i=4 2024-09-12T00:31:47.567 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.569+0000 7f092e924800 20 remove_watcher() i=5 2024-09-12T00:31:47.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.570+0000 7f092e924800 20 remove_watcher() i=6 2024-09-12T00:31:47.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.571+0000 7f092e924800 20 remove_watcher() i=7 2024-09-12T00:31:47.581 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:47.581 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:31:47.581 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-init-index id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:31:47.581 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:47.673 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:31:47.707 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:47.707 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:47.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.746+0000 7f8d8032a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.748+0000 7f8d8032a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:47.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.748+0000 7f8d8032a800 20 realm 2024-09-12T00:31:47.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.748+0000 7f8d8032a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.748+0000 7f8d8032a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:47.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.748+0000 7f8d8032a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:47.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.748+0000 7f8d8032a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.748+0000 7f8d8032a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:47.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.748+0000 7f8d8032a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.749+0000 7f8d8032a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:47.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.749+0000 7f8d8032a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:47.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.750+0000 7f8d8032a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:47.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.750+0000 7f8d8032a800 20 searching for the correct realm 2024-09-12T00:31:47.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.752+0000 7f8d7384e640 0 -- 172.21.15.133:0/413936050 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f8d64063040 msgr2=0x7f8d64048ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:47.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:47.958+0000 7f8d7384e640 0 -- 172.21.15.133:0/413936050 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f8d6c0da050 msgr2=0x7f8d6c0da810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:48.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.165+0000 7f8d8032a800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:48.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.165+0000 7f8d8032a800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:48.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.165+0000 7f8d8032a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:48.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.165+0000 7f8d8032a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:48.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.165+0000 7f8d8032a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:48.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.165+0000 7f8d8032a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:48.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.165+0000 7f8d8032a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.165+0000 7f8d8032a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:48.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.165+0000 7f8d8032a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.165+0000 7f8d8032a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:48.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.166+0000 7f8d8032a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.166+0000 7f8d8032a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.166+0000 7f8d8032a800 20 zone default found 2024-09-12T00:31:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.166+0000 7f8d8032a800 4 Realm: () 2024-09-12T00:31:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.166+0000 7f8d8032a800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.166+0000 7f8d8032a800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.166+0000 7f8d8032a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.166+0000 7f8d8032a800 20 zonegroup default 2024-09-12T00:31:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.166+0000 7f8d8032a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.166+0000 7f8d8032a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:48.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.166+0000 7f8d8032a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.166+0000 7f8d8032a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:48.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.166+0000 7f8d8032a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.167+0000 7f8d8032a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:48.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.167+0000 7f8d8032a800 20 started sync module instance, tier type = 2024-09-12T00:31:48.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.167+0000 7f8d8032a800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:48.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.177+0000 7f8d8032a800 20 add_watcher() i=0 2024-09-12T00:31:48.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.177+0000 7f8d8032a800 20 add_watcher() i=1 2024-09-12T00:31:48.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.177+0000 7f8d8032a800 20 add_watcher() i=2 2024-09-12T00:31:48.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.177+0000 7f8d8032a800 20 add_watcher() i=3 2024-09-12T00:31:48.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.177+0000 7f8d8032a800 20 add_watcher() i=4 2024-09-12T00:31:48.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.177+0000 7f8d8032a800 20 add_watcher() i=5 2024-09-12T00:31:48.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.177+0000 7f8d8032a800 20 add_watcher() i=6 2024-09-12T00:31:48.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.178+0000 7f8d8032a800 20 add_watcher() i=7 2024-09-12T00:31:48.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.178+0000 7f8d8032a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:48.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.180+0000 7f8c32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:48.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.181+0000 7f8d8032a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:48.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.181+0000 7f8d8032a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:48.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.181+0000 7f8d8032a800 5 note: GC not initialized 2024-09-12T00:31:48.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.181+0000 7f8c31fdb640 20 reqs_thread_entry: start 2024-09-12T00:31:48.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.181+0000 7f8d8032a800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:48.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.181+0000 7f8d8032a800 20 Filter name: none 2024-09-12T00:31:48.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.181+0000 7f8ba37fe640 20 reqs_thread_entry: start 2024-09-12T00:31:48.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.181+0000 7f8d8032a800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:31:48.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.181+0000 7f8d8032a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.182+0000 7f8d8032a800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:31:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.182+0000 7f8d8032a800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:31:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.182+0000 7f8d8032a800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:31:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.182+0000 7f8d8032a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 : miss 2024-09-12T00:31:48.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.182+0000 7f8d8032a800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.182+0000 7f8d8032a800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:31:48.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.182+0000 7f8d8032a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 info.flags=0x17 2024-09-12T00:31:48.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.182+0000 7f8d8032a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 to cache LRU end 2024-09-12T00:31:48.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.182+0000 7f8d8032a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:48.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.182+0000 7f8d8032a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:48.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.182+0000 7f8d8032a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 2024-09-12T00:31:48.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.186+0000 7f8d8032a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 info.flags=0x17 2024-09-12T00:31:48.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.186+0000 7f8d8032a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 to cache LRU end 2024-09-12T00:31:48.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.186+0000 7f8d8032a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:48.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.186+0000 7f8d8032a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20, ofs0, ns] 2024-09-12T00:31:48.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.186+0000 7f8c537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 93924872457088 notifier 6354 bl.length()=995 2024-09-12T00:31:48.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.186+0000 7f8c537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 info.flags=0x17 2024-09-12T00:31:48.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.186+0000 7f8c537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 to cache LRU end 2024-09-12T00:31:48.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.186+0000 7f8c537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:48.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.188+0000 7f8d8032a800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20]): orig_sources= new_sources= 2024-09-12T00:31:48.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.188+0000 7f8d8032a800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20]): potential sources added=[] removed=[] 2024-09-12T00:31:48.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.188+0000 7f8d8032a800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20]): orig_dests= new_dests= 2024-09-12T00:31:48.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.188+0000 7f8d8032a800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20]): potential dests added=[] removed=[] 2024-09-12T00:31:48.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.190+0000 7f8d8032a800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20.1.0 2024-09-12T00:31:48.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.190+0000 7f8d8032a800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20.1.0 2024-09-12T00:31:48.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.190+0000 7f8d8032a800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20.1.1 2024-09-12T00:31:48.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.190+0000 7f8d8032a800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20.1.1 2024-09-12T00:31:48.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.190+0000 7f8d8032a800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20.0 2024-09-12T00:31:48.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.192+0000 7f8d8032a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:48.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.192+0000 7f8d8032a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 2024-09-12T00:31:48.192 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.194+0000 7f8d8032a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 info.flags=0x17 2024-09-12T00:31:48.192 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.194+0000 7f8d8032a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 to cache LRU end 2024-09-12T00:31:48.192 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.194+0000 7f8d8032a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:48.192 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.194+0000 7f8d8032a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20, ofs0, ns] 2024-09-12T00:31:48.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.194+0000 7f8c537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497009 cookie 93924872457088 notifier 6354 bl.length()=995 2024-09-12T00:31:48.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.194+0000 7f8c537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 info.flags=0x17 2024-09-12T00:31:48.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.194+0000 7f8c537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 to cache LRU end 2024-09-12T00:31:48.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.194+0000 7f8c537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:48.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.196+0000 7f8d8032a800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20]): orig_sources= new_sources= 2024-09-12T00:31:48.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.196+0000 7f8d8032a800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20]): potential sources added=[] removed=[] 2024-09-12T00:31:48.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.196+0000 7f8d8032a800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20]): orig_dests= new_dests= 2024-09-12T00:31:48.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.196+0000 7f8d8032a800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20]): potential dests added=[] removed=[] 2024-09-12T00:31:48.195 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.197+0000 7f8d8032a800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20.0 2024-09-12T00:31:48.195 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.197+0000 7f8d8032a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:48.195 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.197+0000 7f8d8032a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 2024-09-12T00:31:48.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.198+0000 7f8d8032a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 info.flags=0x17 2024-09-12T00:31:48.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.198+0000 7f8d8032a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 to cache LRU end 2024-09-12T00:31:48.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.198+0000 7f8d8032a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:48.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.198+0000 7f8d8032a800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20, ofs0, ns] 2024-09-12T00:31:48.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.199+0000 7f8c52ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497010 cookie 93924872457088 notifier 6354 bl.length()=963 2024-09-12T00:31:48.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.199+0000 7f8c52ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 info.flags=0x17 2024-09-12T00:31:48.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.199+0000 7f8c52ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 to cache LRU end 2024-09-12T00:31:48.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.199+0000 7f8c52ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:48.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.200+0000 7f8d8032a800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20]): orig_sources= new_sources= 2024-09-12T00:31:48.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.200+0000 7f8d8032a800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20]): potential sources added=[] removed=[] 2024-09-12T00:31:48.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.200+0000 7f8d8032a800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20]): orig_dests= new_dests= 2024-09-12T00:31:48.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.200+0000 7f8d8032a800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20]): potential dests added=[] removed=[] 2024-09-12T00:31:48.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.201+0000 7f8d8032a800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T00:31:48.202 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.203+0000 7f8c32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:48.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.206+0000 7f8d8032a800 20 remove_watcher() i=0 2024-09-12T00:31:48.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.206+0000 7f8d8032a800 2 removed watcher, disabling cache 2024-09-12T00:31:48.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.207+0000 7f8d8032a800 20 remove_watcher() i=1 2024-09-12T00:31:48.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.208+0000 7f8d8032a800 20 remove_watcher() i=2 2024-09-12T00:31:48.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.209+0000 7f8d8032a800 20 remove_watcher() i=3 2024-09-12T00:31:48.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.210+0000 7f8d8032a800 20 remove_watcher() i=4 2024-09-12T00:31:48.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.211+0000 7f8d8032a800 20 remove_watcher() i=5 2024-09-12T00:31:48.211 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.212+0000 7f8d8032a800 20 remove_watcher() i=6 2024-09-12T00:31:48.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.213+0000 7f8d8032a800 20 remove_watcher() i=7 2024-09-12T00:31:48.225 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:31:48.255 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:48.255 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:48.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.294+0000 7fd57e325800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.296+0000 7fd57e325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:48.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.296+0000 7fd57e325800 20 realm 2024-09-12T00:31:48.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.296+0000 7fd57e325800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.296+0000 7fd57e325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:48.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.296+0000 7fd57e325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:48.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.296+0000 7fd57e325800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.296+0000 7fd57e325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:48.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.296+0000 7fd57e325800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.297+0000 7fd57e325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:48.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.297+0000 7fd57e325800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.298+0000 7fd57e325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:48.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.298+0000 7fd57e325800 20 searching for the correct realm 2024-09-12T00:31:48.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.298+0000 7fd57a7b6640 0 -- 172.21.15.133:0/288184272 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x564f441ea110 msgr2=0x564f441ec500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:48.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.301+0000 7fd57a7b6640 0 -- 172.21.15.133:0/288184272 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7fd574017030 msgr2=0x7fd57405e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:48.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.308+0000 7fd57e325800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:48.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.308+0000 7fd57e325800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:48.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.308+0000 7fd57e325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:48.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.308+0000 7fd57e325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:48.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.308+0000 7fd57e325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:48.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.308+0000 7fd57e325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:48.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.308+0000 7fd57e325800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.308+0000 7fd57e325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:48.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.308+0000 7fd57e325800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.308+0000 7fd57e325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:48.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.308+0000 7fd57e325800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.309+0000 7fd57e325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:48.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.309+0000 7fd57e325800 20 zone default found 2024-09-12T00:31:48.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.309+0000 7fd57e325800 4 Realm: () 2024-09-12T00:31:48.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.309+0000 7fd57e325800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:48.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.309+0000 7fd57e325800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:48.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.309+0000 7fd57e325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:48.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.309+0000 7fd57e325800 20 zonegroup default 2024-09-12T00:31:48.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.309+0000 7fd57e325800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.309+0000 7fd57e325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:48.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.309+0000 7fd57e325800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.309+0000 7fd57e325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:48.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.309+0000 7fd57e325800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.309+0000 7fd57e325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:48.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.310+0000 7fd57e325800 20 started sync module instance, tier type = 2024-09-12T00:31:48.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.310+0000 7fd57e325800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:48.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.321+0000 7fd57e325800 20 add_watcher() i=0 2024-09-12T00:31:48.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.321+0000 7fd57e325800 20 add_watcher() i=1 2024-09-12T00:31:48.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.321+0000 7fd57e325800 20 add_watcher() i=2 2024-09-12T00:31:48.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.321+0000 7fd57e325800 20 add_watcher() i=3 2024-09-12T00:31:48.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.321+0000 7fd57e325800 20 add_watcher() i=4 2024-09-12T00:31:48.319 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.321+0000 7fd57e325800 20 add_watcher() i=5 2024-09-12T00:31:48.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.322+0000 7fd57e325800 20 add_watcher() i=6 2024-09-12T00:31:48.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.323+0000 7fd57e325800 20 add_watcher() i=7 2024-09-12T00:31:48.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.323+0000 7fd57e325800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:48.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.325+0000 7fd42b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:48.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.325+0000 7fd57e325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:48.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.325+0000 7fd57e325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:48.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.325+0000 7fd57e325800 5 note: GC not initialized 2024-09-12T00:31:48.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.326+0000 7fd42a7fc640 20 reqs_thread_entry: start 2024-09-12T00:31:48.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.326+0000 7fd57e325800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:48.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.326+0000 7fd57e325800 20 Filter name: none 2024-09-12T00:31:48.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.326+0000 7fd39bfff640 20 reqs_thread_entry: start 2024-09-12T00:31:48.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.326+0000 7fd57e325800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.326+0000 7fd57e325800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:31:48.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.326+0000 7fd57e325800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.327+0000 7fd57e325800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:31:48.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.327+0000 7fd57e325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:48.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.327+0000 7fd57e325800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.327+0000 7fd57e325800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:31:48.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.327+0000 7fd57e325800 20 rados->read ofs=0 len=0 2024-09-12T00:31:48.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.327+0000 7fd57e325800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:31:48.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.327+0000 7fd57e325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:48.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.329+0000 7fd42b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:48.329 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.331+0000 7fd57e325800 20 remove_watcher() i=0 2024-09-12T00:31:48.329 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.331+0000 7fd57e325800 2 removed watcher, disabling cache 2024-09-12T00:31:48.330 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.332+0000 7fd57e325800 20 remove_watcher() i=1 2024-09-12T00:31:48.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.333+0000 7fd57e325800 20 remove_watcher() i=2 2024-09-12T00:31:48.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.334+0000 7fd57e325800 20 remove_watcher() i=3 2024-09-12T00:31:48.333 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.335+0000 7fd57e325800 20 remove_watcher() i=4 2024-09-12T00:31:48.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.336+0000 7fd57e325800 20 remove_watcher() i=5 2024-09-12T00:31:48.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.337+0000 7fd57e325800 20 remove_watcher() i=6 2024-09-12T00:31:48.336 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:48.338+0000 7fd57e325800 20 remove_watcher() i=7 2024-09-12T00:31:48.347 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:48.347 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:31:48.347 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-init-index id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:31:48.347 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:48.647 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T00:31:48.647 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:49.454 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:31:49.482 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:49.482 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:49.519 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:49.521+0000 7fcb73c87800 20 rados->read ofs=0 len=0 2024-09-12T00:31:49.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:49.523+0000 7fcb73c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:49.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:49.523+0000 7fcb73c87800 20 realm 2024-09-12T00:31:49.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:49.523+0000 7fcb73c87800 20 rados->read ofs=0 len=0 2024-09-12T00:31:49.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:49.523+0000 7fcb73c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:49.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:49.523+0000 7fcb73c87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:49.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:49.523+0000 7fcb73c87800 20 rados->read ofs=0 len=0 2024-09-12T00:31:49.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:49.523+0000 7fcb73c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:49.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:49.523+0000 7fcb73c87800 20 rados->read ofs=0 len=0 2024-09-12T00:31:49.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:49.524+0000 7fcb73c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:49.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:49.524+0000 7fcb73c87800 20 rados->read ofs=0 len=0 2024-09-12T00:31:49.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:49.524+0000 7fcb73c87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:49.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:49.524+0000 7fcb73c87800 20 searching for the correct realm 2024-09-12T00:31:49.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:49.727+0000 7fcb70f70640 0 -- 172.21.15.133:0/2015158253 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fcb5c056070 msgr2=0x7fcb5c009250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:50.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.132+0000 7fcb70f70640 0 -- 172.21.15.133:0/2015158253 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fcb6408e610 msgr2=0x7fcb6408fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:50.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.339+0000 7fcb73c87800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:50.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.339+0000 7fcb73c87800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:50.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.339+0000 7fcb73c87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:50.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.339+0000 7fcb73c87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:50.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.339+0000 7fcb73c87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:50.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.339+0000 7fcb73c87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:50.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.339+0000 7fcb73c87800 20 rados->read ofs=0 len=0 2024-09-12T00:31:50.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.339+0000 7fcb73c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:50.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.339+0000 7fcb73c87800 20 rados->read ofs=0 len=0 2024-09-12T00:31:50.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.340+0000 7fcb73c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:50.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.340+0000 7fcb73c87800 20 rados->read ofs=0 len=0 2024-09-12T00:31:50.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.340+0000 7fcb73c87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:50.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.340+0000 7fcb73c87800 20 zone default found 2024-09-12T00:31:50.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.340+0000 7fcb73c87800 4 Realm: () 2024-09-12T00:31:50.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.340+0000 7fcb73c87800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:50.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.340+0000 7fcb73c87800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:50.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.340+0000 7fcb73c87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:50.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.340+0000 7fcb73c87800 20 zonegroup default 2024-09-12T00:31:50.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.340+0000 7fcb73c87800 20 rados->read ofs=0 len=0 2024-09-12T00:31:50.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.341+0000 7fcb73c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:50.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.341+0000 7fcb73c87800 20 rados->read ofs=0 len=0 2024-09-12T00:31:50.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.341+0000 7fcb73c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:50.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.341+0000 7fcb73c87800 20 rados->read ofs=0 len=0 2024-09-12T00:31:50.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.341+0000 7fcb73c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:50.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.341+0000 7fcb73c87800 20 started sync module instance, tier type = 2024-09-12T00:31:50.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.341+0000 7fcb73c87800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:50.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.353+0000 7fcb73c87800 20 add_watcher() i=0 2024-09-12T00:31:50.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.353+0000 7fcb73c87800 20 add_watcher() i=1 2024-09-12T00:31:50.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.353+0000 7fcb73c87800 20 add_watcher() i=2 2024-09-12T00:31:50.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.353+0000 7fcb73c87800 20 add_watcher() i=3 2024-09-12T00:31:50.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.353+0000 7fcb73c87800 20 add_watcher() i=4 2024-09-12T00:31:50.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.353+0000 7fcb73c87800 20 add_watcher() i=5 2024-09-12T00:31:50.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.353+0000 7fcb73c87800 20 add_watcher() i=6 2024-09-12T00:31:50.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.354+0000 7fcb73c87800 20 add_watcher() i=7 2024-09-12T00:31:50.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.354+0000 7fcb73c87800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:50.355 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.356+0000 7fca277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:50.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.357+0000 7fcb73c87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:50.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.357+0000 7fcb73c87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:50.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.357+0000 7fcb73c87800 5 note: GC not initialized 2024-09-12T00:31:50.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.357+0000 7fca267e4640 20 reqs_thread_entry: start 2024-09-12T00:31:50.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.357+0000 7fcb73c87800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:50.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.357+0000 7fcb73c87800 20 Filter name: none 2024-09-12T00:31:50.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.357+0000 7fc997fff640 20 reqs_thread_entry: start 2024-09-12T00:31:50.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.357+0000 7fcb73c87800 20 rados->read ofs=0 len=0 2024-09-12T00:31:50.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.358+0000 7fcb73c87800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:31:50.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.358+0000 7fcb73c87800 20 rados->read ofs=0 len=0 2024-09-12T00:31:50.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.358+0000 7fcb73c87800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:31:50.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.358+0000 7fcb73c87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:50.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.358+0000 7fcb73c87800 20 rados->read ofs=0 len=0 2024-09-12T00:31:50.358 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.359+0000 7fcb73c87800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:31:50.358 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.359+0000 7fcb73c87800 20 rados->read ofs=0 len=0 2024-09-12T00:31:50.358 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.359+0000 7fcb73c87800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:31:50.358 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.359+0000 7fcb73c87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:50.359 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.361+0000 7fca277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:50.361 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.363+0000 7fcb73c87800 20 remove_watcher() i=0 2024-09-12T00:31:50.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.363+0000 7fcb73c87800 2 removed watcher, disabling cache 2024-09-12T00:31:50.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.364+0000 7fcb73c87800 20 remove_watcher() i=1 2024-09-12T00:31:50.364 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.365+0000 7fcb73c87800 20 remove_watcher() i=2 2024-09-12T00:31:50.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.367+0000 7fcb73c87800 20 remove_watcher() i=3 2024-09-12T00:31:50.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.368+0000 7fcb73c87800 20 remove_watcher() i=4 2024-09-12T00:31:50.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.369+0000 7fcb73c87800 20 remove_watcher() i=5 2024-09-12T00:31:50.368 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.370+0000 7fcb73c87800 20 remove_watcher() i=6 2024-09-12T00:31:50.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.371+0000 7fcb73c87800 20 remove_watcher() i=7 2024-09-12T00:31:50.383 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:50.384 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:31:50.384 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-init-index id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:31:50.384 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:50.386 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T00:31:50.424 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:50.424 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:50.463 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.464+0000 7f347800f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:50.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.466+0000 7f347800f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:50.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.466+0000 7f347800f800 20 realm 2024-09-12T00:31:50.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.466+0000 7f347800f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:50.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.466+0000 7f347800f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:50.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.466+0000 7f347800f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:50.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.466+0000 7f347800f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:50.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.466+0000 7f347800f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:50.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.466+0000 7f347800f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:50.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.668+0000 7f347800f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:50.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.668+0000 7f347800f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:50.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.669+0000 7f347800f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:50.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.669+0000 7f347800f800 20 searching for the correct realm 2024-09-12T00:31:50.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.671+0000 7f346bfff640 0 -- 172.21.15.133:0/3046111474 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f345c01f050 msgr2=0x7f345c038980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:50.876 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:50.877+0000 7f346bfff640 0 -- 172.21.15.133:0/3046111474 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f34640ac2d0 msgr2=0x7f34640aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:51.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.084+0000 7f347800f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:51.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.084+0000 7f347800f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:51.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.084+0000 7f347800f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:51.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.084+0000 7f347800f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:51.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.084+0000 7f347800f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:51.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.084+0000 7f347800f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:51.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.084+0000 7f347800f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.084+0000 7f347800f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:51.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.084+0000 7f347800f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.084+0000 7f347800f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:51.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.084+0000 7f347800f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.085+0000 7f347800f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:51.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.085+0000 7f347800f800 20 zone default found 2024-09-12T00:31:51.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.085+0000 7f347800f800 4 Realm: () 2024-09-12T00:31:51.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.085+0000 7f347800f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:51.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.085+0000 7f347800f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:51.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.085+0000 7f347800f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:51.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.085+0000 7f347800f800 20 zonegroup default 2024-09-12T00:31:51.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.085+0000 7f347800f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.085+0000 7f347800f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:51.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.085+0000 7f347800f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.085+0000 7f347800f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:51.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.085+0000 7f347800f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.086+0000 7f347800f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:51.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.086+0000 7f347800f800 20 started sync module instance, tier type = 2024-09-12T00:31:51.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.086+0000 7f347800f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:51.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.095+0000 7f347800f800 20 add_watcher() i=0 2024-09-12T00:31:51.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.095+0000 7f347800f800 20 add_watcher() i=1 2024-09-12T00:31:51.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.095+0000 7f347800f800 20 add_watcher() i=2 2024-09-12T00:31:51.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.095+0000 7f347800f800 20 add_watcher() i=3 2024-09-12T00:31:51.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.095+0000 7f347800f800 20 add_watcher() i=4 2024-09-12T00:31:51.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.095+0000 7f347800f800 20 add_watcher() i=5 2024-09-12T00:31:51.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.096+0000 7f347800f800 20 add_watcher() i=6 2024-09-12T00:31:51.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.097+0000 7f347800f800 20 add_watcher() i=7 2024-09-12T00:31:51.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.097+0000 7f347800f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:51.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.098+0000 7f3329fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:51.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.099+0000 7f347800f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:51.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.099+0000 7f347800f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:51.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.099+0000 7f347800f800 5 note: GC not initialized 2024-09-12T00:31:51.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.099+0000 7f3328fe1640 20 reqs_thread_entry: start 2024-09-12T00:31:51.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.099+0000 7f347800f800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:51.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.099+0000 7f347800f800 20 Filter name: none 2024-09-12T00:31:51.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.099+0000 7f32a27fc640 20 reqs_thread_entry: start 2024-09-12T00:31:51.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.099+0000 7f347800f800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:31:51.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.099+0000 7f347800f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.100+0000 7f347800f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:31:51.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.100+0000 7f347800f800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:31:51.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.100+0000 7f347800f800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:31:51.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.100+0000 7f347800f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 : miss 2024-09-12T00:31:51.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.100+0000 7f347800f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.100+0000 7f347800f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:31:51.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.100+0000 7f347800f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 info.flags=0x17 2024-09-12T00:31:51.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.100+0000 7f347800f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 to cache LRU end 2024-09-12T00:31:51.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.100+0000 7f347800f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:51.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.100+0000 7f347800f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:51.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.100+0000 7f347800f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 2024-09-12T00:31:51.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.102+0000 7f347800f800 -1 Injecting error=-95 at location=init_index 2024-09-12T00:31:51.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.102+0000 7f347800f800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:31:51.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.105+0000 7f347800f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 info.flags=0x17 2024-09-12T00:31:51.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.105+0000 7f347800f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 to cache LRU end 2024-09-12T00:31:51.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.105+0000 7f347800f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:51.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.105+0000 7f347800f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21, ofs0, ns] 2024-09-12T00:31:51.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.105+0000 7f3356ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497015 cookie 94055198715232 notifier 6080 bl.length()=995 2024-09-12T00:31:51.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.105+0000 7f3356ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 info.flags=0x17 2024-09-12T00:31:51.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.105+0000 7f3356ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 to cache LRU end 2024-09-12T00:31:51.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.105+0000 7f3356ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:51.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.108+0000 7f347800f800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21]): orig_sources= new_sources= 2024-09-12T00:31:51.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.108+0000 7f347800f800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21]): potential sources added=[] removed=[] 2024-09-12T00:31:51.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.108+0000 7f347800f800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21]): orig_dests= new_dests= 2024-09-12T00:31:51.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.108+0000 7f347800f800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21]): potential dests added=[] removed=[] 2024-09-12T00:31:51.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.109+0000 7f347800f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21.1.0 2024-09-12T00:31:51.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.109+0000 7f347800f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21.1.0 2024-09-12T00:31:51.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.109+0000 7f347800f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21.1.1 2024-09-12T00:31:51.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.109+0000 7f347800f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21.1.1 2024-09-12T00:31:51.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.109+0000 7f347800f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21.0 2024-09-12T00:31:51.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.112+0000 7f347800f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:51.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.112+0000 7f347800f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 2024-09-12T00:31:51.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.113+0000 7f347800f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 info.flags=0x17 2024-09-12T00:31:51.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.113+0000 7f347800f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 to cache LRU end 2024-09-12T00:31:51.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.113+0000 7f347800f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:51.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.113+0000 7f347800f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21, ofs0, ns] 2024-09-12T00:31:51.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.114+0000 7f33567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497016 cookie 94055198715232 notifier 6080 bl.length()=963 2024-09-12T00:31:51.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.114+0000 7f33567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 info.flags=0x17 2024-09-12T00:31:51.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.114+0000 7f33567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 to cache LRU end 2024-09-12T00:31:51.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.114+0000 7f33567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:51.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.115+0000 7f347800f800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21]): orig_sources= new_sources= 2024-09-12T00:31:51.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.115+0000 7f347800f800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21]): potential sources added=[] removed=[] 2024-09-12T00:31:51.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.115+0000 7f347800f800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21]): orig_dests= new_dests= 2024-09-12T00:31:51.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.115+0000 7f347800f800 20 handle_bi_update(): bucket=:error-at-init-index[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21]): potential dests added=[] removed=[] 2024-09-12T00:31:51.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.117+0000 7f347800f800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T00:31:51.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.119+0000 7f3329fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:51.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.121+0000 7f347800f800 20 remove_watcher() i=0 2024-09-12T00:31:51.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.121+0000 7f347800f800 2 removed watcher, disabling cache 2024-09-12T00:31:51.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.122+0000 7f347800f800 20 remove_watcher() i=1 2024-09-12T00:31:51.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.123+0000 7f347800f800 20 remove_watcher() i=2 2024-09-12T00:31:51.123 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.124+0000 7f347800f800 20 remove_watcher() i=3 2024-09-12T00:31:51.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.125+0000 7f347800f800 20 remove_watcher() i=4 2024-09-12T00:31:51.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.127+0000 7f347800f800 20 remove_watcher() i=5 2024-09-12T00:31:51.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.128+0000 7f347800f800 20 remove_watcher() i=6 2024-09-12T00:31:51.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.129+0000 7f347800f800 20 remove_watcher() i=7 2024-09-12T00:31:51.140 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:31:51.169 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:51.169 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:51.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.208+0000 7f3f42814800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.210+0000 7f3f42814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:51.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.210+0000 7f3f42814800 20 realm 2024-09-12T00:31:51.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.210+0000 7f3f42814800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.210+0000 7f3f42814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:51.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.210+0000 7f3f42814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:51.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.210+0000 7f3f42814800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.210+0000 7f3f42814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:51.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.210+0000 7f3f42814800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.211+0000 7f3f42814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:51.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.211+0000 7f3f42814800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.212+0000 7f3f42814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:51.211 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.212+0000 7f3f42814800 20 searching for the correct realm 2024-09-12T00:31:51.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.214+0000 7f3f3d6ca640 0 -- 172.21.15.133:0/823331149 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f3f2805f9d0 msgr2=0x7f3f28087a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:51.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.420+0000 7f3f3d6ca640 0 -- 172.21.15.133:0/823331149 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f3f38041070 msgr2=0x7f3f380720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:51.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.628+0000 7f3f42814800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:51.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.628+0000 7f3f42814800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:51.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.628+0000 7f3f42814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:51.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.628+0000 7f3f42814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:51.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.628+0000 7f3f42814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:51.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.628+0000 7f3f42814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:51.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.628+0000 7f3f42814800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.628+0000 7f3f42814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:51.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.628+0000 7f3f42814800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.628+0000 7f3f42814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:51.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.628+0000 7f3f42814800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.629+0000 7f3f42814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:51.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.629+0000 7f3f42814800 20 zone default found 2024-09-12T00:31:51.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.629+0000 7f3f42814800 4 Realm: () 2024-09-12T00:31:51.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.629+0000 7f3f42814800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:51.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.629+0000 7f3f42814800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:51.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.629+0000 7f3f42814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:51.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.629+0000 7f3f42814800 20 zonegroup default 2024-09-12T00:31:51.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.629+0000 7f3f42814800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.629+0000 7f3f42814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:51.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.629+0000 7f3f42814800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.629+0000 7f3f42814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:51.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.629+0000 7f3f42814800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.630+0000 7f3f42814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:51.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.630+0000 7f3f42814800 20 started sync module instance, tier type = 2024-09-12T00:31:51.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.630+0000 7f3f42814800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:51.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.640+0000 7f3f42814800 20 add_watcher() i=0 2024-09-12T00:31:51.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.640+0000 7f3f42814800 20 add_watcher() i=1 2024-09-12T00:31:51.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.640+0000 7f3f42814800 20 add_watcher() i=2 2024-09-12T00:31:51.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.640+0000 7f3f42814800 20 add_watcher() i=3 2024-09-12T00:31:51.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.640+0000 7f3f42814800 20 add_watcher() i=4 2024-09-12T00:31:51.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.640+0000 7f3f42814800 20 add_watcher() i=5 2024-09-12T00:31:51.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.640+0000 7f3f42814800 20 add_watcher() i=6 2024-09-12T00:31:51.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.641+0000 7f3f42814800 20 add_watcher() i=7 2024-09-12T00:31:51.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.641+0000 7f3f42814800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:51.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.643+0000 7f3def7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:51.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.643+0000 7f3f42814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:51.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.643+0000 7f3f42814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:51.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.643+0000 7f3f42814800 5 note: GC not initialized 2024-09-12T00:31:51.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.644+0000 7f3dee7fc640 20 reqs_thread_entry: start 2024-09-12T00:31:51.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.644+0000 7f3f42814800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:51.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.644+0000 7f3f42814800 20 Filter name: none 2024-09-12T00:31:51.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.644+0000 7f3d5ffff640 20 reqs_thread_entry: start 2024-09-12T00:31:51.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.644+0000 7f3f42814800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.644+0000 7f3f42814800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:31:51.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.644+0000 7f3f42814800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.645+0000 7f3f42814800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:31:51.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.645+0000 7f3f42814800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:51.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.645+0000 7f3f42814800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.645+0000 7f3f42814800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:31:51.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.645+0000 7f3f42814800 20 rados->read ofs=0 len=0 2024-09-12T00:31:51.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.646+0000 7f3f42814800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:31:51.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.646+0000 7f3f42814800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:51.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.647+0000 7f3def7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:51.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.649+0000 7f3f42814800 20 remove_watcher() i=0 2024-09-12T00:31:51.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.649+0000 7f3f42814800 2 removed watcher, disabling cache 2024-09-12T00:31:51.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.651+0000 7f3f42814800 20 remove_watcher() i=1 2024-09-12T00:31:51.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.652+0000 7f3f42814800 20 remove_watcher() i=2 2024-09-12T00:31:51.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.653+0000 7f3f42814800 20 remove_watcher() i=3 2024-09-12T00:31:51.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.654+0000 7f3f42814800 20 remove_watcher() i=4 2024-09-12T00:31:51.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.655+0000 7f3f42814800 20 remove_watcher() i=5 2024-09-12T00:31:51.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.656+0000 7f3f42814800 20 remove_watcher() i=6 2024-09-12T00:31:51.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:51.657+0000 7f3f42814800 20 remove_watcher() i=7 2024-09-12T00:31:51.667 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:51.667 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:31:51.668 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-init-index id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:31:51.668 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:51.976 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T00:31:51.976 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:52.796 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:31:52.824 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:52.824 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:52.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:52.862+0000 7f5b75135800 20 rados->read ofs=0 len=0 2024-09-12T00:31:52.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:52.864+0000 7f5b75135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:52.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:52.864+0000 7f5b75135800 20 realm 2024-09-12T00:31:52.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:52.864+0000 7f5b75135800 20 rados->read ofs=0 len=0 2024-09-12T00:31:52.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:52.864+0000 7f5b75135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:52.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:52.864+0000 7f5b75135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:52.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:52.864+0000 7f5b75135800 20 rados->read ofs=0 len=0 2024-09-12T00:31:52.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:52.864+0000 7f5b75135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:52.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:52.864+0000 7f5b75135800 20 rados->read ofs=0 len=0 2024-09-12T00:31:52.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:52.865+0000 7f5b75135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:52.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:52.865+0000 7f5b75135800 20 rados->read ofs=0 len=0 2024-09-12T00:31:52.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:52.866+0000 7f5b75135800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:52.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:52.866+0000 7f5b75135800 20 searching for the correct realm 2024-09-12T00:31:53.067 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:53.068+0000 7f5b6bfff640 0 -- 172.21.15.133:0/3107489695 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f5b5c0c9070 msgr2=0x7f5b5c0bf890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:53.472 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:53.473+0000 7f5b6bfff640 0 -- 172.21.15.133:0/3107489695 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f5b6403b040 msgr2=0x7f5b64013920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:54.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.082+0000 7f5b75135800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:54.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.082+0000 7f5b75135800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:54.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.082+0000 7f5b75135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:54.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.082+0000 7f5b75135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:54.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.082+0000 7f5b75135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:54.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.082+0000 7f5b75135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:54.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.082+0000 7f5b75135800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.083+0000 7f5b75135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.083+0000 7f5b75135800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.083+0000 7f5b75135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:54.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.083+0000 7f5b75135800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.083+0000 7f5b75135800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:54.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.083+0000 7f5b75135800 20 zone default found 2024-09-12T00:31:54.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.083+0000 7f5b75135800 4 Realm: () 2024-09-12T00:31:54.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.083+0000 7f5b75135800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:54.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.083+0000 7f5b75135800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:54.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.083+0000 7f5b75135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:54.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.083+0000 7f5b75135800 20 zonegroup default 2024-09-12T00:31:54.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.083+0000 7f5b75135800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.084+0000 7f5b75135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.084+0000 7f5b75135800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.084+0000 7f5b75135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.084+0000 7f5b75135800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.085+0000 7f5b75135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.085+0000 7f5b75135800 20 started sync module instance, tier type = 2024-09-12T00:31:54.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.085+0000 7f5b75135800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:54.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.094+0000 7f5b75135800 20 add_watcher() i=0 2024-09-12T00:31:54.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.094+0000 7f5b75135800 20 add_watcher() i=1 2024-09-12T00:31:54.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.094+0000 7f5b75135800 20 add_watcher() i=2 2024-09-12T00:31:54.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.094+0000 7f5b75135800 20 add_watcher() i=3 2024-09-12T00:31:54.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.094+0000 7f5b75135800 20 add_watcher() i=4 2024-09-12T00:31:54.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.094+0000 7f5b75135800 20 add_watcher() i=5 2024-09-12T00:31:54.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.094+0000 7f5b75135800 20 add_watcher() i=6 2024-09-12T00:31:54.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.095+0000 7f5b75135800 20 add_watcher() i=7 2024-09-12T00:31:54.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.095+0000 7f5b75135800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:54.096 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.097+0000 7f5a277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:54.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.098+0000 7f5b75135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:54.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.098+0000 7f5b75135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:54.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.098+0000 7f5b75135800 5 note: GC not initialized 2024-09-12T00:31:54.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.098+0000 7f5a267e4640 20 reqs_thread_entry: start 2024-09-12T00:31:54.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.098+0000 7f5b75135800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:54.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.098+0000 7f5b75135800 20 Filter name: none 2024-09-12T00:31:54.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.098+0000 7f5a1f7fe640 20 reqs_thread_entry: start 2024-09-12T00:31:54.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.098+0000 7f5b75135800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.099+0000 7f5b75135800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:31:54.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.099+0000 7f5b75135800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.100+0000 7f5b75135800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:31:54.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.100+0000 7f5b75135800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:54.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.100+0000 7f5b75135800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.100+0000 7f5b75135800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:31:54.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.100+0000 7f5b75135800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.101+0000 7f5b75135800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:31:54.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.101+0000 7f5b75135800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:54.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.102+0000 7f5a277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:54.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.105+0000 7f5b75135800 20 remove_watcher() i=0 2024-09-12T00:31:54.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.105+0000 7f5b75135800 2 removed watcher, disabling cache 2024-09-12T00:31:54.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.106+0000 7f5b75135800 20 remove_watcher() i=1 2024-09-12T00:31:54.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.107+0000 7f5b75135800 20 remove_watcher() i=2 2024-09-12T00:31:54.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.108+0000 7f5b75135800 20 remove_watcher() i=3 2024-09-12T00:31:54.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.109+0000 7f5b75135800 20 remove_watcher() i=4 2024-09-12T00:31:54.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.110+0000 7f5b75135800 20 remove_watcher() i=5 2024-09-12T00:31:54.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.111+0000 7f5b75135800 20 remove_watcher() i=6 2024-09-12T00:31:54.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.112+0000 7f5b75135800 20 remove_watcher() i=7 2024-09-12T00:31:54.123 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.123 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:31:54.123 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-init-indext id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:31:54.123 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.125 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T00:31:54.161 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:54.161 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:54.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.203+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.204+0000 7ff93391f800 20 realm 2024-09-12T00:31:54.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.204+0000 7ff93391f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:54.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.205+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:54.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.205+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.206+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:54.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.206+0000 7ff93391f800 20 searching for the correct realm 2024-09-12T00:31:54.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.208+0000 7ff927fff640 0 -- 172.21.15.133:0/423947948 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff91802a070 msgr2=0x7ff918044940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:54.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.414+0000 7ff927fff640 0 -- 172.21.15.133:0/423947948 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff92007d030 msgr2=0x7ff92001a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:54.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:54.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:54.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:54.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:54.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:54.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:54.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.622+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.622+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.622+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.622+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:54.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.622+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:54.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.623+0000 7ff93391f800 20 zone default found 2024-09-12T00:31:54.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.623+0000 7ff93391f800 4 Realm: () 2024-09-12T00:31:54.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.623+0000 7ff93391f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:54.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.623+0000 7ff93391f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:54.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.623+0000 7ff93391f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:54.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.623+0000 7ff93391f800 20 zonegroup default 2024-09-12T00:31:54.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.624+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.624+0000 7ff93391f800 20 started sync module instance, tier type = 2024-09-12T00:31:54.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.624+0000 7ff93391f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:54.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=0 2024-09-12T00:31:54.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=1 2024-09-12T00:31:54.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=2 2024-09-12T00:31:54.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=3 2024-09-12T00:31:54.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=4 2024-09-12T00:31:54.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=5 2024-09-12T00:31:54.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=6 2024-09-12T00:31:54.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.635+0000 7ff93391f800 20 add_watcher() i=7 2024-09-12T00:31:54.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.635+0000 7ff93391f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:54.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.637+0000 7ff7e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:54.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.637+0000 7ff93391f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:54.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.637+0000 7ff93391f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:54.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.638+0000 7ff93391f800 5 note: GC not initialized 2024-09-12T00:31:54.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.638+0000 7ff7e4fe1640 20 reqs_thread_entry: start 2024-09-12T00:31:54.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.638+0000 7ff93391f800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:54.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.638+0000 7ff93391f800 20 Filter name: none 2024-09-12T00:31:54.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.638+0000 7ff75e7fc640 20 reqs_thread_entry: start 2024-09-12T00:31:54.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.638+0000 7ff93391f800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:31:54.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.638+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.639+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:31:54.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.639+0000 7ff93391f800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:31:54.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.639+0000 7ff93391f800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:31:54.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.639+0000 7ff93391f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 : miss 2024-09-12T00:31:54.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.639+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.639+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:31:54.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.639+0000 7ff93391f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 info.flags=0x17 2024-09-12T00:31:54.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.639+0000 7ff93391f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 to cache LRU end 2024-09-12T00:31:54.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.639+0000 7ff93391f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:54.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.639+0000 7ff93391f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:54.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.639+0000 7ff93391f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 2024-09-12T00:31:54.639 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff93391f800 time 2024-09-12T00:31:54.641763+0000 2024-09-12T00:31:54.639 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:31:54.640 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:54.640 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff93518c71a] 2024-09-12T00:31:54.640 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff93518c8d8] 2024-09-12T00:31:54.640 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621947ad641] 2024-09-12T00:31:54.640 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd877a4) [0x562194cbf7a4] 2024-09-12T00:31:54.640 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621947bd31d] 2024-09-12T00:31:54.640 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:31:54.640 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff933e29590] 2024-09-12T00:31:54.640 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:31:54.641 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:31:54.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.641+0000 7ff93391f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff93391f800 time 2024-09-12T00:31:54.641763+0000 2024-09-12T00:31:54.641 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:31:54.641 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.641 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:54.641 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff93518c71a] 2024-09-12T00:31:54.641 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff93518c8d8] 2024-09-12T00:31:54.641 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621947ad641] 2024-09-12T00:31:54.641 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd877a4) [0x562194cbf7a4] 2024-09-12T00:31:54.641 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621947bd31d] 2024-09-12T00:31:54.641 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:31:54.641 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff933e29590] 2024-09-12T00:31:54.641 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:31:54.641 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:31:54.642 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.642 INFO:tasks.workunit.client.0.smithi133.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:31:54.642 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7ff93391f800 thread_name:radosgw-admin 2024-09-12T00:31:54.661 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:54.662 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff933e3e6f0] 2024-09-12T00:31:54.662 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff933e8b99c] 2024-09-12T00:31:54.662 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:31:54.662 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:31:54.662 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff93518c774] 2024-09-12T00:31:54.662 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff93518c8d8] 2024-09-12T00:31:54.662 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621947ad641] 2024-09-12T00:31:54.662 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd877a4) [0x562194cbf7a4] 2024-09-12T00:31:54.662 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621947bd31d] 2024-09-12T00:31:54.662 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:31:54.662 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff933e29590] 2024-09-12T00:31:54.663 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:31:54.663 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:31:54.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.642+0000 7ff93391f800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:31:54.663 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7ff93391f800 thread_name:radosgw-admin 2024-09-12T00:31:54.663 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.663 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:54.663 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff933e3e6f0] 2024-09-12T00:31:54.663 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff933e8b99c] 2024-09-12T00:31:54.663 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:31:54.663 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:31:54.663 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff93518c774] 2024-09-12T00:31:54.663 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff93518c8d8] 2024-09-12T00:31:54.663 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621947ad641] 2024-09-12T00:31:54.664 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd877a4) [0x562194cbf7a4] 2024-09-12T00:31:54.664 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621947bd31d] 2024-09-12T00:31:54.664 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:31:54.664 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff933e29590] 2024-09-12T00:31:54.664 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:31:54.664 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:31:54.664 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:31:54.664 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.664 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:31:54.664 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:31:54.184+0000 7ff92f6a9640 1 monclient: found mon.noname-a 2024-09-12T00:31:54.664 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:31:54.184+0000 7ff92f6a9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:31:54.664 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.665 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:31:54.665 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: dump: 2024-09-12T00:31:54.665 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.665 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.665 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.665 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.665 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.665 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.665 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.665 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.665 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.665 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.665 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: _finish_auth 0 2024-09-12T00:31:54.666 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: _check_auth_tickets 2024-09-12T00:31:54.666 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:54.666 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.666 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:31:54.666 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: dump: 2024-09-12T00:31:54.666 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.666 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.666 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.666 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.666 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.666 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.666 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.666 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.667 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.667 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.667 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:31:54.184+0000 7ff93391f800 5 monclient: authenticate success, global_id 6459 2024-09-12T00:31:54.667 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:31:54.184+0000 7ff93391f800 10 monclient: get_monmap_and_config success 2024-09-12T00:31:54.667 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:31:54.184+0000 7ff93391f800 4 set_mon_vals no callback set 2024-09-12T00:31:54.667 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:31:54.185+0000 7ff93391f800 10 monclient: shutdown 2024-09-12T00:31:54.667 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 asok(0x562196935630) unregister_commands rotate-key 2024-09-12T00:31:54.667 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:31:54.185+0000 7ff93391f800 10 monclient: build_initial_monmap 2024-09-12T00:31:54.667 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:31:54.185+0000 7ff93391f800 1 build_initial for_mkfs: 0 2024-09-12T00:31:54.667 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:31:54.185+0000 7ff93391f800 10 monclient: monmap: 2024-09-12T00:31:54.667 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:31:54.667 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:31:54.667 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:31:54.668 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:31:54.668 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:31:54.668 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.668 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:31:54.668 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:31:54.668 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:31:54.668 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.668 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding auth protocol: cephx 2024-09-12T00:31:54.668 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding auth protocol: cephx 2024-09-12T00:31:54.668 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding auth protocol: cephx 2024-09-12T00:31:54.668 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: secure 2024-09-12T00:31:54.668 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: crc 2024-09-12T00:31:54.668 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: secure 2024-09-12T00:31:54.669 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: crc 2024-09-12T00:31:54.669 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: secure 2024-09-12T00:31:54.669 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: crc 2024-09-12T00:31:54.669 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: crc 2024-09-12T00:31:54.669 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: secure 2024-09-12T00:31:54.669 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: crc 2024-09-12T00:31:54.669 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: secure 2024-09-12T00:31:54.669 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: crc 2024-09-12T00:31:54.669 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: secure 2024-09-12T00:31:54.669 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:31:54.185+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.669 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:31:54.185+0000 7ff93391f800 1 librados: starting msgr at 2024-09-12T00:31:54.669 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:31:54.185+0000 7ff93391f800 1 librados: starting objecter 2024-09-12T00:31:54.669 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 asok(0x562196935630) register_command objecter_requests hook 0x562196b58850 2024-09-12T00:31:54.669 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:31:54.186+0000 7ff93391f800 1 librados: setting wanted keys 2024-09-12T00:31:54.669 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:31:54.186+0000 7ff93391f800 1 librados: calling monclient init 2024-09-12T00:31:54.670 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient: init 2024-09-12T00:31:54.670 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding auth protocol: cephx 2024-09-12T00:31:54.670 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding auth protocol: cephx 2024-09-12T00:31:54.670 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding auth protocol: cephx 2024-09-12T00:31:54.670 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: secure 2024-09-12T00:31:54.670 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: crc 2024-09-12T00:31:54.670 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: secure 2024-09-12T00:31:54.670 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: crc 2024-09-12T00:31:54.670 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: secure 2024-09-12T00:31:54.670 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: crc 2024-09-12T00:31:54.670 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: crc 2024-09-12T00:31:54.670 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: secure 2024-09-12T00:31:54.670 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: crc 2024-09-12T00:31:54.671 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: secure 2024-09-12T00:31:54.671 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: crc 2024-09-12T00:31:54.671 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: secure 2024-09-12T00:31:54.671 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:31:54.186+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.671 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:31:54.186+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.671 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 asok(0x562196935630) register_command rotate-key hook 0x562196b54988 2024-09-12T00:31:54.671 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient: _reopen_session rank -1 2024-09-12T00:31:54.671 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:31:54.671 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-c con 0x562196a0cda0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:31:54.671 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-b con 0x562196a982a0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:31:54.671 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-a con 0x562196a9e5f0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:31:54.671 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.672 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.672 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.672 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): _renew_subs 2024-09-12T00:31:54.672 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): authenticate will time out at 1922.758665s 2024-09-12T00:31:54.672 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:31:54.186+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request con 0x562196a0cda0 auth_method 0 2024-09-12T00:31:54.672 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:31:54.186+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.672 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:31:54.186+0000 7ff92f6a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.672 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:31:54.186+0000 7ff92f6a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.672 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:31:54.186+0000 7ff92feaa640 10 monclient(hunting): get_auth_request con 0x562196a9e5f0 auth_method 0 2024-09-12T00:31:54.672 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:31:54.186+0000 7ff92feaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.672 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:31:54.186+0000 7ff92feaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.672 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:31:54.186+0000 7ff92feaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.672 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:31:54.186+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.673 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:31:54.186+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.673 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:31:54.186+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.673 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:31:54.186+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.673 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:31:54.186+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.673 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:31:54.186+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.673 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:31:54.186+0000 7ff927fff640 10 monclient(hunting): get_auth_request con 0x562196a982a0 auth_method 0 2024-09-12T00:31:54.673 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:31:54.186+0000 7ff927fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.673 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:31:54.186+0000 7ff927fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.673 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:31:54.186+0000 7ff927fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.673 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:31:54.186+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.673 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:31:54.186+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.673 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:31:54.186+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.673 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:31:54.187+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_done global_id 6116 payload 824 2024-09-12T00:31:54.673 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:31:54.187+0000 7ff92f6a9640 10 monclient: _finish_hunting 0 2024-09-12T00:31:54.674 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:31:54.187+0000 7ff92f6a9640 1 monclient: found mon.noname-c 2024-09-12T00:31:54.674 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:31:54.187+0000 7ff92f6a9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.674 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.674 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:31:54.674 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: dump: 2024-09-12T00:31:54.674 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.674 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.674 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.674 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.674 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.674 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.674 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.674 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.674 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.675 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.675 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: _finish_auth 0 2024-09-12T00:31:54.675 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: _check_auth_tickets 2024-09-12T00:31:54.675 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:54.675 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.675 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:31:54.675 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: dump: 2024-09-12T00:31:54.675 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.675 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.675 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.675 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.675 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.675 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.676 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.676 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.676 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.676 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.676 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:31:54.187+0000 7ff93391f800 5 monclient: authenticate success, global_id 6116 2024-09-12T00:31:54.676 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:31:54.187+0000 7ff93391f800 10 monclient: _renew_subs 2024-09-12T00:31:54.676 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:31:54.187+0000 7ff93391f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.676 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:31:54.187+0000 7ff81d60a640 4 set_mon_vals no callback set 2024-09-12T00:31:54.676 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:31:54.187+0000 7ff93391f800 10 monclient: _renew_subs 2024-09-12T00:31:54.676 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:31:54.187+0000 7ff93391f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.676 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:31:54.187+0000 7ff93391f800 1 librados: init done 2024-09-12T00:31:54.676 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:31:54.189+0000 7ff81be07640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:31:54.677 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:31:54.189+0000 7ff81be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:31:54.677 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:31:54.189+0000 7ff81be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:31:54.677 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:31:54.189+0000 7ff927fff640 10 monclient: get_auth_request con 0x7ff814076470 auth_method 0 2024-09-12T00:31:54.677 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:31:54.190+0000 7ff92feaa640 10 monclient: get_auth_request con 0x562196b9e520 auth_method 0 2024-09-12T00:31:54.677 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:31:54.190+0000 7ff92f6a9640 10 monclient: get_auth_request con 0x562196ba14d0 auth_method 0 2024-09-12T00:31:54.677 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:31:54.191+0000 7ff927fff640 10 monclient: get_auth_request con 0x562196ba5830 auth_method 0 2024-09-12T00:31:54.677 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:31:54.192+0000 7ff92feaa640 10 monclient: get_auth_request con 0x562196ba4d80 auth_method 0 2024-09-12T00:31:54.677 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:31:54.193+0000 7ff93391f800 10 monclient: build_initial_monmap 2024-09-12T00:31:54.677 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:31:54.193+0000 7ff93391f800 1 build_initial for_mkfs: 0 2024-09-12T00:31:54.677 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:31:54.193+0000 7ff93391f800 10 monclient: monmap: 2024-09-12T00:31:54.677 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:31:54.677 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:31:54.678 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:31:54.678 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:31:54.678 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:31:54.678 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.678 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:31:54.678 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:31:54.678 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:31:54.678 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.678 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding auth protocol: cephx 2024-09-12T00:31:54.678 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding auth protocol: cephx 2024-09-12T00:31:54.678 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding auth protocol: cephx 2024-09-12T00:31:54.678 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: secure 2024-09-12T00:31:54.678 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: crc 2024-09-12T00:31:54.679 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: secure 2024-09-12T00:31:54.679 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: crc 2024-09-12T00:31:54.679 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: secure 2024-09-12T00:31:54.679 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: crc 2024-09-12T00:31:54.679 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: crc 2024-09-12T00:31:54.679 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: secure 2024-09-12T00:31:54.679 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: crc 2024-09-12T00:31:54.679 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: secure 2024-09-12T00:31:54.679 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: crc 2024-09-12T00:31:54.679 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: secure 2024-09-12T00:31:54.679 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:31:54.193+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.679 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 asok(0x562196935630) register_command objecter_requests cmddesc objecter_requests hook 0x562196bb12f0 EEXIST 2024-09-12T00:31:54.679 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:31:54.193+0000 7ff93391f800 10 monclient: init 2024-09-12T00:31:54.680 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding auth protocol: cephx 2024-09-12T00:31:54.680 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding auth protocol: cephx 2024-09-12T00:31:54.680 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding auth protocol: cephx 2024-09-12T00:31:54.680 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: secure 2024-09-12T00:31:54.680 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: crc 2024-09-12T00:31:54.680 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: secure 2024-09-12T00:31:54.680 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: crc 2024-09-12T00:31:54.680 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: secure 2024-09-12T00:31:54.680 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: crc 2024-09-12T00:31:54.680 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: crc 2024-09-12T00:31:54.680 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: secure 2024-09-12T00:31:54.680 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: crc 2024-09-12T00:31:54.680 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: secure 2024-09-12T00:31:54.681 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: crc 2024-09-12T00:31:54.681 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: secure 2024-09-12T00:31:54.681 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:31:54.194+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.681 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:31:54.194+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.681 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:31:54.194+0000 7ff93391f800 5 asok(0x562196935630) register_command rotate-key cmddesc rotate-key hook 0x562196bac9d0 EEXIST 2024-09-12T00:31:54.681 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient: _reopen_session rank -1 2024-09-12T00:31:54.681 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:31:54.681 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-b con 0x562196bd4fe0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:31:54.681 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-c con 0x562196bd72b0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:31:54.681 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-a con 0x562196bd37b0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:31:54.681 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.681 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.681 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.682 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): _renew_subs 2024-09-12T00:31:54.682 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): authenticate will time out at 1922.766519s 2024-09-12T00:31:54.682 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): get_auth_request con 0x562196bd72b0 auth_method 0 2024-09-12T00:31:54.682 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.682 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.682 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.682 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:31:54.194+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request con 0x562196bd37b0 auth_method 0 2024-09-12T00:31:54.682 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:31:54.194+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.682 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:31:54.194+0000 7ff92f6a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.682 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:31:54.194+0000 7ff92f6a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.682 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:31:54.194+0000 7ff927fff640 10 monclient(hunting): get_auth_request con 0x562196bd4fe0 auth_method 0 2024-09-12T00:31:54.682 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:31:54.194+0000 7ff927fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.682 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:31:54.194+0000 7ff927fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.682 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:31:54.194+0000 7ff927fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.683 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.683 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.683 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.683 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:31:54.194+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.683 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:31:54.194+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.683 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:31:54.194+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.683 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:31:54.194+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.683 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:31:54.194+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.683 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:31:54.194+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.683 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): handle_auth_done global_id 6119 payload 824 2024-09-12T00:31:54.683 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient: _finish_hunting 0 2024-09-12T00:31:54.683 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:31:54.194+0000 7ff92feaa640 1 monclient: found mon.noname-c 2024-09-12T00:31:54.683 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.684 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.684 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:31:54.684 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: dump: 2024-09-12T00:31:54.684 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.684 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.684 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.684 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.684 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.684 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.684 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.684 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.684 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.684 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.685 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: _finish_auth 0 2024-09-12T00:31:54.685 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: _check_auth_tickets 2024-09-12T00:31:54.685 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:54.685 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.685 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:31:54.685 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: dump: 2024-09-12T00:31:54.685 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.685 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.685 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.685 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.685 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.685 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.685 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.686 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.686 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.686 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.686 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:31:54.195+0000 7ff93391f800 5 monclient: authenticate success, global_id 6119 2024-09-12T00:31:54.686 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:31:54.195+0000 7ff93391f800 10 monclient: _renew_subs 2024-09-12T00:31:54.686 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:31:54.195+0000 7ff93391f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.686 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:31:54.195+0000 7ff9306ab640 4 set_mon_vals no callback set 2024-09-12T00:31:54.686 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:31:54.195+0000 7ff93391f800 10 monclient: _renew_subs 2024-09-12T00:31:54.686 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:31:54.195+0000 7ff93391f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.686 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:31:54.197+0000 7ff819602640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:31:54.686 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:31:54.197+0000 7ff819602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:31:54.686 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:31:54.197+0000 7ff819602640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:31:54.686 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:31:54.197+0000 7ff927fff640 10 monclient: get_auth_request con 0x7ff808076380 auth_method 0 2024-09-12T00:31:54.687 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:31:54.197+0000 7ff93391f800 10 monclient: get_monmap_and_config 2024-09-12T00:31:54.687 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:31:54.197+0000 7ff93391f800 10 monclient: build_initial_monmap 2024-09-12T00:31:54.687 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:31:54.197+0000 7ff93391f800 1 build_initial for_mkfs: 0 2024-09-12T00:31:54.687 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:31:54.197+0000 7ff93391f800 10 monclient: monmap: 2024-09-12T00:31:54.687 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:31:54.687 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:31:54.687 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:31:54.687 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:31:54.687 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:31:54.687 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.687 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:31:54.687 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:31:54.687 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:31:54.687 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.688 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding auth protocol: cephx 2024-09-12T00:31:54.688 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding auth protocol: cephx 2024-09-12T00:31:54.688 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding auth protocol: cephx 2024-09-12T00:31:54.688 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: secure 2024-09-12T00:31:54.688 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: crc 2024-09-12T00:31:54.688 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: secure 2024-09-12T00:31:54.688 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: crc 2024-09-12T00:31:54.688 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: secure 2024-09-12T00:31:54.688 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: crc 2024-09-12T00:31:54.688 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: crc 2024-09-12T00:31:54.688 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: secure 2024-09-12T00:31:54.688 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: crc 2024-09-12T00:31:54.688 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: secure 2024-09-12T00:31:54.689 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: crc 2024-09-12T00:31:54.689 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: secure 2024-09-12T00:31:54.689 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:31:54.197+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.689 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:31:54.197+0000 7ff93391f800 10 monclient: init 2024-09-12T00:31:54.689 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding auth protocol: cephx 2024-09-12T00:31:54.689 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding auth protocol: cephx 2024-09-12T00:31:54.689 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding auth protocol: cephx 2024-09-12T00:31:54.689 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: secure 2024-09-12T00:31:54.689 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: crc 2024-09-12T00:31:54.689 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: secure 2024-09-12T00:31:54.689 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: crc 2024-09-12T00:31:54.689 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: secure 2024-09-12T00:31:54.689 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: crc 2024-09-12T00:31:54.690 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: crc 2024-09-12T00:31:54.690 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: secure 2024-09-12T00:31:54.690 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: crc 2024-09-12T00:31:54.690 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: secure 2024-09-12T00:31:54.690 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: crc 2024-09-12T00:31:54.690 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: secure 2024-09-12T00:31:54.690 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:31:54.198+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.690 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:31:54.198+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.690 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:31:54.198+0000 7ff93391f800 5 asok(0x562196935630) register_command rotate-key cmddesc rotate-key hook 0x7ffef02bc8a8 EEXIST 2024-09-12T00:31:54.690 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient: _reopen_session rank -1 2024-09-12T00:31:54.690 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:31:54.690 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-a con 0x562196c29530 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:31:54.690 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-b con 0x562196bfa480 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:31:54.690 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-c con 0x562196c24dd0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:31:54.691 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.691 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.691 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.691 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): _renew_subs 2024-09-12T00:31:54.691 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): authenticate will time out at 1922.770383s 2024-09-12T00:31:54.691 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:31:54.198+0000 7ff927fff640 10 monclient(hunting): get_auth_request con 0x562196c29530 auth_method 0 2024-09-12T00:31:54.691 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:31:54.198+0000 7ff927fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.691 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:31:54.198+0000 7ff927fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.691 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:31:54.198+0000 7ff927fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.691 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request con 0x562196c24dd0 auth_method 0 2024-09-12T00:31:54.692 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.692 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.692 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.692 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.692 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.692 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.692 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:31:54.198+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.692 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:31:54.198+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.692 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:31:54.198+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.692 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:31:54.198+0000 7ff92feaa640 10 monclient(hunting): get_auth_request con 0x562196bfa480 auth_method 0 2024-09-12T00:31:54.692 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:31:54.198+0000 7ff92feaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.692 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:31:54.198+0000 7ff92feaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.692 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:31:54.198+0000 7ff92feaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.693 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_done global_id 6122 payload 274 2024-09-12T00:31:54.693 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient: _finish_hunting 0 2024-09-12T00:31:54.693 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 1 monclient: found mon.noname-c 2024-09-12T00:31:54.693 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.693 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.693 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:31:54.693 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: dump: 2024-09-12T00:31:54.693 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.693 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.693 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.693 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.693 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.693 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.694 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.694 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.694 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.694 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.694 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: _finish_auth 0 2024-09-12T00:31:54.694 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:31:54.694 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:54.694 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.694 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:31:54.694 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: dump: 2024-09-12T00:31:54.694 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.694 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.694 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.694 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.695 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.695 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.695 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.695 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.695 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.695 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.695 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:31:54.198+0000 7ff93391f800 5 monclient: authenticate success, global_id 6122 2024-09-12T00:31:54.695 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient: get_monmap_and_config success 2024-09-12T00:31:54.695 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:31:54.198+0000 7ff93391f800 4 set_mon_vals no callback set 2024-09-12T00:31:54.695 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:31:54.199+0000 7ff93391f800 10 monclient: shutdown 2024-09-12T00:31:54.695 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:31:54.199+0000 7ff93391f800 10 monclient: build_initial_monmap 2024-09-12T00:31:54.695 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:31:54.199+0000 7ff93391f800 1 build_initial for_mkfs: 0 2024-09-12T00:31:54.695 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:31:54.199+0000 7ff93391f800 10 monclient: monmap: 2024-09-12T00:31:54.695 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:31:54.695 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:31:54.696 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:31:54.696 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:31:54.696 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:31:54.696 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.696 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:31:54.696 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:31:54.696 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:31:54.696 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.696 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding auth protocol: cephx 2024-09-12T00:31:54.696 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding auth protocol: cephx 2024-09-12T00:31:54.696 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding auth protocol: cephx 2024-09-12T00:31:54.696 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: secure 2024-09-12T00:31:54.696 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: crc 2024-09-12T00:31:54.696 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: secure 2024-09-12T00:31:54.697 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: crc 2024-09-12T00:31:54.697 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: secure 2024-09-12T00:31:54.697 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: crc 2024-09-12T00:31:54.697 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: crc 2024-09-12T00:31:54.697 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: secure 2024-09-12T00:31:54.697 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: crc 2024-09-12T00:31:54.697 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: secure 2024-09-12T00:31:54.697 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: crc 2024-09-12T00:31:54.697 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: secure 2024-09-12T00:31:54.697 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:31:54.199+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.697 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:31:54.199+0000 7ff93391f800 1 librados: starting msgr at 2024-09-12T00:31:54.698 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:31:54.199+0000 7ff93391f800 1 librados: starting objecter 2024-09-12T00:31:54.698 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 asok(0x562196935630) register_command objecter_requests cmddesc objecter_requests hook 0x562196c255e0 EEXIST 2024-09-12T00:31:54.698 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:31:54.200+0000 7ff93391f800 1 librados: setting wanted keys 2024-09-12T00:31:54.698 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:31:54.200+0000 7ff93391f800 1 librados: calling monclient init 2024-09-12T00:31:54.698 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient: init 2024-09-12T00:31:54.698 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding auth protocol: cephx 2024-09-12T00:31:54.698 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding auth protocol: cephx 2024-09-12T00:31:54.698 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding auth protocol: cephx 2024-09-12T00:31:54.698 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: secure 2024-09-12T00:31:54.698 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: crc 2024-09-12T00:31:54.698 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: secure 2024-09-12T00:31:54.698 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: crc 2024-09-12T00:31:54.699 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: secure 2024-09-12T00:31:54.699 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: crc 2024-09-12T00:31:54.699 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: crc 2024-09-12T00:31:54.699 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: secure 2024-09-12T00:31:54.699 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: crc 2024-09-12T00:31:54.699 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: secure 2024-09-12T00:31:54.699 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: crc 2024-09-12T00:31:54.699 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: secure 2024-09-12T00:31:54.699 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:31:54.200+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.699 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:31:54.200+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.699 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 asok(0x562196935630) register_command rotate-key cmddesc rotate-key hook 0x562196beced8 EEXIST 2024-09-12T00:31:54.699 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient: _reopen_session rank -1 2024-09-12T00:31:54.699 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:31:54.700 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-a con 0x562196bfa480 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:31:54.700 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-b con 0x562196c24dd0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:31:54.700 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-c con 0x562196c29530 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:31:54.700 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.700 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.700 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.700 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): _renew_subs 2024-09-12T00:31:54.700 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): authenticate will time out at 1922.772693s 2024-09-12T00:31:54.700 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request con 0x562196c29530 auth_method 0 2024-09-12T00:31:54.700 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.700 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.700 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.701 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:31:54.200+0000 7ff927fff640 10 monclient(hunting): get_auth_request con 0x562196bfa480 auth_method 0 2024-09-12T00:31:54.701 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:31:54.200+0000 7ff927fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.701 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:31:54.200+0000 7ff927fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.701 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:31:54.200+0000 7ff927fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.701 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.701 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.701 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.701 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:31:54.200+0000 7ff92feaa640 10 monclient(hunting): get_auth_request con 0x562196c24dd0 auth_method 0 2024-09-12T00:31:54.701 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:31:54.200+0000 7ff92feaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.701 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:31:54.200+0000 7ff92feaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.701 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:31:54.200+0000 7ff92feaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.701 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:31:54.200+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.701 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:31:54.200+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.702 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:31:54.200+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.702 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:31:54.200+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.702 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:31:54.200+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.702 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:31:54.200+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.702 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_done global_id 6125 payload 824 2024-09-12T00:31:54.702 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:31:54.201+0000 7ff92f6a9640 10 monclient: _finish_hunting 0 2024-09-12T00:31:54.702 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:31:54.201+0000 7ff92f6a9640 1 monclient: found mon.noname-c 2024-09-12T00:31:54.702 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:31:54.201+0000 7ff92f6a9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.702 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.702 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:31:54.702 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: dump: 2024-09-12T00:31:54.702 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.702 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.702 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.703 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.703 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.703 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.703 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.703 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.703 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.703 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.703 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: _finish_auth 0 2024-09-12T00:31:54.703 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: _check_auth_tickets 2024-09-12T00:31:54.703 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:54.703 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.703 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:31:54.703 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: dump: 2024-09-12T00:31:54.703 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.704 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.704 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.704 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.704 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.704 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.704 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.704 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.704 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.704 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.704 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:31:54.201+0000 7ff93391f800 5 monclient: authenticate success, global_id 6125 2024-09-12T00:31:54.704 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:31:54.201+0000 7ff812ffd640 4 set_mon_vals no callback set 2024-09-12T00:31:54.704 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:31:54.201+0000 7ff93391f800 10 monclient: _renew_subs 2024-09-12T00:31:54.704 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:31:54.201+0000 7ff93391f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.705 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:31:54.201+0000 7ff93391f800 10 monclient: _renew_subs 2024-09-12T00:31:54.705 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:31:54.201+0000 7ff93391f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.705 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:31:54.201+0000 7ff93391f800 1 librados: init done 2024-09-12T00:31:54.705 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:31:54.201+0000 7ff93391f800 5 asok(0x562196935630) register_command cr dump hook 0x562196c25268 2024-09-12T00:31:54.705 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:31:54.203+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.705 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:31:54.203+0000 7ff8117fa640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:31:54.705 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:31:54.203+0000 7ff8117fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:31:54.705 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:31:54.203+0000 7ff8117fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:31:54.705 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:31:54.203+0000 7ff927fff640 10 monclient: get_auth_request con 0x7ff7f8076470 auth_method 0 2024-09-12T00:31:54.705 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:31:54.203+0000 7ff92feaa640 10 monclient: get_auth_request con 0x562196c430b0 auth_method 0 2024-09-12T00:31:54.705 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.705 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:31:54.204+0000 7ff93391f800 20 realm 2024-09-12T00:31:54.705 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.706 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.706 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:31:54.204+0000 7ff93391f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:54.706 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.706 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.706 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.706 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:31:54.204+0000 7ff927fff640 10 monclient: get_auth_request con 0x562196c47340 auth_method 0 2024-09-12T00:31:54.706 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:31:54.205+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:54.706 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:31:54.205+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.706 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:31:54.205+0000 7ff92feaa640 10 monclient: get_auth_request con 0x562196c4abf0 auth_method 0 2024-09-12T00:31:54.706 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:31:54.206+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:54.706 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:31:54.206+0000 7ff93391f800 20 searching for the correct realm 2024-09-12T00:31:54.706 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:31:54.206+0000 7ff92f6a9640 10 monclient: get_auth_request con 0x7ff9280c4c20 auth_method 0 2024-09-12T00:31:54.706 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:31:54.208+0000 7ff927fff640 10 monclient: get_auth_request con 0x7ff91802a070 auth_method 0 2024-09-12T00:31:54.706 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:31:54.208+0000 7ff927fff640 0 -- 172.21.15.133:0/423947948 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff91802a070 msgr2=0x7ff918044940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:54.706 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:31:54.409+0000 7ff927fff640 10 monclient: get_auth_request con 0x7ff91802a070 auth_method 0 2024-09-12T00:31:54.707 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:31:54.411+0000 7ff92feaa640 10 monclient: get_auth_request con 0x7ff9280b2c20 auth_method 0 2024-09-12T00:31:54.707 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:31:54.413+0000 7ff92f6a9640 10 monclient: get_auth_request con 0x7ff918054080 auth_method 0 2024-09-12T00:31:54.707 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:31:54.414+0000 7ff927fff640 0 -- 172.21.15.133:0/423947948 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff92007d030 msgr2=0x7ff92001a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:54.707 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:31:54.615+0000 7ff927fff640 10 monclient: get_auth_request con 0x7ff92007d030 auth_method 0 2024-09-12T00:31:54.707 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:54.707 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:54.707 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:54.707 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:54.707 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:54.707 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:54.707 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.707 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.707 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.708 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:54.708 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.708 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:54.708 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 zone default found 2024-09-12T00:31:54.708 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:31:54.623+0000 7ff93391f800 4 Realm: () 2024-09-12T00:31:54.708 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:31:54.623+0000 7ff93391f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:54.708 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:31:54.623+0000 7ff93391f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:54.708 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:31:54.623+0000 7ff93391f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:54.708 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 zonegroup default 2024-09-12T00:31:54.708 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.708 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.708 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.708 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.709 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.709 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:31:54.624+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.709 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:31:54.624+0000 7ff93391f800 20 started sync module instance, tier type = 2024-09-12T00:31:54.709 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:31:54.624+0000 7ff93391f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:54.709 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=0 2024-09-12T00:31:54.709 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=1 2024-09-12T00:31:54.709 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=2 2024-09-12T00:31:54.709 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=3 2024-09-12T00:31:54.709 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=4 2024-09-12T00:31:54.709 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=5 2024-09-12T00:31:54.709 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=6 2024-09-12T00:31:54.709 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:31:54.635+0000 7ff93391f800 20 add_watcher() i=7 2024-09-12T00:31:54.709 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:31:54.635+0000 7ff93391f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:54.709 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding auth protocol: cephx 2024-09-12T00:31:54.710 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding auth protocol: cephx 2024-09-12T00:31:54.710 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding auth protocol: cephx 2024-09-12T00:31:54.710 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: secure 2024-09-12T00:31:54.710 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: crc 2024-09-12T00:31:54.710 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: secure 2024-09-12T00:31:54.710 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: crc 2024-09-12T00:31:54.710 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: secure 2024-09-12T00:31:54.710 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: crc 2024-09-12T00:31:54.710 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: crc 2024-09-12T00:31:54.710 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: secure 2024-09-12T00:31:54.710 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: crc 2024-09-12T00:31:54.710 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: secure 2024-09-12T00:31:54.710 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:31:54.637+0000 7ff7e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:54.710 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: crc 2024-09-12T00:31:54.711 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: secure 2024-09-12T00:31:54.711 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:31:54.637+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.711 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:31:54.637+0000 7ff93391f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:54.711 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:31:54.637+0000 7ff93391f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:54.711 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 asok(0x562196935630) register_command cache list hook 0x562196c16680 2024-09-12T00:31:54.711 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 asok(0x562196935630) register_command cache inspect hook 0x562196c16680 2024-09-12T00:31:54.711 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 asok(0x562196935630) register_command cache erase hook 0x562196c16680 2024-09-12T00:31:54.711 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 asok(0x562196935630) register_command cache zap hook 0x562196c16680 2024-09-12T00:31:54.711 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:31:54.638+0000 7ff93391f800 5 note: GC not initialized 2024-09-12T00:31:54.711 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:31:54.638+0000 7ff7e4fe1640 20 reqs_thread_entry: start 2024-09-12T00:31:54.711 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:31:54.638+0000 7ff93391f800 5 asok(0x562196935630) register_command sync trace show hook 0x7ff92001d070 2024-09-12T00:31:54.711 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:31:54.638+0000 7ff93391f800 5 asok(0x562196935630) register_command sync trace history hook 0x7ff92001d070 2024-09-12T00:31:54.711 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:31:54.638+0000 7ff93391f800 5 asok(0x562196935630) register_command sync trace active hook 0x7ff92001d070 2024-09-12T00:31:54.712 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:31:54.638+0000 7ff93391f800 5 asok(0x562196935630) register_command sync trace active_short hook 0x7ff92001d070 2024-09-12T00:31:54.712 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:31:54.638+0000 7ff93391f800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:54.712 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:31:54.638+0000 7ff93391f800 20 Filter name: none 2024-09-12T00:31:54.712 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:31:54.638+0000 7ff75e7fc640 20 reqs_thread_entry: start 2024-09-12T00:31:54.712 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:31:54.638+0000 7ff93391f800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:31:54.712 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:31:54.638+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.712 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:31:54.639+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:31:54.712 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:31:54.712 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:31:54.712 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 : miss 2024-09-12T00:31:54.712 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:31:54.639+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.712 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:31:54.639+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:31:54.712 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 info.flags=0x17 2024-09-12T00:31:54.712 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 to cache LRU end 2024-09-12T00:31:54.713 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:54.713 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:54.713 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 2024-09-12T00:31:54.713 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:31:54.641+0000 7ff93391f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff93391f800 time 2024-09-12T00:31:54.641763+0000 2024-09-12T00:31:54.713 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:31:54.713 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.713 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:54.713 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff93518c71a] 2024-09-12T00:31:54.713 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff93518c8d8] 2024-09-12T00:31:54.713 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621947ad641] 2024-09-12T00:31:54.713 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd877a4) [0x562194cbf7a4] 2024-09-12T00:31:54.713 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621947bd31d] 2024-09-12T00:31:54.713 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:31:54.714 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff933e29590] 2024-09-12T00:31:54.714 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:31:54.714 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:31:54.714 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.714 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:31:54.642+0000 7ff93391f800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:31:54.714 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7ff93391f800 thread_name:radosgw-admin 2024-09-12T00:31:54.714 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.714 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:54.714 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff933e3e6f0] 2024-09-12T00:31:54.714 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff933e8b99c] 2024-09-12T00:31:54.714 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:31:54.714 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:31:54.714 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff93518c774] 2024-09-12T00:31:54.714 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff93518c8d8] 2024-09-12T00:31:54.715 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621947ad641] 2024-09-12T00:31:54.715 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd877a4) [0x562194cbf7a4] 2024-09-12T00:31:54.715 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621947bd31d] 2024-09-12T00:31:54.715 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:31:54.715 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff933e29590] 2024-09-12T00:31:54.715 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:31:54.715 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:31:54.715 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:31:54.715 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.715 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:31:54.715 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:31:54.715 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:31:54.715 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:31:54.715 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:31:54.716 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:31:54.716 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:31:54.716 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:31:54.716 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:31:54.716 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:31:54.716 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:31:54.716 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:31:54.716 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:31:54.716 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:31:54.716 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:31:54.716 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:31:54.716 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:31:54.716 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:31:54.717 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:31:54.717 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:31:54.717 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:31:54.717 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:31:54.717 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:31:54.717 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:31:54.717 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:31:54.717 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:31:54.717 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:31:54.717 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:31:54.717 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:31:54.717 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:31:54.717 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:31:54.718 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:31:54.718 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:31:54.718 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:31:54.718 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:31:54.718 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:31:54.718 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:31:54.718 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:31:54.718 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:31:54.718 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:31:54.718 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:31:54.718 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:31:54.718 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:31:54.718 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:31:54.719 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:31:54.719 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:31:54.719 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:31:54.719 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:31:54.719 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:31:54.719 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:31:54.719 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:31:54.719 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:31:54.719 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:31:54.719 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:31:54.719 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:31:54.719 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:31:54.719 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:31:54.719 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:31:54.720 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:31:54.720 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:31:54.720 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:31:54.720 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:31:54.720 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:31:54.720 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:31:54.720 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:31:54.720 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:31:54.720 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:31:54.720 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:31:54.720 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:31:54.720 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:31:54.720 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:31:54.721 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:31:54.721 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:31:54.721 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:31:54.721 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:31:54.721 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:31:54.721 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:31:54.721 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:31:54.721 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:31:54.721 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:31:54.721 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:31:54.721 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:31:54.721 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:31:54.721 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:31:54.721 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:31:54.722 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:31:54.722 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:31:54.722 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:31:54.722 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:31:54.722 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:31:54.722 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:31:54.722 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:31:54.722 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:31:54.722 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:31:54.722 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff75e7fc640 / http_manager 2024-09-12T00:31:54.722 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff7e4fe1640 / http_manager 2024-09-12T00:31:54.722 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff7e5fe3640 / rgw_dt_lg_renew 2024-09-12T00:31:54.722 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff8117fa640 / ms_dispatch 2024-09-12T00:31:54.723 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff812ffd640 / io_context_pool 2024-09-12T00:31:54.723 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff819602640 / ms_dispatch 2024-09-12T00:31:54.723 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff81be07640 / ms_dispatch 2024-09-12T00:31:54.723 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff81d60a640 / io_context_pool 2024-09-12T00:31:54.723 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff927fff640 / msgr-worker-2 2024-09-12T00:31:54.723 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff92f6a9640 / msgr-worker-1 2024-09-12T00:31:54.723 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff92feaa640 / msgr-worker-0 2024-09-12T00:31:54.723 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff9306ab640 / io_context_pool 2024-09-12T00:31:54.723 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff93391f800 / radosgw-admin 2024-09-12T00:31:54.723 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:31:54.723 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:31:54.723 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/log/ceph/ceph-client.admin.92917.log 2024-09-12T00:31:54.723 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:31:54.724 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:31:54.724 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:31:54.184+0000 7ff92f6a9640 1 monclient: found mon.noname-a 2024-09-12T00:31:54.724 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:31:54.184+0000 7ff92f6a9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:31:54.724 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.724 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:31:54.724 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: dump: 2024-09-12T00:31:54.724 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.724 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.724 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.724 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.724 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.724 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.724 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.724 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.725 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.725 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.725 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: _finish_auth 0 2024-09-12T00:31:54.725 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: _check_auth_tickets 2024-09-12T00:31:54.725 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:54.725 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.725 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:31:54.725 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:31:54.184+0000 7ff81d60a640 10 monclient: dump: 2024-09-12T00:31:54.725 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.725 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.725 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.725 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.725 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.726 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.726 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.726 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.726 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.726 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.726 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:31:54.184+0000 7ff93391f800 5 monclient: authenticate success, global_id 6459 2024-09-12T00:31:54.726 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:31:54.184+0000 7ff93391f800 10 monclient: get_monmap_and_config success 2024-09-12T00:31:54.726 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:31:54.184+0000 7ff93391f800 4 set_mon_vals no callback set 2024-09-12T00:31:54.726 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:31:54.185+0000 7ff93391f800 10 monclient: shutdown 2024-09-12T00:31:54.726 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 asok(0x562196935630) unregister_commands rotate-key 2024-09-12T00:31:54.726 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:31:54.185+0000 7ff93391f800 10 monclient: build_initial_monmap 2024-09-12T00:31:54.726 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:31:54.185+0000 7ff93391f800 1 build_initial for_mkfs: 0 2024-09-12T00:31:54.726 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:31:54.185+0000 7ff93391f800 10 monclient: monmap: 2024-09-12T00:31:54.726 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:31:54.727 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:31:54.727 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:31:54.727 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:31:54.727 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:31:54.727 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.727 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:31:54.727 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:31:54.727 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:31:54.727 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.727 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding auth protocol: cephx 2024-09-12T00:31:54.727 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding auth protocol: cephx 2024-09-12T00:31:54.727 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding auth protocol: cephx 2024-09-12T00:31:54.727 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: secure 2024-09-12T00:31:54.727 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: crc 2024-09-12T00:31:54.727 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: secure 2024-09-12T00:31:54.728 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: crc 2024-09-12T00:31:54.728 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: secure 2024-09-12T00:31:54.728 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: crc 2024-09-12T00:31:54.728 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: crc 2024-09-12T00:31:54.728 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: secure 2024-09-12T00:31:54.728 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: crc 2024-09-12T00:31:54.728 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: secure 2024-09-12T00:31:54.728 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: crc 2024-09-12T00:31:54.728 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:31:54.185+0000 7ff93391f800 5 AuthRegistry(0x562196b5a4d0) adding con mode: secure 2024-09-12T00:31:54.728 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:31:54.185+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.728 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:31:54.185+0000 7ff93391f800 1 librados: starting msgr at 2024-09-12T00:31:54.728 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:31:54.185+0000 7ff93391f800 1 librados: starting objecter 2024-09-12T00:31:54.729 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 asok(0x562196935630) register_command objecter_requests hook 0x562196b58850 2024-09-12T00:31:54.729 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:31:54.186+0000 7ff93391f800 1 librados: setting wanted keys 2024-09-12T00:31:54.729 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:31:54.186+0000 7ff93391f800 1 librados: calling monclient init 2024-09-12T00:31:54.729 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient: init 2024-09-12T00:31:54.729 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding auth protocol: cephx 2024-09-12T00:31:54.729 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding auth protocol: cephx 2024-09-12T00:31:54.729 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding auth protocol: cephx 2024-09-12T00:31:54.729 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: secure 2024-09-12T00:31:54.729 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: crc 2024-09-12T00:31:54.729 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: secure 2024-09-12T00:31:54.730 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: crc 2024-09-12T00:31:54.730 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: secure 2024-09-12T00:31:54.730 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: crc 2024-09-12T00:31:54.730 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: crc 2024-09-12T00:31:54.730 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: secure 2024-09-12T00:31:54.730 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: crc 2024-09-12T00:31:54.730 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: secure 2024-09-12T00:31:54.730 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: crc 2024-09-12T00:31:54.730 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 AuthRegistry(0x562196b54840) adding con mode: secure 2024-09-12T00:31:54.730 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:31:54.186+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.731 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:31:54.186+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.731 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:31:54.186+0000 7ff93391f800 5 asok(0x562196935630) register_command rotate-key hook 0x562196b54988 2024-09-12T00:31:54.731 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient: _reopen_session rank -1 2024-09-12T00:31:54.731 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:31:54.731 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-c con 0x562196a0cda0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:31:54.731 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-b con 0x562196a982a0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:31:54.731 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-a con 0x562196a9e5f0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:31:54.731 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.731 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.731 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.731 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): _renew_subs 2024-09-12T00:31:54.731 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:31:54.186+0000 7ff93391f800 10 monclient(hunting): authenticate will time out at 1922.758665s 2024-09-12T00:31:54.731 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:31:54.186+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request con 0x562196a0cda0 auth_method 0 2024-09-12T00:31:54.732 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:31:54.186+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.732 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:31:54.186+0000 7ff92f6a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.732 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:31:54.186+0000 7ff92f6a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.732 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:31:54.186+0000 7ff92feaa640 10 monclient(hunting): get_auth_request con 0x562196a9e5f0 auth_method 0 2024-09-12T00:31:54.732 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:31:54.186+0000 7ff92feaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.732 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:31:54.186+0000 7ff92feaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.732 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:31:54.186+0000 7ff92feaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.732 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:31:54.186+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.732 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:31:54.186+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.732 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:31:54.186+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.732 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:31:54.186+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.732 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:31:54.186+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.732 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:31:54.186+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.733 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:31:54.186+0000 7ff927fff640 10 monclient(hunting): get_auth_request con 0x562196a982a0 auth_method 0 2024-09-12T00:31:54.733 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:31:54.186+0000 7ff927fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.733 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:31:54.186+0000 7ff927fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.733 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:31:54.186+0000 7ff927fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.733 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:31:54.186+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.733 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:31:54.186+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.733 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:31:54.186+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.733 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:31:54.187+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_done global_id 6116 payload 824 2024-09-12T00:31:54.733 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:31:54.187+0000 7ff92f6a9640 10 monclient: _finish_hunting 0 2024-09-12T00:31:54.733 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:31:54.187+0000 7ff92f6a9640 1 monclient: found mon.noname-c 2024-09-12T00:31:54.733 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:31:54.187+0000 7ff92f6a9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.733 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.733 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:31:54.734 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: dump: 2024-09-12T00:31:54.734 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.734 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.734 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.734 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.734 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.734 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.734 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.734 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.734 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.734 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.734 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: _finish_auth 0 2024-09-12T00:31:54.734 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: _check_auth_tickets 2024-09-12T00:31:54.735 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:54.735 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.735 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:31:54.735 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:31:54.187+0000 7ff81be07640 10 monclient: dump: 2024-09-12T00:31:54.735 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.735 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.735 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.735 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.735 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.735 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.735 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.735 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.735 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.736 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.736 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:31:54.187+0000 7ff93391f800 5 monclient: authenticate success, global_id 6116 2024-09-12T00:31:54.736 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:31:54.187+0000 7ff93391f800 10 monclient: _renew_subs 2024-09-12T00:31:54.736 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:31:54.187+0000 7ff93391f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.736 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:31:54.187+0000 7ff81d60a640 4 set_mon_vals no callback set 2024-09-12T00:31:54.736 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:31:54.187+0000 7ff93391f800 10 monclient: _renew_subs 2024-09-12T00:31:54.736 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:31:54.187+0000 7ff93391f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.736 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:31:54.187+0000 7ff93391f800 1 librados: init done 2024-09-12T00:31:54.736 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:31:54.189+0000 7ff81be07640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:31:54.736 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:31:54.189+0000 7ff81be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:31:54.736 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:31:54.189+0000 7ff81be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:31:54.736 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:31:54.189+0000 7ff927fff640 10 monclient: get_auth_request con 0x7ff814076470 auth_method 0 2024-09-12T00:31:54.736 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:31:54.190+0000 7ff92feaa640 10 monclient: get_auth_request con 0x562196b9e520 auth_method 0 2024-09-12T00:31:54.737 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:31:54.190+0000 7ff92f6a9640 10 monclient: get_auth_request con 0x562196ba14d0 auth_method 0 2024-09-12T00:31:54.737 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:31:54.191+0000 7ff927fff640 10 monclient: get_auth_request con 0x562196ba5830 auth_method 0 2024-09-12T00:31:54.737 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:31:54.192+0000 7ff92feaa640 10 monclient: get_auth_request con 0x562196ba4d80 auth_method 0 2024-09-12T00:31:54.737 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:31:54.193+0000 7ff93391f800 10 monclient: build_initial_monmap 2024-09-12T00:31:54.737 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:31:54.193+0000 7ff93391f800 1 build_initial for_mkfs: 0 2024-09-12T00:31:54.737 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:31:54.193+0000 7ff93391f800 10 monclient: monmap: 2024-09-12T00:31:54.737 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:31:54.737 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:31:54.737 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:31:54.737 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:31:54.737 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:31:54.737 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.737 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:31:54.737 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:31:54.738 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:31:54.738 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.738 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding auth protocol: cephx 2024-09-12T00:31:54.738 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding auth protocol: cephx 2024-09-12T00:31:54.738 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding auth protocol: cephx 2024-09-12T00:31:54.738 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: secure 2024-09-12T00:31:54.738 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: crc 2024-09-12T00:31:54.738 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: secure 2024-09-12T00:31:54.738 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: crc 2024-09-12T00:31:54.738 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: secure 2024-09-12T00:31:54.738 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: crc 2024-09-12T00:31:54.738 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: crc 2024-09-12T00:31:54.739 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: secure 2024-09-12T00:31:54.739 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: crc 2024-09-12T00:31:54.739 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: secure 2024-09-12T00:31:54.739 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: crc 2024-09-12T00:31:54.739 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bad900) adding con mode: secure 2024-09-12T00:31:54.739 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:31:54.193+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.739 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 asok(0x562196935630) register_command objecter_requests cmddesc objecter_requests hook 0x562196bb12f0 EEXIST 2024-09-12T00:31:54.739 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:31:54.193+0000 7ff93391f800 10 monclient: init 2024-09-12T00:31:54.739 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding auth protocol: cephx 2024-09-12T00:31:54.739 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding auth protocol: cephx 2024-09-12T00:31:54.739 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding auth protocol: cephx 2024-09-12T00:31:54.739 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: secure 2024-09-12T00:31:54.739 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: crc 2024-09-12T00:31:54.739 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: secure 2024-09-12T00:31:54.740 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: crc 2024-09-12T00:31:54.740 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: secure 2024-09-12T00:31:54.740 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: crc 2024-09-12T00:31:54.740 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: crc 2024-09-12T00:31:54.740 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: secure 2024-09-12T00:31:54.740 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: crc 2024-09-12T00:31:54.740 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: secure 2024-09-12T00:31:54.740 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: crc 2024-09-12T00:31:54.740 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:31:54.193+0000 7ff93391f800 5 AuthRegistry(0x562196bac888) adding con mode: secure 2024-09-12T00:31:54.740 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:31:54.194+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.740 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:31:54.194+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.740 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:31:54.194+0000 7ff93391f800 5 asok(0x562196935630) register_command rotate-key cmddesc rotate-key hook 0x562196bac9d0 EEXIST 2024-09-12T00:31:54.740 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient: _reopen_session rank -1 2024-09-12T00:31:54.741 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:31:54.741 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-b con 0x562196bd4fe0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:31:54.741 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-c con 0x562196bd72b0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:31:54.741 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-a con 0x562196bd37b0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:31:54.741 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.741 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.741 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.741 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): _renew_subs 2024-09-12T00:31:54.741 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:31:54.194+0000 7ff93391f800 10 monclient(hunting): authenticate will time out at 1922.766519s 2024-09-12T00:31:54.741 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): get_auth_request con 0x562196bd72b0 auth_method 0 2024-09-12T00:31:54.741 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.741 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.741 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.742 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:31:54.194+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request con 0x562196bd37b0 auth_method 0 2024-09-12T00:31:54.742 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:31:54.194+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.742 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:31:54.194+0000 7ff92f6a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.742 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:31:54.194+0000 7ff92f6a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.742 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:31:54.194+0000 7ff927fff640 10 monclient(hunting): get_auth_request con 0x562196bd4fe0 auth_method 0 2024-09-12T00:31:54.742 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:31:54.194+0000 7ff927fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.742 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:31:54.194+0000 7ff927fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.742 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:31:54.194+0000 7ff927fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.742 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.742 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.742 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.742 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:31:54.194+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.742 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:31:54.194+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.742 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:31:54.194+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.743 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:31:54.194+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.743 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:31:54.194+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.743 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:31:54.194+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.743 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient(hunting): handle_auth_done global_id 6119 payload 824 2024-09-12T00:31:54.743 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient: _finish_hunting 0 2024-09-12T00:31:54.743 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:31:54.194+0000 7ff92feaa640 1 monclient: found mon.noname-c 2024-09-12T00:31:54.743 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:31:54.194+0000 7ff92feaa640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.743 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.743 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:31:54.743 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: dump: 2024-09-12T00:31:54.743 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.743 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.743 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.743 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.743 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.744 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.744 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.744 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.744 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.744 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.744 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: _finish_auth 0 2024-09-12T00:31:54.744 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: _check_auth_tickets 2024-09-12T00:31:54.744 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:54.744 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.744 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:31:54.744 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:31:54.195+0000 7ff819602640 10 monclient: dump: 2024-09-12T00:31:54.744 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.744 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.745 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.745 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.745 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.745 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.745 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.745 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.745 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.745 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.745 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:31:54.195+0000 7ff93391f800 5 monclient: authenticate success, global_id 6119 2024-09-12T00:31:54.745 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:31:54.195+0000 7ff93391f800 10 monclient: _renew_subs 2024-09-12T00:31:54.745 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:31:54.195+0000 7ff93391f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.745 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:31:54.195+0000 7ff9306ab640 4 set_mon_vals no callback set 2024-09-12T00:31:54.745 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:31:54.195+0000 7ff93391f800 10 monclient: _renew_subs 2024-09-12T00:31:54.745 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:31:54.195+0000 7ff93391f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.746 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:31:54.197+0000 7ff819602640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:31:54.746 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:31:54.197+0000 7ff819602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:31:54.746 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:31:54.197+0000 7ff819602640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:31:54.746 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:31:54.197+0000 7ff927fff640 10 monclient: get_auth_request con 0x7ff808076380 auth_method 0 2024-09-12T00:31:54.746 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:31:54.197+0000 7ff93391f800 10 monclient: get_monmap_and_config 2024-09-12T00:31:54.746 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:31:54.197+0000 7ff93391f800 10 monclient: build_initial_monmap 2024-09-12T00:31:54.746 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:31:54.197+0000 7ff93391f800 1 build_initial for_mkfs: 0 2024-09-12T00:31:54.746 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:31:54.197+0000 7ff93391f800 10 monclient: monmap: 2024-09-12T00:31:54.746 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:31:54.746 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:31:54.746 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:31:54.746 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:31:54.746 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:31:54.747 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.747 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:31:54.747 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:31:54.747 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:31:54.747 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.747 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding auth protocol: cephx 2024-09-12T00:31:54.747 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding auth protocol: cephx 2024-09-12T00:31:54.747 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding auth protocol: cephx 2024-09-12T00:31:54.747 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: secure 2024-09-12T00:31:54.747 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: crc 2024-09-12T00:31:54.747 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: secure 2024-09-12T00:31:54.747 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: crc 2024-09-12T00:31:54.747 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: secure 2024-09-12T00:31:54.748 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: crc 2024-09-12T00:31:54.748 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: crc 2024-09-12T00:31:54.748 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: secure 2024-09-12T00:31:54.748 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: crc 2024-09-12T00:31:54.748 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: secure 2024-09-12T00:31:54.748 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: crc 2024-09-12T00:31:54.748 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x562196bf4e70) adding con mode: secure 2024-09-12T00:31:54.748 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:31:54.197+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.748 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:31:54.197+0000 7ff93391f800 10 monclient: init 2024-09-12T00:31:54.748 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding auth protocol: cephx 2024-09-12T00:31:54.748 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding auth protocol: cephx 2024-09-12T00:31:54.748 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding auth protocol: cephx 2024-09-12T00:31:54.748 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: secure 2024-09-12T00:31:54.748 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: crc 2024-09-12T00:31:54.749 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: secure 2024-09-12T00:31:54.749 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: crc 2024-09-12T00:31:54.749 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: secure 2024-09-12T00:31:54.749 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: crc 2024-09-12T00:31:54.749 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: crc 2024-09-12T00:31:54.749 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: secure 2024-09-12T00:31:54.749 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: crc 2024-09-12T00:31:54.749 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: secure 2024-09-12T00:31:54.749 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: crc 2024-09-12T00:31:54.749 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:31:54.197+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bc760) adding con mode: secure 2024-09-12T00:31:54.749 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:31:54.198+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.749 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:31:54.198+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.749 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:31:54.198+0000 7ff93391f800 5 asok(0x562196935630) register_command rotate-key cmddesc rotate-key hook 0x7ffef02bc8a8 EEXIST 2024-09-12T00:31:54.750 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient: _reopen_session rank -1 2024-09-12T00:31:54.750 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:31:54.750 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-a con 0x562196c29530 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:31:54.750 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-b con 0x562196bfa480 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:31:54.750 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-c con 0x562196c24dd0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:31:54.750 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.750 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.750 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.750 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): _renew_subs 2024-09-12T00:31:54.750 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient(hunting): authenticate will time out at 1922.770383s 2024-09-12T00:31:54.750 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:31:54.198+0000 7ff927fff640 10 monclient(hunting): get_auth_request con 0x562196c29530 auth_method 0 2024-09-12T00:31:54.750 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:31:54.198+0000 7ff927fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.750 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:31:54.198+0000 7ff927fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.750 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:31:54.198+0000 7ff927fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.751 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request con 0x562196c24dd0 auth_method 0 2024-09-12T00:31:54.751 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.751 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.751 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.751 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.751 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.751 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.751 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:31:54.198+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.751 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:31:54.198+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.751 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:31:54.198+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.751 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:31:54.198+0000 7ff92feaa640 10 monclient(hunting): get_auth_request con 0x562196bfa480 auth_method 0 2024-09-12T00:31:54.751 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:31:54.198+0000 7ff92feaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.751 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:31:54.198+0000 7ff92feaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.751 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:31:54.198+0000 7ff92feaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.752 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_done global_id 6122 payload 274 2024-09-12T00:31:54.752 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient: _finish_hunting 0 2024-09-12T00:31:54.752 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 1 monclient: found mon.noname-c 2024-09-12T00:31:54.752 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:31:54.198+0000 7ff92f6a9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.752 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.752 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:31:54.752 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: dump: 2024-09-12T00:31:54.752 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.752 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.752 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.752 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.752 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.752 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.752 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.753 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.753 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.753 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.753 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: _finish_auth 0 2024-09-12T00:31:54.753 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:31:54.753 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:54.753 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.753 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:31:54.753 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:31:54.198+0000 7ff812ffd640 10 monclient: dump: 2024-09-12T00:31:54.753 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.753 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.753 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.753 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.753 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.754 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.754 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.754 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.754 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.754 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.754 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:31:54.198+0000 7ff93391f800 5 monclient: authenticate success, global_id 6122 2024-09-12T00:31:54.754 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:31:54.198+0000 7ff93391f800 10 monclient: get_monmap_and_config success 2024-09-12T00:31:54.754 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:31:54.198+0000 7ff93391f800 4 set_mon_vals no callback set 2024-09-12T00:31:54.754 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:31:54.199+0000 7ff93391f800 10 monclient: shutdown 2024-09-12T00:31:54.754 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:31:54.199+0000 7ff93391f800 10 monclient: build_initial_monmap 2024-09-12T00:31:54.754 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:31:54.199+0000 7ff93391f800 1 build_initial for_mkfs: 0 2024-09-12T00:31:54.754 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:31:54.199+0000 7ff93391f800 10 monclient: monmap: 2024-09-12T00:31:54.754 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:31:54.755 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:31:54.755 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:31:54.755 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:31:54.755 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:31:54.755 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.755 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:31:54.755 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:31:54.755 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:31:54.755 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.755 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding auth protocol: cephx 2024-09-12T00:31:54.755 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding auth protocol: cephx 2024-09-12T00:31:54.755 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding auth protocol: cephx 2024-09-12T00:31:54.755 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: secure 2024-09-12T00:31:54.755 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: crc 2024-09-12T00:31:54.756 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: secure 2024-09-12T00:31:54.756 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: crc 2024-09-12T00:31:54.756 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: secure 2024-09-12T00:31:54.756 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: crc 2024-09-12T00:31:54.756 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: crc 2024-09-12T00:31:54.756 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: secure 2024-09-12T00:31:54.756 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: crc 2024-09-12T00:31:54.756 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: secure 2024-09-12T00:31:54.756 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: crc 2024-09-12T00:31:54.756 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:31:54.199+0000 7ff93391f800 5 AuthRegistry(0x562196c25700) adding con mode: secure 2024-09-12T00:31:54.756 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:31:54.199+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.756 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:31:54.199+0000 7ff93391f800 1 librados: starting msgr at 2024-09-12T00:31:54.756 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:31:54.199+0000 7ff93391f800 1 librados: starting objecter 2024-09-12T00:31:54.757 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 asok(0x562196935630) register_command objecter_requests cmddesc objecter_requests hook 0x562196c255e0 EEXIST 2024-09-12T00:31:54.757 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:31:54.200+0000 7ff93391f800 1 librados: setting wanted keys 2024-09-12T00:31:54.757 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:31:54.200+0000 7ff93391f800 1 librados: calling monclient init 2024-09-12T00:31:54.757 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient: init 2024-09-12T00:31:54.757 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding auth protocol: cephx 2024-09-12T00:31:54.757 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding auth protocol: cephx 2024-09-12T00:31:54.757 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding auth protocol: cephx 2024-09-12T00:31:54.757 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: secure 2024-09-12T00:31:54.757 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: crc 2024-09-12T00:31:54.757 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: secure 2024-09-12T00:31:54.757 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: crc 2024-09-12T00:31:54.757 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: secure 2024-09-12T00:31:54.757 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: crc 2024-09-12T00:31:54.757 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: crc 2024-09-12T00:31:54.758 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: secure 2024-09-12T00:31:54.758 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: crc 2024-09-12T00:31:54.758 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: secure 2024-09-12T00:31:54.758 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: crc 2024-09-12T00:31:54.758 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 AuthRegistry(0x562196becd90) adding con mode: secure 2024-09-12T00:31:54.758 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:31:54.200+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.758 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:31:54.200+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.758 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:31:54.200+0000 7ff93391f800 5 asok(0x562196935630) register_command rotate-key cmddesc rotate-key hook 0x562196beced8 EEXIST 2024-09-12T00:31:54.758 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient: _reopen_session rank -1 2024-09-12T00:31:54.758 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:31:54.758 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-a con 0x562196bfa480 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:31:54.758 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-b con 0x562196c24dd0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:31:54.758 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): picked mon.noname-c con 0x562196c29530 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:31:54.758 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.759 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.759 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:54.759 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): _renew_subs 2024-09-12T00:31:54.759 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:31:54.200+0000 7ff93391f800 10 monclient(hunting): authenticate will time out at 1922.772693s 2024-09-12T00:31:54.759 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request con 0x562196c29530 auth_method 0 2024-09-12T00:31:54.759 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.759 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.759 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.759 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:31:54.200+0000 7ff927fff640 10 monclient(hunting): get_auth_request con 0x562196bfa480 auth_method 0 2024-09-12T00:31:54.759 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:31:54.200+0000 7ff927fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.759 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:31:54.200+0000 7ff927fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.759 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:31:54.200+0000 7ff927fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.759 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.759 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.760 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.760 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:31:54.200+0000 7ff92feaa640 10 monclient(hunting): get_auth_request con 0x562196c24dd0 auth_method 0 2024-09-12T00:31:54.760 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:31:54.200+0000 7ff92feaa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:54.760 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:31:54.200+0000 7ff92feaa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:54.760 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:31:54.200+0000 7ff92feaa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:54.760 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:31:54.200+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.760 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:31:54.200+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.760 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:31:54.200+0000 7ff927fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.760 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:31:54.200+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:54.760 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:31:54.200+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:54.760 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:31:54.200+0000 7ff92feaa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:54.760 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:31:54.200+0000 7ff92f6a9640 10 monclient(hunting): handle_auth_done global_id 6125 payload 824 2024-09-12T00:31:54.760 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:31:54.201+0000 7ff92f6a9640 10 monclient: _finish_hunting 0 2024-09-12T00:31:54.761 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:31:54.201+0000 7ff92f6a9640 1 monclient: found mon.noname-c 2024-09-12T00:31:54.761 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:31:54.201+0000 7ff92f6a9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.761 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.761 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:31:54.761 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: dump: 2024-09-12T00:31:54.761 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.761 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.761 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.761 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.761 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.761 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.761 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.761 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.761 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.762 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.762 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: _finish_auth 0 2024-09-12T00:31:54.762 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: _check_auth_tickets 2024-09-12T00:31:54.762 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:54.762 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:54.762 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:31:54.762 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:31:54.201+0000 7ff8117fa640 10 monclient: dump: 2024-09-12T00:31:54.762 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:31:54.762 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:31:54.762 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.762 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:31:54.762 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:54.762 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:31:54.763 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:31:54.763 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:31:54.763 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:31:54.763 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.763 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:31:54.201+0000 7ff93391f800 5 monclient: authenticate success, global_id 6125 2024-09-12T00:31:54.763 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:31:54.201+0000 7ff812ffd640 4 set_mon_vals no callback set 2024-09-12T00:31:54.763 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:31:54.201+0000 7ff93391f800 10 monclient: _renew_subs 2024-09-12T00:31:54.763 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:31:54.201+0000 7ff93391f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.763 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:31:54.201+0000 7ff93391f800 10 monclient: _renew_subs 2024-09-12T00:31:54.763 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:31:54.201+0000 7ff93391f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:31:54.763 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:31:54.201+0000 7ff93391f800 1 librados: init done 2024-09-12T00:31:54.763 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:31:54.201+0000 7ff93391f800 5 asok(0x562196935630) register_command cr dump hook 0x562196c25268 2024-09-12T00:31:54.763 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:31:54.203+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.763 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:31:54.203+0000 7ff8117fa640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:31:54.764 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:31:54.203+0000 7ff8117fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:31:54.764 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:31:54.203+0000 7ff8117fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:31:54.764 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:31:54.203+0000 7ff927fff640 10 monclient: get_auth_request con 0x7ff7f8076470 auth_method 0 2024-09-12T00:31:54.764 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:31:54.203+0000 7ff92feaa640 10 monclient: get_auth_request con 0x562196c430b0 auth_method 0 2024-09-12T00:31:54.764 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.764 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:31:54.204+0000 7ff93391f800 20 realm 2024-09-12T00:31:54.764 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.764 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.764 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:31:54.204+0000 7ff93391f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:54.764 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.764 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.764 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:31:54.204+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.764 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:31:54.204+0000 7ff927fff640 10 monclient: get_auth_request con 0x562196c47340 auth_method 0 2024-09-12T00:31:54.765 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:31:54.205+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:54.765 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:31:54.205+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.765 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:31:54.205+0000 7ff92feaa640 10 monclient: get_auth_request con 0x562196c4abf0 auth_method 0 2024-09-12T00:31:54.765 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:31:54.206+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:54.765 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:31:54.206+0000 7ff93391f800 20 searching for the correct realm 2024-09-12T00:31:54.765 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:31:54.206+0000 7ff92f6a9640 10 monclient: get_auth_request con 0x7ff9280c4c20 auth_method 0 2024-09-12T00:31:54.765 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:31:54.208+0000 7ff927fff640 10 monclient: get_auth_request con 0x7ff91802a070 auth_method 0 2024-09-12T00:31:54.765 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:31:54.208+0000 7ff927fff640 0 -- 172.21.15.133:0/423947948 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff91802a070 msgr2=0x7ff918044940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:54.765 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:31:54.409+0000 7ff927fff640 10 monclient: get_auth_request con 0x7ff91802a070 auth_method 0 2024-09-12T00:31:54.765 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:31:54.411+0000 7ff92feaa640 10 monclient: get_auth_request con 0x7ff9280b2c20 auth_method 0 2024-09-12T00:31:54.765 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:31:54.413+0000 7ff92f6a9640 10 monclient: get_auth_request con 0x7ff918054080 auth_method 0 2024-09-12T00:31:54.765 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:31:54.414+0000 7ff927fff640 0 -- 172.21.15.133:0/423947948 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff92007d030 msgr2=0x7ff92001a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:54.765 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:31:54.615+0000 7ff927fff640 10 monclient: get_auth_request con 0x7ff92007d030 auth_method 0 2024-09-12T00:31:54.766 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:54.766 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:54.766 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:54.766 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:54.766 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:54.766 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:54.766 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.766 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.766 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.766 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:54.766 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:31:54.622+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.766 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:54.766 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 zone default found 2024-09-12T00:31:54.766 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:31:54.623+0000 7ff93391f800 4 Realm: () 2024-09-12T00:31:54.767 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:31:54.623+0000 7ff93391f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:54.767 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:31:54.623+0000 7ff93391f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:54.767 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:31:54.623+0000 7ff93391f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:54.767 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 zonegroup default 2024-09-12T00:31:54.767 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.767 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.767 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.767 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.767 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:31:54.623+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.767 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:31:54.624+0000 7ff93391f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.767 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:31:54.624+0000 7ff93391f800 20 started sync module instance, tier type = 2024-09-12T00:31:54.767 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:31:54.624+0000 7ff93391f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:54.767 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=0 2024-09-12T00:31:54.767 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=1 2024-09-12T00:31:54.768 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=2 2024-09-12T00:31:54.768 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=3 2024-09-12T00:31:54.768 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=4 2024-09-12T00:31:54.768 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=5 2024-09-12T00:31:54.768 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:31:54.634+0000 7ff93391f800 20 add_watcher() i=6 2024-09-12T00:31:54.768 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:31:54.635+0000 7ff93391f800 20 add_watcher() i=7 2024-09-12T00:31:54.768 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:31:54.635+0000 7ff93391f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:54.768 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding auth protocol: cephx 2024-09-12T00:31:54.768 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding auth protocol: cephx 2024-09-12T00:31:54.768 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding auth protocol: cephx 2024-09-12T00:31:54.768 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: secure 2024-09-12T00:31:54.768 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: crc 2024-09-12T00:31:54.768 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: secure 2024-09-12T00:31:54.768 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: crc 2024-09-12T00:31:54.769 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: secure 2024-09-12T00:31:54.769 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: crc 2024-09-12T00:31:54.769 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: crc 2024-09-12T00:31:54.769 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: secure 2024-09-12T00:31:54.769 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: crc 2024-09-12T00:31:54.769 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: secure 2024-09-12T00:31:54.769 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:31:54.637+0000 7ff7e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:54.769 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: crc 2024-09-12T00:31:54.769 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 AuthRegistry(0x7ffef02bcc40) adding con mode: secure 2024-09-12T00:31:54.769 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:31:54.637+0000 7ff93391f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:54.769 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:31:54.637+0000 7ff93391f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:54.769 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:31:54.637+0000 7ff93391f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:54.769 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 asok(0x562196935630) register_command cache list hook 0x562196c16680 2024-09-12T00:31:54.769 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 asok(0x562196935630) register_command cache inspect hook 0x562196c16680 2024-09-12T00:31:54.770 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 asok(0x562196935630) register_command cache erase hook 0x562196c16680 2024-09-12T00:31:54.770 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:31:54.637+0000 7ff93391f800 5 asok(0x562196935630) register_command cache zap hook 0x562196c16680 2024-09-12T00:31:54.770 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:31:54.638+0000 7ff93391f800 5 note: GC not initialized 2024-09-12T00:31:54.770 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:31:54.638+0000 7ff7e4fe1640 20 reqs_thread_entry: start 2024-09-12T00:31:54.770 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:31:54.638+0000 7ff93391f800 5 asok(0x562196935630) register_command sync trace show hook 0x7ff92001d070 2024-09-12T00:31:54.770 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:31:54.638+0000 7ff93391f800 5 asok(0x562196935630) register_command sync trace history hook 0x7ff92001d070 2024-09-12T00:31:54.770 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:31:54.638+0000 7ff93391f800 5 asok(0x562196935630) register_command sync trace active hook 0x7ff92001d070 2024-09-12T00:31:54.770 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:31:54.638+0000 7ff93391f800 5 asok(0x562196935630) register_command sync trace active_short hook 0x7ff92001d070 2024-09-12T00:31:54.770 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:31:54.638+0000 7ff93391f800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:54.770 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:31:54.638+0000 7ff93391f800 20 Filter name: none 2024-09-12T00:31:54.770 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:31:54.638+0000 7ff75e7fc640 20 reqs_thread_entry: start 2024-09-12T00:31:54.770 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:31:54.638+0000 7ff93391f800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:31:54.770 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:31:54.638+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.770 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:31:54.639+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:31:54.771 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:31:54.771 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:31:54.771 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 : miss 2024-09-12T00:31:54.771 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:31:54.639+0000 7ff93391f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.771 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:31:54.639+0000 7ff93391f800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:31:54.771 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 info.flags=0x17 2024-09-12T00:31:54.771 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 to cache LRU end 2024-09-12T00:31:54.771 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:54.771 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:54.771 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:31:54.639+0000 7ff93391f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 2024-09-12T00:31:54.771 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:31:54.641+0000 7ff93391f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff93391f800 time 2024-09-12T00:31:54.641763+0000 2024-09-12T00:31:54.771 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:31:54.771 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.772 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:54.772 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff93518c71a] 2024-09-12T00:31:54.772 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff93518c8d8] 2024-09-12T00:31:54.772 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621947ad641] 2024-09-12T00:31:54.772 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd877a4) [0x562194cbf7a4] 2024-09-12T00:31:54.772 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621947bd31d] 2024-09-12T00:31:54.772 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:31:54.772 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff933e29590] 2024-09-12T00:31:54.772 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:31:54.772 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:31:54.772 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.772 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:31:54.642+0000 7ff93391f800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:31:54.772 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7ff93391f800 thread_name:radosgw-admin 2024-09-12T00:31:54.773 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.773 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:54.773 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff933e3e6f0] 2024-09-12T00:31:54.773 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff933e8b99c] 2024-09-12T00:31:54.773 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:31:54.773 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:31:54.773 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff93518c774] 2024-09-12T00:31:54.773 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff93518c8d8] 2024-09-12T00:31:54.773 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5621947ad641] 2024-09-12T00:31:54.773 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd877a4) [0x562194cbf7a4] 2024-09-12T00:31:54.773 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5621947bd31d] 2024-09-12T00:31:54.773 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:31:54.773 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff933e29590] 2024-09-12T00:31:54.774 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:31:54.774 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:31:54.774 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:31:54.774 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.774 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:31:54.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:31:54.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:31:54.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:31:54.774 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:31:54.774 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:31:54.774 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:31:54.774 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:31:54.774 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:31:54.774 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:31:54.775 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:31:54.775 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:31:54.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:31:54.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:31:54.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:31:54.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:31:54.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:31:54.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:31:54.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:31:54.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:31:54.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:31:54.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:31:54.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:31:54.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:31:54.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:31:54.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:31:54.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:31:54.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:31:54.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:31:54.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:31:54.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:31:54.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:31:54.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:31:54.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:31:54.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:31:54.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:31:54.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:31:54.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:31:54.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:31:54.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:31:54.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:31:54.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:31:54.777 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:31:54.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:31:54.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:31:54.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:31:54.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:31:54.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:31:54.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:31:54.777 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:31:54.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:31:54.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:31:54.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:31:54.778 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:31:54.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:31:54.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:31:54.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:31:54.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:31:54.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:31:54.778 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:31:54.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:31:54.778 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:31:54.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:31:54.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:31:54.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:31:54.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:31:54.778 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:31:54.778 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:31:54.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:31:54.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:31:54.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:31:54.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:31:54.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:31:54.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:31:54.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:31:54.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:31:54.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:31:54.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:31:54.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:31:54.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:31:54.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:31:54.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:31:54.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:31:54.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:31:54.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:31:54.780 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:31:54.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:31:54.780 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:31:54.780 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:31:54.780 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:31:54.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:31:54.780 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:31:54.780 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:31:54.780 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:31:54.780 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff75e7fc640 / http_manager 2024-09-12T00:31:54.780 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff7e4fe1640 / http_manager 2024-09-12T00:31:54.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff7e5fe3640 / rgw_dt_lg_renew 2024-09-12T00:31:54.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff8117fa640 / ms_dispatch 2024-09-12T00:31:54.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff812ffd640 / io_context_pool 2024-09-12T00:31:54.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff819602640 / ms_dispatch 2024-09-12T00:31:54.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff81be07640 / ms_dispatch 2024-09-12T00:31:54.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff81d60a640 / io_context_pool 2024-09-12T00:31:54.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff927fff640 / msgr-worker-2 2024-09-12T00:31:54.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff92f6a9640 / msgr-worker-1 2024-09-12T00:31:54.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff92feaa640 / msgr-worker-0 2024-09-12T00:31:54.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff9306ab640 / io_context_pool 2024-09-12T00:31:54.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff93391f800 / radosgw-admin 2024-09-12T00:31:54.781 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:31:54.781 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:31:54.781 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:31:54.643464Z_11e33bdc-fb9a-41c6-b306-d5473daab32e/log 2024-09-12T00:31:54.782 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:31:54.782 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:31:54.783 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:54.783 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:54.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.722+0000 7f83a1919800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.724+0000 7f83a1919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.724+0000 7f83a1919800 20 realm 2024-09-12T00:31:54.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.724+0000 7f83a1919800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.724+0000 7f83a1919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.724+0000 7f83a1919800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:54.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.724+0000 7f83a1919800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.724+0000 7f83a1919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.724+0000 7f83a1919800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.725+0000 7f83a1919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:54.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.725+0000 7f83a1919800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.726+0000 7f83a1919800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:54.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.726+0000 7f83a1919800 20 searching for the correct realm 2024-09-12T00:31:54.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.728+0000 7f8396c02640 0 -- 172.21.15.133:0/3108467137 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f838807c020 msgr2=0x7f838807e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:54.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.731+0000 7f8396c02640 0 -- 172.21.15.133:0/3108467137 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f839003a920 msgr2=0x7f839001c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:54.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.938+0000 7f83a1919800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:54.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.938+0000 7f83a1919800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:54.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.938+0000 7f83a1919800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:54.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.938+0000 7f83a1919800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:54.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.938+0000 7f83a1919800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:54.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.938+0000 7f83a1919800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:54.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.938+0000 7f83a1919800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.938+0000 7f83a1919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.938+0000 7f83a1919800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.939+0000 7f83a1919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:54.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.939+0000 7f83a1919800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.939+0000 7f83a1919800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:54.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.939+0000 7f83a1919800 20 zone default found 2024-09-12T00:31:54.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.939+0000 7f83a1919800 4 Realm: () 2024-09-12T00:31:54.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.939+0000 7f83a1919800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:54.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.939+0000 7f83a1919800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:54.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.939+0000 7f83a1919800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:54.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.939+0000 7f83a1919800 20 zonegroup default 2024-09-12T00:31:54.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.939+0000 7f83a1919800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.939+0000 7f83a1919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.939+0000 7f83a1919800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.940+0000 7f83a1919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.940+0000 7f83a1919800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.940+0000 7f83a1919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.940+0000 7f83a1919800 20 started sync module instance, tier type = 2024-09-12T00:31:54.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.940+0000 7f83a1919800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:54.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.950+0000 7f83a1919800 20 add_watcher() i=0 2024-09-12T00:31:54.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.950+0000 7f83a1919800 20 add_watcher() i=1 2024-09-12T00:31:54.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.950+0000 7f83a1919800 20 add_watcher() i=2 2024-09-12T00:31:54.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.950+0000 7f83a1919800 20 add_watcher() i=3 2024-09-12T00:31:54.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.950+0000 7f83a1919800 20 add_watcher() i=4 2024-09-12T00:31:54.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.950+0000 7f83a1919800 20 add_watcher() i=5 2024-09-12T00:31:54.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.950+0000 7f83a1919800 20 add_watcher() i=6 2024-09-12T00:31:54.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.951+0000 7f83a1919800 20 add_watcher() i=7 2024-09-12T00:31:54.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.951+0000 7f83a1919800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:54.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.953+0000 7f8255fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:54.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.954+0000 7f83a1919800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:54.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.954+0000 7f83a1919800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:54.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.954+0000 7f83a1919800 5 note: GC not initialized 2024-09-12T00:31:54.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.954+0000 7f8254fe1640 20 reqs_thread_entry: start 2024-09-12T00:31:54.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.954+0000 7f83a1919800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:54.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.954+0000 7f83a1919800 20 Filter name: none 2024-09-12T00:31:54.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.954+0000 7f81ce7fc640 20 reqs_thread_entry: start 2024-09-12T00:31:54.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.954+0000 7f83a1919800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.955+0000 7f83a1919800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:31:54.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.955+0000 7f83a1919800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.955+0000 7f83a1919800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:31:54.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.955+0000 7f83a1919800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:54.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.955+0000 7f83a1919800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.956+0000 7f83a1919800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:31:54.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.956+0000 7f83a1919800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.956+0000 7f83a1919800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:31:54.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.956+0000 7f83a1919800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:54.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.957+0000 7f8255fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:54.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.960+0000 7f83a1919800 20 remove_watcher() i=0 2024-09-12T00:31:54.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.960+0000 7f83a1919800 2 removed watcher, disabling cache 2024-09-12T00:31:54.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.961+0000 7f83a1919800 20 remove_watcher() i=1 2024-09-12T00:31:54.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.962+0000 7f83a1919800 20 remove_watcher() i=2 2024-09-12T00:31:54.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.963+0000 7f83a1919800 20 remove_watcher() i=3 2024-09-12T00:31:54.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.964+0000 7f83a1919800 20 remove_watcher() i=4 2024-09-12T00:31:54.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.965+0000 7f83a1919800 20 remove_watcher() i=5 2024-09-12T00:31:54.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.966+0000 7f83a1919800 20 remove_watcher() i=6 2024-09-12T00:31:54.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:54.968+0000 7f83a1919800 20 remove_watcher() i=7 2024-09-12T00:31:54.977 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:54.977 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:31:54.977 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-init-indext id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:31:54.977 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:31:55.068 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:31:55.100 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:55.101 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:55.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.341+0000 7f45e4339800 20 rados->read ofs=0 len=0 2024-09-12T00:31:55.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.343+0000 7f45e4339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:55.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.343+0000 7f45e4339800 20 realm 2024-09-12T00:31:55.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.343+0000 7f45e4339800 20 rados->read ofs=0 len=0 2024-09-12T00:31:55.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.343+0000 7f45e4339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:55.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.343+0000 7f45e4339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:55.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.343+0000 7f45e4339800 20 rados->read ofs=0 len=0 2024-09-12T00:31:55.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.343+0000 7f45e4339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:55.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.343+0000 7f45e4339800 20 rados->read ofs=0 len=0 2024-09-12T00:31:55.343 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.344+0000 7f45e4339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:55.343 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.344+0000 7f45e4339800 20 rados->read ofs=0 len=0 2024-09-12T00:31:55.344 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.345+0000 7f45e4339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:55.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.345+0000 7f45e4339800 20 searching for the correct realm 2024-09-12T00:31:55.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.345+0000 7f45e07c8640 0 -- 172.21.15.133:0/1081406457 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x562c14539800 msgr2=0x562c1453bbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:55.346 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.348+0000 7f45e07c8640 0 -- 172.21.15.133:0/1081406457 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f45d8017040 msgr2=0x7f45d8081050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:55.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.355+0000 7f45e4339800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:31:55.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.355+0000 7f45e4339800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:31:55.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.355+0000 7f45e4339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:55.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.355+0000 7f45e4339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:55.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.355+0000 7f45e4339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:55.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.355+0000 7f45e4339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:55.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.355+0000 7f45e4339800 20 rados->read ofs=0 len=0 2024-09-12T00:31:55.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.355+0000 7f45e4339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:55.355 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.355+0000 7f45e4339800 20 rados->read ofs=0 len=0 2024-09-12T00:31:55.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.356+0000 7f45e4339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:55.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.356+0000 7f45e4339800 20 rados->read ofs=0 len=0 2024-09-12T00:31:55.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.356+0000 7f45e4339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:55.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.356+0000 7f45e4339800 20 zone default found 2024-09-12T00:31:55.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.356+0000 7f45e4339800 4 Realm: () 2024-09-12T00:31:55.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.356+0000 7f45e4339800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:31:55.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.356+0000 7f45e4339800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:31:55.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.356+0000 7f45e4339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:55.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.356+0000 7f45e4339800 20 zonegroup default 2024-09-12T00:31:55.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.356+0000 7f45e4339800 20 rados->read ofs=0 len=0 2024-09-12T00:31:55.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.356+0000 7f45e4339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:55.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.356+0000 7f45e4339800 20 rados->read ofs=0 len=0 2024-09-12T00:31:55.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.357+0000 7f45e4339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:55.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.357+0000 7f45e4339800 20 rados->read ofs=0 len=0 2024-09-12T00:31:55.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.357+0000 7f45e4339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:55.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.357+0000 7f45e4339800 20 started sync module instance, tier type = 2024-09-12T00:31:55.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.357+0000 7f45e4339800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:31:55.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.366+0000 7f45e4339800 20 add_watcher() i=0 2024-09-12T00:31:55.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.366+0000 7f45e4339800 20 add_watcher() i=1 2024-09-12T00:31:55.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.366+0000 7f45e4339800 20 add_watcher() i=2 2024-09-12T00:31:55.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.366+0000 7f45e4339800 20 add_watcher() i=3 2024-09-12T00:31:55.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.366+0000 7f45e4339800 20 add_watcher() i=4 2024-09-12T00:31:55.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.366+0000 7f45e4339800 20 add_watcher() i=5 2024-09-12T00:31:55.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.366+0000 7f45e4339800 20 add_watcher() i=6 2024-09-12T00:31:55.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.367+0000 7f45e4339800 20 add_watcher() i=7 2024-09-12T00:31:55.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.367+0000 7f45e4339800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:55.368 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.369+0000 7f4495fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:55.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.370+0000 7f45e4339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:55.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.370+0000 7f45e4339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:55.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.370+0000 7f45e4339800 5 note: GC not initialized 2024-09-12T00:31:55.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.370+0000 7f4494fe1640 20 reqs_thread_entry: start 2024-09-12T00:31:55.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.370+0000 7f45e4339800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:55.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.370+0000 7f45e4339800 20 Filter name: none 2024-09-12T00:31:55.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.370+0000 7f440e7fc640 20 reqs_thread_entry: start 2024-09-12T00:31:55.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.370+0000 7f45e4339800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:31:55.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.370+0000 7f45e4339800 20 rados->read ofs=0 len=0 2024-09-12T00:31:55.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.371+0000 7f45e4339800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:31:55.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.371+0000 7f45e4339800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:31:55.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.371+0000 7f45e4339800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:31:55.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.371+0000 7f45e4339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 : miss 2024-09-12T00:31:55.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.371+0000 7f45e4339800 20 rados->read ofs=0 len=0 2024-09-12T00:31:55.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.372+0000 7f45e4339800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:31:55.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.372+0000 7f45e4339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 info.flags=0x17 2024-09-12T00:31:55.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.372+0000 7f45e4339800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 to cache LRU end 2024-09-12T00:31:55.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.372+0000 7f45e4339800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:55.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.372+0000 7f45e4339800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:31:55.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.372+0000 7f45e4339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 2024-09-12T00:31:55.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.373+0000 7f45e4339800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 to be held by another RGW process; skipping for now 2024-09-12T00:31:55.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.374+0000 7f4495fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:55.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.376+0000 7f45e4339800 20 remove_watcher() i=0 2024-09-12T00:31:55.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.376+0000 7f45e4339800 2 removed watcher, disabling cache 2024-09-12T00:31:55.375 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.377+0000 7f45e4339800 20 remove_watcher() i=1 2024-09-12T00:31:55.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.378+0000 7f45e4339800 20 remove_watcher() i=2 2024-09-12T00:31:55.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.379+0000 7f45e4339800 20 remove_watcher() i=3 2024-09-12T00:31:55.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.381+0000 7f45e4339800 20 remove_watcher() i=4 2024-09-12T00:31:55.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.383+0000 7f45e4339800 20 remove_watcher() i=5 2024-09-12T00:31:55.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.384+0000 7f45e4339800 20 remove_watcher() i=6 2024-09-12T00:31:55.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:31:55.385+0000 7f45e4339800 20 remove_watcher() i=7 2024-09-12T00:31:55.393 INFO:tasks.workunit.client.0.smithi133.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:32:25.422 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:32:25.458 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:25.458 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:25.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.502+0000 7fd1c3887800 20 rados->read ofs=0 len=0 2024-09-12T00:32:25.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.504+0000 7fd1c3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:25.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.504+0000 7fd1c3887800 20 realm 2024-09-12T00:32:25.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.504+0000 7fd1c3887800 20 rados->read ofs=0 len=0 2024-09-12T00:32:25.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.504+0000 7fd1c3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:25.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.504+0000 7fd1c3887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:25.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.504+0000 7fd1c3887800 20 rados->read ofs=0 len=0 2024-09-12T00:32:25.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.504+0000 7fd1c3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:25.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.504+0000 7fd1c3887800 20 rados->read ofs=0 len=0 2024-09-12T00:32:25.504 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.505+0000 7fd1c3887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:25.504 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.505+0000 7fd1c3887800 20 rados->read ofs=0 len=0 2024-09-12T00:32:25.504 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.506+0000 7fd1c3887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:25.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.506+0000 7fd1c3887800 20 searching for the correct realm 2024-09-12T00:32:25.506 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.508+0000 7fd1c0b70640 0 -- 172.21.15.133:0/3569587916 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fd1b8017020 msgr2=0x7fd1b805f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:25.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.714+0000 7fd1c0b70640 0 -- 172.21.15.133:0/3569587916 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fd1b4073070 msgr2=0x7fd1b40a20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:25.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.921+0000 7fd1c3887800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:25.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.921+0000 7fd1c3887800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:25.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.921+0000 7fd1c3887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:25.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.921+0000 7fd1c3887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:25.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.921+0000 7fd1c3887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:25.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.921+0000 7fd1c3887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:25.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.921+0000 7fd1c3887800 20 rados->read ofs=0 len=0 2024-09-12T00:32:25.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.922+0000 7fd1c3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:25.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.922+0000 7fd1c3887800 20 rados->read ofs=0 len=0 2024-09-12T00:32:25.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.922+0000 7fd1c3887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:25.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.922+0000 7fd1c3887800 20 rados->read ofs=0 len=0 2024-09-12T00:32:25.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.922+0000 7fd1c3887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:25.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.922+0000 7fd1c3887800 20 zone default found 2024-09-12T00:32:25.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.922+0000 7fd1c3887800 4 Realm: () 2024-09-12T00:32:25.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.922+0000 7fd1c3887800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:25.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.922+0000 7fd1c3887800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:25.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.922+0000 7fd1c3887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:25.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.922+0000 7fd1c3887800 20 zonegroup default 2024-09-12T00:32:25.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.922+0000 7fd1c3887800 20 rados->read ofs=0 len=0 2024-09-12T00:32:25.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.923+0000 7fd1c3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:25.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.923+0000 7fd1c3887800 20 rados->read ofs=0 len=0 2024-09-12T00:32:25.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.923+0000 7fd1c3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:25.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.923+0000 7fd1c3887800 20 rados->read ofs=0 len=0 2024-09-12T00:32:25.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.923+0000 7fd1c3887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:25.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.923+0000 7fd1c3887800 20 started sync module instance, tier type = 2024-09-12T00:32:25.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.923+0000 7fd1c3887800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:25.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.934+0000 7fd1c3887800 20 add_watcher() i=0 2024-09-12T00:32:25.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.934+0000 7fd1c3887800 20 add_watcher() i=1 2024-09-12T00:32:25.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.934+0000 7fd1c3887800 20 add_watcher() i=2 2024-09-12T00:32:25.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.934+0000 7fd1c3887800 20 add_watcher() i=3 2024-09-12T00:32:25.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.934+0000 7fd1c3887800 20 add_watcher() i=4 2024-09-12T00:32:25.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.934+0000 7fd1c3887800 20 add_watcher() i=5 2024-09-12T00:32:25.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.934+0000 7fd1c3887800 20 add_watcher() i=6 2024-09-12T00:32:25.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.935+0000 7fd1c3887800 20 add_watcher() i=7 2024-09-12T00:32:25.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.935+0000 7fd1c3887800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:25.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.937+0000 7fd077fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:25.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.938+0000 7fd1c3887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:25.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.938+0000 7fd1c3887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:25.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.938+0000 7fd1c3887800 5 note: GC not initialized 2024-09-12T00:32:25.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.938+0000 7fd076fe5640 20 reqs_thread_entry: start 2024-09-12T00:32:25.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.938+0000 7fd1c3887800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:25.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.938+0000 7fd1c3887800 20 Filter name: none 2024-09-12T00:32:25.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.938+0000 7fd074fe1640 20 reqs_thread_entry: start 2024-09-12T00:32:25.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.939+0000 7fd1c3887800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:32:25.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.939+0000 7fd1c3887800 20 rados->read ofs=0 len=0 2024-09-12T00:32:25.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.939+0000 7fd1c3887800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:32:25.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.939+0000 7fd1c3887800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:32:25.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.939+0000 7fd1c3887800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:32:25.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.939+0000 7fd1c3887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 : miss 2024-09-12T00:32:25.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.939+0000 7fd1c3887800 20 rados->read ofs=0 len=0 2024-09-12T00:32:25.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.940+0000 7fd1c3887800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:32:25.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.940+0000 7fd1c3887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 info.flags=0x17 2024-09-12T00:32:25.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.940+0000 7fd1c3887800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 to cache LRU end 2024-09-12T00:32:25.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.940+0000 7fd1c3887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:25.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.940+0000 7fd1c3887800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:25.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.940+0000 7fd1c3887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 2024-09-12T00:32:25.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.944+0000 7fd1c3887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 info.flags=0x17 2024-09-12T00:32:25.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.944+0000 7fd1c3887800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 to cache LRU end 2024-09-12T00:32:25.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.944+0000 7fd1c3887800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:25.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.944+0000 7fd1c3887800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22, ofs0, ns] 2024-09-12T00:32:25.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.945+0000 7fd0a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94312249338384 notifier 6176 bl.length()=997 2024-09-12T00:32:25.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.945+0000 7fd0a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 info.flags=0x17 2024-09-12T00:32:25.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.945+0000 7fd0a4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 to cache LRU end 2024-09-12T00:32:25.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.945+0000 7fd0a4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:25.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.947+0000 7fd1c3887800 20 handle_bi_update(): bucket=:abort-at-init-indext[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22]): orig_sources= new_sources= 2024-09-12T00:32:25.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.947+0000 7fd1c3887800 20 handle_bi_update(): bucket=:abort-at-init-indext[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22]): potential sources added=[] removed=[] 2024-09-12T00:32:25.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.947+0000 7fd1c3887800 20 handle_bi_update(): bucket=:abort-at-init-indext[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22]): orig_dests= new_dests= 2024-09-12T00:32:25.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.947+0000 7fd1c3887800 20 handle_bi_update(): bucket=:abort-at-init-indext[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22]): potential dests added=[] removed=[] 2024-09-12T00:32:25.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.949+0000 7fd1c3887800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22.1.0 2024-09-12T00:32:25.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.949+0000 7fd1c3887800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22.1.0 2024-09-12T00:32:25.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.949+0000 7fd1c3887800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22.1.1 2024-09-12T00:32:25.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.949+0000 7fd1c3887800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22.1.1 2024-09-12T00:32:25.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.949+0000 7fd1c3887800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22.0 2024-09-12T00:32:25.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.952+0000 7fd1c3887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:25.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.952+0000 7fd1c3887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 2024-09-12T00:32:25.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.954+0000 7fd1c3887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 info.flags=0x17 2024-09-12T00:32:25.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.954+0000 7fd1c3887800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 to cache LRU end 2024-09-12T00:32:25.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.954+0000 7fd1c3887800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:25.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.954+0000 7fd1c3887800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22, ofs0, ns] 2024-09-12T00:32:25.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.954+0000 7fd0a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497021 cookie 94312249338384 notifier 6176 bl.length()=997 2024-09-12T00:32:25.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.954+0000 7fd0a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 info.flags=0x17 2024-09-12T00:32:25.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.954+0000 7fd0a4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 to cache LRU end 2024-09-12T00:32:25.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.954+0000 7fd0a4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:25.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.956+0000 7fd1c3887800 20 handle_bi_update(): bucket=:abort-at-init-indext[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22]): orig_sources= new_sources= 2024-09-12T00:32:25.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.956+0000 7fd1c3887800 20 handle_bi_update(): bucket=:abort-at-init-indext[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22]): potential sources added=[] removed=[] 2024-09-12T00:32:25.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.956+0000 7fd1c3887800 20 handle_bi_update(): bucket=:abort-at-init-indext[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22]): orig_dests= new_dests= 2024-09-12T00:32:25.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.956+0000 7fd1c3887800 20 handle_bi_update(): bucket=:abort-at-init-indext[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22]): potential dests added=[] removed=[] 2024-09-12T00:32:25.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.958+0000 7fd1c3887800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22.0 2024-09-12T00:32:25.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.958+0000 7fd1c3887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:25.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.958+0000 7fd1c3887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 2024-09-12T00:32:25.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.960+0000 7fd1c3887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 info.flags=0x17 2024-09-12T00:32:25.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.960+0000 7fd1c3887800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 to cache LRU end 2024-09-12T00:32:25.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.960+0000 7fd1c3887800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:25.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.960+0000 7fd1c3887800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22, ofs0, ns] 2024-09-12T00:32:25.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.960+0000 7fd093fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497022 cookie 94312249338384 notifier 6176 bl.length()=965 2024-09-12T00:32:25.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.960+0000 7fd093fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 info.flags=0x17 2024-09-12T00:32:25.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.960+0000 7fd093fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 to cache LRU end 2024-09-12T00:32:25.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.960+0000 7fd093fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:25.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.962+0000 7fd1c3887800 20 handle_bi_update(): bucket=:abort-at-init-indext[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22]): orig_sources= new_sources= 2024-09-12T00:32:25.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.962+0000 7fd1c3887800 20 handle_bi_update(): bucket=:abort-at-init-indext[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22]): potential sources added=[] removed=[] 2024-09-12T00:32:25.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.962+0000 7fd1c3887800 20 handle_bi_update(): bucket=:abort-at-init-indext[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22]): orig_dests= new_dests= 2024-09-12T00:32:25.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.962+0000 7fd1c3887800 20 handle_bi_update(): bucket=:abort-at-init-indext[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22]): potential dests added=[] removed=[] 2024-09-12T00:32:25.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.963+0000 7fd1c3887800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 1 shards to 2 shards completed successfully 2024-09-12T00:32:25.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.965+0000 7fd077fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:25.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.968+0000 7fd1c3887800 20 remove_watcher() i=0 2024-09-12T00:32:25.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.968+0000 7fd1c3887800 2 removed watcher, disabling cache 2024-09-12T00:32:25.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.969+0000 7fd1c3887800 20 remove_watcher() i=1 2024-09-12T00:32:25.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.970+0000 7fd1c3887800 20 remove_watcher() i=2 2024-09-12T00:32:25.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.971+0000 7fd1c3887800 20 remove_watcher() i=3 2024-09-12T00:32:25.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.972+0000 7fd1c3887800 20 remove_watcher() i=4 2024-09-12T00:32:25.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.973+0000 7fd1c3887800 20 remove_watcher() i=5 2024-09-12T00:32:25.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.975+0000 7fd1c3887800 20 remove_watcher() i=6 2024-09-12T00:32:25.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:25.976+0000 7fd1c3887800 20 remove_watcher() i=7 2024-09-12T00:32:25.988 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:32:26.018 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:26.018 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:26.057 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.058+0000 7effc3214800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.060+0000 7effc3214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:26.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.060+0000 7effc3214800 20 realm 2024-09-12T00:32:26.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.060+0000 7effc3214800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.060+0000 7effc3214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:26.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.060+0000 7effc3214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:26.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.060+0000 7effc3214800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.060 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.061+0000 7effc3214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:26.060 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.061+0000 7effc3214800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.060 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.061+0000 7effc3214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:26.060 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.061+0000 7effc3214800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.061 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.062+0000 7effc3214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:26.061 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.062+0000 7effc3214800 20 searching for the correct realm 2024-09-12T00:32:26.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.065+0000 7effbf1e1640 0 -- 172.21.15.133:0/4286645761 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7effb0090c00 msgr2=0x7effb0079910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:26.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.271+0000 7effbf1e1640 0 -- 172.21.15.133:0/4286645761 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x55907c9f44c0 msgr2=0x55907c9f6960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:26.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.275+0000 7effc3214800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:26.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.275+0000 7effc3214800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:26.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.275+0000 7effc3214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:26.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.275+0000 7effc3214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:26.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.275+0000 7effc3214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:26.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.275+0000 7effc3214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:26.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.275+0000 7effc3214800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.276+0000 7effc3214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:26.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.276+0000 7effc3214800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.276+0000 7effc3214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:26.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.276+0000 7effc3214800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.276+0000 7effc3214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:26.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.276+0000 7effc3214800 20 zone default found 2024-09-12T00:32:26.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.276+0000 7effc3214800 4 Realm: () 2024-09-12T00:32:26.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.276+0000 7effc3214800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:26.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.276+0000 7effc3214800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:26.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.276+0000 7effc3214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:26.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.276+0000 7effc3214800 20 zonegroup default 2024-09-12T00:32:26.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.276+0000 7effc3214800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.276+0000 7effc3214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:26.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.276+0000 7effc3214800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.277+0000 7effc3214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:26.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.277+0000 7effc3214800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.277+0000 7effc3214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:26.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.277+0000 7effc3214800 20 started sync module instance, tier type = 2024-09-12T00:32:26.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.277+0000 7effc3214800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:26.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.287+0000 7effc3214800 20 add_watcher() i=0 2024-09-12T00:32:26.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.287+0000 7effc3214800 20 add_watcher() i=1 2024-09-12T00:32:26.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.287+0000 7effc3214800 20 add_watcher() i=2 2024-09-12T00:32:26.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.287+0000 7effc3214800 20 add_watcher() i=3 2024-09-12T00:32:26.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.287+0000 7effc3214800 20 add_watcher() i=4 2024-09-12T00:32:26.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.287+0000 7effc3214800 20 add_watcher() i=5 2024-09-12T00:32:26.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.287+0000 7effc3214800 20 add_watcher() i=6 2024-09-12T00:32:26.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.288+0000 7effc3214800 20 add_watcher() i=7 2024-09-12T00:32:26.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.288+0000 7effc3214800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:26.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.289+0000 7efe757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:26.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.290+0000 7effc3214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:26.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.290+0000 7effc3214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:26.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.290+0000 7effc3214800 5 note: GC not initialized 2024-09-12T00:32:26.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.290+0000 7efdeffff640 20 reqs_thread_entry: start 2024-09-12T00:32:26.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.290+0000 7effc3214800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:26.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.290+0000 7effc3214800 20 Filter name: none 2024-09-12T00:32:26.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.290+0000 7efdedffb640 20 reqs_thread_entry: start 2024-09-12T00:32:26.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.290+0000 7effc3214800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.291+0000 7effc3214800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:32:26.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.291+0000 7effc3214800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.291+0000 7effc3214800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:32:26.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.291+0000 7effc3214800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:26.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.291+0000 7effc3214800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.292+0000 7effc3214800 20 rados_obj.operate() r=0 bl.length=212 2024-09-12T00:32:26.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.292+0000 7effc3214800 20 rados->read ofs=0 len=0 2024-09-12T00:32:26.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.292+0000 7effc3214800 20 rados_obj.operate() r=0 bl.length=434 2024-09-12T00:32:26.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.292+0000 7effc3214800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:26.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.293+0000 7efe757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:26.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.296+0000 7effc3214800 20 remove_watcher() i=0 2024-09-12T00:32:26.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.296+0000 7effc3214800 2 removed watcher, disabling cache 2024-09-12T00:32:26.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.297+0000 7effc3214800 20 remove_watcher() i=1 2024-09-12T00:32:26.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.298+0000 7effc3214800 20 remove_watcher() i=2 2024-09-12T00:32:26.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.299+0000 7effc3214800 20 remove_watcher() i=3 2024-09-12T00:32:26.298 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.300+0000 7effc3214800 20 remove_watcher() i=4 2024-09-12T00:32:26.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.301+0000 7effc3214800 20 remove_watcher() i=5 2024-09-12T00:32:26.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.302+0000 7effc3214800 20 remove_watcher() i=6 2024-09-12T00:32:26.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:26.303+0000 7effc3214800 20 remove_watcher() i=7 2024-09-12T00:32:26.314 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:26.314 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:32:26.314 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-init-indext id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:32:26.314 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:26.623 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T00:32:26.623 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:27.426 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:32:27.454 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:27.455 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:27.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.493+0000 7facb1519800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.494+0000 7facb1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.494+0000 7facb1519800 20 realm 2024-09-12T00:32:27.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.494+0000 7facb1519800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.494+0000 7facb1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.494+0000 7facb1519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:27.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.494+0000 7facb1519800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.495+0000 7facb1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.495+0000 7facb1519800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.495+0000 7facb1519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:27.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.495+0000 7facb1519800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.495 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.496+0000 7facb1519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:27.495 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.496+0000 7facb1519800 20 searching for the correct realm 2024-09-12T00:32:27.497 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.498+0000 7facaf804640 0 -- 172.21.15.133:0/2358583012 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7faca8088b30 msgr2=0x7faca806f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:27.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.703+0000 7facaf003640 0 -- 172.21.15.133:0/2358583012 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x562ff2e11290 msgr2=0x562ff2e13700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:27.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.707+0000 7facb1519800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.707+0000 7facb1519800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.707+0000 7facb1519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.707+0000 7facb1519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.707+0000 7facb1519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.707+0000 7facb1519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.707+0000 7facb1519800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.707+0000 7facb1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.707+0000 7facb1519800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.707+0000 7facb1519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:27.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.707+0000 7facb1519800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.708+0000 7facb1519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:27.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.708+0000 7facb1519800 20 zone default found 2024-09-12T00:32:27.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.708+0000 7facb1519800 4 Realm: () 2024-09-12T00:32:27.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.708+0000 7facb1519800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:27.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.708+0000 7facb1519800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:27.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.708+0000 7facb1519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:27.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.708+0000 7facb1519800 20 zonegroup default 2024-09-12T00:32:27.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.708+0000 7facb1519800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.708+0000 7facb1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.708+0000 7facb1519800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.708+0000 7facb1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.708+0000 7facb1519800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.708+0000 7facb1519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.708+0000 7facb1519800 20 started sync module instance, tier type = 2024-09-12T00:32:27.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.708+0000 7facb1519800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:27.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.717+0000 7facb1519800 20 add_watcher() i=0 2024-09-12T00:32:27.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.717+0000 7facb1519800 20 add_watcher() i=1 2024-09-12T00:32:27.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.717+0000 7facb1519800 20 add_watcher() i=2 2024-09-12T00:32:27.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.717+0000 7facb1519800 20 add_watcher() i=3 2024-09-12T00:32:27.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.717+0000 7facb1519800 20 add_watcher() i=4 2024-09-12T00:32:27.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.717+0000 7facb1519800 20 add_watcher() i=5 2024-09-12T00:32:27.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.717+0000 7facb1519800 20 add_watcher() i=6 2024-09-12T00:32:27.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.718+0000 7facb1519800 20 add_watcher() i=7 2024-09-12T00:32:27.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.718+0000 7facb1519800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:27.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.720+0000 7fab657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:27.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.720+0000 7facb1519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:27.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.720+0000 7facb1519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:27.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.720+0000 7facb1519800 5 note: GC not initialized 2024-09-12T00:32:27.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.720+0000 7faadffff640 20 reqs_thread_entry: start 2024-09-12T00:32:27.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.720+0000 7facb1519800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:27.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.720+0000 7facb1519800 20 Filter name: none 2024-09-12T00:32:27.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.720+0000 7faaddffb640 20 reqs_thread_entry: start 2024-09-12T00:32:27.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.720+0000 7facb1519800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.721+0000 7facb1519800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:27.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.721+0000 7facb1519800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.721+0000 7facb1519800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:27.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.721+0000 7facb1519800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:27.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.721+0000 7facb1519800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.722+0000 7facb1519800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:27.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.722+0000 7facb1519800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.722+0000 7facb1519800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:27.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.722+0000 7facb1519800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:27.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.723+0000 7fab657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:27.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.725+0000 7facb1519800 20 remove_watcher() i=0 2024-09-12T00:32:27.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.725+0000 7facb1519800 2 removed watcher, disabling cache 2024-09-12T00:32:27.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.726+0000 7facb1519800 20 remove_watcher() i=1 2024-09-12T00:32:27.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.727+0000 7facb1519800 20 remove_watcher() i=2 2024-09-12T00:32:27.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.728+0000 7facb1519800 20 remove_watcher() i=3 2024-09-12T00:32:27.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.729+0000 7facb1519800 20 remove_watcher() i=4 2024-09-12T00:32:27.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.730+0000 7facb1519800 20 remove_watcher() i=5 2024-09-12T00:32:27.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.731+0000 7facb1519800 20 remove_watcher() i=6 2024-09-12T00:32:27.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.732+0000 7facb1519800 20 remove_watcher() i=7 2024-09-12T00:32:27.741 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:27.741 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:32:27.741 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-set-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:32:27.741 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:27.742 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T00:32:27.776 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:27.777 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:27.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.815+0000 7f828f525800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.817+0000 7f828f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.817+0000 7f828f525800 20 realm 2024-09-12T00:32:27.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.817+0000 7f828f525800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.817+0000 7f828f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.817+0000 7f828f525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:27.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.817+0000 7f828f525800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.817+0000 7f828f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:27.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.817+0000 7f828f525800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.818+0000 7f828f525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:27.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.818+0000 7f828f525800 20 rados->read ofs=0 len=0 2024-09-12T00:32:27.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.818+0000 7f828f525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:27.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.818+0000 7f828f525800 20 searching for the correct realm 2024-09-12T00:32:27.819 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.821+0000 7f828a932640 0 -- 172.21.15.133:0/3942057270 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f828001c040 msgr2=0x7f8280044940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:27.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:27.824+0000 7f828a932640 0 -- 172.21.15.133:0/3942057270 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f827c0adab0 msgr2=0x7f827c0a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:28.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.031+0000 7f828f525800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:28.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.031+0000 7f828f525800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:28.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.031+0000 7f828f525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:28.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.031+0000 7f828f525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:28.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.031+0000 7f828f525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:28.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.031+0000 7f828f525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:28.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.031+0000 7f828f525800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.031+0000 7f828f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.031+0000 7f828f525800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.031+0000 7f828f525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:28.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.031+0000 7f828f525800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.032+0000 7f828f525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:28.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.032+0000 7f828f525800 20 zone default found 2024-09-12T00:32:28.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.032+0000 7f828f525800 4 Realm: () 2024-09-12T00:32:28.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.032+0000 7f828f525800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:28.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.032+0000 7f828f525800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:28.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.032+0000 7f828f525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:28.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.032+0000 7f828f525800 20 zonegroup default 2024-09-12T00:32:28.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.032+0000 7f828f525800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.032+0000 7f828f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.032+0000 7f828f525800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.032+0000 7f828f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.032+0000 7f828f525800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.033+0000 7f828f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.033+0000 7f828f525800 20 started sync module instance, tier type = 2024-09-12T00:32:28.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.033+0000 7f828f525800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:28.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.041+0000 7f828f525800 20 add_watcher() i=0 2024-09-12T00:32:28.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.041+0000 7f828f525800 20 add_watcher() i=1 2024-09-12T00:32:28.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.041+0000 7f828f525800 20 add_watcher() i=2 2024-09-12T00:32:28.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.041+0000 7f828f525800 20 add_watcher() i=3 2024-09-12T00:32:28.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.041+0000 7f828f525800 20 add_watcher() i=4 2024-09-12T00:32:28.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.041+0000 7f828f525800 20 add_watcher() i=5 2024-09-12T00:32:28.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.041+0000 7f828f525800 20 add_watcher() i=6 2024-09-12T00:32:28.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.042+0000 7f828f525800 20 add_watcher() i=7 2024-09-12T00:32:28.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.042+0000 7f828f525800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:28.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.043+0000 7f8141fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:28.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.044+0000 7f828f525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:28.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.044+0000 7f828f525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:28.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.044+0000 7f828f525800 5 note: GC not initialized 2024-09-12T00:32:28.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.044+0000 7f8140fe1640 20 reqs_thread_entry: start 2024-09-12T00:32:28.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.044+0000 7f828f525800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:28.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.044+0000 7f828f525800 20 Filter name: none 2024-09-12T00:32:28.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.044+0000 7f80ba7fc640 20 reqs_thread_entry: start 2024-09-12T00:32:28.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.044+0000 7f828f525800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:32:28.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.044+0000 7f828f525800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.045+0000 7f828f525800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:28.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.045+0000 7f828f525800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:32:28.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.045+0000 7f828f525800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:32:28.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.045+0000 7f828f525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 : miss 2024-09-12T00:32:28.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.045+0000 7f828f525800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.046+0000 7f828f525800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:28.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.046+0000 7f828f525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 info.flags=0x17 2024-09-12T00:32:28.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.046+0000 7f828f525800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 to cache LRU end 2024-09-12T00:32:28.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.046+0000 7f828f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:28.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.046+0000 7f828f525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:28.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.046+0000 7f828f525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 2024-09-12T00:32:28.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.048+0000 7f828f525800 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T00:32:28.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.048+0000 7f828f525800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T00:32:28.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.051+0000 7f8141fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:28.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.053+0000 7f828f525800 20 remove_watcher() i=0 2024-09-12T00:32:28.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.053+0000 7f828f525800 2 removed watcher, disabling cache 2024-09-12T00:32:28.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.054+0000 7f828f525800 20 remove_watcher() i=1 2024-09-12T00:32:28.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.055+0000 7f828f525800 20 remove_watcher() i=2 2024-09-12T00:32:28.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.056+0000 7f828f525800 20 remove_watcher() i=3 2024-09-12T00:32:28.055 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.057+0000 7f828f525800 20 remove_watcher() i=4 2024-09-12T00:32:28.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.057+0000 7f828f525800 20 remove_watcher() i=5 2024-09-12T00:32:28.057 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.058+0000 7f828f525800 20 remove_watcher() i=6 2024-09-12T00:32:28.058 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.059+0000 7f828f525800 20 remove_watcher() i=7 2024-09-12T00:32:28.071 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:32:28.100 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:28.100 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:28.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.138+0000 7f536a687800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.139+0000 7f536a687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.139+0000 7f536a687800 20 realm 2024-09-12T00:32:28.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.139+0000 7f536a687800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.139+0000 7f536a687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.139+0000 7f536a687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:28.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.139+0000 7f536a687800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.140+0000 7f536a687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.140+0000 7f536a687800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.140+0000 7f536a687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:28.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.140+0000 7f536a687800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.141+0000 7f536a687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:28.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.141+0000 7f536a687800 20 searching for the correct realm 2024-09-12T00:32:28.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.143+0000 7f5367977640 0 -- 172.21.15.133:0/2376431447 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f53500093c0 msgr2=0x7f53500873d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:28.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.348+0000 7f5367977640 0 -- 172.21.15.133:0/2376431447 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f5360038040 msgr2=0x7f5360038420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:28.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.554+0000 7f536a687800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:28.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.554+0000 7f536a687800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:28.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.554+0000 7f536a687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:28.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.554+0000 7f536a687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:28.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.554+0000 7f536a687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:28.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.554+0000 7f536a687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:28.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.554+0000 7f536a687800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.554+0000 7f536a687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.554+0000 7f536a687800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.555+0000 7f536a687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:28.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.555+0000 7f536a687800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.555 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.555+0000 7f536a687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:28.555 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.555+0000 7f536a687800 20 zone default found 2024-09-12T00:32:28.555 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.555+0000 7f536a687800 4 Realm: () 2024-09-12T00:32:28.555 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.555+0000 7f536a687800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:28.555 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.555+0000 7f536a687800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:28.555 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.555+0000 7f536a687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:28.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.555+0000 7f536a687800 20 zonegroup default 2024-09-12T00:32:28.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.555+0000 7f536a687800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.555+0000 7f536a687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.555+0000 7f536a687800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.556+0000 7f536a687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.556+0000 7f536a687800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.556+0000 7f536a687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.556+0000 7f536a687800 20 started sync module instance, tier type = 2024-09-12T00:32:28.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.556+0000 7f536a687800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:28.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.565+0000 7f536a687800 20 add_watcher() i=0 2024-09-12T00:32:28.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.565+0000 7f536a687800 20 add_watcher() i=1 2024-09-12T00:32:28.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.565+0000 7f536a687800 20 add_watcher() i=2 2024-09-12T00:32:28.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.565+0000 7f536a687800 20 add_watcher() i=3 2024-09-12T00:32:28.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.565+0000 7f536a687800 20 add_watcher() i=4 2024-09-12T00:32:28.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.565+0000 7f536a687800 20 add_watcher() i=5 2024-09-12T00:32:28.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.565+0000 7f536a687800 20 add_watcher() i=6 2024-09-12T00:32:28.565 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.566+0000 7f536a687800 20 add_watcher() i=7 2024-09-12T00:32:28.565 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.566+0000 7f536a687800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:28.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.568+0000 7f521e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:28.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.569+0000 7f536a687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:28.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.569+0000 7f536a687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:28.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.569+0000 7f536a687800 5 note: GC not initialized 2024-09-12T00:32:28.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.569+0000 7f521d7e2640 20 reqs_thread_entry: start 2024-09-12T00:32:28.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.569+0000 7f536a687800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:28.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.569+0000 7f536a687800 20 Filter name: none 2024-09-12T00:32:28.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.569+0000 7f518effd640 20 reqs_thread_entry: start 2024-09-12T00:32:28.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.569+0000 7f536a687800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.570+0000 7f536a687800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:28.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.570+0000 7f536a687800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.570+0000 7f536a687800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:28.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.570+0000 7f536a687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:28.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.570+0000 7f536a687800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.571+0000 7f536a687800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:28.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.571+0000 7f536a687800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.571+0000 7f536a687800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:28.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.571+0000 7f536a687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:28.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.573+0000 7f521e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:28.573 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.575+0000 7f536a687800 20 remove_watcher() i=0 2024-09-12T00:32:28.573 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.575+0000 7f536a687800 2 removed watcher, disabling cache 2024-09-12T00:32:28.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.576+0000 7f536a687800 20 remove_watcher() i=1 2024-09-12T00:32:28.575 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.577+0000 7f536a687800 20 remove_watcher() i=2 2024-09-12T00:32:28.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.578+0000 7f536a687800 20 remove_watcher() i=3 2024-09-12T00:32:28.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.579+0000 7f536a687800 20 remove_watcher() i=4 2024-09-12T00:32:28.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.580+0000 7f536a687800 20 remove_watcher() i=5 2024-09-12T00:32:28.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.581+0000 7f536a687800 20 remove_watcher() i=6 2024-09-12T00:32:28.580 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.581+0000 7f536a687800 20 remove_watcher() i=7 2024-09-12T00:32:28.591 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:28.591 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:32:28.591 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-set-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:32:28.591 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:28.685 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:32:28.717 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:28.717 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:28.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.755+0000 7f1f3440e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.757+0000 7f1f3440e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.757+0000 7f1f3440e800 20 realm 2024-09-12T00:32:28.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.757+0000 7f1f3440e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.757+0000 7f1f3440e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.757+0000 7f1f3440e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:28.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.757+0000 7f1f3440e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.757+0000 7f1f3440e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.757+0000 7f1f3440e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.758+0000 7f1f3440e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:28.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.758+0000 7f1f3440e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.759+0000 7f1f3440e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:28.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.759+0000 7f1f3440e800 20 searching for the correct realm 2024-09-12T00:32:28.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.761+0000 7f1f27258640 0 -- 172.21.15.133:0/2249439857 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f1f1804a060 msgr2=0x7f1f18040660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:28.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.764+0000 7f1f27258640 0 -- 172.21.15.133:0/2249439857 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f1f2007f040 msgr2=0x7f1f20071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:28.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.971+0000 7f1f3440e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:28.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.971+0000 7f1f3440e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:28.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.971+0000 7f1f3440e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:28.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.971+0000 7f1f3440e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:28.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.971+0000 7f1f3440e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:28.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.971+0000 7f1f3440e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:28.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.971+0000 7f1f3440e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.971+0000 7f1f3440e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.971+0000 7f1f3440e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.971+0000 7f1f3440e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:28.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.971+0000 7f1f3440e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.972+0000 7f1f3440e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:28.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.972+0000 7f1f3440e800 20 zone default found 2024-09-12T00:32:28.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.972+0000 7f1f3440e800 4 Realm: () 2024-09-12T00:32:28.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.972+0000 7f1f3440e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:28.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.972+0000 7f1f3440e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:28.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.972+0000 7f1f3440e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:28.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.972+0000 7f1f3440e800 20 zonegroup default 2024-09-12T00:32:28.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.972+0000 7f1f3440e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.972+0000 7f1f3440e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.972+0000 7f1f3440e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.972+0000 7f1f3440e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.972+0000 7f1f3440e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.973+0000 7f1f3440e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:28.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.973+0000 7f1f3440e800 20 started sync module instance, tier type = 2024-09-12T00:32:28.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.973+0000 7f1f3440e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:28.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.982+0000 7f1f3440e800 20 add_watcher() i=0 2024-09-12T00:32:28.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.982+0000 7f1f3440e800 20 add_watcher() i=1 2024-09-12T00:32:28.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.982+0000 7f1f3440e800 20 add_watcher() i=2 2024-09-12T00:32:28.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.982+0000 7f1f3440e800 20 add_watcher() i=3 2024-09-12T00:32:28.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.982+0000 7f1f3440e800 20 add_watcher() i=4 2024-09-12T00:32:28.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.982+0000 7f1f3440e800 20 add_watcher() i=5 2024-09-12T00:32:28.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.982+0000 7f1f3440e800 20 add_watcher() i=6 2024-09-12T00:32:28.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.983+0000 7f1f3440e800 20 add_watcher() i=7 2024-09-12T00:32:28.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.983+0000 7f1f3440e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:28.984 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.985+0000 7f1de5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:28.984 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.985+0000 7f1f3440e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:28.984 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.985+0000 7f1f3440e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:28.984 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.985+0000 7f1f3440e800 5 note: GC not initialized 2024-09-12T00:32:28.984 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.985+0000 7f1de4fe1640 20 reqs_thread_entry: start 2024-09-12T00:32:28.984 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.985+0000 7f1f3440e800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:28.984 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.985+0000 7f1f3440e800 20 Filter name: none 2024-09-12T00:32:28.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.985+0000 7f1d5e7fc640 20 reqs_thread_entry: start 2024-09-12T00:32:28.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.985+0000 7f1f3440e800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:32:28.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.985+0000 7f1f3440e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.986+0000 7f1f3440e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:28.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.986+0000 7f1f3440e800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:32:28.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.986+0000 7f1f3440e800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:32:28.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.986+0000 7f1f3440e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 : miss 2024-09-12T00:32:28.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.986+0000 7f1f3440e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:28.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.986+0000 7f1f3440e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:28.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.986+0000 7f1f3440e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 info.flags=0x17 2024-09-12T00:32:28.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.986+0000 7f1f3440e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 to cache LRU end 2024-09-12T00:32:28.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.986+0000 7f1f3440e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:28.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.986+0000 7f1f3440e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:28.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.986+0000 7f1f3440e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 2024-09-12T00:32:28.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.990+0000 7f1f3440e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 info.flags=0x17 2024-09-12T00:32:28.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.990+0000 7f1f3440e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 to cache LRU end 2024-09-12T00:32:28.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.990+0000 7f1f3440e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:28.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.990+0000 7f1f3440e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23, ofs0, ns] 2024-09-12T00:32:28.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.990+0000 7f1e0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497025 cookie 94413854471328 notifier 6612 bl.length()=1009 2024-09-12T00:32:28.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.990+0000 7f1e0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 info.flags=0x17 2024-09-12T00:32:28.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.990+0000 7f1e0effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 to cache LRU end 2024-09-12T00:32:28.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.990+0000 7f1e0effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:28.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.992+0000 7f1f3440e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23]): orig_sources= new_sources= 2024-09-12T00:32:28.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.992+0000 7f1f3440e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23]): potential sources added=[] removed=[] 2024-09-12T00:32:28.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.992+0000 7f1f3440e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23]): orig_dests= new_dests= 2024-09-12T00:32:28.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.992+0000 7f1f3440e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23]): potential dests added=[] removed=[] 2024-09-12T00:32:28.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.995+0000 7f1f3440e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23.1.0 2024-09-12T00:32:28.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.995+0000 7f1f3440e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23.1.0 2024-09-12T00:32:28.994 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.995+0000 7f1f3440e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23.1.1 2024-09-12T00:32:28.994 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.995+0000 7f1f3440e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23.1.1 2024-09-12T00:32:28.994 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.995+0000 7f1f3440e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23.0 2024-09-12T00:32:28.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.997+0000 7f1f3440e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:28.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.997+0000 7f1f3440e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 2024-09-12T00:32:28.997 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.999+0000 7f1f3440e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 info.flags=0x17 2024-09-12T00:32:28.997 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.999+0000 7f1f3440e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 to cache LRU end 2024-09-12T00:32:28.997 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.999+0000 7f1f3440e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:28.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.999+0000 7f1f3440e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23, ofs0, ns] 2024-09-12T00:32:28.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.999+0000 7f1e0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497026 cookie 94413854471328 notifier 6612 bl.length()=1009 2024-09-12T00:32:28.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.999+0000 7f1e0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 info.flags=0x17 2024-09-12T00:32:28.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.999+0000 7f1e0effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 to cache LRU end 2024-09-12T00:32:28.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:28.999+0000 7f1e0effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:28.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.000+0000 7f1f3440e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23]): orig_sources= new_sources= 2024-09-12T00:32:28.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.000+0000 7f1f3440e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23]): potential sources added=[] removed=[] 2024-09-12T00:32:28.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.000+0000 7f1f3440e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23]): orig_dests= new_dests= 2024-09-12T00:32:28.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.000+0000 7f1f3440e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23]): potential dests added=[] removed=[] 2024-09-12T00:32:29.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.002+0000 7f1f3440e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23.0 2024-09-12T00:32:29.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.002+0000 7f1f3440e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:29.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.002+0000 7f1f3440e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 2024-09-12T00:32:29.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.004+0000 7f1f3440e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 info.flags=0x17 2024-09-12T00:32:29.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.004+0000 7f1f3440e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 to cache LRU end 2024-09-12T00:32:29.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.004+0000 7f1f3440e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:29.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.004+0000 7f1f3440e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23, ofs0, ns] 2024-09-12T00:32:29.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.004+0000 7f1e0e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497027 cookie 94413854471328 notifier 6612 bl.length()=977 2024-09-12T00:32:29.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.004+0000 7f1e0e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 info.flags=0x17 2024-09-12T00:32:29.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.004+0000 7f1e0e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 to cache LRU end 2024-09-12T00:32:29.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.004+0000 7f1e0e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:29.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.005+0000 7f1f3440e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23]): orig_sources= new_sources= 2024-09-12T00:32:29.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.005+0000 7f1f3440e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23]): potential sources added=[] removed=[] 2024-09-12T00:32:29.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.005+0000 7f1f3440e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23]): orig_dests= new_dests= 2024-09-12T00:32:29.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.005+0000 7f1f3440e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23]): potential dests added=[] removed=[] 2024-09-12T00:32:29.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.006+0000 7f1f3440e800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:32:29.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.008+0000 7f1de5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:29.009 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.010+0000 7f1f3440e800 20 remove_watcher() i=0 2024-09-12T00:32:29.009 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.010+0000 7f1f3440e800 2 removed watcher, disabling cache 2024-09-12T00:32:29.010 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.012+0000 7f1f3440e800 20 remove_watcher() i=1 2024-09-12T00:32:29.011 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.013+0000 7f1f3440e800 20 remove_watcher() i=2 2024-09-12T00:32:29.012 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.014+0000 7f1f3440e800 20 remove_watcher() i=3 2024-09-12T00:32:29.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.015+0000 7f1f3440e800 20 remove_watcher() i=4 2024-09-12T00:32:29.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.016+0000 7f1f3440e800 20 remove_watcher() i=5 2024-09-12T00:32:29.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.017+0000 7f1f3440e800 20 remove_watcher() i=6 2024-09-12T00:32:29.017 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.018+0000 7f1f3440e800 20 remove_watcher() i=7 2024-09-12T00:32:29.029 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:32:29.058 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:29.058 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:29.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.096+0000 7f5b7072c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.098+0000 7f5b7072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:29.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.098+0000 7f5b7072c800 20 realm 2024-09-12T00:32:29.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.098+0000 7f5b7072c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.098+0000 7f5b7072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:29.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.098+0000 7f5b7072c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:29.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.098+0000 7f5b7072c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.098+0000 7f5b7072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:29.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.098+0000 7f5b7072c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.099+0000 7f5b7072c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:29.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.099+0000 7f5b7072c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.100+0000 7f5b7072c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:29.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.100+0000 7f5b7072c800 20 searching for the correct realm 2024-09-12T00:32:29.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.102+0000 7f5b6bcd9640 0 -- 172.21.15.133:0/3456498847 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f5b6009abb0 msgr2=0x7f5b60082ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:29.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.105+0000 7f5b6bcd9640 0 -- 172.21.15.133:0/3456498847 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f5b5c07f040 msgr2=0x7f5b5c055920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:29.312 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:29.312 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:29.312 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:29.312 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:29.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:29.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:29.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:29.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:29.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:29.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 20 zone default found 2024-09-12T00:32:29.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 4 Realm: () 2024-09-12T00:32:29.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:29.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:29.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:29.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 20 zonegroup default 2024-09-12T00:32:29.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.313+0000 7f5b7072c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.314+0000 7f5b7072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:29.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.314+0000 7f5b7072c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.315 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.314+0000 7f5b7072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:29.315 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.314+0000 7f5b7072c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.315 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.315+0000 7f5b7072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:29.315 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.315+0000 7f5b7072c800 20 started sync module instance, tier type = 2024-09-12T00:32:29.315 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.315+0000 7f5b7072c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:29.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.324+0000 7f5b7072c800 20 add_watcher() i=0 2024-09-12T00:32:29.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.324+0000 7f5b7072c800 20 add_watcher() i=1 2024-09-12T00:32:29.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.324+0000 7f5b7072c800 20 add_watcher() i=2 2024-09-12T00:32:29.322 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.324+0000 7f5b7072c800 20 add_watcher() i=3 2024-09-12T00:32:29.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.324+0000 7f5b7072c800 20 add_watcher() i=4 2024-09-12T00:32:29.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.324+0000 7f5b7072c800 20 add_watcher() i=5 2024-09-12T00:32:29.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.324+0000 7f5b7072c800 20 add_watcher() i=6 2024-09-12T00:32:29.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.325+0000 7f5b7072c800 20 add_watcher() i=7 2024-09-12T00:32:29.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.325+0000 7f5b7072c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:29.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.326+0000 7f5a22fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:29.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.327+0000 7f5b7072c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:29.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.327+0000 7f5b7072c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:29.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.327+0000 7f5b7072c800 5 note: GC not initialized 2024-09-12T00:32:29.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.327+0000 7f5a21fdb640 20 reqs_thread_entry: start 2024-09-12T00:32:29.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.327+0000 7f5b7072c800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:29.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.327+0000 7f5b7072c800 20 Filter name: none 2024-09-12T00:32:29.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.327+0000 7f59937fe640 20 reqs_thread_entry: start 2024-09-12T00:32:29.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.327+0000 7f5b7072c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.328+0000 7f5b7072c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:29.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.328+0000 7f5b7072c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.328+0000 7f5b7072c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:29.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.328+0000 7f5b7072c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:29.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.328+0000 7f5b7072c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.328 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.329+0000 7f5b7072c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:29.328 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.329+0000 7f5b7072c800 20 rados->read ofs=0 len=0 2024-09-12T00:32:29.328 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.329+0000 7f5b7072c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:29.328 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.329+0000 7f5b7072c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:29.329 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.330+0000 7f5a22fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:29.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.332+0000 7f5b7072c800 20 remove_watcher() i=0 2024-09-12T00:32:29.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.332+0000 7f5b7072c800 2 removed watcher, disabling cache 2024-09-12T00:32:29.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.333+0000 7f5b7072c800 20 remove_watcher() i=1 2024-09-12T00:32:29.333 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.334+0000 7f5b7072c800 20 remove_watcher() i=2 2024-09-12T00:32:29.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.336+0000 7f5b7072c800 20 remove_watcher() i=3 2024-09-12T00:32:29.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.337+0000 7f5b7072c800 20 remove_watcher() i=4 2024-09-12T00:32:29.336 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.338+0000 7f5b7072c800 20 remove_watcher() i=5 2024-09-12T00:32:29.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.338+0000 7f5b7072c800 20 remove_watcher() i=6 2024-09-12T00:32:29.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:29.339+0000 7f5b7072c800 20 remove_watcher() i=7 2024-09-12T00:32:29.348 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:29.348 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:32:29.349 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-set-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:32:29.349 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:29.644 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T00:32:29.644 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:30.446 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:32:30.474 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:30.474 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:30.511 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.512+0000 7f35ba7ab800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.514+0000 7f35ba7ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:30.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.514+0000 7f35ba7ab800 20 realm 2024-09-12T00:32:30.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.514+0000 7f35ba7ab800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.514+0000 7f35ba7ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:30.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.514+0000 7f35ba7ab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:30.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.514+0000 7f35ba7ab800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.514+0000 7f35ba7ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:30.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.514+0000 7f35ba7ab800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.515+0000 7f35ba7ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:30.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.515+0000 7f35ba7ab800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.516+0000 7f35ba7ab800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:30.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.516+0000 7f35ba7ab800 20 searching for the correct realm 2024-09-12T00:32:30.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.518+0000 7f35b7a94640 0 -- 172.21.15.133:0/2894239361 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f35a00778b0 msgr2=0x7f35a000b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:30.519 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.520+0000 7f35b7a94640 0 -- 172.21.15.133:0/2894239361 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f35a8018070 msgr2=0x7f35a805fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:30.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.727+0000 7f35ba7ab800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:30.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.727+0000 7f35ba7ab800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:30.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.727+0000 7f35ba7ab800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:30.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.727+0000 7f35ba7ab800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:30.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.727+0000 7f35ba7ab800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:30.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.727+0000 7f35ba7ab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:30.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.727+0000 7f35ba7ab800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.728+0000 7f35ba7ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:30.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.728+0000 7f35ba7ab800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.728+0000 7f35ba7ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:30.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.728+0000 7f35ba7ab800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.728+0000 7f35ba7ab800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:30.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.728+0000 7f35ba7ab800 20 zone default found 2024-09-12T00:32:30.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.728+0000 7f35ba7ab800 4 Realm: () 2024-09-12T00:32:30.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.728+0000 7f35ba7ab800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:30.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.728+0000 7f35ba7ab800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:30.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.728+0000 7f35ba7ab800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:30.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.728+0000 7f35ba7ab800 20 zonegroup default 2024-09-12T00:32:30.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.728+0000 7f35ba7ab800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.728+0000 7f35ba7ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:30.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.728+0000 7f35ba7ab800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.729+0000 7f35ba7ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:30.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.729+0000 7f35ba7ab800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.729+0000 7f35ba7ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:30.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.729+0000 7f35ba7ab800 20 started sync module instance, tier type = 2024-09-12T00:32:30.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.729+0000 7f35ba7ab800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:30.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.737+0000 7f35ba7ab800 20 add_watcher() i=0 2024-09-12T00:32:30.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.737+0000 7f35ba7ab800 20 add_watcher() i=1 2024-09-12T00:32:30.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.737+0000 7f35ba7ab800 20 add_watcher() i=2 2024-09-12T00:32:30.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.737+0000 7f35ba7ab800 20 add_watcher() i=3 2024-09-12T00:32:30.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.737+0000 7f35ba7ab800 20 add_watcher() i=4 2024-09-12T00:32:30.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.737+0000 7f35ba7ab800 20 add_watcher() i=5 2024-09-12T00:32:30.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.737+0000 7f35ba7ab800 20 add_watcher() i=6 2024-09-12T00:32:30.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.738+0000 7f35ba7ab800 20 add_watcher() i=7 2024-09-12T00:32:30.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.738+0000 7f35ba7ab800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:30.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.740+0000 7f346efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:30.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.741+0000 7f35ba7ab800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:30.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.741+0000 7f35ba7ab800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:30.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.741+0000 7f35ba7ab800 5 note: GC not initialized 2024-09-12T00:32:30.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.741+0000 7f346dfdb640 20 reqs_thread_entry: start 2024-09-12T00:32:30.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.741+0000 7f35ba7ab800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:30.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.741+0000 7f35ba7ab800 20 Filter name: none 2024-09-12T00:32:30.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.741+0000 7f33df7fe640 20 reqs_thread_entry: start 2024-09-12T00:32:30.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.741+0000 7f35ba7ab800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.742+0000 7f35ba7ab800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:30.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.742+0000 7f35ba7ab800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.742+0000 7f35ba7ab800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:30.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.742+0000 7f35ba7ab800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:30.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.742+0000 7f35ba7ab800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.743+0000 7f35ba7ab800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:30.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.743+0000 7f35ba7ab800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.743+0000 7f35ba7ab800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:30.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.743+0000 7f35ba7ab800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:30.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.744+0000 7f346efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:30.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.746+0000 7f35ba7ab800 20 remove_watcher() i=0 2024-09-12T00:32:30.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.746+0000 7f35ba7ab800 2 removed watcher, disabling cache 2024-09-12T00:32:30.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.747+0000 7f35ba7ab800 20 remove_watcher() i=1 2024-09-12T00:32:30.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.748+0000 7f35ba7ab800 20 remove_watcher() i=2 2024-09-12T00:32:30.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.749+0000 7f35ba7ab800 20 remove_watcher() i=3 2024-09-12T00:32:30.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.750+0000 7f35ba7ab800 20 remove_watcher() i=4 2024-09-12T00:32:30.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.751+0000 7f35ba7ab800 20 remove_watcher() i=5 2024-09-12T00:32:30.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.751+0000 7f35ba7ab800 20 remove_watcher() i=6 2024-09-12T00:32:30.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.752+0000 7f35ba7ab800 20 remove_watcher() i=7 2024-09-12T00:32:30.761 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:30.762 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:32:30.762 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-set-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:32:30.762 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:30.764 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T00:32:30.799 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:30.799 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:30.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.838+0000 7f78ee52f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.839+0000 7f78ee52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:30.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.839+0000 7f78ee52f800 20 realm 2024-09-12T00:32:30.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.839+0000 7f78ee52f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.840+0000 7f78ee52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:30.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.840+0000 7f78ee52f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:30.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.840+0000 7f78ee52f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.840+0000 7f78ee52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:30.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.840+0000 7f78ee52f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.840+0000 7f78ee52f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:30.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.840+0000 7f78ee52f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:30.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.841+0000 7f78ee52f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:30.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.841+0000 7f78ee52f800 20 searching for the correct realm 2024-09-12T00:32:30.842 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:30.843+0000 7f78e3fff640 0 -- 172.21.15.133:0/2437505517 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f78d4044be0 msgr2=0x7f78d408a8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:31.046 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.047+0000 7f78e3fff640 0 -- 172.21.15.133:0/2437505517 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f78dc039040 msgr2=0x7f78dc017930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:31.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.253+0000 7f78ee52f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:31.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.253+0000 7f78ee52f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:31.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.253+0000 7f78ee52f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:31.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.253+0000 7f78ee52f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:31.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.253+0000 7f78ee52f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:31.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.253+0000 7f78ee52f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:31.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.253+0000 7f78ee52f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.254+0000 7f78ee52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:31.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.254+0000 7f78ee52f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.254+0000 7f78ee52f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:31.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.254+0000 7f78ee52f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.254+0000 7f78ee52f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:31.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.254+0000 7f78ee52f800 20 zone default found 2024-09-12T00:32:31.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.254+0000 7f78ee52f800 4 Realm: () 2024-09-12T00:32:31.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.254+0000 7f78ee52f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:31.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.254+0000 7f78ee52f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:31.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.254+0000 7f78ee52f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:31.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.254+0000 7f78ee52f800 20 zonegroup default 2024-09-12T00:32:31.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.254+0000 7f78ee52f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.255+0000 7f78ee52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:31.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.255+0000 7f78ee52f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.255+0000 7f78ee52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:31.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.255+0000 7f78ee52f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.256+0000 7f78ee52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:31.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.256+0000 7f78ee52f800 20 started sync module instance, tier type = 2024-09-12T00:32:31.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.256+0000 7f78ee52f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:31.263 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.265+0000 7f78ee52f800 20 add_watcher() i=0 2024-09-12T00:32:31.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.265+0000 7f78ee52f800 20 add_watcher() i=1 2024-09-12T00:32:31.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.265+0000 7f78ee52f800 20 add_watcher() i=2 2024-09-12T00:32:31.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.265+0000 7f78ee52f800 20 add_watcher() i=3 2024-09-12T00:32:31.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.265+0000 7f78ee52f800 20 add_watcher() i=4 2024-09-12T00:32:31.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.265+0000 7f78ee52f800 20 add_watcher() i=5 2024-09-12T00:32:31.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.265+0000 7f78ee52f800 20 add_watcher() i=6 2024-09-12T00:32:31.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.266+0000 7f78ee52f800 20 add_watcher() i=7 2024-09-12T00:32:31.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.266+0000 7f78ee52f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:31.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.268+0000 7f77a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:31.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.268+0000 7f78ee52f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:31.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.268+0000 7f78ee52f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:31.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.268+0000 7f78ee52f800 5 note: GC not initialized 2024-09-12T00:32:31.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.268+0000 7f771b7fe640 20 reqs_thread_entry: start 2024-09-12T00:32:31.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.269+0000 7f78ee52f800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:31.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.269+0000 7f78ee52f800 20 Filter name: none 2024-09-12T00:32:31.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.269+0000 7f77197fa640 20 reqs_thread_entry: start 2024-09-12T00:32:31.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.269+0000 7f78ee52f800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:32:31.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.269+0000 7f78ee52f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.269+0000 7f78ee52f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:31.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.269+0000 7f78ee52f800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:32:31.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.269+0000 7f78ee52f800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:32:31.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.269+0000 7f78ee52f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 : miss 2024-09-12T00:32:31.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.269+0000 7f78ee52f800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.270+0000 7f78ee52f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:31.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.270+0000 7f78ee52f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 info.flags=0x17 2024-09-12T00:32:31.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.270+0000 7f78ee52f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 to cache LRU end 2024-09-12T00:32:31.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.270+0000 7f78ee52f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:31.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.270+0000 7f78ee52f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:31.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.270+0000 7f78ee52f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 2024-09-12T00:32:31.271 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.272+0000 7f78ee52f800 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T00:32:31.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.274+0000 7f78ee52f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 info.flags=0x17 2024-09-12T00:32:31.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.274+0000 7f78ee52f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 to cache LRU end 2024-09-12T00:32:31.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.274+0000 7f78ee52f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:31.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.274+0000 7f78ee52f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24, ofs0, ns] 2024-09-12T00:32:31.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.274+0000 7f77cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497030 cookie 93884241753072 notifier 6666 bl.length()=1009 2024-09-12T00:32:31.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.274+0000 7f77cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 info.flags=0x17 2024-09-12T00:32:31.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.274+0000 7f77cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 to cache LRU end 2024-09-12T00:32:31.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.274+0000 7f77cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:31.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.276+0000 7f78ee52f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24]): orig_sources= new_sources= 2024-09-12T00:32:31.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.276+0000 7f78ee52f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24]): potential sources added=[] removed=[] 2024-09-12T00:32:31.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.276+0000 7f78ee52f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24]): orig_dests= new_dests= 2024-09-12T00:32:31.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.276+0000 7f78ee52f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24]): potential dests added=[] removed=[] 2024-09-12T00:32:31.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.278+0000 7f78ee52f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24.1.0 2024-09-12T00:32:31.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.278+0000 7f78ee52f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24.1.0 2024-09-12T00:32:31.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.278+0000 7f78ee52f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24.1.1 2024-09-12T00:32:31.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.278+0000 7f78ee52f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24.1.1 2024-09-12T00:32:31.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.278+0000 7f78ee52f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24.0 2024-09-12T00:32:31.279 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.281+0000 7f78ee52f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:31.280 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.281+0000 7f78ee52f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 2024-09-12T00:32:31.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.282+0000 7f78ee52f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 info.flags=0x17 2024-09-12T00:32:31.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.282+0000 7f78ee52f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 to cache LRU end 2024-09-12T00:32:31.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.282+0000 7f78ee52f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:31.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.282+0000 7f78ee52f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24, ofs0, ns] 2024-09-12T00:32:31.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.282+0000 7f77cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497031 cookie 93884241753072 notifier 6666 bl.length()=1009 2024-09-12T00:32:31.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.282+0000 7f77cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 info.flags=0x17 2024-09-12T00:32:31.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.282+0000 7f77cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 to cache LRU end 2024-09-12T00:32:31.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.282+0000 7f77cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:31.282 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.284+0000 7f78ee52f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24]): orig_sources= new_sources= 2024-09-12T00:32:31.282 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.284+0000 7f78ee52f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24]): potential sources added=[] removed=[] 2024-09-12T00:32:31.282 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.284+0000 7f78ee52f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24]): orig_dests= new_dests= 2024-09-12T00:32:31.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.284+0000 7f78ee52f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24]): potential dests added=[] removed=[] 2024-09-12T00:32:31.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.285+0000 7f78ee52f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24.0 2024-09-12T00:32:31.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.285+0000 7f78ee52f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:31.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.285+0000 7f78ee52f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 2024-09-12T00:32:31.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.287+0000 7f78ee52f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 info.flags=0x17 2024-09-12T00:32:31.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.287+0000 7f78ee52f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 to cache LRU end 2024-09-12T00:32:31.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.287+0000 7f78ee52f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:31.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.287+0000 7f78ee52f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24, ofs0, ns] 2024-09-12T00:32:31.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.287+0000 7f77cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497032 cookie 93884241753072 notifier 6666 bl.length()=977 2024-09-12T00:32:31.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.287+0000 7f77cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 info.flags=0x17 2024-09-12T00:32:31.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.287+0000 7f77cdffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 to cache LRU end 2024-09-12T00:32:31.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.287+0000 7f77cdffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:31.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.289+0000 7f78ee52f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24]): orig_sources= new_sources= 2024-09-12T00:32:31.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.289+0000 7f78ee52f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24]): potential sources added=[] removed=[] 2024-09-12T00:32:31.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.289+0000 7f78ee52f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24]): orig_dests= new_dests= 2024-09-12T00:32:31.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.289+0000 7f78ee52f800 20 handle_bi_update(): bucket=:error-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24]): potential dests added=[] removed=[] 2024-09-12T00:32:31.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.290+0000 7f78ee52f800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:32:31.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.292+0000 7f77a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:31.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.294+0000 7f78ee52f800 20 remove_watcher() i=0 2024-09-12T00:32:31.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.294+0000 7f78ee52f800 2 removed watcher, disabling cache 2024-09-12T00:32:31.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.295+0000 7f78ee52f800 20 remove_watcher() i=1 2024-09-12T00:32:31.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.296+0000 7f78ee52f800 20 remove_watcher() i=2 2024-09-12T00:32:31.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.297+0000 7f78ee52f800 20 remove_watcher() i=3 2024-09-12T00:32:31.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.298+0000 7f78ee52f800 20 remove_watcher() i=4 2024-09-12T00:32:31.298 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.299+0000 7f78ee52f800 20 remove_watcher() i=5 2024-09-12T00:32:31.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.300+0000 7f78ee52f800 20 remove_watcher() i=6 2024-09-12T00:32:31.300 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.301+0000 7f78ee52f800 20 remove_watcher() i=7 2024-09-12T00:32:31.314 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:32:31.343 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:31.343 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:31.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.381+0000 7f1dec32e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.383+0000 7f1dec32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:31.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.383+0000 7f1dec32e800 20 realm 2024-09-12T00:32:31.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.383+0000 7f1dec32e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.383+0000 7f1dec32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:31.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.383+0000 7f1dec32e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:31.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.383+0000 7f1dec32e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.384+0000 7f1dec32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:31.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.384+0000 7f1dec32e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.384+0000 7f1dec32e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:31.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.384+0000 7f1dec32e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.385+0000 7f1dec32e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:31.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.385+0000 7f1dec32e800 20 searching for the correct realm 2024-09-12T00:32:31.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.387+0000 7f1de78dc640 0 -- 172.21.15.133:0/793924980 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f1ddc01dbb0 msgr2=0x7f1ddc045430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:31.389 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.390+0000 7f1de78dc640 0 -- 172.21.15.133:0/793924980 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f1dd8028020 msgr2=0x7f1dd800b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:31.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.597+0000 7f1dec32e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:31.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.597+0000 7f1dec32e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:31.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.597+0000 7f1dec32e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:31.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.597+0000 7f1dec32e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:31.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.597+0000 7f1dec32e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:31.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.597+0000 7f1dec32e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:31.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.597+0000 7f1dec32e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.597+0000 7f1dec32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:31.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.597+0000 7f1dec32e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.597+0000 7f1dec32e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:31.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.597+0000 7f1dec32e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.598+0000 7f1dec32e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:31.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.598+0000 7f1dec32e800 20 zone default found 2024-09-12T00:32:31.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.598+0000 7f1dec32e800 4 Realm: () 2024-09-12T00:32:31.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.598+0000 7f1dec32e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:31.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.598+0000 7f1dec32e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:31.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.598+0000 7f1dec32e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:31.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.598+0000 7f1dec32e800 20 zonegroup default 2024-09-12T00:32:31.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.598+0000 7f1dec32e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.598+0000 7f1dec32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:31.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.598+0000 7f1dec32e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.598+0000 7f1dec32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:31.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.598+0000 7f1dec32e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.599+0000 7f1dec32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:31.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.599+0000 7f1dec32e800 20 started sync module instance, tier type = 2024-09-12T00:32:31.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.599+0000 7f1dec32e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:31.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.607+0000 7f1dec32e800 20 add_watcher() i=0 2024-09-12T00:32:31.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.607+0000 7f1dec32e800 20 add_watcher() i=1 2024-09-12T00:32:31.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.607+0000 7f1dec32e800 20 add_watcher() i=2 2024-09-12T00:32:31.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.607+0000 7f1dec32e800 20 add_watcher() i=3 2024-09-12T00:32:31.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.607+0000 7f1dec32e800 20 add_watcher() i=4 2024-09-12T00:32:31.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.607+0000 7f1dec32e800 20 add_watcher() i=5 2024-09-12T00:32:31.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.607+0000 7f1dec32e800 20 add_watcher() i=6 2024-09-12T00:32:31.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.608+0000 7f1dec32e800 20 add_watcher() i=7 2024-09-12T00:32:31.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.608+0000 7f1dec32e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:31.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.609+0000 7f1c9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:31.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.610+0000 7f1dec32e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:31.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.610+0000 7f1dec32e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:31.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.610+0000 7f1dec32e800 5 note: GC not initialized 2024-09-12T00:32:31.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.610+0000 7f1c9dfdb640 20 reqs_thread_entry: start 2024-09-12T00:32:31.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.610+0000 7f1dec32e800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:31.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.610+0000 7f1dec32e800 20 Filter name: none 2024-09-12T00:32:31.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.610+0000 7f1c0f7fe640 20 reqs_thread_entry: start 2024-09-12T00:32:31.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.610+0000 7f1dec32e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.611+0000 7f1dec32e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:31.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.611+0000 7f1dec32e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.611+0000 7f1dec32e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:31.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.611+0000 7f1dec32e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:31.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.611+0000 7f1dec32e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.611+0000 7f1dec32e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:31.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.611+0000 7f1dec32e800 20 rados->read ofs=0 len=0 2024-09-12T00:32:31.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.612+0000 7f1dec32e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:31.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.612+0000 7f1dec32e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:31.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.613+0000 7f1c9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:31.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.615+0000 7f1dec32e800 20 remove_watcher() i=0 2024-09-12T00:32:31.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.615+0000 7f1dec32e800 2 removed watcher, disabling cache 2024-09-12T00:32:31.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.616+0000 7f1dec32e800 20 remove_watcher() i=1 2024-09-12T00:32:31.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.617+0000 7f1dec32e800 20 remove_watcher() i=2 2024-09-12T00:32:31.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.618+0000 7f1dec32e800 20 remove_watcher() i=3 2024-09-12T00:32:31.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.619+0000 7f1dec32e800 20 remove_watcher() i=4 2024-09-12T00:32:31.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.620+0000 7f1dec32e800 20 remove_watcher() i=5 2024-09-12T00:32:31.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.621+0000 7f1dec32e800 20 remove_watcher() i=6 2024-09-12T00:32:31.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:31.622+0000 7f1dec32e800 20 remove_watcher() i=7 2024-09-12T00:32:31.632 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:31.632 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:32:31.632 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-set-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:32:31.632 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:31.933 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T00:32:31.933 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:32.749 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:32:32.777 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:32.777 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:32.813 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:32.814+0000 7fcf33498800 20 rados->read ofs=0 len=0 2024-09-12T00:32:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:32.816+0000 7fcf33498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:32.816+0000 7fcf33498800 20 realm 2024-09-12T00:32:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:32.816+0000 7fcf33498800 20 rados->read ofs=0 len=0 2024-09-12T00:32:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:32.816+0000 7fcf33498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:32.816+0000 7fcf33498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:32.816+0000 7fcf33498800 20 rados->read ofs=0 len=0 2024-09-12T00:32:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:32.817+0000 7fcf33498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:32.817+0000 7fcf33498800 20 rados->read ofs=0 len=0 2024-09-12T00:32:32.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:32.817+0000 7fcf33498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:32.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:32.817+0000 7fcf33498800 20 rados->read ofs=0 len=0 2024-09-12T00:32:32.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:32.818+0000 7fcf33498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:32.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:32.818+0000 7fcf33498800 20 searching for the correct realm 2024-09-12T00:32:32.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:32.820+0000 7fcf30781640 0 -- 172.21.15.133:0/2567109720 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fcf180616a0 msgr2=0x7fcf18069330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:32.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:32.823+0000 7fcf30781640 0 -- 172.21.15.133:0/2567109720 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fcf20039040 msgr2=0x7fcf20029910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:33.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.029+0000 7fcf33498800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:33.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.029+0000 7fcf33498800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:33.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.029+0000 7fcf33498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:33.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.029+0000 7fcf33498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:33.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.029+0000 7fcf33498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:33.028 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.029+0000 7fcf33498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:33.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.029+0000 7fcf33498800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.029+0000 7fcf33498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.029+0000 7fcf33498800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.030+0000 7fcf33498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:33.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.030+0000 7fcf33498800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.030+0000 7fcf33498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:33.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.030+0000 7fcf33498800 20 zone default found 2024-09-12T00:32:33.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.030+0000 7fcf33498800 4 Realm: () 2024-09-12T00:32:33.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.030+0000 7fcf33498800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:33.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.030+0000 7fcf33498800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:33.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.030+0000 7fcf33498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:33.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.030+0000 7fcf33498800 20 zonegroup default 2024-09-12T00:32:33.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.030+0000 7fcf33498800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.030+0000 7fcf33498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.030+0000 7fcf33498800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.030+0000 7fcf33498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.030+0000 7fcf33498800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.031+0000 7fcf33498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.031+0000 7fcf33498800 20 started sync module instance, tier type = 2024-09-12T00:32:33.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.031+0000 7fcf33498800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:33.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.039+0000 7fcf33498800 20 add_watcher() i=0 2024-09-12T00:32:33.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.039+0000 7fcf33498800 20 add_watcher() i=1 2024-09-12T00:32:33.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.039+0000 7fcf33498800 20 add_watcher() i=2 2024-09-12T00:32:33.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.039+0000 7fcf33498800 20 add_watcher() i=3 2024-09-12T00:32:33.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.039+0000 7fcf33498800 20 add_watcher() i=4 2024-09-12T00:32:33.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.039+0000 7fcf33498800 20 add_watcher() i=5 2024-09-12T00:32:33.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.039+0000 7fcf33498800 20 add_watcher() i=6 2024-09-12T00:32:33.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.040+0000 7fcf33498800 20 add_watcher() i=7 2024-09-12T00:32:33.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.040+0000 7fcf33498800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:33.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.042+0000 7fcde6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:33.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.042+0000 7fcf33498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:33.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.042+0000 7fcf33498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:33.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.042+0000 7fcf33498800 5 note: GC not initialized 2024-09-12T00:32:33.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.042+0000 7fcde5fe3640 20 reqs_thread_entry: start 2024-09-12T00:32:33.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.042+0000 7fcf33498800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:33.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.042+0000 7fcf33498800 20 Filter name: none 2024-09-12T00:32:33.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.042+0000 7fcd577fe640 20 reqs_thread_entry: start 2024-09-12T00:32:33.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.042+0000 7fcf33498800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.043+0000 7fcf33498800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:33.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.043+0000 7fcf33498800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.043+0000 7fcf33498800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:33.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.043+0000 7fcf33498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:33.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.044+0000 7fcf33498800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.044+0000 7fcf33498800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:33.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.044+0000 7fcf33498800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.044+0000 7fcf33498800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:33.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.044+0000 7fcf33498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:33.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.045+0000 7fcde6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:33.046 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.047+0000 7fcf33498800 20 remove_watcher() i=0 2024-09-12T00:32:33.046 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.047+0000 7fcf33498800 2 removed watcher, disabling cache 2024-09-12T00:32:33.046 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.048+0000 7fcf33498800 20 remove_watcher() i=1 2024-09-12T00:32:33.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.049+0000 7fcf33498800 20 remove_watcher() i=2 2024-09-12T00:32:33.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.050+0000 7fcf33498800 20 remove_watcher() i=3 2024-09-12T00:32:33.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.051+0000 7fcf33498800 20 remove_watcher() i=4 2024-09-12T00:32:33.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.052+0000 7fcf33498800 20 remove_watcher() i=5 2024-09-12T00:32:33.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.053+0000 7fcf33498800 20 remove_watcher() i=6 2024-09-12T00:32:33.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.054+0000 7fcf33498800 20 remove_watcher() i=7 2024-09-12T00:32:33.063 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.063 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:32:33.063 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-set-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:32:33.063 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.065 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T00:32:33.098 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:33.098 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:33.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.137+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.138+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.138+0000 7f4199746800 20 realm 2024-09-12T00:32:33.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.138+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.138+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.138+0000 7f4199746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:33.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.138+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.138+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.139+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.139+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:33.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.139+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.140+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:33.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.140+0000 7f4199746800 20 searching for the correct realm 2024-09-12T00:32:33.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.142+0000 7f4196a36640 0 -- 172.21.15.133:0/2043713964 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f418c085020 msgr2=0x7f418c0c5980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:33.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.145+0000 7f4196a36640 0 -- 172.21.15.133:0/2043713964 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f4188040040 msgr2=0x7f418801d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:33.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:33.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:33.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:33.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:33.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:33.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:33.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.352+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.352+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.352+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.352+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:33.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.352+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.353+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:33.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.353+0000 7f4199746800 20 zone default found 2024-09-12T00:32:33.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.353+0000 7f4199746800 4 Realm: () 2024-09-12T00:32:33.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.353+0000 7f4199746800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:33.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.353+0000 7f4199746800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:33.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.353+0000 7f4199746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:33.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.353+0000 7f4199746800 20 zonegroup default 2024-09-12T00:32:33.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.353+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.353+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.353+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.353+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.353+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.353+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.353+0000 7f4199746800 20 started sync module instance, tier type = 2024-09-12T00:32:33.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.353+0000 7f4199746800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:33.361 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=0 2024-09-12T00:32:33.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=1 2024-09-12T00:32:33.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=2 2024-09-12T00:32:33.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=3 2024-09-12T00:32:33.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=4 2024-09-12T00:32:33.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=5 2024-09-12T00:32:33.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=6 2024-09-12T00:32:33.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.364+0000 7f4199746800 20 add_watcher() i=7 2024-09-12T00:32:33.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.364+0000 7f4199746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:33.364 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.365+0000 7f404dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:33.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.366+0000 7f4199746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:33.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.366+0000 7f4199746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:33.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.366+0000 7f4199746800 5 note: GC not initialized 2024-09-12T00:32:33.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.366+0000 7f404cfe1640 20 reqs_thread_entry: start 2024-09-12T00:32:33.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.366+0000 7f4199746800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:33.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.366+0000 7f4199746800 20 Filter name: none 2024-09-12T00:32:33.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.366+0000 7f3fc67fc640 20 reqs_thread_entry: start 2024-09-12T00:32:33.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.366+0000 7f4199746800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:32:33.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.366+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.367+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:33.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.367+0000 7f4199746800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:32:33.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.367+0000 7f4199746800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:32:33.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.367+0000 7f4199746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 : miss 2024-09-12T00:32:33.366 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.367+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.367+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:33.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.367+0000 7f4199746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 info.flags=0x17 2024-09-12T00:32:33.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.367+0000 7f4199746800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 to cache LRU end 2024-09-12T00:32:33.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.367+0000 7f4199746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:33.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.367+0000 7f4199746800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:33.367 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.367+0000 7f4199746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 2024-09-12T00:32:33.368 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4199746800 time 2024-09-12T00:32:33.370850+0000 2024-09-12T00:32:33.368 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:32:33.369 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:33.369 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f419cd8c71a] 2024-09-12T00:32:33.369 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f419cd8c8d8] 2024-09-12T00:32:33.369 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af56d0641] 2024-09-12T00:32:33.369 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd878e8) [0x563af5be28e8] 2024-09-12T00:32:33.369 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x563af56e031d] 2024-09-12T00:32:33.369 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:32:33.369 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f419ba29590] 2024-09-12T00:32:33.370 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:32:33.370 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:32:33.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.370+0000 7f4199746800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4199746800 time 2024-09-12T00:32:33.370850+0000 2024-09-12T00:32:33.370 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:32:33.370 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.370 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:33.370 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f419cd8c71a] 2024-09-12T00:32:33.370 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f419cd8c8d8] 2024-09-12T00:32:33.370 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af56d0641] 2024-09-12T00:32:33.370 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd878e8) [0x563af5be28e8] 2024-09-12T00:32:33.370 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x563af56e031d] 2024-09-12T00:32:33.370 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:32:33.371 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f419ba29590] 2024-09-12T00:32:33.371 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:32:33.371 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:32:33.371 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.371 INFO:tasks.workunit.client.0.smithi133.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:32:33.371 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f4199746800 thread_name:radosgw-admin 2024-09-12T00:32:33.394 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:33.394 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f419ba3e6f0] 2024-09-12T00:32:33.394 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f419ba8b99c] 2024-09-12T00:32:33.394 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:32:33.395 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:32:33.395 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f419cd8c774] 2024-09-12T00:32:33.395 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f419cd8c8d8] 2024-09-12T00:32:33.395 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af56d0641] 2024-09-12T00:32:33.395 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd878e8) [0x563af5be28e8] 2024-09-12T00:32:33.395 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x563af56e031d] 2024-09-12T00:32:33.395 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:32:33.395 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f419ba29590] 2024-09-12T00:32:33.395 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:32:33.395 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:32:33.395 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.371+0000 7f4199746800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:32:33.395 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f4199746800 thread_name:radosgw-admin 2024-09-12T00:32:33.395 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.396 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:33.396 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f419ba3e6f0] 2024-09-12T00:32:33.396 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f419ba8b99c] 2024-09-12T00:32:33.396 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:32:33.396 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:32:33.396 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f419cd8c774] 2024-09-12T00:32:33.396 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f419cd8c8d8] 2024-09-12T00:32:33.396 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af56d0641] 2024-09-12T00:32:33.396 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd878e8) [0x563af5be28e8] 2024-09-12T00:32:33.396 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x563af56e031d] 2024-09-12T00:32:33.396 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:32:33.396 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f419ba29590] 2024-09-12T00:32:33.396 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:32:33.396 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:32:33.397 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:32:33.397 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.397 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:32:33.397 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:32:33.120+0000 7f408560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:32:33.397 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:32:33.120+0000 7f408560a640 10 monclient: dump: 2024-09-12T00:32:33.397 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.397 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.397 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.397 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.397 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.397 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.397 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.398 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.398 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.398 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.398 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:32:33.120+0000 7f4199746800 5 monclient: authenticate success, global_id 6705 2024-09-12T00:32:33.398 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:32:33.120+0000 7f4199746800 10 monclient: get_monmap_and_config success 2024-09-12T00:32:33.398 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:32:33.120+0000 7f4199746800 4 set_mon_vals no callback set 2024-09-12T00:32:33.398 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:32:33.120+0000 7f4199746800 10 monclient: shutdown 2024-09-12T00:32:33.398 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:32:33.120+0000 7f4199746800 5 asok(0x563af7a4d630) unregister_commands rotate-key 2024-09-12T00:32:33.398 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:32:33.120+0000 7f4199746800 10 monclient: build_initial_monmap 2024-09-12T00:32:33.398 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:32:33.120+0000 7f4199746800 1 build_initial for_mkfs: 0 2024-09-12T00:32:33.398 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:32:33.120+0000 7f4199746800 10 monclient: monmap: 2024-09-12T00:32:33.398 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:32:33.398 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:33.398 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:32:33.399 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:32:33.399 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:33.399 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.399 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:32:33.399 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:32:33.399 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:32:33.399 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.399 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding auth protocol: cephx 2024-09-12T00:32:33.399 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding auth protocol: cephx 2024-09-12T00:32:33.399 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding auth protocol: cephx 2024-09-12T00:32:33.399 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: secure 2024-09-12T00:32:33.399 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: crc 2024-09-12T00:32:33.399 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: secure 2024-09-12T00:32:33.400 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: crc 2024-09-12T00:32:33.400 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: secure 2024-09-12T00:32:33.400 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: crc 2024-09-12T00:32:33.400 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: crc 2024-09-12T00:32:33.400 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: secure 2024-09-12T00:32:33.400 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: crc 2024-09-12T00:32:33.400 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: secure 2024-09-12T00:32:33.400 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: crc 2024-09-12T00:32:33.400 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: secure 2024-09-12T00:32:33.400 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:32:33.121+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.400 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:32:33.121+0000 7f4199746800 1 librados: starting msgr at 2024-09-12T00:32:33.400 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:32:33.121+0000 7f4199746800 1 librados: starting objecter 2024-09-12T00:32:33.401 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:32:33.121+0000 7f4199746800 5 asok(0x563af7a4d630) register_command objecter_requests hook 0x563af7ca0100 2024-09-12T00:32:33.401 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:32:33.121+0000 7f4199746800 1 librados: setting wanted keys 2024-09-12T00:32:33.401 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:32:33.121+0000 7f4199746800 1 librados: calling monclient init 2024-09-12T00:32:33.401 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient: init 2024-09-12T00:32:33.401 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding auth protocol: cephx 2024-09-12T00:32:33.401 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding auth protocol: cephx 2024-09-12T00:32:33.401 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding auth protocol: cephx 2024-09-12T00:32:33.401 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: secure 2024-09-12T00:32:33.401 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: crc 2024-09-12T00:32:33.401 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: secure 2024-09-12T00:32:33.401 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: crc 2024-09-12T00:32:33.401 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: secure 2024-09-12T00:32:33.401 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: crc 2024-09-12T00:32:33.401 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: crc 2024-09-12T00:32:33.402 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: secure 2024-09-12T00:32:33.402 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: crc 2024-09-12T00:32:33.402 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: secure 2024-09-12T00:32:33.402 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: crc 2024-09-12T00:32:33.402 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: secure 2024-09-12T00:32:33.402 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:32:33.121+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.402 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:32:33.121+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.402 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:32:33.121+0000 7f4199746800 5 asok(0x563af7a4d630) register_command rotate-key hook 0x563af7c6df48 2024-09-12T00:32:33.402 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient: _reopen_session rank -1 2024-09-12T00:32:33.402 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:32:33.402 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): picked mon.noname-c con 0x563af7b24da0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:32:33.402 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): picked mon.noname-b con 0x563af7bb02a0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:32:33.402 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): picked mon.noname-a con 0x563af7bb6420 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:32:33.402 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.403 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.403 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.403 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): _renew_subs 2024-09-12T00:32:33.403 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): authenticate will time out at 1961.693892s 2024-09-12T00:32:33.403 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:32:33.121+0000 7f4197237640 10 monclient(hunting): get_auth_request con 0x563af7b24da0 auth_method 0 2024-09-12T00:32:33.403 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:32:33.121+0000 7f4197237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.403 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:32:33.121+0000 7f4197237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.403 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:32:33.121+0000 7f4197237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.403 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): get_auth_request con 0x563af7bb6420 auth_method 0 2024-09-12T00:32:33.403 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.403 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.403 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.403 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:32:33.122+0000 7f4196a36640 10 monclient(hunting): get_auth_request con 0x563af7bb02a0 auth_method 0 2024-09-12T00:32:33.403 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:32:33.122+0000 7f4196a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.403 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:32:33.122+0000 7f4196a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.404 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:32:33.122+0000 7f4196a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.404 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:32:33.122+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.404 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:32:33.122+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.404 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:32:33.122+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.404 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.404 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.404 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.404 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:32:33.122+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.404 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:32:33.122+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.404 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:32:33.122+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.404 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): handle_auth_done global_id 6708 payload 824 2024-09-12T00:32:33.404 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient: _finish_hunting 0 2024-09-12T00:32:33.404 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:32:33.122+0000 7f4197a38640 1 monclient: found mon.noname-a 2024-09-12T00:32:33.404 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:32:33.405 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.405 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:32:33.405 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: dump: 2024-09-12T00:32:33.405 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.405 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.405 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.405 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.405 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.405 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.405 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.405 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.405 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.405 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.405 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: _finish_auth 0 2024-09-12T00:32:33.406 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: _check_auth_tickets 2024-09-12T00:32:33.406 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:33.406 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.406 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:32:33.406 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: dump: 2024-09-12T00:32:33.406 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.406 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.406 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.406 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.406 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.406 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.406 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.406 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.406 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.407 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.407 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:32:33.122+0000 7f4199746800 5 monclient: authenticate success, global_id 6708 2024-09-12T00:32:33.407 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:32:33.122+0000 7f4199746800 10 monclient: _renew_subs 2024-09-12T00:32:33.407 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:32:33.122+0000 7f4199746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:32:33.407 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:32:33.122+0000 7f408560a640 4 set_mon_vals no callback set 2024-09-12T00:32:33.407 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:32:33.122+0000 7f4199746800 10 monclient: _renew_subs 2024-09-12T00:32:33.407 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:32:33.122+0000 7f4199746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:32:33.407 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:32:33.122+0000 7f4199746800 1 librados: init done 2024-09-12T00:32:33.407 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:32:33.124+0000 7f4083e07640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:32:33.407 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:32:33.124+0000 7f4083e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:32:33.407 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:32:33.124+0000 7f4083e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:32:33.407 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:32:33.124+0000 7f4197237640 10 monclient: get_auth_request con 0x7f407c076470 auth_method 0 2024-09-12T00:32:33.407 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:32:33.125+0000 7f4196a36640 10 monclient: get_auth_request con 0x563af7cac920 auth_method 0 2024-09-12T00:32:33.407 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:32:33.125+0000 7f4197237640 10 monclient: get_auth_request con 0x563af7cb94c0 auth_method 0 2024-09-12T00:32:33.407 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:32:33.126+0000 7f4196a36640 10 monclient: get_auth_request con 0x563af7cbd8b0 auth_method 0 2024-09-12T00:32:33.408 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:32:33.127+0000 7f4197a38640 10 monclient: get_auth_request con 0x563af7cbcd80 auth_method 0 2024-09-12T00:32:33.408 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:32:33.128+0000 7f4199746800 10 monclient: build_initial_monmap 2024-09-12T00:32:33.408 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:32:33.128+0000 7f4199746800 1 build_initial for_mkfs: 0 2024-09-12T00:32:33.408 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:32:33.128+0000 7f4199746800 10 monclient: monmap: 2024-09-12T00:32:33.408 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:32:33.408 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:33.408 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:32:33.408 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:32:33.408 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:33.408 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.408 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:32:33.408 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:32:33.408 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:32:33.409 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.409 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding auth protocol: cephx 2024-09-12T00:32:33.409 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding auth protocol: cephx 2024-09-12T00:32:33.409 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding auth protocol: cephx 2024-09-12T00:32:33.409 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: secure 2024-09-12T00:32:33.409 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: crc 2024-09-12T00:32:33.409 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: secure 2024-09-12T00:32:33.409 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: crc 2024-09-12T00:32:33.409 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: secure 2024-09-12T00:32:33.409 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: crc 2024-09-12T00:32:33.409 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: crc 2024-09-12T00:32:33.409 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: secure 2024-09-12T00:32:33.409 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: crc 2024-09-12T00:32:33.410 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: secure 2024-09-12T00:32:33.410 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: crc 2024-09-12T00:32:33.410 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: secure 2024-09-12T00:32:33.410 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:32:33.128+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.410 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:32:33.128+0000 7f4199746800 5 asok(0x563af7a4d630) register_command objecter_requests cmddesc objecter_requests hook 0x563af7cc9480 EEXIST 2024-09-12T00:32:33.410 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:32:33.128+0000 7f4199746800 10 monclient: init 2024-09-12T00:32:33.410 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding auth protocol: cephx 2024-09-12T00:32:33.410 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding auth protocol: cephx 2024-09-12T00:32:33.410 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding auth protocol: cephx 2024-09-12T00:32:33.410 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: secure 2024-09-12T00:32:33.410 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: crc 2024-09-12T00:32:33.410 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: secure 2024-09-12T00:32:33.410 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: crc 2024-09-12T00:32:33.410 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: secure 2024-09-12T00:32:33.411 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: crc 2024-09-12T00:32:33.411 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: crc 2024-09-12T00:32:33.411 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: secure 2024-09-12T00:32:33.411 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: crc 2024-09-12T00:32:33.411 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: secure 2024-09-12T00:32:33.411 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: crc 2024-09-12T00:32:33.411 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: secure 2024-09-12T00:32:33.411 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:32:33.128+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.411 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:32:33.129+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.411 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:32:33.129+0000 7f4199746800 5 asok(0x563af7a4d630) register_command rotate-key cmddesc rotate-key hook 0x563af7cc4b00 EEXIST 2024-09-12T00:32:33.411 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient: _reopen_session rank -1 2024-09-12T00:32:33.411 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:32:33.411 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): picked mon.noname-a con 0x563af7ced170 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:32:33.411 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): picked mon.noname-b con 0x563af7cef440 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:32:33.411 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): picked mon.noname-c con 0x563af7ceb940 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:32:33.412 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.412 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.412 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.412 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): _renew_subs 2024-09-12T00:32:33.412 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): authenticate will time out at 1961.701160s 2024-09-12T00:32:33.412 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): get_auth_request con 0x563af7ced170 auth_method 0 2024-09-12T00:32:33.412 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.412 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.412 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.412 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:32:33.129+0000 7f4197237640 10 monclient(hunting): get_auth_request con 0x563af7ceb940 auth_method 0 2024-09-12T00:32:33.412 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:32:33.129+0000 7f4197237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.412 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:32:33.129+0000 7f4197237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.412 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:32:33.129+0000 7f4197237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.413 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:32:33.129+0000 7f4197a38640 10 monclient(hunting): get_auth_request con 0x563af7cef440 auth_method 0 2024-09-12T00:32:33.413 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:32:33.129+0000 7f4197a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.413 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:32:33.129+0000 7f4197a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.413 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:32:33.129+0000 7f4197a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.413 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.413 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.413 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.413 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:32:33.129+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.413 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:32:33.129+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.413 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:32:33.129+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.413 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:32:33.129+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.413 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:32:33.129+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.413 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:32:33.129+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.414 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): handle_auth_done global_id 6711 payload 824 2024-09-12T00:32:33.414 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient: _finish_hunting 0 2024-09-12T00:32:33.414 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:32:33.129+0000 7f4196a36640 1 monclient: found mon.noname-a 2024-09-12T00:32:33.414 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:32:33.414 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.414 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:32:33.414 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: dump: 2024-09-12T00:32:33.414 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.414 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.414 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.414 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.414 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.414 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.415 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.415 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.415 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.415 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.415 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: _finish_auth 0 2024-09-12T00:32:33.415 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: _check_auth_tickets 2024-09-12T00:32:33.415 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:33.415 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.415 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:32:33.415 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: dump: 2024-09-12T00:32:33.415 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.415 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.416 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.416 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.416 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.416 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.416 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.416 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.416 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.416 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.416 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:32:33.129+0000 7f4199746800 5 monclient: authenticate success, global_id 6711 2024-09-12T00:32:33.416 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient: _renew_subs 2024-09-12T00:32:33.416 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:32:33.416 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:32:33.129+0000 7f4198239640 4 set_mon_vals no callback set 2024-09-12T00:32:33.416 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient: _renew_subs 2024-09-12T00:32:33.416 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:32:33.417 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:32:33.131+0000 7f4081602640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:32:33.417 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:32:33.131+0000 7f4081602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:32:33.417 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:32:33.131+0000 7f4081602640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:32:33.417 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:32:33.131+0000 7f4197a38640 10 monclient: get_auth_request con 0x7f4070076370 auth_method 0 2024-09-12T00:32:33.417 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:32:33.131+0000 7f4199746800 10 monclient: get_monmap_and_config 2024-09-12T00:32:33.417 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:32:33.131+0000 7f4199746800 10 monclient: build_initial_monmap 2024-09-12T00:32:33.417 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:32:33.131+0000 7f4199746800 1 build_initial for_mkfs: 0 2024-09-12T00:32:33.417 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:32:33.131+0000 7f4199746800 10 monclient: monmap: 2024-09-12T00:32:33.417 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:32:33.417 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:33.417 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:32:33.417 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:32:33.417 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:33.417 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.418 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:32:33.418 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:32:33.418 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:32:33.418 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.418 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding auth protocol: cephx 2024-09-12T00:32:33.418 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding auth protocol: cephx 2024-09-12T00:32:33.418 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding auth protocol: cephx 2024-09-12T00:32:33.418 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: secure 2024-09-12T00:32:33.418 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: crc 2024-09-12T00:32:33.418 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: secure 2024-09-12T00:32:33.418 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: crc 2024-09-12T00:32:33.418 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: secure 2024-09-12T00:32:33.418 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: crc 2024-09-12T00:32:33.418 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: crc 2024-09-12T00:32:33.418 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: secure 2024-09-12T00:32:33.419 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: crc 2024-09-12T00:32:33.419 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: secure 2024-09-12T00:32:33.419 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: crc 2024-09-12T00:32:33.419 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: secure 2024-09-12T00:32:33.419 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:32:33.132+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.419 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient: init 2024-09-12T00:32:33.419 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding auth protocol: cephx 2024-09-12T00:32:33.419 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding auth protocol: cephx 2024-09-12T00:32:33.419 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding auth protocol: cephx 2024-09-12T00:32:33.419 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: secure 2024-09-12T00:32:33.419 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: crc 2024-09-12T00:32:33.419 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: secure 2024-09-12T00:32:33.419 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: crc 2024-09-12T00:32:33.419 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: secure 2024-09-12T00:32:33.419 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: crc 2024-09-12T00:32:33.420 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: crc 2024-09-12T00:32:33.420 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: secure 2024-09-12T00:32:33.420 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: crc 2024-09-12T00:32:33.420 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: secure 2024-09-12T00:32:33.420 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: crc 2024-09-12T00:32:33.420 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: secure 2024-09-12T00:32:33.420 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:32:33.132+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.420 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:32:33.132+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.420 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:32:33.132+0000 7f4199746800 5 asok(0x563af7a4d630) register_command rotate-key cmddesc rotate-key hook 0x7fff4ff6c1c8 EEXIST 2024-09-12T00:32:33.420 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient: _reopen_session rank -1 2024-09-12T00:32:33.420 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:32:33.420 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): picked mon.noname-a con 0x563af7d41340 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:32:33.420 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): picked mon.noname-c con 0x563af7d3b8e0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:32:33.420 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): picked mon.noname-b con 0x563af7d11180 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:32:33.421 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.421 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.421 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.421 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): _renew_subs 2024-09-12T00:32:33.421 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): authenticate will time out at 1961.704891s 2024-09-12T00:32:33.421 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:32:33.132+0000 7f4196a36640 10 monclient(hunting): get_auth_request con 0x563af7d41340 auth_method 0 2024-09-12T00:32:33.421 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:32:33.132+0000 7f4196a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.421 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.421 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.421 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:32:33.133+0000 7f4197a38640 10 monclient(hunting): get_auth_request con 0x563af7d3b8e0 auth_method 0 2024-09-12T00:32:33.421 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:32:33.133+0000 7f4197a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.421 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:32:33.133+0000 7f4197a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.421 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:32:33.133+0000 7f4197a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.421 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.422 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.422 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.422 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:32:33.133+0000 7f4197237640 10 monclient(hunting): get_auth_request con 0x563af7d11180 auth_method 0 2024-09-12T00:32:33.422 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:32:33.133+0000 7f4197237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.422 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:32:33.133+0000 7f4197237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.422 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:32:33.133+0000 7f4197237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.422 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:32:33.133+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.422 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:32:33.133+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.422 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:32:33.133+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.422 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:32:33.133+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.422 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:32:33.133+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.422 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:32:33.133+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.422 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient(hunting): handle_auth_done global_id 6714 payload 274 2024-09-12T00:32:33.423 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient: _finish_hunting 0 2024-09-12T00:32:33.423 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:32:33.133+0000 7f4196a36640 1 monclient: found mon.noname-a 2024-09-12T00:32:33.423 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:32:33.423 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.423 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:32:33.423 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: dump: 2024-09-12T00:32:33.423 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.423 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.423 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.423 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.423 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.423 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.423 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.423 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.424 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.424 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.424 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: _finish_auth 0 2024-09-12T00:32:33.424 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: _check_auth_tickets 2024-09-12T00:32:33.424 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:33.424 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.424 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:32:33.424 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: dump: 2024-09-12T00:32:33.424 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.424 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.424 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.424 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.424 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.425 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.425 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.425 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.425 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.425 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.425 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:32:33.133+0000 7f4199746800 5 monclient: authenticate success, global_id 6714 2024-09-12T00:32:33.425 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:32:33.133+0000 7f4199746800 10 monclient: get_monmap_and_config success 2024-09-12T00:32:33.425 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:32:33.133+0000 7f4199746800 4 set_mon_vals no callback set 2024-09-12T00:32:33.425 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:32:33.133+0000 7f4199746800 10 monclient: shutdown 2024-09-12T00:32:33.425 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:32:33.134+0000 7f4199746800 10 monclient: build_initial_monmap 2024-09-12T00:32:33.425 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:32:33.134+0000 7f4199746800 1 build_initial for_mkfs: 0 2024-09-12T00:32:33.425 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:32:33.134+0000 7f4199746800 10 monclient: monmap: 2024-09-12T00:32:33.425 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:32:33.426 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:33.426 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:32:33.426 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:32:33.426 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:33.426 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.426 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:32:33.426 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:32:33.426 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:32:33.426 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.426 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding auth protocol: cephx 2024-09-12T00:32:33.426 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding auth protocol: cephx 2024-09-12T00:32:33.426 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding auth protocol: cephx 2024-09-12T00:32:33.426 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: secure 2024-09-12T00:32:33.426 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: crc 2024-09-12T00:32:33.427 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: secure 2024-09-12T00:32:33.427 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: crc 2024-09-12T00:32:33.427 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: secure 2024-09-12T00:32:33.427 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: crc 2024-09-12T00:32:33.427 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: crc 2024-09-12T00:32:33.427 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: secure 2024-09-12T00:32:33.427 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: crc 2024-09-12T00:32:33.427 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: secure 2024-09-12T00:32:33.427 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: crc 2024-09-12T00:32:33.427 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: secure 2024-09-12T00:32:33.427 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:32:33.134+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.427 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:32:33.134+0000 7f4199746800 1 librados: starting msgr at 2024-09-12T00:32:33.427 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:32:33.134+0000 7f4199746800 1 librados: starting objecter 2024-09-12T00:32:33.427 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:32:33.134+0000 7f4199746800 5 asok(0x563af7a4d630) register_command objecter_requests cmddesc objecter_requests hook 0x563af7d3c0a0 EEXIST 2024-09-12T00:32:33.428 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:32:33.134+0000 7f4199746800 1 librados: setting wanted keys 2024-09-12T00:32:33.428 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:32:33.134+0000 7f4199746800 1 librados: calling monclient init 2024-09-12T00:32:33.428 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:32:33.134+0000 7f4199746800 10 monclient: init 2024-09-12T00:32:33.428 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding auth protocol: cephx 2024-09-12T00:32:33.428 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding auth protocol: cephx 2024-09-12T00:32:33.428 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding auth protocol: cephx 2024-09-12T00:32:33.428 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: secure 2024-09-12T00:32:33.428 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: crc 2024-09-12T00:32:33.428 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: secure 2024-09-12T00:32:33.428 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: crc 2024-09-12T00:32:33.428 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: secure 2024-09-12T00:32:33.428 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: crc 2024-09-12T00:32:33.428 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: crc 2024-09-12T00:32:33.429 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: secure 2024-09-12T00:32:33.429 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: crc 2024-09-12T00:32:33.429 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: secure 2024-09-12T00:32:33.429 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: crc 2024-09-12T00:32:33.429 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: secure 2024-09-12T00:32:33.429 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:32:33.134+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.429 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:32:33.135+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.429 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:32:33.135+0000 7f4199746800 5 asok(0x563af7a4d630) register_command rotate-key cmddesc rotate-key hook 0x563af7d05068 EEXIST 2024-09-12T00:32:33.429 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient: _reopen_session rank -1 2024-09-12T00:32:33.429 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:32:33.429 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): picked mon.noname-b con 0x563af7d11180 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:32:33.429 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): picked mon.noname-c con 0x563af7d3b8e0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:32:33.429 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): picked mon.noname-a con 0x563af7d41340 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:32:33.429 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.430 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.430 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.430 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): _renew_subs 2024-09-12T00:32:33.430 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): authenticate will time out at 1961.707121s 2024-09-12T00:32:33.430 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): get_auth_request con 0x563af7d3b8e0 auth_method 0 2024-09-12T00:32:33.430 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.430 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.430 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.430 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:32:33.135+0000 7f4197237640 10 monclient(hunting): get_auth_request con 0x563af7d41340 auth_method 0 2024-09-12T00:32:33.430 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:32:33.135+0000 7f4197237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.430 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:32:33.135+0000 7f4197237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.430 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:32:33.135+0000 7f4197237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.430 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.430 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.431 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.431 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:32:33.135+0000 7f4196a36640 10 monclient(hunting): get_auth_request con 0x563af7d11180 auth_method 0 2024-09-12T00:32:33.431 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:32:33.135+0000 7f4196a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.431 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:32:33.135+0000 7f4196a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.431 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:32:33.135+0000 7f4196a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.431 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:32:33.135+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.431 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:32:33.135+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.431 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:32:33.135+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.431 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:32:33.135+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.431 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:32:33.135+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.431 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:32:33.135+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.431 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): handle_auth_done global_id 6368 payload 824 2024-09-12T00:32:33.431 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient: _finish_hunting 0 2024-09-12T00:32:33.431 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:32:33.135+0000 7f4197a38640 1 monclient: found mon.noname-c 2024-09-12T00:32:33.432 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:32:33.432 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.432 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:32:33.432 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: dump: 2024-09-12T00:32:33.432 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.432 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.432 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.432 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.432 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.432 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.432 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.432 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.432 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.432 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.432 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: _finish_auth 0 2024-09-12T00:32:33.433 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: _check_auth_tickets 2024-09-12T00:32:33.433 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:33.433 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.433 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:32:33.433 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: dump: 2024-09-12T00:32:33.433 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.433 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.433 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.433 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.433 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.433 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.433 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.433 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.433 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.433 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:32:33.135+0000 7f4199746800 5 monclient: authenticate success, global_id 6368 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient: _renew_subs 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:32:33.135+0000 7f407affd640 4 set_mon_vals no callback set 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient: _renew_subs 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:32:33.135+0000 7f4199746800 1 librados: init done 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:32:33.135+0000 7f4199746800 5 asok(0x563af7a4d630) register_command cr dump hook 0x563af7d2e688 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:32:33.137+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:32:33.137+0000 7f40797fa640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:32:33.137+0000 7f40797fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:32:33.137+0000 7f40797fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:32:33.137+0000 7f4196a36640 10 monclient: get_auth_request con 0x7f4060076470 auth_method 0 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:32:33.138+0000 7f4197237640 10 monclient: get_auth_request con 0x563af7d5b410 auth_method 0 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:32:33.138+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.434 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:32:33.138+0000 7f4199746800 20 realm 2024-09-12T00:32:33.435 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:32:33.138+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.435 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:32:33.138+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.435 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:32:33.138+0000 7f4199746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:33.435 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:32:33.138+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.435 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:32:33.138+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.435 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:32:33.139+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.435 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:32:33.139+0000 7f4196a36640 10 monclient: get_auth_request con 0x563af7d5f6b0 auth_method 0 2024-09-12T00:32:33.435 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:32:33.139+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:33.435 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:32:33.139+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.435 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:32:33.139+0000 7f4197a38640 10 monclient: get_auth_request con 0x563af7d62f10 auth_method 0 2024-09-12T00:32:33.435 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:32:33.140+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:33.435 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:32:33.140+0000 7f4199746800 20 searching for the correct realm 2024-09-12T00:32:33.435 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:32:33.140+0000 7f4197237640 10 monclient: get_auth_request con 0x7f4190018070 auth_method 0 2024-09-12T00:32:33.435 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:32:33.141+0000 7f4196a36640 10 monclient: get_auth_request con 0x7f418c085020 auth_method 0 2024-09-12T00:32:33.435 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:32:33.142+0000 7f4196a36640 0 -- 172.21.15.133:0/2043713964 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f418c085020 msgr2=0x7f418c0c5980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:33.436 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:32:33.142+0000 7f40797fa640 1 client.6368.objecter ms_handle_reset 0x7f418c085020 session 0x7f418c005040 osd.0 2024-09-12T00:32:33.436 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:32:33.142+0000 7f40797fa640 10 monclient: _renew_subs 2024-09-12T00:32:33.436 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:32:33.142+0000 7f40797fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:32:33.436 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:32:33.142+0000 7f4196a36640 10 monclient: get_auth_request con 0x7f4060086720 auth_method 0 2024-09-12T00:32:33.436 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:32:33.142+0000 7f4197a38640 10 monclient: get_auth_request con 0x7f419006c0d0 auth_method 0 2024-09-12T00:32:33.436 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:32:33.144+0000 7f4197237640 10 monclient: get_auth_request con 0x7f418c06d040 auth_method 0 2024-09-12T00:32:33.436 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:32:33.145+0000 7f4196a36640 10 monclient: get_auth_request con 0x7f4188040040 auth_method 0 2024-09-12T00:32:33.436 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:32:33.145+0000 7f4196a36640 0 -- 172.21.15.133:0/2043713964 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f4188040040 msgr2=0x7f418801d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:33.436 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:32:33.347+0000 7f4196a36640 10 monclient: get_auth_request con 0x7f4188040040 auth_method 0 2024-09-12T00:32:33.436 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:33.436 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:33.436 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:33.436 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:33.436 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:33.436 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:33.437 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:32:33.352+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.437 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:32:33.352+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.437 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:32:33.352+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.437 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:32:33.352+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:33.437 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:32:33.352+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.437 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:32:33.353+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:33.437 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:32:33.353+0000 7f4199746800 20 zone default found 2024-09-12T00:32:33.437 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:32:33.353+0000 7f4199746800 4 Realm: () 2024-09-12T00:32:33.437 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:32:33.353+0000 7f4199746800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:33.437 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:32:33.353+0000 7f4199746800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:33.437 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:32:33.353+0000 7f4199746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:33.437 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:32:33.353+0000 7f4199746800 20 zonegroup default 2024-09-12T00:32:33.437 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:32:33.353+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.437 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:32:33.353+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.438 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:32:33.353+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.438 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:32:33.353+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.438 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:32:33.353+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.438 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:32:33.353+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.438 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:32:33.353+0000 7f4199746800 20 started sync module instance, tier type = 2024-09-12T00:32:33.438 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:32:33.353+0000 7f4199746800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:33.438 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:32:33.361+0000 7f40797fa640 1 client.6368.objecter ms_handle_reset 0x7f419006c0d0 session 0x7f41900a1070 osd.5 2024-09-12T00:32:33.438 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:32:33.361+0000 7f4197a38640 10 monclient: get_auth_request con 0x7f418c085020 auth_method 0 2024-09-12T00:32:33.438 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=0 2024-09-12T00:32:33.438 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=1 2024-09-12T00:32:33.438 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=2 2024-09-12T00:32:33.438 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=3 2024-09-12T00:32:33.438 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=4 2024-09-12T00:32:33.438 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=5 2024-09-12T00:32:33.439 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=6 2024-09-12T00:32:33.439 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:32:33.364+0000 7f4199746800 20 add_watcher() i=7 2024-09-12T00:32:33.439 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:32:33.364+0000 7f4199746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:33.439 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding auth protocol: cephx 2024-09-12T00:32:33.439 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding auth protocol: cephx 2024-09-12T00:32:33.439 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding auth protocol: cephx 2024-09-12T00:32:33.439 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: secure 2024-09-12T00:32:33.439 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: crc 2024-09-12T00:32:33.439 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: secure 2024-09-12T00:32:33.439 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: crc 2024-09-12T00:32:33.439 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: secure 2024-09-12T00:32:33.439 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: crc 2024-09-12T00:32:33.439 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: crc 2024-09-12T00:32:33.439 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: secure 2024-09-12T00:32:33.440 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: crc 2024-09-12T00:32:33.440 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: secure 2024-09-12T00:32:33.440 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: crc 2024-09-12T00:32:33.440 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:32:33.365+0000 7f404dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:33.440 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: secure 2024-09-12T00:32:33.440 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:32:33.366+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.440 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:32:33.366+0000 7f4199746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:33.440 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:32:33.366+0000 7f4199746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:33.440 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command cache list hook 0x563af7d2c730 2024-09-12T00:32:33.440 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command cache inspect hook 0x563af7d2c730 2024-09-12T00:32:33.440 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command cache erase hook 0x563af7d2c730 2024-09-12T00:32:33.440 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command cache zap hook 0x563af7d2c730 2024-09-12T00:32:33.440 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:32:33.366+0000 7f4199746800 5 note: GC not initialized 2024-09-12T00:32:33.441 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:32:33.366+0000 7f404cfe1640 20 reqs_thread_entry: start 2024-09-12T00:32:33.441 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command sync trace show hook 0x7f4190004ac0 2024-09-12T00:32:33.441 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command sync trace history hook 0x7f4190004ac0 2024-09-12T00:32:33.441 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command sync trace active hook 0x7f4190004ac0 2024-09-12T00:32:33.441 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command sync trace active_short hook 0x7f4190004ac0 2024-09-12T00:32:33.441 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:32:33.366+0000 7f4199746800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:33.441 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:32:33.366+0000 7f4199746800 20 Filter name: none 2024-09-12T00:32:33.441 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:32:33.366+0000 7f3fc67fc640 20 reqs_thread_entry: start 2024-09-12T00:32:33.441 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:32:33.366+0000 7f4199746800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:32:33.441 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:32:33.366+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.441 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:32:33.367+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:33.441 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:32:33.367+0000 7f4199746800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:32:33.441 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:32:33.367+0000 7f4199746800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:32:33.441 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:32:33.367+0000 7f4199746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 : miss 2024-09-12T00:32:33.442 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:32:33.367+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.442 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:32:33.367+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:33.442 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:32:33.367+0000 7f4199746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 info.flags=0x17 2024-09-12T00:32:33.442 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:32:33.367+0000 7f4199746800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 to cache LRU end 2024-09-12T00:32:33.442 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:32:33.367+0000 7f4199746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:33.442 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:32:33.367+0000 7f4199746800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:33.442 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:32:33.367+0000 7f4199746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 2024-09-12T00:32:33.442 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:32:33.370+0000 7f4199746800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4199746800 time 2024-09-12T00:32:33.370850+0000 2024-09-12T00:32:33.442 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:32:33.442 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.442 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:33.442 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f419cd8c71a] 2024-09-12T00:32:33.443 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f419cd8c8d8] 2024-09-12T00:32:33.443 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af56d0641] 2024-09-12T00:32:33.443 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd878e8) [0x563af5be28e8] 2024-09-12T00:32:33.443 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x563af56e031d] 2024-09-12T00:32:33.443 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:32:33.443 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f419ba29590] 2024-09-12T00:32:33.443 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:32:33.443 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:32:33.443 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.443 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:32:33.371+0000 7f4199746800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:32:33.443 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f4199746800 thread_name:radosgw-admin 2024-09-12T00:32:33.443 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.443 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:33.443 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f419ba3e6f0] 2024-09-12T00:32:33.443 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f419ba8b99c] 2024-09-12T00:32:33.444 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:32:33.444 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:32:33.444 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f419cd8c774] 2024-09-12T00:32:33.444 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f419cd8c8d8] 2024-09-12T00:32:33.444 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af56d0641] 2024-09-12T00:32:33.444 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd878e8) [0x563af5be28e8] 2024-09-12T00:32:33.444 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x563af56e031d] 2024-09-12T00:32:33.444 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:32:33.444 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f419ba29590] 2024-09-12T00:32:33.444 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:32:33.444 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:32:33.444 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:32:33.444 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.445 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:32:33.445 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:32:33.445 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:32:33.445 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:32:33.445 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:32:33.445 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:32:33.445 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:32:33.445 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:32:33.445 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:32:33.445 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:32:33.445 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:32:33.445 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:32:33.445 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:32:33.445 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:32:33.445 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:32:33.446 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:32:33.446 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:32:33.446 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:32:33.446 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:32:33.446 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:32:33.446 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:32:33.446 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:32:33.446 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:32:33.446 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:32:33.446 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:32:33.446 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:32:33.446 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:32:33.446 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:32:33.446 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:32:33.447 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:32:33.447 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:32:33.447 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:32:33.447 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:32:33.447 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:32:33.447 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:32:33.447 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:32:33.447 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:32:33.447 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:32:33.447 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:32:33.447 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:32:33.447 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:32:33.447 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:32:33.447 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:32:33.447 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:32:33.448 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:32:33.448 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:32:33.448 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:32:33.448 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:32:33.448 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:32:33.448 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:32:33.448 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:32:33.448 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:32:33.448 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:32:33.448 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:32:33.448 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:32:33.448 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:32:33.448 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:32:33.448 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:32:33.449 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:32:33.449 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:32:33.449 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:32:33.449 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:32:33.449 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:32:33.449 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:32:33.449 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:32:33.449 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:32:33.449 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:32:33.449 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:32:33.449 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:32:33.449 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:32:33.449 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:32:33.449 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:32:33.450 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:32:33.450 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:32:33.450 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:32:33.450 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:32:33.450 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:32:33.450 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:32:33.450 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:32:33.450 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:32:33.450 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:32:33.450 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:32:33.450 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:32:33.450 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:32:33.450 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:32:33.450 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:32:33.450 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:32:33.451 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:32:33.451 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:32:33.451 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:32:33.451 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:32:33.451 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:32:33.451 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:32:33.451 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:32:33.451 INFO:tasks.workunit.client.0.smithi133.stderr: 7f3fc67fc640 / http_manager 2024-09-12T00:32:33.451 INFO:tasks.workunit.client.0.smithi133.stderr: 7f404cfe1640 / http_manager 2024-09-12T00:32:33.451 INFO:tasks.workunit.client.0.smithi133.stderr: 7f404dfe3640 / rgw_dt_lg_renew 2024-09-12T00:32:33.451 INFO:tasks.workunit.client.0.smithi133.stderr: 7f40797fa640 / ms_dispatch 2024-09-12T00:32:33.451 INFO:tasks.workunit.client.0.smithi133.stderr: 7f407affd640 / io_context_pool 2024-09-12T00:32:33.451 INFO:tasks.workunit.client.0.smithi133.stderr: 7f4081602640 / ms_dispatch 2024-09-12T00:32:33.452 INFO:tasks.workunit.client.0.smithi133.stderr: 7f4083e07640 / ms_dispatch 2024-09-12T00:32:33.452 INFO:tasks.workunit.client.0.smithi133.stderr: 7f408560a640 / io_context_pool 2024-09-12T00:32:33.452 INFO:tasks.workunit.client.0.smithi133.stderr: 7f4196a36640 / msgr-worker-2 2024-09-12T00:32:33.452 INFO:tasks.workunit.client.0.smithi133.stderr: 7f4197237640 / msgr-worker-1 2024-09-12T00:32:33.452 INFO:tasks.workunit.client.0.smithi133.stderr: 7f4197a38640 / msgr-worker-0 2024-09-12T00:32:33.452 INFO:tasks.workunit.client.0.smithi133.stderr: 7f4198239640 / io_context_pool 2024-09-12T00:32:33.452 INFO:tasks.workunit.client.0.smithi133.stderr: 7f4199746800 / radosgw-admin 2024-09-12T00:32:33.452 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:32:33.452 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:32:33.452 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/log/ceph/ceph-client.admin.101164.log 2024-09-12T00:32:33.452 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:32:33.452 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:32:33.452 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:32:33.120+0000 7f408560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:32:33.453 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:32:33.120+0000 7f408560a640 10 monclient: dump: 2024-09-12T00:32:33.453 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.453 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.453 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.453 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.453 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.453 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.453 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.453 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.453 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.453 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.453 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:32:33.120+0000 7f4199746800 5 monclient: authenticate success, global_id 6705 2024-09-12T00:32:33.453 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:32:33.120+0000 7f4199746800 10 monclient: get_monmap_and_config success 2024-09-12T00:32:33.453 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:32:33.120+0000 7f4199746800 4 set_mon_vals no callback set 2024-09-12T00:32:33.453 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:32:33.120+0000 7f4199746800 10 monclient: shutdown 2024-09-12T00:32:33.454 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:32:33.120+0000 7f4199746800 5 asok(0x563af7a4d630) unregister_commands rotate-key 2024-09-12T00:32:33.454 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:32:33.120+0000 7f4199746800 10 monclient: build_initial_monmap 2024-09-12T00:32:33.454 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:32:33.120+0000 7f4199746800 1 build_initial for_mkfs: 0 2024-09-12T00:32:33.454 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:32:33.120+0000 7f4199746800 10 monclient: monmap: 2024-09-12T00:32:33.454 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:32:33.454 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:33.454 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:32:33.454 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:32:33.454 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:33.454 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.454 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:32:33.454 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:32:33.454 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:32:33.455 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.455 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding auth protocol: cephx 2024-09-12T00:32:33.455 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding auth protocol: cephx 2024-09-12T00:32:33.455 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding auth protocol: cephx 2024-09-12T00:32:33.455 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: secure 2024-09-12T00:32:33.455 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: crc 2024-09-12T00:32:33.455 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: secure 2024-09-12T00:32:33.455 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: crc 2024-09-12T00:32:33.455 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: secure 2024-09-12T00:32:33.455 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: crc 2024-09-12T00:32:33.455 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: crc 2024-09-12T00:32:33.455 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: secure 2024-09-12T00:32:33.455 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: crc 2024-09-12T00:32:33.455 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: secure 2024-09-12T00:32:33.455 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: crc 2024-09-12T00:32:33.456 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:32:33.120+0000 7f4199746800 5 AuthRegistry(0x563af7c70100) adding con mode: secure 2024-09-12T00:32:33.456 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:32:33.121+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.456 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:32:33.121+0000 7f4199746800 1 librados: starting msgr at 2024-09-12T00:32:33.456 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:32:33.121+0000 7f4199746800 1 librados: starting objecter 2024-09-12T00:32:33.456 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:32:33.121+0000 7f4199746800 5 asok(0x563af7a4d630) register_command objecter_requests hook 0x563af7ca0100 2024-09-12T00:32:33.456 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:32:33.121+0000 7f4199746800 1 librados: setting wanted keys 2024-09-12T00:32:33.456 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:32:33.121+0000 7f4199746800 1 librados: calling monclient init 2024-09-12T00:32:33.456 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient: init 2024-09-12T00:32:33.456 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding auth protocol: cephx 2024-09-12T00:32:33.456 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding auth protocol: cephx 2024-09-12T00:32:33.456 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding auth protocol: cephx 2024-09-12T00:32:33.456 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: secure 2024-09-12T00:32:33.457 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: crc 2024-09-12T00:32:33.457 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: secure 2024-09-12T00:32:33.457 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: crc 2024-09-12T00:32:33.457 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: secure 2024-09-12T00:32:33.457 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: crc 2024-09-12T00:32:33.457 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: crc 2024-09-12T00:32:33.457 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: secure 2024-09-12T00:32:33.457 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: crc 2024-09-12T00:32:33.457 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: secure 2024-09-12T00:32:33.457 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: crc 2024-09-12T00:32:33.457 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:32:33.121+0000 7f4199746800 5 AuthRegistry(0x563af7c6de00) adding con mode: secure 2024-09-12T00:32:33.457 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:32:33.121+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.457 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:32:33.121+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.458 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:32:33.121+0000 7f4199746800 5 asok(0x563af7a4d630) register_command rotate-key hook 0x563af7c6df48 2024-09-12T00:32:33.458 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient: _reopen_session rank -1 2024-09-12T00:32:33.458 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:32:33.458 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): picked mon.noname-c con 0x563af7b24da0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:32:33.458 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): picked mon.noname-b con 0x563af7bb02a0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:32:33.458 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): picked mon.noname-a con 0x563af7bb6420 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:32:33.458 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.458 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.458 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.458 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): _renew_subs 2024-09-12T00:32:33.458 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:32:33.121+0000 7f4199746800 10 monclient(hunting): authenticate will time out at 1961.693892s 2024-09-12T00:32:33.458 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:32:33.121+0000 7f4197237640 10 monclient(hunting): get_auth_request con 0x563af7b24da0 auth_method 0 2024-09-12T00:32:33.458 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:32:33.121+0000 7f4197237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.458 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:32:33.121+0000 7f4197237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.459 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:32:33.121+0000 7f4197237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.459 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): get_auth_request con 0x563af7bb6420 auth_method 0 2024-09-12T00:32:33.459 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.459 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.459 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.459 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:32:33.122+0000 7f4196a36640 10 monclient(hunting): get_auth_request con 0x563af7bb02a0 auth_method 0 2024-09-12T00:32:33.459 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:32:33.122+0000 7f4196a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.459 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:32:33.122+0000 7f4196a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.459 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:32:33.122+0000 7f4196a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.459 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:32:33.122+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.459 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:32:33.122+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.459 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:32:33.122+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.459 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.460 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.460 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.460 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:32:33.122+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.460 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:32:33.122+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.460 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:32:33.122+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.460 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient(hunting): handle_auth_done global_id 6708 payload 824 2024-09-12T00:32:33.460 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient: _finish_hunting 0 2024-09-12T00:32:33.460 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:32:33.122+0000 7f4197a38640 1 monclient: found mon.noname-a 2024-09-12T00:32:33.460 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:32:33.122+0000 7f4197a38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:32:33.460 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.460 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:32:33.460 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: dump: 2024-09-12T00:32:33.461 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.461 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.461 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.461 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.461 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.461 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.461 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.461 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.461 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.461 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.461 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: _finish_auth 0 2024-09-12T00:32:33.461 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: _check_auth_tickets 2024-09-12T00:32:33.462 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:33.462 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.462 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:32:33.462 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:32:33.122+0000 7f4083e07640 10 monclient: dump: 2024-09-12T00:32:33.462 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.462 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.462 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.462 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.462 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.462 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.462 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.462 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.462 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.462 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.463 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:32:33.122+0000 7f4199746800 5 monclient: authenticate success, global_id 6708 2024-09-12T00:32:33.463 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:32:33.122+0000 7f4199746800 10 monclient: _renew_subs 2024-09-12T00:32:33.463 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:32:33.122+0000 7f4199746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:32:33.463 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:32:33.122+0000 7f408560a640 4 set_mon_vals no callback set 2024-09-12T00:32:33.463 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:32:33.122+0000 7f4199746800 10 monclient: _renew_subs 2024-09-12T00:32:33.463 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:32:33.122+0000 7f4199746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:32:33.463 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:32:33.122+0000 7f4199746800 1 librados: init done 2024-09-12T00:32:33.463 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:32:33.124+0000 7f4083e07640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:32:33.463 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:32:33.124+0000 7f4083e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:32:33.463 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:32:33.124+0000 7f4083e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:32:33.463 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:32:33.124+0000 7f4197237640 10 monclient: get_auth_request con 0x7f407c076470 auth_method 0 2024-09-12T00:32:33.463 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:32:33.125+0000 7f4196a36640 10 monclient: get_auth_request con 0x563af7cac920 auth_method 0 2024-09-12T00:32:33.463 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:32:33.125+0000 7f4197237640 10 monclient: get_auth_request con 0x563af7cb94c0 auth_method 0 2024-09-12T00:32:33.463 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:32:33.126+0000 7f4196a36640 10 monclient: get_auth_request con 0x563af7cbd8b0 auth_method 0 2024-09-12T00:32:33.463 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:32:33.127+0000 7f4197a38640 10 monclient: get_auth_request con 0x563af7cbcd80 auth_method 0 2024-09-12T00:32:33.464 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:32:33.128+0000 7f4199746800 10 monclient: build_initial_monmap 2024-09-12T00:32:33.464 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:32:33.128+0000 7f4199746800 1 build_initial for_mkfs: 0 2024-09-12T00:32:33.464 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:32:33.128+0000 7f4199746800 10 monclient: monmap: 2024-09-12T00:32:33.464 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:32:33.464 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:33.464 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:32:33.464 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:32:33.464 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:33.464 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.464 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:32:33.464 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:32:33.464 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:32:33.464 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.464 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding auth protocol: cephx 2024-09-12T00:32:33.465 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding auth protocol: cephx 2024-09-12T00:32:33.465 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding auth protocol: cephx 2024-09-12T00:32:33.465 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: secure 2024-09-12T00:32:33.465 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: crc 2024-09-12T00:32:33.465 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: secure 2024-09-12T00:32:33.465 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: crc 2024-09-12T00:32:33.465 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: secure 2024-09-12T00:32:33.465 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: crc 2024-09-12T00:32:33.465 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: crc 2024-09-12T00:32:33.465 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: secure 2024-09-12T00:32:33.465 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: crc 2024-09-12T00:32:33.465 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: secure 2024-09-12T00:32:33.465 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: crc 2024-09-12T00:32:33.465 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc5b20) adding con mode: secure 2024-09-12T00:32:33.465 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:32:33.128+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.466 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:32:33.128+0000 7f4199746800 5 asok(0x563af7a4d630) register_command objecter_requests cmddesc objecter_requests hook 0x563af7cc9480 EEXIST 2024-09-12T00:32:33.466 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:32:33.128+0000 7f4199746800 10 monclient: init 2024-09-12T00:32:33.466 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding auth protocol: cephx 2024-09-12T00:32:33.466 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding auth protocol: cephx 2024-09-12T00:32:33.466 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding auth protocol: cephx 2024-09-12T00:32:33.466 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: secure 2024-09-12T00:32:33.466 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: crc 2024-09-12T00:32:33.466 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: secure 2024-09-12T00:32:33.466 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: crc 2024-09-12T00:32:33.466 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: secure 2024-09-12T00:32:33.466 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: crc 2024-09-12T00:32:33.466 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: crc 2024-09-12T00:32:33.466 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: secure 2024-09-12T00:32:33.467 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: crc 2024-09-12T00:32:33.467 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: secure 2024-09-12T00:32:33.467 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: crc 2024-09-12T00:32:33.467 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:32:33.128+0000 7f4199746800 5 AuthRegistry(0x563af7cc49b8) adding con mode: secure 2024-09-12T00:32:33.467 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:32:33.128+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.467 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:32:33.129+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.467 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:32:33.129+0000 7f4199746800 5 asok(0x563af7a4d630) register_command rotate-key cmddesc rotate-key hook 0x563af7cc4b00 EEXIST 2024-09-12T00:32:33.467 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient: _reopen_session rank -1 2024-09-12T00:32:33.467 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:32:33.467 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): picked mon.noname-a con 0x563af7ced170 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:32:33.467 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): picked mon.noname-b con 0x563af7cef440 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:32:33.467 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): picked mon.noname-c con 0x563af7ceb940 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:32:33.467 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.467 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.468 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.468 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): _renew_subs 2024-09-12T00:32:33.468 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient(hunting): authenticate will time out at 1961.701160s 2024-09-12T00:32:33.468 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): get_auth_request con 0x563af7ced170 auth_method 0 2024-09-12T00:32:33.468 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.468 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.468 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.468 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:32:33.129+0000 7f4197237640 10 monclient(hunting): get_auth_request con 0x563af7ceb940 auth_method 0 2024-09-12T00:32:33.468 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:32:33.129+0000 7f4197237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.468 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:32:33.129+0000 7f4197237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.468 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:32:33.129+0000 7f4197237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.468 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:32:33.129+0000 7f4197a38640 10 monclient(hunting): get_auth_request con 0x563af7cef440 auth_method 0 2024-09-12T00:32:33.468 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:32:33.129+0000 7f4197a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.468 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:32:33.129+0000 7f4197a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.469 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:32:33.129+0000 7f4197a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.469 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.469 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.469 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.469 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:32:33.129+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.469 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:32:33.129+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.469 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:32:33.129+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.469 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:32:33.129+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.469 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:32:33.129+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.469 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:32:33.129+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.469 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient(hunting): handle_auth_done global_id 6711 payload 824 2024-09-12T00:32:33.469 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient: _finish_hunting 0 2024-09-12T00:32:33.469 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:32:33.129+0000 7f4196a36640 1 monclient: found mon.noname-a 2024-09-12T00:32:33.469 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:32:33.129+0000 7f4196a36640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:32:33.470 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.470 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:32:33.470 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: dump: 2024-09-12T00:32:33.470 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.470 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.470 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.470 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.470 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.470 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.470 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.470 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.470 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.470 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.471 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: _finish_auth 0 2024-09-12T00:32:33.471 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: _check_auth_tickets 2024-09-12T00:32:33.471 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:33.471 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.471 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:32:33.471 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:32:33.129+0000 7f4081602640 10 monclient: dump: 2024-09-12T00:32:33.471 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.471 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.471 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.471 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.471 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.471 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.471 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.471 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.472 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.472 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.472 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:32:33.129+0000 7f4199746800 5 monclient: authenticate success, global_id 6711 2024-09-12T00:32:33.472 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient: _renew_subs 2024-09-12T00:32:33.472 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:32:33.472 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:32:33.129+0000 7f4198239640 4 set_mon_vals no callback set 2024-09-12T00:32:33.472 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient: _renew_subs 2024-09-12T00:32:33.472 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:32:33.129+0000 7f4199746800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:32:33.472 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:32:33.131+0000 7f4081602640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:32:33.472 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:32:33.131+0000 7f4081602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:32:33.472 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:32:33.131+0000 7f4081602640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:32:33.472 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:32:33.131+0000 7f4197a38640 10 monclient: get_auth_request con 0x7f4070076370 auth_method 0 2024-09-12T00:32:33.472 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:32:33.131+0000 7f4199746800 10 monclient: get_monmap_and_config 2024-09-12T00:32:33.473 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:32:33.131+0000 7f4199746800 10 monclient: build_initial_monmap 2024-09-12T00:32:33.473 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:32:33.131+0000 7f4199746800 1 build_initial for_mkfs: 0 2024-09-12T00:32:33.473 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:32:33.131+0000 7f4199746800 10 monclient: monmap: 2024-09-12T00:32:33.473 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:32:33.473 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:33.473 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:32:33.473 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:32:33.473 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:33.473 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.473 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:32:33.473 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:32:33.473 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:32:33.473 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.473 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding auth protocol: cephx 2024-09-12T00:32:33.474 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding auth protocol: cephx 2024-09-12T00:32:33.474 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding auth protocol: cephx 2024-09-12T00:32:33.474 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: secure 2024-09-12T00:32:33.474 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: crc 2024-09-12T00:32:33.474 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: secure 2024-09-12T00:32:33.474 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: crc 2024-09-12T00:32:33.474 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: secure 2024-09-12T00:32:33.474 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: crc 2024-09-12T00:32:33.474 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: crc 2024-09-12T00:32:33.474 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: secure 2024-09-12T00:32:33.474 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: crc 2024-09-12T00:32:33.474 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: secure 2024-09-12T00:32:33.474 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: crc 2024-09-12T00:32:33.475 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:32:33.131+0000 7f4199746800 5 AuthRegistry(0x563af7d0cdc0) adding con mode: secure 2024-09-12T00:32:33.475 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:32:33.132+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.475 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient: init 2024-09-12T00:32:33.475 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding auth protocol: cephx 2024-09-12T00:32:33.475 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding auth protocol: cephx 2024-09-12T00:32:33.475 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding auth protocol: cephx 2024-09-12T00:32:33.475 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: secure 2024-09-12T00:32:33.475 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: crc 2024-09-12T00:32:33.475 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: secure 2024-09-12T00:32:33.475 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: crc 2024-09-12T00:32:33.475 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: secure 2024-09-12T00:32:33.475 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: crc 2024-09-12T00:32:33.475 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: crc 2024-09-12T00:32:33.476 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: secure 2024-09-12T00:32:33.476 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: crc 2024-09-12T00:32:33.476 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: secure 2024-09-12T00:32:33.476 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: crc 2024-09-12T00:32:33.476 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:32:33.132+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c080) adding con mode: secure 2024-09-12T00:32:33.476 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:32:33.132+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.476 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:32:33.132+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.476 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:32:33.132+0000 7f4199746800 5 asok(0x563af7a4d630) register_command rotate-key cmddesc rotate-key hook 0x7fff4ff6c1c8 EEXIST 2024-09-12T00:32:33.476 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient: _reopen_session rank -1 2024-09-12T00:32:33.476 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:32:33.476 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): picked mon.noname-a con 0x563af7d41340 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:32:33.476 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): picked mon.noname-c con 0x563af7d3b8e0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:32:33.476 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): picked mon.noname-b con 0x563af7d11180 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:32:33.476 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.477 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.477 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.477 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): _renew_subs 2024-09-12T00:32:33.477 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:32:33.132+0000 7f4199746800 10 monclient(hunting): authenticate will time out at 1961.704891s 2024-09-12T00:32:33.477 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:32:33.132+0000 7f4196a36640 10 monclient(hunting): get_auth_request con 0x563af7d41340 auth_method 0 2024-09-12T00:32:33.477 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:32:33.132+0000 7f4196a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.477 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.477 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.477 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:32:33.133+0000 7f4197a38640 10 monclient(hunting): get_auth_request con 0x563af7d3b8e0 auth_method 0 2024-09-12T00:32:33.477 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:32:33.133+0000 7f4197a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.477 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:32:33.133+0000 7f4197a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.477 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:32:33.133+0000 7f4197a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.477 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.477 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.478 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.478 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:32:33.133+0000 7f4197237640 10 monclient(hunting): get_auth_request con 0x563af7d11180 auth_method 0 2024-09-12T00:32:33.478 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:32:33.133+0000 7f4197237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.478 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:32:33.133+0000 7f4197237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.478 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:32:33.133+0000 7f4197237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.478 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:32:33.133+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.478 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:32:33.133+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.478 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:32:33.133+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.478 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:32:33.133+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.478 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:32:33.133+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.478 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:32:33.133+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.478 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient(hunting): handle_auth_done global_id 6714 payload 274 2024-09-12T00:32:33.478 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient: _finish_hunting 0 2024-09-12T00:32:33.479 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:32:33.133+0000 7f4196a36640 1 monclient: found mon.noname-a 2024-09-12T00:32:33.479 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:32:33.133+0000 7f4196a36640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:32:33.479 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.479 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:32:33.479 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: dump: 2024-09-12T00:32:33.479 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.479 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.479 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.479 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.479 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.479 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.479 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.480 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.480 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.480 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.480 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: _finish_auth 0 2024-09-12T00:32:33.480 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: _check_auth_tickets 2024-09-12T00:32:33.480 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:33.480 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.480 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:32:33.480 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:32:33.133+0000 7f407affd640 10 monclient: dump: 2024-09-12T00:32:33.480 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.480 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.480 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.480 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.480 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.481 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.481 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.481 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.481 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.481 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.481 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:32:33.133+0000 7f4199746800 5 monclient: authenticate success, global_id 6714 2024-09-12T00:32:33.481 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:32:33.133+0000 7f4199746800 10 monclient: get_monmap_and_config success 2024-09-12T00:32:33.481 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:32:33.133+0000 7f4199746800 4 set_mon_vals no callback set 2024-09-12T00:32:33.481 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:32:33.133+0000 7f4199746800 10 monclient: shutdown 2024-09-12T00:32:33.481 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:32:33.134+0000 7f4199746800 10 monclient: build_initial_monmap 2024-09-12T00:32:33.481 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:32:33.134+0000 7f4199746800 1 build_initial for_mkfs: 0 2024-09-12T00:32:33.481 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:32:33.134+0000 7f4199746800 10 monclient: monmap: 2024-09-12T00:32:33.481 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:32:33.481 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:33.482 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:32:33.482 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:32:33.482 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:33.482 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.482 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:32:33.482 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:32:33.482 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:32:33.482 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.482 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding auth protocol: cephx 2024-09-12T00:32:33.482 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding auth protocol: cephx 2024-09-12T00:32:33.482 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding auth protocol: cephx 2024-09-12T00:32:33.482 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: secure 2024-09-12T00:32:33.482 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: crc 2024-09-12T00:32:33.482 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: secure 2024-09-12T00:32:33.482 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: crc 2024-09-12T00:32:33.483 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: secure 2024-09-12T00:32:33.483 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: crc 2024-09-12T00:32:33.483 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: crc 2024-09-12T00:32:33.483 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: secure 2024-09-12T00:32:33.483 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: crc 2024-09-12T00:32:33.483 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: secure 2024-09-12T00:32:33.483 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: crc 2024-09-12T00:32:33.483 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d3c8a0) adding con mode: secure 2024-09-12T00:32:33.483 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:32:33.134+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.483 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:32:33.134+0000 7f4199746800 1 librados: starting msgr at 2024-09-12T00:32:33.483 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:32:33.134+0000 7f4199746800 1 librados: starting objecter 2024-09-12T00:32:33.483 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:32:33.134+0000 7f4199746800 5 asok(0x563af7a4d630) register_command objecter_requests cmddesc objecter_requests hook 0x563af7d3c0a0 EEXIST 2024-09-12T00:32:33.483 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:32:33.134+0000 7f4199746800 1 librados: setting wanted keys 2024-09-12T00:32:33.484 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:32:33.134+0000 7f4199746800 1 librados: calling monclient init 2024-09-12T00:32:33.484 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:32:33.134+0000 7f4199746800 10 monclient: init 2024-09-12T00:32:33.484 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding auth protocol: cephx 2024-09-12T00:32:33.484 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding auth protocol: cephx 2024-09-12T00:32:33.484 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding auth protocol: cephx 2024-09-12T00:32:33.484 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: secure 2024-09-12T00:32:33.484 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: crc 2024-09-12T00:32:33.484 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: secure 2024-09-12T00:32:33.484 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: crc 2024-09-12T00:32:33.484 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: secure 2024-09-12T00:32:33.484 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: crc 2024-09-12T00:32:33.484 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: crc 2024-09-12T00:32:33.484 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: secure 2024-09-12T00:32:33.485 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: crc 2024-09-12T00:32:33.485 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: secure 2024-09-12T00:32:33.485 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: crc 2024-09-12T00:32:33.485 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:32:33.134+0000 7f4199746800 5 AuthRegistry(0x563af7d04f20) adding con mode: secure 2024-09-12T00:32:33.485 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:32:33.134+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.485 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:32:33.135+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.485 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:32:33.135+0000 7f4199746800 5 asok(0x563af7a4d630) register_command rotate-key cmddesc rotate-key hook 0x563af7d05068 EEXIST 2024-09-12T00:32:33.485 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient: _reopen_session rank -1 2024-09-12T00:32:33.485 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:32:33.485 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): picked mon.noname-b con 0x563af7d11180 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:32:33.485 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): picked mon.noname-c con 0x563af7d3b8e0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:32:33.485 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): picked mon.noname-a con 0x563af7d41340 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:32:33.485 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.485 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.486 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:33.486 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): _renew_subs 2024-09-12T00:32:33.486 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient(hunting): authenticate will time out at 1961.707121s 2024-09-12T00:32:33.486 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): get_auth_request con 0x563af7d3b8e0 auth_method 0 2024-09-12T00:32:33.486 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.486 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.486 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.486 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:32:33.135+0000 7f4197237640 10 monclient(hunting): get_auth_request con 0x563af7d41340 auth_method 0 2024-09-12T00:32:33.486 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:32:33.135+0000 7f4197237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.486 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:32:33.135+0000 7f4197237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.486 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:32:33.135+0000 7f4197237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.486 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.486 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.486 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.487 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:32:33.135+0000 7f4196a36640 10 monclient(hunting): get_auth_request con 0x563af7d11180 auth_method 0 2024-09-12T00:32:33.487 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:32:33.135+0000 7f4196a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:33.487 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:32:33.135+0000 7f4196a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:33.487 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:32:33.135+0000 7f4196a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:33.487 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:32:33.135+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.487 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:32:33.135+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.487 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:32:33.135+0000 7f4197237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.487 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:32:33.135+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:33.487 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:32:33.135+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:33.487 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:32:33.135+0000 7f4196a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:33.487 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient(hunting): handle_auth_done global_id 6368 payload 824 2024-09-12T00:32:33.488 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient: _finish_hunting 0 2024-09-12T00:32:33.488 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:32:33.135+0000 7f4197a38640 1 monclient: found mon.noname-c 2024-09-12T00:32:33.488 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:32:33.135+0000 7f4197a38640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:32:33.488 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.488 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:32:33.488 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: dump: 2024-09-12T00:32:33.488 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.488 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.488 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.488 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.488 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.488 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.489 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.489 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.489 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.489 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.489 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: _finish_auth 0 2024-09-12T00:32:33.489 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: _check_auth_tickets 2024-09-12T00:32:33.489 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:33.489 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:33.489 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:32:33.489 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:32:33.135+0000 7f40797fa640 10 monclient: dump: 2024-09-12T00:32:33.489 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:32:33.489 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:32:33.489 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.489 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:32:33.490 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:33.490 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:32:33.490 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:32:33.490 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:32:33.490 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:32:33.490 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.490 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:32:33.135+0000 7f4199746800 5 monclient: authenticate success, global_id 6368 2024-09-12T00:32:33.490 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient: _renew_subs 2024-09-12T00:32:33.490 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:32:33.490 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:32:33.135+0000 7f407affd640 4 set_mon_vals no callback set 2024-09-12T00:32:33.490 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient: _renew_subs 2024-09-12T00:32:33.490 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:32:33.135+0000 7f4199746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:32:33.490 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:32:33.135+0000 7f4199746800 1 librados: init done 2024-09-12T00:32:33.490 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:32:33.135+0000 7f4199746800 5 asok(0x563af7a4d630) register_command cr dump hook 0x563af7d2e688 2024-09-12T00:32:33.491 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:32:33.137+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.491 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:32:33.137+0000 7f40797fa640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:32:33.491 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:32:33.137+0000 7f40797fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:32:33.491 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:32:33.137+0000 7f40797fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:32:33.491 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:32:33.137+0000 7f4196a36640 10 monclient: get_auth_request con 0x7f4060076470 auth_method 0 2024-09-12T00:32:33.491 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:32:33.138+0000 7f4197237640 10 monclient: get_auth_request con 0x563af7d5b410 auth_method 0 2024-09-12T00:32:33.491 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:32:33.138+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.491 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:32:33.138+0000 7f4199746800 20 realm 2024-09-12T00:32:33.491 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:32:33.138+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.491 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:32:33.138+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.491 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:32:33.138+0000 7f4199746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:33.491 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:32:33.138+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.491 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:32:33.138+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.491 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:32:33.139+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.492 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:32:33.139+0000 7f4196a36640 10 monclient: get_auth_request con 0x563af7d5f6b0 auth_method 0 2024-09-12T00:32:33.492 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:32:33.139+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:33.492 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:32:33.139+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.492 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:32:33.139+0000 7f4197a38640 10 monclient: get_auth_request con 0x563af7d62f10 auth_method 0 2024-09-12T00:32:33.492 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:32:33.140+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:33.492 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:32:33.140+0000 7f4199746800 20 searching for the correct realm 2024-09-12T00:32:33.492 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:32:33.140+0000 7f4197237640 10 monclient: get_auth_request con 0x7f4190018070 auth_method 0 2024-09-12T00:32:33.492 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:32:33.141+0000 7f4196a36640 10 monclient: get_auth_request con 0x7f418c085020 auth_method 0 2024-09-12T00:32:33.492 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:32:33.142+0000 7f4196a36640 0 -- 172.21.15.133:0/2043713964 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f418c085020 msgr2=0x7f418c0c5980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:33.492 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:32:33.142+0000 7f40797fa640 1 client.6368.objecter ms_handle_reset 0x7f418c085020 session 0x7f418c005040 osd.0 2024-09-12T00:32:33.492 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:32:33.142+0000 7f40797fa640 10 monclient: _renew_subs 2024-09-12T00:32:33.492 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:32:33.142+0000 7f40797fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:32:33.492 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:32:33.142+0000 7f4196a36640 10 monclient: get_auth_request con 0x7f4060086720 auth_method 0 2024-09-12T00:32:33.492 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:32:33.142+0000 7f4197a38640 10 monclient: get_auth_request con 0x7f419006c0d0 auth_method 0 2024-09-12T00:32:33.492 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:32:33.144+0000 7f4197237640 10 monclient: get_auth_request con 0x7f418c06d040 auth_method 0 2024-09-12T00:32:33.493 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:32:33.145+0000 7f4196a36640 10 monclient: get_auth_request con 0x7f4188040040 auth_method 0 2024-09-12T00:32:33.493 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:32:33.145+0000 7f4196a36640 0 -- 172.21.15.133:0/2043713964 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f4188040040 msgr2=0x7f418801d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:33.493 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:32:33.347+0000 7f4196a36640 10 monclient: get_auth_request con 0x7f4188040040 auth_method 0 2024-09-12T00:32:33.493 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:33.493 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:33.493 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:33.493 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:33.493 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:33.493 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:32:33.352+0000 7f4199746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:33.493 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:32:33.352+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.493 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:32:33.352+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.493 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:32:33.352+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.493 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:32:33.352+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:33.493 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:32:33.352+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.494 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:32:33.353+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:33.494 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:32:33.353+0000 7f4199746800 20 zone default found 2024-09-12T00:32:33.494 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:32:33.353+0000 7f4199746800 4 Realm: () 2024-09-12T00:32:33.494 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:32:33.353+0000 7f4199746800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:33.494 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:32:33.353+0000 7f4199746800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:33.494 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:32:33.353+0000 7f4199746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:33.494 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:32:33.353+0000 7f4199746800 20 zonegroup default 2024-09-12T00:32:33.494 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:32:33.353+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.494 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:32:33.353+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.494 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:32:33.353+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.494 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:32:33.353+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.494 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:32:33.353+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.494 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:32:33.353+0000 7f4199746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.495 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:32:33.353+0000 7f4199746800 20 started sync module instance, tier type = 2024-09-12T00:32:33.495 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:32:33.353+0000 7f4199746800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:33.495 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:32:33.361+0000 7f40797fa640 1 client.6368.objecter ms_handle_reset 0x7f419006c0d0 session 0x7f41900a1070 osd.5 2024-09-12T00:32:33.495 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:32:33.361+0000 7f4197a38640 10 monclient: get_auth_request con 0x7f418c085020 auth_method 0 2024-09-12T00:32:33.495 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=0 2024-09-12T00:32:33.495 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=1 2024-09-12T00:32:33.495 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=2 2024-09-12T00:32:33.495 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=3 2024-09-12T00:32:33.495 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=4 2024-09-12T00:32:33.495 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=5 2024-09-12T00:32:33.495 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:32:33.363+0000 7f4199746800 20 add_watcher() i=6 2024-09-12T00:32:33.495 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:32:33.364+0000 7f4199746800 20 add_watcher() i=7 2024-09-12T00:32:33.495 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:32:33.364+0000 7f4199746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:33.495 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding auth protocol: cephx 2024-09-12T00:32:33.496 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding auth protocol: cephx 2024-09-12T00:32:33.496 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding auth protocol: cephx 2024-09-12T00:32:33.496 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: secure 2024-09-12T00:32:33.496 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: crc 2024-09-12T00:32:33.496 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: secure 2024-09-12T00:32:33.496 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: crc 2024-09-12T00:32:33.496 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: secure 2024-09-12T00:32:33.496 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: crc 2024-09-12T00:32:33.496 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: crc 2024-09-12T00:32:33.496 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: secure 2024-09-12T00:32:33.496 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: crc 2024-09-12T00:32:33.496 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: secure 2024-09-12T00:32:33.497 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: crc 2024-09-12T00:32:33.497 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:32:33.365+0000 7f404dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:33.497 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:32:33.365+0000 7f4199746800 5 AuthRegistry(0x7fff4ff6c560) adding con mode: secure 2024-09-12T00:32:33.497 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:32:33.366+0000 7f4199746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:33.497 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:32:33.366+0000 7f4199746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:33.497 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:32:33.366+0000 7f4199746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:33.497 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command cache list hook 0x563af7d2c730 2024-09-12T00:32:33.497 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command cache inspect hook 0x563af7d2c730 2024-09-12T00:32:33.497 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command cache erase hook 0x563af7d2c730 2024-09-12T00:32:33.497 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command cache zap hook 0x563af7d2c730 2024-09-12T00:32:33.497 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:32:33.366+0000 7f4199746800 5 note: GC not initialized 2024-09-12T00:32:33.497 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:32:33.366+0000 7f404cfe1640 20 reqs_thread_entry: start 2024-09-12T00:32:33.497 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command sync trace show hook 0x7f4190004ac0 2024-09-12T00:32:33.497 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command sync trace history hook 0x7f4190004ac0 2024-09-12T00:32:33.498 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command sync trace active hook 0x7f4190004ac0 2024-09-12T00:32:33.498 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:32:33.366+0000 7f4199746800 5 asok(0x563af7a4d630) register_command sync trace active_short hook 0x7f4190004ac0 2024-09-12T00:32:33.498 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:32:33.366+0000 7f4199746800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:33.498 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:32:33.366+0000 7f4199746800 20 Filter name: none 2024-09-12T00:32:33.498 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:32:33.366+0000 7f3fc67fc640 20 reqs_thread_entry: start 2024-09-12T00:32:33.498 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:32:33.366+0000 7f4199746800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:32:33.498 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:32:33.366+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.498 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:32:33.367+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:33.498 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:32:33.367+0000 7f4199746800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:32:33.498 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:32:33.367+0000 7f4199746800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:32:33.498 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:32:33.367+0000 7f4199746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 : miss 2024-09-12T00:32:33.498 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:32:33.367+0000 7f4199746800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.498 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:32:33.367+0000 7f4199746800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:33.499 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:32:33.367+0000 7f4199746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 info.flags=0x17 2024-09-12T00:32:33.499 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:32:33.367+0000 7f4199746800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 to cache LRU end 2024-09-12T00:32:33.499 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:32:33.367+0000 7f4199746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:33.499 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:32:33.367+0000 7f4199746800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:33.499 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:32:33.367+0000 7f4199746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 2024-09-12T00:32:33.499 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:32:33.370+0000 7f4199746800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4199746800 time 2024-09-12T00:32:33.370850+0000 2024-09-12T00:32:33.499 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:32:33.499 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.499 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:33.499 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f419cd8c71a] 2024-09-12T00:32:33.499 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f419cd8c8d8] 2024-09-12T00:32:33.499 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af56d0641] 2024-09-12T00:32:33.499 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd878e8) [0x563af5be28e8] 2024-09-12T00:32:33.500 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x563af56e031d] 2024-09-12T00:32:33.500 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:32:33.500 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f419ba29590] 2024-09-12T00:32:33.500 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:32:33.500 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:32:33.500 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.500 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:32:33.371+0000 7f4199746800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:32:33.500 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f4199746800 thread_name:radosgw-admin 2024-09-12T00:32:33.500 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.500 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:33.500 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f419ba3e6f0] 2024-09-12T00:32:33.500 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f419ba8b99c] 2024-09-12T00:32:33.500 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:32:33.501 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:32:33.501 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f419cd8c774] 2024-09-12T00:32:33.501 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f419cd8c8d8] 2024-09-12T00:32:33.501 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af56d0641] 2024-09-12T00:32:33.501 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd878e8) [0x563af5be28e8] 2024-09-12T00:32:33.501 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x563af56e031d] 2024-09-12T00:32:33.501 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:32:33.501 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f419ba29590] 2024-09-12T00:32:33.501 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:32:33.501 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:32:33.501 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:32:33.501 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.501 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:32:33.501 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:32:33.502 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:32:33.502 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:32:33.502 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:32:33.502 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:32:33.502 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:32:33.502 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:32:33.502 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:32:33.502 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:32:33.502 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:32:33.502 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:32:33.502 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:32:33.502 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:32:33.502 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:32:33.502 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:32:33.503 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:32:33.503 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:32:33.503 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:32:33.503 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:32:33.503 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:32:33.503 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:32:33.503 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:32:33.503 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:32:33.503 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:32:33.503 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:32:33.503 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:32:33.503 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:32:33.503 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:32:33.503 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:32:33.504 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:32:33.504 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:32:33.504 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:32:33.504 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:32:33.504 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:32:33.504 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:32:33.504 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:32:33.504 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:32:33.504 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:32:33.504 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:32:33.504 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:32:33.504 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:32:33.504 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:32:33.504 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:32:33.505 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:32:33.505 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:32:33.505 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:32:33.505 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:32:33.505 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:32:33.505 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:32:33.505 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:32:33.505 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:32:33.505 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:32:33.505 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:32:33.505 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:32:33.506 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:32:33.506 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:32:33.506 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:32:33.506 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:32:33.506 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:32:33.506 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:32:33.506 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:32:33.506 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:32:33.506 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:32:33.506 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:32:33.506 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:32:33.506 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:32:33.506 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:32:33.506 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:32:33.506 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:32:33.507 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:32:33.507 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:32:33.507 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:32:33.507 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:32:33.507 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:32:33.507 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:32:33.507 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:32:33.507 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:32:33.507 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:32:33.507 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:32:33.507 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:32:33.507 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:32:33.507 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:32:33.507 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:32:33.508 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:32:33.508 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:32:33.508 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:32:33.508 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:32:33.508 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:32:33.508 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:32:33.508 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:32:33.508 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:32:33.508 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:32:33.508 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:32:33.508 INFO:tasks.workunit.client.0.smithi133.stderr: 7f3fc67fc640 / http_manager 2024-09-12T00:32:33.508 INFO:tasks.workunit.client.0.smithi133.stderr: 7f404cfe1640 / http_manager 2024-09-12T00:32:33.508 INFO:tasks.workunit.client.0.smithi133.stderr: 7f404dfe3640 / rgw_dt_lg_renew 2024-09-12T00:32:33.508 INFO:tasks.workunit.client.0.smithi133.stderr: 7f40797fa640 / ms_dispatch 2024-09-12T00:32:33.509 INFO:tasks.workunit.client.0.smithi133.stderr: 7f407affd640 / io_context_pool 2024-09-12T00:32:33.509 INFO:tasks.workunit.client.0.smithi133.stderr: 7f4081602640 / ms_dispatch 2024-09-12T00:32:33.509 INFO:tasks.workunit.client.0.smithi133.stderr: 7f4083e07640 / ms_dispatch 2024-09-12T00:32:33.509 INFO:tasks.workunit.client.0.smithi133.stderr: 7f408560a640 / io_context_pool 2024-09-12T00:32:33.509 INFO:tasks.workunit.client.0.smithi133.stderr: 7f4196a36640 / msgr-worker-2 2024-09-12T00:32:33.509 INFO:tasks.workunit.client.0.smithi133.stderr: 7f4197237640 / msgr-worker-1 2024-09-12T00:32:33.509 INFO:tasks.workunit.client.0.smithi133.stderr: 7f4197a38640 / msgr-worker-0 2024-09-12T00:32:33.509 INFO:tasks.workunit.client.0.smithi133.stderr: 7f4198239640 / io_context_pool 2024-09-12T00:32:33.509 INFO:tasks.workunit.client.0.smithi133.stderr: 7f4199746800 / radosgw-admin 2024-09-12T00:32:33.509 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:32:33.509 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:32:33.509 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:32:33.372523Z_3c7b689f-9e5b-4bfa-bb1c-999063bbc55b/log 2024-09-12T00:32:33.509 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:32:33.510 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:32:33.511 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:33.511 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:33.511 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.447+0000 7fab01f15800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.511 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.449+0000 7fab01f15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.511 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.449+0000 7fab01f15800 20 realm 2024-09-12T00:32:33.511 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.449+0000 7fab01f15800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.449+0000 7fab01f15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.449+0000 7fab01f15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:33.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.449+0000 7fab01f15800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.449+0000 7fab01f15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.449+0000 7fab01f15800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.450+0000 7fab01f15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:33.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.450+0000 7fab01f15800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.451+0000 7fab01f15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:33.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.451+0000 7fab01f15800 20 searching for the correct realm 2024-09-12T00:32:33.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.453+0000 7faaf7fff640 0 -- 172.21.15.133:0/3271332887 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7faae806d070 msgr2=0x7faae80c7a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:33.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.658+0000 7faaf7fff640 0 -- 172.21.15.133:0/3271332887 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7faaf0076c00 msgr2=0x7faaf008a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:33.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.864+0000 7fab01f15800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:33.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.864+0000 7fab01f15800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:33.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.864+0000 7fab01f15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:33.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.864+0000 7fab01f15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:33.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.864+0000 7fab01f15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:33.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.864+0000 7fab01f15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:33.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.864+0000 7fab01f15800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.864+0000 7fab01f15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.864+0000 7fab01f15800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.865+0000 7fab01f15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:33.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.865+0000 7fab01f15800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.865+0000 7fab01f15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:33.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.865+0000 7fab01f15800 20 zone default found 2024-09-12T00:32:33.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.865+0000 7fab01f15800 4 Realm: () 2024-09-12T00:32:33.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.865+0000 7fab01f15800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:33.867 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.865+0000 7fab01f15800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:33.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.865+0000 7fab01f15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:33.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.865+0000 7fab01f15800 20 zonegroup default 2024-09-12T00:32:33.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.865+0000 7fab01f15800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.865+0000 7fab01f15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.865+0000 7fab01f15800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.866+0000 7fab01f15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.869 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.866+0000 7fab01f15800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.869 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.866+0000 7fab01f15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:33.869 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.866+0000 7fab01f15800 20 started sync module instance, tier type = 2024-09-12T00:32:33.869 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.866+0000 7fab01f15800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:33.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.875+0000 7fab01f15800 20 add_watcher() i=0 2024-09-12T00:32:33.874 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.875+0000 7fab01f15800 20 add_watcher() i=1 2024-09-12T00:32:33.874 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.875+0000 7fab01f15800 20 add_watcher() i=2 2024-09-12T00:32:33.874 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.875+0000 7fab01f15800 20 add_watcher() i=3 2024-09-12T00:32:33.874 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.875+0000 7fab01f15800 20 add_watcher() i=4 2024-09-12T00:32:33.874 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.875+0000 7fab01f15800 20 add_watcher() i=5 2024-09-12T00:32:33.874 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.875+0000 7fab01f15800 20 add_watcher() i=6 2024-09-12T00:32:33.874 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.876+0000 7fab01f15800 20 add_watcher() i=7 2024-09-12T00:32:33.874 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.876+0000 7fab01f15800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:33.876 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.878+0000 7fa9b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:33.877 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.878+0000 7fab01f15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:33.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.878+0000 7fab01f15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:33.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.878+0000 7fab01f15800 5 note: GC not initialized 2024-09-12T00:32:33.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.879+0000 7fa9b4fe1640 20 reqs_thread_entry: start 2024-09-12T00:32:33.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.879+0000 7fab01f15800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:33.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.879+0000 7fab01f15800 20 Filter name: none 2024-09-12T00:32:33.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.879+0000 7fa92e7fc640 20 reqs_thread_entry: start 2024-09-12T00:32:33.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.879+0000 7fab01f15800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.879+0000 7fab01f15800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:33.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.879+0000 7fab01f15800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.880+0000 7fab01f15800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:33.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.880+0000 7fab01f15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:33.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.880+0000 7fab01f15800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.880+0000 7fab01f15800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:33.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.880+0000 7fab01f15800 20 rados->read ofs=0 len=0 2024-09-12T00:32:33.880 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.881+0000 7fab01f15800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:33.880 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.881+0000 7fab01f15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:33.880 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.882+0000 7fa9b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:33.882 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.884+0000 7fab01f15800 20 remove_watcher() i=0 2024-09-12T00:32:33.882 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.884+0000 7fab01f15800 2 removed watcher, disabling cache 2024-09-12T00:32:33.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.885+0000 7fab01f15800 20 remove_watcher() i=1 2024-09-12T00:32:33.884 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.886+0000 7fab01f15800 20 remove_watcher() i=2 2024-09-12T00:32:33.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.887+0000 7fab01f15800 20 remove_watcher() i=3 2024-09-12T00:32:33.886 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.888+0000 7fab01f15800 20 remove_watcher() i=4 2024-09-12T00:32:33.887 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.889+0000 7fab01f15800 20 remove_watcher() i=5 2024-09-12T00:32:33.889 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.890+0000 7fab01f15800 20 remove_watcher() i=6 2024-09-12T00:32:33.890 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:33.891+0000 7fab01f15800 20 remove_watcher() i=7 2024-09-12T00:32:33.901 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.901 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:32:33.901 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-set-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:32:33.901 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:32:33.990 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:32:34.021 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:34.021 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:34.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.060+0000 7fad02e10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:34.061 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.062+0000 7fad02e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:34.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.062+0000 7fad02e10800 20 realm 2024-09-12T00:32:34.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.062+0000 7fad02e10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:34.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.062+0000 7fad02e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:34.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.062+0000 7fad02e10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:34.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.062+0000 7fad02e10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:34.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.062+0000 7fad02e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:34.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.062+0000 7fad02e10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:34.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.063+0000 7fad02e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:34.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.063+0000 7fad02e10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:34.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.063+0000 7fad02e10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:34.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.063+0000 7fad02e10800 20 searching for the correct realm 2024-09-12T00:32:34.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.066+0000 7facfed7b640 0 -- 172.21.15.133:0/19163779 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7facf8087b60 msgr2=0x7facf8069930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:34.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.271+0000 7facfe57a640 0 -- 172.21.15.133:0/19163779 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x555ba2ac01b0 msgr2=0x555ba2ac2600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:34.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.275+0000 7fad02e10800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:32:34.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.275+0000 7fad02e10800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:32:34.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.275+0000 7fad02e10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:34.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.275+0000 7fad02e10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:34.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.275+0000 7fad02e10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:34.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.275+0000 7fad02e10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:34.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.275+0000 7fad02e10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:34.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.275+0000 7fad02e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:34.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.275+0000 7fad02e10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:34.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.276+0000 7fad02e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:34.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.276+0000 7fad02e10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:34.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.276+0000 7fad02e10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:34.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.276+0000 7fad02e10800 20 zone default found 2024-09-12T00:32:34.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.276+0000 7fad02e10800 4 Realm: () 2024-09-12T00:32:34.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.276+0000 7fad02e10800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:32:34.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.276+0000 7fad02e10800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:32:34.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.276+0000 7fad02e10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:34.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.276+0000 7fad02e10800 20 zonegroup default 2024-09-12T00:32:34.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.276+0000 7fad02e10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:34.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.277+0000 7fad02e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:34.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.277+0000 7fad02e10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:34.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.277+0000 7fad02e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:34.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.277+0000 7fad02e10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:34.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.277+0000 7fad02e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:34.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.277+0000 7fad02e10800 20 started sync module instance, tier type = 2024-09-12T00:32:34.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.277+0000 7fad02e10800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:32:34.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.286+0000 7fad02e10800 20 add_watcher() i=0 2024-09-12T00:32:34.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.286+0000 7fad02e10800 20 add_watcher() i=1 2024-09-12T00:32:34.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.286+0000 7fad02e10800 20 add_watcher() i=2 2024-09-12T00:32:34.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.286+0000 7fad02e10800 20 add_watcher() i=3 2024-09-12T00:32:34.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.286+0000 7fad02e10800 20 add_watcher() i=4 2024-09-12T00:32:34.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.286+0000 7fad02e10800 20 add_watcher() i=5 2024-09-12T00:32:34.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.286+0000 7fad02e10800 20 add_watcher() i=6 2024-09-12T00:32:34.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.287+0000 7fad02e10800 20 add_watcher() i=7 2024-09-12T00:32:34.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.287+0000 7fad02e10800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:34.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.289+0000 7fabb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:34.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.289+0000 7fad02e10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:34.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.289+0000 7fad02e10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:34.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.290+0000 7fad02e10800 5 note: GC not initialized 2024-09-12T00:32:34.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.290+0000 7fab2f7fe640 20 reqs_thread_entry: start 2024-09-12T00:32:34.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.290+0000 7fad02e10800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:34.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.290+0000 7fad02e10800 20 Filter name: none 2024-09-12T00:32:34.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.290+0000 7fab2d7fa640 20 reqs_thread_entry: start 2024-09-12T00:32:34.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.290+0000 7fad02e10800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:32:34.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.290+0000 7fad02e10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:34.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.291+0000 7fad02e10800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:32:34.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.291+0000 7fad02e10800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:32:34.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.291+0000 7fad02e10800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:32:34.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.291+0000 7fad02e10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 : miss 2024-09-12T00:32:34.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.291+0000 7fad02e10800 20 rados->read ofs=0 len=0 2024-09-12T00:32:34.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.291+0000 7fad02e10800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:32:34.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.291+0000 7fad02e10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 info.flags=0x17 2024-09-12T00:32:34.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.291+0000 7fad02e10800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 to cache LRU end 2024-09-12T00:32:34.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.291+0000 7fad02e10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:34.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.291+0000 7fad02e10800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:32:34.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.291+0000 7fad02e10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 2024-09-12T00:32:34.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.292+0000 7fad02e10800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 to be held by another RGW process; skipping for now 2024-09-12T00:32:34.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.293+0000 7fabb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:34.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.295+0000 7fad02e10800 20 remove_watcher() i=0 2024-09-12T00:32:34.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.295+0000 7fad02e10800 2 removed watcher, disabling cache 2024-09-12T00:32:34.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.296+0000 7fad02e10800 20 remove_watcher() i=1 2024-09-12T00:32:34.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.297+0000 7fad02e10800 20 remove_watcher() i=2 2024-09-12T00:32:34.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.298+0000 7fad02e10800 20 remove_watcher() i=3 2024-09-12T00:32:34.298 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.299+0000 7fad02e10800 20 remove_watcher() i=4 2024-09-12T00:32:34.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.300+0000 7fad02e10800 20 remove_watcher() i=5 2024-09-12T00:32:34.300 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.301+0000 7fad02e10800 20 remove_watcher() i=6 2024-09-12T00:32:34.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:32:34.302+0000 7fad02e10800 20 remove_watcher() i=7 2024-09-12T00:32:34.311 INFO:tasks.workunit.client.0.smithi133.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:33:04.340 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:33:04.376 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:04.376 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:04.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.418+0000 7f886a135800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.419+0000 7f886a135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:04.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.419+0000 7f886a135800 20 realm 2024-09-12T00:33:04.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.419+0000 7f886a135800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.420+0000 7f886a135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:04.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.420+0000 7f886a135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:04.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.420+0000 7f886a135800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.420+0000 7f886a135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:04.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.420+0000 7f886a135800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.421+0000 7f886a135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:04.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.421+0000 7f886a135800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.421+0000 7f886a135800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:04.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.422+0000 7f886a135800 20 searching for the correct realm 2024-09-12T00:33:04.424 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.424+0000 7f886667e640 0 -- 172.21.15.133:0/257161693 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x563183449610 msgr2=0x56318344ba20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:04.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.428+0000 7f886567c640 0 -- 172.21.15.133:0/257161693 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f8858027040 msgr2=0x7f8858027930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:04.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.635+0000 7f886a135800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:04.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.635+0000 7f886a135800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:04.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.635+0000 7f886a135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:04.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.635+0000 7f886a135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:04.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.635+0000 7f886a135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:04.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.635+0000 7f886a135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:04.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.635+0000 7f886a135800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.635+0000 7f886a135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:04.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.635+0000 7f886a135800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.635+0000 7f886a135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:04.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.635+0000 7f886a135800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.636+0000 7f886a135800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:04.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.636+0000 7f886a135800 20 zone default found 2024-09-12T00:33:04.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.636+0000 7f886a135800 4 Realm: () 2024-09-12T00:33:04.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.636+0000 7f886a135800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:04.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.636+0000 7f886a135800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:04.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.636+0000 7f886a135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:04.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.636+0000 7f886a135800 20 zonegroup default 2024-09-12T00:33:04.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.636+0000 7f886a135800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.636+0000 7f886a135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:04.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.636+0000 7f886a135800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.637+0000 7f886a135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:04.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.637+0000 7f886a135800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.637+0000 7f886a135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:04.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.637+0000 7f886a135800 20 started sync module instance, tier type = 2024-09-12T00:33:04.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.637+0000 7f886a135800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:04.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.648+0000 7f886a135800 20 add_watcher() i=0 2024-09-12T00:33:04.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.648+0000 7f886a135800 20 add_watcher() i=1 2024-09-12T00:33:04.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.648+0000 7f886a135800 20 add_watcher() i=2 2024-09-12T00:33:04.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.648+0000 7f886a135800 20 add_watcher() i=3 2024-09-12T00:33:04.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.648+0000 7f886a135800 20 add_watcher() i=4 2024-09-12T00:33:04.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.648+0000 7f886a135800 20 add_watcher() i=5 2024-09-12T00:33:04.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.648+0000 7f886a135800 20 add_watcher() i=6 2024-09-12T00:33:04.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.649+0000 7f886a135800 20 add_watcher() i=7 2024-09-12T00:33:04.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.649+0000 7f886a135800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:04.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.651+0000 7f8717fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:04.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.652+0000 7f886a135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:04.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.652+0000 7f886a135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:04.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.652+0000 7f886a135800 5 note: GC not initialized 2024-09-12T00:33:04.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.652+0000 7f8716ffd640 20 reqs_thread_entry: start 2024-09-12T00:33:04.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.652+0000 7f886a135800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:04.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.652+0000 7f886a135800 20 Filter name: none 2024-09-12T00:33:04.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.652+0000 7f8714ff9640 20 reqs_thread_entry: start 2024-09-12T00:33:04.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.652+0000 7f886a135800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:33:04.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.652+0000 7f886a135800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.653+0000 7f886a135800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:33:04.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.653+0000 7f886a135800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:33:04.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.653+0000 7f886a135800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:33:04.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.653+0000 7f886a135800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 : miss 2024-09-12T00:33:04.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.653+0000 7f886a135800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.654+0000 7f886a135800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:33:04.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.654+0000 7f886a135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 info.flags=0x17 2024-09-12T00:33:04.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.654+0000 7f886a135800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 to cache LRU end 2024-09-12T00:33:04.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.654+0000 7f886a135800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:04.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.654+0000 7f886a135800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:04.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.654+0000 7f886a135800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 2024-09-12T00:33:04.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.658+0000 7f886a135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 info.flags=0x17 2024-09-12T00:33:04.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.658+0000 7f886a135800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 to cache LRU end 2024-09-12T00:33:04.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.658+0000 7f886a135800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:04.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.658+0000 7f886a135800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25, ofs0, ns] 2024-09-12T00:33:04.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.658+0000 7f87497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 94770655721632 notifier 6768 bl.length()=1009 2024-09-12T00:33:04.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.658+0000 7f87497fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 info.flags=0x17 2024-09-12T00:33:04.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.658+0000 7f87497fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 to cache LRU end 2024-09-12T00:33:04.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.658+0000 7f87497fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:04.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.660+0000 7f886a135800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25]): orig_sources= new_sources= 2024-09-12T00:33:04.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.660+0000 7f886a135800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25]): potential sources added=[] removed=[] 2024-09-12T00:33:04.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.660+0000 7f886a135800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25]): orig_dests= new_dests= 2024-09-12T00:33:04.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.660+0000 7f886a135800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25]): potential dests added=[] removed=[] 2024-09-12T00:33:04.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.662+0000 7f886a135800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25.1.0 2024-09-12T00:33:04.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.662+0000 7f886a135800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25.1.0 2024-09-12T00:33:04.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.662+0000 7f886a135800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25.1.1 2024-09-12T00:33:04.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.662+0000 7f886a135800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25.1.1 2024-09-12T00:33:04.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.662+0000 7f886a135800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25.0 2024-09-12T00:33:04.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.665+0000 7f886a135800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:04.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.665+0000 7f886a135800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 2024-09-12T00:33:04.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.667+0000 7f886a135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 info.flags=0x17 2024-09-12T00:33:04.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.667+0000 7f886a135800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 to cache LRU end 2024-09-12T00:33:04.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.667+0000 7f886a135800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:04.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.667+0000 7f886a135800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25, ofs0, ns] 2024-09-12T00:33:04.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.668+0000 7f87497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497038 cookie 94770655721632 notifier 6768 bl.length()=1009 2024-09-12T00:33:04.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.668+0000 7f87497fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 info.flags=0x17 2024-09-12T00:33:04.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.668+0000 7f87497fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 to cache LRU end 2024-09-12T00:33:04.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.668+0000 7f87497fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:04.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.669+0000 7f886a135800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25]): orig_sources= new_sources= 2024-09-12T00:33:04.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.669+0000 7f886a135800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25]): potential sources added=[] removed=[] 2024-09-12T00:33:04.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.669+0000 7f886a135800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25]): orig_dests= new_dests= 2024-09-12T00:33:04.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.669+0000 7f886a135800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25]): potential dests added=[] removed=[] 2024-09-12T00:33:04.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.671+0000 7f886a135800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25.0 2024-09-12T00:33:04.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.671+0000 7f886a135800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:04.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.671+0000 7f886a135800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 2024-09-12T00:33:04.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.672+0000 7f886a135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 info.flags=0x17 2024-09-12T00:33:04.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.672+0000 7f886a135800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 to cache LRU end 2024-09-12T00:33:04.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.672+0000 7f886a135800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:04.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.672+0000 7f886a135800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25, ofs0, ns] 2024-09-12T00:33:04.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.673+0000 7f8748ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497039 cookie 94770655721632 notifier 6768 bl.length()=977 2024-09-12T00:33:04.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.673+0000 7f8748ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 info.flags=0x17 2024-09-12T00:33:04.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.673+0000 7f8748ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 to cache LRU end 2024-09-12T00:33:04.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.673+0000 7f8748ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:04.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.675+0000 7f886a135800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25]): orig_sources= new_sources= 2024-09-12T00:33:04.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.675+0000 7f886a135800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25]): potential sources added=[] removed=[] 2024-09-12T00:33:04.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.675+0000 7f886a135800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25]): orig_dests= new_dests= 2024-09-12T00:33:04.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.675+0000 7f886a135800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25]): potential dests added=[] removed=[] 2024-09-12T00:33:04.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.676+0000 7f886a135800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:33:04.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.678+0000 7f8717fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:04.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.680+0000 7f886a135800 20 remove_watcher() i=0 2024-09-12T00:33:04.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.680+0000 7f886a135800 2 removed watcher, disabling cache 2024-09-12T00:33:04.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.682+0000 7f886a135800 20 remove_watcher() i=1 2024-09-12T00:33:04.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.683+0000 7f886a135800 20 remove_watcher() i=2 2024-09-12T00:33:04.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.684+0000 7f886a135800 20 remove_watcher() i=3 2024-09-12T00:33:04.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.685+0000 7f886a135800 20 remove_watcher() i=4 2024-09-12T00:33:04.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.686+0000 7f886a135800 20 remove_watcher() i=5 2024-09-12T00:33:04.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.688+0000 7f886a135800 20 remove_watcher() i=6 2024-09-12T00:33:04.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.689+0000 7f886a135800 20 remove_watcher() i=7 2024-09-12T00:33:04.701 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:33:04.731 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:04.732 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:04.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.769+0000 7f8031740800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.772+0000 7f8031740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:04.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.772+0000 7f8031740800 20 realm 2024-09-12T00:33:04.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.772+0000 7f8031740800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.772+0000 7f8031740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:04.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.772+0000 7f8031740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:04.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.772+0000 7f8031740800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.772+0000 7f8031740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:04.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.772+0000 7f8031740800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.773+0000 7f8031740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:04.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.773+0000 7f8031740800 20 rados->read ofs=0 len=0 2024-09-12T00:33:04.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.774+0000 7f8031740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:04.774 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.774+0000 7f8031740800 20 searching for the correct realm 2024-09-12T00:33:04.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.776+0000 7f8027fff640 0 -- 172.21.15.133:0/3731347958 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f8018042bb0 msgr2=0x7f801808d320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:04.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:04.981+0000 7f8027fff640 0 -- 172.21.15.133:0/3731347958 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f8020022070 msgr2=0x7f8020023400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:05.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.188+0000 7f8031740800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:05.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.188+0000 7f8031740800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:05.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.188+0000 7f8031740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:05.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.188+0000 7f8031740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:05.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.188+0000 7f8031740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:05.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.188+0000 7f8031740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:05.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.188+0000 7f8031740800 20 rados->read ofs=0 len=0 2024-09-12T00:33:05.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.188+0000 7f8031740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:05.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.188+0000 7f8031740800 20 rados->read ofs=0 len=0 2024-09-12T00:33:05.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.189+0000 7f8031740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:05.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.189+0000 7f8031740800 20 rados->read ofs=0 len=0 2024-09-12T00:33:05.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.189+0000 7f8031740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:05.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.189+0000 7f8031740800 20 zone default found 2024-09-12T00:33:05.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.189+0000 7f8031740800 4 Realm: () 2024-09-12T00:33:05.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.189+0000 7f8031740800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:05.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.189+0000 7f8031740800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:05.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.189+0000 7f8031740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:05.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.189+0000 7f8031740800 20 zonegroup default 2024-09-12T00:33:05.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.189+0000 7f8031740800 20 rados->read ofs=0 len=0 2024-09-12T00:33:05.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.189+0000 7f8031740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:05.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.189+0000 7f8031740800 20 rados->read ofs=0 len=0 2024-09-12T00:33:05.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.190+0000 7f8031740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:05.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.190+0000 7f8031740800 20 rados->read ofs=0 len=0 2024-09-12T00:33:05.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.190+0000 7f8031740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:05.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.190+0000 7f8031740800 20 started sync module instance, tier type = 2024-09-12T00:33:05.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.190+0000 7f8031740800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:05.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.200+0000 7f8031740800 20 add_watcher() i=0 2024-09-12T00:33:05.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.200+0000 7f8031740800 20 add_watcher() i=1 2024-09-12T00:33:05.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.200+0000 7f8031740800 20 add_watcher() i=2 2024-09-12T00:33:05.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.200+0000 7f8031740800 20 add_watcher() i=3 2024-09-12T00:33:05.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.200+0000 7f8031740800 20 add_watcher() i=4 2024-09-12T00:33:05.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.200+0000 7f8031740800 20 add_watcher() i=5 2024-09-12T00:33:05.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.200+0000 7f8031740800 20 add_watcher() i=6 2024-09-12T00:33:05.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.201+0000 7f8031740800 20 add_watcher() i=7 2024-09-12T00:33:05.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.201+0000 7f8031740800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:05.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.203+0000 7f7ee37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:05.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.204+0000 7f8031740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:05.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.204+0000 7f8031740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:05.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.204+0000 7f8031740800 5 note: GC not initialized 2024-09-12T00:33:05.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.204+0000 7f7ee27e4640 20 reqs_thread_entry: start 2024-09-12T00:33:05.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.204+0000 7f8031740800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:05.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.204+0000 7f8031740800 20 Filter name: none 2024-09-12T00:33:05.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.204+0000 7f7e53fff640 20 reqs_thread_entry: start 2024-09-12T00:33:05.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.204+0000 7f8031740800 20 rados->read ofs=0 len=0 2024-09-12T00:33:05.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.204+0000 7f8031740800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:33:05.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.204+0000 7f8031740800 20 rados->read ofs=0 len=0 2024-09-12T00:33:05.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.206+0000 7f8031740800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:33:05.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.206+0000 7f8031740800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:05.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.206+0000 7f8031740800 20 rados->read ofs=0 len=0 2024-09-12T00:33:05.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.206+0000 7f8031740800 20 rados_obj.operate() r=0 bl.length=218 2024-09-12T00:33:05.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.206+0000 7f8031740800 20 rados->read ofs=0 len=0 2024-09-12T00:33:05.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.206+0000 7f8031740800 20 rados_obj.operate() r=0 bl.length=440 2024-09-12T00:33:05.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.206+0000 7f8031740800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:05.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.208+0000 7f7ee37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:05.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.210+0000 7f8031740800 20 remove_watcher() i=0 2024-09-12T00:33:05.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.210+0000 7f8031740800 2 removed watcher, disabling cache 2024-09-12T00:33:05.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.211+0000 7f8031740800 20 remove_watcher() i=1 2024-09-12T00:33:05.211 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.212+0000 7f8031740800 20 remove_watcher() i=2 2024-09-12T00:33:05.213 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.213+0000 7f8031740800 20 remove_watcher() i=3 2024-09-12T00:33:05.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.214+0000 7f8031740800 20 remove_watcher() i=4 2024-09-12T00:33:05.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.215+0000 7f8031740800 20 remove_watcher() i=5 2024-09-12T00:33:05.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.216+0000 7f8031740800 20 remove_watcher() i=6 2024-09-12T00:33:05.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:05.217+0000 7f8031740800 20 remove_watcher() i=7 2024-09-12T00:33:05.227 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:05.227 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:33:05.227 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-set-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:33:05.228 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:05.517 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T00:33:05.517 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:06.337 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:33:06.365 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:06.365 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:06.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.401+0000 7fa93af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.403+0000 7fa93af2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:06.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.403+0000 7fa93af2f800 20 realm 2024-09-12T00:33:06.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.403+0000 7fa93af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.403+0000 7fa93af2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:06.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.403+0000 7fa93af2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:06.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.403+0000 7fa93af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.404+0000 7fa93af2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:06.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.404+0000 7fa93af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.404+0000 7fa93af2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:06.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.404+0000 7fa93af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.405+0000 7fa93af2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:06.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.405+0000 7fa93af2f800 20 searching for the correct realm 2024-09-12T00:33:06.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.407+0000 7fa92e419640 0 -- 172.21.15.133:0/2168883426 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fa9200a7c20 msgr2=0x7fa9200bf920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:06.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.410+0000 7fa92e419640 0 -- 172.21.15.133:0/2168883426 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fa928008070 msgr2=0x7fa9280323f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:06.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.616+0000 7fa93af2f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:06.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.616+0000 7fa93af2f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:06.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.616+0000 7fa93af2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:06.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.616+0000 7fa93af2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:06.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.616+0000 7fa93af2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:06.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.616+0000 7fa93af2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:06.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.616+0000 7fa93af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.616+0000 7fa93af2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:06.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.616+0000 7fa93af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.616+0000 7fa93af2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:06.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.616+0000 7fa93af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.617+0000 7fa93af2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:06.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.617+0000 7fa93af2f800 20 zone default found 2024-09-12T00:33:06.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.617+0000 7fa93af2f800 4 Realm: () 2024-09-12T00:33:06.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.617+0000 7fa93af2f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:06.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.617+0000 7fa93af2f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:06.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.617+0000 7fa93af2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:06.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.617+0000 7fa93af2f800 20 zonegroup default 2024-09-12T00:33:06.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.617+0000 7fa93af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.617+0000 7fa93af2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:06.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.617+0000 7fa93af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.617+0000 7fa93af2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:06.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.617+0000 7fa93af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.618+0000 7fa93af2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:06.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.618+0000 7fa93af2f800 20 started sync module instance, tier type = 2024-09-12T00:33:06.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.618+0000 7fa93af2f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:06.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.626+0000 7fa93af2f800 20 add_watcher() i=0 2024-09-12T00:33:06.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.626+0000 7fa93af2f800 20 add_watcher() i=1 2024-09-12T00:33:06.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.626+0000 7fa93af2f800 20 add_watcher() i=2 2024-09-12T00:33:06.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.626+0000 7fa93af2f800 20 add_watcher() i=3 2024-09-12T00:33:06.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.626+0000 7fa93af2f800 20 add_watcher() i=4 2024-09-12T00:33:06.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.626+0000 7fa93af2f800 20 add_watcher() i=5 2024-09-12T00:33:06.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.626+0000 7fa93af2f800 20 add_watcher() i=6 2024-09-12T00:33:06.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.627+0000 7fa93af2f800 20 add_watcher() i=7 2024-09-12T00:33:06.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.627+0000 7fa93af2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:06.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.629+0000 7fa7ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:06.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.630+0000 7fa93af2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:06.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.630+0000 7fa93af2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:06.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.630+0000 7fa93af2f800 5 note: GC not initialized 2024-09-12T00:33:06.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.630+0000 7fa767fff640 20 reqs_thread_entry: start 2024-09-12T00:33:06.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.630+0000 7fa93af2f800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:06.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.630+0000 7fa93af2f800 20 Filter name: none 2024-09-12T00:33:06.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.630+0000 7fa765ffb640 20 reqs_thread_entry: start 2024-09-12T00:33:06.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.630+0000 7fa93af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.631+0000 7fa93af2f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:06.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.631+0000 7fa93af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.631+0000 7fa93af2f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:06.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.631+0000 7fa93af2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:06.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.631+0000 7fa93af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.632+0000 7fa93af2f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:06.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.632+0000 7fa93af2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.632+0000 7fa93af2f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:06.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.632+0000 7fa93af2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:06.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.633+0000 7fa7ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:06.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.635+0000 7fa93af2f800 20 remove_watcher() i=0 2024-09-12T00:33:06.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.635+0000 7fa93af2f800 2 removed watcher, disabling cache 2024-09-12T00:33:06.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.636+0000 7fa93af2f800 20 remove_watcher() i=1 2024-09-12T00:33:06.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.637+0000 7fa93af2f800 20 remove_watcher() i=2 2024-09-12T00:33:06.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.638+0000 7fa93af2f800 20 remove_watcher() i=3 2024-09-12T00:33:06.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.639+0000 7fa93af2f800 20 remove_watcher() i=4 2024-09-12T00:33:06.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.640+0000 7fa93af2f800 20 remove_watcher() i=5 2024-09-12T00:33:06.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.641+0000 7fa93af2f800 20 remove_watcher() i=6 2024-09-12T00:33:06.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.642+0000 7fa93af2f800 20 remove_watcher() i=7 2024-09-12T00:33:06.652 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:06.652 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:33:06.652 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-trim-reshard-log-entries id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:33:06.653 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:06.654 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T00:33:06.688 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:06.688 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:06.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.725+0000 7ff85031f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.727+0000 7ff85031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:06.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.727+0000 7ff85031f800 20 realm 2024-09-12T00:33:06.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.727+0000 7ff85031f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.727+0000 7ff85031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:06.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.727+0000 7ff85031f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:06.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.727+0000 7ff85031f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.727+0000 7ff85031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:06.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.727+0000 7ff85031f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.728+0000 7ff85031f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:06.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.728+0000 7ff85031f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:06.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.729+0000 7ff85031f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:06.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.729+0000 7ff85031f800 20 searching for the correct realm 2024-09-12T00:33:06.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.730+0000 7ff843fff640 0 -- 172.21.15.133:0/1053945115 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff8340701b0 msgr2=0x7ff834068410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:06.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:06.934+0000 7ff843fff640 0 -- 172.21.15.133:0/1053945115 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff83c0cf020 msgr2=0x7ff83c056ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:07.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.140+0000 7ff85031f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:07.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.140+0000 7ff85031f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:07.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.140+0000 7ff85031f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:07.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.140+0000 7ff85031f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:07.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.140+0000 7ff85031f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:07.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.140+0000 7ff85031f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:07.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.141+0000 7ff85031f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.141+0000 7ff85031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:07.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.141+0000 7ff85031f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.141+0000 7ff85031f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:07.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.141+0000 7ff85031f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.141+0000 7ff85031f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:07.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.141+0000 7ff85031f800 20 zone default found 2024-09-12T00:33:07.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.141+0000 7ff85031f800 4 Realm: () 2024-09-12T00:33:07.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.141+0000 7ff85031f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:07.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.141+0000 7ff85031f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:07.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.141+0000 7ff85031f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:07.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.141+0000 7ff85031f800 20 zonegroup default 2024-09-12T00:33:07.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.142+0000 7ff85031f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.142+0000 7ff85031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:07.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.142+0000 7ff85031f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.142+0000 7ff85031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:07.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.142+0000 7ff85031f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.142+0000 7ff85031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:07.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.143+0000 7ff85031f800 20 started sync module instance, tier type = 2024-09-12T00:33:07.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.143+0000 7ff85031f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:07.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.151+0000 7ff85031f800 20 add_watcher() i=0 2024-09-12T00:33:07.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.151+0000 7ff85031f800 20 add_watcher() i=1 2024-09-12T00:33:07.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.151+0000 7ff85031f800 20 add_watcher() i=2 2024-09-12T00:33:07.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.151+0000 7ff85031f800 20 add_watcher() i=3 2024-09-12T00:33:07.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.151+0000 7ff85031f800 20 add_watcher() i=4 2024-09-12T00:33:07.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.151+0000 7ff85031f800 20 add_watcher() i=5 2024-09-12T00:33:07.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.151+0000 7ff85031f800 20 add_watcher() i=6 2024-09-12T00:33:07.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.152+0000 7ff85031f800 20 add_watcher() i=7 2024-09-12T00:33:07.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.152+0000 7ff85031f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:07.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.155+0000 7ff702fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:07.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.155+0000 7ff85031f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:07.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.155+0000 7ff85031f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:07.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.155+0000 7ff85031f800 5 note: GC not initialized 2024-09-12T00:33:07.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.156+0000 7ff701fdb640 20 reqs_thread_entry: start 2024-09-12T00:33:07.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.156+0000 7ff85031f800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:07.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.156+0000 7ff85031f800 20 Filter name: none 2024-09-12T00:33:07.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.156+0000 7ff6737fe640 20 reqs_thread_entry: start 2024-09-12T00:33:07.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.156+0000 7ff85031f800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:33:07.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.156+0000 7ff85031f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.156+0000 7ff85031f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:07.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.156+0000 7ff85031f800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:33:07.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.156+0000 7ff85031f800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:33:07.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.156+0000 7ff85031f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 : miss 2024-09-12T00:33:07.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.156+0000 7ff85031f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.157+0000 7ff85031f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:07.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.157+0000 7ff85031f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 info.flags=0x17 2024-09-12T00:33:07.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.157+0000 7ff85031f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 to cache LRU end 2024-09-12T00:33:07.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.157+0000 7ff85031f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:07.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.157+0000 7ff85031f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:07.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.157+0000 7ff85031f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 2024-09-12T00:33:07.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.161+0000 7ff85031f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 info.flags=0x17 2024-09-12T00:33:07.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.161+0000 7ff85031f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 to cache LRU end 2024-09-12T00:33:07.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.161+0000 7ff85031f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:07.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.161+0000 7ff85031f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26, ofs0, ns] 2024-09-12T00:33:07.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.161+0000 7ff7237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94001830380848 notifier 6467 bl.length()=1023 2024-09-12T00:33:07.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.161+0000 7ff7237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 info.flags=0x17 2024-09-12T00:33:07.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.161+0000 7ff7237fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 to cache LRU end 2024-09-12T00:33:07.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.161+0000 7ff7237fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:07.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.163+0000 7ff85031f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): orig_sources= new_sources= 2024-09-12T00:33:07.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.163+0000 7ff85031f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): potential sources added=[] removed=[] 2024-09-12T00:33:07.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.163+0000 7ff85031f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): orig_dests= new_dests= 2024-09-12T00:33:07.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.163+0000 7ff85031f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): potential dests added=[] removed=[] 2024-09-12T00:33:07.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.163+0000 7ff85031f800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T00:33:07.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.163+0000 7ff85031f800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T00:33:07.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.165+0000 7ff702fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:07.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.167+0000 7ff85031f800 20 remove_watcher() i=0 2024-09-12T00:33:07.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.167+0000 7ff85031f800 2 removed watcher, disabling cache 2024-09-12T00:33:07.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.168+0000 7ff85031f800 20 remove_watcher() i=1 2024-09-12T00:33:07.169 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.169+0000 7ff85031f800 20 remove_watcher() i=2 2024-09-12T00:33:07.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.170+0000 7ff85031f800 20 remove_watcher() i=3 2024-09-12T00:33:07.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.171+0000 7ff85031f800 20 remove_watcher() i=4 2024-09-12T00:33:07.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.172+0000 7ff85031f800 20 remove_watcher() i=5 2024-09-12T00:33:07.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.173+0000 7ff85031f800 20 remove_watcher() i=6 2024-09-12T00:33:07.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.174+0000 7ff85031f800 20 remove_watcher() i=7 2024-09-12T00:33:07.186 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:33:07.215 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:07.215 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:07.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.252+0000 7f0c77b37800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.254+0000 7f0c77b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:07.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.254+0000 7f0c77b37800 20 realm 2024-09-12T00:33:07.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.254+0000 7f0c77b37800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.254+0000 7f0c77b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:07.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.254+0000 7f0c77b37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:07.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.254+0000 7f0c77b37800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.254+0000 7f0c77b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:07.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.254+0000 7f0c77b37800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.255+0000 7f0c77b37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:07.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.255+0000 7f0c77b37800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.256+0000 7f0c77b37800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:07.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.256+0000 7f0c77b37800 20 searching for the correct realm 2024-09-12T00:33:07.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.257+0000 7f0c6b020640 0 -- 172.21.15.133:0/3241145516 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f0c5c046450 msgr2=0x7f0c5c0468b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:07.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.462+0000 7f0c6b020640 0 -- 172.21.15.133:0/3241145516 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f0c64024070 msgr2=0x7f0c640614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:07.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.668+0000 7f0c77b37800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:07.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.668+0000 7f0c77b37800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:07.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.668+0000 7f0c77b37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:07.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.668+0000 7f0c77b37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:07.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.668+0000 7f0c77b37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:07.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.668+0000 7f0c77b37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:07.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.668+0000 7f0c77b37800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.668+0000 7f0c77b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:07.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.668+0000 7f0c77b37800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.668+0000 7f0c77b37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:07.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.668+0000 7f0c77b37800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.669+0000 7f0c77b37800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:07.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.669+0000 7f0c77b37800 20 zone default found 2024-09-12T00:33:07.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.669+0000 7f0c77b37800 4 Realm: () 2024-09-12T00:33:07.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.669+0000 7f0c77b37800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:07.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.669+0000 7f0c77b37800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:07.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.669+0000 7f0c77b37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:07.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.669+0000 7f0c77b37800 20 zonegroup default 2024-09-12T00:33:07.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.669+0000 7f0c77b37800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.669+0000 7f0c77b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:07.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.669+0000 7f0c77b37800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.669+0000 7f0c77b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:07.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.669+0000 7f0c77b37800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.670+0000 7f0c77b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:07.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.670+0000 7f0c77b37800 20 started sync module instance, tier type = 2024-09-12T00:33:07.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.670+0000 7f0c77b37800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:07.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.682+0000 7f0c77b37800 20 add_watcher() i=0 2024-09-12T00:33:07.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.682+0000 7f0c77b37800 20 add_watcher() i=1 2024-09-12T00:33:07.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.682+0000 7f0c77b37800 20 add_watcher() i=2 2024-09-12T00:33:07.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.682+0000 7f0c77b37800 20 add_watcher() i=3 2024-09-12T00:33:07.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.682+0000 7f0c77b37800 20 add_watcher() i=4 2024-09-12T00:33:07.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.682+0000 7f0c77b37800 20 add_watcher() i=5 2024-09-12T00:33:07.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.682+0000 7f0c77b37800 20 add_watcher() i=6 2024-09-12T00:33:07.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.683+0000 7f0c77b37800 20 add_watcher() i=7 2024-09-12T00:33:07.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.683+0000 7f0c77b37800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:07.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.685+0000 7f0b29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:07.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.685+0000 7f0c77b37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:07.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.685+0000 7f0c77b37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:07.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.685+0000 7f0c77b37800 5 note: GC not initialized 2024-09-12T00:33:07.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.685+0000 7f0b28fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:07.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.686+0000 7f0c77b37800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:07.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.686+0000 7f0c77b37800 20 Filter name: none 2024-09-12T00:33:07.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.686+0000 7f0aa27fc640 20 reqs_thread_entry: start 2024-09-12T00:33:07.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.686+0000 7f0c77b37800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.686+0000 7f0c77b37800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:07.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.686+0000 7f0c77b37800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.687+0000 7f0c77b37800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:33:07.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.687+0000 7f0c77b37800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:07.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.687+0000 7f0c77b37800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.687+0000 7f0c77b37800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:07.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.687+0000 7f0c77b37800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.687+0000 7f0c77b37800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:33:07.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.687+0000 7f0c77b37800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:07.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.689+0000 7f0b29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:07.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.691+0000 7f0c77b37800 20 remove_watcher() i=0 2024-09-12T00:33:07.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.691+0000 7f0c77b37800 2 removed watcher, disabling cache 2024-09-12T00:33:07.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.692+0000 7f0c77b37800 20 remove_watcher() i=1 2024-09-12T00:33:07.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.693+0000 7f0c77b37800 20 remove_watcher() i=2 2024-09-12T00:33:07.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.694+0000 7f0c77b37800 20 remove_watcher() i=3 2024-09-12T00:33:07.695 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.695+0000 7f0c77b37800 20 remove_watcher() i=4 2024-09-12T00:33:07.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.696+0000 7f0c77b37800 20 remove_watcher() i=5 2024-09-12T00:33:07.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.697+0000 7f0c77b37800 20 remove_watcher() i=6 2024-09-12T00:33:07.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.699+0000 7f0c77b37800 20 remove_watcher() i=7 2024-09-12T00:33:07.708 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:07.708 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:33:07.708 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-trim-reshard-log-entries id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:33:07.708 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:07.801 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:33:07.832 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:07.832 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:07.869 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.869+0000 7fc546210800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.871 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.871+0000 7fc546210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:07.871 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.871+0000 7fc546210800 20 realm 2024-09-12T00:33:07.871 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.871+0000 7fc546210800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.871 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.871+0000 7fc546210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:07.871 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.871+0000 7fc546210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:07.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.871+0000 7fc546210800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.871+0000 7fc546210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:07.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.871+0000 7fc546210800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.872+0000 7fc546210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:07.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.872+0000 7fc546210800 20 rados->read ofs=0 len=0 2024-09-12T00:33:07.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.873+0000 7fc546210800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:07.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.873+0000 7fc546210800 20 searching for the correct realm 2024-09-12T00:33:07.874 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.875+0000 7fc53bfff640 0 -- 172.21.15.133:0/1046233127 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fc52c02d040 msgr2=0x7fc52c039400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:07.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:07.878+0000 7fc53bfff640 0 -- 172.21.15.133:0/1046233127 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fc5340aca40 msgr2=0x7fc5340ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:08.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.084+0000 7fc546210800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:08.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.084+0000 7fc546210800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:08.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.084+0000 7fc546210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:08.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.084+0000 7fc546210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:08.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.084+0000 7fc546210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:08.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.084+0000 7fc546210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:08.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.084+0000 7fc546210800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.085+0000 7fc546210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:08.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.085+0000 7fc546210800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.085+0000 7fc546210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:08.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.085+0000 7fc546210800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.085+0000 7fc546210800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:08.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.085+0000 7fc546210800 20 zone default found 2024-09-12T00:33:08.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.085+0000 7fc546210800 4 Realm: () 2024-09-12T00:33:08.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.085+0000 7fc546210800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:08.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.085+0000 7fc546210800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:08.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.085+0000 7fc546210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:08.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.085+0000 7fc546210800 20 zonegroup default 2024-09-12T00:33:08.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.085+0000 7fc546210800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.085+0000 7fc546210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:08.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.085+0000 7fc546210800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.086+0000 7fc546210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:08.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.086+0000 7fc546210800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.086+0000 7fc546210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:08.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.086+0000 7fc546210800 20 started sync module instance, tier type = 2024-09-12T00:33:08.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.086+0000 7fc546210800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:08.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.095+0000 7fc546210800 20 add_watcher() i=0 2024-09-12T00:33:08.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.095+0000 7fc546210800 20 add_watcher() i=1 2024-09-12T00:33:08.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.095+0000 7fc546210800 20 add_watcher() i=2 2024-09-12T00:33:08.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.095+0000 7fc546210800 20 add_watcher() i=3 2024-09-12T00:33:08.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.095+0000 7fc546210800 20 add_watcher() i=4 2024-09-12T00:33:08.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.095+0000 7fc546210800 20 add_watcher() i=5 2024-09-12T00:33:08.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.095+0000 7fc546210800 20 add_watcher() i=6 2024-09-12T00:33:08.096 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.096+0000 7fc546210800 20 add_watcher() i=7 2024-09-12T00:33:08.096 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.096+0000 7fc546210800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:08.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.098+0000 7fc3f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:08.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.098+0000 7fc546210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:08.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.098+0000 7fc546210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:08.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.099+0000 7fc546210800 5 note: GC not initialized 2024-09-12T00:33:08.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.099+0000 7fc3f27fc640 20 reqs_thread_entry: start 2024-09-12T00:33:08.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.099+0000 7fc546210800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:08.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.099+0000 7fc546210800 20 Filter name: none 2024-09-12T00:33:08.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.099+0000 7fc363fff640 20 reqs_thread_entry: start 2024-09-12T00:33:08.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.099+0000 7fc546210800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:33:08.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.099+0000 7fc546210800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.099+0000 7fc546210800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:08.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.099+0000 7fc546210800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:33:08.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.099+0000 7fc546210800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:33:08.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.099+0000 7fc546210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 : miss 2024-09-12T00:33:08.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.099+0000 7fc546210800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.100+0000 7fc546210800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:33:08.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.100+0000 7fc546210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 info.flags=0x17 2024-09-12T00:33:08.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.100+0000 7fc546210800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 to cache LRU end 2024-09-12T00:33:08.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.100+0000 7fc546210800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:08.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.100+0000 7fc546210800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:08.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.100+0000 7fc546210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 2024-09-12T00:33:08.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.101+0000 7fc546210800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:33:08.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.105+0000 7fc546210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 info.flags=0x17 2024-09-12T00:33:08.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.105+0000 7fc546210800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 to cache LRU end 2024-09-12T00:33:08.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.105+0000 7fc546210800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:08.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.105+0000 7fc546210800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26, ofs0, ns] 2024-09-12T00:33:08.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.106+0000 7fc4257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94672517542752 notifier 6497 bl.length()=1023 2024-09-12T00:33:08.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.106+0000 7fc4257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 info.flags=0x17 2024-09-12T00:33:08.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.106+0000 7fc4257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 to cache LRU end 2024-09-12T00:33:08.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.106+0000 7fc4257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:08.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.109+0000 7fc546210800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): orig_sources= new_sources= 2024-09-12T00:33:08.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.109+0000 7fc546210800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): potential sources added=[] removed=[] 2024-09-12T00:33:08.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.109+0000 7fc546210800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): orig_dests= new_dests= 2024-09-12T00:33:08.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.109+0000 7fc546210800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): potential dests added=[] removed=[] 2024-09-12T00:33:08.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.110+0000 7fc546210800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26.2.0 2024-09-12T00:33:08.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.110+0000 7fc546210800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26.2.0 2024-09-12T00:33:08.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.110+0000 7fc546210800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26.2.1 2024-09-12T00:33:08.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.110+0000 7fc546210800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26.2.1 2024-09-12T00:33:08.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.110+0000 7fc546210800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26.0 2024-09-12T00:33:08.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.113+0000 7fc546210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:08.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.113+0000 7fc546210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 2024-09-12T00:33:08.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.114+0000 7fc546210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 info.flags=0x17 2024-09-12T00:33:08.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.114+0000 7fc546210800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 to cache LRU end 2024-09-12T00:33:08.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.114+0000 7fc546210800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:08.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.114+0000 7fc546210800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26, ofs0, ns] 2024-09-12T00:33:08.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.114+0000 7fc4257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94672517542752 notifier 6497 bl.length()=1023 2024-09-12T00:33:08.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.114+0000 7fc4257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 info.flags=0x17 2024-09-12T00:33:08.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.114+0000 7fc4257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 to cache LRU end 2024-09-12T00:33:08.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.114+0000 7fc4257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:08.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.116+0000 7fc546210800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): orig_sources= new_sources= 2024-09-12T00:33:08.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.116+0000 7fc546210800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): potential sources added=[] removed=[] 2024-09-12T00:33:08.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.116+0000 7fc546210800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): orig_dests= new_dests= 2024-09-12T00:33:08.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.116+0000 7fc546210800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): potential dests added=[] removed=[] 2024-09-12T00:33:08.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.117+0000 7fc546210800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26.0 2024-09-12T00:33:08.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.117+0000 7fc546210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:08.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.117+0000 7fc546210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 2024-09-12T00:33:08.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.118+0000 7fc546210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 info.flags=0x17 2024-09-12T00:33:08.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.118+0000 7fc546210800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 to cache LRU end 2024-09-12T00:33:08.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.118+0000 7fc546210800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:08.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.118+0000 7fc546210800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26, ofs0, ns] 2024-09-12T00:33:08.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.119+0000 7fc4257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94672517542752 notifier 6497 bl.length()=991 2024-09-12T00:33:08.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.119+0000 7fc4257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 info.flags=0x17 2024-09-12T00:33:08.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.119+0000 7fc4257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 to cache LRU end 2024-09-12T00:33:08.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.119+0000 7fc4257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:08.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.120+0000 7fc546210800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): orig_sources= new_sources= 2024-09-12T00:33:08.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.120+0000 7fc546210800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): potential sources added=[] removed=[] 2024-09-12T00:33:08.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.120+0000 7fc546210800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): orig_dests= new_dests= 2024-09-12T00:33:08.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.120+0000 7fc546210800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26]): potential dests added=[] removed=[] 2024-09-12T00:33:08.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.122+0000 7fc546210800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:33:08.123 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.123+0000 7fc3f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:08.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.125+0000 7fc546210800 20 remove_watcher() i=0 2024-09-12T00:33:08.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.125+0000 7fc546210800 2 removed watcher, disabling cache 2024-09-12T00:33:08.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.126+0000 7fc546210800 20 remove_watcher() i=1 2024-09-12T00:33:08.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.128+0000 7fc546210800 20 remove_watcher() i=2 2024-09-12T00:33:08.128 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.129+0000 7fc546210800 20 remove_watcher() i=3 2024-09-12T00:33:08.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.130+0000 7fc546210800 20 remove_watcher() i=4 2024-09-12T00:33:08.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.131+0000 7fc546210800 20 remove_watcher() i=5 2024-09-12T00:33:08.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.132+0000 7fc546210800 20 remove_watcher() i=6 2024-09-12T00:33:08.133 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.133+0000 7fc546210800 20 remove_watcher() i=7 2024-09-12T00:33:08.144 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:33:08.173 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:08.173 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:08.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.210+0000 7faafae11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.212+0000 7faafae11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:08.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.212+0000 7faafae11800 20 realm 2024-09-12T00:33:08.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.212+0000 7faafae11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.212+0000 7faafae11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:08.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.212+0000 7faafae11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:08.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.212+0000 7faafae11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.213 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.213+0000 7faafae11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:08.213 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.213+0000 7faafae11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.213 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.213+0000 7faafae11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:08.213 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.213+0000 7faafae11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.214+0000 7faafae11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:08.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.214+0000 7faafae11800 20 searching for the correct realm 2024-09-12T00:33:08.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.216+0000 7faaedd21640 0 -- 172.21.15.133:0/3363702657 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7faae0040b60 msgr2=0x7faae004b950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:08.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.422+0000 7faaedd21640 0 -- 172.21.15.133:0/3363702657 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7faae8048040 msgr2=0x7faae8039420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:08.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.629+0000 7faafae11800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:08.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.629+0000 7faafae11800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:08.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.629+0000 7faafae11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:08.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.629+0000 7faafae11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:08.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.629+0000 7faafae11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:08.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.629+0000 7faafae11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:08.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.629+0000 7faafae11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.630+0000 7faafae11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:08.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.630+0000 7faafae11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.630+0000 7faafae11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:08.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.630+0000 7faafae11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.630+0000 7faafae11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:08.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.630+0000 7faafae11800 20 zone default found 2024-09-12T00:33:08.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.630+0000 7faafae11800 4 Realm: () 2024-09-12T00:33:08.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.630+0000 7faafae11800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:08.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.630+0000 7faafae11800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:08.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.630+0000 7faafae11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:08.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.630+0000 7faafae11800 20 zonegroup default 2024-09-12T00:33:08.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.630+0000 7faafae11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.631+0000 7faafae11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:08.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.631+0000 7faafae11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.631+0000 7faafae11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:08.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.631+0000 7faafae11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.631+0000 7faafae11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:08.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.631+0000 7faafae11800 20 started sync module instance, tier type = 2024-09-12T00:33:08.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.631+0000 7faafae11800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:08.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.641+0000 7faafae11800 20 add_watcher() i=0 2024-09-12T00:33:08.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.641+0000 7faafae11800 20 add_watcher() i=1 2024-09-12T00:33:08.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.641+0000 7faafae11800 20 add_watcher() i=2 2024-09-12T00:33:08.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.641+0000 7faafae11800 20 add_watcher() i=3 2024-09-12T00:33:08.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.641+0000 7faafae11800 20 add_watcher() i=4 2024-09-12T00:33:08.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.641+0000 7faafae11800 20 add_watcher() i=5 2024-09-12T00:33:08.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.641+0000 7faafae11800 20 add_watcher() i=6 2024-09-12T00:33:08.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.642+0000 7faafae11800 20 add_watcher() i=7 2024-09-12T00:33:08.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.642+0000 7faafae11800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:08.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.644+0000 7fa9acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:08.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.645+0000 7faafae11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:08.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.645+0000 7faafae11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:08.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.645+0000 7faafae11800 5 note: GC not initialized 2024-09-12T00:33:08.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.645+0000 7fa9277fe640 20 reqs_thread_entry: start 2024-09-12T00:33:08.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.645+0000 7faafae11800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:08.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.645+0000 7faafae11800 20 Filter name: none 2024-09-12T00:33:08.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.645+0000 7fa9257fa640 20 reqs_thread_entry: start 2024-09-12T00:33:08.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.645+0000 7faafae11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.646+0000 7faafae11800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:08.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.646+0000 7faafae11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.646+0000 7faafae11800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:08.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.646+0000 7faafae11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:08.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.646+0000 7faafae11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.647+0000 7faafae11800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:08.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.647+0000 7faafae11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:08.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.647+0000 7faafae11800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:08.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.647+0000 7faafae11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:08.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.648+0000 7fa9acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:08.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.650+0000 7faafae11800 20 remove_watcher() i=0 2024-09-12T00:33:08.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.650+0000 7faafae11800 2 removed watcher, disabling cache 2024-09-12T00:33:08.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.651+0000 7faafae11800 20 remove_watcher() i=1 2024-09-12T00:33:08.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.653+0000 7faafae11800 20 remove_watcher() i=2 2024-09-12T00:33:08.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.654+0000 7faafae11800 20 remove_watcher() i=3 2024-09-12T00:33:08.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.655+0000 7faafae11800 20 remove_watcher() i=4 2024-09-12T00:33:08.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.656+0000 7faafae11800 20 remove_watcher() i=5 2024-09-12T00:33:08.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.657+0000 7faafae11800 20 remove_watcher() i=6 2024-09-12T00:33:08.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:08.658+0000 7faafae11800 20 remove_watcher() i=7 2024-09-12T00:33:08.667 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:08.667 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:33:08.667 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-trim-reshard-log-entries id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:33:08.668 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:08.962 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T00:33:08.962 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:09.798 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:33:09.826 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:09.827 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:09.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:09.865+0000 7f8a7960f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:09.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:09.866+0000 7f8a7960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:09.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:09.866+0000 7f8a7960f800 20 realm 2024-09-12T00:33:09.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:09.866+0000 7f8a7960f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:09.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:09.867+0000 7f8a7960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:09.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:09.867+0000 7f8a7960f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:09.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:09.867+0000 7f8a7960f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:09.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:09.867+0000 7f8a7960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:09.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:09.867+0000 7f8a7960f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:09.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:09.867+0000 7f8a7960f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:09.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:09.867+0000 7f8a7960f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:09.867 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:09.868+0000 7f8a7960f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:09.867 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:09.868+0000 7f8a7960f800 20 searching for the correct realm 2024-09-12T00:33:09.868 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:09.870+0000 7f8a768ff640 0 -- 172.21.15.133:0/2291584259 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f8a6c06b030 msgr2=0x7f8a6c056800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:09.872 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:09.873+0000 7f8a768ff640 0 -- 172.21.15.133:0/2291584259 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f8a68039c40 msgr2=0x7f8a68038440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:10.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.079+0000 7f8a7960f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:10.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.079+0000 7f8a7960f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:10.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.079+0000 7f8a7960f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:10.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.079+0000 7f8a7960f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:10.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.079+0000 7f8a7960f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:10.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.079+0000 7f8a7960f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:10.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.079+0000 7f8a7960f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.079+0000 7f8a7960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:10.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.079+0000 7f8a7960f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.079+0000 7f8a7960f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:10.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.079+0000 7f8a7960f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.080+0000 7f8a7960f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:10.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.080+0000 7f8a7960f800 20 zone default found 2024-09-12T00:33:10.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.080+0000 7f8a7960f800 4 Realm: () 2024-09-12T00:33:10.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.080+0000 7f8a7960f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:10.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.080+0000 7f8a7960f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:10.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.080+0000 7f8a7960f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:10.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.080+0000 7f8a7960f800 20 zonegroup default 2024-09-12T00:33:10.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.080+0000 7f8a7960f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.080+0000 7f8a7960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:10.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.080+0000 7f8a7960f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.080+0000 7f8a7960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:10.080 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.080+0000 7f8a7960f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.081+0000 7f8a7960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:10.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.081+0000 7f8a7960f800 20 started sync module instance, tier type = 2024-09-12T00:33:10.081 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.081+0000 7f8a7960f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:10.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.089+0000 7f8a7960f800 20 add_watcher() i=0 2024-09-12T00:33:10.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.089+0000 7f8a7960f800 20 add_watcher() i=1 2024-09-12T00:33:10.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.089+0000 7f8a7960f800 20 add_watcher() i=2 2024-09-12T00:33:10.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.089+0000 7f8a7960f800 20 add_watcher() i=3 2024-09-12T00:33:10.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.089+0000 7f8a7960f800 20 add_watcher() i=4 2024-09-12T00:33:10.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.089+0000 7f8a7960f800 20 add_watcher() i=5 2024-09-12T00:33:10.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.089+0000 7f8a7960f800 20 add_watcher() i=6 2024-09-12T00:33:10.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.090+0000 7f8a7960f800 20 add_watcher() i=7 2024-09-12T00:33:10.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.090+0000 7f8a7960f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:10.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.091+0000 7f892dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:10.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.092+0000 7f8a7960f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:10.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.092+0000 7f8a7960f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:10.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.092+0000 7f8a7960f800 5 note: GC not initialized 2024-09-12T00:33:10.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.092+0000 7f892cfe1640 20 reqs_thread_entry: start 2024-09-12T00:33:10.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.092+0000 7f8a7960f800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:10.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.092+0000 7f8a7960f800 20 Filter name: none 2024-09-12T00:33:10.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.092+0000 7f88a67fc640 20 reqs_thread_entry: start 2024-09-12T00:33:10.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.092+0000 7f8a7960f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.093+0000 7f8a7960f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:10.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.093+0000 7f8a7960f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.093+0000 7f8a7960f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:10.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.093+0000 7f8a7960f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:10.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.093+0000 7f8a7960f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.093+0000 7f8a7960f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:10.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.093+0000 7f8a7960f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.094+0000 7f8a7960f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:10.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.094+0000 7f8a7960f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:10.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.095+0000 7f892dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:10.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.097+0000 7f8a7960f800 20 remove_watcher() i=0 2024-09-12T00:33:10.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.097+0000 7f8a7960f800 2 removed watcher, disabling cache 2024-09-12T00:33:10.096 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.098+0000 7f8a7960f800 20 remove_watcher() i=1 2024-09-12T00:33:10.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.099+0000 7f8a7960f800 20 remove_watcher() i=2 2024-09-12T00:33:10.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.100+0000 7f8a7960f800 20 remove_watcher() i=3 2024-09-12T00:33:10.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.101+0000 7f8a7960f800 20 remove_watcher() i=4 2024-09-12T00:33:10.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.102+0000 7f8a7960f800 20 remove_watcher() i=5 2024-09-12T00:33:10.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.103+0000 7f8a7960f800 20 remove_watcher() i=6 2024-09-12T00:33:10.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.103+0000 7f8a7960f800 20 remove_watcher() i=7 2024-09-12T00:33:10.112 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:10.112 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:33:10.112 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-trim-reshard-log-entries id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:33:10.112 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:10.114 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T00:33:10.150 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:10.150 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:10.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.189+0000 7fdcc3e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.190+0000 7fdcc3e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:10.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.190+0000 7fdcc3e2f800 20 realm 2024-09-12T00:33:10.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.190+0000 7fdcc3e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.190+0000 7fdcc3e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:10.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.190+0000 7fdcc3e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:10.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.190+0000 7fdcc3e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.190+0000 7fdcc3e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:10.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.190+0000 7fdcc3e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.191+0000 7fdcc3e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:10.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.191+0000 7fdcc3e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.192+0000 7fdcc3e2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:10.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.192+0000 7fdcc3e2f800 20 searching for the correct realm 2024-09-12T00:33:10.192 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.193+0000 7fdcc111f640 0 -- 172.21.15.133:0/2233544332 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fdcb8026040 msgr2=0x7fdcb8034450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:10.396 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.398+0000 7fdcc111f640 0 -- 172.21.15.133:0/2233544332 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fdcb405ff20 msgr2=0x7fdcb4067bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:10.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.604+0000 7fdcc3e2f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:10.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.604+0000 7fdcc3e2f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:10.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.604+0000 7fdcc3e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:10.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.604+0000 7fdcc3e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:10.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.604+0000 7fdcc3e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:10.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.604+0000 7fdcc3e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:10.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.604+0000 7fdcc3e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.605+0000 7fdcc3e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:10.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.605+0000 7fdcc3e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.605+0000 7fdcc3e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:10.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.605+0000 7fdcc3e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.605+0000 7fdcc3e2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:10.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.605+0000 7fdcc3e2f800 20 zone default found 2024-09-12T00:33:10.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.605+0000 7fdcc3e2f800 4 Realm: () 2024-09-12T00:33:10.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.605+0000 7fdcc3e2f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:10.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.605+0000 7fdcc3e2f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:10.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.605+0000 7fdcc3e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:10.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.605+0000 7fdcc3e2f800 20 zonegroup default 2024-09-12T00:33:10.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.605+0000 7fdcc3e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.605+0000 7fdcc3e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:10.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.605+0000 7fdcc3e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.606+0000 7fdcc3e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:10.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.606+0000 7fdcc3e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.606+0000 7fdcc3e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:10.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.606+0000 7fdcc3e2f800 20 started sync module instance, tier type = 2024-09-12T00:33:10.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.606+0000 7fdcc3e2f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:10.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.615+0000 7fdcc3e2f800 20 add_watcher() i=0 2024-09-12T00:33:10.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.615+0000 7fdcc3e2f800 20 add_watcher() i=1 2024-09-12T00:33:10.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.615+0000 7fdcc3e2f800 20 add_watcher() i=2 2024-09-12T00:33:10.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.615+0000 7fdcc3e2f800 20 add_watcher() i=3 2024-09-12T00:33:10.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.615+0000 7fdcc3e2f800 20 add_watcher() i=4 2024-09-12T00:33:10.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.615+0000 7fdcc3e2f800 20 add_watcher() i=5 2024-09-12T00:33:10.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.615+0000 7fdcc3e2f800 20 add_watcher() i=6 2024-09-12T00:33:10.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.616+0000 7fdcc3e2f800 20 add_watcher() i=7 2024-09-12T00:33:10.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.616+0000 7fdcc3e2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:10.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.618+0000 7fdb737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:10.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.618+0000 7fdcc3e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:10.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.618+0000 7fdcc3e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:10.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.618+0000 7fdcc3e2f800 5 note: GC not initialized 2024-09-12T00:33:10.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.619+0000 7fdb727fc640 20 reqs_thread_entry: start 2024-09-12T00:33:10.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.619+0000 7fdcc3e2f800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:10.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.619+0000 7fdcc3e2f800 20 Filter name: none 2024-09-12T00:33:10.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.619+0000 7fdae3fff640 20 reqs_thread_entry: start 2024-09-12T00:33:10.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.619+0000 7fdcc3e2f800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:33:10.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.619+0000 7fdcc3e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.619+0000 7fdcc3e2f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:10.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.619+0000 7fdcc3e2f800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:33:10.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.619+0000 7fdcc3e2f800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:33:10.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.619+0000 7fdcc3e2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 : miss 2024-09-12T00:33:10.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.619+0000 7fdcc3e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.620+0000 7fdcc3e2f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:10.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.620+0000 7fdcc3e2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 info.flags=0x17 2024-09-12T00:33:10.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.620+0000 7fdcc3e2f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 to cache LRU end 2024-09-12T00:33:10.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.620+0000 7fdcc3e2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:10.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.620+0000 7fdcc3e2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:10.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.620+0000 7fdcc3e2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 2024-09-12T00:33:10.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.623+0000 7fdcc3e2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 info.flags=0x17 2024-09-12T00:33:10.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.623+0000 7fdcc3e2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 to cache LRU end 2024-09-12T00:33:10.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.623+0000 7fdcc3e2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:10.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.623+0000 7fdcc3e2f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27, ofs0, ns] 2024-09-12T00:33:10.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.624+0000 7fdba4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 94027226676080 notifier 6548 bl.length()=1023 2024-09-12T00:33:10.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.624+0000 7fdba4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 info.flags=0x17 2024-09-12T00:33:10.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.624+0000 7fdba4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 to cache LRU end 2024-09-12T00:33:10.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.624+0000 7fdba4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:10.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.626+0000 7fdcc3e2f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27]): orig_sources= new_sources= 2024-09-12T00:33:10.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.626+0000 7fdcc3e2f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27]): potential sources added=[] removed=[] 2024-09-12T00:33:10.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.626+0000 7fdcc3e2f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27]): orig_dests= new_dests= 2024-09-12T00:33:10.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.626+0000 7fdcc3e2f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27]): potential dests added=[] removed=[] 2024-09-12T00:33:10.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.626+0000 7fdcc3e2f800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T00:33:10.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.626+0000 7fdcc3e2f800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:33:10.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.627+0000 7fdcc3e2f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27.1.0 2024-09-12T00:33:10.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.627+0000 7fdcc3e2f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27.1.0 2024-09-12T00:33:10.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.627+0000 7fdcc3e2f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27.1.1 2024-09-12T00:33:10.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.627+0000 7fdcc3e2f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27.1.1 2024-09-12T00:33:10.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.627+0000 7fdcc3e2f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27.0 2024-09-12T00:33:10.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.630+0000 7fdcc3e2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:10.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.630+0000 7fdcc3e2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 2024-09-12T00:33:10.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.631+0000 7fdcc3e2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 info.flags=0x17 2024-09-12T00:33:10.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.631+0000 7fdcc3e2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 to cache LRU end 2024-09-12T00:33:10.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.631+0000 7fdcc3e2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:10.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.631+0000 7fdcc3e2f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27, ofs0, ns] 2024-09-12T00:33:10.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.631+0000 7fdba57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496998 cookie 94027226676080 notifier 6548 bl.length()=991 2024-09-12T00:33:10.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.631+0000 7fdba57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 info.flags=0x17 2024-09-12T00:33:10.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.631+0000 7fdba57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 to cache LRU end 2024-09-12T00:33:10.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.631+0000 7fdba57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:10.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.633+0000 7fdcc3e2f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27]): orig_sources= new_sources= 2024-09-12T00:33:10.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.633+0000 7fdcc3e2f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27]): potential sources added=[] removed=[] 2024-09-12T00:33:10.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.633+0000 7fdcc3e2f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27]): orig_dests= new_dests= 2024-09-12T00:33:10.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.633+0000 7fdcc3e2f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27]): potential dests added=[] removed=[] 2024-09-12T00:33:10.632 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.634+0000 7fdcc3e2f800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:33:10.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.636+0000 7fdb737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:10.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.638+0000 7fdcc3e2f800 20 remove_watcher() i=0 2024-09-12T00:33:10.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.638+0000 7fdcc3e2f800 2 removed watcher, disabling cache 2024-09-12T00:33:10.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.639+0000 7fdcc3e2f800 20 remove_watcher() i=1 2024-09-12T00:33:10.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.640+0000 7fdcc3e2f800 20 remove_watcher() i=2 2024-09-12T00:33:10.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.641+0000 7fdcc3e2f800 20 remove_watcher() i=3 2024-09-12T00:33:10.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.642+0000 7fdcc3e2f800 20 remove_watcher() i=4 2024-09-12T00:33:10.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.643+0000 7fdcc3e2f800 20 remove_watcher() i=5 2024-09-12T00:33:10.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.644+0000 7fdcc3e2f800 20 remove_watcher() i=6 2024-09-12T00:33:10.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.645+0000 7fdcc3e2f800 20 remove_watcher() i=7 2024-09-12T00:33:10.656 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:33:10.685 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:10.685 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:10.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.725+0000 7f938171f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.726+0000 7f938171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:10.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.726+0000 7f938171f800 20 realm 2024-09-12T00:33:10.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.726+0000 7f938171f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.726+0000 7f938171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:10.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.726+0000 7f938171f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:10.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.726+0000 7f938171f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.726+0000 7f938171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:10.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.726+0000 7f938171f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.727+0000 7f938171f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:10.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.727+0000 7f938171f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:10.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.728+0000 7f938171f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:10.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.728+0000 7f938171f800 20 searching for the correct realm 2024-09-12T00:33:10.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.730+0000 7f937dca3640 0 -- 172.21.15.133:0/2276961153 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f93780bbb00 msgr2=0x7f93780ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:10.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:10.935+0000 7f937cca1640 0 -- 172.21.15.133:0/2276961153 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f9370020c00 msgr2=0x7f937003a900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:11.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.142+0000 7f938171f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:11.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.142+0000 7f938171f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:11.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.142+0000 7f938171f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:11.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.142+0000 7f938171f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:11.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.142+0000 7f938171f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:11.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.142+0000 7f938171f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:11.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.142+0000 7f938171f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:11.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.142+0000 7f938171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:11.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.142+0000 7f938171f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:11.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.142+0000 7f938171f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:11.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.142+0000 7f938171f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:11.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.143+0000 7f938171f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:11.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.143+0000 7f938171f800 20 zone default found 2024-09-12T00:33:11.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.143+0000 7f938171f800 4 Realm: () 2024-09-12T00:33:11.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.143+0000 7f938171f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:11.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.143+0000 7f938171f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:11.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.143+0000 7f938171f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:11.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.143+0000 7f938171f800 20 zonegroup default 2024-09-12T00:33:11.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.143+0000 7f938171f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:11.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.143+0000 7f938171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:11.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.143+0000 7f938171f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:11.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.143+0000 7f938171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:11.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.143+0000 7f938171f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:11.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.144+0000 7f938171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:11.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.144+0000 7f938171f800 20 started sync module instance, tier type = 2024-09-12T00:33:11.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.144+0000 7f938171f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:11.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.151+0000 7f938171f800 20 add_watcher() i=0 2024-09-12T00:33:11.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.151+0000 7f938171f800 20 add_watcher() i=1 2024-09-12T00:33:11.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.151+0000 7f938171f800 20 add_watcher() i=2 2024-09-12T00:33:11.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.151+0000 7f938171f800 20 add_watcher() i=3 2024-09-12T00:33:11.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.151+0000 7f938171f800 20 add_watcher() i=4 2024-09-12T00:33:11.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.151+0000 7f938171f800 20 add_watcher() i=5 2024-09-12T00:33:11.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.151+0000 7f938171f800 20 add_watcher() i=6 2024-09-12T00:33:11.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.152+0000 7f938171f800 20 add_watcher() i=7 2024-09-12T00:33:11.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.152+0000 7f938171f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:11.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.154+0000 7f9233fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:11.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.154+0000 7f938171f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:11.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.154+0000 7f938171f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:11.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.155+0000 7f938171f800 5 note: GC not initialized 2024-09-12T00:33:11.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.155+0000 7f9232fe5640 20 reqs_thread_entry: start 2024-09-12T00:33:11.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.155+0000 7f938171f800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:11.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.155+0000 7f938171f800 20 Filter name: none 2024-09-12T00:33:11.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.155+0000 7f9230fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:11.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.155+0000 7f938171f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:11.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.155+0000 7f938171f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:11.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.155+0000 7f938171f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:11.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.156+0000 7f938171f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:11.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.156+0000 7f938171f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:11.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.156+0000 7f938171f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:11.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.156+0000 7f938171f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:11.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.156+0000 7f938171f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:11.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.156+0000 7f938171f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:11.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.156+0000 7f938171f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:11.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.158+0000 7f9233fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:11.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.160+0000 7f938171f800 20 remove_watcher() i=0 2024-09-12T00:33:11.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.160+0000 7f938171f800 2 removed watcher, disabling cache 2024-09-12T00:33:11.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.160+0000 7f938171f800 20 remove_watcher() i=1 2024-09-12T00:33:11.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.161+0000 7f938171f800 20 remove_watcher() i=2 2024-09-12T00:33:11.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.162+0000 7f938171f800 20 remove_watcher() i=3 2024-09-12T00:33:11.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.163+0000 7f938171f800 20 remove_watcher() i=4 2024-09-12T00:33:11.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.164+0000 7f938171f800 20 remove_watcher() i=5 2024-09-12T00:33:11.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.165+0000 7f938171f800 20 remove_watcher() i=6 2024-09-12T00:33:11.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:11.166+0000 7f938171f800 20 remove_watcher() i=7 2024-09-12T00:33:11.175 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:11.175 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:33:11.175 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-trim-reshard-log-entries id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:33:11.175 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:11.491 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T00:33:11.491 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:12.371 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:33:12.402 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:12.403 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:12.444 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.446+0000 7f7912925800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.447+0000 7f7912925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.447+0000 7f7912925800 20 realm 2024-09-12T00:33:12.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.447+0000 7f7912925800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.448+0000 7f7912925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.448+0000 7f7912925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:12.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.448+0000 7f7912925800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.448+0000 7f7912925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.448+0000 7f7912925800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.449+0000 7f7912925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:12.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.449+0000 7f7912925800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.449+0000 7f7912925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:12.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.449+0000 7f7912925800 20 searching for the correct realm 2024-09-12T00:33:12.450 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.451+0000 7f790ddad640 0 -- 172.21.15.133:0/2270394683 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f7904039040 msgr2=0x7f7904008420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:12.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.657+0000 7f790ddad640 0 -- 172.21.15.133:0/2270394683 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f790006b030 msgr2=0x7f79000e4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:12.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.864+0000 7f7912925800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:12.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.864+0000 7f7912925800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:12.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.864+0000 7f7912925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:12.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.864+0000 7f7912925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:12.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.864+0000 7f7912925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:12.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.864+0000 7f7912925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:12.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.864+0000 7f7912925800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.864+0000 7f7912925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.864+0000 7f7912925800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.864+0000 7f7912925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:12.864 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.864+0000 7f7912925800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.865+0000 7f7912925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:12.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.865+0000 7f7912925800 20 zone default found 2024-09-12T00:33:12.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.865+0000 7f7912925800 4 Realm: () 2024-09-12T00:33:12.865 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.865+0000 7f7912925800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:12.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.865+0000 7f7912925800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:12.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.865+0000 7f7912925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:12.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.865+0000 7f7912925800 20 zonegroup default 2024-09-12T00:33:12.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.865+0000 7f7912925800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.865+0000 7f7912925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.865+0000 7f7912925800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.865+0000 7f7912925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.865+0000 7f7912925800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.866+0000 7f7912925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.866+0000 7f7912925800 20 started sync module instance, tier type = 2024-09-12T00:33:12.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.866+0000 7f7912925800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:12.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.874+0000 7f7912925800 20 add_watcher() i=0 2024-09-12T00:33:12.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.874+0000 7f7912925800 20 add_watcher() i=1 2024-09-12T00:33:12.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.874+0000 7f7912925800 20 add_watcher() i=2 2024-09-12T00:33:12.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.874+0000 7f7912925800 20 add_watcher() i=3 2024-09-12T00:33:12.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.874+0000 7f7912925800 20 add_watcher() i=4 2024-09-12T00:33:12.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.874+0000 7f7912925800 20 add_watcher() i=5 2024-09-12T00:33:12.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.874+0000 7f7912925800 20 add_watcher() i=6 2024-09-12T00:33:12.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.875+0000 7f7912925800 20 add_watcher() i=7 2024-09-12T00:33:12.873 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.875+0000 7f7912925800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:12.875 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.877+0000 7f77c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:12.876 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.877+0000 7f7912925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:12.876 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.877+0000 7f7912925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:12.876 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.877+0000 7f7912925800 5 note: GC not initialized 2024-09-12T00:33:12.876 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.877+0000 7f773f7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:12.876 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.877+0000 7f7912925800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:12.877 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.877+0000 7f7912925800 20 Filter name: none 2024-09-12T00:33:12.877 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.877+0000 7f773d7fa640 20 reqs_thread_entry: start 2024-09-12T00:33:12.877 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.878+0000 7f7912925800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.878+0000 7f7912925800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:12.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.878+0000 7f7912925800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.878+0000 7f7912925800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:12.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.878+0000 7f7912925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:12.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.878+0000 7f7912925800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.879+0000 7f7912925800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:12.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.879+0000 7f7912925800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.879+0000 7f7912925800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:12.878 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.879+0000 7f7912925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:12.879 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.881+0000 7f77c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:12.882 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.883+0000 7f7912925800 20 remove_watcher() i=0 2024-09-12T00:33:12.882 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.883+0000 7f7912925800 2 removed watcher, disabling cache 2024-09-12T00:33:12.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.884+0000 7f7912925800 20 remove_watcher() i=1 2024-09-12T00:33:12.884 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.885+0000 7f7912925800 20 remove_watcher() i=2 2024-09-12T00:33:12.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.886+0000 7f7912925800 20 remove_watcher() i=3 2024-09-12T00:33:12.886 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.887+0000 7f7912925800 20 remove_watcher() i=4 2024-09-12T00:33:12.886 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.888+0000 7f7912925800 20 remove_watcher() i=5 2024-09-12T00:33:12.887 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.889+0000 7f7912925800 20 remove_watcher() i=6 2024-09-12T00:33:12.888 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.890+0000 7f7912925800 20 remove_watcher() i=7 2024-09-12T00:33:12.899 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:12.899 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:33:12.899 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-trim-reshard-log-entries id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:33:12.899 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:12.900 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T00:33:12.935 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:12.935 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:12.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.973+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.974+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.974+0000 7f5494715800 20 realm 2024-09-12T00:33:12.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.974+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.975+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.975+0000 7f5494715800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:12.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.975+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.975+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.975+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.975+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:12.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.975+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.976+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:12.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:12.976+0000 7f5494715800 20 searching for the correct realm 2024-09-12T00:33:13.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.180+0000 7f548bfff640 0 -- 172.21.15.133:0/2963956149 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f547c03f060 msgr2=0x7f547c067cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:13.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.385+0000 7f548bfff640 0 -- 172.21.15.133:0/2963956149 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f548408a060 msgr2=0x7f5484082040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:13.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:13.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:13.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:13.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:13.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:13.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:13.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:13.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:13.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 20 zone default found 2024-09-12T00:33:13.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 4 Realm: () 2024-09-12T00:33:13.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:13.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:13.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:13.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 20 zonegroup default 2024-09-12T00:33:13.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.593+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.594+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.594+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.594+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.594+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.594+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.594+0000 7f5494715800 20 started sync module instance, tier type = 2024-09-12T00:33:13.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.594+0000 7f5494715800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:13.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=0 2024-09-12T00:33:13.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=1 2024-09-12T00:33:13.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=2 2024-09-12T00:33:13.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=3 2024-09-12T00:33:13.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=4 2024-09-12T00:33:13.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=5 2024-09-12T00:33:13.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=6 2024-09-12T00:33:13.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.605+0000 7f5494715800 20 add_watcher() i=7 2024-09-12T00:33:13.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.605+0000 7f5494715800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:13.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.607+0000 7f5348fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:13.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.607+0000 7f5494715800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:13.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.607+0000 7f5494715800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.607+0000 7f5494715800 5 note: GC not initialized 2024-09-12T00:33:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.607+0000 7f52c37fe640 20 reqs_thread_entry: start 2024-09-12T00:33:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.607+0000 7f5494715800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.607+0000 7f5494715800 20 Filter name: none 2024-09-12T00:33:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.607+0000 7f52c17fa640 20 reqs_thread_entry: start 2024-09-12T00:33:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.608+0000 7f5494715800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:33:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.608+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.608+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.608+0000 7f5494715800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:33:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.608+0000 7f5494715800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:33:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.608+0000 7f5494715800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 : miss 2024-09-12T00:33:13.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.608+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.608+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:13.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.608+0000 7f5494715800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:13.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.608+0000 7f5494715800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:13.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.608+0000 7f5494715800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:13.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.608+0000 7f5494715800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:13.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.608+0000 7f5494715800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 2024-09-12T00:33:13.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.612+0000 7f5494715800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:13.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.612+0000 7f5494715800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:13.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.612+0000 7f5494715800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:13.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.612+0000 7f5494715800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28, ofs0, ns] 2024-09-12T00:33:13.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.612+0000 7f5375ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 93842115333568 notifier 6596 bl.length()=1023 2024-09-12T00:33:13.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.612+0000 7f5375ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:13.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.612+0000 7f5375ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:13.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.612+0000 7f5375ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:13.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.614+0000 7f5494715800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): orig_sources= new_sources= 2024-09-12T00:33:13.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.614+0000 7f5494715800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): potential sources added=[] removed=[] 2024-09-12T00:33:13.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.614+0000 7f5494715800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): orig_dests= new_dests= 2024-09-12T00:33:13.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.614+0000 7f5494715800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): potential dests added=[] removed=[] 2024-09-12T00:33:13.613 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5494715800 time 2024-09-12T00:33:13.615234+0000 2024-09-12T00:33:13.613 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:13.614 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:13.614 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5497b8c71a] 2024-09-12T00:33:13.614 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5497b8c8d8] 2024-09-12T00:33:13.614 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55594f90c641] 2024-09-12T00:33:13.614 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd884de) [0x55594fe1f4de] 2024-09-12T00:33:13.614 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55594f91c31d] 2024-09-12T00:33:13.614 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:33:13.614 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5496829590] 2024-09-12T00:33:13.614 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:33:13.614 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:33:13.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.615+0000 7f5494715800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5494715800 time 2024-09-12T00:33:13.615234+0000 2024-09-12T00:33:13.615 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:13.615 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.615 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:13.615 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5497b8c71a] 2024-09-12T00:33:13.615 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5497b8c8d8] 2024-09-12T00:33:13.615 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55594f90c641] 2024-09-12T00:33:13.615 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd884de) [0x55594fe1f4de] 2024-09-12T00:33:13.615 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55594f91c31d] 2024-09-12T00:33:13.615 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:33:13.615 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5496829590] 2024-09-12T00:33:13.615 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:33:13.615 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:33:13.616 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.616 INFO:tasks.workunit.client.0.smithi133.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:33:13.616 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f5494715800 thread_name:radosgw-admin 2024-09-12T00:33:13.638 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:13.639 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f549683e6f0] 2024-09-12T00:33:13.639 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f549688b99c] 2024-09-12T00:33:13.639 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:33:13.639 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:33:13.639 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5497b8c774] 2024-09-12T00:33:13.639 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5497b8c8d8] 2024-09-12T00:33:13.639 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55594f90c641] 2024-09-12T00:33:13.639 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd884de) [0x55594fe1f4de] 2024-09-12T00:33:13.639 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55594f91c31d] 2024-09-12T00:33:13.639 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:33:13.639 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5496829590] 2024-09-12T00:33:13.640 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:33:13.640 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:33:13.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.616+0000 7f5494715800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:33:13.640 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f5494715800 thread_name:radosgw-admin 2024-09-12T00:33:13.640 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.640 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:13.640 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f549683e6f0] 2024-09-12T00:33:13.640 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f549688b99c] 2024-09-12T00:33:13.640 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:33:13.640 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:33:13.640 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5497b8c774] 2024-09-12T00:33:13.641 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5497b8c8d8] 2024-09-12T00:33:13.641 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55594f90c641] 2024-09-12T00:33:13.641 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd884de) [0x55594fe1f4de] 2024-09-12T00:33:13.641 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55594f91c31d] 2024-09-12T00:33:13.641 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:33:13.641 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5496829590] 2024-09-12T00:33:13.641 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:33:13.641 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:33:13.641 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:33:13.642 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.642 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:33:13.642 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:33:12.956+0000 7f5380608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:13.642 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:33:12.956+0000 7f5380608640 10 monclient: dump: 2024-09-12T00:33:13.642 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.642 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.642 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.642 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.642 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.642 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.642 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.642 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.643 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.643 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.643 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:33:12.956+0000 7f5494715800 5 monclient: authenticate success, global_id 6584 2024-09-12T00:33:13.643 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:33:12.956+0000 7f5494715800 10 monclient: get_monmap_and_config success 2024-09-12T00:33:13.643 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:33:12.956+0000 7f5494715800 4 set_mon_vals no callback set 2024-09-12T00:33:13.643 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:33:12.957+0000 7f5494715800 10 monclient: shutdown 2024-09-12T00:33:13.643 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:33:12.957+0000 7f5494715800 5 asok(0x555951c13630) unregister_commands rotate-key 2024-09-12T00:33:13.643 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:33:12.957+0000 7f5494715800 10 monclient: build_initial_monmap 2024-09-12T00:33:13.643 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:33:12.957+0000 7f5494715800 1 build_initial for_mkfs: 0 2024-09-12T00:33:13.643 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:33:12.957+0000 7f5494715800 10 monclient: monmap: 2024-09-12T00:33:13.643 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:33:13.643 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:13.643 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:33:13.644 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:33:13.644 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:13.644 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.644 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:33:13.644 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:33:13.644 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:33:13.644 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.644 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding auth protocol: cephx 2024-09-12T00:33:13.644 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding auth protocol: cephx 2024-09-12T00:33:13.644 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding auth protocol: cephx 2024-09-12T00:33:13.644 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: secure 2024-09-12T00:33:13.644 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: crc 2024-09-12T00:33:13.644 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: secure 2024-09-12T00:33:13.644 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: crc 2024-09-12T00:33:13.645 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: secure 2024-09-12T00:33:13.645 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: crc 2024-09-12T00:33:13.645 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: crc 2024-09-12T00:33:13.645 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: secure 2024-09-12T00:33:13.645 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: crc 2024-09-12T00:33:13.645 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: secure 2024-09-12T00:33:13.645 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: crc 2024-09-12T00:33:13.645 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: secure 2024-09-12T00:33:13.645 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:33:12.957+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.645 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:33:12.957+0000 7f5494715800 1 librados: starting msgr at 2024-09-12T00:33:13.645 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:33:12.957+0000 7f5494715800 1 librados: starting objecter 2024-09-12T00:33:13.645 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:33:12.957+0000 7f5494715800 5 asok(0x555951c13630) register_command objecter_requests hook 0x555951e37590 2024-09-12T00:33:13.645 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:33:12.957+0000 7f5494715800 1 librados: setting wanted keys 2024-09-12T00:33:13.645 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:33:12.957+0000 7f5494715800 1 librados: calling monclient init 2024-09-12T00:33:13.646 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:33:12.957+0000 7f5494715800 10 monclient: init 2024-09-12T00:33:13.646 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding auth protocol: cephx 2024-09-12T00:33:13.646 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding auth protocol: cephx 2024-09-12T00:33:13.646 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding auth protocol: cephx 2024-09-12T00:33:13.646 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: secure 2024-09-12T00:33:13.646 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: crc 2024-09-12T00:33:13.646 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: secure 2024-09-12T00:33:13.646 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: crc 2024-09-12T00:33:13.646 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: secure 2024-09-12T00:33:13.647 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: crc 2024-09-12T00:33:13.647 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: crc 2024-09-12T00:33:13.647 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: secure 2024-09-12T00:33:13.647 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: crc 2024-09-12T00:33:13.647 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: secure 2024-09-12T00:33:13.647 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: crc 2024-09-12T00:33:13.647 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: secure 2024-09-12T00:33:13.647 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:33:12.958+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.647 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:33:12.958+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.647 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:33:12.958+0000 7f5494715800 5 asok(0x555951c13630) register_command rotate-key hook 0x555951e33e18 2024-09-12T00:33:13.647 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:13.647 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:33:13.647 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): picked mon.noname-c con 0x555951ceada0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:13.648 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): picked mon.noname-a con 0x555951d760d0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:13.648 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): picked mon.noname-b con 0x555951d7c5f0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:13.648 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.648 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.648 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.648 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:13.648 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): authenticate will time out at 2001.530352s 2024-09-12T00:33:13.648 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): get_auth_request con 0x555951ceada0 auth_method 0 2024-09-12T00:33:13.648 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.648 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.648 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.648 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:33:12.958+0000 7f548bfff640 10 monclient(hunting): get_auth_request con 0x555951d760d0 auth_method 0 2024-09-12T00:33:13.648 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:33:12.958+0000 7f548bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.649 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:33:12.958+0000 7f548bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.649 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:33:12.958+0000 7f548bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.649 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.649 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.649 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.649 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:33:12.958+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.649 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:33:12.958+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.649 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:33:12.958+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.649 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:33:12.958+0000 7f5492a00640 10 monclient(hunting): get_auth_request con 0x555951d7c5f0 auth_method 0 2024-09-12T00:33:13.649 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:33:12.958+0000 7f5492a00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.649 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:33:12.958+0000 7f5492a00640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.649 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:33:12.958+0000 7f5492a00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.649 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): handle_auth_done global_id 6587 payload 824 2024-09-12T00:33:13.650 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient: _finish_hunting 0 2024-09-12T00:33:13.650 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:33:12.958+0000 7f54921ff640 1 monclient: found mon.noname-c 2024-09-12T00:33:13.650 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.650 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.650 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:13.650 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: dump: 2024-09-12T00:33:13.650 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.650 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.650 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.650 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.650 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.650 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.650 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.650 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: _finish_auth 0 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: _check_auth_tickets 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: dump: 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.651 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.652 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.652 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.652 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:33:12.958+0000 7f5494715800 5 monclient: authenticate success, global_id 6587 2024-09-12T00:33:13.652 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient: _renew_subs 2024-09-12T00:33:13.652 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.652 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:33:12.958+0000 7f5380608640 4 set_mon_vals no callback set 2024-09-12T00:33:13.652 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:33:12.959+0000 7f5494715800 10 monclient: _renew_subs 2024-09-12T00:33:13.652 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:33:12.959+0000 7f5494715800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.652 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:33:12.959+0000 7f5494715800 1 librados: init done 2024-09-12T00:33:13.652 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:33:12.960+0000 7f537ee05640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:33:13.652 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:33:12.960+0000 7f537ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:13.652 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:33:12.960+0000 7f537ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:13.652 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:33:12.960+0000 7f548bfff640 10 monclient: get_auth_request con 0x7f5378076470 auth_method 0 2024-09-12T00:33:13.652 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:33:12.961+0000 7f5492a00640 10 monclient: get_auth_request con 0x555951e75d80 auth_method 0 2024-09-12T00:33:13.653 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:33:12.961+0000 7f54921ff640 10 monclient: get_auth_request con 0x555951e7f270 auth_method 0 2024-09-12T00:33:13.653 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:33:12.962+0000 7f548bfff640 10 monclient: get_auth_request con 0x555951e83700 auth_method 0 2024-09-12T00:33:13.653 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:33:12.963+0000 7f5492a00640 10 monclient: get_auth_request con 0x555951e82b30 auth_method 0 2024-09-12T00:33:13.653 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:33:12.964+0000 7f5494715800 10 monclient: build_initial_monmap 2024-09-12T00:33:13.653 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:33:12.964+0000 7f5494715800 1 build_initial for_mkfs: 0 2024-09-12T00:33:13.653 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:33:12.964+0000 7f5494715800 10 monclient: monmap: 2024-09-12T00:33:13.653 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:33:13.653 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:13.653 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:33:13.653 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:33:13.653 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:13.653 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.653 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:33:13.653 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:33:13.654 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:33:13.654 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.654 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding auth protocol: cephx 2024-09-12T00:33:13.654 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding auth protocol: cephx 2024-09-12T00:33:13.654 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding auth protocol: cephx 2024-09-12T00:33:13.654 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: secure 2024-09-12T00:33:13.654 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: crc 2024-09-12T00:33:13.654 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: secure 2024-09-12T00:33:13.654 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: crc 2024-09-12T00:33:13.654 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: secure 2024-09-12T00:33:13.654 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: crc 2024-09-12T00:33:13.654 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: crc 2024-09-12T00:33:13.654 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: secure 2024-09-12T00:33:13.654 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: crc 2024-09-12T00:33:13.655 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: secure 2024-09-12T00:33:13.655 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: crc 2024-09-12T00:33:13.655 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: secure 2024-09-12T00:33:13.655 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:33:12.964+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.655 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:33:12.964+0000 7f5494715800 5 asok(0x555951c13630) register_command objecter_requests cmddesc objecter_requests hook 0x555951e8f2d0 EEXIST 2024-09-12T00:33:13.655 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:33:12.964+0000 7f5494715800 10 monclient: init 2024-09-12T00:33:13.655 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding auth protocol: cephx 2024-09-12T00:33:13.655 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding auth protocol: cephx 2024-09-12T00:33:13.655 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding auth protocol: cephx 2024-09-12T00:33:13.655 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: secure 2024-09-12T00:33:13.656 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: crc 2024-09-12T00:33:13.656 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: secure 2024-09-12T00:33:13.656 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: crc 2024-09-12T00:33:13.656 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: secure 2024-09-12T00:33:13.656 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: crc 2024-09-12T00:33:13.656 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: crc 2024-09-12T00:33:13.656 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: secure 2024-09-12T00:33:13.656 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: crc 2024-09-12T00:33:13.656 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: secure 2024-09-12T00:33:13.656 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: crc 2024-09-12T00:33:13.656 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: secure 2024-09-12T00:33:13.656 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:33:12.965+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.657 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:33:12.965+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.657 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:33:12.965+0000 7f5494715800 5 asok(0x555951c13630) register_command rotate-key cmddesc rotate-key hook 0x555951e8a930 EEXIST 2024-09-12T00:33:13.657 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:13.657 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:33:13.657 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): picked mon.noname-c con 0x555951eb2fc0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:13.657 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): picked mon.noname-b con 0x555951eb5290 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:13.657 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): picked mon.noname-a con 0x555951eb1790 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:13.657 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.657 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.657 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.657 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:13.657 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): authenticate will time out at 2001.537433s 2024-09-12T00:33:13.658 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): get_auth_request con 0x555951eb2fc0 auth_method 0 2024-09-12T00:33:13.658 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.658 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.658 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.658 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:33:12.965+0000 7f54921ff640 10 monclient(hunting): get_auth_request con 0x555951eb1790 auth_method 0 2024-09-12T00:33:13.658 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:33:12.965+0000 7f54921ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.658 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:33:12.965+0000 7f54921ff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.658 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:33:12.965+0000 7f54921ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.658 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:33:12.965+0000 7f5492a00640 10 monclient(hunting): get_auth_request con 0x555951eb5290 auth_method 0 2024-09-12T00:33:13.658 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:33:12.965+0000 7f5492a00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.658 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:33:12.965+0000 7f5492a00640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.658 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:33:12.965+0000 7f5492a00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.658 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.658 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.658 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.659 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:33:12.965+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.659 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:33:12.965+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.659 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:33:12.965+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.659 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:33:12.965+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.659 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:33:12.965+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.659 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:33:12.965+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.659 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): handle_auth_done global_id 6590 payload 824 2024-09-12T00:33:13.659 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient: _finish_hunting 0 2024-09-12T00:33:13.659 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:33:12.965+0000 7f548bfff640 1 monclient: found mon.noname-c 2024-09-12T00:33:13.659 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.659 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.659 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:13.659 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: dump: 2024-09-12T00:33:13.659 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.659 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.660 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.660 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.660 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.660 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.660 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.660 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.660 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.660 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.661 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: _finish_auth 0 2024-09-12T00:33:13.661 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: _check_auth_tickets 2024-09-12T00:33:13.661 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:13.661 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.661 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:13.661 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: dump: 2024-09-12T00:33:13.661 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.661 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.661 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.661 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.662 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.662 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.662 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.662 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.662 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.662 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.662 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:33:12.966+0000 7f5494715800 5 monclient: authenticate success, global_id 6590 2024-09-12T00:33:13.662 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:33:12.966+0000 7f5494715800 10 monclient: _renew_subs 2024-09-12T00:33:13.662 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:33:12.966+0000 7f5494715800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.662 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:33:12.966+0000 7f5493201640 4 set_mon_vals no callback set 2024-09-12T00:33:13.662 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:33:12.966+0000 7f5494715800 10 monclient: _renew_subs 2024-09-12T00:33:13.662 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:33:12.966+0000 7f5494715800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.663 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:33:12.967+0000 7f5377fff640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:33:13.663 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:33:12.967+0000 7f5377fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:13.663 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:33:12.967+0000 7f5377fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:13.663 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:33:12.968+0000 7f5492a00640 10 monclient: get_auth_request con 0x7f536c076380 auth_method 0 2024-09-12T00:33:13.663 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:33:12.968+0000 7f5494715800 10 monclient: get_monmap_and_config 2024-09-12T00:33:13.663 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:33:12.968+0000 7f5494715800 10 monclient: build_initial_monmap 2024-09-12T00:33:13.663 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:33:12.968+0000 7f5494715800 1 build_initial for_mkfs: 0 2024-09-12T00:33:13.663 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:33:12.968+0000 7f5494715800 10 monclient: monmap: 2024-09-12T00:33:13.663 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:33:13.664 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:13.664 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:33:13.664 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:33:13.664 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:13.664 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.665 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:33:13.665 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:33:13.665 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:33:13.665 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.665 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding auth protocol: cephx 2024-09-12T00:33:13.665 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding auth protocol: cephx 2024-09-12T00:33:13.666 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding auth protocol: cephx 2024-09-12T00:33:13.666 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: secure 2024-09-12T00:33:13.666 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: crc 2024-09-12T00:33:13.666 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: secure 2024-09-12T00:33:13.666 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: crc 2024-09-12T00:33:13.666 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: secure 2024-09-12T00:33:13.666 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: crc 2024-09-12T00:33:13.666 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: crc 2024-09-12T00:33:13.666 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: secure 2024-09-12T00:33:13.666 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: crc 2024-09-12T00:33:13.667 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: secure 2024-09-12T00:33:13.667 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: crc 2024-09-12T00:33:13.667 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: secure 2024-09-12T00:33:13.667 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:33:12.968+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.667 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:33:12.968+0000 7f5494715800 10 monclient: init 2024-09-12T00:33:13.667 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding auth protocol: cephx 2024-09-12T00:33:13.667 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding auth protocol: cephx 2024-09-12T00:33:13.667 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding auth protocol: cephx 2024-09-12T00:33:13.667 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: secure 2024-09-12T00:33:13.667 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: crc 2024-09-12T00:33:13.668 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: secure 2024-09-12T00:33:13.668 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: crc 2024-09-12T00:33:13.668 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: secure 2024-09-12T00:33:13.668 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: crc 2024-09-12T00:33:13.668 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: crc 2024-09-12T00:33:13.668 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: secure 2024-09-12T00:33:13.668 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: crc 2024-09-12T00:33:13.669 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: secure 2024-09-12T00:33:13.669 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: crc 2024-09-12T00:33:13.669 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: secure 2024-09-12T00:33:13.669 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:33:12.968+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.669 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:33:12.969+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.669 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:33:12.969+0000 7f5494715800 5 asok(0x555951c13630) register_command rotate-key cmddesc rotate-key hook 0x7ffc1af97a88 EEXIST 2024-09-12T00:33:13.669 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:13.669 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:33:13.669 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): picked mon.noname-c con 0x555951f07290 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:13.669 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): picked mon.noname-b con 0x555951f01830 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:13.669 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): picked mon.noname-a con 0x555951ed70d0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:13.669 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.669 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.670 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.670 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:13.670 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): authenticate will time out at 2001.541158s 2024-09-12T00:33:13.670 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:33:12.969+0000 7f548bfff640 10 monclient(hunting): get_auth_request con 0x555951f07290 auth_method 0 2024-09-12T00:33:13.670 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:33:12.969+0000 7f548bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.670 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:33:12.969+0000 7f548bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.670 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:33:12.969+0000 7f548bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.670 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): get_auth_request con 0x555951ed70d0 auth_method 0 2024-09-12T00:33:13.670 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.670 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.670 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.670 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:33:12.969+0000 7f5492a00640 10 monclient(hunting): get_auth_request con 0x555951f01830 auth_method 0 2024-09-12T00:33:13.671 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:33:12.969+0000 7f5492a00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.671 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:33:12.969+0000 7f5492a00640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.671 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:33:12.969+0000 7f5492a00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.671 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:33:12.969+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.671 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:33:12.969+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.671 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:33:12.969+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.671 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.671 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.671 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.671 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:33:12.969+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.671 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:33:12.969+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.671 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:33:12.969+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.671 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): handle_auth_done global_id 6978 payload 274 2024-09-12T00:33:13.672 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient: _finish_hunting 0 2024-09-12T00:33:13.672 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:33:12.969+0000 7f54921ff640 1 monclient: found mon.noname-a 2024-09-12T00:33:13.672 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:33:13.672 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.672 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:33:13.672 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: dump: 2024-09-12T00:33:13.672 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.672 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.672 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.672 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.672 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.672 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.673 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.673 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.673 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.673 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.673 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: _finish_auth 0 2024-09-12T00:33:13.673 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:33:13.673 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:13.673 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:33:12.969+0000 7f5494715800 5 monclient: authenticate success, global_id 6978 2024-09-12T00:33:13.673 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient: get_monmap_and_config success 2024-09-12T00:33:13.673 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:33:12.969+0000 7f5494715800 4 set_mon_vals no callback set 2024-09-12T00:33:13.673 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.673 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:33:13.673 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: dump: 2024-09-12T00:33:13.673 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.674 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.674 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.674 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.674 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.674 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.674 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.674 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.674 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.674 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.674 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:33:12.970+0000 7f5494715800 10 monclient: shutdown 2024-09-12T00:33:13.674 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:33:12.970+0000 7f5494715800 10 monclient: build_initial_monmap 2024-09-12T00:33:13.674 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:33:12.970+0000 7f5494715800 1 build_initial for_mkfs: 0 2024-09-12T00:33:13.675 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:33:12.970+0000 7f5494715800 10 monclient: monmap: 2024-09-12T00:33:13.675 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:33:13.675 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:13.675 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:33:13.675 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:33:13.675 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:13.675 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.675 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:33:13.675 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:33:13.675 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:33:13.676 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.676 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding auth protocol: cephx 2024-09-12T00:33:13.676 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding auth protocol: cephx 2024-09-12T00:33:13.676 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding auth protocol: cephx 2024-09-12T00:33:13.676 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: secure 2024-09-12T00:33:13.676 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: crc 2024-09-12T00:33:13.676 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: secure 2024-09-12T00:33:13.676 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: crc 2024-09-12T00:33:13.676 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: secure 2024-09-12T00:33:13.676 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: crc 2024-09-12T00:33:13.676 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: crc 2024-09-12T00:33:13.676 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: secure 2024-09-12T00:33:13.677 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: crc 2024-09-12T00:33:13.677 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: secure 2024-09-12T00:33:13.677 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: crc 2024-09-12T00:33:13.677 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: secure 2024-09-12T00:33:13.677 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:33:12.970+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.677 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:33:12.970+0000 7f5494715800 1 librados: starting msgr at 2024-09-12T00:33:13.677 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:33:12.970+0000 7f5494715800 1 librados: starting objecter 2024-09-12T00:33:13.677 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:33:12.970+0000 7f5494715800 5 asok(0x555951c13630) register_command objecter_requests cmddesc objecter_requests hook 0x555951e68870 EEXIST 2024-09-12T00:33:13.677 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:33:12.970+0000 7f5494715800 1 librados: setting wanted keys 2024-09-12T00:33:13.677 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:33:12.970+0000 7f5494715800 1 librados: calling monclient init 2024-09-12T00:33:13.677 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:33:12.970+0000 7f5494715800 10 monclient: init 2024-09-12T00:33:13.677 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding auth protocol: cephx 2024-09-12T00:33:13.677 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding auth protocol: cephx 2024-09-12T00:33:13.678 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding auth protocol: cephx 2024-09-12T00:33:13.678 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: secure 2024-09-12T00:33:13.678 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: crc 2024-09-12T00:33:13.678 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: secure 2024-09-12T00:33:13.678 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: crc 2024-09-12T00:33:13.678 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: secure 2024-09-12T00:33:13.678 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: crc 2024-09-12T00:33:13.678 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: crc 2024-09-12T00:33:13.678 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: secure 2024-09-12T00:33:13.678 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: crc 2024-09-12T00:33:13.678 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: secure 2024-09-12T00:33:13.678 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: crc 2024-09-12T00:33:13.678 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: secure 2024-09-12T00:33:13.679 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:33:12.971+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.679 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:33:12.971+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.679 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:33:12.971+0000 7f5494715800 5 asok(0x555951c13630) register_command rotate-key cmddesc rotate-key hook 0x555951ecaeb8 EEXIST 2024-09-12T00:33:13.679 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:13.679 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:33:13.679 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): picked mon.noname-a con 0x555951ed70d0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:13.679 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): picked mon.noname-b con 0x555951f01830 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:13.679 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): picked mon.noname-c con 0x555951f07290 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:13.679 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.679 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.679 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.679 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:13.679 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): authenticate will time out at 2001.543357s 2024-09-12T00:33:13.680 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): get_auth_request con 0x555951f07290 auth_method 0 2024-09-12T00:33:13.680 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.680 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.680 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.680 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:33:12.971+0000 7f548bfff640 10 monclient(hunting): get_auth_request con 0x555951ed70d0 auth_method 0 2024-09-12T00:33:13.680 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:33:12.971+0000 7f548bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.680 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:33:12.971+0000 7f548bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.680 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:33:12.971+0000 7f548bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.680 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:33:12.971+0000 7f5492a00640 10 monclient(hunting): get_auth_request con 0x555951f01830 auth_method 0 2024-09-12T00:33:13.680 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:33:12.971+0000 7f5492a00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.680 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:33:12.971+0000 7f5492a00640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.680 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:33:12.971+0000 7f5492a00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.681 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.681 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.681 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.681 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:33:12.971+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.681 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:33:12.971+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.681 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:33:12.971+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.681 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): handle_auth_done global_id 6596 payload 824 2024-09-12T00:33:13.681 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient: _finish_hunting 0 2024-09-12T00:33:13.681 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:33:12.971+0000 7f54921ff640 1 monclient: found mon.noname-c 2024-09-12T00:33:13.681 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.681 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.681 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:13.681 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: dump: 2024-09-12T00:33:13.682 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.682 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.682 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.682 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.682 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.682 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.682 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.682 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.682 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.682 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.682 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: _finish_auth 0 2024-09-12T00:33:13.683 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: _check_auth_tickets 2024-09-12T00:33:13.683 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:13.683 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.683 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:13.683 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: dump: 2024-09-12T00:33:13.683 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.683 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.683 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.683 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.683 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.683 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.683 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.683 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.683 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.684 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.684 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:33:12.971+0000 7f5375ffb640 4 set_mon_vals no callback set 2024-09-12T00:33:13.684 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:33:12.972+0000 7f5494715800 5 monclient: authenticate success, global_id 6596 2024-09-12T00:33:13.684 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:33:12.972+0000 7f5494715800 10 monclient: _renew_subs 2024-09-12T00:33:13.684 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:33:12.972+0000 7f5494715800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.684 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:33:12.972+0000 7f5494715800 10 monclient: _renew_subs 2024-09-12T00:33:13.684 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:33:12.972+0000 7f5494715800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.684 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:33:12.972+0000 7f5494715800 1 librados: init done 2024-09-12T00:33:13.684 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:33:12.972+0000 7f5494715800 5 asok(0x555951c13630) register_command cr dump hook 0x555951f12258 2024-09-12T00:33:13.684 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:33:12.973+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.684 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:33:12.973+0000 7f5363fff640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:33:13.684 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:33:12.973+0000 7f5363fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:13.684 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:33:12.973+0000 7f5363fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:13.684 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:33:12.974+0000 7f548bfff640 10 monclient: get_auth_request con 0x7f535c0764a0 auth_method 0 2024-09-12T00:33:13.684 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:33:12.974+0000 7f5492a00640 10 monclient: get_auth_request con 0x555951f213a0 auth_method 0 2024-09-12T00:33:13.685 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:33:12.974+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.685 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:33:12.974+0000 7f5494715800 20 realm 2024-09-12T00:33:13.685 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:33:12.974+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.685 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:33:12.975+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.685 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:33:12.975+0000 7f5494715800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:13.685 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:33:12.975+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.685 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:33:12.975+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.685 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:33:12.975+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.685 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:33:12.975+0000 7f548bfff640 10 monclient: get_auth_request con 0x555951f25730 auth_method 0 2024-09-12T00:33:13.685 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:33:12.975+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:13.685 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:33:12.975+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.686 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:33:12.976+0000 7f5492a00640 10 monclient: get_auth_request con 0x555951f28e50 auth_method 0 2024-09-12T00:33:13.686 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:33:12.976+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:13.686 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:33:12.976+0000 7f5494715800 20 searching for the correct realm 2024-09-12T00:33:13.686 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:33:12.977+0000 7f54921ff640 10 monclient: get_auth_request con 0x7f548c04dc20 auth_method 0 2024-09-12T00:33:13.686 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:33:13.178+0000 7f54921ff640 10 monclient: get_auth_request con 0x7f548c04dc20 auth_method 0 2024-09-12T00:33:13.686 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:33:13.180+0000 7f548bfff640 0 -- 172.21.15.133:0/2963956149 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f547c03f060 msgr2=0x7f547c067cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:13.686 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:33:13.381+0000 7f548bfff640 10 monclient: get_auth_request con 0x7f547c03f060 auth_method 0 2024-09-12T00:33:13.686 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:33:13.382+0000 7f5492a00640 10 monclient: get_auth_request con 0x7f548c072920 auth_method 0 2024-09-12T00:33:13.686 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:33:13.384+0000 7f54921ff640 10 monclient: get_auth_request con 0x7f547c028040 auth_method 0 2024-09-12T00:33:13.686 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:33:13.385+0000 7f548bfff640 0 -- 172.21.15.133:0/2963956149 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f548408a060 msgr2=0x7f5484082040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:13.686 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:33:13.587+0000 7f548bfff640 10 monclient: get_auth_request con 0x7f548408a060 auth_method 0 2024-09-12T00:33:13.687 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:13.687 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:13.687 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:13.687 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:13.687 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:13.687 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:13.687 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:33:13.593+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.687 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:33:13.593+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.687 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:33:13.593+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.687 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:33:13.593+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:13.687 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:33:13.593+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.687 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:33:13.593+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:13.687 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:33:13.593+0000 7f5494715800 20 zone default found 2024-09-12T00:33:13.687 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:33:13.593+0000 7f5494715800 4 Realm: () 2024-09-12T00:33:13.688 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:33:13.593+0000 7f5494715800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:13.688 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:33:13.593+0000 7f5494715800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:13.688 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:33:13.593+0000 7f5494715800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:13.688 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:33:13.593+0000 7f5494715800 20 zonegroup default 2024-09-12T00:33:13.688 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:33:13.593+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.688 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:33:13.594+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.688 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:33:13.594+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.688 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:33:13.594+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.688 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:33:13.594+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.688 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:33:13.594+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.688 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:33:13.594+0000 7f5494715800 20 started sync module instance, tier type = 2024-09-12T00:33:13.688 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:33:13.594+0000 7f5494715800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:13.688 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=0 2024-09-12T00:33:13.689 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=1 2024-09-12T00:33:13.689 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=2 2024-09-12T00:33:13.689 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=3 2024-09-12T00:33:13.689 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=4 2024-09-12T00:33:13.689 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=5 2024-09-12T00:33:13.689 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=6 2024-09-12T00:33:13.689 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:33:13.605+0000 7f5494715800 20 add_watcher() i=7 2024-09-12T00:33:13.689 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:33:13.605+0000 7f5494715800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:13.689 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding auth protocol: cephx 2024-09-12T00:33:13.689 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding auth protocol: cephx 2024-09-12T00:33:13.689 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding auth protocol: cephx 2024-09-12T00:33:13.689 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: secure 2024-09-12T00:33:13.689 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: crc 2024-09-12T00:33:13.689 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: secure 2024-09-12T00:33:13.690 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: crc 2024-09-12T00:33:13.690 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: secure 2024-09-12T00:33:13.690 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: crc 2024-09-12T00:33:13.690 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: crc 2024-09-12T00:33:13.690 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: secure 2024-09-12T00:33:13.690 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: crc 2024-09-12T00:33:13.690 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: secure 2024-09-12T00:33:13.690 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: crc 2024-09-12T00:33:13.690 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: secure 2024-09-12T00:33:13.690 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:33:13.607+0000 7f5348fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:13.690 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:33:13.607+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.690 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:33:13.607+0000 7f5494715800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:13.690 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:33:13.607+0000 7f5494715800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:13.690 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command cache list hook 0x555951ed4960 2024-09-12T00:33:13.691 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command cache inspect hook 0x555951ed4960 2024-09-12T00:33:13.691 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command cache erase hook 0x555951ed4960 2024-09-12T00:33:13.691 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command cache zap hook 0x555951ed4960 2024-09-12T00:33:13.691 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:33:13.607+0000 7f5494715800 5 note: GC not initialized 2024-09-12T00:33:13.691 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:33:13.607+0000 7f52c37fe640 20 reqs_thread_entry: start 2024-09-12T00:33:13.691 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command sync trace show hook 0x7f54840043a0 2024-09-12T00:33:13.691 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command sync trace history hook 0x7f54840043a0 2024-09-12T00:33:13.691 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command sync trace active hook 0x7f54840043a0 2024-09-12T00:33:13.691 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command sync trace active_short hook 0x7f54840043a0 2024-09-12T00:33:13.691 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:33:13.607+0000 7f5494715800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:13.691 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:33:13.607+0000 7f5494715800 20 Filter name: none 2024-09-12T00:33:13.691 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:33:13.607+0000 7f52c17fa640 20 reqs_thread_entry: start 2024-09-12T00:33:13.691 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:33:13.608+0000 7f5494715800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:33:13.691 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:33:13.608+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.691 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:33:13.608+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:13.692 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:33:13.608+0000 7f5494715800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:33:13.692 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:33:13.608+0000 7f5494715800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:33:13.692 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:33:13.608+0000 7f5494715800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 : miss 2024-09-12T00:33:13.692 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:33:13.608+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.692 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:33:13.608+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:13.692 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:33:13.608+0000 7f5494715800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:13.692 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:33:13.608+0000 7f5494715800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:13.692 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:33:13.608+0000 7f5494715800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:13.692 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:33:13.608+0000 7f5494715800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:13.692 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:33:13.608+0000 7f5494715800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 2024-09-12T00:33:13.692 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:33:13.612+0000 7f5494715800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:13.692 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:33:13.612+0000 7f5494715800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:13.692 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:33:13.612+0000 7f5494715800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:13.692 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:33:13.612+0000 7f5494715800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28, ofs0, ns] 2024-09-12T00:33:13.693 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:33:13.612+0000 7f5375ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 93842115333568 notifier 6596 bl.length()=1023 2024-09-12T00:33:13.693 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:33:13.612+0000 7f5375ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:13.693 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:33:13.612+0000 7f5375ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:13.693 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:33:13.612+0000 7f5375ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:13.693 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:33:13.614+0000 7f5494715800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): orig_sources= new_sources= 2024-09-12T00:33:13.693 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:33:13.614+0000 7f5494715800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): potential sources added=[] removed=[] 2024-09-12T00:33:13.693 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:33:13.614+0000 7f5494715800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): orig_dests= new_dests= 2024-09-12T00:33:13.693 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:33:13.614+0000 7f5494715800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): potential dests added=[] removed=[] 2024-09-12T00:33:13.693 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:33:13.615+0000 7f5494715800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5494715800 time 2024-09-12T00:33:13.615234+0000 2024-09-12T00:33:13.693 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:13.693 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.694 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:13.694 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5497b8c71a] 2024-09-12T00:33:13.694 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5497b8c8d8] 2024-09-12T00:33:13.694 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55594f90c641] 2024-09-12T00:33:13.694 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd884de) [0x55594fe1f4de] 2024-09-12T00:33:13.694 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55594f91c31d] 2024-09-12T00:33:13.694 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:33:13.694 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5496829590] 2024-09-12T00:33:13.694 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:33:13.694 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:33:13.694 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.694 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:33:13.616+0000 7f5494715800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:33:13.694 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f5494715800 thread_name:radosgw-admin 2024-09-12T00:33:13.695 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.695 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:13.695 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f549683e6f0] 2024-09-12T00:33:13.695 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f549688b99c] 2024-09-12T00:33:13.695 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:33:13.695 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:33:13.695 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5497b8c774] 2024-09-12T00:33:13.695 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5497b8c8d8] 2024-09-12T00:33:13.695 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55594f90c641] 2024-09-12T00:33:13.695 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd884de) [0x55594fe1f4de] 2024-09-12T00:33:13.695 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55594f91c31d] 2024-09-12T00:33:13.695 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:33:13.695 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5496829590] 2024-09-12T00:33:13.696 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:33:13.696 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:33:13.696 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:33:13.696 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.696 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:33:13.696 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:33:13.696 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:33:13.696 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:33:13.696 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:33:13.696 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:33:13.696 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:33:13.697 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:33:13.697 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:33:13.697 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:33:13.697 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:33:13.697 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:33:13.697 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:33:13.697 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:33:13.697 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:33:13.698 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:33:13.698 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:33:13.698 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:33:13.698 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:33:13.698 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:33:13.699 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:33:13.699 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:33:13.699 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:33:13.699 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:33:13.699 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:33:13.699 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:33:13.700 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:33:13.700 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:33:13.700 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:33:13.700 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:33:13.700 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:33:13.700 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:33:13.701 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:33:13.701 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:33:13.701 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:33:13.701 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:33:13.701 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:33:13.701 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:33:13.702 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:33:13.702 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:33:13.702 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:33:13.702 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:33:13.702 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:33:13.703 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:33:13.703 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:33:13.703 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:33:13.703 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:33:13.703 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:33:13.703 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:33:13.704 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:33:13.704 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:33:13.704 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:33:13.704 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:33:13.704 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:33:13.704 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:33:13.705 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:33:13.705 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:33:13.705 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:33:13.705 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:33:13.705 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:33:13.706 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:33:13.706 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:33:13.706 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:33:13.706 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:33:13.706 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:33:13.706 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:33:13.707 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:33:13.707 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:33:13.707 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:33:13.707 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:33:13.707 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:33:13.708 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:33:13.708 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:33:13.708 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:33:13.708 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:33:13.708 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:33:13.708 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:33:13.709 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:33:13.709 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:33:13.709 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:33:13.709 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:33:13.709 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:33:13.709 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:33:13.710 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:33:13.710 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:33:13.710 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:33:13.710 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:33:13.710 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:33:13.710 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:33:13.711 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:33:13.711 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:33:13.711 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:33:13.711 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:33:13.711 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:33:13.711 INFO:tasks.workunit.client.0.smithi133.stderr: 7f52c17fa640 / http_manager 2024-09-12T00:33:13.712 INFO:tasks.workunit.client.0.smithi133.stderr: 7f52c37fe640 / http_manager 2024-09-12T00:33:13.712 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5348fe1640 / rgw_dt_lg_renew 2024-09-12T00:33:13.712 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5363fff640 / ms_dispatch 2024-09-12T00:33:13.712 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5375ffb640 / io_context_pool 2024-09-12T00:33:13.712 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5377fff640 / ms_dispatch 2024-09-12T00:33:13.712 INFO:tasks.workunit.client.0.smithi133.stderr: 7f537ee05640 / ms_dispatch 2024-09-12T00:33:13.713 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5380608640 / io_context_pool 2024-09-12T00:33:13.713 INFO:tasks.workunit.client.0.smithi133.stderr: 7f548bfff640 / msgr-worker-2 2024-09-12T00:33:13.713 INFO:tasks.workunit.client.0.smithi133.stderr: 7f54921ff640 / msgr-worker-1 2024-09-12T00:33:13.713 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5492a00640 / msgr-worker-0 2024-09-12T00:33:13.713 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5493201640 / io_context_pool 2024-09-12T00:33:13.713 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5494715800 / radosgw-admin 2024-09-12T00:33:13.714 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:33:13.714 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:33:13.714 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/log/ceph/ceph-client.admin.109411.log 2024-09-12T00:33:13.714 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:33:13.714 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:33:13.715 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:33:12.956+0000 7f5380608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:13.715 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:33:12.956+0000 7f5380608640 10 monclient: dump: 2024-09-12T00:33:13.715 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.715 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.715 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.715 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.715 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.716 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.716 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.716 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.716 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.716 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.716 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:33:12.956+0000 7f5494715800 5 monclient: authenticate success, global_id 6584 2024-09-12T00:33:13.717 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:33:12.956+0000 7f5494715800 10 monclient: get_monmap_and_config success 2024-09-12T00:33:13.717 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:33:12.956+0000 7f5494715800 4 set_mon_vals no callback set 2024-09-12T00:33:13.717 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:33:12.957+0000 7f5494715800 10 monclient: shutdown 2024-09-12T00:33:13.717 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:33:12.957+0000 7f5494715800 5 asok(0x555951c13630) unregister_commands rotate-key 2024-09-12T00:33:13.717 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:33:12.957+0000 7f5494715800 10 monclient: build_initial_monmap 2024-09-12T00:33:13.718 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:33:12.957+0000 7f5494715800 1 build_initial for_mkfs: 0 2024-09-12T00:33:13.718 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:33:12.957+0000 7f5494715800 10 monclient: monmap: 2024-09-12T00:33:13.718 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:33:13.718 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:13.718 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:33:13.718 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:33:13.718 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:13.719 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.719 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:33:13.719 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:33:13.719 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:33:13.719 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.719 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding auth protocol: cephx 2024-09-12T00:33:13.719 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding auth protocol: cephx 2024-09-12T00:33:13.720 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding auth protocol: cephx 2024-09-12T00:33:13.720 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: secure 2024-09-12T00:33:13.720 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: crc 2024-09-12T00:33:13.720 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: secure 2024-09-12T00:33:13.720 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: crc 2024-09-12T00:33:13.720 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: secure 2024-09-12T00:33:13.721 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: crc 2024-09-12T00:33:13.721 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: crc 2024-09-12T00:33:13.721 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: secure 2024-09-12T00:33:13.721 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: crc 2024-09-12T00:33:13.721 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: secure 2024-09-12T00:33:13.721 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: crc 2024-09-12T00:33:13.721 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e39980) adding con mode: secure 2024-09-12T00:33:13.721 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:33:12.957+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.721 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:33:12.957+0000 7f5494715800 1 librados: starting msgr at 2024-09-12T00:33:13.721 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:33:12.957+0000 7f5494715800 1 librados: starting objecter 2024-09-12T00:33:13.722 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:33:12.957+0000 7f5494715800 5 asok(0x555951c13630) register_command objecter_requests hook 0x555951e37590 2024-09-12T00:33:13.722 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:33:12.957+0000 7f5494715800 1 librados: setting wanted keys 2024-09-12T00:33:13.722 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:33:12.957+0000 7f5494715800 1 librados: calling monclient init 2024-09-12T00:33:13.722 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:33:12.957+0000 7f5494715800 10 monclient: init 2024-09-12T00:33:13.722 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding auth protocol: cephx 2024-09-12T00:33:13.722 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding auth protocol: cephx 2024-09-12T00:33:13.722 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding auth protocol: cephx 2024-09-12T00:33:13.722 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: secure 2024-09-12T00:33:13.722 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: crc 2024-09-12T00:33:13.722 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: secure 2024-09-12T00:33:13.722 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: crc 2024-09-12T00:33:13.722 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: secure 2024-09-12T00:33:13.722 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: crc 2024-09-12T00:33:13.722 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: crc 2024-09-12T00:33:13.723 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: secure 2024-09-12T00:33:13.723 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: crc 2024-09-12T00:33:13.723 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: secure 2024-09-12T00:33:13.723 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: crc 2024-09-12T00:33:13.723 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:33:12.957+0000 7f5494715800 5 AuthRegistry(0x555951e33cd0) adding con mode: secure 2024-09-12T00:33:13.723 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:33:12.958+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.723 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:33:12.958+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.723 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:33:12.958+0000 7f5494715800 5 asok(0x555951c13630) register_command rotate-key hook 0x555951e33e18 2024-09-12T00:33:13.723 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:13.723 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:33:13.723 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): picked mon.noname-c con 0x555951ceada0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:13.723 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): picked mon.noname-a con 0x555951d760d0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:13.723 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): picked mon.noname-b con 0x555951d7c5f0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:13.724 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.724 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.724 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.724 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:13.724 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient(hunting): authenticate will time out at 2001.530352s 2024-09-12T00:33:13.724 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): get_auth_request con 0x555951ceada0 auth_method 0 2024-09-12T00:33:13.724 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.724 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.724 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.724 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:33:12.958+0000 7f548bfff640 10 monclient(hunting): get_auth_request con 0x555951d760d0 auth_method 0 2024-09-12T00:33:13.724 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:33:12.958+0000 7f548bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.724 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:33:12.958+0000 7f548bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.725 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:33:12.958+0000 7f548bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.725 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.725 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.725 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.725 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:33:12.958+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.725 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:33:12.958+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.725 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:33:12.958+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.725 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:33:12.958+0000 7f5492a00640 10 monclient(hunting): get_auth_request con 0x555951d7c5f0 auth_method 0 2024-09-12T00:33:13.725 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:33:12.958+0000 7f5492a00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.725 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:33:12.958+0000 7f5492a00640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.725 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:33:12.958+0000 7f5492a00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.725 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient(hunting): handle_auth_done global_id 6587 payload 824 2024-09-12T00:33:13.726 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient: _finish_hunting 0 2024-09-12T00:33:13.726 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:33:12.958+0000 7f54921ff640 1 monclient: found mon.noname-c 2024-09-12T00:33:13.726 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:33:12.958+0000 7f54921ff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.726 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.726 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:13.726 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: dump: 2024-09-12T00:33:13.726 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.726 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.726 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.726 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.726 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.726 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.727 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.727 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.727 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.727 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.727 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: _finish_auth 0 2024-09-12T00:33:13.727 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: _check_auth_tickets 2024-09-12T00:33:13.727 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:13.727 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.727 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:13.727 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:33:12.958+0000 7f537ee05640 10 monclient: dump: 2024-09-12T00:33:13.727 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.727 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.727 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.727 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.728 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.728 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.728 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.728 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.728 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.728 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.728 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:33:12.958+0000 7f5494715800 5 monclient: authenticate success, global_id 6587 2024-09-12T00:33:13.728 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient: _renew_subs 2024-09-12T00:33:13.728 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:33:12.958+0000 7f5494715800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.728 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:33:12.958+0000 7f5380608640 4 set_mon_vals no callback set 2024-09-12T00:33:13.728 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:33:12.959+0000 7f5494715800 10 monclient: _renew_subs 2024-09-12T00:33:13.728 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:33:12.959+0000 7f5494715800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.728 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:33:12.959+0000 7f5494715800 1 librados: init done 2024-09-12T00:33:13.729 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:33:12.960+0000 7f537ee05640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:33:13.729 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:33:12.960+0000 7f537ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:13.729 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:33:12.960+0000 7f537ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:13.729 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:33:12.960+0000 7f548bfff640 10 monclient: get_auth_request con 0x7f5378076470 auth_method 0 2024-09-12T00:33:13.729 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:33:12.961+0000 7f5492a00640 10 monclient: get_auth_request con 0x555951e75d80 auth_method 0 2024-09-12T00:33:13.729 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:33:12.961+0000 7f54921ff640 10 monclient: get_auth_request con 0x555951e7f270 auth_method 0 2024-09-12T00:33:13.729 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:33:12.962+0000 7f548bfff640 10 monclient: get_auth_request con 0x555951e83700 auth_method 0 2024-09-12T00:33:13.729 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:33:12.963+0000 7f5492a00640 10 monclient: get_auth_request con 0x555951e82b30 auth_method 0 2024-09-12T00:33:13.729 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:33:12.964+0000 7f5494715800 10 monclient: build_initial_monmap 2024-09-12T00:33:13.729 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:33:12.964+0000 7f5494715800 1 build_initial for_mkfs: 0 2024-09-12T00:33:13.729 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:33:12.964+0000 7f5494715800 10 monclient: monmap: 2024-09-12T00:33:13.729 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:33:13.729 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:13.729 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:33:13.730 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:33:13.730 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:13.730 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.730 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:33:13.730 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:33:13.730 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:33:13.730 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.730 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding auth protocol: cephx 2024-09-12T00:33:13.730 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding auth protocol: cephx 2024-09-12T00:33:13.730 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding auth protocol: cephx 2024-09-12T00:33:13.730 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: secure 2024-09-12T00:33:13.730 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: crc 2024-09-12T00:33:13.730 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: secure 2024-09-12T00:33:13.730 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: crc 2024-09-12T00:33:13.730 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: secure 2024-09-12T00:33:13.731 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: crc 2024-09-12T00:33:13.731 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: crc 2024-09-12T00:33:13.731 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: secure 2024-09-12T00:33:13.731 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: crc 2024-09-12T00:33:13.731 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: secure 2024-09-12T00:33:13.731 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: crc 2024-09-12T00:33:13.731 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8b990) adding con mode: secure 2024-09-12T00:33:13.731 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:33:12.964+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.731 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:33:12.964+0000 7f5494715800 5 asok(0x555951c13630) register_command objecter_requests cmddesc objecter_requests hook 0x555951e8f2d0 EEXIST 2024-09-12T00:33:13.731 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:33:12.964+0000 7f5494715800 10 monclient: init 2024-09-12T00:33:13.731 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding auth protocol: cephx 2024-09-12T00:33:13.731 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding auth protocol: cephx 2024-09-12T00:33:13.731 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding auth protocol: cephx 2024-09-12T00:33:13.731 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: secure 2024-09-12T00:33:13.732 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: crc 2024-09-12T00:33:13.732 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: secure 2024-09-12T00:33:13.732 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: crc 2024-09-12T00:33:13.732 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: secure 2024-09-12T00:33:13.732 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: crc 2024-09-12T00:33:13.732 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: crc 2024-09-12T00:33:13.732 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: secure 2024-09-12T00:33:13.732 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: crc 2024-09-12T00:33:13.732 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: secure 2024-09-12T00:33:13.732 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: crc 2024-09-12T00:33:13.732 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:33:12.964+0000 7f5494715800 5 AuthRegistry(0x555951e8a7e8) adding con mode: secure 2024-09-12T00:33:13.732 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:33:12.965+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.732 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:33:12.965+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.732 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:33:12.965+0000 7f5494715800 5 asok(0x555951c13630) register_command rotate-key cmddesc rotate-key hook 0x555951e8a930 EEXIST 2024-09-12T00:33:13.733 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:13.733 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:33:13.733 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): picked mon.noname-c con 0x555951eb2fc0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:13.733 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): picked mon.noname-b con 0x555951eb5290 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:13.733 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): picked mon.noname-a con 0x555951eb1790 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:13.733 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.733 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.733 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.733 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:13.733 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:33:12.965+0000 7f5494715800 10 monclient(hunting): authenticate will time out at 2001.537433s 2024-09-12T00:33:13.733 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): get_auth_request con 0x555951eb2fc0 auth_method 0 2024-09-12T00:33:13.733 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.734 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.734 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.734 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:33:12.965+0000 7f54921ff640 10 monclient(hunting): get_auth_request con 0x555951eb1790 auth_method 0 2024-09-12T00:33:13.734 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:33:12.965+0000 7f54921ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.734 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:33:12.965+0000 7f54921ff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.734 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:33:12.965+0000 7f54921ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.734 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:33:12.965+0000 7f5492a00640 10 monclient(hunting): get_auth_request con 0x555951eb5290 auth_method 0 2024-09-12T00:33:13.734 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:33:12.965+0000 7f5492a00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.734 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:33:12.965+0000 7f5492a00640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.734 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:33:12.965+0000 7f5492a00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.734 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.734 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.734 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.734 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:33:12.965+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.734 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:33:12.965+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.735 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:33:12.965+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.735 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:33:12.965+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.735 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:33:12.965+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.735 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:33:12.965+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.735 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient(hunting): handle_auth_done global_id 6590 payload 824 2024-09-12T00:33:13.735 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient: _finish_hunting 0 2024-09-12T00:33:13.735 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:33:12.965+0000 7f548bfff640 1 monclient: found mon.noname-c 2024-09-12T00:33:13.735 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:33:12.965+0000 7f548bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.735 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.735 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:13.735 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: dump: 2024-09-12T00:33:13.735 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.735 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.736 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.736 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.736 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.736 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.736 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.736 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.736 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.736 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.736 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: _finish_auth 0 2024-09-12T00:33:13.736 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: _check_auth_tickets 2024-09-12T00:33:13.736 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:13.736 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.736 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:13.737 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:33:12.966+0000 7f5377fff640 10 monclient: dump: 2024-09-12T00:33:13.737 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.737 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.737 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.737 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.737 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.737 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.737 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.737 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.737 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.737 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.737 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:33:12.966+0000 7f5494715800 5 monclient: authenticate success, global_id 6590 2024-09-12T00:33:13.737 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:33:12.966+0000 7f5494715800 10 monclient: _renew_subs 2024-09-12T00:33:13.738 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:33:12.966+0000 7f5494715800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.738 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:33:12.966+0000 7f5493201640 4 set_mon_vals no callback set 2024-09-12T00:33:13.738 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:33:12.966+0000 7f5494715800 10 monclient: _renew_subs 2024-09-12T00:33:13.738 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:33:12.966+0000 7f5494715800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.738 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:33:12.967+0000 7f5377fff640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:33:13.738 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:33:12.967+0000 7f5377fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:13.738 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:33:12.967+0000 7f5377fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:13.738 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:33:12.968+0000 7f5492a00640 10 monclient: get_auth_request con 0x7f536c076380 auth_method 0 2024-09-12T00:33:13.738 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:33:12.968+0000 7f5494715800 10 monclient: get_monmap_and_config 2024-09-12T00:33:13.738 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:33:12.968+0000 7f5494715800 10 monclient: build_initial_monmap 2024-09-12T00:33:13.738 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:33:12.968+0000 7f5494715800 1 build_initial for_mkfs: 0 2024-09-12T00:33:13.738 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:33:12.968+0000 7f5494715800 10 monclient: monmap: 2024-09-12T00:33:13.738 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:33:13.738 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:13.738 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:33:13.739 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:33:13.739 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:13.739 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.739 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:33:13.739 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:33:13.739 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:33:13.739 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.739 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding auth protocol: cephx 2024-09-12T00:33:13.739 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding auth protocol: cephx 2024-09-12T00:33:13.739 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding auth protocol: cephx 2024-09-12T00:33:13.739 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: secure 2024-09-12T00:33:13.739 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: crc 2024-09-12T00:33:13.739 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: secure 2024-09-12T00:33:13.739 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: crc 2024-09-12T00:33:13.740 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: secure 2024-09-12T00:33:13.740 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: crc 2024-09-12T00:33:13.740 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: crc 2024-09-12T00:33:13.740 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: secure 2024-09-12T00:33:13.740 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: crc 2024-09-12T00:33:13.740 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: secure 2024-09-12T00:33:13.740 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: crc 2024-09-12T00:33:13.740 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x555951ed2cc0) adding con mode: secure 2024-09-12T00:33:13.740 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:33:12.968+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.740 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:33:12.968+0000 7f5494715800 10 monclient: init 2024-09-12T00:33:13.740 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding auth protocol: cephx 2024-09-12T00:33:13.740 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding auth protocol: cephx 2024-09-12T00:33:13.740 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding auth protocol: cephx 2024-09-12T00:33:13.740 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: secure 2024-09-12T00:33:13.740 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: crc 2024-09-12T00:33:13.741 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: secure 2024-09-12T00:33:13.741 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: crc 2024-09-12T00:33:13.741 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: secure 2024-09-12T00:33:13.741 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: crc 2024-09-12T00:33:13.741 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: crc 2024-09-12T00:33:13.741 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: secure 2024-09-12T00:33:13.741 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: crc 2024-09-12T00:33:13.741 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: secure 2024-09-12T00:33:13.741 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: crc 2024-09-12T00:33:13.741 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:33:12.968+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97940) adding con mode: secure 2024-09-12T00:33:13.741 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:33:12.968+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.741 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:33:12.969+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.742 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:33:12.969+0000 7f5494715800 5 asok(0x555951c13630) register_command rotate-key cmddesc rotate-key hook 0x7ffc1af97a88 EEXIST 2024-09-12T00:33:13.742 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:13.742 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:33:13.742 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): picked mon.noname-c con 0x555951f07290 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:13.742 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): picked mon.noname-b con 0x555951f01830 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:13.742 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): picked mon.noname-a con 0x555951ed70d0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:13.742 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.742 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.742 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.742 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:13.742 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient(hunting): authenticate will time out at 2001.541158s 2024-09-12T00:33:13.742 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:33:12.969+0000 7f548bfff640 10 monclient(hunting): get_auth_request con 0x555951f07290 auth_method 0 2024-09-12T00:33:13.742 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:33:12.969+0000 7f548bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.742 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:33:12.969+0000 7f548bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.743 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:33:12.969+0000 7f548bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.743 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): get_auth_request con 0x555951ed70d0 auth_method 0 2024-09-12T00:33:13.743 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.743 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.743 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.743 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:33:12.969+0000 7f5492a00640 10 monclient(hunting): get_auth_request con 0x555951f01830 auth_method 0 2024-09-12T00:33:13.743 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:33:12.969+0000 7f5492a00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.743 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:33:12.969+0000 7f5492a00640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.743 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:33:12.969+0000 7f5492a00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.743 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:33:12.969+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.743 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:33:12.969+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.743 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:33:12.969+0000 7f548bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.743 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.743 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.743 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.744 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:33:12.969+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.744 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:33:12.969+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.744 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:33:12.969+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.744 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient(hunting): handle_auth_done global_id 6978 payload 274 2024-09-12T00:33:13.744 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient: _finish_hunting 0 2024-09-12T00:33:13.744 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:33:12.969+0000 7f54921ff640 1 monclient: found mon.noname-a 2024-09-12T00:33:13.744 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:33:12.969+0000 7f54921ff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:33:13.744 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.744 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:33:13.744 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: dump: 2024-09-12T00:33:13.744 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.744 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.744 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.744 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.745 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.745 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.745 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.745 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.745 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.745 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.745 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: _finish_auth 0 2024-09-12T00:33:13.745 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:33:13.745 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:13.745 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:33:12.969+0000 7f5494715800 5 monclient: authenticate success, global_id 6978 2024-09-12T00:33:13.745 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:33:12.969+0000 7f5494715800 10 monclient: get_monmap_and_config success 2024-09-12T00:33:13.745 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:33:12.969+0000 7f5494715800 4 set_mon_vals no callback set 2024-09-12T00:33:13.745 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.745 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:33:13.746 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:33:12.969+0000 7f5375ffb640 10 monclient: dump: 2024-09-12T00:33:13.746 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.746 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.746 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.746 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.746 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.746 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.746 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.746 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.747 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.747 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.747 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:33:12.970+0000 7f5494715800 10 monclient: shutdown 2024-09-12T00:33:13.747 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:33:12.970+0000 7f5494715800 10 monclient: build_initial_monmap 2024-09-12T00:33:13.747 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:33:12.970+0000 7f5494715800 1 build_initial for_mkfs: 0 2024-09-12T00:33:13.747 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:33:12.970+0000 7f5494715800 10 monclient: monmap: 2024-09-12T00:33:13.747 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:33:13.747 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:13.747 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:33:13.747 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:33:13.747 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:13.747 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.747 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:33:13.747 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:33:13.748 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:33:13.748 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.748 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding auth protocol: cephx 2024-09-12T00:33:13.748 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding auth protocol: cephx 2024-09-12T00:33:13.748 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding auth protocol: cephx 2024-09-12T00:33:13.748 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: secure 2024-09-12T00:33:13.748 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: crc 2024-09-12T00:33:13.748 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: secure 2024-09-12T00:33:13.748 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: crc 2024-09-12T00:33:13.748 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: secure 2024-09-12T00:33:13.748 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: crc 2024-09-12T00:33:13.748 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: crc 2024-09-12T00:33:13.748 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: secure 2024-09-12T00:33:13.748 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: crc 2024-09-12T00:33:13.749 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: secure 2024-09-12T00:33:13.749 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: crc 2024-09-12T00:33:13.749 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951f027f0) adding con mode: secure 2024-09-12T00:33:13.749 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:33:12.970+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.749 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:33:12.970+0000 7f5494715800 1 librados: starting msgr at 2024-09-12T00:33:13.749 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:33:12.970+0000 7f5494715800 1 librados: starting objecter 2024-09-12T00:33:13.749 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:33:12.970+0000 7f5494715800 5 asok(0x555951c13630) register_command objecter_requests cmddesc objecter_requests hook 0x555951e68870 EEXIST 2024-09-12T00:33:13.749 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:33:12.970+0000 7f5494715800 1 librados: setting wanted keys 2024-09-12T00:33:13.749 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:33:12.970+0000 7f5494715800 1 librados: calling monclient init 2024-09-12T00:33:13.749 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:33:12.970+0000 7f5494715800 10 monclient: init 2024-09-12T00:33:13.749 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding auth protocol: cephx 2024-09-12T00:33:13.749 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding auth protocol: cephx 2024-09-12T00:33:13.749 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding auth protocol: cephx 2024-09-12T00:33:13.749 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: secure 2024-09-12T00:33:13.750 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: crc 2024-09-12T00:33:13.750 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: secure 2024-09-12T00:33:13.750 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: crc 2024-09-12T00:33:13.750 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: secure 2024-09-12T00:33:13.750 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: crc 2024-09-12T00:33:13.750 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: crc 2024-09-12T00:33:13.750 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: secure 2024-09-12T00:33:13.750 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: crc 2024-09-12T00:33:13.750 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: secure 2024-09-12T00:33:13.750 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: crc 2024-09-12T00:33:13.750 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:33:12.970+0000 7f5494715800 5 AuthRegistry(0x555951ecad70) adding con mode: secure 2024-09-12T00:33:13.750 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:33:12.971+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.750 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:33:12.971+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.750 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:33:12.971+0000 7f5494715800 5 asok(0x555951c13630) register_command rotate-key cmddesc rotate-key hook 0x555951ecaeb8 EEXIST 2024-09-12T00:33:13.751 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:13.751 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:33:13.751 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): picked mon.noname-a con 0x555951ed70d0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:13.751 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): picked mon.noname-b con 0x555951f01830 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:13.751 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): picked mon.noname-c con 0x555951f07290 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:13.751 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.751 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.751 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:13.751 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:13.751 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:33:12.971+0000 7f5494715800 10 monclient(hunting): authenticate will time out at 2001.543357s 2024-09-12T00:33:13.751 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): get_auth_request con 0x555951f07290 auth_method 0 2024-09-12T00:33:13.751 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.751 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.751 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.751 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:33:12.971+0000 7f548bfff640 10 monclient(hunting): get_auth_request con 0x555951ed70d0 auth_method 0 2024-09-12T00:33:13.752 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:33:12.971+0000 7f548bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.752 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:33:12.971+0000 7f548bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.752 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:33:12.971+0000 7f548bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.752 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:33:12.971+0000 7f5492a00640 10 monclient(hunting): get_auth_request con 0x555951f01830 auth_method 0 2024-09-12T00:33:13.752 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:33:12.971+0000 7f5492a00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:13.752 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:33:12.971+0000 7f5492a00640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:13.752 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:33:12.971+0000 7f5492a00640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:13.752 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.752 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.752 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.752 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:33:12.971+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:13.753 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:33:12.971+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:13.753 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:33:12.971+0000 7f5492a00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:13.753 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient(hunting): handle_auth_done global_id 6596 payload 824 2024-09-12T00:33:13.753 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient: _finish_hunting 0 2024-09-12T00:33:13.753 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:33:12.971+0000 7f54921ff640 1 monclient: found mon.noname-c 2024-09-12T00:33:13.753 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:33:12.971+0000 7f54921ff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.753 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.753 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:13.753 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: dump: 2024-09-12T00:33:13.753 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.753 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.753 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.753 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.753 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.754 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.754 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.754 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.754 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.754 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.754 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: _finish_auth 0 2024-09-12T00:33:13.754 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: _check_auth_tickets 2024-09-12T00:33:13.755 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:13.755 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:13.755 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:13.755 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:33:12.971+0000 7f5363fff640 10 monclient: dump: 2024-09-12T00:33:13.755 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:13.755 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:13.755 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.756 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:13.756 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:13.756 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:13.756 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:13.756 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:13.756 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:13.757 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.757 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:33:12.971+0000 7f5375ffb640 4 set_mon_vals no callback set 2024-09-12T00:33:13.757 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:33:12.972+0000 7f5494715800 5 monclient: authenticate success, global_id 6596 2024-09-12T00:33:13.757 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:33:12.972+0000 7f5494715800 10 monclient: _renew_subs 2024-09-12T00:33:13.757 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:33:12.972+0000 7f5494715800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.757 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:33:12.972+0000 7f5494715800 10 monclient: _renew_subs 2024-09-12T00:33:13.758 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:33:12.972+0000 7f5494715800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:13.758 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:33:12.972+0000 7f5494715800 1 librados: init done 2024-09-12T00:33:13.758 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:33:12.972+0000 7f5494715800 5 asok(0x555951c13630) register_command cr dump hook 0x555951f12258 2024-09-12T00:33:13.758 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:33:12.973+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.758 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:33:12.973+0000 7f5363fff640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:33:13.758 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:33:12.973+0000 7f5363fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:13.759 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:33:12.973+0000 7f5363fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:13.759 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:33:12.974+0000 7f548bfff640 10 monclient: get_auth_request con 0x7f535c0764a0 auth_method 0 2024-09-12T00:33:13.759 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:33:12.974+0000 7f5492a00640 10 monclient: get_auth_request con 0x555951f213a0 auth_method 0 2024-09-12T00:33:13.759 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:33:12.974+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.759 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:33:12.974+0000 7f5494715800 20 realm 2024-09-12T00:33:13.759 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:33:12.974+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.759 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:33:12.975+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.760 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:33:12.975+0000 7f5494715800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:13.760 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:33:12.975+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.760 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:33:12.975+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.760 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:33:12.975+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.760 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:33:12.975+0000 7f548bfff640 10 monclient: get_auth_request con 0x555951f25730 auth_method 0 2024-09-12T00:33:13.760 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:33:12.975+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:13.761 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:33:12.975+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.761 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:33:12.976+0000 7f5492a00640 10 monclient: get_auth_request con 0x555951f28e50 auth_method 0 2024-09-12T00:33:13.761 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:33:12.976+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:13.761 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:33:12.976+0000 7f5494715800 20 searching for the correct realm 2024-09-12T00:33:13.761 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:33:12.977+0000 7f54921ff640 10 monclient: get_auth_request con 0x7f548c04dc20 auth_method 0 2024-09-12T00:33:13.761 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:33:13.178+0000 7f54921ff640 10 monclient: get_auth_request con 0x7f548c04dc20 auth_method 0 2024-09-12T00:33:13.761 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:33:13.180+0000 7f548bfff640 0 -- 172.21.15.133:0/2963956149 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f547c03f060 msgr2=0x7f547c067cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:13.761 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:33:13.381+0000 7f548bfff640 10 monclient: get_auth_request con 0x7f547c03f060 auth_method 0 2024-09-12T00:33:13.761 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:33:13.382+0000 7f5492a00640 10 monclient: get_auth_request con 0x7f548c072920 auth_method 0 2024-09-12T00:33:13.761 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:33:13.384+0000 7f54921ff640 10 monclient: get_auth_request con 0x7f547c028040 auth_method 0 2024-09-12T00:33:13.761 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:33:13.385+0000 7f548bfff640 0 -- 172.21.15.133:0/2963956149 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f548408a060 msgr2=0x7f5484082040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:13.761 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:33:13.587+0000 7f548bfff640 10 monclient: get_auth_request con 0x7f548408a060 auth_method 0 2024-09-12T00:33:13.761 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:13.762 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:13.762 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:13.762 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:13.762 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:13.762 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:33:13.593+0000 7f5494715800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:13.762 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:33:13.593+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.762 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:33:13.593+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.762 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:33:13.593+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.762 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:33:13.593+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:13.762 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:33:13.593+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.762 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:33:13.593+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:13.762 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:33:13.593+0000 7f5494715800 20 zone default found 2024-09-12T00:33:13.762 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:33:13.593+0000 7f5494715800 4 Realm: () 2024-09-12T00:33:13.763 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:33:13.593+0000 7f5494715800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:13.763 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:33:13.593+0000 7f5494715800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:13.763 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:33:13.593+0000 7f5494715800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:13.763 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:33:13.593+0000 7f5494715800 20 zonegroup default 2024-09-12T00:33:13.763 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:33:13.593+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.763 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:33:13.594+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.763 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:33:13.594+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.763 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:33:13.594+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.763 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:33:13.594+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.763 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:33:13.594+0000 7f5494715800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.763 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:33:13.594+0000 7f5494715800 20 started sync module instance, tier type = 2024-09-12T00:33:13.764 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:33:13.594+0000 7f5494715800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:13.764 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=0 2024-09-12T00:33:13.764 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=1 2024-09-12T00:33:13.764 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=2 2024-09-12T00:33:13.764 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=3 2024-09-12T00:33:13.764 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=4 2024-09-12T00:33:13.764 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=5 2024-09-12T00:33:13.764 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:33:13.604+0000 7f5494715800 20 add_watcher() i=6 2024-09-12T00:33:13.764 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:33:13.605+0000 7f5494715800 20 add_watcher() i=7 2024-09-12T00:33:13.764 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:33:13.605+0000 7f5494715800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:13.764 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding auth protocol: cephx 2024-09-12T00:33:13.764 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding auth protocol: cephx 2024-09-12T00:33:13.764 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding auth protocol: cephx 2024-09-12T00:33:13.764 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: secure 2024-09-12T00:33:13.765 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: crc 2024-09-12T00:33:13.765 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: secure 2024-09-12T00:33:13.765 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: crc 2024-09-12T00:33:13.765 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: secure 2024-09-12T00:33:13.765 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: crc 2024-09-12T00:33:13.765 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: crc 2024-09-12T00:33:13.765 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: secure 2024-09-12T00:33:13.765 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: crc 2024-09-12T00:33:13.765 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: secure 2024-09-12T00:33:13.765 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: crc 2024-09-12T00:33:13.765 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:33:13.607+0000 7f5494715800 5 AuthRegistry(0x7ffc1af97e20) adding con mode: secure 2024-09-12T00:33:13.765 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:33:13.607+0000 7f5348fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:13.765 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:33:13.607+0000 7f5494715800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:13.766 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:33:13.607+0000 7f5494715800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:13.766 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:33:13.607+0000 7f5494715800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:13.766 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command cache list hook 0x555951ed4960 2024-09-12T00:33:13.766 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command cache inspect hook 0x555951ed4960 2024-09-12T00:33:13.766 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command cache erase hook 0x555951ed4960 2024-09-12T00:33:13.766 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command cache zap hook 0x555951ed4960 2024-09-12T00:33:13.766 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:33:13.607+0000 7f5494715800 5 note: GC not initialized 2024-09-12T00:33:13.766 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:33:13.607+0000 7f52c37fe640 20 reqs_thread_entry: start 2024-09-12T00:33:13.766 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command sync trace show hook 0x7f54840043a0 2024-09-12T00:33:13.766 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command sync trace history hook 0x7f54840043a0 2024-09-12T00:33:13.766 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command sync trace active hook 0x7f54840043a0 2024-09-12T00:33:13.766 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:33:13.607+0000 7f5494715800 5 asok(0x555951c13630) register_command sync trace active_short hook 0x7f54840043a0 2024-09-12T00:33:13.766 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:33:13.607+0000 7f5494715800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:13.766 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:33:13.607+0000 7f5494715800 20 Filter name: none 2024-09-12T00:33:13.767 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:33:13.607+0000 7f52c17fa640 20 reqs_thread_entry: start 2024-09-12T00:33:13.767 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:33:13.608+0000 7f5494715800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:33:13.767 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:33:13.608+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.767 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:33:13.608+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:13.767 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:33:13.608+0000 7f5494715800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:33:13.767 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:33:13.608+0000 7f5494715800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:33:13.767 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:33:13.608+0000 7f5494715800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 : miss 2024-09-12T00:33:13.767 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:33:13.608+0000 7f5494715800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.767 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:33:13.608+0000 7f5494715800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:13.767 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:33:13.608+0000 7f5494715800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:13.767 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:33:13.608+0000 7f5494715800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:13.767 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:33:13.608+0000 7f5494715800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:13.767 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:33:13.608+0000 7f5494715800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:13.767 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:33:13.608+0000 7f5494715800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 2024-09-12T00:33:13.768 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:33:13.612+0000 7f5494715800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:13.768 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:33:13.612+0000 7f5494715800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:13.768 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:33:13.612+0000 7f5494715800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:13.768 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:33:13.612+0000 7f5494715800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28, ofs0, ns] 2024-09-12T00:33:13.768 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:33:13.612+0000 7f5375ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 93842115333568 notifier 6596 bl.length()=1023 2024-09-12T00:33:13.768 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:33:13.612+0000 7f5375ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:13.769 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:33:13.612+0000 7f5375ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:13.769 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:33:13.612+0000 7f5375ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:13.769 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:33:13.614+0000 7f5494715800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): orig_sources= new_sources= 2024-09-12T00:33:13.769 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:33:13.614+0000 7f5494715800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): potential sources added=[] removed=[] 2024-09-12T00:33:13.769 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:33:13.614+0000 7f5494715800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): orig_dests= new_dests= 2024-09-12T00:33:13.769 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:33:13.614+0000 7f5494715800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): potential dests added=[] removed=[] 2024-09-12T00:33:13.769 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:33:13.615+0000 7f5494715800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5494715800 time 2024-09-12T00:33:13.615234+0000 2024-09-12T00:33:13.769 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:13.770 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.770 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:13.770 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5497b8c71a] 2024-09-12T00:33:13.770 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5497b8c8d8] 2024-09-12T00:33:13.770 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55594f90c641] 2024-09-12T00:33:13.770 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd884de) [0x55594fe1f4de] 2024-09-12T00:33:13.770 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55594f91c31d] 2024-09-12T00:33:13.770 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:33:13.770 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5496829590] 2024-09-12T00:33:13.771 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:33:13.771 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:33:13.771 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.771 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:33:13.616+0000 7f5494715800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:33:13.771 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f5494715800 thread_name:radosgw-admin 2024-09-12T00:33:13.771 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.771 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:13.771 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f549683e6f0] 2024-09-12T00:33:13.771 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f549688b99c] 2024-09-12T00:33:13.771 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:33:13.771 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:33:13.772 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5497b8c774] 2024-09-12T00:33:13.772 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5497b8c8d8] 2024-09-12T00:33:13.772 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55594f90c641] 2024-09-12T00:33:13.772 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd884de) [0x55594fe1f4de] 2024-09-12T00:33:13.772 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55594f91c31d] 2024-09-12T00:33:13.772 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:33:13.772 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5496829590] 2024-09-12T00:33:13.772 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:33:13.772 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:33:13.772 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:33:13.772 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.772 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:33:13.772 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:33:13.773 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:33:13.773 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:33:13.773 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:33:13.773 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:33:13.773 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:33:13.773 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:33:13.773 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:33:13.773 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:33:13.773 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:33:13.773 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:33:13.773 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:33:13.773 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:33:13.773 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:33:13.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:33:13.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:33:13.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:33:13.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:33:13.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:33:13.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:33:13.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:33:13.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:33:13.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:33:13.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:33:13.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:33:13.774 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:33:13.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:33:13.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:33:13.775 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:33:13.775 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:33:13.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:33:13.775 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:33:13.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:33:13.775 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:33:13.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:33:13.775 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:33:13.775 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:33:13.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:33:13.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:33:13.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:33:13.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:33:13.776 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:33:13.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:33:13.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:33:13.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:33:13.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:33:13.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:33:13.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:33:13.776 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:33:13.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:33:13.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:33:13.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:33:13.777 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:33:13.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:33:13.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:33:13.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:33:13.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:33:13.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:33:13.778 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:33:13.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:33:13.778 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:33:13.779 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:33:13.779 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:33:13.779 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:33:13.779 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:33:13.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:33:13.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:33:13.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:33:13.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:33:13.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:33:13.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:33:13.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:33:13.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:33:13.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:33:13.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:33:13.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:33:13.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:33:13.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:33:13.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:33:13.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:33:13.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:33:13.781 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:33:13.781 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:33:13.781 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:33:13.781 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:33:13.781 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:33:13.781 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:33:13.781 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:33:13.781 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:33:13.781 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:33:13.781 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:33:13.781 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:33:13.781 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:33:13.782 INFO:tasks.workunit.client.0.smithi133.stderr: 7f52c17fa640 / http_manager 2024-09-12T00:33:13.782 INFO:tasks.workunit.client.0.smithi133.stderr: 7f52c37fe640 / http_manager 2024-09-12T00:33:13.782 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5348fe1640 / rgw_dt_lg_renew 2024-09-12T00:33:13.782 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5363fff640 / ms_dispatch 2024-09-12T00:33:13.782 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5375ffb640 / io_context_pool 2024-09-12T00:33:13.782 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5377fff640 / ms_dispatch 2024-09-12T00:33:13.782 INFO:tasks.workunit.client.0.smithi133.stderr: 7f537ee05640 / ms_dispatch 2024-09-12T00:33:13.783 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5380608640 / io_context_pool 2024-09-12T00:33:13.783 INFO:tasks.workunit.client.0.smithi133.stderr: 7f548bfff640 / msgr-worker-2 2024-09-12T00:33:13.783 INFO:tasks.workunit.client.0.smithi133.stderr: 7f54921ff640 / msgr-worker-1 2024-09-12T00:33:13.783 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5492a00640 / msgr-worker-0 2024-09-12T00:33:13.783 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5493201640 / io_context_pool 2024-09-12T00:33:13.784 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5494715800 / radosgw-admin 2024-09-12T00:33:13.784 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:33:13.784 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:33:13.784 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:33:13.616896Z_43d0e1aa-d7b7-4eb2-9493-0e6242465aab/log 2024-09-12T00:33:13.784 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:33:13.784 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:33:13.786 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:13.786 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:13.786 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.691+0000 7fa64ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.786 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.693+0000 7fa64ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.693+0000 7fa64ed25800 20 realm 2024-09-12T00:33:13.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.693+0000 7fa64ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.693+0000 7fa64ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.693+0000 7fa64ed25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:13.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.693+0000 7fa64ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.694+0000 7fa64ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.694+0000 7fa64ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.694+0000 7fa64ed25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:13.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.694+0000 7fa64ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.695+0000 7fa64ed25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:13.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.695+0000 7fa64ed25800 20 searching for the correct realm 2024-09-12T00:33:13.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.697+0000 7fa642132640 0 -- 172.21.15.133:0/3275649940 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fa63402f400 msgr2=0x7fa63402f880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:13.788 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.701+0000 7fa642132640 0 -- 172.21.15.133:0/3275649940 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fa63c06d3c0 msgr2=0x7fa63c0861a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:13.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.908+0000 7fa64ed25800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.908+0000 7fa64ed25800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.908+0000 7fa64ed25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.908+0000 7fa64ed25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.908+0000 7fa64ed25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.908+0000 7fa64ed25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.908+0000 7fa64ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.908+0000 7fa64ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.908+0000 7fa64ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.908+0000 7fa64ed25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.908+0000 7fa64ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.909+0000 7fa64ed25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.909+0000 7fa64ed25800 20 zone default found 2024-09-12T00:33:13.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.909+0000 7fa64ed25800 4 Realm: () 2024-09-12T00:33:13.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.909+0000 7fa64ed25800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:13.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.909+0000 7fa64ed25800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:13.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.909+0000 7fa64ed25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:13.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.909+0000 7fa64ed25800 20 zonegroup default 2024-09-12T00:33:13.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.909+0000 7fa64ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.909+0000 7fa64ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.909+0000 7fa64ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.909+0000 7fa64ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.909+0000 7fa64ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.910+0000 7fa64ed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.910+0000 7fa64ed25800 20 started sync module instance, tier type = 2024-09-12T00:33:13.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.910+0000 7fa64ed25800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:13.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.921+0000 7fa64ed25800 20 add_watcher() i=0 2024-09-12T00:33:13.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.921+0000 7fa64ed25800 20 add_watcher() i=1 2024-09-12T00:33:13.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.921+0000 7fa64ed25800 20 add_watcher() i=2 2024-09-12T00:33:13.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.921+0000 7fa64ed25800 20 add_watcher() i=3 2024-09-12T00:33:13.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.921+0000 7fa64ed25800 20 add_watcher() i=4 2024-09-12T00:33:13.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.921+0000 7fa64ed25800 20 add_watcher() i=5 2024-09-12T00:33:13.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.921+0000 7fa64ed25800 20 add_watcher() i=6 2024-09-12T00:33:13.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.922+0000 7fa64ed25800 20 add_watcher() i=7 2024-09-12T00:33:13.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.922+0000 7fa64ed25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:13.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.924+0000 7fa5017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:13.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.924+0000 7fa64ed25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:13.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.924+0000 7fa64ed25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:13.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.924+0000 7fa64ed25800 5 note: GC not initialized 2024-09-12T00:33:13.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.924+0000 7fa47bfff640 20 reqs_thread_entry: start 2024-09-12T00:33:13.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.924+0000 7fa64ed25800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:13.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.924+0000 7fa64ed25800 20 Filter name: none 2024-09-12T00:33:13.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.924+0000 7fa479ffb640 20 reqs_thread_entry: start 2024-09-12T00:33:13.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.925+0000 7fa64ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.925+0000 7fa64ed25800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:13.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.925+0000 7fa64ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.925+0000 7fa64ed25800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:33:13.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.925+0000 7fa64ed25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:13.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.925+0000 7fa64ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.926+0000 7fa64ed25800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:13.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.926+0000 7fa64ed25800 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.926+0000 7fa64ed25800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:33:13.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.926+0000 7fa64ed25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:13.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.927+0000 7fa5017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:13.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.929+0000 7fa64ed25800 20 remove_watcher() i=0 2024-09-12T00:33:13.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.929+0000 7fa64ed25800 2 removed watcher, disabling cache 2024-09-12T00:33:13.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.931+0000 7fa64ed25800 20 remove_watcher() i=1 2024-09-12T00:33:13.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.932+0000 7fa64ed25800 20 remove_watcher() i=2 2024-09-12T00:33:13.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.933+0000 7fa64ed25800 20 remove_watcher() i=3 2024-09-12T00:33:13.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.935+0000 7fa64ed25800 20 remove_watcher() i=4 2024-09-12T00:33:13.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.935+0000 7fa64ed25800 20 remove_watcher() i=5 2024-09-12T00:33:13.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.937+0000 7fa64ed25800 20 remove_watcher() i=6 2024-09-12T00:33:13.936 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:13.938+0000 7fa64ed25800 20 remove_watcher() i=7 2024-09-12T00:33:13.947 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:13.947 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:33:13.947 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-trim-reshard-log-entries id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:33:13.947 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:14.038 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:33:14.070 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:14.070 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:14.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.109+0000 7f073ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.110+0000 7f073ca11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:14.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.110+0000 7f073ca11800 20 realm 2024-09-12T00:33:14.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.110+0000 7f073ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.111+0000 7f073ca11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:14.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.111+0000 7f073ca11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:14.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.111+0000 7f073ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.111+0000 7f073ca11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:14.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.111+0000 7f073ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.111+0000 7f073ca11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:14.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.111+0000 7f073ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.112+0000 7f073ca11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:14.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.112+0000 7f073ca11800 20 searching for the correct realm 2024-09-12T00:33:14.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.114+0000 7f072ffff640 0 -- 172.21.15.133:0/360436881 >> [v2:172.21.15.133:6824/186004193,v1:172.21.15.133:6825/186004193] conn(0x557aa48046f0 msgr2=0x557aa4806ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:14.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.117+0000 7f0738192640 0 -- 172.21.15.133:0/360436881 >> [v2:172.21.15.160:6818/507321805,v1:172.21.15.160:6819/507321805] conn(0x557aa48046f0 msgr2=0x7f0720091930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:14.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.324+0000 7f073ca11800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:14.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.324+0000 7f073ca11800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:14.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.324+0000 7f073ca11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:14.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.324+0000 7f073ca11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:14.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.324+0000 7f073ca11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:14.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.324+0000 7f073ca11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:14.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.324+0000 7f073ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.325+0000 7f073ca11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:14.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.325+0000 7f073ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.325+0000 7f073ca11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:14.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.325+0000 7f073ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.325+0000 7f073ca11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:14.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.325+0000 7f073ca11800 20 zone default found 2024-09-12T00:33:14.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.325+0000 7f073ca11800 4 Realm: () 2024-09-12T00:33:14.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.325+0000 7f073ca11800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:14.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.325+0000 7f073ca11800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:14.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.325+0000 7f073ca11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:14.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.325+0000 7f073ca11800 20 zonegroup default 2024-09-12T00:33:14.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.325+0000 7f073ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.326+0000 7f073ca11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:14.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.326+0000 7f073ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.326+0000 7f073ca11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:14.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.326+0000 7f073ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.326+0000 7f073ca11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:14.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.326+0000 7f073ca11800 20 started sync module instance, tier type = 2024-09-12T00:33:14.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.326+0000 7f073ca11800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:14.333 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.335+0000 7f073ca11800 20 add_watcher() i=0 2024-09-12T00:33:14.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.335+0000 7f073ca11800 20 add_watcher() i=1 2024-09-12T00:33:14.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.335+0000 7f073ca11800 20 add_watcher() i=2 2024-09-12T00:33:14.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.335+0000 7f073ca11800 20 add_watcher() i=3 2024-09-12T00:33:14.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.335+0000 7f073ca11800 20 add_watcher() i=4 2024-09-12T00:33:14.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.335+0000 7f073ca11800 20 add_watcher() i=5 2024-09-12T00:33:14.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.335+0000 7f073ca11800 20 add_watcher() i=6 2024-09-12T00:33:14.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.336+0000 7f073ca11800 20 add_watcher() i=7 2024-09-12T00:33:14.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.336+0000 7f073ca11800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:14.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.337+0000 7f05eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:14.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.338+0000 7f073ca11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:14.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.338+0000 7f073ca11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:14.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.338+0000 7f073ca11800 5 note: GC not initialized 2024-09-12T00:33:14.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.338+0000 7f05edfdb640 20 reqs_thread_entry: start 2024-09-12T00:33:14.339 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.338+0000 7f073ca11800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:14.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.338+0000 7f073ca11800 20 Filter name: none 2024-09-12T00:33:14.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.338+0000 7f055f7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:14.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.338+0000 7f073ca11800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:33:14.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.338+0000 7f073ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.340 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.339+0000 7f073ca11800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:14.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.339+0000 7f073ca11800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:33:14.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.339+0000 7f073ca11800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:33:14.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.339+0000 7f073ca11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 : miss 2024-09-12T00:33:14.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.339+0000 7f073ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.339+0000 7f073ca11800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:33:14.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.339+0000 7f073ca11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:14.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.339+0000 7f073ca11800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:14.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.339+0000 7f073ca11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:14.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.339+0000 7f073ca11800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:14.342 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.339+0000 7f073ca11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 2024-09-12T00:33:14.343 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.340+0000 7f073ca11800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to be held by another RGW process; skipping for now 2024-09-12T00:33:14.343 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.341+0000 7f05eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:14.343 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.343+0000 7f073ca11800 20 remove_watcher() i=0 2024-09-12T00:33:14.344 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.343+0000 7f073ca11800 2 removed watcher, disabling cache 2024-09-12T00:33:14.344 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.344+0000 7f073ca11800 20 remove_watcher() i=1 2024-09-12T00:33:14.344 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.345+0000 7f073ca11800 20 remove_watcher() i=2 2024-09-12T00:33:14.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.346+0000 7f073ca11800 20 remove_watcher() i=3 2024-09-12T00:33:14.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.347+0000 7f073ca11800 20 remove_watcher() i=4 2024-09-12T00:33:14.346 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.348+0000 7f073ca11800 20 remove_watcher() i=5 2024-09-12T00:33:14.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.349+0000 7f073ca11800 20 remove_watcher() i=6 2024-09-12T00:33:14.348 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:14.349+0000 7f073ca11800 20 remove_watcher() i=7 2024-09-12T00:33:14.358 INFO:tasks.workunit.client.0.smithi133.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:33:44.392 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:33:44.429 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:44.429 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:44.472 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.473+0000 7ff3c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.475+0000 7ff3c260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.475+0000 7ff3c260e800 20 realm 2024-09-12T00:33:44.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.475+0000 7ff3c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.475+0000 7ff3c260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.475+0000 7ff3c260e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:44.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.475+0000 7ff3c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.475+0000 7ff3c260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.475+0000 7ff3c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.476+0000 7ff3c260e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:44.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.476+0000 7ff3c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.476 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.477+0000 7ff3c260e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:44.476 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.477+0000 7ff3c260e800 20 searching for the correct realm 2024-09-12T00:33:44.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.479+0000 7ff3bd579640 0 -- 172.21.15.133:0/1511375813 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff3b4053000 msgr2=0x7ff3b40189a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:44.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.483+0000 7ff3bd579640 0 -- 172.21.15.133:0/1511375813 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff3b001e400 msgr2=0x7ff3b001e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:44.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.690+0000 7ff3c260e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:44.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.690+0000 7ff3c260e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:44.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.690+0000 7ff3c260e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:44.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.690+0000 7ff3c260e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:44.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.690+0000 7ff3c260e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:44.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.690+0000 7ff3c260e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:44.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.690+0000 7ff3c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.690+0000 7ff3c260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.690+0000 7ff3c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.691+0000 7ff3c260e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:44.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.691+0000 7ff3c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.691+0000 7ff3c260e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:44.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.691+0000 7ff3c260e800 20 zone default found 2024-09-12T00:33:44.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.691+0000 7ff3c260e800 4 Realm: () 2024-09-12T00:33:44.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.691+0000 7ff3c260e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:44.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.691+0000 7ff3c260e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:44.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.691+0000 7ff3c260e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:44.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.691+0000 7ff3c260e800 20 zonegroup default 2024-09-12T00:33:44.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.691+0000 7ff3c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.691+0000 7ff3c260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.691+0000 7ff3c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.692+0000 7ff3c260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.692+0000 7ff3c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.692+0000 7ff3c260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.692+0000 7ff3c260e800 20 started sync module instance, tier type = 2024-09-12T00:33:44.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.692+0000 7ff3c260e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:44.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.703+0000 7ff3c260e800 20 add_watcher() i=0 2024-09-12T00:33:44.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.703+0000 7ff3c260e800 20 add_watcher() i=1 2024-09-12T00:33:44.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.703+0000 7ff3c260e800 20 add_watcher() i=2 2024-09-12T00:33:44.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.703+0000 7ff3c260e800 20 add_watcher() i=3 2024-09-12T00:33:44.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.703+0000 7ff3c260e800 20 add_watcher() i=4 2024-09-12T00:33:44.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.703+0000 7ff3c260e800 20 add_watcher() i=5 2024-09-12T00:33:44.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.703+0000 7ff3c260e800 20 add_watcher() i=6 2024-09-12T00:33:44.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.704+0000 7ff3c260e800 20 add_watcher() i=7 2024-09-12T00:33:44.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.704+0000 7ff3c260e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:44.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.706+0000 7ff26f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:44.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.706+0000 7ff3c260e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:44.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.706+0000 7ff3c260e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:44.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.706+0000 7ff3c260e800 5 note: GC not initialized 2024-09-12T00:33:44.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.706+0000 7ff26e7fc640 20 reqs_thread_entry: start 2024-09-12T00:33:44.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.706+0000 7ff3c260e800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:44.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.707+0000 7ff3c260e800 20 Filter name: none 2024-09-12T00:33:44.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.707+0000 7ff1dffff640 20 reqs_thread_entry: start 2024-09-12T00:33:44.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.707+0000 7ff3c260e800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:33:44.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.707+0000 7ff3c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.707+0000 7ff3c260e800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:44.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.707+0000 7ff3c260e800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:33:44.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.707+0000 7ff3c260e800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:33:44.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.707+0000 7ff3c260e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 : miss 2024-09-12T00:33:44.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.707+0000 7ff3c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.708+0000 7ff3c260e800 20 rados_obj.operate() r=0 bl.length=479 2024-09-12T00:33:44.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.708+0000 7ff3c260e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:44.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.708+0000 7ff3c260e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:44.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.708+0000 7ff3c260e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:44.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.708+0000 7ff3c260e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:44.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.708+0000 7ff3c260e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 2024-09-12T00:33:44.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.709+0000 7ff3c260e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:33:44.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.713+0000 7ff3c260e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:44.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.713+0000 7ff3c260e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:44.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.713+0000 7ff3c260e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:44.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.713+0000 7ff3c260e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28, ofs0, ns] 2024-09-12T00:33:44.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.713+0000 7ff2a17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 94811033966608 notifier 6647 bl.length()=1023 2024-09-12T00:33:44.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.713+0000 7ff2a17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:44.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.713+0000 7ff2a17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:44.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.713+0000 7ff2a17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:44.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.715+0000 7ff3c260e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): orig_sources= new_sources= 2024-09-12T00:33:44.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.715+0000 7ff3c260e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): potential sources added=[] removed=[] 2024-09-12T00:33:44.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.715+0000 7ff3c260e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): orig_dests= new_dests= 2024-09-12T00:33:44.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.715+0000 7ff3c260e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): potential dests added=[] removed=[] 2024-09-12T00:33:44.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.718+0000 7ff3c260e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28.2.0 2024-09-12T00:33:44.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.718+0000 7ff3c260e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28.2.0 2024-09-12T00:33:44.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.718+0000 7ff3c260e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28.2.1 2024-09-12T00:33:44.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.718+0000 7ff3c260e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28.2.1 2024-09-12T00:33:44.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.718+0000 7ff3c260e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28.0 2024-09-12T00:33:44.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.721+0000 7ff3c260e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:44.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.721+0000 7ff3c260e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 2024-09-12T00:33:44.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.722+0000 7ff3c260e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:44.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.722+0000 7ff3c260e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:44.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.722+0000 7ff3c260e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:44.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.722+0000 7ff3c260e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28, ofs0, ns] 2024-09-12T00:33:44.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.723+0000 7ff2a17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497045 cookie 94811033966608 notifier 6647 bl.length()=1023 2024-09-12T00:33:44.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.723+0000 7ff2a17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:44.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.723+0000 7ff2a17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:44.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.723+0000 7ff2a17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:44.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.724+0000 7ff3c260e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): orig_sources= new_sources= 2024-09-12T00:33:44.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.724+0000 7ff3c260e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): potential sources added=[] removed=[] 2024-09-12T00:33:44.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.724+0000 7ff3c260e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): orig_dests= new_dests= 2024-09-12T00:33:44.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.724+0000 7ff3c260e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): potential dests added=[] removed=[] 2024-09-12T00:33:44.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.725+0000 7ff3c260e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28.0 2024-09-12T00:33:44.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.726+0000 7ff3c260e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:44.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.726+0000 7ff3c260e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 2024-09-12T00:33:44.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.727+0000 7ff3c260e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:44.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.727+0000 7ff3c260e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:44.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.727+0000 7ff3c260e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:44.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.727+0000 7ff3c260e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28, ofs0, ns] 2024-09-12T00:33:44.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.728+0000 7ff2a0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497046 cookie 94811033966608 notifier 6647 bl.length()=991 2024-09-12T00:33:44.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.728+0000 7ff2a0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 info.flags=0x17 2024-09-12T00:33:44.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.728+0000 7ff2a0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 to cache LRU end 2024-09-12T00:33:44.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.728+0000 7ff2a0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:44.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.729+0000 7ff3c260e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): orig_sources= new_sources= 2024-09-12T00:33:44.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.729+0000 7ff3c260e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): potential sources added=[] removed=[] 2024-09-12T00:33:44.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.729+0000 7ff3c260e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): orig_dests= new_dests= 2024-09-12T00:33:44.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.729+0000 7ff3c260e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28]): potential dests added=[] removed=[] 2024-09-12T00:33:44.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.730+0000 7ff3c260e800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:33:44.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.732+0000 7ff26f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:44.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.735+0000 7ff3c260e800 20 remove_watcher() i=0 2024-09-12T00:33:44.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.735+0000 7ff3c260e800 2 removed watcher, disabling cache 2024-09-12T00:33:44.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.736+0000 7ff3c260e800 20 remove_watcher() i=1 2024-09-12T00:33:44.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.737+0000 7ff3c260e800 20 remove_watcher() i=2 2024-09-12T00:33:44.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.738+0000 7ff3c260e800 20 remove_watcher() i=3 2024-09-12T00:33:44.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.739+0000 7ff3c260e800 20 remove_watcher() i=4 2024-09-12T00:33:44.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.740+0000 7ff3c260e800 20 remove_watcher() i=5 2024-09-12T00:33:44.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.741+0000 7ff3c260e800 20 remove_watcher() i=6 2024-09-12T00:33:44.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.743+0000 7ff3c260e800 20 remove_watcher() i=7 2024-09-12T00:33:44.754 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:33:44.784 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:44.784 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:44.821 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.822+0000 7f4089887800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.824+0000 7f4089887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.824+0000 7f4089887800 20 realm 2024-09-12T00:33:44.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.824+0000 7f4089887800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.824+0000 7f4089887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.824+0000 7f4089887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:44.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.824+0000 7f4089887800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.824+0000 7f4089887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.824+0000 7f4089887800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.825+0000 7f4089887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:44.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.825+0000 7f4089887800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.826+0000 7f4089887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:44.825 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.826+0000 7f4089887800 20 searching for the correct realm 2024-09-12T00:33:44.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:44.828+0000 7f4086b70640 0 -- 172.21.15.133:0/435785853 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f407001a040 msgr2=0x7f40700363f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:45.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.031+0000 7f4087371640 0 -- 172.21.15.133:0/435785853 >> [v2:172.21.15.160:6818/507321805,v1:172.21.15.160:6819/507321805] conn(0x7f4070052450 msgr2=0x7f40700528d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:45.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:45.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:45.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:45.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:45.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:45.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:45.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.037 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:45.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:45.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 20 zone default found 2024-09-12T00:33:45.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 4 Realm: () 2024-09-12T00:33:45.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:45.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:45.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:45.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 20 zonegroup default 2024-09-12T00:33:45.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.038+0000 7f4089887800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.039+0000 7f4089887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.039+0000 7f4089887800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.039+0000 7f4089887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.039+0000 7f4089887800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.039+0000 7f4089887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.039+0000 7f4089887800 20 started sync module instance, tier type = 2024-09-12T00:33:45.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.039+0000 7f4089887800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:45.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.048+0000 7f4089887800 20 add_watcher() i=0 2024-09-12T00:33:45.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.048+0000 7f4089887800 20 add_watcher() i=1 2024-09-12T00:33:45.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.048+0000 7f4089887800 20 add_watcher() i=2 2024-09-12T00:33:45.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.048+0000 7f4089887800 20 add_watcher() i=3 2024-09-12T00:33:45.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.048+0000 7f4089887800 20 add_watcher() i=4 2024-09-12T00:33:45.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.048+0000 7f4089887800 20 add_watcher() i=5 2024-09-12T00:33:45.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.048+0000 7f4089887800 20 add_watcher() i=6 2024-09-12T00:33:45.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.049+0000 7f4089887800 20 add_watcher() i=7 2024-09-12T00:33:45.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.049+0000 7f4089887800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:45.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.051+0000 7f3f3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:45.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.052+0000 7f4089887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:45.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.052+0000 7f4089887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:45.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.052+0000 7f4089887800 5 note: GC not initialized 2024-09-12T00:33:45.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.052+0000 7f3f3cfe1640 20 reqs_thread_entry: start 2024-09-12T00:33:45.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.052+0000 7f4089887800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:45.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.052+0000 7f4089887800 20 Filter name: none 2024-09-12T00:33:45.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.052+0000 7f3eb67fc640 20 reqs_thread_entry: start 2024-09-12T00:33:45.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.052+0000 7f4089887800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.053+0000 7f4089887800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:45.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.053+0000 7f4089887800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.053+0000 7f4089887800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:45.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.053+0000 7f4089887800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:45.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.053+0000 7f4089887800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.054+0000 7f4089887800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:33:45.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.054+0000 7f4089887800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.054+0000 7f4089887800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:45.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.054+0000 7f4089887800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:45.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.055+0000 7f3f3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:45.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.057+0000 7f4089887800 20 remove_watcher() i=0 2024-09-12T00:33:45.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.057+0000 7f4089887800 2 removed watcher, disabling cache 2024-09-12T00:33:45.057 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.058+0000 7f4089887800 20 remove_watcher() i=1 2024-09-12T00:33:45.058 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.059+0000 7f4089887800 20 remove_watcher() i=2 2024-09-12T00:33:45.059 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.060+0000 7f4089887800 20 remove_watcher() i=3 2024-09-12T00:33:45.060 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.061+0000 7f4089887800 20 remove_watcher() i=4 2024-09-12T00:33:45.061 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.062+0000 7f4089887800 20 remove_watcher() i=5 2024-09-12T00:33:45.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.063+0000 7f4089887800 20 remove_watcher() i=6 2024-09-12T00:33:45.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:45.064+0000 7f4089887800 20 remove_watcher() i=7 2024-09-12T00:33:45.074 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:45.074 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:33:45.074 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-trim-reshard-log-entries id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:33:45.074 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:45.361 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T00:33:45.362 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:46.180 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:33:46.209 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:46.209 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:46.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.247+0000 7f7fbf20e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.249+0000 7f7fbf20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:46.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.249+0000 7f7fbf20e800 20 realm 2024-09-12T00:33:46.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.249+0000 7f7fbf20e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.250+0000 7f7fbf20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:46.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.250+0000 7f7fbf20e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:46.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.250+0000 7f7fbf20e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.250+0000 7f7fbf20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:46.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.250+0000 7f7fbf20e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.250 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.251+0000 7f7fbf20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:46.250 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.251+0000 7f7fbf20e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.250 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.252+0000 7f7fbf20e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:46.250 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.252+0000 7f7fbf20e800 20 searching for the correct realm 2024-09-12T00:33:46.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.253+0000 7f7fb3fff640 0 -- 172.21.15.133:0/1515989642 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f7fa405f900 msgr2=0x7f7fa4067590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:46.457 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.458+0000 7f7fb3fff640 0 -- 172.21.15.133:0/1515989642 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f7fac0ac550 msgr2=0x7f7fac0aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:46.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.665+0000 7f7fbf20e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:46.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.665+0000 7f7fbf20e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:46.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.665+0000 7f7fbf20e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:46.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.665+0000 7f7fbf20e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:46.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.665+0000 7f7fbf20e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:46.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.665+0000 7f7fbf20e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:46.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.665+0000 7f7fbf20e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.665+0000 7f7fbf20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:46.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.665+0000 7f7fbf20e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.665+0000 7f7fbf20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:46.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.665+0000 7f7fbf20e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.666+0000 7f7fbf20e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:46.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.666+0000 7f7fbf20e800 20 zone default found 2024-09-12T00:33:46.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.666+0000 7f7fbf20e800 4 Realm: () 2024-09-12T00:33:46.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.666+0000 7f7fbf20e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:46.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.666+0000 7f7fbf20e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:46.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.666+0000 7f7fbf20e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:46.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.666+0000 7f7fbf20e800 20 zonegroup default 2024-09-12T00:33:46.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.666+0000 7f7fbf20e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.666+0000 7f7fbf20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:46.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.666+0000 7f7fbf20e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.666+0000 7f7fbf20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:46.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.666+0000 7f7fbf20e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.667+0000 7f7fbf20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:46.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.667+0000 7f7fbf20e800 20 started sync module instance, tier type = 2024-09-12T00:33:46.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.667+0000 7f7fbf20e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:46.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.676+0000 7f7fbf20e800 20 add_watcher() i=0 2024-09-12T00:33:46.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.676+0000 7f7fbf20e800 20 add_watcher() i=1 2024-09-12T00:33:46.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.676+0000 7f7fbf20e800 20 add_watcher() i=2 2024-09-12T00:33:46.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.676+0000 7f7fbf20e800 20 add_watcher() i=3 2024-09-12T00:33:46.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.676+0000 7f7fbf20e800 20 add_watcher() i=4 2024-09-12T00:33:46.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.676+0000 7f7fbf20e800 20 add_watcher() i=5 2024-09-12T00:33:46.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.676+0000 7f7fbf20e800 20 add_watcher() i=6 2024-09-12T00:33:46.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.678+0000 7f7fbf20e800 20 add_watcher() i=7 2024-09-12T00:33:46.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.678+0000 7f7fbf20e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:46.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.680+0000 7f7e717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:46.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.680+0000 7f7fbf20e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:46.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.680+0000 7f7fbf20e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:46.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.680+0000 7f7fbf20e800 5 note: GC not initialized 2024-09-12T00:33:46.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.680+0000 7f7debfff640 20 reqs_thread_entry: start 2024-09-12T00:33:46.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.680+0000 7f7fbf20e800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:46.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.680+0000 7f7fbf20e800 20 Filter name: none 2024-09-12T00:33:46.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.680+0000 7f7de9ffb640 20 reqs_thread_entry: start 2024-09-12T00:33:46.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.680+0000 7f7fbf20e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.681+0000 7f7fbf20e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:46.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.681+0000 7f7fbf20e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.681+0000 7f7fbf20e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:33:46.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.681+0000 7f7fbf20e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:46.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.681+0000 7f7fbf20e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.682+0000 7f7fbf20e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:46.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.682+0000 7f7fbf20e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.682+0000 7f7fbf20e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:33:46.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.682+0000 7f7fbf20e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:46.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.683+0000 7f7e717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:46.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.686+0000 7f7fbf20e800 20 remove_watcher() i=0 2024-09-12T00:33:46.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.686+0000 7f7fbf20e800 2 removed watcher, disabling cache 2024-09-12T00:33:46.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.687+0000 7f7fbf20e800 20 remove_watcher() i=1 2024-09-12T00:33:46.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.688+0000 7f7fbf20e800 20 remove_watcher() i=2 2024-09-12T00:33:46.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.689+0000 7f7fbf20e800 20 remove_watcher() i=3 2024-09-12T00:33:46.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.690+0000 7f7fbf20e800 20 remove_watcher() i=4 2024-09-12T00:33:46.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.691+0000 7f7fbf20e800 20 remove_watcher() i=5 2024-09-12T00:33:46.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.692+0000 7f7fbf20e800 20 remove_watcher() i=6 2024-09-12T00:33:46.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.694+0000 7f7fbf20e800 20 remove_watcher() i=7 2024-09-12T00:33:46.704 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:46.704 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:33:46.704 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-block-writes id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:33:46.704 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:46.705 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T00:33:46.741 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:46.741 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:46.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.780+0000 7fe3e1736800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.782+0000 7fe3e1736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:46.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.782+0000 7fe3e1736800 20 realm 2024-09-12T00:33:46.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.782+0000 7fe3e1736800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.782+0000 7fe3e1736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:46.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.782+0000 7fe3e1736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:46.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.782+0000 7fe3e1736800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.782+0000 7fe3e1736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:46.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.782+0000 7fe3e1736800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.783+0000 7fe3e1736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:46.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.783+0000 7fe3e1736800 20 rados->read ofs=0 len=0 2024-09-12T00:33:46.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.784+0000 7fe3e1736800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:46.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.784+0000 7fe3e1736800 20 searching for the correct realm 2024-09-12T00:33:46.785 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.786+0000 7fe3d7fff640 0 -- 172.21.15.133:0/3081104933 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fe3c808dbe0 msgr2=0x7fe3c8061910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:46.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:46.992+0000 7fe3d7fff640 0 -- 172.21.15.133:0/3081104933 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fe3d0042060 msgr2=0x7fe3d006fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:47.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.198+0000 7fe3e1736800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:47.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.198+0000 7fe3e1736800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:47.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.198+0000 7fe3e1736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:47.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.198+0000 7fe3e1736800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:47.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.198+0000 7fe3e1736800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:47.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.198+0000 7fe3e1736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:47.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.198+0000 7fe3e1736800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.198+0000 7fe3e1736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:47.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.198+0000 7fe3e1736800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.199+0000 7fe3e1736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:47.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.199+0000 7fe3e1736800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.199+0000 7fe3e1736800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:47.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.199+0000 7fe3e1736800 20 zone default found 2024-09-12T00:33:47.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.199+0000 7fe3e1736800 4 Realm: () 2024-09-12T00:33:47.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.199+0000 7fe3e1736800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:47.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.199+0000 7fe3e1736800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:47.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.199+0000 7fe3e1736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:47.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.199+0000 7fe3e1736800 20 zonegroup default 2024-09-12T00:33:47.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.199+0000 7fe3e1736800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.199+0000 7fe3e1736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:47.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.199+0000 7fe3e1736800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.200+0000 7fe3e1736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:47.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.200+0000 7fe3e1736800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.200+0000 7fe3e1736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:47.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.200+0000 7fe3e1736800 20 started sync module instance, tier type = 2024-09-12T00:33:47.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.200+0000 7fe3e1736800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:47.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.210+0000 7fe3e1736800 20 add_watcher() i=0 2024-09-12T00:33:47.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.210+0000 7fe3e1736800 20 add_watcher() i=1 2024-09-12T00:33:47.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.210+0000 7fe3e1736800 20 add_watcher() i=2 2024-09-12T00:33:47.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.210+0000 7fe3e1736800 20 add_watcher() i=3 2024-09-12T00:33:47.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.210+0000 7fe3e1736800 20 add_watcher() i=4 2024-09-12T00:33:47.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.210+0000 7fe3e1736800 20 add_watcher() i=5 2024-09-12T00:33:47.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.210+0000 7fe3e1736800 20 add_watcher() i=6 2024-09-12T00:33:47.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.211+0000 7fe3e1736800 20 add_watcher() i=7 2024-09-12T00:33:47.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.211+0000 7fe3e1736800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:47.211 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.213+0000 7fe2937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:47.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.213+0000 7fe3e1736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:47.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.213+0000 7fe3e1736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:47.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.213+0000 7fe3e1736800 5 note: GC not initialized 2024-09-12T00:33:47.213 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.213+0000 7fe2927e4640 20 reqs_thread_entry: start 2024-09-12T00:33:47.213 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.213+0000 7fe3e1736800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:47.213 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.214+0000 7fe3e1736800 20 Filter name: none 2024-09-12T00:33:47.213 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.214+0000 7fe203fff640 20 reqs_thread_entry: start 2024-09-12T00:33:47.213 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.214+0000 7fe3e1736800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:33:47.213 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.214+0000 7fe3e1736800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.214+0000 7fe3e1736800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:47.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.214+0000 7fe3e1736800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:33:47.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.214+0000 7fe3e1736800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:33:47.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.214+0000 7fe3e1736800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 : miss 2024-09-12T00:33:47.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.214+0000 7fe3e1736800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.214+0000 7fe3e1736800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:33:47.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.214+0000 7fe3e1736800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 info.flags=0x17 2024-09-12T00:33:47.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.214+0000 7fe3e1736800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 to cache LRU end 2024-09-12T00:33:47.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.214+0000 7fe3e1736800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:47.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.214+0000 7fe3e1736800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:47.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.214+0000 7fe3e1736800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 2024-09-12T00:33:47.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.218+0000 7fe3e1736800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 info.flags=0x17 2024-09-12T00:33:47.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.218+0000 7fe3e1736800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 to cache LRU end 2024-09-12T00:33:47.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.218+0000 7fe3e1736800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:47.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.218+0000 7fe3e1736800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29, ofs0, ns] 2024-09-12T00:33:47.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.219+0000 7fe2c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 94561363125280 notifier 6701 bl.length()=999 2024-09-12T00:33:47.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.219+0000 7fe2c0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 info.flags=0x17 2024-09-12T00:33:47.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.219+0000 7fe2c0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 to cache LRU end 2024-09-12T00:33:47.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.219+0000 7fe2c0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:47.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.221+0000 7fe3e1736800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): orig_sources= new_sources= 2024-09-12T00:33:47.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.221+0000 7fe3e1736800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): potential sources added=[] removed=[] 2024-09-12T00:33:47.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.221+0000 7fe3e1736800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): orig_dests= new_dests= 2024-09-12T00:33:47.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.221+0000 7fe3e1736800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): potential dests added=[] removed=[] 2024-09-12T00:33:47.222 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.223+0000 7fe3e1736800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29.1.0 2024-09-12T00:33:47.222 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.223+0000 7fe3e1736800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29.1.0 2024-09-12T00:33:47.222 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.223+0000 7fe3e1736800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29.1.1 2024-09-12T00:33:47.222 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.223+0000 7fe3e1736800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29.1.1 2024-09-12T00:33:47.222 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.223+0000 7fe3e1736800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29.0 2024-09-12T00:33:47.224 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.225+0000 7fe3e1736800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:47.224 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.225+0000 7fe3e1736800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 2024-09-12T00:33:47.231 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.233+0000 7fe3e1736800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 info.flags=0x17 2024-09-12T00:33:47.232 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.233+0000 7fe3e1736800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 to cache LRU end 2024-09-12T00:33:47.232 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.233+0000 7fe3e1736800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:47.232 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.233+0000 7fe3e1736800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29, ofs0, ns] 2024-09-12T00:33:47.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.234+0000 7fe2affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 94561363125280 notifier 6701 bl.length()=999 2024-09-12T00:33:47.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.234+0000 7fe2affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 info.flags=0x17 2024-09-12T00:33:47.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.234+0000 7fe2affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 to cache LRU end 2024-09-12T00:33:47.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.234+0000 7fe2affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:47.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.236+0000 7fe3e1736800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): orig_sources= new_sources= 2024-09-12T00:33:47.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.236+0000 7fe3e1736800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): potential sources added=[] removed=[] 2024-09-12T00:33:47.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.236+0000 7fe3e1736800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): orig_dests= new_dests= 2024-09-12T00:33:47.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.236+0000 7fe3e1736800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): potential dests added=[] removed=[] 2024-09-12T00:33:47.235 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.236+0000 7fe3e1736800 -1 Injecting error=-5 at location=block_writes 2024-09-12T00:33:47.235 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.236+0000 7fe3e1736800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:33:47.237 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.238+0000 7fe3e1736800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:47.237 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.238+0000 7fe3e1736800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 2024-09-12T00:33:47.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.239+0000 7fe3e1736800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 info.flags=0x17 2024-09-12T00:33:47.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.239+0000 7fe3e1736800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 to cache LRU end 2024-09-12T00:33:47.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.239+0000 7fe3e1736800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:47.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.239+0000 7fe3e1736800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29, ofs0, ns] 2024-09-12T00:33:47.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.240+0000 7fe2c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497005 cookie 94561363125280 notifier 6701 bl.length()=967 2024-09-12T00:33:47.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.240+0000 7fe2c0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 info.flags=0x17 2024-09-12T00:33:47.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.240+0000 7fe2c0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 to cache LRU end 2024-09-12T00:33:47.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.240+0000 7fe2c0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:47.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.241+0000 7fe3e1736800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): orig_sources= new_sources= 2024-09-12T00:33:47.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.242+0000 7fe3e1736800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): potential sources added=[] removed=[] 2024-09-12T00:33:47.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.242+0000 7fe3e1736800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): orig_dests= new_dests= 2024-09-12T00:33:47.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.242+0000 7fe3e1736800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): potential dests added=[] removed=[] 2024-09-12T00:33:47.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.243+0000 7fe3e1736800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T00:33:47.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.245+0000 7fe2937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:47.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.247+0000 7fe3e1736800 20 remove_watcher() i=0 2024-09-12T00:33:47.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.247+0000 7fe3e1736800 2 removed watcher, disabling cache 2024-09-12T00:33:47.247 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.248+0000 7fe3e1736800 20 remove_watcher() i=1 2024-09-12T00:33:47.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.249+0000 7fe3e1736800 20 remove_watcher() i=2 2024-09-12T00:33:47.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.251+0000 7fe3e1736800 20 remove_watcher() i=3 2024-09-12T00:33:47.251 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.252+0000 7fe3e1736800 20 remove_watcher() i=4 2024-09-12T00:33:47.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.253+0000 7fe3e1736800 20 remove_watcher() i=5 2024-09-12T00:33:47.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.254+0000 7fe3e1736800 20 remove_watcher() i=6 2024-09-12T00:33:47.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.255+0000 7fe3e1736800 20 remove_watcher() i=7 2024-09-12T00:33:47.266 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:33:47.295 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:47.295 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:47.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.333+0000 7fe548414800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.335+0000 7fe548414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:47.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.335+0000 7fe548414800 20 realm 2024-09-12T00:33:47.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.335+0000 7fe548414800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.335+0000 7fe548414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:47.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.335+0000 7fe548414800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:47.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.335+0000 7fe548414800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.335+0000 7fe548414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:47.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.335+0000 7fe548414800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.336+0000 7fe548414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:47.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.336+0000 7fe548414800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.336 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.337+0000 7fe548414800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:47.336 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.337+0000 7fe548414800 20 searching for the correct realm 2024-09-12T00:33:47.338 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.339+0000 7fe53bfff640 0 -- 172.21.15.133:0/1843259867 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fe52c072040 msgr2=0x7fe52c067790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:47.543 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.544+0000 7fe53bfff640 0 -- 172.21.15.133:0/1843259867 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fe534035410 msgr2=0x7fe534035890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:47.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.752+0000 7fe548414800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:47.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.752+0000 7fe548414800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:47.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.752+0000 7fe548414800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:47.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.752+0000 7fe548414800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:47.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.752+0000 7fe548414800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:47.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.752+0000 7fe548414800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:47.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.752+0000 7fe548414800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.752+0000 7fe548414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:47.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.752+0000 7fe548414800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.752+0000 7fe548414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:47.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.752+0000 7fe548414800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.753+0000 7fe548414800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:47.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.753+0000 7fe548414800 20 zone default found 2024-09-12T00:33:47.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.753+0000 7fe548414800 4 Realm: () 2024-09-12T00:33:47.754 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.753+0000 7fe548414800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:47.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.753+0000 7fe548414800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:47.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.753+0000 7fe548414800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:47.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.753+0000 7fe548414800 20 zonegroup default 2024-09-12T00:33:47.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.753+0000 7fe548414800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.753+0000 7fe548414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:47.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.753+0000 7fe548414800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.753+0000 7fe548414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:47.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.753+0000 7fe548414800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.754+0000 7fe548414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:47.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.754+0000 7fe548414800 20 started sync module instance, tier type = 2024-09-12T00:33:47.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.754+0000 7fe548414800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:47.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.764+0000 7fe548414800 20 add_watcher() i=0 2024-09-12T00:33:47.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.764+0000 7fe548414800 20 add_watcher() i=1 2024-09-12T00:33:47.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.764+0000 7fe548414800 20 add_watcher() i=2 2024-09-12T00:33:47.763 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.764+0000 7fe548414800 20 add_watcher() i=3 2024-09-12T00:33:47.763 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.764+0000 7fe548414800 20 add_watcher() i=4 2024-09-12T00:33:47.763 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.764+0000 7fe548414800 20 add_watcher() i=5 2024-09-12T00:33:47.763 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.764+0000 7fe548414800 20 add_watcher() i=6 2024-09-12T00:33:47.763 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.765+0000 7fe548414800 20 add_watcher() i=7 2024-09-12T00:33:47.763 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.765+0000 7fe548414800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:47.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.767+0000 7fe3f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:47.767 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.767+0000 7fe548414800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:47.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.767+0000 7fe548414800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:47.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.767+0000 7fe548414800 5 note: GC not initialized 2024-09-12T00:33:47.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.768+0000 7fe3f8fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:47.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.768+0000 7fe548414800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:47.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.768+0000 7fe548414800 20 Filter name: none 2024-09-12T00:33:47.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.768+0000 7fe3727fc640 20 reqs_thread_entry: start 2024-09-12T00:33:47.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.768+0000 7fe548414800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.768+0000 7fe548414800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:47.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.768+0000 7fe548414800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.769+0000 7fe548414800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:33:47.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.769+0000 7fe548414800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:47.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.769+0000 7fe548414800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.769+0000 7fe548414800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:47.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.769+0000 7fe548414800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.769+0000 7fe548414800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:33:47.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.769+0000 7fe548414800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:47.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.770+0000 7fe3f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:47.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.773+0000 7fe548414800 20 remove_watcher() i=0 2024-09-12T00:33:47.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.773+0000 7fe548414800 2 removed watcher, disabling cache 2024-09-12T00:33:47.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.774+0000 7fe548414800 20 remove_watcher() i=1 2024-09-12T00:33:47.774 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.775+0000 7fe548414800 20 remove_watcher() i=2 2024-09-12T00:33:47.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.777+0000 7fe548414800 20 remove_watcher() i=3 2024-09-12T00:33:47.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.778+0000 7fe548414800 20 remove_watcher() i=4 2024-09-12T00:33:47.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.779+0000 7fe548414800 20 remove_watcher() i=5 2024-09-12T00:33:47.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.780+0000 7fe548414800 20 remove_watcher() i=6 2024-09-12T00:33:47.780 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.781+0000 7fe548414800 20 remove_watcher() i=7 2024-09-12T00:33:47.790 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:47.790 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:33:47.790 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-block-writes id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:33:47.790 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:47.880 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:33:47.912 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:47.912 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:47.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.950+0000 7f3c34938800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.952+0000 7f3c34938800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:47.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.952+0000 7f3c34938800 20 realm 2024-09-12T00:33:47.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.952+0000 7f3c34938800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.952+0000 7f3c34938800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:47.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.952+0000 7f3c34938800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:47.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.952+0000 7f3c34938800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.952+0000 7f3c34938800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:47.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.952+0000 7f3c34938800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.953+0000 7f3c34938800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:47.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.953+0000 7f3c34938800 20 rados->read ofs=0 len=0 2024-09-12T00:33:47.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.954+0000 7f3c34938800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:47.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.954+0000 7f3c34938800 20 searching for the correct realm 2024-09-12T00:33:47.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.956+0000 7f3c27fff640 0 -- 172.21.15.133:0/251806840 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f3c18027070 msgr2=0x7f3c18027450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:47.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:47.960+0000 7f3c27fff640 0 -- 172.21.15.133:0/251806840 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f3c200dc280 msgr2=0x7f3c200ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:48.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.166+0000 7f3c34938800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:48.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.166+0000 7f3c34938800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:48.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.166+0000 7f3c34938800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:48.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.166+0000 7f3c34938800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.166+0000 7f3c34938800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.166+0000 7f3c34938800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.166+0000 7f3c34938800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.166+0000 7f3c34938800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.166+0000 7f3c34938800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.167+0000 7f3c34938800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:48.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.167+0000 7f3c34938800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.167+0000 7f3c34938800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:48.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.167+0000 7f3c34938800 20 zone default found 2024-09-12T00:33:48.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.167+0000 7f3c34938800 4 Realm: () 2024-09-12T00:33:48.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.167+0000 7f3c34938800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:48.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.167+0000 7f3c34938800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:48.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.167+0000 7f3c34938800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:48.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.167+0000 7f3c34938800 20 zonegroup default 2024-09-12T00:33:48.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.167+0000 7f3c34938800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.167+0000 7f3c34938800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.167+0000 7f3c34938800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.167+0000 7f3c34938800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.167+0000 7f3c34938800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.168+0000 7f3c34938800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.168+0000 7f3c34938800 20 started sync module instance, tier type = 2024-09-12T00:33:48.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.168+0000 7f3c34938800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:48.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.177+0000 7f3c34938800 20 add_watcher() i=0 2024-09-12T00:33:48.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.177+0000 7f3c34938800 20 add_watcher() i=1 2024-09-12T00:33:48.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.177+0000 7f3c34938800 20 add_watcher() i=2 2024-09-12T00:33:48.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.177+0000 7f3c34938800 20 add_watcher() i=3 2024-09-12T00:33:48.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.177+0000 7f3c34938800 20 add_watcher() i=4 2024-09-12T00:33:48.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.177+0000 7f3c34938800 20 add_watcher() i=5 2024-09-12T00:33:48.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.177+0000 7f3c34938800 20 add_watcher() i=6 2024-09-12T00:33:48.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.178+0000 7f3c34938800 20 add_watcher() i=7 2024-09-12T00:33:48.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.178+0000 7f3c34938800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:48.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.180+0000 7f3ae6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.181+0000 7f3c34938800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.181+0000 7f3c34938800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.181+0000 7f3c34938800 5 note: GC not initialized 2024-09-12T00:33:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.181+0000 7f3ae5fdb640 20 reqs_thread_entry: start 2024-09-12T00:33:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.181+0000 7f3c34938800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.181+0000 7f3c34938800 20 Filter name: none 2024-09-12T00:33:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.181+0000 7f3a577fe640 20 reqs_thread_entry: start 2024-09-12T00:33:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.181+0000 7f3c34938800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:33:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.181+0000 7f3c34938800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.181+0000 7f3c34938800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.181+0000 7f3c34938800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:33:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.181+0000 7f3c34938800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:33:48.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.181+0000 7f3c34938800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 : miss 2024-09-12T00:33:48.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.181+0000 7f3c34938800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.182+0000 7f3c34938800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:33:48.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.182+0000 7f3c34938800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 info.flags=0x17 2024-09-12T00:33:48.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.182+0000 7f3c34938800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 to cache LRU end 2024-09-12T00:33:48.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.182+0000 7f3c34938800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:48.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.182+0000 7f3c34938800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:48.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.182+0000 7f3c34938800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 2024-09-12T00:33:48.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.186+0000 7f3c34938800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 info.flags=0x17 2024-09-12T00:33:48.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.186+0000 7f3c34938800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 to cache LRU end 2024-09-12T00:33:48.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.186+0000 7f3c34938800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:48.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.186+0000 7f3c34938800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29, ofs0, ns] 2024-09-12T00:33:48.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.186+0000 7f3b077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497006 cookie 94023495942640 notifier 6734 bl.length()=999 2024-09-12T00:33:48.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.186+0000 7f3b077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 info.flags=0x17 2024-09-12T00:33:48.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.186+0000 7f3b077fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 to cache LRU end 2024-09-12T00:33:48.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.186+0000 7f3b077fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:48.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.188+0000 7f3c34938800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): orig_sources= new_sources= 2024-09-12T00:33:48.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.188+0000 7f3c34938800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): potential sources added=[] removed=[] 2024-09-12T00:33:48.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.188+0000 7f3c34938800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): orig_dests= new_dests= 2024-09-12T00:33:48.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.188+0000 7f3c34938800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): potential dests added=[] removed=[] 2024-09-12T00:33:48.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.190+0000 7f3c34938800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29.1.0 2024-09-12T00:33:48.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.190+0000 7f3c34938800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29.1.0 2024-09-12T00:33:48.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.190+0000 7f3c34938800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29.1.1 2024-09-12T00:33:48.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.190+0000 7f3c34938800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29.1.1 2024-09-12T00:33:48.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.190+0000 7f3c34938800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29.0 2024-09-12T00:33:48.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.193+0000 7f3c34938800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:48.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.193+0000 7f3c34938800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 2024-09-12T00:33:48.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.194+0000 7f3c34938800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 info.flags=0x17 2024-09-12T00:33:48.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.194+0000 7f3c34938800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 to cache LRU end 2024-09-12T00:33:48.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.194+0000 7f3c34938800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:48.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.194+0000 7f3c34938800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29, ofs0, ns] 2024-09-12T00:33:48.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.194+0000 7f3b06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497007 cookie 94023495942640 notifier 6734 bl.length()=999 2024-09-12T00:33:48.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.194+0000 7f3b06ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 info.flags=0x17 2024-09-12T00:33:48.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.194+0000 7f3b06ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 to cache LRU end 2024-09-12T00:33:48.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.194+0000 7f3b06ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:48.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.196+0000 7f3c34938800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): orig_sources= new_sources= 2024-09-12T00:33:48.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.196+0000 7f3c34938800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): potential sources added=[] removed=[] 2024-09-12T00:33:48.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.196+0000 7f3c34938800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): orig_dests= new_dests= 2024-09-12T00:33:48.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.196+0000 7f3c34938800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): potential dests added=[] removed=[] 2024-09-12T00:33:48.195 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.197+0000 7f3c34938800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29.0 2024-09-12T00:33:48.196 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.197+0000 7f3c34938800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:48.196 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.197+0000 7f3c34938800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 2024-09-12T00:33:48.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.198+0000 7f3c34938800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 info.flags=0x17 2024-09-12T00:33:48.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.198+0000 7f3c34938800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 to cache LRU end 2024-09-12T00:33:48.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.198+0000 7f3c34938800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:48.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.198+0000 7f3c34938800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29, ofs0, ns] 2024-09-12T00:33:48.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.198+0000 7f3b077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 94023495942640 notifier 6734 bl.length()=967 2024-09-12T00:33:48.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.198+0000 7f3b077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 info.flags=0x17 2024-09-12T00:33:48.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.198+0000 7f3b077fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 to cache LRU end 2024-09-12T00:33:48.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.198+0000 7f3b077fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:48.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.200+0000 7f3c34938800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): orig_sources= new_sources= 2024-09-12T00:33:48.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.200+0000 7f3c34938800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): potential sources added=[] removed=[] 2024-09-12T00:33:48.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.200+0000 7f3c34938800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): orig_dests= new_dests= 2024-09-12T00:33:48.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.200+0000 7f3c34938800 20 handle_bi_update(): bucket=:error-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29]): potential dests added=[] removed=[] 2024-09-12T00:33:48.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.201+0000 7f3c34938800 1 execute INFO: reshard of bucket "error-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:33:48.202 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.203+0000 7f3ae6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:48.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.205+0000 7f3c34938800 20 remove_watcher() i=0 2024-09-12T00:33:48.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.205+0000 7f3c34938800 2 removed watcher, disabling cache 2024-09-12T00:33:48.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.206+0000 7f3c34938800 20 remove_watcher() i=1 2024-09-12T00:33:48.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.208+0000 7f3c34938800 20 remove_watcher() i=2 2024-09-12T00:33:48.207 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.209+0000 7f3c34938800 20 remove_watcher() i=3 2024-09-12T00:33:48.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.210+0000 7f3c34938800 20 remove_watcher() i=4 2024-09-12T00:33:48.209 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.211+0000 7f3c34938800 20 remove_watcher() i=5 2024-09-12T00:33:48.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.212+0000 7f3c34938800 20 remove_watcher() i=6 2024-09-12T00:33:48.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.213+0000 7f3c34938800 20 remove_watcher() i=7 2024-09-12T00:33:48.224 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:33:48.252 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:48.253 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:48.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.291+0000 7f6b6f923800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.292+0000 7f6b6f923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.292+0000 7f6b6f923800 20 realm 2024-09-12T00:33:48.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.292+0000 7f6b6f923800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.293+0000 7f6b6f923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.293+0000 7f6b6f923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:48.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.293+0000 7f6b6f923800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.293+0000 7f6b6f923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.293+0000 7f6b6f923800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.294+0000 7f6b6f923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:48.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.294+0000 7f6b6f923800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.294+0000 7f6b6f923800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:48.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.294+0000 7f6b6f923800 20 searching for the correct realm 2024-09-12T00:33:48.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.296+0000 7f6b63fff640 0 -- 172.21.15.133:0/2109798405 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f6b58004b40 msgr2=0x7f6b54089ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:48.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.501+0000 7f6b63fff640 0 -- 172.21.15.133:0/2109798405 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f6b5c07a040 msgr2=0x7f6b5c07b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:48.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.709+0000 7f6b6f923800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:48.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.709+0000 7f6b6f923800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:48.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.709+0000 7f6b6f923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:48.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.709+0000 7f6b6f923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:48.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.709+0000 7f6b6f923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:48.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.709+0000 7f6b6f923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:48.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.709+0000 7f6b6f923800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.709+0000 7f6b6f923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.709+0000 7f6b6f923800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.709+0000 7f6b6f923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:48.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.709+0000 7f6b6f923800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.710+0000 7f6b6f923800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:48.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.710+0000 7f6b6f923800 20 zone default found 2024-09-12T00:33:48.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.710+0000 7f6b6f923800 4 Realm: () 2024-09-12T00:33:48.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.710+0000 7f6b6f923800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:48.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.710+0000 7f6b6f923800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:48.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.710+0000 7f6b6f923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:48.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.710+0000 7f6b6f923800 20 zonegroup default 2024-09-12T00:33:48.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.710+0000 7f6b6f923800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.710+0000 7f6b6f923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.710+0000 7f6b6f923800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.710+0000 7f6b6f923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.710+0000 7f6b6f923800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.711+0000 7f6b6f923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.711+0000 7f6b6f923800 20 started sync module instance, tier type = 2024-09-12T00:33:48.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.711+0000 7f6b6f923800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:48.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.720+0000 7f6b6f923800 20 add_watcher() i=0 2024-09-12T00:33:48.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.720+0000 7f6b6f923800 20 add_watcher() i=1 2024-09-12T00:33:48.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.720+0000 7f6b6f923800 20 add_watcher() i=2 2024-09-12T00:33:48.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.720+0000 7f6b6f923800 20 add_watcher() i=3 2024-09-12T00:33:48.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.720+0000 7f6b6f923800 20 add_watcher() i=4 2024-09-12T00:33:48.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.720+0000 7f6b6f923800 20 add_watcher() i=5 2024-09-12T00:33:48.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.720+0000 7f6b6f923800 20 add_watcher() i=6 2024-09-12T00:33:48.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.721+0000 7f6b6f923800 20 add_watcher() i=7 2024-09-12T00:33:48.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.721+0000 7f6b6f923800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:48.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.723+0000 7f6a21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:48.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.724+0000 7f6b6f923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:48.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.724+0000 7f6b6f923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:48.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.724+0000 7f6b6f923800 5 note: GC not initialized 2024-09-12T00:33:48.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.724+0000 7f6a20fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:48.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.724+0000 7f6b6f923800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:48.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.724+0000 7f6b6f923800 20 Filter name: none 2024-09-12T00:33:48.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.724+0000 7f699a7fc640 20 reqs_thread_entry: start 2024-09-12T00:33:48.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.724+0000 7f6b6f923800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.724+0000 7f6b6f923800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:48.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.724+0000 7f6b6f923800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.725+0000 7f6b6f923800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:33:48.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.725+0000 7f6b6f923800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:48.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.725+0000 7f6b6f923800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.725+0000 7f6b6f923800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:48.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.725+0000 7f6b6f923800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.725+0000 7f6b6f923800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:33:48.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.725+0000 7f6b6f923800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:48.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.727+0000 7f6a21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:48.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.729+0000 7f6b6f923800 20 remove_watcher() i=0 2024-09-12T00:33:48.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.729+0000 7f6b6f923800 2 removed watcher, disabling cache 2024-09-12T00:33:48.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.730+0000 7f6b6f923800 20 remove_watcher() i=1 2024-09-12T00:33:48.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.731+0000 7f6b6f923800 20 remove_watcher() i=2 2024-09-12T00:33:48.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.732+0000 7f6b6f923800 20 remove_watcher() i=3 2024-09-12T00:33:48.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.733+0000 7f6b6f923800 20 remove_watcher() i=4 2024-09-12T00:33:48.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.734+0000 7f6b6f923800 20 remove_watcher() i=5 2024-09-12T00:33:48.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.735+0000 7f6b6f923800 20 remove_watcher() i=6 2024-09-12T00:33:48.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:48.736+0000 7f6b6f923800 20 remove_watcher() i=7 2024-09-12T00:33:48.746 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:48.746 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:33:48.746 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-block-writes id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:33:48.746 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:49.031 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T00:33:49.032 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:49.852 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:33:49.882 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:49.882 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:49.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:49.920+0000 7f59bd726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:49.922+0000 7f59bd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:49.922+0000 7f59bd726800 20 realm 2024-09-12T00:33:49.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:49.922+0000 7f59bd726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:49.923+0000 7f59bd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:49.923+0000 7f59bd726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:49.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:49.923+0000 7f59bd726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:49.923+0000 7f59bd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:49.923+0000 7f59bd726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:49.923+0000 7f59bd726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:49.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:49.923+0000 7f59bd726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:49.924+0000 7f59bd726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:49.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:49.924+0000 7f59bd726800 20 searching for the correct realm 2024-09-12T00:33:49.925 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:49.926+0000 7f59b8c6e640 0 -- 172.21.15.133:0/1467087484 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f59b008a030 msgr2=0x7f59b008a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:49.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:49.930+0000 7f59b8c6e640 0 -- 172.21.15.133:0/1467087484 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f59ac085c20 msgr2=0x7f59ac08e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:50.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.135+0000 7f59bd726800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:50.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.135+0000 7f59bd726800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:50.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.135+0000 7f59bd726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:50.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.135+0000 7f59bd726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:50.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.135+0000 7f59bd726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:50.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.135+0000 7f59bd726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:50.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.135+0000 7f59bd726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.136+0000 7f59bd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.136+0000 7f59bd726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.136+0000 7f59bd726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:50.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.136+0000 7f59bd726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.136+0000 7f59bd726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:50.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.136+0000 7f59bd726800 20 zone default found 2024-09-12T00:33:50.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.136+0000 7f59bd726800 4 Realm: () 2024-09-12T00:33:50.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.136+0000 7f59bd726800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:50.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.136+0000 7f59bd726800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:50.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.136+0000 7f59bd726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:50.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.136+0000 7f59bd726800 20 zonegroup default 2024-09-12T00:33:50.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.136+0000 7f59bd726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.137+0000 7f59bd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.137+0000 7f59bd726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.137+0000 7f59bd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.137+0000 7f59bd726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.137+0000 7f59bd726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.137+0000 7f59bd726800 20 started sync module instance, tier type = 2024-09-12T00:33:50.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.137+0000 7f59bd726800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:50.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.146+0000 7f59bd726800 20 add_watcher() i=0 2024-09-12T00:33:50.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.146+0000 7f59bd726800 20 add_watcher() i=1 2024-09-12T00:33:50.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.146+0000 7f59bd726800 20 add_watcher() i=2 2024-09-12T00:33:50.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.146+0000 7f59bd726800 20 add_watcher() i=3 2024-09-12T00:33:50.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.146+0000 7f59bd726800 20 add_watcher() i=4 2024-09-12T00:33:50.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.146+0000 7f59bd726800 20 add_watcher() i=5 2024-09-12T00:33:50.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.146+0000 7f59bd726800 20 add_watcher() i=6 2024-09-12T00:33:50.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.147+0000 7f59bd726800 20 add_watcher() i=7 2024-09-12T00:33:50.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.147+0000 7f59bd726800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:50.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.149+0000 7f586f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:50.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.149+0000 7f59bd726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:50.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.149+0000 7f59bd726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:50.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.149+0000 7f59bd726800 5 note: GC not initialized 2024-09-12T00:33:50.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.149+0000 7f586e7e4640 20 reqs_thread_entry: start 2024-09-12T00:33:50.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.149+0000 7f59bd726800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:50.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.149+0000 7f59bd726800 20 Filter name: none 2024-09-12T00:33:50.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.149+0000 7f57dffff640 20 reqs_thread_entry: start 2024-09-12T00:33:50.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.150+0000 7f59bd726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.150+0000 7f59bd726800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:50.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.150+0000 7f59bd726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.151+0000 7f59bd726800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:33:50.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.151+0000 7f59bd726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:50.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.151+0000 7f59bd726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.151+0000 7f59bd726800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:50.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.151+0000 7f59bd726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.152+0000 7f59bd726800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:33:50.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.152+0000 7f59bd726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:50.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.153+0000 7f586f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:50.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.155+0000 7f59bd726800 20 remove_watcher() i=0 2024-09-12T00:33:50.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.155+0000 7f59bd726800 2 removed watcher, disabling cache 2024-09-12T00:33:50.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.156+0000 7f59bd726800 20 remove_watcher() i=1 2024-09-12T00:33:50.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.157+0000 7f59bd726800 20 remove_watcher() i=2 2024-09-12T00:33:50.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.158+0000 7f59bd726800 20 remove_watcher() i=3 2024-09-12T00:33:50.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.159+0000 7f59bd726800 20 remove_watcher() i=4 2024-09-12T00:33:50.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.159+0000 7f59bd726800 20 remove_watcher() i=5 2024-09-12T00:33:50.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.160+0000 7f59bd726800 20 remove_watcher() i=6 2024-09-12T00:33:50.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.161+0000 7f59bd726800 20 remove_watcher() i=7 2024-09-12T00:33:50.170 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.170 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:33:50.170 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-block-writes id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:33:50.171 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.172 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T00:33:50.206 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:50.206 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:50.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.244+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.247 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.246+0000 7ff91ef21800 20 realm 2024-09-12T00:33:50.247 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.247 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.246+0000 7ff91ef21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:50.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.247+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:50.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.247+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.248+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:50.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.248+0000 7ff91ef21800 20 searching for the correct realm 2024-09-12T00:33:50.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.249+0000 7ff912355640 0 -- 172.21.15.133:0/334284661 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff904018070 msgr2=0x7ff90408b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:50.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.454+0000 7ff912355640 0 -- 172.21.15.133:0/334284661 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff90c0423f0 msgr2=0x7ff90c042870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:50.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:50.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:50.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:50.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:50.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:50.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:50.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.661+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.661+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.661+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:50.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:50.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.662+0000 7ff91ef21800 20 zone default found 2024-09-12T00:33:50.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.662+0000 7ff91ef21800 4 Realm: () 2024-09-12T00:33:50.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.662+0000 7ff91ef21800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:50.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.662+0000 7ff91ef21800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:50.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.662+0000 7ff91ef21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:50.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.662+0000 7ff91ef21800 20 zonegroup default 2024-09-12T00:33:50.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.663+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.663+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.663+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.663+0000 7ff91ef21800 20 started sync module instance, tier type = 2024-09-12T00:33:50.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.663+0000 7ff91ef21800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:50.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=0 2024-09-12T00:33:50.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=1 2024-09-12T00:33:50.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=2 2024-09-12T00:33:50.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=3 2024-09-12T00:33:50.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=4 2024-09-12T00:33:50.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=5 2024-09-12T00:33:50.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=6 2024-09-12T00:33:50.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.674+0000 7ff91ef21800 20 add_watcher() i=7 2024-09-12T00:33:50.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.674+0000 7ff91ef21800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:50.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.676+0000 7ff7d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:50.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.676+0000 7ff91ef21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:50.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.676+0000 7ff91ef21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:50.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.676+0000 7ff91ef21800 5 note: GC not initialized 2024-09-12T00:33:50.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.676+0000 7ff74bfff640 20 reqs_thread_entry: start 2024-09-12T00:33:50.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.676+0000 7ff91ef21800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:50.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.676+0000 7ff91ef21800 20 Filter name: none 2024-09-12T00:33:50.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.677+0000 7ff749ffb640 20 reqs_thread_entry: start 2024-09-12T00:33:50.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.677+0000 7ff91ef21800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:33:50.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.677+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.677+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:50.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.677+0000 7ff91ef21800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:33:50.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.677+0000 7ff91ef21800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:33:50.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.677+0000 7ff91ef21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 : miss 2024-09-12T00:33:50.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.677+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.678+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:33:50.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.678+0000 7ff91ef21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:50.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.678+0000 7ff91ef21800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:50.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.678+0000 7ff91ef21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:50.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.678+0000 7ff91ef21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:50.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.678+0000 7ff91ef21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 2024-09-12T00:33:50.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.682+0000 7ff91ef21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:50.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.682+0000 7ff91ef21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:50.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.682+0000 7ff91ef21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:50.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.682+0000 7ff91ef21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30, ofs0, ns] 2024-09-12T00:33:50.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.682+0000 7ff7fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94923351648224 notifier 7197 bl.length()=999 2024-09-12T00:33:50.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.682+0000 7ff7fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:50.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.682+0000 7ff7fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:50.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.682+0000 7ff7fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:50.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.684+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_sources= new_sources= 2024-09-12T00:33:50.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.684+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential sources added=[] removed=[] 2024-09-12T00:33:50.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.684+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_dests= new_dests= 2024-09-12T00:33:50.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.684+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential dests added=[] removed=[] 2024-09-12T00:33:50.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.686+0000 7ff91ef21800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.1.0 2024-09-12T00:33:50.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.686+0000 7ff91ef21800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.1.0 2024-09-12T00:33:50.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.686+0000 7ff91ef21800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.1.1 2024-09-12T00:33:50.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.686+0000 7ff91ef21800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.1.1 2024-09-12T00:33:50.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.686+0000 7ff91ef21800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.0 2024-09-12T00:33:50.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.688+0000 7ff91ef21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:50.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.688+0000 7ff91ef21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 2024-09-12T00:33:50.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.689+0000 7ff91ef21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:50.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.689+0000 7ff91ef21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:50.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.689+0000 7ff91ef21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:50.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.689+0000 7ff91ef21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30, ofs0, ns] 2024-09-12T00:33:50.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.690+0000 7ff7fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94923351648224 notifier 7197 bl.length()=999 2024-09-12T00:33:50.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.690+0000 7ff7fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:50.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.690+0000 7ff7fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:50.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.690+0000 7ff7fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:50.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.691+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_sources= new_sources= 2024-09-12T00:33:50.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.691+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential sources added=[] removed=[] 2024-09-12T00:33:50.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.691+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_dests= new_dests= 2024-09-12T00:33:50.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.691+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential dests added=[] removed=[] 2024-09-12T00:33:50.690 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff91ef21800 time 2024-09-12T00:33:50.692569+0000 2024-09-12T00:33:50.690 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:50.691 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:50.691 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff92058c71a] 2024-09-12T00:33:50.691 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff92058c8d8] 2024-09-12T00:33:50.691 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56550eb52641] 2024-09-12T00:33:50.691 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x56550eb61582] 2024-09-12T00:33:50.691 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56550eb623e4] 2024-09-12T00:33:50.691 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:33:50.691 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff91f229590] 2024-09-12T00:33:50.691 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:33:50.691 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:33:50.692 INFO:tasks.workunit.client.0.smithi133.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:33:50.692 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7ff91ef21800 thread_name:radosgw-admin 2024-09-12T00:33:50.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.692+0000 7ff91ef21800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff91ef21800 time 2024-09-12T00:33:50.692569+0000 2024-09-12T00:33:50.692 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:50.692 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.692 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:50.692 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff92058c71a] 2024-09-12T00:33:50.692 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff92058c8d8] 2024-09-12T00:33:50.692 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56550eb52641] 2024-09-12T00:33:50.692 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x56550eb61582] 2024-09-12T00:33:50.692 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56550eb623e4] 2024-09-12T00:33:50.692 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:33:50.692 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff91f229590] 2024-09-12T00:33:50.692 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:33:50.693 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:33:50.693 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.724 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:50.724 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff91f23e6f0] 2024-09-12T00:33:50.724 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff91f28b99c] 2024-09-12T00:33:50.724 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:33:50.724 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:33:50.724 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff92058c774] 2024-09-12T00:33:50.724 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff92058c8d8] 2024-09-12T00:33:50.724 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56550eb52641] 2024-09-12T00:33:50.725 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x56550eb61582] 2024-09-12T00:33:50.725 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56550eb623e4] 2024-09-12T00:33:50.725 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:33:50.725 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff91f229590] 2024-09-12T00:33:50.725 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:33:50.725 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:33:50.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.693+0000 7ff91ef21800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:33:50.725 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7ff91ef21800 thread_name:radosgw-admin 2024-09-12T00:33:50.725 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.725 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:50.725 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff91f23e6f0] 2024-09-12T00:33:50.725 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff91f28b99c] 2024-09-12T00:33:50.725 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:33:50.726 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:33:50.726 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff92058c774] 2024-09-12T00:33:50.726 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff92058c8d8] 2024-09-12T00:33:50.726 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56550eb52641] 2024-09-12T00:33:50.726 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x56550eb61582] 2024-09-12T00:33:50.726 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56550eb623e4] 2024-09-12T00:33:50.726 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:33:50.726 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff91f229590] 2024-09-12T00:33:50.726 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:33:50.726 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:33:50.726 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:33:50.726 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.726 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:33:50.727 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:33:50.228+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.727 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:33:50.228+0000 7ff91ef21800 1 librados: starting msgr at 2024-09-12T00:33:50.727 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:33:50.228+0000 7ff91ef21800 1 librados: starting objecter 2024-09-12T00:33:50.727 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:33:50.228+0000 7ff91ef21800 5 asok(0x56551075d630) register_command objecter_requests hook 0x5655109873c0 2024-09-12T00:33:50.727 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:33:50.229+0000 7ff91ef21800 1 librados: setting wanted keys 2024-09-12T00:33:50.727 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:33:50.229+0000 7ff91ef21800 1 librados: calling monclient init 2024-09-12T00:33:50.727 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient: init 2024-09-12T00:33:50.727 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding auth protocol: cephx 2024-09-12T00:33:50.727 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding auth protocol: cephx 2024-09-12T00:33:50.727 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding auth protocol: cephx 2024-09-12T00:33:50.727 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: secure 2024-09-12T00:33:50.727 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: crc 2024-09-12T00:33:50.727 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: secure 2024-09-12T00:33:50.727 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: crc 2024-09-12T00:33:50.728 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: secure 2024-09-12T00:33:50.728 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: crc 2024-09-12T00:33:50.728 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: crc 2024-09-12T00:33:50.728 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: secure 2024-09-12T00:33:50.728 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: crc 2024-09-12T00:33:50.728 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: secure 2024-09-12T00:33:50.728 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: crc 2024-09-12T00:33:50.728 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: secure 2024-09-12T00:33:50.728 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:33:50.229+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.728 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:33:50.229+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.728 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 asok(0x56551075d630) register_command rotate-key hook 0x565510980118 2024-09-12T00:33:50.728 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:50.728 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:33:50.728 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-b con 0x565510834e40 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:50.729 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-a con 0x5655108c5e10 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:50.729 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-c con 0x5655108cf510 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:50.729 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.729 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.729 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.729 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:50.729 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): authenticate will time out at 2038.801588s 2024-09-12T00:33:50.729 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): get_auth_request con 0x5655108c5e10 auth_method 0 2024-09-12T00:33:50.729 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.729 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.729 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.729 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:33:50.229+0000 7ff91b357640 10 monclient(hunting): get_auth_request con 0x5655108cf510 auth_method 0 2024-09-12T00:33:50.729 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:33:50.229+0000 7ff91b357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.729 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:33:50.229+0000 7ff91b357640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.730 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:33:50.229+0000 7ff91b357640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.730 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.730 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.730 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.730 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:33:50.229+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.730 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:33:50.229+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.730 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:33:50.229+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.730 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:33:50.229+0000 7ff91ab56640 10 monclient(hunting): get_auth_request con 0x565510834e40 auth_method 0 2024-09-12T00:33:50.730 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:33:50.229+0000 7ff91ab56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.730 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:33:50.229+0000 7ff91ab56640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.730 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:33:50.229+0000 7ff91ab56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.730 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:33:50.229+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.730 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:33:50.229+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.730 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:33:50.229+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.731 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): handle_auth_done global_id 7188 payload 824 2024-09-12T00:33:50.731 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient: _finish_hunting 0 2024-09-12T00:33:50.731 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:33:50.229+0000 7ff912355640 1 monclient: found mon.noname-a 2024-09-12T00:33:50.731 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:33:50.731 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.731 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:33:50.731 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: dump: 2024-09-12T00:33:50.731 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.731 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.731 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.731 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.731 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.731 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.731 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.732 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.732 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.732 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.732 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: _finish_auth 0 2024-09-12T00:33:50.732 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: _check_auth_tickets 2024-09-12T00:33:50.732 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:50.732 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.732 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:33:50.732 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: dump: 2024-09-12T00:33:50.732 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.732 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.732 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.733 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.733 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.733 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.733 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.733 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.733 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.733 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.733 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:33:50.230+0000 7ff91ef21800 5 monclient: authenticate success, global_id 7188 2024-09-12T00:33:50.733 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:33:50.230+0000 7ff91ef21800 10 monclient: _renew_subs 2024-09-12T00:33:50.733 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:33:50.230+0000 7ff91ef21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:33:50.733 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:33:50.230+0000 7ff808e09640 4 set_mon_vals no callback set 2024-09-12T00:33:50.733 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:33:50.230+0000 7ff91ef21800 10 monclient: _renew_subs 2024-09-12T00:33:50.733 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:33:50.230+0000 7ff91ef21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:33:50.733 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:33:50.230+0000 7ff91ef21800 1 librados: init done 2024-09-12T00:33:50.733 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:33:50.232+0000 7ff807606640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:33:50.734 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:33:50.232+0000 7ff807606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:50.734 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:33:50.232+0000 7ff807606640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:50.734 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:33:50.232+0000 7ff91ab56640 10 monclient: get_auth_request con 0x7ff800076470 auth_method 0 2024-09-12T00:33:50.734 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:33:50.232+0000 7ff91b357640 10 monclient: get_auth_request con 0x5655109c8d10 auth_method 0 2024-09-12T00:33:50.734 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:33:50.233+0000 7ff91ab56640 10 monclient: get_auth_request con 0x5655109cbef0 auth_method 0 2024-09-12T00:33:50.734 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:33:50.234+0000 7ff912355640 10 monclient: get_auth_request con 0x5655109d0250 auth_method 0 2024-09-12T00:33:50.734 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:33:50.234+0000 7ff91b357640 10 monclient: get_auth_request con 0x5655109cf7b0 auth_method 0 2024-09-12T00:33:50.734 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:33:50.235+0000 7ff91ef21800 10 monclient: build_initial_monmap 2024-09-12T00:33:50.734 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:33:50.235+0000 7ff91ef21800 1 build_initial for_mkfs: 0 2024-09-12T00:33:50.734 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:33:50.235+0000 7ff91ef21800 10 monclient: monmap: 2024-09-12T00:33:50.734 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:33:50.734 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:50.734 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:33:50.734 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:33:50.735 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:50.735 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.735 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:33:50.735 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:33:50.735 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:33:50.735 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.735 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding auth protocol: cephx 2024-09-12T00:33:50.735 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding auth protocol: cephx 2024-09-12T00:33:50.735 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding auth protocol: cephx 2024-09-12T00:33:50.735 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: secure 2024-09-12T00:33:50.735 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: crc 2024-09-12T00:33:50.735 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: secure 2024-09-12T00:33:50.735 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: crc 2024-09-12T00:33:50.735 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: secure 2024-09-12T00:33:50.736 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: crc 2024-09-12T00:33:50.736 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: crc 2024-09-12T00:33:50.736 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: secure 2024-09-12T00:33:50.736 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: crc 2024-09-12T00:33:50.736 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: secure 2024-09-12T00:33:50.736 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: crc 2024-09-12T00:33:50.736 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: secure 2024-09-12T00:33:50.736 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:33:50.235+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.736 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 asok(0x56551075d630) register_command objecter_requests cmddesc objecter_requests hook 0x5655109db880 EEXIST 2024-09-12T00:33:50.736 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient: init 2024-09-12T00:33:50.736 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding auth protocol: cephx 2024-09-12T00:33:50.736 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding auth protocol: cephx 2024-09-12T00:33:50.736 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding auth protocol: cephx 2024-09-12T00:33:50.736 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: secure 2024-09-12T00:33:50.736 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: crc 2024-09-12T00:33:50.737 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: secure 2024-09-12T00:33:50.737 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: crc 2024-09-12T00:33:50.737 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: secure 2024-09-12T00:33:50.737 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: crc 2024-09-12T00:33:50.737 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: crc 2024-09-12T00:33:50.737 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: secure 2024-09-12T00:33:50.737 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: crc 2024-09-12T00:33:50.737 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: secure 2024-09-12T00:33:50.737 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: crc 2024-09-12T00:33:50.737 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: secure 2024-09-12T00:33:50.737 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:33:50.236+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.737 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:33:50.236+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.737 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 asok(0x56551075d630) register_command rotate-key cmddesc rotate-key hook 0x5655109d73f0 EEXIST 2024-09-12T00:33:50.738 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:50.738 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:33:50.738 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-c con 0x5655109ffba0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:50.738 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-b con 0x5655109fff80 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:50.738 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-a con 0x5655109fe8b0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:50.738 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.738 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.738 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.738 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:50.738 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): authenticate will time out at 2038.808584s 2024-09-12T00:33:50.738 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): get_auth_request con 0x5655109ffba0 auth_method 0 2024-09-12T00:33:50.738 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.738 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.738 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.739 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:33:50.236+0000 7ff91ab56640 10 monclient(hunting): get_auth_request con 0x5655109fe8b0 auth_method 0 2024-09-12T00:33:50.739 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:33:50.236+0000 7ff91ab56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.739 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:33:50.236+0000 7ff91ab56640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.739 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:33:50.236+0000 7ff91ab56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.739 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:33:50.236+0000 7ff91b357640 10 monclient(hunting): get_auth_request con 0x5655109fff80 auth_method 0 2024-09-12T00:33:50.739 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:33:50.236+0000 7ff91b357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.739 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:33:50.236+0000 7ff91b357640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.739 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:33:50.236+0000 7ff91b357640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.739 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.739 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.739 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.739 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:33:50.236+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.739 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:33:50.236+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.739 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:33:50.236+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.739 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:33:50.236+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.740 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:33:50.236+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.740 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:33:50.236+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.740 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): handle_auth_done global_id 6773 payload 824 2024-09-12T00:33:50.740 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient: _finish_hunting 0 2024-09-12T00:33:50.740 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:33:50.236+0000 7ff912355640 1 monclient: found mon.noname-c 2024-09-12T00:33:50.740 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:33:50.740 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.740 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:50.740 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: dump: 2024-09-12T00:33:50.740 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.740 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.740 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.740 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.740 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.741 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.741 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.741 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.741 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.741 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.741 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: _finish_auth 0 2024-09-12T00:33:50.741 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: _check_auth_tickets 2024-09-12T00:33:50.741 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:50.741 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.741 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:50.741 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: dump: 2024-09-12T00:33:50.741 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.741 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.741 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.742 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.742 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.742 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.742 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.742 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.742 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.742 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.742 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:33:50.237+0000 7ff91ef21800 5 monclient: authenticate success, global_id 6773 2024-09-12T00:33:50.742 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:33:50.237+0000 7ff91ef21800 10 monclient: _renew_subs 2024-09-12T00:33:50.742 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:33:50.237+0000 7ff91ef21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:50.742 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:33:50.237+0000 7ff91bb58640 4 set_mon_vals no callback set 2024-09-12T00:33:50.742 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:33:50.237+0000 7ff91ef21800 10 monclient: _renew_subs 2024-09-12T00:33:50.742 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:33:50.237+0000 7ff91ef21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:50.742 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:33:50.238+0000 7ff804e01640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:33:50.743 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:33:50.238+0000 7ff804e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:50.743 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:33:50.238+0000 7ff804e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:50.743 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:33:50.239+0000 7ff91b357640 10 monclient: get_auth_request con 0x7ff7f4076380 auth_method 0 2024-09-12T00:33:50.743 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:33:50.239+0000 7ff91ef21800 10 monclient: get_monmap_and_config 2024-09-12T00:33:50.743 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:33:50.239+0000 7ff91ef21800 10 monclient: build_initial_monmap 2024-09-12T00:33:50.743 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:33:50.239+0000 7ff91ef21800 1 build_initial for_mkfs: 0 2024-09-12T00:33:50.743 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:33:50.239+0000 7ff91ef21800 10 monclient: monmap: 2024-09-12T00:33:50.743 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:33:50.743 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:50.743 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:33:50.743 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:33:50.743 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:50.743 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.743 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:33:50.744 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:33:50.744 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:33:50.744 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.744 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding auth protocol: cephx 2024-09-12T00:33:50.744 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding auth protocol: cephx 2024-09-12T00:33:50.744 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding auth protocol: cephx 2024-09-12T00:33:50.744 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: secure 2024-09-12T00:33:50.744 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: crc 2024-09-12T00:33:50.744 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: secure 2024-09-12T00:33:50.744 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: crc 2024-09-12T00:33:50.744 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: secure 2024-09-12T00:33:50.744 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: crc 2024-09-12T00:33:50.744 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: crc 2024-09-12T00:33:50.745 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: secure 2024-09-12T00:33:50.745 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: crc 2024-09-12T00:33:50.745 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: secure 2024-09-12T00:33:50.745 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: crc 2024-09-12T00:33:50.745 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: secure 2024-09-12T00:33:50.745 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:33:50.239+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.745 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:33:50.239+0000 7ff91ef21800 10 monclient: init 2024-09-12T00:33:50.745 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding auth protocol: cephx 2024-09-12T00:33:50.745 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding auth protocol: cephx 2024-09-12T00:33:50.745 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding auth protocol: cephx 2024-09-12T00:33:50.745 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: secure 2024-09-12T00:33:50.745 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: crc 2024-09-12T00:33:50.746 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: secure 2024-09-12T00:33:50.746 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: crc 2024-09-12T00:33:50.746 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: secure 2024-09-12T00:33:50.746 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: crc 2024-09-12T00:33:50.746 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: crc 2024-09-12T00:33:50.746 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: secure 2024-09-12T00:33:50.746 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: crc 2024-09-12T00:33:50.746 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: secure 2024-09-12T00:33:50.746 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: crc 2024-09-12T00:33:50.746 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: secure 2024-09-12T00:33:50.746 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:33:50.239+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.746 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:33:50.240+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.746 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:33:50.240+0000 7ff91ef21800 5 asok(0x56551075d630) register_command rotate-key cmddesc rotate-key hook 0x7fff7e37a2d8 EEXIST 2024-09-12T00:33:50.746 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:50.747 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:33:50.747 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-b con 0x565510a54120 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:50.747 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-c con 0x565510a23f30 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:50.747 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-a con 0x565510a4f4e0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:50.747 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.747 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.747 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.747 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:50.747 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): authenticate will time out at 2038.812303s 2024-09-12T00:33:50.747 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): get_auth_request con 0x565510a4f4e0 auth_method 0 2024-09-12T00:33:50.747 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.747 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.747 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.748 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:33:50.240+0000 7ff91b357640 10 monclient(hunting): get_auth_request con 0x565510a23f30 auth_method 0 2024-09-12T00:33:50.748 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:33:50.240+0000 7ff91b357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.748 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:33:50.240+0000 7ff91b357640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.748 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:33:50.240+0000 7ff91b357640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.748 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:33:50.240+0000 7ff912355640 10 monclient(hunting): get_auth_request con 0x565510a54120 auth_method 0 2024-09-12T00:33:50.748 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:33:50.240+0000 7ff912355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.748 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:33:50.240+0000 7ff912355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.748 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:33:50.240+0000 7ff912355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.748 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.748 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.748 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.748 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:33:50.240+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.748 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:33:50.240+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.748 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:33:50.240+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.749 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:33:50.240+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.749 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:33:50.240+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.749 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:33:50.240+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.749 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): handle_auth_done global_id 7194 payload 274 2024-09-12T00:33:50.749 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient: _finish_hunting 0 2024-09-12T00:33:50.749 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:33:50.240+0000 7ff91ab56640 1 monclient: found mon.noname-a 2024-09-12T00:33:50.749 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:33:50.749 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.749 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:33:50.749 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: dump: 2024-09-12T00:33:50.749 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.749 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.749 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.749 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.750 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.750 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.750 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.750 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.750 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.750 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.750 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: _finish_auth 0 2024-09-12T00:33:50.750 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:33:50.750 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:50.750 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.750 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:33:50.750 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: dump: 2024-09-12T00:33:50.750 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.750 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.751 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.751 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.751 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.751 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.751 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.751 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.751 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.751 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.751 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:33:50.240+0000 7ff91ef21800 5 monclient: authenticate success, global_id 7194 2024-09-12T00:33:50.751 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient: get_monmap_and_config success 2024-09-12T00:33:50.751 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:33:50.240+0000 7ff91ef21800 4 set_mon_vals no callback set 2024-09-12T00:33:50.751 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:33:50.241+0000 7ff91ef21800 10 monclient: shutdown 2024-09-12T00:33:50.751 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:33:50.241+0000 7ff91ef21800 10 monclient: build_initial_monmap 2024-09-12T00:33:50.751 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:33:50.241+0000 7ff91ef21800 1 build_initial for_mkfs: 0 2024-09-12T00:33:50.752 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:33:50.241+0000 7ff91ef21800 10 monclient: monmap: 2024-09-12T00:33:50.752 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:33:50.752 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:50.752 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:33:50.752 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:33:50.752 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:50.752 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.752 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:33:50.752 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:33:50.752 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:33:50.752 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.752 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding auth protocol: cephx 2024-09-12T00:33:50.752 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding auth protocol: cephx 2024-09-12T00:33:50.752 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding auth protocol: cephx 2024-09-12T00:33:50.753 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: secure 2024-09-12T00:33:50.753 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: crc 2024-09-12T00:33:50.753 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: secure 2024-09-12T00:33:50.753 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: crc 2024-09-12T00:33:50.753 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: secure 2024-09-12T00:33:50.753 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: crc 2024-09-12T00:33:50.753 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: crc 2024-09-12T00:33:50.753 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: secure 2024-09-12T00:33:50.753 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: crc 2024-09-12T00:33:50.753 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: secure 2024-09-12T00:33:50.753 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: crc 2024-09-12T00:33:50.753 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: secure 2024-09-12T00:33:50.753 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:33:50.241+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.753 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:33:50.241+0000 7ff91ef21800 1 librados: starting msgr at 2024-09-12T00:33:50.754 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:33:50.241+0000 7ff91ef21800 1 librados: starting objecter 2024-09-12T00:33:50.754 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 asok(0x56551075d630) register_command objecter_requests cmddesc objecter_requests hook 0x565510a512e0 EEXIST 2024-09-12T00:33:50.754 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:33:50.242+0000 7ff91ef21800 1 librados: setting wanted keys 2024-09-12T00:33:50.754 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:33:50.242+0000 7ff91ef21800 1 librados: calling monclient init 2024-09-12T00:33:50.754 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient: init 2024-09-12T00:33:50.754 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding auth protocol: cephx 2024-09-12T00:33:50.754 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding auth protocol: cephx 2024-09-12T00:33:50.754 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding auth protocol: cephx 2024-09-12T00:33:50.754 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: secure 2024-09-12T00:33:50.754 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: crc 2024-09-12T00:33:50.754 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: secure 2024-09-12T00:33:50.754 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: crc 2024-09-12T00:33:50.754 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: secure 2024-09-12T00:33:50.754 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: crc 2024-09-12T00:33:50.754 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: crc 2024-09-12T00:33:50.755 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: secure 2024-09-12T00:33:50.755 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: crc 2024-09-12T00:33:50.755 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: secure 2024-09-12T00:33:50.755 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: crc 2024-09-12T00:33:50.755 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: secure 2024-09-12T00:33:50.755 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:33:50.242+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.755 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:33:50.242+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.755 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 asok(0x56551075d630) register_command rotate-key cmddesc rotate-key hook 0x565510a145a8 EEXIST 2024-09-12T00:33:50.755 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:50.755 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:33:50.755 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-b con 0x565510a23f30 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:50.755 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-a con 0x565510a4f4e0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:50.755 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-c con 0x565510a54120 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:50.755 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.756 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.756 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.756 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:50.756 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): authenticate will time out at 2038.814541s 2024-09-12T00:33:50.756 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): get_auth_request con 0x565510a4f4e0 auth_method 0 2024-09-12T00:33:50.756 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.756 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.756 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.756 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:33:50.242+0000 7ff91ab56640 10 monclient(hunting): get_auth_request con 0x565510a54120 auth_method 0 2024-09-12T00:33:50.756 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:33:50.242+0000 7ff91ab56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.756 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:33:50.242+0000 7ff91ab56640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.756 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:33:50.242+0000 7ff91ab56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.756 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:33:50.242+0000 7ff912355640 10 monclient(hunting): get_auth_request con 0x565510a23f30 auth_method 0 2024-09-12T00:33:50.757 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:33:50.242+0000 7ff912355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.757 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:33:50.242+0000 7ff912355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.757 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:33:50.242+0000 7ff912355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.757 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.757 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.757 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.757 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:33:50.242+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.757 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:33:50.242+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.757 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:33:50.242+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.757 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:33:50.242+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.757 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:33:50.242+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.757 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:33:50.242+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.757 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): handle_auth_done global_id 7197 payload 824 2024-09-12T00:33:50.757 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient: _finish_hunting 0 2024-09-12T00:33:50.758 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:33:50.242+0000 7ff91b357640 1 monclient: found mon.noname-a 2024-09-12T00:33:50.758 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:33:50.758 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.758 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:33:50.758 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: dump: 2024-09-12T00:33:50.758 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.758 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.758 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.758 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.758 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.758 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.758 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.758 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.759 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.759 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.759 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: _finish_auth 0 2024-09-12T00:33:50.759 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: _check_auth_tickets 2024-09-12T00:33:50.759 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:50.759 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.759 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:33:50.759 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: dump: 2024-09-12T00:33:50.759 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.759 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.759 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.759 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.760 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.760 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.760 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.760 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.760 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.760 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.760 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:33:50.243+0000 7ff91ef21800 5 monclient: authenticate success, global_id 7197 2024-09-12T00:33:50.760 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:33:50.243+0000 7ff91ef21800 10 monclient: _renew_subs 2024-09-12T00:33:50.760 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:33:50.243+0000 7ff91ef21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:33:50.760 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:33:50.243+0000 7ff7fe7fc640 4 set_mon_vals no callback set 2024-09-12T00:33:50.760 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:33:50.243+0000 7ff91ef21800 10 monclient: _renew_subs 2024-09-12T00:33:50.760 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:33:50.243+0000 7ff91ef21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:33:50.760 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:33:50.243+0000 7ff91ef21800 1 librados: init done 2024-09-12T00:33:50.761 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:33:50.243+0000 7ff91ef21800 5 asok(0x56551075d630) register_command cr dump hook 0x7ff90c010518 2024-09-12T00:33:50.761 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:33:50.244+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.761 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:33:50.245+0000 7ff7fcff9640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:33:50.761 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:33:50.245+0000 7ff7fcff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:50.761 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:33:50.245+0000 7ff7fcff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:50.761 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:33:50.245+0000 7ff912355640 10 monclient: get_auth_request con 0x7ff7e4076470 auth_method 0 2024-09-12T00:33:50.761 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:33:50.245+0000 7ff91ab56640 10 monclient: get_auth_request con 0x565510a6ebc0 auth_method 0 2024-09-12T00:33:50.761 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.761 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:33:50.246+0000 7ff91ef21800 20 realm 2024-09-12T00:33:50.761 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.761 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.761 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:33:50.246+0000 7ff91ef21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:50.761 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.761 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.762 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.762 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:33:50.246+0000 7ff912355640 10 monclient: get_auth_request con 0x565510a72e10 auth_method 0 2024-09-12T00:33:50.762 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:33:50.247+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:50.762 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:33:50.247+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.762 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:33:50.247+0000 7ff91b357640 10 monclient: get_auth_request con 0x565510a76670 auth_method 0 2024-09-12T00:33:50.762 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:33:50.248+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:50.762 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:33:50.248+0000 7ff91ef21800 20 searching for the correct realm 2024-09-12T00:33:50.762 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:33:50.248+0000 7ff91ab56640 10 monclient: get_auth_request con 0x7ff91404e2b0 auth_method 0 2024-09-12T00:33:50.762 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:33:50.249+0000 7ff912355640 10 monclient: get_auth_request con 0x7ff904018070 auth_method 0 2024-09-12T00:33:50.762 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:33:50.249+0000 7ff912355640 0 -- 172.21.15.133:0/334284661 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff904018070 msgr2=0x7ff90408b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:50.762 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:33:50.450+0000 7ff912355640 10 monclient: get_auth_request con 0x7ff904018070 auth_method 0 2024-09-12T00:33:50.762 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:33:50.451+0000 7ff91b357640 10 monclient: get_auth_request con 0x7ff9140b91b0 auth_method 0 2024-09-12T00:33:50.762 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:33:50.453+0000 7ff91ab56640 10 monclient: get_auth_request con 0x7ff90406d1c0 auth_method 0 2024-09-12T00:33:50.763 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:33:50.454+0000 7ff912355640 0 -- 172.21.15.133:0/334284661 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff90c0423f0 msgr2=0x7ff90c042870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:50.763 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:33:50.655+0000 7ff912355640 10 monclient: get_auth_request con 0x7ff90c0423f0 auth_method 0 2024-09-12T00:33:50.763 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:50.763 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:50.763 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:50.763 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:50.763 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:50.763 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:50.763 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.763 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.763 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.763 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:50.763 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.763 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:50.764 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 zone default found 2024-09-12T00:33:50.764 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:33:50.662+0000 7ff91ef21800 4 Realm: () 2024-09-12T00:33:50.764 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:33:50.662+0000 7ff91ef21800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:50.764 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:33:50.662+0000 7ff91ef21800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:50.764 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:33:50.662+0000 7ff91ef21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:50.764 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 zonegroup default 2024-09-12T00:33:50.764 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.764 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.764 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.764 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:33:50.663+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.764 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:33:50.663+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.764 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:33:50.663+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.764 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:33:50.663+0000 7ff91ef21800 20 started sync module instance, tier type = 2024-09-12T00:33:50.765 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:33:50.663+0000 7ff91ef21800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:50.765 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=0 2024-09-12T00:33:50.765 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=1 2024-09-12T00:33:50.765 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=2 2024-09-12T00:33:50.765 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=3 2024-09-12T00:33:50.765 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=4 2024-09-12T00:33:50.765 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=5 2024-09-12T00:33:50.765 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=6 2024-09-12T00:33:50.765 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:33:50.674+0000 7ff91ef21800 20 add_watcher() i=7 2024-09-12T00:33:50.765 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:33:50.674+0000 7ff91ef21800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:50.765 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding auth protocol: cephx 2024-09-12T00:33:50.765 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding auth protocol: cephx 2024-09-12T00:33:50.765 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding auth protocol: cephx 2024-09-12T00:33:50.766 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: secure 2024-09-12T00:33:50.766 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: crc 2024-09-12T00:33:50.766 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: secure 2024-09-12T00:33:50.766 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: crc 2024-09-12T00:33:50.766 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: secure 2024-09-12T00:33:50.766 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: crc 2024-09-12T00:33:50.766 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: crc 2024-09-12T00:33:50.766 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: secure 2024-09-12T00:33:50.766 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: crc 2024-09-12T00:33:50.766 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: secure 2024-09-12T00:33:50.766 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: crc 2024-09-12T00:33:50.766 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: secure 2024-09-12T00:33:50.766 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:33:50.676+0000 7ff7d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:50.767 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:33:50.676+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.767 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:33:50.676+0000 7ff91ef21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:50.767 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:33:50.676+0000 7ff91ef21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:50.767 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command cache list hook 0x565510a49bc0 2024-09-12T00:33:50.767 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command cache inspect hook 0x565510a49bc0 2024-09-12T00:33:50.767 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command cache erase hook 0x565510a49bc0 2024-09-12T00:33:50.767 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command cache zap hook 0x565510a49bc0 2024-09-12T00:33:50.767 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 note: GC not initialized 2024-09-12T00:33:50.767 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:33:50.676+0000 7ff74bfff640 20 reqs_thread_entry: start 2024-09-12T00:33:50.767 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command sync trace show hook 0x7ff90c002d60 2024-09-12T00:33:50.768 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command sync trace history hook 0x7ff90c002d60 2024-09-12T00:33:50.768 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command sync trace active hook 0x7ff90c002d60 2024-09-12T00:33:50.768 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command sync trace active_short hook 0x7ff90c002d60 2024-09-12T00:33:50.768 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:33:50.676+0000 7ff91ef21800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:50.768 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:33:50.676+0000 7ff91ef21800 20 Filter name: none 2024-09-12T00:33:50.768 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:33:50.677+0000 7ff749ffb640 20 reqs_thread_entry: start 2024-09-12T00:33:50.768 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:33:50.677+0000 7ff91ef21800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:33:50.768 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:33:50.677+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.768 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:33:50.677+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:50.769 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:33:50.677+0000 7ff91ef21800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:33:50.769 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:33:50.677+0000 7ff91ef21800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:33:50.769 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:33:50.677+0000 7ff91ef21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 : miss 2024-09-12T00:33:50.769 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:33:50.677+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.769 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:33:50.678+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:33:50.769 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:33:50.678+0000 7ff91ef21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:50.769 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:33:50.678+0000 7ff91ef21800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:50.769 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:33:50.678+0000 7ff91ef21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:50.769 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:33:50.678+0000 7ff91ef21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:50.769 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:33:50.678+0000 7ff91ef21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 2024-09-12T00:33:50.769 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:33:50.682+0000 7ff91ef21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:50.769 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:33:50.682+0000 7ff91ef21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:50.769 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:33:50.682+0000 7ff91ef21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:50.770 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:33:50.682+0000 7ff91ef21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30, ofs0, ns] 2024-09-12T00:33:50.770 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:33:50.682+0000 7ff7fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94923351648224 notifier 7197 bl.length()=999 2024-09-12T00:33:50.770 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:33:50.682+0000 7ff7fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:50.770 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:33:50.682+0000 7ff7fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:50.770 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:33:50.682+0000 7ff7fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:50.770 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:33:50.684+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_sources= new_sources= 2024-09-12T00:33:50.770 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:33:50.684+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential sources added=[] removed=[] 2024-09-12T00:33:50.770 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:33:50.684+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_dests= new_dests= 2024-09-12T00:33:50.770 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:33:50.684+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential dests added=[] removed=[] 2024-09-12T00:33:50.770 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:33:50.686+0000 7ff91ef21800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.1.0 2024-09-12T00:33:50.770 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:33:50.686+0000 7ff91ef21800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.1.0 2024-09-12T00:33:50.770 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:33:50.686+0000 7ff91ef21800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.1.1 2024-09-12T00:33:50.770 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:33:50.686+0000 7ff91ef21800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.1.1 2024-09-12T00:33:50.771 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:33:50.686+0000 7ff91ef21800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.0 2024-09-12T00:33:50.771 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:33:50.688+0000 7ff91ef21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:50.771 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:33:50.688+0000 7ff91ef21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 2024-09-12T00:33:50.771 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:33:50.689+0000 7ff91ef21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:50.771 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:33:50.689+0000 7ff91ef21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:50.771 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:33:50.689+0000 7ff91ef21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:50.771 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:33:50.689+0000 7ff91ef21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30, ofs0, ns] 2024-09-12T00:33:50.771 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:33:50.690+0000 7ff7fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94923351648224 notifier 7197 bl.length()=999 2024-09-12T00:33:50.771 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:33:50.690+0000 7ff7fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:50.771 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:33:50.690+0000 7ff7fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:50.771 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:33:50.690+0000 7ff7fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:50.771 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:33:50.691+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_sources= new_sources= 2024-09-12T00:33:50.771 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:33:50.691+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential sources added=[] removed=[] 2024-09-12T00:33:50.772 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:33:50.691+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_dests= new_dests= 2024-09-12T00:33:50.772 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:33:50.691+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential dests added=[] removed=[] 2024-09-12T00:33:50.772 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:33:50.692+0000 7ff91ef21800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff91ef21800 time 2024-09-12T00:33:50.692569+0000 2024-09-12T00:33:50.772 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:50.772 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.772 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:50.772 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff92058c71a] 2024-09-12T00:33:50.772 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff92058c8d8] 2024-09-12T00:33:50.772 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56550eb52641] 2024-09-12T00:33:50.772 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x56550eb61582] 2024-09-12T00:33:50.772 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56550eb623e4] 2024-09-12T00:33:50.772 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:33:50.772 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff91f229590] 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:33:50.693+0000 7ff91ef21800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7ff91ef21800 thread_name:radosgw-admin 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff91f23e6f0] 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff91f28b99c] 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff92058c774] 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff92058c8d8] 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56550eb52641] 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x56550eb61582] 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56550eb623e4] 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff91f229590] 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:33:50.779 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:33:50.779 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:33:50.779 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:33:50.779 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:33:50.779 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:33:50.779 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:33:50.779 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:33:50.779 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:33:50.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:33:50.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:33:50.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:33:50.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:33:50.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:33:50.779 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:33:50.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:33:50.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:33:50.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:33:50.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:33:50.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:33:50.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:33:50.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:33:50.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:33:50.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:33:50.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:33:50.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:33:50.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:33:50.780 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:33:50.781 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:33:50.781 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:33:50.781 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:33:50.781 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:33:50.781 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:33:50.781 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:33:50.781 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:33:50.781 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:33:50.781 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:33:50.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff749ffb640 / http_manager 2024-09-12T00:33:50.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff74bfff640 / http_manager 2024-09-12T00:33:50.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff7d17e2640 / rgw_dt_lg_renew 2024-09-12T00:33:50.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff7fcff9640 / ms_dispatch 2024-09-12T00:33:50.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff7fe7fc640 / io_context_pool 2024-09-12T00:33:50.781 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff804e01640 / ms_dispatch 2024-09-12T00:33:50.782 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff807606640 / ms_dispatch 2024-09-12T00:33:50.782 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff808e09640 / io_context_pool 2024-09-12T00:33:50.782 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff912355640 / msgr-worker-2 2024-09-12T00:33:50.782 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff91ab56640 / msgr-worker-1 2024-09-12T00:33:50.782 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff91b357640 / msgr-worker-0 2024-09-12T00:33:50.782 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff91bb58640 / io_context_pool 2024-09-12T00:33:50.782 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff91ef21800 / radosgw-admin 2024-09-12T00:33:50.782 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:33:50.782 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:33:50.782 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/log/ceph/ceph-client.admin.115890.log 2024-09-12T00:33:50.782 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:33:50.782 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:33:50.782 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:33:50.228+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.782 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:33:50.228+0000 7ff91ef21800 1 librados: starting msgr at 2024-09-12T00:33:50.783 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:33:50.228+0000 7ff91ef21800 1 librados: starting objecter 2024-09-12T00:33:50.783 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:33:50.228+0000 7ff91ef21800 5 asok(0x56551075d630) register_command objecter_requests hook 0x5655109873c0 2024-09-12T00:33:50.783 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:33:50.229+0000 7ff91ef21800 1 librados: setting wanted keys 2024-09-12T00:33:50.783 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:33:50.229+0000 7ff91ef21800 1 librados: calling monclient init 2024-09-12T00:33:50.783 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient: init 2024-09-12T00:33:50.783 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding auth protocol: cephx 2024-09-12T00:33:50.783 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding auth protocol: cephx 2024-09-12T00:33:50.783 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding auth protocol: cephx 2024-09-12T00:33:50.783 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: secure 2024-09-12T00:33:50.783 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: crc 2024-09-12T00:33:50.783 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: secure 2024-09-12T00:33:50.783 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: crc 2024-09-12T00:33:50.783 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: secure 2024-09-12T00:33:50.784 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: crc 2024-09-12T00:33:50.784 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: crc 2024-09-12T00:33:50.784 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: secure 2024-09-12T00:33:50.784 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: crc 2024-09-12T00:33:50.784 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: secure 2024-09-12T00:33:50.784 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: crc 2024-09-12T00:33:50.784 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 AuthRegistry(0x56551097ffd0) adding con mode: secure 2024-09-12T00:33:50.784 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:33:50.229+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.784 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:33:50.229+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.784 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:33:50.229+0000 7ff91ef21800 5 asok(0x56551075d630) register_command rotate-key hook 0x565510980118 2024-09-12T00:33:50.784 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:50.784 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:33:50.784 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-b con 0x565510834e40 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:50.785 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-a con 0x5655108c5e10 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:50.785 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-c con 0x5655108cf510 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:50.785 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.785 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.785 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.785 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:50.785 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:33:50.229+0000 7ff91ef21800 10 monclient(hunting): authenticate will time out at 2038.801588s 2024-09-12T00:33:50.785 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): get_auth_request con 0x5655108c5e10 auth_method 0 2024-09-12T00:33:50.785 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.785 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.785 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.785 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:33:50.229+0000 7ff91b357640 10 monclient(hunting): get_auth_request con 0x5655108cf510 auth_method 0 2024-09-12T00:33:50.785 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:33:50.229+0000 7ff91b357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.785 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:33:50.229+0000 7ff91b357640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.785 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:33:50.229+0000 7ff91b357640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.786 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.786 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.786 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.786 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:33:50.229+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.786 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:33:50.229+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.786 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:33:50.229+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.786 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:33:50.229+0000 7ff91ab56640 10 monclient(hunting): get_auth_request con 0x565510834e40 auth_method 0 2024-09-12T00:33:50.786 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:33:50.229+0000 7ff91ab56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.786 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:33:50.229+0000 7ff91ab56640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.786 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:33:50.229+0000 7ff91ab56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.786 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:33:50.229+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.786 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:33:50.229+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.786 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:33:50.229+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.786 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient(hunting): handle_auth_done global_id 7188 payload 824 2024-09-12T00:33:50.786 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient: _finish_hunting 0 2024-09-12T00:33:50.787 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:33:50.229+0000 7ff912355640 1 monclient: found mon.noname-a 2024-09-12T00:33:50.787 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:33:50.229+0000 7ff912355640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:33:50.787 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.787 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:33:50.787 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: dump: 2024-09-12T00:33:50.787 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.787 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.787 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.787 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.787 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.787 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.787 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.787 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.787 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.788 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.788 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: _finish_auth 0 2024-09-12T00:33:50.788 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: _check_auth_tickets 2024-09-12T00:33:50.788 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:50.788 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.788 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:33:50.788 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:33:50.230+0000 7ff807606640 10 monclient: dump: 2024-09-12T00:33:50.788 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.788 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.788 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.788 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.788 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.788 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.788 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.789 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.789 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.789 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.789 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:33:50.230+0000 7ff91ef21800 5 monclient: authenticate success, global_id 7188 2024-09-12T00:33:50.789 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:33:50.230+0000 7ff91ef21800 10 monclient: _renew_subs 2024-09-12T00:33:50.789 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:33:50.230+0000 7ff91ef21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:33:50.789 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:33:50.230+0000 7ff808e09640 4 set_mon_vals no callback set 2024-09-12T00:33:50.789 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:33:50.230+0000 7ff91ef21800 10 monclient: _renew_subs 2024-09-12T00:33:50.789 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:33:50.230+0000 7ff91ef21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:33:50.789 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:33:50.230+0000 7ff91ef21800 1 librados: init done 2024-09-12T00:33:50.789 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:33:50.232+0000 7ff807606640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:33:50.789 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:33:50.232+0000 7ff807606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:50.789 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:33:50.232+0000 7ff807606640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:50.789 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:33:50.232+0000 7ff91ab56640 10 monclient: get_auth_request con 0x7ff800076470 auth_method 0 2024-09-12T00:33:50.789 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:33:50.232+0000 7ff91b357640 10 monclient: get_auth_request con 0x5655109c8d10 auth_method 0 2024-09-12T00:33:50.790 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:33:50.233+0000 7ff91ab56640 10 monclient: get_auth_request con 0x5655109cbef0 auth_method 0 2024-09-12T00:33:50.790 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:33:50.234+0000 7ff912355640 10 monclient: get_auth_request con 0x5655109d0250 auth_method 0 2024-09-12T00:33:50.790 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:33:50.234+0000 7ff91b357640 10 monclient: get_auth_request con 0x5655109cf7b0 auth_method 0 2024-09-12T00:33:50.790 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:33:50.235+0000 7ff91ef21800 10 monclient: build_initial_monmap 2024-09-12T00:33:50.790 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:33:50.235+0000 7ff91ef21800 1 build_initial for_mkfs: 0 2024-09-12T00:33:50.790 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:33:50.235+0000 7ff91ef21800 10 monclient: monmap: 2024-09-12T00:33:50.790 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:33:50.790 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:50.790 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:33:50.790 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:33:50.790 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:50.790 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.790 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:33:50.790 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:33:50.791 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:33:50.791 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.791 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding auth protocol: cephx 2024-09-12T00:33:50.791 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding auth protocol: cephx 2024-09-12T00:33:50.791 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding auth protocol: cephx 2024-09-12T00:33:50.791 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: secure 2024-09-12T00:33:50.791 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: crc 2024-09-12T00:33:50.791 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: secure 2024-09-12T00:33:50.791 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: crc 2024-09-12T00:33:50.791 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: secure 2024-09-12T00:33:50.791 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: crc 2024-09-12T00:33:50.791 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: crc 2024-09-12T00:33:50.791 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: secure 2024-09-12T00:33:50.791 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: crc 2024-09-12T00:33:50.791 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: secure 2024-09-12T00:33:50.792 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: crc 2024-09-12T00:33:50.792 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 AuthRegistry(0x5655109d83b0) adding con mode: secure 2024-09-12T00:33:50.792 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:33:50.235+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.792 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:33:50.235+0000 7ff91ef21800 5 asok(0x56551075d630) register_command objecter_requests cmddesc objecter_requests hook 0x5655109db880 EEXIST 2024-09-12T00:33:50.792 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient: init 2024-09-12T00:33:50.792 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding auth protocol: cephx 2024-09-12T00:33:50.792 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding auth protocol: cephx 2024-09-12T00:33:50.792 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding auth protocol: cephx 2024-09-12T00:33:50.792 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: secure 2024-09-12T00:33:50.792 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: crc 2024-09-12T00:33:50.792 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: secure 2024-09-12T00:33:50.792 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: crc 2024-09-12T00:33:50.793 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: secure 2024-09-12T00:33:50.793 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: crc 2024-09-12T00:33:50.793 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: crc 2024-09-12T00:33:50.793 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: secure 2024-09-12T00:33:50.793 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: crc 2024-09-12T00:33:50.793 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: secure 2024-09-12T00:33:50.793 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: crc 2024-09-12T00:33:50.793 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 AuthRegistry(0x5655109d72a8) adding con mode: secure 2024-09-12T00:33:50.793 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:33:50.236+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.793 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:33:50.236+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.793 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:33:50.236+0000 7ff91ef21800 5 asok(0x56551075d630) register_command rotate-key cmddesc rotate-key hook 0x5655109d73f0 EEXIST 2024-09-12T00:33:50.793 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:50.793 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:33:50.794 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-c con 0x5655109ffba0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:50.794 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-b con 0x5655109fff80 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:50.794 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-a con 0x5655109fe8b0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:50.794 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.794 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.794 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.794 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:50.794 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:33:50.236+0000 7ff91ef21800 10 monclient(hunting): authenticate will time out at 2038.808584s 2024-09-12T00:33:50.794 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): get_auth_request con 0x5655109ffba0 auth_method 0 2024-09-12T00:33:50.794 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.794 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.794 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.794 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:33:50.236+0000 7ff91ab56640 10 monclient(hunting): get_auth_request con 0x5655109fe8b0 auth_method 0 2024-09-12T00:33:50.795 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:33:50.236+0000 7ff91ab56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.795 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:33:50.236+0000 7ff91ab56640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.795 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:33:50.236+0000 7ff91ab56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.795 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:33:50.236+0000 7ff91b357640 10 monclient(hunting): get_auth_request con 0x5655109fff80 auth_method 0 2024-09-12T00:33:50.795 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:33:50.236+0000 7ff91b357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.795 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:33:50.236+0000 7ff91b357640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.795 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:33:50.236+0000 7ff91b357640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.795 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.795 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.795 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.795 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:33:50.236+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.795 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:33:50.236+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.796 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:33:50.236+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.796 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:33:50.236+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.796 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:33:50.236+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.796 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:33:50.236+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.796 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient(hunting): handle_auth_done global_id 6773 payload 824 2024-09-12T00:33:50.796 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient: _finish_hunting 0 2024-09-12T00:33:50.796 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:33:50.236+0000 7ff912355640 1 monclient: found mon.noname-c 2024-09-12T00:33:50.796 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:33:50.236+0000 7ff912355640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:33:50.796 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.796 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:50.796 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: dump: 2024-09-12T00:33:50.796 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.796 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.796 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.797 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.797 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.797 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.797 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.797 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.797 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.797 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.797 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: _finish_auth 0 2024-09-12T00:33:50.797 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: _check_auth_tickets 2024-09-12T00:33:50.797 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:50.797 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.797 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:50.797 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:33:50.237+0000 7ff804e01640 10 monclient: dump: 2024-09-12T00:33:50.797 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.798 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.798 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.798 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.798 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.798 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.798 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.798 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.798 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.798 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.798 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:33:50.237+0000 7ff91ef21800 5 monclient: authenticate success, global_id 6773 2024-09-12T00:33:50.798 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:33:50.237+0000 7ff91ef21800 10 monclient: _renew_subs 2024-09-12T00:33:50.798 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:33:50.237+0000 7ff91ef21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:50.798 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:33:50.237+0000 7ff91bb58640 4 set_mon_vals no callback set 2024-09-12T00:33:50.798 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:33:50.237+0000 7ff91ef21800 10 monclient: _renew_subs 2024-09-12T00:33:50.799 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:33:50.237+0000 7ff91ef21800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:33:50.799 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:33:50.238+0000 7ff804e01640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:33:50.799 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:33:50.238+0000 7ff804e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:50.799 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:33:50.238+0000 7ff804e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:50.799 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:33:50.239+0000 7ff91b357640 10 monclient: get_auth_request con 0x7ff7f4076380 auth_method 0 2024-09-12T00:33:50.799 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:33:50.239+0000 7ff91ef21800 10 monclient: get_monmap_and_config 2024-09-12T00:33:50.799 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:33:50.239+0000 7ff91ef21800 10 monclient: build_initial_monmap 2024-09-12T00:33:50.799 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:33:50.239+0000 7ff91ef21800 1 build_initial for_mkfs: 0 2024-09-12T00:33:50.799 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:33:50.239+0000 7ff91ef21800 10 monclient: monmap: 2024-09-12T00:33:50.799 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:33:50.799 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:50.800 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:33:50.800 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:33:50.800 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:50.800 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.800 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:33:50.800 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:33:50.800 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:33:50.800 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.800 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding auth protocol: cephx 2024-09-12T00:33:50.800 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding auth protocol: cephx 2024-09-12T00:33:50.800 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding auth protocol: cephx 2024-09-12T00:33:50.800 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: secure 2024-09-12T00:33:50.800 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: crc 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: secure 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: crc 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: secure 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: crc 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: crc 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: secure 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: crc 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: secure 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: crc 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x565510a1faa0) adding con mode: secure 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:33:50.239+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:33:50.239+0000 7ff91ef21800 10 monclient: init 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding auth protocol: cephx 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding auth protocol: cephx 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding auth protocol: cephx 2024-09-12T00:33:50.802 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: secure 2024-09-12T00:33:50.802 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: crc 2024-09-12T00:33:50.802 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: secure 2024-09-12T00:33:50.802 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: crc 2024-09-12T00:33:50.802 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: secure 2024-09-12T00:33:50.802 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: crc 2024-09-12T00:33:50.802 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: crc 2024-09-12T00:33:50.802 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: secure 2024-09-12T00:33:50.802 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: crc 2024-09-12T00:33:50.802 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: secure 2024-09-12T00:33:50.802 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: crc 2024-09-12T00:33:50.802 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:33:50.239+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a190) adding con mode: secure 2024-09-12T00:33:50.802 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:33:50.239+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:33:50.240+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:33:50.240+0000 7ff91ef21800 5 asok(0x56551075d630) register_command rotate-key cmddesc rotate-key hook 0x7fff7e37a2d8 EEXIST 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-b con 0x565510a54120 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-c con 0x565510a23f30 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-a con 0x565510a4f4e0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient(hunting): authenticate will time out at 2038.812303s 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): get_auth_request con 0x565510a4f4e0 auth_method 0 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.804 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.804 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:33:50.240+0000 7ff91b357640 10 monclient(hunting): get_auth_request con 0x565510a23f30 auth_method 0 2024-09-12T00:33:50.804 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:33:50.240+0000 7ff91b357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.804 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:33:50.240+0000 7ff91b357640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.804 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:33:50.240+0000 7ff91b357640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.804 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:33:50.240+0000 7ff912355640 10 monclient(hunting): get_auth_request con 0x565510a54120 auth_method 0 2024-09-12T00:33:50.804 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:33:50.240+0000 7ff912355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.804 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:33:50.240+0000 7ff912355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.804 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:33:50.240+0000 7ff912355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.804 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.804 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.804 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.804 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:33:50.240+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.805 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:33:50.240+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.805 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:33:50.240+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.805 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:33:50.240+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.805 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:33:50.240+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.805 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:33:50.240+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.805 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient(hunting): handle_auth_done global_id 7194 payload 274 2024-09-12T00:33:50.805 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient: _finish_hunting 0 2024-09-12T00:33:50.805 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:33:50.240+0000 7ff91ab56640 1 monclient: found mon.noname-a 2024-09-12T00:33:50.805 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:33:50.240+0000 7ff91ab56640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:33:50.805 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.805 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:33:50.805 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: dump: 2024-09-12T00:33:50.805 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.805 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.806 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.806 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.806 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.806 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.806 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.806 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.806 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.806 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.806 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: _finish_auth 0 2024-09-12T00:33:50.806 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:33:50.806 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:50.806 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.806 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:33:50.806 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:33:50.240+0000 7ff7fe7fc640 10 monclient: dump: 2024-09-12T00:33:50.807 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.807 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.807 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.807 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.807 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.807 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.807 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.807 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.807 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.807 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.807 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:33:50.240+0000 7ff91ef21800 5 monclient: authenticate success, global_id 7194 2024-09-12T00:33:50.807 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:33:50.240+0000 7ff91ef21800 10 monclient: get_monmap_and_config success 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:33:50.240+0000 7ff91ef21800 4 set_mon_vals no callback set 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:33:50.241+0000 7ff91ef21800 10 monclient: shutdown 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:33:50.241+0000 7ff91ef21800 10 monclient: build_initial_monmap 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:33:50.241+0000 7ff91ef21800 1 build_initial for_mkfs: 0 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:33:50.241+0000 7ff91ef21800 10 monclient: monmap: 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding auth protocol: cephx 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding auth protocol: cephx 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding auth protocol: cephx 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: secure 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: crc 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: secure 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: crc 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: secure 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: crc 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: crc 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: secure 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: crc 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: secure 2024-09-12T00:33:50.810 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: crc 2024-09-12T00:33:50.810 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 AuthRegistry(0x565510a4f990) adding con mode: secure 2024-09-12T00:33:50.810 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:33:50.241+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.810 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:33:50.241+0000 7ff91ef21800 1 librados: starting msgr at 2024-09-12T00:33:50.810 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:33:50.241+0000 7ff91ef21800 1 librados: starting objecter 2024-09-12T00:33:50.810 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:33:50.241+0000 7ff91ef21800 5 asok(0x56551075d630) register_command objecter_requests cmddesc objecter_requests hook 0x565510a512e0 EEXIST 2024-09-12T00:33:50.810 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:33:50.242+0000 7ff91ef21800 1 librados: setting wanted keys 2024-09-12T00:33:50.810 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:33:50.242+0000 7ff91ef21800 1 librados: calling monclient init 2024-09-12T00:33:50.810 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient: init 2024-09-12T00:33:50.810 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding auth protocol: cephx 2024-09-12T00:33:50.810 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding auth protocol: cephx 2024-09-12T00:33:50.810 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding auth protocol: cephx 2024-09-12T00:33:50.810 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: secure 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: crc 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: secure 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: crc 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: secure 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: crc 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: crc 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: secure 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: crc 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: secure 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: crc 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 AuthRegistry(0x565510a14460) adding con mode: secure 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:33:50.242+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:33:50.242+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:33:50.242+0000 7ff91ef21800 5 asok(0x56551075d630) register_command rotate-key cmddesc rotate-key hook 0x565510a145a8 EEXIST 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient: _reopen_session rank -1 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-b con 0x565510a23f30 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-a con 0x565510a4f4e0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): picked mon.noname-c con 0x565510a54120 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): _renew_subs 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:33:50.242+0000 7ff91ef21800 10 monclient(hunting): authenticate will time out at 2038.814541s 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): get_auth_request con 0x565510a4f4e0 auth_method 0 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:33:50.242+0000 7ff91ab56640 10 monclient(hunting): get_auth_request con 0x565510a54120 auth_method 0 2024-09-12T00:33:50.813 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:33:50.242+0000 7ff91ab56640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.813 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:33:50.242+0000 7ff91ab56640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.813 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:33:50.242+0000 7ff91ab56640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.813 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:33:50.242+0000 7ff912355640 10 monclient(hunting): get_auth_request con 0x565510a23f30 auth_method 0 2024-09-12T00:33:50.813 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:33:50.242+0000 7ff912355640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:50.813 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:33:50.242+0000 7ff912355640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:50.813 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:33:50.242+0000 7ff912355640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:50.813 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.813 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.813 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.813 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:33:50.242+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.813 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:33:50.242+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.813 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:33:50.242+0000 7ff91ab56640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.814 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:33:50.242+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:50.814 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:33:50.242+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:50.814 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:33:50.242+0000 7ff912355640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:50.814 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient(hunting): handle_auth_done global_id 7197 payload 824 2024-09-12T00:33:50.814 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient: _finish_hunting 0 2024-09-12T00:33:50.814 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:33:50.242+0000 7ff91b357640 1 monclient: found mon.noname-a 2024-09-12T00:33:50.814 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:33:50.242+0000 7ff91b357640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:33:50.814 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.814 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:33:50.814 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: dump: 2024-09-12T00:33:50.814 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.814 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.814 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.814 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.814 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.815 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.815 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.815 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.815 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.815 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.815 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: _finish_auth 0 2024-09-12T00:33:50.815 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: _check_auth_tickets 2024-09-12T00:33:50.815 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:50.815 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:50.815 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:33:50.815 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:33:50.243+0000 7ff7fcff9640 10 monclient: dump: 2024-09-12T00:33:50.815 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:33:50.815 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:33:50.815 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.816 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:33:50.816 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:50.816 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:33:50.816 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:33:50.816 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:33:50.816 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:33:50.816 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.816 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:33:50.243+0000 7ff91ef21800 5 monclient: authenticate success, global_id 7197 2024-09-12T00:33:50.816 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:33:50.243+0000 7ff91ef21800 10 monclient: _renew_subs 2024-09-12T00:33:50.816 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:33:50.243+0000 7ff91ef21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:33:50.816 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:33:50.243+0000 7ff7fe7fc640 4 set_mon_vals no callback set 2024-09-12T00:33:50.816 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:33:50.243+0000 7ff91ef21800 10 monclient: _renew_subs 2024-09-12T00:33:50.816 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:33:50.243+0000 7ff91ef21800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:33:50.817 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:33:50.243+0000 7ff91ef21800 1 librados: init done 2024-09-12T00:33:50.817 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:33:50.243+0000 7ff91ef21800 5 asok(0x56551075d630) register_command cr dump hook 0x7ff90c010518 2024-09-12T00:33:50.817 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:33:50.244+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.817 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:33:50.245+0000 7ff7fcff9640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:33:50.817 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:33:50.245+0000 7ff7fcff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:50.817 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:33:50.245+0000 7ff7fcff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:33:50.817 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:33:50.245+0000 7ff912355640 10 monclient: get_auth_request con 0x7ff7e4076470 auth_method 0 2024-09-12T00:33:50.817 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:33:50.245+0000 7ff91ab56640 10 monclient: get_auth_request con 0x565510a6ebc0 auth_method 0 2024-09-12T00:33:50.817 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.817 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:33:50.246+0000 7ff91ef21800 20 realm 2024-09-12T00:33:50.817 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.817 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.817 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:33:50.246+0000 7ff91ef21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:50.818 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.818 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.818 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:33:50.246+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.818 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:33:50.246+0000 7ff912355640 10 monclient: get_auth_request con 0x565510a72e10 auth_method 0 2024-09-12T00:33:50.818 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:33:50.247+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:50.818 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:33:50.247+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.818 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:33:50.247+0000 7ff91b357640 10 monclient: get_auth_request con 0x565510a76670 auth_method 0 2024-09-12T00:33:50.818 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:33:50.248+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:50.818 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:33:50.248+0000 7ff91ef21800 20 searching for the correct realm 2024-09-12T00:33:50.818 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:33:50.248+0000 7ff91ab56640 10 monclient: get_auth_request con 0x7ff91404e2b0 auth_method 0 2024-09-12T00:33:50.818 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:33:50.249+0000 7ff912355640 10 monclient: get_auth_request con 0x7ff904018070 auth_method 0 2024-09-12T00:33:50.818 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:33:50.249+0000 7ff912355640 0 -- 172.21.15.133:0/334284661 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff904018070 msgr2=0x7ff90408b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:50.818 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:33:50.450+0000 7ff912355640 10 monclient: get_auth_request con 0x7ff904018070 auth_method 0 2024-09-12T00:33:50.818 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:33:50.451+0000 7ff91b357640 10 monclient: get_auth_request con 0x7ff9140b91b0 auth_method 0 2024-09-12T00:33:50.819 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:33:50.453+0000 7ff91ab56640 10 monclient: get_auth_request con 0x7ff90406d1c0 auth_method 0 2024-09-12T00:33:50.819 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:33:50.454+0000 7ff912355640 0 -- 172.21.15.133:0/334284661 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff90c0423f0 msgr2=0x7ff90c042870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:50.819 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:33:50.655+0000 7ff912355640 10 monclient: get_auth_request con 0x7ff90c0423f0 auth_method 0 2024-09-12T00:33:50.819 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:50.819 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:50.819 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:50.819 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:50.819 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:50.819 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:50.819 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.819 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.819 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:33:50.661+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.820 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:50.820 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.820 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:50.820 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 zone default found 2024-09-12T00:33:50.820 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:33:50.662+0000 7ff91ef21800 4 Realm: () 2024-09-12T00:33:50.820 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:33:50.662+0000 7ff91ef21800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:50.820 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:33:50.662+0000 7ff91ef21800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:50.820 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:33:50.662+0000 7ff91ef21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:50.820 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 zonegroup default 2024-09-12T00:33:50.820 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.820 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.820 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:33:50.662+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.820 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:33:50.663+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.821 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:33:50.663+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.821 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:33:50.663+0000 7ff91ef21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.821 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:33:50.663+0000 7ff91ef21800 20 started sync module instance, tier type = 2024-09-12T00:33:50.821 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:33:50.663+0000 7ff91ef21800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:50.821 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=0 2024-09-12T00:33:50.821 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=1 2024-09-12T00:33:50.821 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=2 2024-09-12T00:33:50.821 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=3 2024-09-12T00:33:50.821 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=4 2024-09-12T00:33:50.821 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=5 2024-09-12T00:33:50.821 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:33:50.673+0000 7ff91ef21800 20 add_watcher() i=6 2024-09-12T00:33:50.821 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:33:50.674+0000 7ff91ef21800 20 add_watcher() i=7 2024-09-12T00:33:50.821 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:33:50.674+0000 7ff91ef21800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:50.821 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding auth protocol: cephx 2024-09-12T00:33:50.821 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding auth protocol: cephx 2024-09-12T00:33:50.822 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding auth protocol: cephx 2024-09-12T00:33:50.822 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: secure 2024-09-12T00:33:50.822 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: crc 2024-09-12T00:33:50.822 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: secure 2024-09-12T00:33:50.822 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: crc 2024-09-12T00:33:50.822 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: secure 2024-09-12T00:33:50.822 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: crc 2024-09-12T00:33:50.822 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: crc 2024-09-12T00:33:50.822 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: secure 2024-09-12T00:33:50.822 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: crc 2024-09-12T00:33:50.822 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: secure 2024-09-12T00:33:50.822 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: crc 2024-09-12T00:33:50.822 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 AuthRegistry(0x7fff7e37a670) adding con mode: secure 2024-09-12T00:33:50.822 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:33:50.676+0000 7ff7d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:50.823 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:33:50.676+0000 7ff91ef21800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:50.823 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:33:50.676+0000 7ff91ef21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:50.823 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:33:50.676+0000 7ff91ef21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:50.823 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command cache list hook 0x565510a49bc0 2024-09-12T00:33:50.823 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command cache inspect hook 0x565510a49bc0 2024-09-12T00:33:50.823 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command cache erase hook 0x565510a49bc0 2024-09-12T00:33:50.823 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command cache zap hook 0x565510a49bc0 2024-09-12T00:33:50.823 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 note: GC not initialized 2024-09-12T00:33:50.823 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:33:50.676+0000 7ff74bfff640 20 reqs_thread_entry: start 2024-09-12T00:33:50.823 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command sync trace show hook 0x7ff90c002d60 2024-09-12T00:33:50.823 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command sync trace history hook 0x7ff90c002d60 2024-09-12T00:33:50.823 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command sync trace active hook 0x7ff90c002d60 2024-09-12T00:33:50.823 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:33:50.676+0000 7ff91ef21800 5 asok(0x56551075d630) register_command sync trace active_short hook 0x7ff90c002d60 2024-09-12T00:33:50.823 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:33:50.676+0000 7ff91ef21800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:50.824 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:33:50.676+0000 7ff91ef21800 20 Filter name: none 2024-09-12T00:33:50.824 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:33:50.677+0000 7ff749ffb640 20 reqs_thread_entry: start 2024-09-12T00:33:50.824 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:33:50.677+0000 7ff91ef21800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:33:50.824 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:33:50.677+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.824 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:33:50.677+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:50.824 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:33:50.677+0000 7ff91ef21800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:33:50.824 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:33:50.677+0000 7ff91ef21800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:33:50.824 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:33:50.677+0000 7ff91ef21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 : miss 2024-09-12T00:33:50.824 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:33:50.677+0000 7ff91ef21800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.824 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:33:50.678+0000 7ff91ef21800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:33:50.824 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:33:50.678+0000 7ff91ef21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:50.824 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:33:50.678+0000 7ff91ef21800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:50.824 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:33:50.678+0000 7ff91ef21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:50.824 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:33:50.678+0000 7ff91ef21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:50.825 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:33:50.678+0000 7ff91ef21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 2024-09-12T00:33:50.825 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:33:50.682+0000 7ff91ef21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:50.825 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:33:50.682+0000 7ff91ef21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:50.825 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:33:50.682+0000 7ff91ef21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:50.825 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:33:50.682+0000 7ff91ef21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30, ofs0, ns] 2024-09-12T00:33:50.825 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:33:50.682+0000 7ff7fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94923351648224 notifier 7197 bl.length()=999 2024-09-12T00:33:50.825 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:33:50.682+0000 7ff7fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:50.825 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:33:50.682+0000 7ff7fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:50.825 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:33:50.682+0000 7ff7fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:50.825 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:33:50.684+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_sources= new_sources= 2024-09-12T00:33:50.825 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:33:50.684+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential sources added=[] removed=[] 2024-09-12T00:33:50.825 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:33:50.684+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_dests= new_dests= 2024-09-12T00:33:50.825 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:33:50.684+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential dests added=[] removed=[] 2024-09-12T00:33:50.825 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:33:50.686+0000 7ff91ef21800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.1.0 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:33:50.686+0000 7ff91ef21800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.1.0 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:33:50.686+0000 7ff91ef21800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.1.1 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:33:50.686+0000 7ff91ef21800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.1.1 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:33:50.686+0000 7ff91ef21800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.0 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:33:50.688+0000 7ff91ef21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:33:50.688+0000 7ff91ef21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:33:50.689+0000 7ff91ef21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:33:50.689+0000 7ff91ef21800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:33:50.689+0000 7ff91ef21800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:33:50.689+0000 7ff91ef21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30, ofs0, ns] 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:33:50.690+0000 7ff7fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94923351648224 notifier 7197 bl.length()=999 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:33:50.690+0000 7ff7fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:33:50.690+0000 7ff7fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:33:50.690+0000 7ff7fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:33:50.691+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_sources= new_sources= 2024-09-12T00:33:50.827 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:33:50.691+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential sources added=[] removed=[] 2024-09-12T00:33:50.827 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:33:50.691+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_dests= new_dests= 2024-09-12T00:33:50.827 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:33:50.691+0000 7ff91ef21800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential dests added=[] removed=[] 2024-09-12T00:33:50.827 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:33:50.692+0000 7ff91ef21800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff91ef21800 time 2024-09-12T00:33:50.692569+0000 2024-09-12T00:33:50.827 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:50.827 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.827 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:50.827 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff92058c71a] 2024-09-12T00:33:50.827 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff92058c8d8] 2024-09-12T00:33:50.827 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56550eb52641] 2024-09-12T00:33:50.827 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x56550eb61582] 2024-09-12T00:33:50.827 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56550eb623e4] 2024-09-12T00:33:50.827 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:33:50.828 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff91f229590] 2024-09-12T00:33:50.828 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:33:50.828 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:33:50.828 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.828 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:33:50.693+0000 7ff91ef21800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:33:50.828 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7ff91ef21800 thread_name:radosgw-admin 2024-09-12T00:33:50.828 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.828 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:50.828 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff91f23e6f0] 2024-09-12T00:33:50.828 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff91f28b99c] 2024-09-12T00:33:50.828 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:33:50.828 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:33:50.828 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff92058c774] 2024-09-12T00:33:50.829 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff92058c8d8] 2024-09-12T00:33:50.829 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56550eb52641] 2024-09-12T00:33:50.829 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x56550eb61582] 2024-09-12T00:33:50.829 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x56550eb623e4] 2024-09-12T00:33:50.829 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:33:50.829 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff91f229590] 2024-09-12T00:33:50.829 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:33:50.829 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:33:50.829 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:33:50.829 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:50.829 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:33:50.829 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:33:50.829 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:33:50.830 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:33:50.830 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:33:50.830 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:33:50.830 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:33:50.830 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:33:50.830 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:33:50.830 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:33:50.830 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:33:50.830 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:33:50.830 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:33:50.830 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:33:50.830 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:33:50.830 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:33:50.830 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:33:50.831 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:33:50.831 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:33:50.831 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:33:50.831 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:33:50.831 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:33:50.831 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:33:50.831 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:33:50.831 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:33:50.831 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:33:50.831 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:33:50.831 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:33:50.831 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:33:50.831 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:33:50.832 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:33:50.832 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:33:50.832 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:33:50.832 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:33:50.832 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:33:50.832 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:33:50.832 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:33:50.832 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:33:50.832 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:33:50.832 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:33:50.832 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:33:50.832 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:33:50.832 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:33:50.832 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:33:50.833 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:33:50.833 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:33:50.833 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:33:50.833 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:33:50.833 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:33:50.833 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:33:50.833 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:33:50.833 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:33:50.833 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:33:50.833 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:33:50.833 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:33:50.833 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:33:50.833 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:33:50.833 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:33:50.834 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:33:50.834 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:33:50.834 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:33:50.834 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:33:50.834 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:33:50.834 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:33:50.834 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:33:50.834 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:33:50.834 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:33:50.834 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:33:50.834 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:33:50.834 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:33:50.834 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:33:50.834 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:33:50.835 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:33:50.835 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:33:50.835 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:33:50.835 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:33:50.835 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:33:50.835 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:33:50.835 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:33:50.835 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:33:50.835 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:33:50.835 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:33:50.835 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:33:50.835 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:33:50.835 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:33:50.835 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:33:50.836 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:33:50.836 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:33:50.836 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:33:50.836 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:33:50.836 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:33:50.836 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:33:50.836 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:33:50.836 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:33:50.836 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff749ffb640 / http_manager 2024-09-12T00:33:50.836 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff74bfff640 / http_manager 2024-09-12T00:33:50.836 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff7d17e2640 / rgw_dt_lg_renew 2024-09-12T00:33:50.836 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff7fcff9640 / ms_dispatch 2024-09-12T00:33:50.836 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff7fe7fc640 / io_context_pool 2024-09-12T00:33:50.837 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff804e01640 / ms_dispatch 2024-09-12T00:33:50.837 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff807606640 / ms_dispatch 2024-09-12T00:33:50.837 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff808e09640 / io_context_pool 2024-09-12T00:33:50.837 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff912355640 / msgr-worker-2 2024-09-12T00:33:50.837 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff91ab56640 / msgr-worker-1 2024-09-12T00:33:50.837 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff91b357640 / msgr-worker-0 2024-09-12T00:33:50.837 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff91bb58640 / io_context_pool 2024-09-12T00:33:50.837 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff91ef21800 / radosgw-admin 2024-09-12T00:33:50.837 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:33:50.837 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:33:50.837 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:33:50.694211Z_90841daf-0702-4bef-a8fa-3e883713c7cf/log 2024-09-12T00:33:50.837 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:33:50.837 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:33:50.839 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:50.839 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:50.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.769+0000 7fe3db6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.771+0000 7fe3db6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.771+0000 7fe3db6bb800 20 realm 2024-09-12T00:33:50.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.771+0000 7fe3db6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.771+0000 7fe3db6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.771+0000 7fe3db6bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:50.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.771+0000 7fe3db6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.772+0000 7fe3db6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.772+0000 7fe3db6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.772+0000 7fe3db6bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:50.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.772+0000 7fe3db6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.773+0000 7fe3db6bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:50.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.773+0000 7fe3db6bb800 20 searching for the correct realm 2024-09-12T00:33:50.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.775+0000 7fe3d89a4640 0 -- 172.21.15.133:0/3231679540 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fe3c4017070 msgr2=0x7fe3c4076460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:50.841 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.779+0000 7fe3d89a4640 0 -- 172.21.15.133:0/3231679540 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fe3cc07f040 msgr2=0x7fe3cc055410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:50.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.986+0000 7fe3db6bb800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:50.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.986+0000 7fe3db6bb800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:50.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.986+0000 7fe3db6bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:50.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.986+0000 7fe3db6bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:50.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.986+0000 7fe3db6bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:50.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.986+0000 7fe3db6bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:50.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.986+0000 7fe3db6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.986+0000 7fe3db6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.986+0000 7fe3db6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.986+0000 7fe3db6bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:50.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.986+0000 7fe3db6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.987 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.987+0000 7fe3db6bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:50.987 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.987+0000 7fe3db6bb800 20 zone default found 2024-09-12T00:33:50.987 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.987+0000 7fe3db6bb800 4 Realm: () 2024-09-12T00:33:50.987 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.987+0000 7fe3db6bb800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:50.987 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.987+0000 7fe3db6bb800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:50.988 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.987+0000 7fe3db6bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:50.988 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.987+0000 7fe3db6bb800 20 zonegroup default 2024-09-12T00:33:50.988 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.987+0000 7fe3db6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.988 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.987+0000 7fe3db6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.987+0000 7fe3db6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.988+0000 7fe3db6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.988+0000 7fe3db6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.988+0000 7fe3db6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.988+0000 7fe3db6bb800 20 started sync module instance, tier type = 2024-09-12T00:33:50.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.988+0000 7fe3db6bb800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:50.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.997+0000 7fe3db6bb800 20 add_watcher() i=0 2024-09-12T00:33:50.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.997+0000 7fe3db6bb800 20 add_watcher() i=1 2024-09-12T00:33:50.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.997+0000 7fe3db6bb800 20 add_watcher() i=2 2024-09-12T00:33:50.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.997+0000 7fe3db6bb800 20 add_watcher() i=3 2024-09-12T00:33:50.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.997+0000 7fe3db6bb800 20 add_watcher() i=4 2024-09-12T00:33:50.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.997+0000 7fe3db6bb800 20 add_watcher() i=5 2024-09-12T00:33:50.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.997+0000 7fe3db6bb800 20 add_watcher() i=6 2024-09-12T00:33:50.997 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.998+0000 7fe3db6bb800 20 add_watcher() i=7 2024-09-12T00:33:50.997 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:50.998+0000 7fe3db6bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:50.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.000+0000 7fe28f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:51.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.000+0000 7fe3db6bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:51.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.000+0000 7fe3db6bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:51.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.001+0000 7fe3db6bb800 5 note: GC not initialized 2024-09-12T00:33:51.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.001+0000 7fe28e7e4640 20 reqs_thread_entry: start 2024-09-12T00:33:51.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.001+0000 7fe3db6bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:51.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.001+0000 7fe3db6bb800 20 Filter name: none 2024-09-12T00:33:51.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.001+0000 7fe1fffff640 20 reqs_thread_entry: start 2024-09-12T00:33:51.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.001+0000 7fe3db6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.001+0000 7fe3db6bb800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:51.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.001+0000 7fe3db6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.002+0000 7fe3db6bb800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:33:51.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.002+0000 7fe3db6bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:51.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.002+0000 7fe3db6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.003+0000 7fe3db6bb800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:51.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.003+0000 7fe3db6bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.003+0000 7fe3db6bb800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:33:51.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.003+0000 7fe3db6bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:51.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.004+0000 7fe28f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:51.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.006+0000 7fe3db6bb800 20 remove_watcher() i=0 2024-09-12T00:33:51.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.006+0000 7fe3db6bb800 2 removed watcher, disabling cache 2024-09-12T00:33:51.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.007+0000 7fe3db6bb800 20 remove_watcher() i=1 2024-09-12T00:33:51.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.008+0000 7fe3db6bb800 20 remove_watcher() i=2 2024-09-12T00:33:51.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.009+0000 7fe3db6bb800 20 remove_watcher() i=3 2024-09-12T00:33:51.008 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.010+0000 7fe3db6bb800 20 remove_watcher() i=4 2024-09-12T00:33:51.009 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.011+0000 7fe3db6bb800 20 remove_watcher() i=5 2024-09-12T00:33:51.010 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.012+0000 7fe3db6bb800 20 remove_watcher() i=6 2024-09-12T00:33:51.011 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.013+0000 7fe3db6bb800 20 remove_watcher() i=7 2024-09-12T00:33:51.022 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:51.022 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:33:51.022 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-block-writes id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:33:51.022 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:33:51.112 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:33:51.144 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:51.145 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:51.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.183+0000 7fa60e72c800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.185+0000 7fa60e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.185+0000 7fa60e72c800 20 realm 2024-09-12T00:33:51.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.185+0000 7fa60e72c800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.185+0000 7fa60e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.185+0000 7fa60e72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:51.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.185+0000 7fa60e72c800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.185+0000 7fa60e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.185+0000 7fa60e72c800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.186+0000 7fa60e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:51.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.186+0000 7fa60e72c800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.186+0000 7fa60e72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:51.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.187+0000 7fa60e72c800 20 searching for the correct realm 2024-09-12T00:33:51.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.188+0000 7fa603fff640 0 -- 172.21.15.133:0/2251911785 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fa5f4024070 msgr2=0x7fa5f4048010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:51.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.392+0000 7fa603fff640 0 -- 172.21.15.133:0/2251911785 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fa5fc0ac8c0 msgr2=0x7fa5fc0ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:51.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.598+0000 7fa60e72c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:33:51.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.598+0000 7fa60e72c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:33:51.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.598+0000 7fa60e72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:51.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.598+0000 7fa60e72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:51.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.598+0000 7fa60e72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:51.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.598+0000 7fa60e72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:51.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.598+0000 7fa60e72c800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.599+0000 7fa60e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.599+0000 7fa60e72c800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.599+0000 7fa60e72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:51.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.599+0000 7fa60e72c800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.599+0000 7fa60e72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:51.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.599+0000 7fa60e72c800 20 zone default found 2024-09-12T00:33:51.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.599+0000 7fa60e72c800 4 Realm: () 2024-09-12T00:33:51.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.599+0000 7fa60e72c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:33:51.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.599+0000 7fa60e72c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:33:51.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.599+0000 7fa60e72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:51.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.599+0000 7fa60e72c800 20 zonegroup default 2024-09-12T00:33:51.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.599+0000 7fa60e72c800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.600+0000 7fa60e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.600+0000 7fa60e72c800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.600+0000 7fa60e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.600+0000 7fa60e72c800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.600+0000 7fa60e72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.600+0000 7fa60e72c800 20 started sync module instance, tier type = 2024-09-12T00:33:51.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.600+0000 7fa60e72c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:33:51.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.610+0000 7fa60e72c800 20 add_watcher() i=0 2024-09-12T00:33:51.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.610+0000 7fa60e72c800 20 add_watcher() i=1 2024-09-12T00:33:51.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.610+0000 7fa60e72c800 20 add_watcher() i=2 2024-09-12T00:33:51.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.610+0000 7fa60e72c800 20 add_watcher() i=3 2024-09-12T00:33:51.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.610+0000 7fa60e72c800 20 add_watcher() i=4 2024-09-12T00:33:51.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.610+0000 7fa60e72c800 20 add_watcher() i=5 2024-09-12T00:33:51.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.610+0000 7fa60e72c800 20 add_watcher() i=6 2024-09-12T00:33:51.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.611+0000 7fa60e72c800 20 add_watcher() i=7 2024-09-12T00:33:51.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.611+0000 7fa60e72c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:51.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.614+0000 7fa4c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:51.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.614+0000 7fa60e72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:51.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.614+0000 7fa60e72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:51.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.614+0000 7fa60e72c800 5 note: GC not initialized 2024-09-12T00:33:51.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.614+0000 7fa43b7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:51.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.614+0000 7fa60e72c800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:51.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.615+0000 7fa60e72c800 20 Filter name: none 2024-09-12T00:33:51.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.615+0000 7fa4397fa640 20 reqs_thread_entry: start 2024-09-12T00:33:51.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.615+0000 7fa60e72c800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:33:51.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.615+0000 7fa60e72c800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.615+0000 7fa60e72c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:33:51.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.615+0000 7fa60e72c800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:33:51.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.615+0000 7fa60e72c800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:33:51.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.615+0000 7fa60e72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 : miss 2024-09-12T00:33:51.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.615+0000 7fa60e72c800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.616+0000 7fa60e72c800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:33:51.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.616+0000 7fa60e72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:33:51.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.616+0000 7fa60e72c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:33:51.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.616+0000 7fa60e72c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:51.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.616+0000 7fa60e72c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:33:51.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.616+0000 7fa60e72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 2024-09-12T00:33:51.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.617+0000 7fa60e72c800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to be held by another RGW process; skipping for now 2024-09-12T00:33:51.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.618+0000 7fa4c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:51.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.620+0000 7fa60e72c800 20 remove_watcher() i=0 2024-09-12T00:33:51.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.620+0000 7fa60e72c800 2 removed watcher, disabling cache 2024-09-12T00:33:51.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.621+0000 7fa60e72c800 20 remove_watcher() i=1 2024-09-12T00:33:51.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.622+0000 7fa60e72c800 20 remove_watcher() i=2 2024-09-12T00:33:51.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.623+0000 7fa60e72c800 20 remove_watcher() i=3 2024-09-12T00:33:51.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.624+0000 7fa60e72c800 20 remove_watcher() i=4 2024-09-12T00:33:51.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.625+0000 7fa60e72c800 20 remove_watcher() i=5 2024-09-12T00:33:51.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.626+0000 7fa60e72c800 20 remove_watcher() i=6 2024-09-12T00:33:51.625 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:33:51.627+0000 7fa60e72c800 20 remove_watcher() i=7 2024-09-12T00:33:51.636 INFO:tasks.workunit.client.0.smithi133.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:34:21.644 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:34:21.678 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:21.678 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:21.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.722+0000 7fe453d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:21.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.724+0000 7fe453d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:21.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.724+0000 7fe453d2e800 20 realm 2024-09-12T00:34:21.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.724+0000 7fe453d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:21.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.724+0000 7fe453d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:21.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.724+0000 7fe453d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:21.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.724+0000 7fe453d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:21.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.724+0000 7fe453d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:21.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.724+0000 7fe453d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:21.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.725+0000 7fe453d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:21.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.725+0000 7fe453d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:21.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.726+0000 7fe453d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:21.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.726+0000 7fe453d2e800 20 searching for the correct realm 2024-09-12T00:34:21.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.728+0000 7fe447fff640 0 -- 172.21.15.133:0/455250527 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fe43805fe10 msgr2=0x7fe438067b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:21.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.732+0000 7fe447fff640 0 -- 172.21.15.133:0/455250527 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fe440039040 msgr2=0x7fe440018410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:21.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.939+0000 7fe453d2e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:34:21.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.939+0000 7fe453d2e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:34:21.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.939+0000 7fe453d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:21.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.939+0000 7fe453d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:21.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.939+0000 7fe453d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:21.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.939+0000 7fe453d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:21.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.939+0000 7fe453d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:21.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.939+0000 7fe453d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.939+0000 7fe453d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:21.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.940+0000 7fe453d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:21.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.940+0000 7fe453d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:21.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.940+0000 7fe453d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:21.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.940+0000 7fe453d2e800 20 zone default found 2024-09-12T00:34:21.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.940+0000 7fe453d2e800 4 Realm: () 2024-09-12T00:34:21.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.940+0000 7fe453d2e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:34:21.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.940+0000 7fe453d2e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:34:21.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.940+0000 7fe453d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:21.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.940+0000 7fe453d2e800 20 zonegroup default 2024-09-12T00:34:21.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.940+0000 7fe453d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:21.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.940+0000 7fe453d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:21.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.940+0000 7fe453d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:21.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.941+0000 7fe453d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:21.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.941+0000 7fe453d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:21.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.941+0000 7fe453d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:21.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.941+0000 7fe453d2e800 20 started sync module instance, tier type = 2024-09-12T00:34:21.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.941+0000 7fe453d2e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:34:21.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.951+0000 7fe453d2e800 20 add_watcher() i=0 2024-09-12T00:34:21.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.951+0000 7fe453d2e800 20 add_watcher() i=1 2024-09-12T00:34:21.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.951+0000 7fe453d2e800 20 add_watcher() i=2 2024-09-12T00:34:21.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.951+0000 7fe453d2e800 20 add_watcher() i=3 2024-09-12T00:34:21.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.951+0000 7fe453d2e800 20 add_watcher() i=4 2024-09-12T00:34:21.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.951+0000 7fe453d2e800 20 add_watcher() i=5 2024-09-12T00:34:21.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.951+0000 7fe453d2e800 20 add_watcher() i=6 2024-09-12T00:34:21.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.952+0000 7fe453d2e800 20 add_watcher() i=7 2024-09-12T00:34:21.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.952+0000 7fe453d2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:21.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.954+0000 7fe305fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.955+0000 7fe453d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.955+0000 7fe453d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.955+0000 7fe453d2e800 5 note: GC not initialized 2024-09-12T00:34:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.955+0000 7fe304fe1640 20 reqs_thread_entry: start 2024-09-12T00:34:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.955+0000 7fe453d2e800 20 init_complete bucket index max shards: 1 2024-09-12T00:34:21.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.955+0000 7fe453d2e800 20 Filter name: none 2024-09-12T00:34:21.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.955+0000 7fe27e7fc640 20 reqs_thread_entry: start 2024-09-12T00:34:21.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.955+0000 7fe453d2e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:34:21.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.955+0000 7fe453d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.956+0000 7fe453d2e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:34:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.956+0000 7fe453d2e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:34:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.956+0000 7fe453d2e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:34:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.956+0000 7fe453d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 : miss 2024-09-12T00:34:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.956+0000 7fe453d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.956+0000 7fe453d2e800 20 rados_obj.operate() r=0 bl.length=467 2024-09-12T00:34:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.956+0000 7fe453d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:34:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.956+0000 7fe453d2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:34:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.956+0000 7fe453d2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.956+0000 7fe453d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:21.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.956+0000 7fe453d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 2024-09-12T00:34:21.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.958+0000 7fe453d2e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:34:21.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.962+0000 7fe453d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:34:21.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.962+0000 7fe453d2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:34:21.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.962+0000 7fe453d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:21.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.962+0000 7fe453d2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30, ofs0, ns] 2024-09-12T00:34:21.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.962+0000 7fe32e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497051 cookie 94060677443856 notifier 6827 bl.length()=999 2024-09-12T00:34:21.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.962+0000 7fe32e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:34:21.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.962+0000 7fe32e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:34:21.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.962+0000 7fe32e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:21.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.964+0000 7fe453d2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_sources= new_sources= 2024-09-12T00:34:21.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.964+0000 7fe453d2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential sources added=[] removed=[] 2024-09-12T00:34:21.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.964+0000 7fe453d2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_dests= new_dests= 2024-09-12T00:34:21.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.964+0000 7fe453d2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential dests added=[] removed=[] 2024-09-12T00:34:21.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.968+0000 7fe453d2e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.2.0 2024-09-12T00:34:21.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.968+0000 7fe453d2e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.2.0 2024-09-12T00:34:21.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.968+0000 7fe453d2e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.2.1 2024-09-12T00:34:21.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.968+0000 7fe453d2e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.2.1 2024-09-12T00:34:21.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.968+0000 7fe453d2e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.0 2024-09-12T00:34:21.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.970+0000 7fe453d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:21.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.971+0000 7fe453d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 2024-09-12T00:34:21.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.972+0000 7fe453d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:34:21.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.972+0000 7fe453d2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:34:21.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.972+0000 7fe453d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:21.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.972+0000 7fe453d2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30, ofs0, ns] 2024-09-12T00:34:21.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.972+0000 7fe32effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497052 cookie 94060677443856 notifier 6827 bl.length()=999 2024-09-12T00:34:21.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.972+0000 7fe32effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:34:21.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.972+0000 7fe32effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:34:21.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.972+0000 7fe32effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:21.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.974+0000 7fe453d2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_sources= new_sources= 2024-09-12T00:34:21.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.974+0000 7fe453d2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential sources added=[] removed=[] 2024-09-12T00:34:21.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.974+0000 7fe453d2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_dests= new_dests= 2024-09-12T00:34:21.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.974+0000 7fe453d2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential dests added=[] removed=[] 2024-09-12T00:34:21.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.975+0000 7fe453d2e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30.0 2024-09-12T00:34:21.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.975+0000 7fe453d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:21.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.975+0000 7fe453d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 2024-09-12T00:34:21.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.977+0000 7fe453d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:34:21.976 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.977+0000 7fe453d2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:34:21.976 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.977+0000 7fe453d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:21.976 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.977+0000 7fe453d2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30, ofs0, ns] 2024-09-12T00:34:21.976 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.977+0000 7fe32e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497053 cookie 94060677443856 notifier 6827 bl.length()=967 2024-09-12T00:34:21.976 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.977+0000 7fe32e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 info.flags=0x17 2024-09-12T00:34:21.976 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.977+0000 7fe32e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 to cache LRU end 2024-09-12T00:34:21.976 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.977+0000 7fe32e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:21.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.978+0000 7fe453d2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_sources= new_sources= 2024-09-12T00:34:21.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.978+0000 7fe453d2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential sources added=[] removed=[] 2024-09-12T00:34:21.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.978+0000 7fe453d2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): orig_dests= new_dests= 2024-09-12T00:34:21.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.978+0000 7fe453d2e800 20 handle_bi_update(): bucket=:abort-at-block-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30]): potential dests added=[] removed=[] 2024-09-12T00:34:21.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.979+0000 7fe453d2e800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:34:21.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.981+0000 7fe305fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:21.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.984+0000 7fe453d2e800 20 remove_watcher() i=0 2024-09-12T00:34:21.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.984+0000 7fe453d2e800 2 removed watcher, disabling cache 2024-09-12T00:34:21.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.985+0000 7fe453d2e800 20 remove_watcher() i=1 2024-09-12T00:34:21.984 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.986+0000 7fe453d2e800 20 remove_watcher() i=2 2024-09-12T00:34:21.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.987+0000 7fe453d2e800 20 remove_watcher() i=3 2024-09-12T00:34:21.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.988+0000 7fe453d2e800 20 remove_watcher() i=4 2024-09-12T00:34:21.988 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.989+0000 7fe453d2e800 20 remove_watcher() i=5 2024-09-12T00:34:21.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.990+0000 7fe453d2e800 20 remove_watcher() i=6 2024-09-12T00:34:21.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:21.991+0000 7fe453d2e800 20 remove_watcher() i=7 2024-09-12T00:34:22.003 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:34:22.032 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:22.032 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:22.069 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.070+0000 7f4b0ef3c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:22.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.072+0000 7f4b0ef3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:22.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.072+0000 7f4b0ef3c800 20 realm 2024-09-12T00:34:22.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.072+0000 7f4b0ef3c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:22.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.072+0000 7f4b0ef3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:22.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.072+0000 7f4b0ef3c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:22.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.072+0000 7f4b0ef3c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:22.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.072+0000 7f4b0ef3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:22.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.072+0000 7f4b0ef3c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:22.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.073+0000 7f4b0ef3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:22.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.073+0000 7f4b0ef3c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:22.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.074+0000 7f4b0ef3c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:22.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.074+0000 7f4b0ef3c800 20 searching for the correct realm 2024-09-12T00:34:22.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.077+0000 7f4b0b482640 0 -- 172.21.15.133:0/953465668 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f4b04099d60 msgr2=0x7f4b04082a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:22.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.282+0000 7f4b0ac81640 0 -- 172.21.15.133:0/953465668 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x558880b66390 msgr2=0x558880b687b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:22.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.286+0000 7f4b0ef3c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:34:22.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.286+0000 7f4b0ef3c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:34:22.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.286+0000 7f4b0ef3c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:22.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.286+0000 7f4b0ef3c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:22.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.286+0000 7f4b0ef3c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:22.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.286+0000 7f4b0ef3c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:22.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.286+0000 7f4b0ef3c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:22.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.286+0000 7f4b0ef3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:22.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.286+0000 7f4b0ef3c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:22.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.287+0000 7f4b0ef3c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:22.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.287+0000 7f4b0ef3c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:22.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.287+0000 7f4b0ef3c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:22.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.287+0000 7f4b0ef3c800 20 zone default found 2024-09-12T00:34:22.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.287+0000 7f4b0ef3c800 4 Realm: () 2024-09-12T00:34:22.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.287+0000 7f4b0ef3c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:34:22.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.287+0000 7f4b0ef3c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:34:22.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.287+0000 7f4b0ef3c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:22.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.287+0000 7f4b0ef3c800 20 zonegroup default 2024-09-12T00:34:22.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.287+0000 7f4b0ef3c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:22.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.287+0000 7f4b0ef3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:22.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.287+0000 7f4b0ef3c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:22.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.288+0000 7f4b0ef3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:22.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.288+0000 7f4b0ef3c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:22.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.288+0000 7f4b0ef3c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:22.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.288+0000 7f4b0ef3c800 20 started sync module instance, tier type = 2024-09-12T00:34:22.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.288+0000 7f4b0ef3c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:34:22.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.298+0000 7f4b0ef3c800 20 add_watcher() i=0 2024-09-12T00:34:22.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.298+0000 7f4b0ef3c800 20 add_watcher() i=1 2024-09-12T00:34:22.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.298+0000 7f4b0ef3c800 20 add_watcher() i=2 2024-09-12T00:34:22.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.298+0000 7f4b0ef3c800 20 add_watcher() i=3 2024-09-12T00:34:22.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.298+0000 7f4b0ef3c800 20 add_watcher() i=4 2024-09-12T00:34:22.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.298+0000 7f4b0ef3c800 20 add_watcher() i=5 2024-09-12T00:34:22.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.298+0000 7f4b0ef3c800 20 add_watcher() i=6 2024-09-12T00:34:22.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.299+0000 7f4b0ef3c800 20 add_watcher() i=7 2024-09-12T00:34:22.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.299+0000 7f4b0ef3c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:22.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.301+0000 7f49c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:22.300 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.301+0000 7f4b0ef3c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:22.300 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.301+0000 7f4b0ef3c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:22.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.301+0000 7f4b0ef3c800 5 note: GC not initialized 2024-09-12T00:34:22.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.302+0000 7f493bfff640 20 reqs_thread_entry: start 2024-09-12T00:34:22.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.302+0000 7f4b0ef3c800 20 init_complete bucket index max shards: 1 2024-09-12T00:34:22.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.302+0000 7f4b0ef3c800 20 Filter name: none 2024-09-12T00:34:22.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.302+0000 7f4939ffb640 20 reqs_thread_entry: start 2024-09-12T00:34:22.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.302+0000 7f4b0ef3c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:22.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.303+0000 7f4b0ef3c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:34:22.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.303+0000 7f4b0ef3c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:22.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.303+0000 7f4b0ef3c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:34:22.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.303+0000 7f4b0ef3c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:22.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.303+0000 7f4b0ef3c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:22.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.304+0000 7f4b0ef3c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-12T00:34:22.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.304+0000 7f4b0ef3c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:22.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.304+0000 7f4b0ef3c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-12T00:34:22.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.304+0000 7f4b0ef3c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:22.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.305+0000 7f49c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:22.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.308+0000 7f4b0ef3c800 20 remove_watcher() i=0 2024-09-12T00:34:22.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.308+0000 7f4b0ef3c800 2 removed watcher, disabling cache 2024-09-12T00:34:22.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.309+0000 7f4b0ef3c800 20 remove_watcher() i=1 2024-09-12T00:34:22.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.310+0000 7f4b0ef3c800 20 remove_watcher() i=2 2024-09-12T00:34:22.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.311+0000 7f4b0ef3c800 20 remove_watcher() i=3 2024-09-12T00:34:22.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.312+0000 7f4b0ef3c800 20 remove_watcher() i=4 2024-09-12T00:34:22.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.313+0000 7f4b0ef3c800 20 remove_watcher() i=5 2024-09-12T00:34:22.312 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.314+0000 7f4b0ef3c800 20 remove_watcher() i=6 2024-09-12T00:34:22.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:22.315+0000 7f4b0ef3c800 20 remove_watcher() i=7 2024-09-12T00:34:22.324 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:22.324 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:34:22.324 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-block-writes id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:34:22.324 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:22.614 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T00:34:22.614 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:23.428 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:34:23.456 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:23.457 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:23.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.693+0000 7fa9e03d9640 0 --2- 172.21.15.133:0/3339630964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55c25d2ec210 0x55c25d2e2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:34:23.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.697+0000 7fa9e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.699+0000 7fa9e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:23.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.699+0000 7fa9e4726800 20 realm 2024-09-12T00:34:23.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.699+0000 7fa9e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.700+0000 7fa9e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:23.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.700+0000 7fa9e4726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:23.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.700+0000 7fa9e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.700+0000 7fa9e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:23.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.700+0000 7fa9e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.700+0000 7fa9d7fff640 0 -- 172.21.15.133:0/2644947334 >> [v2:172.21.15.133:6824/186004193,v1:172.21.15.133:6825/186004193] conn(0x55c25d30e670 msgr2=0x55c25d310a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:23.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.700+0000 7fa9e4726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:23.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.700+0000 7fa9e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.701+0000 7fa9e4726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:23.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.701+0000 7fa9e4726800 20 searching for the correct realm 2024-09-12T00:34:23.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.703+0000 7fa9d7fff640 0 -- 172.21.15.133:0/2644947334 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fa9c80e6040 msgr2=0x7fa9c808b9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:34:23.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.712+0000 7fa9e4726800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:34:23.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.712+0000 7fa9e4726800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:34:23.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.712+0000 7fa9e4726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:23.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.712+0000 7fa9e4726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:23.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.712+0000 7fa9e4726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:23.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.712+0000 7fa9e4726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:23.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.712+0000 7fa9e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.712+0000 7fa9e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:23.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.712+0000 7fa9e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.712+0000 7fa9e4726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:23.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.712+0000 7fa9e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.713+0000 7fa9e4726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:23.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.713+0000 7fa9e4726800 20 zone default found 2024-09-12T00:34:23.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.713+0000 7fa9e4726800 4 Realm: () 2024-09-12T00:34:23.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.713+0000 7fa9e4726800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:34:23.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.713+0000 7fa9e4726800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:34:23.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.713+0000 7fa9e4726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:23.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.713+0000 7fa9e4726800 20 zonegroup default 2024-09-12T00:34:23.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.713+0000 7fa9e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.713+0000 7fa9e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:23.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.713+0000 7fa9e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.713+0000 7fa9e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:23.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.713+0000 7fa9e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.713+0000 7fa9e4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:23.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.713+0000 7fa9e4726800 20 started sync module instance, tier type = 2024-09-12T00:34:23.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.713+0000 7fa9e4726800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:34:23.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.721+0000 7fa9e4726800 20 add_watcher() i=0 2024-09-12T00:34:23.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.721+0000 7fa9e4726800 20 add_watcher() i=1 2024-09-12T00:34:23.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.721+0000 7fa9e4726800 20 add_watcher() i=2 2024-09-12T00:34:23.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.721+0000 7fa9e4726800 20 add_watcher() i=3 2024-09-12T00:34:23.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.721+0000 7fa9e4726800 20 add_watcher() i=4 2024-09-12T00:34:23.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.721+0000 7fa9e4726800 20 add_watcher() i=5 2024-09-12T00:34:23.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.721+0000 7fa9e4726800 20 add_watcher() i=6 2024-09-12T00:34:23.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.722+0000 7fa9e4726800 20 add_watcher() i=7 2024-09-12T00:34:23.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.722+0000 7fa9e4726800 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:23.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.725+0000 7fa896fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:23.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.725+0000 7fa9e4726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:23.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.725+0000 7fa9e4726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:23.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.725+0000 7fa9e4726800 5 note: GC not initialized 2024-09-12T00:34:23.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.725+0000 7fa895fdb640 20 reqs_thread_entry: start 2024-09-12T00:34:23.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.725+0000 7fa9e4726800 20 init_complete bucket index max shards: 1 2024-09-12T00:34:23.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.725+0000 7fa9e4726800 20 Filter name: none 2024-09-12T00:34:23.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.725+0000 7fa8077fe640 20 reqs_thread_entry: start 2024-09-12T00:34:23.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.725+0000 7fa9e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.726+0000 7fa9e4726800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:23.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.726+0000 7fa9e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.727+0000 7fa9e4726800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:34:23.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.727+0000 7fa9e4726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:23.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.727+0000 7fa9e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.727+0000 7fa9e4726800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:23.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.727+0000 7fa9e4726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.727+0000 7fa9e4726800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:34:23.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.727+0000 7fa9e4726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:23.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.728+0000 7fa896fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:23.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.731+0000 7fa9e4726800 20 remove_watcher() i=0 2024-09-12T00:34:23.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.731+0000 7fa9e4726800 2 removed watcher, disabling cache 2024-09-12T00:34:23.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.732+0000 7fa9e4726800 20 remove_watcher() i=1 2024-09-12T00:34:23.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.733+0000 7fa9e4726800 20 remove_watcher() i=2 2024-09-12T00:34:23.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.734+0000 7fa9e4726800 20 remove_watcher() i=3 2024-09-12T00:34:23.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.735+0000 7fa9e4726800 20 remove_watcher() i=4 2024-09-12T00:34:23.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.736+0000 7fa9e4726800 20 remove_watcher() i=5 2024-09-12T00:34:23.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.737+0000 7fa9e4726800 20 remove_watcher() i=6 2024-09-12T00:34:23.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.738+0000 7fa9e4726800 20 remove_watcher() i=7 2024-09-12T00:34:23.747 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:23.747 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:34:23.747 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-commit-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:34:23.747 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:23.749 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T00:34:23.784 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:23.784 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:23.821 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.823+0000 7f8bdc726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.824+0000 7f8bdc726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:23.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.824+0000 7f8bdc726800 20 realm 2024-09-12T00:34:23.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.824+0000 7f8bdc726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.824+0000 7f8bdc726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:23.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.824+0000 7f8bdc726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:23.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.825+0000 7f8bdc726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.825+0000 7f8bdc726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:23.825 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.825+0000 7f8bdc726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.825+0000 7f8bdc726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:23.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.825+0000 7f8bdc726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:23.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.826+0000 7f8bdc726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:23.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.826+0000 7f8bdc726800 20 searching for the correct realm 2024-09-12T00:34:23.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.828+0000 7f8bd7b5c640 0 -- 172.21.15.133:0/4084520315 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f8bcc036040 msgr2=0x7f8bcc042020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:23.830 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:23.831+0000 7f8bd7b5c640 0 -- 172.21.15.133:0/4084520315 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f8bc80adbe0 msgr2=0x7f8bc80a3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:24.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.038+0000 7f8bdc726800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:34:24.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.038+0000 7f8bdc726800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:34:24.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.038+0000 7f8bdc726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:24.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.038+0000 7f8bdc726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:24.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.038+0000 7f8bdc726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:24.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.038+0000 7f8bdc726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:24.038 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.039+0000 7f8bdc726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.039+0000 7f8bdc726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.039+0000 7f8bdc726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.039+0000 7f8bdc726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:24.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.039+0000 7f8bdc726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.039+0000 7f8bdc726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:24.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.039+0000 7f8bdc726800 20 zone default found 2024-09-12T00:34:24.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.039+0000 7f8bdc726800 4 Realm: () 2024-09-12T00:34:24.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.039+0000 7f8bdc726800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:34:24.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.039+0000 7f8bdc726800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:34:24.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.039+0000 7f8bdc726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:24.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.039+0000 7f8bdc726800 20 zonegroup default 2024-09-12T00:34:24.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.039+0000 7f8bdc726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.040+0000 7f8bdc726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.040+0000 7f8bdc726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.040+0000 7f8bdc726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.040+0000 7f8bdc726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.040+0000 7f8bdc726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.040+0000 7f8bdc726800 20 started sync module instance, tier type = 2024-09-12T00:34:24.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.040+0000 7f8bdc726800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:34:24.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.049+0000 7f8bdc726800 20 add_watcher() i=0 2024-09-12T00:34:24.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.049+0000 7f8bdc726800 20 add_watcher() i=1 2024-09-12T00:34:24.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.049+0000 7f8bdc726800 20 add_watcher() i=2 2024-09-12T00:34:24.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.049+0000 7f8bdc726800 20 add_watcher() i=3 2024-09-12T00:34:24.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.049+0000 7f8bdc726800 20 add_watcher() i=4 2024-09-12T00:34:24.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.049+0000 7f8bdc726800 20 add_watcher() i=5 2024-09-12T00:34:24.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.049+0000 7f8bdc726800 20 add_watcher() i=6 2024-09-12T00:34:24.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.050+0000 7f8bdc726800 20 add_watcher() i=7 2024-09-12T00:34:24.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.050+0000 7f8bdc726800 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:24.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.051+0000 7f8a8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:24.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.052+0000 7f8bdc726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:24.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.052+0000 7f8bdc726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:24.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.052+0000 7f8bdc726800 5 note: GC not initialized 2024-09-12T00:34:24.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.052+0000 7f8a8dfdb640 20 reqs_thread_entry: start 2024-09-12T00:34:24.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.052+0000 7f8bdc726800 20 init_complete bucket index max shards: 1 2024-09-12T00:34:24.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.052+0000 7f8bdc726800 20 Filter name: none 2024-09-12T00:34:24.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.052+0000 7f89ff7fe640 20 reqs_thread_entry: start 2024-09-12T00:34:24.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.052+0000 7f8bdc726800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:34:24.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.052+0000 7f8bdc726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.053+0000 7f8bdc726800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:24.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.053+0000 7f8bdc726800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:34:24.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.053+0000 7f8bdc726800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:34:24.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.053+0000 7f8bdc726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 : miss 2024-09-12T00:34:24.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.053+0000 7f8bdc726800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.053+0000 7f8bdc726800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:34:24.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.053+0000 7f8bdc726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 info.flags=0x17 2024-09-12T00:34:24.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.053+0000 7f8bdc726800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 to cache LRU end 2024-09-12T00:34:24.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.053+0000 7f8bdc726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:24.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.053+0000 7f8bdc726800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:24.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.053+0000 7f8bdc726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 2024-09-12T00:34:24.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.057+0000 7f8bdc726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 info.flags=0x17 2024-09-12T00:34:24.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.057+0000 7f8bdc726800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 to cache LRU end 2024-09-12T00:34:24.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.057+0000 7f8bdc726800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:24.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.057+0000 7f8bdc726800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31, ofs0, ns] 2024-09-12T00:34:24.056 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.057+0000 7f8aaf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497035 cookie 94918509171184 notifier 7314 bl.length()=1015 2024-09-12T00:34:24.057 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.057+0000 7f8aaf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 info.flags=0x17 2024-09-12T00:34:24.057 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.057+0000 7f8aaf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 to cache LRU end 2024-09-12T00:34:24.057 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.057+0000 7f8aaf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:24.058 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.059+0000 7f8bdc726800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): orig_sources= new_sources= 2024-09-12T00:34:24.058 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.059+0000 7f8bdc726800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): potential sources added=[] removed=[] 2024-09-12T00:34:24.058 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.059+0000 7f8bdc726800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): orig_dests= new_dests= 2024-09-12T00:34:24.058 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.059+0000 7f8bdc726800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): potential dests added=[] removed=[] 2024-09-12T00:34:24.061 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.062+0000 7f8bdc726800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31.1.0 2024-09-12T00:34:24.061 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.062+0000 7f8bdc726800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31.1.0 2024-09-12T00:34:24.061 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.062+0000 7f8bdc726800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31.1.1 2024-09-12T00:34:24.061 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.062+0000 7f8bdc726800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31.1.1 2024-09-12T00:34:24.061 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.062+0000 7f8bdc726800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31.0 2024-09-12T00:34:24.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.064+0000 7f8bdc726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:24.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.064+0000 7f8bdc726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 2024-09-12T00:34:24.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.065+0000 7f8bdc726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 info.flags=0x17 2024-09-12T00:34:24.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.065+0000 7f8bdc726800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 to cache LRU end 2024-09-12T00:34:24.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.065+0000 7f8bdc726800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:24.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.065+0000 7f8bdc726800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31, ofs0, ns] 2024-09-12T00:34:24.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.065+0000 7f8aaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497036 cookie 94918509171184 notifier 7314 bl.length()=1015 2024-09-12T00:34:24.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.065+0000 7f8aaeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 info.flags=0x17 2024-09-12T00:34:24.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.065+0000 7f8aaeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 to cache LRU end 2024-09-12T00:34:24.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.065+0000 7f8aaeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:24.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.067+0000 7f8bdc726800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): orig_sources= new_sources= 2024-09-12T00:34:24.065 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.067+0000 7f8bdc726800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): potential sources added=[] removed=[] 2024-09-12T00:34:24.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.067+0000 7f8bdc726800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): orig_dests= new_dests= 2024-09-12T00:34:24.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.067+0000 7f8bdc726800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): potential dests added=[] removed=[] 2024-09-12T00:34:24.067 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.068+0000 7f8bdc726800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31.0 2024-09-12T00:34:24.067 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.068+0000 7f8bdc726800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T00:34:24.067 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.068+0000 7f8bdc726800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T00:34:24.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.071+0000 7f8a8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:24.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.073+0000 7f8bdc726800 20 remove_watcher() i=0 2024-09-12T00:34:24.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.073+0000 7f8bdc726800 2 removed watcher, disabling cache 2024-09-12T00:34:24.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.074+0000 7f8bdc726800 20 remove_watcher() i=1 2024-09-12T00:34:24.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.075+0000 7f8bdc726800 20 remove_watcher() i=2 2024-09-12T00:34:24.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.076+0000 7f8bdc726800 20 remove_watcher() i=3 2024-09-12T00:34:24.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.077+0000 7f8bdc726800 20 remove_watcher() i=4 2024-09-12T00:34:24.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.078+0000 7f8bdc726800 20 remove_watcher() i=5 2024-09-12T00:34:24.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.079+0000 7f8bdc726800 20 remove_watcher() i=6 2024-09-12T00:34:24.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.080+0000 7f8bdc726800 20 remove_watcher() i=7 2024-09-12T00:34:24.090 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:34:24.119 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:24.119 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:24.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.157+0000 7f4045740800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.159+0000 7f4045740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.159+0000 7f4045740800 20 realm 2024-09-12T00:34:24.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.159+0000 7f4045740800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.159+0000 7f4045740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.159+0000 7f4045740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:24.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.159+0000 7f4045740800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.160+0000 7f4045740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.160+0000 7f4045740800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.160+0000 7f4045740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:24.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.160+0000 7f4045740800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.161+0000 7f4045740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:24.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.161+0000 7f4045740800 20 searching for the correct realm 2024-09-12T00:34:24.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.163+0000 7f403bfff640 0 -- 172.21.15.133:0/531721879 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f402c07e020 msgr2=0x7f402c0c18d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:24.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.166+0000 7f403bfff640 0 -- 172.21.15.133:0/531721879 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f4034017b40 msgr2=0x7f4034024910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:34:24.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.372+0000 7f4045740800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:34:24.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.372+0000 7f4045740800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:34:24.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.372+0000 7f4045740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:24.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.372+0000 7f4045740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:24.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.372+0000 7f4045740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:24.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.372+0000 7f4045740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:24.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.372+0000 7f4045740800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.372+0000 7f4045740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.372+0000 7f4045740800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.372+0000 7f4045740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:24.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.372+0000 7f4045740800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.373+0000 7f4045740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:24.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.373+0000 7f4045740800 20 zone default found 2024-09-12T00:34:24.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.373+0000 7f4045740800 4 Realm: () 2024-09-12T00:34:24.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.373+0000 7f4045740800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:34:24.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.373+0000 7f4045740800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:34:24.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.373+0000 7f4045740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:24.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.373+0000 7f4045740800 20 zonegroup default 2024-09-12T00:34:24.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.373+0000 7f4045740800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.373+0000 7f4045740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.373+0000 7f4045740800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.373+0000 7f4045740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.373+0000 7f4045740800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.373+0000 7f4045740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.373+0000 7f4045740800 20 started sync module instance, tier type = 2024-09-12T00:34:24.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.373+0000 7f4045740800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:34:24.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.382+0000 7f4045740800 20 add_watcher() i=0 2024-09-12T00:34:24.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.382+0000 7f4045740800 20 add_watcher() i=1 2024-09-12T00:34:24.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.382+0000 7f4045740800 20 add_watcher() i=2 2024-09-12T00:34:24.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.382+0000 7f4045740800 20 add_watcher() i=3 2024-09-12T00:34:24.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.382+0000 7f4045740800 20 add_watcher() i=4 2024-09-12T00:34:24.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.382+0000 7f4045740800 20 add_watcher() i=5 2024-09-12T00:34:24.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.382+0000 7f4045740800 20 add_watcher() i=6 2024-09-12T00:34:24.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.383+0000 7f4045740800 20 add_watcher() i=7 2024-09-12T00:34:24.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.383+0000 7f4045740800 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:24.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.385+0000 7f3ef77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:24.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.385+0000 7f4045740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:24.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.385+0000 7f4045740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:24.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.385+0000 7f4045740800 5 note: GC not initialized 2024-09-12T00:34:24.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.385+0000 7f3ef67e4640 20 reqs_thread_entry: start 2024-09-12T00:34:24.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.385+0000 7f4045740800 20 init_complete bucket index max shards: 1 2024-09-12T00:34:24.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.385+0000 7f4045740800 20 Filter name: none 2024-09-12T00:34:24.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.385+0000 7f3e67fff640 20 reqs_thread_entry: start 2024-09-12T00:34:24.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.385+0000 7f4045740800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.386+0000 7f4045740800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:24.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.386+0000 7f4045740800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.386+0000 7f4045740800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:34:24.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.386+0000 7f4045740800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:24.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.386+0000 7f4045740800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.387+0000 7f4045740800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:24.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.387+0000 7f4045740800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.387+0000 7f4045740800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:34:24.387 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.387+0000 7f4045740800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:24.387 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.388+0000 7f3ef77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:24.389 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.390+0000 7f4045740800 20 remove_watcher() i=0 2024-09-12T00:34:24.389 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.390+0000 7f4045740800 2 removed watcher, disabling cache 2024-09-12T00:34:24.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.392+0000 7f4045740800 20 remove_watcher() i=1 2024-09-12T00:34:24.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.393+0000 7f4045740800 20 remove_watcher() i=2 2024-09-12T00:34:24.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.394+0000 7f4045740800 20 remove_watcher() i=3 2024-09-12T00:34:24.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.395+0000 7f4045740800 20 remove_watcher() i=4 2024-09-12T00:34:24.394 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.396+0000 7f4045740800 20 remove_watcher() i=5 2024-09-12T00:34:24.395 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.396+0000 7f4045740800 20 remove_watcher() i=6 2024-09-12T00:34:24.396 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.397+0000 7f4045740800 20 remove_watcher() i=7 2024-09-12T00:34:24.406 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:24.406 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:34:24.406 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-commit-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:34:24.406 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:24.496 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:34:24.528 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:24.528 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:24.566 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.567+0000 7f0bb7344800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.567 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.568+0000 7f0bb7344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.568+0000 7f0bb7344800 20 realm 2024-09-12T00:34:24.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.568+0000 7f0bb7344800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.569+0000 7f0bb7344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.569+0000 7f0bb7344800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:24.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.569+0000 7f0bb7344800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.569+0000 7f0bb7344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.569+0000 7f0bb7344800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.569+0000 7f0bb7344800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:24.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.569+0000 7f0bb7344800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.570+0000 7f0bb7344800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:24.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.570+0000 7f0bb7344800 20 searching for the correct realm 2024-09-12T00:34:24.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.571+0000 7f0bb30f4640 0 -- 172.21.15.133:0/2549654739 >> [v2:172.21.15.133:6816/1011460824,v1:172.21.15.133:6817/1011460824] conn(0x7f0ba0003cb0 msgr2=0x7f0bac003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:34:24.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.776+0000 7f0bb30f4640 0 -- 172.21.15.133:0/2549654739 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x559fafa7dc10 msgr2=0x559fafa80080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:24.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.783+0000 7f0bb7344800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:34:24.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.783+0000 7f0bb7344800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:34:24.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.783+0000 7f0bb7344800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:24.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.783+0000 7f0bb7344800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:24.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.783+0000 7f0bb7344800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:24.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.783+0000 7f0bb7344800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:24.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.783+0000 7f0bb7344800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.783+0000 7f0bb7344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.783+0000 7f0bb7344800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.783+0000 7f0bb7344800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:24.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.783+0000 7f0bb7344800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.783 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.783+0000 7f0bb7344800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:24.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.784+0000 7f0bb7344800 20 zone default found 2024-09-12T00:34:24.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.784+0000 7f0bb7344800 4 Realm: () 2024-09-12T00:34:24.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.784+0000 7f0bb7344800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:34:24.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.784+0000 7f0bb7344800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:34:24.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.784+0000 7f0bb7344800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:24.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.784+0000 7f0bb7344800 20 zonegroup default 2024-09-12T00:34:24.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.784+0000 7f0bb7344800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.784+0000 7f0bb7344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.784+0000 7f0bb7344800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.784+0000 7f0bb7344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.784+0000 7f0bb7344800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.785 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.784+0000 7f0bb7344800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.785 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.784+0000 7f0bb7344800 20 started sync module instance, tier type = 2024-09-12T00:34:24.785 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.784+0000 7f0bb7344800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:34:24.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.793+0000 7f0bb7344800 20 add_watcher() i=0 2024-09-12T00:34:24.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.793+0000 7f0bb7344800 20 add_watcher() i=1 2024-09-12T00:34:24.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.793+0000 7f0bb7344800 20 add_watcher() i=2 2024-09-12T00:34:24.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.793+0000 7f0bb7344800 20 add_watcher() i=3 2024-09-12T00:34:24.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.793+0000 7f0bb7344800 20 add_watcher() i=4 2024-09-12T00:34:24.793 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.793+0000 7f0bb7344800 20 add_watcher() i=5 2024-09-12T00:34:24.793 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.793+0000 7f0bb7344800 20 add_watcher() i=6 2024-09-12T00:34:24.793 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.794+0000 7f0bb7344800 20 add_watcher() i=7 2024-09-12T00:34:24.793 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.794+0000 7f0bb7344800 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:24.795 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.796+0000 7f0a69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:24.796 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.796+0000 7f0bb7344800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:24.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.796+0000 7f0bb7344800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:24.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.797+0000 7f0bb7344800 5 note: GC not initialized 2024-09-12T00:34:24.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.797+0000 7f0a68fe1640 20 reqs_thread_entry: start 2024-09-12T00:34:24.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.797+0000 7f0bb7344800 20 init_complete bucket index max shards: 1 2024-09-12T00:34:24.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.797+0000 7f0bb7344800 20 Filter name: none 2024-09-12T00:34:24.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.797+0000 7f09e27fc640 20 reqs_thread_entry: start 2024-09-12T00:34:24.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.797+0000 7f0bb7344800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:34:24.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.797+0000 7f0bb7344800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.797+0000 7f0bb7344800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:24.797 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.797+0000 7f0bb7344800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:34:24.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.797+0000 7f0bb7344800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:34:24.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.797+0000 7f0bb7344800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 : miss 2024-09-12T00:34:24.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.797+0000 7f0bb7344800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.798+0000 7f0bb7344800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:34:24.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.798+0000 7f0bb7344800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 info.flags=0x17 2024-09-12T00:34:24.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.798+0000 7f0bb7344800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 to cache LRU end 2024-09-12T00:34:24.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.798+0000 7f0bb7344800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:24.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.798+0000 7f0bb7344800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:24.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.798+0000 7f0bb7344800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 2024-09-12T00:34:24.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.799+0000 7f0bb7344800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:34:24.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.803+0000 7f0bb7344800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 info.flags=0x17 2024-09-12T00:34:24.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.803+0000 7f0bb7344800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 to cache LRU end 2024-09-12T00:34:24.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.803+0000 7f0bb7344800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:24.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.803+0000 7f0bb7344800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31, ofs0, ns] 2024-09-12T00:34:24.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.803+0000 7f0a96ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 94144335240272 notifier 6908 bl.length()=1015 2024-09-12T00:34:24.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.803+0000 7f0a96ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 info.flags=0x17 2024-09-12T00:34:24.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.803+0000 7f0a96ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 to cache LRU end 2024-09-12T00:34:24.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.803+0000 7f0a96ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:24.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.805+0000 7f0bb7344800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): orig_sources= new_sources= 2024-09-12T00:34:24.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.805+0000 7f0bb7344800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): potential sources added=[] removed=[] 2024-09-12T00:34:24.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.805+0000 7f0bb7344800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): orig_dests= new_dests= 2024-09-12T00:34:24.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.805+0000 7f0bb7344800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): potential dests added=[] removed=[] 2024-09-12T00:34:24.805 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.807+0000 7f0bb7344800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31.2.0 2024-09-12T00:34:24.805 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.807+0000 7f0bb7344800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31.2.0 2024-09-12T00:34:24.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.807+0000 7f0bb7344800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31.2.1 2024-09-12T00:34:24.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.807+0000 7f0bb7344800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31.2.1 2024-09-12T00:34:24.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.807+0000 7f0bb7344800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31.0 2024-09-12T00:34:24.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.809+0000 7f0bb7344800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:24.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.809+0000 7f0bb7344800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 2024-09-12T00:34:24.808 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.810+0000 7f0bb7344800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 info.flags=0x17 2024-09-12T00:34:24.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.810+0000 7f0bb7344800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 to cache LRU end 2024-09-12T00:34:24.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.810+0000 7f0bb7344800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:24.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.810+0000 7f0bb7344800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31, ofs0, ns] 2024-09-12T00:34:24.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.810+0000 7f0a96ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497038 cookie 94144335240272 notifier 6908 bl.length()=1015 2024-09-12T00:34:24.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.810+0000 7f0a96ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 info.flags=0x17 2024-09-12T00:34:24.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.810+0000 7f0a96ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 to cache LRU end 2024-09-12T00:34:24.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.810+0000 7f0a96ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:24.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.812+0000 7f0bb7344800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): orig_sources= new_sources= 2024-09-12T00:34:24.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.812+0000 7f0bb7344800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): potential sources added=[] removed=[] 2024-09-12T00:34:24.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.812+0000 7f0bb7344800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): orig_dests= new_dests= 2024-09-12T00:34:24.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.812+0000 7f0bb7344800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): potential dests added=[] removed=[] 2024-09-12T00:34:24.811 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.813+0000 7f0bb7344800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31.0 2024-09-12T00:34:24.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.813+0000 7f0bb7344800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:24.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.813+0000 7f0bb7344800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 2024-09-12T00:34:24.813 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.814+0000 7f0bb7344800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 info.flags=0x17 2024-09-12T00:34:24.813 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.814+0000 7f0bb7344800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 to cache LRU end 2024-09-12T00:34:24.813 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.814+0000 7f0bb7344800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:24.813 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.814+0000 7f0bb7344800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31, ofs0, ns] 2024-09-12T00:34:24.813 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.814+0000 7f0a967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497039 cookie 94144335240272 notifier 6908 bl.length()=983 2024-09-12T00:34:24.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.814+0000 7f0a967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 info.flags=0x17 2024-09-12T00:34:24.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.814+0000 7f0a967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 to cache LRU end 2024-09-12T00:34:24.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.814+0000 7f0a967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:24.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.816+0000 7f0bb7344800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): orig_sources= new_sources= 2024-09-12T00:34:24.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.816+0000 7f0bb7344800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): potential sources added=[] removed=[] 2024-09-12T00:34:24.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.816+0000 7f0bb7344800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): orig_dests= new_dests= 2024-09-12T00:34:24.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.816+0000 7f0bb7344800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31]): potential dests added=[] removed=[] 2024-09-12T00:34:24.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.817+0000 7f0bb7344800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:34:24.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.818+0000 7f0a69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:24.819 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.820+0000 7f0bb7344800 20 remove_watcher() i=0 2024-09-12T00:34:24.819 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.820+0000 7f0bb7344800 2 removed watcher, disabling cache 2024-09-12T00:34:24.820 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.821+0000 7f0bb7344800 20 remove_watcher() i=1 2024-09-12T00:34:24.821 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.822+0000 7f0bb7344800 20 remove_watcher() i=2 2024-09-12T00:34:24.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.823+0000 7f0bb7344800 20 remove_watcher() i=3 2024-09-12T00:34:24.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.824+0000 7f0bb7344800 20 remove_watcher() i=4 2024-09-12T00:34:24.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.825+0000 7f0bb7344800 20 remove_watcher() i=5 2024-09-12T00:34:24.825 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.826+0000 7f0bb7344800 20 remove_watcher() i=6 2024-09-12T00:34:24.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.827+0000 7f0bb7344800 20 remove_watcher() i=7 2024-09-12T00:34:24.838 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:34:24.867 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:24.867 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:24.905 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.906+0000 7ffa0a12c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.906 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.907+0000 7ffa0a12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.906 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.907+0000 7ffa0a12c800 20 realm 2024-09-12T00:34:24.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.907+0000 7ffa0a12c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.908+0000 7ffa0a12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.908+0000 7ffa0a12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:24.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.908+0000 7ffa0a12c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.908+0000 7ffa0a12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:24.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.908+0000 7ffa0a12c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.909+0000 7ffa0a12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:24.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.909+0000 7ffa0a12c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:24.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.909+0000 7ffa0a12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:24.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.909+0000 7ffa0a12c800 20 searching for the correct realm 2024-09-12T00:34:24.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.911+0000 7ffa056ac640 0 -- 172.21.15.133:0/3184974875 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff9fc067020 msgr2=0x7ff9fc033920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:24.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:24.914+0000 7ffa056ac640 0 -- 172.21.15.133:0/3184974875 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff9f807f450 msgr2=0x7ff9f807f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:34:25.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.120+0000 7ffa0a12c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:34:25.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.120+0000 7ffa0a12c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:34:25.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.120+0000 7ffa0a12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:25.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.120+0000 7ffa0a12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:25.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.120+0000 7ffa0a12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:25.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.120+0000 7ffa0a12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:25.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.120+0000 7ffa0a12c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.120+0000 7ffa0a12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:25.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.120+0000 7ffa0a12c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.121+0000 7ffa0a12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:25.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.121+0000 7ffa0a12c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.121+0000 7ffa0a12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:25.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.121+0000 7ffa0a12c800 20 zone default found 2024-09-12T00:34:25.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.121+0000 7ffa0a12c800 4 Realm: () 2024-09-12T00:34:25.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.121+0000 7ffa0a12c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:34:25.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.121+0000 7ffa0a12c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:34:25.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.121+0000 7ffa0a12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:25.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.121+0000 7ffa0a12c800 20 zonegroup default 2024-09-12T00:34:25.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.121+0000 7ffa0a12c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.121+0000 7ffa0a12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:25.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.122+0000 7ffa0a12c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.122+0000 7ffa0a12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:25.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.122+0000 7ffa0a12c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.122+0000 7ffa0a12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:25.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.122+0000 7ffa0a12c800 20 started sync module instance, tier type = 2024-09-12T00:34:25.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.122+0000 7ffa0a12c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:34:25.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.131+0000 7ffa0a12c800 20 add_watcher() i=0 2024-09-12T00:34:25.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.131+0000 7ffa0a12c800 20 add_watcher() i=1 2024-09-12T00:34:25.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.131+0000 7ffa0a12c800 20 add_watcher() i=2 2024-09-12T00:34:25.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.131+0000 7ffa0a12c800 20 add_watcher() i=3 2024-09-12T00:34:25.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.131+0000 7ffa0a12c800 20 add_watcher() i=4 2024-09-12T00:34:25.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.131+0000 7ffa0a12c800 20 add_watcher() i=5 2024-09-12T00:34:25.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.131+0000 7ffa0a12c800 20 add_watcher() i=6 2024-09-12T00:34:25.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.132+0000 7ffa0a12c800 20 add_watcher() i=7 2024-09-12T00:34:25.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.132+0000 7ffa0a12c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:25.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.134+0000 7ff8b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:25.133 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.134+0000 7ffa0a12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:25.133 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.134+0000 7ffa0a12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:25.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.134+0000 7ffa0a12c800 5 note: GC not initialized 2024-09-12T00:34:25.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.135+0000 7ff8b67fc640 20 reqs_thread_entry: start 2024-09-12T00:34:25.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.135+0000 7ffa0a12c800 20 init_complete bucket index max shards: 1 2024-09-12T00:34:25.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.135+0000 7ffa0a12c800 20 Filter name: none 2024-09-12T00:34:25.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.135+0000 7ff827fff640 20 reqs_thread_entry: start 2024-09-12T00:34:25.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.135+0000 7ffa0a12c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.135+0000 7ffa0a12c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:25.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.135+0000 7ffa0a12c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.136+0000 7ffa0a12c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:34:25.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.136+0000 7ffa0a12c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:25.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.136+0000 7ffa0a12c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.136+0000 7ffa0a12c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:25.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.136+0000 7ffa0a12c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.137+0000 7ffa0a12c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:34:25.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.137+0000 7ffa0a12c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:25.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.139+0000 7ff8b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:25.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.141+0000 7ffa0a12c800 20 remove_watcher() i=0 2024-09-12T00:34:25.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.141+0000 7ffa0a12c800 2 removed watcher, disabling cache 2024-09-12T00:34:25.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.142+0000 7ffa0a12c800 20 remove_watcher() i=1 2024-09-12T00:34:25.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.143+0000 7ffa0a12c800 20 remove_watcher() i=2 2024-09-12T00:34:25.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.143+0000 7ffa0a12c800 20 remove_watcher() i=3 2024-09-12T00:34:25.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.144+0000 7ffa0a12c800 20 remove_watcher() i=4 2024-09-12T00:34:25.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.146+0000 7ffa0a12c800 20 remove_watcher() i=5 2024-09-12T00:34:25.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.147+0000 7ffa0a12c800 20 remove_watcher() i=6 2024-09-12T00:34:25.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:25.148+0000 7ffa0a12c800 20 remove_watcher() i=7 2024-09-12T00:34:25.157 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:25.157 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:34:25.157 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-commit-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:34:25.157 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:25.458 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T00:34:25.458 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:26.263 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:34:26.292 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:26.292 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:26.329 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.330+0000 7fa4bab24800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.332+0000 7fa4bab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.332+0000 7fa4bab24800 20 realm 2024-09-12T00:34:26.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.332+0000 7fa4bab24800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.332+0000 7fa4bab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.332+0000 7fa4bab24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:26.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.332+0000 7fa4bab24800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.332+0000 7fa4bab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.332+0000 7fa4bab24800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.333+0000 7fa4bab24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:26.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.333+0000 7fa4bab24800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.333+0000 7fa4bab24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:26.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.334+0000 7fa4bab24800 20 searching for the correct realm 2024-09-12T00:34:26.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.335+0000 7fa4affff640 0 -- 172.21.15.133:0/3172401325 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fa4a0018070 msgr2=0x7fa4a008f0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:26.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.540+0000 7fa4affff640 0 -- 172.21.15.133:0/3172401325 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fa4a8035040 msgr2=0x7fa4a800a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:34:26.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.747+0000 7fa4bab24800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:34:26.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.747+0000 7fa4bab24800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:34:26.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.747+0000 7fa4bab24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:26.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.747+0000 7fa4bab24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:26.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.747+0000 7fa4bab24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:26.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.747+0000 7fa4bab24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:26.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.747+0000 7fa4bab24800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.747+0000 7fa4bab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.747+0000 7fa4bab24800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.747+0000 7fa4bab24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:26.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.748+0000 7fa4bab24800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.748+0000 7fa4bab24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:26.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.748+0000 7fa4bab24800 20 zone default found 2024-09-12T00:34:26.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.748+0000 7fa4bab24800 4 Realm: () 2024-09-12T00:34:26.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.748+0000 7fa4bab24800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:34:26.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.748+0000 7fa4bab24800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:34:26.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.748+0000 7fa4bab24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:26.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.748+0000 7fa4bab24800 20 zonegroup default 2024-09-12T00:34:26.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.748+0000 7fa4bab24800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.748+0000 7fa4bab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.748+0000 7fa4bab24800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.748+0000 7fa4bab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.748+0000 7fa4bab24800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.749+0000 7fa4bab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.749+0000 7fa4bab24800 20 started sync module instance, tier type = 2024-09-12T00:34:26.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.749+0000 7fa4bab24800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:34:26.756 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.757+0000 7fa4bab24800 20 add_watcher() i=0 2024-09-12T00:34:26.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.757+0000 7fa4bab24800 20 add_watcher() i=1 2024-09-12T00:34:26.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.757+0000 7fa4bab24800 20 add_watcher() i=2 2024-09-12T00:34:26.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.757+0000 7fa4bab24800 20 add_watcher() i=3 2024-09-12T00:34:26.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.757+0000 7fa4bab24800 20 add_watcher() i=4 2024-09-12T00:34:26.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.757+0000 7fa4bab24800 20 add_watcher() i=5 2024-09-12T00:34:26.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.757+0000 7fa4bab24800 20 add_watcher() i=6 2024-09-12T00:34:26.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.758+0000 7fa4bab24800 20 add_watcher() i=7 2024-09-12T00:34:26.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.758+0000 7fa4bab24800 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:26.759 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.760+0000 7fa36cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:26.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.761+0000 7fa4bab24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:26.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.761+0000 7fa4bab24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:26.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.761+0000 7fa4bab24800 5 note: GC not initialized 2024-09-12T00:34:26.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.761+0000 7fa2e77fe640 20 reqs_thread_entry: start 2024-09-12T00:34:26.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.761+0000 7fa4bab24800 20 init_complete bucket index max shards: 1 2024-09-12T00:34:26.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.761+0000 7fa4bab24800 20 Filter name: none 2024-09-12T00:34:26.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.761+0000 7fa2e57fa640 20 reqs_thread_entry: start 2024-09-12T00:34:26.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.761+0000 7fa4bab24800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.762+0000 7fa4bab24800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:26.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.762+0000 7fa4bab24800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.762+0000 7fa4bab24800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:34:26.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.763+0000 7fa4bab24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:26.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.763+0000 7fa4bab24800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.763+0000 7fa4bab24800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:26.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.763+0000 7fa4bab24800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.763+0000 7fa4bab24800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:34:26.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.763+0000 7fa4bab24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:26.763 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.764+0000 7fa36cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:26.765 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.767+0000 7fa4bab24800 20 remove_watcher() i=0 2024-09-12T00:34:26.765 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.767+0000 7fa4bab24800 2 removed watcher, disabling cache 2024-09-12T00:34:26.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.767+0000 7fa4bab24800 20 remove_watcher() i=1 2024-09-12T00:34:26.767 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.769+0000 7fa4bab24800 20 remove_watcher() i=2 2024-09-12T00:34:26.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.770+0000 7fa4bab24800 20 remove_watcher() i=3 2024-09-12T00:34:26.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.770+0000 7fa4bab24800 20 remove_watcher() i=4 2024-09-12T00:34:26.770 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.771+0000 7fa4bab24800 20 remove_watcher() i=5 2024-09-12T00:34:26.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.772+0000 7fa4bab24800 20 remove_watcher() i=6 2024-09-12T00:34:26.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.773+0000 7fa4bab24800 20 remove_watcher() i=7 2024-09-12T00:34:26.784 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:26.784 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:34:26.784 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-commit-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:34:26.784 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:26.786 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T00:34:26.822 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:26.822 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:26.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.860+0000 7fd0d5935800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.862+0000 7fd0d5935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.862+0000 7fd0d5935800 20 realm 2024-09-12T00:34:26.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.862+0000 7fd0d5935800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.862+0000 7fd0d5935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.862+0000 7fd0d5935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:26.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.862+0000 7fd0d5935800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.862+0000 7fd0d5935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.861 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.862+0000 7fd0d5935800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.862 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.863+0000 7fd0d5935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:26.862 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.863+0000 7fd0d5935800 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.862 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.864+0000 7fd0d5935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:26.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.864+0000 7fd0d5935800 20 searching for the correct realm 2024-09-12T00:34:26.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:26.864+0000 7fd0d167d640 0 -- 172.21.15.133:0/949370115 >> [v2:172.21.15.133:6816/1011460824,v1:172.21.15.133:6817/1011460824] conn(0x563fe6db5f30 msgr2=0x7fd0cc0a10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:27.068 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.069+0000 7fd0d167d640 0 -- 172.21.15.133:0/949370115 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x563fe6ff5cd0 msgr2=0x563fe6ff80e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:27.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.075+0000 7fd0d5935800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:34:27.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.075+0000 7fd0d5935800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:34:27.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.075+0000 7fd0d5935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:27.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.075+0000 7fd0d5935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:27.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.075+0000 7fd0d5935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:27.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.075+0000 7fd0d5935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:27.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.075+0000 7fd0d5935800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.075+0000 7fd0d5935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.075+0000 7fd0d5935800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.076+0000 7fd0d5935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:27.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.076+0000 7fd0d5935800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.076+0000 7fd0d5935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:27.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.076+0000 7fd0d5935800 20 zone default found 2024-09-12T00:34:27.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.076+0000 7fd0d5935800 4 Realm: () 2024-09-12T00:34:27.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.076+0000 7fd0d5935800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:34:27.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.076+0000 7fd0d5935800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:34:27.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.076+0000 7fd0d5935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:27.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.076+0000 7fd0d5935800 20 zonegroup default 2024-09-12T00:34:27.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.076+0000 7fd0d5935800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.076+0000 7fd0d5935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.076+0000 7fd0d5935800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.076+0000 7fd0d5935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.076+0000 7fd0d5935800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.077+0000 7fd0d5935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.077+0000 7fd0d5935800 20 started sync module instance, tier type = 2024-09-12T00:34:27.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.077+0000 7fd0d5935800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:34:27.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.085+0000 7fd0d5935800 20 add_watcher() i=0 2024-09-12T00:34:27.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.085+0000 7fd0d5935800 20 add_watcher() i=1 2024-09-12T00:34:27.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.085+0000 7fd0d5935800 20 add_watcher() i=2 2024-09-12T00:34:27.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.085+0000 7fd0d5935800 20 add_watcher() i=3 2024-09-12T00:34:27.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.085+0000 7fd0d5935800 20 add_watcher() i=4 2024-09-12T00:34:27.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.085+0000 7fd0d5935800 20 add_watcher() i=5 2024-09-12T00:34:27.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.085+0000 7fd0d5935800 20 add_watcher() i=6 2024-09-12T00:34:27.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.086+0000 7fd0d5935800 20 add_watcher() i=7 2024-09-12T00:34:27.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.086+0000 7fd0d5935800 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:27.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.088+0000 7fcf877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:27.087 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.088+0000 7fd0d5935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:27.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.088+0000 7fd0d5935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:27.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.088+0000 7fd0d5935800 5 note: GC not initialized 2024-09-12T00:34:27.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.088+0000 7fcf867e4640 20 reqs_thread_entry: start 2024-09-12T00:34:27.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.088+0000 7fd0d5935800 20 init_complete bucket index max shards: 1 2024-09-12T00:34:27.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.088+0000 7fd0d5935800 20 Filter name: none 2024-09-12T00:34:27.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.089+0000 7fcef7fff640 20 reqs_thread_entry: start 2024-09-12T00:34:27.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.089+0000 7fd0d5935800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:34:27.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.089+0000 7fd0d5935800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.089+0000 7fd0d5935800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:27.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.089+0000 7fd0d5935800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:34:27.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.089+0000 7fd0d5935800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:34:27.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.089+0000 7fd0d5935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 : miss 2024-09-12T00:34:27.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.089+0000 7fd0d5935800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.090+0000 7fd0d5935800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:34:27.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.090+0000 7fd0d5935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 info.flags=0x17 2024-09-12T00:34:27.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.090+0000 7fd0d5935800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 to cache LRU end 2024-09-12T00:34:27.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.090+0000 7fd0d5935800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:27.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.090+0000 7fd0d5935800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:27.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.090+0000 7fd0d5935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 2024-09-12T00:34:27.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.094+0000 7fd0d5935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 info.flags=0x17 2024-09-12T00:34:27.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.094+0000 7fd0d5935800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 to cache LRU end 2024-09-12T00:34:27.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.094+0000 7fd0d5935800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:27.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.094+0000 7fd0d5935800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32, ofs0, ns] 2024-09-12T00:34:27.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.094+0000 7fcfb4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497042 cookie 94832458492448 notifier 6956 bl.length()=1015 2024-09-12T00:34:27.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.094+0000 7fcfb4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 info.flags=0x17 2024-09-12T00:34:27.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.094+0000 7fcfb4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 to cache LRU end 2024-09-12T00:34:27.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.094+0000 7fcfb4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:27.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.096+0000 7fd0d5935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32]): orig_sources= new_sources= 2024-09-12T00:34:27.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.096+0000 7fd0d5935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32]): potential sources added=[] removed=[] 2024-09-12T00:34:27.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.096+0000 7fd0d5935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32]): orig_dests= new_dests= 2024-09-12T00:34:27.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.096+0000 7fd0d5935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32]): potential dests added=[] removed=[] 2024-09-12T00:34:27.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.098+0000 7fd0d5935800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32.1.0 2024-09-12T00:34:27.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.098+0000 7fd0d5935800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32.1.0 2024-09-12T00:34:27.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.098+0000 7fd0d5935800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32.1.1 2024-09-12T00:34:27.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.098+0000 7fd0d5935800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32.1.1 2024-09-12T00:34:27.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.098+0000 7fd0d5935800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32.0 2024-09-12T00:34:27.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.101+0000 7fd0d5935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:27.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.101+0000 7fd0d5935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 2024-09-12T00:34:27.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.102+0000 7fd0d5935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 info.flags=0x17 2024-09-12T00:34:27.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.102+0000 7fd0d5935800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 to cache LRU end 2024-09-12T00:34:27.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.102+0000 7fd0d5935800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:27.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.102+0000 7fd0d5935800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32, ofs0, ns] 2024-09-12T00:34:27.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.102+0000 7fcfb4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497043 cookie 94832458492448 notifier 6956 bl.length()=1015 2024-09-12T00:34:27.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.102+0000 7fcfb4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 info.flags=0x17 2024-09-12T00:34:27.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.102+0000 7fcfb4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 to cache LRU end 2024-09-12T00:34:27.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.102+0000 7fcfb4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:27.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.104+0000 7fd0d5935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32]): orig_sources= new_sources= 2024-09-12T00:34:27.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.104+0000 7fd0d5935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32]): potential sources added=[] removed=[] 2024-09-12T00:34:27.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.104+0000 7fd0d5935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32]): orig_dests= new_dests= 2024-09-12T00:34:27.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.104+0000 7fd0d5935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32]): potential dests added=[] removed=[] 2024-09-12T00:34:27.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.105+0000 7fd0d5935800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32.0 2024-09-12T00:34:27.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.105+0000 7fd0d5935800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T00:34:27.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.105+0000 7fd0d5935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:27.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.105+0000 7fd0d5935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 2024-09-12T00:34:27.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.107+0000 7fd0d5935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 info.flags=0x17 2024-09-12T00:34:27.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.107+0000 7fd0d5935800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 to cache LRU end 2024-09-12T00:34:27.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.107+0000 7fd0d5935800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:27.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.107+0000 7fd0d5935800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32, ofs0, ns] 2024-09-12T00:34:27.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.107+0000 7fcfa3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 94832458492448 notifier 6956 bl.length()=983 2024-09-12T00:34:27.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.107+0000 7fcfa3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 info.flags=0x17 2024-09-12T00:34:27.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.107+0000 7fcfa3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 to cache LRU end 2024-09-12T00:34:27.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.107+0000 7fcfa3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:27.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.108+0000 7fd0d5935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32]): orig_sources= new_sources= 2024-09-12T00:34:27.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.108+0000 7fd0d5935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32]): potential sources added=[] removed=[] 2024-09-12T00:34:27.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.108+0000 7fd0d5935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32]): orig_dests= new_dests= 2024-09-12T00:34:27.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.108+0000 7fd0d5935800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32]): potential dests added=[] removed=[] 2024-09-12T00:34:27.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.109+0000 7fd0d5935800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:34:27.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.111+0000 7fcf877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:27.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.113+0000 7fd0d5935800 20 remove_watcher() i=0 2024-09-12T00:34:27.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.113+0000 7fd0d5935800 2 removed watcher, disabling cache 2024-09-12T00:34:27.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.114+0000 7fd0d5935800 20 remove_watcher() i=1 2024-09-12T00:34:27.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.115+0000 7fd0d5935800 20 remove_watcher() i=2 2024-09-12T00:34:27.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.116+0000 7fd0d5935800 20 remove_watcher() i=3 2024-09-12T00:34:27.116 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.117+0000 7fd0d5935800 20 remove_watcher() i=4 2024-09-12T00:34:27.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.118+0000 7fd0d5935800 20 remove_watcher() i=5 2024-09-12T00:34:27.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.119+0000 7fd0d5935800 20 remove_watcher() i=6 2024-09-12T00:34:27.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.120+0000 7fd0d5935800 20 remove_watcher() i=7 2024-09-12T00:34:27.131 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:34:27.160 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:27.160 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:27.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.198+0000 7f0311720800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.200+0000 7f0311720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.200+0000 7f0311720800 20 realm 2024-09-12T00:34:27.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.200+0000 7f0311720800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.200+0000 7f0311720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.200+0000 7f0311720800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:27.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.200+0000 7f0311720800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.200+0000 7f0311720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.200+0000 7f0311720800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.201+0000 7f0311720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:27.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.201+0000 7f0311720800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.202+0000 7f0311720800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:27.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.202+0000 7f0311720800 20 searching for the correct realm 2024-09-12T00:34:27.202 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.204+0000 7f0304c67640 0 -- 172.21.15.133:0/71295666 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f02f8033060 msgr2=0x7f02f8066920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:34:27.206 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.207+0000 7f0304c67640 0 -- 172.21.15.133:0/71295666 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f030006bc20 msgr2=0x7f0300022750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:34:27.411 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.413+0000 7f0311720800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:34:27.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.413+0000 7f0311720800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:34:27.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.413+0000 7f0311720800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:27.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.413+0000 7f0311720800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:27.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.413+0000 7f0311720800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:27.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.413+0000 7f0311720800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:27.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.413+0000 7f0311720800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.413+0000 7f0311720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.413+0000 7f0311720800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.414+0000 7f0311720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:27.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.414+0000 7f0311720800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.414+0000 7f0311720800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:27.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.414+0000 7f0311720800 20 zone default found 2024-09-12T00:34:27.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.414+0000 7f0311720800 4 Realm: () 2024-09-12T00:34:27.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.414+0000 7f0311720800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:34:27.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.414+0000 7f0311720800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:34:27.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.414+0000 7f0311720800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:27.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.414+0000 7f0311720800 20 zonegroup default 2024-09-12T00:34:27.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.414+0000 7f0311720800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.414+0000 7f0311720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.414+0000 7f0311720800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.415+0000 7f0311720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.415+0000 7f0311720800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.415+0000 7f0311720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.415+0000 7f0311720800 20 started sync module instance, tier type = 2024-09-12T00:34:27.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.415+0000 7f0311720800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:34:27.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.423+0000 7f0311720800 20 add_watcher() i=0 2024-09-12T00:34:27.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.423+0000 7f0311720800 20 add_watcher() i=1 2024-09-12T00:34:27.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.423+0000 7f0311720800 20 add_watcher() i=2 2024-09-12T00:34:27.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.423+0000 7f0311720800 20 add_watcher() i=3 2024-09-12T00:34:27.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.423+0000 7f0311720800 20 add_watcher() i=4 2024-09-12T00:34:27.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.423+0000 7f0311720800 20 add_watcher() i=5 2024-09-12T00:34:27.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.423+0000 7f0311720800 20 add_watcher() i=6 2024-09-12T00:34:27.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.424+0000 7f0311720800 20 add_watcher() i=7 2024-09-12T00:34:27.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.424+0000 7f0311720800 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:27.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.426+0000 7f01c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:27.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.426+0000 7f0311720800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:27.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.426+0000 7f0311720800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:27.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.427+0000 7f0311720800 5 note: GC not initialized 2024-09-12T00:34:27.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.427+0000 7f01c27e4640 20 reqs_thread_entry: start 2024-09-12T00:34:27.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.427+0000 7f0311720800 20 init_complete bucket index max shards: 1 2024-09-12T00:34:27.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.427+0000 7f0311720800 20 Filter name: none 2024-09-12T00:34:27.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.427+0000 7f0133fff640 20 reqs_thread_entry: start 2024-09-12T00:34:27.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.427+0000 7f0311720800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.427+0000 7f0311720800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:27.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.427+0000 7f0311720800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.428+0000 7f0311720800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:34:27.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.428+0000 7f0311720800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:27.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.428+0000 7f0311720800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.428+0000 7f0311720800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:27.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.428+0000 7f0311720800 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.429+0000 7f0311720800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:34:27.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.429+0000 7f0311720800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:27.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.430+0000 7f01c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:27.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.432+0000 7f0311720800 20 remove_watcher() i=0 2024-09-12T00:34:27.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.432+0000 7f0311720800 2 removed watcher, disabling cache 2024-09-12T00:34:27.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.433+0000 7f0311720800 20 remove_watcher() i=1 2024-09-12T00:34:27.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.434+0000 7f0311720800 20 remove_watcher() i=2 2024-09-12T00:34:27.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.435+0000 7f0311720800 20 remove_watcher() i=3 2024-09-12T00:34:27.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.436+0000 7f0311720800 20 remove_watcher() i=4 2024-09-12T00:34:27.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.437+0000 7f0311720800 20 remove_watcher() i=5 2024-09-12T00:34:27.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.437+0000 7f0311720800 20 remove_watcher() i=6 2024-09-12T00:34:27.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:27.438+0000 7f0311720800 20 remove_watcher() i=7 2024-09-12T00:34:27.448 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:27.448 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:34:27.448 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-commit-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:34:27.448 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:27.784 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T00:34:27.784 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:28.601 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:34:28.629 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:28.629 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:28.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:28.667+0000 7f835e123800 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:28.669+0000 7f835e123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:28.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:28.669+0000 7f835e123800 20 realm 2024-09-12T00:34:28.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:28.669+0000 7f835e123800 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:28.669+0000 7f835e123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:28.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:28.669+0000 7f835e123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:28.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:28.669+0000 7f835e123800 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:28.669+0000 7f835e123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:28.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:28.669+0000 7f835e123800 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:28.670+0000 7f835e123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:28.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:28.670+0000 7f835e123800 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:28.671+0000 7f835e123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:28.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:28.671+0000 7f835e123800 20 searching for the correct realm 2024-09-12T00:34:28.672 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:28.672+0000 7f8353fff640 0 -- 172.21.15.133:0/2009214869 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f83440df070 msgr2=0x7f834404d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:28.876 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:28.877+0000 7f8353fff640 0 -- 172.21.15.133:0/2009214869 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f834c06c460 msgr2=0x7f834c06af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:29.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.084+0000 7f835e123800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:34:29.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.084+0000 7f835e123800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:34:29.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.084+0000 7f835e123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:29.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.084+0000 7f835e123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:29.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.084+0000 7f835e123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:29.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.084+0000 7f835e123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:29.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.084+0000 7f835e123800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.084+0000 7f835e123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.084+0000 7f835e123800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.084+0000 7f835e123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:29.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.084+0000 7f835e123800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.085+0000 7f835e123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:29.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.085+0000 7f835e123800 20 zone default found 2024-09-12T00:34:29.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.085+0000 7f835e123800 4 Realm: () 2024-09-12T00:34:29.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.085+0000 7f835e123800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:34:29.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.085+0000 7f835e123800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:34:29.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.085+0000 7f835e123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:29.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.085+0000 7f835e123800 20 zonegroup default 2024-09-12T00:34:29.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.085+0000 7f835e123800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.085+0000 7f835e123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.085+0000 7f835e123800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.085+0000 7f835e123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.085+0000 7f835e123800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.086+0000 7f835e123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.086+0000 7f835e123800 20 started sync module instance, tier type = 2024-09-12T00:34:29.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.086+0000 7f835e123800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:34:29.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.094+0000 7f835e123800 20 add_watcher() i=0 2024-09-12T00:34:29.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.094+0000 7f835e123800 20 add_watcher() i=1 2024-09-12T00:34:29.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.094+0000 7f835e123800 20 add_watcher() i=2 2024-09-12T00:34:29.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.094+0000 7f835e123800 20 add_watcher() i=3 2024-09-12T00:34:29.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.094+0000 7f835e123800 20 add_watcher() i=4 2024-09-12T00:34:29.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.094+0000 7f835e123800 20 add_watcher() i=5 2024-09-12T00:34:29.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.094+0000 7f835e123800 20 add_watcher() i=6 2024-09-12T00:34:29.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.095+0000 7f835e123800 20 add_watcher() i=7 2024-09-12T00:34:29.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.095+0000 7f835e123800 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:29.096 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.097+0000 7f820b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:29.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.097+0000 7f835e123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:29.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.097+0000 7f835e123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:29.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.097+0000 7f835e123800 5 note: GC not initialized 2024-09-12T00:34:29.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.098+0000 7f820a7fc640 20 reqs_thread_entry: start 2024-09-12T00:34:29.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.098+0000 7f835e123800 20 init_complete bucket index max shards: 1 2024-09-12T00:34:29.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.098+0000 7f835e123800 20 Filter name: none 2024-09-12T00:34:29.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.098+0000 7f817bfff640 20 reqs_thread_entry: start 2024-09-12T00:34:29.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.098+0000 7f835e123800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.099+0000 7f835e123800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:29.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.099+0000 7f835e123800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.099+0000 7f835e123800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:34:29.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.100+0000 7f835e123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:29.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.100+0000 7f835e123800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.100+0000 7f835e123800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:29.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.100+0000 7f835e123800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.100+0000 7f835e123800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:34:29.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.100+0000 7f835e123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:29.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.101+0000 7f820b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:29.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.104+0000 7f835e123800 20 remove_watcher() i=0 2024-09-12T00:34:29.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.104+0000 7f835e123800 2 removed watcher, disabling cache 2024-09-12T00:34:29.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.105+0000 7f835e123800 20 remove_watcher() i=1 2024-09-12T00:34:29.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.106+0000 7f835e123800 20 remove_watcher() i=2 2024-09-12T00:34:29.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.107+0000 7f835e123800 20 remove_watcher() i=3 2024-09-12T00:34:29.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.108+0000 7f835e123800 20 remove_watcher() i=4 2024-09-12T00:34:29.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.109+0000 7f835e123800 20 remove_watcher() i=5 2024-09-12T00:34:29.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.110+0000 7f835e123800 20 remove_watcher() i=6 2024-09-12T00:34:29.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.111+0000 7f835e123800 20 remove_watcher() i=7 2024-09-12T00:34:29.119 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.120 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:34:29.120 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-commit-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:34:29.120 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.121 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T00:34:29.155 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:29.155 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:29.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.193+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.194+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.194+0000 7f993612c800 20 realm 2024-09-12T00:34:29.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.194+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.195+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.195+0000 7f993612c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:29.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.195+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.195+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.195+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.195 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.196+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:29.195 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.196+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.195 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.196+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:29.195 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.196+0000 7f993612c800 20 searching for the correct realm 2024-09-12T00:34:29.197 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.199+0000 7f99326ae640 0 -- 172.21.15.133:0/2942212293 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x5609954d6ee0 msgr2=0x5609954d92d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:29.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.201+0000 7f99316ac640 0 -- 172.21.15.133:0/2942212293 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f9924087ec0 msgr2=0x7f9924076320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:29.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:34:29.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:34:29.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:29.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:29.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:29.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:29.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.407+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.408+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.408+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.408+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:29.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.408+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.408+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:29.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.408+0000 7f993612c800 20 zone default found 2024-09-12T00:34:29.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.408+0000 7f993612c800 4 Realm: () 2024-09-12T00:34:29.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.408+0000 7f993612c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:34:29.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.408+0000 7f993612c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:34:29.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.408+0000 7f993612c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:29.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.408+0000 7f993612c800 20 zonegroup default 2024-09-12T00:34:29.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.408+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.409+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.409+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.409+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.409+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.410+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.410+0000 7f993612c800 20 started sync module instance, tier type = 2024-09-12T00:34:29.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.410+0000 7f993612c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:34:29.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=0 2024-09-12T00:34:29.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=1 2024-09-12T00:34:29.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=2 2024-09-12T00:34:29.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=3 2024-09-12T00:34:29.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=4 2024-09-12T00:34:29.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=5 2024-09-12T00:34:29.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.419+0000 7f993612c800 20 add_watcher() i=6 2024-09-12T00:34:29.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.419+0000 7f993612c800 20 add_watcher() i=7 2024-09-12T00:34:29.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.419+0000 7f993612c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:29.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.421+0000 7f97e3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:29.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.422+0000 7f993612c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:29.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.422+0000 7f993612c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:29.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.422+0000 7f993612c800 5 note: GC not initialized 2024-09-12T00:34:29.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.422+0000 7f97e2ffd640 20 reqs_thread_entry: start 2024-09-12T00:34:29.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.422+0000 7f993612c800 20 init_complete bucket index max shards: 1 2024-09-12T00:34:29.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.422+0000 7f993612c800 20 Filter name: none 2024-09-12T00:34:29.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.422+0000 7f97e0ff9640 20 reqs_thread_entry: start 2024-09-12T00:34:29.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.422+0000 7f993612c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:34:29.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.422+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.423+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:29.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.423+0000 7f993612c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:34:29.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.423+0000 7f993612c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:34:29.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.423+0000 7f993612c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 : miss 2024-09-12T00:34:29.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.423+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.423+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:34:29.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.423+0000 7f993612c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:34:29.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.423+0000 7f993612c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:34:29.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.423+0000 7f993612c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:29.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.423+0000 7f993612c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:29.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.423+0000 7f993612c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 2024-09-12T00:34:29.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.427+0000 7f993612c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:34:29.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.427+0000 7f993612c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:34:29.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.427+0000 7f993612c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:29.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.427+0000 7f993612c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33, ofs0, ns] 2024-09-12T00:34:29.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.427+0000 7f98157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497047 cookie 94599159606992 notifier 7010 bl.length()=1015 2024-09-12T00:34:29.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.427+0000 7f98157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:34:29.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.427+0000 7f98157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:34:29.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.427+0000 7f98157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:29.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.429+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_sources= new_sources= 2024-09-12T00:34:29.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.429+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential sources added=[] removed=[] 2024-09-12T00:34:29.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.429+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_dests= new_dests= 2024-09-12T00:34:29.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.429+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential dests added=[] removed=[] 2024-09-12T00:34:29.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.431+0000 7f993612c800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.0 2024-09-12T00:34:29.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.431+0000 7f993612c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.0 2024-09-12T00:34:29.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.431+0000 7f993612c800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.1 2024-09-12T00:34:29.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.431+0000 7f993612c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.1 2024-09-12T00:34:29.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.431+0000 7f993612c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.0 2024-09-12T00:34:29.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.433+0000 7f993612c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:29.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.433+0000 7f993612c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 2024-09-12T00:34:29.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.434+0000 7f993612c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:34:29.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.434+0000 7f993612c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:34:29.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.434+0000 7f993612c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:29.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.434+0000 7f993612c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33, ofs0, ns] 2024-09-12T00:34:29.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.435+0000 7f98157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497048 cookie 94599159606992 notifier 7010 bl.length()=1015 2024-09-12T00:34:29.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.435+0000 7f98157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:34:29.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.435+0000 7f98157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:34:29.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.435+0000 7f98157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:29.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.436+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_sources= new_sources= 2024-09-12T00:34:29.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.436+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential sources added=[] removed=[] 2024-09-12T00:34:29.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.436+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_dests= new_dests= 2024-09-12T00:34:29.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.436+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential dests added=[] removed=[] 2024-09-12T00:34:29.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.437+0000 7f993612c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.0 2024-09-12T00:34:29.436 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f993612c800 time 2024-09-12T00:34:29.439234+0000 2024-09-12T00:34:29.437 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:29.437 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:29.437 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f993798c71a] 2024-09-12T00:34:29.437 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f993798c8d8] 2024-09-12T00:34:29.438 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560994570641] 2024-09-12T00:34:29.438 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x560994580637] 2024-09-12T00:34:29.438 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:34:29.438 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9936629590] 2024-09-12T00:34:29.438 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:34:29.438 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:34:29.438 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.439+0000 7f993612c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f993612c800 time 2024-09-12T00:34:29.439234+0000 2024-09-12T00:34:29.438 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:29.438 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.438 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:29.438 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f993798c71a] 2024-09-12T00:34:29.438 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f993798c8d8] 2024-09-12T00:34:29.438 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560994570641] 2024-09-12T00:34:29.439 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x560994580637] 2024-09-12T00:34:29.439 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:34:29.439 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9936629590] 2024-09-12T00:34:29.439 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:34:29.439 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:34:29.439 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.439 INFO:tasks.workunit.client.0.smithi133.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:34:29.439 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f993612c800 thread_name:radosgw-admin 2024-09-12T00:34:29.465 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:29.465 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f993663e6f0] 2024-09-12T00:34:29.465 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f993668b99c] 2024-09-12T00:34:29.465 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:34:29.465 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:34:29.466 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f993798c774] 2024-09-12T00:34:29.466 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f993798c8d8] 2024-09-12T00:34:29.466 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560994570641] 2024-09-12T00:34:29.466 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x560994580637] 2024-09-12T00:34:29.466 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:34:29.466 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9936629590] 2024-09-12T00:34:29.466 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:34:29.466 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:34:29.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.439+0000 7f993612c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:34:29.466 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f993612c800 thread_name:radosgw-admin 2024-09-12T00:34:29.466 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.466 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:29.467 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f993663e6f0] 2024-09-12T00:34:29.467 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f993668b99c] 2024-09-12T00:34:29.467 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:34:29.467 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:34:29.467 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f993798c774] 2024-09-12T00:34:29.467 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f993798c8d8] 2024-09-12T00:34:29.467 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560994570641] 2024-09-12T00:34:29.467 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x560994580637] 2024-09-12T00:34:29.467 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:34:29.468 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9936629590] 2024-09-12T00:34:29.468 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:34:29.468 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:34:29.468 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:34:29.468 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.468 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:34:29.468 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e77e0) adding con mode: crc 2024-09-12T00:34:29.468 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e77e0) adding con mode: secure 2024-09-12T00:34:29.469 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:34:29.177+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.469 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:34:29.177+0000 7f993612c800 1 librados: starting msgr at 2024-09-12T00:34:29.469 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:34:29.177+0000 7f993612c800 1 librados: starting objecter 2024-09-12T00:34:29.469 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:34:29.177+0000 7f993612c800 5 asok(0x5609951c1630) register_command objecter_requests hook 0x56099540ba40 2024-09-12T00:34:29.469 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:34:29.177+0000 7f993612c800 1 librados: setting wanted keys 2024-09-12T00:34:29.469 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:34:29.177+0000 7f993612c800 1 librados: calling monclient init 2024-09-12T00:34:29.469 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:34:29.177+0000 7f993612c800 10 monclient: init 2024-09-12T00:34:29.469 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding auth protocol: cephx 2024-09-12T00:34:29.469 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding auth protocol: cephx 2024-09-12T00:34:29.469 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding auth protocol: cephx 2024-09-12T00:34:29.470 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: secure 2024-09-12T00:34:29.470 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: crc 2024-09-12T00:34:29.470 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: secure 2024-09-12T00:34:29.470 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: crc 2024-09-12T00:34:29.470 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: secure 2024-09-12T00:34:29.470 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: crc 2024-09-12T00:34:29.470 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: crc 2024-09-12T00:34:29.470 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: secure 2024-09-12T00:34:29.470 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: crc 2024-09-12T00:34:29.470 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: secure 2024-09-12T00:34:29.470 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: crc 2024-09-12T00:34:29.470 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: secure 2024-09-12T00:34:29.470 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:34:29.177+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.471 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:34:29.177+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.471 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:34:29.178+0000 7f993612c800 5 asok(0x5609951c1630) register_command rotate-key hook 0x5609953e1c68 2024-09-12T00:34:29.471 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient: _reopen_session rank -1 2024-09-12T00:34:29.471 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:34:29.471 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): picked mon.noname-a con 0x56099528ffa0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:34:29.471 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): picked mon.noname-c con 0x560995298d50 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:34:29.471 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): picked mon.noname-b con 0x5609953248e0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:34:29.471 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.471 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.471 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.471 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): _renew_subs 2024-09-12T00:34:29.471 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): authenticate will time out at 2077.750112s 2024-09-12T00:34:29.471 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:34:29.178+0000 7f99316ac640 10 monclient(hunting): get_auth_request con 0x560995298d50 auth_method 0 2024-09-12T00:34:29.471 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:34:29.178+0000 7f99316ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.472 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:34:29.178+0000 7f99316ac640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.472 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:34:29.178+0000 7f99316ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.472 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): get_auth_request con 0x56099528ffa0 auth_method 0 2024-09-12T00:34:29.472 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.472 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.472 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.472 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:34:29.178+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.472 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:34:29.178+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.472 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:34:29.178+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.472 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.472 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.472 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.472 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): handle_auth_done global_id 7452 payload 824 2024-09-12T00:34:29.473 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient: _finish_hunting 0 2024-09-12T00:34:29.473 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:34:29.178+0000 7f9931ead640 1 monclient: found mon.noname-a 2024-09-12T00:34:29.473 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:34:29.473 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.473 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:29.473 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: dump: 2024-09-12T00:34:29.473 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.473 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.473 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.473 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.473 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.473 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.473 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.474 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.474 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.474 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.474 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: _finish_auth 0 2024-09-12T00:34:29.474 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: _check_auth_tickets 2024-09-12T00:34:29.474 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:29.474 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.474 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:29.474 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: dump: 2024-09-12T00:34:29.474 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.474 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.474 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.475 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.475 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.475 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.475 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.475 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.475 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.475 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.475 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:34:29.178+0000 7f993612c800 5 monclient: authenticate success, global_id 7452 2024-09-12T00:34:29.475 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient: _renew_subs 2024-09-12T00:34:29.475 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:34:29.475 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:34:29.178+0000 7f981fe07640 4 set_mon_vals no callback set 2024-09-12T00:34:29.475 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient: _renew_subs 2024-09-12T00:34:29.476 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:34:29.476 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:34:29.178+0000 7f993612c800 1 librados: init done 2024-09-12T00:34:29.476 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:34:29.180+0000 7f981e604640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:34:29.476 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:34:29.180+0000 7f981e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:34:29.476 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:34:29.180+0000 7f981e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:34:29.476 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:34:29.180+0000 7f99316ac640 10 monclient: get_auth_request con 0x7f9818076470 auth_method 0 2024-09-12T00:34:29.476 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:34:29.181+0000 7f99326ae640 10 monclient: get_auth_request con 0x560995423e00 auth_method 0 2024-09-12T00:34:29.476 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:34:29.181+0000 7f9931ead640 10 monclient: get_auth_request con 0x56099542d7c0 auth_method 0 2024-09-12T00:34:29.476 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:34:29.182+0000 7f99316ac640 10 monclient: get_auth_request con 0x5609954319b0 auth_method 0 2024-09-12T00:34:29.476 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:34:29.183+0000 7f99326ae640 10 monclient: get_auth_request con 0x560995431070 auth_method 0 2024-09-12T00:34:29.476 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:34:29.183+0000 7f993612c800 10 monclient: build_initial_monmap 2024-09-12T00:34:29.476 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:34:29.183+0000 7f993612c800 1 build_initial for_mkfs: 0 2024-09-12T00:34:29.477 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:34:29.183+0000 7f993612c800 10 monclient: monmap: 2024-09-12T00:34:29.477 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:34:29.477 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:29.477 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:34:29.477 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:34:29.477 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:29.477 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.477 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:34:29.477 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:34:29.477 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:34:29.477 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.477 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding auth protocol: cephx 2024-09-12T00:34:29.477 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding auth protocol: cephx 2024-09-12T00:34:29.478 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding auth protocol: cephx 2024-09-12T00:34:29.478 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: secure 2024-09-12T00:34:29.478 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: crc 2024-09-12T00:34:29.478 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: secure 2024-09-12T00:34:29.478 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: crc 2024-09-12T00:34:29.478 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: secure 2024-09-12T00:34:29.478 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: crc 2024-09-12T00:34:29.478 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: crc 2024-09-12T00:34:29.478 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: secure 2024-09-12T00:34:29.478 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: crc 2024-09-12T00:34:29.478 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: secure 2024-09-12T00:34:29.478 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: crc 2024-09-12T00:34:29.478 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: secure 2024-09-12T00:34:29.478 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:34:29.184+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.479 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:34:29.184+0000 7f993612c800 5 asok(0x5609951c1630) register_command objecter_requests cmddesc objecter_requests hook 0x56099543d520 EEXIST 2024-09-12T00:34:29.479 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:34:29.184+0000 7f993612c800 10 monclient: init 2024-09-12T00:34:29.479 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding auth protocol: cephx 2024-09-12T00:34:29.479 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding auth protocol: cephx 2024-09-12T00:34:29.479 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding auth protocol: cephx 2024-09-12T00:34:29.479 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: secure 2024-09-12T00:34:29.479 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: crc 2024-09-12T00:34:29.479 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: secure 2024-09-12T00:34:29.479 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: crc 2024-09-12T00:34:29.479 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: secure 2024-09-12T00:34:29.479 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: crc 2024-09-12T00:34:29.479 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: crc 2024-09-12T00:34:29.479 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: secure 2024-09-12T00:34:29.480 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: crc 2024-09-12T00:34:29.480 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: secure 2024-09-12T00:34:29.480 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: crc 2024-09-12T00:34:29.480 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: secure 2024-09-12T00:34:29.480 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:34:29.184+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.480 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:34:29.184+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.480 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:34:29.184+0000 7f993612c800 5 asok(0x5609951c1630) register_command rotate-key cmddesc rotate-key hook 0x560995438bb0 EEXIST 2024-09-12T00:34:29.480 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:34:29.184+0000 7f993612c800 10 monclient: _reopen_session rank -1 2024-09-12T00:34:29.480 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:34:29.480 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): picked mon.noname-b con 0x560995461210 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:34:29.480 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): picked mon.noname-c con 0x5609954634e0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:34:29.480 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): picked mon.noname-a con 0x56099545f9e0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:34:29.481 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.481 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.481 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.481 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): _renew_subs 2024-09-12T00:34:29.481 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): authenticate will time out at 2077.757060s 2024-09-12T00:34:29.481 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): get_auth_request con 0x56099545f9e0 auth_method 0 2024-09-12T00:34:29.481 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.481 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.481 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.481 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:34:29.185+0000 7f99326ae640 10 monclient(hunting): get_auth_request con 0x5609954634e0 auth_method 0 2024-09-12T00:34:29.482 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:34:29.185+0000 7f99326ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.482 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:34:29.185+0000 7f99326ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.482 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:34:29.185+0000 7f99326ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.482 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.482 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.482 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.482 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:34:29.185+0000 7f99316ac640 10 monclient(hunting): get_auth_request con 0x560995461210 auth_method 0 2024-09-12T00:34:29.482 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:34:29.185+0000 7f99316ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.482 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:34:29.185+0000 7f99316ac640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.482 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:34:29.185+0000 7f99316ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.482 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:34:29.185+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.482 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:34:29.185+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.482 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:34:29.185+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.482 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:34:29.185+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.483 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:34:29.185+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.483 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:34:29.185+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.483 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): handle_auth_done global_id 7455 payload 824 2024-09-12T00:34:29.483 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient: _finish_hunting 0 2024-09-12T00:34:29.483 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:34:29.185+0000 7f9931ead640 1 monclient: found mon.noname-a 2024-09-12T00:34:29.483 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:34:29.483 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.483 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:29.483 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: dump: 2024-09-12T00:34:29.483 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.483 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.483 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.484 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.484 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.484 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.484 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.484 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.484 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.484 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.484 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: _finish_auth 0 2024-09-12T00:34:29.484 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: _check_auth_tickets 2024-09-12T00:34:29.484 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:29.484 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.484 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:29.484 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: dump: 2024-09-12T00:34:29.484 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.485 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.486 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:34:29.185+0000 7f993612c800 5 monclient: authenticate success, global_id 7455 2024-09-12T00:34:29.486 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient: _renew_subs 2024-09-12T00:34:29.486 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:34:29.486 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:34:29.185+0000 7f9932eaf640 4 set_mon_vals no callback set 2024-09-12T00:34:29.486 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient: _renew_subs 2024-09-12T00:34:29.486 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:34:29.486 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:34:29.187+0000 7f98177fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:34:29.486 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:34:29.187+0000 7f98177fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:34:29.486 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:34:29.187+0000 7f98177fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:34:29.486 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:34:29.187+0000 7f99316ac640 10 monclient: get_auth_request con 0x7f980c076380 auth_method 0 2024-09-12T00:34:29.486 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:34:29.187+0000 7f993612c800 10 monclient: get_monmap_and_config 2024-09-12T00:34:29.486 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:34:29.187+0000 7f993612c800 10 monclient: build_initial_monmap 2024-09-12T00:34:29.486 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:34:29.187+0000 7f993612c800 1 build_initial for_mkfs: 0 2024-09-12T00:34:29.486 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:34:29.187+0000 7f993612c800 10 monclient: monmap: 2024-09-12T00:34:29.487 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:34:29.487 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:29.487 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:34:29.487 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:34:29.487 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:29.487 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.487 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:34:29.488 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:34:29.488 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:34:29.488 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.488 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding auth protocol: cephx 2024-09-12T00:34:29.488 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding auth protocol: cephx 2024-09-12T00:34:29.488 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding auth protocol: cephx 2024-09-12T00:34:29.488 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: secure 2024-09-12T00:34:29.488 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: crc 2024-09-12T00:34:29.489 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: secure 2024-09-12T00:34:29.489 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: crc 2024-09-12T00:34:29.489 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: secure 2024-09-12T00:34:29.489 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: crc 2024-09-12T00:34:29.490 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: crc 2024-09-12T00:34:29.490 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: secure 2024-09-12T00:34:29.490 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: crc 2024-09-12T00:34:29.490 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: secure 2024-09-12T00:34:29.490 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: crc 2024-09-12T00:34:29.490 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: secure 2024-09-12T00:34:29.490 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:34:29.188+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.491 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient: init 2024-09-12T00:34:29.491 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding auth protocol: cephx 2024-09-12T00:34:29.491 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding auth protocol: cephx 2024-09-12T00:34:29.491 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding auth protocol: cephx 2024-09-12T00:34:29.491 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: secure 2024-09-12T00:34:29.491 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: crc 2024-09-12T00:34:29.491 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: secure 2024-09-12T00:34:29.491 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: crc 2024-09-12T00:34:29.492 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: secure 2024-09-12T00:34:29.492 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: crc 2024-09-12T00:34:29.492 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: crc 2024-09-12T00:34:29.492 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: secure 2024-09-12T00:34:29.492 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: crc 2024-09-12T00:34:29.493 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: secure 2024-09-12T00:34:29.493 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: crc 2024-09-12T00:34:29.493 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: secure 2024-09-12T00:34:29.493 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:34:29.188+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.493 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:34:29.188+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.494 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:34:29.188+0000 7f993612c800 5 asok(0x5609951c1630) register_command rotate-key cmddesc rotate-key hook 0x7fffde5b5e08 EEXIST 2024-09-12T00:34:29.494 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient: _reopen_session rank -1 2024-09-12T00:34:29.494 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:34:29.494 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): picked mon.noname-a con 0x5609954b5040 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:34:29.494 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): picked mon.noname-b con 0x5609954af5e0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:34:29.494 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): picked mon.noname-c con 0x560995484e80 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:34:29.494 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.495 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.495 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.495 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): _renew_subs 2024-09-12T00:34:29.495 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): authenticate will time out at 2077.760705s 2024-09-12T00:34:29.495 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): get_auth_request con 0x5609954b5040 auth_method 0 2024-09-12T00:34:29.495 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.496 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.496 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.496 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:34:29.188+0000 7f9931ead640 10 monclient(hunting): get_auth_request con 0x560995484e80 auth_method 0 2024-09-12T00:34:29.496 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:34:29.188+0000 7f9931ead640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.496 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:34:29.188+0000 7f9931ead640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.496 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:34:29.188+0000 7f9931ead640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.496 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:34:29.188+0000 7f99326ae640 10 monclient(hunting): get_auth_request con 0x5609954af5e0 auth_method 0 2024-09-12T00:34:29.497 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:34:29.188+0000 7f99326ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.497 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:34:29.188+0000 7f99326ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.497 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:34:29.188+0000 7f99326ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.497 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.497 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.497 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.497 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:34:29.188+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.499 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:34:29.188+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.500 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:34:29.188+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.500 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:34:29.188+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.500 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:34:29.188+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.500 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:34:29.188+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.501 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): handle_auth_done global_id 7458 payload 274 2024-09-12T00:34:29.501 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:34:29.189+0000 7f99316ac640 10 monclient: _finish_hunting 0 2024-09-12T00:34:29.501 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:34:29.189+0000 7f99316ac640 1 monclient: found mon.noname-a 2024-09-12T00:34:29.501 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:34:29.189+0000 7f99316ac640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:34:29.501 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.501 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:29.501 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: dump: 2024-09-12T00:34:29.502 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.502 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.502 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.502 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.502 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.502 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.502 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.502 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.502 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.503 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.503 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: _finish_auth 0 2024-09-12T00:34:29.503 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: _check_auth_tickets 2024-09-12T00:34:29.503 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:29.503 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.503 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:29.503 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: dump: 2024-09-12T00:34:29.503 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.503 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.503 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.503 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.503 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.503 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.504 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.504 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.504 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.504 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.504 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:34:29.189+0000 7f993612c800 5 monclient: authenticate success, global_id 7458 2024-09-12T00:34:29.504 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:34:29.189+0000 7f993612c800 10 monclient: get_monmap_and_config success 2024-09-12T00:34:29.504 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:34:29.189+0000 7f993612c800 4 set_mon_vals no callback set 2024-09-12T00:34:29.504 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:34:29.189+0000 7f993612c800 10 monclient: shutdown 2024-09-12T00:34:29.504 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient: build_initial_monmap 2024-09-12T00:34:29.504 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:34:29.190+0000 7f993612c800 1 build_initial for_mkfs: 0 2024-09-12T00:34:29.504 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient: monmap: 2024-09-12T00:34:29.504 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:34:29.504 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:29.505 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:34:29.505 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:34:29.505 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:29.505 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.505 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:34:29.505 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:34:29.505 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:34:29.505 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.505 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding auth protocol: cephx 2024-09-12T00:34:29.505 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding auth protocol: cephx 2024-09-12T00:34:29.505 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding auth protocol: cephx 2024-09-12T00:34:29.505 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: secure 2024-09-12T00:34:29.505 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: crc 2024-09-12T00:34:29.505 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: secure 2024-09-12T00:34:29.506 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: crc 2024-09-12T00:34:29.506 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: secure 2024-09-12T00:34:29.506 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: crc 2024-09-12T00:34:29.506 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: crc 2024-09-12T00:34:29.506 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: secure 2024-09-12T00:34:29.506 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: crc 2024-09-12T00:34:29.506 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: secure 2024-09-12T00:34:29.506 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: crc 2024-09-12T00:34:29.506 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: secure 2024-09-12T00:34:29.506 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:34:29.190+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.506 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:34:29.190+0000 7f993612c800 1 librados: starting msgr at 2024-09-12T00:34:29.506 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:34:29.190+0000 7f993612c800 1 librados: starting objecter 2024-09-12T00:34:29.506 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:34:29.190+0000 7f993612c800 5 asok(0x5609951c1630) register_command objecter_requests cmddesc objecter_requests hook 0x5609954b0d40 EEXIST 2024-09-12T00:34:29.507 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:34:29.190+0000 7f993612c800 1 librados: setting wanted keys 2024-09-12T00:34:29.507 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:34:29.190+0000 7f993612c800 1 librados: calling monclient init 2024-09-12T00:34:29.507 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient: init 2024-09-12T00:34:29.507 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding auth protocol: cephx 2024-09-12T00:34:29.507 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding auth protocol: cephx 2024-09-12T00:34:29.507 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding auth protocol: cephx 2024-09-12T00:34:29.507 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: secure 2024-09-12T00:34:29.507 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: crc 2024-09-12T00:34:29.507 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: secure 2024-09-12T00:34:29.507 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: crc 2024-09-12T00:34:29.507 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: secure 2024-09-12T00:34:29.507 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: crc 2024-09-12T00:34:29.507 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: crc 2024-09-12T00:34:29.507 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: secure 2024-09-12T00:34:29.508 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: crc 2024-09-12T00:34:29.508 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: secure 2024-09-12T00:34:29.508 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: crc 2024-09-12T00:34:29.508 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: secure 2024-09-12T00:34:29.508 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:34:29.190+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.508 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:34:29.190+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.508 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:34:29.190+0000 7f993612c800 5 asok(0x5609951c1630) register_command rotate-key cmddesc rotate-key hook 0x560995479108 EEXIST 2024-09-12T00:34:29.508 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient: _reopen_session rank -1 2024-09-12T00:34:29.508 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:34:29.508 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): picked mon.noname-c con 0x560995484e80 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:34:29.508 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): picked mon.noname-b con 0x5609954af5e0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:34:29.508 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): picked mon.noname-a con 0x5609954b5040 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:34:29.508 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): _renew_subs 2024-09-12T00:34:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): authenticate will time out at 2077.762962s 2024-09-12T00:34:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): get_auth_request con 0x560995484e80 auth_method 0 2024-09-12T00:34:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:34:29.191+0000 7f9931ead640 10 monclient(hunting): get_auth_request con 0x5609954b5040 auth_method 0 2024-09-12T00:34:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:34:29.191+0000 7f9931ead640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:34:29.191+0000 7f9931ead640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:34:29.191+0000 7f9931ead640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:34:29.191+0000 7f99326ae640 10 monclient(hunting): get_auth_request con 0x5609954af5e0 auth_method 0 2024-09-12T00:34:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:34:29.191+0000 7f99326ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:34:29.191+0000 7f99326ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:34:29.191+0000 7f99326ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:34:29.191+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:34:29.191+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:34:29.191+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:34:29.191+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:34:29.191+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:34:29.191+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.511 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): handle_auth_done global_id 7010 payload 824 2024-09-12T00:34:29.511 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient: _finish_hunting 0 2024-09-12T00:34:29.511 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:34:29.191+0000 7f99316ac640 1 monclient: found mon.noname-c 2024-09-12T00:34:29.511 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:34:29.511 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.511 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:29.511 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: dump: 2024-09-12T00:34:29.511 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.511 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.511 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.511 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.511 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.511 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.512 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.512 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.512 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.512 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.512 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: _finish_auth 0 2024-09-12T00:34:29.512 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: _check_auth_tickets 2024-09-12T00:34:29.512 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:29.512 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.512 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:29.512 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: dump: 2024-09-12T00:34:29.512 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.512 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.512 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.513 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.513 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.513 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.513 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.513 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.513 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.513 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.513 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:34:29.191+0000 7f993612c800 5 monclient: authenticate success, global_id 7010 2024-09-12T00:34:29.513 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:34:29.191+0000 7f993612c800 10 monclient: _renew_subs 2024-09-12T00:34:29.513 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:34:29.191+0000 7f98157fa640 4 set_mon_vals no callback set 2024-09-12T00:34:29.513 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:34:29.191+0000 7f993612c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:34:29.513 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:34:29.191+0000 7f993612c800 10 monclient: _renew_subs 2024-09-12T00:34:29.513 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:34:29.191+0000 7f993612c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:34:29.513 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:34:29.191+0000 7f993612c800 1 librados: init done 2024-09-12T00:34:29.514 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:34:29.191+0000 7f993612c800 5 asok(0x5609951c1630) register_command cr dump hook 0x5609954c2b78 2024-09-12T00:34:29.514 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:34:29.193+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.514 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:34:29.193+0000 7f98037fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:34:29.514 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:34:29.193+0000 7f98037fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:34:29.514 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:34:29.193+0000 7f98037fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:34:29.514 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:34:29.194+0000 7f99326ae640 10 monclient: get_auth_request con 0x7f97fc076470 auth_method 0 2024-09-12T00:34:29.514 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:34:29.194+0000 7f9931ead640 10 monclient: get_auth_request con 0x5609954cf410 auth_method 0 2024-09-12T00:34:29.514 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:34:29.194+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.514 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:34:29.194+0000 7f993612c800 20 realm 2024-09-12T00:34:29.514 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:34:29.194+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.514 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:34:29.195+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.514 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:34:29.195+0000 7f993612c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:29.514 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:34:29.195+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.515 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:34:29.195+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.515 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:34:29.195+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.515 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:34:29.195+0000 7f99316ac640 10 monclient: get_auth_request con 0x5609954d3680 auth_method 0 2024-09-12T00:34:29.515 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:34:29.196+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:29.515 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:34:29.196+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.515 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:34:29.196+0000 7f99326ae640 10 monclient: get_auth_request con 0x5609954d6ee0 auth_method 0 2024-09-12T00:34:29.515 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:34:29.196+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:29.515 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:34:29.196+0000 7f993612c800 20 searching for the correct realm 2024-09-12T00:34:29.515 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:34:29.197+0000 7f9931ead640 10 monclient: get_auth_request con 0x7f992c07d040 auth_method 0 2024-09-12T00:34:29.515 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:34:29.198+0000 7f99316ac640 10 monclient: get_auth_request con 0x7f991c050070 auth_method 0 2024-09-12T00:34:29.515 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:34:29.199+0000 7f99326ae640 0 -- 172.21.15.133:0/2942212293 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x5609954d6ee0 msgr2=0x5609954d92d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:29.515 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:34:29.199+0000 7f98037fe640 1 client.7010.objecter ms_handle_reset 0x5609954d6ee0 session 0x5609954d29d0 osd.4 2024-09-12T00:34:29.515 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:34:29.199+0000 7f98037fe640 10 monclient: _renew_subs 2024-09-12T00:34:29.516 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:34:29.199+0000 7f98037fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:34:29.516 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:34:29.199+0000 7f99326ae640 10 monclient: get_auth_request con 0x7f97fc086720 auth_method 0 2024-09-12T00:34:29.516 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:34:29.199+0000 7f99326ae640 10 monclient: get_auth_request con 0x7f992c065420 auth_method 0 2024-09-12T00:34:29.516 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:34:29.201+0000 7f9931ead640 10 monclient: get_auth_request con 0x7f991c017070 auth_method 0 2024-09-12T00:34:29.516 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:34:29.201+0000 7f99316ac640 10 monclient: get_auth_request con 0x7f9924087ec0 auth_method 0 2024-09-12T00:34:29.516 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:34:29.201+0000 7f99316ac640 0 -- 172.21.15.133:0/2942212293 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f9924087ec0 msgr2=0x7f9924076320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:29.516 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:34:29.402+0000 7f99316ac640 10 monclient: get_auth_request con 0x7f9924087ec0 auth_method 0 2024-09-12T00:34:29.516 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:34:29.516 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:34:29.516 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:29.516 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:29.516 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:29.516 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:29.517 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:34:29.407+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.517 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:34:29.408+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.517 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:34:29.408+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.517 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:34:29.408+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:29.517 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:34:29.408+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.517 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:34:29.408+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:29.517 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:34:29.408+0000 7f993612c800 20 zone default found 2024-09-12T00:34:29.517 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:34:29.408+0000 7f993612c800 4 Realm: () 2024-09-12T00:34:29.517 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:34:29.408+0000 7f993612c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:34:29.517 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:34:29.408+0000 7f993612c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:34:29.517 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:34:29.408+0000 7f993612c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:29.517 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:34:29.408+0000 7f993612c800 20 zonegroup default 2024-09-12T00:34:29.517 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:34:29.408+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.517 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:34:29.409+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.518 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:34:29.409+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.518 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:34:29.409+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.518 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:34:29.409+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.518 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:34:29.410+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.518 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:34:29.410+0000 7f993612c800 20 started sync module instance, tier type = 2024-09-12T00:34:29.518 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:34:29.410+0000 7f993612c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:34:29.518 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=0 2024-09-12T00:34:29.518 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=1 2024-09-12T00:34:29.518 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=2 2024-09-12T00:34:29.518 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=3 2024-09-12T00:34:29.518 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=4 2024-09-12T00:34:29.518 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=5 2024-09-12T00:34:29.518 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:34:29.419+0000 7f993612c800 20 add_watcher() i=6 2024-09-12T00:34:29.519 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:34:29.419+0000 7f993612c800 20 add_watcher() i=7 2024-09-12T00:34:29.519 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:34:29.419+0000 7f993612c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:29.519 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding auth protocol: cephx 2024-09-12T00:34:29.519 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding auth protocol: cephx 2024-09-12T00:34:29.519 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding auth protocol: cephx 2024-09-12T00:34:29.519 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: secure 2024-09-12T00:34:29.519 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: crc 2024-09-12T00:34:29.519 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: secure 2024-09-12T00:34:29.519 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: crc 2024-09-12T00:34:29.519 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: secure 2024-09-12T00:34:29.519 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: crc 2024-09-12T00:34:29.519 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: crc 2024-09-12T00:34:29.519 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: secure 2024-09-12T00:34:29.519 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: crc 2024-09-12T00:34:29.520 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: secure 2024-09-12T00:34:29.520 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: crc 2024-09-12T00:34:29.520 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: secure 2024-09-12T00:34:29.520 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:34:29.421+0000 7f97e3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:29.520 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:34:29.422+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.520 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:34:29.422+0000 7f993612c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:29.520 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:34:29.422+0000 7f993612c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:29.520 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command cache list hook 0x5609954ae520 2024-09-12T00:34:29.520 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command cache inspect hook 0x5609954ae520 2024-09-12T00:34:29.520 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command cache erase hook 0x5609954ae520 2024-09-12T00:34:29.520 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command cache zap hook 0x5609954ae520 2024-09-12T00:34:29.520 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:34:29.422+0000 7f993612c800 5 note: GC not initialized 2024-09-12T00:34:29.520 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:34:29.422+0000 7f97e2ffd640 20 reqs_thread_entry: start 2024-09-12T00:34:29.521 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command sync trace show hook 0x7f991c00ced0 2024-09-12T00:34:29.521 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command sync trace history hook 0x7f991c00ced0 2024-09-12T00:34:29.521 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command sync trace active hook 0x7f991c00ced0 2024-09-12T00:34:29.521 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command sync trace active_short hook 0x7f991c00ced0 2024-09-12T00:34:29.521 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:34:29.422+0000 7f993612c800 20 init_complete bucket index max shards: 1 2024-09-12T00:34:29.521 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:34:29.422+0000 7f993612c800 20 Filter name: none 2024-09-12T00:34:29.521 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:34:29.422+0000 7f97e0ff9640 20 reqs_thread_entry: start 2024-09-12T00:34:29.521 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:34:29.422+0000 7f993612c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:34:29.521 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:34:29.422+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.521 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:34:29.423+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:29.521 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:34:29.423+0000 7f993612c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:34:29.521 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:34:29.423+0000 7f993612c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:34:29.521 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:34:29.423+0000 7f993612c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 : miss 2024-09-12T00:34:29.522 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:34:29.423+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.522 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:34:29.423+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:34:29.522 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:34:29.423+0000 7f993612c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:34:29.522 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:34:29.423+0000 7f993612c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:34:29.522 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:34:29.423+0000 7f993612c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:29.522 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:34:29.423+0000 7f993612c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:29.522 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:34:29.423+0000 7f993612c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 2024-09-12T00:34:29.522 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:34:29.427+0000 7f993612c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:34:29.522 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:34:29.427+0000 7f993612c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:34:29.522 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:34:29.427+0000 7f993612c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:29.522 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:34:29.427+0000 7f993612c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33, ofs0, ns] 2024-09-12T00:34:29.522 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:34:29.427+0000 7f98157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497047 cookie 94599159606992 notifier 7010 bl.length()=1015 2024-09-12T00:34:29.522 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:34:29.427+0000 7f98157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:34:29.522 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:34:29.427+0000 7f98157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:34:29.523 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:34:29.427+0000 7f98157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:29.523 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:34:29.429+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_sources= new_sources= 2024-09-12T00:34:29.523 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:34:29.429+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential sources added=[] removed=[] 2024-09-12T00:34:29.523 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:34:29.429+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_dests= new_dests= 2024-09-12T00:34:29.523 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:34:29.429+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential dests added=[] removed=[] 2024-09-12T00:34:29.523 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:34:29.431+0000 7f993612c800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.0 2024-09-12T00:34:29.523 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:34:29.431+0000 7f993612c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.0 2024-09-12T00:34:29.523 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:34:29.431+0000 7f993612c800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.1 2024-09-12T00:34:29.523 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:34:29.431+0000 7f993612c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.1 2024-09-12T00:34:29.523 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:34:29.431+0000 7f993612c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.0 2024-09-12T00:34:29.523 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:34:29.433+0000 7f993612c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:29.523 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:34:29.433+0000 7f993612c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 2024-09-12T00:34:29.523 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:34:29.434+0000 7f993612c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:34:29.524 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:34:29.434+0000 7f993612c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:34:29.524 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:34:29.434+0000 7f993612c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:29.524 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:34:29.434+0000 7f993612c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33, ofs0, ns] 2024-09-12T00:34:29.524 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:34:29.435+0000 7f98157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497048 cookie 94599159606992 notifier 7010 bl.length()=1015 2024-09-12T00:34:29.524 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:34:29.435+0000 7f98157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:34:29.524 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:34:29.435+0000 7f98157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:34:29.524 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:34:29.435+0000 7f98157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:29.524 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:34:29.436+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_sources= new_sources= 2024-09-12T00:34:29.524 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:34:29.436+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential sources added=[] removed=[] 2024-09-12T00:34:29.525 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:34:29.436+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_dests= new_dests= 2024-09-12T00:34:29.525 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:34:29.436+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential dests added=[] removed=[] 2024-09-12T00:34:29.525 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:34:29.437+0000 7f993612c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.0 2024-09-12T00:34:29.525 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:34:29.439+0000 7f993612c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f993612c800 time 2024-09-12T00:34:29.439234+0000 2024-09-12T00:34:29.525 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:29.525 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.525 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:29.525 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f993798c71a] 2024-09-12T00:34:29.525 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f993798c8d8] 2024-09-12T00:34:29.525 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560994570641] 2024-09-12T00:34:29.525 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x560994580637] 2024-09-12T00:34:29.525 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:34:29.525 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9936629590] 2024-09-12T00:34:29.526 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:34:29.526 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:34:29.526 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.526 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:34:29.439+0000 7f993612c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:34:29.526 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f993612c800 thread_name:radosgw-admin 2024-09-12T00:34:29.526 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.526 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:29.526 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f993663e6f0] 2024-09-12T00:34:29.526 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f993668b99c] 2024-09-12T00:34:29.526 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:34:29.526 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:34:29.526 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f993798c774] 2024-09-12T00:34:29.526 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f993798c8d8] 2024-09-12T00:34:29.526 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560994570641] 2024-09-12T00:34:29.527 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x560994580637] 2024-09-12T00:34:29.527 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:34:29.527 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9936629590] 2024-09-12T00:34:29.527 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:34:29.527 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:34:29.527 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:34:29.527 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.527 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:34:29.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:34:29.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:34:29.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:34:29.527 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:34:29.527 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:34:29.528 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:34:29.528 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:34:29.528 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:34:29.528 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:34:29.528 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:34:29.528 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:34:29.528 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:34:29.528 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:34:29.528 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:34:29.528 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:34:29.528 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:34:29.528 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:34:29.529 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:34:29.529 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:34:29.529 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:34:29.529 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:34:29.529 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:34:29.529 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:34:29.529 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:34:29.529 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:34:29.529 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:34:29.529 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:34:29.529 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:34:29.529 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:34:29.529 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:34:29.529 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:34:29.530 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:34:29.530 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:34:29.530 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:34:29.530 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:34:29.530 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:34:29.530 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:34:29.530 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:34:29.530 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:34:29.530 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:34:29.530 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:34:29.530 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:34:29.530 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:34:29.530 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:34:29.530 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:34:29.531 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:34:29.531 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:34:29.531 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:34:29.531 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:34:29.531 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:34:29.531 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:34:29.531 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:34:29.531 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:34:29.531 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:34:29.531 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:34:29.531 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:34:29.531 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:34:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:34:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:34:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:34:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:34:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:34:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:34:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:34:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:34:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:34:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:34:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:34:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:34:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:34:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:34:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:34:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:34:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:34:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:34:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:34:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:34:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:34:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:34:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:34:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:34:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:34:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:34:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:34:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:34:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:34:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:34:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:34:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:34:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:34:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:34:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:34:29.534 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:34:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 7f97e0ff9640 / http_manager 2024-09-12T00:34:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 7f97e2ffd640 / http_manager 2024-09-12T00:34:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 7f97e3fff640 / rgw_dt_lg_renew 2024-09-12T00:34:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: 7f98037fe640 / ms_dispatch 2024-09-12T00:34:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: 7f98157fa640 / io_context_pool 2024-09-12T00:34:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: 7f98177fe640 / ms_dispatch 2024-09-12T00:34:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: 7f981e604640 / ms_dispatch 2024-09-12T00:34:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: 7f981fe07640 / io_context_pool 2024-09-12T00:34:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: 7f99316ac640 / msgr-worker-2 2024-09-12T00:34:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: 7f9931ead640 / msgr-worker-1 2024-09-12T00:34:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: 7f99326ae640 / msgr-worker-0 2024-09-12T00:34:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: 7f9932eaf640 / io_context_pool 2024-09-12T00:34:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: 7f993612c800 / radosgw-admin 2024-09-12T00:34:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:34:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:34:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/log/ceph/ceph-client.admin.124139.log 2024-09-12T00:34:29.535 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:34:29.536 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:34:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e77e0) adding con mode: crc 2024-09-12T00:34:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e77e0) adding con mode: secure 2024-09-12T00:34:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:34:29.177+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:34:29.177+0000 7f993612c800 1 librados: starting msgr at 2024-09-12T00:34:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:34:29.177+0000 7f993612c800 1 librados: starting objecter 2024-09-12T00:34:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:34:29.177+0000 7f993612c800 5 asok(0x5609951c1630) register_command objecter_requests hook 0x56099540ba40 2024-09-12T00:34:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:34:29.177+0000 7f993612c800 1 librados: setting wanted keys 2024-09-12T00:34:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:34:29.177+0000 7f993612c800 1 librados: calling monclient init 2024-09-12T00:34:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:34:29.177+0000 7f993612c800 10 monclient: init 2024-09-12T00:34:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding auth protocol: cephx 2024-09-12T00:34:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding auth protocol: cephx 2024-09-12T00:34:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding auth protocol: cephx 2024-09-12T00:34:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: secure 2024-09-12T00:34:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: crc 2024-09-12T00:34:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: secure 2024-09-12T00:34:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: crc 2024-09-12T00:34:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: secure 2024-09-12T00:34:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: crc 2024-09-12T00:34:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: crc 2024-09-12T00:34:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: secure 2024-09-12T00:34:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: crc 2024-09-12T00:34:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: secure 2024-09-12T00:34:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: crc 2024-09-12T00:34:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:34:29.177+0000 7f993612c800 5 AuthRegistry(0x5609953e1b20) adding con mode: secure 2024-09-12T00:34:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:34:29.177+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:34:29.177+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:34:29.178+0000 7f993612c800 5 asok(0x5609951c1630) register_command rotate-key hook 0x5609953e1c68 2024-09-12T00:34:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient: _reopen_session rank -1 2024-09-12T00:34:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:34:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): picked mon.noname-a con 0x56099528ffa0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:34:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): picked mon.noname-c con 0x560995298d50 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:34:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): picked mon.noname-b con 0x5609953248e0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:34:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): _renew_subs 2024-09-12T00:34:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient(hunting): authenticate will time out at 2077.750112s 2024-09-12T00:34:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:34:29.178+0000 7f99316ac640 10 monclient(hunting): get_auth_request con 0x560995298d50 auth_method 0 2024-09-12T00:34:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:34:29.178+0000 7f99316ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:34:29.178+0000 7f99316ac640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:34:29.178+0000 7f99316ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): get_auth_request con 0x56099528ffa0 auth_method 0 2024-09-12T00:34:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:34:29.178+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:34:29.178+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:34:29.178+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient(hunting): handle_auth_done global_id 7452 payload 824 2024-09-12T00:34:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient: _finish_hunting 0 2024-09-12T00:34:29.540 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:34:29.178+0000 7f9931ead640 1 monclient: found mon.noname-a 2024-09-12T00:34:29.540 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:34:29.178+0000 7f9931ead640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:34:29.540 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.540 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:29.540 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: dump: 2024-09-12T00:34:29.540 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.540 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.540 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.540 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.540 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.540 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.540 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.540 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.541 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.541 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.541 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: _finish_auth 0 2024-09-12T00:34:29.541 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: _check_auth_tickets 2024-09-12T00:34:29.541 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:29.541 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.541 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:29.541 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:34:29.178+0000 7f981e604640 10 monclient: dump: 2024-09-12T00:34:29.541 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.541 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.542 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.542 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.542 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.542 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.542 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.543 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.543 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.543 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.543 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:34:29.178+0000 7f993612c800 5 monclient: authenticate success, global_id 7452 2024-09-12T00:34:29.543 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient: _renew_subs 2024-09-12T00:34:29.543 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:34:29.544 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:34:29.178+0000 7f981fe07640 4 set_mon_vals no callback set 2024-09-12T00:34:29.544 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient: _renew_subs 2024-09-12T00:34:29.544 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:34:29.178+0000 7f993612c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:34:29.544 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:34:29.178+0000 7f993612c800 1 librados: init done 2024-09-12T00:34:29.544 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:34:29.180+0000 7f981e604640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:34:29.544 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:34:29.180+0000 7f981e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:34:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:34:29.180+0000 7f981e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:34:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:34:29.180+0000 7f99316ac640 10 monclient: get_auth_request con 0x7f9818076470 auth_method 0 2024-09-12T00:34:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:34:29.181+0000 7f99326ae640 10 monclient: get_auth_request con 0x560995423e00 auth_method 0 2024-09-12T00:34:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:34:29.181+0000 7f9931ead640 10 monclient: get_auth_request con 0x56099542d7c0 auth_method 0 2024-09-12T00:34:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:34:29.182+0000 7f99316ac640 10 monclient: get_auth_request con 0x5609954319b0 auth_method 0 2024-09-12T00:34:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:34:29.183+0000 7f99326ae640 10 monclient: get_auth_request con 0x560995431070 auth_method 0 2024-09-12T00:34:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:34:29.183+0000 7f993612c800 10 monclient: build_initial_monmap 2024-09-12T00:34:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:34:29.183+0000 7f993612c800 1 build_initial for_mkfs: 0 2024-09-12T00:34:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:34:29.183+0000 7f993612c800 10 monclient: monmap: 2024-09-12T00:34:29.546 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:34:29.546 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:29.546 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:34:29.546 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:34:29.546 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:29.547 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.547 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:34:29.547 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:34:29.547 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:34:29.547 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.547 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding auth protocol: cephx 2024-09-12T00:34:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding auth protocol: cephx 2024-09-12T00:34:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding auth protocol: cephx 2024-09-12T00:34:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: secure 2024-09-12T00:34:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: crc 2024-09-12T00:34:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: secure 2024-09-12T00:34:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: crc 2024-09-12T00:34:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: secure 2024-09-12T00:34:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: crc 2024-09-12T00:34:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: crc 2024-09-12T00:34:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: secure 2024-09-12T00:34:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: crc 2024-09-12T00:34:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: secure 2024-09-12T00:34:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: crc 2024-09-12T00:34:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995439b70) adding con mode: secure 2024-09-12T00:34:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:34:29.184+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:34:29.184+0000 7f993612c800 5 asok(0x5609951c1630) register_command objecter_requests cmddesc objecter_requests hook 0x56099543d520 EEXIST 2024-09-12T00:34:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:34:29.184+0000 7f993612c800 10 monclient: init 2024-09-12T00:34:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding auth protocol: cephx 2024-09-12T00:34:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding auth protocol: cephx 2024-09-12T00:34:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding auth protocol: cephx 2024-09-12T00:34:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: secure 2024-09-12T00:34:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: crc 2024-09-12T00:34:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: secure 2024-09-12T00:34:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: crc 2024-09-12T00:34:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: secure 2024-09-12T00:34:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: crc 2024-09-12T00:34:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: crc 2024-09-12T00:34:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: secure 2024-09-12T00:34:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: crc 2024-09-12T00:34:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: secure 2024-09-12T00:34:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: crc 2024-09-12T00:34:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:34:29.184+0000 7f993612c800 5 AuthRegistry(0x560995438a68) adding con mode: secure 2024-09-12T00:34:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:34:29.184+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:34:29.184+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:34:29.184+0000 7f993612c800 5 asok(0x5609951c1630) register_command rotate-key cmddesc rotate-key hook 0x560995438bb0 EEXIST 2024-09-12T00:34:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:34:29.184+0000 7f993612c800 10 monclient: _reopen_session rank -1 2024-09-12T00:34:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:34:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): picked mon.noname-b con 0x560995461210 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:34:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): picked mon.noname-c con 0x5609954634e0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:34:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): picked mon.noname-a con 0x56099545f9e0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:34:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): _renew_subs 2024-09-12T00:34:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient(hunting): authenticate will time out at 2077.757060s 2024-09-12T00:34:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): get_auth_request con 0x56099545f9e0 auth_method 0 2024-09-12T00:34:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:34:29.185+0000 7f99326ae640 10 monclient(hunting): get_auth_request con 0x5609954634e0 auth_method 0 2024-09-12T00:34:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:34:29.185+0000 7f99326ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:34:29.185+0000 7f99326ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:34:29.185+0000 7f99326ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:34:29.185+0000 7f99316ac640 10 monclient(hunting): get_auth_request con 0x560995461210 auth_method 0 2024-09-12T00:34:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:34:29.185+0000 7f99316ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:34:29.185+0000 7f99316ac640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:34:29.185+0000 7f99316ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:34:29.185+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:34:29.185+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:34:29.185+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:34:29.185+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:34:29.185+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:34:29.185+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient(hunting): handle_auth_done global_id 7455 payload 824 2024-09-12T00:34:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient: _finish_hunting 0 2024-09-12T00:34:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:34:29.185+0000 7f9931ead640 1 monclient: found mon.noname-a 2024-09-12T00:34:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:34:29.185+0000 7f9931ead640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:34:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: dump: 2024-09-12T00:34:29.555 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.555 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.555 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.555 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.555 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.555 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.555 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.555 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.555 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: _finish_auth 0 2024-09-12T00:34:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: _check_auth_tickets 2024-09-12T00:34:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:34:29.185+0000 7f98177fe640 10 monclient: dump: 2024-09-12T00:34:29.556 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.556 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.556 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.556 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.556 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.556 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.556 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.556 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.556 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:34:29.185+0000 7f993612c800 5 monclient: authenticate success, global_id 7455 2024-09-12T00:34:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient: _renew_subs 2024-09-12T00:34:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:34:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:34:29.185+0000 7f9932eaf640 4 set_mon_vals no callback set 2024-09-12T00:34:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient: _renew_subs 2024-09-12T00:34:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:34:29.185+0000 7f993612c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:34:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:34:29.187+0000 7f98177fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:34:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:34:29.187+0000 7f98177fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:34:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:34:29.187+0000 7f98177fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:34:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:34:29.187+0000 7f99316ac640 10 monclient: get_auth_request con 0x7f980c076380 auth_method 0 2024-09-12T00:34:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:34:29.187+0000 7f993612c800 10 monclient: get_monmap_and_config 2024-09-12T00:34:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:34:29.187+0000 7f993612c800 10 monclient: build_initial_monmap 2024-09-12T00:34:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:34:29.187+0000 7f993612c800 1 build_initial for_mkfs: 0 2024-09-12T00:34:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:34:29.187+0000 7f993612c800 10 monclient: monmap: 2024-09-12T00:34:29.557 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:34:29.558 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:29.558 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:34:29.558 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:34:29.558 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:29.558 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.558 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:34:29.558 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:34:29.558 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:34:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding auth protocol: cephx 2024-09-12T00:34:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding auth protocol: cephx 2024-09-12T00:34:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding auth protocol: cephx 2024-09-12T00:34:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: secure 2024-09-12T00:34:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: crc 2024-09-12T00:34:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: secure 2024-09-12T00:34:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: crc 2024-09-12T00:34:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: secure 2024-09-12T00:34:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: crc 2024-09-12T00:34:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: crc 2024-09-12T00:34:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: secure 2024-09-12T00:34:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: crc 2024-09-12T00:34:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: secure 2024-09-12T00:34:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: crc 2024-09-12T00:34:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:34:29.187+0000 7f993612c800 5 AuthRegistry(0x560995480ac0) adding con mode: secure 2024-09-12T00:34:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:34:29.188+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient: init 2024-09-12T00:34:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding auth protocol: cephx 2024-09-12T00:34:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding auth protocol: cephx 2024-09-12T00:34:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding auth protocol: cephx 2024-09-12T00:34:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: secure 2024-09-12T00:34:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: crc 2024-09-12T00:34:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: secure 2024-09-12T00:34:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: crc 2024-09-12T00:34:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: secure 2024-09-12T00:34:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: crc 2024-09-12T00:34:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: crc 2024-09-12T00:34:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: secure 2024-09-12T00:34:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: crc 2024-09-12T00:34:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: secure 2024-09-12T00:34:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: crc 2024-09-12T00:34:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:34:29.188+0000 7f993612c800 5 AuthRegistry(0x7fffde5b5cc0) adding con mode: secure 2024-09-12T00:34:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:34:29.188+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.561 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:34:29.188+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.561 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:34:29.188+0000 7f993612c800 5 asok(0x5609951c1630) register_command rotate-key cmddesc rotate-key hook 0x7fffde5b5e08 EEXIST 2024-09-12T00:34:29.561 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient: _reopen_session rank -1 2024-09-12T00:34:29.561 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:34:29.561 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): picked mon.noname-a con 0x5609954b5040 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:34:29.561 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): picked mon.noname-b con 0x5609954af5e0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:34:29.561 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): picked mon.noname-c con 0x560995484e80 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:34:29.561 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.561 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.561 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.562 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): _renew_subs 2024-09-12T00:34:29.562 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:34:29.188+0000 7f993612c800 10 monclient(hunting): authenticate will time out at 2077.760705s 2024-09-12T00:34:29.562 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): get_auth_request con 0x5609954b5040 auth_method 0 2024-09-12T00:34:29.562 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.562 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.562 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.562 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:34:29.188+0000 7f9931ead640 10 monclient(hunting): get_auth_request con 0x560995484e80 auth_method 0 2024-09-12T00:34:29.562 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:34:29.188+0000 7f9931ead640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.562 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:34:29.188+0000 7f9931ead640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:34:29.188+0000 7f9931ead640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:34:29.188+0000 7f99326ae640 10 monclient(hunting): get_auth_request con 0x5609954af5e0 auth_method 0 2024-09-12T00:34:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:34:29.188+0000 7f99326ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:34:29.188+0000 7f99326ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:34:29.188+0000 7f99326ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:34:29.188+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:34:29.188+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:34:29.188+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:34:29.188+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:34:29.188+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:34:29.188+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:34:29.188+0000 7f99316ac640 10 monclient(hunting): handle_auth_done global_id 7458 payload 274 2024-09-12T00:34:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:34:29.189+0000 7f99316ac640 10 monclient: _finish_hunting 0 2024-09-12T00:34:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:34:29.189+0000 7f99316ac640 1 monclient: found mon.noname-a 2024-09-12T00:34:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:34:29.189+0000 7f99316ac640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:34:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: dump: 2024-09-12T00:34:29.565 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.565 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.565 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.565 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.566 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.566 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.566 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.566 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.566 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: _finish_auth 0 2024-09-12T00:34:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: _check_auth_tickets 2024-09-12T00:34:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:34:29.189+0000 7f98157fa640 10 monclient: dump: 2024-09-12T00:34:29.567 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.567 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.567 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.567 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.567 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.568 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.568 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.568 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.568 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.568 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.568 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:34:29.189+0000 7f993612c800 5 monclient: authenticate success, global_id 7458 2024-09-12T00:34:29.568 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:34:29.189+0000 7f993612c800 10 monclient: get_monmap_and_config success 2024-09-12T00:34:29.568 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:34:29.189+0000 7f993612c800 4 set_mon_vals no callback set 2024-09-12T00:34:29.568 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:34:29.189+0000 7f993612c800 10 monclient: shutdown 2024-09-12T00:34:29.569 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient: build_initial_monmap 2024-09-12T00:34:29.569 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:34:29.190+0000 7f993612c800 1 build_initial for_mkfs: 0 2024-09-12T00:34:29.569 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient: monmap: 2024-09-12T00:34:29.569 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:34:29.569 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:29.569 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:34:29.569 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:34:29.569 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:29.570 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.570 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:34:29.570 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:34:29.570 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:34:29.570 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.570 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding auth protocol: cephx 2024-09-12T00:34:29.570 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding auth protocol: cephx 2024-09-12T00:34:29.570 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding auth protocol: cephx 2024-09-12T00:34:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: secure 2024-09-12T00:34:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: crc 2024-09-12T00:34:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: secure 2024-09-12T00:34:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: crc 2024-09-12T00:34:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: secure 2024-09-12T00:34:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: crc 2024-09-12T00:34:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: crc 2024-09-12T00:34:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: secure 2024-09-12T00:34:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: crc 2024-09-12T00:34:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: secure 2024-09-12T00:34:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: crc 2024-09-12T00:34:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x5609954b05a0) adding con mode: secure 2024-09-12T00:34:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:34:29.190+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:34:29.190+0000 7f993612c800 1 librados: starting msgr at 2024-09-12T00:34:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:34:29.190+0000 7f993612c800 1 librados: starting objecter 2024-09-12T00:34:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:34:29.190+0000 7f993612c800 5 asok(0x5609951c1630) register_command objecter_requests cmddesc objecter_requests hook 0x5609954b0d40 EEXIST 2024-09-12T00:34:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:34:29.190+0000 7f993612c800 1 librados: setting wanted keys 2024-09-12T00:34:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:34:29.190+0000 7f993612c800 1 librados: calling monclient init 2024-09-12T00:34:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient: init 2024-09-12T00:34:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding auth protocol: cephx 2024-09-12T00:34:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding auth protocol: cephx 2024-09-12T00:34:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding auth protocol: cephx 2024-09-12T00:34:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: secure 2024-09-12T00:34:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: crc 2024-09-12T00:34:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: secure 2024-09-12T00:34:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: crc 2024-09-12T00:34:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: secure 2024-09-12T00:34:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: crc 2024-09-12T00:34:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: crc 2024-09-12T00:34:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: secure 2024-09-12T00:34:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: crc 2024-09-12T00:34:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: secure 2024-09-12T00:34:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: crc 2024-09-12T00:34:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:34:29.190+0000 7f993612c800 5 AuthRegistry(0x560995478fc0) adding con mode: secure 2024-09-12T00:34:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:34:29.190+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:34:29.190+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:34:29.190+0000 7f993612c800 5 asok(0x5609951c1630) register_command rotate-key cmddesc rotate-key hook 0x560995479108 EEXIST 2024-09-12T00:34:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient: _reopen_session rank -1 2024-09-12T00:34:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:34:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): picked mon.noname-c con 0x560995484e80 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:34:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): picked mon.noname-b con 0x5609954af5e0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:34:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): picked mon.noname-a con 0x5609954b5040 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:34:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): _renew_subs 2024-09-12T00:34:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:34:29.190+0000 7f993612c800 10 monclient(hunting): authenticate will time out at 2077.762962s 2024-09-12T00:34:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): get_auth_request con 0x560995484e80 auth_method 0 2024-09-12T00:34:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:34:29.191+0000 7f9931ead640 10 monclient(hunting): get_auth_request con 0x5609954b5040 auth_method 0 2024-09-12T00:34:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:34:29.191+0000 7f9931ead640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:34:29.191+0000 7f9931ead640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:34:29.191+0000 7f9931ead640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:34:29.191+0000 7f99326ae640 10 monclient(hunting): get_auth_request con 0x5609954af5e0 auth_method 0 2024-09-12T00:34:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:34:29.191+0000 7f99326ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:34:29.191+0000 7f99326ae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:34:29.191+0000 7f99326ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:34:29.191+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:34:29.191+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:34:29.191+0000 7f9931ead640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:34:29.191+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:34:29.191+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:34:29.191+0000 7f99326ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient(hunting): handle_auth_done global_id 7010 payload 824 2024-09-12T00:34:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient: _finish_hunting 0 2024-09-12T00:34:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:34:29.191+0000 7f99316ac640 1 monclient: found mon.noname-c 2024-09-12T00:34:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:34:29.191+0000 7f99316ac640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:34:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: dump: 2024-09-12T00:34:29.578 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.578 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.578 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.578 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.578 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.579 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.579 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.579 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.579 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: _finish_auth 0 2024-09-12T00:34:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: _check_auth_tickets 2024-09-12T00:34:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:34:29.191+0000 7f98037fe640 10 monclient: dump: 2024-09-12T00:34:29.579 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:34:29.579 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:34:29.580 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.580 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:34:29.580 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:29.580 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:34:29.580 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:34:29.580 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:34:29.580 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:34:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:34:29.191+0000 7f993612c800 5 monclient: authenticate success, global_id 7010 2024-09-12T00:34:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:34:29.191+0000 7f993612c800 10 monclient: _renew_subs 2024-09-12T00:34:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:34:29.191+0000 7f98157fa640 4 set_mon_vals no callback set 2024-09-12T00:34:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:34:29.191+0000 7f993612c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:34:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:34:29.191+0000 7f993612c800 10 monclient: _renew_subs 2024-09-12T00:34:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:34:29.191+0000 7f993612c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:34:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:34:29.191+0000 7f993612c800 1 librados: init done 2024-09-12T00:34:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:34:29.191+0000 7f993612c800 5 asok(0x5609951c1630) register_command cr dump hook 0x5609954c2b78 2024-09-12T00:34:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:34:29.193+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:34:29.193+0000 7f98037fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:34:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:34:29.193+0000 7f98037fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:34:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:34:29.193+0000 7f98037fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:34:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:34:29.194+0000 7f99326ae640 10 monclient: get_auth_request con 0x7f97fc076470 auth_method 0 2024-09-12T00:34:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:34:29.194+0000 7f9931ead640 10 monclient: get_auth_request con 0x5609954cf410 auth_method 0 2024-09-12T00:34:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:34:29.194+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:34:29.194+0000 7f993612c800 20 realm 2024-09-12T00:34:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:34:29.194+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:34:29.195+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:34:29.195+0000 7f993612c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:34:29.195+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:34:29.195+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:34:29.195+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:34:29.195+0000 7f99316ac640 10 monclient: get_auth_request con 0x5609954d3680 auth_method 0 2024-09-12T00:34:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:34:29.196+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:34:29.196+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:34:29.196+0000 7f99326ae640 10 monclient: get_auth_request con 0x5609954d6ee0 auth_method 0 2024-09-12T00:34:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:34:29.196+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:34:29.196+0000 7f993612c800 20 searching for the correct realm 2024-09-12T00:34:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:34:29.197+0000 7f9931ead640 10 monclient: get_auth_request con 0x7f992c07d040 auth_method 0 2024-09-12T00:34:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:34:29.198+0000 7f99316ac640 10 monclient: get_auth_request con 0x7f991c050070 auth_method 0 2024-09-12T00:34:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:34:29.199+0000 7f99326ae640 0 -- 172.21.15.133:0/2942212293 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x5609954d6ee0 msgr2=0x5609954d92d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:34:29.199+0000 7f98037fe640 1 client.7010.objecter ms_handle_reset 0x5609954d6ee0 session 0x5609954d29d0 osd.4 2024-09-12T00:34:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:34:29.199+0000 7f98037fe640 10 monclient: _renew_subs 2024-09-12T00:34:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:34:29.199+0000 7f98037fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:34:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:34:29.199+0000 7f99326ae640 10 monclient: get_auth_request con 0x7f97fc086720 auth_method 0 2024-09-12T00:34:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:34:29.199+0000 7f99326ae640 10 monclient: get_auth_request con 0x7f992c065420 auth_method 0 2024-09-12T00:34:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:34:29.201+0000 7f9931ead640 10 monclient: get_auth_request con 0x7f991c017070 auth_method 0 2024-09-12T00:34:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:34:29.201+0000 7f99316ac640 10 monclient: get_auth_request con 0x7f9924087ec0 auth_method 0 2024-09-12T00:34:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:34:29.201+0000 7f99316ac640 0 -- 172.21.15.133:0/2942212293 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f9924087ec0 msgr2=0x7f9924076320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:34:29.402+0000 7f99316ac640 10 monclient: get_auth_request con 0x7f9924087ec0 auth_method 0 2024-09-12T00:34:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:34:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:34:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:34:29.407+0000 7f993612c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:34:29.407+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:34:29.408+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:34:29.408+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:34:29.408+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:34:29.408+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:34:29.408+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:34:29.408+0000 7f993612c800 20 zone default found 2024-09-12T00:34:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:34:29.408+0000 7f993612c800 4 Realm: () 2024-09-12T00:34:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:34:29.408+0000 7f993612c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:34:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:34:29.408+0000 7f993612c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:34:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:34:29.408+0000 7f993612c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:34:29.408+0000 7f993612c800 20 zonegroup default 2024-09-12T00:34:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:34:29.408+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:34:29.409+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:34:29.409+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:34:29.409+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:34:29.409+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:34:29.410+0000 7f993612c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:34:29.410+0000 7f993612c800 20 started sync module instance, tier type = 2024-09-12T00:34:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:34:29.410+0000 7f993612c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:34:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=0 2024-09-12T00:34:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=1 2024-09-12T00:34:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=2 2024-09-12T00:34:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=3 2024-09-12T00:34:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=4 2024-09-12T00:34:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:34:29.418+0000 7f993612c800 20 add_watcher() i=5 2024-09-12T00:34:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:34:29.419+0000 7f993612c800 20 add_watcher() i=6 2024-09-12T00:34:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:34:29.419+0000 7f993612c800 20 add_watcher() i=7 2024-09-12T00:34:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:34:29.419+0000 7f993612c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding auth protocol: cephx 2024-09-12T00:34:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding auth protocol: cephx 2024-09-12T00:34:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding auth protocol: cephx 2024-09-12T00:34:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: secure 2024-09-12T00:34:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: crc 2024-09-12T00:34:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: secure 2024-09-12T00:34:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: crc 2024-09-12T00:34:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: secure 2024-09-12T00:34:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: crc 2024-09-12T00:34:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: crc 2024-09-12T00:34:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: secure 2024-09-12T00:34:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: crc 2024-09-12T00:34:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: secure 2024-09-12T00:34:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: crc 2024-09-12T00:34:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:34:29.421+0000 7f993612c800 5 AuthRegistry(0x7fffde5b61a0) adding con mode: secure 2024-09-12T00:34:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:34:29.421+0000 7f97e3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:34:29.422+0000 7f993612c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:34:29.422+0000 7f993612c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:34:29.422+0000 7f993612c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command cache list hook 0x5609954ae520 2024-09-12T00:34:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command cache inspect hook 0x5609954ae520 2024-09-12T00:34:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command cache erase hook 0x5609954ae520 2024-09-12T00:34:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command cache zap hook 0x5609954ae520 2024-09-12T00:34:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:34:29.422+0000 7f993612c800 5 note: GC not initialized 2024-09-12T00:34:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:34:29.422+0000 7f97e2ffd640 20 reqs_thread_entry: start 2024-09-12T00:34:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command sync trace show hook 0x7f991c00ced0 2024-09-12T00:34:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command sync trace history hook 0x7f991c00ced0 2024-09-12T00:34:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command sync trace active hook 0x7f991c00ced0 2024-09-12T00:34:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:34:29.422+0000 7f993612c800 5 asok(0x5609951c1630) register_command sync trace active_short hook 0x7f991c00ced0 2024-09-12T00:34:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:34:29.422+0000 7f993612c800 20 init_complete bucket index max shards: 1 2024-09-12T00:34:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:34:29.422+0000 7f993612c800 20 Filter name: none 2024-09-12T00:34:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:34:29.422+0000 7f97e0ff9640 20 reqs_thread_entry: start 2024-09-12T00:34:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:34:29.422+0000 7f993612c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:34:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:34:29.422+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:34:29.423+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:34:29.423+0000 7f993612c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:34:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:34:29.423+0000 7f993612c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:34:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:34:29.423+0000 7f993612c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 : miss 2024-09-12T00:34:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:34:29.423+0000 7f993612c800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:34:29.423+0000 7f993612c800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:34:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:34:29.423+0000 7f993612c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:34:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:34:29.423+0000 7f993612c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:34:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:34:29.423+0000 7f993612c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:34:29.423+0000 7f993612c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:34:29.423+0000 7f993612c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 2024-09-12T00:34:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:34:29.427+0000 7f993612c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:34:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:34:29.427+0000 7f993612c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:34:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:34:29.427+0000 7f993612c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:34:29.427+0000 7f993612c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33, ofs0, ns] 2024-09-12T00:34:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:34:29.427+0000 7f98157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497047 cookie 94599159606992 notifier 7010 bl.length()=1015 2024-09-12T00:34:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:34:29.427+0000 7f98157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:34:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:34:29.427+0000 7f98157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:34:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:34:29.427+0000 7f98157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:34:29.429+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_sources= new_sources= 2024-09-12T00:34:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:34:29.429+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential sources added=[] removed=[] 2024-09-12T00:34:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:34:29.429+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_dests= new_dests= 2024-09-12T00:34:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:34:29.429+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential dests added=[] removed=[] 2024-09-12T00:34:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:34:29.431+0000 7f993612c800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.0 2024-09-12T00:34:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:34:29.431+0000 7f993612c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.0 2024-09-12T00:34:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:34:29.431+0000 7f993612c800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.1 2024-09-12T00:34:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:34:29.431+0000 7f993612c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.1 2024-09-12T00:34:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:34:29.431+0000 7f993612c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.0 2024-09-12T00:34:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:34:29.433+0000 7f993612c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:34:29.433+0000 7f993612c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 2024-09-12T00:34:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:34:29.434+0000 7f993612c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:34:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:34:29.434+0000 7f993612c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:34:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:34:29.434+0000 7f993612c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:34:29.434+0000 7f993612c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33, ofs0, ns] 2024-09-12T00:34:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:34:29.435+0000 7f98157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497048 cookie 94599159606992 notifier 7010 bl.length()=1015 2024-09-12T00:34:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:34:29.435+0000 7f98157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:34:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:34:29.435+0000 7f98157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:34:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:34:29.435+0000 7f98157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:34:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:34:29.436+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_sources= new_sources= 2024-09-12T00:34:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:34:29.436+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential sources added=[] removed=[] 2024-09-12T00:34:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:34:29.436+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_dests= new_dests= 2024-09-12T00:34:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:34:29.436+0000 7f993612c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential dests added=[] removed=[] 2024-09-12T00:34:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:34:29.437+0000 7f993612c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.0 2024-09-12T00:34:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:34:29.439+0000 7f993612c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f993612c800 time 2024-09-12T00:34:29.439234+0000 2024-09-12T00:34:29.593 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f993798c71a] 2024-09-12T00:34:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f993798c8d8] 2024-09-12T00:34:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560994570641] 2024-09-12T00:34:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x560994580637] 2024-09-12T00:34:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:34:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f9936629590] 2024-09-12T00:34:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:34:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:34:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:34:29.439+0000 7f993612c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:34:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f993612c800 thread_name:radosgw-admin 2024-09-12T00:34:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f993663e6f0] 2024-09-12T00:34:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f993668b99c] 2024-09-12T00:34:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:34:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:34:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f993798c774] 2024-09-12T00:34:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f993798c8d8] 2024-09-12T00:34:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560994570641] 2024-09-12T00:34:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x560994580637] 2024-09-12T00:34:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f9936629590] 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:34:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:34:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:34:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:34:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:34:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:34:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:34:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:34:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:34:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:34:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:34:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:34:29.597 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:34:29.597 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:34:29.597 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:34:29.597 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:34:29.597 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:34:29.597 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:34:29.597 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:34:29.597 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:34:29.597 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:34:29.597 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:34:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:34:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:34:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:34:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:34:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:34:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:34:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:34:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:34:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:34:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:34:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:34:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:34:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:34:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:34:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:34:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:34:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:34:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:34:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:34:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:34:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:34:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:34:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:34:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:34:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:34:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:34:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:34:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:34:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:34:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:34:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:34:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:34:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:34:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:34:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:34:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:34:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:34:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:34:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:34:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:34:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:34:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:34:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:34:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:34:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:34:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:34:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:34:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:34:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:34:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:34:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:34:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:34:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:34:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:34:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:34:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:34:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:34:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:34:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:34:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:34:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:34:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:34:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:34:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:34:29.603 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:34:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: 7f97e0ff9640 / http_manager 2024-09-12T00:34:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: 7f97e2ffd640 / http_manager 2024-09-12T00:34:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: 7f97e3fff640 / rgw_dt_lg_renew 2024-09-12T00:34:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: 7f98037fe640 / ms_dispatch 2024-09-12T00:34:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: 7f98157fa640 / io_context_pool 2024-09-12T00:34:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: 7f98177fe640 / ms_dispatch 2024-09-12T00:34:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: 7f981e604640 / ms_dispatch 2024-09-12T00:34:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: 7f981fe07640 / io_context_pool 2024-09-12T00:34:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: 7f99316ac640 / msgr-worker-2 2024-09-12T00:34:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: 7f9931ead640 / msgr-worker-1 2024-09-12T00:34:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: 7f99326ae640 / msgr-worker-0 2024-09-12T00:34:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: 7f9932eaf640 / io_context_pool 2024-09-12T00:34:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: 7f993612c800 / radosgw-admin 2024-09-12T00:34:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:34:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:34:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:34:29.440614Z_ec657c11-a06e-4328-bf5c-8d9cd7f1d37a/log 2024-09-12T00:34:29.604 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:34:29.604 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:34:29.606 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:29.606 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:29.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.513+0000 7fc305a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.515+0000 7fc305a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.515+0000 7fc305a0e800 20 realm 2024-09-12T00:34:29.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.515+0000 7fc305a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.516+0000 7fc305a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.516+0000 7fc305a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.516+0000 7fc305a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.516+0000 7fc305a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.516+0000 7fc305a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.516+0000 7fc305a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.516+0000 7fc305a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.517+0000 7fc305a0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.517+0000 7fc305a0e800 20 searching for the correct realm 2024-09-12T00:34:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.519+0000 7fc30196c640 0 -- 172.21.15.133:0/2506085579 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7fc2fc01e060 msgr2=0x7fc2fc0029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:29.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.725+0000 7fc30116b640 0 -- 172.21.15.133:0/2506085579 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x5640e94f0830 msgr2=0x5640e94f2c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:29.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.729+0000 7fc305a0e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:34:29.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.729+0000 7fc305a0e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:34:29.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.729+0000 7fc305a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:29.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.729+0000 7fc305a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:29.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.729+0000 7fc305a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:29.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.729+0000 7fc305a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:29.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.729+0000 7fc305a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.729+0000 7fc305a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.729+0000 7fc305a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.729+0000 7fc305a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:29.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.730+0000 7fc305a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.730+0000 7fc305a0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:29.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.730+0000 7fc305a0e800 20 zone default found 2024-09-12T00:34:29.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.730+0000 7fc305a0e800 4 Realm: () 2024-09-12T00:34:29.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.730+0000 7fc305a0e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:34:29.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.730+0000 7fc305a0e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:34:29.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.730+0000 7fc305a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:29.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.730+0000 7fc305a0e800 20 zonegroup default 2024-09-12T00:34:29.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.730+0000 7fc305a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.730+0000 7fc305a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.730+0000 7fc305a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.731+0000 7fc305a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.731+0000 7fc305a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.731+0000 7fc305a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:29.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.731+0000 7fc305a0e800 20 started sync module instance, tier type = 2024-09-12T00:34:29.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.731+0000 7fc305a0e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:34:29.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.739+0000 7fc305a0e800 20 add_watcher() i=0 2024-09-12T00:34:29.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.739+0000 7fc305a0e800 20 add_watcher() i=1 2024-09-12T00:34:29.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.739+0000 7fc305a0e800 20 add_watcher() i=2 2024-09-12T00:34:29.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.739+0000 7fc305a0e800 20 add_watcher() i=3 2024-09-12T00:34:29.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.739+0000 7fc305a0e800 20 add_watcher() i=4 2024-09-12T00:34:29.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.739+0000 7fc305a0e800 20 add_watcher() i=5 2024-09-12T00:34:29.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.740+0000 7fc305a0e800 20 add_watcher() i=6 2024-09-12T00:34:29.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.740+0000 7fc305a0e800 20 add_watcher() i=7 2024-09-12T00:34:29.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.740+0000 7fc305a0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:29.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.742+0000 7fc1b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:29.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.742+0000 7fc305a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:29.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.742+0000 7fc305a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:29.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.742+0000 7fc305a0e800 5 note: GC not initialized 2024-09-12T00:34:29.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.743+0000 7fc1b67e4640 20 reqs_thread_entry: start 2024-09-12T00:34:29.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.743+0000 7fc305a0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:34:29.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.743+0000 7fc305a0e800 20 Filter name: none 2024-09-12T00:34:29.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.743+0000 7fc127fff640 20 reqs_thread_entry: start 2024-09-12T00:34:29.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.743+0000 7fc305a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.743+0000 7fc305a0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:29.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.743+0000 7fc305a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.744+0000 7fc305a0e800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:34:29.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.744+0000 7fc305a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:29.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.744+0000 7fc305a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.744+0000 7fc305a0e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:34:29.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.744+0000 7fc305a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:34:29.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.745+0000 7fc305a0e800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:34:29.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.745+0000 7fc305a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:29.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.746+0000 7fc1b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:29.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.748+0000 7fc305a0e800 20 remove_watcher() i=0 2024-09-12T00:34:29.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.748+0000 7fc305a0e800 2 removed watcher, disabling cache 2024-09-12T00:34:29.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.749+0000 7fc305a0e800 20 remove_watcher() i=1 2024-09-12T00:34:29.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.750+0000 7fc305a0e800 20 remove_watcher() i=2 2024-09-12T00:34:29.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.751+0000 7fc305a0e800 20 remove_watcher() i=3 2024-09-12T00:34:29.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.752+0000 7fc305a0e800 20 remove_watcher() i=4 2024-09-12T00:34:29.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.753+0000 7fc305a0e800 20 remove_watcher() i=5 2024-09-12T00:34:29.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.754+0000 7fc305a0e800 20 remove_watcher() i=6 2024-09-12T00:34:29.753 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:34:29.755+0000 7fc305a0e800 20 remove_watcher() i=7 2024-09-12T00:34:29.763 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:29.764 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:34:29.764 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-commit-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:34:29.764 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:34:59.958 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:34:59.991 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:59.991 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:00.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.031+0000 7f8dc9528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.033+0000 7f8dc9528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.033+0000 7f8dc9528800 20 realm 2024-09-12T00:35:00.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.033+0000 7f8dc9528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.034+0000 7f8dc9528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.034+0000 7f8dc9528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:00.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.034+0000 7f8dc9528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.034+0000 7f8dc9528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.034+0000 7f8dc9528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.035+0000 7f8dc9528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:00.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.035+0000 7f8dc9528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.034 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.035+0000 7f8dc9528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:00.034 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.035+0000 7f8dc9528800 20 searching for the correct realm 2024-09-12T00:35:00.036 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.037+0000 7f8dbffff640 0 -- 172.21.15.133:0/1337956810 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f8db00411e0 msgr2=0x7f8db008db30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:00.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.242+0000 7f8dbffff640 0 -- 172.21.15.133:0/1337956810 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f8db8027040 msgr2=0x7f8db8036450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:00.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.450+0000 7f8dc9528800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:00.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.450+0000 7f8dc9528800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:00.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.450+0000 7f8dc9528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:00.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.450+0000 7f8dc9528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:00.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.450+0000 7f8dc9528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:00.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.450+0000 7f8dc9528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:00.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.450+0000 7f8dc9528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.449 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.450+0000 7f8dc9528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.450 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.450+0000 7f8dc9528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.451+0000 7f8dc9528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:00.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.451+0000 7f8dc9528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.451+0000 7f8dc9528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:00.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.451+0000 7f8dc9528800 20 zone default found 2024-09-12T00:35:00.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.451+0000 7f8dc9528800 4 Realm: () 2024-09-12T00:35:00.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.451+0000 7f8dc9528800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:00.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.451+0000 7f8dc9528800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:00.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.451+0000 7f8dc9528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:00.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.451+0000 7f8dc9528800 20 zonegroup default 2024-09-12T00:35:00.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.451+0000 7f8dc9528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.451+0000 7f8dc9528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.451+0000 7f8dc9528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.452+0000 7f8dc9528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.452+0000 7f8dc9528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.452+0000 7f8dc9528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.452+0000 7f8dc9528800 20 started sync module instance, tier type = 2024-09-12T00:35:00.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.452+0000 7f8dc9528800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:00.460 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.462+0000 7f8dc9528800 20 add_watcher() i=0 2024-09-12T00:35:00.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.462+0000 7f8dc9528800 20 add_watcher() i=1 2024-09-12T00:35:00.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.462+0000 7f8dc9528800 20 add_watcher() i=2 2024-09-12T00:35:00.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.462+0000 7f8dc9528800 20 add_watcher() i=3 2024-09-12T00:35:00.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.462+0000 7f8dc9528800 20 add_watcher() i=4 2024-09-12T00:35:00.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.462+0000 7f8dc9528800 20 add_watcher() i=5 2024-09-12T00:35:00.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.462+0000 7f8dc9528800 20 add_watcher() i=6 2024-09-12T00:35:00.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.463+0000 7f8dc9528800 20 add_watcher() i=7 2024-09-12T00:35:00.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.463+0000 7f8dc9528800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:00.463 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.465+0000 7f8c7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:00.464 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.465+0000 7f8dc9528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:00.464 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.465+0000 7f8dc9528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:00.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.465+0000 7f8dc9528800 5 note: GC not initialized 2024-09-12T00:35:00.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.465+0000 7f8c7a7e4640 20 reqs_thread_entry: start 2024-09-12T00:35:00.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.465+0000 7f8dc9528800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:00.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.465+0000 7f8dc9528800 20 Filter name: none 2024-09-12T00:35:00.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.466+0000 7f8bebfff640 20 reqs_thread_entry: start 2024-09-12T00:35:00.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.466+0000 7f8dc9528800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:35:00.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.466+0000 7f8dc9528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.466+0000 7f8dc9528800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:35:00.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.466+0000 7f8dc9528800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:35:00.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.466+0000 7f8dc9528800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:35:00.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.466+0000 7f8dc9528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 : miss 2024-09-12T00:35:00.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.466+0000 7f8dc9528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.467+0000 7f8dc9528800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:35:00.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.467+0000 7f8dc9528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:35:00.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.467+0000 7f8dc9528800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:35:00.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.467+0000 7f8dc9528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:00.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.467+0000 7f8dc9528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:00.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.467+0000 7f8dc9528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 2024-09-12T00:35:00.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.471+0000 7f8dc9528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:35:00.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.471+0000 7f8dc9528800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:35:00.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.471+0000 7f8dc9528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:00.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.471+0000 7f8dc9528800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33, ofs0, ns] 2024-09-12T00:35:00.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.471+0000 7f8ca8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94748050096688 notifier 7500 bl.length()=1015 2024-09-12T00:35:00.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.471+0000 7f8ca8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:35:00.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.471+0000 7f8ca8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:35:00.470 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.471+0000 7f8ca8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:00.471 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.473+0000 7f8dc9528800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_sources= new_sources= 2024-09-12T00:35:00.471 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.473+0000 7f8dc9528800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential sources added=[] removed=[] 2024-09-12T00:35:00.472 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.473+0000 7f8dc9528800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_dests= new_dests= 2024-09-12T00:35:00.472 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.473+0000 7f8dc9528800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential dests added=[] removed=[] 2024-09-12T00:35:00.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.475+0000 7f8dc9528800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.0 2024-09-12T00:35:00.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.475+0000 7f8dc9528800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.0 2024-09-12T00:35:00.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.475+0000 7f8dc9528800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.1 2024-09-12T00:35:00.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.475+0000 7f8dc9528800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.1.1 2024-09-12T00:35:00.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.475+0000 7f8dc9528800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.0 2024-09-12T00:35:00.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.478+0000 7f8dc9528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:00.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.478+0000 7f8dc9528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 2024-09-12T00:35:00.478 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.479+0000 7f8dc9528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:35:00.478 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.479+0000 7f8dc9528800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:35:00.479 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.479+0000 7f8dc9528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:00.479 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.479+0000 7f8dc9528800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33, ofs0, ns] 2024-09-12T00:35:00.479 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.480+0000 7f8ca8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497051 cookie 94748050096688 notifier 7500 bl.length()=1015 2024-09-12T00:35:00.479 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.480+0000 7f8ca8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:35:00.479 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.480+0000 7f8ca8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:35:00.479 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.480+0000 7f8ca8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:00.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.481+0000 7f8dc9528800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_sources= new_sources= 2024-09-12T00:35:00.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.481+0000 7f8dc9528800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential sources added=[] removed=[] 2024-09-12T00:35:00.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.481+0000 7f8dc9528800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_dests= new_dests= 2024-09-12T00:35:00.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.481+0000 7f8dc9528800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential dests added=[] removed=[] 2024-09-12T00:35:00.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.483+0000 7f8dc9528800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33.0 2024-09-12T00:35:00.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.483+0000 7f8dc9528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:00.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.483+0000 7f8dc9528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 2024-09-12T00:35:00.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.484+0000 7f8dc9528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:35:00.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.484+0000 7f8dc9528800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:35:00.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.484+0000 7f8dc9528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:00.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.484+0000 7f8dc9528800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33, ofs0, ns] 2024-09-12T00:35:00.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.485+0000 7f8ca8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497052 cookie 94748050096688 notifier 7500 bl.length()=983 2024-09-12T00:35:00.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.485+0000 7f8ca8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 info.flags=0x17 2024-09-12T00:35:00.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.485+0000 7f8ca8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 to cache LRU end 2024-09-12T00:35:00.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.485+0000 7f8ca8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:00.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.486+0000 7f8dc9528800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_sources= new_sources= 2024-09-12T00:35:00.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.486+0000 7f8dc9528800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential sources added=[] removed=[] 2024-09-12T00:35:00.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.486+0000 7f8dc9528800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): orig_dests= new_dests= 2024-09-12T00:35:00.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.486+0000 7f8dc9528800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33]): potential dests added=[] removed=[] 2024-09-12T00:35:00.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.488+0000 7f8dc9528800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:35:00.488 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.489+0000 7f8c7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:00.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.492+0000 7f8dc9528800 20 remove_watcher() i=0 2024-09-12T00:35:00.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.492+0000 7f8dc9528800 2 removed watcher, disabling cache 2024-09-12T00:35:00.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.493+0000 7f8dc9528800 20 remove_watcher() i=1 2024-09-12T00:35:00.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.494+0000 7f8dc9528800 20 remove_watcher() i=2 2024-09-12T00:35:00.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.495+0000 7f8dc9528800 20 remove_watcher() i=3 2024-09-12T00:35:00.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.496+0000 7f8dc9528800 20 remove_watcher() i=4 2024-09-12T00:35:00.495 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.497+0000 7f8dc9528800 20 remove_watcher() i=5 2024-09-12T00:35:00.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.498+0000 7f8dc9528800 20 remove_watcher() i=6 2024-09-12T00:35:00.497 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.499+0000 7f8dc9528800 20 remove_watcher() i=7 2024-09-12T00:35:00.509 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:35:00.538 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:00.539 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:00.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.779+0000 7f3f9d332800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.781+0000 7f3f9d332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.781+0000 7f3f9d332800 20 realm 2024-09-12T00:35:00.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.781+0000 7f3f9d332800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.780 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.781+0000 7f3f9d332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.780 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.781+0000 7f3f9d332800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:00.780 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.781+0000 7f3f9d332800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.780 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.781+0000 7f3f9d332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.780 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.781+0000 7f3f9d332800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.780 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.782+0000 7f3f9d332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:00.781 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.782+0000 7f3f9d332800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.783+0000 7f3f9d332800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:00.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.783+0000 7f3f9d332800 20 searching for the correct realm 2024-09-12T00:35:00.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.784+0000 7f3f98fbc640 0 -- 172.21.15.133:0/1280806574 >> [v2:172.21.15.133:6816/1011460824,v1:172.21.15.133:6817/1011460824] conn(0x7f3f9407a3f0 msgr2=0x7f3f94065790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:00.988 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.990+0000 7f3f98fbc640 0 -- 172.21.15.133:0/1280806574 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x55e3efaa5440 msgr2=0x55e3efaa7860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:00.995 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.996+0000 7f3f9d332800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:00.995 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.996+0000 7f3f9d332800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:00.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.996+0000 7f3f9d332800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:00.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.996+0000 7f3f9d332800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:00.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.996+0000 7f3f9d332800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:00.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.996+0000 7f3f9d332800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:00.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.996+0000 7f3f9d332800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.997+0000 7f3f9d332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.997+0000 7f3f9d332800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.997+0000 7f3f9d332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:00.996 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.997+0000 7f3f9d332800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.997 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.997+0000 7f3f9d332800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:00.997 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.997+0000 7f3f9d332800 20 zone default found 2024-09-12T00:35:00.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.997+0000 7f3f9d332800 4 Realm: () 2024-09-12T00:35:00.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.997+0000 7f3f9d332800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:00.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.997+0000 7f3f9d332800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:00.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.997+0000 7f3f9d332800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:00.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.997+0000 7f3f9d332800 20 zonegroup default 2024-09-12T00:35:00.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.997+0000 7f3f9d332800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.997+0000 7f3f9d332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.998+0000 7f3f9d332800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.998+0000 7f3f9d332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.998+0000 7f3f9d332800 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.998+0000 7f3f9d332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.998+0000 7f3f9d332800 20 started sync module instance, tier type = 2024-09-12T00:35:00.998 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:00.998+0000 7f3f9d332800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:01.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.008+0000 7f3f9d332800 20 add_watcher() i=0 2024-09-12T00:35:01.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.008+0000 7f3f9d332800 20 add_watcher() i=1 2024-09-12T00:35:01.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.008+0000 7f3f9d332800 20 add_watcher() i=2 2024-09-12T00:35:01.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.008+0000 7f3f9d332800 20 add_watcher() i=3 2024-09-12T00:35:01.008 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.008+0000 7f3f9d332800 20 add_watcher() i=4 2024-09-12T00:35:01.008 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.008+0000 7f3f9d332800 20 add_watcher() i=5 2024-09-12T00:35:01.008 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.008+0000 7f3f9d332800 20 add_watcher() i=6 2024-09-12T00:35:01.008 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.009+0000 7f3f9d332800 20 add_watcher() i=7 2024-09-12T00:35:01.008 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.009+0000 7f3f9d332800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:01.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.011+0000 7f3e4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:01.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.011+0000 7f3f9d332800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:01.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.011+0000 7f3f9d332800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:01.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.011+0000 7f3f9d332800 5 note: GC not initialized 2024-09-12T00:35:01.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.012+0000 7f3e4dfe3640 20 reqs_thread_entry: start 2024-09-12T00:35:01.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.012+0000 7f3f9d332800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:01.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.012+0000 7f3f9d332800 20 Filter name: none 2024-09-12T00:35:01.014 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.012+0000 7f3dbf7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:01.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.012+0000 7f3f9d332800 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.012+0000 7f3f9d332800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:35:01.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.012+0000 7f3f9d332800 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.013+0000 7f3f9d332800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:35:01.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.013+0000 7f3f9d332800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:01.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.013+0000 7f3f9d332800 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.013+0000 7f3f9d332800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:35:01.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.013+0000 7f3f9d332800 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.014+0000 7f3f9d332800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:35:01.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.014+0000 7f3f9d332800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:01.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.015+0000 7f3e4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:01.017 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.018+0000 7f3f9d332800 20 remove_watcher() i=0 2024-09-12T00:35:01.017 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.018+0000 7f3f9d332800 2 removed watcher, disabling cache 2024-09-12T00:35:01.018 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.019+0000 7f3f9d332800 20 remove_watcher() i=1 2024-09-12T00:35:01.019 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.020+0000 7f3f9d332800 20 remove_watcher() i=2 2024-09-12T00:35:01.020 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.021+0000 7f3f9d332800 20 remove_watcher() i=3 2024-09-12T00:35:01.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.022+0000 7f3f9d332800 20 remove_watcher() i=4 2024-09-12T00:35:01.022 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.024+0000 7f3f9d332800 20 remove_watcher() i=5 2024-09-12T00:35:01.023 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.025+0000 7f3f9d332800 20 remove_watcher() i=6 2024-09-12T00:35:01.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:01.026+0000 7f3f9d332800 20 remove_watcher() i=7 2024-09-12T00:35:01.035 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:01.035 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:35:01.035 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-commit-target-layout id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:35:01.035 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:01.324 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T00:35:01.324 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:02.176 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:35:02.204 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:02.205 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:02.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.243+0000 7fcfbc010800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.244+0000 7fcfbc010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:02.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.244+0000 7fcfbc010800 20 realm 2024-09-12T00:35:02.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.244+0000 7fcfbc010800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.244+0000 7fcfbc010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:02.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.244+0000 7fcfbc010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:02.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.244+0000 7fcfbc010800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.245+0000 7fcfbc010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:02.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.245+0000 7fcfbc010800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.245+0000 7fcfbc010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:02.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.245+0000 7fcfbc010800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.246+0000 7fcfbc010800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:02.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.246+0000 7fcfbc010800 20 searching for the correct realm 2024-09-12T00:35:02.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.248+0000 7fcfaffff640 0 -- 172.21.15.133:0/1317446335 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fcfa0025040 msgr2=0x7fcfa0067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:02.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.453+0000 7fcfaffff640 0 -- 172.21.15.133:0/1317446335 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fcfa806a0e0 msgr2=0x7fcfa8060060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:02.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.660+0000 7fcfbc010800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:02.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.660+0000 7fcfbc010800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:02.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.660+0000 7fcfbc010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:02.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.660+0000 7fcfbc010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:02.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.660+0000 7fcfbc010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:02.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.660+0000 7fcfbc010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:02.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.660+0000 7fcfbc010800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.660+0000 7fcfbc010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:02.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.660+0000 7fcfbc010800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.660+0000 7fcfbc010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:02.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.660+0000 7fcfbc010800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.661+0000 7fcfbc010800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:02.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.661+0000 7fcfbc010800 20 zone default found 2024-09-12T00:35:02.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.661+0000 7fcfbc010800 4 Realm: () 2024-09-12T00:35:02.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.661+0000 7fcfbc010800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:02.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.661+0000 7fcfbc010800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:02.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.661+0000 7fcfbc010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:02.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.661+0000 7fcfbc010800 20 zonegroup default 2024-09-12T00:35:02.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.661+0000 7fcfbc010800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.661+0000 7fcfbc010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:02.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.661+0000 7fcfbc010800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.661+0000 7fcfbc010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:02.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.661+0000 7fcfbc010800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.662+0000 7fcfbc010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:02.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.662+0000 7fcfbc010800 20 started sync module instance, tier type = 2024-09-12T00:35:02.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.662+0000 7fcfbc010800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:02.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.671+0000 7fcfbc010800 20 add_watcher() i=0 2024-09-12T00:35:02.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.671+0000 7fcfbc010800 20 add_watcher() i=1 2024-09-12T00:35:02.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.671+0000 7fcfbc010800 20 add_watcher() i=2 2024-09-12T00:35:02.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.671+0000 7fcfbc010800 20 add_watcher() i=3 2024-09-12T00:35:02.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.671+0000 7fcfbc010800 20 add_watcher() i=4 2024-09-12T00:35:02.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.671+0000 7fcfbc010800 20 add_watcher() i=5 2024-09-12T00:35:02.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.671+0000 7fcfbc010800 20 add_watcher() i=6 2024-09-12T00:35:02.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.672+0000 7fcfbc010800 20 add_watcher() i=7 2024-09-12T00:35:02.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.673+0000 7fcfbc010800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:02.673 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.674+0000 7fce6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:02.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.675+0000 7fcfbc010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:02.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.675+0000 7fcfbc010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:02.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.675+0000 7fcfbc010800 5 note: GC not initialized 2024-09-12T00:35:02.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.675+0000 7fce6cfe1640 20 reqs_thread_entry: start 2024-09-12T00:35:02.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.675+0000 7fcfbc010800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:02.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.675+0000 7fcfbc010800 20 Filter name: none 2024-09-12T00:35:02.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.675+0000 7fcde67fc640 20 reqs_thread_entry: start 2024-09-12T00:35:02.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.675+0000 7fcfbc010800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.676+0000 7fcfbc010800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:02.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.676+0000 7fcfbc010800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.676+0000 7fcfbc010800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:02.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.676+0000 7fcfbc010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:02.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.676+0000 7fcfbc010800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.677+0000 7fcfbc010800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:02.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.677+0000 7fcfbc010800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.677+0000 7fcfbc010800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:02.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.677+0000 7fcfbc010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:02.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.679+0000 7fce6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:02.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.681+0000 7fcfbc010800 20 remove_watcher() i=0 2024-09-12T00:35:02.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.681+0000 7fcfbc010800 2 removed watcher, disabling cache 2024-09-12T00:35:02.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.682+0000 7fcfbc010800 20 remove_watcher() i=1 2024-09-12T00:35:02.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.683+0000 7fcfbc010800 20 remove_watcher() i=2 2024-09-12T00:35:02.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.684+0000 7fcfbc010800 20 remove_watcher() i=3 2024-09-12T00:35:02.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.685+0000 7fcfbc010800 20 remove_watcher() i=4 2024-09-12T00:35:02.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.686+0000 7fcfbc010800 20 remove_watcher() i=5 2024-09-12T00:35:02.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.687+0000 7fcfbc010800 20 remove_watcher() i=6 2024-09-12T00:35:02.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.688+0000 7fcfbc010800 20 remove_watcher() i=7 2024-09-12T00:35:02.697 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:02.697 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:35:02.697 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-do-reshard id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:35:02.697 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:02.699 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T00:35:02.733 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:02.733 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:02.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.773+0000 7ff01da0e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.774+0000 7ff01da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:02.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.774+0000 7ff01da0e800 20 realm 2024-09-12T00:35:02.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.774+0000 7ff01da0e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.774+0000 7ff01da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:02.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.774+0000 7ff01da0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:02.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.774+0000 7ff01da0e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.774+0000 7ff01da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:02.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.774+0000 7ff01da0e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.774 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.775+0000 7ff01da0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:02.774 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.775+0000 7ff01da0e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:02.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.776+0000 7ff01da0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:02.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.776+0000 7ff01da0e800 20 searching for the correct realm 2024-09-12T00:35:02.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.777+0000 7ff018858640 0 -- 172.21.15.133:0/3195393711 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff00c073720 msgr2=0x7ff00c00c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:02.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:02.982+0000 7ff018858640 0 -- 172.21.15.133:0/3195393711 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff004028040 msgr2=0x7ff004042410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:03.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.189+0000 7ff01da0e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:03.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.189+0000 7ff01da0e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:03.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.189+0000 7ff01da0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:03.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.189+0000 7ff01da0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:03.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.189+0000 7ff01da0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:03.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.189+0000 7ff01da0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:03.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.189+0000 7ff01da0e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.189+0000 7ff01da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.189+0000 7ff01da0e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.190+0000 7ff01da0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:03.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.190+0000 7ff01da0e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.190+0000 7ff01da0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:03.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.190+0000 7ff01da0e800 20 zone default found 2024-09-12T00:35:03.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.190+0000 7ff01da0e800 4 Realm: () 2024-09-12T00:35:03.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.190+0000 7ff01da0e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:03.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.190+0000 7ff01da0e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:03.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.190+0000 7ff01da0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:03.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.190+0000 7ff01da0e800 20 zonegroup default 2024-09-12T00:35:03.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.190+0000 7ff01da0e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.190+0000 7ff01da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.190+0000 7ff01da0e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.190+0000 7ff01da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.191+0000 7ff01da0e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.191+0000 7ff01da0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.191+0000 7ff01da0e800 20 started sync module instance, tier type = 2024-09-12T00:35:03.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.191+0000 7ff01da0e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:03.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.200+0000 7ff01da0e800 20 add_watcher() i=0 2024-09-12T00:35:03.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.200+0000 7ff01da0e800 20 add_watcher() i=1 2024-09-12T00:35:03.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.200+0000 7ff01da0e800 20 add_watcher() i=2 2024-09-12T00:35:03.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.200+0000 7ff01da0e800 20 add_watcher() i=3 2024-09-12T00:35:03.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.200+0000 7ff01da0e800 20 add_watcher() i=4 2024-09-12T00:35:03.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.200+0000 7ff01da0e800 20 add_watcher() i=5 2024-09-12T00:35:03.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.200+0000 7ff01da0e800 20 add_watcher() i=6 2024-09-12T00:35:03.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.201+0000 7ff01da0e800 20 add_watcher() i=7 2024-09-12T00:35:03.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.201+0000 7ff01da0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:03.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.203+0000 7feecf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:03.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.204+0000 7ff01da0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:03.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.204+0000 7ff01da0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:03.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.204+0000 7ff01da0e800 5 note: GC not initialized 2024-09-12T00:35:03.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.204+0000 7feece7e4640 20 reqs_thread_entry: start 2024-09-12T00:35:03.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.204+0000 7ff01da0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:03.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.204+0000 7ff01da0e800 20 Filter name: none 2024-09-12T00:35:03.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.204+0000 7fee3ffff640 20 reqs_thread_entry: start 2024-09-12T00:35:03.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.204+0000 7ff01da0e800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:35:03.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.204+0000 7ff01da0e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.205+0000 7ff01da0e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:03.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.205+0000 7ff01da0e800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:35:03.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.205+0000 7ff01da0e800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:35:03.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.205+0000 7ff01da0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 : miss 2024-09-12T00:35:03.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.205+0000 7ff01da0e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.205+0000 7ff01da0e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:03.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.205+0000 7ff01da0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 info.flags=0x17 2024-09-12T00:35:03.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.205+0000 7ff01da0e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 to cache LRU end 2024-09-12T00:35:03.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.205+0000 7ff01da0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:03.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.205+0000 7ff01da0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:03.205 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.205+0000 7ff01da0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 2024-09-12T00:35:03.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.209+0000 7ff01da0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 info.flags=0x17 2024-09-12T00:35:03.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.209+0000 7ff01da0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 to cache LRU end 2024-09-12T00:35:03.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.209+0000 7ff01da0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:03.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.209+0000 7ff01da0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34, ofs0, ns] 2024-09-12T00:35:03.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.209+0000 7feefcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497056 cookie 94152948991856 notifier 7091 bl.length()=995 2024-09-12T00:35:03.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.209+0000 7feefcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 info.flags=0x17 2024-09-12T00:35:03.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.209+0000 7feefcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 to cache LRU end 2024-09-12T00:35:03.208 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.209+0000 7feefcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:03.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.211+0000 7ff01da0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): orig_sources= new_sources= 2024-09-12T00:35:03.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.211+0000 7ff01da0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): potential sources added=[] removed=[] 2024-09-12T00:35:03.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.211+0000 7ff01da0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): orig_dests= new_dests= 2024-09-12T00:35:03.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.211+0000 7ff01da0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): potential dests added=[] removed=[] 2024-09-12T00:35:03.212 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.213+0000 7ff01da0e800 -1 Injecting error=-5 at location=do_reshard 2024-09-12T00:35:03.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.216+0000 7ff01da0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:03.214 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.216+0000 7ff01da0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 2024-09-12T00:35:03.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.217+0000 7ff01da0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 info.flags=0x17 2024-09-12T00:35:03.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.217+0000 7ff01da0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 to cache LRU end 2024-09-12T00:35:03.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.217+0000 7ff01da0e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:03.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.217+0000 7ff01da0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34, ofs0, ns] 2024-09-12T00:35:03.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.218+0000 7feefcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497057 cookie 94152948991856 notifier 7091 bl.length()=963 2024-09-12T00:35:03.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.218+0000 7feefcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 info.flags=0x17 2024-09-12T00:35:03.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.218+0000 7feefcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 to cache LRU end 2024-09-12T00:35:03.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.218+0000 7feefcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:03.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.219+0000 7ff01da0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): orig_sources= new_sources= 2024-09-12T00:35:03.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.219+0000 7ff01da0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): potential sources added=[] removed=[] 2024-09-12T00:35:03.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.219+0000 7ff01da0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): orig_dests= new_dests= 2024-09-12T00:35:03.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.219+0000 7ff01da0e800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): potential dests added=[] removed=[] 2024-09-12T00:35:03.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.219+0000 7ff01da0e800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T00:35:03.220 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.221+0000 7feecf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:03.222 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.223+0000 7ff01da0e800 20 remove_watcher() i=0 2024-09-12T00:35:03.222 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.223+0000 7ff01da0e800 2 removed watcher, disabling cache 2024-09-12T00:35:03.223 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.224+0000 7ff01da0e800 20 remove_watcher() i=1 2024-09-12T00:35:03.224 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.226+0000 7ff01da0e800 20 remove_watcher() i=2 2024-09-12T00:35:03.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.227+0000 7ff01da0e800 20 remove_watcher() i=3 2024-09-12T00:35:03.226 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.228+0000 7ff01da0e800 20 remove_watcher() i=4 2024-09-12T00:35:03.227 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.229+0000 7ff01da0e800 20 remove_watcher() i=5 2024-09-12T00:35:03.228 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.230+0000 7ff01da0e800 20 remove_watcher() i=6 2024-09-12T00:35:03.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.231+0000 7ff01da0e800 20 remove_watcher() i=7 2024-09-12T00:35:03.241 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:35:03.270 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:03.270 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:03.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.308+0000 7f4284c30800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.310+0000 7f4284c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.310+0000 7f4284c30800 20 realm 2024-09-12T00:35:03.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.310+0000 7f4284c30800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.310+0000 7f4284c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.310+0000 7f4284c30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:03.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.310+0000 7f4284c30800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.310+0000 7f4284c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.310+0000 7f4284c30800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.311+0000 7f4284c30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:03.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.311+0000 7f4284c30800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.311+0000 7f4284c30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:03.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.311+0000 7f4284c30800 20 searching for the correct realm 2024-09-12T00:35:03.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.312+0000 7f427ff53640 0 -- 172.21.15.133:0/14953897 >> [v2:172.21.15.133:6816/1011460824,v1:172.21.15.133:6817/1011460824] conn(0x7f426c0036a0 msgr2=0x7f4278090a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:03.516 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.517+0000 7f427ff53640 0 -- 172.21.15.133:0/14953897 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x55e325bb3aa0 msgr2=0x55e325bb5ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:03.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.523+0000 7f4284c30800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:03.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.523+0000 7f4284c30800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:03.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.523+0000 7f4284c30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:03.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.523+0000 7f4284c30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:03.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.523+0000 7f4284c30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:03.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.523+0000 7f4284c30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:03.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.523+0000 7f4284c30800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.524+0000 7f4284c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.524+0000 7f4284c30800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.524 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.524+0000 7f4284c30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:03.524 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.524+0000 7f4284c30800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.524 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.524+0000 7f4284c30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:03.524 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.524+0000 7f4284c30800 20 zone default found 2024-09-12T00:35:03.524 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.524+0000 7f4284c30800 4 Realm: () 2024-09-12T00:35:03.524 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.524+0000 7f4284c30800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:03.524 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.524+0000 7f4284c30800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:03.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.524+0000 7f4284c30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:03.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.524+0000 7f4284c30800 20 zonegroup default 2024-09-12T00:35:03.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.524+0000 7f4284c30800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.525+0000 7f4284c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.525+0000 7f4284c30800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.525+0000 7f4284c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.525+0000 7f4284c30800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.525+0000 7f4284c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.525+0000 7f4284c30800 20 started sync module instance, tier type = 2024-09-12T00:35:03.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.525+0000 7f4284c30800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:03.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.534+0000 7f4284c30800 20 add_watcher() i=0 2024-09-12T00:35:03.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.534+0000 7f4284c30800 20 add_watcher() i=1 2024-09-12T00:35:03.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.534+0000 7f4284c30800 20 add_watcher() i=2 2024-09-12T00:35:03.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.534+0000 7f4284c30800 20 add_watcher() i=3 2024-09-12T00:35:03.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.534+0000 7f4284c30800 20 add_watcher() i=4 2024-09-12T00:35:03.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.534+0000 7f4284c30800 20 add_watcher() i=5 2024-09-12T00:35:03.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.534+0000 7f4284c30800 20 add_watcher() i=6 2024-09-12T00:35:03.534 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.535+0000 7f4284c30800 20 add_watcher() i=7 2024-09-12T00:35:03.534 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.535+0000 7f4284c30800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:03.536 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.537+0000 7f4135fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:03.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.538+0000 7f4284c30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:03.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.538+0000 7f4284c30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:03.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.538+0000 7f4284c30800 5 note: GC not initialized 2024-09-12T00:35:03.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.538+0000 7f4134fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:03.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.538+0000 7f4284c30800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:03.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.538+0000 7f4284c30800 20 Filter name: none 2024-09-12T00:35:03.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.538+0000 7f40ae7fc640 20 reqs_thread_entry: start 2024-09-12T00:35:03.537 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.538+0000 7f4284c30800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.539+0000 7f4284c30800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:03.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.539+0000 7f4284c30800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.539+0000 7f4284c30800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:03.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.539+0000 7f4284c30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:03.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.539+0000 7f4284c30800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.540+0000 7f4284c30800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:03.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.540+0000 7f4284c30800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.540+0000 7f4284c30800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:03.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.540+0000 7f4284c30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:03.540 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.542+0000 7f4135fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:03.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.544+0000 7f4284c30800 20 remove_watcher() i=0 2024-09-12T00:35:03.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.544+0000 7f4284c30800 2 removed watcher, disabling cache 2024-09-12T00:35:03.544 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.545+0000 7f4284c30800 20 remove_watcher() i=1 2024-09-12T00:35:03.545 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.546+0000 7f4284c30800 20 remove_watcher() i=2 2024-09-12T00:35:03.546 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.547+0000 7f4284c30800 20 remove_watcher() i=3 2024-09-12T00:35:03.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.548+0000 7f4284c30800 20 remove_watcher() i=4 2024-09-12T00:35:03.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.549+0000 7f4284c30800 20 remove_watcher() i=5 2024-09-12T00:35:03.549 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.550+0000 7f4284c30800 20 remove_watcher() i=6 2024-09-12T00:35:03.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.551+0000 7f4284c30800 20 remove_watcher() i=7 2024-09-12T00:35:03.560 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:03.560 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:35:03.561 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-do-reshard id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:35:03.561 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:03.652 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:35:03.683 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:03.683 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:03.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.721+0000 7f9892975800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.723+0000 7f9892975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.723+0000 7f9892975800 20 realm 2024-09-12T00:35:03.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.723+0000 7f9892975800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.723+0000 7f9892975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.723+0000 7f9892975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:03.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.723+0000 7f9892975800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.723+0000 7f9892975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:03.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.723+0000 7f9892975800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.724+0000 7f9892975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:03.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.724+0000 7f9892975800 20 rados->read ofs=0 len=0 2024-09-12T00:35:03.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.725+0000 7f9892975800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:03.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.725+0000 7f9892975800 20 searching for the correct realm 2024-09-12T00:35:03.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:03.726+0000 7f988fc5e640 0 -- 172.21.15.133:0/1660784689 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x564a71a63220 msgr2=0x7f98840aaa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:04.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.133+0000 7f989045f640 0 -- 172.21.15.133:0/1660784689 >> [v2:172.21.15.160:6818/507321805,v1:172.21.15.160:6819/507321805] conn(0x7f98840bc040 msgr2=0x7f98840c50d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:04.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.140+0000 7f9892975800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:04.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.140+0000 7f9892975800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:04.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.140+0000 7f9892975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:04.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.140+0000 7f9892975800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:04.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.140+0000 7f9892975800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:04.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.140+0000 7f9892975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:04.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.140+0000 7f9892975800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.140+0000 7f9892975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:04.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.140+0000 7f9892975800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.140+0000 7f9892975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:04.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.140+0000 7f9892975800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.141+0000 7f9892975800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:04.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.141+0000 7f9892975800 20 zone default found 2024-09-12T00:35:04.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.141+0000 7f9892975800 4 Realm: () 2024-09-12T00:35:04.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.141+0000 7f9892975800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:04.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.141+0000 7f9892975800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:04.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.141+0000 7f9892975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:04.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.141+0000 7f9892975800 20 zonegroup default 2024-09-12T00:35:04.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.141+0000 7f9892975800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.141+0000 7f9892975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:04.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.141+0000 7f9892975800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.141+0000 7f9892975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:04.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.141+0000 7f9892975800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.142+0000 7f9892975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:04.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.142+0000 7f9892975800 20 started sync module instance, tier type = 2024-09-12T00:35:04.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.142+0000 7f9892975800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:04.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.151+0000 7f9892975800 20 add_watcher() i=0 2024-09-12T00:35:04.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.151+0000 7f9892975800 20 add_watcher() i=1 2024-09-12T00:35:04.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.151+0000 7f9892975800 20 add_watcher() i=2 2024-09-12T00:35:04.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.151+0000 7f9892975800 20 add_watcher() i=3 2024-09-12T00:35:04.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.151+0000 7f9892975800 20 add_watcher() i=4 2024-09-12T00:35:04.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.151+0000 7f9892975800 20 add_watcher() i=5 2024-09-12T00:35:04.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.151+0000 7f9892975800 20 add_watcher() i=6 2024-09-12T00:35:04.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.152+0000 7f9892975800 20 add_watcher() i=7 2024-09-12T00:35:04.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.152+0000 7f9892975800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:04.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.154+0000 7f9746fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:04.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.155+0000 7f9892975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:04.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.155+0000 7f9892975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:04.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.155+0000 7f9892975800 5 note: GC not initialized 2024-09-12T00:35:04.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.155+0000 7f9745fdb640 20 reqs_thread_entry: start 2024-09-12T00:35:04.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.155+0000 7f9892975800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:04.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.155+0000 7f9892975800 20 Filter name: none 2024-09-12T00:35:04.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.155+0000 7f96b77fe640 20 reqs_thread_entry: start 2024-09-12T00:35:04.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.155+0000 7f9892975800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:35:04.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.155+0000 7f9892975800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.156+0000 7f9892975800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:04.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.156+0000 7f9892975800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:35:04.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.156+0000 7f9892975800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:35:04.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.156+0000 7f9892975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 : miss 2024-09-12T00:35:04.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.156+0000 7f9892975800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.156+0000 7f9892975800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:04.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.156+0000 7f9892975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 info.flags=0x17 2024-09-12T00:35:04.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.156+0000 7f9892975800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 to cache LRU end 2024-09-12T00:35:04.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.156+0000 7f9892975800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:04.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.156+0000 7f9892975800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:04.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.156+0000 7f9892975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 2024-09-12T00:35:04.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.160+0000 7f9892975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 info.flags=0x17 2024-09-12T00:35:04.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.160+0000 7f9892975800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 to cache LRU end 2024-09-12T00:35:04.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.160+0000 7f9892975800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:04.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.160+0000 7f9892975800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34, ofs0, ns] 2024-09-12T00:35:04.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.161+0000 7f97677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 94877736094064 notifier 7124 bl.length()=995 2024-09-12T00:35:04.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.161+0000 7f97677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 info.flags=0x17 2024-09-12T00:35:04.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.161+0000 7f97677fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 to cache LRU end 2024-09-12T00:35:04.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.161+0000 7f97677fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:04.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.162+0000 7f9892975800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): orig_sources= new_sources= 2024-09-12T00:35:04.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.162+0000 7f9892975800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): potential sources added=[] removed=[] 2024-09-12T00:35:04.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.162+0000 7f9892975800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): orig_dests= new_dests= 2024-09-12T00:35:04.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.162+0000 7f9892975800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): potential dests added=[] removed=[] 2024-09-12T00:35:04.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.165+0000 7f9892975800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34.1.0 2024-09-12T00:35:04.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.165+0000 7f9892975800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34.1.0 2024-09-12T00:35:04.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.165+0000 7f9892975800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34.1.1 2024-09-12T00:35:04.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.165+0000 7f9892975800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34.1.1 2024-09-12T00:35:04.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.165+0000 7f9892975800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34.0 2024-09-12T00:35:04.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.167+0000 7f9892975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:04.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.167+0000 7f9892975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 2024-09-12T00:35:04.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.168+0000 7f9892975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 info.flags=0x17 2024-09-12T00:35:04.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.168+0000 7f9892975800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 to cache LRU end 2024-09-12T00:35:04.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.168+0000 7f9892975800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:04.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.168+0000 7f9892975800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34, ofs0, ns] 2024-09-12T00:35:04.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.169+0000 7f97677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497059 cookie 94877736094064 notifier 7124 bl.length()=995 2024-09-12T00:35:04.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.169+0000 7f97677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 info.flags=0x17 2024-09-12T00:35:04.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.169+0000 7f97677fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 to cache LRU end 2024-09-12T00:35:04.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.169+0000 7f97677fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:04.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.170+0000 7f9892975800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): orig_sources= new_sources= 2024-09-12T00:35:04.169 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.170+0000 7f9892975800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): potential sources added=[] removed=[] 2024-09-12T00:35:04.169 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.170+0000 7f9892975800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): orig_dests= new_dests= 2024-09-12T00:35:04.169 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.170+0000 7f9892975800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): potential dests added=[] removed=[] 2024-09-12T00:35:04.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.171+0000 7f9892975800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34.0 2024-09-12T00:35:04.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.172+0000 7f9892975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:04.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.172+0000 7f9892975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 2024-09-12T00:35:04.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.173+0000 7f9892975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 info.flags=0x17 2024-09-12T00:35:04.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.173+0000 7f9892975800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 to cache LRU end 2024-09-12T00:35:04.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.173+0000 7f9892975800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:04.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.173+0000 7f9892975800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34, ofs0, ns] 2024-09-12T00:35:04.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.173+0000 7f97677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497060 cookie 94877736094064 notifier 7124 bl.length()=963 2024-09-12T00:35:04.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.173+0000 7f97677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 info.flags=0x17 2024-09-12T00:35:04.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.173+0000 7f97677fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 to cache LRU end 2024-09-12T00:35:04.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.173+0000 7f97677fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:04.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.175+0000 7f9892975800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): orig_sources= new_sources= 2024-09-12T00:35:04.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.175+0000 7f9892975800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): potential sources added=[] removed=[] 2024-09-12T00:35:04.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.175+0000 7f9892975800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): orig_dests= new_dests= 2024-09-12T00:35:04.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.175+0000 7f9892975800 20 handle_bi_update(): bucket=:error-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34]): potential dests added=[] removed=[] 2024-09-12T00:35:04.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.176+0000 7f9892975800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T00:35:04.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.178+0000 7f9746fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:04.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.180+0000 7f9892975800 20 remove_watcher() i=0 2024-09-12T00:35:04.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.180+0000 7f9892975800 2 removed watcher, disabling cache 2024-09-12T00:35:04.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.181+0000 7f9892975800 20 remove_watcher() i=1 2024-09-12T00:35:04.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.182+0000 7f9892975800 20 remove_watcher() i=2 2024-09-12T00:35:04.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.183+0000 7f9892975800 20 remove_watcher() i=3 2024-09-12T00:35:04.183 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.185+0000 7f9892975800 20 remove_watcher() i=4 2024-09-12T00:35:04.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.186+0000 7f9892975800 20 remove_watcher() i=5 2024-09-12T00:35:04.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.187+0000 7f9892975800 20 remove_watcher() i=6 2024-09-12T00:35:04.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.188+0000 7f9892975800 20 remove_watcher() i=7 2024-09-12T00:35:04.198 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:35:04.227 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:04.227 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:04.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.266+0000 7f32c972c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.268+0000 7f32c972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:04.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.268+0000 7f32c972c800 20 realm 2024-09-12T00:35:04.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.268+0000 7f32c972c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.268+0000 7f32c972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:04.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.268+0000 7f32c972c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:04.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.268+0000 7f32c972c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.268+0000 7f32c972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:04.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.268+0000 7f32c972c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.269+0000 7f32c972c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:04.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.269+0000 7f32c972c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.270+0000 7f32c972c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:04.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.270+0000 7f32c972c800 20 searching for the correct realm 2024-09-12T00:35:04.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.271+0000 7f32c533e640 0 -- 172.21.15.133:0/7922213 >> [v2:172.21.15.133:6816/1011460824,v1:172.21.15.133:6817/1011460824] conn(0x7f32c001f040 msgr2=0x7f32c0068d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:04.476 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.477+0000 7f32c533e640 0 -- 172.21.15.133:0/7922213 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x55668215e000 msgr2=0x5566821604c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:04.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.483+0000 7f32c972c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:04.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.483+0000 7f32c972c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:04.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.483+0000 7f32c972c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:04.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.483+0000 7f32c972c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:04.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.483+0000 7f32c972c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:04.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.483+0000 7f32c972c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:04.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.483+0000 7f32c972c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.484+0000 7f32c972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:04.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.484+0000 7f32c972c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.484+0000 7f32c972c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:04.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.484+0000 7f32c972c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.484+0000 7f32c972c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:04.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.484+0000 7f32c972c800 20 zone default found 2024-09-12T00:35:04.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.484+0000 7f32c972c800 4 Realm: () 2024-09-12T00:35:04.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.484+0000 7f32c972c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:04.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.484+0000 7f32c972c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:04.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.484+0000 7f32c972c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:04.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.484+0000 7f32c972c800 20 zonegroup default 2024-09-12T00:35:04.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.484+0000 7f32c972c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.484+0000 7f32c972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:04.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.484+0000 7f32c972c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.485+0000 7f32c972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:04.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.485+0000 7f32c972c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.485+0000 7f32c972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:04.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.485+0000 7f32c972c800 20 started sync module instance, tier type = 2024-09-12T00:35:04.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.485+0000 7f32c972c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:04.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.497+0000 7f32c972c800 20 add_watcher() i=0 2024-09-12T00:35:04.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.497+0000 7f32c972c800 20 add_watcher() i=1 2024-09-12T00:35:04.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.497+0000 7f32c972c800 20 add_watcher() i=2 2024-09-12T00:35:04.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.497+0000 7f32c972c800 20 add_watcher() i=3 2024-09-12T00:35:04.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.497+0000 7f32c972c800 20 add_watcher() i=4 2024-09-12T00:35:04.497 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.497+0000 7f32c972c800 20 add_watcher() i=5 2024-09-12T00:35:04.497 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.497+0000 7f32c972c800 20 add_watcher() i=6 2024-09-12T00:35:04.497 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.498+0000 7f32c972c800 20 add_watcher() i=7 2024-09-12T00:35:04.497 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.498+0000 7f32c972c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:04.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.500+0000 7f317b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:04.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.501+0000 7f32c972c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:04.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.501+0000 7f32c972c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:04.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.501+0000 7f32c972c800 5 note: GC not initialized 2024-09-12T00:35:04.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.501+0000 7f317a7e4640 20 reqs_thread_entry: start 2024-09-12T00:35:04.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.501+0000 7f32c972c800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:04.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.501+0000 7f32c972c800 20 Filter name: none 2024-09-12T00:35:04.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.501+0000 7f30ebfff640 20 reqs_thread_entry: start 2024-09-12T00:35:04.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.501+0000 7f32c972c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.502+0000 7f32c972c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:04.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.502+0000 7f32c972c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.502+0000 7f32c972c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:04.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.502+0000 7f32c972c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:04.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.502+0000 7f32c972c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.503+0000 7f32c972c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:04.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.503+0000 7f32c972c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:04.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.503+0000 7f32c972c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:04.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.503+0000 7f32c972c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:04.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.504+0000 7f317b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:04.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.506+0000 7f32c972c800 20 remove_watcher() i=0 2024-09-12T00:35:04.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.506+0000 7f32c972c800 2 removed watcher, disabling cache 2024-09-12T00:35:04.507 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.508+0000 7f32c972c800 20 remove_watcher() i=1 2024-09-12T00:35:04.508 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.509+0000 7f32c972c800 20 remove_watcher() i=2 2024-09-12T00:35:04.509 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.510+0000 7f32c972c800 20 remove_watcher() i=3 2024-09-12T00:35:04.510 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.511+0000 7f32c972c800 20 remove_watcher() i=4 2024-09-12T00:35:04.512 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.513+0000 7f32c972c800 20 remove_watcher() i=5 2024-09-12T00:35:04.513 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.514+0000 7f32c972c800 20 remove_watcher() i=6 2024-09-12T00:35:04.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:04.515+0000 7f32c972c800 20 remove_watcher() i=7 2024-09-12T00:35:04.524 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:04.524 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:35:04.525 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-do-reshard id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:35:04.525 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:04.814 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T00:35:04.814 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:05.625 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:35:05.653 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:05.653 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:05.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.691+0000 7f812ef36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:05.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.693+0000 7f812ef36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:05.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.693+0000 7f812ef36800 20 realm 2024-09-12T00:35:05.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.693+0000 7f812ef36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:05.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.693+0000 7f812ef36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:05.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.693+0000 7f812ef36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:05.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.693+0000 7f812ef36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:05.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.693+0000 7f812ef36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:05.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.693+0000 7f812ef36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:05.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.694+0000 7f812ef36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:05.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.694+0000 7f812ef36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:05.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.695+0000 7f812ef36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:05.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.695+0000 7f812ef36800 20 searching for the correct realm 2024-09-12T00:35:05.695 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.697+0000 7f812b4b8640 0 -- 172.21.15.133:0/2457441184 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x55ff1065e310 msgr2=0x55ff10660700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:05.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.700+0000 7f812a4b6640 0 -- 172.21.15.133:0/2457441184 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f811c021060 msgr2=0x7f811c05fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:05.906 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.907+0000 7f812ef36800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:05.906 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.907+0000 7f812ef36800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:05.906 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.907+0000 7f812ef36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:05.906 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.907+0000 7f812ef36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:05.906 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.907+0000 7f812ef36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:05.906 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.907+0000 7f812ef36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:05.906 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.907+0000 7f812ef36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:05.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.907+0000 7f812ef36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:05.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.907+0000 7f812ef36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:05.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.907+0000 7f812ef36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:05.907 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.907+0000 7f812ef36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:05.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.908+0000 7f812ef36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:05.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.908+0000 7f812ef36800 20 zone default found 2024-09-12T00:35:05.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.908+0000 7f812ef36800 4 Realm: () 2024-09-12T00:35:05.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.908+0000 7f812ef36800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:05.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.908+0000 7f812ef36800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:05.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.908+0000 7f812ef36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:05.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.908+0000 7f812ef36800 20 zonegroup default 2024-09-12T00:35:05.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.908+0000 7f812ef36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:05.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.908+0000 7f812ef36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:05.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.908+0000 7f812ef36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:05.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.908+0000 7f812ef36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:05.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.908+0000 7f812ef36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:05.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.908+0000 7f812ef36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:05.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.908+0000 7f812ef36800 20 started sync module instance, tier type = 2024-09-12T00:35:05.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.908+0000 7f812ef36800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:05.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.919+0000 7f812ef36800 20 add_watcher() i=0 2024-09-12T00:35:05.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.919+0000 7f812ef36800 20 add_watcher() i=1 2024-09-12T00:35:05.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.919+0000 7f812ef36800 20 add_watcher() i=2 2024-09-12T00:35:05.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.919+0000 7f812ef36800 20 add_watcher() i=3 2024-09-12T00:35:05.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.919+0000 7f812ef36800 20 add_watcher() i=4 2024-09-12T00:35:05.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.919+0000 7f812ef36800 20 add_watcher() i=5 2024-09-12T00:35:05.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.919+0000 7f812ef36800 20 add_watcher() i=6 2024-09-12T00:35:05.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.920+0000 7f812ef36800 20 add_watcher() i=7 2024-09-12T00:35:05.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.920+0000 7f812ef36800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:05.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.922+0000 7f7fe17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:05.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.922+0000 7f812ef36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:05.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.922+0000 7f812ef36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:05.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.922+0000 7f812ef36800 5 note: GC not initialized 2024-09-12T00:35:05.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.922+0000 7f7f5bfff640 20 reqs_thread_entry: start 2024-09-12T00:35:05.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.922+0000 7f812ef36800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:05.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.922+0000 7f812ef36800 20 Filter name: none 2024-09-12T00:35:05.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.922+0000 7f7f59ffb640 20 reqs_thread_entry: start 2024-09-12T00:35:05.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.922+0000 7f812ef36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:05.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.923+0000 7f812ef36800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:05.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.923+0000 7f812ef36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:05.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.923+0000 7f812ef36800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:05.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.923+0000 7f812ef36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:05.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.923+0000 7f812ef36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:05.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.924+0000 7f812ef36800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:05.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.924+0000 7f812ef36800 20 rados->read ofs=0 len=0 2024-09-12T00:35:05.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.924+0000 7f812ef36800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:05.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.924+0000 7f812ef36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:05.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.925+0000 7f7fe17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:05.926 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.927+0000 7f812ef36800 20 remove_watcher() i=0 2024-09-12T00:35:05.926 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.927+0000 7f812ef36800 2 removed watcher, disabling cache 2024-09-12T00:35:05.927 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.928+0000 7f812ef36800 20 remove_watcher() i=1 2024-09-12T00:35:05.927 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.929+0000 7f812ef36800 20 remove_watcher() i=2 2024-09-12T00:35:05.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.930+0000 7f812ef36800 20 remove_watcher() i=3 2024-09-12T00:35:05.930 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.931+0000 7f812ef36800 20 remove_watcher() i=4 2024-09-12T00:35:05.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.932+0000 7f812ef36800 20 remove_watcher() i=5 2024-09-12T00:35:05.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.933+0000 7f812ef36800 20 remove_watcher() i=6 2024-09-12T00:35:05.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:05.934+0000 7f812ef36800 20 remove_watcher() i=7 2024-09-12T00:35:05.943 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:05.943 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:35:05.943 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-do-reshard id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:35:05.943 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:05.945 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:35:05.979 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:05.979 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:06.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.017+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.017 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.018+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.017 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.018+0000 7fd89c52d800 20 realm 2024-09-12T00:35:06.017 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.018+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.018 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.018+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.018 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.018+0000 7fd89c52d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:06.018 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.018+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.018 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.019+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.018 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.019+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.018 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.019+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:06.018 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.019+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.019 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.020+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:06.019 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.020+0000 7fd89c52d800 20 searching for the correct realm 2024-09-12T00:35:06.021 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.022+0000 7fd897a75640 0 -- 172.21.15.133:0/1127202247 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fd88c034070 msgr2=0x7fd88c024920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:06.226 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.227+0000 7fd897a75640 0 -- 172.21.15.133:0/1127202247 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fd888061040 msgr2=0x7fd88806b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:06.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:06.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:06.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:06.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:06.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:06.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:06.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.434+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.434+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.434+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.434+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:06.434 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.434+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:06.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.435+0000 7fd89c52d800 20 zone default found 2024-09-12T00:35:06.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.435+0000 7fd89c52d800 4 Realm: () 2024-09-12T00:35:06.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.435+0000 7fd89c52d800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:06.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.435+0000 7fd89c52d800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:06.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.435+0000 7fd89c52d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:06.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.435+0000 7fd89c52d800 20 zonegroup default 2024-09-12T00:35:06.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.435+0000 7fd89c52d800 20 started sync module instance, tier type = 2024-09-12T00:35:06.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.436+0000 7fd89c52d800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:06.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=0 2024-09-12T00:35:06.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=1 2024-09-12T00:35:06.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=2 2024-09-12T00:35:06.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=3 2024-09-12T00:35:06.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=4 2024-09-12T00:35:06.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=5 2024-09-12T00:35:06.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=6 2024-09-12T00:35:06.443 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.445+0000 7fd89c52d800 20 add_watcher() i=7 2024-09-12T00:35:06.444 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.445+0000 7fd89c52d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:06.445 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.446+0000 7fd74efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:06.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.447+0000 7fd89c52d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:06.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.447+0000 7fd89c52d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:06.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.447+0000 7fd89c52d800 5 note: GC not initialized 2024-09-12T00:35:06.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.447+0000 7fd74dfdb640 20 reqs_thread_entry: start 2024-09-12T00:35:06.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.447+0000 7fd89c52d800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:06.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.447+0000 7fd89c52d800 20 Filter name: none 2024-09-12T00:35:06.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.447+0000 7fd6bf7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:06.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.447+0000 7fd89c52d800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:35:06.446 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.447+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.448+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:06.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.448+0000 7fd89c52d800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:35:06.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.448+0000 7fd89c52d800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:35:06.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.448+0000 7fd89c52d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 : miss 2024-09-12T00:35:06.447 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.448+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.448+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:06.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.448+0000 7fd89c52d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:06.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.448+0000 7fd89c52d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:06.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.448+0000 7fd89c52d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:06.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.448+0000 7fd89c52d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:06.448 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.448+0000 7fd89c52d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 2024-09-12T00:35:06.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.452+0000 7fd89c52d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:06.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.452+0000 7fd89c52d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:06.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.452+0000 7fd89c52d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:06.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.452+0000 7fd89c52d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35, ofs0, ns] 2024-09-12T00:35:06.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.452+0000 7fd76f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94837867646080 notifier 7647 bl.length()=995 2024-09-12T00:35:06.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.452+0000 7fd76f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:06.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.452+0000 7fd76f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:06.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.452+0000 7fd76f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:06.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.454+0000 7fd89c52d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): orig_sources= new_sources= 2024-09-12T00:35:06.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.454+0000 7fd89c52d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): potential sources added=[] removed=[] 2024-09-12T00:35:06.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.454+0000 7fd89c52d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): orig_dests= new_dests= 2024-09-12T00:35:06.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.454+0000 7fd89c52d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): potential dests added=[] removed=[] 2024-09-12T00:35:06.455 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd89c52d800 time 2024-09-12T00:35:06.457449+0000 2024-09-12T00:35:06.455 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:06.455 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:06.455 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd89dd8c71a] 2024-09-12T00:35:06.455 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd89dd8c8d8] 2024-09-12T00:35:06.456 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564127d67641] 2024-09-12T00:35:06.456 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564127d7738a] 2024-09-12T00:35:06.456 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:35:06.456 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd89ca29590] 2024-09-12T00:35:06.456 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:35:06.456 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:35:06.456 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.457+0000 7fd89c52d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd89c52d800 time 2024-09-12T00:35:06.457449+0000 2024-09-12T00:35:06.456 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:06.456 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.456 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:06.456 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd89dd8c71a] 2024-09-12T00:35:06.456 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd89dd8c8d8] 2024-09-12T00:35:06.456 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564127d67641] 2024-09-12T00:35:06.457 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564127d7738a] 2024-09-12T00:35:06.457 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:35:06.457 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd89ca29590] 2024-09-12T00:35:06.457 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:35:06.457 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:35:06.457 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.457 INFO:tasks.workunit.client.0.smithi133.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:35:06.457 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7fd89c52d800 thread_name:radosgw-admin 2024-09-12T00:35:06.477 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:06.477 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd89ca3e6f0] 2024-09-12T00:35:06.477 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd89ca8b99c] 2024-09-12T00:35:06.477 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:35:06.477 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd89dd8c774] 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd89dd8c8d8] 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564127d67641] 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564127d7738a] 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd89ca29590] 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.458+0000 7fd89c52d800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7fd89c52d800 thread_name:radosgw-admin 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd89ca3e6f0] 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd89ca8b99c] 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:35:06.478 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:35:06.479 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd89dd8c774] 2024-09-12T00:35:06.479 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd89dd8c8d8] 2024-09-12T00:35:06.479 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564127d67641] 2024-09-12T00:35:06.479 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564127d7738a] 2024-09-12T00:35:06.479 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:35:06.479 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd89ca29590] 2024-09-12T00:35:06.479 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:35:06.479 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:35:06.479 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:06.479 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.479 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:35:06.479 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:35:06.000+0000 7fd89c52d800 10 monclient: get_monmap_and_config success 2024-09-12T00:35:06.479 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:35:06.000+0000 7fd89c52d800 4 set_mon_vals no callback set 2024-09-12T00:35:06.479 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:35:06.000+0000 7fd89c52d800 10 monclient: shutdown 2024-09-12T00:35:06.479 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:35:06.000+0000 7fd89c52d800 5 asok(0x56412937b630) unregister_commands rotate-key 2024-09-12T00:35:06.480 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:35:06.001+0000 7fd89c52d800 10 monclient: build_initial_monmap 2024-09-12T00:35:06.480 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:35:06.001+0000 7fd89c52d800 1 build_initial for_mkfs: 0 2024-09-12T00:35:06.480 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:35:06.001+0000 7fd89c52d800 10 monclient: monmap: 2024-09-12T00:35:06.480 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:06.480 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:06.480 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:06.480 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:06.480 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:06.480 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.480 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:06.480 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:06.480 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:06.480 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.480 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding auth protocol: cephx 2024-09-12T00:35:06.480 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding auth protocol: cephx 2024-09-12T00:35:06.481 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding auth protocol: cephx 2024-09-12T00:35:06.481 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: secure 2024-09-12T00:35:06.481 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: crc 2024-09-12T00:35:06.481 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: secure 2024-09-12T00:35:06.481 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: crc 2024-09-12T00:35:06.481 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: secure 2024-09-12T00:35:06.481 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: crc 2024-09-12T00:35:06.481 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: crc 2024-09-12T00:35:06.481 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: secure 2024-09-12T00:35:06.481 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: crc 2024-09-12T00:35:06.481 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: secure 2024-09-12T00:35:06.481 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: crc 2024-09-12T00:35:06.481 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: secure 2024-09-12T00:35:06.481 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:35:06.001+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.482 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:35:06.001+0000 7fd89c52d800 1 librados: starting msgr at 2024-09-12T00:35:06.482 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:35:06.001+0000 7fd89c52d800 1 librados: starting objecter 2024-09-12T00:35:06.482 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 asok(0x56412937b630) register_command objecter_requests hook 0x5641295c35f0 2024-09-12T00:35:06.482 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:35:06.001+0000 7fd89c52d800 1 librados: setting wanted keys 2024-09-12T00:35:06.482 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:35:06.001+0000 7fd89c52d800 1 librados: calling monclient init 2024-09-12T00:35:06.482 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:35:06.001+0000 7fd89c52d800 10 monclient: init 2024-09-12T00:35:06.482 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding auth protocol: cephx 2024-09-12T00:35:06.482 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding auth protocol: cephx 2024-09-12T00:35:06.482 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding auth protocol: cephx 2024-09-12T00:35:06.482 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: secure 2024-09-12T00:35:06.482 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: crc 2024-09-12T00:35:06.483 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: secure 2024-09-12T00:35:06.483 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: crc 2024-09-12T00:35:06.483 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: secure 2024-09-12T00:35:06.483 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: crc 2024-09-12T00:35:06.483 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: crc 2024-09-12T00:35:06.483 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: secure 2024-09-12T00:35:06.483 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: crc 2024-09-12T00:35:06.483 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: secure 2024-09-12T00:35:06.483 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: crc 2024-09-12T00:35:06.483 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: secure 2024-09-12T00:35:06.483 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:35:06.001+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.483 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:35:06.001+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.483 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:35:06.002+0000 7fd89c52d800 5 asok(0x56412937b630) register_command rotate-key hook 0x56412959a9b8 2024-09-12T00:35:06.484 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:06.484 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:35:06.484 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-a con 0x5641294100e0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:06.484 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-b con 0x5641294de190 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:06.484 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-c con 0x5641295c4880 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:06.484 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.484 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.484 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.484 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:06.484 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): authenticate will time out at 2114.574179s 2024-09-12T00:35:06.484 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): get_auth_request con 0x5641294100e0 auth_method 0 2024-09-12T00:35:06.484 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.484 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.484 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.485 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:35:06.002+0000 7fd898a77640 10 monclient(hunting): get_auth_request con 0x5641295c4880 auth_method 0 2024-09-12T00:35:06.485 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:35:06.002+0000 7fd898a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.485 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:35:06.002+0000 7fd898a77640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.485 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:35:06.002+0000 7fd898a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.485 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.485 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.485 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.485 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:35:06.002+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.485 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:35:06.002+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.485 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:35:06.002+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.485 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:35:06.002+0000 7fd897a75640 10 monclient(hunting): get_auth_request con 0x5641294de190 auth_method 0 2024-09-12T00:35:06.485 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:35:06.002+0000 7fd897a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.485 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:35:06.002+0000 7fd897a75640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.485 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:35:06.002+0000 7fd897a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.485 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): handle_auth_done global_id 7638 payload 824 2024-09-12T00:35:06.486 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient: _finish_hunting 0 2024-09-12T00:35:06.486 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:35:06.002+0000 7fd898276640 1 monclient: found mon.noname-a 2024-09-12T00:35:06.486 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:35:06.486 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.486 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:06.486 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: dump: 2024-09-12T00:35:06.486 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.486 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.486 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.486 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.486 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.486 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.486 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.486 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.486 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.487 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.487 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: _finish_auth 0 2024-09-12T00:35:06.487 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: _check_auth_tickets 2024-09-12T00:35:06.487 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:06.487 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.487 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:06.487 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: dump: 2024-09-12T00:35:06.487 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.487 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.487 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.487 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.487 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.487 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.487 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.488 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.488 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.488 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.488 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:35:06.002+0000 7fd89c52d800 5 monclient: authenticate success, global_id 7638 2024-09-12T00:35:06.488 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient: _renew_subs 2024-09-12T00:35:06.488 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:35:06.488 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:35:06.002+0000 7fd78660c640 4 set_mon_vals no callback set 2024-09-12T00:35:06.488 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient: _renew_subs 2024-09-12T00:35:06.488 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:35:06.488 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:35:06.002+0000 7fd89c52d800 1 librados: init done 2024-09-12T00:35:06.488 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:35:06.004+0000 7fd784e09640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:35:06.488 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:35:06.004+0000 7fd784e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:06.488 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:35:06.004+0000 7fd784e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:06.488 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:35:06.004+0000 7fd897a75640 10 monclient: get_auth_request con 0x7fd780076470 auth_method 0 2024-09-12T00:35:06.489 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:35:06.005+0000 7fd898a77640 10 monclient: get_auth_request con 0x5641295e4820 auth_method 0 2024-09-12T00:35:06.489 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:35:06.005+0000 7fd898276640 10 monclient: get_auth_request con 0x5641295e7a00 auth_method 0 2024-09-12T00:35:06.489 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:35:06.006+0000 7fd897a75640 10 monclient: get_auth_request con 0x5641295ebbf0 auth_method 0 2024-09-12T00:35:06.489 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:35:06.007+0000 7fd898a77640 10 monclient: get_auth_request con 0x5641295eb230 auth_method 0 2024-09-12T00:35:06.489 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:35:06.008+0000 7fd89c52d800 10 monclient: build_initial_monmap 2024-09-12T00:35:06.489 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:35:06.008+0000 7fd89c52d800 1 build_initial for_mkfs: 0 2024-09-12T00:35:06.489 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:35:06.008+0000 7fd89c52d800 10 monclient: monmap: 2024-09-12T00:35:06.489 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:06.489 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:06.489 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:06.489 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:06.489 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:06.489 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.489 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:06.489 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:06.490 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:06.490 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.490 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding auth protocol: cephx 2024-09-12T00:35:06.490 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding auth protocol: cephx 2024-09-12T00:35:06.490 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding auth protocol: cephx 2024-09-12T00:35:06.490 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: secure 2024-09-12T00:35:06.490 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: crc 2024-09-12T00:35:06.490 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: secure 2024-09-12T00:35:06.490 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: crc 2024-09-12T00:35:06.490 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: secure 2024-09-12T00:35:06.490 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: crc 2024-09-12T00:35:06.490 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: crc 2024-09-12T00:35:06.490 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: secure 2024-09-12T00:35:06.490 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: crc 2024-09-12T00:35:06.491 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: secure 2024-09-12T00:35:06.491 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: crc 2024-09-12T00:35:06.491 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: secure 2024-09-12T00:35:06.491 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:35:06.008+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.491 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 asok(0x56412937b630) register_command objecter_requests cmddesc objecter_requests hook 0x5641295f7570 EEXIST 2024-09-12T00:35:06.491 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:35:06.008+0000 7fd89c52d800 10 monclient: init 2024-09-12T00:35:06.491 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding auth protocol: cephx 2024-09-12T00:35:06.491 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding auth protocol: cephx 2024-09-12T00:35:06.491 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding auth protocol: cephx 2024-09-12T00:35:06.491 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: secure 2024-09-12T00:35:06.491 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: crc 2024-09-12T00:35:06.491 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: secure 2024-09-12T00:35:06.491 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: crc 2024-09-12T00:35:06.491 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: secure 2024-09-12T00:35:06.491 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: crc 2024-09-12T00:35:06.492 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: crc 2024-09-12T00:35:06.492 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: secure 2024-09-12T00:35:06.492 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: crc 2024-09-12T00:35:06.492 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: secure 2024-09-12T00:35:06.492 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: crc 2024-09-12T00:35:06.492 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: secure 2024-09-12T00:35:06.492 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:35:06.008+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.492 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:35:06.009+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.492 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:35:06.009+0000 7fd89c52d800 5 asok(0x56412937b630) register_command rotate-key cmddesc rotate-key hook 0x5641295f2bc0 EEXIST 2024-09-12T00:35:06.492 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:06.492 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:35:06.492 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-b con 0x56412961b260 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:06.492 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-a con 0x56412961d530 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:06.492 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-c con 0x564129619a30 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:06.492 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): authenticate will time out at 2114.581160s 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:35:06.009+0000 7fd898a77640 10 monclient(hunting): get_auth_request con 0x56412961d530 auth_method 0 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:35:06.009+0000 7fd898a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:35:06.009+0000 7fd898a77640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:35:06.009+0000 7fd898a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): get_auth_request con 0x564129619a30 auth_method 0 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:35:06.009+0000 7fd897a75640 10 monclient(hunting): get_auth_request con 0x56412961b260 auth_method 0 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:35:06.009+0000 7fd897a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:35:06.009+0000 7fd897a75640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.493 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:35:06.009+0000 7fd897a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:35:06.009+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:35:06.009+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:35:06.009+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:35:06.009+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:35:06.009+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:35:06.009+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): handle_auth_done global_id 7169 payload 824 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient: _finish_hunting 0 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:35:06.009+0000 7fd898276640 1 monclient: found mon.noname-c 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:06.494 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: dump: 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: _finish_auth 0 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: _check_auth_tickets 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: dump: 2024-09-12T00:35:06.495 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.496 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.496 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.496 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.496 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.496 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.496 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.496 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.496 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.496 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.496 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:35:06.009+0000 7fd89c52d800 5 monclient: authenticate success, global_id 7169 2024-09-12T00:35:06.496 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient: _renew_subs 2024-09-12T00:35:06.496 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:06.496 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:35:06.009+0000 7fd899278640 4 set_mon_vals no callback set 2024-09-12T00:35:06.496 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient: _renew_subs 2024-09-12T00:35:06.496 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:06.497 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:35:06.011+0000 7fd77dffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:35:06.497 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:35:06.011+0000 7fd77dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:06.497 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:35:06.011+0000 7fd77dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:06.497 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:35:06.011+0000 7fd897a75640 10 monclient: get_auth_request con 0x7fd770076380 auth_method 0 2024-09-12T00:35:06.497 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:35:06.011+0000 7fd89c52d800 10 monclient: get_monmap_and_config 2024-09-12T00:35:06.497 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:35:06.011+0000 7fd89c52d800 10 monclient: build_initial_monmap 2024-09-12T00:35:06.497 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:35:06.011+0000 7fd89c52d800 1 build_initial for_mkfs: 0 2024-09-12T00:35:06.497 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:35:06.011+0000 7fd89c52d800 10 monclient: monmap: 2024-09-12T00:35:06.497 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:06.497 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:06.497 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:06.497 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:06.497 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:06.497 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.497 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:06.498 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:06.498 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:06.498 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.498 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding auth protocol: cephx 2024-09-12T00:35:06.498 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding auth protocol: cephx 2024-09-12T00:35:06.498 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding auth protocol: cephx 2024-09-12T00:35:06.498 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: secure 2024-09-12T00:35:06.498 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: crc 2024-09-12T00:35:06.498 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: secure 2024-09-12T00:35:06.498 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: crc 2024-09-12T00:35:06.498 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: secure 2024-09-12T00:35:06.498 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: crc 2024-09-12T00:35:06.498 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: crc 2024-09-12T00:35:06.498 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: secure 2024-09-12T00:35:06.498 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: crc 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: secure 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: crc 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: secure 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:35:06.012+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient: init 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding auth protocol: cephx 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding auth protocol: cephx 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding auth protocol: cephx 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: secure 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: crc 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: secure 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: crc 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: secure 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: crc 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: crc 2024-09-12T00:35:06.499 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: secure 2024-09-12T00:35:06.500 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: crc 2024-09-12T00:35:06.500 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: secure 2024-09-12T00:35:06.500 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: crc 2024-09-12T00:35:06.500 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: secure 2024-09-12T00:35:06.500 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:35:06.012+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.500 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:35:06.012+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.500 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 asok(0x56412937b630) register_command rotate-key cmddesc rotate-key hook 0x7ffdddd729f8 EEXIST 2024-09-12T00:35:06.500 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:06.500 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:35:06.500 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-c con 0x56412966f460 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:06.500 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-a con 0x56412963f270 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:06.500 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-b con 0x56412966a820 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:06.500 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.500 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.500 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.501 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:06.501 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): authenticate will time out at 2114.584704s 2024-09-12T00:35:06.501 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:35:06.012+0000 7fd897a75640 10 monclient(hunting): get_auth_request con 0x56412966f460 auth_method 0 2024-09-12T00:35:06.501 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:35:06.012+0000 7fd897a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.501 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:35:06.012+0000 7fd897a75640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.501 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:35:06.012+0000 7fd897a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.501 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): get_auth_request con 0x56412963f270 auth_method 0 2024-09-12T00:35:06.501 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.501 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.501 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.501 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:35:06.012+0000 7fd898276640 10 monclient(hunting): get_auth_request con 0x56412966a820 auth_method 0 2024-09-12T00:35:06.501 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:35:06.012+0000 7fd898276640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.501 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:35:06.012+0000 7fd898276640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.501 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:35:06.012+0000 7fd898276640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.501 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:35:06.012+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:35:06.012+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:35:06.012+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:35:06.012+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:35:06.012+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:35:06.012+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): handle_auth_done global_id 7644 payload 274 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:35:06.013+0000 7fd898a77640 10 monclient: _finish_hunting 0 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:35:06.013+0000 7fd898a77640 1 monclient: found mon.noname-a 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:35:06.013+0000 7fd898a77640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: dump: 2024-09-12T00:35:06.502 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: dump: 2024-09-12T00:35:06.503 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.504 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.504 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.504 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.504 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.504 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.504 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.504 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.504 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.504 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.504 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:35:06.013+0000 7fd89c52d800 5 monclient: authenticate success, global_id 7644 2024-09-12T00:35:06.504 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:35:06.013+0000 7fd89c52d800 10 monclient: get_monmap_and_config success 2024-09-12T00:35:06.504 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:35:06.013+0000 7fd89c52d800 4 set_mon_vals no callback set 2024-09-12T00:35:06.504 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:35:06.013+0000 7fd89c52d800 10 monclient: shutdown 2024-09-12T00:35:06.504 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient: build_initial_monmap 2024-09-12T00:35:06.504 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:35:06.014+0000 7fd89c52d800 1 build_initial for_mkfs: 0 2024-09-12T00:35:06.505 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient: monmap: 2024-09-12T00:35:06.505 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:06.505 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:06.505 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:06.505 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:06.505 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:06.505 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.505 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:06.505 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:06.505 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:06.505 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.505 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding auth protocol: cephx 2024-09-12T00:35:06.505 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding auth protocol: cephx 2024-09-12T00:35:06.505 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding auth protocol: cephx 2024-09-12T00:35:06.505 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: secure 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: crc 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: secure 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: crc 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: secure 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: crc 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: crc 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: secure 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: crc 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: secure 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: crc 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: secure 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:35:06.014+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:35:06.014+0000 7fd89c52d800 1 librados: starting msgr at 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:35:06.014+0000 7fd89c52d800 1 librados: starting objecter 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 asok(0x56412937b630) register_command objecter_requests cmddesc objecter_requests hook 0x564129665b40 EEXIST 2024-09-12T00:35:06.506 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:35:06.014+0000 7fd89c52d800 1 librados: setting wanted keys 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:35:06.014+0000 7fd89c52d800 1 librados: calling monclient init 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient: init 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding auth protocol: cephx 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding auth protocol: cephx 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding auth protocol: cephx 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: secure 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: crc 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: secure 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: crc 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: secure 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: crc 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: crc 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: secure 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: crc 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: secure 2024-09-12T00:35:06.507 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: crc 2024-09-12T00:35:06.508 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: secure 2024-09-12T00:35:06.508 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:35:06.014+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.508 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:35:06.014+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.508 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 asok(0x56412937b630) register_command rotate-key cmddesc rotate-key hook 0x564129633158 EEXIST 2024-09-12T00:35:06.508 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:06.508 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:35:06.508 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-c con 0x56412963f270 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:06.508 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-a con 0x56412966a820 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:06.508 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-b con 0x56412966f460 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:06.508 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.508 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.508 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.508 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:06.508 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): authenticate will time out at 2114.586953s 2024-09-12T00:35:06.508 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): get_auth_request con 0x56412966a820 auth_method 0 2024-09-12T00:35:06.509 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.509 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.509 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.509 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:35:06.015+0000 7fd897a75640 10 monclient(hunting): get_auth_request con 0x56412963f270 auth_method 0 2024-09-12T00:35:06.509 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:35:06.015+0000 7fd897a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.509 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:35:06.015+0000 7fd897a75640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.509 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:35:06.015+0000 7fd897a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.509 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:35:06.015+0000 7fd898276640 10 monclient(hunting): get_auth_request con 0x56412966f460 auth_method 0 2024-09-12T00:35:06.509 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:35:06.015+0000 7fd898276640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.509 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:35:06.015+0000 7fd898276640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.509 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:35:06.015+0000 7fd898276640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.509 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.509 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.509 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.509 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:35:06.015+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:35:06.015+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:35:06.015+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:35:06.015+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:35:06.015+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:35:06.015+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): handle_auth_done global_id 7647 payload 824 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient: _finish_hunting 0 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:35:06.015+0000 7fd898a77640 1 monclient: found mon.noname-a 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: dump: 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.510 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: _finish_auth 0 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: _check_auth_tickets 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: dump: 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.511 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.512 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.512 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.512 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.512 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.512 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.512 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.512 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:35:06.015+0000 7fd89c52d800 5 monclient: authenticate success, global_id 7647 2024-09-12T00:35:06.512 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:35:06.015+0000 7fd89c52d800 10 monclient: _renew_subs 2024-09-12T00:35:06.512 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:35:06.015+0000 7fd89c52d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:35:06.512 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:35:06.015+0000 7fd76f7fe640 4 set_mon_vals no callback set 2024-09-12T00:35:06.512 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:35:06.015+0000 7fd89c52d800 10 monclient: _renew_subs 2024-09-12T00:35:06.512 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:35:06.015+0000 7fd89c52d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:35:06.512 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:35:06.015+0000 7fd89c52d800 1 librados: init done 2024-09-12T00:35:06.512 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:35:06.015+0000 7fd89c52d800 5 asok(0x56412937b630) register_command cr dump hook 0x564129663ce8 2024-09-12T00:35:06.513 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:35:06.017+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.513 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:35:06.017+0000 7fd76dffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:35:06.513 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:35:06.017+0000 7fd76dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:06.513 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:35:06.017+0000 7fd76dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:06.513 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:35:06.018+0000 7fd897a75640 10 monclient: get_auth_request con 0x7fd7600764a0 auth_method 0 2024-09-12T00:35:06.513 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:35:06.018+0000 7fd898276640 10 monclient: get_auth_request con 0x564129689bc0 auth_method 0 2024-09-12T00:35:06.513 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:35:06.018+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.513 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:35:06.018+0000 7fd89c52d800 20 realm 2024-09-12T00:35:06.513 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:35:06.018+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.513 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:35:06.018+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.513 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:35:06.018+0000 7fd89c52d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:06.513 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:35:06.018+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.513 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:35:06.019+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.513 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:35:06.019+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.513 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:35:06.019+0000 7fd897a75640 10 monclient: get_auth_request con 0x56412968dd80 auth_method 0 2024-09-12T00:35:06.514 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:35:06.019+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:06.514 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:35:06.019+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.514 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:35:06.020+0000 7fd898a77640 10 monclient: get_auth_request con 0x564129691630 auth_method 0 2024-09-12T00:35:06.514 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:35:06.020+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:06.514 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:35:06.020+0000 7fd89c52d800 20 searching for the correct realm 2024-09-12T00:35:06.514 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:35:06.021+0000 7fd898276640 10 monclient: get_auth_request con 0x7fd89006a680 auth_method 0 2024-09-12T00:35:06.514 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:35:06.022+0000 7fd897a75640 10 monclient: get_auth_request con 0x7fd88c034070 auth_method 0 2024-09-12T00:35:06.514 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:35:06.022+0000 7fd897a75640 0 -- 172.21.15.133:0/1127202247 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fd88c034070 msgr2=0x7fd88c024920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:06.514 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:35:06.223+0000 7fd897a75640 10 monclient: get_auth_request con 0x7fd88c034070 auth_method 0 2024-09-12T00:35:06.514 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:35:06.225+0000 7fd898a77640 10 monclient: get_auth_request con 0x7fd890073170 auth_method 0 2024-09-12T00:35:06.514 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:35:06.227+0000 7fd898276640 10 monclient: get_auth_request con 0x7fd88c025040 auth_method 0 2024-09-12T00:35:06.514 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:35:06.227+0000 7fd897a75640 0 -- 172.21.15.133:0/1127202247 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fd888061040 msgr2=0x7fd88806b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:06.514 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:35:06.429+0000 7fd897a75640 10 monclient: get_auth_request con 0x7fd888061040 auth_method 0 2024-09-12T00:35:06.514 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:06.514 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 zone default found 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:35:06.435+0000 7fd89c52d800 4 Realm: () 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:35:06.435+0000 7fd89c52d800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:35:06.435+0000 7fd89c52d800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:35:06.435+0000 7fd89c52d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:06.515 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 zonegroup default 2024-09-12T00:35:06.516 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.516 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.516 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.516 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.516 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.516 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.516 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 started sync module instance, tier type = 2024-09-12T00:35:06.516 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:35:06.436+0000 7fd89c52d800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:06.516 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=0 2024-09-12T00:35:06.516 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=1 2024-09-12T00:35:06.516 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=2 2024-09-12T00:35:06.516 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=3 2024-09-12T00:35:06.516 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=4 2024-09-12T00:35:06.516 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=5 2024-09-12T00:35:06.516 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=6 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:35:06.445+0000 7fd89c52d800 20 add_watcher() i=7 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:35:06.445+0000 7fd89c52d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding auth protocol: cephx 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding auth protocol: cephx 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding auth protocol: cephx 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: secure 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: crc 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: secure 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: crc 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: secure 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: crc 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: crc 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: secure 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: crc 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: secure 2024-09-12T00:35:06.517 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: crc 2024-09-12T00:35:06.518 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: secure 2024-09-12T00:35:06.518 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:35:06.446+0000 7fd74efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:06.518 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:35:06.447+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.518 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:35:06.447+0000 7fd89c52d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:06.518 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:35:06.447+0000 7fd89c52d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:06.518 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command cache list hook 0x564129664810 2024-09-12T00:35:06.518 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command cache inspect hook 0x564129664810 2024-09-12T00:35:06.518 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command cache erase hook 0x564129664810 2024-09-12T00:35:06.518 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command cache zap hook 0x564129664810 2024-09-12T00:35:06.518 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 note: GC not initialized 2024-09-12T00:35:06.518 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:35:06.447+0000 7fd74dfdb640 20 reqs_thread_entry: start 2024-09-12T00:35:06.518 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command sync trace show hook 0x7fd89000d4a0 2024-09-12T00:35:06.518 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command sync trace history hook 0x7fd89000d4a0 2024-09-12T00:35:06.518 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command sync trace active hook 0x7fd89000d4a0 2024-09-12T00:35:06.518 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command sync trace active_short hook 0x7fd89000d4a0 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:35:06.447+0000 7fd89c52d800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:35:06.447+0000 7fd89c52d800 20 Filter name: none 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:35:06.447+0000 7fd6bf7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:35:06.447+0000 7fd89c52d800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:35:06.447+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:35:06.448+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 : miss 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:35:06.448+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:35:06.448+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:06.519 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 2024-09-12T00:35:06.520 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:35:06.452+0000 7fd89c52d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:06.520 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:35:06.452+0000 7fd89c52d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:06.520 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:35:06.452+0000 7fd89c52d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:06.520 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:35:06.452+0000 7fd89c52d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35, ofs0, ns] 2024-09-12T00:35:06.520 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:35:06.452+0000 7fd76f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94837867646080 notifier 7647 bl.length()=995 2024-09-12T00:35:06.520 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:35:06.452+0000 7fd76f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:06.520 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:35:06.452+0000 7fd76f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:06.520 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:35:06.452+0000 7fd76f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:06.520 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:35:06.454+0000 7fd89c52d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): orig_sources= new_sources= 2024-09-12T00:35:06.520 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:35:06.454+0000 7fd89c52d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): potential sources added=[] removed=[] 2024-09-12T00:35:06.520 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:35:06.454+0000 7fd89c52d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): orig_dests= new_dests= 2024-09-12T00:35:06.520 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:35:06.454+0000 7fd89c52d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): potential dests added=[] removed=[] 2024-09-12T00:35:06.520 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:35:06.457+0000 7fd89c52d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd89c52d800 time 2024-09-12T00:35:06.457449+0000 2024-09-12T00:35:06.520 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:06.520 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.521 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:06.521 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd89dd8c71a] 2024-09-12T00:35:06.521 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd89dd8c8d8] 2024-09-12T00:35:06.521 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564127d67641] 2024-09-12T00:35:06.521 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564127d7738a] 2024-09-12T00:35:06.521 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:35:06.521 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd89ca29590] 2024-09-12T00:35:06.521 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:35:06.521 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:35:06.521 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.521 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:35:06.458+0000 7fd89c52d800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:06.521 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7fd89c52d800 thread_name:radosgw-admin 2024-09-12T00:35:06.521 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.521 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:06.521 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd89ca3e6f0] 2024-09-12T00:35:06.522 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd89ca8b99c] 2024-09-12T00:35:06.522 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:35:06.522 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:35:06.522 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd89dd8c774] 2024-09-12T00:35:06.522 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd89dd8c8d8] 2024-09-12T00:35:06.522 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564127d67641] 2024-09-12T00:35:06.522 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564127d7738a] 2024-09-12T00:35:06.522 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:35:06.522 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd89ca29590] 2024-09-12T00:35:06.522 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:35:06.522 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:35:06.522 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:06.522 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.522 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:35:06.522 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:35:06.523 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:35:06.524 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:35:06.525 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:35:06.526 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:35:06.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:35:06.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:35:06.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:35:06.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:35:06.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:35:06.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:35:06.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:35:06.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:35:06.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:35:06.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:35:06.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:35:06.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:35:06.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:35:06.527 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:35:06.528 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:35:06.528 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:35:06.528 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:35:06.528 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:35:06.528 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:35:06.528 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:35:06.528 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:35:06.528 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:35:06.528 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:35:06.528 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:35:06.528 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:35:06.528 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:35:06.528 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:35:06.528 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:35:06.529 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd6bf7fe640 / http_manager 2024-09-12T00:35:06.529 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd74dfdb640 / http_manager 2024-09-12T00:35:06.529 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd74efdd640 / rgw_dt_lg_renew 2024-09-12T00:35:06.529 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd76dffb640 / ms_dispatch 2024-09-12T00:35:06.529 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd76f7fe640 / io_context_pool 2024-09-12T00:35:06.529 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd77dffb640 / ms_dispatch 2024-09-12T00:35:06.529 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd784e09640 / ms_dispatch 2024-09-12T00:35:06.529 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd78660c640 / io_context_pool 2024-09-12T00:35:06.529 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd897a75640 / msgr-worker-2 2024-09-12T00:35:06.529 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd898276640 / msgr-worker-1 2024-09-12T00:35:06.529 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd898a77640 / msgr-worker-0 2024-09-12T00:35:06.529 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd899278640 / io_context_pool 2024-09-12T00:35:06.529 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd89c52d800 / radosgw-admin 2024-09-12T00:35:06.529 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:35:06.529 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:35:06.530 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/log/ceph/ceph-client.admin.130029.log 2024-09-12T00:35:06.530 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:35:06.530 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:35:06.530 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:35:06.000+0000 7fd89c52d800 10 monclient: get_monmap_and_config success 2024-09-12T00:35:06.530 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:35:06.000+0000 7fd89c52d800 4 set_mon_vals no callback set 2024-09-12T00:35:06.530 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:35:06.000+0000 7fd89c52d800 10 monclient: shutdown 2024-09-12T00:35:06.530 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:35:06.000+0000 7fd89c52d800 5 asok(0x56412937b630) unregister_commands rotate-key 2024-09-12T00:35:06.530 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:35:06.001+0000 7fd89c52d800 10 monclient: build_initial_monmap 2024-09-12T00:35:06.530 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:35:06.001+0000 7fd89c52d800 1 build_initial for_mkfs: 0 2024-09-12T00:35:06.530 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:35:06.001+0000 7fd89c52d800 10 monclient: monmap: 2024-09-12T00:35:06.530 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:06.530 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:06.530 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:06.530 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:06.530 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding auth protocol: cephx 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding auth protocol: cephx 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding auth protocol: cephx 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: secure 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: crc 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: secure 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: crc 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: secure 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: crc 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: crc 2024-09-12T00:35:06.531 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: secure 2024-09-12T00:35:06.532 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: crc 2024-09-12T00:35:06.532 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: secure 2024-09-12T00:35:06.532 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: crc 2024-09-12T00:35:06.532 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959dbc0) adding con mode: secure 2024-09-12T00:35:06.532 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:35:06.001+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.532 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:35:06.001+0000 7fd89c52d800 1 librados: starting msgr at 2024-09-12T00:35:06.532 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:35:06.001+0000 7fd89c52d800 1 librados: starting objecter 2024-09-12T00:35:06.532 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 asok(0x56412937b630) register_command objecter_requests hook 0x5641295c35f0 2024-09-12T00:35:06.532 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:35:06.001+0000 7fd89c52d800 1 librados: setting wanted keys 2024-09-12T00:35:06.532 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:35:06.001+0000 7fd89c52d800 1 librados: calling monclient init 2024-09-12T00:35:06.532 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:35:06.001+0000 7fd89c52d800 10 monclient: init 2024-09-12T00:35:06.532 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding auth protocol: cephx 2024-09-12T00:35:06.532 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding auth protocol: cephx 2024-09-12T00:35:06.532 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding auth protocol: cephx 2024-09-12T00:35:06.532 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: secure 2024-09-12T00:35:06.533 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: crc 2024-09-12T00:35:06.533 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: secure 2024-09-12T00:35:06.533 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: crc 2024-09-12T00:35:06.533 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: secure 2024-09-12T00:35:06.533 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: crc 2024-09-12T00:35:06.533 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: crc 2024-09-12T00:35:06.533 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: secure 2024-09-12T00:35:06.533 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: crc 2024-09-12T00:35:06.533 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: secure 2024-09-12T00:35:06.533 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: crc 2024-09-12T00:35:06.533 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:35:06.001+0000 7fd89c52d800 5 AuthRegistry(0x56412959a870) adding con mode: secure 2024-09-12T00:35:06.533 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:35:06.001+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.533 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:35:06.001+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.533 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:35:06.002+0000 7fd89c52d800 5 asok(0x56412937b630) register_command rotate-key hook 0x56412959a9b8 2024-09-12T00:35:06.533 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:06.534 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:35:06.534 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-a con 0x5641294100e0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:06.534 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-b con 0x5641294de190 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:06.534 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-c con 0x5641295c4880 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:06.534 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.534 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.534 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.534 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:06.534 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient(hunting): authenticate will time out at 2114.574179s 2024-09-12T00:35:06.534 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): get_auth_request con 0x5641294100e0 auth_method 0 2024-09-12T00:35:06.534 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.534 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.534 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.534 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:35:06.002+0000 7fd898a77640 10 monclient(hunting): get_auth_request con 0x5641295c4880 auth_method 0 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:35:06.002+0000 7fd898a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:35:06.002+0000 7fd898a77640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:35:06.002+0000 7fd898a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:35:06.002+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:35:06.002+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:35:06.002+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:35:06.002+0000 7fd897a75640 10 monclient(hunting): get_auth_request con 0x5641294de190 auth_method 0 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:35:06.002+0000 7fd897a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:35:06.002+0000 7fd897a75640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:35:06.002+0000 7fd897a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient(hunting): handle_auth_done global_id 7638 payload 824 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient: _finish_hunting 0 2024-09-12T00:35:06.535 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:35:06.002+0000 7fd898276640 1 monclient: found mon.noname-a 2024-09-12T00:35:06.536 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:35:06.002+0000 7fd898276640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:35:06.536 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.536 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:06.536 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: dump: 2024-09-12T00:35:06.536 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.536 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.536 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.536 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.536 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.536 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.536 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.536 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.536 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.536 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.536 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: _finish_auth 0 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: _check_auth_tickets 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:35:06.002+0000 7fd784e09640 10 monclient: dump: 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.537 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:35:06.002+0000 7fd89c52d800 5 monclient: authenticate success, global_id 7638 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient: _renew_subs 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:35:06.002+0000 7fd78660c640 4 set_mon_vals no callback set 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient: _renew_subs 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:35:06.002+0000 7fd89c52d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:35:06.002+0000 7fd89c52d800 1 librados: init done 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:35:06.004+0000 7fd784e09640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:35:06.004+0000 7fd784e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:35:06.004+0000 7fd784e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:35:06.004+0000 7fd897a75640 10 monclient: get_auth_request con 0x7fd780076470 auth_method 0 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:35:06.005+0000 7fd898a77640 10 monclient: get_auth_request con 0x5641295e4820 auth_method 0 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:35:06.005+0000 7fd898276640 10 monclient: get_auth_request con 0x5641295e7a00 auth_method 0 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:35:06.006+0000 7fd897a75640 10 monclient: get_auth_request con 0x5641295ebbf0 auth_method 0 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:35:06.007+0000 7fd898a77640 10 monclient: get_auth_request con 0x5641295eb230 auth_method 0 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:35:06.008+0000 7fd89c52d800 10 monclient: build_initial_monmap 2024-09-12T00:35:06.538 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:35:06.008+0000 7fd89c52d800 1 build_initial for_mkfs: 0 2024-09-12T00:35:06.539 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:35:06.008+0000 7fd89c52d800 10 monclient: monmap: 2024-09-12T00:35:06.539 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:06.539 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:06.539 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:06.539 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:06.539 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:06.539 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.539 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:06.539 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:06.539 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:06.539 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.539 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding auth protocol: cephx 2024-09-12T00:35:06.539 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding auth protocol: cephx 2024-09-12T00:35:06.539 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding auth protocol: cephx 2024-09-12T00:35:06.540 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: secure 2024-09-12T00:35:06.540 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: crc 2024-09-12T00:35:06.540 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: secure 2024-09-12T00:35:06.540 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: crc 2024-09-12T00:35:06.540 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: secure 2024-09-12T00:35:06.540 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: crc 2024-09-12T00:35:06.540 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: crc 2024-09-12T00:35:06.540 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: secure 2024-09-12T00:35:06.540 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: crc 2024-09-12T00:35:06.540 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: secure 2024-09-12T00:35:06.540 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: crc 2024-09-12T00:35:06.540 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f3b80) adding con mode: secure 2024-09-12T00:35:06.540 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:35:06.008+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.540 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 asok(0x56412937b630) register_command objecter_requests cmddesc objecter_requests hook 0x5641295f7570 EEXIST 2024-09-12T00:35:06.540 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:35:06.008+0000 7fd89c52d800 10 monclient: init 2024-09-12T00:35:06.541 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding auth protocol: cephx 2024-09-12T00:35:06.541 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding auth protocol: cephx 2024-09-12T00:35:06.541 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding auth protocol: cephx 2024-09-12T00:35:06.541 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: secure 2024-09-12T00:35:06.541 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: crc 2024-09-12T00:35:06.541 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: secure 2024-09-12T00:35:06.541 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: crc 2024-09-12T00:35:06.541 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: secure 2024-09-12T00:35:06.541 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: crc 2024-09-12T00:35:06.541 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: crc 2024-09-12T00:35:06.541 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: secure 2024-09-12T00:35:06.541 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: crc 2024-09-12T00:35:06.541 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: secure 2024-09-12T00:35:06.541 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: crc 2024-09-12T00:35:06.541 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:35:06.008+0000 7fd89c52d800 5 AuthRegistry(0x5641295f2a78) adding con mode: secure 2024-09-12T00:35:06.542 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:35:06.008+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.542 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:35:06.009+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.542 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:35:06.009+0000 7fd89c52d800 5 asok(0x56412937b630) register_command rotate-key cmddesc rotate-key hook 0x5641295f2bc0 EEXIST 2024-09-12T00:35:06.542 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:06.542 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:35:06.542 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-b con 0x56412961b260 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:06.542 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-a con 0x56412961d530 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:06.542 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-c con 0x564129619a30 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:06.542 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.542 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.542 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.542 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:06.542 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient(hunting): authenticate will time out at 2114.581160s 2024-09-12T00:35:06.543 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:35:06.009+0000 7fd898a77640 10 monclient(hunting): get_auth_request con 0x56412961d530 auth_method 0 2024-09-12T00:35:06.543 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:35:06.009+0000 7fd898a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.543 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:35:06.009+0000 7fd898a77640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.543 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:35:06.009+0000 7fd898a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.543 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): get_auth_request con 0x564129619a30 auth_method 0 2024-09-12T00:35:06.543 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.543 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.543 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.543 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:35:06.009+0000 7fd897a75640 10 monclient(hunting): get_auth_request con 0x56412961b260 auth_method 0 2024-09-12T00:35:06.543 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:35:06.009+0000 7fd897a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.543 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:35:06.009+0000 7fd897a75640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.544 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:35:06.009+0000 7fd897a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.544 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:35:06.009+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.544 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:35:06.009+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.544 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:35:06.009+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.544 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.544 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.544 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.544 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:35:06.009+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.544 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:35:06.009+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.544 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:35:06.009+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.544 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient(hunting): handle_auth_done global_id 7169 payload 824 2024-09-12T00:35:06.544 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient: _finish_hunting 0 2024-09-12T00:35:06.544 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:35:06.009+0000 7fd898276640 1 monclient: found mon.noname-c 2024-09-12T00:35:06.544 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:35:06.009+0000 7fd898276640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: dump: 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: _finish_auth 0 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: _check_auth_tickets 2024-09-12T00:35:06.545 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:06.546 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.546 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:06.546 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:35:06.009+0000 7fd77dffb640 10 monclient: dump: 2024-09-12T00:35:06.546 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.546 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.546 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.546 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.546 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.546 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.546 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.546 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.546 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.546 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.546 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:35:06.009+0000 7fd89c52d800 5 monclient: authenticate success, global_id 7169 2024-09-12T00:35:06.547 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient: _renew_subs 2024-09-12T00:35:06.547 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:06.547 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:35:06.009+0000 7fd899278640 4 set_mon_vals no callback set 2024-09-12T00:35:06.547 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient: _renew_subs 2024-09-12T00:35:06.547 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:35:06.009+0000 7fd89c52d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:06.547 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:35:06.011+0000 7fd77dffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:35:06.547 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:35:06.011+0000 7fd77dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:06.547 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:35:06.011+0000 7fd77dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:06.547 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:35:06.011+0000 7fd897a75640 10 monclient: get_auth_request con 0x7fd770076380 auth_method 0 2024-09-12T00:35:06.547 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:35:06.011+0000 7fd89c52d800 10 monclient: get_monmap_and_config 2024-09-12T00:35:06.547 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:35:06.011+0000 7fd89c52d800 10 monclient: build_initial_monmap 2024-09-12T00:35:06.547 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:35:06.011+0000 7fd89c52d800 1 build_initial for_mkfs: 0 2024-09-12T00:35:06.547 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:35:06.011+0000 7fd89c52d800 10 monclient: monmap: 2024-09-12T00:35:06.547 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:06.548 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:06.548 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:06.548 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:06.548 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:06.548 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.548 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:06.548 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:06.548 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:06.548 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.548 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding auth protocol: cephx 2024-09-12T00:35:06.548 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding auth protocol: cephx 2024-09-12T00:35:06.548 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding auth protocol: cephx 2024-09-12T00:35:06.548 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: secure 2024-09-12T00:35:06.548 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: crc 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: secure 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: crc 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: secure 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: crc 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: crc 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: secure 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: crc 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: secure 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: crc 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:35:06.011+0000 7fd89c52d800 5 AuthRegistry(0x56412963adc0) adding con mode: secure 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:35:06.012+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient: init 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding auth protocol: cephx 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding auth protocol: cephx 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding auth protocol: cephx 2024-09-12T00:35:06.549 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: secure 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: crc 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: secure 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: crc 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: secure 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: crc 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: crc 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: secure 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: crc 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: secure 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: crc 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd728b0) adding con mode: secure 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:35:06.012+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:35:06.012+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:35:06.012+0000 7fd89c52d800 5 asok(0x56412937b630) register_command rotate-key cmddesc rotate-key hook 0x7ffdddd729f8 EEXIST 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:06.550 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:35:06.551 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-c con 0x56412966f460 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:06.551 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-a con 0x56412963f270 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:06.551 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-b con 0x56412966a820 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:06.551 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.551 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.551 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.551 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:06.551 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:35:06.012+0000 7fd89c52d800 10 monclient(hunting): authenticate will time out at 2114.584704s 2024-09-12T00:35:06.551 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:35:06.012+0000 7fd897a75640 10 monclient(hunting): get_auth_request con 0x56412966f460 auth_method 0 2024-09-12T00:35:06.551 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:35:06.012+0000 7fd897a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.551 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:35:06.012+0000 7fd897a75640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.551 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:35:06.012+0000 7fd897a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.551 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): get_auth_request con 0x56412963f270 auth_method 0 2024-09-12T00:35:06.551 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.551 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.552 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.552 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:35:06.012+0000 7fd898276640 10 monclient(hunting): get_auth_request con 0x56412966a820 auth_method 0 2024-09-12T00:35:06.552 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:35:06.012+0000 7fd898276640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.552 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:35:06.012+0000 7fd898276640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.552 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:35:06.012+0000 7fd898276640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.552 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.552 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.552 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.552 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:35:06.012+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.552 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:35:06.012+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.552 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:35:06.012+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.552 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:35:06.012+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.552 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:35:06.012+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.552 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:35:06.012+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:35:06.012+0000 7fd898a77640 10 monclient(hunting): handle_auth_done global_id 7644 payload 274 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:35:06.013+0000 7fd898a77640 10 monclient: _finish_hunting 0 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:35:06.013+0000 7fd898a77640 1 monclient: found mon.noname-a 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:35:06.013+0000 7fd898a77640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: dump: 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.553 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.554 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.554 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:35:06.554 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:35:06.554 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:06.554 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.554 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:06.554 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:35:06.013+0000 7fd76f7fe640 10 monclient: dump: 2024-09-12T00:35:06.554 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.554 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.554 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.554 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.554 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.554 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.554 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:35:06.013+0000 7fd89c52d800 5 monclient: authenticate success, global_id 7644 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:35:06.013+0000 7fd89c52d800 10 monclient: get_monmap_and_config success 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:35:06.013+0000 7fd89c52d800 4 set_mon_vals no callback set 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:35:06.013+0000 7fd89c52d800 10 monclient: shutdown 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient: build_initial_monmap 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:35:06.014+0000 7fd89c52d800 1 build_initial for_mkfs: 0 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient: monmap: 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:06.555 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.556 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:06.556 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:06.556 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:06.556 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.556 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding auth protocol: cephx 2024-09-12T00:35:06.556 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding auth protocol: cephx 2024-09-12T00:35:06.556 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding auth protocol: cephx 2024-09-12T00:35:06.556 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: secure 2024-09-12T00:35:06.556 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: crc 2024-09-12T00:35:06.556 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: secure 2024-09-12T00:35:06.556 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: crc 2024-09-12T00:35:06.556 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: secure 2024-09-12T00:35:06.556 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: crc 2024-09-12T00:35:06.556 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: crc 2024-09-12T00:35:06.557 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: secure 2024-09-12T00:35:06.557 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: crc 2024-09-12T00:35:06.557 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: secure 2024-09-12T00:35:06.557 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: crc 2024-09-12T00:35:06.557 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x5641296400b0) adding con mode: secure 2024-09-12T00:35:06.557 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:35:06.014+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.557 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:35:06.014+0000 7fd89c52d800 1 librados: starting msgr at 2024-09-12T00:35:06.557 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:35:06.014+0000 7fd89c52d800 1 librados: starting objecter 2024-09-12T00:35:06.557 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 asok(0x56412937b630) register_command objecter_requests cmddesc objecter_requests hook 0x564129665b40 EEXIST 2024-09-12T00:35:06.557 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:35:06.014+0000 7fd89c52d800 1 librados: setting wanted keys 2024-09-12T00:35:06.557 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:35:06.014+0000 7fd89c52d800 1 librados: calling monclient init 2024-09-12T00:35:06.557 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient: init 2024-09-12T00:35:06.557 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding auth protocol: cephx 2024-09-12T00:35:06.557 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding auth protocol: cephx 2024-09-12T00:35:06.557 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding auth protocol: cephx 2024-09-12T00:35:06.558 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: secure 2024-09-12T00:35:06.558 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: crc 2024-09-12T00:35:06.558 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: secure 2024-09-12T00:35:06.558 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: crc 2024-09-12T00:35:06.558 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: secure 2024-09-12T00:35:06.558 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: crc 2024-09-12T00:35:06.558 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: crc 2024-09-12T00:35:06.558 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: secure 2024-09-12T00:35:06.558 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: crc 2024-09-12T00:35:06.558 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: secure 2024-09-12T00:35:06.558 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: crc 2024-09-12T00:35:06.558 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 AuthRegistry(0x564129633010) adding con mode: secure 2024-09-12T00:35:06.558 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:35:06.014+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.558 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:35:06.014+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.558 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:35:06.014+0000 7fd89c52d800 5 asok(0x56412937b630) register_command rotate-key cmddesc rotate-key hook 0x564129633158 EEXIST 2024-09-12T00:35:06.559 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:06.559 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:35:06.559 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-c con 0x56412963f270 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:06.559 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-a con 0x56412966a820 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:06.559 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): picked mon.noname-b con 0x56412966f460 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:06.559 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.559 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.559 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:06.559 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:06.559 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:35:06.014+0000 7fd89c52d800 10 monclient(hunting): authenticate will time out at 2114.586953s 2024-09-12T00:35:06.559 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): get_auth_request con 0x56412966a820 auth_method 0 2024-09-12T00:35:06.559 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.559 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.559 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.559 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:35:06.015+0000 7fd897a75640 10 monclient(hunting): get_auth_request con 0x56412963f270 auth_method 0 2024-09-12T00:35:06.560 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:35:06.015+0000 7fd897a75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.560 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:35:06.015+0000 7fd897a75640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.560 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:35:06.015+0000 7fd897a75640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.560 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:35:06.015+0000 7fd898276640 10 monclient(hunting): get_auth_request con 0x56412966f460 auth_method 0 2024-09-12T00:35:06.560 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:35:06.015+0000 7fd898276640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:06.560 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:35:06.015+0000 7fd898276640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:06.560 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:35:06.015+0000 7fd898276640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:06.560 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.560 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.560 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.560 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:35:06.015+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.560 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:35:06.015+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.560 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:35:06.015+0000 7fd897a75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.560 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:35:06.015+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:06.560 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:35:06.015+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:06.561 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:35:06.015+0000 7fd898276640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:06.561 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient(hunting): handle_auth_done global_id 7647 payload 824 2024-09-12T00:35:06.561 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient: _finish_hunting 0 2024-09-12T00:35:06.561 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:35:06.015+0000 7fd898a77640 1 monclient: found mon.noname-a 2024-09-12T00:35:06.561 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:35:06.015+0000 7fd898a77640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:35:06.561 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.561 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:06.561 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: dump: 2024-09-12T00:35:06.561 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.561 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.561 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.561 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.561 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: _finish_auth 0 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: _check_auth_tickets 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:35:06.015+0000 7fd76dffb640 10 monclient: dump: 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:06.562 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:35:06.015+0000 7fd89c52d800 5 monclient: authenticate success, global_id 7647 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:35:06.015+0000 7fd89c52d800 10 monclient: _renew_subs 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:35:06.015+0000 7fd89c52d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:35:06.015+0000 7fd76f7fe640 4 set_mon_vals no callback set 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:35:06.015+0000 7fd89c52d800 10 monclient: _renew_subs 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:35:06.015+0000 7fd89c52d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:35:06.015+0000 7fd89c52d800 1 librados: init done 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:35:06.015+0000 7fd89c52d800 5 asok(0x56412937b630) register_command cr dump hook 0x564129663ce8 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:35:06.017+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:35:06.017+0000 7fd76dffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:35:06.563 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:35:06.017+0000 7fd76dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:06.564 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:35:06.017+0000 7fd76dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:06.564 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:35:06.018+0000 7fd897a75640 10 monclient: get_auth_request con 0x7fd7600764a0 auth_method 0 2024-09-12T00:35:06.564 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:35:06.018+0000 7fd898276640 10 monclient: get_auth_request con 0x564129689bc0 auth_method 0 2024-09-12T00:35:06.564 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:35:06.018+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.564 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:35:06.018+0000 7fd89c52d800 20 realm 2024-09-12T00:35:06.564 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:35:06.018+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.564 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:35:06.018+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.564 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:35:06.018+0000 7fd89c52d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:06.564 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:35:06.018+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.564 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:35:06.019+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.564 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:35:06.019+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.564 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:35:06.019+0000 7fd897a75640 10 monclient: get_auth_request con 0x56412968dd80 auth_method 0 2024-09-12T00:35:06.564 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:35:06.019+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:06.564 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:35:06.019+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.564 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:35:06.020+0000 7fd898a77640 10 monclient: get_auth_request con 0x564129691630 auth_method 0 2024-09-12T00:35:06.565 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:35:06.020+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:06.565 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:35:06.020+0000 7fd89c52d800 20 searching for the correct realm 2024-09-12T00:35:06.565 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:35:06.021+0000 7fd898276640 10 monclient: get_auth_request con 0x7fd89006a680 auth_method 0 2024-09-12T00:35:06.565 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:35:06.022+0000 7fd897a75640 10 monclient: get_auth_request con 0x7fd88c034070 auth_method 0 2024-09-12T00:35:06.565 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:35:06.022+0000 7fd897a75640 0 -- 172.21.15.133:0/1127202247 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fd88c034070 msgr2=0x7fd88c024920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:06.565 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:35:06.223+0000 7fd897a75640 10 monclient: get_auth_request con 0x7fd88c034070 auth_method 0 2024-09-12T00:35:06.565 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:35:06.225+0000 7fd898a77640 10 monclient: get_auth_request con 0x7fd890073170 auth_method 0 2024-09-12T00:35:06.565 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:35:06.227+0000 7fd898276640 10 monclient: get_auth_request con 0x7fd88c025040 auth_method 0 2024-09-12T00:35:06.565 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:35:06.227+0000 7fd897a75640 0 -- 172.21.15.133:0/1127202247 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fd888061040 msgr2=0x7fd88806b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:06.565 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:35:06.429+0000 7fd897a75640 10 monclient: get_auth_request con 0x7fd888061040 auth_method 0 2024-09-12T00:35:06.565 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:06.565 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:06.565 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:06.565 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:06.565 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:06.566 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:06.566 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.566 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.566 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.566 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:06.566 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:35:06.434+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.566 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:06.566 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 zone default found 2024-09-12T00:35:06.566 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:35:06.435+0000 7fd89c52d800 4 Realm: () 2024-09-12T00:35:06.566 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:35:06.435+0000 7fd89c52d800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:06.566 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:35:06.435+0000 7fd89c52d800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:06.566 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:35:06.435+0000 7fd89c52d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:06.566 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 zonegroup default 2024-09-12T00:35:06.566 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:35:06.435+0000 7fd89c52d800 20 started sync module instance, tier type = 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:35:06.436+0000 7fd89c52d800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=0 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=1 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=2 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=3 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=4 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=5 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:35:06.444+0000 7fd89c52d800 20 add_watcher() i=6 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:35:06.445+0000 7fd89c52d800 20 add_watcher() i=7 2024-09-12T00:35:06.567 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:35:06.445+0000 7fd89c52d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:06.568 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding auth protocol: cephx 2024-09-12T00:35:06.568 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding auth protocol: cephx 2024-09-12T00:35:06.568 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding auth protocol: cephx 2024-09-12T00:35:06.568 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: secure 2024-09-12T00:35:06.568 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: crc 2024-09-12T00:35:06.568 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: secure 2024-09-12T00:35:06.568 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: crc 2024-09-12T00:35:06.568 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: secure 2024-09-12T00:35:06.568 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: crc 2024-09-12T00:35:06.568 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: crc 2024-09-12T00:35:06.568 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: secure 2024-09-12T00:35:06.568 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: crc 2024-09-12T00:35:06.568 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: secure 2024-09-12T00:35:06.568 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: crc 2024-09-12T00:35:06.568 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:35:06.446+0000 7fd89c52d800 5 AuthRegistry(0x7ffdddd72d90) adding con mode: secure 2024-09-12T00:35:06.569 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:35:06.446+0000 7fd74efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:06.569 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:35:06.447+0000 7fd89c52d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:06.569 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:35:06.447+0000 7fd89c52d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:06.569 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:35:06.447+0000 7fd89c52d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:06.569 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command cache list hook 0x564129664810 2024-09-12T00:35:06.569 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command cache inspect hook 0x564129664810 2024-09-12T00:35:06.569 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command cache erase hook 0x564129664810 2024-09-12T00:35:06.569 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command cache zap hook 0x564129664810 2024-09-12T00:35:06.569 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 note: GC not initialized 2024-09-12T00:35:06.569 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:35:06.447+0000 7fd74dfdb640 20 reqs_thread_entry: start 2024-09-12T00:35:06.569 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command sync trace show hook 0x7fd89000d4a0 2024-09-12T00:35:06.569 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command sync trace history hook 0x7fd89000d4a0 2024-09-12T00:35:06.569 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command sync trace active hook 0x7fd89000d4a0 2024-09-12T00:35:06.569 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:35:06.447+0000 7fd89c52d800 5 asok(0x56412937b630) register_command sync trace active_short hook 0x7fd89000d4a0 2024-09-12T00:35:06.569 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:35:06.447+0000 7fd89c52d800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:35:06.447+0000 7fd89c52d800 20 Filter name: none 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:35:06.447+0000 7fd6bf7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:35:06.447+0000 7fd89c52d800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:35:06.447+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:35:06.448+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 : miss 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:35:06.448+0000 7fd89c52d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:35:06.448+0000 7fd89c52d800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:35:06.448+0000 7fd89c52d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 2024-09-12T00:35:06.570 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:35:06.452+0000 7fd89c52d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:06.571 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:35:06.452+0000 7fd89c52d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:06.571 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:35:06.452+0000 7fd89c52d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:06.571 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:35:06.452+0000 7fd89c52d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35, ofs0, ns] 2024-09-12T00:35:06.571 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:35:06.452+0000 7fd76f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94837867646080 notifier 7647 bl.length()=995 2024-09-12T00:35:06.571 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:35:06.452+0000 7fd76f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:06.571 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:35:06.452+0000 7fd76f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:06.571 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:35:06.452+0000 7fd76f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:06.571 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:35:06.454+0000 7fd89c52d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): orig_sources= new_sources= 2024-09-12T00:35:06.571 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:35:06.454+0000 7fd89c52d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): potential sources added=[] removed=[] 2024-09-12T00:35:06.571 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:35:06.454+0000 7fd89c52d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): orig_dests= new_dests= 2024-09-12T00:35:06.571 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:35:06.454+0000 7fd89c52d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): potential dests added=[] removed=[] 2024-09-12T00:35:06.571 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:35:06.457+0000 7fd89c52d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd89c52d800 time 2024-09-12T00:35:06.457449+0000 2024-09-12T00:35:06.571 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:06.571 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.571 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:06.572 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd89dd8c71a] 2024-09-12T00:35:06.572 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd89dd8c8d8] 2024-09-12T00:35:06.572 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564127d67641] 2024-09-12T00:35:06.572 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564127d7738a] 2024-09-12T00:35:06.572 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:35:06.572 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fd89ca29590] 2024-09-12T00:35:06.572 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:35:06.572 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:35:06.572 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.572 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:35:06.458+0000 7fd89c52d800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:06.572 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7fd89c52d800 thread_name:radosgw-admin 2024-09-12T00:35:06.572 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.572 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:06.572 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd89ca3e6f0] 2024-09-12T00:35:06.573 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd89ca8b99c] 2024-09-12T00:35:06.573 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:35:06.573 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:35:06.573 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd89dd8c774] 2024-09-12T00:35:06.573 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fd89dd8c8d8] 2024-09-12T00:35:06.573 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564127d67641] 2024-09-12T00:35:06.573 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564127d7738a] 2024-09-12T00:35:06.573 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:35:06.573 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fd89ca29590] 2024-09-12T00:35:06.573 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:35:06.573 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:35:06.573 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:06.573 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:35:06.574 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:35:06.575 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:35:06.575 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:35:06.575 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:35:06.575 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:35:06.575 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:35:06.575 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:35:06.575 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:35:06.575 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:35:06.575 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:35:06.575 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:35:06.575 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:35:06.575 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:35:06.575 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:35:06.575 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:35:06.575 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:35:06.576 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:35:06.577 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:35:06.577 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:35:06.577 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:35:06.577 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:35:06.577 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:35:06.577 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:35:06.577 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:35:06.577 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:35:06.577 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:35:06.577 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:35:06.577 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:35:06.577 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:35:06.577 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:35:06.577 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:35:06.577 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:35:06.578 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:35:06.579 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd6bf7fe640 / http_manager 2024-09-12T00:35:06.580 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd74dfdb640 / http_manager 2024-09-12T00:35:06.580 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd74efdd640 / rgw_dt_lg_renew 2024-09-12T00:35:06.580 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd76dffb640 / ms_dispatch 2024-09-12T00:35:06.580 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd76f7fe640 / io_context_pool 2024-09-12T00:35:06.580 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd77dffb640 / ms_dispatch 2024-09-12T00:35:06.580 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd784e09640 / ms_dispatch 2024-09-12T00:35:06.580 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd78660c640 / io_context_pool 2024-09-12T00:35:06.580 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd897a75640 / msgr-worker-2 2024-09-12T00:35:06.580 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd898276640 / msgr-worker-1 2024-09-12T00:35:06.580 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd898a77640 / msgr-worker-0 2024-09-12T00:35:06.580 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd899278640 / io_context_pool 2024-09-12T00:35:06.580 INFO:tasks.workunit.client.0.smithi133.stderr: 7fd89c52d800 / radosgw-admin 2024-09-12T00:35:06.580 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:35:06.580 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:35:06.580 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:35:06.458849Z_a202e86d-84e4-4d2b-a79f-cf54bc69ddd5/log 2024-09-12T00:35:06.581 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:35:06.581 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:35:06.582 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:06.582 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:06.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.533+0000 7fd267d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.535+0000 7fd267d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.535+0000 7fd267d2e800 20 realm 2024-09-12T00:35:06.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.535+0000 7fd267d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.535+0000 7fd267d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.535+0000 7fd267d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:06.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.535+0000 7fd267d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.535+0000 7fd267d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.535+0000 7fd267d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.536+0000 7fd267d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:06.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.536+0000 7fd267d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.537+0000 7fd267d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:06.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.537+0000 7fd267d2e800 20 searching for the correct realm 2024-09-12T00:35:06.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.538+0000 7fd25b16a640 0 -- 172.21.15.133:0/3336935759 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fd24c06d060 msgr2=0x7fd24c007720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:06.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.743+0000 7fd25b16a640 0 -- 172.21.15.133:0/3336935759 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fd25403f040 msgr2=0x7fd25403f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:06.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:06.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:06.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:06.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:06.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:06.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:06.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:06.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:06.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 20 zone default found 2024-09-12T00:35:06.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 4 Realm: () 2024-09-12T00:35:06.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:06.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:06.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:06.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 20 zonegroup default 2024-09-12T00:35:06.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.950+0000 7fd267d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.951+0000 7fd267d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.951+0000 7fd267d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.951+0000 7fd267d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.951+0000 7fd267d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.951+0000 7fd267d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:06.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.951+0000 7fd267d2e800 20 started sync module instance, tier type = 2024-09-12T00:35:06.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.951+0000 7fd267d2e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:06.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.960+0000 7fd267d2e800 20 add_watcher() i=0 2024-09-12T00:35:06.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.960+0000 7fd267d2e800 20 add_watcher() i=1 2024-09-12T00:35:06.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.960+0000 7fd267d2e800 20 add_watcher() i=2 2024-09-12T00:35:06.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.960+0000 7fd267d2e800 20 add_watcher() i=3 2024-09-12T00:35:06.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.960+0000 7fd267d2e800 20 add_watcher() i=4 2024-09-12T00:35:06.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.960+0000 7fd267d2e800 20 add_watcher() i=5 2024-09-12T00:35:06.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.960+0000 7fd267d2e800 20 add_watcher() i=6 2024-09-12T00:35:06.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.961+0000 7fd267d2e800 20 add_watcher() i=7 2024-09-12T00:35:06.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.961+0000 7fd267d2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:06.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.962+0000 7fd119fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:06.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.962+0000 7fd267d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:06.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.962+0000 7fd267d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:06.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.963+0000 7fd267d2e800 5 note: GC not initialized 2024-09-12T00:35:06.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.963+0000 7fd118fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:06.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.963+0000 7fd267d2e800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:06.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.963+0000 7fd267d2e800 20 Filter name: none 2024-09-12T00:35:06.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.963+0000 7fd0927fc640 20 reqs_thread_entry: start 2024-09-12T00:35:06.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.963+0000 7fd267d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.963+0000 7fd267d2e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:06.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.963+0000 7fd267d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.964+0000 7fd267d2e800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:35:06.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.964+0000 7fd267d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:06.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.964+0000 7fd267d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.964+0000 7fd267d2e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:06.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.964+0000 7fd267d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:06.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.965+0000 7fd267d2e800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:35:06.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.965+0000 7fd267d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:06.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.966+0000 7fd119fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:06.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.968+0000 7fd267d2e800 20 remove_watcher() i=0 2024-09-12T00:35:06.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.968+0000 7fd267d2e800 2 removed watcher, disabling cache 2024-09-12T00:35:06.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.969+0000 7fd267d2e800 20 remove_watcher() i=1 2024-09-12T00:35:06.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.970+0000 7fd267d2e800 20 remove_watcher() i=2 2024-09-12T00:35:06.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.971+0000 7fd267d2e800 20 remove_watcher() i=3 2024-09-12T00:35:06.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.972+0000 7fd267d2e800 20 remove_watcher() i=4 2024-09-12T00:35:06.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.973+0000 7fd267d2e800 20 remove_watcher() i=5 2024-09-12T00:35:06.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.974+0000 7fd267d2e800 20 remove_watcher() i=6 2024-09-12T00:35:06.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:06.975+0000 7fd267d2e800 20 remove_watcher() i=7 2024-09-12T00:35:06.984 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:06.984 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:35:06.984 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-do-reshard id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:35:06.984 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:07.074 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:35:07.107 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:07.107 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:07.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.145+0000 7fd0d8c87800 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.146+0000 7fd0d8c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:07.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.146+0000 7fd0d8c87800 20 realm 2024-09-12T00:35:07.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.146+0000 7fd0d8c87800 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.146+0000 7fd0d8c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:07.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.146+0000 7fd0d8c87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:07.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.146+0000 7fd0d8c87800 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.147+0000 7fd0d8c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:07.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.147+0000 7fd0d8c87800 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.147+0000 7fd0d8c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:07.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.147+0000 7fd0d8c87800 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.148+0000 7fd0d8c87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:07.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.148+0000 7fd0d8c87800 20 searching for the correct realm 2024-09-12T00:35:07.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.150+0000 7fd0cffff640 0 -- 172.21.15.133:0/2075253889 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fd0c003f020 msgr2=0x7fd0c006c500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:07.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.355+0000 7fd0cffff640 0 -- 172.21.15.133:0/2075253889 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fd0c8095060 msgr2=0x7fd0c808a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:07.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:07.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:07.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:07.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:07.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:07.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:07.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:07.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:07.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:07.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 20 zone default found 2024-09-12T00:35:07.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 4 Realm: () 2024-09-12T00:35:07.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:07.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:07.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:07.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 20 zonegroup default 2024-09-12T00:35:07.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.562+0000 7fd0d8c87800 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.563+0000 7fd0d8c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:07.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.563+0000 7fd0d8c87800 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.563+0000 7fd0d8c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:07.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.563+0000 7fd0d8c87800 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.563+0000 7fd0d8c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:07.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.563+0000 7fd0d8c87800 20 started sync module instance, tier type = 2024-09-12T00:35:07.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.563+0000 7fd0d8c87800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:07.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.572+0000 7fd0d8c87800 20 add_watcher() i=0 2024-09-12T00:35:07.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.572+0000 7fd0d8c87800 20 add_watcher() i=1 2024-09-12T00:35:07.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.572+0000 7fd0d8c87800 20 add_watcher() i=2 2024-09-12T00:35:07.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.572+0000 7fd0d8c87800 20 add_watcher() i=3 2024-09-12T00:35:07.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.572+0000 7fd0d8c87800 20 add_watcher() i=4 2024-09-12T00:35:07.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.572+0000 7fd0d8c87800 20 add_watcher() i=5 2024-09-12T00:35:07.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.572+0000 7fd0d8c87800 20 add_watcher() i=6 2024-09-12T00:35:07.572 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.573+0000 7fd0d8c87800 20 add_watcher() i=7 2024-09-12T00:35:07.572 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.573+0000 7fd0d8c87800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:07.575 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.575+0000 7fcf8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:07.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.575+0000 7fd0d8c87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:07.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.575+0000 7fd0d8c87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:07.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.575+0000 7fd0d8c87800 5 note: GC not initialized 2024-09-12T00:35:07.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.576+0000 7fcf077fe640 20 reqs_thread_entry: start 2024-09-12T00:35:07.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.576+0000 7fd0d8c87800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:07.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.576+0000 7fd0d8c87800 20 Filter name: none 2024-09-12T00:35:07.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.576+0000 7fcf057fa640 20 reqs_thread_entry: start 2024-09-12T00:35:07.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.576+0000 7fd0d8c87800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:35:07.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.576+0000 7fd0d8c87800 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.576+0000 7fd0d8c87800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:07.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.576+0000 7fd0d8c87800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:35:07.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.576+0000 7fd0d8c87800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:35:07.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.576+0000 7fd0d8c87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 : miss 2024-09-12T00:35:07.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.576+0000 7fd0d8c87800 20 rados->read ofs=0 len=0 2024-09-12T00:35:07.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.577+0000 7fd0d8c87800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:35:07.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.577+0000 7fd0d8c87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:07.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.577+0000 7fd0d8c87800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:07.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.577+0000 7fd0d8c87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:07.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.577+0000 7fd0d8c87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:07.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.577+0000 7fd0d8c87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 2024-09-12T00:35:07.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.578+0000 7fd0d8c87800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to be held by another RGW process; skipping for now 2024-09-12T00:35:07.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.578+0000 7fcf8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:07.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.581+0000 7fd0d8c87800 20 remove_watcher() i=0 2024-09-12T00:35:07.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.581+0000 7fd0d8c87800 2 removed watcher, disabling cache 2024-09-12T00:35:07.580 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.582+0000 7fd0d8c87800 20 remove_watcher() i=1 2024-09-12T00:35:07.581 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.583+0000 7fd0d8c87800 20 remove_watcher() i=2 2024-09-12T00:35:07.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.584+0000 7fd0d8c87800 20 remove_watcher() i=3 2024-09-12T00:35:07.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.585+0000 7fd0d8c87800 20 remove_watcher() i=4 2024-09-12T00:35:07.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.586+0000 7fd0d8c87800 20 remove_watcher() i=5 2024-09-12T00:35:07.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.587+0000 7fd0d8c87800 20 remove_watcher() i=6 2024-09-12T00:35:07.586 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:07.588+0000 7fd0d8c87800 20 remove_watcher() i=7 2024-09-12T00:35:07.596 INFO:tasks.workunit.client.0.smithi133.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:35:37.626 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:35:37.661 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:37.661 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:37.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.704+0000 7f0774a1d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.706+0000 7f0774a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:37.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.706+0000 7f0774a1d800 20 realm 2024-09-12T00:35:37.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.706+0000 7f0774a1d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.706+0000 7f0774a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:37.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.706+0000 7f0774a1d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:37.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.706+0000 7f0774a1d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.706+0000 7f0774a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:37.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.706+0000 7f0774a1d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.707+0000 7f0774a1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:37.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.707+0000 7f0774a1d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.708+0000 7f0774a1d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:37.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.708+0000 7f0774a1d800 20 searching for the correct realm 2024-09-12T00:35:37.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.710+0000 7f076f9ea640 0 -- 172.21.15.133:0/481787381 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f076406a640 msgr2=0x7f07640779f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:37.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.714+0000 7f076f9ea640 0 -- 172.21.15.133:0/481787381 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f0760047020 msgr2=0x7f076006f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:37.920 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.921+0000 7f0774a1d800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:37.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.921+0000 7f0774a1d800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:37.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.921+0000 7f0774a1d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:37.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.921+0000 7f0774a1d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:37.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.921+0000 7f0774a1d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:37.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.921+0000 7f0774a1d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:37.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.921+0000 7f0774a1d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.922+0000 7f0774a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:37.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.922+0000 7f0774a1d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.922+0000 7f0774a1d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:37.921 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.922+0000 7f0774a1d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.922+0000 7f0774a1d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:37.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.922+0000 7f0774a1d800 20 zone default found 2024-09-12T00:35:37.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.922+0000 7f0774a1d800 4 Realm: () 2024-09-12T00:35:37.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.922+0000 7f0774a1d800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:37.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.922+0000 7f0774a1d800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:37.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.922+0000 7f0774a1d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:37.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.922+0000 7f0774a1d800 20 zonegroup default 2024-09-12T00:35:37.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.922+0000 7f0774a1d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.923+0000 7f0774a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:37.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.923+0000 7f0774a1d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.923+0000 7f0774a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:37.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.923+0000 7f0774a1d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.923+0000 7f0774a1d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:37.923 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.923+0000 7f0774a1d800 20 started sync module instance, tier type = 2024-09-12T00:35:37.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.923+0000 7f0774a1d800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:37.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.933+0000 7f0774a1d800 20 add_watcher() i=0 2024-09-12T00:35:37.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.933+0000 7f0774a1d800 20 add_watcher() i=1 2024-09-12T00:35:37.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.933+0000 7f0774a1d800 20 add_watcher() i=2 2024-09-12T00:35:37.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.933+0000 7f0774a1d800 20 add_watcher() i=3 2024-09-12T00:35:37.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.933+0000 7f0774a1d800 20 add_watcher() i=4 2024-09-12T00:35:37.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.933+0000 7f0774a1d800 20 add_watcher() i=5 2024-09-12T00:35:37.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.933+0000 7f0774a1d800 20 add_watcher() i=6 2024-09-12T00:35:37.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.934+0000 7f0774a1d800 20 add_watcher() i=7 2024-09-12T00:35:37.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.934+0000 7f0774a1d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:37.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.936+0000 7f06277de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:37.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.937+0000 7f0774a1d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:37.936 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.937+0000 7f0774a1d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:37.936 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.937+0000 7f0774a1d800 5 note: GC not initialized 2024-09-12T00:35:37.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.937+0000 7f06267dc640 20 reqs_thread_entry: start 2024-09-12T00:35:37.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.937+0000 7f0774a1d800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:37.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.937+0000 7f0774a1d800 20 Filter name: none 2024-09-12T00:35:37.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.937+0000 7f061f7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:37.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.937+0000 7f0774a1d800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:35:37.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.937+0000 7f0774a1d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.938+0000 7f0774a1d800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:37.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.938+0000 7f0774a1d800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:35:37.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.938+0000 7f0774a1d800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:35:37.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.938+0000 7f0774a1d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 : miss 2024-09-12T00:35:37.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.938+0000 7f0774a1d800 20 rados->read ofs=0 len=0 2024-09-12T00:35:37.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.938+0000 7f0774a1d800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:35:37.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.938+0000 7f0774a1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:37.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.938+0000 7f0774a1d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:37.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.938+0000 7f0774a1d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:37.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.938+0000 7f0774a1d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:37.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.938+0000 7f0774a1d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 2024-09-12T00:35:37.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.939+0000 7f0774a1d800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:35:37.942 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.944+0000 7f0774a1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:37.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.944+0000 7f0774a1d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:37.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.944+0000 7f0774a1d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:37.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.944+0000 7f0774a1d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35, ofs0, ns] 2024-09-12T00:35:37.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.944+0000 7f06477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94230432372672 notifier 7226 bl.length()=995 2024-09-12T00:35:37.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.944+0000 7f06477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:37.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.944+0000 7f06477fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:37.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.944+0000 7f06477fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:37.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.945+0000 7f0774a1d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): orig_sources= new_sources= 2024-09-12T00:35:37.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.945+0000 7f0774a1d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): potential sources added=[] removed=[] 2024-09-12T00:35:37.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.945+0000 7f0774a1d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): orig_dests= new_dests= 2024-09-12T00:35:37.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.945+0000 7f0774a1d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): potential dests added=[] removed=[] 2024-09-12T00:35:37.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.949+0000 7f0774a1d800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35.2.0 2024-09-12T00:35:37.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.949+0000 7f0774a1d800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35.2.0 2024-09-12T00:35:37.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.949+0000 7f0774a1d800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35.2.1 2024-09-12T00:35:37.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.949+0000 7f0774a1d800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35.2.1 2024-09-12T00:35:37.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.949+0000 7f0774a1d800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35.0 2024-09-12T00:35:37.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.951+0000 7f0774a1d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:37.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.951+0000 7f0774a1d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 2024-09-12T00:35:37.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.952+0000 7f0774a1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:37.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.952+0000 7f0774a1d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:37.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.952+0000 7f0774a1d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:37.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.952+0000 7f0774a1d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35, ofs0, ns] 2024-09-12T00:35:37.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.953+0000 7f0646ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497051 cookie 94230432372672 notifier 7226 bl.length()=995 2024-09-12T00:35:37.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.953+0000 7f0646ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:37.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.953+0000 7f0646ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:37.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.953+0000 7f0646ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:37.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.954+0000 7f0774a1d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): orig_sources= new_sources= 2024-09-12T00:35:37.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.954+0000 7f0774a1d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): potential sources added=[] removed=[] 2024-09-12T00:35:37.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.954+0000 7f0774a1d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): orig_dests= new_dests= 2024-09-12T00:35:37.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.954+0000 7f0774a1d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): potential dests added=[] removed=[] 2024-09-12T00:35:37.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.956+0000 7f0774a1d800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35.0 2024-09-12T00:35:37.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.956+0000 7f0774a1d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:37.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.956+0000 7f0774a1d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 2024-09-12T00:35:37.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.957+0000 7f0774a1d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:37.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.957+0000 7f0774a1d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:37.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.957+0000 7f0774a1d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:37.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.957+0000 7f0774a1d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35, ofs0, ns] 2024-09-12T00:35:37.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.957+0000 7f0646ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497052 cookie 94230432372672 notifier 7226 bl.length()=963 2024-09-12T00:35:37.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.957+0000 7f0646ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 info.flags=0x17 2024-09-12T00:35:37.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.957+0000 7f0646ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 to cache LRU end 2024-09-12T00:35:37.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.957+0000 7f0646ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:37.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.959+0000 7f0774a1d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): orig_sources= new_sources= 2024-09-12T00:35:37.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.959+0000 7f0774a1d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): potential sources added=[] removed=[] 2024-09-12T00:35:37.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.959+0000 7f0774a1d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): orig_dests= new_dests= 2024-09-12T00:35:37.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.959+0000 7f0774a1d800 20 handle_bi_update(): bucket=:abort-at-do-reshard[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35]): potential dests added=[] removed=[] 2024-09-12T00:35:37.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.960+0000 7f0774a1d800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T00:35:37.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.962+0000 7f06277de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:37.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.964+0000 7f0774a1d800 20 remove_watcher() i=0 2024-09-12T00:35:37.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.964+0000 7f0774a1d800 2 removed watcher, disabling cache 2024-09-12T00:35:37.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.965+0000 7f0774a1d800 20 remove_watcher() i=1 2024-09-12T00:35:37.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.966+0000 7f0774a1d800 20 remove_watcher() i=2 2024-09-12T00:35:37.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.967+0000 7f0774a1d800 20 remove_watcher() i=3 2024-09-12T00:35:37.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.968+0000 7f0774a1d800 20 remove_watcher() i=4 2024-09-12T00:35:37.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.969+0000 7f0774a1d800 20 remove_watcher() i=5 2024-09-12T00:35:37.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.970+0000 7f0774a1d800 20 remove_watcher() i=6 2024-09-12T00:35:37.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:37.971+0000 7f0774a1d800 20 remove_watcher() i=7 2024-09-12T00:35:37.982 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:35:38.011 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:38.011 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:38.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.049+0000 7fc726d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.051+0000 7fc726d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.051+0000 7fc726d2c800 20 realm 2024-09-12T00:35:38.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.051+0000 7fc726d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.051+0000 7fc726d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.051+0000 7fc726d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:38.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.051+0000 7fc726d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.051+0000 7fc726d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.051+0000 7fc726d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.052+0000 7fc726d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:38.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.052+0000 7fc726d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.053+0000 7fc726d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:38.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.053+0000 7fc726d2c800 20 searching for the correct realm 2024-09-12T00:35:38.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.055+0000 7fc7222ac640 0 -- 172.21.15.133:0/1489579851 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fc718095990 msgr2=0x7fc718093430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:38.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.260+0000 7fc7222ac640 0 -- 172.21.15.133:0/1489579851 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fc714096260 msgr2=0x7fc7140860c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.466+0000 7fc726d2c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.466+0000 7fc726d2c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.466+0000 7fc726d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.466+0000 7fc726d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:38.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.466+0000 7fc726d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.466+0000 7fc726d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.466+0000 7fc726d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.466+0000 7fc726d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.466+0000 7fc726d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.466+0000 7fc726d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:38.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.466+0000 7fc726d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.467+0000 7fc726d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.467+0000 7fc726d2c800 20 zone default found 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.467+0000 7fc726d2c800 4 Realm: () 2024-09-12T00:35:38.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.467+0000 7fc726d2c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.467+0000 7fc726d2c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.467+0000 7fc726d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.467+0000 7fc726d2c800 20 zonegroup default 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.467+0000 7fc726d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.467+0000 7fc726d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.467+0000 7fc726d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.467+0000 7fc726d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.467+0000 7fc726d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.468+0000 7fc726d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.468+0000 7fc726d2c800 20 started sync module instance, tier type = 2024-09-12T00:35:38.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.468+0000 7fc726d2c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:38.476 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.478+0000 7fc726d2c800 20 add_watcher() i=0 2024-09-12T00:35:38.476 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.478+0000 7fc726d2c800 20 add_watcher() i=1 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.478+0000 7fc726d2c800 20 add_watcher() i=2 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.478+0000 7fc726d2c800 20 add_watcher() i=3 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.478+0000 7fc726d2c800 20 add_watcher() i=4 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.478+0000 7fc726d2c800 20 add_watcher() i=5 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.478+0000 7fc726d2c800 20 add_watcher() i=6 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.479+0000 7fc726d2c800 20 add_watcher() i=7 2024-09-12T00:35:38.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.479+0000 7fc726d2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:38.479 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.481+0000 7fc5d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.481+0000 7fc726d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.481+0000 7fc726d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.481+0000 7fc726d2c800 5 note: GC not initialized 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.481+0000 7fc553fff640 20 reqs_thread_entry: start 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.481+0000 7fc726d2c800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.481+0000 7fc726d2c800 20 Filter name: none 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.481+0000 7fc551ffb640 20 reqs_thread_entry: start 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.481+0000 7fc726d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.482+0000 7fc726d2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:38.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.482+0000 7fc726d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.482+0000 7fc726d2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.482+0000 7fc726d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.482+0000 7fc726d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.483+0000 7fc726d2c800 20 rados_obj.operate() r=0 bl.length=211 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.483+0000 7fc726d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.483+0000 7fc726d2c800 20 rados_obj.operate() r=0 bl.length=433 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.483+0000 7fc726d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:38.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.484+0000 7fc5d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:38.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.486+0000 7fc726d2c800 20 remove_watcher() i=0 2024-09-12T00:35:38.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.487+0000 7fc726d2c800 2 removed watcher, disabling cache 2024-09-12T00:35:38.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.488+0000 7fc726d2c800 20 remove_watcher() i=1 2024-09-12T00:35:38.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.489+0000 7fc726d2c800 20 remove_watcher() i=2 2024-09-12T00:35:38.488 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.490+0000 7fc726d2c800 20 remove_watcher() i=3 2024-09-12T00:35:38.489 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.491+0000 7fc726d2c800 20 remove_watcher() i=4 2024-09-12T00:35:38.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.492+0000 7fc726d2c800 20 remove_watcher() i=5 2024-09-12T00:35:38.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.493+0000 7fc726d2c800 20 remove_watcher() i=6 2024-09-12T00:35:38.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:38.494+0000 7fc726d2c800 20 remove_watcher() i=7 2024-09-12T00:35:38.503 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:38.503 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:35:38.503 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-do-reshard id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:35:38.503 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:38.796 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T00:35:38.796 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:39.609 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:35:39.637 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:39.637 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:39.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.676+0000 7f4b71faf800 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.678+0000 7f4b71faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:39.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.678+0000 7f4b71faf800 20 realm 2024-09-12T00:35:39.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.678+0000 7f4b71faf800 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.678+0000 7f4b71faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:39.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.678+0000 7f4b71faf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:39.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.678+0000 7f4b71faf800 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.678+0000 7f4b71faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:39.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.678+0000 7f4b71faf800 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.679+0000 7f4b71faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:39.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.679+0000 7f4b71faf800 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.679+0000 7f4b71faf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:39.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.679+0000 7f4b71faf800 20 searching for the correct realm 2024-09-12T00:35:39.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.681+0000 7f4b6f298640 0 -- 172.21.15.133:0/2421128020 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f4b64075f10 msgr2=0x7f4b64043420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:39.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.684+0000 7f4b6f298640 0 -- 172.21.15.133:0/2421128020 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f4b60062040 msgr2=0x7f4b60060ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:39.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.890+0000 7f4b71faf800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:39.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.890+0000 7f4b71faf800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:39.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.890+0000 7f4b71faf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:39.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.890+0000 7f4b71faf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:39.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.890+0000 7f4b71faf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:39.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.890+0000 7f4b71faf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:39.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.890+0000 7f4b71faf800 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.890+0000 7f4b71faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:39.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.890+0000 7f4b71faf800 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.891+0000 7f4b71faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:39.891 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.891+0000 7f4b71faf800 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.891+0000 7f4b71faf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:39.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.891+0000 7f4b71faf800 20 zone default found 2024-09-12T00:35:39.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.891+0000 7f4b71faf800 4 Realm: () 2024-09-12T00:35:39.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.891+0000 7f4b71faf800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:39.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.891+0000 7f4b71faf800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:39.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.891+0000 7f4b71faf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:39.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.891+0000 7f4b71faf800 20 zonegroup default 2024-09-12T00:35:39.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.891+0000 7f4b71faf800 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.891+0000 7f4b71faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:39.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.891+0000 7f4b71faf800 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.892+0000 7f4b71faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:39.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.892+0000 7f4b71faf800 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.892+0000 7f4b71faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:39.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.892+0000 7f4b71faf800 20 started sync module instance, tier type = 2024-09-12T00:35:39.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.892+0000 7f4b71faf800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:39.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.900+0000 7f4b71faf800 20 add_watcher() i=0 2024-09-12T00:35:39.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.900+0000 7f4b71faf800 20 add_watcher() i=1 2024-09-12T00:35:39.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.900+0000 7f4b71faf800 20 add_watcher() i=2 2024-09-12T00:35:39.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.900+0000 7f4b71faf800 20 add_watcher() i=3 2024-09-12T00:35:39.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.900+0000 7f4b71faf800 20 add_watcher() i=4 2024-09-12T00:35:39.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.900+0000 7f4b71faf800 20 add_watcher() i=5 2024-09-12T00:35:39.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.900+0000 7f4b71faf800 20 add_watcher() i=6 2024-09-12T00:35:39.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.901+0000 7f4b71faf800 20 add_watcher() i=7 2024-09-12T00:35:39.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.901+0000 7f4b71faf800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:39.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.903+0000 7f4a25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:39.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.903+0000 7f4b71faf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:39.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.903+0000 7f4b71faf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:39.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.903+0000 7f4b71faf800 5 note: GC not initialized 2024-09-12T00:35:39.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.904+0000 7f4a24fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:39.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.904+0000 7f4b71faf800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:39.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.904+0000 7f4b71faf800 20 Filter name: none 2024-09-12T00:35:39.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.904+0000 7f499e7fc640 20 reqs_thread_entry: start 2024-09-12T00:35:39.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.904+0000 7f4b71faf800 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.905+0000 7f4b71faf800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:39.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.905+0000 7f4b71faf800 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.905+0000 7f4b71faf800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:35:39.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.905+0000 7f4b71faf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:39.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.905+0000 7f4b71faf800 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.906+0000 7f4b71faf800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:39.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.906+0000 7f4b71faf800 20 rados->read ofs=0 len=0 2024-09-12T00:35:39.905 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.906+0000 7f4b71faf800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:35:39.905 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.906+0000 7f4b71faf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:39.906 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.907+0000 7f4a25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:39.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.910+0000 7f4b71faf800 20 remove_watcher() i=0 2024-09-12T00:35:39.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.910+0000 7f4b71faf800 2 removed watcher, disabling cache 2024-09-12T00:35:39.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.910+0000 7f4b71faf800 20 remove_watcher() i=1 2024-09-12T00:35:39.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.911+0000 7f4b71faf800 20 remove_watcher() i=2 2024-09-12T00:35:39.911 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.912+0000 7f4b71faf800 20 remove_watcher() i=3 2024-09-12T00:35:39.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.913+0000 7f4b71faf800 20 remove_watcher() i=4 2024-09-12T00:35:39.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.914+0000 7f4b71faf800 20 remove_watcher() i=5 2024-09-12T00:35:39.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.915+0000 7f4b71faf800 20 remove_watcher() i=6 2024-09-12T00:35:39.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:39.916+0000 7f4b71faf800 20 remove_watcher() i=7 2024-09-12T00:35:39.925 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:39.925 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:35:39.925 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-logrecord-writes id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:35:39.925 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:39.927 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T00:35:39.963 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:39.963 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:40.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.001+0000 7f76f2814800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.003+0000 7f76f2814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.003+0000 7f76f2814800 20 realm 2024-09-12T00:35:40.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.003+0000 7f76f2814800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.003+0000 7f76f2814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.003+0000 7f76f2814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:40.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.003+0000 7f76f2814800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.003+0000 7f76f2814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.003+0000 7f76f2814800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.004+0000 7f76f2814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:40.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.004+0000 7f76f2814800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.004+0000 7f76f2814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:40.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.005+0000 7f76f2814800 20 searching for the correct realm 2024-09-12T00:35:40.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.006+0000 7f76ee7e1640 0 -- 172.21.15.133:0/35653843 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x555ad1ac0410 msgr2=0x555ad1ac2800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:40.210 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.212+0000 7f76edfe0640 0 -- 172.21.15.133:0/35653843 >> [v2:172.21.15.160:6818/507321805,v1:172.21.15.160:6819/507321805] conn(0x7f76d8087b20 msgr2=0x7f76d809a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:40.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.216+0000 7f76f2814800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:40.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.216+0000 7f76f2814800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:40.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.216+0000 7f76f2814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:40.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.216+0000 7f76f2814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:40.215 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.216+0000 7f76f2814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:40.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.216+0000 7f76f2814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:40.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.216+0000 7f76f2814800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.217+0000 7f76f2814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.216 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.217+0000 7f76f2814800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.217 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.217+0000 7f76f2814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:40.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.217+0000 7f76f2814800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.217+0000 7f76f2814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:40.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.217+0000 7f76f2814800 20 zone default found 2024-09-12T00:35:40.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.217+0000 7f76f2814800 4 Realm: () 2024-09-12T00:35:40.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.217+0000 7f76f2814800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:40.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.217+0000 7f76f2814800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:40.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.217+0000 7f76f2814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:40.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.217+0000 7f76f2814800 20 zonegroup default 2024-09-12T00:35:40.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.217+0000 7f76f2814800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.218+0000 7f76f2814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.218+0000 7f76f2814800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.218+0000 7f76f2814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.218 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.218+0000 7f76f2814800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.218+0000 7f76f2814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.218+0000 7f76f2814800 20 started sync module instance, tier type = 2024-09-12T00:35:40.219 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.218+0000 7f76f2814800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:40.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.226+0000 7f76f2814800 20 add_watcher() i=0 2024-09-12T00:35:40.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.226+0000 7f76f2814800 20 add_watcher() i=1 2024-09-12T00:35:40.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.226+0000 7f76f2814800 20 add_watcher() i=2 2024-09-12T00:35:40.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.226+0000 7f76f2814800 20 add_watcher() i=3 2024-09-12T00:35:40.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.226+0000 7f76f2814800 20 add_watcher() i=4 2024-09-12T00:35:40.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.226+0000 7f76f2814800 20 add_watcher() i=5 2024-09-12T00:35:40.225 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.226+0000 7f76f2814800 20 add_watcher() i=6 2024-09-12T00:35:40.226 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.227+0000 7f76f2814800 20 add_watcher() i=7 2024-09-12T00:35:40.226 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.227+0000 7f76f2814800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:40.228 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.229+0000 7f759ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:40.228 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.229+0000 7f76f2814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:40.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.229+0000 7f76f2814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:40.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.229+0000 7f76f2814800 5 note: GC not initialized 2024-09-12T00:35:40.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.230+0000 7f759effd640 20 reqs_thread_entry: start 2024-09-12T00:35:40.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.230+0000 7f76f2814800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:40.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.230+0000 7f76f2814800 20 Filter name: none 2024-09-12T00:35:40.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.230+0000 7f759cff9640 20 reqs_thread_entry: start 2024-09-12T00:35:40.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.230+0000 7f76f2814800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:35:40.229 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.230+0000 7f76f2814800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.230 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.230+0000 7f76f2814800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:40.230 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.230+0000 7f76f2814800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:35:40.230 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.230+0000 7f76f2814800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:35:40.230 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.230+0000 7f76f2814800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 : miss 2024-09-12T00:35:40.230 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.230+0000 7f76f2814800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.230 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.231+0000 7f76f2814800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:35:40.230 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.231+0000 7f76f2814800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 info.flags=0x17 2024-09-12T00:35:40.230 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.231+0000 7f76f2814800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 to cache LRU end 2024-09-12T00:35:40.230 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.231+0000 7f76f2814800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:40.231 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.231+0000 7f76f2814800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:40.231 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.231+0000 7f76f2814800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 2024-09-12T00:35:40.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.234+0000 7f76f2814800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 info.flags=0x17 2024-09-12T00:35:40.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.234+0000 7f76f2814800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 to cache LRU end 2024-09-12T00:35:40.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.234+0000 7f76f2814800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:40.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.234+0000 7f76f2814800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36, ofs0, ns] 2024-09-12T00:35:40.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.235+0000 7f75d17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497057 cookie 93848553160320 notifier 7758 bl.length()=1007 2024-09-12T00:35:40.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.235+0000 7f75d17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 info.flags=0x17 2024-09-12T00:35:40.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.235+0000 7f75d17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 to cache LRU end 2024-09-12T00:35:40.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.235+0000 7f75d17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:40.235 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.237+0000 7f76f2814800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): orig_sources= new_sources= 2024-09-12T00:35:40.235 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.237+0000 7f76f2814800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): potential sources added=[] removed=[] 2024-09-12T00:35:40.235 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.237+0000 7f76f2814800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): orig_dests= new_dests= 2024-09-12T00:35:40.236 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.237+0000 7f76f2814800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): potential dests added=[] removed=[] 2024-09-12T00:35:40.236 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.238+0000 7f76f2814800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T00:35:40.236 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.238+0000 7f76f2814800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:35:40.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.240+0000 7f76f2814800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:40.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.240+0000 7f76f2814800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 2024-09-12T00:35:40.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.241+0000 7f76f2814800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 info.flags=0x17 2024-09-12T00:35:40.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.241+0000 7f76f2814800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 to cache LRU end 2024-09-12T00:35:40.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.241+0000 7f76f2814800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:40.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.241+0000 7f76f2814800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36, ofs0, ns] 2024-09-12T00:35:40.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.242+0000 7f75d17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 93848553160320 notifier 7758 bl.length()=975 2024-09-12T00:35:40.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.242+0000 7f75d17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 info.flags=0x17 2024-09-12T00:35:40.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.242+0000 7f75d17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 to cache LRU end 2024-09-12T00:35:40.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.242+0000 7f75d17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:40.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.243+0000 7f76f2814800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): orig_sources= new_sources= 2024-09-12T00:35:40.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.243+0000 7f76f2814800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): potential sources added=[] removed=[] 2024-09-12T00:35:40.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.243+0000 7f76f2814800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): orig_dests= new_dests= 2024-09-12T00:35:40.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.243+0000 7f76f2814800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): potential dests added=[] removed=[] 2024-09-12T00:35:40.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.245+0000 7f759ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:40.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.247+0000 7f76f2814800 20 remove_watcher() i=0 2024-09-12T00:35:40.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.247+0000 7f76f2814800 2 removed watcher, disabling cache 2024-09-12T00:35:40.247 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.248+0000 7f76f2814800 20 remove_watcher() i=1 2024-09-12T00:35:40.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.249+0000 7f76f2814800 20 remove_watcher() i=2 2024-09-12T00:35:40.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.250+0000 7f76f2814800 20 remove_watcher() i=3 2024-09-12T00:35:40.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.251+0000 7f76f2814800 20 remove_watcher() i=4 2024-09-12T00:35:40.250 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.252+0000 7f76f2814800 20 remove_watcher() i=5 2024-09-12T00:35:40.251 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.253+0000 7f76f2814800 20 remove_watcher() i=6 2024-09-12T00:35:40.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.254+0000 7f76f2814800 20 remove_watcher() i=7 2024-09-12T00:35:40.265 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:35:40.293 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:40.294 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:40.330 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.331+0000 7f54c10bb800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.333 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.333+0000 7f54c10bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.333 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.333+0000 7f54c10bb800 20 realm 2024-09-12T00:35:40.333 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.333+0000 7f54c10bb800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.333+0000 7f54c10bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.333+0000 7f54c10bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:40.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.333+0000 7f54c10bb800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.334+0000 7f54c10bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.334+0000 7f54c10bb800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.334+0000 7f54c10bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:40.334 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.334+0000 7f54c10bb800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.335+0000 7f54c10bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:40.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.335+0000 7f54c10bb800 20 searching for the correct realm 2024-09-12T00:35:40.336 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.337+0000 7f54b63a4640 0 -- 172.21.15.133:0/4057070611 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f54a8058020 msgr2=0x7f54a8058bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:40.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.542+0000 7f54b63a4640 0 -- 172.21.15.133:0/4057070611 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f54b006b020 msgr2=0x7f54b004df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:40.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:40.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:40.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:40.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:40.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:40.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:40.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:40.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:40.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 20 zone default found 2024-09-12T00:35:40.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 4 Realm: () 2024-09-12T00:35:40.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:40.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:40.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:40.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 20 zonegroup default 2024-09-12T00:35:40.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.748+0000 7f54c10bb800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.749+0000 7f54c10bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.749+0000 7f54c10bb800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.749+0000 7f54c10bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.749+0000 7f54c10bb800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.750+0000 7f54c10bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.750+0000 7f54c10bb800 20 started sync module instance, tier type = 2024-09-12T00:35:40.751 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.750+0000 7f54c10bb800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:40.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.758+0000 7f54c10bb800 20 add_watcher() i=0 2024-09-12T00:35:40.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.758+0000 7f54c10bb800 20 add_watcher() i=1 2024-09-12T00:35:40.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.758+0000 7f54c10bb800 20 add_watcher() i=2 2024-09-12T00:35:40.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.758+0000 7f54c10bb800 20 add_watcher() i=3 2024-09-12T00:35:40.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.758+0000 7f54c10bb800 20 add_watcher() i=4 2024-09-12T00:35:40.757 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.758+0000 7f54c10bb800 20 add_watcher() i=5 2024-09-12T00:35:40.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.758+0000 7f54c10bb800 20 add_watcher() i=6 2024-09-12T00:35:40.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.759+0000 7f54c10bb800 20 add_watcher() i=7 2024-09-12T00:35:40.758 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.759+0000 7f54c10bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:40.760 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.761+0000 7f53757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:40.761 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.762+0000 7f54c10bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:40.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.762+0000 7f54c10bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:40.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.762+0000 7f54c10bb800 5 note: GC not initialized 2024-09-12T00:35:40.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.762+0000 7f52effff640 20 reqs_thread_entry: start 2024-09-12T00:35:40.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.762+0000 7f54c10bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:40.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.762+0000 7f54c10bb800 20 Filter name: none 2024-09-12T00:35:40.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.762+0000 7f52edffb640 20 reqs_thread_entry: start 2024-09-12T00:35:40.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.762+0000 7f54c10bb800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.762+0000 7f54c10bb800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:40.762 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.763+0000 7f54c10bb800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.763 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.763+0000 7f54c10bb800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:35:40.763 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.763+0000 7f54c10bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:40.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.763+0000 7f54c10bb800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.764+0000 7f54c10bb800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:40.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.764+0000 7f54c10bb800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.764+0000 7f54c10bb800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:35:40.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.764+0000 7f54c10bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:40.764 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.765+0000 7f53757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:40.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.767+0000 7f54c10bb800 20 remove_watcher() i=0 2024-09-12T00:35:40.766 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.767+0000 7f54c10bb800 2 removed watcher, disabling cache 2024-09-12T00:35:40.767 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.769+0000 7f54c10bb800 20 remove_watcher() i=1 2024-09-12T00:35:40.768 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.770+0000 7f54c10bb800 20 remove_watcher() i=2 2024-09-12T00:35:40.769 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.771+0000 7f54c10bb800 20 remove_watcher() i=3 2024-09-12T00:35:40.770 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.771+0000 7f54c10bb800 20 remove_watcher() i=4 2024-09-12T00:35:40.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.772+0000 7f54c10bb800 20 remove_watcher() i=5 2024-09-12T00:35:40.772 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.773+0000 7f54c10bb800 20 remove_watcher() i=6 2024-09-12T00:35:40.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.774+0000 7f54c10bb800 20 remove_watcher() i=7 2024-09-12T00:35:40.784 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:40.784 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:35:40.784 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-logrecord-writes id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:35:40.784 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:40.877 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:35:40.909 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:40.909 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:40.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.947+0000 7f34aa10c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.948+0000 7f34aa10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.948+0000 7f34aa10c800 20 realm 2024-09-12T00:35:40.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.948+0000 7f34aa10c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.948+0000 7f34aa10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.949+0000 7f34aa10c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:40.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.949+0000 7f34aa10c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.949+0000 7f34aa10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:40.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.949+0000 7f34aa10c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.949+0000 7f34aa10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:40.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.949+0000 7f34aa10c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:40.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.950+0000 7f34aa10c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:40.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.950+0000 7f34aa10c800 20 searching for the correct realm 2024-09-12T00:35:40.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.952+0000 7f349f3f5640 0 -- 172.21.15.133:0/116927095 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f3490077220 msgr2=0x7f3490060bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:40.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:40.955+0000 7f349f3f5640 0 -- 172.21.15.133:0/116927095 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f3498081410 msgr2=0x7f3498081870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:41.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.161+0000 7f34aa10c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:41.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.161+0000 7f34aa10c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:41.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.161+0000 7f34aa10c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:41.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.161+0000 7f34aa10c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:41.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.161+0000 7f34aa10c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:41.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.161+0000 7f34aa10c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:41.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.161+0000 7f34aa10c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.161+0000 7f34aa10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:41.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.161+0000 7f34aa10c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.161+0000 7f34aa10c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:41.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.161+0000 7f34aa10c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.162+0000 7f34aa10c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:41.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.162+0000 7f34aa10c800 20 zone default found 2024-09-12T00:35:41.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.162+0000 7f34aa10c800 4 Realm: () 2024-09-12T00:35:41.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.162+0000 7f34aa10c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:41.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.162+0000 7f34aa10c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:41.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.162+0000 7f34aa10c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:41.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.162+0000 7f34aa10c800 20 zonegroup default 2024-09-12T00:35:41.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.162+0000 7f34aa10c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.162+0000 7f34aa10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:41.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.162+0000 7f34aa10c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.163+0000 7f34aa10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:41.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.163+0000 7f34aa10c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.163+0000 7f34aa10c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:41.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.163+0000 7f34aa10c800 20 started sync module instance, tier type = 2024-09-12T00:35:41.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.163+0000 7f34aa10c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:41.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.172+0000 7f34aa10c800 20 add_watcher() i=0 2024-09-12T00:35:41.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.172+0000 7f34aa10c800 20 add_watcher() i=1 2024-09-12T00:35:41.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.172+0000 7f34aa10c800 20 add_watcher() i=2 2024-09-12T00:35:41.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.172+0000 7f34aa10c800 20 add_watcher() i=3 2024-09-12T00:35:41.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.172+0000 7f34aa10c800 20 add_watcher() i=4 2024-09-12T00:35:41.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.172+0000 7f34aa10c800 20 add_watcher() i=5 2024-09-12T00:35:41.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.172+0000 7f34aa10c800 20 add_watcher() i=6 2024-09-12T00:35:41.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.173+0000 7f34aa10c800 20 add_watcher() i=7 2024-09-12T00:35:41.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.173+0000 7f34aa10c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:41.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.174+0000 7f335dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:41.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.175+0000 7f34aa10c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:41.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.175+0000 7f34aa10c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:41.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.175+0000 7f34aa10c800 5 note: GC not initialized 2024-09-12T00:35:41.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.175+0000 7f335cfe1640 20 reqs_thread_entry: start 2024-09-12T00:35:41.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.175+0000 7f34aa10c800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:41.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.175+0000 7f34aa10c800 20 Filter name: none 2024-09-12T00:35:41.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.175+0000 7f32d67fc640 20 reqs_thread_entry: start 2024-09-12T00:35:41.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.175+0000 7f34aa10c800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:35:41.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.175+0000 7f34aa10c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.175+0000 7f34aa10c800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:41.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.175+0000 7f34aa10c800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:35:41.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.175+0000 7f34aa10c800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:35:41.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.176+0000 7f34aa10c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 : miss 2024-09-12T00:35:41.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.176+0000 7f34aa10c800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.176+0000 7f34aa10c800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:35:41.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.176+0000 7f34aa10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 info.flags=0x17 2024-09-12T00:35:41.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.176+0000 7f34aa10c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 to cache LRU end 2024-09-12T00:35:41.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.176+0000 7f34aa10c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:41.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.176+0000 7f34aa10c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:41.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.176+0000 7f34aa10c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 2024-09-12T00:35:41.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.180+0000 7f34aa10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 info.flags=0x17 2024-09-12T00:35:41.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.180+0000 7f34aa10c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 to cache LRU end 2024-09-12T00:35:41.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.180+0000 7f34aa10c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:41.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.180+0000 7f34aa10c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36, ofs0, ns] 2024-09-12T00:35:41.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.180+0000 7f3386ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497059 cookie 94542570945920 notifier 7310 bl.length()=1007 2024-09-12T00:35:41.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.180+0000 7f3386ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 info.flags=0x17 2024-09-12T00:35:41.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.180+0000 7f3386ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 to cache LRU end 2024-09-12T00:35:41.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.180+0000 7f3386ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:41.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.181+0000 7f34aa10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): orig_sources= new_sources= 2024-09-12T00:35:41.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.181+0000 7f34aa10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): potential sources added=[] removed=[] 2024-09-12T00:35:41.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.181+0000 7f34aa10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): orig_dests= new_dests= 2024-09-12T00:35:41.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.181+0000 7f34aa10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): potential dests added=[] removed=[] 2024-09-12T00:35:41.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.184+0000 7f34aa10c800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36.1.0 2024-09-12T00:35:41.183 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.184+0000 7f34aa10c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36.1.0 2024-09-12T00:35:41.183 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.184+0000 7f34aa10c800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36.1.1 2024-09-12T00:35:41.183 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.184+0000 7f34aa10c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36.1.1 2024-09-12T00:35:41.183 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.184+0000 7f34aa10c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36.0 2024-09-12T00:35:41.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.186+0000 7f34aa10c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:41.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.186+0000 7f34aa10c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 2024-09-12T00:35:41.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.187+0000 7f34aa10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 info.flags=0x17 2024-09-12T00:35:41.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.187+0000 7f34aa10c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 to cache LRU end 2024-09-12T00:35:41.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.187+0000 7f34aa10c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:41.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.187+0000 7f34aa10c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36, ofs0, ns] 2024-09-12T00:35:41.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.188+0000 7f33867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497060 cookie 94542570945920 notifier 7310 bl.length()=1007 2024-09-12T00:35:41.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.188+0000 7f33867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 info.flags=0x17 2024-09-12T00:35:41.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.188+0000 7f33867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 to cache LRU end 2024-09-12T00:35:41.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.188+0000 7f33867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:41.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.189+0000 7f34aa10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): orig_sources= new_sources= 2024-09-12T00:35:41.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.189+0000 7f34aa10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): potential sources added=[] removed=[] 2024-09-12T00:35:41.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.189+0000 7f34aa10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): orig_dests= new_dests= 2024-09-12T00:35:41.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.189+0000 7f34aa10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): potential dests added=[] removed=[] 2024-09-12T00:35:41.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.191+0000 7f34aa10c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36.0 2024-09-12T00:35:41.189 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.191+0000 7f34aa10c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:41.190 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.191+0000 7f34aa10c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 2024-09-12T00:35:41.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.192+0000 7f34aa10c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 info.flags=0x17 2024-09-12T00:35:41.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.192+0000 7f34aa10c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 to cache LRU end 2024-09-12T00:35:41.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.192+0000 7f34aa10c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:41.191 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.192+0000 7f34aa10c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36, ofs0, ns] 2024-09-12T00:35:41.192 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.193+0000 7f33867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497061 cookie 94542570945920 notifier 7310 bl.length()=975 2024-09-12T00:35:41.192 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.193+0000 7f33867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 info.flags=0x17 2024-09-12T00:35:41.192 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.193+0000 7f33867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 to cache LRU end 2024-09-12T00:35:41.192 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.193+0000 7f33867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:41.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.194+0000 7f34aa10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): orig_sources= new_sources= 2024-09-12T00:35:41.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.194+0000 7f34aa10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): potential sources added=[] removed=[] 2024-09-12T00:35:41.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.194+0000 7f34aa10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): orig_dests= new_dests= 2024-09-12T00:35:41.193 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.194+0000 7f34aa10c800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36]): potential dests added=[] removed=[] 2024-09-12T00:35:41.194 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.195+0000 7f34aa10c800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:35:41.196 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.197+0000 7f335dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:41.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.199+0000 7f34aa10c800 20 remove_watcher() i=0 2024-09-12T00:35:41.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.199+0000 7f34aa10c800 2 removed watcher, disabling cache 2024-09-12T00:35:41.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.200+0000 7f34aa10c800 20 remove_watcher() i=1 2024-09-12T00:35:41.199 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.201+0000 7f34aa10c800 20 remove_watcher() i=2 2024-09-12T00:35:41.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.202+0000 7f34aa10c800 20 remove_watcher() i=3 2024-09-12T00:35:41.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.203+0000 7f34aa10c800 20 remove_watcher() i=4 2024-09-12T00:35:41.202 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.204+0000 7f34aa10c800 20 remove_watcher() i=5 2024-09-12T00:35:41.203 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.205+0000 7f34aa10c800 20 remove_watcher() i=6 2024-09-12T00:35:41.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.205+0000 7f34aa10c800 20 remove_watcher() i=7 2024-09-12T00:35:41.216 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:35:41.245 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:41.245 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:41.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.282+0000 7f48f860e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.284+0000 7f48f860e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:41.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.284+0000 7f48f860e800 20 realm 2024-09-12T00:35:41.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.284+0000 7f48f860e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.284+0000 7f48f860e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:41.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.284+0000 7f48f860e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:41.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.284+0000 7f48f860e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.284+0000 7f48f860e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:41.283 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.284+0000 7f48f860e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.285+0000 7f48f860e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:41.284 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.285+0000 7f48f860e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.286+0000 7f48f860e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:41.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.286+0000 7f48f860e800 20 searching for the correct realm 2024-09-12T00:35:41.286 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.288+0000 7f48f356a640 0 -- 172.21.15.133:0/2494653320 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f48dc04f040 msgr2=0x7f48dc04f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:41.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.493+0000 7f48f356a640 0 -- 172.21.15.133:0/2494653320 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f48ec0601f0 msgr2=0x7f48ec06a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:41.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.700+0000 7f48f860e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:41.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.700+0000 7f48f860e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:41.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.700+0000 7f48f860e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:41.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.700+0000 7f48f860e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:41.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.700+0000 7f48f860e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:41.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.700+0000 7f48f860e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:41.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.700+0000 7f48f860e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.700+0000 7f48f860e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:41.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.700+0000 7f48f860e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.701+0000 7f48f860e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:41.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.701+0000 7f48f860e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.701+0000 7f48f860e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:41.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.701+0000 7f48f860e800 20 zone default found 2024-09-12T00:35:41.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.701+0000 7f48f860e800 4 Realm: () 2024-09-12T00:35:41.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.701+0000 7f48f860e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:41.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.701+0000 7f48f860e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:41.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.701+0000 7f48f860e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:41.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.701+0000 7f48f860e800 20 zonegroup default 2024-09-12T00:35:41.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.701+0000 7f48f860e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.701+0000 7f48f860e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:41.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.701+0000 7f48f860e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.702+0000 7f48f860e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:41.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.702+0000 7f48f860e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.702+0000 7f48f860e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:41.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.702+0000 7f48f860e800 20 started sync module instance, tier type = 2024-09-12T00:35:41.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.702+0000 7f48f860e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:41.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.710+0000 7f48f860e800 20 add_watcher() i=0 2024-09-12T00:35:41.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.710+0000 7f48f860e800 20 add_watcher() i=1 2024-09-12T00:35:41.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.710+0000 7f48f860e800 20 add_watcher() i=2 2024-09-12T00:35:41.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.710+0000 7f48f860e800 20 add_watcher() i=3 2024-09-12T00:35:41.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.710+0000 7f48f860e800 20 add_watcher() i=4 2024-09-12T00:35:41.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.710+0000 7f48f860e800 20 add_watcher() i=5 2024-09-12T00:35:41.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.710+0000 7f48f860e800 20 add_watcher() i=6 2024-09-12T00:35:41.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.711+0000 7f48f860e800 20 add_watcher() i=7 2024-09-12T00:35:41.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.711+0000 7f48f860e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:41.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.713+0000 7f47a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:41.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.713+0000 7f48f860e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:41.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.713+0000 7f48f860e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:41.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.713+0000 7f48f860e800 5 note: GC not initialized 2024-09-12T00:35:41.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.713+0000 7f47a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:41.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.713+0000 7f48f860e800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:41.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.714+0000 7f48f860e800 20 Filter name: none 2024-09-12T00:35:41.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.714+0000 7f47227fc640 20 reqs_thread_entry: start 2024-09-12T00:35:41.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.714+0000 7f48f860e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.714+0000 7f48f860e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:41.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.714+0000 7f48f860e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.715+0000 7f48f860e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:35:41.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.715+0000 7f48f860e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:41.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.715+0000 7f48f860e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.715+0000 7f48f860e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:41.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.715+0000 7f48f860e800 20 rados->read ofs=0 len=0 2024-09-12T00:35:41.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.715+0000 7f48f860e800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:35:41.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.715+0000 7f48f860e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:41.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.717+0000 7f47a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:41.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.719+0000 7f48f860e800 20 remove_watcher() i=0 2024-09-12T00:35:41.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.719+0000 7f48f860e800 2 removed watcher, disabling cache 2024-09-12T00:35:41.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.720+0000 7f48f860e800 20 remove_watcher() i=1 2024-09-12T00:35:41.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.721+0000 7f48f860e800 20 remove_watcher() i=2 2024-09-12T00:35:41.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.722+0000 7f48f860e800 20 remove_watcher() i=3 2024-09-12T00:35:41.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.723+0000 7f48f860e800 20 remove_watcher() i=4 2024-09-12T00:35:41.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.724+0000 7f48f860e800 20 remove_watcher() i=5 2024-09-12T00:35:41.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.725+0000 7f48f860e800 20 remove_watcher() i=6 2024-09-12T00:35:41.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:41.726+0000 7f48f860e800 20 remove_watcher() i=7 2024-09-12T00:35:41.735 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:41.735 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:35:41.735 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-logrecord-writes id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:35:41.735 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:42.030 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T00:35:42.030 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:42.842 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:35:42.871 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:42.872 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:42.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:42.910+0000 7fd90a731800 20 rados->read ofs=0 len=0 2024-09-12T00:35:42.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:42.912+0000 7fd90a731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:42.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:42.912+0000 7fd90a731800 20 realm 2024-09-12T00:35:42.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:42.912+0000 7fd90a731800 20 rados->read ofs=0 len=0 2024-09-12T00:35:42.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:42.912+0000 7fd90a731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:42.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:42.912+0000 7fd90a731800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:42.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:42.912+0000 7fd90a731800 20 rados->read ofs=0 len=0 2024-09-12T00:35:42.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:42.912+0000 7fd90a731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:42.913 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:42.912+0000 7fd90a731800 20 rados->read ofs=0 len=0 2024-09-12T00:35:42.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:42.913+0000 7fd90a731800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:42.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:42.913+0000 7fd90a731800 20 rados->read ofs=0 len=0 2024-09-12T00:35:42.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:42.914+0000 7fd90a731800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:42.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:42.914+0000 7fd90a731800 20 searching for the correct realm 2024-09-12T00:35:42.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:42.916+0000 7fd906c1b640 0 -- 172.21.15.133:0/238571385 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7fd900031060 msgr2=0x7fd90009d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:43.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.121+0000 7fd90641a640 0 -- 172.21.15.133:0/238571385 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x55d932645720 msgr2=0x55d932647b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:43.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.124+0000 7fd90a731800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:43.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.124+0000 7fd90a731800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:43.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.124+0000 7fd90a731800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:43.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.124+0000 7fd90a731800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:43.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.124+0000 7fd90a731800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:43.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.124+0000 7fd90a731800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:43.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.124+0000 7fd90a731800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.124+0000 7fd90a731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.124+0000 7fd90a731800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.125+0000 7fd90a731800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:43.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.125+0000 7fd90a731800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.125+0000 7fd90a731800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:43.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.125+0000 7fd90a731800 20 zone default found 2024-09-12T00:35:43.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.125+0000 7fd90a731800 4 Realm: () 2024-09-12T00:35:43.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.125+0000 7fd90a731800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:43.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.125+0000 7fd90a731800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:43.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.125+0000 7fd90a731800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:43.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.125+0000 7fd90a731800 20 zonegroup default 2024-09-12T00:35:43.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.125+0000 7fd90a731800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.126+0000 7fd90a731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.126+0000 7fd90a731800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.126+0000 7fd90a731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.126+0000 7fd90a731800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.126+0000 7fd90a731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.126+0000 7fd90a731800 20 started sync module instance, tier type = 2024-09-12T00:35:43.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.126+0000 7fd90a731800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:43.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.134+0000 7fd90a731800 20 add_watcher() i=0 2024-09-12T00:35:43.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.134+0000 7fd90a731800 20 add_watcher() i=1 2024-09-12T00:35:43.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.134+0000 7fd90a731800 20 add_watcher() i=2 2024-09-12T00:35:43.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.134+0000 7fd90a731800 20 add_watcher() i=3 2024-09-12T00:35:43.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.134+0000 7fd90a731800 20 add_watcher() i=4 2024-09-12T00:35:43.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.134+0000 7fd90a731800 20 add_watcher() i=5 2024-09-12T00:35:43.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.134+0000 7fd90a731800 20 add_watcher() i=6 2024-09-12T00:35:43.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.135+0000 7fd90a731800 20 add_watcher() i=7 2024-09-12T00:35:43.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.135+0000 7fd90a731800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:43.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.137+0000 7fd7bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:43.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.138+0000 7fd90a731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:43.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.138+0000 7fd90a731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:43.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.138+0000 7fd90a731800 5 note: GC not initialized 2024-09-12T00:35:43.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.138+0000 7fd7377fe640 20 reqs_thread_entry: start 2024-09-12T00:35:43.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.138+0000 7fd90a731800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:43.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.138+0000 7fd90a731800 20 Filter name: none 2024-09-12T00:35:43.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.138+0000 7fd7357fa640 20 reqs_thread_entry: start 2024-09-12T00:35:43.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.138+0000 7fd90a731800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.139+0000 7fd90a731800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:43.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.139+0000 7fd90a731800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.139+0000 7fd90a731800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:35:43.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.139+0000 7fd90a731800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:43.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.139+0000 7fd90a731800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.140+0000 7fd90a731800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:43.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.140+0000 7fd90a731800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.140+0000 7fd90a731800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:35:43.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.140+0000 7fd90a731800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:43.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.141+0000 7fd7bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:43.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.143+0000 7fd90a731800 20 remove_watcher() i=0 2024-09-12T00:35:43.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.143+0000 7fd90a731800 2 removed watcher, disabling cache 2024-09-12T00:35:43.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.144+0000 7fd90a731800 20 remove_watcher() i=1 2024-09-12T00:35:43.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.145+0000 7fd90a731800 20 remove_watcher() i=2 2024-09-12T00:35:43.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.146+0000 7fd90a731800 20 remove_watcher() i=3 2024-09-12T00:35:43.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.146+0000 7fd90a731800 20 remove_watcher() i=4 2024-09-12T00:35:43.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.147+0000 7fd90a731800 20 remove_watcher() i=5 2024-09-12T00:35:43.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.148+0000 7fd90a731800 20 remove_watcher() i=6 2024-09-12T00:35:43.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.149+0000 7fd90a731800 20 remove_watcher() i=7 2024-09-12T00:35:43.159 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.159 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:35:43.160 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-logrecord-writes id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:35:43.160 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.161 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:35:43.195 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:43.195 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:43.231 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.231+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.233+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.233+0000 7ff622528800 20 realm 2024-09-12T00:35:43.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.233+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.233+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.233+0000 7ff622528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:43.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.233+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.233+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.233 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.233+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.234+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:43.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.234+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.235+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:43.234 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.235+0000 7ff622528800 20 searching for the correct realm 2024-09-12T00:35:43.236 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.236+0000 7ff615a4a640 0 -- 172.21.15.133:0/542334586 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff60807d040 msgr2=0x7ff60804e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:43.440 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.440+0000 7ff615a4a640 0 -- 172.21.15.133:0/542334586 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff610045470 msgr2=0x7ff6100458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:43.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:43.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:43.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:43.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:43.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:43.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:43.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.647+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.647+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.647+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.648+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:43.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.648+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.648+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:43.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.648+0000 7ff622528800 20 zone default found 2024-09-12T00:35:43.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.648+0000 7ff622528800 4 Realm: () 2024-09-12T00:35:43.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.648+0000 7ff622528800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:43.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.648+0000 7ff622528800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:43.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.648+0000 7ff622528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:43.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.648+0000 7ff622528800 20 zonegroup default 2024-09-12T00:35:43.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.648+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.648+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.648+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.649+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.649+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.649+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.649+0000 7ff622528800 20 started sync module instance, tier type = 2024-09-12T00:35:43.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.649+0000 7ff622528800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:43.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=0 2024-09-12T00:35:43.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=1 2024-09-12T00:35:43.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=2 2024-09-12T00:35:43.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=3 2024-09-12T00:35:43.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=4 2024-09-12T00:35:43.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=5 2024-09-12T00:35:43.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=6 2024-09-12T00:35:43.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.659+0000 7ff622528800 20 add_watcher() i=7 2024-09-12T00:35:43.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.659+0000 7ff622528800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:43.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.660+0000 7ff4d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:43.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.661+0000 7ff622528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:43.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.661+0000 7ff622528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:43.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.661+0000 7ff622528800 5 note: GC not initialized 2024-09-12T00:35:43.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.661+0000 7ff44f7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:43.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.661+0000 7ff622528800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:43.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.661+0000 7ff622528800 20 Filter name: none 2024-09-12T00:35:43.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.661+0000 7ff44d7fa640 20 reqs_thread_entry: start 2024-09-12T00:35:43.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.661+0000 7ff622528800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:35:43.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.661+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.662+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:43.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.662+0000 7ff622528800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:35:43.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.662+0000 7ff622528800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:35:43.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.662+0000 7ff622528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 : miss 2024-09-12T00:35:43.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.662+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.662+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:35:43.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.662+0000 7ff622528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:35:43.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.662+0000 7ff622528800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:35:43.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.662+0000 7ff622528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:43.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.662+0000 7ff622528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:43.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.662+0000 7ff622528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 2024-09-12T00:35:43.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.666+0000 7ff622528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:35:43.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.666+0000 7ff622528800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:35:43.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.666+0000 7ff622528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:43.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.666+0000 7ff622528800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37, ofs0, ns] 2024-09-12T00:35:43.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.666+0000 7ff5017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497057 cookie 94174646962448 notifier 7361 bl.length()=1007 2024-09-12T00:35:43.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.666+0000 7ff5017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:35:43.666 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.666+0000 7ff5017fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:35:43.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.666+0000 7ff5017fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:43.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.668+0000 7ff622528800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): orig_sources= new_sources= 2024-09-12T00:35:43.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.668+0000 7ff622528800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): potential sources added=[] removed=[] 2024-09-12T00:35:43.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.668+0000 7ff622528800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): orig_dests= new_dests= 2024-09-12T00:35:43.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.668+0000 7ff622528800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): potential dests added=[] removed=[] 2024-09-12T00:35:43.669 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff622528800 time 2024-09-12T00:35:43.671456+0000 2024-09-12T00:35:43.669 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:43.670 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:43.670 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff623d8c71a] 2024-09-12T00:35:43.670 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff623d8c8d8] 2024-09-12T00:35:43.670 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6bc973641] 2024-09-12T00:35:43.670 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd8854c) [0x55a6bce8654c] 2024-09-12T00:35:43.670 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6bc98331d] 2024-09-12T00:35:43.670 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:35:43.670 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff622a29590] 2024-09-12T00:35:43.670 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:35:43.670 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:35:43.670 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.670+0000 7ff622528800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff622528800 time 2024-09-12T00:35:43.671456+0000 2024-09-12T00:35:43.670 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:43.671 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.671 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:43.671 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff623d8c71a] 2024-09-12T00:35:43.671 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff623d8c8d8] 2024-09-12T00:35:43.671 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6bc973641] 2024-09-12T00:35:43.671 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd8854c) [0x55a6bce8654c] 2024-09-12T00:35:43.671 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6bc98331d] 2024-09-12T00:35:43.671 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:35:43.671 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff622a29590] 2024-09-12T00:35:43.671 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:35:43.671 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:35:43.671 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.671 INFO:tasks.workunit.client.0.smithi133.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:35:43.672 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7ff622528800 thread_name:radosgw-admin 2024-09-12T00:35:43.690 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:43.690 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff622a3e6f0] 2024-09-12T00:35:43.690 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff622a8b99c] 2024-09-12T00:35:43.691 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:35:43.691 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:35:43.691 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff623d8c774] 2024-09-12T00:35:43.691 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff623d8c8d8] 2024-09-12T00:35:43.691 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6bc973641] 2024-09-12T00:35:43.691 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd8854c) [0x55a6bce8654c] 2024-09-12T00:35:43.691 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6bc98331d] 2024-09-12T00:35:43.691 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:35:43.691 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff622a29590] 2024-09-12T00:35:43.691 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:35:43.691 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:35:43.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.671+0000 7ff622528800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:43.691 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7ff622528800 thread_name:radosgw-admin 2024-09-12T00:35:43.691 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.692 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:43.692 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff622a3e6f0] 2024-09-12T00:35:43.692 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff622a8b99c] 2024-09-12T00:35:43.692 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:35:43.692 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:35:43.692 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff623d8c774] 2024-09-12T00:35:43.692 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff623d8c8d8] 2024-09-12T00:35:43.692 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6bc973641] 2024-09-12T00:35:43.692 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd8854c) [0x55a6bce8654c] 2024-09-12T00:35:43.692 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6bc98331d] 2024-09-12T00:35:43.692 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:35:43.692 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff622a29590] 2024-09-12T00:35:43.692 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:35:43.693 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:35:43.693 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:43.693 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.693 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:35:43.693 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:35:43.215+0000 7ff622528800 5 asok(0x55a6be2ef630) unregister_commands rotate-key 2024-09-12T00:35:43.693 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:35:43.215+0000 7ff622528800 10 monclient: build_initial_monmap 2024-09-12T00:35:43.693 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:35:43.215+0000 7ff622528800 1 build_initial for_mkfs: 0 2024-09-12T00:35:43.693 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:35:43.215+0000 7ff622528800 10 monclient: monmap: 2024-09-12T00:35:43.693 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:43.693 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:43.693 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:43.693 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:43.693 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:43.693 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.694 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:43.694 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:43.694 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:43.694 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.694 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding auth protocol: cephx 2024-09-12T00:35:43.694 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding auth protocol: cephx 2024-09-12T00:35:43.694 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding auth protocol: cephx 2024-09-12T00:35:43.694 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: secure 2024-09-12T00:35:43.694 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: crc 2024-09-12T00:35:43.694 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: secure 2024-09-12T00:35:43.694 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: crc 2024-09-12T00:35:43.694 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: secure 2024-09-12T00:35:43.694 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: crc 2024-09-12T00:35:43.695 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: crc 2024-09-12T00:35:43.695 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: secure 2024-09-12T00:35:43.695 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: crc 2024-09-12T00:35:43.695 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: secure 2024-09-12T00:35:43.695 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: crc 2024-09-12T00:35:43.695 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: secure 2024-09-12T00:35:43.695 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:35:43.216+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.695 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:35:43.216+0000 7ff622528800 1 librados: starting msgr at 2024-09-12T00:35:43.695 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:35:43.216+0000 7ff622528800 1 librados: starting objecter 2024-09-12T00:35:43.695 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:35:43.216+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command objecter_requests hook 0x55a6be513ed0 2024-09-12T00:35:43.695 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:35:43.216+0000 7ff622528800 1 librados: setting wanted keys 2024-09-12T00:35:43.695 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:35:43.216+0000 7ff622528800 1 librados: calling monclient init 2024-09-12T00:35:43.695 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient: init 2024-09-12T00:35:43.695 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding auth protocol: cephx 2024-09-12T00:35:43.696 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding auth protocol: cephx 2024-09-12T00:35:43.696 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding auth protocol: cephx 2024-09-12T00:35:43.696 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: secure 2024-09-12T00:35:43.696 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: crc 2024-09-12T00:35:43.696 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: secure 2024-09-12T00:35:43.696 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: crc 2024-09-12T00:35:43.696 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: secure 2024-09-12T00:35:43.696 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: crc 2024-09-12T00:35:43.696 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: crc 2024-09-12T00:35:43.696 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: secure 2024-09-12T00:35:43.696 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: crc 2024-09-12T00:35:43.696 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: secure 2024-09-12T00:35:43.696 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: crc 2024-09-12T00:35:43.696 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: secure 2024-09-12T00:35:43.697 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:35:43.216+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.697 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:35:43.216+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.697 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:35:43.216+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command rotate-key hook 0x55a6be511be8 2024-09-12T00:35:43.697 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:43.697 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:35:43.697 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): picked mon.noname-b con 0x55a6be3c90d0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:43.697 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): picked mon.noname-a con 0x55a6be454f50 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:43.697 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): picked mon.noname-c con 0x55a6be45b910 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:43.697 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.697 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.697 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.697 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:43.697 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): authenticate will time out at 2151.789824s 2024-09-12T00:35:43.697 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:35:43.216+0000 7ff615a4a640 10 monclient(hunting): get_auth_request con 0x55a6be454f50 auth_method 0 2024-09-12T00:35:43.698 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:35:43.216+0000 7ff615a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.698 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:35:43.216+0000 7ff615a4a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.698 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:35:43.216+0000 7ff615a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.698 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:35:43.216+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request con 0x55a6be45b910 auth_method 0 2024-09-12T00:35:43.698 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:35:43.216+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.698 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:35:43.216+0000 7ff61ea4c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.698 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:35:43.216+0000 7ff61ea4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.698 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:35:43.216+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.698 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:35:43.216+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.698 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:35:43.216+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.698 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:35:43.217+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.698 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:35:43.217+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.698 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:35:43.217+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.698 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:35:43.217+0000 7ff61e24b640 10 monclient(hunting): get_auth_request con 0x55a6be3c90d0 auth_method 0 2024-09-12T00:35:43.699 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:35:43.217+0000 7ff61e24b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.699 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:35:43.217+0000 7ff61e24b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.699 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:35:43.217+0000 7ff61e24b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.699 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:35:43.217+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.699 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:35:43.217+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.699 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:35:43.217+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.699 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:35:43.217+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_done global_id 7352 payload 824 2024-09-12T00:35:43.699 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:35:43.217+0000 7ff61ea4c640 10 monclient: _finish_hunting 0 2024-09-12T00:35:43.699 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:35:43.217+0000 7ff61ea4c640 1 monclient: found mon.noname-c 2024-09-12T00:35:43.699 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:35:43.217+0000 7ff61ea4c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.699 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.699 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:43.699 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: dump: 2024-09-12T00:35:43.699 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.699 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.700 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.700 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.700 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.700 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.700 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.700 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.700 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.700 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.700 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: _finish_auth 0 2024-09-12T00:35:43.700 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: _check_auth_tickets 2024-09-12T00:35:43.700 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:43.700 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.700 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:43.701 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: dump: 2024-09-12T00:35:43.701 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.701 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.701 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.701 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.701 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.701 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.701 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.701 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.701 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.701 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.702 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:35:43.217+0000 7ff622528800 5 monclient: authenticate success, global_id 7352 2024-09-12T00:35:43.702 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:35:43.217+0000 7ff622528800 10 monclient: _renew_subs 2024-09-12T00:35:43.702 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:35:43.217+0000 7ff622528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.702 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:35:43.217+0000 7ff50c608640 4 set_mon_vals no callback set 2024-09-12T00:35:43.702 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:35:43.217+0000 7ff622528800 10 monclient: _renew_subs 2024-09-12T00:35:43.702 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:35:43.217+0000 7ff622528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.702 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:35:43.217+0000 7ff622528800 1 librados: init done 2024-09-12T00:35:43.702 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:35:43.219+0000 7ff50ae05640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:35:43.702 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:35:43.219+0000 7ff50ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:43.702 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:35:43.219+0000 7ff50ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:43.702 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:35:43.219+0000 7ff61e24b640 10 monclient: get_auth_request con 0x7ff504076470 auth_method 0 2024-09-12T00:35:43.702 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:35:43.219+0000 7ff615a4a640 10 monclient: get_auth_request con 0x55a6be53aa70 auth_method 0 2024-09-12T00:35:43.702 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:35:43.220+0000 7ff61e24b640 10 monclient: get_auth_request con 0x55a6be55d3d0 auth_method 0 2024-09-12T00:35:43.702 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:35:43.221+0000 7ff615a4a640 10 monclient: get_auth_request con 0x55a6be5615c0 auth_method 0 2024-09-12T00:35:43.702 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:35:43.222+0000 7ff61ea4c640 10 monclient: get_auth_request con 0x55a6be560cb0 auth_method 0 2024-09-12T00:35:43.703 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:35:43.222+0000 7ff622528800 10 monclient: build_initial_monmap 2024-09-12T00:35:43.703 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:35:43.222+0000 7ff622528800 1 build_initial for_mkfs: 0 2024-09-12T00:35:43.703 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:35:43.222+0000 7ff622528800 10 monclient: monmap: 2024-09-12T00:35:43.703 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:43.703 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:43.703 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:43.703 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:43.703 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:43.703 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.703 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:43.703 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:43.703 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:43.703 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.703 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding auth protocol: cephx 2024-09-12T00:35:43.703 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding auth protocol: cephx 2024-09-12T00:35:43.704 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding auth protocol: cephx 2024-09-12T00:35:43.704 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: secure 2024-09-12T00:35:43.704 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: crc 2024-09-12T00:35:43.704 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: secure 2024-09-12T00:35:43.704 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: crc 2024-09-12T00:35:43.704 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: secure 2024-09-12T00:35:43.704 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: crc 2024-09-12T00:35:43.704 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: crc 2024-09-12T00:35:43.704 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: secure 2024-09-12T00:35:43.704 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: crc 2024-09-12T00:35:43.704 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: secure 2024-09-12T00:35:43.704 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: crc 2024-09-12T00:35:43.704 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: secure 2024-09-12T00:35:43.705 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:35:43.223+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.705 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:35:43.223+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command objecter_requests cmddesc objecter_requests hook 0x55a6be56d1a0 EEXIST 2024-09-12T00:35:43.705 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient: init 2024-09-12T00:35:43.705 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding auth protocol: cephx 2024-09-12T00:35:43.705 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding auth protocol: cephx 2024-09-12T00:35:43.705 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding auth protocol: cephx 2024-09-12T00:35:43.705 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: secure 2024-09-12T00:35:43.705 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: crc 2024-09-12T00:35:43.705 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: secure 2024-09-12T00:35:43.705 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: crc 2024-09-12T00:35:43.705 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: secure 2024-09-12T00:35:43.705 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: crc 2024-09-12T00:35:43.705 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: crc 2024-09-12T00:35:43.705 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: secure 2024-09-12T00:35:43.706 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: crc 2024-09-12T00:35:43.706 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: secure 2024-09-12T00:35:43.706 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: crc 2024-09-12T00:35:43.706 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: secure 2024-09-12T00:35:43.706 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:35:43.223+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.706 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:35:43.223+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.706 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:35:43.223+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command rotate-key cmddesc rotate-key hook 0x55a6be5687f0 EEXIST 2024-09-12T00:35:43.706 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:43.706 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:35:43.706 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): picked mon.noname-b con 0x55a6be590e90 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:43.706 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): picked mon.noname-c con 0x55a6be593160 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:43.706 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): picked mon.noname-a con 0x55a6be58f660 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:43.706 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.706 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.707 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.707 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:43.707 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): authenticate will time out at 2151.796848s 2024-09-12T00:35:43.707 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:35:43.223+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request con 0x55a6be593160 auth_method 0 2024-09-12T00:35:43.707 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:35:43.223+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.707 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:35:43.223+0000 7ff61ea4c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.707 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:35:43.223+0000 7ff61ea4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.707 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:35:43.223+0000 7ff61e24b640 10 monclient(hunting): get_auth_request con 0x55a6be58f660 auth_method 0 2024-09-12T00:35:43.707 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:35:43.223+0000 7ff61e24b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.707 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:35:43.223+0000 7ff61e24b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.707 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:35:43.223+0000 7ff61e24b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.707 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:35:43.223+0000 7ff615a4a640 10 monclient(hunting): get_auth_request con 0x55a6be590e90 auth_method 0 2024-09-12T00:35:43.707 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:35:43.224+0000 7ff615a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.707 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:35:43.224+0000 7ff615a4a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.708 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:35:43.224+0000 7ff615a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.708 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:35:43.224+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.708 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:35:43.224+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.708 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:35:43.224+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.708 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:35:43.224+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.708 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:35:43.224+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.708 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:35:43.224+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.708 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:35:43.224+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.708 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:35:43.224+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.708 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:35:43.224+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.708 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:35:43.224+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_done global_id 7355 payload 824 2024-09-12T00:35:43.708 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:35:43.224+0000 7ff61ea4c640 10 monclient: _finish_hunting 0 2024-09-12T00:35:43.708 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:35:43.224+0000 7ff61ea4c640 1 monclient: found mon.noname-c 2024-09-12T00:35:43.708 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:35:43.224+0000 7ff61ea4c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.709 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.709 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:43.709 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: dump: 2024-09-12T00:35:43.709 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.709 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.709 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.709 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.709 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.709 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.709 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.709 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.709 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.709 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.709 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: _finish_auth 0 2024-09-12T00:35:43.710 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: _check_auth_tickets 2024-09-12T00:35:43.710 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:35:43.224+0000 7ff622528800 5 monclient: authenticate success, global_id 7355 2024-09-12T00:35:43.710 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:43.710 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.710 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:43.710 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: dump: 2024-09-12T00:35:43.710 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.710 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.710 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.710 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.710 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.710 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.710 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.710 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.711 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.711 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.711 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:35:43.224+0000 7ff622528800 10 monclient: _renew_subs 2024-09-12T00:35:43.711 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:35:43.224+0000 7ff622528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.711 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:35:43.224+0000 7ff61f24d640 4 set_mon_vals no callback set 2024-09-12T00:35:43.711 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:35:43.224+0000 7ff622528800 10 monclient: _renew_subs 2024-09-12T00:35:43.711 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:35:43.224+0000 7ff622528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.711 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:35:43.226+0000 7ff503fff640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:35:43.711 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:35:43.226+0000 7ff503fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:43.711 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:35:43.226+0000 7ff503fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:43.711 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:35:43.226+0000 7ff615a4a640 10 monclient: get_auth_request con 0x7ff4f8076380 auth_method 0 2024-09-12T00:35:43.711 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:35:43.226+0000 7ff622528800 10 monclient: get_monmap_and_config 2024-09-12T00:35:43.711 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:35:43.226+0000 7ff622528800 10 monclient: build_initial_monmap 2024-09-12T00:35:43.711 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:35:43.226+0000 7ff622528800 1 build_initial for_mkfs: 0 2024-09-12T00:35:43.711 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:35:43.226+0000 7ff622528800 10 monclient: monmap: 2024-09-12T00:35:43.712 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:43.712 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:43.712 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:43.712 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:43.712 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:43.712 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.712 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:43.712 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:43.712 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:43.712 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.712 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding auth protocol: cephx 2024-09-12T00:35:43.712 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding auth protocol: cephx 2024-09-12T00:35:43.712 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding auth protocol: cephx 2024-09-12T00:35:43.712 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: secure 2024-09-12T00:35:43.713 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: crc 2024-09-12T00:35:43.713 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: secure 2024-09-12T00:35:43.713 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: crc 2024-09-12T00:35:43.713 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: secure 2024-09-12T00:35:43.713 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: crc 2024-09-12T00:35:43.713 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: crc 2024-09-12T00:35:43.713 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: secure 2024-09-12T00:35:43.713 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: crc 2024-09-12T00:35:43.713 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: secure 2024-09-12T00:35:43.713 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: crc 2024-09-12T00:35:43.713 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: secure 2024-09-12T00:35:43.713 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:35:43.226+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.713 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:35:43.226+0000 7ff622528800 10 monclient: init 2024-09-12T00:35:43.713 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding auth protocol: cephx 2024-09-12T00:35:43.714 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding auth protocol: cephx 2024-09-12T00:35:43.714 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding auth protocol: cephx 2024-09-12T00:35:43.714 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: secure 2024-09-12T00:35:43.714 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: crc 2024-09-12T00:35:43.714 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: secure 2024-09-12T00:35:43.714 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: crc 2024-09-12T00:35:43.714 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: secure 2024-09-12T00:35:43.714 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: crc 2024-09-12T00:35:43.714 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: crc 2024-09-12T00:35:43.714 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: secure 2024-09-12T00:35:43.714 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: crc 2024-09-12T00:35:43.714 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: secure 2024-09-12T00:35:43.714 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: crc 2024-09-12T00:35:43.714 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: secure 2024-09-12T00:35:43.714 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:35:43.227+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.715 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:35:43.227+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.715 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:35:43.227+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command rotate-key cmddesc rotate-key hook 0x7ffef54db838 EEXIST 2024-09-12T00:35:43.715 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:43.715 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:35:43.715 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): picked mon.noname-a con 0x55a6be5e5080 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:43.715 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): picked mon.noname-c con 0x55a6be5df620 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:43.715 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): picked mon.noname-b con 0x55a6be5b4ec0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:43.715 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.715 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.715 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.715 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:43.715 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): authenticate will time out at 2151.800357s 2024-09-12T00:35:43.715 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): get_auth_request con 0x55a6be5e5080 auth_method 0 2024-09-12T00:35:43.715 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.716 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.716 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.716 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:35:43.227+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request con 0x55a6be5df620 auth_method 0 2024-09-12T00:35:43.716 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:35:43.227+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.716 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:35:43.227+0000 7ff61ea4c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.716 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:35:43.227+0000 7ff61ea4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.716 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.716 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.716 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.716 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:35:43.227+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.716 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:35:43.227+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.716 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:35:43.227+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.716 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:35:43.227+0000 7ff61e24b640 10 monclient(hunting): get_auth_request con 0x55a6be5b4ec0 auth_method 0 2024-09-12T00:35:43.716 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:35:43.227+0000 7ff61e24b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.717 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:35:43.227+0000 7ff61e24b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.717 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:35:43.227+0000 7ff61e24b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.717 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:35:43.227+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.717 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:35:43.227+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.717 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:35:43.227+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.717 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): handle_auth_done global_id 7851 payload 274 2024-09-12T00:35:43.717 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient: _finish_hunting 0 2024-09-12T00:35:43.717 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:35:43.227+0000 7ff615a4a640 1 monclient: found mon.noname-a 2024-09-12T00:35:43.717 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:35:43.717 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:35:43.227+0000 7ff501ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.717 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:35:43.227+0000 7ff501ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:43.717 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:35:43.227+0000 7ff501ffb640 10 monclient: dump: 2024-09-12T00:35:43.717 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.717 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.717 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.718 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.718 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.718 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.718 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.718 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.718 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.718 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.718 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:35:43.227+0000 7ff501ffb640 10 monclient: _finish_auth 0 2024-09-12T00:35:43.718 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:35:43.227+0000 7ff501ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:35:43.718 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:35:43.227+0000 7ff501ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:43.718 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:35:43.227+0000 7ff501ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.718 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:35:43.228+0000 7ff501ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:43.718 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:35:43.228+0000 7ff501ffb640 10 monclient: dump: 2024-09-12T00:35:43.718 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.718 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.719 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.719 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.719 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.719 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.719 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.719 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.719 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.719 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.719 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:35:43.228+0000 7ff622528800 5 monclient: authenticate success, global_id 7851 2024-09-12T00:35:43.719 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:35:43.228+0000 7ff622528800 10 monclient: get_monmap_and_config success 2024-09-12T00:35:43.719 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:35:43.228+0000 7ff622528800 4 set_mon_vals no callback set 2024-09-12T00:35:43.719 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:35:43.228+0000 7ff622528800 10 monclient: shutdown 2024-09-12T00:35:43.719 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:35:43.228+0000 7ff622528800 10 monclient: build_initial_monmap 2024-09-12T00:35:43.719 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:35:43.228+0000 7ff622528800 1 build_initial for_mkfs: 0 2024-09-12T00:35:43.720 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:35:43.228+0000 7ff622528800 10 monclient: monmap: 2024-09-12T00:35:43.720 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:43.720 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:43.720 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:43.720 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:43.720 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:43.720 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.720 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:43.720 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:43.720 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:43.720 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.720 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding auth protocol: cephx 2024-09-12T00:35:43.720 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding auth protocol: cephx 2024-09-12T00:35:43.720 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding auth protocol: cephx 2024-09-12T00:35:43.721 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: secure 2024-09-12T00:35:43.721 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: crc 2024-09-12T00:35:43.721 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: secure 2024-09-12T00:35:43.721 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: crc 2024-09-12T00:35:43.721 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: secure 2024-09-12T00:35:43.721 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: crc 2024-09-12T00:35:43.721 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: crc 2024-09-12T00:35:43.721 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: secure 2024-09-12T00:35:43.721 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: crc 2024-09-12T00:35:43.721 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: secure 2024-09-12T00:35:43.721 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: crc 2024-09-12T00:35:43.721 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: secure 2024-09-12T00:35:43.721 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:35:43.228+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.721 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:35:43.228+0000 7ff622528800 1 librados: starting msgr at 2024-09-12T00:35:43.722 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:35:43.228+0000 7ff622528800 1 librados: starting objecter 2024-09-12T00:35:43.722 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:35:43.229+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command objecter_requests cmddesc objecter_requests hook 0x55a6be5def00 EEXIST 2024-09-12T00:35:43.722 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:35:43.229+0000 7ff622528800 1 librados: setting wanted keys 2024-09-12T00:35:43.722 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:35:43.229+0000 7ff622528800 1 librados: calling monclient init 2024-09-12T00:35:43.722 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient: init 2024-09-12T00:35:43.722 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding auth protocol: cephx 2024-09-12T00:35:43.722 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding auth protocol: cephx 2024-09-12T00:35:43.722 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding auth protocol: cephx 2024-09-12T00:35:43.722 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: secure 2024-09-12T00:35:43.722 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: crc 2024-09-12T00:35:43.722 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: secure 2024-09-12T00:35:43.722 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: crc 2024-09-12T00:35:43.722 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: secure 2024-09-12T00:35:43.722 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: crc 2024-09-12T00:35:43.722 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: crc 2024-09-12T00:35:43.723 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: secure 2024-09-12T00:35:43.723 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: crc 2024-09-12T00:35:43.723 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: secure 2024-09-12T00:35:43.723 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: crc 2024-09-12T00:35:43.723 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: secure 2024-09-12T00:35:43.723 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:35:43.229+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.723 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:35:43.229+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.723 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:35:43.229+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command rotate-key cmddesc rotate-key hook 0x55a6be5a8d88 EEXIST 2024-09-12T00:35:43.723 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:43.723 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:35:43.723 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): picked mon.noname-c con 0x55a6be5b4ec0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:43.723 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): picked mon.noname-a con 0x55a6be5df620 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:43.723 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): picked mon.noname-b con 0x55a6be5e5080 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:43.723 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.723 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.724 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.724 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:43.724 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): authenticate will time out at 2151.802636s 2024-09-12T00:35:43.724 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): get_auth_request con 0x55a6be5b4ec0 auth_method 0 2024-09-12T00:35:43.724 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.724 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.724 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.724 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:35:43.229+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request con 0x55a6be5df620 auth_method 0 2024-09-12T00:35:43.724 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:35:43.229+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.724 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:35:43.229+0000 7ff61ea4c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.724 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:35:43.229+0000 7ff61ea4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.724 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:35:43.229+0000 7ff61e24b640 10 monclient(hunting): get_auth_request con 0x55a6be5e5080 auth_method 0 2024-09-12T00:35:43.724 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:35:43.229+0000 7ff61e24b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.724 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:35:43.229+0000 7ff61e24b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.725 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:35:43.229+0000 7ff61e24b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.725 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.725 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.725 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.725 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:35:43.229+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.725 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:35:43.229+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.725 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:35:43.229+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.725 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:35:43.229+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.725 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:35:43.229+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.725 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:35:43.229+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.725 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): handle_auth_done global_id 7361 payload 824 2024-09-12T00:35:43.725 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient: _finish_hunting 0 2024-09-12T00:35:43.725 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:35:43.229+0000 7ff615a4a640 1 monclient: found mon.noname-c 2024-09-12T00:35:43.725 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.726 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.726 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:43.726 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: dump: 2024-09-12T00:35:43.726 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.726 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.726 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.726 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.726 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.726 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.726 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.726 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.726 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.726 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.726 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: _finish_auth 0 2024-09-12T00:35:43.726 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: _check_auth_tickets 2024-09-12T00:35:43.727 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:43.727 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.727 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:43.727 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: dump: 2024-09-12T00:35:43.727 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.727 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.727 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.727 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.727 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.727 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.727 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.727 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.727 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.727 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.727 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:35:43.230+0000 7ff622528800 5 monclient: authenticate success, global_id 7361 2024-09-12T00:35:43.728 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:35:43.230+0000 7ff501ffb640 4 set_mon_vals no callback set 2024-09-12T00:35:43.728 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:35:43.230+0000 7ff622528800 10 monclient: _renew_subs 2024-09-12T00:35:43.728 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:35:43.230+0000 7ff622528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.728 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:35:43.230+0000 7ff622528800 10 monclient: _renew_subs 2024-09-12T00:35:43.728 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:35:43.230+0000 7ff622528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.728 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:35:43.230+0000 7ff622528800 1 librados: init done 2024-09-12T00:35:43.728 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:35:43.230+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command cr dump hook 0x55a6be5d4978 2024-09-12T00:35:43.728 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:35:43.231+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.728 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:35:43.232+0000 7ff4effff640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:35:43.728 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:35:43.232+0000 7ff4effff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:43.728 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:35:43.232+0000 7ff4effff640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:43.728 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:35:43.232+0000 7ff61ea4c640 10 monclient: get_auth_request con 0x7ff4e8076470 auth_method 0 2024-09-12T00:35:43.728 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:35:43.232+0000 7ff61e24b640 10 monclient: get_auth_request con 0x55a6be5ff550 auth_method 0 2024-09-12T00:35:43.728 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:35:43.233+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.728 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:35:43.233+0000 7ff622528800 20 realm 2024-09-12T00:35:43.729 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:35:43.233+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.729 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:35:43.233+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.729 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:35:43.233+0000 7ff622528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:43.729 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:35:43.233+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.729 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:35:43.233+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.729 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:35:43.233+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.729 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:35:43.233+0000 7ff615a4a640 10 monclient: get_auth_request con 0x55a6be603780 auth_method 0 2024-09-12T00:35:43.729 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:35:43.234+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:43.729 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:35:43.234+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.729 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:35:43.234+0000 7ff61ea4c640 10 monclient: get_auth_request con 0x55a6be606fe0 auth_method 0 2024-09-12T00:35:43.729 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:35:43.235+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:43.729 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:35:43.235+0000 7ff622528800 20 searching for the correct realm 2024-09-12T00:35:43.729 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:35:43.235+0000 7ff61e24b640 10 monclient: get_auth_request con 0x7ff61806a040 auth_method 0 2024-09-12T00:35:43.729 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:35:43.236+0000 7ff615a4a640 0 -- 172.21.15.133:0/542334586 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff60807d040 msgr2=0x7ff60804e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:43.730 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:35:43.236+0000 7ff615a4a640 10 monclient: get_auth_request con 0x7ff60807d040 auth_method 0 2024-09-12T00:35:43.730 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:35:43.437+0000 7ff615a4a640 10 monclient: get_auth_request con 0x7ff60807d040 auth_method 0 2024-09-12T00:35:43.730 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:35:43.438+0000 7ff61ea4c640 10 monclient: get_auth_request con 0x7ff618082340 auth_method 0 2024-09-12T00:35:43.730 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:35:43.440+0000 7ff61e24b640 10 monclient: get_auth_request con 0x7ff6080d1040 auth_method 0 2024-09-12T00:35:43.730 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:35:43.440+0000 7ff615a4a640 0 -- 172.21.15.133:0/542334586 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff610045470 msgr2=0x7ff6100458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:43.730 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:35:43.642+0000 7ff615a4a640 10 monclient: get_auth_request con 0x7ff610045470 auth_method 0 2024-09-12T00:35:43.730 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:43.730 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:43.730 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:43.730 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:43.730 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:43.730 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:43.730 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:35:43.647+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.730 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:35:43.647+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.730 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:35:43.647+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:35:43.648+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:35:43.648+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:35:43.648+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:35:43.648+0000 7ff622528800 20 zone default found 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:35:43.648+0000 7ff622528800 4 Realm: () 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:35:43.648+0000 7ff622528800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:35:43.648+0000 7ff622528800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:35:43.648+0000 7ff622528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:35:43.648+0000 7ff622528800 20 zonegroup default 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:35:43.648+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:35:43.648+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:35:43.648+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:35:43.649+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:35:43.649+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:35:43.649+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.731 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:35:43.649+0000 7ff622528800 20 started sync module instance, tier type = 2024-09-12T00:35:43.732 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:35:43.649+0000 7ff622528800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:43.732 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=0 2024-09-12T00:35:43.732 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=1 2024-09-12T00:35:43.732 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=2 2024-09-12T00:35:43.732 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=3 2024-09-12T00:35:43.732 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=4 2024-09-12T00:35:43.732 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=5 2024-09-12T00:35:43.732 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=6 2024-09-12T00:35:43.732 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:35:43.659+0000 7ff622528800 20 add_watcher() i=7 2024-09-12T00:35:43.732 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:35:43.659+0000 7ff622528800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:43.732 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:35:43.660+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding auth protocol: cephx 2024-09-12T00:35:43.732 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:35:43.660+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding auth protocol: cephx 2024-09-12T00:35:43.732 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:35:43.660+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding auth protocol: cephx 2024-09-12T00:35:43.733 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:35:43.660+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: secure 2024-09-12T00:35:43.733 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:35:43.660+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: crc 2024-09-12T00:35:43.733 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: secure 2024-09-12T00:35:43.733 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: crc 2024-09-12T00:35:43.733 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: secure 2024-09-12T00:35:43.733 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: crc 2024-09-12T00:35:43.733 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: crc 2024-09-12T00:35:43.733 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: secure 2024-09-12T00:35:43.733 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:35:43.660+0000 7ff4d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:43.733 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: crc 2024-09-12T00:35:43.733 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: secure 2024-09-12T00:35:43.733 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: crc 2024-09-12T00:35:43.733 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: secure 2024-09-12T00:35:43.733 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:35:43.661+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.733 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:35:43.661+0000 7ff622528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:43.734 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:35:43.661+0000 7ff622528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:43.734 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command cache list hook 0x55a6be5dbef0 2024-09-12T00:35:43.734 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command cache inspect hook 0x55a6be5dbef0 2024-09-12T00:35:43.734 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command cache erase hook 0x55a6be5dbef0 2024-09-12T00:35:43.734 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command cache zap hook 0x55a6be5dbef0 2024-09-12T00:35:43.734 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:35:43.661+0000 7ff622528800 5 note: GC not initialized 2024-09-12T00:35:43.734 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:35:43.661+0000 7ff44f7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:43.734 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command sync trace show hook 0x7ff608056d50 2024-09-12T00:35:43.734 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command sync trace history hook 0x7ff608056d50 2024-09-12T00:35:43.734 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command sync trace active hook 0x7ff608056d50 2024-09-12T00:35:43.734 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command sync trace active_short hook 0x7ff608056d50 2024-09-12T00:35:43.734 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:35:43.661+0000 7ff622528800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:43.734 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:35:43.661+0000 7ff622528800 20 Filter name: none 2024-09-12T00:35:43.734 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:35:43.661+0000 7ff44d7fa640 20 reqs_thread_entry: start 2024-09-12T00:35:43.734 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:35:43.661+0000 7ff622528800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:35:43.735 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:35:43.661+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.735 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:35:43.662+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:43.735 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:35:43.662+0000 7ff622528800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:35:43.735 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:35:43.662+0000 7ff622528800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:35:43.735 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:35:43.662+0000 7ff622528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 : miss 2024-09-12T00:35:43.735 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:35:43.662+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.735 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:35:43.662+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:35:43.735 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:35:43.662+0000 7ff622528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:35:43.735 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:35:43.662+0000 7ff622528800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:35:43.735 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:35:43.662+0000 7ff622528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:43.735 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:35:43.662+0000 7ff622528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:43.735 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:35:43.662+0000 7ff622528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 2024-09-12T00:35:43.735 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:35:43.666+0000 7ff622528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:35:43.735 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:35:43.666+0000 7ff622528800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:35:43.736 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:35:43.666+0000 7ff622528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:43.736 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:35:43.666+0000 7ff622528800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37, ofs0, ns] 2024-09-12T00:35:43.736 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:35:43.666+0000 7ff5017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497057 cookie 94174646962448 notifier 7361 bl.length()=1007 2024-09-12T00:35:43.736 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:35:43.666+0000 7ff5017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:35:43.736 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:35:43.666+0000 7ff5017fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:35:43.736 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:35:43.666+0000 7ff5017fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:43.736 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:35:43.668+0000 7ff622528800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): orig_sources= new_sources= 2024-09-12T00:35:43.736 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:35:43.668+0000 7ff622528800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): potential sources added=[] removed=[] 2024-09-12T00:35:43.736 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:35:43.668+0000 7ff622528800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): orig_dests= new_dests= 2024-09-12T00:35:43.736 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:35:43.668+0000 7ff622528800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): potential dests added=[] removed=[] 2024-09-12T00:35:43.736 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:35:43.670+0000 7ff622528800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff622528800 time 2024-09-12T00:35:43.671456+0000 2024-09-12T00:35:43.736 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:43.736 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.736 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:43.737 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff623d8c71a] 2024-09-12T00:35:43.737 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff623d8c8d8] 2024-09-12T00:35:43.737 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6bc973641] 2024-09-12T00:35:43.737 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd8854c) [0x55a6bce8654c] 2024-09-12T00:35:43.737 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6bc98331d] 2024-09-12T00:35:43.737 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:35:43.737 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff622a29590] 2024-09-12T00:35:43.737 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:35:43.737 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:35:43.737 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.737 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:35:43.671+0000 7ff622528800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:43.737 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7ff622528800 thread_name:radosgw-admin 2024-09-12T00:35:43.737 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.737 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:43.737 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff622a3e6f0] 2024-09-12T00:35:43.738 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff622a8b99c] 2024-09-12T00:35:43.738 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:35:43.738 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:35:43.738 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff623d8c774] 2024-09-12T00:35:43.738 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff623d8c8d8] 2024-09-12T00:35:43.738 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6bc973641] 2024-09-12T00:35:43.738 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd8854c) [0x55a6bce8654c] 2024-09-12T00:35:43.738 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6bc98331d] 2024-09-12T00:35:43.738 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:35:43.738 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff622a29590] 2024-09-12T00:35:43.738 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:35:43.738 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:35:43.738 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:43.738 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.739 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:35:43.739 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:35:43.739 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:35:43.739 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:35:43.739 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:35:43.739 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:35:43.739 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:35:43.739 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:35:43.739 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:35:43.739 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:35:43.739 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:35:43.739 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:35:43.739 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:35:43.739 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:35:43.739 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:35:43.740 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:35:43.741 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:35:43.741 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:35:43.741 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:35:43.741 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:35:43.741 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:35:43.741 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:35:43.741 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:35:43.741 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:35:43.741 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:35:43.741 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:35:43.741 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:35:43.741 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:35:43.741 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:35:43.741 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:35:43.742 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:35:43.742 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:35:43.742 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:35:43.742 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:35:43.742 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:35:43.742 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:35:43.742 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:35:43.742 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:35:43.742 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:35:43.742 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:35:43.742 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:35:43.742 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:35:43.742 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:35:43.742 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:35:43.742 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:35:43.743 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:35:43.743 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:35:43.743 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:35:43.743 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:35:43.743 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:35:43.743 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:35:43.743 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:35:43.743 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:35:43.743 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:35:43.743 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:35:43.743 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:35:43.743 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:35:43.743 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:35:43.743 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:35:43.743 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:35:43.744 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:35:43.744 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:35:43.744 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:35:43.744 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:35:43.744 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:35:43.744 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:35:43.744 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:35:43.744 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:35:43.744 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:35:43.744 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:35:43.744 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:35:43.744 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:35:43.744 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:35:43.744 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:35:43.744 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:35:43.745 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:35:43.745 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:35:43.745 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:35:43.745 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:35:43.745 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff44d7fa640 / http_manager 2024-09-12T00:35:43.745 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff44f7fe640 / http_manager 2024-09-12T00:35:43.745 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff4d4fe1640 / rgw_dt_lg_renew 2024-09-12T00:35:43.745 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff4effff640 / ms_dispatch 2024-09-12T00:35:43.745 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff5017fa640 / io_context_pool 2024-09-12T00:35:43.745 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff501ffb640 / io_context_pool 2024-09-12T00:35:43.745 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff503fff640 / ms_dispatch 2024-09-12T00:35:43.745 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff50ae05640 / ms_dispatch 2024-09-12T00:35:43.745 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff50c608640 / io_context_pool 2024-09-12T00:35:43.746 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff615a4a640 / msgr-worker-2 2024-09-12T00:35:43.746 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff61e24b640 / msgr-worker-1 2024-09-12T00:35:43.746 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff61ea4c640 / msgr-worker-0 2024-09-12T00:35:43.746 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff61f24d640 / io_context_pool 2024-09-12T00:35:43.746 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff622528800 / radosgw-admin 2024-09-12T00:35:43.746 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:35:43.746 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:35:43.746 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/log/ceph/ceph-client.admin.136508.log 2024-09-12T00:35:43.746 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:35:43.746 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:35:43.746 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:35:43.215+0000 7ff622528800 5 asok(0x55a6be2ef630) unregister_commands rotate-key 2024-09-12T00:35:43.746 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:35:43.215+0000 7ff622528800 10 monclient: build_initial_monmap 2024-09-12T00:35:43.746 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:35:43.215+0000 7ff622528800 1 build_initial for_mkfs: 0 2024-09-12T00:35:43.746 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:35:43.215+0000 7ff622528800 10 monclient: monmap: 2024-09-12T00:35:43.746 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:43.747 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:43.747 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:43.747 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:43.747 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:43.747 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.747 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:43.747 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:43.747 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:43.747 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.747 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding auth protocol: cephx 2024-09-12T00:35:43.747 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding auth protocol: cephx 2024-09-12T00:35:43.747 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding auth protocol: cephx 2024-09-12T00:35:43.747 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: secure 2024-09-12T00:35:43.747 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: crc 2024-09-12T00:35:43.747 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: secure 2024-09-12T00:35:43.748 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: crc 2024-09-12T00:35:43.748 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: secure 2024-09-12T00:35:43.748 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: crc 2024-09-12T00:35:43.748 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: crc 2024-09-12T00:35:43.748 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: secure 2024-09-12T00:35:43.748 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: crc 2024-09-12T00:35:43.748 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: secure 2024-09-12T00:35:43.748 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: crc 2024-09-12T00:35:43.748 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:35:43.215+0000 7ff622528800 5 AuthRegistry(0x55a6be5176f0) adding con mode: secure 2024-09-12T00:35:43.748 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:35:43.216+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.748 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:35:43.216+0000 7ff622528800 1 librados: starting msgr at 2024-09-12T00:35:43.748 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:35:43.216+0000 7ff622528800 1 librados: starting objecter 2024-09-12T00:35:43.748 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:35:43.216+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command objecter_requests hook 0x55a6be513ed0 2024-09-12T00:35:43.748 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:35:43.216+0000 7ff622528800 1 librados: setting wanted keys 2024-09-12T00:35:43.748 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:35:43.216+0000 7ff622528800 1 librados: calling monclient init 2024-09-12T00:35:43.749 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient: init 2024-09-12T00:35:43.749 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding auth protocol: cephx 2024-09-12T00:35:43.749 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding auth protocol: cephx 2024-09-12T00:35:43.749 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding auth protocol: cephx 2024-09-12T00:35:43.749 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: secure 2024-09-12T00:35:43.749 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: crc 2024-09-12T00:35:43.749 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: secure 2024-09-12T00:35:43.749 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: crc 2024-09-12T00:35:43.749 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: secure 2024-09-12T00:35:43.749 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: crc 2024-09-12T00:35:43.749 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: crc 2024-09-12T00:35:43.749 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: secure 2024-09-12T00:35:43.749 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: crc 2024-09-12T00:35:43.749 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: secure 2024-09-12T00:35:43.749 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: crc 2024-09-12T00:35:43.750 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:35:43.216+0000 7ff622528800 5 AuthRegistry(0x55a6be511aa0) adding con mode: secure 2024-09-12T00:35:43.750 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:35:43.216+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.750 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:35:43.216+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.750 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:35:43.216+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command rotate-key hook 0x55a6be511be8 2024-09-12T00:35:43.750 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:43.750 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:35:43.750 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): picked mon.noname-b con 0x55a6be3c90d0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:43.750 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): picked mon.noname-a con 0x55a6be454f50 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:43.750 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): picked mon.noname-c con 0x55a6be45b910 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:43.750 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.750 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.750 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.750 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:43.750 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:35:43.216+0000 7ff622528800 10 monclient(hunting): authenticate will time out at 2151.789824s 2024-09-12T00:35:43.750 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:35:43.216+0000 7ff615a4a640 10 monclient(hunting): get_auth_request con 0x55a6be454f50 auth_method 0 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:35:43.216+0000 7ff615a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:35:43.216+0000 7ff615a4a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:35:43.216+0000 7ff615a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:35:43.216+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request con 0x55a6be45b910 auth_method 0 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:35:43.216+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:35:43.216+0000 7ff61ea4c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:35:43.216+0000 7ff61ea4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:35:43.216+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:35:43.216+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:35:43.216+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:35:43.217+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:35:43.217+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:35:43.217+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:35:43.217+0000 7ff61e24b640 10 monclient(hunting): get_auth_request con 0x55a6be3c90d0 auth_method 0 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:35:43.217+0000 7ff61e24b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.751 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:35:43.217+0000 7ff61e24b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.752 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:35:43.217+0000 7ff61e24b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.752 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:35:43.217+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.752 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:35:43.217+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.752 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:35:43.217+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.752 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:35:43.217+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_done global_id 7352 payload 824 2024-09-12T00:35:43.752 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:35:43.217+0000 7ff61ea4c640 10 monclient: _finish_hunting 0 2024-09-12T00:35:43.752 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:35:43.217+0000 7ff61ea4c640 1 monclient: found mon.noname-c 2024-09-12T00:35:43.752 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:35:43.217+0000 7ff61ea4c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.752 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.752 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:43.752 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: dump: 2024-09-12T00:35:43.752 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.752 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.752 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.753 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.753 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.753 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.753 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.753 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.753 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.753 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.753 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: _finish_auth 0 2024-09-12T00:35:43.753 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: _check_auth_tickets 2024-09-12T00:35:43.753 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:43.753 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.753 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:43.753 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:35:43.217+0000 7ff50ae05640 10 monclient: dump: 2024-09-12T00:35:43.754 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.754 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.754 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.754 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.754 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.754 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.754 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.754 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.754 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.754 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.754 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:35:43.217+0000 7ff622528800 5 monclient: authenticate success, global_id 7352 2024-09-12T00:35:43.754 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:35:43.217+0000 7ff622528800 10 monclient: _renew_subs 2024-09-12T00:35:43.754 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:35:43.217+0000 7ff622528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.754 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:35:43.217+0000 7ff50c608640 4 set_mon_vals no callback set 2024-09-12T00:35:43.754 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:35:43.217+0000 7ff622528800 10 monclient: _renew_subs 2024-09-12T00:35:43.755 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:35:43.217+0000 7ff622528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.755 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:35:43.217+0000 7ff622528800 1 librados: init done 2024-09-12T00:35:43.755 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:35:43.219+0000 7ff50ae05640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:35:43.755 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:35:43.219+0000 7ff50ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:43.755 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:35:43.219+0000 7ff50ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:43.755 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:35:43.219+0000 7ff61e24b640 10 monclient: get_auth_request con 0x7ff504076470 auth_method 0 2024-09-12T00:35:43.755 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:35:43.219+0000 7ff615a4a640 10 monclient: get_auth_request con 0x55a6be53aa70 auth_method 0 2024-09-12T00:35:43.755 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:35:43.220+0000 7ff61e24b640 10 monclient: get_auth_request con 0x55a6be55d3d0 auth_method 0 2024-09-12T00:35:43.755 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:35:43.221+0000 7ff615a4a640 10 monclient: get_auth_request con 0x55a6be5615c0 auth_method 0 2024-09-12T00:35:43.755 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:35:43.222+0000 7ff61ea4c640 10 monclient: get_auth_request con 0x55a6be560cb0 auth_method 0 2024-09-12T00:35:43.755 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:35:43.222+0000 7ff622528800 10 monclient: build_initial_monmap 2024-09-12T00:35:43.756 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:35:43.222+0000 7ff622528800 1 build_initial for_mkfs: 0 2024-09-12T00:35:43.756 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:35:43.222+0000 7ff622528800 10 monclient: monmap: 2024-09-12T00:35:43.756 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:43.756 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:43.756 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:43.756 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:43.756 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:43.756 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.756 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:43.756 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:43.756 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:43.756 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.756 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding auth protocol: cephx 2024-09-12T00:35:43.756 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding auth protocol: cephx 2024-09-12T00:35:43.757 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding auth protocol: cephx 2024-09-12T00:35:43.757 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: secure 2024-09-12T00:35:43.757 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: crc 2024-09-12T00:35:43.757 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: secure 2024-09-12T00:35:43.757 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: crc 2024-09-12T00:35:43.757 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: secure 2024-09-12T00:35:43.757 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: crc 2024-09-12T00:35:43.757 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: crc 2024-09-12T00:35:43.757 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: secure 2024-09-12T00:35:43.757 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: crc 2024-09-12T00:35:43.757 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: secure 2024-09-12T00:35:43.757 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: crc 2024-09-12T00:35:43.757 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:35:43.222+0000 7ff622528800 5 AuthRegistry(0x55a6be5697b0) adding con mode: secure 2024-09-12T00:35:43.757 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:35:43.223+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.758 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:35:43.223+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command objecter_requests cmddesc objecter_requests hook 0x55a6be56d1a0 EEXIST 2024-09-12T00:35:43.758 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient: init 2024-09-12T00:35:43.758 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding auth protocol: cephx 2024-09-12T00:35:43.758 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding auth protocol: cephx 2024-09-12T00:35:43.758 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding auth protocol: cephx 2024-09-12T00:35:43.758 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: secure 2024-09-12T00:35:43.758 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: crc 2024-09-12T00:35:43.758 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: secure 2024-09-12T00:35:43.758 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: crc 2024-09-12T00:35:43.758 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: secure 2024-09-12T00:35:43.758 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: crc 2024-09-12T00:35:43.758 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: crc 2024-09-12T00:35:43.758 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: secure 2024-09-12T00:35:43.758 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: crc 2024-09-12T00:35:43.758 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: secure 2024-09-12T00:35:43.759 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: crc 2024-09-12T00:35:43.759 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:35:43.223+0000 7ff622528800 5 AuthRegistry(0x55a6be5686a8) adding con mode: secure 2024-09-12T00:35:43.759 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:35:43.223+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.759 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:35:43.223+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.759 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:35:43.223+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command rotate-key cmddesc rotate-key hook 0x55a6be5687f0 EEXIST 2024-09-12T00:35:43.759 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:43.759 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:35:43.759 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): picked mon.noname-b con 0x55a6be590e90 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:43.759 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): picked mon.noname-c con 0x55a6be593160 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:43.759 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): picked mon.noname-a con 0x55a6be58f660 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:43.759 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.759 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.759 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.759 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:43.759 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:35:43.223+0000 7ff622528800 10 monclient(hunting): authenticate will time out at 2151.796848s 2024-09-12T00:35:43.760 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:35:43.223+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request con 0x55a6be593160 auth_method 0 2024-09-12T00:35:43.760 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:35:43.223+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.760 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:35:43.223+0000 7ff61ea4c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.760 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:35:43.223+0000 7ff61ea4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.760 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:35:43.223+0000 7ff61e24b640 10 monclient(hunting): get_auth_request con 0x55a6be58f660 auth_method 0 2024-09-12T00:35:43.760 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:35:43.223+0000 7ff61e24b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.760 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:35:43.223+0000 7ff61e24b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.760 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:35:43.223+0000 7ff61e24b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.760 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:35:43.223+0000 7ff615a4a640 10 monclient(hunting): get_auth_request con 0x55a6be590e90 auth_method 0 2024-09-12T00:35:43.760 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:35:43.224+0000 7ff615a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.760 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:35:43.224+0000 7ff615a4a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.760 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:35:43.224+0000 7ff615a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.760 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:35:43.224+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.760 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:35:43.224+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.761 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:35:43.224+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.761 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:35:43.224+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.761 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:35:43.224+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.761 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:35:43.224+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.761 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:35:43.224+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.761 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:35:43.224+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.761 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:35:43.224+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.761 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:35:43.224+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_done global_id 7355 payload 824 2024-09-12T00:35:43.761 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:35:43.224+0000 7ff61ea4c640 10 monclient: _finish_hunting 0 2024-09-12T00:35:43.761 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:35:43.224+0000 7ff61ea4c640 1 monclient: found mon.noname-c 2024-09-12T00:35:43.761 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:35:43.224+0000 7ff61ea4c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.761 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.761 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:43.761 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: dump: 2024-09-12T00:35:43.762 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.762 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.762 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.762 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.762 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.762 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.762 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.762 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.762 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.762 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.762 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: _finish_auth 0 2024-09-12T00:35:43.762 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: _check_auth_tickets 2024-09-12T00:35:43.762 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:35:43.224+0000 7ff622528800 5 monclient: authenticate success, global_id 7355 2024-09-12T00:35:43.762 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:43.763 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.763 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:43.763 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:35:43.224+0000 7ff503fff640 10 monclient: dump: 2024-09-12T00:35:43.763 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.763 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.763 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.763 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.763 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.763 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.763 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.763 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.763 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.763 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.763 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:35:43.224+0000 7ff622528800 10 monclient: _renew_subs 2024-09-12T00:35:43.764 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:35:43.224+0000 7ff622528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.764 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:35:43.224+0000 7ff61f24d640 4 set_mon_vals no callback set 2024-09-12T00:35:43.764 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:35:43.224+0000 7ff622528800 10 monclient: _renew_subs 2024-09-12T00:35:43.764 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:35:43.224+0000 7ff622528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.764 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:35:43.226+0000 7ff503fff640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:35:43.764 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:35:43.226+0000 7ff503fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:43.764 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:35:43.226+0000 7ff503fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:43.764 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:35:43.226+0000 7ff615a4a640 10 monclient: get_auth_request con 0x7ff4f8076380 auth_method 0 2024-09-12T00:35:43.764 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:35:43.226+0000 7ff622528800 10 monclient: get_monmap_and_config 2024-09-12T00:35:43.764 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:35:43.226+0000 7ff622528800 10 monclient: build_initial_monmap 2024-09-12T00:35:43.764 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:35:43.226+0000 7ff622528800 1 build_initial for_mkfs: 0 2024-09-12T00:35:43.764 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:35:43.226+0000 7ff622528800 10 monclient: monmap: 2024-09-12T00:35:43.764 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:43.765 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:43.765 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:43.765 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:43.765 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:43.765 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.765 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:43.765 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:43.765 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:43.765 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.765 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding auth protocol: cephx 2024-09-12T00:35:43.765 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding auth protocol: cephx 2024-09-12T00:35:43.765 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding auth protocol: cephx 2024-09-12T00:35:43.765 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: secure 2024-09-12T00:35:43.765 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: crc 2024-09-12T00:35:43.766 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: secure 2024-09-12T00:35:43.766 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: crc 2024-09-12T00:35:43.766 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: secure 2024-09-12T00:35:43.766 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: crc 2024-09-12T00:35:43.766 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: crc 2024-09-12T00:35:43.766 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: secure 2024-09-12T00:35:43.766 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: crc 2024-09-12T00:35:43.766 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: secure 2024-09-12T00:35:43.766 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: crc 2024-09-12T00:35:43.766 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x55a6be5b0ae0) adding con mode: secure 2024-09-12T00:35:43.766 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:35:43.226+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.766 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:35:43.226+0000 7ff622528800 10 monclient: init 2024-09-12T00:35:43.766 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding auth protocol: cephx 2024-09-12T00:35:43.766 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding auth protocol: cephx 2024-09-12T00:35:43.766 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding auth protocol: cephx 2024-09-12T00:35:43.767 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: secure 2024-09-12T00:35:43.767 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: crc 2024-09-12T00:35:43.767 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: secure 2024-09-12T00:35:43.767 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: crc 2024-09-12T00:35:43.767 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: secure 2024-09-12T00:35:43.767 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: crc 2024-09-12T00:35:43.767 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: crc 2024-09-12T00:35:43.767 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: secure 2024-09-12T00:35:43.767 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: crc 2024-09-12T00:35:43.767 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: secure 2024-09-12T00:35:43.767 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: crc 2024-09-12T00:35:43.767 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:35:43.226+0000 7ff622528800 5 AuthRegistry(0x7ffef54db6f0) adding con mode: secure 2024-09-12T00:35:43.767 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:35:43.227+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.767 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:35:43.227+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.768 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:35:43.227+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command rotate-key cmddesc rotate-key hook 0x7ffef54db838 EEXIST 2024-09-12T00:35:43.768 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:43.768 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:35:43.768 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): picked mon.noname-a con 0x55a6be5e5080 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:43.768 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): picked mon.noname-c con 0x55a6be5df620 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:43.768 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): picked mon.noname-b con 0x55a6be5b4ec0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:43.768 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.768 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.768 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.768 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:43.768 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:35:43.227+0000 7ff622528800 10 monclient(hunting): authenticate will time out at 2151.800357s 2024-09-12T00:35:43.768 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): get_auth_request con 0x55a6be5e5080 auth_method 0 2024-09-12T00:35:43.768 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.768 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.769 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.769 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:35:43.227+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request con 0x55a6be5df620 auth_method 0 2024-09-12T00:35:43.769 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:35:43.227+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.769 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:35:43.227+0000 7ff61ea4c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.769 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:35:43.227+0000 7ff61ea4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.769 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.769 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.769 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.769 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:35:43.227+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.769 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:35:43.227+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.769 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:35:43.227+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.769 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:35:43.227+0000 7ff61e24b640 10 monclient(hunting): get_auth_request con 0x55a6be5b4ec0 auth_method 0 2024-09-12T00:35:43.769 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:35:43.227+0000 7ff61e24b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.769 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:35:43.227+0000 7ff61e24b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.770 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:35:43.227+0000 7ff61e24b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.770 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:35:43.227+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.770 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:35:43.227+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.770 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:35:43.227+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.770 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient(hunting): handle_auth_done global_id 7851 payload 274 2024-09-12T00:35:43.770 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient: _finish_hunting 0 2024-09-12T00:35:43.770 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:35:43.227+0000 7ff615a4a640 1 monclient: found mon.noname-a 2024-09-12T00:35:43.770 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:35:43.227+0000 7ff615a4a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:35:43.770 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:35:43.227+0000 7ff501ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.770 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:35:43.227+0000 7ff501ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:43.770 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:35:43.227+0000 7ff501ffb640 10 monclient: dump: 2024-09-12T00:35:43.770 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.770 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.770 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.771 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.771 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.771 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.771 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.771 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.771 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.771 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.771 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:35:43.227+0000 7ff501ffb640 10 monclient: _finish_auth 0 2024-09-12T00:35:43.771 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:35:43.227+0000 7ff501ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:35:43.771 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:35:43.227+0000 7ff501ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:43.771 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:35:43.227+0000 7ff501ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.771 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:35:43.228+0000 7ff501ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:43.771 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:35:43.228+0000 7ff501ffb640 10 monclient: dump: 2024-09-12T00:35:43.771 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:35:43.228+0000 7ff622528800 5 monclient: authenticate success, global_id 7851 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:35:43.228+0000 7ff622528800 10 monclient: get_monmap_and_config success 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:35:43.228+0000 7ff622528800 4 set_mon_vals no callback set 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:35:43.228+0000 7ff622528800 10 monclient: shutdown 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:35:43.228+0000 7ff622528800 10 monclient: build_initial_monmap 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:35:43.228+0000 7ff622528800 1 build_initial for_mkfs: 0 2024-09-12T00:35:43.772 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:35:43.228+0000 7ff622528800 10 monclient: monmap: 2024-09-12T00:35:43.773 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:35:43.773 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:43.773 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:35:43.773 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:35:43.773 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:43.773 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.773 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:35:43.773 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:35:43.773 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:35:43.773 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.773 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding auth protocol: cephx 2024-09-12T00:35:43.773 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding auth protocol: cephx 2024-09-12T00:35:43.773 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding auth protocol: cephx 2024-09-12T00:35:43.773 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: secure 2024-09-12T00:35:43.774 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: crc 2024-09-12T00:35:43.774 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: secure 2024-09-12T00:35:43.774 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: crc 2024-09-12T00:35:43.774 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: secure 2024-09-12T00:35:43.774 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: crc 2024-09-12T00:35:43.774 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: crc 2024-09-12T00:35:43.774 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: secure 2024-09-12T00:35:43.774 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: crc 2024-09-12T00:35:43.774 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: secure 2024-09-12T00:35:43.774 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: crc 2024-09-12T00:35:43.774 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:35:43.228+0000 7ff622528800 5 AuthRegistry(0x55a6be5d7830) adding con mode: secure 2024-09-12T00:35:43.774 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:35:43.228+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.774 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:35:43.228+0000 7ff622528800 1 librados: starting msgr at 2024-09-12T00:35:43.774 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:35:43.228+0000 7ff622528800 1 librados: starting objecter 2024-09-12T00:35:43.774 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:35:43.229+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command objecter_requests cmddesc objecter_requests hook 0x55a6be5def00 EEXIST 2024-09-12T00:35:43.775 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:35:43.229+0000 7ff622528800 1 librados: setting wanted keys 2024-09-12T00:35:43.775 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:35:43.229+0000 7ff622528800 1 librados: calling monclient init 2024-09-12T00:35:43.775 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient: init 2024-09-12T00:35:43.775 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding auth protocol: cephx 2024-09-12T00:35:43.775 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding auth protocol: cephx 2024-09-12T00:35:43.775 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding auth protocol: cephx 2024-09-12T00:35:43.775 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: secure 2024-09-12T00:35:43.775 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: crc 2024-09-12T00:35:43.775 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: secure 2024-09-12T00:35:43.775 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: crc 2024-09-12T00:35:43.775 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: secure 2024-09-12T00:35:43.775 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: crc 2024-09-12T00:35:43.775 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: crc 2024-09-12T00:35:43.775 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: secure 2024-09-12T00:35:43.776 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: crc 2024-09-12T00:35:43.776 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: secure 2024-09-12T00:35:43.776 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: crc 2024-09-12T00:35:43.776 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:35:43.229+0000 7ff622528800 5 AuthRegistry(0x55a6be5a8c40) adding con mode: secure 2024-09-12T00:35:43.776 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:35:43.229+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.776 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:35:43.229+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.776 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:35:43.229+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command rotate-key cmddesc rotate-key hook 0x55a6be5a8d88 EEXIST 2024-09-12T00:35:43.776 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient: _reopen_session rank -1 2024-09-12T00:35:43.776 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:35:43.776 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): picked mon.noname-c con 0x55a6be5b4ec0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:35:43.776 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): picked mon.noname-a con 0x55a6be5df620 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:35:43.776 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): picked mon.noname-b con 0x55a6be5e5080 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:35:43.776 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.776 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.776 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:43.777 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): _renew_subs 2024-09-12T00:35:43.777 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:35:43.229+0000 7ff622528800 10 monclient(hunting): authenticate will time out at 2151.802636s 2024-09-12T00:35:43.777 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): get_auth_request con 0x55a6be5b4ec0 auth_method 0 2024-09-12T00:35:43.777 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.777 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.777 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.777 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:35:43.229+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request con 0x55a6be5df620 auth_method 0 2024-09-12T00:35:43.777 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:35:43.229+0000 7ff61ea4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.777 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:35:43.229+0000 7ff61ea4c640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.777 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:35:43.229+0000 7ff61ea4c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.777 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:35:43.229+0000 7ff61e24b640 10 monclient(hunting): get_auth_request con 0x55a6be5e5080 auth_method 0 2024-09-12T00:35:43.777 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:35:43.229+0000 7ff61e24b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:43.777 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:35:43.229+0000 7ff61e24b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:43.777 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:35:43.229+0000 7ff61e24b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:43.777 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.778 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.778 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.778 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:35:43.229+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.778 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:35:43.229+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.778 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:35:43.229+0000 7ff61ea4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.778 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:35:43.229+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:43.778 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:35:43.229+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:43.778 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:35:43.229+0000 7ff61e24b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:43.778 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient(hunting): handle_auth_done global_id 7361 payload 824 2024-09-12T00:35:43.778 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient: _finish_hunting 0 2024-09-12T00:35:43.778 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:35:43.229+0000 7ff615a4a640 1 monclient: found mon.noname-c 2024-09-12T00:35:43.778 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:35:43.229+0000 7ff615a4a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.778 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.778 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:43.778 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: dump: 2024-09-12T00:35:43.779 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.779 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.779 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.779 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.779 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.779 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.779 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.779 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.779 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.779 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.779 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: _finish_auth 0 2024-09-12T00:35:43.779 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: _check_auth_tickets 2024-09-12T00:35:43.779 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:43.779 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:43.780 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:43.780 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:35:43.230+0000 7ff4effff640 10 monclient: dump: 2024-09-12T00:35:43.780 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:35:43.780 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:35:43.780 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.780 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:35:43.780 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:43.780 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:35:43.780 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:35:43.780 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:35:43.780 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:35:43.780 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.780 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:35:43.230+0000 7ff622528800 5 monclient: authenticate success, global_id 7361 2024-09-12T00:35:43.780 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:35:43.230+0000 7ff501ffb640 4 set_mon_vals no callback set 2024-09-12T00:35:43.781 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:35:43.230+0000 7ff622528800 10 monclient: _renew_subs 2024-09-12T00:35:43.781 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:35:43.230+0000 7ff622528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.781 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:35:43.230+0000 7ff622528800 10 monclient: _renew_subs 2024-09-12T00:35:43.781 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:35:43.230+0000 7ff622528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:35:43.781 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:35:43.230+0000 7ff622528800 1 librados: init done 2024-09-12T00:35:43.781 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:35:43.230+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command cr dump hook 0x55a6be5d4978 2024-09-12T00:35:43.781 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:35:43.231+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.781 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:35:43.232+0000 7ff4effff640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:35:43.781 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:35:43.232+0000 7ff4effff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:43.781 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:35:43.232+0000 7ff4effff640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:35:43.781 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:35:43.232+0000 7ff61ea4c640 10 monclient: get_auth_request con 0x7ff4e8076470 auth_method 0 2024-09-12T00:35:43.781 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:35:43.232+0000 7ff61e24b640 10 monclient: get_auth_request con 0x55a6be5ff550 auth_method 0 2024-09-12T00:35:43.781 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:35:43.233+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.781 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:35:43.233+0000 7ff622528800 20 realm 2024-09-12T00:35:43.782 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:35:43.233+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.782 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:35:43.233+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.782 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:35:43.233+0000 7ff622528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:43.782 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:35:43.233+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.782 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:35:43.233+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.782 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:35:43.233+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.782 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:35:43.233+0000 7ff615a4a640 10 monclient: get_auth_request con 0x55a6be603780 auth_method 0 2024-09-12T00:35:43.782 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:35:43.234+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:43.782 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:35:43.234+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.782 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:35:43.234+0000 7ff61ea4c640 10 monclient: get_auth_request con 0x55a6be606fe0 auth_method 0 2024-09-12T00:35:43.782 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:35:43.235+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:43.782 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:35:43.235+0000 7ff622528800 20 searching for the correct realm 2024-09-12T00:35:43.782 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:35:43.235+0000 7ff61e24b640 10 monclient: get_auth_request con 0x7ff61806a040 auth_method 0 2024-09-12T00:35:43.782 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:35:43.236+0000 7ff615a4a640 0 -- 172.21.15.133:0/542334586 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff60807d040 msgr2=0x7ff60804e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:43.782 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:35:43.236+0000 7ff615a4a640 10 monclient: get_auth_request con 0x7ff60807d040 auth_method 0 2024-09-12T00:35:43.783 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:35:43.437+0000 7ff615a4a640 10 monclient: get_auth_request con 0x7ff60807d040 auth_method 0 2024-09-12T00:35:43.783 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:35:43.438+0000 7ff61ea4c640 10 monclient: get_auth_request con 0x7ff618082340 auth_method 0 2024-09-12T00:35:43.783 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:35:43.440+0000 7ff61e24b640 10 monclient: get_auth_request con 0x7ff6080d1040 auth_method 0 2024-09-12T00:35:43.783 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:35:43.440+0000 7ff615a4a640 0 -- 172.21.15.133:0/542334586 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff610045470 msgr2=0x7ff6100458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:43.783 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:35:43.642+0000 7ff615a4a640 10 monclient: get_auth_request con 0x7ff610045470 auth_method 0 2024-09-12T00:35:43.783 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:43.783 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:43.783 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:43.783 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:43.783 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:43.783 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:35:43.647+0000 7ff622528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:43.783 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:35:43.647+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.783 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:35:43.647+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.783 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:35:43.647+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.784 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:35:43.648+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:43.784 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:35:43.648+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.784 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:35:43.648+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:43.784 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:35:43.648+0000 7ff622528800 20 zone default found 2024-09-12T00:35:43.784 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:35:43.648+0000 7ff622528800 4 Realm: () 2024-09-12T00:35:43.784 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:35:43.648+0000 7ff622528800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:43.784 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:35:43.648+0000 7ff622528800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:43.784 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:35:43.648+0000 7ff622528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:43.784 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:35:43.648+0000 7ff622528800 20 zonegroup default 2024-09-12T00:35:43.784 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:35:43.648+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.784 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:35:43.648+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.784 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:35:43.648+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.784 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:35:43.649+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.784 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:35:43.649+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.785 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:35:43.649+0000 7ff622528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.785 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:35:43.649+0000 7ff622528800 20 started sync module instance, tier type = 2024-09-12T00:35:43.785 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:35:43.649+0000 7ff622528800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:43.785 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=0 2024-09-12T00:35:43.785 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=1 2024-09-12T00:35:43.785 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=2 2024-09-12T00:35:43.785 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=3 2024-09-12T00:35:43.785 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=4 2024-09-12T00:35:43.785 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=5 2024-09-12T00:35:43.785 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:35:43.658+0000 7ff622528800 20 add_watcher() i=6 2024-09-12T00:35:43.785 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:35:43.659+0000 7ff622528800 20 add_watcher() i=7 2024-09-12T00:35:43.785 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:35:43.659+0000 7ff622528800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:43.785 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:35:43.660+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding auth protocol: cephx 2024-09-12T00:35:43.785 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:35:43.660+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding auth protocol: cephx 2024-09-12T00:35:43.785 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:35:43.660+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding auth protocol: cephx 2024-09-12T00:35:43.786 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:35:43.660+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: secure 2024-09-12T00:35:43.786 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:35:43.660+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: crc 2024-09-12T00:35:43.786 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: secure 2024-09-12T00:35:43.786 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: crc 2024-09-12T00:35:43.786 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: secure 2024-09-12T00:35:43.786 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: crc 2024-09-12T00:35:43.786 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: crc 2024-09-12T00:35:43.786 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: secure 2024-09-12T00:35:43.786 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:35:43.660+0000 7ff4d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:43.786 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: crc 2024-09-12T00:35:43.786 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: secure 2024-09-12T00:35:43.786 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: crc 2024-09-12T00:35:43.786 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:35:43.661+0000 7ff622528800 5 AuthRegistry(0x7ffef54dbbd0) adding con mode: secure 2024-09-12T00:35:43.786 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:35:43.661+0000 7ff622528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:43.786 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:35:43.661+0000 7ff622528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:43.787 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:35:43.661+0000 7ff622528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:43.787 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command cache list hook 0x55a6be5dbef0 2024-09-12T00:35:43.787 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command cache inspect hook 0x55a6be5dbef0 2024-09-12T00:35:43.787 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command cache erase hook 0x55a6be5dbef0 2024-09-12T00:35:43.787 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command cache zap hook 0x55a6be5dbef0 2024-09-12T00:35:43.787 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:35:43.661+0000 7ff622528800 5 note: GC not initialized 2024-09-12T00:35:43.787 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:35:43.661+0000 7ff44f7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:43.787 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command sync trace show hook 0x7ff608056d50 2024-09-12T00:35:43.787 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command sync trace history hook 0x7ff608056d50 2024-09-12T00:35:43.787 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command sync trace active hook 0x7ff608056d50 2024-09-12T00:35:43.787 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:35:43.661+0000 7ff622528800 5 asok(0x55a6be2ef630) register_command sync trace active_short hook 0x7ff608056d50 2024-09-12T00:35:43.787 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:35:43.661+0000 7ff622528800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:43.787 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:35:43.661+0000 7ff622528800 20 Filter name: none 2024-09-12T00:35:43.787 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:35:43.661+0000 7ff44d7fa640 20 reqs_thread_entry: start 2024-09-12T00:35:43.787 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:35:43.661+0000 7ff622528800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:35:43.788 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:35:43.661+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.788 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:35:43.662+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:43.788 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:35:43.662+0000 7ff622528800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:35:43.788 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:35:43.662+0000 7ff622528800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:35:43.788 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:35:43.662+0000 7ff622528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 : miss 2024-09-12T00:35:43.788 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:35:43.662+0000 7ff622528800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.788 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:35:43.662+0000 7ff622528800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:35:43.788 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:35:43.662+0000 7ff622528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:35:43.788 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:35:43.662+0000 7ff622528800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:35:43.788 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:35:43.662+0000 7ff622528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:43.788 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:35:43.662+0000 7ff622528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:43.788 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:35:43.662+0000 7ff622528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 2024-09-12T00:35:43.788 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:35:43.666+0000 7ff622528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:35:43.788 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:35:43.666+0000 7ff622528800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:35:43.789 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:35:43.666+0000 7ff622528800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:43.789 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:35:43.666+0000 7ff622528800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37, ofs0, ns] 2024-09-12T00:35:43.789 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:35:43.666+0000 7ff5017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497057 cookie 94174646962448 notifier 7361 bl.length()=1007 2024-09-12T00:35:43.789 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:35:43.666+0000 7ff5017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:35:43.789 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:35:43.666+0000 7ff5017fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:35:43.789 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:35:43.666+0000 7ff5017fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:43.789 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:35:43.668+0000 7ff622528800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): orig_sources= new_sources= 2024-09-12T00:35:43.789 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:35:43.668+0000 7ff622528800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): potential sources added=[] removed=[] 2024-09-12T00:35:43.789 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:35:43.668+0000 7ff622528800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): orig_dests= new_dests= 2024-09-12T00:35:43.789 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:35:43.668+0000 7ff622528800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): potential dests added=[] removed=[] 2024-09-12T00:35:43.789 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:35:43.670+0000 7ff622528800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff622528800 time 2024-09-12T00:35:43.671456+0000 2024-09-12T00:35:43.789 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:43.789 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.789 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:43.790 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff623d8c71a] 2024-09-12T00:35:43.790 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff623d8c8d8] 2024-09-12T00:35:43.790 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6bc973641] 2024-09-12T00:35:43.790 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd8854c) [0x55a6bce8654c] 2024-09-12T00:35:43.790 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6bc98331d] 2024-09-12T00:35:43.790 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:35:43.790 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ff622a29590] 2024-09-12T00:35:43.790 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:35:43.790 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:35:43.790 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.790 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:35:43.671+0000 7ff622528800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:43.790 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7ff622528800 thread_name:radosgw-admin 2024-09-12T00:35:43.790 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.791 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:43.791 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ff622a3e6f0] 2024-09-12T00:35:43.791 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ff622a8b99c] 2024-09-12T00:35:43.791 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:35:43.791 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:35:43.791 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff623d8c774] 2024-09-12T00:35:43.791 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7ff623d8c8d8] 2024-09-12T00:35:43.791 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6bc973641] 2024-09-12T00:35:43.791 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd8854c) [0x55a6bce8654c] 2024-09-12T00:35:43.791 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6bc98331d] 2024-09-12T00:35:43.791 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:35:43.791 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ff622a29590] 2024-09-12T00:35:43.791 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:35:43.792 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:35:43.793 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:35:43.793 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:35:43.793 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:35:43.793 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:35:43.793 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:35:43.793 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:35:43.793 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:35:43.793 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:35:43.793 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:35:43.793 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:35:43.793 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:35:43.793 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:35:43.793 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:35:43.793 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:35:43.794 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:35:43.794 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:35:43.794 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:35:43.794 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:35:43.794 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:35:43.794 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:35:43.794 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:35:43.794 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:35:43.794 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:35:43.794 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:35:43.794 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:35:43.794 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:35:43.794 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:35:43.794 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:35:43.795 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:35:43.795 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:35:43.795 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:35:43.795 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:35:43.795 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:35:43.795 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:35:43.795 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:35:43.795 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:35:43.795 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:35:43.795 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:35:43.795 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:35:43.795 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:35:43.795 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:35:43.795 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:35:43.796 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:35:43.796 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:35:43.796 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:35:43.796 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:35:43.796 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:35:43.796 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:35:43.796 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:35:43.796 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:35:43.796 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:35:43.796 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:35:43.796 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:35:43.796 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:35:43.796 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:35:43.796 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:35:43.797 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:35:43.797 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:35:43.797 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:35:43.797 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:35:43.797 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:35:43.797 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:35:43.797 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:35:43.797 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:35:43.797 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:35:43.797 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:35:43.797 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:35:43.797 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:35:43.797 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:35:43.797 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:35:43.798 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:35:43.798 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:35:43.798 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:35:43.798 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:35:43.798 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:35:43.798 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:35:43.798 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:35:43.798 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:35:43.798 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:35:43.798 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:35:43.798 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:35:43.798 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff44d7fa640 / http_manager 2024-09-12T00:35:43.798 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff44f7fe640 / http_manager 2024-09-12T00:35:43.798 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff4d4fe1640 / rgw_dt_lg_renew 2024-09-12T00:35:43.799 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff4effff640 / ms_dispatch 2024-09-12T00:35:43.799 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff5017fa640 / io_context_pool 2024-09-12T00:35:43.799 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff501ffb640 / io_context_pool 2024-09-12T00:35:43.799 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff503fff640 / ms_dispatch 2024-09-12T00:35:43.799 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff50ae05640 / ms_dispatch 2024-09-12T00:35:43.799 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff50c608640 / io_context_pool 2024-09-12T00:35:43.799 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff615a4a640 / msgr-worker-2 2024-09-12T00:35:43.799 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff61e24b640 / msgr-worker-1 2024-09-12T00:35:43.799 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff61ea4c640 / msgr-worker-0 2024-09-12T00:35:43.799 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff61f24d640 / io_context_pool 2024-09-12T00:35:43.799 INFO:tasks.workunit.client.0.smithi133.stderr: 7ff622528800 / radosgw-admin 2024-09-12T00:35:43.799 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:35:43.799 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:35:43.799 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:35:43.673163Z_9556ba0d-8dba-4c06-816a-119ea925ee28/log 2024-09-12T00:35:43.799 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:35:43.800 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:35:43.801 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:43.801 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:43.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.748+0000 7f8b15098800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.749+0000 7f8b15098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.749+0000 7f8b15098800 20 realm 2024-09-12T00:35:43.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.749+0000 7f8b15098800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.750+0000 7f8b15098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.750+0000 7f8b15098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:43.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.750+0000 7f8b15098800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.750+0000 7f8b15098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.750+0000 7f8b15098800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.751+0000 7f8b15098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:43.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.751+0000 7f8b15098800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.752+0000 7f8b15098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:43.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.752+0000 7f8b15098800 20 searching for the correct realm 2024-09-12T00:35:43.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.754+0000 7f8b13383640 0 -- 172.21.15.133:0/272452728 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f8b0c06fc40 msgr2=0x7f8b0c08c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:43.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.960+0000 7f8b12b82640 0 -- 172.21.15.133:0/272452728 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x562571cdb750 msgr2=0x562571cddbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:43.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.964+0000 7f8b15098800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:43.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.964+0000 7f8b15098800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:43.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.964+0000 7f8b15098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:43.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.964+0000 7f8b15098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:43.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.964+0000 7f8b15098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:43.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.964+0000 7f8b15098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:43.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.964+0000 7f8b15098800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.964+0000 7f8b15098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.964+0000 7f8b15098800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.964+0000 7f8b15098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:43.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.964+0000 7f8b15098800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.965+0000 7f8b15098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:43.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.965+0000 7f8b15098800 20 zone default found 2024-09-12T00:35:43.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.965+0000 7f8b15098800 4 Realm: () 2024-09-12T00:35:43.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.965+0000 7f8b15098800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:43.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.965+0000 7f8b15098800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:43.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.965+0000 7f8b15098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:43.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.965+0000 7f8b15098800 20 zonegroup default 2024-09-12T00:35:43.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.965+0000 7f8b15098800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.965+0000 7f8b15098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.965+0000 7f8b15098800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.965+0000 7f8b15098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.965+0000 7f8b15098800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.965+0000 7f8b15098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:43.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.965+0000 7f8b15098800 20 started sync module instance, tier type = 2024-09-12T00:35:43.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.965+0000 7f8b15098800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:43.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.974+0000 7f8b15098800 20 add_watcher() i=0 2024-09-12T00:35:43.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.974+0000 7f8b15098800 20 add_watcher() i=1 2024-09-12T00:35:43.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.974+0000 7f8b15098800 20 add_watcher() i=2 2024-09-12T00:35:43.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.974+0000 7f8b15098800 20 add_watcher() i=3 2024-09-12T00:35:43.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.974+0000 7f8b15098800 20 add_watcher() i=4 2024-09-12T00:35:43.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.974+0000 7f8b15098800 20 add_watcher() i=5 2024-09-12T00:35:43.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.974+0000 7f8b15098800 20 add_watcher() i=6 2024-09-12T00:35:43.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.975+0000 7f8b15098800 20 add_watcher() i=7 2024-09-12T00:35:43.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.975+0000 7f8b15098800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:43.976 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.976+0000 7f89c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:43.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.977+0000 7f8b15098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:43.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.977+0000 7f8b15098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:43.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.977+0000 7f8b15098800 5 note: GC not initialized 2024-09-12T00:35:43.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.977+0000 7f8943fff640 20 reqs_thread_entry: start 2024-09-12T00:35:43.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.977+0000 7f8b15098800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:43.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.977+0000 7f8b15098800 20 Filter name: none 2024-09-12T00:35:43.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.977+0000 7f8941ffb640 20 reqs_thread_entry: start 2024-09-12T00:35:43.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.977+0000 7f8b15098800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.978+0000 7f8b15098800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:43.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.978+0000 7f8b15098800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.978+0000 7f8b15098800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:35:43.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.978+0000 7f8b15098800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:43.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.978+0000 7f8b15098800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.979+0000 7f8b15098800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:43.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.979+0000 7f8b15098800 20 rados->read ofs=0 len=0 2024-09-12T00:35:43.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.979+0000 7f8b15098800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:35:43.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.979+0000 7f8b15098800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:43.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.980+0000 7f89c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:43.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.982+0000 7f8b15098800 20 remove_watcher() i=0 2024-09-12T00:35:43.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.982+0000 7f8b15098800 2 removed watcher, disabling cache 2024-09-12T00:35:43.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.984+0000 7f8b15098800 20 remove_watcher() i=1 2024-09-12T00:35:43.984 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.984+0000 7f8b15098800 20 remove_watcher() i=2 2024-09-12T00:35:43.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.985+0000 7f8b15098800 20 remove_watcher() i=3 2024-09-12T00:35:43.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.986+0000 7f8b15098800 20 remove_watcher() i=4 2024-09-12T00:35:43.987 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.987+0000 7f8b15098800 20 remove_watcher() i=5 2024-09-12T00:35:43.988 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.988+0000 7f8b15098800 20 remove_watcher() i=6 2024-09-12T00:35:43.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:43.989+0000 7f8b15098800 20 remove_watcher() i=7 2024-09-12T00:35:43.999 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:43.999 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:35:43.999 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-logrecord-writes id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:35:43.999 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:35:44.090 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:35:44.121 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:44.121 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:44.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.360+0000 7f3eb160f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:44.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.362+0000 7f3eb160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:44.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.362+0000 7f3eb160f800 20 realm 2024-09-12T00:35:44.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.362+0000 7f3eb160f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:44.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.362+0000 7f3eb160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:44.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.362+0000 7f3eb160f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:44.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.362+0000 7f3eb160f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:44.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.362+0000 7f3eb160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:44.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.362+0000 7f3eb160f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:44.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.363+0000 7f3eb160f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:44.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.363+0000 7f3eb160f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:44.364 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.364+0000 7f3eb160f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:44.364 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.364+0000 7f3eb160f800 20 searching for the correct realm 2024-09-12T00:35:44.365 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.365+0000 7f3ea68f8640 0 -- 172.21.15.133:0/4158756998 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f3e9802e070 msgr2=0x7f3e9806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:44.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.570+0000 7f3ea68f8640 0 -- 172.21.15.133:0/4158756998 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f3ea00ac580 msgr2=0x7f3ea00aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:44.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.775+0000 7f3eb160f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:35:44.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.775+0000 7f3eb160f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:35:44.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.775+0000 7f3eb160f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:44.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.775+0000 7f3eb160f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:44.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.775+0000 7f3eb160f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:44.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.775+0000 7f3eb160f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:44.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.775+0000 7f3eb160f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:44.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.776+0000 7f3eb160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:44.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.776+0000 7f3eb160f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:44.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.776+0000 7f3eb160f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:44.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.776+0000 7f3eb160f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:44.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.776+0000 7f3eb160f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:44.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.776+0000 7f3eb160f800 20 zone default found 2024-09-12T00:35:44.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.776+0000 7f3eb160f800 4 Realm: () 2024-09-12T00:35:44.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.776+0000 7f3eb160f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:35:44.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.776+0000 7f3eb160f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:35:44.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.776+0000 7f3eb160f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:44.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.776+0000 7f3eb160f800 20 zonegroup default 2024-09-12T00:35:44.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.776+0000 7f3eb160f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:44.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.776+0000 7f3eb160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:44.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.776+0000 7f3eb160f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:44.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.777+0000 7f3eb160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:44.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.777+0000 7f3eb160f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:44.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.777+0000 7f3eb160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:44.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.777+0000 7f3eb160f800 20 started sync module instance, tier type = 2024-09-12T00:35:44.779 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.777+0000 7f3eb160f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:35:44.786 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.786+0000 7f3eb160f800 20 add_watcher() i=0 2024-09-12T00:35:44.786 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.786+0000 7f3eb160f800 20 add_watcher() i=1 2024-09-12T00:35:44.786 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.786+0000 7f3eb160f800 20 add_watcher() i=2 2024-09-12T00:35:44.786 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.786+0000 7f3eb160f800 20 add_watcher() i=3 2024-09-12T00:35:44.786 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.786+0000 7f3eb160f800 20 add_watcher() i=4 2024-09-12T00:35:44.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.786+0000 7f3eb160f800 20 add_watcher() i=5 2024-09-12T00:35:44.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.786+0000 7f3eb160f800 20 add_watcher() i=6 2024-09-12T00:35:44.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.787+0000 7f3eb160f800 20 add_watcher() i=7 2024-09-12T00:35:44.787 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.787+0000 7f3eb160f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:44.789 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.789+0000 7f3d65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:44.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.789+0000 7f3eb160f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:44.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.789+0000 7f3eb160f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:44.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.789+0000 7f3eb160f800 5 note: GC not initialized 2024-09-12T00:35:44.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.790+0000 7f3d64fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:44.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.790+0000 7f3eb160f800 20 init_complete bucket index max shards: 1 2024-09-12T00:35:44.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.790+0000 7f3eb160f800 20 Filter name: none 2024-09-12T00:35:44.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.790+0000 7f3cde7fc640 20 reqs_thread_entry: start 2024-09-12T00:35:44.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.790+0000 7f3eb160f800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:35:44.790 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.790+0000 7f3eb160f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:44.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.790+0000 7f3eb160f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:35:44.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.790+0000 7f3eb160f800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:35:44.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.790+0000 7f3eb160f800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:35:44.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.790+0000 7f3eb160f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 : miss 2024-09-12T00:35:44.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.790+0000 7f3eb160f800 20 rados->read ofs=0 len=0 2024-09-12T00:35:44.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.791+0000 7f3eb160f800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:35:44.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.791+0000 7f3eb160f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:35:44.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.791+0000 7f3eb160f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:35:44.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.791+0000 7f3eb160f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:44.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.791+0000 7f3eb160f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:35:44.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.791+0000 7f3eb160f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 2024-09-12T00:35:44.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.792+0000 7f3eb160f800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to be held by another RGW process; skipping for now 2024-09-12T00:35:44.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.792+0000 7f3d65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:44.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.794+0000 7f3eb160f800 20 remove_watcher() i=0 2024-09-12T00:35:44.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.794+0000 7f3eb160f800 2 removed watcher, disabling cache 2024-09-12T00:35:44.795 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.796+0000 7f3eb160f800 20 remove_watcher() i=1 2024-09-12T00:35:44.796 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.797+0000 7f3eb160f800 20 remove_watcher() i=2 2024-09-12T00:35:44.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.798+0000 7f3eb160f800 20 remove_watcher() i=3 2024-09-12T00:35:44.798 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.799+0000 7f3eb160f800 20 remove_watcher() i=4 2024-09-12T00:35:44.799 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.800+0000 7f3eb160f800 20 remove_watcher() i=5 2024-09-12T00:35:44.800 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.801+0000 7f3eb160f800 20 remove_watcher() i=6 2024-09-12T00:35:44.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:35:44.802+0000 7f3eb160f800 20 remove_watcher() i=7 2024-09-12T00:35:44.812 INFO:tasks.workunit.client.0.smithi133.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:36:14.843 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:36:14.879 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:14.880 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:14.922 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:14.923+0000 7f555121b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:14.925+0000 7f555121b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.924 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:14.925+0000 7f555121b800 20 realm 2024-09-12T00:36:14.925 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:14.925+0000 7f555121b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.925 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:14.925+0000 7f555121b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.925 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:14.925+0000 7f555121b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:14.925 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:14.925+0000 7f555121b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.925 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:14.926+0000 7f555121b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:14.925 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:14.926+0000 7f555121b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.925 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:14.926+0000 7f555121b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:14.925 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:14.926+0000 7f555121b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:14.926 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:14.927+0000 7f555121b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:14.926 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:14.927+0000 7f555121b800 20 searching for the correct realm 2024-09-12T00:36:14.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:14.930+0000 7f5547fff640 0 -- 172.21.15.133:0/2719274797 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f5538008410 msgr2=0x7f5538008830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:15.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.137+0000 7f5547fff640 0 -- 172.21.15.133:0/2719274797 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f5540061040 msgr2=0x7f554006d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:15.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.345+0000 7f555121b800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:15.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.345+0000 7f555121b800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:15.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.345+0000 7f555121b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:15.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.345+0000 7f555121b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:15.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.345+0000 7f555121b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:15.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.345+0000 7f555121b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:15.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.345+0000 7f555121b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.345+0000 7f555121b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.345+0000 7f555121b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.346+0000 7f555121b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:15.345 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.346+0000 7f555121b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.346 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.346+0000 7f555121b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:15.346 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.346+0000 7f555121b800 20 zone default found 2024-09-12T00:36:15.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.346+0000 7f555121b800 4 Realm: () 2024-09-12T00:36:15.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.346+0000 7f555121b800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:15.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.346+0000 7f555121b800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:15.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.346+0000 7f555121b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:15.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.346+0000 7f555121b800 20 zonegroup default 2024-09-12T00:36:15.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.346+0000 7f555121b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.347+0000 7f555121b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.347+0000 7f555121b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.347+0000 7f555121b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.347+0000 7f555121b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.347+0000 7f555121b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.347+0000 7f555121b800 20 started sync module instance, tier type = 2024-09-12T00:36:15.347 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.347+0000 7f555121b800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:15.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.358+0000 7f555121b800 20 add_watcher() i=0 2024-09-12T00:36:15.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.358+0000 7f555121b800 20 add_watcher() i=1 2024-09-12T00:36:15.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.358+0000 7f555121b800 20 add_watcher() i=2 2024-09-12T00:36:15.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.358+0000 7f555121b800 20 add_watcher() i=3 2024-09-12T00:36:15.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.358+0000 7f555121b800 20 add_watcher() i=4 2024-09-12T00:36:15.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.358+0000 7f555121b800 20 add_watcher() i=5 2024-09-12T00:36:15.357 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.358+0000 7f555121b800 20 add_watcher() i=6 2024-09-12T00:36:15.358 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.359+0000 7f555121b800 20 add_watcher() i=7 2024-09-12T00:36:15.358 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.359+0000 7f555121b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:15.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.362+0000 7f54037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:15.361 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.362+0000 7f555121b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:15.361 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.362+0000 7f555121b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:15.361 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.362+0000 7f555121b800 5 note: GC not initialized 2024-09-12T00:36:15.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.362+0000 7f54027e4640 20 reqs_thread_entry: start 2024-09-12T00:36:15.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.362+0000 7f555121b800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:15.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.363+0000 7f555121b800 20 Filter name: none 2024-09-12T00:36:15.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.363+0000 7f53fbfff640 20 reqs_thread_entry: start 2024-09-12T00:36:15.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.363+0000 7f555121b800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:36:15.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.363+0000 7f555121b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.363+0000 7f555121b800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:36:15.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.363+0000 7f555121b800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:36:15.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.363+0000 7f555121b800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:36:15.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.363+0000 7f555121b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 : miss 2024-09-12T00:36:15.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.363+0000 7f555121b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.364+0000 7f555121b800 20 rados_obj.operate() r=0 bl.length=471 2024-09-12T00:36:15.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.364+0000 7f555121b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:36:15.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.364+0000 7f555121b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:36:15.364 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.364+0000 7f555121b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:15.364 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.364+0000 7f555121b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:15.364 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.364+0000 7f555121b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 2024-09-12T00:36:15.364 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.365+0000 7f555121b800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:36:15.368 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.369+0000 7f555121b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:36:15.368 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.369+0000 7f555121b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:36:15.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.369+0000 7f555121b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:15.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.369+0000 7f555121b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37, ofs0, ns] 2024-09-12T00:36:15.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.370+0000 7f5423fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497058 cookie 94217516224736 notifier 7908 bl.length()=1007 2024-09-12T00:36:15.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.370+0000 7f5423fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:36:15.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.370+0000 7f5423fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:36:15.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.370+0000 7f5423fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:15.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.372+0000 7f555121b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): orig_sources= new_sources= 2024-09-12T00:36:15.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.372+0000 7f555121b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): potential sources added=[] removed=[] 2024-09-12T00:36:15.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.372+0000 7f555121b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): orig_dests= new_dests= 2024-09-12T00:36:15.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.372+0000 7f555121b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): potential dests added=[] removed=[] 2024-09-12T00:36:15.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.374+0000 7f555121b800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37.2.0 2024-09-12T00:36:15.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.374+0000 7f555121b800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37.2.0 2024-09-12T00:36:15.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.374+0000 7f555121b800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37.2.1 2024-09-12T00:36:15.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.374+0000 7f555121b800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37.2.1 2024-09-12T00:36:15.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.374+0000 7f555121b800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37.0 2024-09-12T00:36:15.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.377+0000 7f555121b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:15.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.377+0000 7f555121b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 2024-09-12T00:36:15.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.378+0000 7f555121b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:36:15.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.378+0000 7f555121b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:36:15.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.378+0000 7f555121b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:15.377 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.378+0000 7f555121b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37, ofs0, ns] 2024-09-12T00:36:15.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.379+0000 7f5423fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497059 cookie 94217516224736 notifier 7908 bl.length()=1007 2024-09-12T00:36:15.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.379+0000 7f5423fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:36:15.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.379+0000 7f5423fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:36:15.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.379+0000 7f5423fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:15.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.380+0000 7f555121b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): orig_sources= new_sources= 2024-09-12T00:36:15.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.380+0000 7f555121b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): potential sources added=[] removed=[] 2024-09-12T00:36:15.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.380+0000 7f555121b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): orig_dests= new_dests= 2024-09-12T00:36:15.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.380+0000 7f555121b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): potential dests added=[] removed=[] 2024-09-12T00:36:15.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.382+0000 7f555121b800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37.0 2024-09-12T00:36:15.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.382+0000 7f555121b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:15.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.382+0000 7f555121b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 2024-09-12T00:36:15.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.383+0000 7f555121b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:36:15.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.383+0000 7f555121b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:36:15.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.383+0000 7f555121b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:15.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.383+0000 7f555121b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37, ofs0, ns] 2024-09-12T00:36:15.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.384+0000 7f54237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497060 cookie 94217516224736 notifier 7908 bl.length()=975 2024-09-12T00:36:15.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.384+0000 7f54237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 info.flags=0x17 2024-09-12T00:36:15.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.384+0000 7f54237fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 to cache LRU end 2024-09-12T00:36:15.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.384+0000 7f54237fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:15.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.385+0000 7f555121b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): orig_sources= new_sources= 2024-09-12T00:36:15.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.385+0000 7f555121b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): potential sources added=[] removed=[] 2024-09-12T00:36:15.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.385+0000 7f555121b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): orig_dests= new_dests= 2024-09-12T00:36:15.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.385+0000 7f555121b800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37]): potential dests added=[] removed=[] 2024-09-12T00:36:15.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.387+0000 7f555121b800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:36:15.388 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.389+0000 7f54037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:15.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.392+0000 7f555121b800 20 remove_watcher() i=0 2024-09-12T00:36:15.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.392+0000 7f555121b800 2 removed watcher, disabling cache 2024-09-12T00:36:15.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.393+0000 7f555121b800 20 remove_watcher() i=1 2024-09-12T00:36:15.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.394+0000 7f555121b800 20 remove_watcher() i=2 2024-09-12T00:36:15.394 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.395+0000 7f555121b800 20 remove_watcher() i=3 2024-09-12T00:36:15.395 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.397+0000 7f555121b800 20 remove_watcher() i=4 2024-09-12T00:36:15.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.398+0000 7f555121b800 20 remove_watcher() i=5 2024-09-12T00:36:15.398 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.399+0000 7f555121b800 20 remove_watcher() i=6 2024-09-12T00:36:15.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.400+0000 7f555121b800 20 remove_watcher() i=7 2024-09-12T00:36:15.412 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:36:15.442 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:15.443 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:15.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.482+0000 7f07ab126800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.484+0000 7f07ab126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.484+0000 7f07ab126800 20 realm 2024-09-12T00:36:15.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.484+0000 7f07ab126800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.484+0000 7f07ab126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.484+0000 7f07ab126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:15.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.484+0000 7f07ab126800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.484+0000 7f07ab126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.484+0000 7f07ab126800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.485+0000 7f07ab126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:15.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.485+0000 7f07ab126800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.486+0000 7f07ab126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:15.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.486+0000 7f07ab126800 20 searching for the correct realm 2024-09-12T00:36:15.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.487+0000 7f079e5d8640 0 -- 172.21.15.133:0/1662456849 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f079002e930 msgr2=0x7f079003e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:15.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.491+0000 7f079e5d8640 0 -- 172.21.15.133:0/1662456849 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f079806d060 msgr2=0x7f07980aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:15.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.697+0000 7f07ab126800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:15.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.697+0000 7f07ab126800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:15.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.697+0000 7f07ab126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:15.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.697+0000 7f07ab126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:15.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.697+0000 7f07ab126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:15.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.697+0000 7f07ab126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:15.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.697+0000 7f07ab126800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.697+0000 7f07ab126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.697+0000 7f07ab126800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.698+0000 7f07ab126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:15.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.698+0000 7f07ab126800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.698+0000 7f07ab126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:15.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.698+0000 7f07ab126800 20 zone default found 2024-09-12T00:36:15.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.698+0000 7f07ab126800 4 Realm: () 2024-09-12T00:36:15.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.698+0000 7f07ab126800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:15.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.698+0000 7f07ab126800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:15.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.698+0000 7f07ab126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:15.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.698+0000 7f07ab126800 20 zonegroup default 2024-09-12T00:36:15.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.698+0000 7f07ab126800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.698+0000 7f07ab126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.698+0000 7f07ab126800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.699+0000 7f07ab126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.699+0000 7f07ab126800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.699+0000 7f07ab126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:15.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.699+0000 7f07ab126800 20 started sync module instance, tier type = 2024-09-12T00:36:15.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.699+0000 7f07ab126800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:15.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.708+0000 7f07ab126800 20 add_watcher() i=0 2024-09-12T00:36:15.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.708+0000 7f07ab126800 20 add_watcher() i=1 2024-09-12T00:36:15.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.708+0000 7f07ab126800 20 add_watcher() i=2 2024-09-12T00:36:15.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.708+0000 7f07ab126800 20 add_watcher() i=3 2024-09-12T00:36:15.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.708+0000 7f07ab126800 20 add_watcher() i=4 2024-09-12T00:36:15.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.708+0000 7f07ab126800 20 add_watcher() i=5 2024-09-12T00:36:15.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.708+0000 7f07ab126800 20 add_watcher() i=6 2024-09-12T00:36:15.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.709+0000 7f07ab126800 20 add_watcher() i=7 2024-09-12T00:36:15.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.709+0000 7f07ab126800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:15.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.711+0000 7f065d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:15.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.711+0000 7f07ab126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:15.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.711+0000 7f07ab126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:15.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.711+0000 7f07ab126800 5 note: GC not initialized 2024-09-12T00:36:15.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.712+0000 7f05d7fff640 20 reqs_thread_entry: start 2024-09-12T00:36:15.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.712+0000 7f07ab126800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:15.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.712+0000 7f07ab126800 20 Filter name: none 2024-09-12T00:36:15.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.712+0000 7f05d5ffb640 20 reqs_thread_entry: start 2024-09-12T00:36:15.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.712+0000 7f07ab126800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.712+0000 7f07ab126800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:36:15.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.712+0000 7f07ab126800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.713+0000 7f07ab126800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:36:15.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.713+0000 7f07ab126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:15.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.713+0000 7f07ab126800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.713+0000 7f07ab126800 20 rados_obj.operate() r=0 bl.length=217 2024-09-12T00:36:15.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.713+0000 7f07ab126800 20 rados->read ofs=0 len=0 2024-09-12T00:36:15.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.713+0000 7f07ab126800 20 rados_obj.operate() r=0 bl.length=439 2024-09-12T00:36:15.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.713+0000 7f07ab126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:15.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.715+0000 7f065d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:15.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.717+0000 7f07ab126800 20 remove_watcher() i=0 2024-09-12T00:36:15.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.717+0000 7f07ab126800 2 removed watcher, disabling cache 2024-09-12T00:36:15.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.718+0000 7f07ab126800 20 remove_watcher() i=1 2024-09-12T00:36:15.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.719+0000 7f07ab126800 20 remove_watcher() i=2 2024-09-12T00:36:15.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.720+0000 7f07ab126800 20 remove_watcher() i=3 2024-09-12T00:36:15.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.721+0000 7f07ab126800 20 remove_watcher() i=4 2024-09-12T00:36:15.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.722+0000 7f07ab126800 20 remove_watcher() i=5 2024-09-12T00:36:15.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.723+0000 7f07ab126800 20 remove_watcher() i=6 2024-09-12T00:36:15.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:15.724+0000 7f07ab126800 20 remove_watcher() i=7 2024-09-12T00:36:15.733 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:15.734 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:36:15.734 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-logrecord-writes id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:36:15.734 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:16.023 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T00:36:16.023 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:16.847 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:36:16.875 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:16.875 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:16.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:16.913+0000 7fcee6508800 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:16.915+0000 7fcee6508800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:16.915+0000 7fcee6508800 20 realm 2024-09-12T00:36:16.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:16.915+0000 7fcee6508800 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:16.915+0000 7fcee6508800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:16.915+0000 7fcee6508800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:16.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:16.915+0000 7fcee6508800 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:16.915+0000 7fcee6508800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:16.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:16.916+0000 7fcee6508800 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:16.916+0000 7fcee6508800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:16.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:16.916+0000 7fcee6508800 20 rados->read ofs=0 len=0 2024-09-12T00:36:16.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:16.917+0000 7fcee6508800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:16.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:16.917+0000 7fcee6508800 20 searching for the correct realm 2024-09-12T00:36:16.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:16.918+0000 7fcee3ff2640 0 -- 172.21.15.133:0/3483751355 >> [v2:172.21.15.133:6816/1011460824,v1:172.21.15.133:6817/1011460824] conn(0x7fcedc073040 msgr2=0x7fcedc0aa9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:17.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.123+0000 7fcee3ff2640 0 -- 172.21.15.133:0/3483751355 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x5618cfbdf950 msgr2=0x5618cfbe1d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:17.128 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.129+0000 7fcee6508800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.129+0000 7fcee6508800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.129+0000 7fcee6508800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.129+0000 7fcee6508800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.129+0000 7fcee6508800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.129+0000 7fcee6508800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.129+0000 7fcee6508800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.130+0000 7fcee6508800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.130+0000 7fcee6508800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.130+0000 7fcee6508800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.130+0000 7fcee6508800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.130+0000 7fcee6508800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:17.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.130+0000 7fcee6508800 20 zone default found 2024-09-12T00:36:17.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.130+0000 7fcee6508800 4 Realm: () 2024-09-12T00:36:17.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.130+0000 7fcee6508800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:17.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.130+0000 7fcee6508800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:17.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.130+0000 7fcee6508800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:17.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.130+0000 7fcee6508800 20 zonegroup default 2024-09-12T00:36:17.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.130+0000 7fcee6508800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.130+0000 7fcee6508800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.130+0000 7fcee6508800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.131+0000 7fcee6508800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.131+0000 7fcee6508800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.131+0000 7fcee6508800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.131+0000 7fcee6508800 20 started sync module instance, tier type = 2024-09-12T00:36:17.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.131+0000 7fcee6508800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:17.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.139+0000 7fcee6508800 20 add_watcher() i=0 2024-09-12T00:36:17.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.139+0000 7fcee6508800 20 add_watcher() i=1 2024-09-12T00:36:17.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.139+0000 7fcee6508800 20 add_watcher() i=2 2024-09-12T00:36:17.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.139+0000 7fcee6508800 20 add_watcher() i=3 2024-09-12T00:36:17.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.139+0000 7fcee6508800 20 add_watcher() i=4 2024-09-12T00:36:17.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.139+0000 7fcee6508800 20 add_watcher() i=5 2024-09-12T00:36:17.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.139+0000 7fcee6508800 20 add_watcher() i=6 2024-09-12T00:36:17.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.140+0000 7fcee6508800 20 add_watcher() i=7 2024-09-12T00:36:17.139 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.140+0000 7fcee6508800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:17.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.142+0000 7fcd99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:17.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.142+0000 7fcee6508800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:17.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.142+0000 7fcee6508800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:17.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.143+0000 7fcee6508800 5 note: GC not initialized 2024-09-12T00:36:17.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.143+0000 7fcd98fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:17.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.143+0000 7fcee6508800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:17.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.143+0000 7fcee6508800 20 Filter name: none 2024-09-12T00:36:17.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.143+0000 7fcd127fc640 20 reqs_thread_entry: start 2024-09-12T00:36:17.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.143+0000 7fcee6508800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.144+0000 7fcee6508800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:17.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.144+0000 7fcee6508800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.144+0000 7fcee6508800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:17.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.144+0000 7fcee6508800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:17.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.144+0000 7fcee6508800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.144+0000 7fcee6508800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:17.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.144+0000 7fcee6508800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.145+0000 7fcee6508800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:17.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.145+0000 7fcee6508800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:17.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.146+0000 7fcd99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:17.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.148+0000 7fcee6508800 20 remove_watcher() i=0 2024-09-12T00:36:17.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.148+0000 7fcee6508800 2 removed watcher, disabling cache 2024-09-12T00:36:17.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.149+0000 7fcee6508800 20 remove_watcher() i=1 2024-09-12T00:36:17.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.150+0000 7fcee6508800 20 remove_watcher() i=2 2024-09-12T00:36:17.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.151+0000 7fcee6508800 20 remove_watcher() i=3 2024-09-12T00:36:17.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.152+0000 7fcee6508800 20 remove_watcher() i=4 2024-09-12T00:36:17.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.153+0000 7fcee6508800 20 remove_watcher() i=5 2024-09-12T00:36:17.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.154+0000 7fcee6508800 20 remove_watcher() i=6 2024-09-12T00:36:17.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.155+0000 7fcee6508800 20 remove_watcher() i=7 2024-09-12T00:36:17.164 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:17.164 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:36:17.164 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-change-reshard-state id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:36:17.164 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:17.166 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T00:36:17.200 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:17.200 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:17.236 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.238+0000 7fce7a542800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.239+0000 7fce7a542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.239+0000 7fce7a542800 20 realm 2024-09-12T00:36:17.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.239+0000 7fce7a542800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.239+0000 7fce7a542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.239+0000 7fce7a542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:17.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.239+0000 7fce7a542800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.238 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.239+0000 7fce7a542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.239+0000 7fce7a542800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.240+0000 7fce7a542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:17.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.240+0000 7fce7a542800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.241+0000 7fce7a542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:17.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.241+0000 7fce7a542800 20 searching for the correct realm 2024-09-12T00:36:17.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.242+0000 7fce6ffff640 0 -- 172.21.15.133:0/1783452649 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fce60033060 msgr2=0x7fce60074ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:17.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.246+0000 7fce6ffff640 0 -- 172.21.15.133:0/1783452649 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fce680a5f40 msgr2=0x7fce680a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:17.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:17.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:17.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:17.451 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:17.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:17.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:17.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:17.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:17.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 20 zone default found 2024-09-12T00:36:17.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 4 Realm: () 2024-09-12T00:36:17.452 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:17.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:17.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:17.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 20 zonegroup default 2024-09-12T00:36:17.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.452+0000 7fce7a542800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.453+0000 7fce7a542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.453+0000 7fce7a542800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.453 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.453+0000 7fce7a542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.454 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.453+0000 7fce7a542800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.454 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.453+0000 7fce7a542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.454 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.453+0000 7fce7a542800 20 started sync module instance, tier type = 2024-09-12T00:36:17.454 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.453+0000 7fce7a542800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:17.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.462+0000 7fce7a542800 20 add_watcher() i=0 2024-09-12T00:36:17.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.462+0000 7fce7a542800 20 add_watcher() i=1 2024-09-12T00:36:17.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.462+0000 7fce7a542800 20 add_watcher() i=2 2024-09-12T00:36:17.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.462+0000 7fce7a542800 20 add_watcher() i=3 2024-09-12T00:36:17.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.462+0000 7fce7a542800 20 add_watcher() i=4 2024-09-12T00:36:17.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.462+0000 7fce7a542800 20 add_watcher() i=5 2024-09-12T00:36:17.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.462+0000 7fce7a542800 20 add_watcher() i=6 2024-09-12T00:36:17.461 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.463+0000 7fce7a542800 20 add_watcher() i=7 2024-09-12T00:36:17.462 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.463+0000 7fce7a542800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:17.463 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.465+0000 7fcd2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:17.464 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.465+0000 7fce7a542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:17.464 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.465+0000 7fce7a542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:17.464 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.465+0000 7fce7a542800 5 note: GC not initialized 2024-09-12T00:36:17.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.465+0000 7fcca77fe640 20 reqs_thread_entry: start 2024-09-12T00:36:17.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.465+0000 7fce7a542800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:17.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.465+0000 7fce7a542800 20 Filter name: none 2024-09-12T00:36:17.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.465+0000 7fcca57fa640 20 reqs_thread_entry: start 2024-09-12T00:36:17.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.466+0000 7fce7a542800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:36:17.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.466+0000 7fce7a542800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.466+0000 7fce7a542800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:17.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.466+0000 7fce7a542800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:36:17.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.466+0000 7fce7a542800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:36:17.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.466+0000 7fce7a542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 : miss 2024-09-12T00:36:17.465 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.466+0000 7fce7a542800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.466+0000 7fce7a542800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:17.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.466+0000 7fce7a542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 info.flags=0x17 2024-09-12T00:36:17.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.466+0000 7fce7a542800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 to cache LRU end 2024-09-12T00:36:17.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.466+0000 7fce7a542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:17.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.466+0000 7fce7a542800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:17.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.467+0000 7fce7a542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 2024-09-12T00:36:17.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.470+0000 7fce7a542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 info.flags=0x17 2024-09-12T00:36:17.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.470+0000 7fce7a542800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 to cache LRU end 2024-09-12T00:36:17.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.470+0000 7fce7a542800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:17.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.470+0000 7fce7a542800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38, ofs0, ns] 2024-09-12T00:36:17.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.470+0000 7fcd59ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497066 cookie 94055573363232 notifier 7965 bl.length()=1015 2024-09-12T00:36:17.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.470+0000 7fcd59ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 info.flags=0x17 2024-09-12T00:36:17.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.470+0000 7fcd59ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 to cache LRU end 2024-09-12T00:36:17.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.470+0000 7fcd59ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:17.471 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.472+0000 7fce7a542800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): orig_sources= new_sources= 2024-09-12T00:36:17.471 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.472+0000 7fce7a542800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): potential sources added=[] removed=[] 2024-09-12T00:36:17.471 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.472+0000 7fce7a542800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): orig_dests= new_dests= 2024-09-12T00:36:17.471 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.472+0000 7fce7a542800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): potential dests added=[] removed=[] 2024-09-12T00:36:17.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.474+0000 7fce7a542800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38.1.0 2024-09-12T00:36:17.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.474+0000 7fce7a542800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38.1.0 2024-09-12T00:36:17.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.474+0000 7fce7a542800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38.1.1 2024-09-12T00:36:17.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.474+0000 7fce7a542800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38.1.1 2024-09-12T00:36:17.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.474+0000 7fce7a542800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38.0 2024-09-12T00:36:17.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.476+0000 7fce7a542800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T00:36:17.475 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.476+0000 7fce7a542800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T00:36:17.479 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.480+0000 7fce7a542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:17.479 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.480+0000 7fce7a542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 2024-09-12T00:36:17.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.481+0000 7fce7a542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 info.flags=0x17 2024-09-12T00:36:17.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.481+0000 7fce7a542800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 to cache LRU end 2024-09-12T00:36:17.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.481+0000 7fce7a542800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:17.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.481+0000 7fce7a542800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38, ofs0, ns] 2024-09-12T00:36:17.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.482+0000 7fcd597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497067 cookie 94055573363232 notifier 7965 bl.length()=983 2024-09-12T00:36:17.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.482+0000 7fcd597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 info.flags=0x17 2024-09-12T00:36:17.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.482+0000 7fcd597fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 to cache LRU end 2024-09-12T00:36:17.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.482+0000 7fcd597fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:17.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.483+0000 7fce7a542800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): orig_sources= new_sources= 2024-09-12T00:36:17.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.483+0000 7fce7a542800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): potential sources added=[] removed=[] 2024-09-12T00:36:17.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.483+0000 7fce7a542800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): orig_dests= new_dests= 2024-09-12T00:36:17.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.483+0000 7fce7a542800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): potential dests added=[] removed=[] 2024-09-12T00:36:17.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.483+0000 7fce7a542800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T00:36:17.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.485+0000 7fcd2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:17.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.487+0000 7fce7a542800 20 remove_watcher() i=0 2024-09-12T00:36:17.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.487+0000 7fce7a542800 2 removed watcher, disabling cache 2024-09-12T00:36:17.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.488+0000 7fce7a542800 20 remove_watcher() i=1 2024-09-12T00:36:17.488 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.489+0000 7fce7a542800 20 remove_watcher() i=2 2024-09-12T00:36:17.489 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.491+0000 7fce7a542800 20 remove_watcher() i=3 2024-09-12T00:36:17.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.492+0000 7fce7a542800 20 remove_watcher() i=4 2024-09-12T00:36:17.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.493+0000 7fce7a542800 20 remove_watcher() i=5 2024-09-12T00:36:17.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.494+0000 7fce7a542800 20 remove_watcher() i=6 2024-09-12T00:36:17.493 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.495+0000 7fce7a542800 20 remove_watcher() i=7 2024-09-12T00:36:17.506 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:36:17.534 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:17.534 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:17.773 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.774+0000 7fb75f140800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.776+0000 7fb75f140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.776+0000 7fb75f140800 20 realm 2024-09-12T00:36:17.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.776+0000 7fb75f140800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.777+0000 7fb75f140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.777+0000 7fb75f140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:17.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.777+0000 7fb75f140800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.777+0000 7fb75f140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.776 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.777+0000 7fb75f140800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.777+0000 7fb75f140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:17.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.777+0000 7fb75f140800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.778+0000 7fb75f140800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:17.777 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.778+0000 7fb75f140800 20 searching for the correct realm 2024-09-12T00:36:17.778 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.780+0000 7fb7526bf640 0 -- 172.21.15.133:0/462582599 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fb744027030 msgr2=0x7fb744090ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:17.782 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.783+0000 7fb7526bf640 0 -- 172.21.15.133:0/462582599 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fb74c00b040 msgr2=0x7fb74c0680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:17.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.990+0000 7fb75f140800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:17.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.990+0000 7fb75f140800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:17.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.990+0000 7fb75f140800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:17.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.990+0000 7fb75f140800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:17.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.990+0000 7fb75f140800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:17.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.990+0000 7fb75f140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:17.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.990+0000 7fb75f140800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.990+0000 7fb75f140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.990+0000 7fb75f140800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.990+0000 7fb75f140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:17.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.990+0000 7fb75f140800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.990+0000 7fb75f140800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:17.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.991+0000 7fb75f140800 20 zone default found 2024-09-12T00:36:17.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.991+0000 7fb75f140800 4 Realm: () 2024-09-12T00:36:17.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.991+0000 7fb75f140800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:17.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.991+0000 7fb75f140800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:17.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.991+0000 7fb75f140800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:17.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.991+0000 7fb75f140800 20 zonegroup default 2024-09-12T00:36:17.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.991+0000 7fb75f140800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.991+0000 7fb75f140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.991+0000 7fb75f140800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.991+0000 7fb75f140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.991+0000 7fb75f140800 20 rados->read ofs=0 len=0 2024-09-12T00:36:17.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.991+0000 7fb75f140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:17.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.991+0000 7fb75f140800 20 started sync module instance, tier type = 2024-09-12T00:36:17.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:17.991+0000 7fb75f140800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:17.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.000+0000 7fb75f140800 20 add_watcher() i=0 2024-09-12T00:36:17.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.000+0000 7fb75f140800 20 add_watcher() i=1 2024-09-12T00:36:17.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.000+0000 7fb75f140800 20 add_watcher() i=2 2024-09-12T00:36:17.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.000+0000 7fb75f140800 20 add_watcher() i=3 2024-09-12T00:36:17.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.000+0000 7fb75f140800 20 add_watcher() i=4 2024-09-12T00:36:17.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.000+0000 7fb75f140800 20 add_watcher() i=5 2024-09-12T00:36:17.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.000+0000 7fb75f140800 20 add_watcher() i=6 2024-09-12T00:36:17.999 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.001+0000 7fb75f140800 20 add_watcher() i=7 2024-09-12T00:36:18.000 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.001+0000 7fb75f140800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:18.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.002+0000 7fb6117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:18.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.003+0000 7fb75f140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:18.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.003+0000 7fb75f140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:18.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.003+0000 7fb75f140800 5 note: GC not initialized 2024-09-12T00:36:18.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.003+0000 7fb58bfff640 20 reqs_thread_entry: start 2024-09-12T00:36:18.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.003+0000 7fb75f140800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:18.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.003+0000 7fb75f140800 20 Filter name: none 2024-09-12T00:36:18.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.003+0000 7fb589ffb640 20 reqs_thread_entry: start 2024-09-12T00:36:18.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.003+0000 7fb75f140800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.004+0000 7fb75f140800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:18.003 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.004+0000 7fb75f140800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.004+0000 7fb75f140800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:18.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.004+0000 7fb75f140800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:18.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.004+0000 7fb75f140800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.004+0000 7fb75f140800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:18.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.004+0000 7fb75f140800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.005+0000 7fb75f140800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:18.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.005+0000 7fb75f140800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:18.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.006+0000 7fb6117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:18.009 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.008+0000 7fb75f140800 20 remove_watcher() i=0 2024-09-12T00:36:18.009 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.008+0000 7fb75f140800 2 removed watcher, disabling cache 2024-09-12T00:36:18.009 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.009+0000 7fb75f140800 20 remove_watcher() i=1 2024-09-12T00:36:18.009 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.010+0000 7fb75f140800 20 remove_watcher() i=2 2024-09-12T00:36:18.010 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.011+0000 7fb75f140800 20 remove_watcher() i=3 2024-09-12T00:36:18.010 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.012+0000 7fb75f140800 20 remove_watcher() i=4 2024-09-12T00:36:18.011 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.013+0000 7fb75f140800 20 remove_watcher() i=5 2024-09-12T00:36:18.012 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.014+0000 7fb75f140800 20 remove_watcher() i=6 2024-09-12T00:36:18.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.015+0000 7fb75f140800 20 remove_watcher() i=7 2024-09-12T00:36:18.023 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:18.023 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:36:18.024 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-change-reshard-state id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:36:18.024 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:18.115 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:36:18.146 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:18.146 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:18.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.185+0000 7fa78b80f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.187+0000 7fa78b80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.187+0000 7fa78b80f800 20 realm 2024-09-12T00:36:18.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.187+0000 7fa78b80f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.187+0000 7fa78b80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.186 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.187+0000 7fa78b80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:18.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.187+0000 7fa78b80f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.187+0000 7fa78b80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.187+0000 7fa78b80f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.188+0000 7fa78b80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:18.187 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.188+0000 7fa78b80f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.189+0000 7fa78b80f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:18.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.189+0000 7fa78b80f800 20 searching for the correct realm 2024-09-12T00:36:18.188 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.189+0000 7fa7892f9640 0 -- 172.21.15.133:0/1596414168 >> [v2:172.21.15.133:6816/1011460824,v1:172.21.15.133:6817/1011460824] conn(0x7fa778003cb0 msgr2=0x7fa78408a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:18.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.393+0000 7fa7892f9640 0 -- 172.21.15.133:0/1596414168 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x5586bdcce830 msgr2=0x5586bdcd0ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:18.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.399+0000 7fa78b80f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:18.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.399+0000 7fa78b80f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:18.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.399+0000 7fa78b80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:18.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.399+0000 7fa78b80f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:18.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.399+0000 7fa78b80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:18.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.399+0000 7fa78b80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:18.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.399+0000 7fa78b80f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.399+0000 7fa78b80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.399+0000 7fa78b80f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.400+0000 7fa78b80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:18.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.400+0000 7fa78b80f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.400+0000 7fa78b80f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:18.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.400+0000 7fa78b80f800 20 zone default found 2024-09-12T00:36:18.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.400+0000 7fa78b80f800 4 Realm: () 2024-09-12T00:36:18.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.400+0000 7fa78b80f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:18.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.400+0000 7fa78b80f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:18.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.400+0000 7fa78b80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:18.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.400+0000 7fa78b80f800 20 zonegroup default 2024-09-12T00:36:18.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.400+0000 7fa78b80f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.400+0000 7fa78b80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.400+0000 7fa78b80f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.400+0000 7fa78b80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.400+0000 7fa78b80f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.401+0000 7fa78b80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.401+0000 7fa78b80f800 20 started sync module instance, tier type = 2024-09-12T00:36:18.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.401+0000 7fa78b80f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:18.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.409+0000 7fa78b80f800 20 add_watcher() i=0 2024-09-12T00:36:18.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.409+0000 7fa78b80f800 20 add_watcher() i=1 2024-09-12T00:36:18.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.409+0000 7fa78b80f800 20 add_watcher() i=2 2024-09-12T00:36:18.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.409+0000 7fa78b80f800 20 add_watcher() i=3 2024-09-12T00:36:18.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.409+0000 7fa78b80f800 20 add_watcher() i=4 2024-09-12T00:36:18.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.409+0000 7fa78b80f800 20 add_watcher() i=5 2024-09-12T00:36:18.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.409+0000 7fa78b80f800 20 add_watcher() i=6 2024-09-12T00:36:18.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.410+0000 7fa78b80f800 20 add_watcher() i=7 2024-09-12T00:36:18.408 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.410+0000 7fa78b80f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:18.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.411+0000 7fa63f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:18.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.411+0000 7fa78b80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:18.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.411+0000 7fa78b80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:18.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.412+0000 7fa78b80f800 5 note: GC not initialized 2024-09-12T00:36:18.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.412+0000 7fa63e7e4640 20 reqs_thread_entry: start 2024-09-12T00:36:18.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.412+0000 7fa78b80f800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:18.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.412+0000 7fa78b80f800 20 Filter name: none 2024-09-12T00:36:18.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.412+0000 7fa5affff640 20 reqs_thread_entry: start 2024-09-12T00:36:18.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.412+0000 7fa78b80f800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:36:18.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.412+0000 7fa78b80f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.412+0000 7fa78b80f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:18.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.412+0000 7fa78b80f800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:36:18.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.412+0000 7fa78b80f800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:36:18.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.412+0000 7fa78b80f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 : miss 2024-09-12T00:36:18.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.412+0000 7fa78b80f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.413+0000 7fa78b80f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:18.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.413+0000 7fa78b80f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 info.flags=0x17 2024-09-12T00:36:18.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.413+0000 7fa78b80f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 to cache LRU end 2024-09-12T00:36:18.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.413+0000 7fa78b80f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:18.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.413+0000 7fa78b80f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:18.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.413+0000 7fa78b80f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 2024-09-12T00:36:18.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.417+0000 7fa78b80f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 info.flags=0x17 2024-09-12T00:36:18.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.417+0000 7fa78b80f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 to cache LRU end 2024-09-12T00:36:18.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.417+0000 7fa78b80f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:18.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.417+0000 7fa78b80f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38, ofs0, ns] 2024-09-12T00:36:18.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.417+0000 7fa66cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497068 cookie 94037198363648 notifier 7496 bl.length()=1015 2024-09-12T00:36:18.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.417+0000 7fa66cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 info.flags=0x17 2024-09-12T00:36:18.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.417+0000 7fa66cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 to cache LRU end 2024-09-12T00:36:18.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.417+0000 7fa66cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:18.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.419+0000 7fa78b80f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): orig_sources= new_sources= 2024-09-12T00:36:18.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.419+0000 7fa78b80f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): potential sources added=[] removed=[] 2024-09-12T00:36:18.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.419+0000 7fa78b80f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): orig_dests= new_dests= 2024-09-12T00:36:18.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.419+0000 7fa78b80f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): potential dests added=[] removed=[] 2024-09-12T00:36:18.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.421+0000 7fa78b80f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38.1.0 2024-09-12T00:36:18.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.421+0000 7fa78b80f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38.1.0 2024-09-12T00:36:18.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.421+0000 7fa78b80f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38.1.1 2024-09-12T00:36:18.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.421+0000 7fa78b80f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38.1.1 2024-09-12T00:36:18.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.421+0000 7fa78b80f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38.0 2024-09-12T00:36:18.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.423+0000 7fa78b80f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:18.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.423+0000 7fa78b80f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 2024-09-12T00:36:18.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.424+0000 7fa78b80f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 info.flags=0x17 2024-09-12T00:36:18.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.424+0000 7fa78b80f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 to cache LRU end 2024-09-12T00:36:18.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.424+0000 7fa78b80f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:18.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.424+0000 7fa78b80f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38, ofs0, ns] 2024-09-12T00:36:18.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.424+0000 7fa66cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497069 cookie 94037198363648 notifier 7496 bl.length()=1015 2024-09-12T00:36:18.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.424+0000 7fa66cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 info.flags=0x17 2024-09-12T00:36:18.424 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.424+0000 7fa66cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 to cache LRU end 2024-09-12T00:36:18.424 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.424+0000 7fa66cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:18.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.426+0000 7fa78b80f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): orig_sources= new_sources= 2024-09-12T00:36:18.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.427+0000 7fa78b80f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): potential sources added=[] removed=[] 2024-09-12T00:36:18.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.427+0000 7fa78b80f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): orig_dests= new_dests= 2024-09-12T00:36:18.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.427+0000 7fa78b80f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): potential dests added=[] removed=[] 2024-09-12T00:36:18.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.428+0000 7fa78b80f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38.0 2024-09-12T00:36:18.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.428+0000 7fa78b80f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:18.427 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.428+0000 7fa78b80f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 2024-09-12T00:36:18.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.429+0000 7fa78b80f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 info.flags=0x17 2024-09-12T00:36:18.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.429+0000 7fa78b80f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 to cache LRU end 2024-09-12T00:36:18.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.429+0000 7fa78b80f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:18.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.429+0000 7fa78b80f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38, ofs0, ns] 2024-09-12T00:36:18.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.430+0000 7fa65bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497070 cookie 94037198363648 notifier 7496 bl.length()=983 2024-09-12T00:36:18.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.430+0000 7fa65bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 info.flags=0x17 2024-09-12T00:36:18.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.430+0000 7fa65bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 to cache LRU end 2024-09-12T00:36:18.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.430+0000 7fa65bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:18.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.431+0000 7fa78b80f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): orig_sources= new_sources= 2024-09-12T00:36:18.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.431+0000 7fa78b80f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): potential sources added=[] removed=[] 2024-09-12T00:36:18.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.431+0000 7fa78b80f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): orig_dests= new_dests= 2024-09-12T00:36:18.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.431+0000 7fa78b80f800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38]): potential dests added=[] removed=[] 2024-09-12T00:36:18.431 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.432+0000 7fa78b80f800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:36:18.433 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.434+0000 7fa63f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:18.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.436+0000 7fa78b80f800 20 remove_watcher() i=0 2024-09-12T00:36:18.435 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.436+0000 7fa78b80f800 2 removed watcher, disabling cache 2024-09-12T00:36:18.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.437+0000 7fa78b80f800 20 remove_watcher() i=1 2024-09-12T00:36:18.436 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.438+0000 7fa78b80f800 20 remove_watcher() i=2 2024-09-12T00:36:18.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.439+0000 7fa78b80f800 20 remove_watcher() i=3 2024-09-12T00:36:18.439 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.440+0000 7fa78b80f800 20 remove_watcher() i=4 2024-09-12T00:36:18.440 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.441+0000 7fa78b80f800 20 remove_watcher() i=5 2024-09-12T00:36:18.441 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.442+0000 7fa78b80f800 20 remove_watcher() i=6 2024-09-12T00:36:18.442 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.443+0000 7fa78b80f800 20 remove_watcher() i=7 2024-09-12T00:36:18.454 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:36:18.483 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:18.483 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:18.519 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.521+0000 7f048f717800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.523+0000 7f048f717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.523+0000 7f048f717800 20 realm 2024-09-12T00:36:18.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.523+0000 7f048f717800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.523+0000 7f048f717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.523+0000 7f048f717800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:18.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.523+0000 7f048f717800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.523+0000 7f048f717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.522 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.523+0000 7f048f717800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.524+0000 7f048f717800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:18.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.524+0000 7f048f717800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.525+0000 7f048f717800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:18.523 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.525+0000 7f048f717800 20 searching for the correct realm 2024-09-12T00:36:18.525 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.526+0000 7f0484a00640 0 -- 172.21.15.133:0/2072089529 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f04780b9550 msgr2=0x7f0478003090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:18.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.730+0000 7f048d201640 0 -- 172.21.15.133:0/2072089529 >> [v2:172.21.15.160:6818/507321805,v1:172.21.15.160:6819/507321805] conn(0x7f04780d1040 msgr2=0x7f0478066000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:18.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.937+0000 7f048f717800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:18.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.937+0000 7f048f717800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:18.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.937+0000 7f048f717800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:18.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.937+0000 7f048f717800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:18.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.937+0000 7f048f717800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:18.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.937+0000 7f048f717800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:18.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.937+0000 7f048f717800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.938+0000 7f048f717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.938+0000 7f048f717800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.938+0000 7f048f717800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:18.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.938+0000 7f048f717800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.938+0000 7f048f717800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:18.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.938+0000 7f048f717800 20 zone default found 2024-09-12T00:36:18.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.938+0000 7f048f717800 4 Realm: () 2024-09-12T00:36:18.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.938+0000 7f048f717800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:18.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.938+0000 7f048f717800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:18.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.938+0000 7f048f717800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:18.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.938+0000 7f048f717800 20 zonegroup default 2024-09-12T00:36:18.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.938+0000 7f048f717800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.939+0000 7f048f717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.939+0000 7f048f717800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.939+0000 7f048f717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.939+0000 7f048f717800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.939+0000 7f048f717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:18.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.939+0000 7f048f717800 20 started sync module instance, tier type = 2024-09-12T00:36:18.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.939+0000 7f048f717800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:18.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.948+0000 7f048f717800 20 add_watcher() i=0 2024-09-12T00:36:18.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.948+0000 7f048f717800 20 add_watcher() i=1 2024-09-12T00:36:18.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.948+0000 7f048f717800 20 add_watcher() i=2 2024-09-12T00:36:18.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.948+0000 7f048f717800 20 add_watcher() i=3 2024-09-12T00:36:18.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.948+0000 7f048f717800 20 add_watcher() i=4 2024-09-12T00:36:18.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.948+0000 7f048f717800 20 add_watcher() i=5 2024-09-12T00:36:18.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.948+0000 7f048f717800 20 add_watcher() i=6 2024-09-12T00:36:18.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.949+0000 7f048f717800 20 add_watcher() i=7 2024-09-12T00:36:18.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.949+0000 7f048f717800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:18.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.951+0000 7f03437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:18.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.951+0000 7f048f717800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:18.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.951+0000 7f048f717800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:18.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.951+0000 7f048f717800 5 note: GC not initialized 2024-09-12T00:36:18.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.951+0000 7f03427e4640 20 reqs_thread_entry: start 2024-09-12T00:36:18.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.951+0000 7f048f717800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:18.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.951+0000 7f048f717800 20 Filter name: none 2024-09-12T00:36:18.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.951+0000 7f02b3fff640 20 reqs_thread_entry: start 2024-09-12T00:36:18.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.951+0000 7f048f717800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.952+0000 7f048f717800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:18.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.952+0000 7f048f717800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.951 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.952+0000 7f048f717800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:18.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.952+0000 7f048f717800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:18.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.952+0000 7f048f717800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.953+0000 7f048f717800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:18.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.953+0000 7f048f717800 20 rados->read ofs=0 len=0 2024-09-12T00:36:18.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.953+0000 7f048f717800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:18.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.953+0000 7f048f717800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:18.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.954+0000 7f03437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:18.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.957+0000 7f048f717800 20 remove_watcher() i=0 2024-09-12T00:36:18.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.957+0000 7f048f717800 2 removed watcher, disabling cache 2024-09-12T00:36:18.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.957+0000 7f048f717800 20 remove_watcher() i=1 2024-09-12T00:36:18.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.959+0000 7f048f717800 20 remove_watcher() i=2 2024-09-12T00:36:18.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.959+0000 7f048f717800 20 remove_watcher() i=3 2024-09-12T00:36:18.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.960+0000 7f048f717800 20 remove_watcher() i=4 2024-09-12T00:36:18.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.961+0000 7f048f717800 20 remove_watcher() i=5 2024-09-12T00:36:18.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.962+0000 7f048f717800 20 remove_watcher() i=6 2024-09-12T00:36:18.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:18.963+0000 7f048f717800 20 remove_watcher() i=7 2024-09-12T00:36:18.973 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:18.973 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:36:18.973 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-change-reshard-state id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:36:18.973 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:19.271 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T00:36:19.271 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:20.080 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:36:20.109 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:20.109 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:20.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.147+0000 7f446f122800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.149+0000 7f446f122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.149+0000 7f446f122800 20 realm 2024-09-12T00:36:20.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.149+0000 7f446f122800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.149+0000 7f446f122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.149+0000 7f446f122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:20.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.149+0000 7f446f122800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.149+0000 7f446f122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.149+0000 7f446f122800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.150+0000 7f446f122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:20.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.150+0000 7f446f122800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.150+0000 7f446f122800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:20.149 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.150+0000 7f446f122800 20 searching for the correct realm 2024-09-12T00:36:20.151 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.152+0000 7f4463fff640 0 -- 172.21.15.133:0/967776643 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f445407a040 msgr2=0x7f4454064920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:20.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.155+0000 7f4463fff640 0 -- 172.21.15.133:0/967776643 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f445c026040 msgr2=0x7f445c0669b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:20.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.361+0000 7f446f122800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:20.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.361+0000 7f446f122800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:20.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.361+0000 7f446f122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:20.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.361+0000 7f446f122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:20.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.361+0000 7f446f122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:20.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.361+0000 7f446f122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:20.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.361+0000 7f446f122800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.360 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.361+0000 7f446f122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.361 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.361+0000 7f446f122800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.361 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.361+0000 7f446f122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:20.361 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.361+0000 7f446f122800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.362+0000 7f446f122800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:20.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.362+0000 7f446f122800 20 zone default found 2024-09-12T00:36:20.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.362+0000 7f446f122800 4 Realm: () 2024-09-12T00:36:20.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.362+0000 7f446f122800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:20.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.362+0000 7f446f122800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:20.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.362+0000 7f446f122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:20.362 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.362+0000 7f446f122800 20 zonegroup default 2024-09-12T00:36:20.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.362+0000 7f446f122800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.362+0000 7f446f122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.362+0000 7f446f122800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.362+0000 7f446f122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.362+0000 7f446f122800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.363+0000 7f446f122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.363+0000 7f446f122800 20 started sync module instance, tier type = 2024-09-12T00:36:20.363 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.363+0000 7f446f122800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:20.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.371+0000 7f446f122800 20 add_watcher() i=0 2024-09-12T00:36:20.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.371+0000 7f446f122800 20 add_watcher() i=1 2024-09-12T00:36:20.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.371+0000 7f446f122800 20 add_watcher() i=2 2024-09-12T00:36:20.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.371+0000 7f446f122800 20 add_watcher() i=3 2024-09-12T00:36:20.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.371+0000 7f446f122800 20 add_watcher() i=4 2024-09-12T00:36:20.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.371+0000 7f446f122800 20 add_watcher() i=5 2024-09-12T00:36:20.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.371+0000 7f446f122800 20 add_watcher() i=6 2024-09-12T00:36:20.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.372+0000 7f446f122800 20 add_watcher() i=7 2024-09-12T00:36:20.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.372+0000 7f446f122800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:20.372 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.374+0000 7f43217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:20.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.374+0000 7f446f122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:20.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.374+0000 7f446f122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:20.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.374+0000 7f446f122800 5 note: GC not initialized 2024-09-12T00:36:20.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.374+0000 7f429bfff640 20 reqs_thread_entry: start 2024-09-12T00:36:20.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.374+0000 7f446f122800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:20.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.374+0000 7f446f122800 20 Filter name: none 2024-09-12T00:36:20.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.375+0000 7f4299ffb640 20 reqs_thread_entry: start 2024-09-12T00:36:20.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.375+0000 7f446f122800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.374 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.375+0000 7f446f122800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:20.375 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.375+0000 7f446f122800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.375 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.376+0000 7f446f122800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:20.375 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.376+0000 7f446f122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:20.375 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.376+0000 7f446f122800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.375 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.376+0000 7f446f122800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:20.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.376+0000 7f446f122800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.376+0000 7f446f122800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:20.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.376+0000 7f446f122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:20.376 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.377+0000 7f43217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:20.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.380+0000 7f446f122800 20 remove_watcher() i=0 2024-09-12T00:36:20.378 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.380+0000 7f446f122800 2 removed watcher, disabling cache 2024-09-12T00:36:20.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.381+0000 7f446f122800 20 remove_watcher() i=1 2024-09-12T00:36:20.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.382+0000 7f446f122800 20 remove_watcher() i=2 2024-09-12T00:36:20.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.383+0000 7f446f122800 20 remove_watcher() i=3 2024-09-12T00:36:20.382 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.384+0000 7f446f122800 20 remove_watcher() i=4 2024-09-12T00:36:20.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.385+0000 7f446f122800 20 remove_watcher() i=5 2024-09-12T00:36:20.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.386+0000 7f446f122800 20 remove_watcher() i=6 2024-09-12T00:36:20.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.387+0000 7f446f122800 20 remove_watcher() i=7 2024-09-12T00:36:20.396 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:20.396 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:36:20.396 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-change-reshard-state id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:36:20.396 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:20.398 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T00:36:20.434 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:20.434 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:20.471 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.472+0000 7f9a14e40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.472 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.473+0000 7f9a14e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.472 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.473+0000 7f9a14e40800 20 realm 2024-09-12T00:36:20.472 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.473+0000 7f9a14e40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.473+0000 7f9a14e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.473+0000 7f9a14e40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:20.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.473+0000 7f9a14e40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.474+0000 7f9a14e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.473 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.474+0000 7f9a14e40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.474+0000 7f9a14e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:20.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.474+0000 7f9a14e40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.475+0000 7f9a14e40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:20.474 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.475+0000 7f9a14e40800 20 searching for the correct realm 2024-09-12T00:36:20.476 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.477+0000 7f9a12129640 0 -- 172.21.15.133:0/3587045689 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f99fc027030 msgr2=0x7f99fc0687b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:20.478 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.480+0000 7f9a12129640 0 -- 172.21.15.133:0/3587045689 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f9a04008040 msgr2=0x7f9a040630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:20.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:20.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:20.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:20.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:20.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:20.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:20.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:20.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:20.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 20 zone default found 2024-09-12T00:36:20.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 4 Realm: () 2024-09-12T00:36:20.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:20.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:20.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:20.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 20 zonegroup default 2024-09-12T00:36:20.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.688+0000 7f9a14e40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.689+0000 7f9a14e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.689+0000 7f9a14e40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.689+0000 7f9a14e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.689+0000 7f9a14e40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.689+0000 7f9a14e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.689+0000 7f9a14e40800 20 started sync module instance, tier type = 2024-09-12T00:36:20.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.689+0000 7f9a14e40800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:20.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.698+0000 7f9a14e40800 20 add_watcher() i=0 2024-09-12T00:36:20.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.698+0000 7f9a14e40800 20 add_watcher() i=1 2024-09-12T00:36:20.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.698+0000 7f9a14e40800 20 add_watcher() i=2 2024-09-12T00:36:20.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.698+0000 7f9a14e40800 20 add_watcher() i=3 2024-09-12T00:36:20.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.698+0000 7f9a14e40800 20 add_watcher() i=4 2024-09-12T00:36:20.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.698+0000 7f9a14e40800 20 add_watcher() i=5 2024-09-12T00:36:20.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.698+0000 7f9a14e40800 20 add_watcher() i=6 2024-09-12T00:36:20.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.699+0000 7f9a14e40800 20 add_watcher() i=7 2024-09-12T00:36:20.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.699+0000 7f9a14e40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:20.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.700+0000 7f98c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:20.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.701+0000 7f9a14e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:20.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.701+0000 7f9a14e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:20.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.701+0000 7f9a14e40800 5 note: GC not initialized 2024-09-12T00:36:20.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.701+0000 7f9843fff640 20 reqs_thread_entry: start 2024-09-12T00:36:20.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.701+0000 7f9a14e40800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:20.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.701+0000 7f9a14e40800 20 Filter name: none 2024-09-12T00:36:20.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.701+0000 7f9841ffb640 20 reqs_thread_entry: start 2024-09-12T00:36:20.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.701+0000 7f9a14e40800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:36:20.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.701+0000 7f9a14e40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.702+0000 7f9a14e40800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:20.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.702+0000 7f9a14e40800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:36:20.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.702+0000 7f9a14e40800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:36:20.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.702+0000 7f9a14e40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 : miss 2024-09-12T00:36:20.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.702+0000 7f9a14e40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.702+0000 7f9a14e40800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:20.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.702+0000 7f9a14e40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 info.flags=0x17 2024-09-12T00:36:20.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.702+0000 7f9a14e40800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 to cache LRU end 2024-09-12T00:36:20.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.702+0000 7f9a14e40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:20.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.702+0000 7f9a14e40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:20.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.702+0000 7f9a14e40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 2024-09-12T00:36:20.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.705+0000 7f9a14e40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 info.flags=0x17 2024-09-12T00:36:20.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.705+0000 7f9a14e40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 to cache LRU end 2024-09-12T00:36:20.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.705+0000 7f9a14e40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:20.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.705+0000 7f9a14e40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39, ofs0, ns] 2024-09-12T00:36:20.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.706+0000 7f98f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497073 cookie 94413725477088 notifier 8058 bl.length()=1015 2024-09-12T00:36:20.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.706+0000 7f98f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 info.flags=0x17 2024-09-12T00:36:20.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.706+0000 7f98f67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 to cache LRU end 2024-09-12T00:36:20.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.706+0000 7f98f67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:20.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.707+0000 7f9a14e40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39]): orig_sources= new_sources= 2024-09-12T00:36:20.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.707+0000 7f9a14e40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39]): potential sources added=[] removed=[] 2024-09-12T00:36:20.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.707+0000 7f9a14e40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39]): orig_dests= new_dests= 2024-09-12T00:36:20.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.707+0000 7f9a14e40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39]): potential dests added=[] removed=[] 2024-09-12T00:36:20.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.709+0000 7f9a14e40800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39.1.0 2024-09-12T00:36:20.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.709+0000 7f9a14e40800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39.1.0 2024-09-12T00:36:20.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.709+0000 7f9a14e40800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39.1.1 2024-09-12T00:36:20.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.709+0000 7f9a14e40800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39.1.1 2024-09-12T00:36:20.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.709+0000 7f9a14e40800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39.0 2024-09-12T00:36:20.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.712+0000 7f9a14e40800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T00:36:20.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.712+0000 7f9a14e40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:20.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.712+0000 7f9a14e40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 2024-09-12T00:36:20.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.713+0000 7f9a14e40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 info.flags=0x17 2024-09-12T00:36:20.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.713+0000 7f9a14e40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 to cache LRU end 2024-09-12T00:36:20.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.713+0000 7f9a14e40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:20.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.713+0000 7f9a14e40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39, ofs0, ns] 2024-09-12T00:36:20.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.713+0000 7f98f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497074 cookie 94413725477088 notifier 8058 bl.length()=1015 2024-09-12T00:36:20.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.713+0000 7f98f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 info.flags=0x17 2024-09-12T00:36:20.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.713+0000 7f98f67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 to cache LRU end 2024-09-12T00:36:20.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.713+0000 7f98f67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:20.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.715+0000 7f9a14e40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39]): orig_sources= new_sources= 2024-09-12T00:36:20.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.715+0000 7f9a14e40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39]): potential sources added=[] removed=[] 2024-09-12T00:36:20.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.715+0000 7f9a14e40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39]): orig_dests= new_dests= 2024-09-12T00:36:20.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.715+0000 7f9a14e40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39]): potential dests added=[] removed=[] 2024-09-12T00:36:20.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.716+0000 7f9a14e40800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39.0 2024-09-12T00:36:20.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.716+0000 7f9a14e40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:20.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.716+0000 7f9a14e40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 2024-09-12T00:36:20.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.717+0000 7f9a14e40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 info.flags=0x17 2024-09-12T00:36:20.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.717+0000 7f9a14e40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 to cache LRU end 2024-09-12T00:36:20.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.717+0000 7f9a14e40800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:20.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.717+0000 7f9a14e40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39, ofs0, ns] 2024-09-12T00:36:20.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.718+0000 7f98f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497075 cookie 94413725477088 notifier 8058 bl.length()=983 2024-09-12T00:36:20.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.718+0000 7f98f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 info.flags=0x17 2024-09-12T00:36:20.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.718+0000 7f98f67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 to cache LRU end 2024-09-12T00:36:20.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.718+0000 7f98f67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:20.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.719+0000 7f9a14e40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39]): orig_sources= new_sources= 2024-09-12T00:36:20.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.719+0000 7f9a14e40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39]): potential sources added=[] removed=[] 2024-09-12T00:36:20.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.719+0000 7f9a14e40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39]): orig_dests= new_dests= 2024-09-12T00:36:20.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.719+0000 7f9a14e40800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39]): potential dests added=[] removed=[] 2024-09-12T00:36:20.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.720+0000 7f9a14e40800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:36:20.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.722+0000 7f98c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:20.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.724+0000 7f9a14e40800 20 remove_watcher() i=0 2024-09-12T00:36:20.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.724+0000 7f9a14e40800 2 removed watcher, disabling cache 2024-09-12T00:36:20.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.725+0000 7f9a14e40800 20 remove_watcher() i=1 2024-09-12T00:36:20.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.726+0000 7f9a14e40800 20 remove_watcher() i=2 2024-09-12T00:36:20.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.727+0000 7f9a14e40800 20 remove_watcher() i=3 2024-09-12T00:36:20.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.728+0000 7f9a14e40800 20 remove_watcher() i=4 2024-09-12T00:36:20.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.729+0000 7f9a14e40800 20 remove_watcher() i=5 2024-09-12T00:36:20.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.730+0000 7f9a14e40800 20 remove_watcher() i=6 2024-09-12T00:36:20.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.731+0000 7f9a14e40800 20 remove_watcher() i=7 2024-09-12T00:36:20.741 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:36:20.770 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:20.770 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:20.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.808+0000 7f089a80e800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.810+0000 7f089a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.810+0000 7f089a80e800 20 realm 2024-09-12T00:36:20.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.810+0000 7f089a80e800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.810+0000 7f089a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.810+0000 7f089a80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:20.809 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.810+0000 7f089a80e800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.810+0000 7f089a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:20.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.810+0000 7f089a80e800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.811+0000 7f089a80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:20.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.811+0000 7f089a80e800 20 rados->read ofs=0 len=0 2024-09-12T00:36:20.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.811+0000 7f089a80e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:20.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.812+0000 7f089a80e800 20 searching for the correct realm 2024-09-12T00:36:20.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.814+0000 7f08967e1640 0 -- 172.21.15.133:0/1267078251 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x5585bdb75c30 msgr2=0x5585bdb78020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:20.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:20.816+0000 7f088ffff640 0 -- 172.21.15.133:0/1267078251 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f0888035040 msgr2=0x7f0888008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:21.023 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.023+0000 7f089a80e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:21.023 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.023+0000 7f089a80e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:21.023 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.023+0000 7f089a80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:21.023 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.023+0000 7f089a80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:21.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.023+0000 7f089a80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:21.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.023+0000 7f089a80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:21.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.023+0000 7f089a80e800 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.023+0000 7f089a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.023+0000 7f089a80e800 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.023+0000 7f089a80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:21.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.023+0000 7f089a80e800 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.024+0000 7f089a80e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:21.024 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.024+0000 7f089a80e800 20 zone default found 2024-09-12T00:36:21.025 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.024+0000 7f089a80e800 4 Realm: () 2024-09-12T00:36:21.025 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.024+0000 7f089a80e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:21.025 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.024+0000 7f089a80e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:21.025 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.024+0000 7f089a80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:21.025 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.024+0000 7f089a80e800 20 zonegroup default 2024-09-12T00:36:21.025 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.024+0000 7f089a80e800 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.025 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.024+0000 7f089a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.025 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.024+0000 7f089a80e800 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.025 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.024+0000 7f089a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.025 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.024+0000 7f089a80e800 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.026 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.025+0000 7f089a80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.026 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.025+0000 7f089a80e800 20 started sync module instance, tier type = 2024-09-12T00:36:21.026 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.025+0000 7f089a80e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:21.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.033+0000 7f089a80e800 20 add_watcher() i=0 2024-09-12T00:36:21.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.033+0000 7f089a80e800 20 add_watcher() i=1 2024-09-12T00:36:21.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.033+0000 7f089a80e800 20 add_watcher() i=2 2024-09-12T00:36:21.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.033+0000 7f089a80e800 20 add_watcher() i=3 2024-09-12T00:36:21.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.033+0000 7f089a80e800 20 add_watcher() i=4 2024-09-12T00:36:21.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.033+0000 7f089a80e800 20 add_watcher() i=5 2024-09-12T00:36:21.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.033+0000 7f089a80e800 20 add_watcher() i=6 2024-09-12T00:36:21.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.034+0000 7f089a80e800 20 add_watcher() i=7 2024-09-12T00:36:21.033 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.034+0000 7f089a80e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:21.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.040+0000 7f07477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:21.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.041+0000 7f089a80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:21.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.041+0000 7f089a80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:21.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.041+0000 7f089a80e800 5 note: GC not initialized 2024-09-12T00:36:21.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.041+0000 7f07467fc640 20 reqs_thread_entry: start 2024-09-12T00:36:21.041 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.041+0000 7f089a80e800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:21.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.041+0000 7f089a80e800 20 Filter name: none 2024-09-12T00:36:21.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.041+0000 7f06b7fff640 20 reqs_thread_entry: start 2024-09-12T00:36:21.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.041+0000 7f089a80e800 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.042+0000 7f089a80e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:21.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.042+0000 7f089a80e800 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.042+0000 7f089a80e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:21.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.042+0000 7f089a80e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:21.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.042+0000 7f089a80e800 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.043+0000 7f089a80e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:21.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.043+0000 7f089a80e800 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.043+0000 7f089a80e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:21.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.043+0000 7f089a80e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:21.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.044+0000 7f07477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:21.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.046+0000 7f089a80e800 20 remove_watcher() i=0 2024-09-12T00:36:21.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.046+0000 7f089a80e800 2 removed watcher, disabling cache 2024-09-12T00:36:21.046 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.047+0000 7f089a80e800 20 remove_watcher() i=1 2024-09-12T00:36:21.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.048+0000 7f089a80e800 20 remove_watcher() i=2 2024-09-12T00:36:21.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.049+0000 7f089a80e800 20 remove_watcher() i=3 2024-09-12T00:36:21.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.050+0000 7f089a80e800 20 remove_watcher() i=4 2024-09-12T00:36:21.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.051+0000 7f089a80e800 20 remove_watcher() i=5 2024-09-12T00:36:21.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.052+0000 7f089a80e800 20 remove_watcher() i=6 2024-09-12T00:36:21.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:21.053+0000 7f089a80e800 20 remove_watcher() i=7 2024-09-12T00:36:21.062 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:21.062 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:36:21.063 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: error-at-change-reshard-state id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:36:21.063 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:21.369 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T00:36:21.369 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.186 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:36:22.215 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:22.215 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:22.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.253+0000 7f4ffef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.255+0000 7f4ffef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.255+0000 7f4ffef1f800 20 realm 2024-09-12T00:36:22.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.255+0000 7f4ffef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.255+0000 7f4ffef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.255+0000 7f4ffef1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:22.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.255+0000 7f4ffef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.255+0000 7f4ffef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.255+0000 7f4ffef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.256+0000 7f4ffef1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.256+0000 7f4ffef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.257+0000 7f4ffef1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:22.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.257+0000 7f4ffef1f800 20 searching for the correct realm 2024-09-12T00:36:22.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.258+0000 7f4ff3fff640 0 -- 172.21.15.133:0/3414183463 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f4fe4081e50 msgr2=0x7f4fe4066890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:22.260 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.262+0000 7f4ff3fff640 0 -- 172.21.15.133:0/3414183463 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f4fec086070 msgr2=0x7f4fec0611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:22.466 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.467+0000 7f4ffef1f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:22.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.467+0000 7f4ffef1f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:22.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.467+0000 7f4ffef1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:22.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.467+0000 7f4ffef1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:22.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.467+0000 7f4ffef1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:22.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.467+0000 7f4ffef1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:22.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.467+0000 7f4ffef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.468+0000 7f4ffef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.468+0000 7f4ffef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.468+0000 7f4ffef1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.467 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.468+0000 7f4ffef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.468+0000 7f4ffef1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:22.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.468+0000 7f4ffef1f800 20 zone default found 2024-09-12T00:36:22.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.468+0000 7f4ffef1f800 4 Realm: () 2024-09-12T00:36:22.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.468+0000 7f4ffef1f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:22.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.468+0000 7f4ffef1f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:22.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.468+0000 7f4ffef1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:22.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.468+0000 7f4ffef1f800 20 zonegroup default 2024-09-12T00:36:22.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.468+0000 7f4ffef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.469+0000 7f4ffef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.469+0000 7f4ffef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.469+0000 7f4ffef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.469+0000 7f4ffef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.469+0000 7f4ffef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.469+0000 7f4ffef1f800 20 started sync module instance, tier type = 2024-09-12T00:36:22.469 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.469+0000 7f4ffef1f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:22.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.478+0000 7f4ffef1f800 20 add_watcher() i=0 2024-09-12T00:36:22.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.478+0000 7f4ffef1f800 20 add_watcher() i=1 2024-09-12T00:36:22.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.478+0000 7f4ffef1f800 20 add_watcher() i=2 2024-09-12T00:36:22.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.478+0000 7f4ffef1f800 20 add_watcher() i=3 2024-09-12T00:36:22.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.478+0000 7f4ffef1f800 20 add_watcher() i=4 2024-09-12T00:36:22.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.478+0000 7f4ffef1f800 20 add_watcher() i=5 2024-09-12T00:36:22.477 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.478+0000 7f4ffef1f800 20 add_watcher() i=6 2024-09-12T00:36:22.478 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.479+0000 7f4ffef1f800 20 add_watcher() i=7 2024-09-12T00:36:22.478 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.479+0000 7f4ffef1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:22.479 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.481+0000 7f4eb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:22.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.481+0000 7f4ffef1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:22.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.481+0000 7f4ffef1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:22.480 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.481+0000 7f4ffef1f800 5 note: GC not initialized 2024-09-12T00:36:22.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.481+0000 7f4e2bfff640 20 reqs_thread_entry: start 2024-09-12T00:36:22.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.481+0000 7f4ffef1f800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:22.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.482+0000 7f4ffef1f800 20 Filter name: none 2024-09-12T00:36:22.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.482+0000 7f4e29ffb640 20 reqs_thread_entry: start 2024-09-12T00:36:22.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.482+0000 7f4ffef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.482+0000 7f4ffef1f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:22.481 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.482+0000 7f4ffef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.483+0000 7f4ffef1f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:22.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.483+0000 7f4ffef1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:22.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.483+0000 7f4ffef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.482 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.484+0000 7f4ffef1f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:22.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.484+0000 7f4ffef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.484+0000 7f4ffef1f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:22.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.484+0000 7f4ffef1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:22.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.485+0000 7f4eb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:22.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.487+0000 7f4ffef1f800 20 remove_watcher() i=0 2024-09-12T00:36:22.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.487+0000 7f4ffef1f800 2 removed watcher, disabling cache 2024-09-12T00:36:22.487 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.488+0000 7f4ffef1f800 20 remove_watcher() i=1 2024-09-12T00:36:22.488 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.489+0000 7f4ffef1f800 20 remove_watcher() i=2 2024-09-12T00:36:22.489 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.490+0000 7f4ffef1f800 20 remove_watcher() i=3 2024-09-12T00:36:22.490 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.491+0000 7f4ffef1f800 20 remove_watcher() i=4 2024-09-12T00:36:22.491 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.492+0000 7f4ffef1f800 20 remove_watcher() i=5 2024-09-12T00:36:22.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.493+0000 7f4ffef1f800 20 remove_watcher() i=6 2024-09-12T00:36:22.492 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.494+0000 7f4ffef1f800 20 remove_watcher() i=7 2024-09-12T00:36:22.503 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.503 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:36:22.503 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-change-reshard-state id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:36:22.503 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.504 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:36:22.539 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:22.539 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:22.575 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.577+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.578+0000 7feb6652b800 20 realm 2024-09-12T00:36:22.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.578+0000 7feb6652b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:22.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.579+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.579+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.580+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:22.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.580+0000 7feb6652b800 20 searching for the correct realm 2024-09-12T00:36:22.580 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.582+0000 7feb5bfff640 0 -- 172.21.15.133:0/783716372 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7feb4c056980 msgr2=0x7feb4c063480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:22.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.585+0000 7feb62273640 0 -- 172.21.15.133:0/783716372 >> [v2:172.21.15.160:6818/507321805,v1:172.21.15.160:6819/507321805] conn(0x7feb4c08e420 msgr2=0x7feb4c08e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:22.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:22.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:22.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:22.791 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:22.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:22.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:22.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.792+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.792+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.792+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.792 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.793 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:22.793 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.793+0000 7feb6652b800 20 zone default found 2024-09-12T00:36:22.793 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.793+0000 7feb6652b800 4 Realm: () 2024-09-12T00:36:22.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.793+0000 7feb6652b800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:22.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.793+0000 7feb6652b800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:22.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.793+0000 7feb6652b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:22.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.793+0000 7feb6652b800 20 zonegroup default 2024-09-12T00:36:22.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.794+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.794+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.794+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.794+0000 7feb6652b800 20 started sync module instance, tier type = 2024-09-12T00:36:22.794 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.794+0000 7feb6652b800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:22.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=0 2024-09-12T00:36:22.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=1 2024-09-12T00:36:22.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=2 2024-09-12T00:36:22.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=3 2024-09-12T00:36:22.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=4 2024-09-12T00:36:22.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=5 2024-09-12T00:36:22.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=6 2024-09-12T00:36:22.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.803+0000 7feb6652b800 20 add_watcher() i=7 2024-09-12T00:36:22.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.803+0000 7feb6652b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:22.804 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.806+0000 7fea18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:22.805 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.806+0000 7feb6652b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:22.805 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.806+0000 7feb6652b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:22.805 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.806+0000 7feb6652b800 5 note: GC not initialized 2024-09-12T00:36:22.805 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.806+0000 7fe9937fe640 20 reqs_thread_entry: start 2024-09-12T00:36:22.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.806+0000 7feb6652b800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:22.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.806+0000 7feb6652b800 20 Filter name: none 2024-09-12T00:36:22.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.806+0000 7fe9917fa640 20 reqs_thread_entry: start 2024-09-12T00:36:22.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.807+0000 7feb6652b800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:36:22.806 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.807+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.807+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:22.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.807+0000 7feb6652b800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:36:22.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.807+0000 7feb6652b800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:36:22.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.807+0000 7feb6652b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 : miss 2024-09-12T00:36:22.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.807+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.808+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:22.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.808+0000 7feb6652b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:22.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.808+0000 7feb6652b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:22.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.808+0000 7feb6652b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:22.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.808+0000 7feb6652b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:22.807 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.808+0000 7feb6652b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 2024-09-12T00:36:22.811 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.811+0000 7feb6652b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:22.811 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.811+0000 7feb6652b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:22.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.811+0000 7feb6652b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:22.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.811+0000 7feb6652b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40, ofs0, ns] 2024-09-12T00:36:22.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.811+0000 7fea45ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497067 cookie 94507132622928 notifier 7598 bl.length()=1015 2024-09-12T00:36:22.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.811+0000 7fea45ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:22.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.811+0000 7fea45ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:22.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.811+0000 7fea45ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:22.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.813+0000 7feb6652b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): orig_sources= new_sources= 2024-09-12T00:36:22.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.813+0000 7feb6652b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): potential sources added=[] removed=[] 2024-09-12T00:36:22.813 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.813+0000 7feb6652b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): orig_dests= new_dests= 2024-09-12T00:36:22.813 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.813+0000 7feb6652b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): potential dests added=[] removed=[] 2024-09-12T00:36:22.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.815+0000 7feb6652b800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.1.0 2024-09-12T00:36:22.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.815+0000 7feb6652b800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.1.0 2024-09-12T00:36:22.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.815+0000 7feb6652b800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.1.1 2024-09-12T00:36:22.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.815+0000 7feb6652b800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.1.1 2024-09-12T00:36:22.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.815+0000 7feb6652b800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.0 2024-09-12T00:36:22.816 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feb6652b800 time 2024-09-12T00:36:22.818955+0000 2024-09-12T00:36:22.816 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:22.817 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:22.817 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feb67d8c71a] 2024-09-12T00:36:22.817 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feb67d8c8d8] 2024-09-12T00:36:22.817 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f42568f641] 2024-09-12T00:36:22.817 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55f42569e51b] 2024-09-12T00:36:22.818 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f42569f3e4] 2024-09-12T00:36:22.818 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:36:22.818 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7feb66a29590] 2024-09-12T00:36:22.818 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:36:22.818 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:36:22.818 INFO:tasks.workunit.client.0.smithi133.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:36:22.818 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7feb6652b800 thread_name:radosgw-admin 2024-09-12T00:36:22.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.818+0000 7feb6652b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feb6652b800 time 2024-09-12T00:36:22.818955+0000 2024-09-12T00:36:22.818 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:22.818 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.818 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:22.818 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feb67d8c71a] 2024-09-12T00:36:22.818 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feb67d8c8d8] 2024-09-12T00:36:22.819 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f42568f641] 2024-09-12T00:36:22.819 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55f42569e51b] 2024-09-12T00:36:22.819 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f42569f3e4] 2024-09-12T00:36:22.819 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:36:22.819 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7feb66a29590] 2024-09-12T00:36:22.819 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:36:22.819 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:36:22.819 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.841 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:22.841 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7feb66a3e6f0] 2024-09-12T00:36:22.841 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7feb66a8b99c] 2024-09-12T00:36:22.841 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:36:22.841 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:36:22.841 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feb67d8c774] 2024-09-12T00:36:22.841 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feb67d8c8d8] 2024-09-12T00:36:22.842 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f42568f641] 2024-09-12T00:36:22.842 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55f42569e51b] 2024-09-12T00:36:22.842 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f42569f3e4] 2024-09-12T00:36:22.842 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:36:22.842 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7feb66a29590] 2024-09-12T00:36:22.842 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:36:22.842 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:36:22.842 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.819+0000 7feb6652b800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:22.842 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7feb6652b800 thread_name:radosgw-admin 2024-09-12T00:36:22.842 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.842 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:22.842 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7feb66a3e6f0] 2024-09-12T00:36:22.842 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7feb66a8b99c] 2024-09-12T00:36:22.843 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:36:22.843 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:36:22.843 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feb67d8c774] 2024-09-12T00:36:22.843 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feb67d8c8d8] 2024-09-12T00:36:22.843 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f42568f641] 2024-09-12T00:36:22.843 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55f42569e51b] 2024-09-12T00:36:22.843 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f42569f3e4] 2024-09-12T00:36:22.843 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:36:22.843 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7feb66a29590] 2024-09-12T00:36:22.843 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:36:22.843 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:36:22.843 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:22.843 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.844 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:36:22.844 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: crc 2024-09-12T00:36:22.844 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: secure 2024-09-12T00:36:22.844 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: crc 2024-09-12T00:36:22.844 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: secure 2024-09-12T00:36:22.844 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: crc 2024-09-12T00:36:22.844 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: crc 2024-09-12T00:36:22.844 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: secure 2024-09-12T00:36:22.844 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: crc 2024-09-12T00:36:22.844 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: secure 2024-09-12T00:36:22.844 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: crc 2024-09-12T00:36:22.844 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: secure 2024-09-12T00:36:22.844 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:36:22.561+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.844 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:36:22.561+0000 7feb6652b800 1 librados: starting msgr at 2024-09-12T00:36:22.845 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:36:22.561+0000 7feb6652b800 1 librados: starting objecter 2024-09-12T00:36:22.845 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command objecter_requests hook 0x55f42804c7c0 2024-09-12T00:36:22.845 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:36:22.561+0000 7feb6652b800 1 librados: setting wanted keys 2024-09-12T00:36:22.845 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:36:22.561+0000 7feb6652b800 1 librados: calling monclient init 2024-09-12T00:36:22.845 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:36:22.561+0000 7feb6652b800 10 monclient: init 2024-09-12T00:36:22.845 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding auth protocol: cephx 2024-09-12T00:36:22.845 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding auth protocol: cephx 2024-09-12T00:36:22.845 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding auth protocol: cephx 2024-09-12T00:36:22.845 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: secure 2024-09-12T00:36:22.845 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: crc 2024-09-12T00:36:22.845 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: secure 2024-09-12T00:36:22.845 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: crc 2024-09-12T00:36:22.845 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: secure 2024-09-12T00:36:22.845 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: crc 2024-09-12T00:36:22.846 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: crc 2024-09-12T00:36:22.846 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: secure 2024-09-12T00:36:22.846 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: crc 2024-09-12T00:36:22.846 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: secure 2024-09-12T00:36:22.846 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: crc 2024-09-12T00:36:22.846 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: secure 2024-09-12T00:36:22.846 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:36:22.561+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.846 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:36:22.561+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.846 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command rotate-key hook 0x55f42801dc48 2024-09-12T00:36:22.846 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:36:22.561+0000 7feb6652b800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:22.846 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:36:22.561+0000 7feb6652b800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:36:22.846 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:36:22.561+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-c con 0x55f427ecbf20 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:22.846 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-b con 0x55f427ed4d10 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:22.846 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-a con 0x55f427f67020 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:22.847 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.847 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.847 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.847 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:22.847 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient(hunting): authenticate will time out at 2191.134026s 2024-09-12T00:36:22.847 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): get_auth_request con 0x55f427ecbf20 auth_method 0 2024-09-12T00:36:22.847 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.847 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.847 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.847 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:36:22.562+0000 7feb62a74640 10 monclient(hunting): get_auth_request con 0x55f427f67020 auth_method 0 2024-09-12T00:36:22.847 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:36:22.562+0000 7feb62a74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.847 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:36:22.562+0000 7feb62a74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.847 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:36:22.562+0000 7feb62a74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.847 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.848 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.848 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.848 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:36:22.562+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.848 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:36:22.562+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.848 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:36:22.562+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.848 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:36:22.562+0000 7feb5bfff640 10 monclient(hunting): get_auth_request con 0x55f427ed4d10 auth_method 0 2024-09-12T00:36:22.848 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:36:22.562+0000 7feb5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.848 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:36:22.562+0000 7feb5bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.848 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:36:22.562+0000 7feb5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.848 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): handle_auth_done global_id 7589 payload 824 2024-09-12T00:36:22.848 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient: _finish_hunting 0 2024-09-12T00:36:22.848 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:36:22.562+0000 7feb62273640 1 monclient: found mon.noname-c 2024-09-12T00:36:22.848 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: dump: 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.849 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: _finish_auth 0 2024-09-12T00:36:22.850 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: _check_auth_tickets 2024-09-12T00:36:22.850 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:36:22.562+0000 7feb6652b800 5 monclient: authenticate success, global_id 7589 2024-09-12T00:36:22.850 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient: _renew_subs 2024-09-12T00:36:22.850 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.850 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:22.850 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.850 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:22.850 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: dump: 2024-09-12T00:36:22.850 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.850 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.850 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.850 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.850 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.850 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.851 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.851 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.851 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.851 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.851 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:36:22.562+0000 7fea50608640 4 set_mon_vals no callback set 2024-09-12T00:36:22.851 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient: _renew_subs 2024-09-12T00:36:22.851 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.851 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:36:22.562+0000 7feb6652b800 1 librados: init done 2024-09-12T00:36:22.851 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:36:22.564+0000 7fea4ee05640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:36:22.851 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:36:22.564+0000 7fea4ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:22.851 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:36:22.564+0000 7fea4ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:22.851 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:36:22.564+0000 7feb5bfff640 10 monclient: get_auth_request con 0x7fea48076470 auth_method 0 2024-09-12T00:36:22.851 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:36:22.565+0000 7feb62a74640 10 monclient: get_auth_request con 0x55f4280468c0 auth_method 0 2024-09-12T00:36:22.851 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:36:22.565+0000 7feb62273640 10 monclient: get_auth_request con 0x55f428069190 auth_method 0 2024-09-12T00:36:22.851 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:36:22.566+0000 7feb5bfff640 10 monclient: get_auth_request con 0x55f42806d4f0 auth_method 0 2024-09-12T00:36:22.852 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:36:22.567+0000 7feb62a74640 10 monclient: get_auth_request con 0x55f42806ca40 auth_method 0 2024-09-12T00:36:22.852 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:36:22.568+0000 7feb6652b800 10 monclient: build_initial_monmap 2024-09-12T00:36:22.852 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:36:22.568+0000 7feb6652b800 1 build_initial for_mkfs: 0 2024-09-12T00:36:22.852 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:36:22.568+0000 7feb6652b800 10 monclient: monmap: 2024-09-12T00:36:22.852 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:36:22.852 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:22.852 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:36:22.852 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:36:22.852 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:22.852 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.852 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:36:22.852 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:36:22.852 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:36:22.853 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.853 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding auth protocol: cephx 2024-09-12T00:36:22.853 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding auth protocol: cephx 2024-09-12T00:36:22.853 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding auth protocol: cephx 2024-09-12T00:36:22.853 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: secure 2024-09-12T00:36:22.853 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: crc 2024-09-12T00:36:22.853 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: secure 2024-09-12T00:36:22.853 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: crc 2024-09-12T00:36:22.853 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: secure 2024-09-12T00:36:22.853 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: crc 2024-09-12T00:36:22.853 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: crc 2024-09-12T00:36:22.853 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: secure 2024-09-12T00:36:22.853 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: crc 2024-09-12T00:36:22.853 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: secure 2024-09-12T00:36:22.853 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: crc 2024-09-12T00:36:22.854 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: secure 2024-09-12T00:36:22.854 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:36:22.568+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.854 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command objecter_requests cmddesc objecter_requests hook 0x55f428078af0 EEXIST 2024-09-12T00:36:22.854 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:36:22.568+0000 7feb6652b800 10 monclient: init 2024-09-12T00:36:22.854 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding auth protocol: cephx 2024-09-12T00:36:22.854 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding auth protocol: cephx 2024-09-12T00:36:22.854 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding auth protocol: cephx 2024-09-12T00:36:22.854 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: secure 2024-09-12T00:36:22.854 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: crc 2024-09-12T00:36:22.854 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: secure 2024-09-12T00:36:22.854 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: crc 2024-09-12T00:36:22.854 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: secure 2024-09-12T00:36:22.854 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: crc 2024-09-12T00:36:22.855 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: crc 2024-09-12T00:36:22.855 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: secure 2024-09-12T00:36:22.855 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: crc 2024-09-12T00:36:22.855 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: secure 2024-09-12T00:36:22.855 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: crc 2024-09-12T00:36:22.855 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: secure 2024-09-12T00:36:22.855 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:36:22.568+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.855 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:36:22.569+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.855 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:36:22.569+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command rotate-key cmddesc rotate-key hook 0x55f428074680 EEXIST 2024-09-12T00:36:22.855 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:22.855 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:36:22.855 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-a con 0x55f42809ce10 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:22.855 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-b con 0x55f42809d1f0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:22.856 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-c con 0x55f42809bb20 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:22.856 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.856 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.856 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.856 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:22.856 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): authenticate will time out at 2191.141194s 2024-09-12T00:36:22.856 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): get_auth_request con 0x55f42809bb20 auth_method 0 2024-09-12T00:36:22.856 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.856 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.856 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.856 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:36:22.569+0000 7feb5bfff640 10 monclient(hunting): get_auth_request con 0x55f42809ce10 auth_method 0 2024-09-12T00:36:22.856 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:36:22.569+0000 7feb5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.856 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:36:22.569+0000 7feb5bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.856 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:36:22.569+0000 7feb5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.857 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.857 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.857 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.857 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:36:22.569+0000 7feb62a74640 10 monclient(hunting): get_auth_request con 0x55f42809d1f0 auth_method 0 2024-09-12T00:36:22.857 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:36:22.569+0000 7feb62a74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.857 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:36:22.569+0000 7feb62a74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.857 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:36:22.569+0000 7feb62a74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.857 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:36:22.569+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.857 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:36:22.569+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.857 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:36:22.569+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.857 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:36:22.569+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.857 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:36:22.569+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.857 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:36:22.569+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.858 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): handle_auth_done global_id 7592 payload 824 2024-09-12T00:36:22.858 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient: _finish_hunting 0 2024-09-12T00:36:22.858 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:36:22.569+0000 7feb62273640 1 monclient: found mon.noname-c 2024-09-12T00:36:22.858 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.858 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.858 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:22.858 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: dump: 2024-09-12T00:36:22.858 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.858 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.858 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.858 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.858 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.858 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.858 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.859 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.859 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.859 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.859 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: _finish_auth 0 2024-09-12T00:36:22.859 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: _check_auth_tickets 2024-09-12T00:36:22.859 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:22.859 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.859 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:22.859 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: dump: 2024-09-12T00:36:22.859 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.859 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.859 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.859 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.859 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.860 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.860 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.860 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.860 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.860 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.860 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:36:22.569+0000 7feb6652b800 5 monclient: authenticate success, global_id 7592 2024-09-12T00:36:22.860 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient: _renew_subs 2024-09-12T00:36:22.860 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:36:22.569+0000 7feb63275640 4 set_mon_vals no callback set 2024-09-12T00:36:22.860 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.860 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient: _renew_subs 2024-09-12T00:36:22.860 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.860 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:36:22.571+0000 7fea47fff640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:36:22.861 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:36:22.571+0000 7fea47fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:22.861 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:36:22.571+0000 7fea47fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:22.861 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:36:22.571+0000 7feb5bfff640 10 monclient: get_auth_request con 0x7fea3c076380 auth_method 0 2024-09-12T00:36:22.861 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:36:22.571+0000 7feb6652b800 10 monclient: get_monmap_and_config 2024-09-12T00:36:22.861 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:36:22.571+0000 7feb6652b800 10 monclient: build_initial_monmap 2024-09-12T00:36:22.861 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:36:22.571+0000 7feb6652b800 1 build_initial for_mkfs: 0 2024-09-12T00:36:22.861 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:36:22.571+0000 7feb6652b800 10 monclient: monmap: 2024-09-12T00:36:22.861 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:36:22.861 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:22.861 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:36:22.861 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:36:22.861 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding auth protocol: cephx 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding auth protocol: cephx 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding auth protocol: cephx 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: secure 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: crc 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: secure 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: crc 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: secure 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: crc 2024-09-12T00:36:22.862 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: crc 2024-09-12T00:36:22.863 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: secure 2024-09-12T00:36:22.863 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: crc 2024-09-12T00:36:22.863 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: secure 2024-09-12T00:36:22.863 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: crc 2024-09-12T00:36:22.863 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: secure 2024-09-12T00:36:22.863 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:36:22.572+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.863 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient: init 2024-09-12T00:36:22.863 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding auth protocol: cephx 2024-09-12T00:36:22.863 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding auth protocol: cephx 2024-09-12T00:36:22.863 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding auth protocol: cephx 2024-09-12T00:36:22.863 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: secure 2024-09-12T00:36:22.863 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: crc 2024-09-12T00:36:22.863 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: secure 2024-09-12T00:36:22.863 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: crc 2024-09-12T00:36:22.864 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: secure 2024-09-12T00:36:22.864 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: crc 2024-09-12T00:36:22.864 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: crc 2024-09-12T00:36:22.864 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: secure 2024-09-12T00:36:22.864 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: crc 2024-09-12T00:36:22.864 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: secure 2024-09-12T00:36:22.864 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: crc 2024-09-12T00:36:22.864 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: secure 2024-09-12T00:36:22.864 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:36:22.572+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.864 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:36:22.572+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.864 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command rotate-key cmddesc rotate-key hook 0x7ffc0a7dfb48 EEXIST 2024-09-12T00:36:22.864 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:22.864 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:36:22.864 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-c con 0x55f4280f1300 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:22.865 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-a con 0x55f4280c1110 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:22.865 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-b con 0x55f4280ec6c0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:22.865 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.865 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.865 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.865 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:22.865 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): authenticate will time out at 2191.144734s 2024-09-12T00:36:22.865 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:36:22.572+0000 7feb5bfff640 10 monclient(hunting): get_auth_request con 0x55f4280f1300 auth_method 0 2024-09-12T00:36:22.865 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:36:22.572+0000 7feb5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.865 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:36:22.572+0000 7feb5bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.865 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:36:22.572+0000 7feb5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.866 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:36:22.572+0000 7feb62a74640 10 monclient(hunting): get_auth_request con 0x55f4280c1110 auth_method 0 2024-09-12T00:36:22.866 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:36:22.572+0000 7feb62a74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.866 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:36:22.572+0000 7feb62a74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.866 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:36:22.572+0000 7feb62a74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.866 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:36:22.572+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.866 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:36:22.572+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.866 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:36:22.572+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.866 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:36:22.572+0000 7feb62273640 10 monclient(hunting): get_auth_request con 0x55f4280ec6c0 auth_method 0 2024-09-12T00:36:22.866 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:36:22.572+0000 7feb62273640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.866 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:36:22.572+0000 7feb62273640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.866 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:36:22.572+0000 7feb62273640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.866 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:36:22.572+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.866 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:36:22.572+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.867 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:36:22.572+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.867 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:36:22.572+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.867 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:36:22.572+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.867 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:36:22.572+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.867 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:36:22.573+0000 7feb5bfff640 10 monclient(hunting): handle_auth_done global_id 7595 payload 274 2024-09-12T00:36:22.867 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:36:22.573+0000 7feb5bfff640 10 monclient: _finish_hunting 0 2024-09-12T00:36:22.867 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:36:22.573+0000 7feb5bfff640 1 monclient: found mon.noname-c 2024-09-12T00:36:22.867 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:36:22.573+0000 7feb5bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.867 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.867 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:22.867 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: dump: 2024-09-12T00:36:22.867 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.867 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.867 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.868 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.868 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.868 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.868 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.868 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.868 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.868 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.868 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: _finish_auth 0 2024-09-12T00:36:22.868 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:36:22.868 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:36:22.573+0000 7feb6652b800 5 monclient: authenticate success, global_id 7595 2024-09-12T00:36:22.868 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:22.868 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.868 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:22.868 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: dump: 2024-09-12T00:36:22.869 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.869 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.869 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.869 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.869 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.869 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.869 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.869 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.869 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.869 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.869 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:36:22.573+0000 7feb6652b800 10 monclient: get_monmap_and_config success 2024-09-12T00:36:22.869 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:36:22.573+0000 7feb6652b800 4 set_mon_vals no callback set 2024-09-12T00:36:22.869 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:36:22.573+0000 7feb6652b800 10 monclient: shutdown 2024-09-12T00:36:22.869 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:36:22.573+0000 7feb6652b800 10 monclient: build_initial_monmap 2024-09-12T00:36:22.870 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:36:22.573+0000 7feb6652b800 1 build_initial for_mkfs: 0 2024-09-12T00:36:22.870 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:36:22.573+0000 7feb6652b800 10 monclient: monmap: 2024-09-12T00:36:22.870 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:36:22.870 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:22.870 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:36:22.870 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:36:22.870 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:22.870 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.870 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:36:22.870 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:36:22.871 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:36:22.871 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.871 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding auth protocol: cephx 2024-09-12T00:36:22.871 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding auth protocol: cephx 2024-09-12T00:36:22.871 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding auth protocol: cephx 2024-09-12T00:36:22.871 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: secure 2024-09-12T00:36:22.871 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: crc 2024-09-12T00:36:22.871 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: secure 2024-09-12T00:36:22.871 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: crc 2024-09-12T00:36:22.871 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: secure 2024-09-12T00:36:22.871 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: crc 2024-09-12T00:36:22.871 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: crc 2024-09-12T00:36:22.871 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: secure 2024-09-12T00:36:22.871 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: crc 2024-09-12T00:36:22.872 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: secure 2024-09-12T00:36:22.872 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: crc 2024-09-12T00:36:22.872 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: secure 2024-09-12T00:36:22.872 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:36:22.574+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.872 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:36:22.574+0000 7feb6652b800 1 librados: starting msgr at 2024-09-12T00:36:22.872 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:36:22.574+0000 7feb6652b800 1 librados: starting objecter 2024-09-12T00:36:22.872 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command objecter_requests cmddesc objecter_requests hook 0x55f4280c0f40 EEXIST 2024-09-12T00:36:22.872 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:36:22.574+0000 7feb6652b800 1 librados: setting wanted keys 2024-09-12T00:36:22.872 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:36:22.574+0000 7feb6652b800 1 librados: calling monclient init 2024-09-12T00:36:22.872 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient: init 2024-09-12T00:36:22.872 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding auth protocol: cephx 2024-09-12T00:36:22.872 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding auth protocol: cephx 2024-09-12T00:36:22.872 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding auth protocol: cephx 2024-09-12T00:36:22.872 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: secure 2024-09-12T00:36:22.873 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: crc 2024-09-12T00:36:22.873 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: secure 2024-09-12T00:36:22.873 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: crc 2024-09-12T00:36:22.873 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: secure 2024-09-12T00:36:22.873 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: crc 2024-09-12T00:36:22.873 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: crc 2024-09-12T00:36:22.873 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: secure 2024-09-12T00:36:22.873 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: crc 2024-09-12T00:36:22.873 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: secure 2024-09-12T00:36:22.873 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: crc 2024-09-12T00:36:22.873 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: secure 2024-09-12T00:36:22.873 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:36:22.574+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.873 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:36:22.574+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.873 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command rotate-key cmddesc rotate-key hook 0x55f4280b1818 EEXIST 2024-09-12T00:36:22.874 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:22.874 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:36:22.874 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-b con 0x55f4280c1110 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:22.874 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-a con 0x55f4280ec6c0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:22.874 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-c con 0x55f4280f1300 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:22.874 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.874 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.874 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.874 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:22.874 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): authenticate will time out at 2191.146931s 2024-09-12T00:36:22.874 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): get_auth_request con 0x55f4280f1300 auth_method 0 2024-09-12T00:36:22.874 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.874 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.874 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.875 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:36:22.575+0000 7feb62a74640 10 monclient(hunting): get_auth_request con 0x55f4280ec6c0 auth_method 0 2024-09-12T00:36:22.875 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:36:22.575+0000 7feb62a74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.875 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:36:22.575+0000 7feb62a74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.875 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:36:22.575+0000 7feb62a74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.875 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:36:22.575+0000 7feb5bfff640 10 monclient(hunting): get_auth_request con 0x55f4280c1110 auth_method 0 2024-09-12T00:36:22.875 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:36:22.575+0000 7feb5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.875 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:36:22.575+0000 7feb5bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.875 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:36:22.575+0000 7feb5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.875 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.875 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.875 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.875 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:36:22.575+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.875 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:36:22.575+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.875 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:36:22.575+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.876 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:36:22.575+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.876 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:36:22.575+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.876 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:36:22.575+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.876 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): handle_auth_done global_id 7598 payload 824 2024-09-12T00:36:22.876 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient: _finish_hunting 0 2024-09-12T00:36:22.876 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:36:22.575+0000 7feb62273640 1 monclient: found mon.noname-c 2024-09-12T00:36:22.876 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.876 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.876 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:22.876 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: dump: 2024-09-12T00:36:22.876 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.876 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.876 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: _finish_auth 0 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: _check_auth_tickets 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: dump: 2024-09-12T00:36:22.877 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:36:22.575+0000 7feb6652b800 5 monclient: authenticate success, global_id 7598 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:36:22.575+0000 7fea45ffb640 4 set_mon_vals no callback set 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:36:22.575+0000 7feb6652b800 10 monclient: _renew_subs 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:36:22.575+0000 7feb6652b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:36:22.575+0000 7feb6652b800 10 monclient: _renew_subs 2024-09-12T00:36:22.878 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:36:22.575+0000 7feb6652b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.879 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:36:22.575+0000 7feb6652b800 1 librados: init done 2024-09-12T00:36:22.879 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:36:22.575+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command cr dump hook 0x55f4280e13d8 2024-09-12T00:36:22.879 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:36:22.577+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.879 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:36:22.577+0000 7fea33fff640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:36:22.879 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:36:22.577+0000 7fea33fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:22.879 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:36:22.577+0000 7fea33fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:22.879 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:36:22.577+0000 7feb5bfff640 10 monclient: get_auth_request con 0x7fea2c076470 auth_method 0 2024-09-12T00:36:22.879 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:36:22.578+0000 7feb62a74640 10 monclient: get_auth_request con 0x55f42810b4c0 auth_method 0 2024-09-12T00:36:22.879 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.879 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:36:22.578+0000 7feb6652b800 20 realm 2024-09-12T00:36:22.879 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.879 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.879 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:36:22.578+0000 7feb6652b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:22.879 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.880 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.880 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.880 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:36:22.579+0000 7feb5bfff640 10 monclient: get_auth_request con 0x55f42810f730 auth_method 0 2024-09-12T00:36:22.880 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:36:22.579+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.880 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:36:22.579+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.880 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:36:22.579+0000 7feb62a74640 10 monclient: get_auth_request con 0x55f428112f90 auth_method 0 2024-09-12T00:36:22.880 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:36:22.580+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:22.880 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:36:22.580+0000 7feb6652b800 20 searching for the correct realm 2024-09-12T00:36:22.880 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:36:22.580+0000 7feb62273640 10 monclient: get_auth_request con 0x7feb5c02e040 auth_method 0 2024-09-12T00:36:22.880 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:36:22.581+0000 7feb5bfff640 10 monclient: get_auth_request con 0x7feb4c056980 auth_method 0 2024-09-12T00:36:22.880 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:36:22.582+0000 7feb5bfff640 0 -- 172.21.15.133:0/783716372 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7feb4c056980 msgr2=0x7feb4c063480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:22.880 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:36:22.582+0000 7fea33fff640 1 client.7598.objecter ms_handle_reset 0x7feb4c056980 session 0x7feb4c005040 osd.0 2024-09-12T00:36:22.880 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:36:22.582+0000 7fea33fff640 10 monclient: _renew_subs 2024-09-12T00:36:22.880 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:36:22.582+0000 7fea33fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.881 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:36:22.582+0000 7feb5bfff640 10 monclient: get_auth_request con 0x7fea2c0866a0 auth_method 0 2024-09-12T00:36:22.881 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:36:22.582+0000 7feb62a74640 10 monclient: get_auth_request con 0x7feb5c02e420 auth_method 0 2024-09-12T00:36:22.881 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:36:22.583+0000 7fea33fff640 1 client.7598.objecter ms_handle_reset 0x55f42810b4c0 session 0x55f42810adf0 osd.6 2024-09-12T00:36:22.881 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:36:22.583+0000 7feb62a74640 10 monclient: get_auth_request con 0x7feb4c056980 auth_method 0 2024-09-12T00:36:22.881 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:36:22.584+0000 7feb62273640 10 monclient: get_auth_request con 0x7feb4c08e420 auth_method 0 2024-09-12T00:36:22.881 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:36:22.585+0000 7feb62273640 0 -- 172.21.15.133:0/783716372 >> [v2:172.21.15.160:6818/507321805,v1:172.21.15.160:6819/507321805] conn(0x7feb4c08e420 msgr2=0x7feb4c08e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:22.881 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:36:22.786+0000 7feb62273640 10 monclient: get_auth_request con 0x7feb4c08e420 auth_method 0 2024-09-12T00:36:22.881 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:36:22.787+0000 7feb5bfff640 10 monclient: get_auth_request con 0x7feb54090930 auth_method 0 2024-09-12T00:36:22.881 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:22.881 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:22.881 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:22.881 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:22.881 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:22.881 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 zone default found 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:36:22.793+0000 7feb6652b800 4 Realm: () 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:36:22.793+0000 7feb6652b800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:36:22.793+0000 7feb6652b800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:36:22.793+0000 7feb6652b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 zonegroup default 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.882 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.883 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.883 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:36:22.794+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.883 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:36:22.794+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.883 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:36:22.794+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.883 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:36:22.794+0000 7feb6652b800 20 started sync module instance, tier type = 2024-09-12T00:36:22.883 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:36:22.794+0000 7feb6652b800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:22.883 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=0 2024-09-12T00:36:22.883 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=1 2024-09-12T00:36:22.883 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=2 2024-09-12T00:36:22.883 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=3 2024-09-12T00:36:22.884 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=4 2024-09-12T00:36:22.884 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=5 2024-09-12T00:36:22.884 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=6 2024-09-12T00:36:22.884 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:36:22.803+0000 7feb6652b800 20 add_watcher() i=7 2024-09-12T00:36:22.884 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:36:22.803+0000 7feb6652b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:22.884 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding auth protocol: cephx 2024-09-12T00:36:22.884 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding auth protocol: cephx 2024-09-12T00:36:22.884 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding auth protocol: cephx 2024-09-12T00:36:22.884 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: secure 2024-09-12T00:36:22.884 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: crc 2024-09-12T00:36:22.884 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: secure 2024-09-12T00:36:22.884 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: crc 2024-09-12T00:36:22.884 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: secure 2024-09-12T00:36:22.884 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: crc 2024-09-12T00:36:22.885 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: crc 2024-09-12T00:36:22.885 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: secure 2024-09-12T00:36:22.885 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: crc 2024-09-12T00:36:22.885 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: secure 2024-09-12T00:36:22.885 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: crc 2024-09-12T00:36:22.885 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: secure 2024-09-12T00:36:22.885 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:36:22.806+0000 7fea18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:22.885 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:36:22.806+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.885 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:36:22.806+0000 7feb6652b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:22.885 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:36:22.806+0000 7feb6652b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:22.885 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command cache list hook 0x55f4280e1e40 2024-09-12T00:36:22.885 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command cache inspect hook 0x55f4280e1e40 2024-09-12T00:36:22.885 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command cache erase hook 0x55f4280e1e40 2024-09-12T00:36:22.885 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command cache zap hook 0x55f4280e1e40 2024-09-12T00:36:22.886 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 note: GC not initialized 2024-09-12T00:36:22.886 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:36:22.806+0000 7fe9937fe640 20 reqs_thread_entry: start 2024-09-12T00:36:22.886 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command sync trace show hook 0x7feb4c06b330 2024-09-12T00:36:22.886 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command sync trace history hook 0x7feb4c06b330 2024-09-12T00:36:22.886 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command sync trace active hook 0x7feb4c06b330 2024-09-12T00:36:22.886 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command sync trace active_short hook 0x7feb4c06b330 2024-09-12T00:36:22.886 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:36:22.806+0000 7feb6652b800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:22.886 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:36:22.806+0000 7feb6652b800 20 Filter name: none 2024-09-12T00:36:22.886 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:36:22.806+0000 7fe9917fa640 20 reqs_thread_entry: start 2024-09-12T00:36:22.886 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:36:22.807+0000 7feb6652b800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:36:22.886 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:36:22.807+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.886 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:36:22.807+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:22.886 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:36:22.807+0000 7feb6652b800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:36:22.886 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:36:22.807+0000 7feb6652b800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:36:22.887 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:36:22.807+0000 7feb6652b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 : miss 2024-09-12T00:36:22.887 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:36:22.807+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.887 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:36:22.808+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:22.887 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:36:22.808+0000 7feb6652b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:22.887 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:36:22.808+0000 7feb6652b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:22.887 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:36:22.808+0000 7feb6652b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:22.887 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:36:22.808+0000 7feb6652b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:22.887 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:36:22.808+0000 7feb6652b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 2024-09-12T00:36:22.887 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:36:22.811+0000 7feb6652b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:22.887 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:36:22.811+0000 7feb6652b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:22.887 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:36:22.811+0000 7feb6652b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:22.887 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:36:22.811+0000 7feb6652b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40, ofs0, ns] 2024-09-12T00:36:22.887 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:36:22.811+0000 7fea45ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497067 cookie 94507132622928 notifier 7598 bl.length()=1015 2024-09-12T00:36:22.887 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:36:22.811+0000 7fea45ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:22.888 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:36:22.811+0000 7fea45ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:22.888 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:36:22.811+0000 7fea45ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:22.888 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:36:22.813+0000 7feb6652b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): orig_sources= new_sources= 2024-09-12T00:36:22.888 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:36:22.813+0000 7feb6652b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): potential sources added=[] removed=[] 2024-09-12T00:36:22.888 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:36:22.813+0000 7feb6652b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): orig_dests= new_dests= 2024-09-12T00:36:22.888 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:36:22.813+0000 7feb6652b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): potential dests added=[] removed=[] 2024-09-12T00:36:22.888 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:36:22.815+0000 7feb6652b800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.1.0 2024-09-12T00:36:22.888 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:36:22.815+0000 7feb6652b800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.1.0 2024-09-12T00:36:22.888 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:36:22.815+0000 7feb6652b800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.1.1 2024-09-12T00:36:22.888 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:36:22.815+0000 7feb6652b800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.1.1 2024-09-12T00:36:22.888 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:36:22.815+0000 7feb6652b800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.0 2024-09-12T00:36:22.888 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:36:22.818+0000 7feb6652b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feb6652b800 time 2024-09-12T00:36:22.818955+0000 2024-09-12T00:36:22.888 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feb67d8c71a] 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feb67d8c8d8] 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f42568f641] 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55f42569e51b] 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f42569f3e4] 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7feb66a29590] 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:36:22.819+0000 7feb6652b800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:22.889 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7feb6652b800 thread_name:radosgw-admin 2024-09-12T00:36:22.890 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.890 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:22.890 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7feb66a3e6f0] 2024-09-12T00:36:22.890 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7feb66a8b99c] 2024-09-12T00:36:22.890 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:36:22.890 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:36:22.890 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feb67d8c774] 2024-09-12T00:36:22.890 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feb67d8c8d8] 2024-09-12T00:36:22.890 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f42568f641] 2024-09-12T00:36:22.890 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55f42569e51b] 2024-09-12T00:36:22.890 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f42569f3e4] 2024-09-12T00:36:22.890 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:36:22.890 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7feb66a29590] 2024-09-12T00:36:22.890 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:36:22.891 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:36:22.892 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:36:22.892 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:36:22.892 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:36:22.892 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:36:22.892 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:36:22.892 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:36:22.892 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:36:22.892 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:36:22.892 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:36:22.892 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:36:22.892 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:36:22.892 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:36:22.892 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:36:22.892 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:36:22.893 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:36:22.893 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:36:22.893 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:36:22.893 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:36:22.893 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:36:22.893 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:36:22.893 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:36:22.893 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:36:22.893 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:36:22.893 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:36:22.893 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:36:22.893 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:36:22.893 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:36:22.893 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:36:22.894 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:36:22.894 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:36:22.894 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:36:22.894 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:36:22.894 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:36:22.894 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:36:22.894 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:36:22.894 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:36:22.894 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:36:22.894 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:36:22.894 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:36:22.894 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:36:22.894 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:36:22.894 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:36:22.895 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:36:22.896 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:36:22.896 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:36:22.896 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:36:22.896 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:36:22.896 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:36:22.896 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:36:22.896 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:36:22.896 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:36:22.896 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:36:22.896 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:36:22.896 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:36:22.896 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:36:22.896 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:36:22.896 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:36:22.897 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:36:22.897 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:36:22.897 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:36:22.897 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:36:22.897 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:36:22.897 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:36:22.897 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:36:22.897 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:36:22.897 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:36:22.897 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:36:22.897 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:36:22.897 INFO:tasks.workunit.client.0.smithi133.stderr: 7fe9917fa640 / http_manager 2024-09-12T00:36:22.897 INFO:tasks.workunit.client.0.smithi133.stderr: 7fe9937fe640 / http_manager 2024-09-12T00:36:22.897 INFO:tasks.workunit.client.0.smithi133.stderr: 7fea18fe1640 / rgw_dt_lg_renew 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi133.stderr: 7fea33fff640 / ms_dispatch 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi133.stderr: 7fea45ffb640 / io_context_pool 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi133.stderr: 7fea47fff640 / ms_dispatch 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi133.stderr: 7fea4ee05640 / ms_dispatch 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi133.stderr: 7fea50608640 / io_context_pool 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi133.stderr: 7feb5bfff640 / msgr-worker-2 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi133.stderr: 7feb62273640 / msgr-worker-1 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi133.stderr: 7feb62a74640 / msgr-worker-0 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi133.stderr: 7feb63275640 / io_context_pool 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi133.stderr: 7feb6652b800 / radosgw-admin 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/log/ceph/ceph-client.admin.144755.log 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:36:22.898 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:36:22.899 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: crc 2024-09-12T00:36:22.899 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: secure 2024-09-12T00:36:22.899 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: crc 2024-09-12T00:36:22.899 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: secure 2024-09-12T00:36:22.899 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: crc 2024-09-12T00:36:22.899 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: crc 2024-09-12T00:36:22.899 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: secure 2024-09-12T00:36:22.899 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: crc 2024-09-12T00:36:22.899 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: secure 2024-09-12T00:36:22.899 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: crc 2024-09-12T00:36:22.899 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f4280237b0) adding con mode: secure 2024-09-12T00:36:22.899 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:36:22.561+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.899 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:36:22.561+0000 7feb6652b800 1 librados: starting msgr at 2024-09-12T00:36:22.899 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:36:22.561+0000 7feb6652b800 1 librados: starting objecter 2024-09-12T00:36:22.900 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command objecter_requests hook 0x55f42804c7c0 2024-09-12T00:36:22.900 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:36:22.561+0000 7feb6652b800 1 librados: setting wanted keys 2024-09-12T00:36:22.900 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:36:22.561+0000 7feb6652b800 1 librados: calling monclient init 2024-09-12T00:36:22.900 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:36:22.561+0000 7feb6652b800 10 monclient: init 2024-09-12T00:36:22.900 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding auth protocol: cephx 2024-09-12T00:36:22.900 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding auth protocol: cephx 2024-09-12T00:36:22.900 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding auth protocol: cephx 2024-09-12T00:36:22.900 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: secure 2024-09-12T00:36:22.900 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: crc 2024-09-12T00:36:22.900 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: secure 2024-09-12T00:36:22.900 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: crc 2024-09-12T00:36:22.900 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: secure 2024-09-12T00:36:22.900 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: crc 2024-09-12T00:36:22.900 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: crc 2024-09-12T00:36:22.901 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: secure 2024-09-12T00:36:22.901 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: crc 2024-09-12T00:36:22.901 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: secure 2024-09-12T00:36:22.901 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: crc 2024-09-12T00:36:22.901 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 AuthRegistry(0x55f42801db00) adding con mode: secure 2024-09-12T00:36:22.901 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:36:22.561+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.901 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:36:22.561+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.901 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:36:22.561+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command rotate-key hook 0x55f42801dc48 2024-09-12T00:36:22.901 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:36:22.561+0000 7feb6652b800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:22.901 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:36:22.561+0000 7feb6652b800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:36:22.901 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:36:22.561+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-c con 0x55f427ecbf20 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:22.901 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-b con 0x55f427ed4d10 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:22.901 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-a con 0x55f427f67020 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:22.901 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient(hunting): authenticate will time out at 2191.134026s 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): get_auth_request con 0x55f427ecbf20 auth_method 0 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:36:22.562+0000 7feb62a74640 10 monclient(hunting): get_auth_request con 0x55f427f67020 auth_method 0 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:36:22.562+0000 7feb62a74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:36:22.562+0000 7feb62a74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:36:22.562+0000 7feb62a74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.902 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.903 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.903 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:36:22.562+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.903 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:36:22.562+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.903 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:36:22.562+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.903 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:36:22.562+0000 7feb5bfff640 10 monclient(hunting): get_auth_request con 0x55f427ed4d10 auth_method 0 2024-09-12T00:36:22.903 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:36:22.562+0000 7feb5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.903 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:36:22.562+0000 7feb5bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.903 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:36:22.562+0000 7feb5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.903 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient(hunting): handle_auth_done global_id 7589 payload 824 2024-09-12T00:36:22.903 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient: _finish_hunting 0 2024-09-12T00:36:22.903 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:36:22.562+0000 7feb62273640 1 monclient: found mon.noname-c 2024-09-12T00:36:22.903 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:36:22.562+0000 7feb62273640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.903 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.903 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:22.904 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: dump: 2024-09-12T00:36:22.904 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.904 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.904 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.904 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.904 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.904 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.904 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.904 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.904 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.904 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.904 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: _finish_auth 0 2024-09-12T00:36:22.904 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: _check_auth_tickets 2024-09-12T00:36:22.904 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:36:22.562+0000 7feb6652b800 5 monclient: authenticate success, global_id 7589 2024-09-12T00:36:22.905 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient: _renew_subs 2024-09-12T00:36:22.905 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.905 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:22.905 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.905 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:22.905 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:36:22.562+0000 7fea4ee05640 10 monclient: dump: 2024-09-12T00:36:22.905 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.905 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.905 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.905 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.905 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.905 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.905 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.905 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.906 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.906 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.906 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:36:22.562+0000 7fea50608640 4 set_mon_vals no callback set 2024-09-12T00:36:22.906 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient: _renew_subs 2024-09-12T00:36:22.906 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:36:22.562+0000 7feb6652b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.906 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:36:22.562+0000 7feb6652b800 1 librados: init done 2024-09-12T00:36:22.906 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:36:22.564+0000 7fea4ee05640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:36:22.906 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:36:22.564+0000 7fea4ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:22.906 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:36:22.564+0000 7fea4ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:22.906 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:36:22.564+0000 7feb5bfff640 10 monclient: get_auth_request con 0x7fea48076470 auth_method 0 2024-09-12T00:36:22.906 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:36:22.565+0000 7feb62a74640 10 monclient: get_auth_request con 0x55f4280468c0 auth_method 0 2024-09-12T00:36:22.906 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:36:22.565+0000 7feb62273640 10 monclient: get_auth_request con 0x55f428069190 auth_method 0 2024-09-12T00:36:22.906 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:36:22.566+0000 7feb5bfff640 10 monclient: get_auth_request con 0x55f42806d4f0 auth_method 0 2024-09-12T00:36:22.906 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:36:22.567+0000 7feb62a74640 10 monclient: get_auth_request con 0x55f42806ca40 auth_method 0 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:36:22.568+0000 7feb6652b800 10 monclient: build_initial_monmap 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:36:22.568+0000 7feb6652b800 1 build_initial for_mkfs: 0 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:36:22.568+0000 7feb6652b800 10 monclient: monmap: 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding auth protocol: cephx 2024-09-12T00:36:22.907 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding auth protocol: cephx 2024-09-12T00:36:22.908 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding auth protocol: cephx 2024-09-12T00:36:22.908 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: secure 2024-09-12T00:36:22.908 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: crc 2024-09-12T00:36:22.908 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: secure 2024-09-12T00:36:22.908 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: crc 2024-09-12T00:36:22.908 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: secure 2024-09-12T00:36:22.908 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: crc 2024-09-12T00:36:22.908 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: crc 2024-09-12T00:36:22.908 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: secure 2024-09-12T00:36:22.908 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: crc 2024-09-12T00:36:22.908 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: secure 2024-09-12T00:36:22.908 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: crc 2024-09-12T00:36:22.908 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428075640) adding con mode: secure 2024-09-12T00:36:22.908 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:36:22.568+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.909 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command objecter_requests cmddesc objecter_requests hook 0x55f428078af0 EEXIST 2024-09-12T00:36:22.909 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:36:22.568+0000 7feb6652b800 10 monclient: init 2024-09-12T00:36:22.909 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding auth protocol: cephx 2024-09-12T00:36:22.909 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding auth protocol: cephx 2024-09-12T00:36:22.909 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding auth protocol: cephx 2024-09-12T00:36:22.909 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: secure 2024-09-12T00:36:22.909 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: crc 2024-09-12T00:36:22.909 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: secure 2024-09-12T00:36:22.909 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: crc 2024-09-12T00:36:22.909 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: secure 2024-09-12T00:36:22.909 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: crc 2024-09-12T00:36:22.909 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: crc 2024-09-12T00:36:22.909 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: secure 2024-09-12T00:36:22.909 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: crc 2024-09-12T00:36:22.910 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: secure 2024-09-12T00:36:22.910 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: crc 2024-09-12T00:36:22.910 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:36:22.568+0000 7feb6652b800 5 AuthRegistry(0x55f428074538) adding con mode: secure 2024-09-12T00:36:22.910 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:36:22.568+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.910 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:36:22.569+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.910 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:36:22.569+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command rotate-key cmddesc rotate-key hook 0x55f428074680 EEXIST 2024-09-12T00:36:22.910 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:22.910 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:36:22.910 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-a con 0x55f42809ce10 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:22.910 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-b con 0x55f42809d1f0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:22.910 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-c con 0x55f42809bb20 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:22.910 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.910 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.910 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.911 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:22.911 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient(hunting): authenticate will time out at 2191.141194s 2024-09-12T00:36:22.911 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): get_auth_request con 0x55f42809bb20 auth_method 0 2024-09-12T00:36:22.911 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.911 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.911 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.911 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:36:22.569+0000 7feb5bfff640 10 monclient(hunting): get_auth_request con 0x55f42809ce10 auth_method 0 2024-09-12T00:36:22.911 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:36:22.569+0000 7feb5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.911 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:36:22.569+0000 7feb5bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.911 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:36:22.569+0000 7feb5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.911 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.911 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.911 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.911 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:36:22.569+0000 7feb62a74640 10 monclient(hunting): get_auth_request con 0x55f42809d1f0 auth_method 0 2024-09-12T00:36:22.912 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:36:22.569+0000 7feb62a74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.912 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:36:22.569+0000 7feb62a74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.912 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:36:22.569+0000 7feb62a74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.912 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:36:22.569+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.912 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:36:22.569+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.912 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:36:22.569+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.912 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:36:22.569+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.912 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:36:22.569+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.912 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:36:22.569+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.912 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient(hunting): handle_auth_done global_id 7592 payload 824 2024-09-12T00:36:22.912 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient: _finish_hunting 0 2024-09-12T00:36:22.912 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:36:22.569+0000 7feb62273640 1 monclient: found mon.noname-c 2024-09-12T00:36:22.912 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:36:22.569+0000 7feb62273640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.912 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.913 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:22.913 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: dump: 2024-09-12T00:36:22.913 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.913 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.913 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.913 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.913 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.913 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.913 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.913 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.913 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.913 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.913 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: _finish_auth 0 2024-09-12T00:36:22.913 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: _check_auth_tickets 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:36:22.569+0000 7fea47fff640 10 monclient: dump: 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.914 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.915 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:36:22.569+0000 7feb6652b800 5 monclient: authenticate success, global_id 7592 2024-09-12T00:36:22.915 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient: _renew_subs 2024-09-12T00:36:22.915 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:36:22.569+0000 7feb63275640 4 set_mon_vals no callback set 2024-09-12T00:36:22.915 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.915 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient: _renew_subs 2024-09-12T00:36:22.915 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:36:22.569+0000 7feb6652b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.915 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:36:22.571+0000 7fea47fff640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:36:22.915 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:36:22.571+0000 7fea47fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:22.915 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:36:22.571+0000 7fea47fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:22.915 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:36:22.571+0000 7feb5bfff640 10 monclient: get_auth_request con 0x7fea3c076380 auth_method 0 2024-09-12T00:36:22.915 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:36:22.571+0000 7feb6652b800 10 monclient: get_monmap_and_config 2024-09-12T00:36:22.915 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:36:22.571+0000 7feb6652b800 10 monclient: build_initial_monmap 2024-09-12T00:36:22.915 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:36:22.571+0000 7feb6652b800 1 build_initial for_mkfs: 0 2024-09-12T00:36:22.915 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:36:22.571+0000 7feb6652b800 10 monclient: monmap: 2024-09-12T00:36:22.915 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:36:22.916 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:22.916 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:36:22.916 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:36:22.916 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:22.916 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.916 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:36:22.916 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:36:22.916 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:36:22.916 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.916 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding auth protocol: cephx 2024-09-12T00:36:22.916 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding auth protocol: cephx 2024-09-12T00:36:22.916 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding auth protocol: cephx 2024-09-12T00:36:22.916 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: secure 2024-09-12T00:36:22.917 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: crc 2024-09-12T00:36:22.917 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: secure 2024-09-12T00:36:22.917 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: crc 2024-09-12T00:36:22.917 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: secure 2024-09-12T00:36:22.917 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: crc 2024-09-12T00:36:22.917 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: crc 2024-09-12T00:36:22.917 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: secure 2024-09-12T00:36:22.917 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: crc 2024-09-12T00:36:22.917 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: secure 2024-09-12T00:36:22.917 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: crc 2024-09-12T00:36:22.917 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:36:22.571+0000 7feb6652b800 5 AuthRegistry(0x55f4280bcc60) adding con mode: secure 2024-09-12T00:36:22.917 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:36:22.572+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.917 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient: init 2024-09-12T00:36:22.917 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding auth protocol: cephx 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding auth protocol: cephx 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding auth protocol: cephx 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: secure 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: crc 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: secure 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: crc 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: secure 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: crc 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: crc 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: secure 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: crc 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: secure 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: crc 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfa00) adding con mode: secure 2024-09-12T00:36:22.918 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:36:22.572+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.919 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:36:22.572+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.919 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:36:22.572+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command rotate-key cmddesc rotate-key hook 0x7ffc0a7dfb48 EEXIST 2024-09-12T00:36:22.919 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:22.919 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:36:22.919 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-c con 0x55f4280f1300 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:22.919 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-a con 0x55f4280c1110 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:22.919 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-b con 0x55f4280ec6c0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:22.919 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.919 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.919 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.919 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:22.919 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:36:22.572+0000 7feb6652b800 10 monclient(hunting): authenticate will time out at 2191.144734s 2024-09-12T00:36:22.919 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:36:22.572+0000 7feb5bfff640 10 monclient(hunting): get_auth_request con 0x55f4280f1300 auth_method 0 2024-09-12T00:36:22.919 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:36:22.572+0000 7feb5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.920 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:36:22.572+0000 7feb5bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.920 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:36:22.572+0000 7feb5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.920 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:36:22.572+0000 7feb62a74640 10 monclient(hunting): get_auth_request con 0x55f4280c1110 auth_method 0 2024-09-12T00:36:22.920 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:36:22.572+0000 7feb62a74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.920 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:36:22.572+0000 7feb62a74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.920 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:36:22.572+0000 7feb62a74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.920 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:36:22.572+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.920 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:36:22.572+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.920 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:36:22.572+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.920 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:36:22.572+0000 7feb62273640 10 monclient(hunting): get_auth_request con 0x55f4280ec6c0 auth_method 0 2024-09-12T00:36:22.920 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:36:22.572+0000 7feb62273640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.920 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:36:22.572+0000 7feb62273640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.920 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:36:22.572+0000 7feb62273640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.920 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:36:22.572+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:36:22.572+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:36:22.572+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:36:22.572+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:36:22.572+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:36:22.572+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:36:22.573+0000 7feb5bfff640 10 monclient(hunting): handle_auth_done global_id 7595 payload 274 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:36:22.573+0000 7feb5bfff640 10 monclient: _finish_hunting 0 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:36:22.573+0000 7feb5bfff640 1 monclient: found mon.noname-c 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:36:22.573+0000 7feb5bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: dump: 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.921 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.922 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.922 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.922 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.922 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.922 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.922 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.922 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.922 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.922 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: _finish_auth 0 2024-09-12T00:36:22.922 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:36:22.922 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:36:22.573+0000 7feb6652b800 5 monclient: authenticate success, global_id 7595 2024-09-12T00:36:22.922 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:22.922 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.922 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:22.923 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:36:22.573+0000 7fea45ffb640 10 monclient: dump: 2024-09-12T00:36:22.923 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.923 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.923 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.923 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.923 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.923 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.923 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.923 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.923 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.923 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.923 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:36:22.573+0000 7feb6652b800 10 monclient: get_monmap_and_config success 2024-09-12T00:36:22.923 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:36:22.573+0000 7feb6652b800 4 set_mon_vals no callback set 2024-09-12T00:36:22.923 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:36:22.573+0000 7feb6652b800 10 monclient: shutdown 2024-09-12T00:36:22.923 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:36:22.573+0000 7feb6652b800 10 monclient: build_initial_monmap 2024-09-12T00:36:22.924 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:36:22.573+0000 7feb6652b800 1 build_initial for_mkfs: 0 2024-09-12T00:36:22.924 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:36:22.573+0000 7feb6652b800 10 monclient: monmap: 2024-09-12T00:36:22.924 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:36:22.924 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:22.924 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:36:22.924 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:36:22.924 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:22.924 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.924 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:36:22.924 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:36:22.924 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:36:22.924 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.924 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding auth protocol: cephx 2024-09-12T00:36:22.924 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding auth protocol: cephx 2024-09-12T00:36:22.925 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding auth protocol: cephx 2024-09-12T00:36:22.925 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: secure 2024-09-12T00:36:22.925 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: crc 2024-09-12T00:36:22.925 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: secure 2024-09-12T00:36:22.925 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: crc 2024-09-12T00:36:22.925 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: secure 2024-09-12T00:36:22.925 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: crc 2024-09-12T00:36:22.925 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: crc 2024-09-12T00:36:22.925 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: secure 2024-09-12T00:36:22.925 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: crc 2024-09-12T00:36:22.925 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: secure 2024-09-12T00:36:22.925 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: crc 2024-09-12T00:36:22.925 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280ecbf0) adding con mode: secure 2024-09-12T00:36:22.925 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:36:22.574+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.926 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:36:22.574+0000 7feb6652b800 1 librados: starting msgr at 2024-09-12T00:36:22.926 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:36:22.574+0000 7feb6652b800 1 librados: starting objecter 2024-09-12T00:36:22.926 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command objecter_requests cmddesc objecter_requests hook 0x55f4280c0f40 EEXIST 2024-09-12T00:36:22.926 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:36:22.574+0000 7feb6652b800 1 librados: setting wanted keys 2024-09-12T00:36:22.926 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:36:22.574+0000 7feb6652b800 1 librados: calling monclient init 2024-09-12T00:36:22.926 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient: init 2024-09-12T00:36:22.926 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding auth protocol: cephx 2024-09-12T00:36:22.926 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding auth protocol: cephx 2024-09-12T00:36:22.926 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding auth protocol: cephx 2024-09-12T00:36:22.926 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: secure 2024-09-12T00:36:22.926 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: crc 2024-09-12T00:36:22.926 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: secure 2024-09-12T00:36:22.926 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: crc 2024-09-12T00:36:22.926 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: secure 2024-09-12T00:36:22.927 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: crc 2024-09-12T00:36:22.927 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: crc 2024-09-12T00:36:22.927 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: secure 2024-09-12T00:36:22.928 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: crc 2024-09-12T00:36:22.928 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: secure 2024-09-12T00:36:22.928 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: crc 2024-09-12T00:36:22.928 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 AuthRegistry(0x55f4280b16d0) adding con mode: secure 2024-09-12T00:36:22.928 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:36:22.574+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.928 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:36:22.574+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.928 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:36:22.574+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command rotate-key cmddesc rotate-key hook 0x55f4280b1818 EEXIST 2024-09-12T00:36:22.928 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:22.928 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:36:22.928 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-b con 0x55f4280c1110 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:22.928 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-a con 0x55f4280ec6c0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:22.928 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): picked mon.noname-c con 0x55f4280f1300 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:22.928 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.929 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.929 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:22.929 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:22.929 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:36:22.574+0000 7feb6652b800 10 monclient(hunting): authenticate will time out at 2191.146931s 2024-09-12T00:36:22.929 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): get_auth_request con 0x55f4280f1300 auth_method 0 2024-09-12T00:36:22.929 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.929 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.929 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.929 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:36:22.575+0000 7feb62a74640 10 monclient(hunting): get_auth_request con 0x55f4280ec6c0 auth_method 0 2024-09-12T00:36:22.929 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:36:22.575+0000 7feb62a74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.929 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:36:22.575+0000 7feb62a74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.929 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:36:22.575+0000 7feb62a74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.929 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:36:22.575+0000 7feb5bfff640 10 monclient(hunting): get_auth_request con 0x55f4280c1110 auth_method 0 2024-09-12T00:36:22.929 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:36:22.575+0000 7feb5bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:22.930 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:36:22.575+0000 7feb5bfff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:22.930 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:36:22.575+0000 7feb5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:22.930 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.930 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.930 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.930 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:36:22.575+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.930 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:36:22.575+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.930 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:36:22.575+0000 7feb62a74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.930 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:36:22.575+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:22.930 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:36:22.575+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:22.930 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:36:22.575+0000 7feb5bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:22.930 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient(hunting): handle_auth_done global_id 7598 payload 824 2024-09-12T00:36:22.930 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient: _finish_hunting 0 2024-09-12T00:36:22.930 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:36:22.575+0000 7feb62273640 1 monclient: found mon.noname-c 2024-09-12T00:36:22.931 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:36:22.575+0000 7feb62273640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.931 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.931 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:22.931 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: dump: 2024-09-12T00:36:22.931 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.931 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.931 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.931 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.931 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.931 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.931 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.931 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.931 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.931 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.932 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: _finish_auth 0 2024-09-12T00:36:22.932 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: _check_auth_tickets 2024-09-12T00:36:22.932 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:22.932 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:22.932 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:22.932 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:36:22.575+0000 7fea33fff640 10 monclient: dump: 2024-09-12T00:36:22.932 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:22.932 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:22.932 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.932 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:22.932 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:22.932 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:22.932 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:22.932 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:22.933 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:22.933 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.933 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:36:22.575+0000 7feb6652b800 5 monclient: authenticate success, global_id 7598 2024-09-12T00:36:22.933 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:36:22.575+0000 7fea45ffb640 4 set_mon_vals no callback set 2024-09-12T00:36:22.933 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:36:22.575+0000 7feb6652b800 10 monclient: _renew_subs 2024-09-12T00:36:22.933 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:36:22.575+0000 7feb6652b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.933 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:36:22.575+0000 7feb6652b800 10 monclient: _renew_subs 2024-09-12T00:36:22.933 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:36:22.575+0000 7feb6652b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.933 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:36:22.575+0000 7feb6652b800 1 librados: init done 2024-09-12T00:36:22.933 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:36:22.575+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command cr dump hook 0x55f4280e13d8 2024-09-12T00:36:22.933 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:36:22.577+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.933 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:36:22.577+0000 7fea33fff640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:36:22.933 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:36:22.577+0000 7fea33fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:22.933 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:36:22.577+0000 7fea33fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:22.934 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:36:22.577+0000 7feb5bfff640 10 monclient: get_auth_request con 0x7fea2c076470 auth_method 0 2024-09-12T00:36:22.934 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:36:22.578+0000 7feb62a74640 10 monclient: get_auth_request con 0x55f42810b4c0 auth_method 0 2024-09-12T00:36:22.934 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.934 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:36:22.578+0000 7feb6652b800 20 realm 2024-09-12T00:36:22.934 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.934 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.934 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:36:22.578+0000 7feb6652b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:22.934 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.934 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.934 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:36:22.578+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.934 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:36:22.579+0000 7feb5bfff640 10 monclient: get_auth_request con 0x55f42810f730 auth_method 0 2024-09-12T00:36:22.934 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:36:22.579+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.934 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:36:22.579+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.934 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:36:22.579+0000 7feb62a74640 10 monclient: get_auth_request con 0x55f428112f90 auth_method 0 2024-09-12T00:36:22.935 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:36:22.580+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:22.935 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:36:22.580+0000 7feb6652b800 20 searching for the correct realm 2024-09-12T00:36:22.935 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:36:22.580+0000 7feb62273640 10 monclient: get_auth_request con 0x7feb5c02e040 auth_method 0 2024-09-12T00:36:22.935 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:36:22.581+0000 7feb5bfff640 10 monclient: get_auth_request con 0x7feb4c056980 auth_method 0 2024-09-12T00:36:22.935 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:36:22.582+0000 7feb5bfff640 0 -- 172.21.15.133:0/783716372 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7feb4c056980 msgr2=0x7feb4c063480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:22.935 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:36:22.582+0000 7fea33fff640 1 client.7598.objecter ms_handle_reset 0x7feb4c056980 session 0x7feb4c005040 osd.0 2024-09-12T00:36:22.935 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:36:22.582+0000 7fea33fff640 10 monclient: _renew_subs 2024-09-12T00:36:22.935 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:36:22.582+0000 7fea33fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:22.935 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:36:22.582+0000 7feb5bfff640 10 monclient: get_auth_request con 0x7fea2c0866a0 auth_method 0 2024-09-12T00:36:22.935 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:36:22.582+0000 7feb62a74640 10 monclient: get_auth_request con 0x7feb5c02e420 auth_method 0 2024-09-12T00:36:22.935 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:36:22.583+0000 7fea33fff640 1 client.7598.objecter ms_handle_reset 0x55f42810b4c0 session 0x55f42810adf0 osd.6 2024-09-12T00:36:22.935 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:36:22.583+0000 7feb62a74640 10 monclient: get_auth_request con 0x7feb4c056980 auth_method 0 2024-09-12T00:36:22.935 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:36:22.584+0000 7feb62273640 10 monclient: get_auth_request con 0x7feb4c08e420 auth_method 0 2024-09-12T00:36:22.935 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:36:22.585+0000 7feb62273640 0 -- 172.21.15.133:0/783716372 >> [v2:172.21.15.160:6818/507321805,v1:172.21.15.160:6819/507321805] conn(0x7feb4c08e420 msgr2=0x7feb4c08e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:22.936 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:36:22.786+0000 7feb62273640 10 monclient: get_auth_request con 0x7feb4c08e420 auth_method 0 2024-09-12T00:36:22.936 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:36:22.787+0000 7feb5bfff640 10 monclient: get_auth_request con 0x7feb54090930 auth_method 0 2024-09-12T00:36:22.936 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:22.936 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:22.936 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:22.936 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:22.936 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:22.936 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:22.936 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.936 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.936 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:36:22.792+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.936 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.936 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.936 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:22.937 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 zone default found 2024-09-12T00:36:22.937 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:36:22.793+0000 7feb6652b800 4 Realm: () 2024-09-12T00:36:22.937 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:36:22.793+0000 7feb6652b800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:22.937 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:36:22.793+0000 7feb6652b800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:22.937 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:36:22.793+0000 7feb6652b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:22.937 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 zonegroup default 2024-09-12T00:36:22.937 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.937 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.937 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:36:22.793+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.937 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:36:22.794+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.937 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:36:22.794+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.937 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:36:22.794+0000 7feb6652b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.937 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:36:22.794+0000 7feb6652b800 20 started sync module instance, tier type = 2024-09-12T00:36:22.937 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:36:22.794+0000 7feb6652b800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:22.938 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=0 2024-09-12T00:36:22.938 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=1 2024-09-12T00:36:22.938 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=2 2024-09-12T00:36:22.938 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=3 2024-09-12T00:36:22.938 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=4 2024-09-12T00:36:22.938 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=5 2024-09-12T00:36:22.938 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:36:22.802+0000 7feb6652b800 20 add_watcher() i=6 2024-09-12T00:36:22.938 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:36:22.803+0000 7feb6652b800 20 add_watcher() i=7 2024-09-12T00:36:22.938 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:36:22.803+0000 7feb6652b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:22.938 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding auth protocol: cephx 2024-09-12T00:36:22.938 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding auth protocol: cephx 2024-09-12T00:36:22.938 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding auth protocol: cephx 2024-09-12T00:36:22.938 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: secure 2024-09-12T00:36:22.938 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: crc 2024-09-12T00:36:22.939 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: secure 2024-09-12T00:36:22.939 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: crc 2024-09-12T00:36:22.939 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: secure 2024-09-12T00:36:22.939 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: crc 2024-09-12T00:36:22.939 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: crc 2024-09-12T00:36:22.939 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: secure 2024-09-12T00:36:22.939 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: crc 2024-09-12T00:36:22.939 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: secure 2024-09-12T00:36:22.939 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: crc 2024-09-12T00:36:22.939 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 AuthRegistry(0x7ffc0a7dfee0) adding con mode: secure 2024-09-12T00:36:22.939 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:36:22.806+0000 7fea18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:22.939 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:36:22.806+0000 7feb6652b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:22.939 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:36:22.806+0000 7feb6652b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:22.939 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:36:22.806+0000 7feb6652b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:22.939 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command cache list hook 0x55f4280e1e40 2024-09-12T00:36:22.940 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command cache inspect hook 0x55f4280e1e40 2024-09-12T00:36:22.940 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command cache erase hook 0x55f4280e1e40 2024-09-12T00:36:22.940 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command cache zap hook 0x55f4280e1e40 2024-09-12T00:36:22.940 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 note: GC not initialized 2024-09-12T00:36:22.940 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:36:22.806+0000 7fe9937fe640 20 reqs_thread_entry: start 2024-09-12T00:36:22.940 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command sync trace show hook 0x7feb4c06b330 2024-09-12T00:36:22.940 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command sync trace history hook 0x7feb4c06b330 2024-09-12T00:36:22.940 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command sync trace active hook 0x7feb4c06b330 2024-09-12T00:36:22.940 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:36:22.806+0000 7feb6652b800 5 asok(0x55f427dfd630) register_command sync trace active_short hook 0x7feb4c06b330 2024-09-12T00:36:22.940 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:36:22.806+0000 7feb6652b800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:22.940 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:36:22.806+0000 7feb6652b800 20 Filter name: none 2024-09-12T00:36:22.940 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:36:22.806+0000 7fe9917fa640 20 reqs_thread_entry: start 2024-09-12T00:36:22.940 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:36:22.807+0000 7feb6652b800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:36:22.940 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:36:22.807+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:36:22.807+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:36:22.807+0000 7feb6652b800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:36:22.807+0000 7feb6652b800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:36:22.807+0000 7feb6652b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 : miss 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:36:22.807+0000 7feb6652b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:36:22.808+0000 7feb6652b800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:36:22.808+0000 7feb6652b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:36:22.808+0000 7feb6652b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:36:22.808+0000 7feb6652b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:36:22.808+0000 7feb6652b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:36:22.808+0000 7feb6652b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:36:22.811+0000 7feb6652b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:36:22.811+0000 7feb6652b800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:22.941 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:36:22.811+0000 7feb6652b800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:22.942 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:36:22.811+0000 7feb6652b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40, ofs0, ns] 2024-09-12T00:36:22.942 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:36:22.811+0000 7fea45ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497067 cookie 94507132622928 notifier 7598 bl.length()=1015 2024-09-12T00:36:22.942 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:36:22.811+0000 7fea45ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:22.942 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:36:22.811+0000 7fea45ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:22.942 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:36:22.811+0000 7fea45ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:22.942 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:36:22.813+0000 7feb6652b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): orig_sources= new_sources= 2024-09-12T00:36:22.942 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:36:22.813+0000 7feb6652b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): potential sources added=[] removed=[] 2024-09-12T00:36:22.942 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:36:22.813+0000 7feb6652b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): orig_dests= new_dests= 2024-09-12T00:36:22.942 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:36:22.813+0000 7feb6652b800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): potential dests added=[] removed=[] 2024-09-12T00:36:22.942 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:36:22.815+0000 7feb6652b800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.1.0 2024-09-12T00:36:22.942 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:36:22.815+0000 7feb6652b800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.1.0 2024-09-12T00:36:22.942 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:36:22.815+0000 7feb6652b800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.1.1 2024-09-12T00:36:22.942 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:36:22.815+0000 7feb6652b800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.1.1 2024-09-12T00:36:22.942 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:36:22.815+0000 7feb6652b800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.0 2024-09-12T00:36:22.943 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:36:22.818+0000 7feb6652b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7feb6652b800 time 2024-09-12T00:36:22.818955+0000 2024-09-12T00:36:22.943 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:22.943 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.943 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:22.943 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7feb67d8c71a] 2024-09-12T00:36:22.943 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feb67d8c8d8] 2024-09-12T00:36:22.943 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f42568f641] 2024-09-12T00:36:22.943 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55f42569e51b] 2024-09-12T00:36:22.943 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f42569f3e4] 2024-09-12T00:36:22.943 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:36:22.943 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7feb66a29590] 2024-09-12T00:36:22.943 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:36:22.943 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:36:22.943 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.944 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:36:22.819+0000 7feb6652b800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:22.944 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7feb6652b800 thread_name:radosgw-admin 2024-09-12T00:36:22.944 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.944 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:22.944 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7feb66a3e6f0] 2024-09-12T00:36:22.944 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7feb66a8b99c] 2024-09-12T00:36:22.944 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:36:22.944 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:36:22.944 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7feb67d8c774] 2024-09-12T00:36:22.944 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7feb67d8c8d8] 2024-09-12T00:36:22.944 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f42568f641] 2024-09-12T00:36:22.944 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55f42569e51b] 2024-09-12T00:36:22.944 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55f42569f3e4] 2024-09-12T00:36:22.944 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:36:22.945 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7feb66a29590] 2024-09-12T00:36:22.945 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:36:22.945 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:36:22.945 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:22.945 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:22.945 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:36:22.945 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:36:22.945 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:36:22.945 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:36:22.945 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:36:22.945 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:36:22.945 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:36:22.945 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:36:22.945 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:36:22.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:36:22.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:36:22.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:36:22.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:36:22.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:36:22.948 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:36:22.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:36:22.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:36:22.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:36:22.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:36:22.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:36:22.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:36:22.948 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:36:22.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:36:22.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:36:22.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:36:22.949 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:36:22.949 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:36:22.949 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:36:22.949 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:36:22.949 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:36:22.949 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:36:22.949 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:36:22.949 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:36:22.949 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:36:22.949 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:36:22.949 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:36:22.949 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:36:22.949 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:36:22.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:36:22.951 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:36:22.951 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:36:22.951 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:36:22.951 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:36:22.951 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:36:22.951 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:36:22.951 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:36:22.951 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:36:22.951 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:36:22.951 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:36:22.951 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:36:22.951 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:36:22.951 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:36:22.951 INFO:tasks.workunit.client.0.smithi133.stderr: 7fe9917fa640 / http_manager 2024-09-12T00:36:22.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7fe9937fe640 / http_manager 2024-09-12T00:36:22.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7fea18fe1640 / rgw_dt_lg_renew 2024-09-12T00:36:22.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7fea33fff640 / ms_dispatch 2024-09-12T00:36:22.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7fea45ffb640 / io_context_pool 2024-09-12T00:36:22.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7fea47fff640 / ms_dispatch 2024-09-12T00:36:22.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7fea4ee05640 / ms_dispatch 2024-09-12T00:36:22.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7fea50608640 / io_context_pool 2024-09-12T00:36:22.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7feb5bfff640 / msgr-worker-2 2024-09-12T00:36:22.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7feb62273640 / msgr-worker-1 2024-09-12T00:36:22.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7feb62a74640 / msgr-worker-0 2024-09-12T00:36:22.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7feb63275640 / io_context_pool 2024-09-12T00:36:22.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7feb6652b800 / radosgw-admin 2024-09-12T00:36:22.952 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:36:22.952 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:36:22.953 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:36:22.820605Z_fccab5a3-58ee-44a4-83b1-95e3f1deb8c4/log 2024-09-12T00:36:22.953 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:36:22.953 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:36:22.954 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:22.954 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:22.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.897+0000 7f64d1e14800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.899+0000 7f64d1e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.899+0000 7f64d1e14800 20 realm 2024-09-12T00:36:22.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.899+0000 7f64d1e14800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.899+0000 7f64d1e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.899+0000 7f64d1e14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:22.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.899+0000 7f64d1e14800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.899+0000 7f64d1e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.899+0000 7f64d1e14800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.900+0000 7f64d1e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.900+0000 7f64d1e14800 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.900+0000 7f64d1e14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:22.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.900+0000 7f64d1e14800 20 searching for the correct realm 2024-09-12T00:36:22.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:22.901+0000 7f64cd4cb640 0 -- 172.21.15.133:0/788461408 >> [v2:172.21.15.133:6816/1011460824,v1:172.21.15.133:6817/1011460824] conn(0x7f64c808c420 msgr2=0x7f64c808c880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:23.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.106+0000 7f64cd4cb640 0 -- 172.21.15.133:0/788461408 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x55ef56ba5cd0 msgr2=0x55ef56ba8100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:23.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.112+0000 7f64d1e14800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:23.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.112+0000 7f64d1e14800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:23.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.112+0000 7f64d1e14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:23.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.112+0000 7f64d1e14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:23.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.112+0000 7f64d1e14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:23.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.112+0000 7f64d1e14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:23.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.112+0000 7f64d1e14800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.112+0000 7f64d1e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.112+0000 7f64d1e14800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.113+0000 7f64d1e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:23.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.113+0000 7f64d1e14800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.113+0000 7f64d1e14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:23.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.113+0000 7f64d1e14800 20 zone default found 2024-09-12T00:36:23.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.113+0000 7f64d1e14800 4 Realm: () 2024-09-12T00:36:23.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.113+0000 7f64d1e14800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:23.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.113+0000 7f64d1e14800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:23.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.113+0000 7f64d1e14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:23.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.113+0000 7f64d1e14800 20 zonegroup default 2024-09-12T00:36:23.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.113+0000 7f64d1e14800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.113+0000 7f64d1e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.113+0000 7f64d1e14800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.113+0000 7f64d1e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.113+0000 7f64d1e14800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.114+0000 7f64d1e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.114+0000 7f64d1e14800 20 started sync module instance, tier type = 2024-09-12T00:36:23.114 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.114+0000 7f64d1e14800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:23.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.122+0000 7f64d1e14800 20 add_watcher() i=0 2024-09-12T00:36:23.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.122+0000 7f64d1e14800 20 add_watcher() i=1 2024-09-12T00:36:23.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.122+0000 7f64d1e14800 20 add_watcher() i=2 2024-09-12T00:36:23.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.122+0000 7f64d1e14800 20 add_watcher() i=3 2024-09-12T00:36:23.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.122+0000 7f64d1e14800 20 add_watcher() i=4 2024-09-12T00:36:23.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.122+0000 7f64d1e14800 20 add_watcher() i=5 2024-09-12T00:36:23.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.122+0000 7f64d1e14800 20 add_watcher() i=6 2024-09-12T00:36:23.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.123+0000 7f64d1e14800 20 add_watcher() i=7 2024-09-12T00:36:23.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.123+0000 7f64d1e14800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:23.123 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.124+0000 7f63837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.125+0000 7f64d1e14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:23.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.125+0000 7f64d1e14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:23.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.125+0000 7f64d1e14800 5 note: GC not initialized 2024-09-12T00:36:23.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.125+0000 7f63827e4640 20 reqs_thread_entry: start 2024-09-12T00:36:23.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.125+0000 7f64d1e14800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:23.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.125+0000 7f64d1e14800 20 Filter name: none 2024-09-12T00:36:23.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.125+0000 7f62f3fff640 20 reqs_thread_entry: start 2024-09-12T00:36:23.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.125+0000 7f64d1e14800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.126+0000 7f64d1e14800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:23.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.126+0000 7f64d1e14800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.127+0000 7f64d1e14800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:36:23.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.127+0000 7f64d1e14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:23.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.127+0000 7f64d1e14800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.127+0000 7f64d1e14800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:23.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.127+0000 7f64d1e14800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.127+0000 7f64d1e14800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:36:23.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.127+0000 7f64d1e14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:23.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.129+0000 7f63837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.131+0000 7f64d1e14800 20 remove_watcher() i=0 2024-09-12T00:36:23.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.131+0000 7f64d1e14800 2 removed watcher, disabling cache 2024-09-12T00:36:23.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.132+0000 7f64d1e14800 20 remove_watcher() i=1 2024-09-12T00:36:23.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.132+0000 7f64d1e14800 20 remove_watcher() i=2 2024-09-12T00:36:23.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.133+0000 7f64d1e14800 20 remove_watcher() i=3 2024-09-12T00:36:23.133 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.134+0000 7f64d1e14800 20 remove_watcher() i=4 2024-09-12T00:36:23.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.135+0000 7f64d1e14800 20 remove_watcher() i=5 2024-09-12T00:36:23.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.136+0000 7f64d1e14800 20 remove_watcher() i=6 2024-09-12T00:36:23.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.137+0000 7f64d1e14800 20 remove_watcher() i=7 2024-09-12T00:36:23.146 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:23.146 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:36:23.146 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-change-reshard-state id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:36:23.146 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:23.237 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:36:23.268 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:23.268 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:23.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.306+0000 7fdd6dc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.307+0000 7fdd6dc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.307+0000 7fdd6dc0f800 20 realm 2024-09-12T00:36:23.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.307+0000 7fdd6dc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.308+0000 7fdd6dc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.308+0000 7fdd6dc0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:23.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.308+0000 7fdd6dc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.308+0000 7fdd6dc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.308+0000 7fdd6dc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.309+0000 7fdd6dc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:23.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.309+0000 7fdd6dc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.509 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.510+0000 7fdd6dc0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:23.509 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.510+0000 7fdd6dc0f800 20 searching for the correct realm 2024-09-12T00:36:23.510 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.512+0000 7fdd6aef8640 0 -- 172.21.15.133:0/4271157576 >> [v2:172.21.15.133:6824/186004193,v1:172.21.15.133:6825/186004193] conn(0x55e34f103950 msgr2=0x55e34f105d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:23.514 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.515+0000 7fdd6b6f9640 0 -- 172.21.15.133:0/4271157576 >> [v2:172.21.15.160:6818/507321805,v1:172.21.15.160:6819/507321805] conn(0x55e34f103950 msgr2=0x7fdd600619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:23.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.721+0000 7fdd6dc0f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:23.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.721+0000 7fdd6dc0f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:23.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.721+0000 7fdd6dc0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:23.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.722+0000 7fdd6dc0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:23.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.722+0000 7fdd6dc0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:23.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.722+0000 7fdd6dc0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:23.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.722+0000 7fdd6dc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.722+0000 7fdd6dc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.722+0000 7fdd6dc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.722+0000 7fdd6dc0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:23.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.722+0000 7fdd6dc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.722+0000 7fdd6dc0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.722+0000 7fdd6dc0f800 20 zone default found 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.723+0000 7fdd6dc0f800 4 Realm: () 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.723+0000 7fdd6dc0f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.723+0000 7fdd6dc0f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.723+0000 7fdd6dc0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.723+0000 7fdd6dc0f800 20 zonegroup default 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.723+0000 7fdd6dc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.723+0000 7fdd6dc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.723+0000 7fdd6dc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.723+0000 7fdd6dc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.723+0000 7fdd6dc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.723+0000 7fdd6dc0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.724+0000 7fdd6dc0f800 20 started sync module instance, tier type = 2024-09-12T00:36:23.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.724+0000 7fdd6dc0f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:23.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.732+0000 7fdd6dc0f800 20 add_watcher() i=0 2024-09-12T00:36:23.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.732+0000 7fdd6dc0f800 20 add_watcher() i=1 2024-09-12T00:36:23.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.732+0000 7fdd6dc0f800 20 add_watcher() i=2 2024-09-12T00:36:23.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.732+0000 7fdd6dc0f800 20 add_watcher() i=3 2024-09-12T00:36:23.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.732+0000 7fdd6dc0f800 20 add_watcher() i=4 2024-09-12T00:36:23.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.732+0000 7fdd6dc0f800 20 add_watcher() i=5 2024-09-12T00:36:23.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.732+0000 7fdd6dc0f800 20 add_watcher() i=6 2024-09-12T00:36:23.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.734+0000 7fdd6dc0f800 20 add_watcher() i=7 2024-09-12T00:36:23.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.734+0000 7fdd6dc0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:23.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.735+0000 7fdc21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.736+0000 7fdd6dc0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:23.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.736+0000 7fdd6dc0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:23.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.736+0000 7fdd6dc0f800 5 note: GC not initialized 2024-09-12T00:36:23.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.736+0000 7fdc20fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:23.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.736+0000 7fdd6dc0f800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:23.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.736+0000 7fdd6dc0f800 20 Filter name: none 2024-09-12T00:36:23.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.736+0000 7fdb9a7fc640 20 reqs_thread_entry: start 2024-09-12T00:36:23.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.736+0000 7fdd6dc0f800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:36:23.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.736+0000 7fdd6dc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.737+0000 7fdd6dc0f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:23.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.737+0000 7fdd6dc0f800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:36:23.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.737+0000 7fdd6dc0f800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:36:23.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.737+0000 7fdd6dc0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 : miss 2024-09-12T00:36:23.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.737+0000 7fdd6dc0f800 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.737+0000 7fdd6dc0f800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:36:23.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.737+0000 7fdd6dc0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:23.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.737+0000 7fdd6dc0f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:23.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.737+0000 7fdd6dc0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:23.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.737+0000 7fdd6dc0f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:23.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.737+0000 7fdd6dc0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 2024-09-12T00:36:23.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.738+0000 7fdd6dc0f800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to be held by another RGW process; skipping for now 2024-09-12T00:36:23.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.739+0000 7fdc21fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.741+0000 7fdd6dc0f800 20 remove_watcher() i=0 2024-09-12T00:36:23.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.741+0000 7fdd6dc0f800 2 removed watcher, disabling cache 2024-09-12T00:36:23.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.742+0000 7fdd6dc0f800 20 remove_watcher() i=1 2024-09-12T00:36:23.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.743+0000 7fdd6dc0f800 20 remove_watcher() i=2 2024-09-12T00:36:23.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.744+0000 7fdd6dc0f800 20 remove_watcher() i=3 2024-09-12T00:36:23.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.745+0000 7fdd6dc0f800 20 remove_watcher() i=4 2024-09-12T00:36:23.744 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.746+0000 7fdd6dc0f800 20 remove_watcher() i=5 2024-09-12T00:36:23.745 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.746+0000 7fdd6dc0f800 20 remove_watcher() i=6 2024-09-12T00:36:23.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:23.747+0000 7fdd6dc0f800 20 remove_watcher() i=7 2024-09-12T00:36:23.757 INFO:tasks.workunit.client.0.smithi133.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:36:53.778 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:36:53.812 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:53.812 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:53.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:53.854+0000 7f7905539800 20 rados->read ofs=0 len=0 2024-09-12T00:36:53.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:53.856+0000 7f7905539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:53.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:53.856+0000 7f7905539800 20 realm 2024-09-12T00:36:53.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:53.856+0000 7f7905539800 20 rados->read ofs=0 len=0 2024-09-12T00:36:53.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:53.857+0000 7f7905539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:53.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:53.857+0000 7f7905539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:53.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:53.857+0000 7f7905539800 20 rados->read ofs=0 len=0 2024-09-12T00:36:53.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:53.857+0000 7f7905539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:53.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:53.857+0000 7f7905539800 20 rados->read ofs=0 len=0 2024-09-12T00:36:53.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:53.858+0000 7f7905539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:53.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:53.858+0000 7f7905539800 20 rados->read ofs=0 len=0 2024-09-12T00:36:53.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:53.858+0000 7f7905539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:53.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:53.858+0000 7f7905539800 20 searching for the correct realm 2024-09-12T00:36:53.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:53.861+0000 7f79009c6640 0 -- 172.21.15.133:0/3227865378 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f78f8089be0 msgr2=0x7f78f807c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:53.863 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:53.864+0000 7f79009c6640 0 -- 172.21.15.133:0/3227865378 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f78f4016420 msgr2=0x7f78f4016880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:54.070 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.071+0000 7f7905539800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:54.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.071+0000 7f7905539800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:54.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.071+0000 7f7905539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:54.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.071+0000 7f7905539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:54.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.071+0000 7f7905539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:54.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.071+0000 7f7905539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:54.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.071+0000 7f7905539800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.072+0000 7f7905539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:54.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.072+0000 7f7905539800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.072+0000 7f7905539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:54.071 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.072+0000 7f7905539800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.072+0000 7f7905539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:54.072 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.072+0000 7f7905539800 20 zone default found 2024-09-12T00:36:54.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.072+0000 7f7905539800 4 Realm: () 2024-09-12T00:36:54.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.072+0000 7f7905539800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:54.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.072+0000 7f7905539800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:54.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.072+0000 7f7905539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:54.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.072+0000 7f7905539800 20 zonegroup default 2024-09-12T00:36:54.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.072+0000 7f7905539800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.073+0000 7f7905539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:54.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.073+0000 7f7905539800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.073+0000 7f7905539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:54.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.073+0000 7f7905539800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.073+0000 7f7905539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:54.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.073+0000 7f7905539800 20 started sync module instance, tier type = 2024-09-12T00:36:54.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.073+0000 7f7905539800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:54.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.083+0000 7f7905539800 20 add_watcher() i=0 2024-09-12T00:36:54.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.083+0000 7f7905539800 20 add_watcher() i=1 2024-09-12T00:36:54.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.083+0000 7f7905539800 20 add_watcher() i=2 2024-09-12T00:36:54.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.083+0000 7f7905539800 20 add_watcher() i=3 2024-09-12T00:36:54.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.083+0000 7f7905539800 20 add_watcher() i=4 2024-09-12T00:36:54.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.083+0000 7f7905539800 20 add_watcher() i=5 2024-09-12T00:36:54.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.083+0000 7f7905539800 20 add_watcher() i=6 2024-09-12T00:36:54.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.084+0000 7f7905539800 20 add_watcher() i=7 2024-09-12T00:36:54.083 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.084+0000 7f7905539800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:54.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.086+0000 7f77b7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:54.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.087+0000 7f7905539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:54.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.087+0000 7f7905539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:54.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.087+0000 7f7905539800 5 note: GC not initialized 2024-09-12T00:36:54.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.087+0000 7f77b6fe5640 20 reqs_thread_entry: start 2024-09-12T00:36:54.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.087+0000 7f7905539800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:54.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.087+0000 7f7905539800 20 Filter name: none 2024-09-12T00:36:54.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.087+0000 7f7905539800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:36:54.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.087+0000 7f77b4fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:54.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.087+0000 7f7905539800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.088+0000 7f7905539800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:54.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.088+0000 7f7905539800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:36:54.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.088+0000 7f7905539800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:36:54.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.088+0000 7f7905539800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 : miss 2024-09-12T00:36:54.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.088+0000 7f7905539800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.088+0000 7f7905539800 20 rados_obj.operate() r=0 bl.length=475 2024-09-12T00:36:54.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.088+0000 7f7905539800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:54.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.088+0000 7f7905539800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:54.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.088+0000 7f7905539800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:54.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.088+0000 7f7905539800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:54.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.088+0000 7f7905539800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 2024-09-12T00:36:54.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.089+0000 7f7905539800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:36:54.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.093+0000 7f7905539800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:54.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.093+0000 7f7905539800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:54.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.093+0000 7f7905539800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:54.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.093+0000 7f7905539800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40, ofs0, ns] 2024-09-12T00:36:54.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.093+0000 7f77e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497068 cookie 94826324161136 notifier 7652 bl.length()=1015 2024-09-12T00:36:54.092 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.093+0000 7f77e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:54.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.093+0000 7f77e4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:54.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.093+0000 7f77e4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:54.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.095+0000 7f7905539800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): orig_sources= new_sources= 2024-09-12T00:36:54.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.095+0000 7f7905539800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): potential sources added=[] removed=[] 2024-09-12T00:36:54.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.095+0000 7f7905539800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): orig_dests= new_dests= 2024-09-12T00:36:54.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.095+0000 7f7905539800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): potential dests added=[] removed=[] 2024-09-12T00:36:54.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.099+0000 7f7905539800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.2.0 2024-09-12T00:36:54.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.099+0000 7f7905539800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.2.0 2024-09-12T00:36:54.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.099+0000 7f7905539800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.2.1 2024-09-12T00:36:54.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.099+0000 7f7905539800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.2.1 2024-09-12T00:36:54.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.099+0000 7f7905539800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.0 2024-09-12T00:36:54.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.101+0000 7f7905539800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:54.100 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.101+0000 7f7905539800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 2024-09-12T00:36:54.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.102+0000 7f7905539800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:54.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.102+0000 7f7905539800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:54.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.102+0000 7f7905539800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:54.101 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.102+0000 7f7905539800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40, ofs0, ns] 2024-09-12T00:36:54.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.103+0000 7f77e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497069 cookie 94826324161136 notifier 7652 bl.length()=1015 2024-09-12T00:36:54.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.103+0000 7f77e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:54.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.103+0000 7f77e4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:54.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.103+0000 7f77e4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:54.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.104+0000 7f7905539800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): orig_sources= new_sources= 2024-09-12T00:36:54.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.104+0000 7f7905539800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): potential sources added=[] removed=[] 2024-09-12T00:36:54.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.104+0000 7f7905539800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): orig_dests= new_dests= 2024-09-12T00:36:54.103 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.104+0000 7f7905539800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): potential dests added=[] removed=[] 2024-09-12T00:36:54.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.105+0000 7f7905539800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40.0 2024-09-12T00:36:54.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.106+0000 7f7905539800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:54.104 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.106+0000 7f7905539800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 2024-09-12T00:36:54.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.107+0000 7f7905539800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:54.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.107+0000 7f7905539800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:54.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.107+0000 7f7905539800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:54.105 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.107+0000 7f7905539800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40, ofs0, ns] 2024-09-12T00:36:54.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.107+0000 7f77d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497070 cookie 94826324161136 notifier 7652 bl.length()=983 2024-09-12T00:36:54.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.107+0000 7f77d3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 info.flags=0x17 2024-09-12T00:36:54.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.107+0000 7f77d3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 to cache LRU end 2024-09-12T00:36:54.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.107+0000 7f77d3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-12T00:36:54.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.108+0000 7f7905539800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): orig_sources= new_sources= 2024-09-12T00:36:54.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.108+0000 7f7905539800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): potential sources added=[] removed=[] 2024-09-12T00:36:54.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.108+0000 7f7905539800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): orig_dests= new_dests= 2024-09-12T00:36:54.107 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.108+0000 7f7905539800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40]): potential dests added=[] removed=[] 2024-09-12T00:36:54.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.109+0000 7f7905539800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:36:54.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.111+0000 7f77b7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:54.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.114+0000 7f7905539800 20 remove_watcher() i=0 2024-09-12T00:36:54.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.114+0000 7f7905539800 2 removed watcher, disabling cache 2024-09-12T00:36:54.113 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.115+0000 7f7905539800 20 remove_watcher() i=1 2024-09-12T00:36:54.115 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.116+0000 7f7905539800 20 remove_watcher() i=2 2024-09-12T00:36:54.116 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.117+0000 7f7905539800 20 remove_watcher() i=3 2024-09-12T00:36:54.117 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.118+0000 7f7905539800 20 remove_watcher() i=4 2024-09-12T00:36:54.118 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.120+0000 7f7905539800 20 remove_watcher() i=5 2024-09-12T00:36:54.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.121+0000 7f7905539800 20 remove_watcher() i=6 2024-09-12T00:36:54.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.122+0000 7f7905539800 20 remove_watcher() i=7 2024-09-12T00:36:54.133 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:36:54.162 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:54.162 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:54.198 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.199+0000 7f03afb25800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.201+0000 7f03afb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:54.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.201+0000 7f03afb25800 20 realm 2024-09-12T00:36:54.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.201+0000 7f03afb25800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.201+0000 7f03afb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:54.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.201+0000 7f03afb25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:54.200 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.201+0000 7f03afb25800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.202+0000 7f03afb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:54.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.202+0000 7f03afb25800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.202+0000 7f03afb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:54.201 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.202+0000 7f03afb25800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.202 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.203+0000 7f03afb25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:54.202 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.203+0000 7f03afb25800 20 searching for the correct realm 2024-09-12T00:36:54.204 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.205+0000 7f03abfb6640 0 -- 172.21.15.133:0/3646050466 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f03a4077950 msgr2=0x7f03a401a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:54.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.410+0000 7f03ab7b5640 0 -- 172.21.15.133:0/3646050466 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x558623929620 msgr2=0x55862392ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:54.413 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.414+0000 7f03afb25800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:54.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.414+0000 7f03afb25800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:54.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.414+0000 7f03afb25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:54.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.414+0000 7f03afb25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:54.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.415+0000 7f03afb25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:54.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.415+0000 7f03afb25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:54.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.415+0000 7f03afb25800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.415+0000 7f03afb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:54.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.415+0000 7f03afb25800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.415+0000 7f03afb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:54.414 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.415+0000 7f03afb25800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.415+0000 7f03afb25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:54.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.415+0000 7f03afb25800 20 zone default found 2024-09-12T00:36:54.415 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.415+0000 7f03afb25800 4 Realm: () 2024-09-12T00:36:54.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.415+0000 7f03afb25800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:54.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.415+0000 7f03afb25800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:54.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.415+0000 7f03afb25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:54.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.415+0000 7f03afb25800 20 zonegroup default 2024-09-12T00:36:54.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.415+0000 7f03afb25800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.416+0000 7f03afb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:54.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.416+0000 7f03afb25800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.416+0000 7f03afb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:54.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.416+0000 7f03afb25800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.416+0000 7f03afb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:54.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.416+0000 7f03afb25800 20 started sync module instance, tier type = 2024-09-12T00:36:54.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.416+0000 7f03afb25800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:54.424 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.426+0000 7f03afb25800 20 add_watcher() i=0 2024-09-12T00:36:54.424 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.426+0000 7f03afb25800 20 add_watcher() i=1 2024-09-12T00:36:54.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.426+0000 7f03afb25800 20 add_watcher() i=2 2024-09-12T00:36:54.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.426+0000 7f03afb25800 20 add_watcher() i=3 2024-09-12T00:36:54.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.426+0000 7f03afb25800 20 add_watcher() i=4 2024-09-12T00:36:54.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.426+0000 7f03afb25800 20 add_watcher() i=5 2024-09-12T00:36:54.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.426+0000 7f03afb25800 20 add_watcher() i=6 2024-09-12T00:36:54.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.427+0000 7f03afb25800 20 add_watcher() i=7 2024-09-12T00:36:54.425 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.427+0000 7f03afb25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:54.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.429+0000 7f0261fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:54.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.429+0000 7f03afb25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:54.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.429+0000 7f03afb25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:54.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.429+0000 7f03afb25800 5 note: GC not initialized 2024-09-12T00:36:54.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.429+0000 7f0260fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:54.428 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.429+0000 7f03afb25800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:54.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.429+0000 7f03afb25800 20 Filter name: none 2024-09-12T00:36:54.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.429+0000 7f01da7fc640 20 reqs_thread_entry: start 2024-09-12T00:36:54.429 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.430+0000 7f03afb25800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.430+0000 7f03afb25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:54.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.430+0000 7f03afb25800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.430+0000 7f03afb25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:54.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.430+0000 7f03afb25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:54.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.431+0000 7f03afb25800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.431+0000 7f03afb25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-12T00:36:54.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.431+0000 7f03afb25800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.431+0000 7f03afb25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:54.430 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.431+0000 7f03afb25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:54.432 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.433+0000 7f0261fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:54.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.435+0000 7f03afb25800 20 remove_watcher() i=0 2024-09-12T00:36:54.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.435+0000 7f03afb25800 2 removed watcher, disabling cache 2024-09-12T00:36:54.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.436+0000 7f03afb25800 20 remove_watcher() i=1 2024-09-12T00:36:54.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.437+0000 7f03afb25800 20 remove_watcher() i=2 2024-09-12T00:36:54.437 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.438+0000 7f03afb25800 20 remove_watcher() i=3 2024-09-12T00:36:54.438 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.439+0000 7f03afb25800 20 remove_watcher() i=4 2024-09-12T00:36:54.439 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.440+0000 7f03afb25800 20 remove_watcher() i=5 2024-09-12T00:36:54.440 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.441+0000 7f03afb25800 20 remove_watcher() i=6 2024-09-12T00:36:54.441 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.442+0000 7f03afb25800 20 remove_watcher() i=7 2024-09-12T00:36:54.452 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:54.452 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:36:54.452 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: abort-at-change-reshard-state id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:36:54.452 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:54.746 INFO:tasks.workunit.client.0.smithi133.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T00:36:54.748 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:36:54.777 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:54.777 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:54.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.815+0000 7f9c00d40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.817+0000 7f9c00d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:54.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.817+0000 7f9c00d40800 20 realm 2024-09-12T00:36:54.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.817+0000 7f9c00d40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.817+0000 7f9c00d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:54.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.817+0000 7f9c00d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:54.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.817+0000 7f9c00d40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.817+0000 7f9c00d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:54.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.817+0000 7f9c00d40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.818+0000 7f9c00d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:54.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.818+0000 7f9c00d40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:54.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.818+0000 7f9c00d40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:54.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.818+0000 7f9c00d40800 20 searching for the correct realm 2024-09-12T00:36:54.819 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.820+0000 7f9bf7fff640 0 -- 172.21.15.133:0/587690816 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f9be80cf070 msgr2=0x7f9be80d48d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:54.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:54.823+0000 7f9bf7fff640 0 -- 172.21.15.133:0/587690816 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f9bf003c040 msgr2=0x7f9bf001c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:55.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.030+0000 7f9c00d40800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:55.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.030+0000 7f9c00d40800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:55.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.030+0000 7f9c00d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:55.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.030+0000 7f9c00d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:55.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.030+0000 7f9c00d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:55.029 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.030+0000 7f9c00d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:55.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.030+0000 7f9c00d40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.030+0000 7f9c00d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:55.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.030+0000 7f9c00d40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.030+0000 7f9c00d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:55.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.030+0000 7f9c00d40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.031+0000 7f9c00d40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:55.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.031+0000 7f9c00d40800 20 zone default found 2024-09-12T00:36:55.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.031+0000 7f9c00d40800 4 Realm: () 2024-09-12T00:36:55.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.031+0000 7f9c00d40800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:55.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.031+0000 7f9c00d40800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:55.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.031+0000 7f9c00d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:55.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.031+0000 7f9c00d40800 20 zonegroup default 2024-09-12T00:36:55.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.031+0000 7f9c00d40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.031+0000 7f9c00d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:55.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.031+0000 7f9c00d40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.032+0000 7f9c00d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:55.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.032+0000 7f9c00d40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.032+0000 7f9c00d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:55.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.032+0000 7f9c00d40800 20 started sync module instance, tier type = 2024-09-12T00:36:55.032 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.032+0000 7f9c00d40800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:55.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.041+0000 7f9c00d40800 20 add_watcher() i=0 2024-09-12T00:36:55.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.041+0000 7f9c00d40800 20 add_watcher() i=1 2024-09-12T00:36:55.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.041+0000 7f9c00d40800 20 add_watcher() i=2 2024-09-12T00:36:55.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.041+0000 7f9c00d40800 20 add_watcher() i=3 2024-09-12T00:36:55.039 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.041+0000 7f9c00d40800 20 add_watcher() i=4 2024-09-12T00:36:55.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.041+0000 7f9c00d40800 20 add_watcher() i=5 2024-09-12T00:36:55.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.041+0000 7f9c00d40800 20 add_watcher() i=6 2024-09-12T00:36:55.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.042+0000 7f9c00d40800 20 add_watcher() i=7 2024-09-12T00:36:55.040 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.042+0000 7f9c00d40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:55.042 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.043+0000 7f9ab2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:55.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.044+0000 7f9c00d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:55.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.044+0000 7f9c00d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:55.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.044+0000 7f9c00d40800 5 note: GC not initialized 2024-09-12T00:36:55.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.044+0000 7f9ab1fe3640 20 reqs_thread_entry: start 2024-09-12T00:36:55.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.044+0000 7f9c00d40800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:55.043 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.044+0000 7f9c00d40800 20 Filter name: none 2024-09-12T00:36:55.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.044+0000 7f9a237fe640 20 reqs_thread_entry: start 2024-09-12T00:36:55.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.044+0000 7f9c00d40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.045+0000 7f9c00d40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:36:55.044 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.045+0000 7f9c00d40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.045+0000 7f9c00d40800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:36:55.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.045+0000 7f9c00d40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:55.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.045+0000 7f9c00d40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.045+0000 7f9c00d40800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:36:55.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.045+0000 7f9c00d40800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.046+0000 7f9c00d40800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:36:55.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.046+0000 7f9c00d40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:55.045 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.047+0000 7f9ab2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:55.047 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.049+0000 7f9c00d40800 20 remove_watcher() i=0 2024-09-12T00:36:55.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.049+0000 7f9c00d40800 2 removed watcher, disabling cache 2024-09-12T00:36:55.048 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.050+0000 7f9c00d40800 20 remove_watcher() i=1 2024-09-12T00:36:55.049 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.051+0000 7f9c00d40800 20 remove_watcher() i=2 2024-09-12T00:36:55.050 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.052+0000 7f9c00d40800 20 remove_watcher() i=3 2024-09-12T00:36:55.051 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.053+0000 7f9c00d40800 20 remove_watcher() i=4 2024-09-12T00:36:55.052 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.054+0000 7f9c00d40800 20 remove_watcher() i=5 2024-09-12T00:36:55.053 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.055+0000 7f9c00d40800 20 remove_watcher() i=6 2024-09-12T00:36:55.054 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.056+0000 7f9c00d40800 20 remove_watcher() i=7 2024-09-12T00:36:55.064 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:55.064 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:36:55.064 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: a-bucket id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T00:36:55.065 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:55.066 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:36:55.095 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:55.095 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:55.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.133+0000 7f952601b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.135+0000 7f952601b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:55.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.135+0000 7f952601b800 20 realm 2024-09-12T00:36:55.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.135+0000 7f952601b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.135+0000 7f952601b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:55.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.135+0000 7f952601b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:55.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.135+0000 7f952601b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.135+0000 7f952601b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:55.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.135+0000 7f952601b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.136+0000 7f952601b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:55.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.136+0000 7f952601b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.136+0000 7f952601b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:55.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.136+0000 7f952601b800 20 searching for the correct realm 2024-09-12T00:36:55.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.138+0000 7f9520fea640 0 -- 172.21.15.133:0/1223604779 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f951808f7d0 msgr2=0x7f9518047400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:55.341 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.342+0000 7f9520fea640 0 -- 172.21.15.133:0/1223604779 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f9514020070 msgr2=0x7f951402c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:55.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.548+0000 7f952601b800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:55.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.548+0000 7f952601b800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:55.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.548+0000 7f952601b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:55.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.548+0000 7f952601b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:55.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.548+0000 7f952601b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:55.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.548+0000 7f952601b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:55.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.548+0000 7f952601b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.548+0000 7f952601b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:55.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.548+0000 7f952601b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.549+0000 7f952601b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:55.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.549+0000 7f952601b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.549 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.549+0000 7f952601b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:55.549 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.549+0000 7f952601b800 20 zone default found 2024-09-12T00:36:55.549 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.549+0000 7f952601b800 4 Realm: () 2024-09-12T00:36:55.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.549+0000 7f952601b800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:55.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.549+0000 7f952601b800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:55.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.549+0000 7f952601b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:55.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.549+0000 7f952601b800 20 zonegroup default 2024-09-12T00:36:55.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.549+0000 7f952601b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.550+0000 7f952601b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:55.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.550+0000 7f952601b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.550+0000 7f952601b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:55.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.550+0000 7f952601b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.550+0000 7f952601b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:55.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.550+0000 7f952601b800 20 started sync module instance, tier type = 2024-09-12T00:36:55.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.550+0000 7f952601b800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:55.559 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.560+0000 7f952601b800 20 add_watcher() i=0 2024-09-12T00:36:55.559 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.560+0000 7f952601b800 20 add_watcher() i=1 2024-09-12T00:36:55.559 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.560+0000 7f952601b800 20 add_watcher() i=2 2024-09-12T00:36:55.559 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.560+0000 7f952601b800 20 add_watcher() i=3 2024-09-12T00:36:55.559 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.560+0000 7f952601b800 20 add_watcher() i=4 2024-09-12T00:36:55.559 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.560+0000 7f952601b800 20 add_watcher() i=5 2024-09-12T00:36:55.559 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.560+0000 7f952601b800 20 add_watcher() i=6 2024-09-12T00:36:55.560 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.561+0000 7f952601b800 20 add_watcher() i=7 2024-09-12T00:36:55.560 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.561+0000 7f952601b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:55.561 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.563+0000 7f93d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:55.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.563+0000 7f952601b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:55.562 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.563+0000 7f952601b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:55.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.563+0000 7f952601b800 5 note: GC not initialized 2024-09-12T00:36:55.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.564+0000 7f93d67e4640 20 reqs_thread_entry: start 2024-09-12T00:36:55.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.564+0000 7f952601b800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:55.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.564+0000 7f952601b800 20 Filter name: none 2024-09-12T00:36:55.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.564+0000 7f9347fff640 20 reqs_thread_entry: start 2024-09-12T00:36:55.563 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.564+0000 7f952601b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.564+0000 7f952601b800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:36:55.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.564+0000 7f952601b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.565+0000 7f952601b800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:36:55.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.565+0000 7f952601b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:55.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.565+0000 7f952601b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.565+0000 7f952601b800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:36:55.564 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.565+0000 7f952601b800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.565 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.565+0000 7f952601b800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:36:55.565 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.565+0000 7f952601b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:55.565 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.566+0000 7f93d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:55.567 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.568+0000 7f952601b800 20 remove_watcher() i=0 2024-09-12T00:36:55.567 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.568+0000 7f952601b800 2 removed watcher, disabling cache 2024-09-12T00:36:55.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.569+0000 7f952601b800 20 remove_watcher() i=1 2024-09-12T00:36:55.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.571+0000 7f952601b800 20 remove_watcher() i=2 2024-09-12T00:36:55.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.572+0000 7f952601b800 20 remove_watcher() i=3 2024-09-12T00:36:55.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.573+0000 7f952601b800 20 remove_watcher() i=4 2024-09-12T00:36:55.572 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.573+0000 7f952601b800 20 remove_watcher() i=5 2024-09-12T00:36:55.573 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.574+0000 7f952601b800 20 remove_watcher() i=6 2024-09-12T00:36:55.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.575+0000 7f952601b800 20 remove_watcher() i=7 2024-09-12T00:36:55.586 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:36:55.620 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:55.620 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:55.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.657+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:55.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.659+0000 7f93b8537800 20 realm 2024-09-12T00:36:55.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:55.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.659+0000 7f93b8537800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:55.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:55.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.660+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:55.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.660+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:55.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.661+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:55.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.661+0000 7f93b8537800 20 searching for the correct realm 2024-09-12T00:36:55.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.662+0000 7f93ab9c2640 0 -- 172.21.15.133:0/2048925550 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f939c040040 msgr2=0x7f939c04c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:55.866 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:55.867+0000 7f93ab9c2640 0 -- 172.21.15.133:0/2048925550 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f93a4073030 msgr2=0x7f93a40c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:56.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:56.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:56.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:56.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:56.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:56.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:56.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.074+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.074+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.074+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.074+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:56.074 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.074+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:56.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.075+0000 7f93b8537800 20 zone default found 2024-09-12T00:36:56.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.075+0000 7f93b8537800 4 Realm: () 2024-09-12T00:36:56.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.075+0000 7f93b8537800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:56.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.075+0000 7f93b8537800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:56.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.075+0000 7f93b8537800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:56.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.075+0000 7f93b8537800 20 zonegroup default 2024-09-12T00:36:56.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.076+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.076+0000 7f93b8537800 20 started sync module instance, tier type = 2024-09-12T00:36:56.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.076+0000 7f93b8537800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:56.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=0 2024-09-12T00:36:56.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=1 2024-09-12T00:36:56.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=2 2024-09-12T00:36:56.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=3 2024-09-12T00:36:56.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=4 2024-09-12T00:36:56.084 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=5 2024-09-12T00:36:56.085 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.086+0000 7f93b8537800 20 add_watcher() i=6 2024-09-12T00:36:56.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.087+0000 7f93b8537800 20 add_watcher() i=7 2024-09-12T00:36:56.086 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.087+0000 7f93b8537800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:56.088 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.089+0000 7f926afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:56.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.090+0000 7f93b8537800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:56.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.090+0000 7f93b8537800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:56.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.090+0000 7f93b8537800 5 note: GC not initialized 2024-09-12T00:36:56.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.090+0000 7f9269fdb640 20 reqs_thread_entry: start 2024-09-12T00:36:56.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.090+0000 7f93b8537800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:56.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.090+0000 7f93b8537800 20 Filter name: none 2024-09-12T00:36:56.089 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.090+0000 7f91db7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:56.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.090+0000 7f93b8537800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:36:56.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.090+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.090+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:36:56.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.090+0000 7f93b8537800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:36:56.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.090+0000 7f93b8537800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:36:56.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.090+0000 7f93b8537800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:36:56.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.090+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.090 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.091+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:36:56.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.091+0000 7f93b8537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:36:56.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.091+0000 7f93b8537800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:36:56.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.091+0000 7f93b8537800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:56.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.091+0000 7f93b8537800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:36:56.091 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.091+0000 7f93b8537800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:36:56.093 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.095+0000 7f93b8537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:36:56.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.095+0000 7f93b8537800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:36:56.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.095+0000 7f93b8537800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:36:56.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.095+0000 7f93b8537800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:36:56.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.095+0000 7f928b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497079 cookie 94603216197360 notifier 8235 bl.length()=911 2024-09-12T00:36:56.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.095+0000 7f928b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:36:56.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.095+0000 7f928b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:36:56.094 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.095+0000 7f928b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:36:56.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.097+0000 7f93b8537800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:36:56.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.097+0000 7f93b8537800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:36:56.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.097+0000 7f93b8537800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:36:56.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.097+0000 7f93b8537800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:36:56.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.099+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.0 2024-09-12T00:36:56.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.099+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.0 2024-09-12T00:36:56.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.099+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.1 2024-09-12T00:36:56.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.099+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.1 2024-09-12T00:36:56.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.099+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.2 2024-09-12T00:36:56.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.099+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.2 2024-09-12T00:36:56.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.099+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.3 2024-09-12T00:36:56.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.099+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.3 2024-09-12T00:36:56.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.099+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:36:56.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.099+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:36:56.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.100+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:36:56.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.100+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:36:56.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.100+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:36:56.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.100+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:36:56.101 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f93b8537800 time 2024-09-12T00:36:56.103536+0000 2024-09-12T00:36:56.101 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:56.102 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:56.102 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f93b9b8c71a] 2024-09-12T00:36:56.102 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f93b9b8c8d8] 2024-09-12T00:36:56.102 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560a84f48641] 2024-09-12T00:36:56.102 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x560a84f5751b] 2024-09-12T00:36:56.102 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x560a84f583e4] 2024-09-12T00:36:56.102 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:36:56.102 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f93b8829590] 2024-09-12T00:36:56.102 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:36:56.102 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:36:56.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.103+0000 7f93b8537800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f93b8537800 time 2024-09-12T00:36:56.103536+0000 2024-09-12T00:36:56.103 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:56.103 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.103 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:56.103 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f93b9b8c71a] 2024-09-12T00:36:56.103 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f93b9b8c8d8] 2024-09-12T00:36:56.103 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560a84f48641] 2024-09-12T00:36:56.103 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x560a84f5751b] 2024-09-12T00:36:56.103 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x560a84f583e4] 2024-09-12T00:36:56.103 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:36:56.103 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f93b8829590] 2024-09-12T00:36:56.103 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:36:56.103 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:36:56.103 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.104 INFO:tasks.workunit.client.0.smithi133.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:36:56.104 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f93b8537800 thread_name:radosgw-admin 2024-09-12T00:36:56.124 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:56.125 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f93b883e6f0] 2024-09-12T00:36:56.125 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f93b888b99c] 2024-09-12T00:36:56.125 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:36:56.125 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:36:56.125 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f93b9b8c774] 2024-09-12T00:36:56.125 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f93b9b8c8d8] 2024-09-12T00:36:56.125 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560a84f48641] 2024-09-12T00:36:56.125 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x560a84f5751b] 2024-09-12T00:36:56.125 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x560a84f583e4] 2024-09-12T00:36:56.125 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:36:56.125 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f93b8829590] 2024-09-12T00:36:56.125 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:36:56.125 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:36:56.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.104+0000 7f93b8537800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:56.126 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f93b8537800 thread_name:radosgw-admin 2024-09-12T00:36:56.126 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.126 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:56.126 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f93b883e6f0] 2024-09-12T00:36:56.126 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f93b888b99c] 2024-09-12T00:36:56.126 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:36:56.126 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:36:56.126 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f93b9b8c774] 2024-09-12T00:36:56.126 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f93b9b8c8d8] 2024-09-12T00:36:56.126 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560a84f48641] 2024-09-12T00:36:56.126 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x560a84f5751b] 2024-09-12T00:36:56.127 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x560a84f583e4] 2024-09-12T00:36:56.127 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:36:56.127 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f93b8829590] 2024-09-12T00:36:56.127 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:36:56.127 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:36:56.127 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:56.127 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.127 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:36:56.127 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: secure 2024-09-12T00:36:56.127 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: crc 2024-09-12T00:36:56.127 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: crc 2024-09-12T00:36:56.127 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: secure 2024-09-12T00:36:56.127 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: crc 2024-09-12T00:36:56.128 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: secure 2024-09-12T00:36:56.128 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: crc 2024-09-12T00:36:56.128 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: secure 2024-09-12T00:36:56.128 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:36:55.642+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.128 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:36:55.642+0000 7f93b8537800 1 librados: starting msgr at 2024-09-12T00:36:56.128 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:36:55.642+0000 7f93b8537800 1 librados: starting objecter 2024-09-12T00:36:56.128 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command objecter_requests hook 0x560a870b5170 2024-09-12T00:36:56.128 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:36:55.642+0000 7f93b8537800 1 librados: setting wanted keys 2024-09-12T00:36:56.128 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:36:55.642+0000 7f93b8537800 1 librados: calling monclient init 2024-09-12T00:36:56.128 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:36:55.642+0000 7f93b8537800 10 monclient: init 2024-09-12T00:36:56.128 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding auth protocol: cephx 2024-09-12T00:36:56.128 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding auth protocol: cephx 2024-09-12T00:36:56.128 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding auth protocol: cephx 2024-09-12T00:36:56.129 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: secure 2024-09-12T00:36:56.129 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: crc 2024-09-12T00:36:56.129 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: secure 2024-09-12T00:36:56.129 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: crc 2024-09-12T00:36:56.129 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: secure 2024-09-12T00:36:56.129 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: crc 2024-09-12T00:36:56.129 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: crc 2024-09-12T00:36:56.129 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: secure 2024-09-12T00:36:56.129 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: crc 2024-09-12T00:36:56.129 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: secure 2024-09-12T00:36:56.129 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: crc 2024-09-12T00:36:56.129 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: secure 2024-09-12T00:36:56.129 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:36:55.642+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.130 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:36:55.643+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.130 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:36:55.643+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command rotate-key hook 0x560a8708ab58 2024-09-12T00:36:56.130 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:56.130 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:36:56.130 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-a con 0x560a86f3e920 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:56.130 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-b con 0x560a86f41b80 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:56.130 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-c con 0x560a86fcde00 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:56.130 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.130 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.130 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.130 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:56.130 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): authenticate will time out at 2224.215244s 2024-09-12T00:36:56.131 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): get_auth_request con 0x560a86f3e920 auth_method 0 2024-09-12T00:36:56.132 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.132 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.132 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.132 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:36:55.643+0000 7f93b49c4640 10 monclient(hunting): get_auth_request con 0x560a86fcde00 auth_method 0 2024-09-12T00:36:56.132 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:36:55.643+0000 7f93b49c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.132 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:36:55.643+0000 7f93b49c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.132 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:36:55.643+0000 7f93b49c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.132 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:36:55.643+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request con 0x560a86f41b80 auth_method 0 2024-09-12T00:36:56.133 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:36:55.643+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.133 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:36:55.643+0000 7f93ab9c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.133 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:36:55.643+0000 7f93ab9c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.133 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.133 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.133 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.133 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:36:55.643+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.133 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:36:55.643+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.133 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:36:55.643+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.133 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:36:55.643+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.133 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:36:55.643+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.133 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:36:55.643+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.134 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): handle_auth_done global_id 8226 payload 824 2024-09-12T00:36:56.134 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient: _finish_hunting 0 2024-09-12T00:36:56.134 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:36:55.643+0000 7f93b41c3640 1 monclient: found mon.noname-a 2024-09-12T00:36:56.134 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:36:56.134 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.134 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:56.134 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: dump: 2024-09-12T00:36:56.134 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.134 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.134 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.135 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.135 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.135 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.135 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.135 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.135 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.135 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.135 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: _finish_auth 0 2024-09-12T00:36:56.135 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: _check_auth_tickets 2024-09-12T00:36:56.135 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:36:55.643+0000 7f93b8537800 5 monclient: authenticate success, global_id 8226 2024-09-12T00:36:56.135 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient: _renew_subs 2024-09-12T00:36:56.135 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:36:56.135 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:56.136 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.136 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:56.136 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: dump: 2024-09-12T00:36:56.136 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.136 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.136 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.136 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.136 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.136 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.136 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.136 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.136 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.136 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.137 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:36:55.643+0000 7f92a260c640 4 set_mon_vals no callback set 2024-09-12T00:36:56.137 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient: _renew_subs 2024-09-12T00:36:56.137 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:36:56.137 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:36:55.643+0000 7f93b8537800 1 librados: init done 2024-09-12T00:36:56.137 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:36:55.645+0000 7f92a0e09640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:36:56.137 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:36:55.645+0000 7f92a0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:56.137 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:36:55.645+0000 7f92a0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:56.137 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:36:55.645+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x7f929c076470 auth_method 0 2024-09-12T00:36:56.137 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:36:55.646+0000 7f93b49c4640 10 monclient: get_auth_request con 0x560a870b3630 auth_method 0 2024-09-12T00:36:56.137 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:36:55.646+0000 7f93b41c3640 10 monclient: get_auth_request con 0x560a870d5ef0 auth_method 0 2024-09-12T00:36:56.137 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:36:55.647+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x560a870da590 auth_method 0 2024-09-12T00:36:56.137 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:36:55.648+0000 7f93b49c4640 10 monclient: get_auth_request con 0x560a870d9bf0 auth_method 0 2024-09-12T00:36:56.137 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:36:55.649+0000 7f93b8537800 10 monclient: build_initial_monmap 2024-09-12T00:36:56.138 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:36:55.649+0000 7f93b8537800 1 build_initial for_mkfs: 0 2024-09-12T00:36:56.138 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:36:55.649+0000 7f93b8537800 10 monclient: monmap: 2024-09-12T00:36:56.138 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:36:56.138 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:56.138 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:36:56.138 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:36:56.138 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:56.138 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.138 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:36:56.138 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:36:56.138 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:36:56.138 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.138 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding auth protocol: cephx 2024-09-12T00:36:56.138 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding auth protocol: cephx 2024-09-12T00:36:56.139 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding auth protocol: cephx 2024-09-12T00:36:56.139 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: secure 2024-09-12T00:36:56.139 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: crc 2024-09-12T00:36:56.139 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: secure 2024-09-12T00:36:56.139 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: crc 2024-09-12T00:36:56.139 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: secure 2024-09-12T00:36:56.139 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: crc 2024-09-12T00:36:56.139 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: crc 2024-09-12T00:36:56.139 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: secure 2024-09-12T00:36:56.139 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: crc 2024-09-12T00:36:56.139 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: secure 2024-09-12T00:36:56.139 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: crc 2024-09-12T00:36:56.139 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: secure 2024-09-12T00:36:56.140 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:36:55.649+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.140 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command objecter_requests cmddesc objecter_requests hook 0x560a870e5ef0 EEXIST 2024-09-12T00:36:56.140 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:36:55.649+0000 7f93b8537800 10 monclient: init 2024-09-12T00:36:56.140 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding auth protocol: cephx 2024-09-12T00:36:56.140 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding auth protocol: cephx 2024-09-12T00:36:56.140 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding auth protocol: cephx 2024-09-12T00:36:56.140 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: secure 2024-09-12T00:36:56.140 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: crc 2024-09-12T00:36:56.140 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: secure 2024-09-12T00:36:56.140 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: crc 2024-09-12T00:36:56.140 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: secure 2024-09-12T00:36:56.140 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: crc 2024-09-12T00:36:56.140 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: crc 2024-09-12T00:36:56.141 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: secure 2024-09-12T00:36:56.141 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: crc 2024-09-12T00:36:56.141 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: secure 2024-09-12T00:36:56.141 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: crc 2024-09-12T00:36:56.141 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: secure 2024-09-12T00:36:56.141 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:36:55.649+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.141 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:36:55.650+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.141 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:36:55.650+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command rotate-key cmddesc rotate-key hook 0x560a870e1550 EEXIST 2024-09-12T00:36:56.141 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:56.141 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:36:56.141 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-b con 0x560a87109be0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:56.141 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-a con 0x560a8710beb0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:56.141 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-c con 0x560a871083b0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:56.141 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.142 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.142 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.142 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:56.142 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): authenticate will time out at 2224.222102s 2024-09-12T00:36:56.142 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:36:55.650+0000 7f93b49c4640 10 monclient(hunting): get_auth_request con 0x560a8710beb0 auth_method 0 2024-09-12T00:36:56.142 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:36:55.650+0000 7f93b49c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.142 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:36:55.650+0000 7f93b49c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.142 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:36:55.650+0000 7f93b49c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.142 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): get_auth_request con 0x560a871083b0 auth_method 0 2024-09-12T00:36:56.142 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.142 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.142 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.142 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:36:55.650+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.143 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:36:55.650+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.143 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:36:55.650+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.143 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.143 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.143 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.143 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:36:55.650+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request con 0x560a87109be0 auth_method 0 2024-09-12T00:36:56.143 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:36:55.650+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.143 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:36:55.650+0000 7f93ab9c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.143 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:36:55.650+0000 7f93ab9c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.143 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): handle_auth_done global_id 7718 payload 824 2024-09-12T00:36:56.143 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient: _finish_hunting 0 2024-09-12T00:36:56.143 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:36:55.650+0000 7f93b41c3640 1 monclient: found mon.noname-c 2024-09-12T00:36:56.143 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:36:56.143 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.144 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:56.144 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: dump: 2024-09-12T00:36:56.144 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.144 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.144 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.144 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.144 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.144 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.144 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.144 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.144 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.144 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.144 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: _finish_auth 0 2024-09-12T00:36:56.144 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:36:56.145 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:56.145 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.145 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:56.145 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: dump: 2024-09-12T00:36:56.145 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.145 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.145 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.145 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.145 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.145 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.145 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.145 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.145 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.145 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.146 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:36:55.650+0000 7f93b8537800 5 monclient: authenticate success, global_id 7718 2024-09-12T00:36:56.146 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:36:55.650+0000 7f93b51c5640 4 set_mon_vals no callback set 2024-09-12T00:36:56.146 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient: _renew_subs 2024-09-12T00:36:56.146 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:56.146 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient: _renew_subs 2024-09-12T00:36:56.146 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:56.146 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:36:55.652+0000 7f9299ffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:36:56.146 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:36:55.652+0000 7f9299ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:56.146 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:36:55.652+0000 7f9299ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:56.146 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:36:55.652+0000 7f93b8537800 10 monclient: get_monmap_and_config 2024-09-12T00:36:56.147 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:36:55.652+0000 7f93b8537800 10 monclient: build_initial_monmap 2024-09-12T00:36:56.147 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:36:55.652+0000 7f93b8537800 1 build_initial for_mkfs: 0 2024-09-12T00:36:56.147 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:36:55.652+0000 7f93b8537800 10 monclient: monmap: 2024-09-12T00:36:56.147 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:36:56.147 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:56.147 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:36:56.147 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:36:56.147 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:56.147 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.147 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:36:56.147 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:36:56.147 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:36:56.147 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.148 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding auth protocol: cephx 2024-09-12T00:36:56.148 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding auth protocol: cephx 2024-09-12T00:36:56.148 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding auth protocol: cephx 2024-09-12T00:36:56.148 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: secure 2024-09-12T00:36:56.148 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: crc 2024-09-12T00:36:56.148 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: secure 2024-09-12T00:36:56.148 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: crc 2024-09-12T00:36:56.148 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: secure 2024-09-12T00:36:56.148 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: crc 2024-09-12T00:36:56.148 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: crc 2024-09-12T00:36:56.148 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: secure 2024-09-12T00:36:56.148 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: crc 2024-09-12T00:36:56.148 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: secure 2024-09-12T00:36:56.148 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: crc 2024-09-12T00:36:56.149 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: secure 2024-09-12T00:36:56.149 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:36:55.652+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x7f928c076380 auth_method 0 2024-09-12T00:36:56.149 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:36:55.653+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.149 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient: init 2024-09-12T00:36:56.149 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding auth protocol: cephx 2024-09-12T00:36:56.149 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding auth protocol: cephx 2024-09-12T00:36:56.149 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding auth protocol: cephx 2024-09-12T00:36:56.149 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: secure 2024-09-12T00:36:56.149 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: crc 2024-09-12T00:36:56.149 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: secure 2024-09-12T00:36:56.149 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: crc 2024-09-12T00:36:56.149 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: secure 2024-09-12T00:36:56.149 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: crc 2024-09-12T00:36:56.150 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: crc 2024-09-12T00:36:56.150 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: secure 2024-09-12T00:36:56.150 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: crc 2024-09-12T00:36:56.150 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: secure 2024-09-12T00:36:56.150 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: crc 2024-09-12T00:36:56.150 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: secure 2024-09-12T00:36:56.150 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:36:55.653+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.150 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:36:55.653+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.150 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command rotate-key cmddesc rotate-key hook 0x7ffce4861718 EEXIST 2024-09-12T00:36:56.150 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:56.150 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:36:56.150 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-a con 0x560a8715d880 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:56.151 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-c con 0x560a87157a00 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:56.151 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-b con 0x560a87158c40 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:56.151 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.151 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.151 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.151 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:56.151 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): authenticate will time out at 2224.225653s 2024-09-12T00:36:56.151 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request con 0x560a8715d880 auth_method 0 2024-09-12T00:36:56.151 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.151 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.151 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.151 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:36:55.653+0000 7f93b49c4640 10 monclient(hunting): get_auth_request con 0x560a87157a00 auth_method 0 2024-09-12T00:36:56.152 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:36:55.653+0000 7f93b49c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.152 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:36:55.653+0000 7f93b49c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.152 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:36:55.653+0000 7f93b49c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.152 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.152 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.152 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.152 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:36:55.653+0000 7f93b41c3640 10 monclient(hunting): get_auth_request con 0x560a87158c40 auth_method 0 2024-09-12T00:36:56.152 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:36:55.653+0000 7f93b41c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.152 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:36:55.653+0000 7f93b41c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.152 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:36:55.653+0000 7f93b41c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.152 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:36:55.653+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.152 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:36:55.653+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.152 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:36:55.653+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.153 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:36:55.653+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.153 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:36:55.653+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.153 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:36:55.653+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.153 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_done global_id 8232 payload 274 2024-09-12T00:36:56.153 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient: _finish_hunting 0 2024-09-12T00:36:56.153 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 1 monclient: found mon.noname-a 2024-09-12T00:36:56.153 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:36:56.153 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.153 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:56.153 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: dump: 2024-09-12T00:36:56.153 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.153 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.153 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.154 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.154 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.154 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.154 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.154 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.154 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.154 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.154 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:36:56.154 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:36:56.154 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:56.154 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.154 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:56.154 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: dump: 2024-09-12T00:36:56.154 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.155 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.155 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.155 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.155 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.155 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.155 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.155 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.155 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.155 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.155 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 monclient: authenticate success, global_id 8232 2024-09-12T00:36:56.155 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:36:55.654+0000 7f93b8537800 10 monclient: get_monmap_and_config success 2024-09-12T00:36:56.155 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:36:55.654+0000 7f93b8537800 4 set_mon_vals no callback set 2024-09-12T00:36:56.155 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:36:55.654+0000 7f93b8537800 10 monclient: shutdown 2024-09-12T00:36:56.155 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:36:55.654+0000 7f93b8537800 10 monclient: build_initial_monmap 2024-09-12T00:36:56.156 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:36:55.654+0000 7f93b8537800 1 build_initial for_mkfs: 0 2024-09-12T00:36:56.156 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:36:55.654+0000 7f93b8537800 10 monclient: monmap: 2024-09-12T00:36:56.156 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:36:56.156 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:56.156 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:36:56.156 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:36:56.156 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:56.156 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.156 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:36:56.156 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:36:56.156 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:36:56.156 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.156 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding auth protocol: cephx 2024-09-12T00:36:56.156 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding auth protocol: cephx 2024-09-12T00:36:56.157 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding auth protocol: cephx 2024-09-12T00:36:56.157 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: secure 2024-09-12T00:36:56.157 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: crc 2024-09-12T00:36:56.157 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: secure 2024-09-12T00:36:56.157 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: crc 2024-09-12T00:36:56.157 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: secure 2024-09-12T00:36:56.157 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: crc 2024-09-12T00:36:56.157 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: crc 2024-09-12T00:36:56.157 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: secure 2024-09-12T00:36:56.157 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: crc 2024-09-12T00:36:56.157 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: secure 2024-09-12T00:36:56.157 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: crc 2024-09-12T00:36:56.157 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: secure 2024-09-12T00:36:56.158 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:36:55.655+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.158 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:36:55.655+0000 7f93b8537800 1 librados: starting msgr at 2024-09-12T00:36:56.158 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:36:55.655+0000 7f93b8537800 1 librados: starting objecter 2024-09-12T00:36:56.158 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command objecter_requests cmddesc objecter_requests hook 0x560a8712f020 EEXIST 2024-09-12T00:36:56.158 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:36:55.655+0000 7f93b8537800 1 librados: setting wanted keys 2024-09-12T00:36:56.158 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:36:55.655+0000 7f93b8537800 1 librados: calling monclient init 2024-09-12T00:36:56.158 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient: init 2024-09-12T00:36:56.158 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding auth protocol: cephx 2024-09-12T00:36:56.158 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding auth protocol: cephx 2024-09-12T00:36:56.158 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding auth protocol: cephx 2024-09-12T00:36:56.158 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: secure 2024-09-12T00:36:56.158 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: crc 2024-09-12T00:36:56.158 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: secure 2024-09-12T00:36:56.158 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: crc 2024-09-12T00:36:56.159 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: secure 2024-09-12T00:36:56.159 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: crc 2024-09-12T00:36:56.159 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: crc 2024-09-12T00:36:56.159 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: secure 2024-09-12T00:36:56.159 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: crc 2024-09-12T00:36:56.159 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: secure 2024-09-12T00:36:56.159 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: crc 2024-09-12T00:36:56.159 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: secure 2024-09-12T00:36:56.159 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:36:55.655+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.159 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:36:55.655+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.159 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command rotate-key cmddesc rotate-key hook 0x560a87121ad8 EEXIST 2024-09-12T00:36:56.159 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:56.159 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:36:56.160 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-c con 0x560a87157a00 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:56.160 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-b con 0x560a87158c40 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:56.160 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-a con 0x560a8715d880 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:56.160 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.160 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.160 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.160 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:56.160 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): authenticate will time out at 2224.227889s 2024-09-12T00:36:56.160 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:36:55.655+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request con 0x560a87157a00 auth_method 0 2024-09-12T00:36:56.160 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:36:55.655+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.160 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:36:55.655+0000 7f93ab9c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.160 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:36:55.655+0000 7f93ab9c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.160 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:36:55.655+0000 7f93b41c3640 10 monclient(hunting): get_auth_request con 0x560a8715d880 auth_method 0 2024-09-12T00:36:56.161 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.161 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.161 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.161 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:36:55.656+0000 7f93b49c4640 10 monclient(hunting): get_auth_request con 0x560a87158c40 auth_method 0 2024-09-12T00:36:56.161 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:36:55.656+0000 7f93b49c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.161 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:36:55.656+0000 7f93b49c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.161 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:36:55.656+0000 7f93b49c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.161 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:36:55.656+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.161 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:36:55.656+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.161 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:36:55.656+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.161 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.161 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.162 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.162 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:36:55.656+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.162 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:36:55.656+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.162 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:36:55.656+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.162 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient(hunting): handle_auth_done global_id 8235 payload 824 2024-09-12T00:36:56.162 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient: _finish_hunting 0 2024-09-12T00:36:56.162 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:36:55.656+0000 7f93b41c3640 1 monclient: found mon.noname-a 2024-09-12T00:36:56.162 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:36:56.162 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.162 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:56.162 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: dump: 2024-09-12T00:36:56.162 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.162 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.162 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.163 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.163 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.163 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.163 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.163 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.163 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.163 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.163 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: _finish_auth 0 2024-09-12T00:36:56.163 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:36:56.163 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:56.163 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.163 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:56.163 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: dump: 2024-09-12T00:36:56.164 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.164 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.164 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.164 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.164 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.164 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.164 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.164 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.164 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.164 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.164 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:36:55.656+0000 7f93b8537800 5 monclient: authenticate success, global_id 8235 2024-09-12T00:36:56.164 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:36:55.656+0000 7f928b7fe640 4 set_mon_vals no callback set 2024-09-12T00:36:56.164 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:36:55.656+0000 7f93b8537800 10 monclient: _renew_subs 2024-09-12T00:36:56.165 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:36:55.656+0000 7f93b8537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:36:56.165 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:36:55.656+0000 7f93b8537800 10 monclient: _renew_subs 2024-09-12T00:36:56.165 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:36:55.656+0000 7f93b8537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:36:56.165 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:36:55.656+0000 7f93b8537800 1 librados: init done 2024-09-12T00:36:56.165 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:36:55.656+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command cr dump hook 0x560a87150c38 2024-09-12T00:36:56.165 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:36:55.657+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.165 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:36:55.658+0000 7f9289ffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:36:56.165 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:36:55.658+0000 7f9289ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:56.165 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:36:55.658+0000 7f9289ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:56.165 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:36:55.658+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x7f927c076470 auth_method 0 2024-09-12T00:36:56.165 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:36:55.658+0000 7f93b49c4640 10 monclient: get_auth_request con 0x560a871777e0 auth_method 0 2024-09-12T00:36:56.165 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.165 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:36:55.659+0000 7f93b8537800 20 realm 2024-09-12T00:36:56.165 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.166 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.166 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:36:55.659+0000 7f93b8537800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:56.166 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.166 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.166 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.166 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:36:55.659+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x560a8717ba30 auth_method 0 2024-09-12T00:36:56.166 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:36:55.660+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:56.166 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:36:55.660+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.166 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:36:55.660+0000 7f93b49c4640 10 monclient: get_auth_request con 0x560a8717f2e0 auth_method 0 2024-09-12T00:36:56.166 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:36:55.661+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:56.166 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:36:55.661+0000 7f93b8537800 20 searching for the correct realm 2024-09-12T00:36:56.166 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:36:55.661+0000 7f93b41c3640 10 monclient: get_auth_request con 0x7f93ac030080 auth_method 0 2024-09-12T00:36:56.166 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:36:55.662+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x7f939c040040 auth_method 0 2024-09-12T00:36:56.166 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:36:55.662+0000 7f93ab9c2640 0 -- 172.21.15.133:0/2048925550 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f939c040040 msgr2=0x7f939c04c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:56.167 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:36:55.863+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x7f939c040040 auth_method 0 2024-09-12T00:36:56.167 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:36:55.864+0000 7f93b49c4640 10 monclient: get_auth_request con 0x7f93ac018040 auth_method 0 2024-09-12T00:36:56.167 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:36:55.866+0000 7f93b41c3640 10 monclient: get_auth_request con 0x7f939c034070 auth_method 0 2024-09-12T00:36:56.167 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:36:55.867+0000 7f93ab9c2640 0 -- 172.21.15.133:0/2048925550 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f93a4073030 msgr2=0x7f93a40c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:56.167 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:36:56.069+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x7f93a4073030 auth_method 0 2024-09-12T00:36:56.167 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:56.167 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:56.167 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:56.167 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:56.167 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:56.167 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:56.167 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.167 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.168 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.168 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:56.168 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.168 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:56.168 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 zone default found 2024-09-12T00:36:56.168 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:36:56.075+0000 7f93b8537800 4 Realm: () 2024-09-12T00:36:56.168 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:36:56.075+0000 7f93b8537800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:56.168 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:36:56.075+0000 7f93b8537800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:56.168 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:36:56.075+0000 7f93b8537800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:56.168 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 zonegroup default 2024-09-12T00:36:56.168 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.168 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.168 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.169 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.169 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.169 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:36:56.076+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.169 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:36:56.076+0000 7f93b8537800 20 started sync module instance, tier type = 2024-09-12T00:36:56.169 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:36:56.076+0000 7f93b8537800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:56.169 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=0 2024-09-12T00:36:56.169 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=1 2024-09-12T00:36:56.169 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=2 2024-09-12T00:36:56.169 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=3 2024-09-12T00:36:56.169 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=4 2024-09-12T00:36:56.169 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=5 2024-09-12T00:36:56.169 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:36:56.086+0000 7f93b8537800 20 add_watcher() i=6 2024-09-12T00:36:56.169 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:36:56.087+0000 7f93b8537800 20 add_watcher() i=7 2024-09-12T00:36:56.170 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:36:56.087+0000 7f93b8537800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:56.170 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding auth protocol: cephx 2024-09-12T00:36:56.170 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding auth protocol: cephx 2024-09-12T00:36:56.170 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding auth protocol: cephx 2024-09-12T00:36:56.170 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: secure 2024-09-12T00:36:56.170 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: crc 2024-09-12T00:36:56.170 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: secure 2024-09-12T00:36:56.170 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: crc 2024-09-12T00:36:56.170 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: secure 2024-09-12T00:36:56.170 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: crc 2024-09-12T00:36:56.170 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: crc 2024-09-12T00:36:56.170 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: secure 2024-09-12T00:36:56.170 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: crc 2024-09-12T00:36:56.171 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: secure 2024-09-12T00:36:56.171 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: crc 2024-09-12T00:36:56.171 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: secure 2024-09-12T00:36:56.171 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:36:56.089+0000 7f926afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:56.171 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:36:56.089+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.171 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:36:56.090+0000 7f93b8537800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:56.171 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:36:56.090+0000 7f93b8537800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:56.171 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command cache list hook 0x560a87152fb0 2024-09-12T00:36:56.171 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command cache inspect hook 0x560a87152fb0 2024-09-12T00:36:56.171 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command cache erase hook 0x560a87152fb0 2024-09-12T00:36:56.171 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command cache zap hook 0x560a87152fb0 2024-09-12T00:36:56.171 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 note: GC not initialized 2024-09-12T00:36:56.171 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:36:56.090+0000 7f9269fdb640 20 reqs_thread_entry: start 2024-09-12T00:36:56.171 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command sync trace show hook 0x7f939c00c5d0 2024-09-12T00:36:56.172 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command sync trace history hook 0x7f939c00c5d0 2024-09-12T00:36:56.172 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command sync trace active hook 0x7f939c00c5d0 2024-09-12T00:36:56.172 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command sync trace active_short hook 0x7f939c00c5d0 2024-09-12T00:36:56.172 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:36:56.090+0000 7f93b8537800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:56.172 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:36:56.090+0000 7f93b8537800 20 Filter name: none 2024-09-12T00:36:56.172 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:36:56.090+0000 7f91db7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:56.172 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:36:56.090+0000 7f93b8537800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:36:56.172 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:36:56.090+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.172 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:36:56.090+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:36:56.172 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:36:56.090+0000 7f93b8537800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:36:56.172 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:36:56.090+0000 7f93b8537800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:36:56.172 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:36:56.090+0000 7f93b8537800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:36:56.172 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:36:56.090+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.172 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:36:56.091+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:36:56.172 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:36:56.091+0000 7f93b8537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:36:56.173 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:36:56.091+0000 7f93b8537800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:36:56.173 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:36:56.091+0000 7f93b8537800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:56.173 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:36:56.091+0000 7f93b8537800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:36:56.173 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:36:56.091+0000 7f93b8537800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:36:56.173 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:36:56.095+0000 7f93b8537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:36:56.173 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:36:56.095+0000 7f93b8537800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:36:56.173 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:36:56.095+0000 7f93b8537800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:36:56.173 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:36:56.095+0000 7f93b8537800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:36:56.173 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:36:56.095+0000 7f928b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497079 cookie 94603216197360 notifier 8235 bl.length()=911 2024-09-12T00:36:56.173 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:36:56.095+0000 7f928b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:36:56.173 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:36:56.095+0000 7f928b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:36:56.173 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:36:56.095+0000 7f928b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:36:56.173 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:36:56.097+0000 7f93b8537800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:36:56.174 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:36:56.097+0000 7f93b8537800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:36:56.174 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:36:56.097+0000 7f93b8537800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:36:56.174 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:36:56.097+0000 7f93b8537800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:36:56.174 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:36:56.099+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.0 2024-09-12T00:36:56.174 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:36:56.099+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.0 2024-09-12T00:36:56.174 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:36:56.099+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.1 2024-09-12T00:36:56.174 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:36:56.099+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.1 2024-09-12T00:36:56.174 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:36:56.099+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.2 2024-09-12T00:36:56.174 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:36:56.099+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.2 2024-09-12T00:36:56.174 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:36:56.099+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.3 2024-09-12T00:36:56.174 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:36:56.099+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.3 2024-09-12T00:36:56.174 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:36:56.099+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:36:56.174 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:36:56.099+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:36:56.174 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:36:56.100+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:36:56.174 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:36:56.100+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:36:56.175 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:36:56.100+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:36:56.175 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:36:56.100+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:36:56.175 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:36:56.103+0000 7f93b8537800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f93b8537800 time 2024-09-12T00:36:56.103536+0000 2024-09-12T00:36:56.175 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:56.175 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.175 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:56.175 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f93b9b8c71a] 2024-09-12T00:36:56.175 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f93b9b8c8d8] 2024-09-12T00:36:56.175 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560a84f48641] 2024-09-12T00:36:56.175 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x560a84f5751b] 2024-09-12T00:36:56.175 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x560a84f583e4] 2024-09-12T00:36:56.175 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:36:56.175 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f93b8829590] 2024-09-12T00:36:56.176 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:36:56.176 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:36:56.176 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.176 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:36:56.104+0000 7f93b8537800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:56.176 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f93b8537800 thread_name:radosgw-admin 2024-09-12T00:36:56.176 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.176 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:56.176 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f93b883e6f0] 2024-09-12T00:36:56.176 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f93b888b99c] 2024-09-12T00:36:56.176 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:36:56.176 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:36:56.176 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f93b9b8c774] 2024-09-12T00:36:56.176 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f93b9b8c8d8] 2024-09-12T00:36:56.177 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560a84f48641] 2024-09-12T00:36:56.177 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x560a84f5751b] 2024-09-12T00:36:56.177 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x560a84f583e4] 2024-09-12T00:36:56.177 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:36:56.177 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f93b8829590] 2024-09-12T00:36:56.177 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:36:56.177 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:36:56.177 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:56.177 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.177 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:36:56.177 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:36:56.177 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:36:56.178 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:36:56.178 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:36:56.178 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:36:56.178 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:36:56.178 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:36:56.178 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:36:56.178 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:36:56.178 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:36:56.178 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:36:56.178 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:36:56.178 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:36:56.178 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:36:56.178 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:36:56.179 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:36:56.179 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:36:56.179 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:36:56.179 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:36:56.179 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:36:56.179 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:36:56.179 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:36:56.179 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:36:56.179 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:36:56.179 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:36:56.179 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:36:56.179 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:36:56.179 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:36:56.180 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:36:56.180 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:36:56.180 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:36:56.180 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:36:56.180 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:36:56.180 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:36:56.180 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:36:56.180 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:36:56.180 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:36:56.180 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:36:56.180 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:36:56.180 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:36:56.180 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:36:56.181 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:36:56.181 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:36:56.181 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:36:56.181 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:36:56.181 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:36:56.181 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:36:56.181 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:36:56.181 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:36:56.181 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:36:56.181 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:36:56.181 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:36:56.181 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:36:56.181 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:36:56.181 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:36:56.182 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:36:56.182 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:36:56.182 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:36:56.182 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:36:56.182 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:36:56.182 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:36:56.182 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:36:56.182 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:36:56.182 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:36:56.182 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:36:56.182 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:36:56.182 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:36:56.182 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:36:56.182 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:36:56.183 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:36:56.183 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:36:56.183 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:36:56.183 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:36:56.183 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:36:56.183 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:36:56.183 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:36:56.183 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:36:56.183 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:36:56.183 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:36:56.183 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:36:56.183 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:36:56.183 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:36:56.183 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:36:56.183 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:36:56.184 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:36:56.184 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:36:56.184 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:36:56.184 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:36:56.184 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:36:56.184 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:36:56.184 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:36:56.184 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:36:56.184 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:36:56.184 INFO:tasks.workunit.client.0.smithi133.stderr: 7f91db7fe640 / http_manager 2024-09-12T00:36:56.184 INFO:tasks.workunit.client.0.smithi133.stderr: 7f9269fdb640 / http_manager 2024-09-12T00:36:56.184 INFO:tasks.workunit.client.0.smithi133.stderr: 7f926afdd640 / rgw_dt_lg_renew 2024-09-12T00:36:56.184 INFO:tasks.workunit.client.0.smithi133.stderr: 7f9289ffb640 / ms_dispatch 2024-09-12T00:36:56.184 INFO:tasks.workunit.client.0.smithi133.stderr: 7f928b7fe640 / io_context_pool 2024-09-12T00:36:56.185 INFO:tasks.workunit.client.0.smithi133.stderr: 7f9299ffb640 / ms_dispatch 2024-09-12T00:36:56.185 INFO:tasks.workunit.client.0.smithi133.stderr: 7f92a0e09640 / ms_dispatch 2024-09-12T00:36:56.185 INFO:tasks.workunit.client.0.smithi133.stderr: 7f92a260c640 / io_context_pool 2024-09-12T00:36:56.185 INFO:tasks.workunit.client.0.smithi133.stderr: 7f93ab9c2640 / msgr-worker-2 2024-09-12T00:36:56.185 INFO:tasks.workunit.client.0.smithi133.stderr: 7f93b41c3640 / msgr-worker-1 2024-09-12T00:36:56.185 INFO:tasks.workunit.client.0.smithi133.stderr: 7f93b49c4640 / msgr-worker-0 2024-09-12T00:36:56.185 INFO:tasks.workunit.client.0.smithi133.stderr: 7f93b51c5640 / io_context_pool 2024-09-12T00:36:56.185 INFO:tasks.workunit.client.0.smithi133.stderr: 7f93b8537800 / radosgw-admin 2024-09-12T00:36:56.185 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:36:56.185 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:36:56.185 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/log/ceph/ceph-client.admin.148878.log 2024-09-12T00:36:56.185 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:36:56.185 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:36:56.186 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: secure 2024-09-12T00:36:56.186 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: crc 2024-09-12T00:36:56.186 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: crc 2024-09-12T00:36:56.186 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: secure 2024-09-12T00:36:56.186 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: crc 2024-09-12T00:36:56.186 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: secure 2024-09-12T00:36:56.186 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: crc 2024-09-12T00:36:56.186 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a87090660) adding con mode: secure 2024-09-12T00:36:56.186 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:36:55.642+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.186 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:36:55.642+0000 7f93b8537800 1 librados: starting msgr at 2024-09-12T00:36:56.186 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:36:55.642+0000 7f93b8537800 1 librados: starting objecter 2024-09-12T00:36:56.186 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command objecter_requests hook 0x560a870b5170 2024-09-12T00:36:56.186 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:36:55.642+0000 7f93b8537800 1 librados: setting wanted keys 2024-09-12T00:36:56.186 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:36:55.642+0000 7f93b8537800 1 librados: calling monclient init 2024-09-12T00:36:56.187 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:36:55.642+0000 7f93b8537800 10 monclient: init 2024-09-12T00:36:56.187 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding auth protocol: cephx 2024-09-12T00:36:56.187 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding auth protocol: cephx 2024-09-12T00:36:56.187 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding auth protocol: cephx 2024-09-12T00:36:56.187 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: secure 2024-09-12T00:36:56.187 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: crc 2024-09-12T00:36:56.187 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: secure 2024-09-12T00:36:56.187 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: crc 2024-09-12T00:36:56.187 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: secure 2024-09-12T00:36:56.187 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: crc 2024-09-12T00:36:56.187 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: crc 2024-09-12T00:36:56.187 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: secure 2024-09-12T00:36:56.188 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: crc 2024-09-12T00:36:56.188 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: secure 2024-09-12T00:36:56.188 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: crc 2024-09-12T00:36:56.188 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:36:55.642+0000 7f93b8537800 5 AuthRegistry(0x560a8708aa10) adding con mode: secure 2024-09-12T00:36:56.188 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:36:55.642+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.188 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:36:55.643+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.188 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:36:55.643+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command rotate-key hook 0x560a8708ab58 2024-09-12T00:36:56.188 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:56.188 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:36:56.188 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-a con 0x560a86f3e920 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:56.188 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-b con 0x560a86f41b80 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:56.188 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-c con 0x560a86fcde00 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:56.188 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.189 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.189 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.189 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:56.189 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient(hunting): authenticate will time out at 2224.215244s 2024-09-12T00:36:56.189 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): get_auth_request con 0x560a86f3e920 auth_method 0 2024-09-12T00:36:56.189 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.189 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.189 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.189 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:36:55.643+0000 7f93b49c4640 10 monclient(hunting): get_auth_request con 0x560a86fcde00 auth_method 0 2024-09-12T00:36:56.189 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:36:55.643+0000 7f93b49c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.189 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:36:55.643+0000 7f93b49c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.189 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:36:55.643+0000 7f93b49c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.189 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:36:55.643+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request con 0x560a86f41b80 auth_method 0 2024-09-12T00:36:56.190 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:36:55.643+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.190 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:36:55.643+0000 7f93ab9c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.190 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:36:55.643+0000 7f93ab9c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.190 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.190 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.190 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.190 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:36:55.643+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.190 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:36:55.643+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.190 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:36:55.643+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.190 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:36:55.643+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.190 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:36:55.643+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.190 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:36:55.643+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.190 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient(hunting): handle_auth_done global_id 8226 payload 824 2024-09-12T00:36:56.191 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient: _finish_hunting 0 2024-09-12T00:36:56.191 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:36:55.643+0000 7f93b41c3640 1 monclient: found mon.noname-a 2024-09-12T00:36:56.191 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:36:55.643+0000 7f93b41c3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:36:56.191 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.191 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:56.191 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: dump: 2024-09-12T00:36:56.191 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.191 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.191 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.191 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.191 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.191 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.191 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.191 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.192 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.192 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.192 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: _finish_auth 0 2024-09-12T00:36:56.192 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: _check_auth_tickets 2024-09-12T00:36:56.192 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:36:55.643+0000 7f93b8537800 5 monclient: authenticate success, global_id 8226 2024-09-12T00:36:56.192 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient: _renew_subs 2024-09-12T00:36:56.192 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:36:56.192 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:56.192 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.192 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:56.192 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:36:55.643+0000 7f92a0e09640 10 monclient: dump: 2024-09-12T00:36:56.192 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.192 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.193 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.193 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.193 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.193 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.193 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.193 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.193 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.193 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.193 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:36:55.643+0000 7f92a260c640 4 set_mon_vals no callback set 2024-09-12T00:36:56.193 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient: _renew_subs 2024-09-12T00:36:56.193 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:36:55.643+0000 7f93b8537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:36:56.193 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:36:55.643+0000 7f93b8537800 1 librados: init done 2024-09-12T00:36:56.194 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:36:55.645+0000 7f92a0e09640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:36:56.194 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:36:55.645+0000 7f92a0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:56.194 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:36:55.645+0000 7f92a0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:56.194 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:36:55.645+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x7f929c076470 auth_method 0 2024-09-12T00:36:56.194 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:36:55.646+0000 7f93b49c4640 10 monclient: get_auth_request con 0x560a870b3630 auth_method 0 2024-09-12T00:36:56.194 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:36:55.646+0000 7f93b41c3640 10 monclient: get_auth_request con 0x560a870d5ef0 auth_method 0 2024-09-12T00:36:56.194 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:36:55.647+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x560a870da590 auth_method 0 2024-09-12T00:36:56.194 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:36:55.648+0000 7f93b49c4640 10 monclient: get_auth_request con 0x560a870d9bf0 auth_method 0 2024-09-12T00:36:56.194 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:36:55.649+0000 7f93b8537800 10 monclient: build_initial_monmap 2024-09-12T00:36:56.194 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:36:55.649+0000 7f93b8537800 1 build_initial for_mkfs: 0 2024-09-12T00:36:56.194 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:36:55.649+0000 7f93b8537800 10 monclient: monmap: 2024-09-12T00:36:56.194 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:36:56.195 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:56.195 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:36:56.195 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:36:56.195 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:56.195 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.195 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:36:56.195 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:36:56.195 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:36:56.195 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.195 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding auth protocol: cephx 2024-09-12T00:36:56.195 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding auth protocol: cephx 2024-09-12T00:36:56.195 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding auth protocol: cephx 2024-09-12T00:36:56.195 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: secure 2024-09-12T00:36:56.195 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: crc 2024-09-12T00:36:56.196 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: secure 2024-09-12T00:36:56.196 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: crc 2024-09-12T00:36:56.196 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: secure 2024-09-12T00:36:56.196 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: crc 2024-09-12T00:36:56.196 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: crc 2024-09-12T00:36:56.196 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: secure 2024-09-12T00:36:56.196 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: crc 2024-09-12T00:36:56.196 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: secure 2024-09-12T00:36:56.196 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: crc 2024-09-12T00:36:56.196 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e25b0) adding con mode: secure 2024-09-12T00:36:56.196 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:36:55.649+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.196 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command objecter_requests cmddesc objecter_requests hook 0x560a870e5ef0 EEXIST 2024-09-12T00:36:56.196 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:36:55.649+0000 7f93b8537800 10 monclient: init 2024-09-12T00:36:56.196 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding auth protocol: cephx 2024-09-12T00:36:56.197 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding auth protocol: cephx 2024-09-12T00:36:56.197 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding auth protocol: cephx 2024-09-12T00:36:56.197 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: secure 2024-09-12T00:36:56.197 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: crc 2024-09-12T00:36:56.197 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: secure 2024-09-12T00:36:56.197 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: crc 2024-09-12T00:36:56.197 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: secure 2024-09-12T00:36:56.197 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: crc 2024-09-12T00:36:56.197 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: crc 2024-09-12T00:36:56.197 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: secure 2024-09-12T00:36:56.197 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: crc 2024-09-12T00:36:56.197 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: secure 2024-09-12T00:36:56.197 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: crc 2024-09-12T00:36:56.198 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:36:55.649+0000 7f93b8537800 5 AuthRegistry(0x560a870e1408) adding con mode: secure 2024-09-12T00:36:56.198 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:36:55.649+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.198 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:36:55.650+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.198 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:36:55.650+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command rotate-key cmddesc rotate-key hook 0x560a870e1550 EEXIST 2024-09-12T00:36:56.198 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:56.198 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:36:56.198 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-b con 0x560a87109be0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:56.198 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-a con 0x560a8710beb0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:56.198 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-c con 0x560a871083b0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:56.198 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.198 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.198 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.198 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:56.199 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient(hunting): authenticate will time out at 2224.222102s 2024-09-12T00:36:56.199 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:36:55.650+0000 7f93b49c4640 10 monclient(hunting): get_auth_request con 0x560a8710beb0 auth_method 0 2024-09-12T00:36:56.199 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:36:55.650+0000 7f93b49c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.199 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:36:55.650+0000 7f93b49c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.199 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:36:55.650+0000 7f93b49c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.199 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): get_auth_request con 0x560a871083b0 auth_method 0 2024-09-12T00:36:56.199 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.199 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.199 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.199 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:36:55.650+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.199 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:36:55.650+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.199 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:36:55.650+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.199 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.200 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.200 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.200 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:36:55.650+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request con 0x560a87109be0 auth_method 0 2024-09-12T00:36:56.200 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:36:55.650+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.200 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:36:55.650+0000 7f93ab9c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.200 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:36:55.650+0000 7f93ab9c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.200 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient(hunting): handle_auth_done global_id 7718 payload 824 2024-09-12T00:36:56.200 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient: _finish_hunting 0 2024-09-12T00:36:56.200 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:36:55.650+0000 7f93b41c3640 1 monclient: found mon.noname-c 2024-09-12T00:36:56.200 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:36:55.650+0000 7f93b41c3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:36:56.200 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.200 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:56.200 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: dump: 2024-09-12T00:36:56.201 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.201 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.201 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.201 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.201 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.201 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.201 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.201 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.201 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.201 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.201 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: _finish_auth 0 2024-09-12T00:36:56.201 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:36:56.201 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:56.201 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.202 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:56.202 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:36:55.650+0000 7f9299ffb640 10 monclient: dump: 2024-09-12T00:36:56.202 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.202 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.202 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.202 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.202 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.202 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.202 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.202 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.202 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.202 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.202 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:36:55.650+0000 7f93b8537800 5 monclient: authenticate success, global_id 7718 2024-09-12T00:36:56.202 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:36:55.650+0000 7f93b51c5640 4 set_mon_vals no callback set 2024-09-12T00:36:56.203 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient: _renew_subs 2024-09-12T00:36:56.203 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:56.203 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient: _renew_subs 2024-09-12T00:36:56.203 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:36:55.650+0000 7f93b8537800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:36:56.203 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:36:55.652+0000 7f9299ffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:36:56.203 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:36:55.652+0000 7f9299ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:56.203 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:36:55.652+0000 7f9299ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:56.203 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:36:55.652+0000 7f93b8537800 10 monclient: get_monmap_and_config 2024-09-12T00:36:56.203 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:36:55.652+0000 7f93b8537800 10 monclient: build_initial_monmap 2024-09-12T00:36:56.203 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:36:55.652+0000 7f93b8537800 1 build_initial for_mkfs: 0 2024-09-12T00:36:56.203 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:36:55.652+0000 7f93b8537800 10 monclient: monmap: 2024-09-12T00:36:56.203 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:36:56.203 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:56.203 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:36:56.204 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:36:56.204 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:56.204 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.204 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:36:56.204 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:36:56.204 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:36:56.204 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.204 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding auth protocol: cephx 2024-09-12T00:36:56.204 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding auth protocol: cephx 2024-09-12T00:36:56.204 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding auth protocol: cephx 2024-09-12T00:36:56.204 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: secure 2024-09-12T00:36:56.204 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: crc 2024-09-12T00:36:56.204 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: secure 2024-09-12T00:36:56.204 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: crc 2024-09-12T00:36:56.205 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: secure 2024-09-12T00:36:56.205 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: crc 2024-09-12T00:36:56.205 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: crc 2024-09-12T00:36:56.205 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: secure 2024-09-12T00:36:56.205 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: crc 2024-09-12T00:36:56.205 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: secure 2024-09-12T00:36:56.205 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: crc 2024-09-12T00:36:56.205 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:36:55.652+0000 7f93b8537800 5 AuthRegistry(0x560a871293d0) adding con mode: secure 2024-09-12T00:36:56.205 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:36:55.652+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x7f928c076380 auth_method 0 2024-09-12T00:36:56.205 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:36:55.653+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.205 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient: init 2024-09-12T00:36:56.205 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding auth protocol: cephx 2024-09-12T00:36:56.205 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding auth protocol: cephx 2024-09-12T00:36:56.206 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding auth protocol: cephx 2024-09-12T00:36:56.206 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: secure 2024-09-12T00:36:56.206 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: crc 2024-09-12T00:36:56.206 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: secure 2024-09-12T00:36:56.206 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: crc 2024-09-12T00:36:56.206 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: secure 2024-09-12T00:36:56.206 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: crc 2024-09-12T00:36:56.206 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: crc 2024-09-12T00:36:56.206 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: secure 2024-09-12T00:36:56.206 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: crc 2024-09-12T00:36:56.206 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: secure 2024-09-12T00:36:56.206 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: crc 2024-09-12T00:36:56.206 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 AuthRegistry(0x7ffce48615d0) adding con mode: secure 2024-09-12T00:36:56.206 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:36:55.653+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.207 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:36:55.653+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.207 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:36:55.653+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command rotate-key cmddesc rotate-key hook 0x7ffce4861718 EEXIST 2024-09-12T00:36:56.207 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:56.207 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:36:56.207 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-a con 0x560a8715d880 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:56.207 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-c con 0x560a87157a00 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:56.207 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-b con 0x560a87158c40 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:56.207 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.207 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.207 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.207 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:56.207 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:36:55.653+0000 7f93b8537800 10 monclient(hunting): authenticate will time out at 2224.225653s 2024-09-12T00:36:56.207 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request con 0x560a8715d880 auth_method 0 2024-09-12T00:36:56.207 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.208 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.208 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.208 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:36:55.653+0000 7f93b49c4640 10 monclient(hunting): get_auth_request con 0x560a87157a00 auth_method 0 2024-09-12T00:36:56.208 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:36:55.653+0000 7f93b49c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.208 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:36:55.653+0000 7f93b49c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.208 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:36:55.653+0000 7f93b49c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.208 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.208 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.208 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.208 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:36:55.653+0000 7f93b41c3640 10 monclient(hunting): get_auth_request con 0x560a87158c40 auth_method 0 2024-09-12T00:36:56.208 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:36:55.653+0000 7f93b41c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.208 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:36:55.653+0000 7f93b41c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.208 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:36:55.653+0000 7f93b41c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.208 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:36:55.653+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.209 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:36:55.653+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.209 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:36:55.653+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.209 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:36:55.653+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.209 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:36:55.653+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.209 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:36:55.653+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.209 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_done global_id 8232 payload 274 2024-09-12T00:36:56.209 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient: _finish_hunting 0 2024-09-12T00:36:56.209 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 1 monclient: found mon.noname-a 2024-09-12T00:36:56.209 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:36:55.653+0000 7f93ab9c2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:36:56.209 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.209 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:56.209 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: dump: 2024-09-12T00:36:56.209 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.209 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.210 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.210 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.210 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.210 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.210 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.210 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.210 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.210 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.210 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:36:56.210 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:36:56.210 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:56.210 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.210 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:56.210 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:36:55.654+0000 7f928b7fe640 10 monclient: dump: 2024-09-12T00:36:56.211 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.211 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.211 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.211 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.211 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.211 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.211 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.211 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.211 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.211 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.211 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 monclient: authenticate success, global_id 8232 2024-09-12T00:36:56.211 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:36:55.654+0000 7f93b8537800 10 monclient: get_monmap_and_config success 2024-09-12T00:36:56.211 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:36:55.654+0000 7f93b8537800 4 set_mon_vals no callback set 2024-09-12T00:36:56.212 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:36:55.654+0000 7f93b8537800 10 monclient: shutdown 2024-09-12T00:36:56.212 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:36:55.654+0000 7f93b8537800 10 monclient: build_initial_monmap 2024-09-12T00:36:56.212 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:36:55.654+0000 7f93b8537800 1 build_initial for_mkfs: 0 2024-09-12T00:36:56.212 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:36:55.654+0000 7f93b8537800 10 monclient: monmap: 2024-09-12T00:36:56.212 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:36:56.212 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:56.212 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:36:56.212 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:36:56.212 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:56.212 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.212 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:36:56.212 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:36:56.212 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:36:56.212 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.213 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding auth protocol: cephx 2024-09-12T00:36:56.213 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding auth protocol: cephx 2024-09-12T00:36:56.213 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding auth protocol: cephx 2024-09-12T00:36:56.213 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: secure 2024-09-12T00:36:56.213 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: crc 2024-09-12T00:36:56.213 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: secure 2024-09-12T00:36:56.213 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: crc 2024-09-12T00:36:56.213 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: secure 2024-09-12T00:36:56.213 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: crc 2024-09-12T00:36:56.213 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: crc 2024-09-12T00:36:56.213 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: secure 2024-09-12T00:36:56.213 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: crc 2024-09-12T00:36:56.214 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: secure 2024-09-12T00:36:56.214 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: crc 2024-09-12T00:36:56.214 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:36:55.654+0000 7f93b8537800 5 AuthRegistry(0x560a8714dfc0) adding con mode: secure 2024-09-12T00:36:56.214 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:36:55.655+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.214 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:36:55.655+0000 7f93b8537800 1 librados: starting msgr at 2024-09-12T00:36:56.214 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:36:55.655+0000 7f93b8537800 1 librados: starting objecter 2024-09-12T00:36:56.214 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command objecter_requests cmddesc objecter_requests hook 0x560a8712f020 EEXIST 2024-09-12T00:36:56.214 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:36:55.655+0000 7f93b8537800 1 librados: setting wanted keys 2024-09-12T00:36:56.214 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:36:55.655+0000 7f93b8537800 1 librados: calling monclient init 2024-09-12T00:36:56.214 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient: init 2024-09-12T00:36:56.214 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding auth protocol: cephx 2024-09-12T00:36:56.214 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding auth protocol: cephx 2024-09-12T00:36:56.214 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding auth protocol: cephx 2024-09-12T00:36:56.214 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: secure 2024-09-12T00:36:56.215 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: crc 2024-09-12T00:36:56.215 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: secure 2024-09-12T00:36:56.215 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: crc 2024-09-12T00:36:56.215 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: secure 2024-09-12T00:36:56.215 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: crc 2024-09-12T00:36:56.215 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: crc 2024-09-12T00:36:56.215 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: secure 2024-09-12T00:36:56.215 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: crc 2024-09-12T00:36:56.215 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: secure 2024-09-12T00:36:56.215 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: crc 2024-09-12T00:36:56.215 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 AuthRegistry(0x560a87121990) adding con mode: secure 2024-09-12T00:36:56.215 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:36:55.655+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.215 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:36:55.655+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.215 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:36:55.655+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command rotate-key cmddesc rotate-key hook 0x560a87121ad8 EEXIST 2024-09-12T00:36:56.216 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient: _reopen_session rank -1 2024-09-12T00:36:56.216 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:36:56.216 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-c con 0x560a87157a00 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:36:56.216 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-b con 0x560a87158c40 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:36:56.216 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): picked mon.noname-a con 0x560a8715d880 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:36:56.216 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.216 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.216 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:56.216 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): _renew_subs 2024-09-12T00:36:56.216 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:36:55.655+0000 7f93b8537800 10 monclient(hunting): authenticate will time out at 2224.227889s 2024-09-12T00:36:56.216 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:36:55.655+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request con 0x560a87157a00 auth_method 0 2024-09-12T00:36:56.216 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:36:55.655+0000 7f93ab9c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.216 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:36:55.655+0000 7f93ab9c2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.216 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:36:55.655+0000 7f93ab9c2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.217 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:36:55.655+0000 7f93b41c3640 10 monclient(hunting): get_auth_request con 0x560a8715d880 auth_method 0 2024-09-12T00:36:56.217 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.217 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.217 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.217 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:36:55.656+0000 7f93b49c4640 10 monclient(hunting): get_auth_request con 0x560a87158c40 auth_method 0 2024-09-12T00:36:56.217 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:36:55.656+0000 7f93b49c4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:56.217 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:36:55.656+0000 7f93b49c4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:56.217 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:36:55.656+0000 7f93b49c4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:56.217 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:36:55.656+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.217 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:36:55.656+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.217 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:36:55.656+0000 7f93ab9c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.217 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.217 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.218 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.218 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:36:55.656+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:56.218 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:36:55.656+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:56.218 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:36:55.656+0000 7f93b49c4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:56.218 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient(hunting): handle_auth_done global_id 8235 payload 824 2024-09-12T00:36:56.218 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient: _finish_hunting 0 2024-09-12T00:36:56.218 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:36:55.656+0000 7f93b41c3640 1 monclient: found mon.noname-a 2024-09-12T00:36:56.218 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:36:55.656+0000 7f93b41c3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:36:56.218 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.218 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:56.218 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: dump: 2024-09-12T00:36:56.218 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.218 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.218 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.219 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.219 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.219 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.219 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.219 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.219 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.219 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.219 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: _finish_auth 0 2024-09-12T00:36:56.219 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:36:56.219 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:56.219 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:56.219 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:56.220 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:36:55.656+0000 7f9289ffb640 10 monclient: dump: 2024-09-12T00:36:56.220 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:36:56.220 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:36:56.220 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.220 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:36:56.220 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:56.220 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:36:56.220 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:36:56.220 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:36:56.220 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:36:56.220 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.220 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:36:55.656+0000 7f93b8537800 5 monclient: authenticate success, global_id 8235 2024-09-12T00:36:56.220 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:36:55.656+0000 7f928b7fe640 4 set_mon_vals no callback set 2024-09-12T00:36:56.221 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:36:55.656+0000 7f93b8537800 10 monclient: _renew_subs 2024-09-12T00:36:56.221 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:36:55.656+0000 7f93b8537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:36:56.221 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:36:55.656+0000 7f93b8537800 10 monclient: _renew_subs 2024-09-12T00:36:56.221 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:36:55.656+0000 7f93b8537800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:36:56.221 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:36:55.656+0000 7f93b8537800 1 librados: init done 2024-09-12T00:36:56.221 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:36:55.656+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command cr dump hook 0x560a87150c38 2024-09-12T00:36:56.221 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:36:55.657+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.221 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:36:55.658+0000 7f9289ffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:36:56.221 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:36:55.658+0000 7f9289ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:56.221 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:36:55.658+0000 7f9289ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:36:56.221 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:36:55.658+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x7f927c076470 auth_method 0 2024-09-12T00:36:56.221 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:36:55.658+0000 7f93b49c4640 10 monclient: get_auth_request con 0x560a871777e0 auth_method 0 2024-09-12T00:36:56.221 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.221 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:36:55.659+0000 7f93b8537800 20 realm 2024-09-12T00:36:56.222 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.222 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.222 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:36:55.659+0000 7f93b8537800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:56.222 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.222 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.222 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:36:55.659+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.222 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:36:55.659+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x560a8717ba30 auth_method 0 2024-09-12T00:36:56.222 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:36:55.660+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:56.222 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:36:55.660+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.222 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:36:55.660+0000 7f93b49c4640 10 monclient: get_auth_request con 0x560a8717f2e0 auth_method 0 2024-09-12T00:36:56.222 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:36:55.661+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:56.222 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:36:55.661+0000 7f93b8537800 20 searching for the correct realm 2024-09-12T00:36:56.222 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:36:55.661+0000 7f93b41c3640 10 monclient: get_auth_request con 0x7f93ac030080 auth_method 0 2024-09-12T00:36:56.223 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:36:55.662+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x7f939c040040 auth_method 0 2024-09-12T00:36:56.223 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:36:55.662+0000 7f93ab9c2640 0 -- 172.21.15.133:0/2048925550 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f939c040040 msgr2=0x7f939c04c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:56.223 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:36:55.863+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x7f939c040040 auth_method 0 2024-09-12T00:36:56.223 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:36:55.864+0000 7f93b49c4640 10 monclient: get_auth_request con 0x7f93ac018040 auth_method 0 2024-09-12T00:36:56.223 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:36:55.866+0000 7f93b41c3640 10 monclient: get_auth_request con 0x7f939c034070 auth_method 0 2024-09-12T00:36:56.223 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:36:55.867+0000 7f93ab9c2640 0 -- 172.21.15.133:0/2048925550 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f93a4073030 msgr2=0x7f93a40c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:56.223 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:36:56.069+0000 7f93ab9c2640 10 monclient: get_auth_request con 0x7f93a4073030 auth_method 0 2024-09-12T00:36:56.223 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:56.223 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:56.223 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:56.223 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:56.223 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:56.223 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:56.224 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.224 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.224 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.224 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:56.224 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:36:56.074+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.224 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:56.224 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 zone default found 2024-09-12T00:36:56.224 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:36:56.075+0000 7f93b8537800 4 Realm: () 2024-09-12T00:36:56.224 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:36:56.075+0000 7f93b8537800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:56.224 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:36:56.075+0000 7f93b8537800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:56.224 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:36:56.075+0000 7f93b8537800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:56.224 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 zonegroup default 2024-09-12T00:36:56.224 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.225 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.225 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.225 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.225 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:36:56.075+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.225 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:36:56.076+0000 7f93b8537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.225 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:36:56.076+0000 7f93b8537800 20 started sync module instance, tier type = 2024-09-12T00:36:56.225 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:36:56.076+0000 7f93b8537800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:56.225 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=0 2024-09-12T00:36:56.225 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=1 2024-09-12T00:36:56.225 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=2 2024-09-12T00:36:56.225 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=3 2024-09-12T00:36:56.225 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=4 2024-09-12T00:36:56.225 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:36:56.085+0000 7f93b8537800 20 add_watcher() i=5 2024-09-12T00:36:56.226 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:36:56.086+0000 7f93b8537800 20 add_watcher() i=6 2024-09-12T00:36:56.226 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:36:56.087+0000 7f93b8537800 20 add_watcher() i=7 2024-09-12T00:36:56.226 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:36:56.087+0000 7f93b8537800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:56.226 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding auth protocol: cephx 2024-09-12T00:36:56.226 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding auth protocol: cephx 2024-09-12T00:36:56.226 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding auth protocol: cephx 2024-09-12T00:36:56.226 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: secure 2024-09-12T00:36:56.226 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: crc 2024-09-12T00:36:56.226 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: secure 2024-09-12T00:36:56.226 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: crc 2024-09-12T00:36:56.226 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: secure 2024-09-12T00:36:56.226 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: crc 2024-09-12T00:36:56.226 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: crc 2024-09-12T00:36:56.226 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: secure 2024-09-12T00:36:56.227 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: crc 2024-09-12T00:36:56.227 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: secure 2024-09-12T00:36:56.227 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: crc 2024-09-12T00:36:56.227 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:36:56.089+0000 7f93b8537800 5 AuthRegistry(0x7ffce4861ab0) adding con mode: secure 2024-09-12T00:36:56.227 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:36:56.089+0000 7f926afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:56.227 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:36:56.089+0000 7f93b8537800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:56.227 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:36:56.090+0000 7f93b8537800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:56.227 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:36:56.090+0000 7f93b8537800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:56.227 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command cache list hook 0x560a87152fb0 2024-09-12T00:36:56.227 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command cache inspect hook 0x560a87152fb0 2024-09-12T00:36:56.227 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command cache erase hook 0x560a87152fb0 2024-09-12T00:36:56.227 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command cache zap hook 0x560a87152fb0 2024-09-12T00:36:56.227 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 note: GC not initialized 2024-09-12T00:36:56.227 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:36:56.090+0000 7f9269fdb640 20 reqs_thread_entry: start 2024-09-12T00:36:56.228 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command sync trace show hook 0x7f939c00c5d0 2024-09-12T00:36:56.228 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command sync trace history hook 0x7f939c00c5d0 2024-09-12T00:36:56.228 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command sync trace active hook 0x7f939c00c5d0 2024-09-12T00:36:56.228 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:36:56.090+0000 7f93b8537800 5 asok(0x560a86e6b630) register_command sync trace active_short hook 0x7f939c00c5d0 2024-09-12T00:36:56.228 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:36:56.090+0000 7f93b8537800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:56.228 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:36:56.090+0000 7f93b8537800 20 Filter name: none 2024-09-12T00:36:56.228 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:36:56.090+0000 7f91db7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:56.228 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:36:56.090+0000 7f93b8537800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:36:56.228 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:36:56.090+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.228 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:36:56.090+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:36:56.228 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:36:56.090+0000 7f93b8537800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:36:56.228 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:36:56.090+0000 7f93b8537800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:36:56.228 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:36:56.090+0000 7f93b8537800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:36:56.228 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:36:56.090+0000 7f93b8537800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.229 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:36:56.091+0000 7f93b8537800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:36:56.229 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:36:56.091+0000 7f93b8537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:36:56.229 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:36:56.091+0000 7f93b8537800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:36:56.229 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:36:56.091+0000 7f93b8537800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:56.229 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:36:56.091+0000 7f93b8537800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:36:56.229 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:36:56.091+0000 7f93b8537800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:36:56.229 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:36:56.095+0000 7f93b8537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:36:56.229 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:36:56.095+0000 7f93b8537800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:36:56.229 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:36:56.095+0000 7f93b8537800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:36:56.229 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:36:56.095+0000 7f93b8537800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:36:56.229 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:36:56.095+0000 7f928b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497079 cookie 94603216197360 notifier 8235 bl.length()=911 2024-09-12T00:36:56.229 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:36:56.095+0000 7f928b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:36:56.229 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:36:56.095+0000 7f928b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:36:56.230 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:36:56.095+0000 7f928b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:36:56.230 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:36:56.097+0000 7f93b8537800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:36:56.230 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:36:56.097+0000 7f93b8537800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:36:56.230 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:36:56.097+0000 7f93b8537800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:36:56.230 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:36:56.097+0000 7f93b8537800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:36:56.230 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:36:56.099+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.0 2024-09-12T00:36:56.230 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:36:56.099+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.0 2024-09-12T00:36:56.230 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:36:56.099+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.1 2024-09-12T00:36:56.230 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:36:56.099+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.1 2024-09-12T00:36:56.230 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:36:56.099+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.2 2024-09-12T00:36:56.230 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:36:56.099+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.2 2024-09-12T00:36:56.230 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:36:56.099+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.3 2024-09-12T00:36:56.230 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:36:56.099+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.3 2024-09-12T00:36:56.231 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:36:56.099+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:36:56.231 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:36:56.099+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:36:56.231 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:36:56.100+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:36:56.231 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:36:56.100+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:36:56.231 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:36:56.100+0000 7f93b8537800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:36:56.231 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:36:56.100+0000 7f93b8537800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:36:56.231 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:36:56.103+0000 7f93b8537800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f93b8537800 time 2024-09-12T00:36:56.103536+0000 2024-09-12T00:36:56.231 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:56.231 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.231 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:56.231 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f93b9b8c71a] 2024-09-12T00:36:56.231 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f93b9b8c8d8] 2024-09-12T00:36:56.231 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560a84f48641] 2024-09-12T00:36:56.232 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x560a84f5751b] 2024-09-12T00:36:56.232 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x560a84f583e4] 2024-09-12T00:36:56.232 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:36:56.232 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f93b8829590] 2024-09-12T00:36:56.232 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:36:56.232 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:36:56.232 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.232 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:36:56.104+0000 7f93b8537800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:56.232 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f93b8537800 thread_name:radosgw-admin 2024-09-12T00:36:56.232 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.232 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:56.232 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f93b883e6f0] 2024-09-12T00:36:56.233 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f93b888b99c] 2024-09-12T00:36:56.233 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:36:56.233 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:36:56.233 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f93b9b8c774] 2024-09-12T00:36:56.233 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f93b9b8c8d8] 2024-09-12T00:36:56.233 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560a84f48641] 2024-09-12T00:36:56.233 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x560a84f5751b] 2024-09-12T00:36:56.233 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x560a84f583e4] 2024-09-12T00:36:56.233 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:36:56.233 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f93b8829590] 2024-09-12T00:36:56.233 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:36:56.233 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:36:56.233 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:56.233 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:36:56.234 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:36:56.234 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:36:56.234 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:36:56.234 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:36:56.234 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:36:56.234 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:36:56.234 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:36:56.234 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:36:56.234 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:36:56.234 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:36:56.234 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:36:56.234 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:36:56.234 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:36:56.234 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:36:56.235 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:36:56.235 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:36:56.235 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:36:56.235 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:36:56.235 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:36:56.235 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:36:56.235 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:36:56.235 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:36:56.235 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:36:56.235 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:36:56.235 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:36:56.235 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:36:56.235 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:36:56.235 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:36:56.236 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:36:56.236 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:36:56.236 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:36:56.236 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:36:56.236 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:36:56.236 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:36:56.236 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:36:56.236 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:36:56.236 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:36:56.236 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:36:56.236 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:36:56.236 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:36:56.236 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:36:56.236 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:36:56.237 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:36:56.237 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:36:56.237 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:36:56.237 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:36:56.237 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:36:56.237 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:36:56.237 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:36:56.237 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:36:56.237 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:36:56.237 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:36:56.237 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:36:56.237 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:36:56.237 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:36:56.237 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:36:56.238 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:36:56.238 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:36:56.238 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:36:56.238 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:36:56.238 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:36:56.238 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:36:56.238 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:36:56.238 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:36:56.238 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:36:56.238 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:36:56.238 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:36:56.238 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:36:56.238 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:36:56.239 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:36:56.239 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:36:56.239 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:36:56.239 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:36:56.239 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:36:56.239 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:36:56.239 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:36:56.239 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:36:56.239 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:36:56.239 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:36:56.239 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:36:56.239 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:36:56.239 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:36:56.239 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:36:56.240 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:36:56.240 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:36:56.240 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:36:56.240 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:36:56.240 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:36:56.240 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:36:56.240 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:36:56.240 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:36:56.240 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:36:56.240 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:36:56.240 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:36:56.240 INFO:tasks.workunit.client.0.smithi133.stderr: 7f91db7fe640 / http_manager 2024-09-12T00:36:56.240 INFO:tasks.workunit.client.0.smithi133.stderr: 7f9269fdb640 / http_manager 2024-09-12T00:36:56.240 INFO:tasks.workunit.client.0.smithi133.stderr: 7f926afdd640 / rgw_dt_lg_renew 2024-09-12T00:36:56.241 INFO:tasks.workunit.client.0.smithi133.stderr: 7f9289ffb640 / ms_dispatch 2024-09-12T00:36:56.241 INFO:tasks.workunit.client.0.smithi133.stderr: 7f928b7fe640 / io_context_pool 2024-09-12T00:36:56.241 INFO:tasks.workunit.client.0.smithi133.stderr: 7f9299ffb640 / ms_dispatch 2024-09-12T00:36:56.241 INFO:tasks.workunit.client.0.smithi133.stderr: 7f92a0e09640 / ms_dispatch 2024-09-12T00:36:56.241 INFO:tasks.workunit.client.0.smithi133.stderr: 7f92a260c640 / io_context_pool 2024-09-12T00:36:56.241 INFO:tasks.workunit.client.0.smithi133.stderr: 7f93ab9c2640 / msgr-worker-2 2024-09-12T00:36:56.241 INFO:tasks.workunit.client.0.smithi133.stderr: 7f93b41c3640 / msgr-worker-1 2024-09-12T00:36:56.241 INFO:tasks.workunit.client.0.smithi133.stderr: 7f93b49c4640 / msgr-worker-0 2024-09-12T00:36:56.241 INFO:tasks.workunit.client.0.smithi133.stderr: 7f93b51c5640 / io_context_pool 2024-09-12T00:36:56.241 INFO:tasks.workunit.client.0.smithi133.stderr: 7f93b8537800 / radosgw-admin 2024-09-12T00:36:56.241 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:36:56.241 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:36:56.241 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:36:56.105219Z_e7d9b1c0-7d5f-4cac-95af-38ba959e5560/log 2024-09-12T00:36:56.241 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:36:56.242 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:36:56.243 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:56.243 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:56.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.179+0000 7fd26d013800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.181+0000 7fd26d013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.181+0000 7fd26d013800 20 realm 2024-09-12T00:36:56.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.181+0000 7fd26d013800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.181+0000 7fd26d013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.181+0000 7fd26d013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:56.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.181+0000 7fd26d013800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.181+0000 7fd26d013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.181+0000 7fd26d013800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.182+0000 7fd26d013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:56.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.182+0000 7fd26d013800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.183+0000 7fd26d013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:56.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.183+0000 7fd26d013800 20 searching for the correct realm 2024-09-12T00:36:56.245 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.185+0000 7fd267f91640 0 -- 172.21.15.133:0/1300970276 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fd25c03d940 msgr2=0x7fd25c016400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:56.389 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.390+0000 7fd267f91640 0 -- 172.21.15.133:0/1300970276 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fd258018070 msgr2=0x7fd25808a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:56.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.596+0000 7fd26d013800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:56.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.596+0000 7fd26d013800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:56.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.596+0000 7fd26d013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:56.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.596+0000 7fd26d013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:56.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.596+0000 7fd26d013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:56.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.596+0000 7fd26d013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:56.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.596+0000 7fd26d013800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.597+0000 7fd26d013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.597+0000 7fd26d013800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.597+0000 7fd26d013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:56.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.597+0000 7fd26d013800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.597+0000 7fd26d013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:56.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.597+0000 7fd26d013800 20 zone default found 2024-09-12T00:36:56.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.597+0000 7fd26d013800 4 Realm: () 2024-09-12T00:36:56.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.597+0000 7fd26d013800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:56.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.597+0000 7fd26d013800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:56.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.597+0000 7fd26d013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:56.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.597+0000 7fd26d013800 20 zonegroup default 2024-09-12T00:36:56.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.597+0000 7fd26d013800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.598+0000 7fd26d013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.598+0000 7fd26d013800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.598+0000 7fd26d013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.598+0000 7fd26d013800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.598+0000 7fd26d013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.598+0000 7fd26d013800 20 started sync module instance, tier type = 2024-09-12T00:36:56.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.598+0000 7fd26d013800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:56.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.606+0000 7fd26d013800 20 add_watcher() i=0 2024-09-12T00:36:56.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.606+0000 7fd26d013800 20 add_watcher() i=1 2024-09-12T00:36:56.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.606+0000 7fd26d013800 20 add_watcher() i=2 2024-09-12T00:36:56.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.606+0000 7fd26d013800 20 add_watcher() i=3 2024-09-12T00:36:56.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.606+0000 7fd26d013800 20 add_watcher() i=4 2024-09-12T00:36:56.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.606+0000 7fd26d013800 20 add_watcher() i=5 2024-09-12T00:36:56.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.606+0000 7fd26d013800 20 add_watcher() i=6 2024-09-12T00:36:56.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.607+0000 7fd26d013800 20 add_watcher() i=7 2024-09-12T00:36:56.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.607+0000 7fd26d013800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:56.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.609+0000 7fd11efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:56.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.609+0000 7fd26d013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:56.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.609+0000 7fd26d013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:56.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.609+0000 7fd26d013800 5 note: GC not initialized 2024-09-12T00:36:56.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.609+0000 7fd11dfdb640 20 reqs_thread_entry: start 2024-09-12T00:36:56.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.609+0000 7fd26d013800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:56.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.610+0000 7fd26d013800 20 Filter name: none 2024-09-12T00:36:56.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.610+0000 7fd08f7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:56.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.610+0000 7fd26d013800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.610+0000 7fd26d013800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:36:56.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.610+0000 7fd26d013800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.611+0000 7fd26d013800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:36:56.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.611+0000 7fd26d013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:56.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.611+0000 7fd26d013800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.611+0000 7fd26d013800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:36:56.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.611+0000 7fd26d013800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.612+0000 7fd26d013800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:36:56.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.612+0000 7fd26d013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:56.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.613+0000 7fd11efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:56.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.615+0000 7fd26d013800 20 remove_watcher() i=0 2024-09-12T00:36:56.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.615+0000 7fd26d013800 2 removed watcher, disabling cache 2024-09-12T00:36:56.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.616+0000 7fd26d013800 20 remove_watcher() i=1 2024-09-12T00:36:56.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.617+0000 7fd26d013800 20 remove_watcher() i=2 2024-09-12T00:36:56.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.618+0000 7fd26d013800 20 remove_watcher() i=3 2024-09-12T00:36:56.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.619+0000 7fd26d013800 20 remove_watcher() i=4 2024-09-12T00:36:56.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.620+0000 7fd26d013800 20 remove_watcher() i=5 2024-09-12T00:36:56.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.621+0000 7fd26d013800 20 remove_watcher() i=6 2024-09-12T00:36:56.621 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.622+0000 7fd26d013800 20 remove_watcher() i=7 2024-09-12T00:36:56.671 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:36:56.699 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:56.699 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:56.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.934+0000 7f3fb5894640 0 --2- 172.21.15.133:0/3293264922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x557410c042a0 0x557410bd3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:36:56.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.939+0000 7f3fb85ab800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.940+0000 7f3fb85ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.940+0000 7f3fb85ab800 20 realm 2024-09-12T00:36:56.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.940+0000 7f3fb85ab800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.940+0000 7f3fb85ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.940+0000 7f3fb85ab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:56.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.940+0000 7f3fb85ab800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.940+0000 7f3fb85ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:56.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.940+0000 7f3fb85ab800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.941+0000 7f3fb85ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:56.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.941+0000 7f3fb85ab800 20 rados->read ofs=0 len=0 2024-09-12T00:36:56.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.942+0000 7f3fb85ab800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:56.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.942+0000 7f3fb85ab800 20 searching for the correct realm 2024-09-12T00:36:56.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:56.942+0000 7f3fb6095640 0 -- 172.21.15.133:0/1379651609 >> [v2:172.21.15.133:6816/1011460824,v1:172.21.15.133:6817/1011460824] conn(0x7f3fb006fd50 msgr2=0x7f3fb006eab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:57.145 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.146+0000 7f3fb6896640 0 -- 172.21.15.133:0/1379651609 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f3fb0080b70 msgr2=0x7f3fb0026a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:57.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.153+0000 7f3fb85ab800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:36:57.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.153+0000 7f3fb85ab800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:36:57.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.153+0000 7f3fb85ab800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:57.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.153+0000 7f3fb85ab800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:57.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.153+0000 7f3fb85ab800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:57.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.153+0000 7f3fb85ab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:57.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.153+0000 7f3fb85ab800 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.153+0000 7f3fb85ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:57.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.153+0000 7f3fb85ab800 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.153+0000 7f3fb85ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:57.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.153+0000 7f3fb85ab800 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.154+0000 7f3fb85ab800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:57.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.154+0000 7f3fb85ab800 20 zone default found 2024-09-12T00:36:57.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.154+0000 7f3fb85ab800 4 Realm: () 2024-09-12T00:36:57.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.154+0000 7f3fb85ab800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:36:57.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.154+0000 7f3fb85ab800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:36:57.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.154+0000 7f3fb85ab800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:57.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.154+0000 7f3fb85ab800 20 zonegroup default 2024-09-12T00:36:57.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.154+0000 7f3fb85ab800 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.154+0000 7f3fb85ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:57.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.154+0000 7f3fb85ab800 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.154+0000 7f3fb85ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:57.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.154+0000 7f3fb85ab800 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.154+0000 7f3fb85ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:57.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.154+0000 7f3fb85ab800 20 started sync module instance, tier type = 2024-09-12T00:36:57.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.154+0000 7f3fb85ab800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:36:57.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.163+0000 7f3fb85ab800 20 add_watcher() i=0 2024-09-12T00:36:57.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.163+0000 7f3fb85ab800 20 add_watcher() i=1 2024-09-12T00:36:57.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.163+0000 7f3fb85ab800 20 add_watcher() i=2 2024-09-12T00:36:57.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.163+0000 7f3fb85ab800 20 add_watcher() i=3 2024-09-12T00:36:57.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.163+0000 7f3fb85ab800 20 add_watcher() i=4 2024-09-12T00:36:57.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.163+0000 7f3fb85ab800 20 add_watcher() i=5 2024-09-12T00:36:57.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.163+0000 7f3fb85ab800 20 add_watcher() i=6 2024-09-12T00:36:57.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.164+0000 7f3fb85ab800 20 add_watcher() i=7 2024-09-12T00:36:57.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.164+0000 7f3fb85ab800 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:57.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.165+0000 7f3e6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:57.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.166+0000 7f3fb85ab800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:57.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.166+0000 7f3fb85ab800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:57.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.166+0000 7f3fb85ab800 5 note: GC not initialized 2024-09-12T00:36:57.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.166+0000 7f3de77fe640 20 reqs_thread_entry: start 2024-09-12T00:36:57.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.166+0000 7f3fb85ab800 20 init_complete bucket index max shards: 1 2024-09-12T00:36:57.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.166+0000 7f3fb85ab800 20 Filter name: none 2024-09-12T00:36:57.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.166+0000 7f3de57fa640 20 reqs_thread_entry: start 2024-09-12T00:36:57.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.166+0000 7f3fb85ab800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:36:57.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.166+0000 7f3fb85ab800 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.167+0000 7f3fb85ab800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:36:57.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.167+0000 7f3fb85ab800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:36:57.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.167+0000 7f3fb85ab800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:36:57.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.167+0000 7f3fb85ab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:36:57.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.167+0000 7f3fb85ab800 20 rados->read ofs=0 len=0 2024-09-12T00:36:57.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.167+0000 7f3fb85ab800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:36:57.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.167+0000 7f3fb85ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:36:57.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.167+0000 7f3fb85ab800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:36:57.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.167+0000 7f3fb85ab800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:57.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.167+0000 7f3fb85ab800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:36:57.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.167+0000 7f3fb85ab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:36:57.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.167+0000 7f3fb85ab800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:36:57.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.167+0000 7f3fb85ab800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:36:57.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.168+0000 7f3fb85ab800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:36:57.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.168+0000 7f3fb85ab800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:36:57.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.168+0000 7f3fb85ab800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:36:57.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.168+0000 7f3fb85ab800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:36:57.168 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.169+0000 7f3e6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:57.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.171+0000 7f3fb85ab800 20 remove_watcher() i=0 2024-09-12T00:36:57.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.171+0000 7f3fb85ab800 2 removed watcher, disabling cache 2024-09-12T00:36:57.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.172+0000 7f3fb85ab800 20 remove_watcher() i=1 2024-09-12T00:36:57.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.173+0000 7f3fb85ab800 20 remove_watcher() i=2 2024-09-12T00:36:57.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.174+0000 7f3fb85ab800 20 remove_watcher() i=3 2024-09-12T00:36:57.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.175+0000 7f3fb85ab800 20 remove_watcher() i=4 2024-09-12T00:36:57.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.176+0000 7f3fb85ab800 20 remove_watcher() i=5 2024-09-12T00:36:57.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.176+0000 7f3fb85ab800 20 remove_watcher() i=6 2024-09-12T00:36:57.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:36:57.177+0000 7f3fb85ab800 20 remove_watcher() i=7 2024-09-12T00:37:27.212 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:37:27.243 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:27.243 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:27.285 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.286+0000 7f5563298800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.288+0000 7f5563298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:27.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.288+0000 7f5563298800 20 realm 2024-09-12T00:37:27.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.288+0000 7f5563298800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.288+0000 7f5563298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:27.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.288+0000 7f5563298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:27.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.288+0000 7f5563298800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.287 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.289+0000 7f5563298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:27.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.289+0000 7f5563298800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.289+0000 7f5563298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:27.288 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.289+0000 7f5563298800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.290+0000 7f5563298800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:27.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.290+0000 7f5563298800 20 searching for the correct realm 2024-09-12T00:37:27.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.292+0000 7f555bfff640 0 -- 172.21.15.133:0/1201684420 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f554c049460 msgr2=0x7f554c049880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:27.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.497+0000 7f555bfff640 0 -- 172.21.15.133:0/1201684420 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f555408c960 msgr2=0x7f5554064430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:27.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.705+0000 7f5563298800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:37:27.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.705+0000 7f5563298800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:37:27.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.705+0000 7f5563298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:27.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.705+0000 7f5563298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:27.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.705+0000 7f5563298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:27.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.705+0000 7f5563298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:27.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.705+0000 7f5563298800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.705+0000 7f5563298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:27.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.705+0000 7f5563298800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.705+0000 7f5563298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.705+0000 7f5563298800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.706+0000 7f5563298800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.706+0000 7f5563298800 20 zone default found 2024-09-12T00:37:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.706+0000 7f5563298800 4 Realm: () 2024-09-12T00:37:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.706+0000 7f5563298800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:37:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.706+0000 7f5563298800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:37:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.706+0000 7f5563298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.706+0000 7f5563298800 20 zonegroup default 2024-09-12T00:37:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.706+0000 7f5563298800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.706+0000 7f5563298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:27.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.706+0000 7f5563298800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.707+0000 7f5563298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:27.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.707+0000 7f5563298800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.707+0000 7f5563298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:27.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.707+0000 7f5563298800 20 started sync module instance, tier type = 2024-09-12T00:37:27.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.707+0000 7f5563298800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:37:27.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.718+0000 7f5563298800 20 add_watcher() i=0 2024-09-12T00:37:27.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.718+0000 7f5563298800 20 add_watcher() i=1 2024-09-12T00:37:27.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.718+0000 7f5563298800 20 add_watcher() i=2 2024-09-12T00:37:27.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.718+0000 7f5563298800 20 add_watcher() i=3 2024-09-12T00:37:27.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.718+0000 7f5563298800 20 add_watcher() i=4 2024-09-12T00:37:27.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.718+0000 7f5563298800 20 add_watcher() i=5 2024-09-12T00:37:27.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.718+0000 7f5563298800 20 add_watcher() i=6 2024-09-12T00:37:27.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.719+0000 7f5563298800 20 add_watcher() i=7 2024-09-12T00:37:27.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.719+0000 7f5563298800 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:27.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.722+0000 7f54177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:27.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.723+0000 7f5563298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:27.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.723+0000 7f5563298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:27.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.723+0000 7f5563298800 5 note: GC not initialized 2024-09-12T00:37:27.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.723+0000 7f54167e4640 20 reqs_thread_entry: start 2024-09-12T00:37:27.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.723+0000 7f5563298800 20 init_complete bucket index max shards: 1 2024-09-12T00:37:27.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.723+0000 7f5563298800 20 Filter name: none 2024-09-12T00:37:27.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.724+0000 7f540f7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:27.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.724+0000 7f5563298800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.724+0000 7f5563298800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:37:27.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.724+0000 7f5563298800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.725+0000 7f5563298800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:37:27.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.725+0000 7f5563298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:27.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.725+0000 7f5563298800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.725+0000 7f5563298800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:37:27.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.725+0000 7f5563298800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.725+0000 7f5563298800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:37:27.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.725+0000 7f5563298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:27.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.727+0000 7f54177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:27.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.729+0000 7f5563298800 20 remove_watcher() i=0 2024-09-12T00:37:27.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.729+0000 7f5563298800 2 removed watcher, disabling cache 2024-09-12T00:37:27.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.730+0000 7f5563298800 20 remove_watcher() i=1 2024-09-12T00:37:27.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.732+0000 7f5563298800 20 remove_watcher() i=2 2024-09-12T00:37:27.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.733+0000 7f5563298800 20 remove_watcher() i=3 2024-09-12T00:37:27.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.734+0000 7f5563298800 20 remove_watcher() i=4 2024-09-12T00:37:27.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.735+0000 7f5563298800 20 remove_watcher() i=5 2024-09-12T00:37:27.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.737+0000 7f5563298800 20 remove_watcher() i=6 2024-09-12T00:37:27.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.738+0000 7f5563298800 20 remove_watcher() i=7 2024-09-12T00:37:27.826 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:37:27.854 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:27.854 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:27.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.893+0000 7febfb92c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.894+0000 7febfb92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:27.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.894+0000 7febfb92c800 20 realm 2024-09-12T00:37:27.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.894+0000 7febfb92c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.895+0000 7febfb92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:27.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.895+0000 7febfb92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:27.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.895+0000 7febfb92c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.895+0000 7febfb92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:27.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.895+0000 7febfb92c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.896+0000 7febfb92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:27.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.896+0000 7febfb92c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:27.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.896+0000 7febfb92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:27.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.896+0000 7febfb92c800 20 searching for the correct realm 2024-09-12T00:37:27.897 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:27.898+0000 7febf6d3d640 0 -- 172.21.15.133:0/3057598041 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7febec0760f0 msgr2=0x7febec02d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:28.102 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.103+0000 7febf6d3d640 0 -- 172.21.15.133:0/3057598041 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7febe808c960 msgr2=0x7febe8064430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:28.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.309+0000 7febfb92c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:37:28.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.309+0000 7febfb92c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:37:28.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.309+0000 7febfb92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:28.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.309+0000 7febfb92c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:28.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.309+0000 7febfb92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:28.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.309+0000 7febfb92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:28.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.309+0000 7febfb92c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.309+0000 7febfb92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:28.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.309+0000 7febfb92c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.309+0000 7febfb92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:28.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.309+0000 7febfb92c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.310+0000 7febfb92c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:28.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.310+0000 7febfb92c800 20 zone default found 2024-09-12T00:37:28.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.310+0000 7febfb92c800 4 Realm: () 2024-09-12T00:37:28.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.310+0000 7febfb92c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:37:28.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.310+0000 7febfb92c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:37:28.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.310+0000 7febfb92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:28.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.310+0000 7febfb92c800 20 zonegroup default 2024-09-12T00:37:28.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.310+0000 7febfb92c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.310+0000 7febfb92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:28.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.310+0000 7febfb92c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.311+0000 7febfb92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:28.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.311+0000 7febfb92c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.311+0000 7febfb92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:28.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.311+0000 7febfb92c800 20 started sync module instance, tier type = 2024-09-12T00:37:28.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.311+0000 7febfb92c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:37:28.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.321+0000 7febfb92c800 20 add_watcher() i=0 2024-09-12T00:37:28.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.321+0000 7febfb92c800 20 add_watcher() i=1 2024-09-12T00:37:28.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.321+0000 7febfb92c800 20 add_watcher() i=2 2024-09-12T00:37:28.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.321+0000 7febfb92c800 20 add_watcher() i=3 2024-09-12T00:37:28.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.321+0000 7febfb92c800 20 add_watcher() i=4 2024-09-12T00:37:28.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.321+0000 7febfb92c800 20 add_watcher() i=5 2024-09-12T00:37:28.320 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.321+0000 7febfb92c800 20 add_watcher() i=6 2024-09-12T00:37:28.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.322+0000 7febfb92c800 20 add_watcher() i=7 2024-09-12T00:37:28.321 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.322+0000 7febfb92c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:28.323 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.324+0000 7feaadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:28.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.325+0000 7febfb92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:28.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.325+0000 7febfb92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:28.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.325+0000 7febfb92c800 5 note: GC not initialized 2024-09-12T00:37:28.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.325+0000 7feaacfe1640 20 reqs_thread_entry: start 2024-09-12T00:37:28.324 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.325+0000 7febfb92c800 20 init_complete bucket index max shards: 1 2024-09-12T00:37:28.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.325+0000 7febfb92c800 20 Filter name: none 2024-09-12T00:37:28.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.325+0000 7fea267fc640 20 reqs_thread_entry: start 2024-09-12T00:37:28.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.325+0000 7febfb92c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:37:28.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.325+0000 7febfb92c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.326+0000 7febfb92c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:37:28.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.326+0000 7febfb92c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:37:28.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.326+0000 7febfb92c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:37:28.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.326+0000 7febfb92c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:37:28.325 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.326+0000 7febfb92c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.326+0000 7febfb92c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:37:28.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.326+0000 7febfb92c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:37:28.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.326+0000 7febfb92c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:37:28.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.326+0000 7febfb92c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:28.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.326+0000 7febfb92c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:37:28.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.326+0000 7febfb92c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:37:28.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.326+0000 7febfb92c800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:37:28.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.326+0000 7febfb92c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:37:28.326 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.327+0000 7febfb92c800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:37:28.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.327+0000 7febfb92c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:37:28.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.327+0000 7febfb92c800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:37:28.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.327+0000 7febfb92c800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:37:28.327 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.328+0000 7feaadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:28.329 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.330+0000 7febfb92c800 20 remove_watcher() i=0 2024-09-12T00:37:28.329 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.330+0000 7febfb92c800 2 removed watcher, disabling cache 2024-09-12T00:37:28.330 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.331+0000 7febfb92c800 20 remove_watcher() i=1 2024-09-12T00:37:28.331 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.332+0000 7febfb92c800 20 remove_watcher() i=2 2024-09-12T00:37:28.332 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.333+0000 7febfb92c800 20 remove_watcher() i=3 2024-09-12T00:37:28.333 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.334+0000 7febfb92c800 20 remove_watcher() i=4 2024-09-12T00:37:28.335 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.336+0000 7febfb92c800 20 remove_watcher() i=5 2024-09-12T00:37:28.336 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.337+0000 7febfb92c800 20 remove_watcher() i=6 2024-09-12T00:37:28.337 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.339+0000 7febfb92c800 20 remove_watcher() i=7 2024-09-12T00:37:28.351 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:37:28.379 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:28.379 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:28.416 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.417+0000 7f8eb3a30800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.419+0000 7f8eb3a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:28.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.419+0000 7f8eb3a30800 20 realm 2024-09-12T00:37:28.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.419+0000 7f8eb3a30800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.419+0000 7f8eb3a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:28.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.419+0000 7f8eb3a30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:28.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.419+0000 7f8eb3a30800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.419+0000 7f8eb3a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:28.418 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.419+0000 7f8eb3a30800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.420+0000 7f8eb3a30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:28.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.420+0000 7f8eb3a30800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.421+0000 7f8eb3a30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:28.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.421+0000 7f8eb3a30800 20 searching for the correct realm 2024-09-12T00:37:28.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.422+0000 7f8eae552640 0 -- 172.21.15.133:0/1295004976 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f8ea4079070 msgr2=0x7f8ea40aa350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:28.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.627+0000 7f8eae552640 0 -- 172.21.15.133:0/1295004976 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f8ea0066040 msgr2=0x7f8ea0060cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:28.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.833+0000 7f8eb3a30800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:37:28.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.833+0000 7f8eb3a30800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:37:28.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.833+0000 7f8eb3a30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:28.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.833+0000 7f8eb3a30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:28.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.833+0000 7f8eb3a30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:28.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.833+0000 7f8eb3a30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:28.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.833+0000 7f8eb3a30800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.833+0000 7f8eb3a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:28.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.833+0000 7f8eb3a30800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.834+0000 7f8eb3a30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:28.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.834+0000 7f8eb3a30800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.834+0000 7f8eb3a30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:28.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.834+0000 7f8eb3a30800 20 zone default found 2024-09-12T00:37:28.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.834+0000 7f8eb3a30800 4 Realm: () 2024-09-12T00:37:28.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.834+0000 7f8eb3a30800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:37:28.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.834+0000 7f8eb3a30800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:37:28.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.834+0000 7f8eb3a30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:28.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.834+0000 7f8eb3a30800 20 zonegroup default 2024-09-12T00:37:28.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.834+0000 7f8eb3a30800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.835 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.834+0000 7f8eb3a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:28.835 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.834+0000 7f8eb3a30800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.835 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.835+0000 7f8eb3a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:28.835 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.835+0000 7f8eb3a30800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.835 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.835+0000 7f8eb3a30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:28.835 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.835+0000 7f8eb3a30800 20 started sync module instance, tier type = 2024-09-12T00:37:28.835 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.835+0000 7f8eb3a30800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:37:28.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.845+0000 7f8eb3a30800 20 add_watcher() i=0 2024-09-12T00:37:28.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.845+0000 7f8eb3a30800 20 add_watcher() i=1 2024-09-12T00:37:28.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.845+0000 7f8eb3a30800 20 add_watcher() i=2 2024-09-12T00:37:28.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.845+0000 7f8eb3a30800 20 add_watcher() i=3 2024-09-12T00:37:28.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.845+0000 7f8eb3a30800 20 add_watcher() i=4 2024-09-12T00:37:28.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.845+0000 7f8eb3a30800 20 add_watcher() i=5 2024-09-12T00:37:28.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.845+0000 7f8eb3a30800 20 add_watcher() i=6 2024-09-12T00:37:28.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.846+0000 7f8eb3a30800 20 add_watcher() i=7 2024-09-12T00:37:28.845 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.846+0000 7f8eb3a30800 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:28.847 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.848+0000 7f8d657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:28.849 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.848+0000 7f8eb3a30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:28.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.848+0000 7f8eb3a30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:28.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.848+0000 7f8eb3a30800 5 note: GC not initialized 2024-09-12T00:37:28.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.849+0000 7f8cdffff640 20 reqs_thread_entry: start 2024-09-12T00:37:28.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.849+0000 7f8eb3a30800 20 init_complete bucket index max shards: 1 2024-09-12T00:37:28.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.849+0000 7f8eb3a30800 20 Filter name: none 2024-09-12T00:37:28.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.849+0000 7f8cddffb640 20 reqs_thread_entry: start 2024-09-12T00:37:28.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.849+0000 7f8eb3a30800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.850 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.849+0000 7f8eb3a30800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:37:28.851 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.849+0000 7f8eb3a30800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.851 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.850+0000 7f8eb3a30800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:37:28.851 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.850+0000 7f8eb3a30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:28.851 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.850+0000 7f8eb3a30800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.851 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.850+0000 7f8eb3a30800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:37:28.851 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.850+0000 7f8eb3a30800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.851 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.850+0000 7f8eb3a30800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:37:28.851 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.850+0000 7f8eb3a30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:28.852 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.852+0000 7f8d657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:28.852 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.854+0000 7f8eb3a30800 20 remove_watcher() i=0 2024-09-12T00:37:28.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.854+0000 7f8eb3a30800 2 removed watcher, disabling cache 2024-09-12T00:37:28.853 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.855+0000 7f8eb3a30800 20 remove_watcher() i=1 2024-09-12T00:37:28.854 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.856+0000 7f8eb3a30800 20 remove_watcher() i=2 2024-09-12T00:37:28.855 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.857+0000 7f8eb3a30800 20 remove_watcher() i=3 2024-09-12T00:37:28.856 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.858+0000 7f8eb3a30800 20 remove_watcher() i=4 2024-09-12T00:37:28.857 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.859+0000 7f8eb3a30800 20 remove_watcher() i=5 2024-09-12T00:37:28.858 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.860+0000 7f8eb3a30800 20 remove_watcher() i=6 2024-09-12T00:37:28.859 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.861+0000 7f8eb3a30800 20 remove_watcher() i=7 2024-09-12T00:37:28.870 INFO:tasks.workunit.client.0.smithi133.stderr: test: duplicated entries should be purged before reshard 2024-09-12T00:37:28.871 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:37:28.900 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:28.900 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:28.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.938+0000 7fe0e1524800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.940+0000 7fe0e1524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:28.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.940+0000 7fe0e1524800 20 realm 2024-09-12T00:37:28.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.940+0000 7fe0e1524800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.941+0000 7fe0e1524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:28.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.941+0000 7fe0e1524800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:28.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.941+0000 7fe0e1524800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.941+0000 7fe0e1524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:28.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.941+0000 7fe0e1524800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.942+0000 7fe0e1524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:28.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.942+0000 7fe0e1524800 20 rados->read ofs=0 len=0 2024-09-12T00:37:28.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.943+0000 7fe0e1524800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:28.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.943+0000 7fe0e1524800 20 searching for the correct realm 2024-09-12T00:37:28.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:28.945+0000 7fe0dda69640 0 -- 172.21.15.133:0/1113434236 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7fe0d8043920 msgr2=0x7fe0d8042460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:29.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.151+0000 7fe0dd268640 0 -- 172.21.15.133:0/1113434236 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x5636519b0ff0 msgr2=0x5636519b3480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:29.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.156+0000 7fe0e1524800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:37:29.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.156+0000 7fe0e1524800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:37:29.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.156+0000 7fe0e1524800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:29.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.156+0000 7fe0e1524800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:29.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.156+0000 7fe0e1524800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:29.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.156+0000 7fe0e1524800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:29.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.156+0000 7fe0e1524800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.156+0000 7fe0e1524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.156+0000 7fe0e1524800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.156+0000 7fe0e1524800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:29.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.156+0000 7fe0e1524800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.157+0000 7fe0e1524800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:29.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.157+0000 7fe0e1524800 20 zone default found 2024-09-12T00:37:29.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.157+0000 7fe0e1524800 4 Realm: () 2024-09-12T00:37:29.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.157+0000 7fe0e1524800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:37:29.156 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.157+0000 7fe0e1524800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:37:29.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.157+0000 7fe0e1524800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:29.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.157+0000 7fe0e1524800 20 zonegroup default 2024-09-12T00:37:29.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.157+0000 7fe0e1524800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.157+0000 7fe0e1524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.157+0000 7fe0e1524800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.157+0000 7fe0e1524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.157+0000 7fe0e1524800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.158+0000 7fe0e1524800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.158+0000 7fe0e1524800 20 started sync module instance, tier type = 2024-09-12T00:37:29.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.158+0000 7fe0e1524800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:37:29.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.167+0000 7fe0e1524800 20 add_watcher() i=0 2024-09-12T00:37:29.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.167+0000 7fe0e1524800 20 add_watcher() i=1 2024-09-12T00:37:29.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.167+0000 7fe0e1524800 20 add_watcher() i=2 2024-09-12T00:37:29.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.167+0000 7fe0e1524800 20 add_watcher() i=3 2024-09-12T00:37:29.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.167+0000 7fe0e1524800 20 add_watcher() i=4 2024-09-12T00:37:29.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.167+0000 7fe0e1524800 20 add_watcher() i=5 2024-09-12T00:37:29.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.167+0000 7fe0e1524800 20 add_watcher() i=6 2024-09-12T00:37:29.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.169+0000 7fe0e1524800 20 add_watcher() i=7 2024-09-12T00:37:29.167 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.169+0000 7fe0e1524800 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:29.169 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.171+0000 7fdf93fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:29.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.171+0000 7fe0e1524800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:29.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.171+0000 7fe0e1524800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:29.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.171+0000 7fe0e1524800 5 note: GC not initialized 2024-09-12T00:37:29.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.171+0000 7fdf92fe5640 20 reqs_thread_entry: start 2024-09-12T00:37:29.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.171+0000 7fe0e1524800 20 init_complete bucket index max shards: 1 2024-09-12T00:37:29.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.171+0000 7fe0e1524800 20 Filter name: none 2024-09-12T00:37:29.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.171+0000 7fdf90fe1640 20 reqs_thread_entry: start 2024-09-12T00:37:29.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.172+0000 7fe0e1524800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.172+0000 7fe0e1524800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:37:29.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.172+0000 7fe0e1524800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.173+0000 7fe0e1524800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:37:29.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.173+0000 7fe0e1524800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:29.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.173+0000 7fe0e1524800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.173+0000 7fe0e1524800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:37:29.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.173+0000 7fe0e1524800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.173+0000 7fe0e1524800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:37:29.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.173+0000 7fe0e1524800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:29.173 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.175+0000 7fdf93fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:29.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.177+0000 7fe0e1524800 20 remove_watcher() i=0 2024-09-12T00:37:29.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.177+0000 7fe0e1524800 2 removed watcher, disabling cache 2024-09-12T00:37:29.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.178+0000 7fe0e1524800 20 remove_watcher() i=1 2024-09-12T00:37:29.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.179+0000 7fe0e1524800 20 remove_watcher() i=2 2024-09-12T00:37:29.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.180+0000 7fe0e1524800 20 remove_watcher() i=3 2024-09-12T00:37:29.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.181+0000 7fe0e1524800 20 remove_watcher() i=4 2024-09-12T00:37:29.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.182+0000 7fe0e1524800 20 remove_watcher() i=5 2024-09-12T00:37:29.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.183+0000 7fe0e1524800 20 remove_watcher() i=6 2024-09-12T00:37:29.183 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.184+0000 7fe0e1524800 20 remove_watcher() i=7 2024-09-12T00:37:29.194 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.194 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:37:29.194 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: a-bucket id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 num_objects: 10 size_kb: 1 num_shards: 3 2024-09-12T00:37:29.194 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.196 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:37:29.229 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:29.229 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:29.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.268+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.270+0000 7fc27092b800 20 realm 2024-09-12T00:37:29.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.270+0000 7fc27092b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:29.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.271+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:29.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.271+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.272+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:29.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.272+0000 7fc27092b800 20 searching for the correct realm 2024-09-12T00:37:29.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.274+0000 7fc26ce74640 0 -- 172.21.15.133:0/4261069916 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x5622e5fb04c0 msgr2=0x5622e5fb28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:29.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.277+0000 7fc26be72640 0 -- 172.21.15.133:0/4261069916 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fc25c041040 msgr2=0x7fc25c041420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:29.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:37:29.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:37:29.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:29.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:29.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:29.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:29.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.483+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.484+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.483 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.484+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.484+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:29.484 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.484+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.485+0000 7fc27092b800 20 zone default found 2024-09-12T00:37:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.485+0000 7fc27092b800 4 Realm: () 2024-09-12T00:37:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.485+0000 7fc27092b800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:37:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.485+0000 7fc27092b800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:37:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.485+0000 7fc27092b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.485+0000 7fc27092b800 20 zonegroup default 2024-09-12T00:37:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.485 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.485+0000 7fc27092b800 20 started sync module instance, tier type = 2024-09-12T00:37:29.486 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.485+0000 7fc27092b800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:37:29.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=0 2024-09-12T00:37:29.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=1 2024-09-12T00:37:29.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=2 2024-09-12T00:37:29.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=3 2024-09-12T00:37:29.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=4 2024-09-12T00:37:29.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=5 2024-09-12T00:37:29.494 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=6 2024-09-12T00:37:29.495 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.496+0000 7fc27092b800 20 add_watcher() i=7 2024-09-12T00:37:29.495 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.496+0000 7fc27092b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:29.497 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.498+0000 7fc122fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:29.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.499+0000 7fc27092b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:29.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.499+0000 7fc27092b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:29.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.499+0000 7fc27092b800 5 note: GC not initialized 2024-09-12T00:37:29.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.499+0000 7fc121fdb640 20 reqs_thread_entry: start 2024-09-12T00:37:29.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.499+0000 7fc27092b800 20 init_complete bucket index max shards: 1 2024-09-12T00:37:29.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.499+0000 7fc27092b800 20 Filter name: none 2024-09-12T00:37:29.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.499+0000 7fc0937fe640 20 reqs_thread_entry: start 2024-09-12T00:37:29.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.499+0000 7fc27092b800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:37:29.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.499+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.500+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:37:29.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.500+0000 7fc27092b800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:37:29.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.500+0000 7fc27092b800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:37:29.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.500+0000 7fc27092b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:37:29.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.500+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.500+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:37:29.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.500+0000 7fc27092b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:37:29.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.500+0000 7fc27092b800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:37:29.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.500+0000 7fc27092b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:29.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.500+0000 7fc27092b800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:37:29.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.500+0000 7fc27092b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:37:29.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.504+0000 7fc27092b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:37:29.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.504+0000 7fc27092b800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:37:29.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.504+0000 7fc27092b800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:37:29.503 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.504+0000 7fc27092b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:37:29.504 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.505+0000 7fc142ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497081 cookie 94707887342368 notifier 7841 bl.length()=911 2024-09-12T00:37:29.504 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.505+0000 7fc142ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:37:29.504 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.505+0000 7fc142ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:37:29.504 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.505+0000 7fc142ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:37:29.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.506+0000 7fc27092b800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:37:29.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.506+0000 7fc27092b800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:37:29.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.506+0000 7fc27092b800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:37:29.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.506+0000 7fc27092b800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:37:29.508 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc27092b800 time 2024-09-12T00:37:29.510814+0000 2024-09-12T00:37:29.508 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc27218c71a] 2024-09-12T00:37:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc27218c8d8] 2024-09-12T00:37:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5622e3a94641] 2024-09-12T00:37:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5622e3aa438a] 2024-09-12T00:37:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:37:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fc270e29590] 2024-09-12T00:37:29.509 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:37:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:37:29.510 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.510+0000 7fc27092b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc27092b800 time 2024-09-12T00:37:29.510814+0000 2024-09-12T00:37:29.510 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc27218c71a] 2024-09-12T00:37:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc27218c8d8] 2024-09-12T00:37:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5622e3a94641] 2024-09-12T00:37:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5622e3aa438a] 2024-09-12T00:37:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:37:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fc270e29590] 2024-09-12T00:37:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:37:29.510 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:37:29.511 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.511 INFO:tasks.workunit.client.0.smithi133.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:37:29.511 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7fc27092b800 thread_name:radosgw-admin 2024-09-12T00:37:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc270e3e6f0] 2024-09-12T00:37:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc270e8b99c] 2024-09-12T00:37:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:37:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:37:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc27218c774] 2024-09-12T00:37:29.532 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc27218c8d8] 2024-09-12T00:37:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5622e3a94641] 2024-09-12T00:37:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5622e3aa438a] 2024-09-12T00:37:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:37:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fc270e29590] 2024-09-12T00:37:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:37:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:37:29.533 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.511+0000 7fc27092b800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7fc27092b800 thread_name:radosgw-admin 2024-09-12T00:37:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc270e3e6f0] 2024-09-12T00:37:29.533 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc270e8b99c] 2024-09-12T00:37:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:37:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:37:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc27218c774] 2024-09-12T00:37:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc27218c8d8] 2024-09-12T00:37:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5622e3a94641] 2024-09-12T00:37:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5622e3aa438a] 2024-09-12T00:37:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:37:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fc270e29590] 2024-09-12T00:37:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:37:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:37:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:29.534 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.534 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:37:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding auth protocol: cephx 2024-09-12T00:37:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding auth protocol: cephx 2024-09-12T00:37:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding auth protocol: cephx 2024-09-12T00:37:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: secure 2024-09-12T00:37:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: crc 2024-09-12T00:37:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: secure 2024-09-12T00:37:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: crc 2024-09-12T00:37:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: secure 2024-09-12T00:37:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: crc 2024-09-12T00:37:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: crc 2024-09-12T00:37:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: secure 2024-09-12T00:37:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: crc 2024-09-12T00:37:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: secure 2024-09-12T00:37:29.535 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: crc 2024-09-12T00:37:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: secure 2024-09-12T00:37:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:37:29.252+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:37:29.252+0000 7fc27092b800 1 librados: starting msgr at 2024-09-12T00:37:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:37:29.252+0000 7fc27092b800 1 librados: starting objecter 2024-09-12T00:37:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command objecter_requests hook 0x5622e5ebcf20 2024-09-12T00:37:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:37:29.252+0000 7fc27092b800 1 librados: setting wanted keys 2024-09-12T00:37:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:37:29.252+0000 7fc27092b800 1 librados: calling monclient init 2024-09-12T00:37:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient: init 2024-09-12T00:37:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding auth protocol: cephx 2024-09-12T00:37:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding auth protocol: cephx 2024-09-12T00:37:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding auth protocol: cephx 2024-09-12T00:37:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: secure 2024-09-12T00:37:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: crc 2024-09-12T00:37:29.536 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: secure 2024-09-12T00:37:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: crc 2024-09-12T00:37:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: secure 2024-09-12T00:37:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: crc 2024-09-12T00:37:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: crc 2024-09-12T00:37:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: secure 2024-09-12T00:37:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: crc 2024-09-12T00:37:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: secure 2024-09-12T00:37:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: crc 2024-09-12T00:37:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: secure 2024-09-12T00:37:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:37:29.252+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:37:29.252+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command rotate-key hook 0x5622e5ebac78 2024-09-12T00:37:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient: _reopen_session rank -1 2024-09-12T00:37:29.537 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:37:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-b con 0x5622e5d683b0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:37:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-c con 0x5622e5d740d0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:37:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-a con 0x5622e5ee5350 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:37:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): _renew_subs 2024-09-12T00:37:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): authenticate will time out at 2257.824807s 2024-09-12T00:37:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:37:29.252+0000 7fc26be72640 10 monclient(hunting): get_auth_request con 0x5622e5d740d0 auth_method 0 2024-09-12T00:37:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:37:29.252+0000 7fc26be72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:37:29.252+0000 7fc26be72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:37:29.252+0000 7fc26be72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.538 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:37:29.252+0000 7fc26ce74640 10 monclient(hunting): get_auth_request con 0x5622e5ee5350 auth_method 0 2024-09-12T00:37:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:37:29.252+0000 7fc26ce74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:37:29.252+0000 7fc26ce74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:37:29.252+0000 7fc26ce74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:37:29.252+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:37:29.252+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:37:29.253+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:37:29.253+0000 7fc26c673640 10 monclient(hunting): get_auth_request con 0x5622e5d683b0 auth_method 0 2024-09-12T00:37:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:37:29.253+0000 7fc26c673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:37:29.253+0000 7fc26c673640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:37:29.253+0000 7fc26c673640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:37:29.253+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:37:29.253+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:37:29.253+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.539 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:37:29.253+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.540 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:37:29.253+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.540 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:37:29.253+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.540 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:37:29.253+0000 7fc26be72640 10 monclient(hunting): handle_auth_done global_id 7832 payload 824 2024-09-12T00:37:29.540 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:37:29.253+0000 7fc26be72640 10 monclient: _finish_hunting 0 2024-09-12T00:37:29.540 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:37:29.253+0000 7fc26be72640 1 monclient: found mon.noname-c 2024-09-12T00:37:29.540 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:37:29.253+0000 7fc26be72640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.540 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.540 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:29.540 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: dump: 2024-09-12T00:37:29.540 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.540 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.540 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.540 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.541 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.541 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.541 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.541 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.541 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.541 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.541 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: _finish_auth 0 2024-09-12T00:37:29.541 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: _check_auth_tickets 2024-09-12T00:37:29.541 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:29.541 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.541 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:29.541 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: dump: 2024-09-12T00:37:29.541 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.541 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.542 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.542 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.542 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.542 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.542 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.542 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.542 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.542 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.542 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:37:29.253+0000 7fc27092b800 5 monclient: authenticate success, global_id 7832 2024-09-12T00:37:29.542 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:37:29.253+0000 7fc27092b800 10 monclient: _renew_subs 2024-09-12T00:37:29.542 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:37:29.253+0000 7fc27092b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.542 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:37:29.253+0000 7fc15a60c640 4 set_mon_vals no callback set 2024-09-12T00:37:29.542 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:37:29.253+0000 7fc27092b800 10 monclient: _renew_subs 2024-09-12T00:37:29.542 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:37:29.253+0000 7fc27092b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.543 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:37:29.253+0000 7fc27092b800 1 librados: init done 2024-09-12T00:37:29.543 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:37:29.255+0000 7fc158e09640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:37:29.543 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:37:29.255+0000 7fc158e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:37:29.543 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:37:29.255+0000 7fc158e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:37:29.543 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:37:29.255+0000 7fc26c673640 10 monclient: get_auth_request con 0x7fc154076470 auth_method 0 2024-09-12T00:37:29.543 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:37:29.255+0000 7fc26ce74640 10 monclient: get_auth_request con 0x5622e5ee3550 auth_method 0 2024-09-12T00:37:29.543 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:37:29.256+0000 7fc26c673640 10 monclient: get_auth_request con 0x5622e5f06890 auth_method 0 2024-09-12T00:37:29.543 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:37:29.257+0000 7fc26be72640 10 monclient: get_auth_request con 0x5622e5f0ac80 auth_method 0 2024-09-12T00:37:29.544 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:37:29.258+0000 7fc26ce74640 10 monclient: get_auth_request con 0x5622e5f0f180 auth_method 0 2024-09-12T00:37:29.544 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:37:29.259+0000 7fc27092b800 10 monclient: build_initial_monmap 2024-09-12T00:37:29.544 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:37:29.259+0000 7fc27092b800 1 build_initial for_mkfs: 0 2024-09-12T00:37:29.544 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:37:29.259+0000 7fc27092b800 10 monclient: monmap: 2024-09-12T00:37:29.544 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:37:29.544 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:29.544 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:37:29.544 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:37:29.544 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:29.544 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.544 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:37:29.544 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:37:29.544 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:37:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding auth protocol: cephx 2024-09-12T00:37:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding auth protocol: cephx 2024-09-12T00:37:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding auth protocol: cephx 2024-09-12T00:37:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: secure 2024-09-12T00:37:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: crc 2024-09-12T00:37:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: secure 2024-09-12T00:37:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: crc 2024-09-12T00:37:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: secure 2024-09-12T00:37:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: crc 2024-09-12T00:37:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: crc 2024-09-12T00:37:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: secure 2024-09-12T00:37:29.545 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: crc 2024-09-12T00:37:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: secure 2024-09-12T00:37:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: crc 2024-09-12T00:37:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: secure 2024-09-12T00:37:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:37:29.259+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command objecter_requests cmddesc objecter_requests hook 0x5622e5f163c0 EEXIST 2024-09-12T00:37:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:37:29.259+0000 7fc27092b800 10 monclient: init 2024-09-12T00:37:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding auth protocol: cephx 2024-09-12T00:37:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding auth protocol: cephx 2024-09-12T00:37:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding auth protocol: cephx 2024-09-12T00:37:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: secure 2024-09-12T00:37:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: crc 2024-09-12T00:37:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: secure 2024-09-12T00:37:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: crc 2024-09-12T00:37:29.546 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: secure 2024-09-12T00:37:29.547 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: crc 2024-09-12T00:37:29.547 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: crc 2024-09-12T00:37:29.547 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: secure 2024-09-12T00:37:29.547 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: crc 2024-09-12T00:37:29.547 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: secure 2024-09-12T00:37:29.547 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: crc 2024-09-12T00:37:29.547 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: secure 2024-09-12T00:37:29.547 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:37:29.259+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.547 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:37:29.260+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.547 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:37:29.260+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command rotate-key cmddesc rotate-key hook 0x5622e5f12010 EEXIST 2024-09-12T00:37:29.547 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient: _reopen_session rank -1 2024-09-12T00:37:29.547 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:37:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-a con 0x5622e5f3a6e0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:37:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-c con 0x5622e5f3aac0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:37:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-b con 0x5622e5f393f0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:37:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): _renew_subs 2024-09-12T00:37:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): authenticate will time out at 2257.832210s 2024-09-12T00:37:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): get_auth_request con 0x5622e5f3a6e0 auth_method 0 2024-09-12T00:37:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.548 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:37:29.260+0000 7fc26ce74640 10 monclient(hunting): get_auth_request con 0x5622e5f3aac0 auth_method 0 2024-09-12T00:37:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:37:29.260+0000 7fc26ce74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:37:29.260+0000 7fc26ce74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:37:29.260+0000 7fc26ce74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:37:29.260+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:37:29.260+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:37:29.260+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:37:29.260+0000 7fc26c673640 10 monclient(hunting): get_auth_request con 0x5622e5f393f0 auth_method 0 2024-09-12T00:37:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:37:29.260+0000 7fc26c673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:37:29.260+0000 7fc26c673640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:37:29.260+0000 7fc26c673640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.549 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:37:29.260+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:37:29.260+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:37:29.260+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): handle_auth_done global_id 8364 payload 824 2024-09-12T00:37:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient: _finish_hunting 0 2024-09-12T00:37:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:37:29.260+0000 7fc26be72640 1 monclient: found mon.noname-a 2024-09-12T00:37:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:37:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:29.550 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: dump: 2024-09-12T00:37:29.550 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.550 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.550 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.550 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.550 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.551 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.551 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.551 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.551 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:29.551 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: dump: 2024-09-12T00:37:29.551 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.551 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.551 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.552 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.552 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.552 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.552 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.552 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.552 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:37:29.260+0000 7fc27092b800 5 monclient: authenticate success, global_id 8364 2024-09-12T00:37:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient: _renew_subs 2024-09-12T00:37:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:37:29.260+0000 7fc26d675640 4 set_mon_vals no callback set 2024-09-12T00:37:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:37:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient: _renew_subs 2024-09-12T00:37:29.552 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:37:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:37:29.262+0000 7fc151ffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:37:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:37:29.262+0000 7fc151ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:37:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:37:29.262+0000 7fc151ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:37:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:37:29.262+0000 7fc26ce74640 10 monclient: get_auth_request con 0x7fc144076380 auth_method 0 2024-09-12T00:37:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:37:29.262+0000 7fc27092b800 10 monclient: get_monmap_and_config 2024-09-12T00:37:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:37:29.262+0000 7fc27092b800 10 monclient: build_initial_monmap 2024-09-12T00:37:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:37:29.262+0000 7fc27092b800 1 build_initial for_mkfs: 0 2024-09-12T00:37:29.553 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:37:29.262+0000 7fc27092b800 10 monclient: monmap: 2024-09-12T00:37:29.553 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:37:29.553 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:29.553 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:37:29.553 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:37:29.553 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:29.554 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.554 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:37:29.554 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:37:29.554 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:37:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding auth protocol: cephx 2024-09-12T00:37:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding auth protocol: cephx 2024-09-12T00:37:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding auth protocol: cephx 2024-09-12T00:37:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: secure 2024-09-12T00:37:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: crc 2024-09-12T00:37:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: secure 2024-09-12T00:37:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: crc 2024-09-12T00:37:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: secure 2024-09-12T00:37:29.554 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: crc 2024-09-12T00:37:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: crc 2024-09-12T00:37:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: secure 2024-09-12T00:37:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: crc 2024-09-12T00:37:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: secure 2024-09-12T00:37:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: crc 2024-09-12T00:37:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: secure 2024-09-12T00:37:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:37:29.263+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient: init 2024-09-12T00:37:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding auth protocol: cephx 2024-09-12T00:37:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding auth protocol: cephx 2024-09-12T00:37:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding auth protocol: cephx 2024-09-12T00:37:29.555 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: secure 2024-09-12T00:37:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: crc 2024-09-12T00:37:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: secure 2024-09-12T00:37:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: crc 2024-09-12T00:37:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: secure 2024-09-12T00:37:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: crc 2024-09-12T00:37:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: crc 2024-09-12T00:37:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: secure 2024-09-12T00:37:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: crc 2024-09-12T00:37:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: secure 2024-09-12T00:37:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: crc 2024-09-12T00:37:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: secure 2024-09-12T00:37:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:37:29.263+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.556 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:37:29.263+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command rotate-key cmddesc rotate-key hook 0x7ffda65d8178 EEXIST 2024-09-12T00:37:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient: _reopen_session rank -1 2024-09-12T00:37:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:37:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-b con 0x5622e5f8e8c0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:37:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-a con 0x5622e5f7f210 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:37:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-c con 0x5622e5f89cf0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:37:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): _renew_subs 2024-09-12T00:37:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): authenticate will time out at 2257.835820s 2024-09-12T00:37:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:37:29.263+0000 7fc26c673640 10 monclient(hunting): get_auth_request con 0x5622e5f89cf0 auth_method 0 2024-09-12T00:37:29.557 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:37:29.263+0000 7fc26c673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:37:29.263+0000 7fc26c673640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:37:29.263+0000 7fc26c673640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:37:29.263+0000 7fc26ce74640 10 monclient(hunting): get_auth_request con 0x5622e5f7f210 auth_method 0 2024-09-12T00:37:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:37:29.263+0000 7fc26ce74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:37:29.263+0000 7fc26ce74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:37:29.263+0000 7fc26ce74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:37:29.263+0000 7fc26be72640 10 monclient(hunting): get_auth_request con 0x5622e5f8e8c0 auth_method 0 2024-09-12T00:37:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:37:29.263+0000 7fc26be72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:37:29.263+0000 7fc26be72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:37:29.263+0000 7fc26be72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:37:29.263+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:37:29.263+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:37:29.264+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.558 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:37:29.264+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:37:29.264+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:37:29.264+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:37:29.264+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:37:29.264+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:37:29.264+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:37:29.264+0000 7fc26c673640 10 monclient(hunting): handle_auth_done global_id 7838 payload 274 2024-09-12T00:37:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:37:29.264+0000 7fc26c673640 10 monclient: _finish_hunting 0 2024-09-12T00:37:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:37:29.264+0000 7fc26c673640 1 monclient: found mon.noname-c 2024-09-12T00:37:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:37:29.264+0000 7fc26c673640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:29.559 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: dump: 2024-09-12T00:37:29.559 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.560 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.560 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.560 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.560 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.560 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.560 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.560 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.560 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: _finish_auth 0 2024-09-12T00:37:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: _check_auth_tickets 2024-09-12T00:37:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:29.560 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:37:29.264+0000 7fc27092b800 5 monclient: authenticate success, global_id 7838 2024-09-12T00:37:29.561 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:37:29.264+0000 7fc27092b800 10 monclient: get_monmap_and_config success 2024-09-12T00:37:29.561 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:37:29.264+0000 7fc27092b800 4 set_mon_vals no callback set 2024-09-12T00:37:29.561 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.561 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:29.561 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: dump: 2024-09-12T00:37:29.561 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.561 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.561 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.561 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.561 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.561 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.561 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.561 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.562 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.562 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.562 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:37:29.264+0000 7fc27092b800 10 monclient: shutdown 2024-09-12T00:37:29.562 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:37:29.265+0000 7fc27092b800 10 monclient: build_initial_monmap 2024-09-12T00:37:29.562 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:37:29.265+0000 7fc27092b800 1 build_initial for_mkfs: 0 2024-09-12T00:37:29.562 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:37:29.265+0000 7fc27092b800 10 monclient: monmap: 2024-09-12T00:37:29.562 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:37:29.562 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:29.562 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:37:29.562 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:37:29.562 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:29.562 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.562 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:37:29.562 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:37:29.563 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:37:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding auth protocol: cephx 2024-09-12T00:37:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding auth protocol: cephx 2024-09-12T00:37:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding auth protocol: cephx 2024-09-12T00:37:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: secure 2024-09-12T00:37:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: crc 2024-09-12T00:37:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: secure 2024-09-12T00:37:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: crc 2024-09-12T00:37:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: secure 2024-09-12T00:37:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: crc 2024-09-12T00:37:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: crc 2024-09-12T00:37:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: secure 2024-09-12T00:37:29.563 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: crc 2024-09-12T00:37:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: secure 2024-09-12T00:37:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: crc 2024-09-12T00:37:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: secure 2024-09-12T00:37:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:37:29.265+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:37:29.265+0000 7fc27092b800 1 librados: starting msgr at 2024-09-12T00:37:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:37:29.265+0000 7fc27092b800 1 librados: starting objecter 2024-09-12T00:37:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command objecter_requests cmddesc objecter_requests hook 0x5622e5f5cde0 EEXIST 2024-09-12T00:37:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:37:29.265+0000 7fc27092b800 1 librados: setting wanted keys 2024-09-12T00:37:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:37:29.265+0000 7fc27092b800 1 librados: calling monclient init 2024-09-12T00:37:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:37:29.265+0000 7fc27092b800 10 monclient: init 2024-09-12T00:37:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding auth protocol: cephx 2024-09-12T00:37:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding auth protocol: cephx 2024-09-12T00:37:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding auth protocol: cephx 2024-09-12T00:37:29.564 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: secure 2024-09-12T00:37:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: crc 2024-09-12T00:37:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: secure 2024-09-12T00:37:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: crc 2024-09-12T00:37:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: secure 2024-09-12T00:37:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: crc 2024-09-12T00:37:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: crc 2024-09-12T00:37:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: secure 2024-09-12T00:37:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: crc 2024-09-12T00:37:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: secure 2024-09-12T00:37:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: crc 2024-09-12T00:37:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: secure 2024-09-12T00:37:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:37:29.265+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:37:29.265+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.565 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:37:29.266+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command rotate-key cmddesc rotate-key hook 0x5622e5f4f0e8 EEXIST 2024-09-12T00:37:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient: _reopen_session rank -1 2024-09-12T00:37:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:37:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-a con 0x5622e5f7f210 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:37:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-c con 0x5622e5f89cf0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:37:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-b con 0x5622e5f8e8c0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:37:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): _renew_subs 2024-09-12T00:37:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): authenticate will time out at 2257.838089s 2024-09-12T00:37:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): get_auth_request con 0x5622e5f89cf0 auth_method 0 2024-09-12T00:37:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.566 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:37:29.266+0000 7fc26be72640 10 monclient(hunting): get_auth_request con 0x5622e5f7f210 auth_method 0 2024-09-12T00:37:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:37:29.266+0000 7fc26be72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:37:29.266+0000 7fc26be72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:37:29.266+0000 7fc26be72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:37:29.266+0000 7fc26c673640 10 monclient(hunting): get_auth_request con 0x5622e5f8e8c0 auth_method 0 2024-09-12T00:37:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:37:29.266+0000 7fc26c673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:37:29.266+0000 7fc26c673640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:37:29.266+0000 7fc26c673640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:37:29.266+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:37:29.266+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.567 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:37:29.266+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.568 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:37:29.266+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.568 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:37:29.266+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.568 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:37:29.266+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.568 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): handle_auth_done global_id 7841 payload 824 2024-09-12T00:37:29.568 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient: _finish_hunting 0 2024-09-12T00:37:29.568 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:37:29.266+0000 7fc26ce74640 1 monclient: found mon.noname-c 2024-09-12T00:37:29.568 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.568 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.568 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:29.568 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: dump: 2024-09-12T00:37:29.568 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.568 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.568 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.569 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.569 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.569 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.569 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.569 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.569 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.569 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.569 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:29.569 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:29.569 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:29.569 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.569 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:29.569 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: dump: 2024-09-12T00:37:29.570 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.570 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.570 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.570 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.570 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.570 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.570 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.570 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.570 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.570 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.570 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:37:29.266+0000 7fc27092b800 5 monclient: authenticate success, global_id 7841 2024-09-12T00:37:29.570 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient: _renew_subs 2024-09-12T00:37:29.570 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:37:29.266+0000 7fc1437fe640 4 set_mon_vals no callback set 2024-09-12T00:37:29.570 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient: _renew_subs 2024-09-12T00:37:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:37:29.266+0000 7fc27092b800 1 librados: init done 2024-09-12T00:37:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:37:29.266+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command cr dump hook 0x5622e5f85f28 2024-09-12T00:37:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:37:29.268+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:37:29.269+0000 7fc141ffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:37:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:37:29.269+0000 7fc141ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:37:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:37:29.269+0000 7fc141ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:37:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:37:29.269+0000 7fc26be72640 10 monclient: get_auth_request con 0x7fc134076470 auth_method 0 2024-09-12T00:37:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:37:29.269+0000 7fc26c673640 10 monclient: get_auth_request con 0x5622e5fa8a50 auth_method 0 2024-09-12T00:37:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:37:29.270+0000 7fc27092b800 20 realm 2024-09-12T00:37:29.571 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:37:29.270+0000 7fc27092b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:37:29.270+0000 7fc26be72640 10 monclient: get_auth_request con 0x5622e5facc60 auth_method 0 2024-09-12T00:37:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:37:29.271+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:37:29.271+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:37:29.271+0000 7fc26ce74640 10 monclient: get_auth_request con 0x5622e5fb04c0 auth_method 0 2024-09-12T00:37:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:37:29.272+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:37:29.272+0000 7fc27092b800 20 searching for the correct realm 2024-09-12T00:37:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:37:29.272+0000 7fc26c673640 10 monclient: get_auth_request con 0x7fc264030040 auth_method 0 2024-09-12T00:37:29.572 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:37:29.273+0000 7fc26be72640 10 monclient: get_auth_request con 0x7fc25406d060 auth_method 0 2024-09-12T00:37:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:37:29.274+0000 7fc26ce74640 0 -- 172.21.15.133:0/4261069916 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x5622e5fb04c0 msgr2=0x5622e5fb28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:37:29.274+0000 7fc141ffb640 1 client.7841.objecter ms_handle_reset 0x5622e5fb04c0 session 0x5622e5fabff0 osd.4 2024-09-12T00:37:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:37:29.274+0000 7fc141ffb640 10 monclient: _renew_subs 2024-09-12T00:37:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:37:29.274+0000 7fc141ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:37:29.274+0000 7fc26ce74640 10 monclient: get_auth_request con 0x7fc26400b040 auth_method 0 2024-09-12T00:37:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:37:29.274+0000 7fc26ce74640 10 monclient: get_auth_request con 0x7fc134086720 auth_method 0 2024-09-12T00:37:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:37:29.276+0000 7fc26c673640 10 monclient: get_auth_request con 0x7fc2540e3360 auth_method 0 2024-09-12T00:37:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:37:29.277+0000 7fc26be72640 10 monclient: get_auth_request con 0x7fc25c041040 auth_method 0 2024-09-12T00:37:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:37:29.277+0000 7fc26be72640 0 -- 172.21.15.133:0/4261069916 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fc25c041040 msgr2=0x7fc25c041420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:37:29.478+0000 7fc26be72640 10 monclient: get_auth_request con 0x7fc25c041040 auth_method 0 2024-09-12T00:37:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:37:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:37:29.573 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:37:29.483+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:37:29.484+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:37:29.484+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:37:29.484+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:37:29.484+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 zone default found 2024-09-12T00:37:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:37:29.485+0000 7fc27092b800 4 Realm: () 2024-09-12T00:37:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:37:29.485+0000 7fc27092b800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:37:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:37:29.485+0000 7fc27092b800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:37:29.574 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:37:29.485+0000 7fc27092b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 zonegroup default 2024-09-12T00:37:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 started sync module instance, tier type = 2024-09-12T00:37:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:37:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=0 2024-09-12T00:37:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=1 2024-09-12T00:37:29.575 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=2 2024-09-12T00:37:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=3 2024-09-12T00:37:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=4 2024-09-12T00:37:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=5 2024-09-12T00:37:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=6 2024-09-12T00:37:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:37:29.496+0000 7fc27092b800 20 add_watcher() i=7 2024-09-12T00:37:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:37:29.496+0000 7fc27092b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding auth protocol: cephx 2024-09-12T00:37:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding auth protocol: cephx 2024-09-12T00:37:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding auth protocol: cephx 2024-09-12T00:37:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: secure 2024-09-12T00:37:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: crc 2024-09-12T00:37:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: secure 2024-09-12T00:37:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: crc 2024-09-12T00:37:29.576 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: secure 2024-09-12T00:37:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: crc 2024-09-12T00:37:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: crc 2024-09-12T00:37:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: secure 2024-09-12T00:37:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: crc 2024-09-12T00:37:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: secure 2024-09-12T00:37:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:37:29.498+0000 7fc122fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: crc 2024-09-12T00:37:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: secure 2024-09-12T00:37:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:37:29.499+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:37:29.499+0000 7fc27092b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:37:29.499+0000 7fc27092b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command cache list hook 0x5622e5f87b30 2024-09-12T00:37:29.577 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command cache inspect hook 0x5622e5f87b30 2024-09-12T00:37:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command cache erase hook 0x5622e5f87b30 2024-09-12T00:37:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command cache zap hook 0x5622e5f87b30 2024-09-12T00:37:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 note: GC not initialized 2024-09-12T00:37:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:37:29.499+0000 7fc121fdb640 20 reqs_thread_entry: start 2024-09-12T00:37:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command sync trace show hook 0x7fc25c006d20 2024-09-12T00:37:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command sync trace history hook 0x7fc25c006d20 2024-09-12T00:37:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command sync trace active hook 0x7fc25c006d20 2024-09-12T00:37:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command sync trace active_short hook 0x7fc25c006d20 2024-09-12T00:37:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:37:29.499+0000 7fc27092b800 20 init_complete bucket index max shards: 1 2024-09-12T00:37:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:37:29.499+0000 7fc27092b800 20 Filter name: none 2024-09-12T00:37:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:37:29.499+0000 7fc0937fe640 20 reqs_thread_entry: start 2024-09-12T00:37:29.578 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:37:29.499+0000 7fc27092b800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:37:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:37:29.499+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:37:29.500+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:37:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:37:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:37:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:37:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:37:29.500+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:37:29.500+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:37:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:37:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:37:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:37:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:37:29.579 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:37:29.504+0000 7fc27092b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:37:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:37:29.504+0000 7fc27092b800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:37:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:37:29.504+0000 7fc27092b800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:37:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:37:29.504+0000 7fc27092b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:37:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:37:29.505+0000 7fc142ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497081 cookie 94707887342368 notifier 7841 bl.length()=911 2024-09-12T00:37:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:37:29.505+0000 7fc142ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:37:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:37:29.505+0000 7fc142ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:37:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:37:29.505+0000 7fc142ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:37:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:37:29.506+0000 7fc27092b800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:37:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:37:29.506+0000 7fc27092b800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:37:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:37:29.506+0000 7fc27092b800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:37:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:37:29.506+0000 7fc27092b800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:37:29.580 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:37:29.510+0000 7fc27092b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc27092b800 time 2024-09-12T00:37:29.510814+0000 2024-09-12T00:37:29.580 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc27218c71a] 2024-09-12T00:37:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc27218c8d8] 2024-09-12T00:37:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5622e3a94641] 2024-09-12T00:37:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5622e3aa438a] 2024-09-12T00:37:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:37:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fc270e29590] 2024-09-12T00:37:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:37:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:37:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:37:29.511+0000 7fc27092b800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:29.581 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7fc27092b800 thread_name:radosgw-admin 2024-09-12T00:37:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc270e3e6f0] 2024-09-12T00:37:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc270e8b99c] 2024-09-12T00:37:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:37:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:37:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc27218c774] 2024-09-12T00:37:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc27218c8d8] 2024-09-12T00:37:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5622e3a94641] 2024-09-12T00:37:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5622e3aa438a] 2024-09-12T00:37:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:37:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fc270e29590] 2024-09-12T00:37:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:37:29.582 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:37:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.583 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:37:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:37:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:37:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:37:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:37:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:37:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:37:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:37:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:37:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:37:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:37:29.583 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:37:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:37:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:37:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:37:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:37:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:37:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:37:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:37:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:37:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:37:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:37:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:37:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:37:29.584 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:37:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:37:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:37:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:37:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:37:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:37:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:37:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:37:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:37:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:37:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:37:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:37:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:37:29.585 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:37:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:37:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:37:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:37:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:37:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:37:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:37:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:37:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:37:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:37:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:37:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:37:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:37:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:37:29.586 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:37:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:37:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:37:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:37:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:37:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:37:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:37:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:37:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:37:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:37:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:37:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:37:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:37:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:37:29.587 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:37:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:37:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:37:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:37:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:37:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:37:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:37:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:37:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:37:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:37:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:37:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:37:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:37:29.588 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:37:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:37:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:37:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:37:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:37:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:37:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:37:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:37:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:37:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:37:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:37:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:37:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:37:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:37:29.589 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:37:29.590 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:37:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc0937fe640 / http_manager 2024-09-12T00:37:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc121fdb640 / http_manager 2024-09-12T00:37:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc122fdd640 / rgw_dt_lg_renew 2024-09-12T00:37:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc141ffb640 / ms_dispatch 2024-09-12T00:37:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc142ffd640 / io_context_pool 2024-09-12T00:37:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc1437fe640 / io_context_pool 2024-09-12T00:37:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc151ffb640 / ms_dispatch 2024-09-12T00:37:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc158e09640 / ms_dispatch 2024-09-12T00:37:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc15a60c640 / io_context_pool 2024-09-12T00:37:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc26be72640 / msgr-worker-2 2024-09-12T00:37:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc26c673640 / msgr-worker-1 2024-09-12T00:37:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc26ce74640 / msgr-worker-0 2024-09-12T00:37:29.590 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc26d675640 / io_context_pool 2024-09-12T00:37:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc27092b800 / radosgw-admin 2024-09-12T00:37:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:37:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:37:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/log/ceph/ceph-client.admin.153002.log 2024-09-12T00:37:29.591 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:37:29.591 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:37:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding auth protocol: cephx 2024-09-12T00:37:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding auth protocol: cephx 2024-09-12T00:37:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding auth protocol: cephx 2024-09-12T00:37:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: secure 2024-09-12T00:37:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: crc 2024-09-12T00:37:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: secure 2024-09-12T00:37:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: crc 2024-09-12T00:37:29.591 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: secure 2024-09-12T00:37:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: crc 2024-09-12T00:37:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: crc 2024-09-12T00:37:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: secure 2024-09-12T00:37:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: crc 2024-09-12T00:37:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: secure 2024-09-12T00:37:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: crc 2024-09-12T00:37:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:37:29.251+0000 7fc27092b800 5 AuthRegistry(0x5622e5ec07d0) adding con mode: secure 2024-09-12T00:37:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:37:29.252+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:37:29.252+0000 7fc27092b800 1 librados: starting msgr at 2024-09-12T00:37:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:37:29.252+0000 7fc27092b800 1 librados: starting objecter 2024-09-12T00:37:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command objecter_requests hook 0x5622e5ebcf20 2024-09-12T00:37:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:37:29.252+0000 7fc27092b800 1 librados: setting wanted keys 2024-09-12T00:37:29.592 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:37:29.252+0000 7fc27092b800 1 librados: calling monclient init 2024-09-12T00:37:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient: init 2024-09-12T00:37:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding auth protocol: cephx 2024-09-12T00:37:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding auth protocol: cephx 2024-09-12T00:37:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding auth protocol: cephx 2024-09-12T00:37:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: secure 2024-09-12T00:37:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: crc 2024-09-12T00:37:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: secure 2024-09-12T00:37:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: crc 2024-09-12T00:37:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: secure 2024-09-12T00:37:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: crc 2024-09-12T00:37:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: crc 2024-09-12T00:37:29.593 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: secure 2024-09-12T00:37:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: crc 2024-09-12T00:37:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: secure 2024-09-12T00:37:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: crc 2024-09-12T00:37:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 AuthRegistry(0x5622e5ebab30) adding con mode: secure 2024-09-12T00:37:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:37:29.252+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:37:29.252+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:37:29.252+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command rotate-key hook 0x5622e5ebac78 2024-09-12T00:37:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient: _reopen_session rank -1 2024-09-12T00:37:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:37:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-b con 0x5622e5d683b0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:37:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-c con 0x5622e5d740d0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:37:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-a con 0x5622e5ee5350 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:37:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.594 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): _renew_subs 2024-09-12T00:37:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:37:29.252+0000 7fc27092b800 10 monclient(hunting): authenticate will time out at 2257.824807s 2024-09-12T00:37:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:37:29.252+0000 7fc26be72640 10 monclient(hunting): get_auth_request con 0x5622e5d740d0 auth_method 0 2024-09-12T00:37:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:37:29.252+0000 7fc26be72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:37:29.252+0000 7fc26be72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:37:29.252+0000 7fc26be72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:37:29.252+0000 7fc26ce74640 10 monclient(hunting): get_auth_request con 0x5622e5ee5350 auth_method 0 2024-09-12T00:37:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:37:29.252+0000 7fc26ce74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:37:29.252+0000 7fc26ce74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:37:29.252+0000 7fc26ce74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:37:29.252+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:37:29.252+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:37:29.253+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.595 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:37:29.253+0000 7fc26c673640 10 monclient(hunting): get_auth_request con 0x5622e5d683b0 auth_method 0 2024-09-12T00:37:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:37:29.253+0000 7fc26c673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:37:29.253+0000 7fc26c673640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:37:29.253+0000 7fc26c673640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:37:29.253+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:37:29.253+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:37:29.253+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:37:29.253+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:37:29.253+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:37:29.253+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:37:29.253+0000 7fc26be72640 10 monclient(hunting): handle_auth_done global_id 7832 payload 824 2024-09-12T00:37:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:37:29.253+0000 7fc26be72640 10 monclient: _finish_hunting 0 2024-09-12T00:37:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:37:29.253+0000 7fc26be72640 1 monclient: found mon.noname-c 2024-09-12T00:37:29.596 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:37:29.253+0000 7fc26be72640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.597 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.597 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:29.597 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: dump: 2024-09-12T00:37:29.597 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.597 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.597 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.597 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.597 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.597 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.597 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.597 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.597 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.597 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: _finish_auth 0 2024-09-12T00:37:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: _check_auth_tickets 2024-09-12T00:37:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:29.598 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:37:29.253+0000 7fc158e09640 10 monclient: dump: 2024-09-12T00:37:29.598 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.598 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.598 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.598 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.598 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.598 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.598 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.598 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.599 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:37:29.253+0000 7fc27092b800 5 monclient: authenticate success, global_id 7832 2024-09-12T00:37:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:37:29.253+0000 7fc27092b800 10 monclient: _renew_subs 2024-09-12T00:37:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:37:29.253+0000 7fc27092b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:37:29.253+0000 7fc15a60c640 4 set_mon_vals no callback set 2024-09-12T00:37:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:37:29.253+0000 7fc27092b800 10 monclient: _renew_subs 2024-09-12T00:37:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:37:29.253+0000 7fc27092b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:37:29.253+0000 7fc27092b800 1 librados: init done 2024-09-12T00:37:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:37:29.255+0000 7fc158e09640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:37:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:37:29.255+0000 7fc158e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:37:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:37:29.255+0000 7fc158e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:37:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:37:29.255+0000 7fc26c673640 10 monclient: get_auth_request con 0x7fc154076470 auth_method 0 2024-09-12T00:37:29.599 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:37:29.255+0000 7fc26ce74640 10 monclient: get_auth_request con 0x5622e5ee3550 auth_method 0 2024-09-12T00:37:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:37:29.256+0000 7fc26c673640 10 monclient: get_auth_request con 0x5622e5f06890 auth_method 0 2024-09-12T00:37:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:37:29.257+0000 7fc26be72640 10 monclient: get_auth_request con 0x5622e5f0ac80 auth_method 0 2024-09-12T00:37:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:37:29.258+0000 7fc26ce74640 10 monclient: get_auth_request con 0x5622e5f0f180 auth_method 0 2024-09-12T00:37:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:37:29.259+0000 7fc27092b800 10 monclient: build_initial_monmap 2024-09-12T00:37:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:37:29.259+0000 7fc27092b800 1 build_initial for_mkfs: 0 2024-09-12T00:37:29.600 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:37:29.259+0000 7fc27092b800 10 monclient: monmap: 2024-09-12T00:37:29.600 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:37:29.600 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:29.600 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:37:29.600 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:37:29.600 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:29.600 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.600 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:37:29.601 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:37:29.601 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:37:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding auth protocol: cephx 2024-09-12T00:37:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding auth protocol: cephx 2024-09-12T00:37:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding auth protocol: cephx 2024-09-12T00:37:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: secure 2024-09-12T00:37:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: crc 2024-09-12T00:37:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: secure 2024-09-12T00:37:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: crc 2024-09-12T00:37:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: secure 2024-09-12T00:37:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: crc 2024-09-12T00:37:29.601 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: crc 2024-09-12T00:37:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: secure 2024-09-12T00:37:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: crc 2024-09-12T00:37:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: secure 2024-09-12T00:37:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: crc 2024-09-12T00:37:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f12f10) adding con mode: secure 2024-09-12T00:37:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:37:29.259+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command objecter_requests cmddesc objecter_requests hook 0x5622e5f163c0 EEXIST 2024-09-12T00:37:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:37:29.259+0000 7fc27092b800 10 monclient: init 2024-09-12T00:37:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding auth protocol: cephx 2024-09-12T00:37:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding auth protocol: cephx 2024-09-12T00:37:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding auth protocol: cephx 2024-09-12T00:37:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: secure 2024-09-12T00:37:29.602 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: crc 2024-09-12T00:37:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: secure 2024-09-12T00:37:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: crc 2024-09-12T00:37:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: secure 2024-09-12T00:37:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: crc 2024-09-12T00:37:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: crc 2024-09-12T00:37:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: secure 2024-09-12T00:37:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: crc 2024-09-12T00:37:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: secure 2024-09-12T00:37:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: crc 2024-09-12T00:37:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:37:29.259+0000 7fc27092b800 5 AuthRegistry(0x5622e5f11ec8) adding con mode: secure 2024-09-12T00:37:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:37:29.259+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:37:29.260+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:37:29.260+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command rotate-key cmddesc rotate-key hook 0x5622e5f12010 EEXIST 2024-09-12T00:37:29.603 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient: _reopen_session rank -1 2024-09-12T00:37:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:37:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-a con 0x5622e5f3a6e0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:37:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-c con 0x5622e5f3aac0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:37:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-b con 0x5622e5f393f0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:37:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): _renew_subs 2024-09-12T00:37:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient(hunting): authenticate will time out at 2257.832210s 2024-09-12T00:37:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): get_auth_request con 0x5622e5f3a6e0 auth_method 0 2024-09-12T00:37:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.604 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.605 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:37:29.260+0000 7fc26ce74640 10 monclient(hunting): get_auth_request con 0x5622e5f3aac0 auth_method 0 2024-09-12T00:37:29.605 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:37:29.260+0000 7fc26ce74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.605 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:37:29.260+0000 7fc26ce74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.605 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:37:29.260+0000 7fc26ce74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.605 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.605 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.605 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.605 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:37:29.260+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.605 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:37:29.260+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.605 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:37:29.260+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.605 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:37:29.260+0000 7fc26c673640 10 monclient(hunting): get_auth_request con 0x5622e5f393f0 auth_method 0 2024-09-12T00:37:29.605 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:37:29.260+0000 7fc26c673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.605 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:37:29.260+0000 7fc26c673640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.606 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:37:29.260+0000 7fc26c673640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.606 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:37:29.260+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.606 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:37:29.260+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.606 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:37:29.260+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.606 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient(hunting): handle_auth_done global_id 8364 payload 824 2024-09-12T00:37:29.606 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient: _finish_hunting 0 2024-09-12T00:37:29.606 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:37:29.260+0000 7fc26be72640 1 monclient: found mon.noname-a 2024-09-12T00:37:29.606 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:37:29.260+0000 7fc26be72640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:37:29.606 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.606 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:29.606 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: dump: 2024-09-12T00:37:29.606 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.606 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.606 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.607 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.607 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:29.607 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:29.607 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:29.607 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.607 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:29.607 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:37:29.260+0000 7fc151ffb640 10 monclient: dump: 2024-09-12T00:37:29.607 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.608 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.608 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.608 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.608 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.608 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.608 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.608 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.608 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.608 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.608 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:37:29.260+0000 7fc27092b800 5 monclient: authenticate success, global_id 8364 2024-09-12T00:37:29.608 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient: _renew_subs 2024-09-12T00:37:29.608 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:37:29.260+0000 7fc26d675640 4 set_mon_vals no callback set 2024-09-12T00:37:29.609 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:37:29.609 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient: _renew_subs 2024-09-12T00:37:29.609 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:37:29.260+0000 7fc27092b800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:37:29.609 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:37:29.262+0000 7fc151ffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:37:29.609 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:37:29.262+0000 7fc151ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:37:29.609 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:37:29.262+0000 7fc151ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:37:29.609 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:37:29.262+0000 7fc26ce74640 10 monclient: get_auth_request con 0x7fc144076380 auth_method 0 2024-09-12T00:37:29.609 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:37:29.262+0000 7fc27092b800 10 monclient: get_monmap_and_config 2024-09-12T00:37:29.609 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:37:29.262+0000 7fc27092b800 10 monclient: build_initial_monmap 2024-09-12T00:37:29.609 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:37:29.262+0000 7fc27092b800 1 build_initial for_mkfs: 0 2024-09-12T00:37:29.609 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:37:29.262+0000 7fc27092b800 10 monclient: monmap: 2024-09-12T00:37:29.609 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:37:29.609 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:29.609 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:37:29.610 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:37:29.610 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:29.610 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.610 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:37:29.610 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:37:29.610 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:37:29.610 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.610 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding auth protocol: cephx 2024-09-12T00:37:29.610 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding auth protocol: cephx 2024-09-12T00:37:29.610 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding auth protocol: cephx 2024-09-12T00:37:29.610 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: secure 2024-09-12T00:37:29.610 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: crc 2024-09-12T00:37:29.610 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: secure 2024-09-12T00:37:29.611 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: crc 2024-09-12T00:37:29.611 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: secure 2024-09-12T00:37:29.611 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: crc 2024-09-12T00:37:29.611 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: crc 2024-09-12T00:37:29.611 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: secure 2024-09-12T00:37:29.611 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: crc 2024-09-12T00:37:29.611 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: secure 2024-09-12T00:37:29.611 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: crc 2024-09-12T00:37:29.611 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:37:29.262+0000 7fc27092b800 5 AuthRegistry(0x5622e5f5a2c0) adding con mode: secure 2024-09-12T00:37:29.611 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:37:29.263+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.611 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient: init 2024-09-12T00:37:29.611 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding auth protocol: cephx 2024-09-12T00:37:29.611 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding auth protocol: cephx 2024-09-12T00:37:29.611 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding auth protocol: cephx 2024-09-12T00:37:29.612 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: secure 2024-09-12T00:37:29.612 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: crc 2024-09-12T00:37:29.612 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: secure 2024-09-12T00:37:29.612 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: crc 2024-09-12T00:37:29.612 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: secure 2024-09-12T00:37:29.612 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: crc 2024-09-12T00:37:29.612 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: crc 2024-09-12T00:37:29.612 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: secure 2024-09-12T00:37:29.612 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: crc 2024-09-12T00:37:29.612 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: secure 2024-09-12T00:37:29.612 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: crc 2024-09-12T00:37:29.612 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8030) adding con mode: secure 2024-09-12T00:37:29.612 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:37:29.263+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.613 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:37:29.263+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.613 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:37:29.263+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command rotate-key cmddesc rotate-key hook 0x7ffda65d8178 EEXIST 2024-09-12T00:37:29.613 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient: _reopen_session rank -1 2024-09-12T00:37:29.613 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:37:29.613 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-b con 0x5622e5f8e8c0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:37:29.613 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-a con 0x5622e5f7f210 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:37:29.613 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-c con 0x5622e5f89cf0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:37:29.613 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.613 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.613 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.613 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): _renew_subs 2024-09-12T00:37:29.613 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:37:29.263+0000 7fc27092b800 10 monclient(hunting): authenticate will time out at 2257.835820s 2024-09-12T00:37:29.613 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:37:29.263+0000 7fc26c673640 10 monclient(hunting): get_auth_request con 0x5622e5f89cf0 auth_method 0 2024-09-12T00:37:29.614 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:37:29.263+0000 7fc26c673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.614 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:37:29.263+0000 7fc26c673640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.614 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:37:29.263+0000 7fc26c673640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.614 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:37:29.263+0000 7fc26ce74640 10 monclient(hunting): get_auth_request con 0x5622e5f7f210 auth_method 0 2024-09-12T00:37:29.614 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:37:29.263+0000 7fc26ce74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.614 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:37:29.263+0000 7fc26ce74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.614 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:37:29.263+0000 7fc26ce74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.614 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:37:29.263+0000 7fc26be72640 10 monclient(hunting): get_auth_request con 0x5622e5f8e8c0 auth_method 0 2024-09-12T00:37:29.614 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:37:29.263+0000 7fc26be72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.614 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:37:29.263+0000 7fc26be72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.614 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:37:29.263+0000 7fc26be72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.614 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:37:29.263+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.614 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:37:29.263+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.614 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:37:29.264+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.615 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:37:29.264+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.615 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:37:29.264+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.615 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:37:29.264+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.615 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:37:29.264+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.615 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:37:29.264+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.615 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:37:29.264+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.615 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:37:29.264+0000 7fc26c673640 10 monclient(hunting): handle_auth_done global_id 7838 payload 274 2024-09-12T00:37:29.615 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:37:29.264+0000 7fc26c673640 10 monclient: _finish_hunting 0 2024-09-12T00:37:29.615 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:37:29.264+0000 7fc26c673640 1 monclient: found mon.noname-c 2024-09-12T00:37:29.615 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:37:29.264+0000 7fc26c673640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.615 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.615 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:29.615 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: dump: 2024-09-12T00:37:29.615 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.616 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.616 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.616 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.616 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.616 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.616 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.616 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.616 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.616 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.616 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: _finish_auth 0 2024-09-12T00:37:29.616 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: _check_auth_tickets 2024-09-12T00:37:29.616 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:29.616 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:37:29.264+0000 7fc27092b800 5 monclient: authenticate success, global_id 7838 2024-09-12T00:37:29.617 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:37:29.264+0000 7fc27092b800 10 monclient: get_monmap_and_config success 2024-09-12T00:37:29.617 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:37:29.264+0000 7fc27092b800 4 set_mon_vals no callback set 2024-09-12T00:37:29.617 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.617 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:29.617 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:37:29.264+0000 7fc1437fe640 10 monclient: dump: 2024-09-12T00:37:29.617 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.617 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.617 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.617 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.617 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.617 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.617 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.617 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.618 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.618 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.618 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:37:29.264+0000 7fc27092b800 10 monclient: shutdown 2024-09-12T00:37:29.618 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:37:29.265+0000 7fc27092b800 10 monclient: build_initial_monmap 2024-09-12T00:37:29.618 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:37:29.265+0000 7fc27092b800 1 build_initial for_mkfs: 0 2024-09-12T00:37:29.618 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:37:29.265+0000 7fc27092b800 10 monclient: monmap: 2024-09-12T00:37:29.618 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:37:29.618 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:29.618 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:37:29.618 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:37:29.618 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:29.618 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.618 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:37:29.618 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:37:29.619 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:37:29.619 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.619 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding auth protocol: cephx 2024-09-12T00:37:29.619 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding auth protocol: cephx 2024-09-12T00:37:29.619 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding auth protocol: cephx 2024-09-12T00:37:29.619 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: secure 2024-09-12T00:37:29.619 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: crc 2024-09-12T00:37:29.619 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: secure 2024-09-12T00:37:29.619 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: crc 2024-09-12T00:37:29.619 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: secure 2024-09-12T00:37:29.619 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: crc 2024-09-12T00:37:29.619 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: crc 2024-09-12T00:37:29.619 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: secure 2024-09-12T00:37:29.620 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: crc 2024-09-12T00:37:29.620 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: secure 2024-09-12T00:37:29.620 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: crc 2024-09-12T00:37:29.620 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f7f700) adding con mode: secure 2024-09-12T00:37:29.620 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:37:29.265+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.620 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:37:29.265+0000 7fc27092b800 1 librados: starting msgr at 2024-09-12T00:37:29.620 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:37:29.265+0000 7fc27092b800 1 librados: starting objecter 2024-09-12T00:37:29.620 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command objecter_requests cmddesc objecter_requests hook 0x5622e5f5cde0 EEXIST 2024-09-12T00:37:29.620 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:37:29.265+0000 7fc27092b800 1 librados: setting wanted keys 2024-09-12T00:37:29.620 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:37:29.265+0000 7fc27092b800 1 librados: calling monclient init 2024-09-12T00:37:29.620 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:37:29.265+0000 7fc27092b800 10 monclient: init 2024-09-12T00:37:29.620 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding auth protocol: cephx 2024-09-12T00:37:29.620 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding auth protocol: cephx 2024-09-12T00:37:29.621 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding auth protocol: cephx 2024-09-12T00:37:29.621 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: secure 2024-09-12T00:37:29.621 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: crc 2024-09-12T00:37:29.621 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: secure 2024-09-12T00:37:29.621 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: crc 2024-09-12T00:37:29.621 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: secure 2024-09-12T00:37:29.621 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: crc 2024-09-12T00:37:29.621 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: crc 2024-09-12T00:37:29.621 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: secure 2024-09-12T00:37:29.621 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: crc 2024-09-12T00:37:29.621 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: secure 2024-09-12T00:37:29.621 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: crc 2024-09-12T00:37:29.621 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:37:29.265+0000 7fc27092b800 5 AuthRegistry(0x5622e5f4efa0) adding con mode: secure 2024-09-12T00:37:29.621 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:37:29.265+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.622 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:37:29.265+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.622 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:37:29.266+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command rotate-key cmddesc rotate-key hook 0x5622e5f4f0e8 EEXIST 2024-09-12T00:37:29.622 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient: _reopen_session rank -1 2024-09-12T00:37:29.622 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:37:29.622 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-a con 0x5622e5f7f210 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:37:29.622 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-c con 0x5622e5f89cf0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:37:29.622 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): picked mon.noname-b con 0x5622e5f8e8c0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:37:29.622 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.622 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.622 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:29.622 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): _renew_subs 2024-09-12T00:37:29.622 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient(hunting): authenticate will time out at 2257.838089s 2024-09-12T00:37:29.622 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): get_auth_request con 0x5622e5f89cf0 auth_method 0 2024-09-12T00:37:29.623 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.623 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.623 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.623 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:37:29.266+0000 7fc26be72640 10 monclient(hunting): get_auth_request con 0x5622e5f7f210 auth_method 0 2024-09-12T00:37:29.623 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:37:29.266+0000 7fc26be72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.623 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:37:29.266+0000 7fc26be72640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.623 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:37:29.266+0000 7fc26be72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.623 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.623 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.623 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.623 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:37:29.266+0000 7fc26c673640 10 monclient(hunting): get_auth_request con 0x5622e5f8e8c0 auth_method 0 2024-09-12T00:37:29.623 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:37:29.266+0000 7fc26c673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:29.623 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:37:29.266+0000 7fc26c673640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:29.623 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:37:29.266+0000 7fc26c673640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:29.624 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:37:29.266+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.624 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:37:29.266+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.624 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:37:29.266+0000 7fc26be72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.624 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:37:29.266+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:29.624 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:37:29.266+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:29.624 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:37:29.266+0000 7fc26c673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:29.624 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient(hunting): handle_auth_done global_id 7841 payload 824 2024-09-12T00:37:29.624 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient: _finish_hunting 0 2024-09-12T00:37:29.624 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:37:29.266+0000 7fc26ce74640 1 monclient: found mon.noname-c 2024-09-12T00:37:29.624 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:37:29.266+0000 7fc26ce74640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.624 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.624 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:29.624 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: dump: 2024-09-12T00:37:29.625 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.625 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.625 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.625 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.625 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.625 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.625 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.625 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.625 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.625 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.625 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:29.625 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:29.626 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:29.626 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:29.626 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:29.626 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:37:29.266+0000 7fc141ffb640 10 monclient: dump: 2024-09-12T00:37:29.626 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:37:29.626 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:37:29.626 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.626 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:37:29.626 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:29.626 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:37:29.626 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:37:29.626 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:37:29.626 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:37:29.627 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.627 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:37:29.266+0000 7fc27092b800 5 monclient: authenticate success, global_id 7841 2024-09-12T00:37:29.627 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient: _renew_subs 2024-09-12T00:37:29.627 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:37:29.266+0000 7fc1437fe640 4 set_mon_vals no callback set 2024-09-12T00:37:29.627 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.627 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient: _renew_subs 2024-09-12T00:37:29.627 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:37:29.266+0000 7fc27092b800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.627 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:37:29.266+0000 7fc27092b800 1 librados: init done 2024-09-12T00:37:29.627 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:37:29.266+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command cr dump hook 0x5622e5f85f28 2024-09-12T00:37:29.627 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:37:29.268+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.627 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:37:29.269+0000 7fc141ffb640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:37:29.627 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:37:29.269+0000 7fc141ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:37:29.627 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:37:29.269+0000 7fc141ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:37:29.628 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:37:29.269+0000 7fc26be72640 10 monclient: get_auth_request con 0x7fc134076470 auth_method 0 2024-09-12T00:37:29.628 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:37:29.269+0000 7fc26c673640 10 monclient: get_auth_request con 0x5622e5fa8a50 auth_method 0 2024-09-12T00:37:29.628 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.628 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:37:29.270+0000 7fc27092b800 20 realm 2024-09-12T00:37:29.628 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.628 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.628 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:37:29.270+0000 7fc27092b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:29.628 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.628 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.628 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:37:29.270+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.628 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:37:29.270+0000 7fc26be72640 10 monclient: get_auth_request con 0x5622e5facc60 auth_method 0 2024-09-12T00:37:29.628 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:37:29.271+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:29.628 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:37:29.271+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.629 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:37:29.271+0000 7fc26ce74640 10 monclient: get_auth_request con 0x5622e5fb04c0 auth_method 0 2024-09-12T00:37:29.629 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:37:29.272+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:29.629 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:37:29.272+0000 7fc27092b800 20 searching for the correct realm 2024-09-12T00:37:29.629 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:37:29.272+0000 7fc26c673640 10 monclient: get_auth_request con 0x7fc264030040 auth_method 0 2024-09-12T00:37:29.629 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:37:29.273+0000 7fc26be72640 10 monclient: get_auth_request con 0x7fc25406d060 auth_method 0 2024-09-12T00:37:29.629 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:37:29.274+0000 7fc26ce74640 0 -- 172.21.15.133:0/4261069916 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x5622e5fb04c0 msgr2=0x5622e5fb28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:29.629 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:37:29.274+0000 7fc141ffb640 1 client.7841.objecter ms_handle_reset 0x5622e5fb04c0 session 0x5622e5fabff0 osd.4 2024-09-12T00:37:29.629 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:37:29.274+0000 7fc141ffb640 10 monclient: _renew_subs 2024-09-12T00:37:29.629 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:37:29.274+0000 7fc141ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:37:29.629 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:37:29.274+0000 7fc26ce74640 10 monclient: get_auth_request con 0x7fc26400b040 auth_method 0 2024-09-12T00:37:29.629 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:37:29.274+0000 7fc26ce74640 10 monclient: get_auth_request con 0x7fc134086720 auth_method 0 2024-09-12T00:37:29.629 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:37:29.276+0000 7fc26c673640 10 monclient: get_auth_request con 0x7fc2540e3360 auth_method 0 2024-09-12T00:37:29.629 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:37:29.277+0000 7fc26be72640 10 monclient: get_auth_request con 0x7fc25c041040 auth_method 0 2024-09-12T00:37:29.629 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:37:29.277+0000 7fc26be72640 0 -- 172.21.15.133:0/4261069916 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fc25c041040 msgr2=0x7fc25c041420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:29.630 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:37:29.478+0000 7fc26be72640 10 monclient: get_auth_request con 0x7fc25c041040 auth_method 0 2024-09-12T00:37:29.630 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:37:29.630 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:37:29.630 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:29.630 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:29.630 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:29.630 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:37:29.483+0000 7fc27092b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:29.630 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:37:29.483+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.630 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:37:29.484+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.630 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:37:29.484+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.630 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:37:29.484+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:29.630 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:37:29.484+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.630 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:29.631 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 zone default found 2024-09-12T00:37:29.631 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:37:29.485+0000 7fc27092b800 4 Realm: () 2024-09-12T00:37:29.631 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:37:29.485+0000 7fc27092b800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:37:29.631 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:37:29.485+0000 7fc27092b800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:37:29.631 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:37:29.485+0000 7fc27092b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:29.631 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 zonegroup default 2024-09-12T00:37:29.631 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.631 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.631 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.631 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.631 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.631 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.631 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 started sync module instance, tier type = 2024-09-12T00:37:29.632 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:37:29.485+0000 7fc27092b800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:37:29.632 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=0 2024-09-12T00:37:29.632 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=1 2024-09-12T00:37:29.632 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=2 2024-09-12T00:37:29.632 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=3 2024-09-12T00:37:29.632 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=4 2024-09-12T00:37:29.632 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=5 2024-09-12T00:37:29.632 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:37:29.495+0000 7fc27092b800 20 add_watcher() i=6 2024-09-12T00:37:29.632 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:37:29.496+0000 7fc27092b800 20 add_watcher() i=7 2024-09-12T00:37:29.632 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:37:29.496+0000 7fc27092b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:29.632 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding auth protocol: cephx 2024-09-12T00:37:29.632 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding auth protocol: cephx 2024-09-12T00:37:29.632 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding auth protocol: cephx 2024-09-12T00:37:29.633 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: secure 2024-09-12T00:37:29.633 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: crc 2024-09-12T00:37:29.633 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: secure 2024-09-12T00:37:29.633 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: crc 2024-09-12T00:37:29.633 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: secure 2024-09-12T00:37:29.633 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: crc 2024-09-12T00:37:29.633 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: crc 2024-09-12T00:37:29.633 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: secure 2024-09-12T00:37:29.633 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: crc 2024-09-12T00:37:29.633 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: secure 2024-09-12T00:37:29.633 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:37:29.498+0000 7fc122fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:29.633 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: crc 2024-09-12T00:37:29.633 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:37:29.498+0000 7fc27092b800 5 AuthRegistry(0x7ffda65d8510) adding con mode: secure 2024-09-12T00:37:29.633 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:37:29.499+0000 7fc27092b800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:29.634 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:37:29.499+0000 7fc27092b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:29.634 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:37:29.499+0000 7fc27092b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:29.634 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command cache list hook 0x5622e5f87b30 2024-09-12T00:37:29.634 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command cache inspect hook 0x5622e5f87b30 2024-09-12T00:37:29.634 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command cache erase hook 0x5622e5f87b30 2024-09-12T00:37:29.634 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command cache zap hook 0x5622e5f87b30 2024-09-12T00:37:29.634 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 note: GC not initialized 2024-09-12T00:37:29.634 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:37:29.499+0000 7fc121fdb640 20 reqs_thread_entry: start 2024-09-12T00:37:29.634 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command sync trace show hook 0x7fc25c006d20 2024-09-12T00:37:29.634 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command sync trace history hook 0x7fc25c006d20 2024-09-12T00:37:29.634 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command sync trace active hook 0x7fc25c006d20 2024-09-12T00:37:29.634 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:37:29.499+0000 7fc27092b800 5 asok(0x5622e5c9a630) register_command sync trace active_short hook 0x7fc25c006d20 2024-09-12T00:37:29.634 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:37:29.499+0000 7fc27092b800 20 init_complete bucket index max shards: 1 2024-09-12T00:37:29.635 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:37:29.499+0000 7fc27092b800 20 Filter name: none 2024-09-12T00:37:29.635 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:37:29.499+0000 7fc0937fe640 20 reqs_thread_entry: start 2024-09-12T00:37:29.635 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:37:29.499+0000 7fc27092b800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:37:29.635 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:37:29.499+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.635 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:37:29.500+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:37:29.635 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:37:29.635 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:37:29.635 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:37:29.635 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:37:29.500+0000 7fc27092b800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.635 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:37:29.500+0000 7fc27092b800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:37:29.635 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:37:29.635 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:37:29.635 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:29.635 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:37:29.636 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:37:29.500+0000 7fc27092b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:37:29.636 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:37:29.504+0000 7fc27092b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:37:29.636 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:37:29.504+0000 7fc27092b800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:37:29.636 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:37:29.504+0000 7fc27092b800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:37:29.636 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:37:29.504+0000 7fc27092b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:37:29.636 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:37:29.505+0000 7fc142ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497081 cookie 94707887342368 notifier 7841 bl.length()=911 2024-09-12T00:37:29.636 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:37:29.505+0000 7fc142ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:37:29.636 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:37:29.505+0000 7fc142ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:37:29.636 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:37:29.505+0000 7fc142ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:37:29.636 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:37:29.506+0000 7fc27092b800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:37:29.636 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:37:29.506+0000 7fc27092b800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:37:29.636 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:37:29.506+0000 7fc27092b800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:37:29.637 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:37:29.506+0000 7fc27092b800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:37:29.637 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:37:29.510+0000 7fc27092b800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc27092b800 time 2024-09-12T00:37:29.510814+0000 2024-09-12T00:37:29.637 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:29.637 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.637 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:29.637 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc27218c71a] 2024-09-12T00:37:29.637 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc27218c8d8] 2024-09-12T00:37:29.637 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5622e3a94641] 2024-09-12T00:37:29.637 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5622e3aa438a] 2024-09-12T00:37:29.637 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:37:29.637 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fc270e29590] 2024-09-12T00:37:29.637 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:37:29.637 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:37:29.638 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.638 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:37:29.511+0000 7fc27092b800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:29.638 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7fc27092b800 thread_name:radosgw-admin 2024-09-12T00:37:29.638 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.638 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:29.638 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc270e3e6f0] 2024-09-12T00:37:29.638 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc270e8b99c] 2024-09-12T00:37:29.638 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:37:29.638 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:37:29.638 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc27218c774] 2024-09-12T00:37:29.638 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc27218c8d8] 2024-09-12T00:37:29.638 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5622e3a94641] 2024-09-12T00:37:29.638 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5622e3aa438a] 2024-09-12T00:37:29.638 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:37:29.639 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fc270e29590] 2024-09-12T00:37:29.639 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:37:29.639 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:37:29.639 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:29.639 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:37:29.639 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:37:29.639 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:37:29.639 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:37:29.639 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:37:29.639 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:37:29.639 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:37:29.639 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:37:29.639 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:37:29.640 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:37:29.640 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:37:29.640 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:37:29.640 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:37:29.640 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:37:29.640 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:37:29.640 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:37:29.640 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:37:29.640 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:37:29.640 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:37:29.640 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:37:29.640 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:37:29.640 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:37:29.640 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:37:29.641 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:37:29.641 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:37:29.641 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:37:29.641 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:37:29.641 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:37:29.641 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:37:29.641 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:37:29.641 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:37:29.641 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:37:29.641 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:37:29.641 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:37:29.641 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:37:29.641 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:37:29.641 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:37:29.642 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:37:29.642 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:37:29.642 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:37:29.642 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:37:29.642 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:37:29.642 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:37:29.642 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:37:29.642 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:37:29.642 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:37:29.642 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:37:29.642 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:37:29.642 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:37:29.642 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:37:29.643 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:37:29.643 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:37:29.643 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:37:29.643 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:37:29.643 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:37:29.643 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:37:29.643 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:37:29.643 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:37:29.643 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:37:29.643 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:37:29.643 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:37:29.643 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:37:29.643 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:37:29.644 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:37:29.644 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:37:29.644 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:37:29.644 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:37:29.644 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:37:29.644 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:37:29.644 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:37:29.644 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:37:29.644 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:37:29.644 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:37:29.645 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:37:29.645 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:37:29.645 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:37:29.645 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:37:29.645 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:37:29.645 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:37:29.645 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:37:29.645 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:37:29.645 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:37:29.645 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:37:29.645 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:37:29.645 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:37:29.645 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:37:29.646 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:37:29.646 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:37:29.646 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:37:29.646 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:37:29.646 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:37:29.646 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:37:29.646 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:37:29.646 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:37:29.646 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:37:29.646 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc0937fe640 / http_manager 2024-09-12T00:37:29.646 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc121fdb640 / http_manager 2024-09-12T00:37:29.646 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc122fdd640 / rgw_dt_lg_renew 2024-09-12T00:37:29.646 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc141ffb640 / ms_dispatch 2024-09-12T00:37:29.646 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc142ffd640 / io_context_pool 2024-09-12T00:37:29.647 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc1437fe640 / io_context_pool 2024-09-12T00:37:29.647 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc151ffb640 / ms_dispatch 2024-09-12T00:37:29.647 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc158e09640 / ms_dispatch 2024-09-12T00:37:29.647 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc15a60c640 / io_context_pool 2024-09-12T00:37:29.647 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc26be72640 / msgr-worker-2 2024-09-12T00:37:29.647 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc26c673640 / msgr-worker-1 2024-09-12T00:37:29.647 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc26ce74640 / msgr-worker-0 2024-09-12T00:37:29.647 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc26d675640 / io_context_pool 2024-09-12T00:37:29.647 INFO:tasks.workunit.client.0.smithi133.stderr: 7fc27092b800 / radosgw-admin 2024-09-12T00:37:29.647 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:37:29.647 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:37:29.647 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:37:29.512213Z_e2585d4f-c7bf-4578-9201-4433634cface/log 2024-09-12T00:37:29.647 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:37:29.647 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:37:29.649 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:29.649 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:29.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.586+0000 7fe471d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.588+0000 7fe471d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.588+0000 7fe471d2c800 20 realm 2024-09-12T00:37:29.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.588+0000 7fe471d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.588+0000 7fe471d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.588+0000 7fe471d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:29.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.588+0000 7fe471d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.588+0000 7fe471d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.588+0000 7fe471d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.589+0000 7fe471d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:29.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.589+0000 7fe471d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.590+0000 7fe471d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:29.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.590+0000 7fe471d2c800 20 searching for the correct realm 2024-09-12T00:37:29.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.592+0000 7fe467fff640 0 -- 172.21.15.133:0/1210368051 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fe458027020 msgr2=0x7fe45806caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:29.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.595+0000 7fe467fff640 0 -- 172.21.15.133:0/1210368051 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fe460048040 msgr2=0x7fe460039930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:29.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.801+0000 7fe471d2c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:37:29.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.801+0000 7fe471d2c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:37:29.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.801+0000 7fe471d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:29.801 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.801+0000 7fe471d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:29.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.801+0000 7fe471d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:29.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.801+0000 7fe471d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:29.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.801+0000 7fe471d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.801+0000 7fe471d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.802+0000 7fe471d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.802+0000 7fe471d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:29.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.802+0000 7fe471d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.802+0000 7fe471d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:29.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.802+0000 7fe471d2c800 20 zone default found 2024-09-12T00:37:29.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.802+0000 7fe471d2c800 4 Realm: () 2024-09-12T00:37:29.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.802+0000 7fe471d2c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:37:29.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.802+0000 7fe471d2c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:37:29.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.802+0000 7fe471d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:29.802 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.802+0000 7fe471d2c800 20 zonegroup default 2024-09-12T00:37:29.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.802+0000 7fe471d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.802+0000 7fe471d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.802+0000 7fe471d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.803+0000 7fe471d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.803+0000 7fe471d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.803+0000 7fe471d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.803 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.803+0000 7fe471d2c800 20 started sync module instance, tier type = 2024-09-12T00:37:29.804 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.803+0000 7fe471d2c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:37:29.810 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.812+0000 7fe471d2c800 20 add_watcher() i=0 2024-09-12T00:37:29.811 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.812+0000 7fe471d2c800 20 add_watcher() i=1 2024-09-12T00:37:29.811 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.812+0000 7fe471d2c800 20 add_watcher() i=2 2024-09-12T00:37:29.811 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.812+0000 7fe471d2c800 20 add_watcher() i=3 2024-09-12T00:37:29.811 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.812+0000 7fe471d2c800 20 add_watcher() i=4 2024-09-12T00:37:29.811 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.812+0000 7fe471d2c800 20 add_watcher() i=5 2024-09-12T00:37:29.811 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.812+0000 7fe471d2c800 20 add_watcher() i=6 2024-09-12T00:37:29.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.813+0000 7fe471d2c800 20 add_watcher() i=7 2024-09-12T00:37:29.812 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.813+0000 7fe471d2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:29.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.815+0000 7fe31f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:29.814 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.815+0000 7fe471d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:29.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.815+0000 7fe471d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:29.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.815+0000 7fe471d2c800 5 note: GC not initialized 2024-09-12T00:37:29.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.816+0000 7fe31e7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:29.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.816+0000 7fe471d2c800 20 init_complete bucket index max shards: 1 2024-09-12T00:37:29.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.816+0000 7fe471d2c800 20 Filter name: none 2024-09-12T00:37:29.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.816+0000 7fe28ffff640 20 reqs_thread_entry: start 2024-09-12T00:37:29.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.816+0000 7fe471d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.816+0000 7fe471d2c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:37:29.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.816+0000 7fe471d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.817+0000 7fe471d2c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:37:29.816 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.817+0000 7fe471d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:29.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.817+0000 7fe471d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.817+0000 7fe471d2c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:37:29.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.817+0000 7fe471d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.817+0000 7fe471d2c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:37:29.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.817+0000 7fe471d2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:29.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.819+0000 7fe31f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:29.819 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.821+0000 7fe471d2c800 20 remove_watcher() i=0 2024-09-12T00:37:29.819 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.821+0000 7fe471d2c800 2 removed watcher, disabling cache 2024-09-12T00:37:29.820 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.822+0000 7fe471d2c800 20 remove_watcher() i=1 2024-09-12T00:37:29.821 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.822+0000 7fe471d2c800 20 remove_watcher() i=2 2024-09-12T00:37:29.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.824+0000 7fe471d2c800 20 remove_watcher() i=3 2024-09-12T00:37:29.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.824+0000 7fe471d2c800 20 remove_watcher() i=4 2024-09-12T00:37:29.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.825+0000 7fe471d2c800 20 remove_watcher() i=5 2024-09-12T00:37:29.825 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.826+0000 7fe471d2c800 20 remove_watcher() i=6 2024-09-12T00:37:29.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.828+0000 7fe471d2c800 20 remove_watcher() i=7 2024-09-12T00:37:29.878 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:37:29.906 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:29.906 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:29.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.945+0000 7fc5a4726800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.946+0000 7fc5a4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.946+0000 7fc5a4726800 20 realm 2024-09-12T00:37:29.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.946+0000 7fc5a4726800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.947+0000 7fc5a4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.947+0000 7fc5a4726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:29.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.947+0000 7fc5a4726800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.947+0000 7fc5a4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:29.946 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.947+0000 7fc5a4726800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.947+0000 7fc5a4726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:29.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.947+0000 7fc5a4726800 20 rados->read ofs=0 len=0 2024-09-12T00:37:29.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.948+0000 7fc5a4726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:29.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.948+0000 7fc5a4726800 20 searching for the correct realm 2024-09-12T00:37:29.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:29.949+0000 7fc5a046f640 0 -- 172.21.15.133:0/1744614774 >> [v2:172.21.15.133:6816/1011460824,v1:172.21.15.133:6817/1011460824] conn(0x7fc59801f040 msgr2=0x7fc59802f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:30.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.154+0000 7fc5a046f640 0 -- 172.21.15.133:0/1744614774 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x5597e28d5590 msgr2=0x5597e28d79a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:30.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.160+0000 7fc5a4726800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:37:30.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.160+0000 7fc5a4726800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:37:30.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.160+0000 7fc5a4726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.160+0000 7fc5a4726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.160+0000 7fc5a4726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.160+0000 7fc5a4726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.160+0000 7fc5a4726800 20 rados->read ofs=0 len=0 2024-09-12T00:37:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.161+0000 7fc5a4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.161+0000 7fc5a4726800 20 rados->read ofs=0 len=0 2024-09-12T00:37:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.161+0000 7fc5a4726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.161+0000 7fc5a4726800 20 rados->read ofs=0 len=0 2024-09-12T00:37:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.161+0000 7fc5a4726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.161+0000 7fc5a4726800 20 zone default found 2024-09-12T00:37:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.161+0000 7fc5a4726800 4 Realm: () 2024-09-12T00:37:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.161+0000 7fc5a4726800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:37:30.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.161+0000 7fc5a4726800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:37:30.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.161+0000 7fc5a4726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:30.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.161+0000 7fc5a4726800 20 zonegroup default 2024-09-12T00:37:30.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.161+0000 7fc5a4726800 20 rados->read ofs=0 len=0 2024-09-12T00:37:30.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.161+0000 7fc5a4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:30.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.162+0000 7fc5a4726800 20 rados->read ofs=0 len=0 2024-09-12T00:37:30.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.162+0000 7fc5a4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:30.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.162+0000 7fc5a4726800 20 rados->read ofs=0 len=0 2024-09-12T00:37:30.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.162+0000 7fc5a4726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:30.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.162+0000 7fc5a4726800 20 started sync module instance, tier type = 2024-09-12T00:37:30.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.162+0000 7fc5a4726800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:37:30.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.171+0000 7fc5a4726800 20 add_watcher() i=0 2024-09-12T00:37:30.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.171+0000 7fc5a4726800 20 add_watcher() i=1 2024-09-12T00:37:30.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.171+0000 7fc5a4726800 20 add_watcher() i=2 2024-09-12T00:37:30.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.171+0000 7fc5a4726800 20 add_watcher() i=3 2024-09-12T00:37:30.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.171+0000 7fc5a4726800 20 add_watcher() i=4 2024-09-12T00:37:30.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.171+0000 7fc5a4726800 20 add_watcher() i=5 2024-09-12T00:37:30.170 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.171+0000 7fc5a4726800 20 add_watcher() i=6 2024-09-12T00:37:30.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.172+0000 7fc5a4726800 20 add_watcher() i=7 2024-09-12T00:37:30.171 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.172+0000 7fc5a4726800 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:30.172 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.174+0000 7fc4567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:30.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.174+0000 7fc5a4726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:30.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.174+0000 7fc5a4726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:30.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.174+0000 7fc5a4726800 5 note: GC not initialized 2024-09-12T00:37:30.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.174+0000 7fc4557e2640 20 reqs_thread_entry: start 2024-09-12T00:37:30.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.174+0000 7fc5a4726800 20 init_complete bucket index max shards: 1 2024-09-12T00:37:30.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.174+0000 7fc5a4726800 20 Filter name: none 2024-09-12T00:37:30.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc3c6ffd640 20 reqs_thread_entry: start 2024-09-12T00:37:30.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc5a4726800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:37:30.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc5a4726800 20 rados->read ofs=0 len=0 2024-09-12T00:37:30.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc5a4726800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:37:30.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc5a4726800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:37:30.174 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc5a4726800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:37:30.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc5a4726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:37:30.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc5a4726800 20 rados->read ofs=0 len=0 2024-09-12T00:37:30.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc5a4726800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:37:30.175 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc5a4726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:37:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc5a4726800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:37:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc5a4726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc5a4726800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:37:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc5a4726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:37:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc5a4726800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:37:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.175+0000 7fc5a4726800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:37:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.176+0000 7fc5a4726800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:37:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.176+0000 7fc5a4726800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:37:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.176+0000 7fc5a4726800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:37:30.176 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.176+0000 7fc5a4726800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:37:30.177 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.177+0000 7fc4567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:30.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.179+0000 7fc5a4726800 20 remove_watcher() i=0 2024-09-12T00:37:30.178 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.179+0000 7fc5a4726800 2 removed watcher, disabling cache 2024-09-12T00:37:30.179 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.180+0000 7fc5a4726800 20 remove_watcher() i=1 2024-09-12T00:37:30.180 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.181+0000 7fc5a4726800 20 remove_watcher() i=2 2024-09-12T00:37:30.181 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.182+0000 7fc5a4726800 20 remove_watcher() i=3 2024-09-12T00:37:30.182 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.183+0000 7fc5a4726800 20 remove_watcher() i=4 2024-09-12T00:37:30.183 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.184+0000 7fc5a4726800 20 remove_watcher() i=5 2024-09-12T00:37:30.184 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.185+0000 7fc5a4726800 20 remove_watcher() i=6 2024-09-12T00:37:30.185 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:37:30.186+0000 7fc5a4726800 20 remove_watcher() i=7 2024-09-12T00:38:00.209 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:38:00.246 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:00.246 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:00.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.290+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.292+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.292+0000 7f520f520800 20 realm 2024-09-12T00:38:00.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.292+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.292+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.292+0000 7f520f520800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:00.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.292+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.292+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.292+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.293+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:00.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.293+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.294+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:00.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.294+0000 7f520f520800 20 searching for the correct realm 2024-09-12T00:38:00.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.296+0000 7f5203fff640 0 -- 172.21.15.133:0/4032917150 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f51f402f070 msgr2=0x7f51f406c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:00.501 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.502+0000 7f5203fff640 0 -- 172.21.15.133:0/4032917150 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f51fc0611f0 msgr2=0x7f51fc05fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:00.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:38:00.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:38:00.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:00.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:00.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:00.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:00.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.709+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.709+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.709+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.709+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:00.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.709+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.710+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:00.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.710+0000 7f520f520800 20 zone default found 2024-09-12T00:38:00.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.710+0000 7f520f520800 4 Realm: () 2024-09-12T00:38:00.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.710+0000 7f520f520800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:38:00.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.710+0000 7f520f520800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:38:00.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.710+0000 7f520f520800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:00.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.710+0000 7f520f520800 20 zonegroup default 2024-09-12T00:38:00.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.710+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.710+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.710+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.711+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.711+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.711+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.711+0000 7f520f520800 20 started sync module instance, tier type = 2024-09-12T00:38:00.712 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.711+0000 7f520f520800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:38:00.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=0 2024-09-12T00:38:00.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=1 2024-09-12T00:38:00.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=2 2024-09-12T00:38:00.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=3 2024-09-12T00:38:00.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=4 2024-09-12T00:38:00.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=5 2024-09-12T00:38:00.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=6 2024-09-12T00:38:00.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.723+0000 7f520f520800 20 add_watcher() i=7 2024-09-12T00:38:00.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.723+0000 7f520f520800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:00.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.725+0000 7f50c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:00.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.725+0000 7f520f520800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:00.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.725+0000 7f520f520800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:00.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.726+0000 7f520f520800 5 note: GC not initialized 2024-09-12T00:38:00.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.726+0000 7f50c17e2640 20 reqs_thread_entry: start 2024-09-12T00:38:00.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.726+0000 7f520f520800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:00.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.726+0000 7f520f520800 20 Filter name: none 2024-09-12T00:38:00.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.726+0000 7f50ba7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:00.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.726+0000 7f520f520800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:38:00.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.726+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.727+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:38:00.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.727+0000 7f520f520800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:38:00.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.727+0000 7f520f520800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:38:00.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.727+0000 7f520f520800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:38:00.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.727+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.727+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:38:00.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.727+0000 7f520f520800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:00.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.727+0000 7f520f520800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:00.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.727+0000 7f520f520800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:00.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.727+0000 7f520f520800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:00.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.727+0000 7f520f520800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:38:00.727 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.728+0000 7f520f520800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:38:00.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.733+0000 7f520f520800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:00.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.733+0000 7f520f520800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:00.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.733+0000 7f520f520800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:00.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.733+0000 7f520f520800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:38:00.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.733+0000 7f50ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497082 cookie 94014671013216 notifier 8424 bl.length()=911 2024-09-12T00:38:00.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.733+0000 7f50ee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:00.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.733+0000 7f50ee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:00.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.733+0000 7f50ee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:00.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.735+0000 7f520f520800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:38:00.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.735+0000 7f520f520800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:38:00.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.735+0000 7f520f520800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:38:00.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.735+0000 7f520f520800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:38:00.736 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f520f520800 time 2024-09-12T00:38:00.738935+0000 2024-09-12T00:38:00.736 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:00.737 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:00.737 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5210d8c71a] 2024-09-12T00:38:00.737 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5210d8c8d8] 2024-09-12T00:38:00.737 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55817cd78641] 2024-09-12T00:38:00.737 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd8854c) [0x55817d28b54c] 2024-09-12T00:38:00.737 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55817cd8831d] 2024-09-12T00:38:00.738 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:38:00.738 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f520fa29590] 2024-09-12T00:38:00.738 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:38:00.738 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:38:00.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.738+0000 7f520f520800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f520f520800 time 2024-09-12T00:38:00.738935+0000 2024-09-12T00:38:00.738 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:00.738 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.738 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:00.738 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5210d8c71a] 2024-09-12T00:38:00.738 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5210d8c8d8] 2024-09-12T00:38:00.738 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55817cd78641] 2024-09-12T00:38:00.738 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd8854c) [0x55817d28b54c] 2024-09-12T00:38:00.738 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55817cd8831d] 2024-09-12T00:38:00.739 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:38:00.739 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f520fa29590] 2024-09-12T00:38:00.739 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:38:00.739 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:38:00.739 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.739 INFO:tasks.workunit.client.0.smithi133.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:38:00.739 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f520f520800 thread_name:radosgw-admin 2024-09-12T00:38:00.768 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:00.769 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f520fa3e6f0] 2024-09-12T00:38:00.769 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f520fa8b99c] 2024-09-12T00:38:00.769 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:38:00.769 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:38:00.770 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5210d8c774] 2024-09-12T00:38:00.770 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5210d8c8d8] 2024-09-12T00:38:00.770 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55817cd78641] 2024-09-12T00:38:00.770 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd8854c) [0x55817d28b54c] 2024-09-12T00:38:00.770 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55817cd8831d] 2024-09-12T00:38:00.770 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:38:00.771 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f520fa29590] 2024-09-12T00:38:00.771 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:38:00.771 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:38:00.771 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.739+0000 7f520f520800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:00.771 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f520f520800 thread_name:radosgw-admin 2024-09-12T00:38:00.772 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.772 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:00.772 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f520fa3e6f0] 2024-09-12T00:38:00.772 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f520fa8b99c] 2024-09-12T00:38:00.772 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:38:00.772 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:38:00.773 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5210d8c774] 2024-09-12T00:38:00.773 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5210d8c8d8] 2024-09-12T00:38:00.773 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55817cd78641] 2024-09-12T00:38:00.773 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd8854c) [0x55817d28b54c] 2024-09-12T00:38:00.773 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55817cd8831d] 2024-09-12T00:38:00.774 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:38:00.774 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f520fa29590] 2024-09-12T00:38:00.774 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:38:00.774 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:38:00.774 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:00.775 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.775 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:38:00.775 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:38:00.271+0000 7f50f960a640 10 monclient: dump: 2024-09-12T00:38:00.775 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.775 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.776 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.776 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.776 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.776 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.776 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.776 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.777 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.777 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.777 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:38:00.271+0000 7f520f520800 5 monclient: authenticate success, global_id 7880 2024-09-12T00:38:00.777 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:38:00.271+0000 7f520f520800 10 monclient: get_monmap_and_config success 2024-09-12T00:38:00.777 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:38:00.271+0000 7f520f520800 4 set_mon_vals no callback set 2024-09-12T00:38:00.778 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:38:00.271+0000 7f520f520800 10 monclient: shutdown 2024-09-12T00:38:00.778 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:38:00.271+0000 7f520f520800 5 asok(0x55817edff630) unregister_commands rotate-key 2024-09-12T00:38:00.778 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:38:00.272+0000 7f520f520800 10 monclient: build_initial_monmap 2024-09-12T00:38:00.778 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:38:00.272+0000 7f520f520800 1 build_initial for_mkfs: 0 2024-09-12T00:38:00.778 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:38:00.272+0000 7f520f520800 10 monclient: monmap: 2024-09-12T00:38:00.778 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:00.779 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:00.779 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:00.779 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:00.779 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:00.779 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.780 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:00.780 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:00.780 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:00.780 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.781 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding auth protocol: cephx 2024-09-12T00:38:00.781 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding auth protocol: cephx 2024-09-12T00:38:00.781 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding auth protocol: cephx 2024-09-12T00:38:00.781 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: secure 2024-09-12T00:38:00.781 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: crc 2024-09-12T00:38:00.782 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: secure 2024-09-12T00:38:00.782 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: crc 2024-09-12T00:38:00.782 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: secure 2024-09-12T00:38:00.782 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: crc 2024-09-12T00:38:00.782 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: crc 2024-09-12T00:38:00.782 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: secure 2024-09-12T00:38:00.783 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: crc 2024-09-12T00:38:00.783 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: secure 2024-09-12T00:38:00.783 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: crc 2024-09-12T00:38:00.783 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: secure 2024-09-12T00:38:00.784 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:38:00.272+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.784 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:38:00.272+0000 7f520f520800 1 librados: starting msgr at 2024-09-12T00:38:00.784 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:38:00.272+0000 7f520f520800 1 librados: starting objecter 2024-09-12T00:38:00.784 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:38:00.272+0000 7f520f520800 5 asok(0x55817edff630) register_command objecter_requests hook 0x55817f050aa0 2024-09-12T00:38:00.784 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:38:00.272+0000 7f520f520800 1 librados: setting wanted keys 2024-09-12T00:38:00.785 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:38:00.272+0000 7f520f520800 1 librados: calling monclient init 2024-09-12T00:38:00.785 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:38:00.272+0000 7f520f520800 10 monclient: init 2024-09-12T00:38:00.785 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding auth protocol: cephx 2024-09-12T00:38:00.785 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding auth protocol: cephx 2024-09-12T00:38:00.785 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding auth protocol: cephx 2024-09-12T00:38:00.786 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: secure 2024-09-12T00:38:00.786 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: crc 2024-09-12T00:38:00.786 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: secure 2024-09-12T00:38:00.786 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: crc 2024-09-12T00:38:00.786 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: secure 2024-09-12T00:38:00.786 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: crc 2024-09-12T00:38:00.787 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: crc 2024-09-12T00:38:00.787 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: secure 2024-09-12T00:38:00.787 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: crc 2024-09-12T00:38:00.788 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: secure 2024-09-12T00:38:00.788 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: crc 2024-09-12T00:38:00.789 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: secure 2024-09-12T00:38:00.789 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:38:00.272+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.789 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:38:00.273+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.789 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:38:00.273+0000 7f520f520800 5 asok(0x55817edff630) register_command rotate-key hook 0x55817f01ede8 2024-09-12T00:38:00.789 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:00.790 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:38:00.790 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): picked mon.noname-c con 0x55817eed6da0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:00.790 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): picked mon.noname-b con 0x55817ef620d0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:00.790 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): picked mon.noname-a con 0x55817ef68420 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:00.790 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.790 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.791 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.791 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:00.791 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): authenticate will time out at 2288.845205s 2024-09-12T00:38:00.792 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): get_auth_request con 0x55817eed6da0 auth_method 0 2024-09-12T00:38:00.792 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.792 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.792 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.793 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:38:00.273+0000 7f520ba69640 10 monclient(hunting): get_auth_request con 0x55817ef68420 auth_method 0 2024-09-12T00:38:00.793 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:38:00.273+0000 7f520ba69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.793 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:38:00.273+0000 7f520ba69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.793 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:38:00.273+0000 7f520ba69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.793 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.793 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.794 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.794 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:38:00.273+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.794 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:38:00.273+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.794 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:38:00.273+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.794 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:38:00.273+0000 7f5203fff640 10 monclient(hunting): get_auth_request con 0x55817ef620d0 auth_method 0 2024-09-12T00:38:00.795 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:38:00.273+0000 7f5203fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.795 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:38:00.273+0000 7f5203fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.795 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:38:00.273+0000 7f5203fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.795 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:38:00.273+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.795 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:38:00.273+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.795 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:38:00.273+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.796 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): handle_auth_done global_id 7883 payload 824 2024-09-12T00:38:00.796 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient: _finish_hunting 0 2024-09-12T00:38:00.796 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:38:00.273+0000 7f520b268640 1 monclient: found mon.noname-c 2024-09-12T00:38:00.796 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:38:00.796 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.796 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:00.796 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: dump: 2024-09-12T00:38:00.796 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.797 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.797 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.797 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.797 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.797 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.798 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.798 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.798 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.798 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.798 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: _finish_auth 0 2024-09-12T00:38:00.798 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: _check_auth_tickets 2024-09-12T00:38:00.798 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:38:00.273+0000 7f520f520800 5 monclient: authenticate success, global_id 7883 2024-09-12T00:38:00.798 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:00.798 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.798 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:00.798 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: dump: 2024-09-12T00:38:00.798 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.798 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.798 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.798 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.799 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.799 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.799 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.799 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.799 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.799 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.799 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient: _renew_subs 2024-09-12T00:38:00.799 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:38:00.799 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:38:00.273+0000 7f50f960a640 4 set_mon_vals no callback set 2024-09-12T00:38:00.799 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:38:00.274+0000 7f520f520800 10 monclient: _renew_subs 2024-09-12T00:38:00.799 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:38:00.274+0000 7f520f520800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:38:00.799 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:38:00.274+0000 7f520f520800 1 librados: init done 2024-09-12T00:38:00.800 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:38:00.276+0000 7f50f7e07640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:38:00.800 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:38:00.276+0000 7f50f7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:00.800 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:38:00.276+0000 7f50f7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:00.800 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:38:00.276+0000 7f5203fff640 10 monclient: get_auth_request con 0x7f50f00764a0 auth_method 0 2024-09-12T00:38:00.800 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:38:00.276+0000 7f520ba69640 10 monclient: get_auth_request con 0x55817f0478a0 auth_method 0 2024-09-12T00:38:00.800 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:38:00.277+0000 7f520b268640 10 monclient: get_auth_request con 0x55817f069f80 auth_method 0 2024-09-12T00:38:00.800 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:38:00.278+0000 7f5203fff640 10 monclient: get_auth_request con 0x55817f06e730 auth_method 0 2024-09-12T00:38:00.800 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:38:00.279+0000 7f520ba69640 10 monclient: get_auth_request con 0x55817f072760 auth_method 0 2024-09-12T00:38:00.800 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:38:00.280+0000 7f520f520800 10 monclient: build_initial_monmap 2024-09-12T00:38:00.800 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:38:00.280+0000 7f520f520800 1 build_initial for_mkfs: 0 2024-09-12T00:38:00.800 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:38:00.280+0000 7f520f520800 10 monclient: monmap: 2024-09-12T00:38:00.800 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:00.800 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:00.801 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:00.801 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:00.801 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:00.801 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.801 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:00.801 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:00.801 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:00.801 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.801 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding auth protocol: cephx 2024-09-12T00:38:00.801 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding auth protocol: cephx 2024-09-12T00:38:00.801 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding auth protocol: cephx 2024-09-12T00:38:00.801 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: secure 2024-09-12T00:38:00.802 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: crc 2024-09-12T00:38:00.802 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: secure 2024-09-12T00:38:00.802 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: crc 2024-09-12T00:38:00.802 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: secure 2024-09-12T00:38:00.802 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: crc 2024-09-12T00:38:00.802 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: crc 2024-09-12T00:38:00.802 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: secure 2024-09-12T00:38:00.802 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: crc 2024-09-12T00:38:00.802 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: secure 2024-09-12T00:38:00.802 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: crc 2024-09-12T00:38:00.802 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: secure 2024-09-12T00:38:00.802 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:38:00.280+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.802 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:38:00.280+0000 7f520f520800 5 asok(0x55817edff630) register_command objecter_requests cmddesc objecter_requests hook 0x55817f07a290 EEXIST 2024-09-12T00:38:00.803 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient: init 2024-09-12T00:38:00.803 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding auth protocol: cephx 2024-09-12T00:38:00.803 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding auth protocol: cephx 2024-09-12T00:38:00.803 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding auth protocol: cephx 2024-09-12T00:38:00.803 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: secure 2024-09-12T00:38:00.803 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: crc 2024-09-12T00:38:00.803 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: secure 2024-09-12T00:38:00.803 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: crc 2024-09-12T00:38:00.803 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: secure 2024-09-12T00:38:00.803 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: crc 2024-09-12T00:38:00.803 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: crc 2024-09-12T00:38:00.803 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: secure 2024-09-12T00:38:00.803 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: crc 2024-09-12T00:38:00.804 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: secure 2024-09-12T00:38:00.804 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: crc 2024-09-12T00:38:00.804 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: secure 2024-09-12T00:38:00.804 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:38:00.281+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.804 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:38:00.281+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.804 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:38:00.281+0000 7f520f520800 5 asok(0x55817edff630) register_command rotate-key cmddesc rotate-key hook 0x55817f0758e0 EEXIST 2024-09-12T00:38:00.804 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:00.804 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:38:00.804 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): picked mon.noname-a con 0x55817f09df80 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:00.804 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): picked mon.noname-c con 0x55817f0a0250 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:00.804 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): picked mon.noname-b con 0x55817f09c750 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:00.804 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.804 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.805 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.805 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:00.805 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): authenticate will time out at 2288.853615s 2024-09-12T00:38:00.805 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): get_auth_request con 0x55817f0a0250 auth_method 0 2024-09-12T00:38:00.805 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.805 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.805 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.805 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:38:00.281+0000 7f5203fff640 10 monclient(hunting): get_auth_request con 0x55817f09df80 auth_method 0 2024-09-12T00:38:00.805 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:38:00.281+0000 7f5203fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.805 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:38:00.281+0000 7f5203fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.805 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:38:00.281+0000 7f5203fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.805 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:38:00.281+0000 7f520b268640 10 monclient(hunting): get_auth_request con 0x55817f09c750 auth_method 0 2024-09-12T00:38:00.805 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:38:00.281+0000 7f520b268640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.805 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:38:00.281+0000 7f520b268640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.805 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:38:00.281+0000 7f520b268640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.806 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.806 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.806 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.806 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:38:00.281+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.806 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:38:00.281+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.806 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:38:00.281+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.806 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:38:00.281+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.806 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:38:00.281+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.806 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:38:00.281+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.806 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): handle_auth_done global_id 7886 payload 824 2024-09-12T00:38:00.806 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:38:00.282+0000 7f520ba69640 10 monclient: _finish_hunting 0 2024-09-12T00:38:00.806 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:38:00.282+0000 7f520ba69640 1 monclient: found mon.noname-c 2024-09-12T00:38:00.807 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:38:00.282+0000 7f520ba69640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:38:00.807 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.807 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:00.807 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: dump: 2024-09-12T00:38:00.807 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.807 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.807 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.807 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.807 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.807 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.807 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.807 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.808 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.808 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.808 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: _finish_auth 0 2024-09-12T00:38:00.808 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: _check_auth_tickets 2024-09-12T00:38:00.808 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:00.808 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.808 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:00.808 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: dump: 2024-09-12T00:38:00.809 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.809 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.809 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.809 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.809 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.810 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.810 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.810 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.810 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.810 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.810 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:38:00.282+0000 7f520f520800 5 monclient: authenticate success, global_id 7886 2024-09-12T00:38:00.811 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:38:00.282+0000 7f520f520800 10 monclient: _renew_subs 2024-09-12T00:38:00.811 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:38:00.282+0000 7f520f520800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:38:00.811 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:38:00.282+0000 7f520c26a640 4 set_mon_vals no callback set 2024-09-12T00:38:00.811 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:38:00.282+0000 7f520f520800 10 monclient: _renew_subs 2024-09-12T00:38:00.811 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:38:00.282+0000 7f520f520800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:38:00.811 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:38:00.284+0000 7f50f5602640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:38:00.811 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:38:00.284+0000 7f50f5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:00.811 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:38:00.284+0000 7f50f5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:00.811 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:38:00.284+0000 7f5203fff640 10 monclient: get_auth_request con 0x7f50e4076380 auth_method 0 2024-09-12T00:38:00.811 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:38:00.284+0000 7f520f520800 10 monclient: get_monmap_and_config 2024-09-12T00:38:00.811 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:38:00.284+0000 7f520f520800 10 monclient: build_initial_monmap 2024-09-12T00:38:00.811 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:38:00.284+0000 7f520f520800 1 build_initial for_mkfs: 0 2024-09-12T00:38:00.812 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:38:00.284+0000 7f520f520800 10 monclient: monmap: 2024-09-12T00:38:00.812 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:00.812 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:00.812 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:00.812 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:00.812 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:00.812 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.812 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:00.812 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:00.812 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:00.812 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.812 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding auth protocol: cephx 2024-09-12T00:38:00.812 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding auth protocol: cephx 2024-09-12T00:38:00.813 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding auth protocol: cephx 2024-09-12T00:38:00.813 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: secure 2024-09-12T00:38:00.813 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: crc 2024-09-12T00:38:00.813 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: secure 2024-09-12T00:38:00.813 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: crc 2024-09-12T00:38:00.813 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: secure 2024-09-12T00:38:00.813 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: crc 2024-09-12T00:38:00.813 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: crc 2024-09-12T00:38:00.813 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: secure 2024-09-12T00:38:00.813 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: crc 2024-09-12T00:38:00.813 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: secure 2024-09-12T00:38:00.813 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: crc 2024-09-12T00:38:00.813 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: secure 2024-09-12T00:38:00.814 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:38:00.285+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.814 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient: init 2024-09-12T00:38:00.814 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding auth protocol: cephx 2024-09-12T00:38:00.814 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding auth protocol: cephx 2024-09-12T00:38:00.814 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding auth protocol: cephx 2024-09-12T00:38:00.814 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: secure 2024-09-12T00:38:00.814 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: crc 2024-09-12T00:38:00.814 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: secure 2024-09-12T00:38:00.814 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: crc 2024-09-12T00:38:00.814 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: secure 2024-09-12T00:38:00.814 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: crc 2024-09-12T00:38:00.814 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: crc 2024-09-12T00:38:00.815 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: secure 2024-09-12T00:38:00.815 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: crc 2024-09-12T00:38:00.815 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: secure 2024-09-12T00:38:00.815 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: crc 2024-09-12T00:38:00.815 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: secure 2024-09-12T00:38:00.815 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:38:00.285+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.815 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:38:00.285+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.815 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:38:00.285+0000 7f520f520800 5 asok(0x55817edff630) register_command rotate-key cmddesc rotate-key hook 0x7ffdd157d688 EEXIST 2024-09-12T00:38:00.815 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:00.815 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:38:00.815 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): picked mon.noname-b con 0x55817f0f1ed0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:00.815 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): picked mon.noname-c con 0x55817f0f22b0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:00.815 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): picked mon.noname-a con 0x55817f0f79e0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:00.816 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.816 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.816 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.816 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:00.816 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): authenticate will time out at 2288.857721s 2024-09-12T00:38:00.816 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:38:00.285+0000 7f520ba69640 10 monclient(hunting): get_auth_request con 0x55817f0f22b0 auth_method 0 2024-09-12T00:38:00.816 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:38:00.285+0000 7f520ba69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.816 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:38:00.285+0000 7f520ba69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.816 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:38:00.285+0000 7f520ba69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.816 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:38:00.285+0000 7f520b268640 10 monclient(hunting): get_auth_request con 0x55817f0f79e0 auth_method 0 2024-09-12T00:38:00.816 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:38:00.285+0000 7f520b268640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.816 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:38:00.285+0000 7f520b268640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.817 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:38:00.285+0000 7f520b268640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.817 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:38:00.285+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.817 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:38:00.285+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.817 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:38:00.285+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.817 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:38:00.285+0000 7f5203fff640 10 monclient(hunting): get_auth_request con 0x55817f0f1ed0 auth_method 0 2024-09-12T00:38:00.817 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:38:00.285+0000 7f5203fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.817 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:38:00.285+0000 7f5203fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.818 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:38:00.285+0000 7f5203fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.818 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:38:00.285+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.818 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:38:00.285+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.818 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:38:00.285+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.818 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:38:00.286+0000 7f520ba69640 10 monclient(hunting): handle_auth_done global_id 7889 payload 274 2024-09-12T00:38:00.818 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:38:00.286+0000 7f520ba69640 10 monclient: _finish_hunting 0 2024-09-12T00:38:00.818 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:38:00.286+0000 7f520ba69640 1 monclient: found mon.noname-c 2024-09-12T00:38:00.818 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:38:00.286+0000 7f520ba69640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:38:00.818 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.818 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:00.819 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: dump: 2024-09-12T00:38:00.819 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.819 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.819 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.819 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.819 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.819 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.819 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.819 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.819 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.819 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.820 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: _finish_auth 0 2024-09-12T00:38:00.820 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: _check_auth_tickets 2024-09-12T00:38:00.820 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:00.820 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.820 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:00.820 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: dump: 2024-09-12T00:38:00.821 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.821 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.821 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.821 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.821 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.822 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.822 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.822 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.822 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.822 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.822 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:38:00.286+0000 7f520f520800 5 monclient: authenticate success, global_id 7889 2024-09-12T00:38:00.822 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:38:00.286+0000 7f520f520800 10 monclient: get_monmap_and_config success 2024-09-12T00:38:00.822 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:38:00.286+0000 7f520f520800 4 set_mon_vals no callback set 2024-09-12T00:38:00.822 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:38:00.286+0000 7f520f520800 10 monclient: shutdown 2024-09-12T00:38:00.822 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:38:00.287+0000 7f520f520800 10 monclient: build_initial_monmap 2024-09-12T00:38:00.822 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:38:00.287+0000 7f520f520800 1 build_initial for_mkfs: 0 2024-09-12T00:38:00.822 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:38:00.287+0000 7f520f520800 10 monclient: monmap: 2024-09-12T00:38:00.822 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:00.823 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:00.823 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:00.823 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:00.823 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:00.823 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.823 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:00.823 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:00.823 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:00.823 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.823 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding auth protocol: cephx 2024-09-12T00:38:00.823 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding auth protocol: cephx 2024-09-12T00:38:00.824 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding auth protocol: cephx 2024-09-12T00:38:00.824 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: secure 2024-09-12T00:38:00.824 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: crc 2024-09-12T00:38:00.824 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: secure 2024-09-12T00:38:00.824 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: crc 2024-09-12T00:38:00.824 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: secure 2024-09-12T00:38:00.824 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: crc 2024-09-12T00:38:00.824 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: crc 2024-09-12T00:38:00.824 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: secure 2024-09-12T00:38:00.824 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: crc 2024-09-12T00:38:00.824 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: secure 2024-09-12T00:38:00.824 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: crc 2024-09-12T00:38:00.825 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: secure 2024-09-12T00:38:00.825 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:38:00.287+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.825 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:38:00.287+0000 7f520f520800 1 librados: starting msgr at 2024-09-12T00:38:00.825 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:38:00.287+0000 7f520f520800 1 librados: starting objecter 2024-09-12T00:38:00.825 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:38:00.287+0000 7f520f520800 5 asok(0x55817edff630) register_command objecter_requests cmddesc objecter_requests hook 0x55817f0c4040 EEXIST 2024-09-12T00:38:00.825 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:38:00.287+0000 7f520f520800 1 librados: setting wanted keys 2024-09-12T00:38:00.825 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:38:00.287+0000 7f520f520800 1 librados: calling monclient init 2024-09-12T00:38:00.825 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:38:00.287+0000 7f520f520800 10 monclient: init 2024-09-12T00:38:00.825 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding auth protocol: cephx 2024-09-12T00:38:00.825 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding auth protocol: cephx 2024-09-12T00:38:00.825 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding auth protocol: cephx 2024-09-12T00:38:00.825 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: secure 2024-09-12T00:38:00.825 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: crc 2024-09-12T00:38:00.825 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: secure 2024-09-12T00:38:00.826 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: crc 2024-09-12T00:38:00.826 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: secure 2024-09-12T00:38:00.826 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: crc 2024-09-12T00:38:00.826 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: crc 2024-09-12T00:38:00.826 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: secure 2024-09-12T00:38:00.826 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: crc 2024-09-12T00:38:00.826 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: secure 2024-09-12T00:38:00.826 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: crc 2024-09-12T00:38:00.826 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: secure 2024-09-12T00:38:00.826 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:38:00.287+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.826 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:38:00.287+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.826 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:38:00.288+0000 7f520f520800 5 asok(0x55817edff630) register_command rotate-key cmddesc rotate-key hook 0x55817f0b5e78 EEXIST 2024-09-12T00:38:00.826 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:00.826 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:38:00.826 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): picked mon.noname-a con 0x55817f0f1ed0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:00.827 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): picked mon.noname-c con 0x55817f0f79e0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:00.827 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): picked mon.noname-b con 0x55817f0e8b00 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:00.827 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.827 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.827 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.827 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:00.827 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): authenticate will time out at 2288.860080s 2024-09-12T00:38:00.827 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): get_auth_request con 0x55817f0f1ed0 auth_method 0 2024-09-12T00:38:00.827 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.827 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.827 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.827 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:38:00.288+0000 7f520ba69640 10 monclient(hunting): get_auth_request con 0x55817f0f79e0 auth_method 0 2024-09-12T00:38:00.827 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:38:00.288+0000 7f520ba69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.828 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:38:00.288+0000 7f520ba69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.828 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:38:00.288+0000 7f520ba69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.828 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.828 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.828 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.828 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:38:00.288+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.828 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:38:00.288+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.828 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:38:00.288+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.828 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:38:00.288+0000 7f520b268640 10 monclient(hunting): get_auth_request con 0x55817f0e8b00 auth_method 0 2024-09-12T00:38:00.828 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:38:00.288+0000 7f520b268640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.828 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:38:00.288+0000 7f520b268640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.828 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:38:00.288+0000 7f520b268640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.829 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): handle_auth_done global_id 8424 payload 824 2024-09-12T00:38:00.829 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient: _finish_hunting 0 2024-09-12T00:38:00.829 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:38:00.288+0000 7f5203fff640 1 monclient: found mon.noname-a 2024-09-12T00:38:00.829 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:38:00.829 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.829 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:00.829 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: dump: 2024-09-12T00:38:00.829 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.829 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.829 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.829 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.829 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.830 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.830 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.830 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.830 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.830 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.830 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: _finish_auth 0 2024-09-12T00:38:00.830 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:38:00.830 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:00.830 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.830 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:00.830 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: dump: 2024-09-12T00:38:00.831 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.831 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.831 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.831 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.831 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.831 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.831 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.831 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.831 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.831 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.831 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:38:00.288+0000 7f520f520800 5 monclient: authenticate success, global_id 8424 2024-09-12T00:38:00.831 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient: _renew_subs 2024-09-12T00:38:00.831 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:38:00.288+0000 7f50eeffd640 4 set_mon_vals no callback set 2024-09-12T00:38:00.832 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:38:00.832 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient: _renew_subs 2024-09-12T00:38:00.832 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:38:00.832 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:38:00.288+0000 7f520f520800 1 librados: init done 2024-09-12T00:38:00.832 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:38:00.289+0000 7f520f520800 5 asok(0x55817edff630) register_command cr dump hook 0x55817f0f07f8 2024-09-12T00:38:00.832 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:38:00.290+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.832 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:38:00.291+0000 7f50ed7fa640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:38:00.832 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:38:00.291+0000 7f50ed7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:00.832 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:38:00.291+0000 7f50ed7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:00.832 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:38:00.291+0000 7f520ba69640 10 monclient: get_auth_request con 0x7f50d40764c0 auth_method 0 2024-09-12T00:38:00.832 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:38:00.291+0000 7f520b268640 10 monclient: get_auth_request con 0x55817f10c900 auth_method 0 2024-09-12T00:38:00.832 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:38:00.292+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.832 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:38:00.292+0000 7f520f520800 20 realm 2024-09-12T00:38:00.833 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:38:00.292+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.833 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:38:00.292+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.833 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:38:00.292+0000 7f520f520800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:00.833 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:38:00.292+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.833 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:38:00.292+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.833 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:38:00.292+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.833 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:38:00.293+0000 7f5203fff640 10 monclient: get_auth_request con 0x55817f110c00 auth_method 0 2024-09-12T00:38:00.833 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:38:00.293+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:00.833 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:38:00.293+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.833 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:38:00.293+0000 7f520ba69640 10 monclient: get_auth_request con 0x55817f114340 auth_method 0 2024-09-12T00:38:00.833 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:38:00.294+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:00.833 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:38:00.294+0000 7f520f520800 20 searching for the correct realm 2024-09-12T00:38:00.834 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:38:00.294+0000 7f520b268640 10 monclient: get_auth_request con 0x7f520406a040 auth_method 0 2024-09-12T00:38:00.834 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:38:00.296+0000 7f5203fff640 10 monclient: get_auth_request con 0x7f51f402f070 auth_method 0 2024-09-12T00:38:00.834 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:38:00.296+0000 7f5203fff640 0 -- 172.21.15.133:0/4032917150 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f51f402f070 msgr2=0x7f51f406c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:00.834 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:38:00.497+0000 7f5203fff640 10 monclient: get_auth_request con 0x7f51f402f070 auth_method 0 2024-09-12T00:38:00.834 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:38:00.499+0000 7f520ba69640 10 monclient: get_auth_request con 0x7f520406a420 auth_method 0 2024-09-12T00:38:00.834 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:38:00.501+0000 7f520b268640 10 monclient: get_auth_request con 0x7f51f406d7c0 auth_method 0 2024-09-12T00:38:00.834 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:38:00.502+0000 7f5203fff640 0 -- 172.21.15.133:0/4032917150 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f51fc0611f0 msgr2=0x7f51fc05fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:00.834 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:38:00.703+0000 7f5203fff640 10 monclient: get_auth_request con 0x7f51fc0611f0 auth_method 0 2024-09-12T00:38:00.834 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:38:00.834 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:38:00.834 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:00.834 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:00.834 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:00.835 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:00.835 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:38:00.709+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.835 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:38:00.709+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.835 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:38:00.709+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.835 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:38:00.709+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:00.835 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:38:00.709+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.835 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:38:00.710+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:00.835 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:38:00.710+0000 7f520f520800 20 zone default found 2024-09-12T00:38:00.835 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:38:00.710+0000 7f520f520800 4 Realm: () 2024-09-12T00:38:00.835 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:38:00.710+0000 7f520f520800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:38:00.835 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:38:00.710+0000 7f520f520800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:38:00.835 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:38:00.710+0000 7f520f520800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:00.835 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:38:00.710+0000 7f520f520800 20 zonegroup default 2024-09-12T00:38:00.835 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:38:00.710+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.836 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:38:00.710+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.836 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:38:00.710+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.836 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:38:00.711+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.836 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:38:00.711+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.836 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:38:00.711+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.836 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:38:00.711+0000 7f520f520800 20 started sync module instance, tier type = 2024-09-12T00:38:00.836 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:38:00.711+0000 7f520f520800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:38:00.836 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=0 2024-09-12T00:38:00.836 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=1 2024-09-12T00:38:00.836 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=2 2024-09-12T00:38:00.836 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=3 2024-09-12T00:38:00.836 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=4 2024-09-12T00:38:00.836 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=5 2024-09-12T00:38:00.837 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=6 2024-09-12T00:38:00.837 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:38:00.723+0000 7f520f520800 20 add_watcher() i=7 2024-09-12T00:38:00.837 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:38:00.723+0000 7f520f520800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:00.837 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding auth protocol: cephx 2024-09-12T00:38:00.837 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding auth protocol: cephx 2024-09-12T00:38:00.837 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding auth protocol: cephx 2024-09-12T00:38:00.837 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: secure 2024-09-12T00:38:00.837 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: crc 2024-09-12T00:38:00.837 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: secure 2024-09-12T00:38:00.837 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: crc 2024-09-12T00:38:00.837 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:38:00.725+0000 7f50c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:00.838 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: secure 2024-09-12T00:38:00.838 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: crc 2024-09-12T00:38:00.838 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: crc 2024-09-12T00:38:00.838 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: secure 2024-09-12T00:38:00.838 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: crc 2024-09-12T00:38:00.838 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: secure 2024-09-12T00:38:00.838 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: crc 2024-09-12T00:38:00.838 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: secure 2024-09-12T00:38:00.838 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:38:00.725+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.838 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:38:00.725+0000 7f520f520800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:00.839 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:38:00.725+0000 7f520f520800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:00.839 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:38:00.725+0000 7f520f520800 5 asok(0x55817edff630) register_command cache list hook 0x55817f0e87e0 2024-09-12T00:38:00.839 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:38:00.725+0000 7f520f520800 5 asok(0x55817edff630) register_command cache inspect hook 0x55817f0e87e0 2024-09-12T00:38:00.839 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:38:00.725+0000 7f520f520800 5 asok(0x55817edff630) register_command cache erase hook 0x55817f0e87e0 2024-09-12T00:38:00.839 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:38:00.726+0000 7f520f520800 5 asok(0x55817edff630) register_command cache zap hook 0x55817f0e87e0 2024-09-12T00:38:00.840 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:38:00.726+0000 7f520f520800 5 note: GC not initialized 2024-09-12T00:38:00.840 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:38:00.726+0000 7f50c17e2640 20 reqs_thread_entry: start 2024-09-12T00:38:00.840 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:38:00.726+0000 7f520f520800 5 asok(0x55817edff630) register_command sync trace show hook 0x7f51f400b620 2024-09-12T00:38:00.840 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:38:00.726+0000 7f520f520800 5 asok(0x55817edff630) register_command sync trace history hook 0x7f51f400b620 2024-09-12T00:38:00.840 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:38:00.726+0000 7f520f520800 5 asok(0x55817edff630) register_command sync trace active hook 0x7f51f400b620 2024-09-12T00:38:00.840 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:38:00.726+0000 7f520f520800 5 asok(0x55817edff630) register_command sync trace active_short hook 0x7f51f400b620 2024-09-12T00:38:00.841 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:38:00.726+0000 7f520f520800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:00.841 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:38:00.726+0000 7f520f520800 20 Filter name: none 2024-09-12T00:38:00.841 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:38:00.726+0000 7f50ba7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:00.841 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:38:00.726+0000 7f520f520800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:38:00.841 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:38:00.726+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.842 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:38:00.727+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:38:00.842 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:38:00.727+0000 7f520f520800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:38:00.842 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:38:00.727+0000 7f520f520800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:38:00.842 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:38:00.727+0000 7f520f520800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:38:00.842 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:38:00.727+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.842 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:38:00.727+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:38:00.843 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:38:00.727+0000 7f520f520800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:00.843 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:38:00.727+0000 7f520f520800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:00.843 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:38:00.727+0000 7f520f520800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:00.843 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:38:00.727+0000 7f520f520800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:00.843 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:38:00.727+0000 7f520f520800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:38:00.843 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:38:00.728+0000 7f520f520800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:38:00.844 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:38:00.733+0000 7f520f520800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:00.844 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:38:00.733+0000 7f520f520800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:00.844 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:38:00.733+0000 7f520f520800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:00.844 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:38:00.733+0000 7f520f520800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:38:00.844 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:38:00.733+0000 7f50ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497082 cookie 94014671013216 notifier 8424 bl.length()=911 2024-09-12T00:38:00.845 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:38:00.733+0000 7f50ee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:00.845 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:38:00.733+0000 7f50ee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:00.845 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:38:00.733+0000 7f50ee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:00.845 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:38:00.735+0000 7f520f520800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:38:00.845 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:38:00.735+0000 7f520f520800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:38:00.845 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:38:00.735+0000 7f520f520800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:38:00.846 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:38:00.735+0000 7f520f520800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:38:00.846 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:38:00.738+0000 7f520f520800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f520f520800 time 2024-09-12T00:38:00.738935+0000 2024-09-12T00:38:00.846 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:00.846 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.846 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:00.847 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5210d8c71a] 2024-09-12T00:38:00.847 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5210d8c8d8] 2024-09-12T00:38:00.847 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55817cd78641] 2024-09-12T00:38:00.847 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd8854c) [0x55817d28b54c] 2024-09-12T00:38:00.847 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55817cd8831d] 2024-09-12T00:38:00.848 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:38:00.848 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f520fa29590] 2024-09-12T00:38:00.848 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:38:00.848 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:38:00.848 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.848 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:38:00.739+0000 7f520f520800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:00.849 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f520f520800 thread_name:radosgw-admin 2024-09-12T00:38:00.849 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.849 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:00.849 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f520fa3e6f0] 2024-09-12T00:38:00.849 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f520fa8b99c] 2024-09-12T00:38:00.849 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:38:00.850 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:38:00.850 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5210d8c774] 2024-09-12T00:38:00.850 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5210d8c8d8] 2024-09-12T00:38:00.850 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55817cd78641] 2024-09-12T00:38:00.850 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd8854c) [0x55817d28b54c] 2024-09-12T00:38:00.850 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55817cd8831d] 2024-09-12T00:38:00.851 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:38:00.851 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f520fa29590] 2024-09-12T00:38:00.851 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:38:00.851 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:38:00.851 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:00.851 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.852 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:38:00.852 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:38:00.852 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:38:00.852 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:38:00.852 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:38:00.852 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:38:00.853 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:38:00.853 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:38:00.853 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:38:00.853 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:38:00.853 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:38:00.854 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:38:00.854 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:38:00.854 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:38:00.854 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:38:00.854 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:38:00.854 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:38:00.855 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:38:00.855 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:38:00.855 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:38:00.855 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:38:00.855 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:38:00.856 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:38:00.856 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:38:00.856 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:38:00.856 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:38:00.856 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:38:00.856 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:38:00.856 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:38:00.856 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:38:00.857 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:38:00.857 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:38:00.857 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:38:00.857 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:38:00.857 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:38:00.857 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:38:00.857 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:38:00.857 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:38:00.857 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:38:00.857 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:38:00.857 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:38:00.857 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:38:00.857 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:38:00.858 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:38:00.858 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:38:00.858 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:38:00.858 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:38:00.858 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:38:00.858 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:38:00.858 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:38:00.858 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:38:00.858 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:38:00.858 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:38:00.858 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:38:00.858 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:38:00.859 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:38:00.859 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:38:00.859 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:38:00.859 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:38:00.859 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:38:00.859 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:38:00.859 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:38:00.859 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:38:00.859 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:38:00.859 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:38:00.859 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:38:00.859 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:38:00.859 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:38:00.859 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:38:00.859 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:38:00.860 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:38:00.860 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:38:00.860 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:38:00.860 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:38:00.860 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:38:00.860 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:38:00.860 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:38:00.860 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:38:00.860 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:38:00.860 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:38:00.860 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:38:00.860 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:38:00.860 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:38:00.861 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:38:00.861 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:38:00.861 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:38:00.861 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:38:00.861 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:38:00.861 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:38:00.861 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:38:00.861 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:38:00.861 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:38:00.861 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:38:00.861 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:38:00.861 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50ba7fc640 / http_manager 2024-09-12T00:38:00.861 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50c17e2640 / http_manager 2024-09-12T00:38:00.861 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50c27e4640 / rgw_dt_lg_renew 2024-09-12T00:38:00.862 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50ed7fa640 / ms_dispatch 2024-09-12T00:38:00.862 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50ee7fc640 / io_context_pool 2024-09-12T00:38:00.862 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50eeffd640 / io_context_pool 2024-09-12T00:38:00.864 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50f5602640 / ms_dispatch 2024-09-12T00:38:00.864 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50f7e07640 / ms_dispatch 2024-09-12T00:38:00.864 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50f960a640 / io_context_pool 2024-09-12T00:38:00.864 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5203fff640 / msgr-worker-2 2024-09-12T00:38:00.864 INFO:tasks.workunit.client.0.smithi133.stderr: 7f520b268640 / msgr-worker-1 2024-09-12T00:38:00.864 INFO:tasks.workunit.client.0.smithi133.stderr: 7f520ba69640 / msgr-worker-0 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi133.stderr: 7f520c26a640 / io_context_pool 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi133.stderr: 7f520f520800 / radosgw-admin 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/log/ceph/ceph-client.admin.154769.log 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:38:00.271+0000 7f50f960a640 10 monclient: dump: 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.865 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.866 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.866 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.866 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.866 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.866 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.866 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:38:00.271+0000 7f520f520800 5 monclient: authenticate success, global_id 7880 2024-09-12T00:38:00.866 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:38:00.271+0000 7f520f520800 10 monclient: get_monmap_and_config success 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:38:00.271+0000 7f520f520800 4 set_mon_vals no callback set 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:38:00.271+0000 7f520f520800 10 monclient: shutdown 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:38:00.271+0000 7f520f520800 5 asok(0x55817edff630) unregister_commands rotate-key 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:38:00.272+0000 7f520f520800 10 monclient: build_initial_monmap 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:38:00.272+0000 7f520f520800 1 build_initial for_mkfs: 0 2024-09-12T00:38:00.867 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:38:00.272+0000 7f520f520800 10 monclient: monmap: 2024-09-12T00:38:00.868 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:00.868 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:00.868 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:00.868 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:00.868 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:00.868 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.868 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:00.868 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:00.868 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:00.868 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.869 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding auth protocol: cephx 2024-09-12T00:38:00.869 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding auth protocol: cephx 2024-09-12T00:38:00.869 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding auth protocol: cephx 2024-09-12T00:38:00.869 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: secure 2024-09-12T00:38:00.869 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: crc 2024-09-12T00:38:00.869 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: secure 2024-09-12T00:38:00.869 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: crc 2024-09-12T00:38:00.869 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: secure 2024-09-12T00:38:00.869 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: crc 2024-09-12T00:38:00.869 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: crc 2024-09-12T00:38:00.869 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: secure 2024-09-12T00:38:00.869 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: crc 2024-09-12T00:38:00.870 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: secure 2024-09-12T00:38:00.870 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: crc 2024-09-12T00:38:00.870 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f024950) adding con mode: secure 2024-09-12T00:38:00.870 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:38:00.272+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.870 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:38:00.272+0000 7f520f520800 1 librados: starting msgr at 2024-09-12T00:38:00.870 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:38:00.272+0000 7f520f520800 1 librados: starting objecter 2024-09-12T00:38:00.870 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:38:00.272+0000 7f520f520800 5 asok(0x55817edff630) register_command objecter_requests hook 0x55817f050aa0 2024-09-12T00:38:00.870 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:38:00.272+0000 7f520f520800 1 librados: setting wanted keys 2024-09-12T00:38:00.870 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:38:00.272+0000 7f520f520800 1 librados: calling monclient init 2024-09-12T00:38:00.870 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:38:00.272+0000 7f520f520800 10 monclient: init 2024-09-12T00:38:00.870 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding auth protocol: cephx 2024-09-12T00:38:00.870 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding auth protocol: cephx 2024-09-12T00:38:00.871 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding auth protocol: cephx 2024-09-12T00:38:00.871 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: secure 2024-09-12T00:38:00.871 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: crc 2024-09-12T00:38:00.871 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: secure 2024-09-12T00:38:00.871 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: crc 2024-09-12T00:38:00.871 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: secure 2024-09-12T00:38:00.871 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: crc 2024-09-12T00:38:00.871 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: crc 2024-09-12T00:38:00.871 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: secure 2024-09-12T00:38:00.871 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: crc 2024-09-12T00:38:00.871 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: secure 2024-09-12T00:38:00.872 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: crc 2024-09-12T00:38:00.872 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:38:00.272+0000 7f520f520800 5 AuthRegistry(0x55817f01eca0) adding con mode: secure 2024-09-12T00:38:00.872 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:38:00.272+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.872 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:38:00.273+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.872 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:38:00.273+0000 7f520f520800 5 asok(0x55817edff630) register_command rotate-key hook 0x55817f01ede8 2024-09-12T00:38:00.872 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:00.872 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:38:00.872 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): picked mon.noname-c con 0x55817eed6da0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:00.872 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): picked mon.noname-b con 0x55817ef620d0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:00.872 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): picked mon.noname-a con 0x55817ef68420 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:00.872 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.872 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.872 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.873 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:00.873 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient(hunting): authenticate will time out at 2288.845205s 2024-09-12T00:38:00.873 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): get_auth_request con 0x55817eed6da0 auth_method 0 2024-09-12T00:38:00.873 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.873 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.873 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.873 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:38:00.273+0000 7f520ba69640 10 monclient(hunting): get_auth_request con 0x55817ef68420 auth_method 0 2024-09-12T00:38:00.873 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:38:00.273+0000 7f520ba69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.873 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:38:00.273+0000 7f520ba69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.873 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:38:00.273+0000 7f520ba69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.873 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.873 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.874 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.874 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:38:00.273+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.874 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:38:00.273+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.874 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:38:00.273+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.874 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:38:00.273+0000 7f5203fff640 10 monclient(hunting): get_auth_request con 0x55817ef620d0 auth_method 0 2024-09-12T00:38:00.874 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:38:00.273+0000 7f5203fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.874 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:38:00.273+0000 7f5203fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.874 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:38:00.273+0000 7f5203fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.874 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:38:00.273+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.874 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:38:00.273+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.874 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:38:00.273+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.874 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient(hunting): handle_auth_done global_id 7883 payload 824 2024-09-12T00:38:00.874 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient: _finish_hunting 0 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:38:00.273+0000 7f520b268640 1 monclient: found mon.noname-c 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:38:00.273+0000 7f520b268640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: dump: 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.875 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: _finish_auth 0 2024-09-12T00:38:00.876 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: _check_auth_tickets 2024-09-12T00:38:00.876 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:38:00.273+0000 7f520f520800 5 monclient: authenticate success, global_id 7883 2024-09-12T00:38:00.876 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:00.876 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.876 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:00.876 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:38:00.273+0000 7f50f7e07640 10 monclient: dump: 2024-09-12T00:38:00.876 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.876 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.876 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.876 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.876 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.876 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.876 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.877 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.877 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.877 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.877 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient: _renew_subs 2024-09-12T00:38:00.877 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:38:00.273+0000 7f520f520800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:38:00.877 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:38:00.273+0000 7f50f960a640 4 set_mon_vals no callback set 2024-09-12T00:38:00.877 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:38:00.274+0000 7f520f520800 10 monclient: _renew_subs 2024-09-12T00:38:00.877 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:38:00.274+0000 7f520f520800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:38:00.877 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:38:00.274+0000 7f520f520800 1 librados: init done 2024-09-12T00:38:00.877 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:38:00.276+0000 7f50f7e07640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:38:00.877 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:38:00.276+0000 7f50f7e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:00.877 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:38:00.276+0000 7f50f7e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:00.877 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:38:00.276+0000 7f5203fff640 10 monclient: get_auth_request con 0x7f50f00764a0 auth_method 0 2024-09-12T00:38:00.877 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:38:00.276+0000 7f520ba69640 10 monclient: get_auth_request con 0x55817f0478a0 auth_method 0 2024-09-12T00:38:00.878 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:38:00.277+0000 7f520b268640 10 monclient: get_auth_request con 0x55817f069f80 auth_method 0 2024-09-12T00:38:00.878 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:38:00.278+0000 7f5203fff640 10 monclient: get_auth_request con 0x55817f06e730 auth_method 0 2024-09-12T00:38:00.878 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:38:00.279+0000 7f520ba69640 10 monclient: get_auth_request con 0x55817f072760 auth_method 0 2024-09-12T00:38:00.878 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:38:00.280+0000 7f520f520800 10 monclient: build_initial_monmap 2024-09-12T00:38:00.878 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:38:00.280+0000 7f520f520800 1 build_initial for_mkfs: 0 2024-09-12T00:38:00.878 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:38:00.280+0000 7f520f520800 10 monclient: monmap: 2024-09-12T00:38:00.878 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:00.878 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:00.878 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:00.878 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:00.878 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:00.878 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.878 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:00.878 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:00.878 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:00.879 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.879 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding auth protocol: cephx 2024-09-12T00:38:00.879 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding auth protocol: cephx 2024-09-12T00:38:00.879 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding auth protocol: cephx 2024-09-12T00:38:00.879 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: secure 2024-09-12T00:38:00.879 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: crc 2024-09-12T00:38:00.879 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: secure 2024-09-12T00:38:00.879 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: crc 2024-09-12T00:38:00.880 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: secure 2024-09-12T00:38:00.880 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: crc 2024-09-12T00:38:00.880 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: crc 2024-09-12T00:38:00.880 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: secure 2024-09-12T00:38:00.880 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: crc 2024-09-12T00:38:00.880 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: secure 2024-09-12T00:38:00.880 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: crc 2024-09-12T00:38:00.880 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:38:00.280+0000 7f520f520800 5 AuthRegistry(0x55817f0768a0) adding con mode: secure 2024-09-12T00:38:00.880 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:38:00.280+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.881 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:38:00.280+0000 7f520f520800 5 asok(0x55817edff630) register_command objecter_requests cmddesc objecter_requests hook 0x55817f07a290 EEXIST 2024-09-12T00:38:00.881 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient: init 2024-09-12T00:38:00.881 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding auth protocol: cephx 2024-09-12T00:38:00.881 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding auth protocol: cephx 2024-09-12T00:38:00.881 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding auth protocol: cephx 2024-09-12T00:38:00.881 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: secure 2024-09-12T00:38:00.881 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: crc 2024-09-12T00:38:00.881 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: secure 2024-09-12T00:38:00.881 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: crc 2024-09-12T00:38:00.881 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: secure 2024-09-12T00:38:00.881 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: crc 2024-09-12T00:38:00.881 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: crc 2024-09-12T00:38:00.881 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: secure 2024-09-12T00:38:00.882 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: crc 2024-09-12T00:38:00.882 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: secure 2024-09-12T00:38:00.882 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: crc 2024-09-12T00:38:00.882 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:38:00.281+0000 7f520f520800 5 AuthRegistry(0x55817f075798) adding con mode: secure 2024-09-12T00:38:00.882 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:38:00.281+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.882 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:38:00.281+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.882 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:38:00.281+0000 7f520f520800 5 asok(0x55817edff630) register_command rotate-key cmddesc rotate-key hook 0x55817f0758e0 EEXIST 2024-09-12T00:38:00.882 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:00.882 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:38:00.882 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): picked mon.noname-a con 0x55817f09df80 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:00.882 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): picked mon.noname-c con 0x55817f0a0250 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:00.882 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): picked mon.noname-b con 0x55817f09c750 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:00.882 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.882 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.883 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.883 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:00.883 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:38:00.281+0000 7f520f520800 10 monclient(hunting): authenticate will time out at 2288.853615s 2024-09-12T00:38:00.883 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): get_auth_request con 0x55817f0a0250 auth_method 0 2024-09-12T00:38:00.883 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.883 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.883 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.883 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:38:00.281+0000 7f5203fff640 10 monclient(hunting): get_auth_request con 0x55817f09df80 auth_method 0 2024-09-12T00:38:00.883 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:38:00.281+0000 7f5203fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.883 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:38:00.281+0000 7f5203fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.883 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:38:00.281+0000 7f5203fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.883 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:38:00.281+0000 7f520b268640 10 monclient(hunting): get_auth_request con 0x55817f09c750 auth_method 0 2024-09-12T00:38:00.883 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:38:00.281+0000 7f520b268640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.883 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:38:00.281+0000 7f520b268640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.884 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:38:00.281+0000 7f520b268640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.884 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.884 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.884 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.884 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:38:00.281+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.884 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:38:00.281+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.884 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:38:00.281+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.884 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:38:00.281+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.884 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:38:00.281+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.884 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:38:00.281+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.884 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:38:00.281+0000 7f520ba69640 10 monclient(hunting): handle_auth_done global_id 7886 payload 824 2024-09-12T00:38:00.884 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:38:00.282+0000 7f520ba69640 10 monclient: _finish_hunting 0 2024-09-12T00:38:00.884 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:38:00.282+0000 7f520ba69640 1 monclient: found mon.noname-c 2024-09-12T00:38:00.884 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:38:00.282+0000 7f520ba69640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:38:00.885 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.885 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:00.885 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: dump: 2024-09-12T00:38:00.885 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.885 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.885 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.885 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.885 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.885 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.885 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.885 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.885 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.885 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.885 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: _finish_auth 0 2024-09-12T00:38:00.886 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: _check_auth_tickets 2024-09-12T00:38:00.886 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:00.886 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.886 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:00.886 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:38:00.282+0000 7f50f5602640 10 monclient: dump: 2024-09-12T00:38:00.886 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.886 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.886 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.886 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.886 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.886 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.886 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.886 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.886 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.886 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.887 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:38:00.282+0000 7f520f520800 5 monclient: authenticate success, global_id 7886 2024-09-12T00:38:00.887 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:38:00.282+0000 7f520f520800 10 monclient: _renew_subs 2024-09-12T00:38:00.887 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:38:00.282+0000 7f520f520800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:38:00.887 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:38:00.282+0000 7f520c26a640 4 set_mon_vals no callback set 2024-09-12T00:38:00.887 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:38:00.282+0000 7f520f520800 10 monclient: _renew_subs 2024-09-12T00:38:00.887 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:38:00.282+0000 7f520f520800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:38:00.887 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:38:00.284+0000 7f50f5602640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:38:00.887 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:38:00.284+0000 7f50f5602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:00.887 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:38:00.284+0000 7f50f5602640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:00.887 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:38:00.284+0000 7f5203fff640 10 monclient: get_auth_request con 0x7f50e4076380 auth_method 0 2024-09-12T00:38:00.887 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:38:00.284+0000 7f520f520800 10 monclient: get_monmap_and_config 2024-09-12T00:38:00.888 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:38:00.284+0000 7f520f520800 10 monclient: build_initial_monmap 2024-09-12T00:38:00.888 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:38:00.284+0000 7f520f520800 1 build_initial for_mkfs: 0 2024-09-12T00:38:00.888 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:38:00.284+0000 7f520f520800 10 monclient: monmap: 2024-09-12T00:38:00.888 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:00.888 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:00.888 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:00.888 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:00.888 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:00.888 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.888 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:00.888 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:00.888 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:00.889 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.889 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding auth protocol: cephx 2024-09-12T00:38:00.889 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding auth protocol: cephx 2024-09-12T00:38:00.889 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding auth protocol: cephx 2024-09-12T00:38:00.889 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: secure 2024-09-12T00:38:00.889 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: crc 2024-09-12T00:38:00.889 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: secure 2024-09-12T00:38:00.889 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: crc 2024-09-12T00:38:00.889 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: secure 2024-09-12T00:38:00.889 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: crc 2024-09-12T00:38:00.889 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: crc 2024-09-12T00:38:00.889 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: secure 2024-09-12T00:38:00.889 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: crc 2024-09-12T00:38:00.890 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: secure 2024-09-12T00:38:00.890 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: crc 2024-09-12T00:38:00.890 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:38:00.284+0000 7f520f520800 5 AuthRegistry(0x55817f0bdb80) adding con mode: secure 2024-09-12T00:38:00.890 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:38:00.285+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.890 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient: init 2024-09-12T00:38:00.890 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding auth protocol: cephx 2024-09-12T00:38:00.890 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding auth protocol: cephx 2024-09-12T00:38:00.890 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding auth protocol: cephx 2024-09-12T00:38:00.890 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: secure 2024-09-12T00:38:00.890 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: crc 2024-09-12T00:38:00.890 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: secure 2024-09-12T00:38:00.890 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: crc 2024-09-12T00:38:00.890 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: secure 2024-09-12T00:38:00.890 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: crc 2024-09-12T00:38:00.891 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: crc 2024-09-12T00:38:00.891 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: secure 2024-09-12T00:38:00.891 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: crc 2024-09-12T00:38:00.891 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: secure 2024-09-12T00:38:00.891 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: crc 2024-09-12T00:38:00.891 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:38:00.285+0000 7f520f520800 5 AuthRegistry(0x7ffdd157d540) adding con mode: secure 2024-09-12T00:38:00.891 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:38:00.285+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.891 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:38:00.285+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.891 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:38:00.285+0000 7f520f520800 5 asok(0x55817edff630) register_command rotate-key cmddesc rotate-key hook 0x7ffdd157d688 EEXIST 2024-09-12T00:38:00.892 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:00.892 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:38:00.892 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): picked mon.noname-b con 0x55817f0f1ed0 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:00.892 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): picked mon.noname-c con 0x55817f0f22b0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:00.892 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): picked mon.noname-a con 0x55817f0f79e0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:00.892 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.893 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.893 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.893 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:00.893 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:38:00.285+0000 7f520f520800 10 monclient(hunting): authenticate will time out at 2288.857721s 2024-09-12T00:38:00.894 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:38:00.285+0000 7f520ba69640 10 monclient(hunting): get_auth_request con 0x55817f0f22b0 auth_method 0 2024-09-12T00:38:00.894 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:38:00.285+0000 7f520ba69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.894 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:38:00.285+0000 7f520ba69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.894 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:38:00.285+0000 7f520ba69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.894 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:38:00.285+0000 7f520b268640 10 monclient(hunting): get_auth_request con 0x55817f0f79e0 auth_method 0 2024-09-12T00:38:00.894 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:38:00.285+0000 7f520b268640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.895 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:38:00.285+0000 7f520b268640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.895 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:38:00.285+0000 7f520b268640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.895 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:38:00.285+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.895 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:38:00.285+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.895 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:38:00.285+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.895 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:38:00.285+0000 7f5203fff640 10 monclient(hunting): get_auth_request con 0x55817f0f1ed0 auth_method 0 2024-09-12T00:38:00.896 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:38:00.285+0000 7f5203fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.896 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:38:00.285+0000 7f5203fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.896 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:38:00.285+0000 7f5203fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.896 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:38:00.285+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.896 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:38:00.285+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.896 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:38:00.285+0000 7f520b268640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.897 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:38:00.286+0000 7f520ba69640 10 monclient(hunting): handle_auth_done global_id 7889 payload 274 2024-09-12T00:38:00.897 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:38:00.286+0000 7f520ba69640 10 monclient: _finish_hunting 0 2024-09-12T00:38:00.897 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:38:00.286+0000 7f520ba69640 1 monclient: found mon.noname-c 2024-09-12T00:38:00.897 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:38:00.286+0000 7f520ba69640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:38:00.897 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.897 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:00.898 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: dump: 2024-09-12T00:38:00.898 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.898 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.898 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.898 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.898 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.899 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.899 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.899 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.899 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.899 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.900 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: _finish_auth 0 2024-09-12T00:38:00.900 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: _check_auth_tickets 2024-09-12T00:38:00.900 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:00.900 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.900 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:00.900 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:38:00.286+0000 7f50eeffd640 10 monclient: dump: 2024-09-12T00:38:00.901 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.901 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.901 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.901 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.901 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.902 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.902 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.902 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.902 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.902 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.902 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:38:00.286+0000 7f520f520800 5 monclient: authenticate success, global_id 7889 2024-09-12T00:38:00.903 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:38:00.286+0000 7f520f520800 10 monclient: get_monmap_and_config success 2024-09-12T00:38:00.903 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:38:00.286+0000 7f520f520800 4 set_mon_vals no callback set 2024-09-12T00:38:00.903 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:38:00.286+0000 7f520f520800 10 monclient: shutdown 2024-09-12T00:38:00.903 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:38:00.287+0000 7f520f520800 10 monclient: build_initial_monmap 2024-09-12T00:38:00.903 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:38:00.287+0000 7f520f520800 1 build_initial for_mkfs: 0 2024-09-12T00:38:00.903 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:38:00.287+0000 7f520f520800 10 monclient: monmap: 2024-09-12T00:38:00.904 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:00.904 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:00.904 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:00.904 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:00.904 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:00.904 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.905 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:00.905 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:00.905 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:00.905 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.905 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding auth protocol: cephx 2024-09-12T00:38:00.905 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding auth protocol: cephx 2024-09-12T00:38:00.906 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding auth protocol: cephx 2024-09-12T00:38:00.906 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: secure 2024-09-12T00:38:00.906 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: crc 2024-09-12T00:38:00.906 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: secure 2024-09-12T00:38:00.906 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: crc 2024-09-12T00:38:00.906 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: secure 2024-09-12T00:38:00.907 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: crc 2024-09-12T00:38:00.907 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: crc 2024-09-12T00:38:00.907 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: secure 2024-09-12T00:38:00.907 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: crc 2024-09-12T00:38:00.907 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: secure 2024-09-12T00:38:00.907 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: crc 2024-09-12T00:38:00.908 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0c1660) adding con mode: secure 2024-09-12T00:38:00.908 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:38:00.287+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.908 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:38:00.287+0000 7f520f520800 1 librados: starting msgr at 2024-09-12T00:38:00.908 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:38:00.287+0000 7f520f520800 1 librados: starting objecter 2024-09-12T00:38:00.908 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:38:00.287+0000 7f520f520800 5 asok(0x55817edff630) register_command objecter_requests cmddesc objecter_requests hook 0x55817f0c4040 EEXIST 2024-09-12T00:38:00.908 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:38:00.287+0000 7f520f520800 1 librados: setting wanted keys 2024-09-12T00:38:00.909 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:38:00.287+0000 7f520f520800 1 librados: calling monclient init 2024-09-12T00:38:00.909 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:38:00.287+0000 7f520f520800 10 monclient: init 2024-09-12T00:38:00.909 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding auth protocol: cephx 2024-09-12T00:38:00.909 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding auth protocol: cephx 2024-09-12T00:38:00.909 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding auth protocol: cephx 2024-09-12T00:38:00.910 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: secure 2024-09-12T00:38:00.910 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: crc 2024-09-12T00:38:00.910 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: secure 2024-09-12T00:38:00.910 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: crc 2024-09-12T00:38:00.910 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: secure 2024-09-12T00:38:00.910 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: crc 2024-09-12T00:38:00.911 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: crc 2024-09-12T00:38:00.911 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: secure 2024-09-12T00:38:00.911 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: crc 2024-09-12T00:38:00.911 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: secure 2024-09-12T00:38:00.911 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: crc 2024-09-12T00:38:00.911 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:38:00.287+0000 7f520f520800 5 AuthRegistry(0x55817f0b5d30) adding con mode: secure 2024-09-12T00:38:00.912 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:38:00.287+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.912 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:38:00.287+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.912 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:38:00.288+0000 7f520f520800 5 asok(0x55817edff630) register_command rotate-key cmddesc rotate-key hook 0x55817f0b5e78 EEXIST 2024-09-12T00:38:00.912 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:00.912 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:38:00.913 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): picked mon.noname-a con 0x55817f0f1ed0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:00.913 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): picked mon.noname-c con 0x55817f0f79e0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:00.913 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): picked mon.noname-b con 0x55817f0e8b00 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:00.913 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.913 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.914 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:00.914 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:00.914 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient(hunting): authenticate will time out at 2288.860080s 2024-09-12T00:38:00.914 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): get_auth_request con 0x55817f0f1ed0 auth_method 0 2024-09-12T00:38:00.914 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.914 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.915 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.915 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:38:00.288+0000 7f520ba69640 10 monclient(hunting): get_auth_request con 0x55817f0f79e0 auth_method 0 2024-09-12T00:38:00.915 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:38:00.288+0000 7f520ba69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.915 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:38:00.288+0000 7f520ba69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.915 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:38:00.288+0000 7f520ba69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.915 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.916 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.916 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.916 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:38:00.288+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:00.916 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:38:00.288+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:00.916 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:38:00.288+0000 7f520ba69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:00.917 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:38:00.288+0000 7f520b268640 10 monclient(hunting): get_auth_request con 0x55817f0e8b00 auth_method 0 2024-09-12T00:38:00.917 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:38:00.288+0000 7f520b268640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:00.917 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:38:00.288+0000 7f520b268640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:00.917 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:38:00.288+0000 7f520b268640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:00.917 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient(hunting): handle_auth_done global_id 8424 payload 824 2024-09-12T00:38:00.917 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient: _finish_hunting 0 2024-09-12T00:38:00.918 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:38:00.288+0000 7f5203fff640 1 monclient: found mon.noname-a 2024-09-12T00:38:00.918 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:38:00.288+0000 7f5203fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:38:00.918 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.918 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:00.918 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: dump: 2024-09-12T00:38:00.918 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.919 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.919 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.919 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.919 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.919 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.919 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.920 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.920 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.920 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.920 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: _finish_auth 0 2024-09-12T00:38:00.920 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:38:00.920 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:00.921 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:00.921 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:00.921 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:38:00.288+0000 7f50ed7fa640 10 monclient: dump: 2024-09-12T00:38:00.921 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:00.921 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:00.921 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.922 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:00.922 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:00.922 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:00.922 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:00.922 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:00.922 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:00.923 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.923 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:38:00.288+0000 7f520f520800 5 monclient: authenticate success, global_id 8424 2024-09-12T00:38:00.923 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient: _renew_subs 2024-09-12T00:38:00.923 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:38:00.288+0000 7f50eeffd640 4 set_mon_vals no callback set 2024-09-12T00:38:00.923 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:38:00.924 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient: _renew_subs 2024-09-12T00:38:00.924 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:38:00.288+0000 7f520f520800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:38:00.924 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:38:00.288+0000 7f520f520800 1 librados: init done 2024-09-12T00:38:00.924 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:38:00.289+0000 7f520f520800 5 asok(0x55817edff630) register_command cr dump hook 0x55817f0f07f8 2024-09-12T00:38:00.924 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:38:00.290+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.925 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:38:00.291+0000 7f50ed7fa640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:38:00.925 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:38:00.291+0000 7f50ed7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:00.925 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:38:00.291+0000 7f50ed7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:00.925 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:38:00.291+0000 7f520ba69640 10 monclient: get_auth_request con 0x7f50d40764c0 auth_method 0 2024-09-12T00:38:00.925 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:38:00.291+0000 7f520b268640 10 monclient: get_auth_request con 0x55817f10c900 auth_method 0 2024-09-12T00:38:00.925 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:38:00.292+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.926 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:38:00.292+0000 7f520f520800 20 realm 2024-09-12T00:38:00.926 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:38:00.292+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.926 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:38:00.292+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.926 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:38:00.292+0000 7f520f520800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:00.926 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:38:00.292+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.927 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:38:00.292+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.927 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:38:00.292+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.927 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:38:00.293+0000 7f5203fff640 10 monclient: get_auth_request con 0x55817f110c00 auth_method 0 2024-09-12T00:38:00.927 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:38:00.293+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:00.927 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:38:00.293+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.927 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:38:00.293+0000 7f520ba69640 10 monclient: get_auth_request con 0x55817f114340 auth_method 0 2024-09-12T00:38:00.928 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:38:00.294+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:00.928 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:38:00.294+0000 7f520f520800 20 searching for the correct realm 2024-09-12T00:38:00.928 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:38:00.294+0000 7f520b268640 10 monclient: get_auth_request con 0x7f520406a040 auth_method 0 2024-09-12T00:38:00.928 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:38:00.296+0000 7f5203fff640 10 monclient: get_auth_request con 0x7f51f402f070 auth_method 0 2024-09-12T00:38:00.928 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:38:00.296+0000 7f5203fff640 0 -- 172.21.15.133:0/4032917150 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f51f402f070 msgr2=0x7f51f406c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:00.928 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:38:00.497+0000 7f5203fff640 10 monclient: get_auth_request con 0x7f51f402f070 auth_method 0 2024-09-12T00:38:00.929 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:38:00.499+0000 7f520ba69640 10 monclient: get_auth_request con 0x7f520406a420 auth_method 0 2024-09-12T00:38:00.929 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:38:00.501+0000 7f520b268640 10 monclient: get_auth_request con 0x7f51f406d7c0 auth_method 0 2024-09-12T00:38:00.929 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:38:00.502+0000 7f5203fff640 0 -- 172.21.15.133:0/4032917150 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f51fc0611f0 msgr2=0x7f51fc05fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:00.929 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:38:00.703+0000 7f5203fff640 10 monclient: get_auth_request con 0x7f51fc0611f0 auth_method 0 2024-09-12T00:38:00.929 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:38:00.930 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:38:00.930 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:00.930 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:00.930 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:00.930 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:38:00.709+0000 7f520f520800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:00.931 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:38:00.709+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.931 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:38:00.709+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.931 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:38:00.709+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.931 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:38:00.709+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:00.931 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:38:00.709+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.932 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:38:00.710+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:00.932 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:38:00.710+0000 7f520f520800 20 zone default found 2024-09-12T00:38:00.932 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:38:00.710+0000 7f520f520800 4 Realm: () 2024-09-12T00:38:00.932 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:38:00.710+0000 7f520f520800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:38:00.932 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:38:00.710+0000 7f520f520800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:38:00.933 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:38:00.710+0000 7f520f520800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:00.933 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:38:00.710+0000 7f520f520800 20 zonegroup default 2024-09-12T00:38:00.933 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:38:00.710+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.933 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:38:00.710+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.933 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:38:00.710+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.933 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:38:00.711+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.934 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:38:00.711+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.934 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:38:00.711+0000 7f520f520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.934 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:38:00.711+0000 7f520f520800 20 started sync module instance, tier type = 2024-09-12T00:38:00.934 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:38:00.711+0000 7f520f520800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:38:00.934 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=0 2024-09-12T00:38:00.934 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=1 2024-09-12T00:38:00.934 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=2 2024-09-12T00:38:00.934 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=3 2024-09-12T00:38:00.935 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=4 2024-09-12T00:38:00.935 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=5 2024-09-12T00:38:00.935 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:38:00.722+0000 7f520f520800 20 add_watcher() i=6 2024-09-12T00:38:00.935 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:38:00.723+0000 7f520f520800 20 add_watcher() i=7 2024-09-12T00:38:00.935 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:38:00.723+0000 7f520f520800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:00.935 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding auth protocol: cephx 2024-09-12T00:38:00.935 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding auth protocol: cephx 2024-09-12T00:38:00.936 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding auth protocol: cephx 2024-09-12T00:38:00.936 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: secure 2024-09-12T00:38:00.936 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: crc 2024-09-12T00:38:00.936 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: secure 2024-09-12T00:38:00.936 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: crc 2024-09-12T00:38:00.936 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:38:00.725+0000 7f50c27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:00.936 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: secure 2024-09-12T00:38:00.936 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: crc 2024-09-12T00:38:00.937 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: crc 2024-09-12T00:38:00.937 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: secure 2024-09-12T00:38:00.937 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: crc 2024-09-12T00:38:00.937 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: secure 2024-09-12T00:38:00.937 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: crc 2024-09-12T00:38:00.937 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:38:00.725+0000 7f520f520800 5 AuthRegistry(0x7ffdd157da20) adding con mode: secure 2024-09-12T00:38:00.937 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:38:00.725+0000 7f520f520800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:00.937 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:38:00.725+0000 7f520f520800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:00.938 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:38:00.725+0000 7f520f520800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:00.938 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:38:00.725+0000 7f520f520800 5 asok(0x55817edff630) register_command cache list hook 0x55817f0e87e0 2024-09-12T00:38:00.938 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:38:00.725+0000 7f520f520800 5 asok(0x55817edff630) register_command cache inspect hook 0x55817f0e87e0 2024-09-12T00:38:00.938 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:38:00.725+0000 7f520f520800 5 asok(0x55817edff630) register_command cache erase hook 0x55817f0e87e0 2024-09-12T00:38:00.938 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:38:00.726+0000 7f520f520800 5 asok(0x55817edff630) register_command cache zap hook 0x55817f0e87e0 2024-09-12T00:38:00.938 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:38:00.726+0000 7f520f520800 5 note: GC not initialized 2024-09-12T00:38:00.938 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:38:00.726+0000 7f50c17e2640 20 reqs_thread_entry: start 2024-09-12T00:38:00.939 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:38:00.726+0000 7f520f520800 5 asok(0x55817edff630) register_command sync trace show hook 0x7f51f400b620 2024-09-12T00:38:00.939 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:38:00.726+0000 7f520f520800 5 asok(0x55817edff630) register_command sync trace history hook 0x7f51f400b620 2024-09-12T00:38:00.939 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:38:00.726+0000 7f520f520800 5 asok(0x55817edff630) register_command sync trace active hook 0x7f51f400b620 2024-09-12T00:38:00.939 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:38:00.726+0000 7f520f520800 5 asok(0x55817edff630) register_command sync trace active_short hook 0x7f51f400b620 2024-09-12T00:38:00.939 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:38:00.726+0000 7f520f520800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:00.939 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:38:00.726+0000 7f520f520800 20 Filter name: none 2024-09-12T00:38:00.939 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:38:00.726+0000 7f50ba7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:00.939 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:38:00.726+0000 7f520f520800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:38:00.939 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:38:00.726+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.939 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:38:00.727+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:38:00.939 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:38:00.727+0000 7f520f520800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:38:00.939 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:38:00.727+0000 7f520f520800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:38:00.940 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:38:00.727+0000 7f520f520800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:38:00.940 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:38:00.727+0000 7f520f520800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.940 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:38:00.727+0000 7f520f520800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:38:00.940 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:38:00.727+0000 7f520f520800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:00.940 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:38:00.727+0000 7f520f520800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:00.940 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:38:00.727+0000 7f520f520800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:00.940 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:38:00.727+0000 7f520f520800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:00.940 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:38:00.727+0000 7f520f520800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:38:00.940 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:38:00.728+0000 7f520f520800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:38:00.940 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:38:00.733+0000 7f520f520800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:00.940 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:38:00.733+0000 7f520f520800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:00.940 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:38:00.733+0000 7f520f520800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:00.941 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:38:00.733+0000 7f520f520800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:38:00.941 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:38:00.733+0000 7f50ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497082 cookie 94014671013216 notifier 8424 bl.length()=911 2024-09-12T00:38:00.941 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:38:00.733+0000 7f50ee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:00.941 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:38:00.733+0000 7f50ee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:00.941 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:38:00.733+0000 7f50ee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:00.941 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:38:00.735+0000 7f520f520800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:38:00.941 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:38:00.735+0000 7f520f520800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:38:00.941 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:38:00.735+0000 7f520f520800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:38:00.941 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:38:00.735+0000 7f520f520800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:38:00.941 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:38:00.738+0000 7f520f520800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f520f520800 time 2024-09-12T00:38:00.738935+0000 2024-09-12T00:38:00.941 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:00.942 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.942 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:00.942 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5210d8c71a] 2024-09-12T00:38:00.942 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5210d8c8d8] 2024-09-12T00:38:00.942 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55817cd78641] 2024-09-12T00:38:00.942 INFO:tasks.workunit.client.0.smithi133.stderr: 4: radosgw-admin(+0xd8854c) [0x55817d28b54c] 2024-09-12T00:38:00.942 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55817cd8831d] 2024-09-12T00:38:00.942 INFO:tasks.workunit.client.0.smithi133.stderr: 6: main() 2024-09-12T00:38:00.942 INFO:tasks.workunit.client.0.smithi133.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f520fa29590] 2024-09-12T00:38:00.942 INFO:tasks.workunit.client.0.smithi133.stderr: 8: __libc_start_main() 2024-09-12T00:38:00.942 INFO:tasks.workunit.client.0.smithi133.stderr: 9: _start() 2024-09-12T00:38:00.942 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.943 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:38:00.739+0000 7f520f520800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:00.943 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f520f520800 thread_name:radosgw-admin 2024-09-12T00:38:00.943 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.943 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:00.943 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f520fa3e6f0] 2024-09-12T00:38:00.943 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f520fa8b99c] 2024-09-12T00:38:00.943 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:38:00.943 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:38:00.943 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5210d8c774] 2024-09-12T00:38:00.943 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5210d8c8d8] 2024-09-12T00:38:00.943 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55817cd78641] 2024-09-12T00:38:00.943 INFO:tasks.workunit.client.0.smithi133.stderr: 8: radosgw-admin(+0xd8854c) [0x55817d28b54c] 2024-09-12T00:38:00.944 INFO:tasks.workunit.client.0.smithi133.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55817cd8831d] 2024-09-12T00:38:00.944 INFO:tasks.workunit.client.0.smithi133.stderr: 10: main() 2024-09-12T00:38:00.944 INFO:tasks.workunit.client.0.smithi133.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f520fa29590] 2024-09-12T00:38:00.944 INFO:tasks.workunit.client.0.smithi133.stderr: 12: __libc_start_main() 2024-09-12T00:38:00.944 INFO:tasks.workunit.client.0.smithi133.stderr: 13: _start() 2024-09-12T00:38:00.944 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:00.944 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:00.944 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:38:00.944 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:38:00.944 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:38:00.944 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:38:00.944 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:38:00.944 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:38:00.945 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:38:00.945 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:38:00.945 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:38:00.945 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:38:00.945 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:38:00.945 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:38:00.945 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:38:00.945 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:38:00.945 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:38:00.945 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:38:00.945 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:38:00.945 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:38:00.945 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:38:00.945 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:38:00.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:38:00.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:38:00.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:38:00.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:38:00.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:38:00.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:38:00.946 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:38:00.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:38:00.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:38:00.946 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:38:00.946 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:38:00.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:38:00.946 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:38:00.946 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:38:00.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:38:00.947 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:38:00.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:38:00.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:38:00.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:38:00.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:38:00.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:38:00.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:38:00.947 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:38:00.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:38:00.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:38:00.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:38:00.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:38:00.947 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:38:00.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:38:00.948 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:38:00.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:38:00.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:38:00.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:38:00.948 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:38:00.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:38:00.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:38:00.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:38:00.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:38:00.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:38:00.948 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:38:00.948 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:38:00.949 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:38:00.949 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:38:00.949 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:38:00.949 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:38:00.949 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:38:00.949 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:38:00.949 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:38:00.949 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:38:00.949 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:38:00.949 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:38:00.949 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:38:00.949 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:38:00.949 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:38:00.949 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:38:00.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:38:00.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:38:00.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:38:00.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:38:00.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:38:00.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:38:00.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:38:00.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:38:00.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:38:00.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:38:00.950 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:38:00.950 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:38:00.950 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:38:00.950 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:38:00.951 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:38:00.951 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:38:00.951 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:38:00.951 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:38:00.951 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:38:00.951 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50ba7fc640 / http_manager 2024-09-12T00:38:00.951 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50c17e2640 / http_manager 2024-09-12T00:38:00.951 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50c27e4640 / rgw_dt_lg_renew 2024-09-12T00:38:00.951 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50ed7fa640 / ms_dispatch 2024-09-12T00:38:00.951 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50ee7fc640 / io_context_pool 2024-09-12T00:38:00.951 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50eeffd640 / io_context_pool 2024-09-12T00:38:00.951 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50f5602640 / ms_dispatch 2024-09-12T00:38:00.951 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50f7e07640 / ms_dispatch 2024-09-12T00:38:00.951 INFO:tasks.workunit.client.0.smithi133.stderr: 7f50f960a640 / io_context_pool 2024-09-12T00:38:00.951 INFO:tasks.workunit.client.0.smithi133.stderr: 7f5203fff640 / msgr-worker-2 2024-09-12T00:38:00.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7f520b268640 / msgr-worker-1 2024-09-12T00:38:00.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7f520ba69640 / msgr-worker-0 2024-09-12T00:38:00.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7f520c26a640 / io_context_pool 2024-09-12T00:38:00.952 INFO:tasks.workunit.client.0.smithi133.stderr: 7f520f520800 / radosgw-admin 2024-09-12T00:38:00.952 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:38:00.952 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:38:00.952 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:38:00.740635Z_e26368e5-e17a-4917-a68c-80398480fd08/log 2024-09-12T00:38:00.952 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:38:00.952 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:38:00.954 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:00.954 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:00.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.819+0000 7fde3c2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.821+0000 7fde3c2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.821+0000 7fde3c2bb800 20 realm 2024-09-12T00:38:00.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.821+0000 7fde3c2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.821+0000 7fde3c2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.821+0000 7fde3c2bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:00.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.821+0000 7fde3c2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.821+0000 7fde3c2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:00.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.821+0000 7fde3c2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.822+0000 7fde3c2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:00.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.822+0000 7fde3c2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:38:00.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.823+0000 7fde3c2bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:00.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.823+0000 7fde3c2bb800 20 searching for the correct realm 2024-09-12T00:38:00.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:00.825+0000 7fde395a4640 0 -- 172.21.15.133:0/3070480572 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fde30080d40 msgr2=0x7fde30065ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:01.030 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.031+0000 7fde395a4640 0 -- 172.21.15.133:0/3070480572 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fde2c03b400 msgr2=0x7fde2c03b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:01.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.238+0000 7fde3c2bb800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:38:01.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.238+0000 7fde3c2bb800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:38:01.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.238+0000 7fde3c2bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:01.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.238+0000 7fde3c2bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:01.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.238+0000 7fde3c2bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:01.239 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.238+0000 7fde3c2bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:01.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.238+0000 7fde3c2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.238+0000 7fde3c2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.238+0000 7fde3c2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.239+0000 7fde3c2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:01.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.239+0000 7fde3c2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.239+0000 7fde3c2bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:01.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.239+0000 7fde3c2bb800 20 zone default found 2024-09-12T00:38:01.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.239+0000 7fde3c2bb800 4 Realm: () 2024-09-12T00:38:01.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.239+0000 7fde3c2bb800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:38:01.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.239+0000 7fde3c2bb800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:38:01.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.239+0000 7fde3c2bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:01.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.239+0000 7fde3c2bb800 20 zonegroup default 2024-09-12T00:38:01.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.239+0000 7fde3c2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.239+0000 7fde3c2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.240+0000 7fde3c2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.240+0000 7fde3c2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.240+0000 7fde3c2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.240+0000 7fde3c2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:01.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.240+0000 7fde3c2bb800 20 started sync module instance, tier type = 2024-09-12T00:38:01.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.240+0000 7fde3c2bb800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:38:01.248 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.250+0000 7fde3c2bb800 20 add_watcher() i=0 2024-09-12T00:38:01.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.250+0000 7fde3c2bb800 20 add_watcher() i=1 2024-09-12T00:38:01.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.250+0000 7fde3c2bb800 20 add_watcher() i=2 2024-09-12T00:38:01.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.250+0000 7fde3c2bb800 20 add_watcher() i=3 2024-09-12T00:38:01.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.250+0000 7fde3c2bb800 20 add_watcher() i=4 2024-09-12T00:38:01.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.250+0000 7fde3c2bb800 20 add_watcher() i=5 2024-09-12T00:38:01.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.250+0000 7fde3c2bb800 20 add_watcher() i=6 2024-09-12T00:38:01.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.251+0000 7fde3c2bb800 20 add_watcher() i=7 2024-09-12T00:38:01.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.251+0000 7fde3c2bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:01.251 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.252+0000 7fdcebfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:01.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.253+0000 7fde3c2bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:01.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.253+0000 7fde3c2bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:01.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.253+0000 7fde3c2bb800 5 note: GC not initialized 2024-09-12T00:38:01.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.253+0000 7fdceaffd640 20 reqs_thread_entry: start 2024-09-12T00:38:01.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.253+0000 7fde3c2bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:01.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.253+0000 7fde3c2bb800 20 Filter name: none 2024-09-12T00:38:01.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.253+0000 7fdce8ff9640 20 reqs_thread_entry: start 2024-09-12T00:38:01.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.253+0000 7fde3c2bb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:38:01.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.253+0000 7fde3c2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.254+0000 7fde3c2bb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:38:01.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.254+0000 7fde3c2bb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:38:01.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.254+0000 7fde3c2bb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:38:01.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.254+0000 7fde3c2bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:38:01.253 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.254+0000 7fde3c2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:38:01.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.254+0000 7fde3c2bb800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:38:01.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.254+0000 7fde3c2bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:01.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.254+0000 7fde3c2bb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:01.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.254+0000 7fde3c2bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:01.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.254+0000 7fde3c2bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:01.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.254+0000 7fde3c2bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:38:01.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.254+0000 7fde3c2bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:38:01.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.254+0000 7fde3c2bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:38:01.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.255+0000 7fde3c2bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:38:01.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.255+0000 7fde3c2bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:38:01.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.255+0000 7fde3c2bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:38:01.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.255+0000 7fde3c2bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:38:01.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.256+0000 7fdcebfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:01.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.258+0000 7fde3c2bb800 20 remove_watcher() i=0 2024-09-12T00:38:01.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.258+0000 7fde3c2bb800 2 removed watcher, disabling cache 2024-09-12T00:38:01.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.259+0000 7fde3c2bb800 20 remove_watcher() i=1 2024-09-12T00:38:01.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.261+0000 7fde3c2bb800 20 remove_watcher() i=2 2024-09-12T00:38:01.260 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.262+0000 7fde3c2bb800 20 remove_watcher() i=3 2024-09-12T00:38:01.262 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.263+0000 7fde3c2bb800 20 remove_watcher() i=4 2024-09-12T00:38:01.263 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.264+0000 7fde3c2bb800 20 remove_watcher() i=5 2024-09-12T00:38:01.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.265+0000 7fde3c2bb800 20 remove_watcher() i=6 2024-09-12T00:38:01.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:01.266+0000 7fde3c2bb800 20 remove_watcher() i=7 2024-09-12T00:38:01.276 INFO:tasks.workunit.client.0.smithi133.stderr: test: duplicated entries can be purged manually 2024-09-12T00:38:31.309 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:38:31.341 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:31.341 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:31.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.383+0000 7f0a2032c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.385+0000 7f0a2032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.385+0000 7f0a2032c800 20 realm 2024-09-12T00:38:31.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.385+0000 7f0a2032c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.386+0000 7f0a2032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.386+0000 7f0a2032c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:31.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.386+0000 7f0a2032c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.386+0000 7f0a2032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.386+0000 7f0a2032c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.386+0000 7f0a2032c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:31.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.386+0000 7f0a2032c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.387 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.387+0000 7f0a2032c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:31.387 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.387+0000 7f0a2032c800 20 searching for the correct realm 2024-09-12T00:38:31.389 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.390+0000 7f0a1b8ac640 0 -- 172.21.15.133:0/364178074 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f0a100be020 msgr2=0x7f0a100ae9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:31.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.393+0000 7f0a1b8ac640 0 -- 172.21.15.133:0/364178074 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f0a0c018070 msgr2=0x7f0a0c05fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:31.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.602+0000 7f0a2032c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:38:31.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.602+0000 7f0a2032c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:38:31.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.602+0000 7f0a2032c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:31.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.602+0000 7f0a2032c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:31.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.602+0000 7f0a2032c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:31.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.602+0000 7f0a2032c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:31.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.602+0000 7f0a2032c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.602+0000 7f0a2032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.602+0000 7f0a2032c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.602+0000 7f0a2032c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:31.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.602+0000 7f0a2032c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.603+0000 7f0a2032c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:31.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.603+0000 7f0a2032c800 20 zone default found 2024-09-12T00:38:31.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.603+0000 7f0a2032c800 4 Realm: () 2024-09-12T00:38:31.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.603+0000 7f0a2032c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:38:31.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.603+0000 7f0a2032c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:38:31.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.603+0000 7f0a2032c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:31.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.603+0000 7f0a2032c800 20 zonegroup default 2024-09-12T00:38:31.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.603+0000 7f0a2032c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.603+0000 7f0a2032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.603 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.603+0000 7f0a2032c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.603+0000 7f0a2032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.603+0000 7f0a2032c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.604+0000 7f0a2032c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.604+0000 7f0a2032c800 20 started sync module instance, tier type = 2024-09-12T00:38:31.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.604+0000 7f0a2032c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:38:31.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.614+0000 7f0a2032c800 20 add_watcher() i=0 2024-09-12T00:38:31.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.614+0000 7f0a2032c800 20 add_watcher() i=1 2024-09-12T00:38:31.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.614+0000 7f0a2032c800 20 add_watcher() i=2 2024-09-12T00:38:31.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.614+0000 7f0a2032c800 20 add_watcher() i=3 2024-09-12T00:38:31.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.614+0000 7f0a2032c800 20 add_watcher() i=4 2024-09-12T00:38:31.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.614+0000 7f0a2032c800 20 add_watcher() i=5 2024-09-12T00:38:31.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.614+0000 7f0a2032c800 20 add_watcher() i=6 2024-09-12T00:38:31.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.616+0000 7f0a2032c800 20 add_watcher() i=7 2024-09-12T00:38:31.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.616+0000 7f0a2032c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:31.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.617+0000 7f08d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:31.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.618+0000 7f0a2032c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:31.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.618+0000 7f0a2032c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:31.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.618+0000 7f0a2032c800 5 note: GC not initialized 2024-09-12T00:38:31.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.618+0000 7f08d1fdb640 20 reqs_thread_entry: start 2024-09-12T00:38:31.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.618+0000 7f0a2032c800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:31.617 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.618+0000 7f0a2032c800 20 Filter name: none 2024-09-12T00:38:31.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.618+0000 7f08437fe640 20 reqs_thread_entry: start 2024-09-12T00:38:31.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.619+0000 7f0a2032c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.619+0000 7f0a2032c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:38:31.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.619+0000 7f0a2032c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.620+0000 7f0a2032c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:38:31.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.620+0000 7f0a2032c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:31.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.620+0000 7f0a2032c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.620+0000 7f0a2032c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:38:31.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.620+0000 7f0a2032c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.620+0000 7f0a2032c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:38:31.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.620+0000 7f0a2032c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:31.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.622+0000 7f08d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:31.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.624+0000 7f0a2032c800 20 remove_watcher() i=0 2024-09-12T00:38:31.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.624+0000 7f0a2032c800 2 removed watcher, disabling cache 2024-09-12T00:38:31.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.625+0000 7f0a2032c800 20 remove_watcher() i=1 2024-09-12T00:38:31.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.626+0000 7f0a2032c800 20 remove_watcher() i=2 2024-09-12T00:38:31.626 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.627+0000 7f0a2032c800 20 remove_watcher() i=3 2024-09-12T00:38:31.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.628+0000 7f0a2032c800 20 remove_watcher() i=4 2024-09-12T00:38:31.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.629+0000 7f0a2032c800 20 remove_watcher() i=5 2024-09-12T00:38:31.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.630+0000 7f0a2032c800 20 remove_watcher() i=6 2024-09-12T00:38:31.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.632+0000 7f0a2032c800 20 remove_watcher() i=7 2024-09-12T00:38:31.641 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:31.641 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:38:31.642 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: a-bucket id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 num_objects: 11 size_kb: 1 num_shards: 3 2024-09-12T00:38:31.642 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:31.643 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:38:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:31.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.717+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.719+0000 7f78be12c800 20 realm 2024-09-12T00:38:31.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.719+0000 7f78be12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:31.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.720+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:31.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.720+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.721+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:31.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.721+0000 7f78be12c800 20 searching for the correct realm 2024-09-12T00:38:31.721 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.723+0000 7f78b3fff640 0 -- 172.21.15.133:0/1348478779 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f78a4066480 msgr2=0x7f78a40668a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:31.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.726+0000 7f78b3fff640 0 -- 172.21.15.133:0/1348478779 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f78ac017070 msgr2=0x7f78ac08bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:31.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:38:31.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:38:31.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:31.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:31.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:31.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:31.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.934+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.934+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.934+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.934+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:31.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.934+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:31.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.935+0000 7f78be12c800 20 zone default found 2024-09-12T00:38:31.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.935+0000 7f78be12c800 4 Realm: () 2024-09-12T00:38:31.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.935+0000 7f78be12c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:38:31.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.935+0000 7f78be12c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:38:31.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.935+0000 7f78be12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:31.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.935+0000 7f78be12c800 20 zonegroup default 2024-09-12T00:38:31.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:31.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.935+0000 7f78be12c800 20 started sync module instance, tier type = 2024-09-12T00:38:31.936 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.935+0000 7f78be12c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:38:31.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=0 2024-09-12T00:38:31.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=1 2024-09-12T00:38:31.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=2 2024-09-12T00:38:31.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=3 2024-09-12T00:38:31.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=4 2024-09-12T00:38:31.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=5 2024-09-12T00:38:31.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=6 2024-09-12T00:38:31.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.947+0000 7f78be12c800 20 add_watcher() i=7 2024-09-12T00:38:31.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.947+0000 7f78be12c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:31.947 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.948+0000 7f776bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:31.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.949+0000 7f78be12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:31.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.949+0000 7f78be12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:31.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.949+0000 7f78be12c800 5 note: GC not initialized 2024-09-12T00:38:31.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.949+0000 7f776affd640 20 reqs_thread_entry: start 2024-09-12T00:38:31.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.949+0000 7f78be12c800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:31.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.949+0000 7f78be12c800 20 Filter name: none 2024-09-12T00:38:31.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.949+0000 7f7768ff9640 20 reqs_thread_entry: start 2024-09-12T00:38:31.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.949+0000 7f78be12c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:38:31.948 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.949+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.950+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:38:31.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.950+0000 7f78be12c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:38:31.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.950+0000 7f78be12c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:38:31.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.950+0000 7f78be12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:38:31.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.950+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:31.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.950+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:38:31.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.950+0000 7f78be12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:31.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.950+0000 7f78be12c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:31.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.950+0000 7f78be12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:31.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.950+0000 7f78be12c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:31.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.950+0000 7f78be12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:38:31.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.951+0000 7f78be12c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:38:31.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.956+0000 7f78be12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:31.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.956+0000 7f78be12c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:31.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.956+0000 7f78be12c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:31.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.956+0000 7f78be12c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:38:31.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.956+0000 7f779d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497083 cookie 94648803755760 notifier 8481 bl.length()=911 2024-09-12T00:38:31.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.956+0000 7f779d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:31.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.956+0000 7f779d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:31.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.956+0000 7f779d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:31.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.958+0000 7f78be12c800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:38:31.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.958+0000 7f78be12c800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:38:31.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.958+0000 7f78be12c800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:38:31.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.958+0000 7f78be12c800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:38:31.960 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f78be12c800 time 2024-09-12T00:38:31.962409+0000 2024-09-12T00:38:31.960 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:31.960 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:31.961 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f78bf78c71a] 2024-09-12T00:38:31.961 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f78bf78c8d8] 2024-09-12T00:38:31.961 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561522b24641] 2024-09-12T00:38:31.961 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561522b3438a] 2024-09-12T00:38:31.961 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:38:31.961 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f78be429590] 2024-09-12T00:38:31.961 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:38:31.961 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:38:31.961 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.962+0000 7f78be12c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f78be12c800 time 2024-09-12T00:38:31.962409+0000 2024-09-12T00:38:31.961 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:31.961 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:31.961 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:31.961 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f78bf78c71a] 2024-09-12T00:38:31.962 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f78bf78c8d8] 2024-09-12T00:38:31.962 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561522b24641] 2024-09-12T00:38:31.962 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561522b3438a] 2024-09-12T00:38:31.962 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:38:31.962 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f78be429590] 2024-09-12T00:38:31.962 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:38:31.962 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:38:31.962 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:31.962 INFO:tasks.workunit.client.0.smithi133.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:38:31.962 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f78be12c800 thread_name:radosgw-admin 2024-09-12T00:38:31.983 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:31.983 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f78be43e6f0] 2024-09-12T00:38:31.983 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f78be48b99c] 2024-09-12T00:38:31.983 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:38:31.983 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:38:31.983 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f78bf78c774] 2024-09-12T00:38:31.983 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f78bf78c8d8] 2024-09-12T00:38:31.983 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561522b24641] 2024-09-12T00:38:31.983 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561522b3438a] 2024-09-12T00:38:31.983 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:38:31.984 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f78be429590] 2024-09-12T00:38:31.984 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:38:31.984 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:38:31.984 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:31.962+0000 7f78be12c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:31.984 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f78be12c800 thread_name:radosgw-admin 2024-09-12T00:38:31.984 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:31.984 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:31.984 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f78be43e6f0] 2024-09-12T00:38:31.984 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f78be48b99c] 2024-09-12T00:38:31.984 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:38:31.984 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:38:31.984 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f78bf78c774] 2024-09-12T00:38:31.984 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f78bf78c8d8] 2024-09-12T00:38:31.985 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561522b24641] 2024-09-12T00:38:31.985 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561522b3438a] 2024-09-12T00:38:31.985 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:38:31.985 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f78be429590] 2024-09-12T00:38:31.985 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:38:31.985 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:38:31.985 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:31.985 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:31.985 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:38:31.985 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:38:31.700+0000 7f78be12c800 5 monclient: authenticate success, global_id 8469 2024-09-12T00:38:31.985 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:38:31.700+0000 7f77a7e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:31.985 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:38:31.700+0000 7f78be12c800 10 monclient: get_monmap_and_config success 2024-09-12T00:38:31.985 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:38:31.700+0000 7f78be12c800 4 set_mon_vals no callback set 2024-09-12T00:38:31.985 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:38:31.700+0000 7f77a7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:31.986 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:38:31.700+0000 7f77a7e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:31.986 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:38:31.700+0000 7f77a7e07640 10 monclient: dump: 2024-09-12T00:38:31.986 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:31.986 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:31.986 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:31.986 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:31.986 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:31.986 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:31.986 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:31.986 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:31.986 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:31.986 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:31.986 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:38:31.700+0000 7f78be12c800 10 monclient: shutdown 2024-09-12T00:38:31.986 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 asok(0x561524219630) unregister_commands rotate-key 2024-09-12T00:38:31.986 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:38:31.701+0000 7f78be12c800 10 monclient: build_initial_monmap 2024-09-12T00:38:31.987 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:38:31.701+0000 7f78be12c800 1 build_initial for_mkfs: 0 2024-09-12T00:38:31.987 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:38:31.701+0000 7f78be12c800 10 monclient: monmap: 2024-09-12T00:38:31.987 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:31.987 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:31.987 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:31.987 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:31.987 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:31.987 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:31.987 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:31.987 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:31.987 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:31.987 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:31.987 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding auth protocol: cephx 2024-09-12T00:38:31.987 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding auth protocol: cephx 2024-09-12T00:38:31.988 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding auth protocol: cephx 2024-09-12T00:38:31.988 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: secure 2024-09-12T00:38:31.988 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: crc 2024-09-12T00:38:31.988 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: secure 2024-09-12T00:38:31.988 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: crc 2024-09-12T00:38:31.988 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: secure 2024-09-12T00:38:31.988 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: crc 2024-09-12T00:38:31.988 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: crc 2024-09-12T00:38:31.988 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: secure 2024-09-12T00:38:31.988 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: crc 2024-09-12T00:38:31.988 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: secure 2024-09-12T00:38:31.988 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: crc 2024-09-12T00:38:31.988 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: secure 2024-09-12T00:38:31.988 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:38:31.701+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:31.989 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:38:31.701+0000 7f78be12c800 1 librados: starting msgr at 2024-09-12T00:38:31.989 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:38:31.701+0000 7f78be12c800 1 librados: starting objecter 2024-09-12T00:38:31.989 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 asok(0x561524219630) register_command objecter_requests hook 0x56152443d350 2024-09-12T00:38:31.989 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:38:31.701+0000 7f78be12c800 1 librados: setting wanted keys 2024-09-12T00:38:31.989 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:38:31.701+0000 7f78be12c800 1 librados: calling monclient init 2024-09-12T00:38:31.989 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:38:31.701+0000 7f78be12c800 10 monclient: init 2024-09-12T00:38:31.989 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding auth protocol: cephx 2024-09-12T00:38:31.989 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding auth protocol: cephx 2024-09-12T00:38:31.989 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding auth protocol: cephx 2024-09-12T00:38:31.989 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: secure 2024-09-12T00:38:31.989 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: crc 2024-09-12T00:38:31.989 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: secure 2024-09-12T00:38:31.989 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: crc 2024-09-12T00:38:31.990 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: secure 2024-09-12T00:38:31.990 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: crc 2024-09-12T00:38:31.990 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: crc 2024-09-12T00:38:31.990 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: secure 2024-09-12T00:38:31.990 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: crc 2024-09-12T00:38:31.990 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: secure 2024-09-12T00:38:31.990 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: crc 2024-09-12T00:38:31.990 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: secure 2024-09-12T00:38:31.990 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:38:31.701+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:31.990 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:38:31.702+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:31.990 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:38:31.702+0000 7f78be12c800 5 asok(0x561524219630) register_command rotate-key hook 0x561524439c18 2024-09-12T00:38:31.990 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:31.990 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:38:31.990 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-c con 0x5615242f0da0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:31.991 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-a con 0x56152437c2a0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:31.991 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-b con 0x561524382420 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:31.991 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:31.991 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:31.991 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:31.991 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:31.991 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): authenticate will time out at 2320.274182s 2024-09-12T00:38:31.991 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request con 0x5615242f0da0 auth_method 0 2024-09-12T00:38:31.991 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:31.991 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:31.991 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:31.991 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:38:31.702+0000 7f78b3fff640 10 monclient(hunting): get_auth_request con 0x56152437c2a0 auth_method 0 2024-09-12T00:38:31.991 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:38:31.702+0000 7f78b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:31.991 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:38:31.702+0000 7f78b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:31.992 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:38:31.702+0000 7f78b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:31.992 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:31.992 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:31.992 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:31.992 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:38:31.702+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:31.992 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:38:31.702+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:31.992 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:38:31.702+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:31.992 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:38:31.702+0000 7f78ba53f640 10 monclient(hunting): get_auth_request con 0x561524382420 auth_method 0 2024-09-12T00:38:31.992 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:38:31.702+0000 7f78ba53f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:31.992 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:38:31.702+0000 7f78ba53f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:31.992 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:38:31.702+0000 7f78ba53f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:31.992 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_done global_id 7928 payload 824 2024-09-12T00:38:31.992 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient: _finish_hunting 0 2024-09-12T00:38:31.993 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 1 monclient: found mon.noname-c 2024-09-12T00:38:31.993 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:38:31.993 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:31.993 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:31.993 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: dump: 2024-09-12T00:38:31.993 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:31.993 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:31.993 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:31.993 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:31.993 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:31.993 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:31.993 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:31.993 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:31.993 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:31.994 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:31.994 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: _finish_auth 0 2024-09-12T00:38:31.994 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: _check_auth_tickets 2024-09-12T00:38:31.994 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:31.994 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:31.994 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:31.994 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: dump: 2024-09-12T00:38:31.994 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:31.994 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:31.994 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:31.994 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:31.994 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:31.994 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:31.994 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:31.994 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:31.995 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:31.995 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:31.995 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:38:31.702+0000 7f78be12c800 5 monclient: authenticate success, global_id 7928 2024-09-12T00:38:31.995 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient: _renew_subs 2024-09-12T00:38:31.995 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:38:31.702+0000 7f77a7e07640 4 set_mon_vals no callback set 2024-09-12T00:38:31.995 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:38:31.995 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient: _renew_subs 2024-09-12T00:38:31.995 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:38:31.995 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:38:31.702+0000 7f78be12c800 1 librados: init done 2024-09-12T00:38:31.995 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:38:31.704+0000 7f77a6604640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:38:31.995 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:38:31.704+0000 7f77a6604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:31.995 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:38:31.704+0000 7f77a6604640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:31.995 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:38:31.704+0000 7f78b3fff640 10 monclient: get_auth_request con 0x7f77a0076470 auth_method 0 2024-09-12T00:38:31.995 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:38:31.705+0000 7f78ba53f640 10 monclient: get_auth_request con 0x561524462310 auth_method 0 2024-09-12T00:38:31.996 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:38:31.705+0000 7f78b9d3e640 10 monclient: get_auth_request con 0x561524484f80 auth_method 0 2024-09-12T00:38:31.996 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:38:31.706+0000 7f78b3fff640 10 monclient: get_auth_request con 0x561524489450 auth_method 0 2024-09-12T00:38:31.996 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:38:31.707+0000 7f78ba53f640 10 monclient: get_auth_request con 0x5615244888b0 auth_method 0 2024-09-12T00:38:31.996 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:38:31.708+0000 7f78be12c800 10 monclient: build_initial_monmap 2024-09-12T00:38:31.996 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:38:31.708+0000 7f78be12c800 1 build_initial for_mkfs: 0 2024-09-12T00:38:31.996 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:38:31.708+0000 7f78be12c800 10 monclient: monmap: 2024-09-12T00:38:31.996 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:31.996 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:31.996 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:31.996 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:31.996 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:31.996 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:31.996 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:31.996 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:31.997 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:31.997 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:31.997 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding auth protocol: cephx 2024-09-12T00:38:31.997 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding auth protocol: cephx 2024-09-12T00:38:31.997 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding auth protocol: cephx 2024-09-12T00:38:31.997 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: secure 2024-09-12T00:38:31.997 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: crc 2024-09-12T00:38:31.997 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: secure 2024-09-12T00:38:31.997 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: crc 2024-09-12T00:38:31.997 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: secure 2024-09-12T00:38:31.997 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: crc 2024-09-12T00:38:31.997 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: crc 2024-09-12T00:38:31.997 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: secure 2024-09-12T00:38:31.997 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: crc 2024-09-12T00:38:31.998 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: secure 2024-09-12T00:38:31.998 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: crc 2024-09-12T00:38:31.998 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: secure 2024-09-12T00:38:31.998 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:38:31.708+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:31.998 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 asok(0x561524219630) register_command objecter_requests cmddesc objecter_requests hook 0x561524494ae0 EEXIST 2024-09-12T00:38:31.998 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:38:31.708+0000 7f78be12c800 10 monclient: init 2024-09-12T00:38:31.998 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding auth protocol: cephx 2024-09-12T00:38:31.998 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding auth protocol: cephx 2024-09-12T00:38:31.998 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding auth protocol: cephx 2024-09-12T00:38:31.998 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: secure 2024-09-12T00:38:31.998 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: crc 2024-09-12T00:38:31.998 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: secure 2024-09-12T00:38:31.998 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: crc 2024-09-12T00:38:31.998 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: secure 2024-09-12T00:38:31.999 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: crc 2024-09-12T00:38:31.999 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: crc 2024-09-12T00:38:31.999 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: secure 2024-09-12T00:38:31.999 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: crc 2024-09-12T00:38:31.999 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: secure 2024-09-12T00:38:31.999 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: crc 2024-09-12T00:38:31.999 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: secure 2024-09-12T00:38:31.999 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:38:31.709+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:31.999 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:38:31.709+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:31.999 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:38:31.709+0000 7f78be12c800 5 asok(0x561524219630) register_command rotate-key cmddesc rotate-key hook 0x561524490670 EEXIST 2024-09-12T00:38:31.999 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:31.999 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:38:31.999 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-b con 0x5615244b8e00 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:32.000 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-a con 0x5615244b91e0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:32.000 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-c con 0x5615244b7b10 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:32.000 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.000 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.000 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.000 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:32.000 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): authenticate will time out at 2320.281417s 2024-09-12T00:38:32.000 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): get_auth_request con 0x5615244b91e0 auth_method 0 2024-09-12T00:38:32.000 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.000 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.000 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.000 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:38:31.709+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request con 0x5615244b7b10 auth_method 0 2024-09-12T00:38:32.000 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:38:31.709+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.000 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:38:31.709+0000 7f78b9d3e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.001 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:38:31.709+0000 7f78b9d3e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.001 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.001 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.001 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.001 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:38:31.709+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.001 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:38:31.709+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.001 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:38:31.709+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.001 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:38:31.709+0000 7f78b3fff640 10 monclient(hunting): get_auth_request con 0x5615244b8e00 auth_method 0 2024-09-12T00:38:32.001 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:38:31.709+0000 7f78b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.001 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:38:31.709+0000 7f78b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.001 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:38:31.709+0000 7f78b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.001 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:38:31.709+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.001 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:38:31.709+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.001 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:38:31.709+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.002 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): handle_auth_done global_id 8475 payload 824 2024-09-12T00:38:32.002 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient: _finish_hunting 0 2024-09-12T00:38:32.002 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:38:31.709+0000 7f78ba53f640 1 monclient: found mon.noname-a 2024-09-12T00:38:32.002 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:38:32.002 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:32.002 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:32.002 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: dump: 2024-09-12T00:38:32.002 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:32.002 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:32.002 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.002 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.002 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:32.002 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.002 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:32.003 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:32.003 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:32.003 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.003 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:38:32.003 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:38:32.003 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:32.003 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:32.003 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:32.003 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: dump: 2024-09-12T00:38:32.003 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:32.003 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:32.003 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.003 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.004 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:32.004 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.004 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:32.004 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:32.004 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:32.004 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.004 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:38:31.710+0000 7f78be12c800 5 monclient: authenticate success, global_id 8475 2024-09-12T00:38:32.004 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:38:31.710+0000 7f78be12c800 10 monclient: _renew_subs 2024-09-12T00:38:32.004 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:38:31.710+0000 7f78be12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:38:32.004 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:38:31.710+0000 7f78bad40640 4 set_mon_vals no callback set 2024-09-12T00:38:32.004 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:38:31.710+0000 7f78be12c800 10 monclient: _renew_subs 2024-09-12T00:38:32.004 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:38:31.710+0000 7f78be12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:38:32.004 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:38:31.711+0000 7f779f7fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:38:32.004 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:38:31.711+0000 7f779f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:32.005 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:38:31.711+0000 7f779f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:32.005 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:38:31.712+0000 7f78b3fff640 10 monclient: get_auth_request con 0x7f7794076380 auth_method 0 2024-09-12T00:38:32.005 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:38:31.712+0000 7f78be12c800 10 monclient: get_monmap_and_config 2024-09-12T00:38:32.005 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:38:31.712+0000 7f78be12c800 10 monclient: build_initial_monmap 2024-09-12T00:38:32.005 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:38:31.712+0000 7f78be12c800 1 build_initial for_mkfs: 0 2024-09-12T00:38:32.005 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:38:31.712+0000 7f78be12c800 10 monclient: monmap: 2024-09-12T00:38:32.005 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:32.005 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:32.005 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:32.005 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:32.005 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:32.005 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.005 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:32.006 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:32.006 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:32.006 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.006 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding auth protocol: cephx 2024-09-12T00:38:32.006 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding auth protocol: cephx 2024-09-12T00:38:32.006 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding auth protocol: cephx 2024-09-12T00:38:32.006 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: secure 2024-09-12T00:38:32.006 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: crc 2024-09-12T00:38:32.006 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: secure 2024-09-12T00:38:32.006 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: crc 2024-09-12T00:38:32.006 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: secure 2024-09-12T00:38:32.006 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: crc 2024-09-12T00:38:32.006 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: crc 2024-09-12T00:38:32.006 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: secure 2024-09-12T00:38:32.007 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: crc 2024-09-12T00:38:32.007 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: secure 2024-09-12T00:38:32.007 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: crc 2024-09-12T00:38:32.007 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: secure 2024-09-12T00:38:32.007 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:38:31.712+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.007 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:38:31.712+0000 7f78be12c800 10 monclient: init 2024-09-12T00:38:32.007 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding auth protocol: cephx 2024-09-12T00:38:32.007 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding auth protocol: cephx 2024-09-12T00:38:32.007 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding auth protocol: cephx 2024-09-12T00:38:32.007 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: secure 2024-09-12T00:38:32.007 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: crc 2024-09-12T00:38:32.007 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: secure 2024-09-12T00:38:32.007 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: crc 2024-09-12T00:38:32.007 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: secure 2024-09-12T00:38:32.008 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: crc 2024-09-12T00:38:32.008 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: crc 2024-09-12T00:38:32.008 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: secure 2024-09-12T00:38:32.008 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: crc 2024-09-12T00:38:32.008 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: secure 2024-09-12T00:38:32.008 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: crc 2024-09-12T00:38:32.008 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: secure 2024-09-12T00:38:32.008 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:38:31.712+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.008 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:38:31.713+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.008 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:38:31.713+0000 7f78be12c800 5 asok(0x561524219630) register_command rotate-key cmddesc rotate-key hook 0x7fff16cd3088 EEXIST 2024-09-12T00:38:32.008 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:32.008 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:38:32.008 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-b con 0x56152450d300 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:32.008 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-c con 0x5615244fdc50 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:32.009 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-a con 0x561524508730 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:32.009 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.009 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.009 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.009 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:32.009 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): authenticate will time out at 2320.285276s 2024-09-12T00:38:32.009 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:38:31.713+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request con 0x561524508730 auth_method 0 2024-09-12T00:38:32.009 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:38:31.713+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.009 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:38:31.713+0000 7f78b9d3e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.009 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:38:31.713+0000 7f78b9d3e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.009 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): get_auth_request con 0x5615244fdc50 auth_method 0 2024-09-12T00:38:32.009 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.009 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.009 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.010 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:38:31.713+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.010 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:38:31.713+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.010 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:38:31.713+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.010 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.010 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.010 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.010 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:38:31.713+0000 7f78b3fff640 10 monclient(hunting): get_auth_request con 0x56152450d300 auth_method 0 2024-09-12T00:38:32.010 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:38:31.713+0000 7f78b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.010 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:38:31.713+0000 7f78b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.010 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:38:31.713+0000 7f78b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.010 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): handle_auth_done global_id 7934 payload 274 2024-09-12T00:38:32.010 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient: _finish_hunting 0 2024-09-12T00:38:32.010 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:38:31.713+0000 7f78ba53f640 1 monclient: found mon.noname-c 2024-09-12T00:38:32.010 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:38:32.011 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:32.011 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:32.011 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: dump: 2024-09-12T00:38:32.011 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:32.011 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:32.011 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.011 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.011 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:32.011 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.011 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:32.011 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:32.011 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:32.011 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.011 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:38:32.012 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:38:32.012 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:32.012 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:32.012 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:32.012 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: dump: 2024-09-12T00:38:32.012 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:32.012 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:32.012 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.012 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.012 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:32.012 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.012 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:32.012 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:32.013 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:32.013 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.013 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:38:31.713+0000 7f78be12c800 5 monclient: authenticate success, global_id 7934 2024-09-12T00:38:32.013 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient: get_monmap_and_config success 2024-09-12T00:38:32.013 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:38:31.713+0000 7f78be12c800 4 set_mon_vals no callback set 2024-09-12T00:38:32.013 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:38:31.714+0000 7f78be12c800 10 monclient: shutdown 2024-09-12T00:38:32.013 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:38:31.714+0000 7f78be12c800 10 monclient: build_initial_monmap 2024-09-12T00:38:32.013 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:38:31.714+0000 7f78be12c800 1 build_initial for_mkfs: 0 2024-09-12T00:38:32.013 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:38:31.714+0000 7f78be12c800 10 monclient: monmap: 2024-09-12T00:38:32.013 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:32.013 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:32.013 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:32.013 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:32.013 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:32.014 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.014 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:32.014 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:32.014 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:32.014 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.014 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding auth protocol: cephx 2024-09-12T00:38:32.014 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding auth protocol: cephx 2024-09-12T00:38:32.014 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding auth protocol: cephx 2024-09-12T00:38:32.014 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: secure 2024-09-12T00:38:32.014 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: crc 2024-09-12T00:38:32.014 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: secure 2024-09-12T00:38:32.014 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: crc 2024-09-12T00:38:32.014 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: secure 2024-09-12T00:38:32.014 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: crc 2024-09-12T00:38:32.015 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: crc 2024-09-12T00:38:32.015 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: secure 2024-09-12T00:38:32.015 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: crc 2024-09-12T00:38:32.015 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: secure 2024-09-12T00:38:32.015 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: crc 2024-09-12T00:38:32.015 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: secure 2024-09-12T00:38:32.015 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:38:31.714+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.015 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:38:31.714+0000 7f78be12c800 1 librados: starting msgr at 2024-09-12T00:38:32.015 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:38:31.714+0000 7f78be12c800 1 librados: starting objecter 2024-09-12T00:38:32.015 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 asok(0x561524219630) register_command objecter_requests cmddesc objecter_requests hook 0x5615244de790 EEXIST 2024-09-12T00:38:32.015 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:38:31.715+0000 7f78be12c800 1 librados: setting wanted keys 2024-09-12T00:38:32.015 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:38:31.715+0000 7f78be12c800 1 librados: calling monclient init 2024-09-12T00:38:32.015 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient: init 2024-09-12T00:38:32.015 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding auth protocol: cephx 2024-09-12T00:38:32.016 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding auth protocol: cephx 2024-09-12T00:38:32.016 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding auth protocol: cephx 2024-09-12T00:38:32.016 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: secure 2024-09-12T00:38:32.016 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: crc 2024-09-12T00:38:32.016 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: secure 2024-09-12T00:38:32.016 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: crc 2024-09-12T00:38:32.016 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: secure 2024-09-12T00:38:32.016 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: crc 2024-09-12T00:38:32.016 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: crc 2024-09-12T00:38:32.016 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: secure 2024-09-12T00:38:32.016 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: crc 2024-09-12T00:38:32.016 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: secure 2024-09-12T00:38:32.016 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: crc 2024-09-12T00:38:32.016 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: secure 2024-09-12T00:38:32.017 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:38:31.715+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.017 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:38:31.715+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.017 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 asok(0x561524219630) register_command rotate-key cmddesc rotate-key hook 0x5615244cd808 EEXIST 2024-09-12T00:38:32.017 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:32.017 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:38:32.017 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-c con 0x5615244fdc50 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:32.017 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-b con 0x561524508730 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:32.017 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-a con 0x56152450d300 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:32.017 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.017 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.017 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.017 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:32.017 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): authenticate will time out at 2320.287560s 2024-09-12T00:38:32.018 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:38:31.715+0000 7f78b3fff640 10 monclient(hunting): get_auth_request con 0x5615244fdc50 auth_method 0 2024-09-12T00:38:32.018 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:38:31.715+0000 7f78b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.018 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:38:31.715+0000 7f78b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.018 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:38:31.715+0000 7f78b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.018 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request con 0x56152450d300 auth_method 0 2024-09-12T00:38:32.018 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.018 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.018 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.018 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.018 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.018 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.018 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:38:31.715+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.018 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:38:31.715+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.018 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:38:31.715+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.019 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_done global_id 8481 payload 824 2024-09-12T00:38:32.019 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient: _finish_hunting 0 2024-09-12T00:38:32.019 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 1 monclient: found mon.noname-a 2024-09-12T00:38:32.019 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:38:32.019 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:32.019 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:32.019 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: dump: 2024-09-12T00:38:32.019 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:32.019 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:32.019 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.019 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.019 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:32.019 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.019 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:32.019 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:32.020 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:32.020 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.020 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:38:32.020 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:38:32.020 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:32.020 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:32.020 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:32.020 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: dump: 2024-09-12T00:38:32.020 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:32.020 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:32.020 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.020 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.020 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:32.021 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.021 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:32.021 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:32.021 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:32.021 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.021 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:38:31.716+0000 7f78be12c800 5 monclient: authenticate success, global_id 8481 2024-09-12T00:38:32.021 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:38:31.716+0000 7f78be12c800 10 monclient: _renew_subs 2024-09-12T00:38:32.021 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:38:31.716+0000 7f78be12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:38:32.021 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:38:31.716+0000 7f779d7fa640 4 set_mon_vals no callback set 2024-09-12T00:38:32.021 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:38:31.716+0000 7f78be12c800 10 monclient: _renew_subs 2024-09-12T00:38:32.021 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:38:31.716+0000 7f78be12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:38:32.021 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:38:31.716+0000 7f78be12c800 1 librados: init done 2024-09-12T00:38:32.021 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:38:31.716+0000 7f78be12c800 5 asok(0x561524219630) register_command cr dump hook 0x561524500998 2024-09-12T00:38:32.021 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:38:31.717+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.021 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:38:31.718+0000 7f778b7fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:38:32.022 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:38:31.718+0000 7f778b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:32.022 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:38:31.718+0000 7f778b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:32.022 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:38:31.718+0000 7f78b3fff640 10 monclient: get_auth_request con 0x7f7784076470 auth_method 0 2024-09-12T00:38:32.022 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:38:31.718+0000 7f78ba53f640 10 monclient: get_auth_request con 0x561524527690 auth_method 0 2024-09-12T00:38:32.022 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.022 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:38:31.719+0000 7f78be12c800 20 realm 2024-09-12T00:38:32.022 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.022 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.022 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:38:31.719+0000 7f78be12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:32.022 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.022 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.022 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.022 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:38:31.719+0000 7f78b3fff640 10 monclient: get_auth_request con 0x56152452b9f0 auth_method 0 2024-09-12T00:38:32.022 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:38:31.720+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:32.023 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:38:31.720+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.023 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:38:31.720+0000 7f78ba53f640 10 monclient: get_auth_request con 0x56152452f130 auth_method 0 2024-09-12T00:38:32.023 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:38:31.721+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:32.023 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:38:31.721+0000 7f78be12c800 20 searching for the correct realm 2024-09-12T00:38:32.023 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:38:31.721+0000 7f78b9d3e640 10 monclient: get_auth_request con 0x7f78b4072150 auth_method 0 2024-09-12T00:38:32.023 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:38:31.722+0000 7f78b3fff640 10 monclient: get_auth_request con 0x7f78a4066480 auth_method 0 2024-09-12T00:38:32.023 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:38:31.723+0000 7f78b3fff640 0 -- 172.21.15.133:0/1348478779 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f78a4066480 msgr2=0x7f78a40668a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:32.023 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:38:31.723+0000 7f778b7fe640 1 client.8481.objecter ms_handle_reset 0x7f78a4066480 session 0x7f78a4084040 osd.0 2024-09-12T00:38:32.023 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:38:31.723+0000 7f778b7fe640 10 monclient: _renew_subs 2024-09-12T00:38:32.023 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:38:31.723+0000 7f778b7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:38:32.023 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:38:31.723+0000 7f78b3fff640 10 monclient: get_auth_request con 0x7f7784086720 auth_method 0 2024-09-12T00:38:32.023 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:38:31.723+0000 7f78ba53f640 10 monclient: get_auth_request con 0x7f78b407ebd0 auth_method 0 2024-09-12T00:38:32.023 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:38:31.725+0000 7f78b9d3e640 10 monclient: get_auth_request con 0x7f78a40a7040 auth_method 0 2024-09-12T00:38:32.023 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:38:31.726+0000 7f78b3fff640 0 -- 172.21.15.133:0/1348478779 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f78ac017070 msgr2=0x7f78ac08bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:32.023 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:38:31.726+0000 7f78b3fff640 10 monclient: get_auth_request con 0x7f78ac017070 auth_method 0 2024-09-12T00:38:32.024 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:38:31.928+0000 7f78b3fff640 10 monclient: get_auth_request con 0x7f78ac017070 auth_method 0 2024-09-12T00:38:32.024 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:38:32.024 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:38:32.024 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:32.024 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:32.024 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:32.024 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:32.024 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.024 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.024 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.024 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:32.024 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.024 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:32.025 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 zone default found 2024-09-12T00:38:32.025 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:38:31.935+0000 7f78be12c800 4 Realm: () 2024-09-12T00:38:32.025 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:38:31.935+0000 7f78be12c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:38:32.025 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:38:31.935+0000 7f78be12c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:38:32.025 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:38:31.935+0000 7f78be12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:32.025 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 zonegroup default 2024-09-12T00:38:32.025 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.025 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.025 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.025 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.025 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.025 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.025 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 started sync module instance, tier type = 2024-09-12T00:38:32.025 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:38:32.026 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=0 2024-09-12T00:38:32.026 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=1 2024-09-12T00:38:32.026 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=2 2024-09-12T00:38:32.026 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=3 2024-09-12T00:38:32.026 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=4 2024-09-12T00:38:32.026 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=5 2024-09-12T00:38:32.026 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=6 2024-09-12T00:38:32.026 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:38:31.947+0000 7f78be12c800 20 add_watcher() i=7 2024-09-12T00:38:32.026 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:38:31.947+0000 7f78be12c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:32.026 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding auth protocol: cephx 2024-09-12T00:38:32.026 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding auth protocol: cephx 2024-09-12T00:38:32.026 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding auth protocol: cephx 2024-09-12T00:38:32.026 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: secure 2024-09-12T00:38:32.026 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: crc 2024-09-12T00:38:32.026 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: secure 2024-09-12T00:38:32.027 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: crc 2024-09-12T00:38:32.027 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: secure 2024-09-12T00:38:32.027 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: crc 2024-09-12T00:38:32.027 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: crc 2024-09-12T00:38:32.027 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:38:31.948+0000 7f776bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:32.027 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: secure 2024-09-12T00:38:32.027 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: crc 2024-09-12T00:38:32.027 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: secure 2024-09-12T00:38:32.027 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: crc 2024-09-12T00:38:32.027 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: secure 2024-09-12T00:38:32.027 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:38:31.949+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.027 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:38:31.949+0000 7f78be12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:32.027 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:38:31.949+0000 7f78be12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:32.027 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command cache list hook 0x561524500ec0 2024-09-12T00:38:32.028 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command cache inspect hook 0x561524500ec0 2024-09-12T00:38:32.028 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command cache erase hook 0x561524500ec0 2024-09-12T00:38:32.028 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command cache zap hook 0x561524500ec0 2024-09-12T00:38:32.028 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 note: GC not initialized 2024-09-12T00:38:32.028 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:38:31.949+0000 7f776affd640 20 reqs_thread_entry: start 2024-09-12T00:38:32.028 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command sync trace show hook 0x7f78a404e730 2024-09-12T00:38:32.028 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command sync trace history hook 0x7f78a404e730 2024-09-12T00:38:32.028 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command sync trace active hook 0x7f78a404e730 2024-09-12T00:38:32.028 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command sync trace active_short hook 0x7f78a404e730 2024-09-12T00:38:32.028 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:38:31.949+0000 7f78be12c800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:32.028 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:38:31.949+0000 7f78be12c800 20 Filter name: none 2024-09-12T00:38:32.028 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:38:31.949+0000 7f7768ff9640 20 reqs_thread_entry: start 2024-09-12T00:38:32.028 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:38:31.949+0000 7f78be12c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:38:32.028 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:38:31.949+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.029 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:38:31.950+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:38:32.029 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:38:32.029 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:38:32.029 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:38:32.029 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:38:31.950+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.029 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:38:31.950+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:38:32.029 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:32.029 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:32.029 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:32.029 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:32.029 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:38:32.029 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:38:31.951+0000 7f78be12c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:38:32.029 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:38:31.956+0000 7f78be12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:32.030 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:38:31.956+0000 7f78be12c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:32.030 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:38:31.956+0000 7f78be12c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:32.030 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:38:31.956+0000 7f78be12c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:38:32.030 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:38:31.956+0000 7f779d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497083 cookie 94648803755760 notifier 8481 bl.length()=911 2024-09-12T00:38:32.030 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:38:31.956+0000 7f779d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:32.030 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:38:31.956+0000 7f779d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:32.030 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:38:31.956+0000 7f779d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:32.030 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:38:31.958+0000 7f78be12c800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:38:32.030 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:38:31.958+0000 7f78be12c800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:38:32.030 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:38:31.958+0000 7f78be12c800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:38:32.030 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:38:31.958+0000 7f78be12c800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:38:32.030 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:38:31.962+0000 7f78be12c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f78be12c800 time 2024-09-12T00:38:31.962409+0000 2024-09-12T00:38:32.030 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:32.030 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.031 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:32.031 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f78bf78c71a] 2024-09-12T00:38:32.031 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f78bf78c8d8] 2024-09-12T00:38:32.031 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561522b24641] 2024-09-12T00:38:32.031 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561522b3438a] 2024-09-12T00:38:32.031 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:38:32.031 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f78be429590] 2024-09-12T00:38:32.031 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:38:32.031 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:38:32.031 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.031 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:38:31.962+0000 7f78be12c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:32.031 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f78be12c800 thread_name:radosgw-admin 2024-09-12T00:38:32.031 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.031 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:32.032 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f78be43e6f0] 2024-09-12T00:38:32.032 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f78be48b99c] 2024-09-12T00:38:32.032 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:38:32.032 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:38:32.032 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f78bf78c774] 2024-09-12T00:38:32.032 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f78bf78c8d8] 2024-09-12T00:38:32.032 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561522b24641] 2024-09-12T00:38:32.032 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561522b3438a] 2024-09-12T00:38:32.032 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:38:32.032 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f78be429590] 2024-09-12T00:38:32.032 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:38:32.032 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:38:32.032 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:32.032 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.033 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:38:32.033 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:38:32.033 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:38:32.033 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:38:32.033 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:38:32.033 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:38:32.033 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:38:32.033 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:38:32.033 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:38:32.033 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:38:32.033 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:38:32.033 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:38:32.033 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:38:32.033 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:38:32.034 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:38:32.034 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:38:32.034 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:38:32.034 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:38:32.034 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:38:32.034 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:38:32.034 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:38:32.034 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:38:32.034 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:38:32.034 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:38:32.034 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:38:32.034 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:38:32.034 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:38:32.034 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:38:32.034 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:38:32.035 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:38:32.035 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:38:32.035 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:38:32.035 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:38:32.035 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:38:32.035 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:38:32.035 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:38:32.035 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:38:32.035 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:38:32.035 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:38:32.035 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:38:32.035 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:38:32.035 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:38:32.035 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:38:32.035 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:38:32.036 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:38:32.036 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:38:32.036 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:38:32.036 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:38:32.036 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:38:32.036 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:38:32.036 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:38:32.036 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:38:32.036 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:38:32.036 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:38:32.037 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:38:32.037 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:38:32.037 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:38:32.037 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:38:32.037 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:38:32.037 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:38:32.037 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:38:32.037 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:38:32.037 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:38:32.037 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:38:32.037 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:38:32.037 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:38:32.037 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:38:32.037 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:38:32.038 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:38:32.038 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:38:32.038 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:38:32.038 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:38:32.038 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:38:32.038 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:38:32.038 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:38:32.038 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:38:32.038 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:38:32.038 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:38:32.038 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:38:32.038 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:38:32.038 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:38:32.038 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:38:32.038 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:38:32.039 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:38:32.039 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:38:32.039 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:38:32.039 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:38:32.039 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:38:32.039 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:38:32.039 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:38:32.039 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:38:32.039 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:38:32.039 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:38:32.039 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:38:32.039 INFO:tasks.workunit.client.0.smithi133.stderr: 7f7768ff9640 / http_manager 2024-09-12T00:38:32.039 INFO:tasks.workunit.client.0.smithi133.stderr: 7f776affd640 / http_manager 2024-09-12T00:38:32.039 INFO:tasks.workunit.client.0.smithi133.stderr: 7f776bfff640 / rgw_dt_lg_renew 2024-09-12T00:38:32.040 INFO:tasks.workunit.client.0.smithi133.stderr: 7f778b7fe640 / ms_dispatch 2024-09-12T00:38:32.040 INFO:tasks.workunit.client.0.smithi133.stderr: 7f779d7fa640 / io_context_pool 2024-09-12T00:38:32.040 INFO:tasks.workunit.client.0.smithi133.stderr: 7f779f7fe640 / ms_dispatch 2024-09-12T00:38:32.040 INFO:tasks.workunit.client.0.smithi133.stderr: 7f77a6604640 / ms_dispatch 2024-09-12T00:38:32.040 INFO:tasks.workunit.client.0.smithi133.stderr: 7f77a7e07640 / io_context_pool 2024-09-12T00:38:32.040 INFO:tasks.workunit.client.0.smithi133.stderr: 7f78b3fff640 / msgr-worker-2 2024-09-12T00:38:32.040 INFO:tasks.workunit.client.0.smithi133.stderr: 7f78b9d3e640 / msgr-worker-1 2024-09-12T00:38:32.040 INFO:tasks.workunit.client.0.smithi133.stderr: 7f78ba53f640 / msgr-worker-0 2024-09-12T00:38:32.040 INFO:tasks.workunit.client.0.smithi133.stderr: 7f78bad40640 / io_context_pool 2024-09-12T00:38:32.040 INFO:tasks.workunit.client.0.smithi133.stderr: 7f78be12c800 / radosgw-admin 2024-09-12T00:38:32.040 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:38:32.040 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:38:32.040 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/log/ceph/ceph-client.admin.156536.log 2024-09-12T00:38:32.040 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:38:32.040 INFO:tasks.workunit.client.0.smithi133.stderr:--- begin dump of recent events --- 2024-09-12T00:38:32.041 INFO:tasks.workunit.client.0.smithi133.stderr: -499> 2024-09-12T00:38:31.700+0000 7f78be12c800 5 monclient: authenticate success, global_id 8469 2024-09-12T00:38:32.041 INFO:tasks.workunit.client.0.smithi133.stderr: -498> 2024-09-12T00:38:31.700+0000 7f77a7e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:32.041 INFO:tasks.workunit.client.0.smithi133.stderr: -497> 2024-09-12T00:38:31.700+0000 7f78be12c800 10 monclient: get_monmap_and_config success 2024-09-12T00:38:32.041 INFO:tasks.workunit.client.0.smithi133.stderr: -496> 2024-09-12T00:38:31.700+0000 7f78be12c800 4 set_mon_vals no callback set 2024-09-12T00:38:32.041 INFO:tasks.workunit.client.0.smithi133.stderr: -495> 2024-09-12T00:38:31.700+0000 7f77a7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:32.041 INFO:tasks.workunit.client.0.smithi133.stderr: -494> 2024-09-12T00:38:31.700+0000 7f77a7e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:32.041 INFO:tasks.workunit.client.0.smithi133.stderr: -493> 2024-09-12T00:38:31.700+0000 7f77a7e07640 10 monclient: dump: 2024-09-12T00:38:32.041 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:32.041 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:32.041 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.041 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.041 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:32.041 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.042 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:32.042 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:32.042 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:32.042 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.042 INFO:tasks.workunit.client.0.smithi133.stderr: -492> 2024-09-12T00:38:31.700+0000 7f78be12c800 10 monclient: shutdown 2024-09-12T00:38:32.042 INFO:tasks.workunit.client.0.smithi133.stderr: -491> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 asok(0x561524219630) unregister_commands rotate-key 2024-09-12T00:38:32.042 INFO:tasks.workunit.client.0.smithi133.stderr: -490> 2024-09-12T00:38:31.701+0000 7f78be12c800 10 monclient: build_initial_monmap 2024-09-12T00:38:32.042 INFO:tasks.workunit.client.0.smithi133.stderr: -489> 2024-09-12T00:38:31.701+0000 7f78be12c800 1 build_initial for_mkfs: 0 2024-09-12T00:38:32.042 INFO:tasks.workunit.client.0.smithi133.stderr: -488> 2024-09-12T00:38:31.701+0000 7f78be12c800 10 monclient: monmap: 2024-09-12T00:38:32.042 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:32.042 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:32.042 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:32.042 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:32.042 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:32.043 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.043 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:32.043 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:32.043 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:32.043 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.043 INFO:tasks.workunit.client.0.smithi133.stderr: -487> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding auth protocol: cephx 2024-09-12T00:38:32.043 INFO:tasks.workunit.client.0.smithi133.stderr: -486> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding auth protocol: cephx 2024-09-12T00:38:32.043 INFO:tasks.workunit.client.0.smithi133.stderr: -485> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding auth protocol: cephx 2024-09-12T00:38:32.043 INFO:tasks.workunit.client.0.smithi133.stderr: -484> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: secure 2024-09-12T00:38:32.043 INFO:tasks.workunit.client.0.smithi133.stderr: -483> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: crc 2024-09-12T00:38:32.043 INFO:tasks.workunit.client.0.smithi133.stderr: -482> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: secure 2024-09-12T00:38:32.043 INFO:tasks.workunit.client.0.smithi133.stderr: -481> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: crc 2024-09-12T00:38:32.043 INFO:tasks.workunit.client.0.smithi133.stderr: -480> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: secure 2024-09-12T00:38:32.043 INFO:tasks.workunit.client.0.smithi133.stderr: -479> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: crc 2024-09-12T00:38:32.044 INFO:tasks.workunit.client.0.smithi133.stderr: -478> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: crc 2024-09-12T00:38:32.044 INFO:tasks.workunit.client.0.smithi133.stderr: -477> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: secure 2024-09-12T00:38:32.044 INFO:tasks.workunit.client.0.smithi133.stderr: -476> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: crc 2024-09-12T00:38:32.044 INFO:tasks.workunit.client.0.smithi133.stderr: -475> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: secure 2024-09-12T00:38:32.044 INFO:tasks.workunit.client.0.smithi133.stderr: -474> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: crc 2024-09-12T00:38:32.044 INFO:tasks.workunit.client.0.smithi133.stderr: -473> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x56152443f750) adding con mode: secure 2024-09-12T00:38:32.044 INFO:tasks.workunit.client.0.smithi133.stderr: -472> 2024-09-12T00:38:31.701+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.044 INFO:tasks.workunit.client.0.smithi133.stderr: -471> 2024-09-12T00:38:31.701+0000 7f78be12c800 1 librados: starting msgr at 2024-09-12T00:38:32.044 INFO:tasks.workunit.client.0.smithi133.stderr: -470> 2024-09-12T00:38:31.701+0000 7f78be12c800 1 librados: starting objecter 2024-09-12T00:38:32.044 INFO:tasks.workunit.client.0.smithi133.stderr: -469> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 asok(0x561524219630) register_command objecter_requests hook 0x56152443d350 2024-09-12T00:38:32.044 INFO:tasks.workunit.client.0.smithi133.stderr: -468> 2024-09-12T00:38:31.701+0000 7f78be12c800 1 librados: setting wanted keys 2024-09-12T00:38:32.044 INFO:tasks.workunit.client.0.smithi133.stderr: -467> 2024-09-12T00:38:31.701+0000 7f78be12c800 1 librados: calling monclient init 2024-09-12T00:38:32.044 INFO:tasks.workunit.client.0.smithi133.stderr: -466> 2024-09-12T00:38:31.701+0000 7f78be12c800 10 monclient: init 2024-09-12T00:38:32.044 INFO:tasks.workunit.client.0.smithi133.stderr: -465> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding auth protocol: cephx 2024-09-12T00:38:32.045 INFO:tasks.workunit.client.0.smithi133.stderr: -464> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding auth protocol: cephx 2024-09-12T00:38:32.045 INFO:tasks.workunit.client.0.smithi133.stderr: -463> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding auth protocol: cephx 2024-09-12T00:38:32.045 INFO:tasks.workunit.client.0.smithi133.stderr: -462> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: secure 2024-09-12T00:38:32.045 INFO:tasks.workunit.client.0.smithi133.stderr: -461> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: crc 2024-09-12T00:38:32.045 INFO:tasks.workunit.client.0.smithi133.stderr: -460> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: secure 2024-09-12T00:38:32.045 INFO:tasks.workunit.client.0.smithi133.stderr: -459> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: crc 2024-09-12T00:38:32.045 INFO:tasks.workunit.client.0.smithi133.stderr: -458> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: secure 2024-09-12T00:38:32.045 INFO:tasks.workunit.client.0.smithi133.stderr: -457> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: crc 2024-09-12T00:38:32.045 INFO:tasks.workunit.client.0.smithi133.stderr: -456> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: crc 2024-09-12T00:38:32.045 INFO:tasks.workunit.client.0.smithi133.stderr: -455> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: secure 2024-09-12T00:38:32.045 INFO:tasks.workunit.client.0.smithi133.stderr: -454> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: crc 2024-09-12T00:38:32.045 INFO:tasks.workunit.client.0.smithi133.stderr: -453> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: secure 2024-09-12T00:38:32.045 INFO:tasks.workunit.client.0.smithi133.stderr: -452> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: crc 2024-09-12T00:38:32.045 INFO:tasks.workunit.client.0.smithi133.stderr: -451> 2024-09-12T00:38:31.701+0000 7f78be12c800 5 AuthRegistry(0x561524439ad0) adding con mode: secure 2024-09-12T00:38:32.046 INFO:tasks.workunit.client.0.smithi133.stderr: -450> 2024-09-12T00:38:31.701+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.046 INFO:tasks.workunit.client.0.smithi133.stderr: -449> 2024-09-12T00:38:31.702+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.046 INFO:tasks.workunit.client.0.smithi133.stderr: -448> 2024-09-12T00:38:31.702+0000 7f78be12c800 5 asok(0x561524219630) register_command rotate-key hook 0x561524439c18 2024-09-12T00:38:32.046 INFO:tasks.workunit.client.0.smithi133.stderr: -447> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:32.046 INFO:tasks.workunit.client.0.smithi133.stderr: -446> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:38:32.046 INFO:tasks.workunit.client.0.smithi133.stderr: -445> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-c con 0x5615242f0da0 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:32.046 INFO:tasks.workunit.client.0.smithi133.stderr: -444> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-a con 0x56152437c2a0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:32.046 INFO:tasks.workunit.client.0.smithi133.stderr: -443> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-b con 0x561524382420 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:32.046 INFO:tasks.workunit.client.0.smithi133.stderr: -442> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.046 INFO:tasks.workunit.client.0.smithi133.stderr: -441> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.046 INFO:tasks.workunit.client.0.smithi133.stderr: -440> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.046 INFO:tasks.workunit.client.0.smithi133.stderr: -439> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:32.046 INFO:tasks.workunit.client.0.smithi133.stderr: -438> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient(hunting): authenticate will time out at 2320.274182s 2024-09-12T00:38:32.047 INFO:tasks.workunit.client.0.smithi133.stderr: -437> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request con 0x5615242f0da0 auth_method 0 2024-09-12T00:38:32.047 INFO:tasks.workunit.client.0.smithi133.stderr: -436> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.047 INFO:tasks.workunit.client.0.smithi133.stderr: -435> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.047 INFO:tasks.workunit.client.0.smithi133.stderr: -434> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.047 INFO:tasks.workunit.client.0.smithi133.stderr: -433> 2024-09-12T00:38:31.702+0000 7f78b3fff640 10 monclient(hunting): get_auth_request con 0x56152437c2a0 auth_method 0 2024-09-12T00:38:32.047 INFO:tasks.workunit.client.0.smithi133.stderr: -432> 2024-09-12T00:38:31.702+0000 7f78b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.047 INFO:tasks.workunit.client.0.smithi133.stderr: -431> 2024-09-12T00:38:31.702+0000 7f78b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.047 INFO:tasks.workunit.client.0.smithi133.stderr: -430> 2024-09-12T00:38:31.702+0000 7f78b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.047 INFO:tasks.workunit.client.0.smithi133.stderr: -429> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.047 INFO:tasks.workunit.client.0.smithi133.stderr: -428> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.047 INFO:tasks.workunit.client.0.smithi133.stderr: -427> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.047 INFO:tasks.workunit.client.0.smithi133.stderr: -426> 2024-09-12T00:38:31.702+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.047 INFO:tasks.workunit.client.0.smithi133.stderr: -425> 2024-09-12T00:38:31.702+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.047 INFO:tasks.workunit.client.0.smithi133.stderr: -424> 2024-09-12T00:38:31.702+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.048 INFO:tasks.workunit.client.0.smithi133.stderr: -423> 2024-09-12T00:38:31.702+0000 7f78ba53f640 10 monclient(hunting): get_auth_request con 0x561524382420 auth_method 0 2024-09-12T00:38:32.048 INFO:tasks.workunit.client.0.smithi133.stderr: -422> 2024-09-12T00:38:31.702+0000 7f78ba53f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.048 INFO:tasks.workunit.client.0.smithi133.stderr: -421> 2024-09-12T00:38:31.702+0000 7f78ba53f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.048 INFO:tasks.workunit.client.0.smithi133.stderr: -420> 2024-09-12T00:38:31.702+0000 7f78ba53f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.048 INFO:tasks.workunit.client.0.smithi133.stderr: -419> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_done global_id 7928 payload 824 2024-09-12T00:38:32.048 INFO:tasks.workunit.client.0.smithi133.stderr: -418> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient: _finish_hunting 0 2024-09-12T00:38:32.048 INFO:tasks.workunit.client.0.smithi133.stderr: -417> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 1 monclient: found mon.noname-c 2024-09-12T00:38:32.048 INFO:tasks.workunit.client.0.smithi133.stderr: -416> 2024-09-12T00:38:31.702+0000 7f78b9d3e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:38:32.048 INFO:tasks.workunit.client.0.smithi133.stderr: -415> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:32.048 INFO:tasks.workunit.client.0.smithi133.stderr: -414> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:32.048 INFO:tasks.workunit.client.0.smithi133.stderr: -413> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: dump: 2024-09-12T00:38:32.048 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:32.048 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:32.048 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.049 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.049 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:32.049 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.049 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:32.049 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:32.049 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:32.049 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.049 INFO:tasks.workunit.client.0.smithi133.stderr: -412> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: _finish_auth 0 2024-09-12T00:38:32.049 INFO:tasks.workunit.client.0.smithi133.stderr: -411> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: _check_auth_tickets 2024-09-12T00:38:32.049 INFO:tasks.workunit.client.0.smithi133.stderr: -410> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:32.049 INFO:tasks.workunit.client.0.smithi133.stderr: -409> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:32.049 INFO:tasks.workunit.client.0.smithi133.stderr: -408> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:32.049 INFO:tasks.workunit.client.0.smithi133.stderr: -407> 2024-09-12T00:38:31.702+0000 7f77a6604640 10 monclient: dump: 2024-09-12T00:38:32.049 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:32.049 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:32.050 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.050 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.050 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:32.050 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.050 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:32.050 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:32.050 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:32.050 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.050 INFO:tasks.workunit.client.0.smithi133.stderr: -406> 2024-09-12T00:38:31.702+0000 7f78be12c800 5 monclient: authenticate success, global_id 7928 2024-09-12T00:38:32.050 INFO:tasks.workunit.client.0.smithi133.stderr: -405> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient: _renew_subs 2024-09-12T00:38:32.050 INFO:tasks.workunit.client.0.smithi133.stderr: -404> 2024-09-12T00:38:31.702+0000 7f77a7e07640 4 set_mon_vals no callback set 2024-09-12T00:38:32.050 INFO:tasks.workunit.client.0.smithi133.stderr: -403> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:38:32.050 INFO:tasks.workunit.client.0.smithi133.stderr: -402> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient: _renew_subs 2024-09-12T00:38:32.050 INFO:tasks.workunit.client.0.smithi133.stderr: -401> 2024-09-12T00:38:31.702+0000 7f78be12c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.133:3301/0 2024-09-12T00:38:32.051 INFO:tasks.workunit.client.0.smithi133.stderr: -400> 2024-09-12T00:38:31.702+0000 7f78be12c800 1 librados: init done 2024-09-12T00:38:32.051 INFO:tasks.workunit.client.0.smithi133.stderr: -399> 2024-09-12T00:38:31.704+0000 7f77a6604640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:38:32.051 INFO:tasks.workunit.client.0.smithi133.stderr: -398> 2024-09-12T00:38:31.704+0000 7f77a6604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:32.051 INFO:tasks.workunit.client.0.smithi133.stderr: -397> 2024-09-12T00:38:31.704+0000 7f77a6604640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:32.051 INFO:tasks.workunit.client.0.smithi133.stderr: -396> 2024-09-12T00:38:31.704+0000 7f78b3fff640 10 monclient: get_auth_request con 0x7f77a0076470 auth_method 0 2024-09-12T00:38:32.051 INFO:tasks.workunit.client.0.smithi133.stderr: -395> 2024-09-12T00:38:31.705+0000 7f78ba53f640 10 monclient: get_auth_request con 0x561524462310 auth_method 0 2024-09-12T00:38:32.051 INFO:tasks.workunit.client.0.smithi133.stderr: -394> 2024-09-12T00:38:31.705+0000 7f78b9d3e640 10 monclient: get_auth_request con 0x561524484f80 auth_method 0 2024-09-12T00:38:32.051 INFO:tasks.workunit.client.0.smithi133.stderr: -393> 2024-09-12T00:38:31.706+0000 7f78b3fff640 10 monclient: get_auth_request con 0x561524489450 auth_method 0 2024-09-12T00:38:32.051 INFO:tasks.workunit.client.0.smithi133.stderr: -392> 2024-09-12T00:38:31.707+0000 7f78ba53f640 10 monclient: get_auth_request con 0x5615244888b0 auth_method 0 2024-09-12T00:38:32.051 INFO:tasks.workunit.client.0.smithi133.stderr: -391> 2024-09-12T00:38:31.708+0000 7f78be12c800 10 monclient: build_initial_monmap 2024-09-12T00:38:32.051 INFO:tasks.workunit.client.0.smithi133.stderr: -390> 2024-09-12T00:38:31.708+0000 7f78be12c800 1 build_initial for_mkfs: 0 2024-09-12T00:38:32.051 INFO:tasks.workunit.client.0.smithi133.stderr: -389> 2024-09-12T00:38:31.708+0000 7f78be12c800 10 monclient: monmap: 2024-09-12T00:38:32.051 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:32.051 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:32.052 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:32.052 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:32.052 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:32.052 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.052 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:32.052 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:32.052 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:32.052 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.052 INFO:tasks.workunit.client.0.smithi133.stderr: -388> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding auth protocol: cephx 2024-09-12T00:38:32.052 INFO:tasks.workunit.client.0.smithi133.stderr: -387> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding auth protocol: cephx 2024-09-12T00:38:32.052 INFO:tasks.workunit.client.0.smithi133.stderr: -386> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding auth protocol: cephx 2024-09-12T00:38:32.052 INFO:tasks.workunit.client.0.smithi133.stderr: -385> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: secure 2024-09-12T00:38:32.052 INFO:tasks.workunit.client.0.smithi133.stderr: -384> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: crc 2024-09-12T00:38:32.052 INFO:tasks.workunit.client.0.smithi133.stderr: -383> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: secure 2024-09-12T00:38:32.053 INFO:tasks.workunit.client.0.smithi133.stderr: -382> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: crc 2024-09-12T00:38:32.053 INFO:tasks.workunit.client.0.smithi133.stderr: -381> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: secure 2024-09-12T00:38:32.053 INFO:tasks.workunit.client.0.smithi133.stderr: -380> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: crc 2024-09-12T00:38:32.053 INFO:tasks.workunit.client.0.smithi133.stderr: -379> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: crc 2024-09-12T00:38:32.053 INFO:tasks.workunit.client.0.smithi133.stderr: -378> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: secure 2024-09-12T00:38:32.053 INFO:tasks.workunit.client.0.smithi133.stderr: -377> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: crc 2024-09-12T00:38:32.053 INFO:tasks.workunit.client.0.smithi133.stderr: -376> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: secure 2024-09-12T00:38:32.053 INFO:tasks.workunit.client.0.smithi133.stderr: -375> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: crc 2024-09-12T00:38:32.053 INFO:tasks.workunit.client.0.smithi133.stderr: -374> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524491630) adding con mode: secure 2024-09-12T00:38:32.053 INFO:tasks.workunit.client.0.smithi133.stderr: -373> 2024-09-12T00:38:31.708+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.053 INFO:tasks.workunit.client.0.smithi133.stderr: -372> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 asok(0x561524219630) register_command objecter_requests cmddesc objecter_requests hook 0x561524494ae0 EEXIST 2024-09-12T00:38:32.053 INFO:tasks.workunit.client.0.smithi133.stderr: -371> 2024-09-12T00:38:31.708+0000 7f78be12c800 10 monclient: init 2024-09-12T00:38:32.053 INFO:tasks.workunit.client.0.smithi133.stderr: -370> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding auth protocol: cephx 2024-09-12T00:38:32.053 INFO:tasks.workunit.client.0.smithi133.stderr: -369> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding auth protocol: cephx 2024-09-12T00:38:32.053 INFO:tasks.workunit.client.0.smithi133.stderr: -368> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding auth protocol: cephx 2024-09-12T00:38:32.054 INFO:tasks.workunit.client.0.smithi133.stderr: -367> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: secure 2024-09-12T00:38:32.054 INFO:tasks.workunit.client.0.smithi133.stderr: -366> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: crc 2024-09-12T00:38:32.054 INFO:tasks.workunit.client.0.smithi133.stderr: -365> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: secure 2024-09-12T00:38:32.054 INFO:tasks.workunit.client.0.smithi133.stderr: -364> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: crc 2024-09-12T00:38:32.054 INFO:tasks.workunit.client.0.smithi133.stderr: -363> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: secure 2024-09-12T00:38:32.054 INFO:tasks.workunit.client.0.smithi133.stderr: -362> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: crc 2024-09-12T00:38:32.054 INFO:tasks.workunit.client.0.smithi133.stderr: -361> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: crc 2024-09-12T00:38:32.054 INFO:tasks.workunit.client.0.smithi133.stderr: -360> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: secure 2024-09-12T00:38:32.054 INFO:tasks.workunit.client.0.smithi133.stderr: -359> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: crc 2024-09-12T00:38:32.054 INFO:tasks.workunit.client.0.smithi133.stderr: -358> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: secure 2024-09-12T00:38:32.054 INFO:tasks.workunit.client.0.smithi133.stderr: -357> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: crc 2024-09-12T00:38:32.054 INFO:tasks.workunit.client.0.smithi133.stderr: -356> 2024-09-12T00:38:31.708+0000 7f78be12c800 5 AuthRegistry(0x561524490528) adding con mode: secure 2024-09-12T00:38:32.054 INFO:tasks.workunit.client.0.smithi133.stderr: -355> 2024-09-12T00:38:31.709+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.054 INFO:tasks.workunit.client.0.smithi133.stderr: -354> 2024-09-12T00:38:31.709+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.055 INFO:tasks.workunit.client.0.smithi133.stderr: -353> 2024-09-12T00:38:31.709+0000 7f78be12c800 5 asok(0x561524219630) register_command rotate-key cmddesc rotate-key hook 0x561524490670 EEXIST 2024-09-12T00:38:32.055 INFO:tasks.workunit.client.0.smithi133.stderr: -352> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:32.055 INFO:tasks.workunit.client.0.smithi133.stderr: -351> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:38:32.055 INFO:tasks.workunit.client.0.smithi133.stderr: -350> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-b con 0x5615244b8e00 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:32.055 INFO:tasks.workunit.client.0.smithi133.stderr: -349> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-a con 0x5615244b91e0 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:32.055 INFO:tasks.workunit.client.0.smithi133.stderr: -348> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-c con 0x5615244b7b10 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:32.055 INFO:tasks.workunit.client.0.smithi133.stderr: -347> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.055 INFO:tasks.workunit.client.0.smithi133.stderr: -346> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.055 INFO:tasks.workunit.client.0.smithi133.stderr: -345> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.055 INFO:tasks.workunit.client.0.smithi133.stderr: -344> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:32.055 INFO:tasks.workunit.client.0.smithi133.stderr: -343> 2024-09-12T00:38:31.709+0000 7f78be12c800 10 monclient(hunting): authenticate will time out at 2320.281417s 2024-09-12T00:38:32.055 INFO:tasks.workunit.client.0.smithi133.stderr: -342> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): get_auth_request con 0x5615244b91e0 auth_method 0 2024-09-12T00:38:32.055 INFO:tasks.workunit.client.0.smithi133.stderr: -341> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.055 INFO:tasks.workunit.client.0.smithi133.stderr: -340> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.056 INFO:tasks.workunit.client.0.smithi133.stderr: -339> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.056 INFO:tasks.workunit.client.0.smithi133.stderr: -338> 2024-09-12T00:38:31.709+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request con 0x5615244b7b10 auth_method 0 2024-09-12T00:38:32.056 INFO:tasks.workunit.client.0.smithi133.stderr: -337> 2024-09-12T00:38:31.709+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.056 INFO:tasks.workunit.client.0.smithi133.stderr: -336> 2024-09-12T00:38:31.709+0000 7f78b9d3e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.056 INFO:tasks.workunit.client.0.smithi133.stderr: -335> 2024-09-12T00:38:31.709+0000 7f78b9d3e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.056 INFO:tasks.workunit.client.0.smithi133.stderr: -334> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.056 INFO:tasks.workunit.client.0.smithi133.stderr: -333> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.056 INFO:tasks.workunit.client.0.smithi133.stderr: -332> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.056 INFO:tasks.workunit.client.0.smithi133.stderr: -331> 2024-09-12T00:38:31.709+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.056 INFO:tasks.workunit.client.0.smithi133.stderr: -330> 2024-09-12T00:38:31.709+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.056 INFO:tasks.workunit.client.0.smithi133.stderr: -329> 2024-09-12T00:38:31.709+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.056 INFO:tasks.workunit.client.0.smithi133.stderr: -328> 2024-09-12T00:38:31.709+0000 7f78b3fff640 10 monclient(hunting): get_auth_request con 0x5615244b8e00 auth_method 0 2024-09-12T00:38:32.056 INFO:tasks.workunit.client.0.smithi133.stderr: -327> 2024-09-12T00:38:31.709+0000 7f78b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.056 INFO:tasks.workunit.client.0.smithi133.stderr: -326> 2024-09-12T00:38:31.709+0000 7f78b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.056 INFO:tasks.workunit.client.0.smithi133.stderr: -325> 2024-09-12T00:38:31.709+0000 7f78b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.057 INFO:tasks.workunit.client.0.smithi133.stderr: -324> 2024-09-12T00:38:31.709+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.057 INFO:tasks.workunit.client.0.smithi133.stderr: -323> 2024-09-12T00:38:31.709+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.057 INFO:tasks.workunit.client.0.smithi133.stderr: -322> 2024-09-12T00:38:31.709+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.057 INFO:tasks.workunit.client.0.smithi133.stderr: -321> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient(hunting): handle_auth_done global_id 8475 payload 824 2024-09-12T00:38:32.057 INFO:tasks.workunit.client.0.smithi133.stderr: -320> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient: _finish_hunting 0 2024-09-12T00:38:32.057 INFO:tasks.workunit.client.0.smithi133.stderr: -319> 2024-09-12T00:38:31.709+0000 7f78ba53f640 1 monclient: found mon.noname-a 2024-09-12T00:38:32.057 INFO:tasks.workunit.client.0.smithi133.stderr: -318> 2024-09-12T00:38:31.709+0000 7f78ba53f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:38:32.057 INFO:tasks.workunit.client.0.smithi133.stderr: -317> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:32.057 INFO:tasks.workunit.client.0.smithi133.stderr: -316> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:32.057 INFO:tasks.workunit.client.0.smithi133.stderr: -315> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: dump: 2024-09-12T00:38:32.057 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:32.057 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:32.057 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.057 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.058 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:32.058 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.058 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:32.058 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:32.058 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:32.058 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.058 INFO:tasks.workunit.client.0.smithi133.stderr: -314> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:38:32.058 INFO:tasks.workunit.client.0.smithi133.stderr: -313> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:38:32.058 INFO:tasks.workunit.client.0.smithi133.stderr: -312> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:32.058 INFO:tasks.workunit.client.0.smithi133.stderr: -311> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:32.058 INFO:tasks.workunit.client.0.smithi133.stderr: -310> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:32.058 INFO:tasks.workunit.client.0.smithi133.stderr: -309> 2024-09-12T00:38:31.710+0000 7f779f7fe640 10 monclient: dump: 2024-09-12T00:38:32.058 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:32.058 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:32.058 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.059 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.059 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:32.059 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.059 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:32.059 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:32.059 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:32.059 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.059 INFO:tasks.workunit.client.0.smithi133.stderr: -308> 2024-09-12T00:38:31.710+0000 7f78be12c800 5 monclient: authenticate success, global_id 8475 2024-09-12T00:38:32.059 INFO:tasks.workunit.client.0.smithi133.stderr: -307> 2024-09-12T00:38:31.710+0000 7f78be12c800 10 monclient: _renew_subs 2024-09-12T00:38:32.059 INFO:tasks.workunit.client.0.smithi133.stderr: -306> 2024-09-12T00:38:31.710+0000 7f78be12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:38:32.059 INFO:tasks.workunit.client.0.smithi133.stderr: -305> 2024-09-12T00:38:31.710+0000 7f78bad40640 4 set_mon_vals no callback set 2024-09-12T00:38:32.059 INFO:tasks.workunit.client.0.smithi133.stderr: -304> 2024-09-12T00:38:31.710+0000 7f78be12c800 10 monclient: _renew_subs 2024-09-12T00:38:32.059 INFO:tasks.workunit.client.0.smithi133.stderr: -303> 2024-09-12T00:38:31.710+0000 7f78be12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:38:32.059 INFO:tasks.workunit.client.0.smithi133.stderr: -302> 2024-09-12T00:38:31.711+0000 7f779f7fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:38:32.060 INFO:tasks.workunit.client.0.smithi133.stderr: -301> 2024-09-12T00:38:31.711+0000 7f779f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:32.060 INFO:tasks.workunit.client.0.smithi133.stderr: -300> 2024-09-12T00:38:31.711+0000 7f779f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:32.060 INFO:tasks.workunit.client.0.smithi133.stderr: -299> 2024-09-12T00:38:31.712+0000 7f78b3fff640 10 monclient: get_auth_request con 0x7f7794076380 auth_method 0 2024-09-12T00:38:32.060 INFO:tasks.workunit.client.0.smithi133.stderr: -298> 2024-09-12T00:38:31.712+0000 7f78be12c800 10 monclient: get_monmap_and_config 2024-09-12T00:38:32.060 INFO:tasks.workunit.client.0.smithi133.stderr: -297> 2024-09-12T00:38:31.712+0000 7f78be12c800 10 monclient: build_initial_monmap 2024-09-12T00:38:32.060 INFO:tasks.workunit.client.0.smithi133.stderr: -296> 2024-09-12T00:38:31.712+0000 7f78be12c800 1 build_initial for_mkfs: 0 2024-09-12T00:38:32.060 INFO:tasks.workunit.client.0.smithi133.stderr: -295> 2024-09-12T00:38:31.712+0000 7f78be12c800 10 monclient: monmap: 2024-09-12T00:38:32.060 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:32.060 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:32.060 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:32.060 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:32.060 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:32.060 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.060 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:32.061 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:32.061 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:32.061 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.061 INFO:tasks.workunit.client.0.smithi133.stderr: -294> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding auth protocol: cephx 2024-09-12T00:38:32.061 INFO:tasks.workunit.client.0.smithi133.stderr: -293> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding auth protocol: cephx 2024-09-12T00:38:32.061 INFO:tasks.workunit.client.0.smithi133.stderr: -292> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding auth protocol: cephx 2024-09-12T00:38:32.061 INFO:tasks.workunit.client.0.smithi133.stderr: -291> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: secure 2024-09-12T00:38:32.061 INFO:tasks.workunit.client.0.smithi133.stderr: -290> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: crc 2024-09-12T00:38:32.061 INFO:tasks.workunit.client.0.smithi133.stderr: -289> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: secure 2024-09-12T00:38:32.061 INFO:tasks.workunit.client.0.smithi133.stderr: -288> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: crc 2024-09-12T00:38:32.061 INFO:tasks.workunit.client.0.smithi133.stderr: -287> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: secure 2024-09-12T00:38:32.061 INFO:tasks.workunit.client.0.smithi133.stderr: -286> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: crc 2024-09-12T00:38:32.061 INFO:tasks.workunit.client.0.smithi133.stderr: -285> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: crc 2024-09-12T00:38:32.061 INFO:tasks.workunit.client.0.smithi133.stderr: -284> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: secure 2024-09-12T00:38:32.062 INFO:tasks.workunit.client.0.smithi133.stderr: -283> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: crc 2024-09-12T00:38:32.062 INFO:tasks.workunit.client.0.smithi133.stderr: -282> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: secure 2024-09-12T00:38:32.062 INFO:tasks.workunit.client.0.smithi133.stderr: -281> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: crc 2024-09-12T00:38:32.062 INFO:tasks.workunit.client.0.smithi133.stderr: -280> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x5615244d8ce0) adding con mode: secure 2024-09-12T00:38:32.062 INFO:tasks.workunit.client.0.smithi133.stderr: -279> 2024-09-12T00:38:31.712+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.062 INFO:tasks.workunit.client.0.smithi133.stderr: -278> 2024-09-12T00:38:31.712+0000 7f78be12c800 10 monclient: init 2024-09-12T00:38:32.062 INFO:tasks.workunit.client.0.smithi133.stderr: -277> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding auth protocol: cephx 2024-09-12T00:38:32.062 INFO:tasks.workunit.client.0.smithi133.stderr: -276> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding auth protocol: cephx 2024-09-12T00:38:32.062 INFO:tasks.workunit.client.0.smithi133.stderr: -275> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding auth protocol: cephx 2024-09-12T00:38:32.062 INFO:tasks.workunit.client.0.smithi133.stderr: -274> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: secure 2024-09-12T00:38:32.062 INFO:tasks.workunit.client.0.smithi133.stderr: -273> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: crc 2024-09-12T00:38:32.062 INFO:tasks.workunit.client.0.smithi133.stderr: -272> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: secure 2024-09-12T00:38:32.062 INFO:tasks.workunit.client.0.smithi133.stderr: -271> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: crc 2024-09-12T00:38:32.062 INFO:tasks.workunit.client.0.smithi133.stderr: -270> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: secure 2024-09-12T00:38:32.063 INFO:tasks.workunit.client.0.smithi133.stderr: -269> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: crc 2024-09-12T00:38:32.063 INFO:tasks.workunit.client.0.smithi133.stderr: -268> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: crc 2024-09-12T00:38:32.063 INFO:tasks.workunit.client.0.smithi133.stderr: -267> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: secure 2024-09-12T00:38:32.063 INFO:tasks.workunit.client.0.smithi133.stderr: -266> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: crc 2024-09-12T00:38:32.063 INFO:tasks.workunit.client.0.smithi133.stderr: -265> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: secure 2024-09-12T00:38:32.063 INFO:tasks.workunit.client.0.smithi133.stderr: -264> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: crc 2024-09-12T00:38:32.063 INFO:tasks.workunit.client.0.smithi133.stderr: -263> 2024-09-12T00:38:31.712+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd2f40) adding con mode: secure 2024-09-12T00:38:32.063 INFO:tasks.workunit.client.0.smithi133.stderr: -262> 2024-09-12T00:38:31.712+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.063 INFO:tasks.workunit.client.0.smithi133.stderr: -261> 2024-09-12T00:38:31.713+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.063 INFO:tasks.workunit.client.0.smithi133.stderr: -260> 2024-09-12T00:38:31.713+0000 7f78be12c800 5 asok(0x561524219630) register_command rotate-key cmddesc rotate-key hook 0x7fff16cd3088 EEXIST 2024-09-12T00:38:32.063 INFO:tasks.workunit.client.0.smithi133.stderr: -259> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:32.063 INFO:tasks.workunit.client.0.smithi133.stderr: -258> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:38:32.063 INFO:tasks.workunit.client.0.smithi133.stderr: -257> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-b con 0x56152450d300 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:32.063 INFO:tasks.workunit.client.0.smithi133.stderr: -256> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-c con 0x5615244fdc50 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:32.064 INFO:tasks.workunit.client.0.smithi133.stderr: -255> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-a con 0x561524508730 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:32.064 INFO:tasks.workunit.client.0.smithi133.stderr: -254> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.064 INFO:tasks.workunit.client.0.smithi133.stderr: -253> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.064 INFO:tasks.workunit.client.0.smithi133.stderr: -252> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.064 INFO:tasks.workunit.client.0.smithi133.stderr: -251> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:32.064 INFO:tasks.workunit.client.0.smithi133.stderr: -250> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient(hunting): authenticate will time out at 2320.285276s 2024-09-12T00:38:32.064 INFO:tasks.workunit.client.0.smithi133.stderr: -249> 2024-09-12T00:38:31.713+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request con 0x561524508730 auth_method 0 2024-09-12T00:38:32.064 INFO:tasks.workunit.client.0.smithi133.stderr: -248> 2024-09-12T00:38:31.713+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.064 INFO:tasks.workunit.client.0.smithi133.stderr: -247> 2024-09-12T00:38:31.713+0000 7f78b9d3e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.064 INFO:tasks.workunit.client.0.smithi133.stderr: -246> 2024-09-12T00:38:31.713+0000 7f78b9d3e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.064 INFO:tasks.workunit.client.0.smithi133.stderr: -245> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): get_auth_request con 0x5615244fdc50 auth_method 0 2024-09-12T00:38:32.064 INFO:tasks.workunit.client.0.smithi133.stderr: -244> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.064 INFO:tasks.workunit.client.0.smithi133.stderr: -243> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.064 INFO:tasks.workunit.client.0.smithi133.stderr: -242> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.065 INFO:tasks.workunit.client.0.smithi133.stderr: -241> 2024-09-12T00:38:31.713+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.065 INFO:tasks.workunit.client.0.smithi133.stderr: -240> 2024-09-12T00:38:31.713+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.065 INFO:tasks.workunit.client.0.smithi133.stderr: -239> 2024-09-12T00:38:31.713+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.065 INFO:tasks.workunit.client.0.smithi133.stderr: -238> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.065 INFO:tasks.workunit.client.0.smithi133.stderr: -237> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.065 INFO:tasks.workunit.client.0.smithi133.stderr: -236> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.065 INFO:tasks.workunit.client.0.smithi133.stderr: -235> 2024-09-12T00:38:31.713+0000 7f78b3fff640 10 monclient(hunting): get_auth_request con 0x56152450d300 auth_method 0 2024-09-12T00:38:32.065 INFO:tasks.workunit.client.0.smithi133.stderr: -234> 2024-09-12T00:38:31.713+0000 7f78b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.065 INFO:tasks.workunit.client.0.smithi133.stderr: -233> 2024-09-12T00:38:31.713+0000 7f78b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.065 INFO:tasks.workunit.client.0.smithi133.stderr: -232> 2024-09-12T00:38:31.713+0000 7f78b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.065 INFO:tasks.workunit.client.0.smithi133.stderr: -231> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient(hunting): handle_auth_done global_id 7934 payload 274 2024-09-12T00:38:32.065 INFO:tasks.workunit.client.0.smithi133.stderr: -230> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient: _finish_hunting 0 2024-09-12T00:38:32.065 INFO:tasks.workunit.client.0.smithi133.stderr: -229> 2024-09-12T00:38:31.713+0000 7f78ba53f640 1 monclient: found mon.noname-c 2024-09-12T00:38:32.066 INFO:tasks.workunit.client.0.smithi133.stderr: -228> 2024-09-12T00:38:31.713+0000 7f78ba53f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.133:3301/0 2024-09-12T00:38:32.066 INFO:tasks.workunit.client.0.smithi133.stderr: -227> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:32.066 INFO:tasks.workunit.client.0.smithi133.stderr: -226> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:32.066 INFO:tasks.workunit.client.0.smithi133.stderr: -225> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: dump: 2024-09-12T00:38:32.066 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:32.066 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:32.066 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.066 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.066 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:32.066 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.066 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:32.066 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:32.066 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:32.066 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.066 INFO:tasks.workunit.client.0.smithi133.stderr: -224> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:38:32.067 INFO:tasks.workunit.client.0.smithi133.stderr: -223> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:38:32.067 INFO:tasks.workunit.client.0.smithi133.stderr: -222> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:32.067 INFO:tasks.workunit.client.0.smithi133.stderr: -221> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:32.067 INFO:tasks.workunit.client.0.smithi133.stderr: -220> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:32.067 INFO:tasks.workunit.client.0.smithi133.stderr: -219> 2024-09-12T00:38:31.713+0000 7f779d7fa640 10 monclient: dump: 2024-09-12T00:38:32.067 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:32.067 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:32.067 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.067 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.067 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:32.067 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.067 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:32.067 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:32.067 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:32.068 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.068 INFO:tasks.workunit.client.0.smithi133.stderr: -218> 2024-09-12T00:38:31.713+0000 7f78be12c800 5 monclient: authenticate success, global_id 7934 2024-09-12T00:38:32.068 INFO:tasks.workunit.client.0.smithi133.stderr: -217> 2024-09-12T00:38:31.713+0000 7f78be12c800 10 monclient: get_monmap_and_config success 2024-09-12T00:38:32.068 INFO:tasks.workunit.client.0.smithi133.stderr: -216> 2024-09-12T00:38:31.713+0000 7f78be12c800 4 set_mon_vals no callback set 2024-09-12T00:38:32.068 INFO:tasks.workunit.client.0.smithi133.stderr: -215> 2024-09-12T00:38:31.714+0000 7f78be12c800 10 monclient: shutdown 2024-09-12T00:38:32.068 INFO:tasks.workunit.client.0.smithi133.stderr: -214> 2024-09-12T00:38:31.714+0000 7f78be12c800 10 monclient: build_initial_monmap 2024-09-12T00:38:32.068 INFO:tasks.workunit.client.0.smithi133.stderr: -213> 2024-09-12T00:38:31.714+0000 7f78be12c800 1 build_initial for_mkfs: 0 2024-09-12T00:38:32.068 INFO:tasks.workunit.client.0.smithi133.stderr: -212> 2024-09-12T00:38:31.714+0000 7f78be12c800 10 monclient: monmap: 2024-09-12T00:38:32.068 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 0 2024-09-12T00:38:32.068 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:32.068 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 0.000000 2024-09-12T00:38:32.068 INFO:tasks.workunit.client.0.smithi133.stderr:created 0.000000 2024-09-12T00:38:32.068 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:32.068 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.069 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.noname-a 2024-09-12T00:38:32.069 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.noname-b 2024-09-12T00:38:32.069 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.noname-c 2024-09-12T00:38:32.069 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.069 INFO:tasks.workunit.client.0.smithi133.stderr: -211> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding auth protocol: cephx 2024-09-12T00:38:32.069 INFO:tasks.workunit.client.0.smithi133.stderr: -210> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding auth protocol: cephx 2024-09-12T00:38:32.069 INFO:tasks.workunit.client.0.smithi133.stderr: -209> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding auth protocol: cephx 2024-09-12T00:38:32.069 INFO:tasks.workunit.client.0.smithi133.stderr: -208> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: secure 2024-09-12T00:38:32.069 INFO:tasks.workunit.client.0.smithi133.stderr: -207> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: crc 2024-09-12T00:38:32.069 INFO:tasks.workunit.client.0.smithi133.stderr: -206> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: secure 2024-09-12T00:38:32.069 INFO:tasks.workunit.client.0.smithi133.stderr: -205> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: crc 2024-09-12T00:38:32.069 INFO:tasks.workunit.client.0.smithi133.stderr: -204> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: secure 2024-09-12T00:38:32.069 INFO:tasks.workunit.client.0.smithi133.stderr: -203> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: crc 2024-09-12T00:38:32.069 INFO:tasks.workunit.client.0.smithi133.stderr: -202> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: crc 2024-09-12T00:38:32.070 INFO:tasks.workunit.client.0.smithi133.stderr: -201> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: secure 2024-09-12T00:38:32.070 INFO:tasks.workunit.client.0.smithi133.stderr: -200> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: crc 2024-09-12T00:38:32.070 INFO:tasks.workunit.client.0.smithi133.stderr: -199> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: secure 2024-09-12T00:38:32.070 INFO:tasks.workunit.client.0.smithi133.stderr: -198> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: crc 2024-09-12T00:38:32.070 INFO:tasks.workunit.client.0.smithi133.stderr: -197> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 AuthRegistry(0x5615244dc860) adding con mode: secure 2024-09-12T00:38:32.070 INFO:tasks.workunit.client.0.smithi133.stderr: -196> 2024-09-12T00:38:31.714+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.070 INFO:tasks.workunit.client.0.smithi133.stderr: -195> 2024-09-12T00:38:31.714+0000 7f78be12c800 1 librados: starting msgr at 2024-09-12T00:38:32.070 INFO:tasks.workunit.client.0.smithi133.stderr: -194> 2024-09-12T00:38:31.714+0000 7f78be12c800 1 librados: starting objecter 2024-09-12T00:38:32.070 INFO:tasks.workunit.client.0.smithi133.stderr: -193> 2024-09-12T00:38:31.714+0000 7f78be12c800 5 asok(0x561524219630) register_command objecter_requests cmddesc objecter_requests hook 0x5615244de790 EEXIST 2024-09-12T00:38:32.070 INFO:tasks.workunit.client.0.smithi133.stderr: -192> 2024-09-12T00:38:31.715+0000 7f78be12c800 1 librados: setting wanted keys 2024-09-12T00:38:32.070 INFO:tasks.workunit.client.0.smithi133.stderr: -191> 2024-09-12T00:38:31.715+0000 7f78be12c800 1 librados: calling monclient init 2024-09-12T00:38:32.070 INFO:tasks.workunit.client.0.smithi133.stderr: -190> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient: init 2024-09-12T00:38:32.070 INFO:tasks.workunit.client.0.smithi133.stderr: -189> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding auth protocol: cephx 2024-09-12T00:38:32.070 INFO:tasks.workunit.client.0.smithi133.stderr: -188> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding auth protocol: cephx 2024-09-12T00:38:32.071 INFO:tasks.workunit.client.0.smithi133.stderr: -187> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding auth protocol: cephx 2024-09-12T00:38:32.071 INFO:tasks.workunit.client.0.smithi133.stderr: -186> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: secure 2024-09-12T00:38:32.071 INFO:tasks.workunit.client.0.smithi133.stderr: -185> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: crc 2024-09-12T00:38:32.071 INFO:tasks.workunit.client.0.smithi133.stderr: -184> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: secure 2024-09-12T00:38:32.071 INFO:tasks.workunit.client.0.smithi133.stderr: -183> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: crc 2024-09-12T00:38:32.071 INFO:tasks.workunit.client.0.smithi133.stderr: -182> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: secure 2024-09-12T00:38:32.071 INFO:tasks.workunit.client.0.smithi133.stderr: -181> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: crc 2024-09-12T00:38:32.071 INFO:tasks.workunit.client.0.smithi133.stderr: -180> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: crc 2024-09-12T00:38:32.071 INFO:tasks.workunit.client.0.smithi133.stderr: -179> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: secure 2024-09-12T00:38:32.071 INFO:tasks.workunit.client.0.smithi133.stderr: -178> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: crc 2024-09-12T00:38:32.071 INFO:tasks.workunit.client.0.smithi133.stderr: -177> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: secure 2024-09-12T00:38:32.071 INFO:tasks.workunit.client.0.smithi133.stderr: -176> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: crc 2024-09-12T00:38:32.071 INFO:tasks.workunit.client.0.smithi133.stderr: -175> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 AuthRegistry(0x5615244cd6c0) adding con mode: secure 2024-09-12T00:38:32.071 INFO:tasks.workunit.client.0.smithi133.stderr: -174> 2024-09-12T00:38:31.715+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.071 INFO:tasks.workunit.client.0.smithi133.stderr: -173> 2024-09-12T00:38:31.715+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.072 INFO:tasks.workunit.client.0.smithi133.stderr: -172> 2024-09-12T00:38:31.715+0000 7f78be12c800 5 asok(0x561524219630) register_command rotate-key cmddesc rotate-key hook 0x5615244cd808 EEXIST 2024-09-12T00:38:32.072 INFO:tasks.workunit.client.0.smithi133.stderr: -171> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient: _reopen_session rank -1 2024-09-12T00:38:32.072 INFO:tasks.workunit.client.0.smithi133.stderr: -170> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:38:32.072 INFO:tasks.workunit.client.0.smithi133.stderr: -169> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-c con 0x5615244fdc50 addr [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] 2024-09-12T00:38:32.072 INFO:tasks.workunit.client.0.smithi133.stderr: -168> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-b con 0x561524508730 addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-09-12T00:38:32.072 INFO:tasks.workunit.client.0.smithi133.stderr: -167> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): picked mon.noname-a con 0x56152450d300 addr [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] 2024-09-12T00:38:32.072 INFO:tasks.workunit.client.0.smithi133.stderr: -166> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.072 INFO:tasks.workunit.client.0.smithi133.stderr: -165> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.072 INFO:tasks.workunit.client.0.smithi133.stderr: -164> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:32.072 INFO:tasks.workunit.client.0.smithi133.stderr: -163> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): _renew_subs 2024-09-12T00:38:32.072 INFO:tasks.workunit.client.0.smithi133.stderr: -162> 2024-09-12T00:38:31.715+0000 7f78be12c800 10 monclient(hunting): authenticate will time out at 2320.287560s 2024-09-12T00:38:32.072 INFO:tasks.workunit.client.0.smithi133.stderr: -161> 2024-09-12T00:38:31.715+0000 7f78b3fff640 10 monclient(hunting): get_auth_request con 0x5615244fdc50 auth_method 0 2024-09-12T00:38:32.072 INFO:tasks.workunit.client.0.smithi133.stderr: -160> 2024-09-12T00:38:31.715+0000 7f78b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.072 INFO:tasks.workunit.client.0.smithi133.stderr: -159> 2024-09-12T00:38:31.715+0000 7f78b3fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.073 INFO:tasks.workunit.client.0.smithi133.stderr: -158> 2024-09-12T00:38:31.715+0000 7f78b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.073 INFO:tasks.workunit.client.0.smithi133.stderr: -157> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request con 0x56152450d300 auth_method 0 2024-09-12T00:38:32.073 INFO:tasks.workunit.client.0.smithi133.stderr: -156> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:32.073 INFO:tasks.workunit.client.0.smithi133.stderr: -155> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:32.073 INFO:tasks.workunit.client.0.smithi133.stderr: -154> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:32.073 INFO:tasks.workunit.client.0.smithi133.stderr: -153> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.073 INFO:tasks.workunit.client.0.smithi133.stderr: -152> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.073 INFO:tasks.workunit.client.0.smithi133.stderr: -151> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.073 INFO:tasks.workunit.client.0.smithi133.stderr: -150> 2024-09-12T00:38:31.715+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:32.073 INFO:tasks.workunit.client.0.smithi133.stderr: -149> 2024-09-12T00:38:31.715+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:32.073 INFO:tasks.workunit.client.0.smithi133.stderr: -148> 2024-09-12T00:38:31.715+0000 7f78b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:32.073 INFO:tasks.workunit.client.0.smithi133.stderr: -147> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient(hunting): handle_auth_done global_id 8481 payload 824 2024-09-12T00:38:32.073 INFO:tasks.workunit.client.0.smithi133.stderr: -146> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient: _finish_hunting 0 2024-09-12T00:38:32.073 INFO:tasks.workunit.client.0.smithi133.stderr: -145> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 1 monclient: found mon.noname-a 2024-09-12T00:38:32.073 INFO:tasks.workunit.client.0.smithi133.stderr: -144> 2024-09-12T00:38:31.715+0000 7f78b9d3e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.133:3300/0 2024-09-12T00:38:32.074 INFO:tasks.workunit.client.0.smithi133.stderr: -143> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:32.074 INFO:tasks.workunit.client.0.smithi133.stderr: -142> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:32.074 INFO:tasks.workunit.client.0.smithi133.stderr: -141> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: dump: 2024-09-12T00:38:32.074 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:32.074 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:32.074 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.074 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.074 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:32.074 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.074 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:32.074 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:32.074 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:32.074 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.074 INFO:tasks.workunit.client.0.smithi133.stderr: -140> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:38:32.075 INFO:tasks.workunit.client.0.smithi133.stderr: -139> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:38:32.075 INFO:tasks.workunit.client.0.smithi133.stderr: -138> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:32.075 INFO:tasks.workunit.client.0.smithi133.stderr: -137> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:32.075 INFO:tasks.workunit.client.0.smithi133.stderr: -136> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:32.075 INFO:tasks.workunit.client.0.smithi133.stderr: -135> 2024-09-12T00:38:31.716+0000 7f778b7fe640 10 monclient: dump: 2024-09-12T00:38:32.075 INFO:tasks.workunit.client.0.smithi133.stderr:epoch 1 2024-09-12T00:38:32.075 INFO:tasks.workunit.client.0.smithi133.stderr:fsid 9d5b883a-c64b-4bbd-824a-b1076948973e 2024-09-12T00:38:32.075 INFO:tasks.workunit.client.0.smithi133.stderr:last_changed 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.075 INFO:tasks.workunit.client.0.smithi133.stderr:created 2024-09-12T00:11:20.722636+0000 2024-09-12T00:38:32.075 INFO:tasks.workunit.client.0.smithi133.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:32.075 INFO:tasks.workunit.client.0.smithi133.stderr:election_strategy: 1 2024-09-12T00:38:32.075 INFO:tasks.workunit.client.0.smithi133.stderr:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2024-09-12T00:38:32.075 INFO:tasks.workunit.client.0.smithi133.stderr:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-12T00:38:32.075 INFO:tasks.workunit.client.0.smithi133.stderr:2: [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] mon.c 2024-09-12T00:38:32.075 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.076 INFO:tasks.workunit.client.0.smithi133.stderr: -134> 2024-09-12T00:38:31.716+0000 7f78be12c800 5 monclient: authenticate success, global_id 8481 2024-09-12T00:38:32.076 INFO:tasks.workunit.client.0.smithi133.stderr: -133> 2024-09-12T00:38:31.716+0000 7f78be12c800 10 monclient: _renew_subs 2024-09-12T00:38:32.076 INFO:tasks.workunit.client.0.smithi133.stderr: -132> 2024-09-12T00:38:31.716+0000 7f78be12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:38:32.076 INFO:tasks.workunit.client.0.smithi133.stderr: -131> 2024-09-12T00:38:31.716+0000 7f779d7fa640 4 set_mon_vals no callback set 2024-09-12T00:38:32.076 INFO:tasks.workunit.client.0.smithi133.stderr: -130> 2024-09-12T00:38:31.716+0000 7f78be12c800 10 monclient: _renew_subs 2024-09-12T00:38:32.076 INFO:tasks.workunit.client.0.smithi133.stderr: -129> 2024-09-12T00:38:31.716+0000 7f78be12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:38:32.076 INFO:tasks.workunit.client.0.smithi133.stderr: -128> 2024-09-12T00:38:31.716+0000 7f78be12c800 1 librados: init done 2024-09-12T00:38:32.076 INFO:tasks.workunit.client.0.smithi133.stderr: -127> 2024-09-12T00:38:31.716+0000 7f78be12c800 5 asok(0x561524219630) register_command cr dump hook 0x561524500998 2024-09-12T00:38:32.076 INFO:tasks.workunit.client.0.smithi133.stderr: -126> 2024-09-12T00:38:31.717+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.076 INFO:tasks.workunit.client.0.smithi133.stderr: -125> 2024-09-12T00:38:31.718+0000 7f778b7fe640 4 mgrc handle_mgr_map Got map version 6 2024-09-12T00:38:32.076 INFO:tasks.workunit.client.0.smithi133.stderr: -124> 2024-09-12T00:38:31.718+0000 7f778b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:32.076 INFO:tasks.workunit.client.0.smithi133.stderr: -123> 2024-09-12T00:38:31.718+0000 7f778b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.160:6808/2578085440,v1:172.21.15.160:6809/2578085440] 2024-09-12T00:38:32.076 INFO:tasks.workunit.client.0.smithi133.stderr: -122> 2024-09-12T00:38:31.718+0000 7f78b3fff640 10 monclient: get_auth_request con 0x7f7784076470 auth_method 0 2024-09-12T00:38:32.076 INFO:tasks.workunit.client.0.smithi133.stderr: -121> 2024-09-12T00:38:31.718+0000 7f78ba53f640 10 monclient: get_auth_request con 0x561524527690 auth_method 0 2024-09-12T00:38:32.077 INFO:tasks.workunit.client.0.smithi133.stderr: -120> 2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.077 INFO:tasks.workunit.client.0.smithi133.stderr: -119> 2024-09-12T00:38:31.719+0000 7f78be12c800 20 realm 2024-09-12T00:38:32.077 INFO:tasks.workunit.client.0.smithi133.stderr: -118> 2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.077 INFO:tasks.workunit.client.0.smithi133.stderr: -117> 2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.077 INFO:tasks.workunit.client.0.smithi133.stderr: -116> 2024-09-12T00:38:31.719+0000 7f78be12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:32.077 INFO:tasks.workunit.client.0.smithi133.stderr: -115> 2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.077 INFO:tasks.workunit.client.0.smithi133.stderr: -114> 2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.077 INFO:tasks.workunit.client.0.smithi133.stderr: -113> 2024-09-12T00:38:31.719+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.077 INFO:tasks.workunit.client.0.smithi133.stderr: -112> 2024-09-12T00:38:31.719+0000 7f78b3fff640 10 monclient: get_auth_request con 0x56152452b9f0 auth_method 0 2024-09-12T00:38:32.077 INFO:tasks.workunit.client.0.smithi133.stderr: -111> 2024-09-12T00:38:31.720+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:32.077 INFO:tasks.workunit.client.0.smithi133.stderr: -110> 2024-09-12T00:38:31.720+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.077 INFO:tasks.workunit.client.0.smithi133.stderr: -109> 2024-09-12T00:38:31.720+0000 7f78ba53f640 10 monclient: get_auth_request con 0x56152452f130 auth_method 0 2024-09-12T00:38:32.077 INFO:tasks.workunit.client.0.smithi133.stderr: -108> 2024-09-12T00:38:31.721+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:32.077 INFO:tasks.workunit.client.0.smithi133.stderr: -107> 2024-09-12T00:38:31.721+0000 7f78be12c800 20 searching for the correct realm 2024-09-12T00:38:32.078 INFO:tasks.workunit.client.0.smithi133.stderr: -106> 2024-09-12T00:38:31.721+0000 7f78b9d3e640 10 monclient: get_auth_request con 0x7f78b4072150 auth_method 0 2024-09-12T00:38:32.078 INFO:tasks.workunit.client.0.smithi133.stderr: -105> 2024-09-12T00:38:31.722+0000 7f78b3fff640 10 monclient: get_auth_request con 0x7f78a4066480 auth_method 0 2024-09-12T00:38:32.078 INFO:tasks.workunit.client.0.smithi133.stderr: -104> 2024-09-12T00:38:31.723+0000 7f78b3fff640 0 -- 172.21.15.133:0/1348478779 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f78a4066480 msgr2=0x7f78a40668a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:32.078 INFO:tasks.workunit.client.0.smithi133.stderr: -103> 2024-09-12T00:38:31.723+0000 7f778b7fe640 1 client.8481.objecter ms_handle_reset 0x7f78a4066480 session 0x7f78a4084040 osd.0 2024-09-12T00:38:32.078 INFO:tasks.workunit.client.0.smithi133.stderr: -102> 2024-09-12T00:38:31.723+0000 7f778b7fe640 10 monclient: _renew_subs 2024-09-12T00:38:32.078 INFO:tasks.workunit.client.0.smithi133.stderr: -101> 2024-09-12T00:38:31.723+0000 7f778b7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.133:3300/0 2024-09-12T00:38:32.078 INFO:tasks.workunit.client.0.smithi133.stderr: -100> 2024-09-12T00:38:31.723+0000 7f78b3fff640 10 monclient: get_auth_request con 0x7f7784086720 auth_method 0 2024-09-12T00:38:32.078 INFO:tasks.workunit.client.0.smithi133.stderr: -99> 2024-09-12T00:38:31.723+0000 7f78ba53f640 10 monclient: get_auth_request con 0x7f78b407ebd0 auth_method 0 2024-09-12T00:38:32.078 INFO:tasks.workunit.client.0.smithi133.stderr: -98> 2024-09-12T00:38:31.725+0000 7f78b9d3e640 10 monclient: get_auth_request con 0x7f78a40a7040 auth_method 0 2024-09-12T00:38:32.078 INFO:tasks.workunit.client.0.smithi133.stderr: -97> 2024-09-12T00:38:31.726+0000 7f78b3fff640 0 -- 172.21.15.133:0/1348478779 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f78ac017070 msgr2=0x7f78ac08bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:32.078 INFO:tasks.workunit.client.0.smithi133.stderr: -96> 2024-09-12T00:38:31.726+0000 7f78b3fff640 10 monclient: get_auth_request con 0x7f78ac017070 auth_method 0 2024-09-12T00:38:32.078 INFO:tasks.workunit.client.0.smithi133.stderr: -95> 2024-09-12T00:38:31.928+0000 7f78b3fff640 10 monclient: get_auth_request con 0x7f78ac017070 auth_method 0 2024-09-12T00:38:32.078 INFO:tasks.workunit.client.0.smithi133.stderr: -94> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:38:32.078 INFO:tasks.workunit.client.0.smithi133.stderr: -93> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:38:32.078 INFO:tasks.workunit.client.0.smithi133.stderr: -92> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:32.079 INFO:tasks.workunit.client.0.smithi133.stderr: -91> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:32.079 INFO:tasks.workunit.client.0.smithi133.stderr: -90> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:32.079 INFO:tasks.workunit.client.0.smithi133.stderr: -89> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:32.079 INFO:tasks.workunit.client.0.smithi133.stderr: -88> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.079 INFO:tasks.workunit.client.0.smithi133.stderr: -87> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.079 INFO:tasks.workunit.client.0.smithi133.stderr: -86> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.079 INFO:tasks.workunit.client.0.smithi133.stderr: -85> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:32.079 INFO:tasks.workunit.client.0.smithi133.stderr: -84> 2024-09-12T00:38:31.934+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.079 INFO:tasks.workunit.client.0.smithi133.stderr: -83> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:32.079 INFO:tasks.workunit.client.0.smithi133.stderr: -82> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 zone default found 2024-09-12T00:38:32.079 INFO:tasks.workunit.client.0.smithi133.stderr: -81> 2024-09-12T00:38:31.935+0000 7f78be12c800 4 Realm: () 2024-09-12T00:38:32.079 INFO:tasks.workunit.client.0.smithi133.stderr: -80> 2024-09-12T00:38:31.935+0000 7f78be12c800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:38:32.079 INFO:tasks.workunit.client.0.smithi133.stderr: -79> 2024-09-12T00:38:31.935+0000 7f78be12c800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:38:32.080 INFO:tasks.workunit.client.0.smithi133.stderr: -78> 2024-09-12T00:38:31.935+0000 7f78be12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:32.080 INFO:tasks.workunit.client.0.smithi133.stderr: -77> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 zonegroup default 2024-09-12T00:38:32.080 INFO:tasks.workunit.client.0.smithi133.stderr: -76> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.080 INFO:tasks.workunit.client.0.smithi133.stderr: -75> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.080 INFO:tasks.workunit.client.0.smithi133.stderr: -74> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.080 INFO:tasks.workunit.client.0.smithi133.stderr: -73> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.080 INFO:tasks.workunit.client.0.smithi133.stderr: -72> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.080 INFO:tasks.workunit.client.0.smithi133.stderr: -71> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.080 INFO:tasks.workunit.client.0.smithi133.stderr: -70> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 started sync module instance, tier type = 2024-09-12T00:38:32.080 INFO:tasks.workunit.client.0.smithi133.stderr: -69> 2024-09-12T00:38:31.935+0000 7f78be12c800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:38:32.080 INFO:tasks.workunit.client.0.smithi133.stderr: -68> 2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=0 2024-09-12T00:38:32.080 INFO:tasks.workunit.client.0.smithi133.stderr: -67> 2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=1 2024-09-12T00:38:32.080 INFO:tasks.workunit.client.0.smithi133.stderr: -66> 2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=2 2024-09-12T00:38:32.080 INFO:tasks.workunit.client.0.smithi133.stderr: -65> 2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=3 2024-09-12T00:38:32.080 INFO:tasks.workunit.client.0.smithi133.stderr: -64> 2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=4 2024-09-12T00:38:32.081 INFO:tasks.workunit.client.0.smithi133.stderr: -63> 2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=5 2024-09-12T00:38:32.081 INFO:tasks.workunit.client.0.smithi133.stderr: -62> 2024-09-12T00:38:31.945+0000 7f78be12c800 20 add_watcher() i=6 2024-09-12T00:38:32.081 INFO:tasks.workunit.client.0.smithi133.stderr: -61> 2024-09-12T00:38:31.947+0000 7f78be12c800 20 add_watcher() i=7 2024-09-12T00:38:32.081 INFO:tasks.workunit.client.0.smithi133.stderr: -60> 2024-09-12T00:38:31.947+0000 7f78be12c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:32.081 INFO:tasks.workunit.client.0.smithi133.stderr: -59> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding auth protocol: cephx 2024-09-12T00:38:32.081 INFO:tasks.workunit.client.0.smithi133.stderr: -58> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding auth protocol: cephx 2024-09-12T00:38:32.081 INFO:tasks.workunit.client.0.smithi133.stderr: -57> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding auth protocol: cephx 2024-09-12T00:38:32.081 INFO:tasks.workunit.client.0.smithi133.stderr: -56> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: secure 2024-09-12T00:38:32.081 INFO:tasks.workunit.client.0.smithi133.stderr: -55> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: crc 2024-09-12T00:38:32.081 INFO:tasks.workunit.client.0.smithi133.stderr: -54> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: secure 2024-09-12T00:38:32.081 INFO:tasks.workunit.client.0.smithi133.stderr: -53> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: crc 2024-09-12T00:38:32.081 INFO:tasks.workunit.client.0.smithi133.stderr: -52> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: secure 2024-09-12T00:38:32.081 INFO:tasks.workunit.client.0.smithi133.stderr: -51> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: crc 2024-09-12T00:38:32.081 INFO:tasks.workunit.client.0.smithi133.stderr: -50> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: crc 2024-09-12T00:38:32.082 INFO:tasks.workunit.client.0.smithi133.stderr: -49> 2024-09-12T00:38:31.948+0000 7f776bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:32.082 INFO:tasks.workunit.client.0.smithi133.stderr: -48> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: secure 2024-09-12T00:38:32.082 INFO:tasks.workunit.client.0.smithi133.stderr: -47> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: crc 2024-09-12T00:38:32.082 INFO:tasks.workunit.client.0.smithi133.stderr: -46> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: secure 2024-09-12T00:38:32.082 INFO:tasks.workunit.client.0.smithi133.stderr: -45> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: crc 2024-09-12T00:38:32.082 INFO:tasks.workunit.client.0.smithi133.stderr: -44> 2024-09-12T00:38:31.948+0000 7f78be12c800 5 AuthRegistry(0x7fff16cd3420) adding con mode: secure 2024-09-12T00:38:32.082 INFO:tasks.workunit.client.0.smithi133.stderr: -43> 2024-09-12T00:38:31.949+0000 7f78be12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:32.082 INFO:tasks.workunit.client.0.smithi133.stderr: -42> 2024-09-12T00:38:31.949+0000 7f78be12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:32.082 INFO:tasks.workunit.client.0.smithi133.stderr: -41> 2024-09-12T00:38:31.949+0000 7f78be12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:32.082 INFO:tasks.workunit.client.0.smithi133.stderr: -40> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command cache list hook 0x561524500ec0 2024-09-12T00:38:32.082 INFO:tasks.workunit.client.0.smithi133.stderr: -39> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command cache inspect hook 0x561524500ec0 2024-09-12T00:38:32.082 INFO:tasks.workunit.client.0.smithi133.stderr: -38> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command cache erase hook 0x561524500ec0 2024-09-12T00:38:32.082 INFO:tasks.workunit.client.0.smithi133.stderr: -37> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command cache zap hook 0x561524500ec0 2024-09-12T00:38:32.082 INFO:tasks.workunit.client.0.smithi133.stderr: -36> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 note: GC not initialized 2024-09-12T00:38:32.083 INFO:tasks.workunit.client.0.smithi133.stderr: -35> 2024-09-12T00:38:31.949+0000 7f776affd640 20 reqs_thread_entry: start 2024-09-12T00:38:32.083 INFO:tasks.workunit.client.0.smithi133.stderr: -34> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command sync trace show hook 0x7f78a404e730 2024-09-12T00:38:32.083 INFO:tasks.workunit.client.0.smithi133.stderr: -33> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command sync trace history hook 0x7f78a404e730 2024-09-12T00:38:32.083 INFO:tasks.workunit.client.0.smithi133.stderr: -32> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command sync trace active hook 0x7f78a404e730 2024-09-12T00:38:32.083 INFO:tasks.workunit.client.0.smithi133.stderr: -31> 2024-09-12T00:38:31.949+0000 7f78be12c800 5 asok(0x561524219630) register_command sync trace active_short hook 0x7f78a404e730 2024-09-12T00:38:32.083 INFO:tasks.workunit.client.0.smithi133.stderr: -30> 2024-09-12T00:38:31.949+0000 7f78be12c800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:32.083 INFO:tasks.workunit.client.0.smithi133.stderr: -29> 2024-09-12T00:38:31.949+0000 7f78be12c800 20 Filter name: none 2024-09-12T00:38:32.083 INFO:tasks.workunit.client.0.smithi133.stderr: -28> 2024-09-12T00:38:31.949+0000 7f7768ff9640 20 reqs_thread_entry: start 2024-09-12T00:38:32.083 INFO:tasks.workunit.client.0.smithi133.stderr: -27> 2024-09-12T00:38:31.949+0000 7f78be12c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:38:32.083 INFO:tasks.workunit.client.0.smithi133.stderr: -26> 2024-09-12T00:38:31.949+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.083 INFO:tasks.workunit.client.0.smithi133.stderr: -25> 2024-09-12T00:38:31.950+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:38:32.083 INFO:tasks.workunit.client.0.smithi133.stderr: -24> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:38:32.083 INFO:tasks.workunit.client.0.smithi133.stderr: -23> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:38:32.083 INFO:tasks.workunit.client.0.smithi133.stderr: -22> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:38:32.083 INFO:tasks.workunit.client.0.smithi133.stderr: -21> 2024-09-12T00:38:31.950+0000 7f78be12c800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.084 INFO:tasks.workunit.client.0.smithi133.stderr: -20> 2024-09-12T00:38:31.950+0000 7f78be12c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:38:32.084 INFO:tasks.workunit.client.0.smithi133.stderr: -19> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:32.084 INFO:tasks.workunit.client.0.smithi133.stderr: -18> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:32.084 INFO:tasks.workunit.client.0.smithi133.stderr: -17> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:32.084 INFO:tasks.workunit.client.0.smithi133.stderr: -16> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:32.084 INFO:tasks.workunit.client.0.smithi133.stderr: -15> 2024-09-12T00:38:31.950+0000 7f78be12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:38:32.084 INFO:tasks.workunit.client.0.smithi133.stderr: -14> 2024-09-12T00:38:31.951+0000 7f78be12c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:38:32.084 INFO:tasks.workunit.client.0.smithi133.stderr: -13> 2024-09-12T00:38:31.956+0000 7f78be12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:32.084 INFO:tasks.workunit.client.0.smithi133.stderr: -12> 2024-09-12T00:38:31.956+0000 7f78be12c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:32.084 INFO:tasks.workunit.client.0.smithi133.stderr: -11> 2024-09-12T00:38:31.956+0000 7f78be12c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:32.084 INFO:tasks.workunit.client.0.smithi133.stderr: -10> 2024-09-12T00:38:31.956+0000 7f78be12c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:38:32.084 INFO:tasks.workunit.client.0.smithi133.stderr: -9> 2024-09-12T00:38:31.956+0000 7f779d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497083 cookie 94648803755760 notifier 8481 bl.length()=911 2024-09-12T00:38:32.084 INFO:tasks.workunit.client.0.smithi133.stderr: -8> 2024-09-12T00:38:31.956+0000 7f779d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:32.084 INFO:tasks.workunit.client.0.smithi133.stderr: -7> 2024-09-12T00:38:31.956+0000 7f779d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:32.085 INFO:tasks.workunit.client.0.smithi133.stderr: -6> 2024-09-12T00:38:31.956+0000 7f779d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:32.085 INFO:tasks.workunit.client.0.smithi133.stderr: -5> 2024-09-12T00:38:31.958+0000 7f78be12c800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:38:32.085 INFO:tasks.workunit.client.0.smithi133.stderr: -4> 2024-09-12T00:38:31.958+0000 7f78be12c800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:38:32.085 INFO:tasks.workunit.client.0.smithi133.stderr: -3> 2024-09-12T00:38:31.958+0000 7f78be12c800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:38:32.085 INFO:tasks.workunit.client.0.smithi133.stderr: -2> 2024-09-12T00:38:31.958+0000 7f78be12c800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:38:32.085 INFO:tasks.workunit.client.0.smithi133.stderr: -1> 2024-09-12T00:38:31.962+0000 7f78be12c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f78be12c800 time 2024-09-12T00:38:31.962409+0000 2024-09-12T00:38:32.085 INFO:tasks.workunit.client.0.smithi133.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:32.085 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.085 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:32.085 INFO:tasks.workunit.client.0.smithi133.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f78bf78c71a] 2024-09-12T00:38:32.085 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f78bf78c8d8] 2024-09-12T00:38:32.085 INFO:tasks.workunit.client.0.smithi133.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561522b24641] 2024-09-12T00:38:32.085 INFO:tasks.workunit.client.0.smithi133.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561522b3438a] 2024-09-12T00:38:32.086 INFO:tasks.workunit.client.0.smithi133.stderr: 5: main() 2024-09-12T00:38:32.086 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f78be429590] 2024-09-12T00:38:32.086 INFO:tasks.workunit.client.0.smithi133.stderr: 7: __libc_start_main() 2024-09-12T00:38:32.086 INFO:tasks.workunit.client.0.smithi133.stderr: 8: _start() 2024-09-12T00:38:32.086 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.086 INFO:tasks.workunit.client.0.smithi133.stderr: 0> 2024-09-12T00:38:31.962+0000 7f78be12c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:32.086 INFO:tasks.workunit.client.0.smithi133.stderr: in thread 7f78be12c800 thread_name:radosgw-admin 2024-09-12T00:38:32.086 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.086 INFO:tasks.workunit.client.0.smithi133.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:32.086 INFO:tasks.workunit.client.0.smithi133.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f78be43e6f0] 2024-09-12T00:38:32.086 INFO:tasks.workunit.client.0.smithi133.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f78be48b99c] 2024-09-12T00:38:32.086 INFO:tasks.workunit.client.0.smithi133.stderr: 3: raise() 2024-09-12T00:38:32.086 INFO:tasks.workunit.client.0.smithi133.stderr: 4: abort() 2024-09-12T00:38:32.086 INFO:tasks.workunit.client.0.smithi133.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f78bf78c774] 2024-09-12T00:38:32.086 INFO:tasks.workunit.client.0.smithi133.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f78bf78c8d8] 2024-09-12T00:38:32.087 INFO:tasks.workunit.client.0.smithi133.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561522b24641] 2024-09-12T00:38:32.087 INFO:tasks.workunit.client.0.smithi133.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561522b3438a] 2024-09-12T00:38:32.087 INFO:tasks.workunit.client.0.smithi133.stderr: 9: main() 2024-09-12T00:38:32.087 INFO:tasks.workunit.client.0.smithi133.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f78be429590] 2024-09-12T00:38:32.087 INFO:tasks.workunit.client.0.smithi133.stderr: 11: __libc_start_main() 2024-09-12T00:38:32.087 INFO:tasks.workunit.client.0.smithi133.stderr: 12: _start() 2024-09-12T00:38:32.087 INFO:tasks.workunit.client.0.smithi133.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:32.087 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:38:32.087 INFO:tasks.workunit.client.0.smithi133.stderr:--- logging levels --- 2024-09-12T00:38:32.087 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 none 2024-09-12T00:38:32.087 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 lockdep 2024-09-12T00:38:32.087 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 context 2024-09-12T00:38:32.087 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 crush 2024-09-12T00:38:32.087 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds 2024-09-12T00:38:32.087 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_balancer 2024-09-12T00:38:32.088 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_locker 2024-09-12T00:38:32.088 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log 2024-09-12T00:38:32.088 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_log_expire 2024-09-12T00:38:32.088 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mds_migrator 2024-09-12T00:38:32.088 INFO:tasks.workunit.client.0.smithi133.stderr: 3/ 5 mds_quiesce 2024-09-12T00:38:32.088 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 buffer 2024-09-12T00:38:32.088 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 timer 2024-09-12T00:38:32.088 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 filer 2024-09-12T00:38:32.088 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 striper 2024-09-12T00:38:32.088 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 1 objecter 2024-09-12T00:38:32.088 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rados 2024-09-12T00:38:32.088 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd 2024-09-12T00:38:32.088 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_mirror 2024-09-12T00:38:32.088 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_replay 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 rbd_pwl 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 journaler 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objectcacher 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 client 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 osd 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 optracker 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 objclass 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 filestore 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 journal 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 ms 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mon 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi133.stderr: 0/10 monc 2024-09-12T00:38:32.089 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 paxos 2024-09-12T00:38:32.090 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 tp 2024-09-12T00:38:32.090 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 auth 2024-09-12T00:38:32.090 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 crypto 2024-09-12T00:38:32.090 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 finisher 2024-09-12T00:38:32.090 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 reserver 2024-09-12T00:38:32.090 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 heartbeatmap 2024-09-12T00:38:32.090 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 perfcounter 2024-09-12T00:38:32.090 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw 2024-09-12T00:38:32.090 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_sync 2024-09-12T00:38:32.090 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_datacache 2024-09-12T00:38:32.090 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_access 2024-09-12T00:38:32.090 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:38:32.090 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_flight 2024-09-12T00:38:32.090 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:38:32.090 INFO:tasks.workunit.client.0.smithi133.stderr: 20/20 rgw_notification 2024-09-12T00:38:32.091 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 javaclient 2024-09-12T00:38:32.091 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 asok 2024-09-12T00:38:32.091 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 1 throttle 2024-09-12T00:38:32.091 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 0 refs 2024-09-12T00:38:32.091 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 compressor 2024-09-12T00:38:32.091 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluestore 2024-09-12T00:38:32.091 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 bluefs 2024-09-12T00:38:32.091 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 3 bdev 2024-09-12T00:38:32.091 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 kstore 2024-09-12T00:38:32.091 INFO:tasks.workunit.client.0.smithi133.stderr: 4/ 5 rocksdb 2024-09-12T00:38:32.091 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 fuse 2024-09-12T00:38:32.091 INFO:tasks.workunit.client.0.smithi133.stderr: 2/ 5 mgr 2024-09-12T00:38:32.091 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mgrc 2024-09-12T00:38:32.091 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 dpdk 2024-09-12T00:38:32.091 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 eventtrace 2024-09-12T00:38:32.092 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 prioritycache 2024-09-12T00:38:32.092 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 test 2024-09-12T00:38:32.092 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:38:32.092 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cephsqlite 2024-09-12T00:38:32.092 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:38:32.092 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore 2024-09-12T00:38:32.092 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_onode 2024-09-12T00:38:32.092 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_odata 2024-09-12T00:38:32.092 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_omap 2024-09-12T00:38:32.092 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_tm 2024-09-12T00:38:32.092 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_t 2024-09-12T00:38:32.092 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:38:32.092 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_epm 2024-09-12T00:38:32.092 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_lba 2024-09-12T00:38:32.092 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:38:32.093 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_cache 2024-09-12T00:38:32.093 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_journal 2024-09-12T00:38:32.093 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_device 2024-09-12T00:38:32.093 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 seastore_backref 2024-09-12T00:38:32.093 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 alienstore 2024-09-12T00:38:32.093 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 mclock 2024-09-12T00:38:32.093 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 cyanstore 2024-09-12T00:38:32.093 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 ceph_exporter 2024-09-12T00:38:32.093 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 memstore 2024-09-12T00:38:32.093 INFO:tasks.workunit.client.0.smithi133.stderr: 1/ 5 trace 2024-09-12T00:38:32.093 INFO:tasks.workunit.client.0.smithi133.stderr: 0/ 5 ceph_dedup 2024-09-12T00:38:32.093 INFO:tasks.workunit.client.0.smithi133.stderr: -2/-2 (syslog threshold) 2024-09-12T00:38:32.093 INFO:tasks.workunit.client.0.smithi133.stderr: 99/99 (stderr threshold) 2024-09-12T00:38:32.093 INFO:tasks.workunit.client.0.smithi133.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:38:32.093 INFO:tasks.workunit.client.0.smithi133.stderr: 7f7768ff9640 / http_manager 2024-09-12T00:38:32.094 INFO:tasks.workunit.client.0.smithi133.stderr: 7f776affd640 / http_manager 2024-09-12T00:38:32.094 INFO:tasks.workunit.client.0.smithi133.stderr: 7f776bfff640 / rgw_dt_lg_renew 2024-09-12T00:38:32.094 INFO:tasks.workunit.client.0.smithi133.stderr: 7f778b7fe640 / ms_dispatch 2024-09-12T00:38:32.094 INFO:tasks.workunit.client.0.smithi133.stderr: 7f779d7fa640 / io_context_pool 2024-09-12T00:38:32.094 INFO:tasks.workunit.client.0.smithi133.stderr: 7f779f7fe640 / ms_dispatch 2024-09-12T00:38:32.094 INFO:tasks.workunit.client.0.smithi133.stderr: 7f77a6604640 / ms_dispatch 2024-09-12T00:38:32.094 INFO:tasks.workunit.client.0.smithi133.stderr: 7f77a7e07640 / io_context_pool 2024-09-12T00:38:32.094 INFO:tasks.workunit.client.0.smithi133.stderr: 7f78b3fff640 / msgr-worker-2 2024-09-12T00:38:32.094 INFO:tasks.workunit.client.0.smithi133.stderr: 7f78b9d3e640 / msgr-worker-1 2024-09-12T00:38:32.094 INFO:tasks.workunit.client.0.smithi133.stderr: 7f78ba53f640 / msgr-worker-0 2024-09-12T00:38:32.094 INFO:tasks.workunit.client.0.smithi133.stderr: 7f78bad40640 / io_context_pool 2024-09-12T00:38:32.094 INFO:tasks.workunit.client.0.smithi133.stderr: 7f78be12c800 / radosgw-admin 2024-09-12T00:38:32.094 INFO:tasks.workunit.client.0.smithi133.stderr: max_recent 500 2024-09-12T00:38:32.094 INFO:tasks.workunit.client.0.smithi133.stderr: max_new 1000 2024-09-12T00:38:32.094 INFO:tasks.workunit.client.0.smithi133.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:38:31.963804Z_d45e6a5a-f88a-4f5b-86c8-3b908db582cd/log 2024-09-12T00:38:32.095 INFO:tasks.workunit.client.0.smithi133.stderr:--- end dump of recent events --- 2024-09-12T00:38:32.095 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:38:32.096 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:32.096 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:32.096 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.038+0000 7fee36296800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.096 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.039+0000 7fee36296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.096 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.039+0000 7fee36296800 20 realm 2024-09-12T00:38:32.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.039+0000 7fee36296800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.039+0000 7fee36296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.039+0000 7fee36296800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:32.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.039+0000 7fee36296800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.040+0000 7fee36296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.040+0000 7fee36296800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.040+0000 7fee36296800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:32.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.040+0000 7fee36296800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.041+0000 7fee36296800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:32.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.041+0000 7fee36296800 20 searching for the correct realm 2024-09-12T00:38:32.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.043+0000 7fee2b57f640 0 -- 172.21.15.133:0/4074178575 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fee1c03c030 msgr2=0x7fee1c03e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:32.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.047+0000 7fee2b57f640 0 -- 172.21.15.133:0/4074178575 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fee240a4ec0 msgr2=0x7fee240acc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.254+0000 7fee36296800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:38:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.254+0000 7fee36296800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:38:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.254+0000 7fee36296800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.254+0000 7fee36296800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.254+0000 7fee36296800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.254+0000 7fee36296800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.254+0000 7fee36296800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.254+0000 7fee36296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.254+0000 7fee36296800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.254+0000 7fee36296800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.254+0000 7fee36296800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.255+0000 7fee36296800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:32.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.255+0000 7fee36296800 20 zone default found 2024-09-12T00:38:32.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.255+0000 7fee36296800 4 Realm: () 2024-09-12T00:38:32.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.255+0000 7fee36296800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:38:32.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.255+0000 7fee36296800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:38:32.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.255+0000 7fee36296800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:32.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.255+0000 7fee36296800 20 zonegroup default 2024-09-12T00:38:32.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.255+0000 7fee36296800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.255+0000 7fee36296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.255+0000 7fee36296800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.255+0000 7fee36296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.255+0000 7fee36296800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.256+0000 7fee36296800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.256+0000 7fee36296800 20 started sync module instance, tier type = 2024-09-12T00:38:32.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.256+0000 7fee36296800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:38:32.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.265+0000 7fee36296800 20 add_watcher() i=0 2024-09-12T00:38:32.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.265+0000 7fee36296800 20 add_watcher() i=1 2024-09-12T00:38:32.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.265+0000 7fee36296800 20 add_watcher() i=2 2024-09-12T00:38:32.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.265+0000 7fee36296800 20 add_watcher() i=3 2024-09-12T00:38:32.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.265+0000 7fee36296800 20 add_watcher() i=4 2024-09-12T00:38:32.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.265+0000 7fee36296800 20 add_watcher() i=5 2024-09-12T00:38:32.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.265+0000 7fee36296800 20 add_watcher() i=6 2024-09-12T00:38:32.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.267+0000 7fee36296800 20 add_watcher() i=7 2024-09-12T00:38:32.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.267+0000 7fee36296800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:32.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.268+0000 7fece9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:32.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.269+0000 7fee36296800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:32.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.269+0000 7fee36296800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:32.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.269+0000 7fee36296800 5 note: GC not initialized 2024-09-12T00:38:32.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.269+0000 7fece8fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:32.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.269+0000 7fee36296800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:32.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.269+0000 7fee36296800 20 Filter name: none 2024-09-12T00:38:32.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.269+0000 7fec627fc640 20 reqs_thread_entry: start 2024-09-12T00:38:32.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.269+0000 7fee36296800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.270+0000 7fee36296800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:38:32.269 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.270+0000 7fee36296800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.270+0000 7fee36296800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:38:32.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.270+0000 7fee36296800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:32.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.270+0000 7fee36296800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.271+0000 7fee36296800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:38:32.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.271+0000 7fee36296800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.270 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.271+0000 7fee36296800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:38:32.271 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.271+0000 7fee36296800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:32.271 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.272+0000 7fece9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:32.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.275+0000 7fee36296800 20 remove_watcher() i=0 2024-09-12T00:38:32.273 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.275+0000 7fee36296800 2 removed watcher, disabling cache 2024-09-12T00:38:32.274 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.276+0000 7fee36296800 20 remove_watcher() i=1 2024-09-12T00:38:32.275 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.277+0000 7fee36296800 20 remove_watcher() i=2 2024-09-12T00:38:32.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.278+0000 7fee36296800 20 remove_watcher() i=3 2024-09-12T00:38:32.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.279+0000 7fee36296800 20 remove_watcher() i=4 2024-09-12T00:38:32.279 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.280+0000 7fee36296800 20 remove_watcher() i=5 2024-09-12T00:38:32.280 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.281+0000 7fee36296800 20 remove_watcher() i=6 2024-09-12T00:38:32.281 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.282+0000 7fee36296800 20 remove_watcher() i=7 2024-09-12T00:38:32.330 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:38:32.359 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:32.359 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:32.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.398+0000 7fd6f9534800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.400+0000 7fd6f9534800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.400+0000 7fd6f9534800 20 realm 2024-09-12T00:38:32.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.400+0000 7fd6f9534800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.400+0000 7fd6f9534800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.400+0000 7fd6f9534800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:32.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.400+0000 7fd6f9534800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.400+0000 7fd6f9534800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.400+0000 7fd6f9534800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.401+0000 7fd6f9534800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:32.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.401+0000 7fd6f9534800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.402+0000 7fd6f9534800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:32.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.402+0000 7fd6f9534800 20 searching for the correct realm 2024-09-12T00:38:32.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.404+0000 7fd6ecab6640 0 -- 172.21.15.133:0/1929300302 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fd6e0041060 msgr2=0x7fd6e0073aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:32.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.609+0000 7fd6ecab6640 0 -- 172.21.15.133:0/1929300302 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fd6e801a040 msgr2=0x7fd6e80611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.816+0000 7fd6f9534800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:38:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.816+0000 7fd6f9534800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:38:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.816+0000 7fd6f9534800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.816+0000 7fd6f9534800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.816+0000 7fd6f9534800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.816+0000 7fd6f9534800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.816+0000 7fd6f9534800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.816+0000 7fd6f9534800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.815 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.816+0000 7fd6f9534800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.816+0000 7fd6f9534800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:32.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.816+0000 7fd6f9534800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.817+0000 7fd6f9534800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:32.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.817+0000 7fd6f9534800 20 zone default found 2024-09-12T00:38:32.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.817+0000 7fd6f9534800 4 Realm: () 2024-09-12T00:38:32.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.817+0000 7fd6f9534800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:38:32.817 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.817+0000 7fd6f9534800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:38:32.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.817+0000 7fd6f9534800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:32.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.817+0000 7fd6f9534800 20 zonegroup default 2024-09-12T00:38:32.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.817+0000 7fd6f9534800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.817+0000 7fd6f9534800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.817+0000 7fd6f9534800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.817+0000 7fd6f9534800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.817+0000 7fd6f9534800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.818+0000 7fd6f9534800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.818+0000 7fd6f9534800 20 started sync module instance, tier type = 2024-09-12T00:38:32.818 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.818+0000 7fd6f9534800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:38:32.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.828+0000 7fd6f9534800 20 add_watcher() i=0 2024-09-12T00:38:32.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.828+0000 7fd6f9534800 20 add_watcher() i=1 2024-09-12T00:38:32.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.828+0000 7fd6f9534800 20 add_watcher() i=2 2024-09-12T00:38:32.826 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.828+0000 7fd6f9534800 20 add_watcher() i=3 2024-09-12T00:38:32.827 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.828+0000 7fd6f9534800 20 add_watcher() i=4 2024-09-12T00:38:32.827 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.828+0000 7fd6f9534800 20 add_watcher() i=5 2024-09-12T00:38:32.827 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.828+0000 7fd6f9534800 20 add_watcher() i=6 2024-09-12T00:38:32.827 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.829+0000 7fd6f9534800 20 add_watcher() i=7 2024-09-12T00:38:32.827 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.829+0000 7fd6f9534800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:32.829 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.831+0000 7fd5ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:32.830 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.831+0000 7fd6f9534800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:32.830 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.831+0000 7fd6f9534800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:32.831 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.831+0000 7fd6f9534800 5 note: GC not initialized 2024-09-12T00:38:32.831 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.831+0000 7fd5aa7e4640 20 reqs_thread_entry: start 2024-09-12T00:38:32.831 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.832+0000 7fd6f9534800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:32.831 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.832+0000 7fd6f9534800 20 Filter name: none 2024-09-12T00:38:32.831 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.832+0000 7fd51bfff640 20 reqs_thread_entry: start 2024-09-12T00:38:32.831 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.832+0000 7fd6f9534800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:38:32.831 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.832+0000 7fd6f9534800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.832+0000 7fd6f9534800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:38:32.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.832+0000 7fd6f9534800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:38:32.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.832+0000 7fd6f9534800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:38:32.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.832+0000 7fd6f9534800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:38:32.832 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.832+0000 7fd6f9534800 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.833+0000 7fd6f9534800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:38:32.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.833+0000 7fd6f9534800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:38:32.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.833+0000 7fd6f9534800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:38:32.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.833+0000 7fd6f9534800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:32.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.833+0000 7fd6f9534800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:38:32.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.833+0000 7fd6f9534800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:38:32.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.833+0000 7fd6f9534800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:38:32.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.833+0000 7fd6f9534800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:38:32.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.833+0000 7fd6f9534800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:38:32.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.833+0000 7fd6f9534800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:38:32.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.834+0000 7fd6f9534800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:38:32.833 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.834+0000 7fd6f9534800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:38:32.834 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.835+0000 7fd5ab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:32.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.837+0000 7fd6f9534800 20 remove_watcher() i=0 2024-09-12T00:38:32.836 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.837+0000 7fd6f9534800 2 removed watcher, disabling cache 2024-09-12T00:38:32.837 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.838+0000 7fd6f9534800 20 remove_watcher() i=1 2024-09-12T00:38:32.838 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.839+0000 7fd6f9534800 20 remove_watcher() i=2 2024-09-12T00:38:32.839 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.840+0000 7fd6f9534800 20 remove_watcher() i=3 2024-09-12T00:38:32.840 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.842+0000 7fd6f9534800 20 remove_watcher() i=4 2024-09-12T00:38:32.842 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.843+0000 7fd6f9534800 20 remove_watcher() i=5 2024-09-12T00:38:32.843 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.844+0000 7fd6f9534800 20 remove_watcher() i=6 2024-09-12T00:38:32.844 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:38:32.845+0000 7fd6f9534800 20 remove_watcher() i=7 2024-09-12T00:39:02.885 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T00:39:02.916 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:02.916 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:03.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.159+0000 7f7a70865640 0 --2- 172.21.15.133:0/1771603914 >> [v2:172.21.15.133:3301/0,v1:172.21.15.133:6790/0] conn(0x563c6785bd70 0x563c6785e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:39:03.161 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.162+0000 7f7a7b575800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.163 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.164+0000 7f7a7b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.165+0000 7f7a7b575800 20 realm 2024-09-12T00:39:03.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.165+0000 7f7a7b575800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.165+0000 7f7a7b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.165+0000 7f7a7b575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:03.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.165+0000 7f7a7b575800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.165+0000 7f7a7b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.164 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.165+0000 7f7a7b575800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.166+0000 7f7a7b575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:03.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.166+0000 7f7a7b575800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.167+0000 7f7a7b575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:03.165 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.167+0000 7f7a7b575800 20 searching for the correct realm 2024-09-12T00:39:03.166 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.168+0000 7f7a79066640 0 -- 172.21.15.133:0/1771603914 >> [v2:172.21.15.133:6816/1011460824,v1:172.21.15.133:6817/1011460824] conn(0x7f7a7409c040 msgr2=0x7f7a74066fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:03.373 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.374+0000 7f7a79066640 0 -- 172.21.15.133:0/1771603914 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x563c6787e0f0 msgr2=0x563c67880540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:03.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.382+0000 7f7a7b575800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:03.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.382+0000 7f7a7b575800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:03.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.382+0000 7f7a7b575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:03.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.382+0000 7f7a7b575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:03.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.382+0000 7f7a7b575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:03.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.382+0000 7f7a7b575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:03.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.382+0000 7f7a7b575800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.382+0000 7f7a7b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.382+0000 7f7a7b575800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.383+0000 7f7a7b575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:03.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.383+0000 7f7a7b575800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.383+0000 7f7a7b575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:03.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.383+0000 7f7a7b575800 20 zone default found 2024-09-12T00:39:03.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.383+0000 7f7a7b575800 4 Realm: () 2024-09-12T00:39:03.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.383+0000 7f7a7b575800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:03.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.383+0000 7f7a7b575800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:03.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.383+0000 7f7a7b575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:03.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.383+0000 7f7a7b575800 20 zonegroup default 2024-09-12T00:39:03.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.383+0000 7f7a7b575800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.383+0000 7f7a7b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.383+0000 7f7a7b575800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.384+0000 7f7a7b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.384+0000 7f7a7b575800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.384+0000 7f7a7b575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.384+0000 7f7a7b575800 20 started sync module instance, tier type = 2024-09-12T00:39:03.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.384+0000 7f7a7b575800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:03.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.394+0000 7f7a7b575800 20 add_watcher() i=0 2024-09-12T00:39:03.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.394+0000 7f7a7b575800 20 add_watcher() i=1 2024-09-12T00:39:03.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.394+0000 7f7a7b575800 20 add_watcher() i=2 2024-09-12T00:39:03.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.394+0000 7f7a7b575800 20 add_watcher() i=3 2024-09-12T00:39:03.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.394+0000 7f7a7b575800 20 add_watcher() i=4 2024-09-12T00:39:03.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.394+0000 7f7a7b575800 20 add_watcher() i=5 2024-09-12T00:39:03.393 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.394+0000 7f7a7b575800 20 add_watcher() i=6 2024-09-12T00:39:03.394 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.395+0000 7f7a7b575800 20 add_watcher() i=7 2024-09-12T00:39:03.394 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.395+0000 7f7a7b575800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:03.395 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.397+0000 7f792f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:03.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.397+0000 7f7a7b575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:03.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.397+0000 7f7a7b575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:03.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.397+0000 7f7a7b575800 5 note: GC not initialized 2024-09-12T00:39:03.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.398+0000 7f792e7e4640 20 reqs_thread_entry: start 2024-09-12T00:39:03.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.398+0000 7f7a7b575800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:03.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.398+0000 7f7a7b575800 20 Filter name: none 2024-09-12T00:39:03.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.398+0000 7f789ffff640 20 reqs_thread_entry: start 2024-09-12T00:39:03.398 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.398+0000 7f7a7b575800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:03.398 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.398+0000 7f7a7b575800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.398 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.398+0000 7f7a7b575800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:39:03.398 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.398+0000 7f7a7b575800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:39:03.398 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.398+0000 7f7a7b575800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:03.398 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.398+0000 7f7a7b575800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:39:03.398 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.398+0000 7f7a7b575800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.398 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.399+0000 7f7a7b575800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:39:03.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.399+0000 7f7a7b575800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:39:03.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.399+0000 7f7a7b575800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:39:03.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.399+0000 7f7a7b575800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:03.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.399+0000 7f7a7b575800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:03.399 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.399+0000 7f7a7b575800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:39:03.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.403+0000 7f792f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:03.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.406+0000 7f7a7b575800 20 remove_watcher() i=0 2024-09-12T00:39:03.404 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.406+0000 7f7a7b575800 2 removed watcher, disabling cache 2024-09-12T00:39:03.405 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.407+0000 7f7a7b575800 20 remove_watcher() i=1 2024-09-12T00:39:03.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.408+0000 7f7a7b575800 20 remove_watcher() i=2 2024-09-12T00:39:03.407 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.409+0000 7f7a7b575800 20 remove_watcher() i=3 2024-09-12T00:39:03.409 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.410+0000 7f7a7b575800 20 remove_watcher() i=4 2024-09-12T00:39:03.410 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.411+0000 7f7a7b575800 20 remove_watcher() i=5 2024-09-12T00:39:03.411 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.412+0000 7f7a7b575800 20 remove_watcher() i=6 2024-09-12T00:39:03.412 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.413+0000 7f7a7b575800 20 remove_watcher() i=7 2024-09-12T00:39:03.426 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:39:03.456 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:03.457 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:03.496 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.498+0000 7f35d7c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.499+0000 7f35d7c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.499+0000 7f35d7c0f800 20 realm 2024-09-12T00:39:03.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.499+0000 7f35d7c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.498 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.499+0000 7f35d7c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.499+0000 7f35d7c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:03.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.500+0000 7f35d7c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.500+0000 7f35d7c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.500+0000 7f35d7c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.500+0000 7f35d7c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:03.499 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.500+0000 7f35d7c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.501+0000 7f35d7c0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:03.500 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.501+0000 7f35d7c0f800 20 searching for the correct realm 2024-09-12T00:39:03.502 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.503+0000 7f35d2b21640 0 -- 172.21.15.133:0/2117816962 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f35bc075c20 msgr2=0x7f35bc088bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:03.505 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.507+0000 7f35d2b21640 0 -- 172.21.15.133:0/2117816962 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f35c4081410 msgr2=0x7f35c4081890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:03.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.714+0000 7f35d7c0f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:03.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.714+0000 7f35d7c0f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:03.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.714+0000 7f35d7c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:03.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.714+0000 7f35d7c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:03.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.714+0000 7f35d7c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:03.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.714+0000 7f35d7c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:03.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.714+0000 7f35d7c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.713 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.714+0000 7f35d7c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.714+0000 7f35d7c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.715+0000 7f35d7c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:03.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.715+0000 7f35d7c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.715+0000 7f35d7c0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:03.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.715+0000 7f35d7c0f800 20 zone default found 2024-09-12T00:39:03.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.715+0000 7f35d7c0f800 4 Realm: () 2024-09-12T00:39:03.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.715+0000 7f35d7c0f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:03.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.715+0000 7f35d7c0f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:03.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.715+0000 7f35d7c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:03.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.715+0000 7f35d7c0f800 20 zonegroup default 2024-09-12T00:39:03.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.715+0000 7f35d7c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.715+0000 7f35d7c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.715+0000 7f35d7c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.716+0000 7f35d7c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.716+0000 7f35d7c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.716+0000 7f35d7c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.716+0000 7f35d7c0f800 20 started sync module instance, tier type = 2024-09-12T00:39:03.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.716+0000 7f35d7c0f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:03.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.727+0000 7f35d7c0f800 20 add_watcher() i=0 2024-09-12T00:39:03.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.727+0000 7f35d7c0f800 20 add_watcher() i=1 2024-09-12T00:39:03.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.727+0000 7f35d7c0f800 20 add_watcher() i=2 2024-09-12T00:39:03.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.727+0000 7f35d7c0f800 20 add_watcher() i=3 2024-09-12T00:39:03.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.727+0000 7f35d7c0f800 20 add_watcher() i=4 2024-09-12T00:39:03.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.727+0000 7f35d7c0f800 20 add_watcher() i=5 2024-09-12T00:39:03.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.727+0000 7f35d7c0f800 20 add_watcher() i=6 2024-09-12T00:39:03.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.728+0000 7f35d7c0f800 20 add_watcher() i=7 2024-09-12T00:39:03.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.728+0000 7f35d7c0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:03.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.729+0000 7f3489fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:03.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.730+0000 7f35d7c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:03.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.730+0000 7f35d7c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:03.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.730+0000 7f35d7c0f800 5 note: GC not initialized 2024-09-12T00:39:03.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.730+0000 7f3488fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:03.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.730+0000 7f35d7c0f800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:03.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.730+0000 7f35d7c0f800 20 Filter name: none 2024-09-12T00:39:03.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.730+0000 7f34027fc640 20 reqs_thread_entry: start 2024-09-12T00:39:03.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.730+0000 7f35d7c0f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:03.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.730+0000 7f35d7c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.730 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.731+0000 7f35d7c0f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:39:03.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.731+0000 7f35d7c0f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:39:03.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.731+0000 7f35d7c0f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:03.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.731+0000 7f35d7c0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:39:03.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.731+0000 7f35d7c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.731+0000 7f35d7c0f800 20 rados_obj.operate() r=0 bl.length=454 2024-09-12T00:39:03.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.731+0000 7f35d7c0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:39:03.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.731+0000 7f35d7c0f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:39:03.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.731+0000 7f35d7c0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:03.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.731+0000 7f35d7c0f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:03.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.731+0000 7f35d7c0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:39:03.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.732+0000 7f35d7c0f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:39:03.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.732+0000 7f35d7c0f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:39:03.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.732+0000 7f35d7c0f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:39:03.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.732+0000 7f35d7c0f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:39:03.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.732+0000 7f35d7c0f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:39:03.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.732+0000 7f35d7c0f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:39:03.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.734+0000 7f3489fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:03.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.736+0000 7f35d7c0f800 20 remove_watcher() i=0 2024-09-12T00:39:03.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.736+0000 7f35d7c0f800 2 removed watcher, disabling cache 2024-09-12T00:39:03.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.737+0000 7f35d7c0f800 20 remove_watcher() i=1 2024-09-12T00:39:03.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.738+0000 7f35d7c0f800 20 remove_watcher() i=2 2024-09-12T00:39:03.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.739+0000 7f35d7c0f800 20 remove_watcher() i=3 2024-09-12T00:39:03.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.740+0000 7f35d7c0f800 20 remove_watcher() i=4 2024-09-12T00:39:03.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.741+0000 7f35d7c0f800 20 remove_watcher() i=5 2024-09-12T00:39:03.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.742+0000 7f35d7c0f800 20 remove_watcher() i=6 2024-09-12T00:39:03.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.743+0000 7f35d7c0f800 20 remove_watcher() i=7 2024-09-12T00:39:03.753 INFO:tasks.workunit.client.0.smithi133.stderr:check reshard logrecord successfully 2024-09-12T00:39:03.753 INFO:tasks.workunit.client.0.smithi133.stderr: test: reshard versioned bucket 2024-09-12T00:39:03.754 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:39:03.783 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:03.783 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:03.820 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.821+0000 7f0d16e13800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.823+0000 7f0d16e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.823+0000 7f0d16e13800 20 realm 2024-09-12T00:39:03.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.823+0000 7f0d16e13800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.823+0000 7f0d16e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.823+0000 7f0d16e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:03.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.823+0000 7f0d16e13800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.823+0000 7f0d16e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:03.822 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.823+0000 7f0d16e13800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.824+0000 7f0d16e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:03.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.824+0000 7f0d16e13800 20 rados->read ofs=0 len=0 2024-09-12T00:39:03.823 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.825+0000 7f0d16e13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:03.824 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.825+0000 7f0d16e13800 20 searching for the correct realm 2024-09-12T00:39:03.825 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:03.827+0000 7f0d09d47640 0 -- 172.21.15.133:0/3768390213 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f0cfc045020 msgr2=0x7f0cfc06f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:04.031 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.033+0000 7f0d09d47640 0 -- 172.21.15.133:0/3768390213 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f0d0406bc20 msgr2=0x7f0d0408ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:04.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.240+0000 7f0d16e13800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:04.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.240+0000 7f0d16e13800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:04.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.240+0000 7f0d16e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:04.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.240+0000 7f0d16e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:04.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.240+0000 7f0d16e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:04.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.240+0000 7f0d16e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:04.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.240+0000 7f0d16e13800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.241+0000 7f0d16e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:04.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.241+0000 7f0d16e13800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.241+0000 7f0d16e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:04.240 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.241+0000 7f0d16e13800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.241 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.241+0000 7f0d16e13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:04.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.241+0000 7f0d16e13800 20 zone default found 2024-09-12T00:39:04.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.241+0000 7f0d16e13800 4 Realm: () 2024-09-12T00:39:04.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.241+0000 7f0d16e13800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:04.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.241+0000 7f0d16e13800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:04.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.241+0000 7f0d16e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:04.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.241+0000 7f0d16e13800 20 zonegroup default 2024-09-12T00:39:04.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.241+0000 7f0d16e13800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.242+0000 7f0d16e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:04.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.242+0000 7f0d16e13800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.242+0000 7f0d16e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:04.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.242+0000 7f0d16e13800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.242 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.242+0000 7f0d16e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:04.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.242+0000 7f0d16e13800 20 started sync module instance, tier type = 2024-09-12T00:39:04.243 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.242+0000 7f0d16e13800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:04.251 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.252+0000 7f0d16e13800 20 add_watcher() i=0 2024-09-12T00:39:04.251 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.252+0000 7f0d16e13800 20 add_watcher() i=1 2024-09-12T00:39:04.251 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.252+0000 7f0d16e13800 20 add_watcher() i=2 2024-09-12T00:39:04.251 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.252+0000 7f0d16e13800 20 add_watcher() i=3 2024-09-12T00:39:04.251 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.252+0000 7f0d16e13800 20 add_watcher() i=4 2024-09-12T00:39:04.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.252+0000 7f0d16e13800 20 add_watcher() i=5 2024-09-12T00:39:04.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.252+0000 7f0d16e13800 20 add_watcher() i=6 2024-09-12T00:39:04.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.254+0000 7f0d16e13800 20 add_watcher() i=7 2024-09-12T00:39:04.252 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.254+0000 7f0d16e13800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:04.254 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.255+0000 7f0bc8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:04.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.256+0000 7f0d16e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:04.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.256+0000 7f0d16e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:04.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.256+0000 7f0d16e13800 5 note: GC not initialized 2024-09-12T00:39:04.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.256+0000 7f0b437fe640 20 reqs_thread_entry: start 2024-09-12T00:39:04.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.256+0000 7f0d16e13800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:04.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.256+0000 7f0d16e13800 20 Filter name: none 2024-09-12T00:39:04.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.256+0000 7f0b417fa640 20 reqs_thread_entry: start 2024-09-12T00:39:04.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.256+0000 7f0d16e13800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.257+0000 7f0d16e13800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:04.256 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.257+0000 7f0d16e13800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.258+0000 7f0d16e13800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:04.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.258+0000 7f0d16e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:04.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.258+0000 7f0d16e13800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.258+0000 7f0d16e13800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:04.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.258+0000 7f0d16e13800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.259+0000 7f0d16e13800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:04.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.259+0000 7f0d16e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:04.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.260+0000 7f0bc8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:04.261 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.262+0000 7f0d16e13800 20 remove_watcher() i=0 2024-09-12T00:39:04.261 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.262+0000 7f0d16e13800 2 removed watcher, disabling cache 2024-09-12T00:39:04.262 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.263+0000 7f0d16e13800 20 remove_watcher() i=1 2024-09-12T00:39:04.263 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.264+0000 7f0d16e13800 20 remove_watcher() i=2 2024-09-12T00:39:04.264 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.265+0000 7f0d16e13800 20 remove_watcher() i=3 2024-09-12T00:39:04.265 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.266+0000 7f0d16e13800 20 remove_watcher() i=4 2024-09-12T00:39:04.266 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.267+0000 7f0d16e13800 20 remove_watcher() i=5 2024-09-12T00:39:04.267 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.268+0000 7f0d16e13800 20 remove_watcher() i=6 2024-09-12T00:39:04.268 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.269+0000 7f0d16e13800 20 remove_watcher() i=7 2024-09-12T00:39:04.280 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:39:04.280 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:39:04.280 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: myver id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T00:39:04.280 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:39:04.281 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-09-12T00:39:04.313 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:04.313 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:04.351 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.352+0000 7f8a03339800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.353+0000 7f8a03339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:04.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.353+0000 7f8a03339800 20 realm 2024-09-12T00:39:04.352 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.353+0000 7f8a03339800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.353+0000 7f8a03339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:04.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.353+0000 7f8a03339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:04.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.353+0000 7f8a03339800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.354+0000 7f8a03339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:04.353 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.354+0000 7f8a03339800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.354+0000 7f8a03339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:04.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.354+0000 7f8a03339800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.355+0000 7f8a03339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:04.354 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.355+0000 7f8a03339800 20 searching for the correct realm 2024-09-12T00:39:04.356 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.358+0000 7f89ff7c8640 0 -- 172.21.15.133:0/3964441764 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f89f8036400 msgr2=0x7f89f8036860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:04.561 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.563+0000 7f89fefc7640 0 -- 172.21.15.133:0/3964441764 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x5653c6956b50 msgr2=0x5653c6958f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:04.567 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.568+0000 7f8a03339800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:04.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.568+0000 7f8a03339800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:04.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.568+0000 7f8a03339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:04.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.568+0000 7f8a03339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:04.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.568+0000 7f8a03339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:04.568 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.568+0000 7f8a03339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:04.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.568+0000 7f8a03339800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.568+0000 7f8a03339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:04.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.568+0000 7f8a03339800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.568+0000 7f8a03339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:04.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.568+0000 7f8a03339800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.569+0000 7f8a03339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:04.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.569+0000 7f8a03339800 20 zone default found 2024-09-12T00:39:04.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.569+0000 7f8a03339800 4 Realm: () 2024-09-12T00:39:04.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.569+0000 7f8a03339800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:04.569 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.569+0000 7f8a03339800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:04.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.569+0000 7f8a03339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:04.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.569+0000 7f8a03339800 20 zonegroup default 2024-09-12T00:39:04.570 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.569+0000 7f8a03339800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.569+0000 7f8a03339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:04.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.569+0000 7f8a03339800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.569+0000 7f8a03339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:04.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.569+0000 7f8a03339800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.570+0000 7f8a03339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:04.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.570+0000 7f8a03339800 20 started sync module instance, tier type = 2024-09-12T00:39:04.571 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.570+0000 7f8a03339800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:04.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.580+0000 7f8a03339800 20 add_watcher() i=0 2024-09-12T00:39:04.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.580+0000 7f8a03339800 20 add_watcher() i=1 2024-09-12T00:39:04.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.580+0000 7f8a03339800 20 add_watcher() i=2 2024-09-12T00:39:04.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.580+0000 7f8a03339800 20 add_watcher() i=3 2024-09-12T00:39:04.579 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.580+0000 7f8a03339800 20 add_watcher() i=4 2024-09-12T00:39:04.580 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.580+0000 7f8a03339800 20 add_watcher() i=5 2024-09-12T00:39:04.580 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.580+0000 7f8a03339800 20 add_watcher() i=6 2024-09-12T00:39:04.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.581+0000 7f8a03339800 20 add_watcher() i=7 2024-09-12T00:39:04.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.581+0000 7f8a03339800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:04.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.583+0000 7f88b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:04.582 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.583+0000 7f8a03339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:04.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.583+0000 7f8a03339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:04.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.583+0000 7f8a03339800 5 note: GC not initialized 2024-09-12T00:39:04.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.583+0000 7f882ffff640 20 reqs_thread_entry: start 2024-09-12T00:39:04.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.583+0000 7f8a03339800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:04.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.583+0000 7f8a03339800 20 Filter name: none 2024-09-12T00:39:04.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.584+0000 7f882dffb640 20 reqs_thread_entry: start 2024-09-12T00:39:04.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.584+0000 7f8a03339800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:39:04.583 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.584+0000 7f8a03339800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.584+0000 7f8a03339800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:04.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.584+0000 7f8a03339800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:39:04.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.584+0000 7f8a03339800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:39:04.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.584+0000 7f8a03339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 : miss 2024-09-12T00:39:04.584 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.584+0000 7f8a03339800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.584+0000 7f8a03339800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:04.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.584+0000 7f8a03339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:04.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.584+0000 7f8a03339800 10 adding default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:04.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.584+0000 7f8a03339800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:04.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.584+0000 7f8a03339800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:04.585 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.584+0000 7f8a03339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 2024-09-12T00:39:04.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.588+0000 7f8a03339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:04.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.588+0000 7f8a03339800 10 moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:04.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.588+0000 7f8a03339800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:04.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.588+0000 7f8a03339800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19, ofs0, ns] 2024-09-12T00:39:04.587 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.589+0000 7f88e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497084 cookie 94917814019840 notifier 8036 bl.length()=905 2024-09-12T00:39:04.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.589+0000 7f88e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:04.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.589+0000 7f88e27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:04.588 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.589+0000 7f88e27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:04.589 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.590+0000 7f8a03339800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_sources= new_sources= 2024-09-12T00:39:04.589 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.590+0000 7f8a03339800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential sources added=[] removed=[] 2024-09-12T00:39:04.589 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.590+0000 7f8a03339800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_dests= new_dests= 2024-09-12T00:39:04.589 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.590+0000 7f8a03339800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential dests added=[] removed=[] 2024-09-12T00:39:04.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.593+0000 7f8a03339800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.1.0 2024-09-12T00:39:04.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.593+0000 7f8a03339800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.1.0 2024-09-12T00:39:04.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.593+0000 7f8a03339800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.1.1 2024-09-12T00:39:04.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.593+0000 7f8a03339800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.1.1 2024-09-12T00:39:04.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.593+0000 7f8a03339800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.0 2024-09-12T00:39:04.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.593+0000 7f8a03339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:04.592 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.593+0000 7f8a03339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 2024-09-12T00:39:04.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.595+0000 7f8a03339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:04.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.595+0000 7f8a03339800 10 moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:04.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.595+0000 7f8a03339800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:04.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.595+0000 7f8a03339800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19, ofs0, ns] 2024-09-12T00:39:04.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.595+0000 7f88e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497085 cookie 94917814019840 notifier 8036 bl.length()=905 2024-09-12T00:39:04.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.595+0000 7f88e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:04.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.595+0000 7f88e27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:04.594 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.595+0000 7f88e27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:04.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.597+0000 7f8a03339800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_sources= new_sources= 2024-09-12T00:39:04.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.597+0000 7f8a03339800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential sources added=[] removed=[] 2024-09-12T00:39:04.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.597+0000 7f8a03339800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_dests= new_dests= 2024-09-12T00:39:04.595 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.597+0000 7f8a03339800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential dests added=[] removed=[] 2024-09-12T00:39:04.596 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.598+0000 7f8a03339800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.0 2024-09-12T00:39:04.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.598+0000 7f8a03339800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:04.597 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.598+0000 7f8a03339800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 2024-09-12T00:39:04.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.600+0000 7f8a03339800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:04.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.600+0000 7f8a03339800 10 moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:04.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.600+0000 7f8a03339800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:04.598 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.600+0000 7f8a03339800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19, ofs0, ns] 2024-09-12T00:39:04.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.600+0000 7f88e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497086 cookie 94917814019840 notifier 8036 bl.length()=873 2024-09-12T00:39:04.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.600+0000 7f88e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:04.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.600+0000 7f88e27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:04.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.600+0000 7f88e27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:04.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.601+0000 7f8a03339800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_sources= new_sources= 2024-09-12T00:39:04.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.601+0000 7f8a03339800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential sources added=[] removed=[] 2024-09-12T00:39:04.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.601+0000 7f8a03339800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_dests= new_dests= 2024-09-12T00:39:04.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.601+0000 7f8a03339800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential dests added=[] removed=[] 2024-09-12T00:39:04.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.603+0000 7f8a03339800 1 execute INFO: reshard of bucket "myver" from 1 shards to 2 shards completed successfully 2024-09-12T00:39:04.604 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.605+0000 7f88b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:04.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.607+0000 7f8a03339800 20 remove_watcher() i=0 2024-09-12T00:39:04.605 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.607+0000 7f8a03339800 2 removed watcher, disabling cache 2024-09-12T00:39:04.606 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.608+0000 7f8a03339800 20 remove_watcher() i=1 2024-09-12T00:39:04.607 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.609+0000 7f8a03339800 20 remove_watcher() i=2 2024-09-12T00:39:04.608 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.610+0000 7f8a03339800 20 remove_watcher() i=3 2024-09-12T00:39:04.609 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.611+0000 7f8a03339800 20 remove_watcher() i=4 2024-09-12T00:39:04.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.612+0000 7f8a03339800 20 remove_watcher() i=5 2024-09-12T00:39:04.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.613+0000 7f8a03339800 20 remove_watcher() i=6 2024-09-12T00:39:04.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.614+0000 7f8a03339800 20 remove_watcher() i=7 2024-09-12T00:39:04.624 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:39:04.653 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:04.653 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:04.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.691+0000 7fd4fb01b800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.693+0000 7fd4fb01b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:04.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.693+0000 7fd4fb01b800 20 realm 2024-09-12T00:39:04.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.693+0000 7fd4fb01b800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.693+0000 7fd4fb01b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:04.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.693+0000 7fd4fb01b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:04.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.693+0000 7fd4fb01b800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.694+0000 7fd4fb01b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:04.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.694+0000 7fd4fb01b800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.694+0000 7fd4fb01b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:04.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.694+0000 7fd4fb01b800 20 rados->read ofs=0 len=0 2024-09-12T00:39:04.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.695+0000 7fd4fb01b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:04.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.695+0000 7fd4fb01b800 20 searching for the correct realm 2024-09-12T00:39:04.695 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.697+0000 7fd4edfea640 0 -- 172.21.15.133:0/1896736839 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fd4e005c600 msgr2=0x7fd4e008eb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:04.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:04.903+0000 7fd4edfea640 0 -- 172.21.15.133:0/1896736839 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fd4e800abd0 msgr2=0x7fd4e8009420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:05.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.110+0000 7fd4fb01b800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:05.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.110+0000 7fd4fb01b800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:05.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.110+0000 7fd4fb01b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:05.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.110+0000 7fd4fb01b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:05.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.110+0000 7fd4fb01b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:05.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.110+0000 7fd4fb01b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:05.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.110+0000 7fd4fb01b800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.111+0000 7fd4fb01b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:05.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.111+0000 7fd4fb01b800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.111+0000 7fd4fb01b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:05.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.111+0000 7fd4fb01b800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.111+0000 7fd4fb01b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:05.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.111+0000 7fd4fb01b800 20 zone default found 2024-09-12T00:39:05.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.111+0000 7fd4fb01b800 4 Realm: () 2024-09-12T00:39:05.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.111+0000 7fd4fb01b800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:05.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.111+0000 7fd4fb01b800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:05.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.111+0000 7fd4fb01b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:05.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.111+0000 7fd4fb01b800 20 zonegroup default 2024-09-12T00:39:05.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.111+0000 7fd4fb01b800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.111+0000 7fd4fb01b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:05.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.112+0000 7fd4fb01b800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.112+0000 7fd4fb01b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:05.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.112+0000 7fd4fb01b800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.112+0000 7fd4fb01b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:05.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.112+0000 7fd4fb01b800 20 started sync module instance, tier type = 2024-09-12T00:39:05.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.112+0000 7fd4fb01b800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:05.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.122+0000 7fd4fb01b800 20 add_watcher() i=0 2024-09-12T00:39:05.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.122+0000 7fd4fb01b800 20 add_watcher() i=1 2024-09-12T00:39:05.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.122+0000 7fd4fb01b800 20 add_watcher() i=2 2024-09-12T00:39:05.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.122+0000 7fd4fb01b800 20 add_watcher() i=3 2024-09-12T00:39:05.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.122+0000 7fd4fb01b800 20 add_watcher() i=4 2024-09-12T00:39:05.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.122+0000 7fd4fb01b800 20 add_watcher() i=5 2024-09-12T00:39:05.121 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.122+0000 7fd4fb01b800 20 add_watcher() i=6 2024-09-12T00:39:05.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.123+0000 7fd4fb01b800 20 add_watcher() i=7 2024-09-12T00:39:05.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.123+0000 7fd4fb01b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:05.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.125+0000 7fd3acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:05.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.125+0000 7fd4fb01b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:05.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.125+0000 7fd4fb01b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:05.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.125+0000 7fd4fb01b800 5 note: GC not initialized 2024-09-12T00:39:05.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.125+0000 7fd3277fe640 20 reqs_thread_entry: start 2024-09-12T00:39:05.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.125+0000 7fd4fb01b800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:05.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.126+0000 7fd4fb01b800 20 Filter name: none 2024-09-12T00:39:05.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.126+0000 7fd3257fa640 20 reqs_thread_entry: start 2024-09-12T00:39:05.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.126+0000 7fd4fb01b800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.126+0000 7fd4fb01b800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:05.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.126+0000 7fd4fb01b800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.127+0000 7fd4fb01b800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:05.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.127+0000 7fd4fb01b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:05.126 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.127+0000 7fd4fb01b800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.127+0000 7fd4fb01b800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:05.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.127+0000 7fd4fb01b800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.128+0000 7fd4fb01b800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:05.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.128+0000 7fd4fb01b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:05.127 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.129+0000 7fd3acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:05.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.131+0000 7fd4fb01b800 20 remove_watcher() i=0 2024-09-12T00:39:05.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.131+0000 7fd4fb01b800 2 removed watcher, disabling cache 2024-09-12T00:39:05.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.132+0000 7fd4fb01b800 20 remove_watcher() i=1 2024-09-12T00:39:05.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.133+0000 7fd4fb01b800 20 remove_watcher() i=2 2024-09-12T00:39:05.133 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.134+0000 7fd4fb01b800 20 remove_watcher() i=3 2024-09-12T00:39:05.134 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.136+0000 7fd4fb01b800 20 remove_watcher() i=4 2024-09-12T00:39:05.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.137+0000 7fd4fb01b800 20 remove_watcher() i=5 2024-09-12T00:39:05.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.138+0000 7fd4fb01b800 20 remove_watcher() i=6 2024-09-12T00:39:05.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.139+0000 7fd4fb01b800 20 remove_watcher() i=7 2024-09-12T00:39:05.148 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:39:05.148 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:39:05.148 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: myver id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:39:05.148 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:39:05.224 INFO:tasks.workunit.client.0.smithi133.stderr: test: reshard removes olh entries with empty name 2024-09-12T00:39:05.509 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:39:05.537 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:05.538 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:05.574 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.576+0000 7fd2f4813800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.576 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.578+0000 7fd2f4813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:05.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.578+0000 7fd2f4813800 20 realm 2024-09-12T00:39:05.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.578+0000 7fd2f4813800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.578+0000 7fd2f4813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:05.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.578+0000 7fd2f4813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:05.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.578+0000 7fd2f4813800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.578+0000 7fd2f4813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:05.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.578+0000 7fd2f4813800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.579+0000 7fd2f4813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:05.577 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.579+0000 7fd2f4813800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.580+0000 7fd2f4813800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:05.578 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.580+0000 7fd2f4813800 20 searching for the correct realm 2024-09-12T00:39:05.580 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.581+0000 7fd2ef791640 0 -- 172.21.15.133:0/2006004347 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fd2e4018070 msgr2=0x7fd2e408ab10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:05.784 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.785+0000 7fd2ef791640 0 -- 172.21.15.133:0/2006004347 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fd2e007f040 msgr2=0x7fd2e0064910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:05.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.991+0000 7fd2f4813800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:05.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.991+0000 7fd2f4813800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:05.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.991+0000 7fd2f4813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:05.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.991+0000 7fd2f4813800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:05.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.991+0000 7fd2f4813800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:05.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.991+0000 7fd2f4813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:05.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.991+0000 7fd2f4813800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.992+0000 7fd2f4813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:05.991 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.992+0000 7fd2f4813800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.992+0000 7fd2f4813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:05.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.992+0000 7fd2f4813800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.992+0000 7fd2f4813800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:05.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.992+0000 7fd2f4813800 20 zone default found 2024-09-12T00:39:05.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.992+0000 7fd2f4813800 4 Realm: () 2024-09-12T00:39:05.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.992+0000 7fd2f4813800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:05.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.992+0000 7fd2f4813800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:05.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.992+0000 7fd2f4813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:05.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.992+0000 7fd2f4813800 20 zonegroup default 2024-09-12T00:39:05.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.992+0000 7fd2f4813800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.993+0000 7fd2f4813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:05.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.993+0000 7fd2f4813800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.993+0000 7fd2f4813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:05.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.993+0000 7fd2f4813800 20 rados->read ofs=0 len=0 2024-09-12T00:39:05.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.993+0000 7fd2f4813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:05.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.993+0000 7fd2f4813800 20 started sync module instance, tier type = 2024-09-12T00:39:05.994 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:05.993+0000 7fd2f4813800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:06.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.002+0000 7fd2f4813800 20 add_watcher() i=0 2024-09-12T00:39:06.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.002+0000 7fd2f4813800 20 add_watcher() i=1 2024-09-12T00:39:06.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.002+0000 7fd2f4813800 20 add_watcher() i=2 2024-09-12T00:39:06.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.002+0000 7fd2f4813800 20 add_watcher() i=3 2024-09-12T00:39:06.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.002+0000 7fd2f4813800 20 add_watcher() i=4 2024-09-12T00:39:06.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.002+0000 7fd2f4813800 20 add_watcher() i=5 2024-09-12T00:39:06.001 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.002+0000 7fd2f4813800 20 add_watcher() i=6 2024-09-12T00:39:06.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.003+0000 7fd2f4813800 20 add_watcher() i=7 2024-09-12T00:39:06.002 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.003+0000 7fd2f4813800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:06.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.005+0000 7fd1a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:06.004 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.005+0000 7fd2f4813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:06.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.005+0000 7fd2f4813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:06.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.005+0000 7fd2f4813800 5 note: GC not initialized 2024-09-12T00:39:06.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.005+0000 7fd1a57e2640 20 reqs_thread_entry: start 2024-09-12T00:39:06.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.006+0000 7fd2f4813800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:06.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.006+0000 7fd2f4813800 20 Filter name: none 2024-09-12T00:39:06.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.006+0000 7fd19e7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:06.005 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.006+0000 7fd2f4813800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.006+0000 7fd2f4813800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:39:06.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.006+0000 7fd2f4813800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.007+0000 7fd2f4813800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:39:06.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.007+0000 7fd2f4813800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:06.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.007+0000 7fd2f4813800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.007+0000 7fd2f4813800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:39:06.006 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.007+0000 7fd2f4813800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.008+0000 7fd2f4813800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:39:06.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.008+0000 7fd2f4813800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:06.007 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.009+0000 7fd1a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:06.010 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.011+0000 7fd2f4813800 20 remove_watcher() i=0 2024-09-12T00:39:06.010 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.011+0000 7fd2f4813800 2 removed watcher, disabling cache 2024-09-12T00:39:06.011 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.012+0000 7fd2f4813800 20 remove_watcher() i=1 2024-09-12T00:39:06.012 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.013+0000 7fd2f4813800 20 remove_watcher() i=2 2024-09-12T00:39:06.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.014+0000 7fd2f4813800 20 remove_watcher() i=3 2024-09-12T00:39:06.013 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.015+0000 7fd2f4813800 20 remove_watcher() i=4 2024-09-12T00:39:06.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.016+0000 7fd2f4813800 20 remove_watcher() i=5 2024-09-12T00:39:06.015 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.017+0000 7fd2f4813800 20 remove_watcher() i=6 2024-09-12T00:39:06.016 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.018+0000 7fd2f4813800 20 remove_watcher() i=7 2024-09-12T00:39:06.027 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:39:06.027 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:39:06.027 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: a-bucket id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 num_objects: 0 size_kb: 0 num_shards: 3 2024-09-12T00:39:06.027 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:39:06.028 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T00:39:06.057 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:06.057 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:06.095 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.096+0000 7f5b14f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.098+0000 7f5b14f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:06.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.098+0000 7f5b14f25800 20 realm 2024-09-12T00:39:06.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.098+0000 7f5b14f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.097 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.098+0000 7f5b14f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:06.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.098+0000 7f5b14f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:06.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.098+0000 7f5b14f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.099+0000 7f5b14f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:06.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.099+0000 7f5b14f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.099+0000 7f5b14f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:06.098 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.099+0000 7f5b14f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.100+0000 7f5b14f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:06.099 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.100+0000 7f5b14f25800 20 searching for the correct realm 2024-09-12T00:39:06.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.303+0000 7f5b0bfff640 0 -- 172.21.15.133:0/3612781605 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f5afc071310 msgr2=0x7f5afc067290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:06.707 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.708+0000 7f5b0bfff640 0 -- 172.21.15.133:0/3612781605 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f5b040acc20 msgr2=0x7f5b040aaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:06.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.916+0000 7f5b14f25800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:06.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.916+0000 7f5b14f25800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:06.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.916+0000 7f5b14f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:06.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.916+0000 7f5b14f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:06.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.916+0000 7f5b14f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:06.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.916+0000 7f5b14f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:06.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.916+0000 7f5b14f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.916 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.917+0000 7f5b14f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:06.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.917+0000 7f5b14f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.917+0000 7f5b14f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:06.917 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.917+0000 7f5b14f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.917+0000 7f5b14f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:06.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.917+0000 7f5b14f25800 20 zone default found 2024-09-12T00:39:06.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.917+0000 7f5b14f25800 4 Realm: () 2024-09-12T00:39:06.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.917+0000 7f5b14f25800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:06.918 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.917+0000 7f5b14f25800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:06.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.917+0000 7f5b14f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:06.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.917+0000 7f5b14f25800 20 zonegroup default 2024-09-12T00:39:06.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.917+0000 7f5b14f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.918+0000 7f5b14f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:06.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.918+0000 7f5b14f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.918+0000 7f5b14f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:06.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.918+0000 7f5b14f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.918+0000 7f5b14f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:06.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.918+0000 7f5b14f25800 20 started sync module instance, tier type = 2024-09-12T00:39:06.919 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.918+0000 7f5b14f25800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:06.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.929+0000 7f5b14f25800 20 add_watcher() i=0 2024-09-12T00:39:06.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.929+0000 7f5b14f25800 20 add_watcher() i=1 2024-09-12T00:39:06.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.929+0000 7f5b14f25800 20 add_watcher() i=2 2024-09-12T00:39:06.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.929+0000 7f5b14f25800 20 add_watcher() i=3 2024-09-12T00:39:06.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.929+0000 7f5b14f25800 20 add_watcher() i=4 2024-09-12T00:39:06.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.929+0000 7f5b14f25800 20 add_watcher() i=5 2024-09-12T00:39:06.928 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.929+0000 7f5b14f25800 20 add_watcher() i=6 2024-09-12T00:39:06.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.930+0000 7f5b14f25800 20 add_watcher() i=7 2024-09-12T00:39:06.929 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.931+0000 7f5b14f25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:06.931 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.933+0000 7f59c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:06.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.933+0000 7f5b14f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:06.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.933+0000 7f5b14f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:06.932 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.933+0000 7f5b14f25800 5 note: GC not initialized 2024-09-12T00:39:06.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.933+0000 7f59c67e4640 20 reqs_thread_entry: start 2024-09-12T00:39:06.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.933+0000 7f5b14f25800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:06.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.933+0000 7f5b14f25800 20 Filter name: none 2024-09-12T00:39:06.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.934+0000 7f59bf7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:06.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.934+0000 7f5b14f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.934+0000 7f5b14f25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:39:06.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.934+0000 7f5b14f25800 20 rados->read ofs=0 len=0 2024-09-12T00:39:06.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.935+0000 7f5b14f25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:39:06.934 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.935+0000 7f5b14f25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:06.935 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.936+0000 7f59c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:06.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.938+0000 7f5b14f25800 20 remove_watcher() i=0 2024-09-12T00:39:06.937 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.938+0000 7f5b14f25800 2 removed watcher, disabling cache 2024-09-12T00:39:06.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.940+0000 7f5b14f25800 20 remove_watcher() i=1 2024-09-12T00:39:06.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.941+0000 7f5b14f25800 20 remove_watcher() i=2 2024-09-12T00:39:06.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.942+0000 7f5b14f25800 20 remove_watcher() i=3 2024-09-12T00:39:06.942 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.943+0000 7f5b14f25800 20 remove_watcher() i=4 2024-09-12T00:39:06.943 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.945+0000 7f5b14f25800 20 remove_watcher() i=5 2024-09-12T00:39:06.944 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.946+0000 7f5b14f25800 20 remove_watcher() i=6 2024-09-12T00:39:06.945 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:06.947+0000 7f5b14f25800 20 remove_watcher() i=7 2024-09-12T00:39:06.960 INFO:tasks.workunit.client.0.smithi133.stderr:rados -p default.rgw.buckets.index setomapval .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T00:39:06.988 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:06.988 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:07.005 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:39:07.035 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:07.035 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:07.073 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.074+0000 7fc8bce98800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.076+0000 7fc8bce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.075 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.076+0000 7fc8bce98800 20 realm 2024-09-12T00:39:07.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.076+0000 7fc8bce98800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.076+0000 7fc8bce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.076+0000 7fc8bce98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:07.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.076+0000 7fc8bce98800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.076 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.076+0000 7fc8bce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.077 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.076+0000 7fc8bce98800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.077+0000 7fc8bce98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:07.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.077+0000 7fc8bce98800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.078+0000 7fc8bce98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:07.078 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.078+0000 7fc8bce98800 20 searching for the correct realm 2024-09-12T00:39:07.079 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.080+0000 7fc8b3fff640 0 -- 172.21.15.133:0/1872205307 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fc8a4032020 msgr2=0x7fc8a4066c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:07.082 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.084+0000 7fc8b3fff640 0 -- 172.21.15.133:0/1872205307 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fc8ac08e960 msgr2=0x7fc8ac066480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:07.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.290+0000 7fc8bce98800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:07.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.290+0000 7fc8bce98800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:07.289 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.290+0000 7fc8bce98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:07.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.290+0000 7fc8bce98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:07.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.290+0000 7fc8bce98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:07.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.290+0000 7fc8bce98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:07.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.290+0000 7fc8bce98800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.290+0000 7fc8bce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.290+0000 7fc8bce98800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.290+0000 7fc8bce98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:07.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.290+0000 7fc8bce98800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.291+0000 7fc8bce98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:07.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.291+0000 7fc8bce98800 20 zone default found 2024-09-12T00:39:07.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.291+0000 7fc8bce98800 4 Realm: () 2024-09-12T00:39:07.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.291+0000 7fc8bce98800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:07.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.291+0000 7fc8bce98800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:07.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.291+0000 7fc8bce98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:07.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.291+0000 7fc8bce98800 20 zonegroup default 2024-09-12T00:39:07.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.291+0000 7fc8bce98800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.291+0000 7fc8bce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.291+0000 7fc8bce98800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.291+0000 7fc8bce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.291+0000 7fc8bce98800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.292+0000 7fc8bce98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.292+0000 7fc8bce98800 20 started sync module instance, tier type = 2024-09-12T00:39:07.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.292+0000 7fc8bce98800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:07.300 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.301+0000 7fc8bce98800 20 add_watcher() i=0 2024-09-12T00:39:07.300 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.301+0000 7fc8bce98800 20 add_watcher() i=1 2024-09-12T00:39:07.300 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.301+0000 7fc8bce98800 20 add_watcher() i=2 2024-09-12T00:39:07.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.301+0000 7fc8bce98800 20 add_watcher() i=3 2024-09-12T00:39:07.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.301+0000 7fc8bce98800 20 add_watcher() i=4 2024-09-12T00:39:07.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.301+0000 7fc8bce98800 20 add_watcher() i=5 2024-09-12T00:39:07.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.301+0000 7fc8bce98800 20 add_watcher() i=6 2024-09-12T00:39:07.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.302+0000 7fc8bce98800 20 add_watcher() i=7 2024-09-12T00:39:07.302 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.302+0000 7fc8bce98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:07.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.304+0000 7fc7717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:07.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.305+0000 7fc8bce98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:07.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.305+0000 7fc8bce98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:07.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.305+0000 7fc8bce98800 5 note: GC not initialized 2024-09-12T00:39:07.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.305+0000 7fc6ebfff640 20 reqs_thread_entry: start 2024-09-12T00:39:07.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.305+0000 7fc8bce98800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:07.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.305+0000 7fc8bce98800 20 Filter name: none 2024-09-12T00:39:07.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.305+0000 7fc6e9ffb640 20 reqs_thread_entry: start 2024-09-12T00:39:07.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.305+0000 7fc8bce98800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.305 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.305+0000 7fc8bce98800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:39:07.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.305+0000 7fc8bce98800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.306+0000 7fc8bce98800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:39:07.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.306+0000 7fc8bce98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:07.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.306+0000 7fc8bce98800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:39:07.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.306+0000 7fc8bce98800 20 INFO: main: starting shard=0 2024-09-12T00:39:07.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.306+0000 7fc8bce98800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:39:07.306 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.306+0000 7fc8bce98800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:39:07.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.306+0000 7fc8bce98800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:39:07.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.307+0000 7fc8bce98800 20 INFO: main: starting shard=1 2024-09-12T00:39:07.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.307+0000 7fc8bce98800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:39:07.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.307+0000 7fc8bce98800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:39:07.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.307+0000 7fc8bce98800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:39:07.307 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.307+0000 7fc8bce98800 20 INFO: main: starting shard=2 2024-09-12T00:39:07.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.307+0000 7fc8bce98800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:39:07.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.307+0000 7fc8bce98800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:39:07.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.307+0000 7fc8bce98800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:39:07.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.307+0000 7fc8bce98800 20 INFO: main: done 2024-09-12T00:39:07.308 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.308+0000 7fc7717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:07.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.310+0000 7fc8bce98800 20 remove_watcher() i=0 2024-09-12T00:39:07.309 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.310+0000 7fc8bce98800 2 removed watcher, disabling cache 2024-09-12T00:39:07.310 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.311+0000 7fc8bce98800 20 remove_watcher() i=1 2024-09-12T00:39:07.311 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.312+0000 7fc8bce98800 20 remove_watcher() i=2 2024-09-12T00:39:07.312 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.313+0000 7fc8bce98800 20 remove_watcher() i=3 2024-09-12T00:39:07.313 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.314+0000 7fc8bce98800 20 remove_watcher() i=4 2024-09-12T00:39:07.314 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.315+0000 7fc8bce98800 20 remove_watcher() i=5 2024-09-12T00:39:07.315 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.317+0000 7fc8bce98800 20 remove_watcher() i=6 2024-09-12T00:39:07.316 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.318+0000 7fc8bce98800 20 remove_watcher() i=7 2024-09-12T00:39:07.329 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T00:39:07.361 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:07.361 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:07.398 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.399+0000 7f19f171f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.400+0000 7f19f171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.400+0000 7f19f171f800 20 realm 2024-09-12T00:39:07.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.400+0000 7f19f171f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.400+0000 7f19f171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.400 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.400+0000 7f19f171f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:07.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.400+0000 7f19f171f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.401+0000 7f19f171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.401+0000 7f19f171f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.401+0000 7f19f171f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:07.401 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.401+0000 7f19f171f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.402+0000 7f19f171f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:07.402 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.402+0000 7f19f171f800 20 searching for the correct realm 2024-09-12T00:39:07.403 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.404+0000 7f19e4ca8640 0 -- 172.21.15.133:0/3793475967 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f19d8082c20 msgr2=0x7f19d805fa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:07.406 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.407+0000 7f19e4ca8640 0 -- 172.21.15.133:0/3793475967 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f19e00b5c20 msgr2=0x7f19e00ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:07.612 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.613+0000 7f19f171f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:07.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.613+0000 7f19f171f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:07.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.613+0000 7f19f171f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:07.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.613+0000 7f19f171f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:07.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.613+0000 7f19f171f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:07.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.613+0000 7f19f171f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:07.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.613+0000 7f19f171f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.614+0000 7f19f171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.614+0000 7f19f171f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.614+0000 7f19f171f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:07.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.614+0000 7f19f171f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.614+0000 7f19f171f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:07.614 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.614+0000 7f19f171f800 20 zone default found 2024-09-12T00:39:07.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.614+0000 7f19f171f800 4 Realm: () 2024-09-12T00:39:07.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.614+0000 7f19f171f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:07.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.614+0000 7f19f171f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:07.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.614+0000 7f19f171f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:07.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.614+0000 7f19f171f800 20 zonegroup default 2024-09-12T00:39:07.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.614+0000 7f19f171f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.615+0000 7f19f171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.615+0000 7f19f171f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.615+0000 7f19f171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.615+0000 7f19f171f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.615+0000 7f19f171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.615+0000 7f19f171f800 20 started sync module instance, tier type = 2024-09-12T00:39:07.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.615+0000 7f19f171f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:07.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.625+0000 7f19f171f800 20 add_watcher() i=0 2024-09-12T00:39:07.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.625+0000 7f19f171f800 20 add_watcher() i=1 2024-09-12T00:39:07.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.625+0000 7f19f171f800 20 add_watcher() i=2 2024-09-12T00:39:07.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.625+0000 7f19f171f800 20 add_watcher() i=3 2024-09-12T00:39:07.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.625+0000 7f19f171f800 20 add_watcher() i=4 2024-09-12T00:39:07.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.625+0000 7f19f171f800 20 add_watcher() i=5 2024-09-12T00:39:07.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.625+0000 7f19f171f800 20 add_watcher() i=6 2024-09-12T00:39:07.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.626+0000 7f19f171f800 20 add_watcher() i=7 2024-09-12T00:39:07.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.626+0000 7f19f171f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:07.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.628+0000 7f18a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:07.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.628+0000 7f19f171f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:07.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.628+0000 7f19f171f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:07.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.628+0000 7f19f171f800 5 note: GC not initialized 2024-09-12T00:39:07.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.629+0000 7f18a27e4640 20 reqs_thread_entry: start 2024-09-12T00:39:07.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.629+0000 7f19f171f800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:07.628 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.629+0000 7f19f171f800 20 Filter name: none 2024-09-12T00:39:07.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.629+0000 7f1813fff640 20 reqs_thread_entry: start 2024-09-12T00:39:07.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.629+0000 7f19f171f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:07.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.629+0000 7f19f171f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.629+0000 7f19f171f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:39:07.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.629+0000 7f19f171f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:39:07.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.629+0000 7f19f171f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:07.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.629+0000 7f19f171f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : miss 2024-09-12T00:39:07.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.629+0000 7f19f171f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.630+0000 7f19f171f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:39:07.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.630+0000 7f19f171f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:39:07.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.630+0000 7f19f171f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:39:07.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.630+0000 7f19f171f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:07.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.630+0000 7f19f171f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:07.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.630+0000 7f19f171f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:39:07.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.634+0000 7f19f171f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:39:07.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.634+0000 7f19f171f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:39:07.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.634+0000 7f19f171f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:07.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.634+0000 7f19f171f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:39:07.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.634+0000 7f18bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497088 cookie 94730404623552 notifier 8123 bl.length()=911 2024-09-12T00:39:07.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.634+0000 7f18bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:39:07.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.634+0000 7f18bffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:39:07.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.634+0000 7f18bffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:07.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.635+0000 7f19f171f800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:39:07.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.635+0000 7f19f171f800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:39:07.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.635+0000 7f19f171f800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:39:07.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.635+0000 7f19f171f800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:39:07.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.638+0000 7f19f171f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.0 2024-09-12T00:39:07.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.638+0000 7f19f171f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.0 2024-09-12T00:39:07.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.638+0000 7f19f171f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:39:07.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.638+0000 7f19f171f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:39:07.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.639+0000 7f19f171f800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T00:39:07.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.639+0000 7f19f171f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:39:07.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.639+0000 7f19f171f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:39:07.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.639+0000 7f19f171f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:39:07.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.639+0000 7f19f171f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:39:07.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.640+0000 7f19f171f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:07.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.640+0000 7f19f171f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:39:07.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.641+0000 7f19f171f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:39:07.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.641+0000 7f19f171f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:39:07.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.641+0000 7f19f171f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:07.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.641+0000 7f19f171f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:39:07.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.642+0000 7f18bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497089 cookie 94730404623552 notifier 8123 bl.length()=911 2024-09-12T00:39:07.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.642+0000 7f18bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:39:07.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.642+0000 7f18bffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:39:07.641 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.642+0000 7f18bffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:07.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.644+0000 7f19f171f800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:39:07.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.644+0000 7f19f171f800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:39:07.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.644+0000 7f19f171f800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:39:07.642 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.644+0000 7f19f171f800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:39:07.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.645+0000 7f19f171f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:39:07.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.645+0000 7f19f171f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.0 2024-09-12T00:39:07.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.645+0000 7f19f171f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:39:07.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.645+0000 7f19f171f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.1 2024-09-12T00:39:07.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.646+0000 7f19f171f800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:39:07.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.646+0000 7f19f171f800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.2.2 2024-09-12T00:39:07.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.646+0000 7f19f171f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:07.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.646+0000 7f19f171f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 2024-09-12T00:39:07.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.647+0000 7f19f171f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:39:07.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.647+0000 7f19f171f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:39:07.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.647+0000 7f19f171f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:07.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.647+0000 7f19f171f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18, ofs0, ns] 2024-09-12T00:39:07.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.648+0000 7f18d0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497090 cookie 94730404623552 notifier 8123 bl.length()=879 2024-09-12T00:39:07.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.648+0000 7f18d0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 info.flags=0x17 2024-09-12T00:39:07.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.648+0000 7f18d0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18 to cache LRU end 2024-09-12T00:39:07.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.648+0000 7f18d0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:07.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.649+0000 7f19f171f800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_sources= new_sources= 2024-09-12T00:39:07.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.649+0000 7f19f171f800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential sources added=[] removed=[] 2024-09-12T00:39:07.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.649+0000 7f19f171f800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): orig_dests= new_dests= 2024-09-12T00:39:07.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.649+0000 7f19f171f800 20 handle_bi_update(): bucket=:a-bucket[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18]): potential dests added=[] removed=[] 2024-09-12T00:39:07.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.650+0000 7f19f171f800 1 execute INFO: reshard of bucket "a-bucket" from 3 shards to 1 shards completed successfully 2024-09-12T00:39:07.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.652+0000 7f18a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:07.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.655+0000 7f19f171f800 20 remove_watcher() i=0 2024-09-12T00:39:07.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.655+0000 7f19f171f800 2 removed watcher, disabling cache 2024-09-12T00:39:07.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.656+0000 7f19f171f800 20 remove_watcher() i=1 2024-09-12T00:39:07.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.657+0000 7f19f171f800 20 remove_watcher() i=2 2024-09-12T00:39:07.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.658+0000 7f19f171f800 20 remove_watcher() i=3 2024-09-12T00:39:07.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.659+0000 7f19f171f800 20 remove_watcher() i=4 2024-09-12T00:39:07.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.660+0000 7f19f171f800 20 remove_watcher() i=5 2024-09-12T00:39:07.659 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.661+0000 7f19f171f800 20 remove_watcher() i=6 2024-09-12T00:39:07.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.662+0000 7f19f171f800 20 remove_watcher() i=7 2024-09-12T00:39:07.672 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:39:07.702 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:07.702 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:07.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.739+0000 7f59db93d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.741+0000 7f59db93d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.741+0000 7f59db93d800 20 realm 2024-09-12T00:39:07.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.741+0000 7f59db93d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.741+0000 7f59db93d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.741+0000 7f59db93d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:07.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.741+0000 7f59db93d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.741+0000 7f59db93d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.741+0000 7f59db93d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.742+0000 7f59db93d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:07.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.742+0000 7f59db93d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.743+0000 7f59db93d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:07.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.743+0000 7f59db93d800 20 searching for the correct realm 2024-09-12T00:39:07.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.745+0000 7f59cffff640 0 -- 172.21.15.133:0/2073529607 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f59c001f070 msgr2=0x7f59c0061140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:07.747 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.748+0000 7f59cffff640 0 -- 172.21.15.133:0/2073529607 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f59c8063420 msgr2=0x7f59c80638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:07.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.956+0000 7f59db93d800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:07.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.956+0000 7f59db93d800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:07.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.956+0000 7f59db93d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:07.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.956+0000 7f59db93d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:07.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.956+0000 7f59db93d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:07.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.956+0000 7f59db93d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:07.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.956+0000 7f59db93d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.956+0000 7f59db93d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.956+0000 7f59db93d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.957+0000 7f59db93d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:07.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.957+0000 7f59db93d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.957+0000 7f59db93d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:07.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.957+0000 7f59db93d800 20 zone default found 2024-09-12T00:39:07.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.957+0000 7f59db93d800 4 Realm: () 2024-09-12T00:39:07.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.957+0000 7f59db93d800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:07.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.957+0000 7f59db93d800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:07.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.957+0000 7f59db93d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:07.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.957+0000 7f59db93d800 20 zonegroup default 2024-09-12T00:39:07.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.957+0000 7f59db93d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.958+0000 7f59db93d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.958+0000 7f59db93d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.958+0000 7f59db93d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.958+0000 7f59db93d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.958+0000 7f59db93d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:07.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.958+0000 7f59db93d800 20 started sync module instance, tier type = 2024-09-12T00:39:07.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.958+0000 7f59db93d800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:07.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.969+0000 7f59db93d800 20 add_watcher() i=0 2024-09-12T00:39:07.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.969+0000 7f59db93d800 20 add_watcher() i=1 2024-09-12T00:39:07.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.969+0000 7f59db93d800 20 add_watcher() i=2 2024-09-12T00:39:07.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.969+0000 7f59db93d800 20 add_watcher() i=3 2024-09-12T00:39:07.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.969+0000 7f59db93d800 20 add_watcher() i=4 2024-09-12T00:39:07.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.969+0000 7f59db93d800 20 add_watcher() i=5 2024-09-12T00:39:07.968 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.969+0000 7f59db93d800 20 add_watcher() i=6 2024-09-12T00:39:07.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.970+0000 7f59db93d800 20 add_watcher() i=7 2024-09-12T00:39:07.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.970+0000 7f59db93d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:07.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.972+0000 7f588dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:07.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.972+0000 7f59db93d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:07.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.972+0000 7f59db93d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:07.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.972+0000 7f59db93d800 5 note: GC not initialized 2024-09-12T00:39:07.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.972+0000 7f588cfe1640 20 reqs_thread_entry: start 2024-09-12T00:39:07.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.972+0000 7f59db93d800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:07.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.972+0000 7f59db93d800 20 Filter name: none 2024-09-12T00:39:07.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.973+0000 7f58067fc640 20 reqs_thread_entry: start 2024-09-12T00:39:07.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.973+0000 7f59db93d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.973+0000 7f59db93d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-12T00:39:07.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.973+0000 7f59db93d800 20 rados->read ofs=0 len=0 2024-09-12T00:39:07.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.973+0000 7f59db93d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-12T00:39:07.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.974+0000 7f59db93d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:07.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.974+0000 7f59db93d800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T00:39:07.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.974+0000 7f59db93d800 20 INFO: main: starting shard=0 2024-09-12T00:39:07.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.974+0000 7f59db93d800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.0 2024-09-12T00:39:07.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.974+0000 7f59db93d800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18.3.0 2024-09-12T00:39:07.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.974+0000 7f59db93d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:39:07.973 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.974+0000 7f59db93d800 20 INFO: main: done 2024-09-12T00:39:07.974 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.975+0000 7f588dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:07.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.977+0000 7f59db93d800 20 remove_watcher() i=0 2024-09-12T00:39:07.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.977+0000 7f59db93d800 2 removed watcher, disabling cache 2024-09-12T00:39:07.976 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.978+0000 7f59db93d800 20 remove_watcher() i=1 2024-09-12T00:39:07.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.979+0000 7f59db93d800 20 remove_watcher() i=2 2024-09-12T00:39:07.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.980+0000 7f59db93d800 20 remove_watcher() i=3 2024-09-12T00:39:07.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.981+0000 7f59db93d800 20 remove_watcher() i=4 2024-09-12T00:39:07.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.982+0000 7f59db93d800 20 remove_watcher() i=5 2024-09-12T00:39:07.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.983+0000 7f59db93d800 20 remove_watcher() i=6 2024-09-12T00:39:07.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:07.984+0000 7f59db93d800 20 remove_watcher() i=7 2024-09-12T00:39:07.993 INFO:tasks.workunit.client.0.smithi133.stderr: test: PUT succeeds during reshard 2024-09-12T00:39:07.995 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:39:08.023 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:08.024 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:08.060 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.061+0000 7f331213a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.063+0000 7f331213a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:08.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.063+0000 7f331213a800 20 realm 2024-09-12T00:39:08.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.063+0000 7f331213a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.063+0000 7f331213a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:08.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.063+0000 7f331213a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:08.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.063+0000 7f331213a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.064+0000 7f331213a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:08.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.064+0000 7f331213a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.064+0000 7f331213a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:08.063 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.064+0000 7f331213a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.065+0000 7f331213a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:08.064 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.065+0000 7f331213a800 20 searching for the correct realm 2024-09-12T00:39:08.066 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.067+0000 7f330e682640 0 -- 172.21.15.133:0/3260796235 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f3308018040 msgr2=0x7f3308038420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:08.271 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.272+0000 7f330e682640 0 -- 172.21.15.133:0/3260796235 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x55840cb96300 msgr2=0x55840cb98780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:08.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.276+0000 7f331213a800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:08.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.276+0000 7f331213a800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:08.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.276+0000 7f331213a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:08.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.276+0000 7f331213a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:08.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.276+0000 7f331213a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:08.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.276+0000 7f331213a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:08.276 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.276+0000 7f331213a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.276+0000 7f331213a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:08.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.276+0000 7f331213a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.277+0000 7f331213a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:08.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.277+0000 7f331213a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.277+0000 7f331213a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:08.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.277+0000 7f331213a800 20 zone default found 2024-09-12T00:39:08.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.277+0000 7f331213a800 4 Realm: () 2024-09-12T00:39:08.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.277+0000 7f331213a800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:08.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.277+0000 7f331213a800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:08.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.277+0000 7f331213a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:08.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.277+0000 7f331213a800 20 zonegroup default 2024-09-12T00:39:08.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.277+0000 7f331213a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.277+0000 7f331213a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:08.277 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.277+0000 7f331213a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.277+0000 7f331213a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:08.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.277+0000 7f331213a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.278+0000 7f331213a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:08.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.278+0000 7f331213a800 20 started sync module instance, tier type = 2024-09-12T00:39:08.278 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.278+0000 7f331213a800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:08.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.287+0000 7f331213a800 20 add_watcher() i=0 2024-09-12T00:39:08.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.287+0000 7f331213a800 20 add_watcher() i=1 2024-09-12T00:39:08.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.287+0000 7f331213a800 20 add_watcher() i=2 2024-09-12T00:39:08.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.287+0000 7f331213a800 20 add_watcher() i=3 2024-09-12T00:39:08.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.287+0000 7f331213a800 20 add_watcher() i=4 2024-09-12T00:39:08.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.287+0000 7f331213a800 20 add_watcher() i=5 2024-09-12T00:39:08.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.287+0000 7f331213a800 20 add_watcher() i=6 2024-09-12T00:39:08.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.288+0000 7f331213a800 20 add_watcher() i=7 2024-09-12T00:39:08.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.288+0000 7f331213a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:08.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.290+0000 7f31bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:08.290 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.291+0000 7f331213a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:08.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.291+0000 7f331213a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:08.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.291+0000 7f331213a800 5 note: GC not initialized 2024-09-12T00:39:08.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.291+0000 7f31be7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:08.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.291+0000 7f331213a800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:08.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.291+0000 7f331213a800 20 Filter name: none 2024-09-12T00:39:08.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.291+0000 7f312ffff640 20 reqs_thread_entry: start 2024-09-12T00:39:08.291 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.291+0000 7f331213a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.292+0000 7f331213a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:08.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.292+0000 7f331213a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.292+0000 7f331213a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:08.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.292+0000 7f331213a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:08.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.292+0000 7f331213a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.292+0000 7f331213a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:08.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.292+0000 7f331213a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.293+0000 7f331213a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:08.292 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.293+0000 7f331213a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:08.293 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.294+0000 7f31bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:08.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.296+0000 7f331213a800 20 remove_watcher() i=0 2024-09-12T00:39:08.294 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.296+0000 7f331213a800 2 removed watcher, disabling cache 2024-09-12T00:39:08.295 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.297+0000 7f331213a800 20 remove_watcher() i=1 2024-09-12T00:39:08.296 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.298+0000 7f331213a800 20 remove_watcher() i=2 2024-09-12T00:39:08.297 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.299+0000 7f331213a800 20 remove_watcher() i=3 2024-09-12T00:39:08.298 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.300+0000 7f331213a800 20 remove_watcher() i=4 2024-09-12T00:39:08.299 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.301+0000 7f331213a800 20 remove_watcher() i=5 2024-09-12T00:39:08.300 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.302+0000 7f331213a800 20 remove_watcher() i=6 2024-09-12T00:39:08.301 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.303+0000 7f331213a800 20 remove_watcher() i=7 2024-09-12T00:39:08.312 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:39:08.312 INFO:tasks.workunit.client.0.smithi133.stderr:BUCKET_STATS: 2024-09-12T00:39:08.312 INFO:tasks.workunit.client.0.smithi133.stderr:bucket: myver id: dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:39:08.312 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:39:08.313 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-09-12T00:39:08.347 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:08.347 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:08.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.385+0000 7f6f7ff26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.387+0000 7f6f7ff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:08.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.387+0000 7f6f7ff26800 20 realm 2024-09-12T00:39:08.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.387+0000 7f6f7ff26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.387+0000 7f6f7ff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:08.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.387+0000 7f6f7ff26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:08.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.387+0000 7f6f7ff26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.387+0000 7f6f7ff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:08.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.387+0000 7f6f7ff26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.388+0000 7f6f7ff26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:08.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.388+0000 7f6f7ff26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.389+0000 7f6f7ff26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:08.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.389+0000 7f6f7ff26800 20 searching for the correct realm 2024-09-12T00:39:08.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.391+0000 7f6f7b3b4640 0 -- 172.21.15.133:0/1553247391 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f6f6408c900 msgr2=0x7f6f6408b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:08.422 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.394+0000 7f6f7b3b4640 0 -- 172.21.15.133:0/1553247391 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f6f6c08d160 msgr2=0x7f6f6c0699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:08.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.600+0000 7f6f7ff26800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:08.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.600+0000 7f6f7ff26800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:08.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.600+0000 7f6f7ff26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:08.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.600+0000 7f6f7ff26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:08.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.600+0000 7f6f7ff26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:08.599 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.600+0000 7f6f7ff26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:08.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.600+0000 7f6f7ff26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.600+0000 7f6f7ff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:08.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.600+0000 7f6f7ff26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.600+0000 7f6f7ff26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:08.600 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.600+0000 7f6f7ff26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.601+0000 7f6f7ff26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:08.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.601+0000 7f6f7ff26800 20 zone default found 2024-09-12T00:39:08.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.601+0000 7f6f7ff26800 4 Realm: () 2024-09-12T00:39:08.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.601+0000 7f6f7ff26800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:08.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.601+0000 7f6f7ff26800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:08.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.601+0000 7f6f7ff26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:08.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.601+0000 7f6f7ff26800 20 zonegroup default 2024-09-12T00:39:08.601 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.601+0000 7f6f7ff26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.601+0000 7f6f7ff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:08.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.601+0000 7f6f7ff26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.601+0000 7f6f7ff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:08.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.601+0000 7f6f7ff26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.602+0000 7f6f7ff26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:08.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.602+0000 7f6f7ff26800 20 started sync module instance, tier type = 2024-09-12T00:39:08.602 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.602+0000 7f6f7ff26800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:08.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.611+0000 7f6f7ff26800 20 add_watcher() i=0 2024-09-12T00:39:08.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.611+0000 7f6f7ff26800 20 add_watcher() i=1 2024-09-12T00:39:08.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.611+0000 7f6f7ff26800 20 add_watcher() i=2 2024-09-12T00:39:08.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.611+0000 7f6f7ff26800 20 add_watcher() i=3 2024-09-12T00:39:08.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.611+0000 7f6f7ff26800 20 add_watcher() i=4 2024-09-12T00:39:08.610 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.611+0000 7f6f7ff26800 20 add_watcher() i=5 2024-09-12T00:39:08.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.611+0000 7f6f7ff26800 20 add_watcher() i=6 2024-09-12T00:39:08.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.612+0000 7f6f7ff26800 20 add_watcher() i=7 2024-09-12T00:39:08.611 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.612+0000 7f6f7ff26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:08.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.614+0000 7f6e327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:08.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.614+0000 7f6f7ff26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:08.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.614+0000 7f6f7ff26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:08.613 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.614+0000 7f6f7ff26800 5 note: GC not initialized 2024-09-12T00:39:08.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.615+0000 7f6e317e2640 20 reqs_thread_entry: start 2024-09-12T00:39:08.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.615+0000 7f6f7ff26800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:08.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.615+0000 7f6f7ff26800 20 Filter name: none 2024-09-12T00:39:08.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.615+0000 7f6e2a7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:08.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.615+0000 7f6f7ff26800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:39:08.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.615+0000 7f6f7ff26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.615+0000 7f6f7ff26800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:08.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.615+0000 7f6f7ff26800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:39:08.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.615+0000 7f6f7ff26800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:39:08.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.615+0000 7f6f7ff26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 : miss 2024-09-12T00:39:08.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.615+0000 7f6f7ff26800 20 rados->read ofs=0 len=0 2024-09-12T00:39:08.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.616+0000 7f6f7ff26800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:08.615 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.616+0000 7f6f7ff26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:08.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.616+0000 7f6f7ff26800 10 adding default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:08.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.616+0000 7f6f7ff26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:08.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.616+0000 7f6f7ff26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:08.616 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.616+0000 7f6f7ff26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 2024-09-12T00:39:08.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.619+0000 7f6f7ff26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:08.618 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.620+0000 7f6f7ff26800 10 moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:08.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.620+0000 7f6f7ff26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:08.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.620+0000 7f6f7ff26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19, ofs0, ns] 2024-09-12T00:39:08.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.620+0000 7f6e5affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497091 cookie 94805929989904 notifier 8168 bl.length()=905 2024-09-12T00:39:08.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.620+0000 7f6e5affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:08.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.620+0000 7f6e5affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:08.619 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.620+0000 7f6e5affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:08.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.621+0000 7f6f7ff26800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_sources= new_sources= 2024-09-12T00:39:08.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.621+0000 7f6f7ff26800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential sources added=[] removed=[] 2024-09-12T00:39:08.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.621+0000 7f6f7ff26800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_dests= new_dests= 2024-09-12T00:39:08.620 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.621+0000 7f6f7ff26800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential dests added=[] removed=[] 2024-09-12T00:39:08.622 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:08.624+0000 7f6f7ff26800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T00:39:09.383 INFO:tasks.workunit.client.0.smithi133.stderr:put object successful 2024-09-12T00:39:13.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.625+0000 7f6f7ff26800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.0 2024-09-12T00:39:13.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.625+0000 7f6f7ff26800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.0 2024-09-12T00:39:13.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.625+0000 7f6f7ff26800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.1 2024-09-12T00:39:13.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.625+0000 7f6f7ff26800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.1 2024-09-12T00:39:13.623 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.625+0000 7f6f7ff26800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.2 2024-09-12T00:39:13.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.625+0000 7f6f7ff26800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.2 2024-09-12T00:39:13.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.625+0000 7f6f7ff26800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.1.0 2024-09-12T00:39:13.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.625+0000 7f6f7ff26800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.1.0 2024-09-12T00:39:13.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.625+0000 7f6f7ff26800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.1.1 2024-09-12T00:39:13.624 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.625+0000 7f6f7ff26800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.1.1 2024-09-12T00:39:13.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.628+0000 7f6f7ff26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:13.627 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.628+0000 7f6f7ff26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 2024-09-12T00:39:13.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.630+0000 7f6f7ff26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:13.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.630+0000 7f6f7ff26800 10 moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:13.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.630+0000 7f6f7ff26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:13.629 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.630+0000 7f6f7ff26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19, ofs0, ns] 2024-09-12T00:39:13.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.631+0000 7f6e5affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497092 cookie 94805929989904 notifier 8168 bl.length()=905 2024-09-12T00:39:13.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.631+0000 7f6e5affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:13.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.631+0000 7f6e5affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:13.630 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.631+0000 7f6e5affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:13.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.632+0000 7f6f7ff26800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_sources= new_sources= 2024-09-12T00:39:13.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.632+0000 7f6f7ff26800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential sources added=[] removed=[] 2024-09-12T00:39:13.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.632+0000 7f6f7ff26800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_dests= new_dests= 2024-09-12T00:39:13.631 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.632+0000 7f6f7ff26800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential dests added=[] removed=[] 2024-09-12T00:39:13.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.634+0000 7f6f7ff26800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.1.0 2024-09-12T00:39:13.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.634+0000 7f6f7ff26800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.1.0 2024-09-12T00:39:13.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.635+0000 7f6f7ff26800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.1.1 2024-09-12T00:39:13.633 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.635+0000 7f6f7ff26800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.1.1 2024-09-12T00:39:13.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.637+0000 7f6f7ff26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:13.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.637+0000 7f6f7ff26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 2024-09-12T00:39:13.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.638+0000 7f6f7ff26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:13.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.638+0000 7f6f7ff26800 10 moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:13.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.638+0000 7f6f7ff26800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:13.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.638+0000 7f6f7ff26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19, ofs0, ns] 2024-09-12T00:39:13.637 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.639+0000 7f6e5affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497093 cookie 94805929989904 notifier 8168 bl.length()=873 2024-09-12T00:39:13.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.639+0000 7f6e5affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:13.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.639+0000 7f6e5affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:13.638 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.639+0000 7f6e5affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:13.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.640+0000 7f6f7ff26800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_sources= new_sources= 2024-09-12T00:39:13.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.640+0000 7f6f7ff26800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential sources added=[] removed=[] 2024-09-12T00:39:13.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.640+0000 7f6f7ff26800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_dests= new_dests= 2024-09-12T00:39:13.639 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.640+0000 7f6f7ff26800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential dests added=[] removed=[] 2024-09-12T00:39:13.640 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.642+0000 7f6f7ff26800 1 execute INFO: reshard of bucket "myver" from 2 shards to 3 shards completed successfully 2024-09-12T00:39:13.643 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.644+0000 7f6e327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:13.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.647+0000 7f6f7ff26800 20 remove_watcher() i=0 2024-09-12T00:39:13.646 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.647+0000 7f6f7ff26800 2 removed watcher, disabling cache 2024-09-12T00:39:13.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.648+0000 7f6f7ff26800 20 remove_watcher() i=1 2024-09-12T00:39:13.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.650+0000 7f6f7ff26800 20 remove_watcher() i=2 2024-09-12T00:39:13.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.651+0000 7f6f7ff26800 20 remove_watcher() i=3 2024-09-12T00:39:13.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.652+0000 7f6f7ff26800 20 remove_watcher() i=4 2024-09-12T00:39:13.652 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.654+0000 7f6f7ff26800 20 remove_watcher() i=5 2024-09-12T00:39:13.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.655+0000 7f6f7ff26800 20 remove_watcher() i=6 2024-09-12T00:39:13.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:13.656+0000 7f6f7ff26800 20 remove_watcher() i=7 2024-09-12T00:39:14.389 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T00:39:14.389 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T00:39:14.712 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:39:15.104 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:39:16.591 INFO:tasks.workunit.client.0.smithi133.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:39:16.593 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T00:39:16.625 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:16.626 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:16.665 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.666+0000 7f42ec539800 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.668+0000 7f42ec539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.668+0000 7f42ec539800 20 realm 2024-09-12T00:39:16.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.668+0000 7f42ec539800 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.668+0000 7f42ec539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.668+0000 7f42ec539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:16.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.668+0000 7f42ec539800 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.667 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.669+0000 7f42ec539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.669+0000 7f42ec539800 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.669+0000 7f42ec539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:16.668 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.669+0000 7f42ec539800 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.670+0000 7f42ec539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:16.669 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.670+0000 7f42ec539800 20 searching for the correct realm 2024-09-12T00:39:16.671 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.672+0000 7f42e89c8640 0 -- 172.21.15.133:0/126535429 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x55dd84c67100 msgr2=0x55dd84c694f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:16.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.676+0000 7f42e79c6640 0 -- 172.21.15.133:0/126535429 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f42d802a920 msgr2=0x7f42d801b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:16.882 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.882+0000 7f42ec539800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:16.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.882+0000 7f42ec539800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:16.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.882+0000 7f42ec539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:16.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.882+0000 7f42ec539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:16.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.882+0000 7f42ec539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:16.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.882+0000 7f42ec539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:16.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.883+0000 7f42ec539800 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.883+0000 7f42ec539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.883 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.883+0000 7f42ec539800 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.884 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.883+0000 7f42ec539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:16.884 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.883+0000 7f42ec539800 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.884 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.883+0000 7f42ec539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:16.884 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.884+0000 7f42ec539800 20 zone default found 2024-09-12T00:39:16.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.884+0000 7f42ec539800 4 Realm: () 2024-09-12T00:39:16.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.884+0000 7f42ec539800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:16.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.884+0000 7f42ec539800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:16.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.884+0000 7f42ec539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:16.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.884+0000 7f42ec539800 20 zonegroup default 2024-09-12T00:39:16.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.884+0000 7f42ec539800 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.884+0000 7f42ec539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.884+0000 7f42ec539800 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.884+0000 7f42ec539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.884+0000 7f42ec539800 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.884+0000 7f42ec539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:16.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.884+0000 7f42ec539800 20 started sync module instance, tier type = 2024-09-12T00:39:16.885 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.884+0000 7f42ec539800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:16.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.895+0000 7f42ec539800 20 add_watcher() i=0 2024-09-12T00:39:16.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.895+0000 7f42ec539800 20 add_watcher() i=1 2024-09-12T00:39:16.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.895+0000 7f42ec539800 20 add_watcher() i=2 2024-09-12T00:39:16.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.895+0000 7f42ec539800 20 add_watcher() i=3 2024-09-12T00:39:16.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.895+0000 7f42ec539800 20 add_watcher() i=4 2024-09-12T00:39:16.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.895+0000 7f42ec539800 20 add_watcher() i=5 2024-09-12T00:39:16.895 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.895+0000 7f42ec539800 20 add_watcher() i=6 2024-09-12T00:39:16.896 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.897+0000 7f42ec539800 20 add_watcher() i=7 2024-09-12T00:39:16.896 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.897+0000 7f42ec539800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:16.899 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.899+0000 7f419efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:16.899 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.899+0000 7f42ec539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:16.899 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.899+0000 7f42ec539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:16.899 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.899+0000 7f42ec539800 5 note: GC not initialized 2024-09-12T00:39:16.899 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.899+0000 7f419dfdb640 20 reqs_thread_entry: start 2024-09-12T00:39:16.899 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.899+0000 7f42ec539800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:16.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.899+0000 7f42ec539800 20 Filter name: none 2024-09-12T00:39:16.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.899+0000 7f410f7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:16.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.900+0000 7f42ec539800 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.900+0000 7f42ec539800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:16.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.900+0000 7f42ec539800 20 rados->read ofs=0 len=0 2024-09-12T00:39:16.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.901+0000 7f42ec539800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:16.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.901+0000 7f42ec539800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:16.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.901+0000 7f42ec539800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:39:16.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.901+0000 7f42ec539800 20 INFO: main: starting shard=0 2024-09-12T00:39:16.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.901+0000 7f42ec539800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.0 2024-09-12T00:39:16.901 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.901+0000 7f42ec539800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.0 2024-09-12T00:39:16.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.902+0000 7f42ec539800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:39:16.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.902+0000 7f42ec539800 20 INFO: main: starting shard=1 2024-09-12T00:39:16.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.902+0000 7f42ec539800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.1 2024-09-12T00:39:16.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.902+0000 7f42ec539800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.1 2024-09-12T00:39:16.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.903+0000 7f42ec539800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:39:16.902 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.903+0000 7f42ec539800 20 INFO: main: starting shard=2 2024-09-12T00:39:16.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.903+0000 7f42ec539800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.2 2024-09-12T00:39:16.903 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.903+0000 7f42ec539800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.2 2024-09-12T00:39:16.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.903+0000 7f42ec539800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:39:16.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.903+0000 7f42ec539800 20 INFO: main: done 2024-09-12T00:39:16.904 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.904+0000 7f419efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:16.906 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.907+0000 7f42ec539800 20 remove_watcher() i=0 2024-09-12T00:39:16.906 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.907+0000 7f42ec539800 2 removed watcher, disabling cache 2024-09-12T00:39:16.908 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.908+0000 7f42ec539800 20 remove_watcher() i=1 2024-09-12T00:39:16.909 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.909+0000 7f42ec539800 20 remove_watcher() i=2 2024-09-12T00:39:16.910 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.911+0000 7f42ec539800 20 remove_watcher() i=3 2024-09-12T00:39:16.911 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.912+0000 7f42ec539800 20 remove_watcher() i=4 2024-09-12T00:39:16.912 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.913+0000 7f42ec539800 20 remove_watcher() i=5 2024-09-12T00:39:16.914 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.914+0000 7f42ec539800 20 remove_watcher() i=6 2024-09-12T00:39:16.915 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:16.915+0000 7f42ec539800 20 remove_watcher() i=7 2024-09-12T00:39:17.037 INFO:tasks.workunit.client.0.smithi133.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:39:17.038 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T00:39:17.069 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:17.069 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:17.106 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.106+0000 7f86a1415800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.108+0000 7f86a1415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.108+0000 7f86a1415800 20 realm 2024-09-12T00:39:17.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.108+0000 7f86a1415800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.108+0000 7f86a1415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.108+0000 7f86a1415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:17.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.108+0000 7f86a1415800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.109+0000 7f86a1415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.109+0000 7f86a1415800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.109+0000 7f86a1415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:17.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.109+0000 7f86a1415800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.110+0000 7f86a1415800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:17.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.110+0000 7f86a1415800 20 searching for the correct realm 2024-09-12T00:39:17.112 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.112+0000 7f869c391640 0 -- 172.21.15.133:0/2984777610 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f868407f980 msgr2=0x7f86840882a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:17.318 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.318+0000 7f869c391640 0 -- 172.21.15.133:0/2984777610 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f8694085070 msgr2=0x7f86940799d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:17.526 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.526+0000 7f86a1415800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:17.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.526+0000 7f86a1415800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:17.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.526+0000 7f86a1415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:17.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.526+0000 7f86a1415800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:17.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.526+0000 7f86a1415800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:17.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.526+0000 7f86a1415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:17.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.526+0000 7f86a1415800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.526+0000 7f86a1415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.526+0000 7f86a1415800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.526+0000 7f86a1415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:17.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.526+0000 7f86a1415800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.527+0000 7f86a1415800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:17.527 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.527+0000 7f86a1415800 20 zone default found 2024-09-12T00:39:17.528 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.527+0000 7f86a1415800 4 Realm: () 2024-09-12T00:39:17.528 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.527+0000 7f86a1415800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:17.528 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.527+0000 7f86a1415800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:17.528 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.527+0000 7f86a1415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:17.528 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.527+0000 7f86a1415800 20 zonegroup default 2024-09-12T00:39:17.528 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.527+0000 7f86a1415800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.528 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.527+0000 7f86a1415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.528 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.527+0000 7f86a1415800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.529 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.527+0000 7f86a1415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.529 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.527+0000 7f86a1415800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.529 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.528+0000 7f86a1415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.529 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.528+0000 7f86a1415800 20 started sync module instance, tier type = 2024-09-12T00:39:17.529 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.528+0000 7f86a1415800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:17.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.538+0000 7f86a1415800 20 add_watcher() i=0 2024-09-12T00:39:17.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.538+0000 7f86a1415800 20 add_watcher() i=1 2024-09-12T00:39:17.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.538+0000 7f86a1415800 20 add_watcher() i=2 2024-09-12T00:39:17.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.538+0000 7f86a1415800 20 add_watcher() i=3 2024-09-12T00:39:17.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.538+0000 7f86a1415800 20 add_watcher() i=4 2024-09-12T00:39:17.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.538+0000 7f86a1415800 20 add_watcher() i=5 2024-09-12T00:39:17.538 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.538+0000 7f86a1415800 20 add_watcher() i=6 2024-09-12T00:39:17.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.539+0000 7f86a1415800 20 add_watcher() i=7 2024-09-12T00:39:17.539 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.539+0000 7f86a1415800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:17.541 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.541+0000 7f85537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:17.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.542+0000 7f86a1415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:17.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.542+0000 7f86a1415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:17.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.542+0000 7f86a1415800 5 note: GC not initialized 2024-09-12T00:39:17.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.542+0000 7f85527e4640 20 reqs_thread_entry: start 2024-09-12T00:39:17.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.542+0000 7f86a1415800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:17.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.542+0000 7f86a1415800 20 Filter name: none 2024-09-12T00:39:17.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.542+0000 7f854b7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:17.542 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.542+0000 7f86a1415800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.544 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.543+0000 7f86a1415800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:17.544 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.543+0000 7f86a1415800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.544 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.543+0000 7f86a1415800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:17.544 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.543+0000 7f86a1415800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:17.544 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.543+0000 7f86a1415800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:39:17.545 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.543+0000 7f86a1415800 20 INFO: main: starting shard=0 2024-09-12T00:39:17.545 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.543+0000 7f86a1415800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.0 2024-09-12T00:39:17.546 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.543+0000 7f86a1415800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.0 2024-09-12T00:39:17.546 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.544+0000 7f86a1415800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:39:17.546 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.544+0000 7f86a1415800 20 INFO: main: starting shard=1 2024-09-12T00:39:17.546 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.544+0000 7f86a1415800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.1 2024-09-12T00:39:17.546 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.544+0000 7f86a1415800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.1 2024-09-12T00:39:17.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.545+0000 7f86a1415800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:39:17.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.545+0000 7f86a1415800 20 INFO: main: starting shard=2 2024-09-12T00:39:17.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.545+0000 7f86a1415800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.2 2024-09-12T00:39:17.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.545+0000 7f86a1415800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.2 2024-09-12T00:39:17.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.545+0000 7f86a1415800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:39:17.547 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.545+0000 7f86a1415800 20 INFO: main: done 2024-09-12T00:39:17.548 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.546+0000 7f85537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:17.549 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.548+0000 7f86a1415800 20 remove_watcher() i=0 2024-09-12T00:39:17.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.548+0000 7f86a1415800 2 removed watcher, disabling cache 2024-09-12T00:39:17.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.549+0000 7f86a1415800 20 remove_watcher() i=1 2024-09-12T00:39:17.550 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.550+0000 7f86a1415800 20 remove_watcher() i=2 2024-09-12T00:39:17.551 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.552+0000 7f86a1415800 20 remove_watcher() i=3 2024-09-12T00:39:17.552 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.553+0000 7f86a1415800 20 remove_watcher() i=4 2024-09-12T00:39:17.553 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.554+0000 7f86a1415800 20 remove_watcher() i=5 2024-09-12T00:39:17.554 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.555+0000 7f86a1415800 20 remove_watcher() i=6 2024-09-12T00:39:17.556 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.556+0000 7f86a1415800 20 remove_watcher() i=7 2024-09-12T00:39:17.677 INFO:tasks.workunit.client.0.smithi133.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:39:17.678 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T00:39:17.708 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:17.709 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:17.746 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.746+0000 7fb444c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.748+0000 7fb444c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.748+0000 7fb444c0e800 20 realm 2024-09-12T00:39:17.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.748+0000 7fb444c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.748 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.748+0000 7fb444c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.748+0000 7fb444c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:17.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.748+0000 7fb444c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.749+0000 7fb444c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.749+0000 7fb444c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.749+0000 7fb444c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:17.749 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.749+0000 7fb444c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.750+0000 7fb444c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:17.750 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.750+0000 7fb444c0e800 20 searching for the correct realm 2024-09-12T00:39:17.752 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.752+0000 7fb440be1640 0 -- 172.21.15.133:0/3608364379 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x557cabd14290 msgr2=0x557cabd16680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:17.755 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.755+0000 7fb437fff640 0 -- 172.21.15.133:0/3608364379 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fb43006b020 msgr2=0x7fb4300a3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.963+0000 7fb444c0e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.963+0000 7fb444c0e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.963+0000 7fb444c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.963+0000 7fb444c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.963+0000 7fb444c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.963+0000 7fb444c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:17.963 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.963+0000 7fb444c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.963+0000 7fb444c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.963+0000 7fb444c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.964+0000 7fb444c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:17.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.964+0000 7fb444c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.964+0000 7fb444c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:17.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.964+0000 7fb444c0e800 20 zone default found 2024-09-12T00:39:17.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.964+0000 7fb444c0e800 4 Realm: () 2024-09-12T00:39:17.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.964+0000 7fb444c0e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:17.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.964+0000 7fb444c0e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:17.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.964+0000 7fb444c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:17.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.964+0000 7fb444c0e800 20 zonegroup default 2024-09-12T00:39:17.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.964+0000 7fb444c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.964+0000 7fb444c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.964+0000 7fb444c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.964+0000 7fb444c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.964+0000 7fb444c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.965+0000 7fb444c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:17.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.965+0000 7fb444c0e800 20 started sync module instance, tier type = 2024-09-12T00:39:17.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.965+0000 7fb444c0e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:17.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.975+0000 7fb444c0e800 20 add_watcher() i=0 2024-09-12T00:39:17.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.975+0000 7fb444c0e800 20 add_watcher() i=1 2024-09-12T00:39:17.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.975+0000 7fb444c0e800 20 add_watcher() i=2 2024-09-12T00:39:17.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.975+0000 7fb444c0e800 20 add_watcher() i=3 2024-09-12T00:39:17.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.975+0000 7fb444c0e800 20 add_watcher() i=4 2024-09-12T00:39:17.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.975+0000 7fb444c0e800 20 add_watcher() i=5 2024-09-12T00:39:17.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.975+0000 7fb444c0e800 20 add_watcher() i=6 2024-09-12T00:39:17.975 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.976+0000 7fb444c0e800 20 add_watcher() i=7 2024-09-12T00:39:17.976 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.976+0000 7fb444c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:17.977 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.978+0000 7fb2f67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:17.978 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.978+0000 7fb444c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:17.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.978+0000 7fb444c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:17.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.978+0000 7fb444c0e800 5 note: GC not initialized 2024-09-12T00:39:17.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.978+0000 7fb2f57e2640 20 reqs_thread_entry: start 2024-09-12T00:39:17.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.979+0000 7fb444c0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:17.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.979+0000 7fb444c0e800 20 Filter name: none 2024-09-12T00:39:17.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.979+0000 7fb266ffd640 20 reqs_thread_entry: start 2024-09-12T00:39:17.979 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.979+0000 7fb444c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.980 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.980+0000 7fb444c0e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:17.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.980+0000 7fb444c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:39:17.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.980+0000 7fb444c0e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:17.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.980+0000 7fb444c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:17.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.980+0000 7fb444c0e800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:39:17.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.980+0000 7fb444c0e800 20 INFO: main: starting shard=0 2024-09-12T00:39:17.981 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.980+0000 7fb444c0e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.0 2024-09-12T00:39:17.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.980+0000 7fb444c0e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.0 2024-09-12T00:39:17.982 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.981+0000 7fb444c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:39:17.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.981+0000 7fb444c0e800 20 INFO: main: starting shard=1 2024-09-12T00:39:17.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.981+0000 7fb444c0e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.1 2024-09-12T00:39:17.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.981+0000 7fb444c0e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.1 2024-09-12T00:39:17.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.981+0000 7fb444c0e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:39:17.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.981+0000 7fb444c0e800 20 INFO: main: starting shard=2 2024-09-12T00:39:17.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.981+0000 7fb444c0e800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.2 2024-09-12T00:39:17.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.981+0000 7fb444c0e800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.2 2024-09-12T00:39:17.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.982+0000 7fb444c0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:39:17.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.982+0000 7fb444c0e800 20 INFO: main: done 2024-09-12T00:39:17.983 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.983+0000 7fb2f67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:17.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.985+0000 7fb444c0e800 20 remove_watcher() i=0 2024-09-12T00:39:17.985 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.985+0000 7fb444c0e800 2 removed watcher, disabling cache 2024-09-12T00:39:17.986 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.986+0000 7fb444c0e800 20 remove_watcher() i=1 2024-09-12T00:39:17.987 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.987+0000 7fb444c0e800 20 remove_watcher() i=2 2024-09-12T00:39:17.988 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.988+0000 7fb444c0e800 20 remove_watcher() i=3 2024-09-12T00:39:17.989 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.989+0000 7fb444c0e800 20 remove_watcher() i=4 2024-09-12T00:39:17.990 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.990+0000 7fb444c0e800 20 remove_watcher() i=5 2024-09-12T00:39:17.992 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.992+0000 7fb444c0e800 20 remove_watcher() i=6 2024-09-12T00:39:17.993 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:17.993+0000 7fb444c0e800 20 remove_watcher() i=7 2024-09-12T00:39:18.029 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:39:18.429 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:39:18.821 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T00:39:18.853 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:18.853 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:18.890 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:18.891+0000 7f82432bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:18.892+0000 7f82432bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:18.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:18.892+0000 7f82432bb800 20 realm 2024-09-12T00:39:18.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:18.892+0000 7f82432bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:18.892+0000 7f82432bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:18.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:18.892+0000 7f82432bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:18.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:18.892+0000 7f82432bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:18.892+0000 7f82432bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:18.892 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:18.892+0000 7f82432bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.893 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:18.893+0000 7f82432bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:18.893 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:18.893+0000 7f82432bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:18.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:18.894+0000 7f82432bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:18.894 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:18.894+0000 7f82432bb800 20 searching for the correct realm 2024-09-12T00:39:18.896 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:18.896+0000 7f82405a4640 0 -- 172.21.15.133:0/768002345 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f8228036070 msgr2=0x7f8228047480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:18.900 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:18.900+0000 7f82405a4640 0 -- 172.21.15.133:0/768002345 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f823006b030 msgr2=0x7f82300a37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:19.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.107+0000 7f82432bb800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:19.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.107+0000 7f82432bb800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:19.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.107+0000 7f82432bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:19.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.107+0000 7f82432bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:19.108 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.107+0000 7f82432bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:19.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.107+0000 7f82432bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:19.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.107+0000 7f82432bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.107+0000 7f82432bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.107+0000 7f82432bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.108+0000 7f82432bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:19.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.108+0000 7f82432bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.108+0000 7f82432bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:19.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.108+0000 7f82432bb800 20 zone default found 2024-09-12T00:39:19.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.108+0000 7f82432bb800 4 Realm: () 2024-09-12T00:39:19.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.108+0000 7f82432bb800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:19.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.108+0000 7f82432bb800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:19.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.108+0000 7f82432bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:19.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.108+0000 7f82432bb800 20 zonegroup default 2024-09-12T00:39:19.109 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.108+0000 7f82432bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.108+0000 7f82432bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.108+0000 7f82432bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.109+0000 7f82432bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.109+0000 7f82432bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.110 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.109+0000 7f82432bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.109+0000 7f82432bb800 20 started sync module instance, tier type = 2024-09-12T00:39:19.111 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.109+0000 7f82432bb800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:19.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.119+0000 7f82432bb800 20 add_watcher() i=0 2024-09-12T00:39:19.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.119+0000 7f82432bb800 20 add_watcher() i=1 2024-09-12T00:39:19.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.119+0000 7f82432bb800 20 add_watcher() i=2 2024-09-12T00:39:19.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.119+0000 7f82432bb800 20 add_watcher() i=3 2024-09-12T00:39:19.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.119+0000 7f82432bb800 20 add_watcher() i=4 2024-09-12T00:39:19.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.119+0000 7f82432bb800 20 add_watcher() i=5 2024-09-12T00:39:19.119 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.119+0000 7f82432bb800 20 add_watcher() i=6 2024-09-12T00:39:19.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.120+0000 7f82432bb800 20 add_watcher() i=7 2024-09-12T00:39:19.120 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.120+0000 7f82432bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:19.122 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.122+0000 7f80f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:19.123 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.123+0000 7f82432bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:19.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.123+0000 7f82432bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:19.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.123+0000 7f82432bb800 5 note: GC not initialized 2024-09-12T00:39:19.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.123+0000 7f80f67e4640 20 reqs_thread_entry: start 2024-09-12T00:39:19.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.123+0000 7f82432bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:19.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.123+0000 7f82432bb800 20 Filter name: none 2024-09-12T00:39:19.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.123+0000 7f80effff640 20 reqs_thread_entry: start 2024-09-12T00:39:19.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.123+0000 7f82432bb800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:39:19.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.123+0000 7f82432bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.124+0000 7f82432bb800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:19.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.124+0000 7f82432bb800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:39:19.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.124+0000 7f82432bb800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:39:19.124 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.124+0000 7f82432bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 : miss 2024-09-12T00:39:19.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.124+0000 7f82432bb800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.124+0000 7f82432bb800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:19.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.124+0000 7f82432bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:19.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.124+0000 7f82432bb800 10 adding default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:19.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.124+0000 7f82432bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:19.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.124+0000 7f82432bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:19.125 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.124+0000 7f82432bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 2024-09-12T00:39:19.129 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.130+0000 7f82432bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:19.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.130+0000 7f82432bb800 10 moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:19.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.130+0000 7f82432bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:19.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.130+0000 7f82432bb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19, ofs0, ns] 2024-09-12T00:39:19.130 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.130+0000 7f81177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497094 cookie 94301420154576 notifier 8868 bl.length()=905 2024-09-12T00:39:19.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.130+0000 7f81177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:19.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.130+0000 7f81177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:19.131 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.130+0000 7f81177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:19.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.132+0000 7f82432bb800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_sources= new_sources= 2024-09-12T00:39:19.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.132+0000 7f82432bb800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential sources added=[] removed=[] 2024-09-12T00:39:19.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.132+0000 7f82432bb800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_dests= new_dests= 2024-09-12T00:39:19.132 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.132+0000 7f82432bb800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential dests added=[] removed=[] 2024-09-12T00:39:19.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.0 2024-09-12T00:39:19.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.0 2024-09-12T00:39:19.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.1 2024-09-12T00:39:19.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.1 2024-09-12T00:39:19.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.2 2024-09-12T00:39:19.135 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.2 2024-09-12T00:39:19.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.3 2024-09-12T00:39:19.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.3 2024-09-12T00:39:19.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.4 2024-09-12T00:39:19.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.4 2024-09-12T00:39:19.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.5 2024-09-12T00:39:19.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.5 2024-09-12T00:39:19.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.6 2024-09-12T00:39:19.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.6 2024-09-12T00:39:19.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.7 2024-09-12T00:39:19.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.7 2024-09-12T00:39:19.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.8 2024-09-12T00:39:19.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.8 2024-09-12T00:39:19.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.136 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.10 2024-09-12T00:39:19.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.10 2024-09-12T00:39:19.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.11 2024-09-12T00:39:19.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.11 2024-09-12T00:39:19.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.12 2024-09-12T00:39:19.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.12 2024-09-12T00:39:19.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.13 2024-09-12T00:39:19.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.13 2024-09-12T00:39:19.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.14 2024-09-12T00:39:19.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.14 2024-09-12T00:39:19.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.15 2024-09-12T00:39:19.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.15 2024-09-12T00:39:19.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.16 2024-09-12T00:39:19.137 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.16 2024-09-12T00:39:19.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.0 2024-09-12T00:39:19.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.135+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.0 2024-09-12T00:39:19.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.136+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.1 2024-09-12T00:39:19.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.136+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.1 2024-09-12T00:39:19.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.136+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.2 2024-09-12T00:39:19.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.136+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.2 2024-09-12T00:39:19.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.139+0000 7f82432bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:19.138 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.139+0000 7f82432bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 2024-09-12T00:39:19.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.140+0000 7f82432bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:19.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.140+0000 7f82432bb800 10 moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:19.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.140+0000 7f82432bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:19.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.140+0000 7f82432bb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19, ofs0, ns] 2024-09-12T00:39:19.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.140+0000 7f81177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497095 cookie 94301420154576 notifier 8868 bl.length()=905 2024-09-12T00:39:19.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.140+0000 7f81177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:19.140 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.140+0000 7f81177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:19.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.140+0000 7f81177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:19.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.142+0000 7f82432bb800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_sources= new_sources= 2024-09-12T00:39:19.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.142+0000 7f82432bb800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential sources added=[] removed=[] 2024-09-12T00:39:19.141 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.142+0000 7f82432bb800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_dests= new_dests= 2024-09-12T00:39:19.142 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.142+0000 7f82432bb800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential dests added=[] removed=[] 2024-09-12T00:39:19.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.143+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.0 2024-09-12T00:39:19.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.143+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.0 2024-09-12T00:39:19.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.143+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.1 2024-09-12T00:39:19.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.143+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.1 2024-09-12T00:39:19.143 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.144+0000 7f82432bb800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.2 2024-09-12T00:39:19.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.144+0000 7f82432bb800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.2.2 2024-09-12T00:39:19.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.144+0000 7f82432bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:39:19.144 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.144+0000 7f82432bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 2024-09-12T00:39:19.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.146+0000 7f82432bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:19.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.146+0000 7f82432bb800 10 moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:19.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.146+0000 7f82432bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:19.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.146+0000 7f82432bb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19, ofs0, ns] 2024-09-12T00:39:19.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.146+0000 7f8117fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497096 cookie 94301420154576 notifier 8868 bl.length()=873 2024-09-12T00:39:19.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.146+0000 7f8117fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:19.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.146+0000 7f8117fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:19.146 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.146+0000 7f8117fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:19.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.147+0000 7f82432bb800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_sources= new_sources= 2024-09-12T00:39:19.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.147+0000 7f82432bb800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential sources added=[] removed=[] 2024-09-12T00:39:19.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.147+0000 7f82432bb800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): orig_dests= new_dests= 2024-09-12T00:39:19.147 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.147+0000 7f82432bb800 20 handle_bi_update(): bucket=:myver[dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19]): potential dests added=[] removed=[] 2024-09-12T00:39:19.148 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.149+0000 7f82432bb800 1 execute INFO: reshard of bucket "myver" from 3 shards to 17 shards completed successfully 2024-09-12T00:39:19.150 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.151+0000 7f80f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:19.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.153+0000 7f82432bb800 20 remove_watcher() i=0 2024-09-12T00:39:19.152 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.153+0000 7f82432bb800 2 removed watcher, disabling cache 2024-09-12T00:39:19.153 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.154+0000 7f82432bb800 20 remove_watcher() i=1 2024-09-12T00:39:19.154 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.155+0000 7f82432bb800 20 remove_watcher() i=2 2024-09-12T00:39:19.155 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.156+0000 7f82432bb800 20 remove_watcher() i=3 2024-09-12T00:39:19.157 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.157+0000 7f82432bb800 20 remove_watcher() i=4 2024-09-12T00:39:19.158 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.158+0000 7f82432bb800 20 remove_watcher() i=5 2024-09-12T00:39:19.159 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.159+0000 7f82432bb800 20 remove_watcher() i=6 2024-09-12T00:39:19.160 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.160+0000 7f82432bb800 20 remove_watcher() i=7 2024-09-12T00:39:19.172 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:39:19.207 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:19.207 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:19.244 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.244+0000 7f3168c14800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.246+0000 7f3168c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.246+0000 7f3168c14800 20 realm 2024-09-12T00:39:19.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.246+0000 7f3168c14800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.246+0000 7f3168c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.246+0000 7f3168c14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:19.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.246+0000 7f3168c14800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.246+0000 7f3168c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.246 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.246+0000 7f3168c14800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.247 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.247+0000 7f3168c14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:19.247 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.247+0000 7f3168c14800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.247 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.248+0000 7f3168c14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:19.247 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.248+0000 7f3168c14800 20 searching for the correct realm 2024-09-12T00:39:19.249 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.249+0000 7f315baca640 0 -- 172.21.15.133:0/559563620 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f314c0a39b0 msgr2=0x7f314c0ab640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:19.454 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.454+0000 7f315baca640 0 -- 172.21.15.133:0/559563620 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f31540730f0 msgr2=0x7f3154068fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:19.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.661+0000 7f3168c14800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:19.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.661+0000 7f3168c14800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:19.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.661+0000 7f3168c14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:19.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.661+0000 7f3168c14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:19.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.661+0000 7f3168c14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:19.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.661+0000 7f3168c14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:19.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.661+0000 7f3168c14800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.661+0000 7f3168c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.661+0000 7f3168c14800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.662 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.662+0000 7f3168c14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:19.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.662+0000 7f3168c14800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.662+0000 7f3168c14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:19.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.662+0000 7f3168c14800 20 zone default found 2024-09-12T00:39:19.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.662+0000 7f3168c14800 4 Realm: () 2024-09-12T00:39:19.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.662+0000 7f3168c14800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:19.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.662+0000 7f3168c14800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:19.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.662+0000 7f3168c14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:19.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.662+0000 7f3168c14800 20 zonegroup default 2024-09-12T00:39:19.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.662+0000 7f3168c14800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.663+0000 7f3168c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.663+0000 7f3168c14800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.663+0000 7f3168c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.663 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.663+0000 7f3168c14800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.663+0000 7f3168c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.663+0000 7f3168c14800 20 started sync module instance, tier type = 2024-09-12T00:39:19.664 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.663+0000 7f3168c14800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:19.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.674+0000 7f3168c14800 20 add_watcher() i=0 2024-09-12T00:39:19.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.674+0000 7f3168c14800 20 add_watcher() i=1 2024-09-12T00:39:19.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.674+0000 7f3168c14800 20 add_watcher() i=2 2024-09-12T00:39:19.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.674+0000 7f3168c14800 20 add_watcher() i=3 2024-09-12T00:39:19.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.674+0000 7f3168c14800 20 add_watcher() i=4 2024-09-12T00:39:19.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.674+0000 7f3168c14800 20 add_watcher() i=5 2024-09-12T00:39:19.674 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.674+0000 7f3168c14800 20 add_watcher() i=6 2024-09-12T00:39:19.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.675+0000 7f3168c14800 20 add_watcher() i=7 2024-09-12T00:39:19.675 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.675+0000 7f3168c14800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:19.676 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.677+0000 7f301a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:19.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.677+0000 7f3168c14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:19.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.677+0000 7f3168c14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:19.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.677+0000 7f3168c14800 5 note: GC not initialized 2024-09-12T00:39:19.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.677+0000 7f30197e2640 20 reqs_thread_entry: start 2024-09-12T00:39:19.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.678+0000 7f3168c14800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:19.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.678+0000 7f3168c14800 20 Filter name: none 2024-09-12T00:39:19.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.678+0000 7f2f8affd640 20 reqs_thread_entry: start 2024-09-12T00:39:19.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.678+0000 7f3168c14800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:39:19.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.678+0000 7f3168c14800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.678+0000 7f3168c14800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:19.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.678+0000 7f3168c14800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:39:19.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.678+0000 7f3168c14800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:39:19.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.678+0000 7f3168c14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 : miss 2024-09-12T00:39:19.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.678+0000 7f3168c14800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.679+0000 7f3168c14800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:19.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.679+0000 7f3168c14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 info.flags=0x17 2024-09-12T00:39:19.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.679+0000 7f3168c14800 10 adding default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 to cache LRU end 2024-09-12T00:39:19.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.679+0000 7f3168c14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:19.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.679+0000 7f3168c14800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T00:39:19.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.679+0000 7f3168c14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19 2024-09-12T00:39:19.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.679+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.0 2024-09-12T00:39:19.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.679+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.0 2024-09-12T00:39:19.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.679+0000 7f3168c14800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:39:19.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.679+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.1 2024-09-12T00:39:19.680 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.679+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.1 2024-09-12T00:39:19.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.680+0000 7f3168c14800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:39:19.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.680+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.2 2024-09-12T00:39:19.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.680+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.2 2024-09-12T00:39:19.681 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.680+0000 7f3168c14800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:39:19.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.680+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.3 2024-09-12T00:39:19.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.680+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.3 2024-09-12T00:39:19.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.681+0000 7f3168c14800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:39:19.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.681+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.4 2024-09-12T00:39:19.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.681+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.4 2024-09-12T00:39:19.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.681+0000 7f3168c14800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:39:19.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.681+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.5 2024-09-12T00:39:19.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.681+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.5 2024-09-12T00:39:19.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.682+0000 7f3168c14800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T00:39:19.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.682+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.6 2024-09-12T00:39:19.682 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.682+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.6 2024-09-12T00:39:19.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.682+0000 7f3168c14800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:39:19.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.682+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.7 2024-09-12T00:39:19.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.682+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.7 2024-09-12T00:39:19.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.683+0000 7f3168c14800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:39:19.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.683+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.8 2024-09-12T00:39:19.683 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.683+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.8 2024-09-12T00:39:19.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.683+0000 7f3168c14800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T00:39:19.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.683+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.683+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.684+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.10 2024-09-12T00:39:19.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.684+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.10 2024-09-12T00:39:19.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.684+0000 7f3168c14800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:39:19.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.684+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.11 2024-09-12T00:39:19.684 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.684+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.11 2024-09-12T00:39:19.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.685+0000 7f3168c14800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T00:39:19.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.685+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.12 2024-09-12T00:39:19.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.685+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.12 2024-09-12T00:39:19.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.685+0000 7f3168c14800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T00:39:19.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.685+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.13 2024-09-12T00:39:19.685 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.685+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.13 2024-09-12T00:39:19.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.686+0000 7f3168c14800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T00:39:19.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.686+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.14 2024-09-12T00:39:19.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.686+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.14 2024-09-12T00:39:19.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.686+0000 7f3168c14800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T00:39:19.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.686+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.15 2024-09-12T00:39:19.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.686+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.15 2024-09-12T00:39:19.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.687+0000 7f3168c14800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T00:39:19.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.687+0000 7f3168c14800 10 bucket_obj is .dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.16 2024-09-12T00:39:19.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.687+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.16 2024-09-12T00:39:19.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.687+0000 7f3168c14800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T00:39:19.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.687+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.687+0000 7f3168c14800 20 get_obj_state: octx=0x55e419abf690 obj=myver:x state=0x55e419d8af58 s->prefetch_data=0 2024-09-12T00:39:19.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.688+0000 7f3168c14800 20 get_obj_state: setting s->obj_tag to a8mgbajwtgy8q4zgpwxwj754dcscbva9 2024-09-12T00:39:19.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.688+0000 7f3168c14800 20 get_obj_state_impl: setting s->olh_tag to njkj3970qete6jmum9z780t1oou474hm 2024-09-12T00:39:19.688 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.688+0000 7f3168c14800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=njkj3970qete6jmum9z780t1oou474hm 2024-09-12T00:39:19.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.689+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.691+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.691+0000 7f3168c14800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T00:39:19.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.691+0000 7f3168c14800 20 olh_log_entry: epoch=2 op=3 key=x[DbYMMaJ6BKjfdzM-15fhlFQ-4mr8NSQ] 2024-09-12T00:39:19.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.691+0000 7f3168c14800 20 get_obj_state: octx=0x55e419abf690 obj=myver:_:DbYMMaJ6BKjfdzM-15fhlFQ-4mr8NSQ_x state=0x55e419dc8a38 s->prefetch_data=0 2024-09-12T00:39:19.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.692+0000 7f3168c14800 10 manifest: total_size = 12 2024-09-12T00:39:19.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.692+0000 7f3168c14800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1128410604991842497 2024-09-12T00:39:19.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.692+0000 7f3168c14800 20 get_obj_state: octx=0x55e419abf690 obj=myver:_:DbYMMaJ6BKjfdzM-15fhlFQ-4mr8NSQ_x state=0x55e419dc8a38 s->prefetch_data=0 2024-09-12T00:39:19.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.692+0000 7f3168c14800 20 prepare_atomic_modification: state is not atomic. state=0x55e419dc8a38 2024-09-12T00:39:19.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.692+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.695+0000 7f3168c14800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:39:19.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.695+0000 7f3168c14800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:39:19.694 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.695+0000 7f3168c14800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:39:19.695 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.695+0000 7f3168c14800 5 delete_objs_inline: removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19__shadow:DbYMMaJ6BKjfdzM-15fhlFQ-4mr8NSQ_.gkanOmdfdMtsWERiUc-L7SzMBMuvkIZ_0 2024-09-12T00:39:19.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.696+0000 7f3168c14800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:39:19.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.696+0000 7f303affd640 20 handle_completion(): completion ok for obj=x[DbYMMaJ6BKjfdzM-15fhlFQ-4mr8NSQ] 2024-09-12T00:39:19.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.697+0000 7f3168c14800 20 get_obj_state: octx=0x55e419abf690 obj=myver:x state=0x55e419d8af58 s->prefetch_data=0 2024-09-12T00:39:19.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.697+0000 7f3168c14800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=njkj3970qete6jmum9z780t1oou474hm 2024-09-12T00:39:19.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.700+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.701+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.702+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.702+0000 7f3168c14800 20 get_obj_state: octx=0x55e419abf690 obj=myver:y state=0x55e419dcab38 s->prefetch_data=0 2024-09-12T00:39:19.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.702+0000 7f3168c14800 20 get_obj_state: setting s->obj_tag to rbox92sxhm7e72pi358r8kkw07wmdxfh 2024-09-12T00:39:19.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.702+0000 7f3168c14800 20 get_obj_state_impl: setting s->olh_tag to x7tjo1ai10w0r8nqtdx2qnje3zj56f68 2024-09-12T00:39:19.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.702+0000 7f3168c14800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=x7tjo1ai10w0r8nqtdx2qnje3zj56f68 2024-09-12T00:39:19.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.704+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.705+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.706+0000 7f3168c14800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T00:39:19.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.706+0000 7f3168c14800 20 olh_log_entry: epoch=2 op=3 key=y[sIGjskIFkKWNPQX7N2PEa2aojI6s-8e] 2024-09-12T00:39:19.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.706+0000 7f3168c14800 20 get_obj_state: octx=0x55e419abf690 obj=myver:_:sIGjskIFkKWNPQX7N2PEa2aojI6s-8e_y state=0x55e419d8bf68 s->prefetch_data=0 2024-09-12T00:39:19.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.706+0000 7f3168c14800 10 manifest: total_size = 12 2024-09-12T00:39:19.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.706+0000 7f3168c14800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2361277405859365452 2024-09-12T00:39:19.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.706+0000 7f3168c14800 20 get_obj_state: octx=0x55e419abf690 obj=myver:_:sIGjskIFkKWNPQX7N2PEa2aojI6s-8e_y state=0x55e419d8bf68 s->prefetch_data=0 2024-09-12T00:39:19.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.706+0000 7f3168c14800 20 prepare_atomic_modification: state is not atomic. state=0x55e419d8bf68 2024-09-12T00:39:19.706 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.706+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.709+0000 7f3168c14800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:39:19.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.709+0000 7f3168c14800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:39:19.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.709+0000 7f3168c14800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:39:19.709 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.709+0000 7f3168c14800 5 delete_objs_inline: removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19__shadow:sIGjskIFkKWNPQX7N2PEa2aojI6s-8e_.d7rGH1vC_WZK2Loxo_iZamO6ZTTBa5E_0 2024-09-12T00:39:19.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.710+0000 7f303b7fe640 20 handle_completion(): completion ok for obj=y[sIGjskIFkKWNPQX7N2PEa2aojI6s-8e] 2024-09-12T00:39:19.710 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.710+0000 7f3168c14800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:39:19.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.712+0000 7f3168c14800 20 get_obj_state: octx=0x55e419abf690 obj=myver:y state=0x55e419dcab38 s->prefetch_data=0 2024-09-12T00:39:19.711 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.712+0000 7f3168c14800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=x7tjo1ai10w0r8nqtdx2qnje3zj56f68 2024-09-12T00:39:19.714 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.714+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.715+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.715 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.716+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.716+0000 7f3168c14800 20 get_obj_state: octx=0x55e419abf690 obj=myver:z state=0x55e419dcab38 s->prefetch_data=0 2024-09-12T00:39:19.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.716+0000 7f3168c14800 20 get_obj_state: setting s->obj_tag to vn3h7iw73hu4sjmx10l11qh3ghdac241 2024-09-12T00:39:19.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.716+0000 7f3168c14800 20 get_obj_state_impl: setting s->olh_tag to 7qpoyzv7xiwzjwtmlqpm2bta5knl59g6 2024-09-12T00:39:19.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.716+0000 7f3168c14800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7qpoyzv7xiwzjwtmlqpm2bta5knl59g6 2024-09-12T00:39:19.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.717+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.719+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.719+0000 7f3168c14800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T00:39:19.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.719+0000 7f3168c14800 20 olh_log_entry: epoch=2 op=3 key=z[QvnwCr0fALbIlDvOOKLCSGpvFBLUUjH] 2024-09-12T00:39:19.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.719+0000 7f3168c14800 20 get_obj_state: octx=0x55e419abf690 obj=myver:_:QvnwCr0fALbIlDvOOKLCSGpvFBLUUjH_z state=0x55e419d8bf68 s->prefetch_data=0 2024-09-12T00:39:19.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.719+0000 7f3168c14800 10 manifest: total_size = 22 2024-09-12T00:39:19.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.719+0000 7f3168c14800 20 get_obj_state: setting s->obj_tag to dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6960611980940614878 2024-09-12T00:39:19.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.719+0000 7f3168c14800 20 get_obj_state: octx=0x55e419abf690 obj=myver:_:QvnwCr0fALbIlDvOOKLCSGpvFBLUUjH_z state=0x55e419d8bf68 s->prefetch_data=0 2024-09-12T00:39:19.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.719+0000 7f3168c14800 20 prepare_atomic_modification: state is not atomic. state=0x55e419d8bf68 2024-09-12T00:39:19.720 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.719+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.722+0000 7f3168c14800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:39:19.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.722+0000 7f3168c14800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:39:19.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.722+0000 7f3168c14800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:39:19.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.722+0000 7f3168c14800 5 delete_objs_inline: removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19__shadow:QvnwCr0fALbIlDvOOKLCSGpvFBLUUjH_.Ub3C0RJEB55zLb_hh6jqVg7-9Xu_S7n_0 2024-09-12T00:39:19.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.723+0000 7f3168c14800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:39:19.723 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.723+0000 7f303affd640 20 handle_completion(): completion ok for obj=z[QvnwCr0fALbIlDvOOKLCSGpvFBLUUjH] 2024-09-12T00:39:19.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.724+0000 7f3168c14800 20 get_obj_state: octx=0x55e419abf690 obj=myver:z state=0x55e419dcab38 s->prefetch_data=0 2024-09-12T00:39:19.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.724+0000 7f3168c14800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7qpoyzv7xiwzjwtmlqpm2bta5knl59g6 2024-09-12T00:39:19.726 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.727+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.728+0000 7f3168c14800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19.3.9 2024-09-12T00:39:19.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.728+0000 7f3168c14800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T00:39:19.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.728+0000 7f3168c14800 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T00:39:19.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.729+0000 7f301a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:19.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.732+0000 7f3168c14800 20 remove_watcher() i=0 2024-09-12T00:39:19.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.732+0000 7f3168c14800 2 removed watcher, disabling cache 2024-09-12T00:39:19.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.734+0000 7f3168c14800 20 remove_watcher() i=1 2024-09-12T00:39:19.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.735+0000 7f3168c14800 20 remove_watcher() i=2 2024-09-12T00:39:19.735 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.736+0000 7f3168c14800 20 remove_watcher() i=3 2024-09-12T00:39:19.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.737+0000 7f3168c14800 20 remove_watcher() i=4 2024-09-12T00:39:19.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.738+0000 7f3168c14800 20 remove_watcher() i=5 2024-09-12T00:39:19.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.739+0000 7f3168c14800 20 remove_watcher() i=6 2024-09-12T00:39:19.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.740+0000 7f3168c14800 20 remove_watcher() i=7 2024-09-12T00:39:19.886 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:39:19.916 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:19.916 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:19.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.953+0000 7fa9ab93a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.954+0000 7fa9ab93a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.954+0000 7fa9ab93a800 20 realm 2024-09-12T00:39:19.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.954+0000 7fa9ab93a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.955+0000 7fa9ab93a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.955+0000 7fa9ab93a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:19.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.955+0000 7fa9ab93a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.955+0000 7fa9ab93a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.955+0000 7fa9ab93a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.956+0000 7fa9ab93a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:19.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.956+0000 7fa9ab93a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.957+0000 7fa9ab93a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:19.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.957+0000 7fa9ab93a800 20 searching for the correct realm 2024-09-12T00:39:19.958 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:19.958+0000 7fa9a6e80640 0 -- 172.21.15.133:0/2453872026 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fa990029070 msgr2=0x7fa990084b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:20.162 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.163+0000 7fa9a6e80640 0 -- 172.21.15.133:0/2453872026 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fa99806d070 msgr2=0x7fa998087920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:20.368 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.368+0000 7fa9ab93a800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:20.368 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.368+0000 7fa9ab93a800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:20.368 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.368+0000 7fa9ab93a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:20.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.368+0000 7fa9ab93a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:20.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.368+0000 7fa9ab93a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:20.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.368+0000 7fa9ab93a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:20.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.368+0000 7fa9ab93a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.368+0000 7fa9ab93a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.368+0000 7fa9ab93a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.369+0000 7fa9ab93a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:20.369 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.369+0000 7fa9ab93a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.369+0000 7fa9ab93a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:20.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.369+0000 7fa9ab93a800 20 zone default found 2024-09-12T00:39:20.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.369+0000 7fa9ab93a800 4 Realm: () 2024-09-12T00:39:20.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.369+0000 7fa9ab93a800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:20.370 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.369+0000 7fa9ab93a800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:20.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.369+0000 7fa9ab93a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:20.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.369+0000 7fa9ab93a800 20 zonegroup default 2024-09-12T00:39:20.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.369+0000 7fa9ab93a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.370+0000 7fa9ab93a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.370+0000 7fa9ab93a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.370+0000 7fa9ab93a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.370+0000 7fa9ab93a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.370+0000 7fa9ab93a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.370+0000 7fa9ab93a800 20 started sync module instance, tier type = 2024-09-12T00:39:20.371 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.370+0000 7fa9ab93a800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:20.379 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.379+0000 7fa9ab93a800 20 add_watcher() i=0 2024-09-12T00:39:20.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.379+0000 7fa9ab93a800 20 add_watcher() i=1 2024-09-12T00:39:20.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.379+0000 7fa9ab93a800 20 add_watcher() i=2 2024-09-12T00:39:20.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.379+0000 7fa9ab93a800 20 add_watcher() i=3 2024-09-12T00:39:20.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.379+0000 7fa9ab93a800 20 add_watcher() i=4 2024-09-12T00:39:20.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.379+0000 7fa9ab93a800 20 add_watcher() i=5 2024-09-12T00:39:20.380 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.380+0000 7fa9ab93a800 20 add_watcher() i=6 2024-09-12T00:39:20.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.382+0000 7fa9ab93a800 20 add_watcher() i=7 2024-09-12T00:39:20.381 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.382+0000 7fa9ab93a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:20.383 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.383+0000 7fa85dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:20.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.384+0000 7fa9ab93a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:20.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.384+0000 7fa9ab93a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:20.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.384+0000 7fa9ab93a800 5 note: GC not initialized 2024-09-12T00:39:20.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.384+0000 7fa85cfe1640 20 reqs_thread_entry: start 2024-09-12T00:39:20.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.384+0000 7fa9ab93a800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:20.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.384+0000 7fa9ab93a800 20 Filter name: none 2024-09-12T00:39:20.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.384+0000 7fa7d67fc640 20 reqs_thread_entry: start 2024-09-12T00:39:20.384 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.384+0000 7fa9ab93a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.385 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.385+0000 7fa9ab93a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:20.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.385+0000 7fa9ab93a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.385+0000 7fa9ab93a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:20.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.385+0000 7fa9ab93a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:20.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.385+0000 7fa9ab93a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.385+0000 7fa9ab93a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:39:20.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.385+0000 7fa9ab93a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.386+0000 7fa9ab93a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:39:20.386 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.386+0000 7fa9ab93a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:20.387 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.388+0000 7fa85dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:20.389 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.389+0000 7fa9ab93a800 20 remove_watcher() i=0 2024-09-12T00:39:20.389 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.389+0000 7fa9ab93a800 2 removed watcher, disabling cache 2024-09-12T00:39:20.390 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.390+0000 7fa9ab93a800 20 remove_watcher() i=1 2024-09-12T00:39:20.391 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.391+0000 7fa9ab93a800 20 remove_watcher() i=2 2024-09-12T00:39:20.392 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.392+0000 7fa9ab93a800 20 remove_watcher() i=3 2024-09-12T00:39:20.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.394+0000 7fa9ab93a800 20 remove_watcher() i=4 2024-09-12T00:39:20.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.395+0000 7fa9ab93a800 20 remove_watcher() i=5 2024-09-12T00:39:20.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.396+0000 7fa9ab93a800 20 remove_watcher() i=6 2024-09-12T00:39:20.397 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T00:39:20.397+0000 7fa9ab93a800 20 remove_watcher() i=7 2024-09-12T00:39:20.407 INFO:tasks.workunit.client.0.smithi133.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:39:20.408 INFO:tasks.workunit.client.0.smithi133.stderr:Deleting bucket a-bucket 2024-09-12T00:39:20.487 INFO:tasks.workunit.client.0.smithi133.stderr:Deleting bucket myver 2024-09-12T00:39:20.735 INFO:tasks.workunit.client.0.smithi133.stderr:Completed resharding tests 2024-09-12T00:39:20.735 INFO:tasks.workunit.client.0.smithi133.stdout:connected to http://localhost:80 2024-09-12T00:39:20.815 INFO:tasks.workunit.client.0.smithi133.stderr:+ deactivate 2024-09-12T00:39:20.815 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:39:20.815 INFO:tasks.workunit.client.0.smithi133.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:39:20.815 INFO:tasks.workunit.client.0.smithi133.stderr:+ export PATH 2024-09-12T00:39:20.815 INFO:tasks.workunit.client.0.smithi133.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:39:20.816 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n '' ']' 2024-09-12T00:39:20.816 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:39:20.816 INFO:tasks.workunit.client.0.smithi133.stderr:+ hash -r 2024-09-12T00:39:20.816 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n '' ']' 2024-09-12T00:39:20.816 INFO:tasks.workunit.client.0.smithi133.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:39:20.816 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:39:20.816 INFO:tasks.workunit.client.0.smithi133.stderr:+ unset -f deactivate 2024-09-12T00:39:20.816 INFO:tasks.workunit.client.0.smithi133.stderr:+ echo OK. 2024-09-12T00:39:20.817 INFO:tasks.workunit.client.0.smithi133.stdout:OK. 2024-09-12T00:39:20.817 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:39:20.818 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:39:20.898 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T00:39:20.898 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:39:21.304 DEBUG:teuthology.parallel:result is None 2024-09-12T00:39:21.305 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:39:21.344 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:39:21.344 DEBUG:teuthology.orchestra.run.smithi133:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:39:21.413 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:39:21.415 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T00:39:21.433 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T00:39:21.434 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T00:39:21.434 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T00:39:21.434 DEBUG:teuthology.orchestra.run.smithi133:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T00:39:21.482 INFO:teuthology.orchestra.run.smithi133.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T00:39:25.746 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T00:39:25.746 DEBUG:teuthology.orchestra.run.smithi133:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T00:39:27.646 INFO:teuthology.orchestra.run.smithi133.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-12T00:39:28.214 INFO:teuthology.orchestra.run.smithi133.stdout:Last metadata expiration check: 0:30:07 ago on Thu 12 Sep 2024 12:09:21 AM UTC. 2024-09-12T00:39:28.356 INFO:teuthology.orchestra.run.smithi133.stdout:Dependencies resolved. 2024-09-12T00:39:28.357 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-09-12T00:39:28.357 INFO:teuthology.orchestra.run.smithi133.stdout: Package Arch Version Repository Size 2024-09-12T00:39:28.357 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-09-12T00:39:28.357 INFO:teuthology.orchestra.run.smithi133.stdout:Installing: 2024-09-12T00:39:28.357 INFO:teuthology.orchestra.run.smithi133.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-12T00:39:28.357 INFO:teuthology.orchestra.run.smithi133.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-12T00:39:28.357 INFO:teuthology.orchestra.run.smithi133.stdout:Installing dependencies: 2024-09-12T00:39:28.357 INFO:teuthology.orchestra.run.smithi133.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-12T00:39:28.357 INFO:teuthology.orchestra.run.smithi133.stdout:Installing weak dependencies: 2024-09-12T00:39:28.358 INFO:teuthology.orchestra.run.smithi133.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-12T00:39:28.358 INFO:teuthology.orchestra.run.smithi133.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-12T00:39:28.358 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:39:28.358 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction Summary 2024-09-12T00:39:28.358 INFO:teuthology.orchestra.run.smithi133.stdout:================================================================================ 2024-09-12T00:39:28.358 INFO:teuthology.orchestra.run.smithi133.stdout:Install 5 Packages 2024-09-12T00:39:28.358 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:39:28.358 INFO:teuthology.orchestra.run.smithi133.stdout:Total download size: 46 M 2024-09-12T00:39:28.359 INFO:teuthology.orchestra.run.smithi133.stdout:Installed size: 166 M 2024-09-12T00:39:28.359 INFO:teuthology.orchestra.run.smithi133.stdout:Downloading Packages: 2024-09-12T00:39:28.622 INFO:teuthology.orchestra.run.smithi133.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 2.6 MB/s | 426 kB 00:00 2024-09-12T00:39:28.798 INFO:teuthology.orchestra.run.smithi133.stdout:(2/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 28 MB/s | 9.3 MB 00:00 2024-09-12T00:39:28.865 INFO:teuthology.orchestra.run.smithi133.stdout:(3/5): gtk2-2.24.33-8.el9.x86_64.rpm 8.7 MB/s | 3.5 MB 00:00 2024-09-12T00:39:28.881 INFO:teuthology.orchestra.run.smithi133.stdout:(4/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 311 kB/s | 26 kB 00:00 2024-09-12T00:39:29.416 INFO:teuthology.orchestra.run.smithi133.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 41 MB/s | 32 MB 00:00 2024-09-12T00:39:29.416 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:39:29.416 INFO:teuthology.orchestra.run.smithi133.stdout:Total 43 MB/s | 46 MB 00:01 2024-09-12T00:39:29.841 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction check 2024-09-12T00:39:29.862 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction check succeeded. 2024-09-12T00:39:29.862 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction test 2024-09-12T00:39:30.344 INFO:teuthology.orchestra.run.smithi133.stdout:Transaction test succeeded. 2024-09-12T00:39:30.344 INFO:teuthology.orchestra.run.smithi133.stdout:Running transaction 2024-09-12T00:39:30.867 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-12T00:39:31.015 INFO:teuthology.orchestra.run.smithi133.stdout: Preparing : 1/1 2024-09-12T00:39:31.216 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-12T00:39:31.831 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-12T00:39:31.868 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T00:39:32.107 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T00:39:32.135 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T00:39:32.364 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T00:39:32.406 INFO:teuthology.orchestra.run.smithi133.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:39:32.414 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:39:32.423 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-12T00:39:32.466 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-12T00:39:35.516 INFO:teuthology.orchestra.run.smithi133.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:39:35.516 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-12T00:39:35.516 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-12T00:39:35.516 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-12T00:39:35.516 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-12T00:39:35.909 INFO:teuthology.orchestra.run.smithi133.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-12T00:39:35.909 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:39:35.909 INFO:teuthology.orchestra.run.smithi133.stdout:Installed: 2024-09-12T00:39:35.909 INFO:teuthology.orchestra.run.smithi133.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-12T00:39:35.909 INFO:teuthology.orchestra.run.smithi133.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:39:35.909 INFO:teuthology.orchestra.run.smithi133.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:39:35.909 INFO:teuthology.orchestra.run.smithi133.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:39:35.909 INFO:teuthology.orchestra.run.smithi133.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-12T00:39:35.909 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:39:35.909 INFO:teuthology.orchestra.run.smithi133.stdout:Complete! 2024-09-12T00:39:36.381 INFO:teuthology.orchestra.run.smithi133.stdout: Gradle will be installed under /opt/gradle 2024-09-12T00:39:36.459 INFO:teuthology.orchestra.run.smithi133.stderr:--2024-09-12 00:39:36-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T00:39:36.819 INFO:teuthology.orchestra.run.smithi133.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4865, ... 2024-09-12T00:39:36.833 INFO:teuthology.orchestra.run.smithi133.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-12T00:39:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T00:39:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T00:39:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:--2024-09-12 00:39:36-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T00:39:36.913 INFO:teuthology.orchestra.run.smithi133.stderr:Resolving github.com (github.com)... 140.82.113.3 2024-09-12T00:39:36.922 INFO:teuthology.orchestra.run.smithi133.stderr:Connecting to github.com (github.com)|140.82.113.3|:443... connected. 2024-09-12T00:39:37.061 INFO:teuthology.orchestra.run.smithi133.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T00:39:37.061 INFO:teuthology.orchestra.run.smithi133.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T003937Z&X-Amz-Expires=300&X-Amz-Signature=f974adefee3fcd78302367bcfcbbd00ad2dcb7d03d5ca1f517fd996d78526e48&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T00:39:37.061 INFO:teuthology.orchestra.run.smithi133.stderr:--2024-09-12 00:39:37-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T003937Z&X-Amz-Expires=300&X-Amz-Signature=f974adefee3fcd78302367bcfcbbd00ad2dcb7d03d5ca1f517fd996d78526e48&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T00:39:37.061 INFO:teuthology.orchestra.run.smithi133.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.108.133, 185.199.111.133, ... 2024-09-12T00:39:37.072 INFO:teuthology.orchestra.run.smithi133.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-12T00:39:37.156 INFO:teuthology.orchestra.run.smithi133.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T00:39:37.157 INFO:teuthology.orchestra.run.smithi133.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T00:39:37.157 INFO:teuthology.orchestra.run.smithi133.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-12T00:39:37.162 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-09-12T00:39:37.184 INFO:teuthology.orchestra.run.smithi133.stderr: 0K .......... .......... .......... .......... .......... 0% 1.75M 52s 2024-09-12T00:39:37.187 INFO:teuthology.orchestra.run.smithi133.stderr: 50K .......... .......... .......... .......... .......... 0% 16.0M 29s 2024-09-12T00:39:37.195 INFO:teuthology.orchestra.run.smithi133.stderr: 100K .......... .......... .......... .......... .......... 0% 5.67M 24s 2024-09-12T00:39:37.198 INFO:teuthology.orchestra.run.smithi133.stderr: 150K .......... .......... .......... .......... .......... 0% 22.1M 19s 2024-09-12T00:39:37.200 INFO:teuthology.orchestra.run.smithi133.stderr: 200K .......... .......... .......... .......... .......... 0% 24.0M 16s 2024-09-12T00:39:37.202 INFO:teuthology.orchestra.run.smithi133.stderr: 250K .......... .......... .......... .......... .......... 0% 27.2M 14s 2024-09-12T00:39:37.208 INFO:teuthology.orchestra.run.smithi133.stderr: 300K .......... .......... .......... .......... .......... 0% 8.34M 14s 2024-09-12T00:39:37.210 INFO:teuthology.orchestra.run.smithi133.stderr: 350K .......... .......... .......... .......... .......... 0% 26.4M 12s 2024-09-12T00:39:37.211 INFO:teuthology.orchestra.run.smithi133.stderr: 400K .......... .......... .......... .......... .......... 0% 59.7M 11s 2024-09-12T00:39:37.212 INFO:teuthology.orchestra.run.smithi133.stderr: 450K .......... .......... .......... .......... .......... 0% 34.7M 10s 2024-09-12T00:39:37.214 INFO:teuthology.orchestra.run.smithi133.stderr: 500K .......... .......... .......... .......... .......... 0% 65.1M 9s 2024-09-12T00:39:37.214 INFO:teuthology.orchestra.run.smithi133.stderr: 550K .......... .......... .......... .......... .......... 0% 52.5M 9s 2024-09-12T00:39:37.214 INFO:teuthology.orchestra.run.smithi133.stderr: 600K .......... .......... .......... .......... .......... 0% 82.4M 8s 2024-09-12T00:39:37.220 INFO:teuthology.orchestra.run.smithi133.stderr: 650K .......... .......... .......... .......... .......... 0% 9.23M 8s 2024-09-12T00:39:37.230 INFO:teuthology.orchestra.run.smithi133.stderr: 700K .......... .......... .......... .......... .......... 0% 25.6M 8s 2024-09-12T00:39:37.230 INFO:teuthology.orchestra.run.smithi133.stderr: 750K .......... .......... .......... .......... .......... 0% 138M 8s 2024-09-12T00:39:37.230 INFO:teuthology.orchestra.run.smithi133.stderr: 800K .......... .......... .......... .......... .......... 0% 254M 7s 2024-09-12T00:39:37.230 INFO:teuthology.orchestra.run.smithi133.stderr: 850K .......... .......... .......... .......... .......... 0% 81.1M 7s 2024-09-12T00:39:37.230 INFO:teuthology.orchestra.run.smithi133.stderr: 900K .......... .......... .......... .......... .......... 1% 207M 6s 2024-09-12T00:39:37.230 INFO:teuthology.orchestra.run.smithi133.stderr: 950K .......... .......... .......... .......... .......... 1% 73.6M 6s 2024-09-12T00:39:37.230 INFO:teuthology.orchestra.run.smithi133.stderr: 1000K .......... .......... .......... .......... .......... 1% 57.4M 6s 2024-09-12T00:39:37.230 INFO:teuthology.orchestra.run.smithi133.stderr: 1050K .......... .......... .......... .......... .......... 1% 273M 6s 2024-09-12T00:39:37.230 INFO:teuthology.orchestra.run.smithi133.stderr: 1100K .......... .......... .......... .......... .......... 1% 146M 5s 2024-09-12T00:39:37.230 INFO:teuthology.orchestra.run.smithi133.stderr: 1150K .......... .......... .......... .......... .......... 1% 67.3M 5s 2024-09-12T00:39:37.230 INFO:teuthology.orchestra.run.smithi133.stderr: 1200K .......... .......... .......... .......... .......... 1% 146M 5s 2024-09-12T00:39:37.231 INFO:teuthology.orchestra.run.smithi133.stderr: 1250K .......... .......... .......... .......... .......... 1% 105M 5s 2024-09-12T00:39:37.231 INFO:teuthology.orchestra.run.smithi133.stderr: 1300K .......... .......... .......... .......... .......... 1% 254M 5s 2024-09-12T00:39:37.241 INFO:teuthology.orchestra.run.smithi133.stderr: 1350K .......... .......... .......... .......... .......... 1% 11.1M 5s 2024-09-12T00:39:37.241 INFO:teuthology.orchestra.run.smithi133.stderr: 1400K .......... .......... .......... .......... .......... 1% 234M 5s 2024-09-12T00:39:37.241 INFO:teuthology.orchestra.run.smithi133.stderr: 1450K .......... .......... .......... .......... .......... 1% 68.2M 5s 2024-09-12T00:39:37.241 INFO:teuthology.orchestra.run.smithi133.stderr: 1500K .......... .......... .......... .......... .......... 1% 42.3M 5s 2024-09-12T00:39:37.241 INFO:teuthology.orchestra.run.smithi133.stderr: 1550K .......... .......... .......... .......... .......... 1% 250M 4s 2024-09-12T00:39:37.241 INFO:teuthology.orchestra.run.smithi133.stderr: 1600K .......... .......... .......... .......... .......... 1% 179M 4s 2024-09-12T00:39:37.241 INFO:teuthology.orchestra.run.smithi133.stderr: 1650K .......... .......... .......... .......... .......... 1% 181M 4s 2024-09-12T00:39:37.242 INFO:teuthology.orchestra.run.smithi133.stderr: 1700K .......... .......... .......... .......... .......... 1% 139M 4s 2024-09-12T00:39:37.242 INFO:teuthology.orchestra.run.smithi133.stderr: 1750K .......... .......... .......... .......... .......... 1% 271M 4s 2024-09-12T00:39:37.242 INFO:teuthology.orchestra.run.smithi133.stderr: 1800K .......... .......... .......... .......... .......... 1% 91.2M 4s 2024-09-12T00:39:37.242 INFO:teuthology.orchestra.run.smithi133.stderr: 1850K .......... .......... .......... .......... .......... 2% 241M 4s 2024-09-12T00:39:37.242 INFO:teuthology.orchestra.run.smithi133.stderr: 1900K .......... .......... .......... .......... .......... 2% 165M 4s 2024-09-12T00:39:37.242 INFO:teuthology.orchestra.run.smithi133.stderr: 1950K .......... .......... .......... .......... .......... 2% 12.5M 4s 2024-09-12T00:39:38.640 INFO:teuthology.orchestra.run.smithi133.stderr: 2000K .......... .......... .......... .......... .......... 2% 11.3M 4s 2024-09-12T00:39:38.640 INFO:teuthology.orchestra.run.smithi133.stderr: 2050K .......... .......... .......... .......... .......... 2% 235M 4s 2024-09-12T00:39:38.641 INFO:teuthology.orchestra.run.smithi133.stderr: 2100K .......... .......... .......... .......... .......... 2% 250M 4s 2024-09-12T00:39:38.641 INFO:teuthology.orchestra.run.smithi133.stderr: 2150K .......... .......... .......... .......... .......... 2% 108M 4s 2024-09-12T00:39:38.641 INFO:teuthology.orchestra.run.smithi133.stderr: 2200K .......... .......... .......... .......... .......... 2% 34.5M 4s 2024-09-12T00:39:38.641 INFO:teuthology.orchestra.run.smithi133.stderr: 2250K .......... .......... .......... .......... .......... 2% 225M 4s 2024-09-12T00:39:38.641 INFO:teuthology.orchestra.run.smithi133.stderr: 2300K .......... .......... .......... .......... .......... 2% 204M 3s 2024-09-12T00:39:38.641 INFO:teuthology.orchestra.run.smithi133.stderr: 2350K .......... .......... .......... .......... .......... 2% 268M 3s 2024-09-12T00:39:38.641 INFO:teuthology.orchestra.run.smithi133.stderr: 2400K .......... .......... .......... .......... .......... 2% 61.4M 3s 2024-09-12T00:39:38.641 INFO:teuthology.orchestra.run.smithi133.stderr: 2450K .......... .......... .......... .......... .......... 2% 229M 3s 2024-09-12T00:39:38.641 INFO:teuthology.orchestra.run.smithi133.stderr: 2500K .......... .......... .......... .......... .......... 2% 251M 3s 2024-09-12T00:39:38.641 INFO:teuthology.orchestra.run.smithi133.stderr: 2550K .......... .......... .......... .......... .......... 2% 293M 3s 2024-09-12T00:39:38.641 INFO:teuthology.orchestra.run.smithi133.stderr: 2600K .......... .......... .......... .......... .......... 2% 66.7M 3s 2024-09-12T00:39:38.641 INFO:teuthology.orchestra.run.smithi133.stderr: 2650K .......... .......... .......... .......... .......... 2% 263M 3s 2024-09-12T00:39:38.641 INFO:teuthology.orchestra.run.smithi133.stderr: 2700K .......... .......... .......... .......... .......... 2% 173M 3s 2024-09-12T00:39:38.641 INFO:teuthology.orchestra.run.smithi133.stderr: 2750K .......... .......... .......... .......... .......... 3% 273M 3s 2024-09-12T00:39:38.642 INFO:teuthology.orchestra.run.smithi133.stderr: 2800K .......... .......... .......... .......... .......... 3% 183M 3s 2024-09-12T00:39:38.642 INFO:teuthology.orchestra.run.smithi133.stderr: 2850K .......... .......... .......... .......... .......... 3% 205M 3s 2024-09-12T00:39:38.642 INFO:teuthology.orchestra.run.smithi133.stderr: 2900K .......... .......... .......... .......... .......... 3% 262M 3s 2024-09-12T00:39:38.642 INFO:teuthology.orchestra.run.smithi133.stderr: 2950K .......... .......... .......... .......... .......... 3% 286M 3s 2024-09-12T00:39:38.642 INFO:teuthology.orchestra.run.smithi133.stderr: 3000K .......... .......... .......... .......... .......... 3% 289M 3s 2024-09-12T00:39:38.642 INFO:teuthology.orchestra.run.smithi133.stderr: 3050K .......... .......... .......... .......... .......... 3% 280M 3s 2024-09-12T00:39:38.642 INFO:teuthology.orchestra.run.smithi133.stderr: 3100K .......... .......... .......... .......... .......... 3% 226M 3s 2024-09-12T00:39:38.642 INFO:teuthology.orchestra.run.smithi133.stderr: 3150K .......... .......... .......... .......... .......... 3% 269M 3s 2024-09-12T00:39:38.642 INFO:teuthology.orchestra.run.smithi133.stderr: 3200K .......... .......... .......... .......... .......... 3% 273M 3s 2024-09-12T00:39:38.642 INFO:teuthology.orchestra.run.smithi133.stderr: 3250K .......... .......... .......... .......... .......... 3% 271M 3s 2024-09-12T00:39:38.642 INFO:teuthology.orchestra.run.smithi133.stderr: 3300K .......... .......... .......... .......... .......... 3% 243M 3s 2024-09-12T00:39:38.642 INFO:teuthology.orchestra.run.smithi133.stderr: 3350K .......... .......... .......... .......... .......... 3% 271M 3s 2024-09-12T00:39:38.642 INFO:teuthology.orchestra.run.smithi133.stderr: 3400K .......... .......... .......... .......... .......... 3% 267M 2s 2024-09-12T00:39:38.643 INFO:teuthology.orchestra.run.smithi133.stderr: 3450K .......... .......... .......... .......... .......... 3% 269M 2s 2024-09-12T00:39:38.643 INFO:teuthology.orchestra.run.smithi133.stderr: 3500K .......... .......... .......... .......... .......... 3% 236M 2s 2024-09-12T00:39:38.643 INFO:teuthology.orchestra.run.smithi133.stderr: 3550K .......... .......... .......... .......... .......... 3% 287M 2s 2024-09-12T00:39:38.643 INFO:teuthology.orchestra.run.smithi133.stderr: 3600K .......... .......... .......... .......... .......... 3% 282M 2s 2024-09-12T00:39:38.643 INFO:teuthology.orchestra.run.smithi133.stderr: 3650K .......... .......... .......... .......... .......... 3% 281M 2s 2024-09-12T00:39:38.643 INFO:teuthology.orchestra.run.smithi133.stderr: 3700K .......... .......... .......... .......... .......... 4% 251M 2s 2024-09-12T00:39:38.643 INFO:teuthology.orchestra.run.smithi133.stderr: 3750K .......... .......... .......... .......... .......... 4% 20.0M 2s 2024-09-12T00:39:38.643 INFO:teuthology.orchestra.run.smithi133.stderr: 3800K .......... .......... .......... .......... .......... 4% 230M 2s 2024-09-12T00:39:38.643 INFO:teuthology.orchestra.run.smithi133.stderr: 3850K .......... .......... .......... .......... .......... 4% 271M 2s 2024-09-12T00:39:38.643 INFO:teuthology.orchestra.run.smithi133.stderr: 3900K .......... .......... .......... .......... .......... 4% 216M 2s 2024-09-12T00:39:38.643 INFO:teuthology.orchestra.run.smithi133.stderr: 3950K .......... .......... .......... .......... .......... 4% 285M 2s 2024-09-12T00:39:38.643 INFO:teuthology.orchestra.run.smithi133.stderr: 4000K .......... .......... .......... .......... .......... 4% 251M 2s 2024-09-12T00:39:38.643 INFO:teuthology.orchestra.run.smithi133.stderr: 4050K .......... .......... .......... .......... .......... 4% 30.1M 2s 2024-09-12T00:39:38.644 INFO:teuthology.orchestra.run.smithi133.stderr: 4100K .......... .......... .......... .......... .......... 4% 238M 2s 2024-09-12T00:39:38.644 INFO:teuthology.orchestra.run.smithi133.stderr: 4150K .......... .......... .......... .......... .......... 4% 287M 2s 2024-09-12T00:39:38.644 INFO:teuthology.orchestra.run.smithi133.stderr: 4200K .......... .......... .......... .......... .......... 4% 268M 2s 2024-09-12T00:39:38.644 INFO:teuthology.orchestra.run.smithi133.stderr: 4250K .......... .......... .......... .......... .......... 4% 34.7M 2s 2024-09-12T00:39:38.644 INFO:teuthology.orchestra.run.smithi133.stderr: 4300K .......... .......... .......... .......... .......... 4% 113M 2s 2024-09-12T00:39:38.644 INFO:teuthology.orchestra.run.smithi133.stderr: 4350K .......... .......... .......... .......... .......... 4% 208M 2s 2024-09-12T00:39:38.644 INFO:teuthology.orchestra.run.smithi133.stderr: 4400K .......... .......... .......... .......... .......... 4% 260M 2s 2024-09-12T00:39:38.644 INFO:teuthology.orchestra.run.smithi133.stderr: 4450K .......... .......... .......... .......... .......... 4% 279M 2s 2024-09-12T00:39:38.644 INFO:teuthology.orchestra.run.smithi133.stderr: 4500K .......... .......... .......... .......... .......... 4% 261M 2s 2024-09-12T00:39:38.644 INFO:teuthology.orchestra.run.smithi133.stderr: 4550K .......... .......... .......... .......... .......... 4% 236M 2s 2024-09-12T00:39:38.644 INFO:teuthology.orchestra.run.smithi133.stderr: 4600K .......... .......... .......... .......... .......... 5% 237M 2s 2024-09-12T00:39:38.644 INFO:teuthology.orchestra.run.smithi133.stderr: 4650K .......... .......... .......... .......... .......... 5% 252M 2s 2024-09-12T00:39:38.644 INFO:teuthology.orchestra.run.smithi133.stderr: 4700K .......... .......... .......... .......... .......... 5% 282M 2s 2024-09-12T00:39:38.644 INFO:teuthology.orchestra.run.smithi133.stderr: 4750K .......... .......... .......... .......... .......... 5% 405M 2s 2024-09-12T00:39:38.645 INFO:teuthology.orchestra.run.smithi133.stderr: 4800K .......... .......... .......... .......... .......... 5% 426M 2s 2024-09-12T00:39:38.645 INFO:teuthology.orchestra.run.smithi133.stderr: 4850K .......... .......... .......... .......... .......... 5% 431M 2s 2024-09-12T00:39:38.645 INFO:teuthology.orchestra.run.smithi133.stderr: 4900K .......... .......... .......... .......... .......... 5% 348M 2s 2024-09-12T00:39:38.645 INFO:teuthology.orchestra.run.smithi133.stderr: 4950K .......... .......... .......... .......... .......... 5% 430M 2s 2024-09-12T00:39:38.645 INFO:teuthology.orchestra.run.smithi133.stderr: 5000K .......... .......... .......... .......... .......... 5% 432M 2s 2024-09-12T00:39:38.645 INFO:teuthology.orchestra.run.smithi133.stderr: 5050K .......... .......... .......... .......... .......... 5% 402M 2s 2024-09-12T00:39:38.645 INFO:teuthology.orchestra.run.smithi133.stderr: 5100K .......... .......... .......... .......... .......... 5% 359M 2s 2024-09-12T00:39:38.645 INFO:teuthology.orchestra.run.smithi133.stderr: 5150K .......... .......... .......... .......... .......... 5% 425M 2s 2024-09-12T00:39:38.645 INFO:teuthology.orchestra.run.smithi133.stderr: 5200K .......... .......... .......... .......... .......... 5% 440M 2s 2024-09-12T00:39:38.645 INFO:teuthology.orchestra.run.smithi133.stderr: 5250K .......... .......... .......... .......... .......... 5% 456M 2s 2024-09-12T00:39:38.645 INFO:teuthology.orchestra.run.smithi133.stderr: 5300K .......... .......... .......... .......... .......... 5% 365M 2s 2024-09-12T00:39:38.645 INFO:teuthology.orchestra.run.smithi133.stderr: 5350K .......... .......... .......... .......... .......... 5% 356M 2s 2024-09-12T00:39:38.645 INFO:teuthology.orchestra.run.smithi133.stderr: 5400K .......... .......... .......... .......... .......... 5% 318M 2s 2024-09-12T00:39:38.645 INFO:teuthology.orchestra.run.smithi133.stderr: 5450K .......... .......... .......... .......... .......... 5% 397M 2s 2024-09-12T00:39:38.646 INFO:teuthology.orchestra.run.smithi133.stderr: 5500K .......... .......... .......... .......... .......... 5% 328M 2s 2024-09-12T00:39:38.646 INFO:teuthology.orchestra.run.smithi133.stderr: 5550K .......... .......... .......... .......... .......... 6% 342M 2s 2024-09-12T00:39:38.646 INFO:teuthology.orchestra.run.smithi133.stderr: 5600K .......... .......... .......... .......... .......... 6% 392M 2s 2024-09-12T00:39:38.646 INFO:teuthology.orchestra.run.smithi133.stderr: 5650K .......... .......... .......... .......... .......... 6% 403M 2s 2024-09-12T00:39:38.646 INFO:teuthology.orchestra.run.smithi133.stderr: 5700K .......... .......... .......... .......... .......... 6% 396M 2s 2024-09-12T00:39:38.646 INFO:teuthology.orchestra.run.smithi133.stderr: 5750K .......... .......... .......... .......... .......... 6% 54.5M 2s 2024-09-12T00:39:38.646 INFO:teuthology.orchestra.run.smithi133.stderr: 5800K .......... .......... .......... .......... .......... 6% 395M 2s 2024-09-12T00:39:38.646 INFO:teuthology.orchestra.run.smithi133.stderr: 5850K .......... .......... .......... .......... .......... 6% 315M 2s 2024-09-12T00:39:38.646 INFO:teuthology.orchestra.run.smithi133.stderr: 5900K .......... .......... .......... .......... .......... 6% 234M 2s 2024-09-12T00:39:38.646 INFO:teuthology.orchestra.run.smithi133.stderr: 5950K .......... .......... .......... .......... .......... 6% 387M 2s 2024-09-12T00:39:38.646 INFO:teuthology.orchestra.run.smithi133.stderr: 6000K .......... .......... .......... .......... .......... 6% 409M 2s 2024-09-12T00:39:38.646 INFO:teuthology.orchestra.run.smithi133.stderr: 6050K .......... .......... .......... .......... .......... 6% 436M 2s 2024-09-12T00:39:38.646 INFO:teuthology.orchestra.run.smithi133.stderr: 6100K .......... .......... .......... .......... .......... 6% 321M 2s 2024-09-12T00:39:38.646 INFO:teuthology.orchestra.run.smithi133.stderr: 6150K .......... .......... .......... .......... .......... 6% 214M 2s 2024-09-12T00:39:38.647 INFO:teuthology.orchestra.run.smithi133.stderr: 6200K .......... .......... .......... .......... .......... 6% 429M 2s 2024-09-12T00:39:38.647 INFO:teuthology.orchestra.run.smithi133.stderr: 6250K .......... .......... .......... .......... .......... 6% 70.1M 2s 2024-09-12T00:39:38.647 INFO:teuthology.orchestra.run.smithi133.stderr: 6300K .......... .......... .......... .......... .......... 6% 261M 2s 2024-09-12T00:39:38.647 INFO:teuthology.orchestra.run.smithi133.stderr: 6350K .......... .......... .......... .......... .......... 6% 368M 2s 2024-09-12T00:39:38.647 INFO:teuthology.orchestra.run.smithi133.stderr: 6400K .......... .......... .......... .......... .......... 6% 239M 1s 2024-09-12T00:39:38.647 INFO:teuthology.orchestra.run.smithi133.stderr: 6450K .......... .......... .......... .......... .......... 6% 423M 1s 2024-09-12T00:39:38.647 INFO:teuthology.orchestra.run.smithi133.stderr: 6500K .......... .......... .......... .......... .......... 7% 268M 1s 2024-09-12T00:39:38.647 INFO:teuthology.orchestra.run.smithi133.stderr: 6550K .......... .......... .......... .......... .......... 7% 333M 1s 2024-09-12T00:39:38.647 INFO:teuthology.orchestra.run.smithi133.stderr: 6600K .......... .......... .......... .......... .......... 7% 163M 1s 2024-09-12T00:39:38.647 INFO:teuthology.orchestra.run.smithi133.stderr: 6650K .......... .......... .......... .......... .......... 7% 409M 1s 2024-09-12T00:39:38.647 INFO:teuthology.orchestra.run.smithi133.stderr: 6700K .......... .......... .......... .......... .......... 7% 204M 1s 2024-09-12T00:39:38.647 INFO:teuthology.orchestra.run.smithi133.stderr: 6750K .......... .......... .......... .......... .......... 7% 136M 1s 2024-09-12T00:39:38.647 INFO:teuthology.orchestra.run.smithi133.stderr: 6800K .......... .......... .......... .......... .......... 7% 285M 1s 2024-09-12T00:39:38.647 INFO:teuthology.orchestra.run.smithi133.stderr: 6850K .......... .......... .......... .......... .......... 7% 279M 1s 2024-09-12T00:39:38.647 INFO:teuthology.orchestra.run.smithi133.stderr: 6900K .......... .......... .......... .......... .......... 7% 284M 1s 2024-09-12T00:39:38.648 INFO:teuthology.orchestra.run.smithi133.stderr: 6950K .......... .......... .......... .......... .......... 7% 440M 1s 2024-09-12T00:39:38.648 INFO:teuthology.orchestra.run.smithi133.stderr: 7000K .......... .......... .......... .......... .......... 7% 407M 1s 2024-09-12T00:39:38.648 INFO:teuthology.orchestra.run.smithi133.stderr: 7050K .......... .......... .......... .......... .......... 7% 330M 1s 2024-09-12T00:39:38.648 INFO:teuthology.orchestra.run.smithi133.stderr: 7100K .......... .......... .......... .......... .......... 7% 359M 1s 2024-09-12T00:39:38.648 INFO:teuthology.orchestra.run.smithi133.stderr: 7150K .......... .......... .......... .......... .......... 7% 429M 1s 2024-09-12T00:39:38.648 INFO:teuthology.orchestra.run.smithi133.stderr: 7200K .......... .......... .......... .......... .......... 7% 96.0M 1s 2024-09-12T00:39:38.648 INFO:teuthology.orchestra.run.smithi133.stderr: 7250K .......... .......... .......... .......... .......... 7% 411M 1s 2024-09-12T00:39:38.648 INFO:teuthology.orchestra.run.smithi133.stderr: 7300K .......... .......... .......... .......... .......... 7% 69.8M 1s 2024-09-12T00:39:38.648 INFO:teuthology.orchestra.run.smithi133.stderr: 7350K .......... .......... .......... .......... .......... 7% 53.0M 1s 2024-09-12T00:39:38.648 INFO:teuthology.orchestra.run.smithi133.stderr: 7400K .......... .......... .......... .......... .......... 8% 410M 1s 2024-09-12T00:39:38.648 INFO:teuthology.orchestra.run.smithi133.stderr: 7450K .......... .......... .......... .......... .......... 8% 259M 1s 2024-09-12T00:39:38.648 INFO:teuthology.orchestra.run.smithi133.stderr: 7500K .......... .......... .......... .......... .......... 8% 189M 1s 2024-09-12T00:39:38.648 INFO:teuthology.orchestra.run.smithi133.stderr: 7550K .......... .......... .......... .......... .......... 8% 165M 1s 2024-09-12T00:39:38.649 INFO:teuthology.orchestra.run.smithi133.stderr: 7600K .......... .......... .......... .......... .......... 8% 222M 1s 2024-09-12T00:39:38.649 INFO:teuthology.orchestra.run.smithi133.stderr: 7650K .......... .......... .......... .......... .......... 8% 417M 1s 2024-09-12T00:39:38.649 INFO:teuthology.orchestra.run.smithi133.stderr: 7700K .......... .......... .......... .......... .......... 8% 113M 1s 2024-09-12T00:39:38.649 INFO:teuthology.orchestra.run.smithi133.stderr: 7750K .......... .......... .......... .......... .......... 8% 435M 1s 2024-09-12T00:39:38.649 INFO:teuthology.orchestra.run.smithi133.stderr: 7800K .......... .......... .......... .......... .......... 8% 147M 1s 2024-09-12T00:39:38.649 INFO:teuthology.orchestra.run.smithi133.stderr: 7850K .......... .......... .......... .......... .......... 8% 422M 1s 2024-09-12T00:39:38.649 INFO:teuthology.orchestra.run.smithi133.stderr: 7900K .......... .......... .......... .......... .......... 8% 253M 1s 2024-09-12T00:39:38.649 INFO:teuthology.orchestra.run.smithi133.stderr: 7950K .......... .......... .......... .......... .......... 8% 341M 1s 2024-09-12T00:39:38.649 INFO:teuthology.orchestra.run.smithi133.stderr: 8000K .......... .......... .......... .......... .......... 8% 253M 1s 2024-09-12T00:39:38.649 INFO:teuthology.orchestra.run.smithi133.stderr: 8050K .......... .......... .......... .......... .......... 8% 373M 1s 2024-09-12T00:39:38.649 INFO:teuthology.orchestra.run.smithi133.stderr: 8100K .......... .......... .......... .......... .......... 8% 278M 1s 2024-09-12T00:39:38.649 INFO:teuthology.orchestra.run.smithi133.stderr: 8150K .......... .......... .......... .......... .......... 8% 417M 1s 2024-09-12T00:39:38.649 INFO:teuthology.orchestra.run.smithi133.stderr: 8200K .......... .......... .......... .......... .......... 8% 380M 1s 2024-09-12T00:39:38.649 INFO:teuthology.orchestra.run.smithi133.stderr: 8250K .......... .......... .......... .......... .......... 8% 340M 1s 2024-09-12T00:39:38.650 INFO:teuthology.orchestra.run.smithi133.stderr: 8300K .......... .......... .......... .......... .......... 8% 353M 1s 2024-09-12T00:39:38.650 INFO:teuthology.orchestra.run.smithi133.stderr: 8350K .......... .......... .......... .......... .......... 9% 379M 1s 2024-09-12T00:39:38.650 INFO:teuthology.orchestra.run.smithi133.stderr: 8400K .......... .......... .......... .......... .......... 9% 273M 1s 2024-09-12T00:39:38.650 INFO:teuthology.orchestra.run.smithi133.stderr: 8450K .......... .......... .......... .......... .......... 9% 414M 1s 2024-09-12T00:39:38.650 INFO:teuthology.orchestra.run.smithi133.stderr: 8500K .......... .......... .......... .......... .......... 9% 396M 1s 2024-09-12T00:39:38.650 INFO:teuthology.orchestra.run.smithi133.stderr: 8550K .......... .......... .......... .......... .......... 9% 345M 1s 2024-09-12T00:39:38.650 INFO:teuthology.orchestra.run.smithi133.stderr: 8600K .......... .......... .......... .......... .......... 9% 443M 1s 2024-09-12T00:39:38.650 INFO:teuthology.orchestra.run.smithi133.stderr: 8650K .......... .......... .......... .......... .......... 9% 186M 1s 2024-09-12T00:39:38.650 INFO:teuthology.orchestra.run.smithi133.stderr: 8700K .......... .......... .......... .......... .......... 9% 287M 1s 2024-09-12T00:39:38.650 INFO:teuthology.orchestra.run.smithi133.stderr: 8750K .......... .......... .......... .......... .......... 9% 315M 1s 2024-09-12T00:39:38.650 INFO:teuthology.orchestra.run.smithi133.stderr: 8800K .......... .......... .......... .......... .......... 9% 264M 1s 2024-09-12T00:39:38.650 INFO:teuthology.orchestra.run.smithi133.stderr: 8850K .......... .......... .......... .......... .......... 9% 246M 1s 2024-09-12T00:39:38.650 INFO:teuthology.orchestra.run.smithi133.stderr: 8900K .......... .......... .......... .......... .......... 9% 391M 1s 2024-09-12T00:39:38.651 INFO:teuthology.orchestra.run.smithi133.stderr: 8950K .......... .......... .......... .......... .......... 9% 445M 1s 2024-09-12T00:39:38.651 INFO:teuthology.orchestra.run.smithi133.stderr: 9000K .......... .......... .......... .......... .......... 9% 419M 1s 2024-09-12T00:39:38.651 INFO:teuthology.orchestra.run.smithi133.stderr: 9050K .......... .......... .......... .......... .......... 9% 323M 1s 2024-09-12T00:39:38.651 INFO:teuthology.orchestra.run.smithi133.stderr: 9100K .......... .......... .......... .......... .......... 9% 331M 1s 2024-09-12T00:39:38.651 INFO:teuthology.orchestra.run.smithi133.stderr: 9150K .......... .......... .......... .......... .......... 9% 445M 1s 2024-09-12T00:39:38.651 INFO:teuthology.orchestra.run.smithi133.stderr: 9200K .......... .......... .......... .......... .......... 9% 161M 1s 2024-09-12T00:39:38.651 INFO:teuthology.orchestra.run.smithi133.stderr: 9250K .......... .......... .......... .......... .......... 10% 219M 1s 2024-09-12T00:39:38.651 INFO:teuthology.orchestra.run.smithi133.stderr: 9300K .......... .......... .......... .......... .......... 10% 378M 1s 2024-09-12T00:39:38.651 INFO:teuthology.orchestra.run.smithi133.stderr: 9350K .......... .......... .......... .......... .......... 10% 162M 1s 2024-09-12T00:39:38.651 INFO:teuthology.orchestra.run.smithi133.stderr: 9400K .......... .......... .......... .......... .......... 10% 83.6M 1s 2024-09-12T00:39:38.651 INFO:teuthology.orchestra.run.smithi133.stderr: 9450K .......... .......... .......... .......... .......... 10% 418M 1s 2024-09-12T00:39:38.651 INFO:teuthology.orchestra.run.smithi133.stderr: 9500K .......... .......... .......... .......... .......... 10% 66.4M 1s 2024-09-12T00:39:38.651 INFO:teuthology.orchestra.run.smithi133.stderr: 9550K .......... .......... .......... .......... .......... 10% 301M 1s 2024-09-12T00:39:38.651 INFO:teuthology.orchestra.run.smithi133.stderr: 9600K .......... .......... .......... .......... .......... 10% 106M 1s 2024-09-12T00:39:38.652 INFO:teuthology.orchestra.run.smithi133.stderr: 9650K .......... .......... .......... .......... .......... 10% 235M 1s 2024-09-12T00:39:38.652 INFO:teuthology.orchestra.run.smithi133.stderr: 9700K .......... .......... .......... .......... .......... 10% 216M 1s 2024-09-12T00:39:38.652 INFO:teuthology.orchestra.run.smithi133.stderr: 9750K .......... .......... .......... .......... .......... 10% 239M 1s 2024-09-12T00:39:38.652 INFO:teuthology.orchestra.run.smithi133.stderr: 9800K .......... .......... .......... .......... .......... 10% 252M 1s 2024-09-12T00:39:38.652 INFO:teuthology.orchestra.run.smithi133.stderr: 9850K .......... .......... .......... .......... .......... 10% 266M 1s 2024-09-12T00:39:38.652 INFO:teuthology.orchestra.run.smithi133.stderr: 9900K .......... .......... .......... .......... .......... 10% 277M 1s 2024-09-12T00:39:38.652 INFO:teuthology.orchestra.run.smithi133.stderr: 9950K .......... .......... .......... .......... .......... 10% 250M 1s 2024-09-12T00:39:38.652 INFO:teuthology.orchestra.run.smithi133.stderr: 10000K .......... .......... .......... .......... .......... 10% 276M 1s 2024-09-12T00:39:38.652 INFO:teuthology.orchestra.run.smithi133.stderr: 10050K .......... .......... .......... .......... .......... 10% 266M 1s 2024-09-12T00:39:38.652 INFO:teuthology.orchestra.run.smithi133.stderr: 10100K .......... .......... .......... .......... .......... 10% 254M 1s 2024-09-12T00:39:38.652 INFO:teuthology.orchestra.run.smithi133.stderr: 10150K .......... .......... .......... .......... .......... 10% 295M 1s 2024-09-12T00:39:38.652 INFO:teuthology.orchestra.run.smithi133.stderr: 10200K .......... .......... .......... .......... .......... 11% 269M 1s 2024-09-12T00:39:38.652 INFO:teuthology.orchestra.run.smithi133.stderr: 10250K .......... .......... .......... .......... .......... 11% 320M 1s 2024-09-12T00:39:38.652 INFO:teuthology.orchestra.run.smithi133.stderr: 10300K .......... .......... .......... .......... .......... 11% 304M 1s 2024-09-12T00:39:38.653 INFO:teuthology.orchestra.run.smithi133.stderr: 10350K .......... .......... .......... .......... .......... 11% 312M 1s 2024-09-12T00:39:38.653 INFO:teuthology.orchestra.run.smithi133.stderr: 10400K .......... .......... .......... .......... .......... 11% 243M 1s 2024-09-12T00:39:38.653 INFO:teuthology.orchestra.run.smithi133.stderr: 10450K .......... .......... .......... .......... .......... 11% 196M 1s 2024-09-12T00:39:38.653 INFO:teuthology.orchestra.run.smithi133.stderr: 10500K .......... .......... .......... .......... .......... 11% 317M 1s 2024-09-12T00:39:38.653 INFO:teuthology.orchestra.run.smithi133.stderr: 10550K .......... .......... .......... .......... .......... 11% 7.01M 1s 2024-09-12T00:39:38.653 INFO:teuthology.orchestra.run.smithi133.stderr: 10600K .......... .......... .......... .......... .......... 11% 273M 1s 2024-09-12T00:39:38.653 INFO:teuthology.orchestra.run.smithi133.stderr: 10650K .......... .......... .......... .......... .......... 11% 242M 1s 2024-09-12T00:39:38.653 INFO:teuthology.orchestra.run.smithi133.stderr: 10700K .......... .......... .......... .......... .......... 11% 51.0M 1s 2024-09-12T00:39:38.653 INFO:teuthology.orchestra.run.smithi133.stderr: 10750K .......... .......... .......... .......... .......... 11% 204M 1s 2024-09-12T00:39:38.653 INFO:teuthology.orchestra.run.smithi133.stderr: 10800K .......... .......... .......... .......... .......... 11% 266M 1s 2024-09-12T00:39:38.653 INFO:teuthology.orchestra.run.smithi133.stderr: 10850K .......... .......... .......... .......... .......... 11% 272M 1s 2024-09-12T00:39:38.653 INFO:teuthology.orchestra.run.smithi133.stderr: 10900K .......... .......... .......... .......... .......... 11% 288M 1s 2024-09-12T00:39:38.653 INFO:teuthology.orchestra.run.smithi133.stderr: 10950K .......... .......... .......... .......... .......... 11% 243M 1s 2024-09-12T00:39:38.653 INFO:teuthology.orchestra.run.smithi133.stderr: 11000K .......... .......... .......... .......... .......... 11% 134M 1s 2024-09-12T00:39:38.654 INFO:teuthology.orchestra.run.smithi133.stderr: 11050K .......... .......... .......... .......... .......... 11% 192M 1s 2024-09-12T00:39:38.654 INFO:teuthology.orchestra.run.smithi133.stderr: 11100K .......... .......... .......... .......... .......... 12% 231M 1s 2024-09-12T00:39:38.654 INFO:teuthology.orchestra.run.smithi133.stderr: 11150K .......... .......... .......... .......... .......... 12% 199M 1s 2024-09-12T00:39:38.654 INFO:teuthology.orchestra.run.smithi133.stderr: 11200K .......... .......... .......... .......... .......... 12% 230M 1s 2024-09-12T00:39:38.654 INFO:teuthology.orchestra.run.smithi133.stderr: 11250K .......... .......... .......... .......... .......... 12% 262M 1s 2024-09-12T00:39:38.654 INFO:teuthology.orchestra.run.smithi133.stderr: 11300K .......... .......... .......... .......... .......... 12% 284M 1s 2024-09-12T00:39:38.654 INFO:teuthology.orchestra.run.smithi133.stderr: 11350K .......... .......... .......... .......... .......... 12% 263M 1s 2024-09-12T00:39:38.654 INFO:teuthology.orchestra.run.smithi133.stderr: 11400K .......... .......... .......... .......... .......... 12% 283M 1s 2024-09-12T00:39:38.654 INFO:teuthology.orchestra.run.smithi133.stderr: 11450K .......... .......... .......... .......... .......... 12% 286M 1s 2024-09-12T00:39:38.654 INFO:teuthology.orchestra.run.smithi133.stderr: 11500K .......... .......... .......... .......... .......... 12% 271M 1s 2024-09-12T00:39:38.654 INFO:teuthology.orchestra.run.smithi133.stderr: 11550K .......... .......... .......... .......... .......... 12% 237M 1s 2024-09-12T00:39:38.654 INFO:teuthology.orchestra.run.smithi133.stderr: 11600K .......... .......... .......... .......... .......... 12% 11.3M 1s 2024-09-12T00:39:38.654 INFO:teuthology.orchestra.run.smithi133.stderr: 11650K .......... .......... .......... .......... .......... 12% 238M 1s 2024-09-12T00:39:38.655 INFO:teuthology.orchestra.run.smithi133.stderr: 11700K .......... .......... .......... .......... .......... 12% 263M 1s 2024-09-12T00:39:38.655 INFO:teuthology.orchestra.run.smithi133.stderr: 11750K .......... .......... .......... .......... .......... 12% 256M 1s 2024-09-12T00:39:38.655 INFO:teuthology.orchestra.run.smithi133.stderr: 11800K .......... .......... .......... .......... .......... 12% 2.96M 1s 2024-09-12T00:39:38.655 INFO:teuthology.orchestra.run.smithi133.stderr: 11850K .......... .......... .......... .......... .......... 12% 252M 1s 2024-09-12T00:39:38.655 INFO:teuthology.orchestra.run.smithi133.stderr: 11900K .......... .......... .......... .......... .......... 12% 266M 1s 2024-09-12T00:39:38.655 INFO:teuthology.orchestra.run.smithi133.stderr: 11950K .......... .......... .......... .......... .......... 12% 24.3M 1s 2024-09-12T00:39:38.655 INFO:teuthology.orchestra.run.smithi133.stderr: 12000K .......... .......... .......... .......... .......... 12% 67.3M 1s 2024-09-12T00:39:38.655 INFO:teuthology.orchestra.run.smithi133.stderr: 12050K .......... .......... .......... .......... .......... 13% 273M 1s 2024-09-12T00:39:38.655 INFO:teuthology.orchestra.run.smithi133.stderr: 12100K .......... .......... .......... .......... .......... 13% 283M 1s 2024-09-12T00:39:38.655 INFO:teuthology.orchestra.run.smithi133.stderr: 12150K .......... .......... .......... .......... .......... 13% 50.1M 1s 2024-09-12T00:39:38.655 INFO:teuthology.orchestra.run.smithi133.stderr: 12200K .......... .......... .......... .......... .......... 13% 10.7M 1s 2024-09-12T00:39:38.655 INFO:teuthology.orchestra.run.smithi133.stderr: 12250K .......... .......... .......... .......... .......... 13% 268M 1s 2024-09-12T00:39:38.655 INFO:teuthology.orchestra.run.smithi133.stderr: 12300K .......... .......... .......... .......... .......... 13% 275M 1s 2024-09-12T00:39:38.655 INFO:teuthology.orchestra.run.smithi133.stderr: 12350K .......... .......... .......... .......... .......... 13% 80.5M 1s 2024-09-12T00:39:38.656 INFO:teuthology.orchestra.run.smithi133.stderr: 12400K .......... .......... .......... .......... .......... 13% 7.34M 1s 2024-09-12T00:39:38.656 INFO:teuthology.orchestra.run.smithi133.stderr: 12450K .......... .......... .......... .......... .......... 13% 148M 1s 2024-09-12T00:39:38.656 INFO:teuthology.orchestra.run.smithi133.stderr: 12500K .......... .......... .......... .......... .......... 13% 287M 1s 2024-09-12T00:39:38.656 INFO:teuthology.orchestra.run.smithi133.stderr: 12550K .......... .......... .......... .......... .......... 13% 109M 1s 2024-09-12T00:39:38.656 INFO:teuthology.orchestra.run.smithi133.stderr: 12600K .......... .......... .......... .......... .......... 13% 215M 1s 2024-09-12T00:39:38.656 INFO:teuthology.orchestra.run.smithi133.stderr: 12650K .......... .......... .......... .......... .......... 13% 260M 1s 2024-09-12T00:39:38.656 INFO:teuthology.orchestra.run.smithi133.stderr: 12700K .......... .......... .......... .......... .......... 13% 240M 1s 2024-09-12T00:39:38.656 INFO:teuthology.orchestra.run.smithi133.stderr: 12750K .......... .......... .......... .......... .......... 13% 232M 1s 2024-09-12T00:39:38.656 INFO:teuthology.orchestra.run.smithi133.stderr: 12800K .......... .......... .......... .......... .......... 13% 212M 1s 2024-09-12T00:39:38.656 INFO:teuthology.orchestra.run.smithi133.stderr: 12850K .......... .......... .......... .......... .......... 13% 284M 1s 2024-09-12T00:39:38.656 INFO:teuthology.orchestra.run.smithi133.stderr: 12900K .......... .......... .......... .......... .......... 13% 280M 1s 2024-09-12T00:39:38.656 INFO:teuthology.orchestra.run.smithi133.stderr: 12950K .......... .......... .......... .......... .......... 13% 247M 1s 2024-09-12T00:39:38.657 INFO:teuthology.orchestra.run.smithi133.stderr: 13000K .......... .......... .......... .......... .......... 14% 125M 1s 2024-09-12T00:39:38.657 INFO:teuthology.orchestra.run.smithi133.stderr: 13050K .......... .......... .......... .......... .......... 14% 287M 1s 2024-09-12T00:39:38.657 INFO:teuthology.orchestra.run.smithi133.stderr: 13100K .......... .......... .......... .......... .......... 14% 281M 1s 2024-09-12T00:39:38.657 INFO:teuthology.orchestra.run.smithi133.stderr: 13150K .......... .......... .......... .......... .......... 14% 236M 1s 2024-09-12T00:39:38.657 INFO:teuthology.orchestra.run.smithi133.stderr: 13200K .......... .......... .......... .......... .......... 14% 271M 1s 2024-09-12T00:39:38.657 INFO:teuthology.orchestra.run.smithi133.stderr: 13250K .......... .......... .......... .......... .......... 14% 280M 1s 2024-09-12T00:39:38.657 INFO:teuthology.orchestra.run.smithi133.stderr: 13300K .......... .......... .......... .......... .......... 14% 288M 1s 2024-09-12T00:39:38.657 INFO:teuthology.orchestra.run.smithi133.stderr: 13350K .......... .......... .......... .......... .......... 14% 252M 1s 2024-09-12T00:39:38.657 INFO:teuthology.orchestra.run.smithi133.stderr: 13400K .......... .......... .......... .......... .......... 14% 285M 1s 2024-09-12T00:39:38.657 INFO:teuthology.orchestra.run.smithi133.stderr: 13450K .......... .......... .......... .......... .......... 14% 274M 1s 2024-09-12T00:39:38.657 INFO:teuthology.orchestra.run.smithi133.stderr: 13500K .......... .......... .......... .......... .......... 14% 274M 1s 2024-09-12T00:39:38.657 INFO:teuthology.orchestra.run.smithi133.stderr: 13550K .......... .......... .......... .......... .......... 14% 234M 1s 2024-09-12T00:39:38.657 INFO:teuthology.orchestra.run.smithi133.stderr: 13600K .......... .......... .......... .......... .......... 14% 288M 1s 2024-09-12T00:39:38.657 INFO:teuthology.orchestra.run.smithi133.stderr: 13650K .......... .......... .......... .......... .......... 14% 273M 1s 2024-09-12T00:39:38.658 INFO:teuthology.orchestra.run.smithi133.stderr: 13700K .......... .......... .......... .......... .......... 14% 215M 1s 2024-09-12T00:39:38.658 INFO:teuthology.orchestra.run.smithi133.stderr: 13750K .......... .......... .......... .......... .......... 14% 210M 1s 2024-09-12T00:39:38.658 INFO:teuthology.orchestra.run.smithi133.stderr: 13800K .......... .......... .......... .......... .......... 14% 244M 1s 2024-09-12T00:39:38.658 INFO:teuthology.orchestra.run.smithi133.stderr: 13850K .......... .......... .......... .......... .......... 14% 235M 1s 2024-09-12T00:39:38.658 INFO:teuthology.orchestra.run.smithi133.stderr: 13900K .......... .......... .......... .......... .......... 15% 255M 1s 2024-09-12T00:39:38.658 INFO:teuthology.orchestra.run.smithi133.stderr: 13950K .......... .......... .......... .......... .......... 15% 233M 1s 2024-09-12T00:39:38.658 INFO:teuthology.orchestra.run.smithi133.stderr: 14000K .......... .......... .......... .......... .......... 15% 274M 1s 2024-09-12T00:39:38.658 INFO:teuthology.orchestra.run.smithi133.stderr: 14050K .......... .......... .......... .......... .......... 15% 277M 1s 2024-09-12T00:39:38.658 INFO:teuthology.orchestra.run.smithi133.stderr: 14100K .......... .......... .......... .......... .......... 15% 279M 1s 2024-09-12T00:39:38.658 INFO:teuthology.orchestra.run.smithi133.stderr: 14150K .......... .......... .......... .......... .......... 15% 257M 1s 2024-09-12T00:39:38.658 INFO:teuthology.orchestra.run.smithi133.stderr: 14200K .......... .......... .......... .......... .......... 15% 278M 1s 2024-09-12T00:39:38.658 INFO:teuthology.orchestra.run.smithi133.stderr: 14250K .......... .......... .......... .......... .......... 15% 287M 1s 2024-09-12T00:39:38.658 INFO:teuthology.orchestra.run.smithi133.stderr: 14300K .......... .......... .......... .......... .......... 15% 279M 1s 2024-09-12T00:39:38.658 INFO:teuthology.orchestra.run.smithi133.stderr: 14350K .......... .......... .......... .......... .......... 15% 239M 1s 2024-09-12T00:39:38.659 INFO:teuthology.orchestra.run.smithi133.stderr: 14400K .......... .......... .......... .......... .......... 15% 295M 1s 2024-09-12T00:39:38.659 INFO:teuthology.orchestra.run.smithi133.stderr: 14450K .......... .......... .......... .......... .......... 15% 282M 1s 2024-09-12T00:39:38.659 INFO:teuthology.orchestra.run.smithi133.stderr: 14500K .......... .......... .......... .......... .......... 15% 285M 1s 2024-09-12T00:39:38.659 INFO:teuthology.orchestra.run.smithi133.stderr: 14550K .......... .......... .......... .......... .......... 15% 254M 1s 2024-09-12T00:39:38.659 INFO:teuthology.orchestra.run.smithi133.stderr: 14600K .......... .......... .......... .......... .......... 15% 298M 1s 2024-09-12T00:39:38.659 INFO:teuthology.orchestra.run.smithi133.stderr: 14650K .......... .......... .......... .......... .......... 15% 271M 1s 2024-09-12T00:39:38.659 INFO:teuthology.orchestra.run.smithi133.stderr: 14700K .......... .......... .......... .......... .......... 15% 301M 1s 2024-09-12T00:39:38.659 INFO:teuthology.orchestra.run.smithi133.stderr: 14750K .......... .......... .......... .......... .......... 15% 258M 1s 2024-09-12T00:39:38.659 INFO:teuthology.orchestra.run.smithi133.stderr: 14800K .......... .......... .......... .......... .......... 15% 310M 1s 2024-09-12T00:39:38.659 INFO:teuthology.orchestra.run.smithi133.stderr: 14850K .......... .......... .......... .......... .......... 16% 264M 1s 2024-09-12T00:39:38.659 INFO:teuthology.orchestra.run.smithi133.stderr: 14900K .......... .......... .......... .......... .......... 16% 296M 1s 2024-09-12T00:39:38.659 INFO:teuthology.orchestra.run.smithi133.stderr: 14950K .......... .......... .......... .......... .......... 16% 251M 1s 2024-09-12T00:39:38.659 INFO:teuthology.orchestra.run.smithi133.stderr: 15000K .......... .......... .......... .......... .......... 16% 265M 1s 2024-09-12T00:39:38.659 INFO:teuthology.orchestra.run.smithi133.stderr: 15050K .......... .......... .......... .......... .......... 16% 259M 1s 2024-09-12T00:39:38.659 INFO:teuthology.orchestra.run.smithi133.stderr: 15100K .......... .......... .......... .......... .......... 16% 314M 1s 2024-09-12T00:39:38.660 INFO:teuthology.orchestra.run.smithi133.stderr: 15150K .......... .......... .......... .......... .......... 16% 222M 1s 2024-09-12T00:39:38.660 INFO:teuthology.orchestra.run.smithi133.stderr: 15200K .......... .......... .......... .......... .......... 16% 279M 1s 2024-09-12T00:39:38.660 INFO:teuthology.orchestra.run.smithi133.stderr: 15250K .......... .......... .......... .......... .......... 16% 307M 1s 2024-09-12T00:39:38.660 INFO:teuthology.orchestra.run.smithi133.stderr: 15300K .......... .......... .......... .......... .......... 16% 302M 1s 2024-09-12T00:39:38.660 INFO:teuthology.orchestra.run.smithi133.stderr: 15350K .......... .......... .......... .......... .......... 16% 276M 1s 2024-09-12T00:39:38.660 INFO:teuthology.orchestra.run.smithi133.stderr: 15400K .......... .......... .......... .......... .......... 16% 10.8M 1s 2024-09-12T00:39:38.660 INFO:teuthology.orchestra.run.smithi133.stderr: 15450K .......... .......... .......... .......... .......... 16% 226M 1s 2024-09-12T00:39:38.660 INFO:teuthology.orchestra.run.smithi133.stderr: 15500K .......... .......... .......... .......... .......... 16% 282M 1s 2024-09-12T00:39:38.660 INFO:teuthology.orchestra.run.smithi133.stderr: 15550K .......... .......... .......... .......... .......... 16% 6.45M 1s 2024-09-12T00:39:38.660 INFO:teuthology.orchestra.run.smithi133.stderr: 15600K .......... .......... .......... .......... .......... 16% 62.9M 1s 2024-09-12T00:39:38.660 INFO:teuthology.orchestra.run.smithi133.stderr: 15650K .......... .......... .......... .......... .......... 16% 281M 1s 2024-09-12T00:39:38.660 INFO:teuthology.orchestra.run.smithi133.stderr: 15700K .......... .......... .......... .......... .......... 16% 114M 1s 2024-09-12T00:39:38.661 INFO:teuthology.orchestra.run.smithi133.stderr: 15750K .......... .......... .......... .......... .......... 17% 250M 1s 2024-09-12T00:39:38.661 INFO:teuthology.orchestra.run.smithi133.stderr: 15800K .......... .......... .......... .......... .......... 17% 260M 1s 2024-09-12T00:39:38.661 INFO:teuthology.orchestra.run.smithi133.stderr: 15850K .......... .......... .......... .......... .......... 17% 276M 1s 2024-09-12T00:39:38.661 INFO:teuthology.orchestra.run.smithi133.stderr: 15900K .......... .......... .......... .......... .......... 17% 286M 1s 2024-09-12T00:39:38.661 INFO:teuthology.orchestra.run.smithi133.stderr: 15950K .......... .......... .......... .......... .......... 17% 234M 1s 2024-09-12T00:39:38.661 INFO:teuthology.orchestra.run.smithi133.stderr: 16000K .......... .......... .......... .......... .......... 17% 285M 1s 2024-09-12T00:39:38.661 INFO:teuthology.orchestra.run.smithi133.stderr: 16050K .......... .......... .......... .......... .......... 17% 194M 1s 2024-09-12T00:39:38.661 INFO:teuthology.orchestra.run.smithi133.stderr: 16100K .......... .......... .......... .......... .......... 17% 282M 1s 2024-09-12T00:39:38.661 INFO:teuthology.orchestra.run.smithi133.stderr: 16150K .......... .......... .......... .......... .......... 17% 260M 1s 2024-09-12T00:39:38.661 INFO:teuthology.orchestra.run.smithi133.stderr: 16200K .......... .......... .......... .......... .......... 17% 299M 1s 2024-09-12T00:39:38.661 INFO:teuthology.orchestra.run.smithi133.stderr: 16250K .......... .......... .......... .......... .......... 17% 279M 1s 2024-09-12T00:39:38.661 INFO:teuthology.orchestra.run.smithi133.stderr: 16300K .......... .......... .......... .......... .......... 17% 317M 1s 2024-09-12T00:39:38.661 INFO:teuthology.orchestra.run.smithi133.stderr: 16350K .......... .......... .......... .......... .......... 17% 20.3M 1s 2024-09-12T00:39:38.661 INFO:teuthology.orchestra.run.smithi133.stderr: 16400K .......... .......... .......... .......... .......... 17% 236M 1s 2024-09-12T00:39:38.662 INFO:teuthology.orchestra.run.smithi133.stderr: 16450K .......... .......... .......... .......... .......... 17% 294M 1s 2024-09-12T00:39:38.662 INFO:teuthology.orchestra.run.smithi133.stderr: 16500K .......... .......... .......... .......... .......... 17% 180M 1s 2024-09-12T00:39:38.662 INFO:teuthology.orchestra.run.smithi133.stderr: 16550K .......... .......... .......... .......... .......... 17% 210M 1s 2024-09-12T00:39:38.662 INFO:teuthology.orchestra.run.smithi133.stderr: 16600K .......... .......... .......... .......... .......... 17% 280M 1s 2024-09-12T00:39:38.662 INFO:teuthology.orchestra.run.smithi133.stderr: 16650K .......... .......... .......... .......... .......... 17% 281M 1s 2024-09-12T00:39:38.662 INFO:teuthology.orchestra.run.smithi133.stderr: 16700K .......... .......... .......... .......... .......... 18% 291M 1s 2024-09-12T00:39:38.662 INFO:teuthology.orchestra.run.smithi133.stderr: 16750K .......... .......... .......... .......... .......... 18% 28.7M 1s 2024-09-12T00:39:38.662 INFO:teuthology.orchestra.run.smithi133.stderr: 16800K .......... .......... .......... .......... .......... 18% 268M 1s 2024-09-12T00:39:38.662 INFO:teuthology.orchestra.run.smithi133.stderr: 16850K .......... .......... .......... .......... .......... 18% 271M 1s 2024-09-12T00:39:38.662 INFO:teuthology.orchestra.run.smithi133.stderr: 16900K .......... .......... .......... .......... .......... 18% 286M 1s 2024-09-12T00:39:38.662 INFO:teuthology.orchestra.run.smithi133.stderr: 16950K .......... .......... .......... .......... .......... 18% 61.1M 1s 2024-09-12T00:39:38.662 INFO:teuthology.orchestra.run.smithi133.stderr: 17000K .......... .......... .......... .......... .......... 18% 176M 1s 2024-09-12T00:39:38.662 INFO:teuthology.orchestra.run.smithi133.stderr: 17050K .......... .......... .......... .......... .......... 18% 422M 1s 2024-09-12T00:39:38.662 INFO:teuthology.orchestra.run.smithi133.stderr: 17100K .......... .......... .......... .......... .......... 18% 425M 1s 2024-09-12T00:39:38.663 INFO:teuthology.orchestra.run.smithi133.stderr: 17150K .......... .......... .......... .......... .......... 18% 130M 1s 2024-09-12T00:39:38.663 INFO:teuthology.orchestra.run.smithi133.stderr: 17200K .......... .......... .......... .......... .......... 18% 435M 1s 2024-09-12T00:39:38.663 INFO:teuthology.orchestra.run.smithi133.stderr: 17250K .......... .......... .......... .......... .......... 18% 433M 1s 2024-09-12T00:39:38.663 INFO:teuthology.orchestra.run.smithi133.stderr: 17300K .......... .......... .......... .......... .......... 18% 453M 1s 2024-09-12T00:39:38.663 INFO:teuthology.orchestra.run.smithi133.stderr: 17350K .......... .......... .......... .......... .......... 18% 16.8M 1s 2024-09-12T00:39:38.663 INFO:teuthology.orchestra.run.smithi133.stderr: 17400K .......... .......... .......... .......... .......... 18% 32.0M 1s 2024-09-12T00:39:38.663 INFO:teuthology.orchestra.run.smithi133.stderr: 17450K .......... .......... .......... .......... .......... 18% 255M 1s 2024-09-12T00:39:38.663 INFO:teuthology.orchestra.run.smithi133.stderr: 17500K .......... .......... .......... .......... .......... 18% 445M 1s 2024-09-12T00:39:38.663 INFO:teuthology.orchestra.run.smithi133.stderr: 17550K .......... .......... .......... .......... .......... 18% 16.3M 1s 2024-09-12T00:39:38.663 INFO:teuthology.orchestra.run.smithi133.stderr: 17600K .......... .......... .......... .......... .......... 18% 418M 1s 2024-09-12T00:39:38.663 INFO:teuthology.orchestra.run.smithi133.stderr: 17650K .......... .......... .......... .......... .......... 19% 138M 1s 2024-09-12T00:39:38.663 INFO:teuthology.orchestra.run.smithi133.stderr: 17700K .......... .......... .......... .......... .......... 19% 137M 1s 2024-09-12T00:39:38.663 INFO:teuthology.orchestra.run.smithi133.stderr: 17750K .......... .......... .......... .......... .......... 19% 362M 1s 2024-09-12T00:39:38.664 INFO:teuthology.orchestra.run.smithi133.stderr: 17800K .......... .......... .......... .......... .......... 19% 351M 1s 2024-09-12T00:39:38.664 INFO:teuthology.orchestra.run.smithi133.stderr: 17850K .......... .......... .......... .......... .......... 19% 4.82M 1s 2024-09-12T00:39:38.664 INFO:teuthology.orchestra.run.smithi133.stderr: 17900K .......... .......... .......... .......... .......... 19% 93.2M 1s 2024-09-12T00:39:38.664 INFO:teuthology.orchestra.run.smithi133.stderr: 17950K .......... .......... .......... .......... .......... 19% 320M 1s 2024-09-12T00:39:38.664 INFO:teuthology.orchestra.run.smithi133.stderr: 18000K .......... .......... .......... .......... .......... 19% 424M 1s 2024-09-12T00:39:38.664 INFO:teuthology.orchestra.run.smithi133.stderr: 18050K .......... .......... .......... .......... .......... 19% 226M 1s 2024-09-12T00:39:38.664 INFO:teuthology.orchestra.run.smithi133.stderr: 18100K .......... .......... .......... .......... .......... 19% 15.4M 1s 2024-09-12T00:39:38.664 INFO:teuthology.orchestra.run.smithi133.stderr: 18150K .......... .......... .......... .......... .......... 19% 297M 1s 2024-09-12T00:39:38.664 INFO:teuthology.orchestra.run.smithi133.stderr: 18200K .......... .......... .......... .......... .......... 19% 424M 1s 2024-09-12T00:39:38.664 INFO:teuthology.orchestra.run.smithi133.stderr: 18250K .......... .......... .......... .......... .......... 19% 211M 1s 2024-09-12T00:39:38.664 INFO:teuthology.orchestra.run.smithi133.stderr: 18300K .......... .......... .......... .......... .......... 19% 22.4M 1s 2024-09-12T00:39:38.664 INFO:teuthology.orchestra.run.smithi133.stderr: 18350K .......... .......... .......... .......... .......... 19% 362M 1s 2024-09-12T00:39:38.664 INFO:teuthology.orchestra.run.smithi133.stderr: 18400K .......... .......... .......... .......... .......... 19% 152M 1s 2024-09-12T00:39:38.665 INFO:teuthology.orchestra.run.smithi133.stderr: 18450K .......... .......... .......... .......... .......... 19% 407M 1s 2024-09-12T00:39:38.665 INFO:teuthology.orchestra.run.smithi133.stderr: 18500K .......... .......... .......... .......... .......... 19% 39.0M 1s 2024-09-12T00:39:38.665 INFO:teuthology.orchestra.run.smithi133.stderr: 18550K .......... .......... .......... .......... .......... 20% 190M 1s 2024-09-12T00:39:38.665 INFO:teuthology.orchestra.run.smithi133.stderr: 18600K .......... .......... .......... .......... .......... 20% 235M 1s 2024-09-12T00:39:38.665 INFO:teuthology.orchestra.run.smithi133.stderr: 18650K .......... .......... .......... .......... .......... 20% 113M 1s 2024-09-12T00:39:38.665 INFO:teuthology.orchestra.run.smithi133.stderr: 18700K .......... .......... .......... .......... .......... 20% 29.6M 1s 2024-09-12T00:39:38.665 INFO:teuthology.orchestra.run.smithi133.stderr: 18750K .......... .......... .......... .......... .......... 20% 84.9M 1s 2024-09-12T00:39:38.665 INFO:teuthology.orchestra.run.smithi133.stderr: 18800K .......... .......... .......... .......... .......... 20% 64.2M 1s 2024-09-12T00:39:38.665 INFO:teuthology.orchestra.run.smithi133.stderr: 18850K .......... .......... .......... .......... .......... 20% 222M 1s 2024-09-12T00:39:38.665 INFO:teuthology.orchestra.run.smithi133.stderr: 18900K .......... .......... .......... .......... .......... 20% 419M 1s 2024-09-12T00:39:38.665 INFO:teuthology.orchestra.run.smithi133.stderr: 18950K .......... .......... .......... .......... .......... 20% 26.1M 1s 2024-09-12T00:39:38.665 INFO:teuthology.orchestra.run.smithi133.stderr: 19000K .......... .......... .......... .......... .......... 20% 311M 1s 2024-09-12T00:39:38.665 INFO:teuthology.orchestra.run.smithi133.stderr: 19050K .......... .......... .......... .......... .......... 20% 427M 1s 2024-09-12T00:39:38.665 INFO:teuthology.orchestra.run.smithi133.stderr: 19100K .......... .......... .......... .......... .......... 20% 376M 1s 2024-09-12T00:39:38.666 INFO:teuthology.orchestra.run.smithi133.stderr: 19150K .......... .......... .......... .......... .......... 20% 27.0M 1s 2024-09-12T00:39:38.666 INFO:teuthology.orchestra.run.smithi133.stderr: 19200K .......... .......... .......... .......... .......... 20% 175M 1s 2024-09-12T00:39:38.666 INFO:teuthology.orchestra.run.smithi133.stderr: 19250K .......... .......... .......... .......... .......... 20% 421M 1s 2024-09-12T00:39:38.666 INFO:teuthology.orchestra.run.smithi133.stderr: 19300K .......... .......... .......... .......... .......... 20% 420M 1s 2024-09-12T00:39:38.666 INFO:teuthology.orchestra.run.smithi133.stderr: 19350K .......... .......... .......... .......... .......... 20% 41.0M 1s 2024-09-12T00:39:38.666 INFO:teuthology.orchestra.run.smithi133.stderr: 19400K .......... .......... .......... .......... .......... 20% 344M 1s 2024-09-12T00:39:38.666 INFO:teuthology.orchestra.run.smithi133.stderr: 19450K .......... .......... .......... .......... .......... 20% 422M 1s 2024-09-12T00:39:38.666 INFO:teuthology.orchestra.run.smithi133.stderr: 19500K .......... .......... .......... .......... .......... 21% 321M 1s 2024-09-12T00:39:38.666 INFO:teuthology.orchestra.run.smithi133.stderr: 19550K .......... .......... .......... .......... .......... 21% 43.8M 1s 2024-09-12T00:39:38.666 INFO:teuthology.orchestra.run.smithi133.stderr: 19600K .......... .......... .......... .......... .......... 21% 410M 1s 2024-09-12T00:39:38.666 INFO:teuthology.orchestra.run.smithi133.stderr: 19650K .......... .......... .......... .......... .......... 21% 374M 1s 2024-09-12T00:39:38.666 INFO:teuthology.orchestra.run.smithi133.stderr: 19700K .......... .......... .......... .......... .......... 21% 426M 1s 2024-09-12T00:39:38.666 INFO:teuthology.orchestra.run.smithi133.stderr: 19750K .......... .......... .......... .......... .......... 21% 35.8M 1s 2024-09-12T00:39:38.667 INFO:teuthology.orchestra.run.smithi133.stderr: 19800K .......... .......... .......... .......... .......... 21% 382M 1s 2024-09-12T00:39:38.667 INFO:teuthology.orchestra.run.smithi133.stderr: 19850K .......... .......... .......... .......... .......... 21% 314M 1s 2024-09-12T00:39:38.667 INFO:teuthology.orchestra.run.smithi133.stderr: 19900K .......... .......... .......... .......... .......... 21% 436M 1s 2024-09-12T00:39:38.667 INFO:teuthology.orchestra.run.smithi133.stderr: 19950K .......... .......... .......... .......... .......... 21% 65.4M 1s 2024-09-12T00:39:38.667 INFO:teuthology.orchestra.run.smithi133.stderr: 20000K .......... .......... .......... .......... .......... 21% 331M 1s 2024-09-12T00:39:38.667 INFO:teuthology.orchestra.run.smithi133.stderr: 20050K .......... .......... .......... .......... .......... 21% 409M 1s 2024-09-12T00:39:38.667 INFO:teuthology.orchestra.run.smithi133.stderr: 20100K .......... .......... .......... .......... .......... 21% 48.4M 1s 2024-09-12T00:39:38.667 INFO:teuthology.orchestra.run.smithi133.stderr: 20150K .......... .......... .......... .......... .......... 21% 265M 1s 2024-09-12T00:39:38.667 INFO:teuthology.orchestra.run.smithi133.stderr: 20200K .......... .......... .......... .......... .......... 21% 412M 1s 2024-09-12T00:39:38.667 INFO:teuthology.orchestra.run.smithi133.stderr: 20250K .......... .......... .......... .......... .......... 21% 301M 1s 2024-09-12T00:39:38.667 INFO:teuthology.orchestra.run.smithi133.stderr: 20300K .......... .......... .......... .......... .......... 21% 67.8M 1s 2024-09-12T00:39:38.667 INFO:teuthology.orchestra.run.smithi133.stderr: 20350K .......... .......... .......... .......... .......... 21% 255M 1s 2024-09-12T00:39:38.667 INFO:teuthology.orchestra.run.smithi133.stderr: 20400K .......... .......... .......... .......... .......... 22% 442M 1s 2024-09-12T00:39:38.667 INFO:teuthology.orchestra.run.smithi133.stderr: 20450K .......... .......... .......... .......... .......... 22% 19.2M 1s 2024-09-12T00:39:38.668 INFO:teuthology.orchestra.run.smithi133.stderr: 20500K .......... .......... .......... .......... .......... 22% 340M 1s 2024-09-12T00:39:38.668 INFO:teuthology.orchestra.run.smithi133.stderr: 20550K .......... .......... .......... .......... .......... 22% 364M 1s 2024-09-12T00:39:38.668 INFO:teuthology.orchestra.run.smithi133.stderr: 20600K .......... .......... .......... .......... .......... 22% 74.7M 1s 2024-09-12T00:39:38.668 INFO:teuthology.orchestra.run.smithi133.stderr: 20650K .......... .......... .......... .......... .......... 22% 311M 1s 2024-09-12T00:39:38.668 INFO:teuthology.orchestra.run.smithi133.stderr: 20700K .......... .......... .......... .......... .......... 22% 314M 1s 2024-09-12T00:39:38.668 INFO:teuthology.orchestra.run.smithi133.stderr: 20750K .......... .......... .......... .......... .......... 22% 351M 1s 2024-09-12T00:39:38.668 INFO:teuthology.orchestra.run.smithi133.stderr: 20800K .......... .......... .......... .......... .......... 22% 195M 1s 2024-09-12T00:39:38.668 INFO:teuthology.orchestra.run.smithi133.stderr: 20850K .......... .......... .......... .......... .......... 22% 385M 1s 2024-09-12T00:39:38.668 INFO:teuthology.orchestra.run.smithi133.stderr: 20900K .......... .......... .......... .......... .......... 22% 76.7M 1s 2024-09-12T00:39:38.668 INFO:teuthology.orchestra.run.smithi133.stderr: 20950K .......... .......... .......... .......... .......... 22% 360M 1s 2024-09-12T00:39:38.668 INFO:teuthology.orchestra.run.smithi133.stderr: 21000K .......... .......... .......... .......... .......... 22% 79.9M 1s 2024-09-12T00:39:38.668 INFO:teuthology.orchestra.run.smithi133.stderr: 21050K .......... .......... .......... .......... .......... 22% 382M 1s 2024-09-12T00:39:38.669 INFO:teuthology.orchestra.run.smithi133.stderr: 21100K .......... .......... .......... .......... .......... 22% 233M 1s 2024-09-12T00:39:38.669 INFO:teuthology.orchestra.run.smithi133.stderr: 21150K .......... .......... .......... .......... .......... 22% 314M 1s 2024-09-12T00:39:38.669 INFO:teuthology.orchestra.run.smithi133.stderr: 21200K .......... .......... .......... .......... .......... 22% 101M 1s 2024-09-12T00:39:38.669 INFO:teuthology.orchestra.run.smithi133.stderr: 21250K .......... .......... .......... .......... .......... 22% 83.3M 1s 2024-09-12T00:39:38.669 INFO:teuthology.orchestra.run.smithi133.stderr: 21300K .......... .......... .......... .......... .......... 22% 260M 1s 2024-09-12T00:39:38.669 INFO:teuthology.orchestra.run.smithi133.stderr: 21350K .......... .......... .......... .......... .......... 23% 400M 1s 2024-09-12T00:39:38.669 INFO:teuthology.orchestra.run.smithi133.stderr: 21400K .......... .......... .......... .......... .......... 23% 408M 1s 2024-09-12T00:39:38.669 INFO:teuthology.orchestra.run.smithi133.stderr: 21450K .......... .......... .......... .......... .......... 23% 148M 1s 2024-09-12T00:39:38.669 INFO:teuthology.orchestra.run.smithi133.stderr: 21500K .......... .......... .......... .......... .......... 23% 286M 1s 2024-09-12T00:39:38.669 INFO:teuthology.orchestra.run.smithi133.stderr: 21550K .......... .......... .......... .......... .......... 23% 405M 1s 2024-09-12T00:39:38.669 INFO:teuthology.orchestra.run.smithi133.stderr: 21600K .......... .......... .......... .......... .......... 23% 21.9M 1s 2024-09-12T00:39:38.669 INFO:teuthology.orchestra.run.smithi133.stderr: 21650K .......... .......... .......... .......... .......... 23% 405M 1s 2024-09-12T00:39:38.669 INFO:teuthology.orchestra.run.smithi133.stderr: 21700K .......... .......... .......... .......... .......... 23% 381M 1s 2024-09-12T00:39:38.670 INFO:teuthology.orchestra.run.smithi133.stderr: 21750K .......... .......... .......... .......... .......... 23% 136M 1s 2024-09-12T00:39:38.670 INFO:teuthology.orchestra.run.smithi133.stderr: 21800K .......... .......... .......... .......... .......... 23% 5.58M 1s 2024-09-12T00:39:38.670 INFO:teuthology.orchestra.run.smithi133.stderr: 21850K .......... .......... .......... .......... .......... 23% 286M 1s 2024-09-12T00:39:38.670 INFO:teuthology.orchestra.run.smithi133.stderr: 21900K .......... .......... .......... .......... .......... 23% 88.8M 1s 2024-09-12T00:39:38.670 INFO:teuthology.orchestra.run.smithi133.stderr: 21950K .......... .......... .......... .......... .......... 23% 40.1M 1s 2024-09-12T00:39:38.670 INFO:teuthology.orchestra.run.smithi133.stderr: 22000K .......... .......... .......... .......... .......... 23% 3.77M 1s 2024-09-12T00:39:38.670 INFO:teuthology.orchestra.run.smithi133.stderr: 22050K .......... .......... .......... .......... .......... 23% 226M 1s 2024-09-12T00:39:38.670 INFO:teuthology.orchestra.run.smithi133.stderr: 22100K .......... .......... .......... .......... .......... 23% 370M 1s 2024-09-12T00:39:38.670 INFO:teuthology.orchestra.run.smithi133.stderr: 22150K .......... .......... .......... .......... .......... 23% 379M 1s 2024-09-12T00:39:38.670 INFO:teuthology.orchestra.run.smithi133.stderr: 22200K .......... .......... .......... .......... .......... 23% 9.93M 1s 2024-09-12T00:39:38.670 INFO:teuthology.orchestra.run.smithi133.stderr: 22250K .......... .......... .......... .......... .......... 24% 35.7M 1s 2024-09-12T00:39:38.670 INFO:teuthology.orchestra.run.smithi133.stderr: 22300K .......... .......... .......... .......... .......... 24% 307M 1s 2024-09-12T00:39:38.670 INFO:teuthology.orchestra.run.smithi133.stderr: 22350K .......... .......... .......... .......... .......... 24% 51.5M 1s 2024-09-12T00:39:38.670 INFO:teuthology.orchestra.run.smithi133.stderr: 22400K .......... .......... .......... .......... .......... 24% 327M 1s 2024-09-12T00:39:38.671 INFO:teuthology.orchestra.run.smithi133.stderr: 22450K .......... .......... .......... .......... .......... 24% 386M 1s 2024-09-12T00:39:38.671 INFO:teuthology.orchestra.run.smithi133.stderr: 22500K .......... .......... .......... .......... .......... 24% 92.9M 1s 2024-09-12T00:39:38.671 INFO:teuthology.orchestra.run.smithi133.stderr: 22550K .......... .......... .......... .......... .......... 24% 76.1M 1s 2024-09-12T00:39:38.671 INFO:teuthology.orchestra.run.smithi133.stderr: 22600K .......... .......... .......... .......... .......... 24% 158M 1s 2024-09-12T00:39:38.671 INFO:teuthology.orchestra.run.smithi133.stderr: 22650K .......... .......... .......... .......... .......... 24% 75.0M 1s 2024-09-12T00:39:38.671 INFO:teuthology.orchestra.run.smithi133.stderr: 22700K .......... .......... .......... .......... .......... 24% 185M 1s 2024-09-12T00:39:38.671 INFO:teuthology.orchestra.run.smithi133.stderr: 22750K .......... .......... .......... .......... .......... 24% 440M 1s 2024-09-12T00:39:38.671 INFO:teuthology.orchestra.run.smithi133.stderr: 22800K .......... .......... .......... .......... .......... 24% 12.1M 1s 2024-09-12T00:39:38.671 INFO:teuthology.orchestra.run.smithi133.stderr: 22850K .......... .......... .......... .......... .......... 24% 378M 1s 2024-09-12T00:39:38.671 INFO:teuthology.orchestra.run.smithi133.stderr: 22900K .......... .......... .......... .......... .......... 24% 340M 1s 2024-09-12T00:39:38.671 INFO:teuthology.orchestra.run.smithi133.stderr: 22950K .......... .......... .......... .......... .......... 24% 27.0M 1s 2024-09-12T00:39:38.671 INFO:teuthology.orchestra.run.smithi133.stderr: 23000K .......... .......... .......... .......... .......... 24% 258M 1s 2024-09-12T00:39:38.671 INFO:teuthology.orchestra.run.smithi133.stderr: 23050K .......... .......... .......... .......... .......... 24% 259M 1s 2024-09-12T00:39:38.671 INFO:teuthology.orchestra.run.smithi133.stderr: 23100K .......... .......... .......... .......... .......... 24% 73.6M 1s 2024-09-12T00:39:38.672 INFO:teuthology.orchestra.run.smithi133.stderr: 23150K .......... .......... .......... .......... .......... 24% 24.6M 1s 2024-09-12T00:39:38.672 INFO:teuthology.orchestra.run.smithi133.stderr: 23200K .......... .......... .......... .......... .......... 25% 214M 1s 2024-09-12T00:39:38.672 INFO:teuthology.orchestra.run.smithi133.stderr: 23250K .......... .......... .......... .......... .......... 25% 415M 1s 2024-09-12T00:39:38.672 INFO:teuthology.orchestra.run.smithi133.stderr: 23300K .......... .......... .......... .......... .......... 25% 65.3M 1s 2024-09-12T00:39:38.672 INFO:teuthology.orchestra.run.smithi133.stderr: 23350K .......... .......... .......... .......... .......... 25% 241M 1s 2024-09-12T00:39:38.672 INFO:teuthology.orchestra.run.smithi133.stderr: 23400K .......... .......... .......... .......... .......... 25% 290M 1s 2024-09-12T00:39:38.672 INFO:teuthology.orchestra.run.smithi133.stderr: 23450K .......... .......... .......... .......... .......... 25% 143M 1s 2024-09-12T00:39:38.672 INFO:teuthology.orchestra.run.smithi133.stderr: 23500K .......... .......... .......... .......... .......... 25% 362M 1s 2024-09-12T00:39:38.672 INFO:teuthology.orchestra.run.smithi133.stderr: 23550K .......... .......... .......... .......... .......... 25% 151M 1s 2024-09-12T00:39:38.672 INFO:teuthology.orchestra.run.smithi133.stderr: 23600K .......... .......... .......... .......... .......... 25% 349M 1s 2024-09-12T00:39:38.672 INFO:teuthology.orchestra.run.smithi133.stderr: 23650K .......... .......... .......... .......... .......... 25% 133M 1s 2024-09-12T00:39:38.672 INFO:teuthology.orchestra.run.smithi133.stderr: 23700K .......... .......... .......... .......... .......... 25% 377M 1s 2024-09-12T00:39:38.672 INFO:teuthology.orchestra.run.smithi133.stderr: 23750K .......... .......... .......... .......... .......... 25% 87.0M 1s 2024-09-12T00:39:38.672 INFO:teuthology.orchestra.run.smithi133.stderr: 23800K .......... .......... .......... .......... .......... 25% 315M 1s 2024-09-12T00:39:38.673 INFO:teuthology.orchestra.run.smithi133.stderr: 23850K .......... .......... .......... .......... .......... 25% 121M 1s 2024-09-12T00:39:38.673 INFO:teuthology.orchestra.run.smithi133.stderr: 23900K .......... .......... .......... .......... .......... 25% 308M 1s 2024-09-12T00:39:38.673 INFO:teuthology.orchestra.run.smithi133.stderr: 23950K .......... .......... .......... .......... .......... 25% 117M 1s 2024-09-12T00:39:38.673 INFO:teuthology.orchestra.run.smithi133.stderr: 24000K .......... .......... .......... .......... .......... 25% 409M 1s 2024-09-12T00:39:38.673 INFO:teuthology.orchestra.run.smithi133.stderr: 24050K .......... .......... .......... .......... .......... 25% 413M 1s 2024-09-12T00:39:38.673 INFO:teuthology.orchestra.run.smithi133.stderr: 24100K .......... .......... .......... .......... .......... 25% 376M 1s 2024-09-12T00:39:38.673 INFO:teuthology.orchestra.run.smithi133.stderr: 24150K .......... .......... .......... .......... .......... 26% 423M 1s 2024-09-12T00:39:38.673 INFO:teuthology.orchestra.run.smithi133.stderr: 24200K .......... .......... .......... .......... .......... 26% 432M 1s 2024-09-12T00:39:38.673 INFO:teuthology.orchestra.run.smithi133.stderr: 24250K .......... .......... .......... .......... .......... 26% 383M 1s 2024-09-12T00:39:38.673 INFO:teuthology.orchestra.run.smithi133.stderr: 24300K .......... .......... .......... .......... .......... 26% 200M 1s 2024-09-12T00:39:38.673 INFO:teuthology.orchestra.run.smithi133.stderr: 24350K .......... .......... .......... .......... .......... 26% 71.2M 1s 2024-09-12T00:39:38.673 INFO:teuthology.orchestra.run.smithi133.stderr: 24400K .......... .......... .......... .......... .......... 26% 241M 1s 2024-09-12T00:39:38.673 INFO:teuthology.orchestra.run.smithi133.stderr: 24450K .......... .......... .......... .......... .......... 26% 349M 1s 2024-09-12T00:39:38.674 INFO:teuthology.orchestra.run.smithi133.stderr: 24500K .......... .......... .......... .......... .......... 26% 76.7M 1s 2024-09-12T00:39:38.674 INFO:teuthology.orchestra.run.smithi133.stderr: 24550K .......... .......... .......... .......... .......... 26% 419M 1s 2024-09-12T00:39:38.674 INFO:teuthology.orchestra.run.smithi133.stderr: 24600K .......... .......... .......... .......... .......... 26% 286M 1s 2024-09-12T00:39:38.674 INFO:teuthology.orchestra.run.smithi133.stderr: 24650K .......... .......... .......... .......... .......... 26% 313M 1s 2024-09-12T00:39:38.674 INFO:teuthology.orchestra.run.smithi133.stderr: 24700K .......... .......... .......... .......... .......... 26% 104M 1s 2024-09-12T00:39:38.674 INFO:teuthology.orchestra.run.smithi133.stderr: 24750K .......... .......... .......... .......... .......... 26% 374M 1s 2024-09-12T00:39:38.674 INFO:teuthology.orchestra.run.smithi133.stderr: 24800K .......... .......... .......... .......... .......... 26% 367M 1s 2024-09-12T00:39:38.674 INFO:teuthology.orchestra.run.smithi133.stderr: 24850K .......... .......... .......... .......... .......... 26% 418M 1s 2024-09-12T00:39:38.674 INFO:teuthology.orchestra.run.smithi133.stderr: 24900K .......... .......... .......... .......... .......... 26% 118M 1s 2024-09-12T00:39:38.674 INFO:teuthology.orchestra.run.smithi133.stderr: 24950K .......... .......... .......... .......... .......... 26% 248M 1s 2024-09-12T00:39:38.674 INFO:teuthology.orchestra.run.smithi133.stderr: 25000K .......... .......... .......... .......... .......... 26% 412M 1s 2024-09-12T00:39:38.674 INFO:teuthology.orchestra.run.smithi133.stderr: 25050K .......... .......... .......... .......... .......... 27% 408M 1s 2024-09-12T00:39:38.674 INFO:teuthology.orchestra.run.smithi133.stderr: 25100K .......... .......... .......... .......... .......... 27% 30.4M 1s 2024-09-12T00:39:38.674 INFO:teuthology.orchestra.run.smithi133.stderr: 25150K .......... .......... .......... .......... .......... 27% 406M 1s 2024-09-12T00:39:38.675 INFO:teuthology.orchestra.run.smithi133.stderr: 25200K .......... .......... .......... .......... .......... 27% 249M 1s 2024-09-12T00:39:38.675 INFO:teuthology.orchestra.run.smithi133.stderr: 25250K .......... .......... .......... .......... .......... 27% 136M 1s 2024-09-12T00:39:38.675 INFO:teuthology.orchestra.run.smithi133.stderr: 25300K .......... .......... .......... .......... .......... 27% 286M 1s 2024-09-12T00:39:38.675 INFO:teuthology.orchestra.run.smithi133.stderr: 25350K .......... .......... .......... .......... .......... 27% 359M 1s 2024-09-12T00:39:38.675 INFO:teuthology.orchestra.run.smithi133.stderr: 25400K .......... .......... .......... .......... .......... 27% 452M 1s 2024-09-12T00:39:38.675 INFO:teuthology.orchestra.run.smithi133.stderr: 25450K .......... .......... .......... .......... .......... 27% 135M 1s 2024-09-12T00:39:38.675 INFO:teuthology.orchestra.run.smithi133.stderr: 25500K .......... .......... .......... .......... .......... 27% 272M 1s 2024-09-12T00:39:38.675 INFO:teuthology.orchestra.run.smithi133.stderr: 25550K .......... .......... .......... .......... .......... 27% 398M 1s 2024-09-12T00:39:38.675 INFO:teuthology.orchestra.run.smithi133.stderr: 25600K .......... .......... .......... .......... .......... 27% 119M 1s 2024-09-12T00:39:38.675 INFO:teuthology.orchestra.run.smithi133.stderr: 25650K .......... .......... .......... .......... .......... 27% 427M 1s 2024-09-12T00:39:38.675 INFO:teuthology.orchestra.run.smithi133.stderr: 25700K .......... .......... .......... .......... .......... 27% 398M 1s 2024-09-12T00:39:38.675 INFO:teuthology.orchestra.run.smithi133.stderr: 25750K .......... .......... .......... .......... .......... 27% 412M 1s 2024-09-12T00:39:38.675 INFO:teuthology.orchestra.run.smithi133.stderr: 25800K .......... .......... .......... .......... .......... 27% 309M 1s 2024-09-12T00:39:38.676 INFO:teuthology.orchestra.run.smithi133.stderr: 25850K .......... .......... .......... .......... .......... 27% 435M 1s 2024-09-12T00:39:38.676 INFO:teuthology.orchestra.run.smithi133.stderr: 25900K .......... .......... .......... .......... .......... 27% 66.3M 1s 2024-09-12T00:39:38.676 INFO:teuthology.orchestra.run.smithi133.stderr: 25950K .......... .......... .......... .......... .......... 27% 369M 1s 2024-09-12T00:39:38.676 INFO:teuthology.orchestra.run.smithi133.stderr: 26000K .......... .......... .......... .......... .......... 28% 395M 1s 2024-09-12T00:39:38.676 INFO:teuthology.orchestra.run.smithi133.stderr: 26050K .......... .......... .......... .......... .......... 28% 111M 1s 2024-09-12T00:39:38.676 INFO:teuthology.orchestra.run.smithi133.stderr: 26100K .......... .......... .......... .......... .......... 28% 196M 1s 2024-09-12T00:39:38.676 INFO:teuthology.orchestra.run.smithi133.stderr: 26150K .......... .......... .......... .......... .......... 28% 268M 1s 2024-09-12T00:39:38.676 INFO:teuthology.orchestra.run.smithi133.stderr: 26200K .......... .......... .......... .......... .......... 28% 392M 1s 2024-09-12T00:39:38.676 INFO:teuthology.orchestra.run.smithi133.stderr: 26250K .......... .......... .......... .......... .......... 28% 263M 1s 2024-09-12T00:39:38.676 INFO:teuthology.orchestra.run.smithi133.stderr: 26300K .......... .......... .......... .......... .......... 28% 313M 1s 2024-09-12T00:39:38.676 INFO:teuthology.orchestra.run.smithi133.stderr: 26350K .......... .......... .......... .......... .......... 28% 278M 1s 2024-09-12T00:39:38.676 INFO:teuthology.orchestra.run.smithi133.stderr: 26400K .......... .......... .......... .......... .......... 28% 264M 1s 2024-09-12T00:39:38.676 INFO:teuthology.orchestra.run.smithi133.stderr: 26450K .......... .......... .......... .......... .......... 28% 80.4M 1s 2024-09-12T00:39:38.676 INFO:teuthology.orchestra.run.smithi133.stderr: 26500K .......... .......... .......... .......... .......... 28% 323M 1s 2024-09-12T00:39:38.676 INFO:teuthology.orchestra.run.smithi133.stderr: 26550K .......... .......... .......... .......... .......... 28% 405M 1s 2024-09-12T00:39:38.677 INFO:teuthology.orchestra.run.smithi133.stderr: 26600K .......... .......... .......... .......... .......... 28% 432M 1s 2024-09-12T00:39:38.677 INFO:teuthology.orchestra.run.smithi133.stderr: 26650K .......... .......... .......... .......... .......... 28% 6.42M 1s 2024-09-12T00:39:38.677 INFO:teuthology.orchestra.run.smithi133.stderr: 26700K .......... .......... .......... .......... .......... 28% 288M 1s 2024-09-12T00:39:38.677 INFO:teuthology.orchestra.run.smithi133.stderr: 26750K .......... .......... .......... .......... .......... 28% 384M 1s 2024-09-12T00:39:38.677 INFO:teuthology.orchestra.run.smithi133.stderr: 26800K .......... .......... .......... .......... .......... 28% 89.9M 1s 2024-09-12T00:39:38.677 INFO:teuthology.orchestra.run.smithi133.stderr: 26850K .......... .......... .......... .......... .......... 28% 378M 1s 2024-09-12T00:39:38.677 INFO:teuthology.orchestra.run.smithi133.stderr: 26900K .......... .......... .......... .......... .......... 29% 336M 1s 2024-09-12T00:39:38.677 INFO:teuthology.orchestra.run.smithi133.stderr: 26950K .......... .......... .......... .......... .......... 29% 427M 1s 2024-09-12T00:39:38.677 INFO:teuthology.orchestra.run.smithi133.stderr: 27000K .......... .......... .......... .......... .......... 29% 414M 1s 2024-09-12T00:39:38.677 INFO:teuthology.orchestra.run.smithi133.stderr: 27050K .......... .......... .......... .......... .......... 29% 235M 1s 2024-09-12T00:39:38.677 INFO:teuthology.orchestra.run.smithi133.stderr: 27100K .......... .......... .......... .......... .......... 29% 301M 1s 2024-09-12T00:39:38.677 INFO:teuthology.orchestra.run.smithi133.stderr: 27150K .......... .......... .......... .......... .......... 29% 403M 1s 2024-09-12T00:39:38.677 INFO:teuthology.orchestra.run.smithi133.stderr: 27200K .......... .......... .......... .......... .......... 29% 425M 1s 2024-09-12T00:39:38.677 INFO:teuthology.orchestra.run.smithi133.stderr: 27250K .......... .......... .......... .......... .......... 29% 126M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 27300K .......... .......... .......... .......... .......... 29% 313M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 27350K .......... .......... .......... .......... .......... 29% 385M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 27400K .......... .......... .......... .......... .......... 29% 428M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 27450K .......... .......... .......... .......... .......... 29% 325M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 27500K .......... .......... .......... .......... .......... 29% 231M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 27550K .......... .......... .......... .......... .......... 29% 421M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 27600K .......... .......... .......... .......... .......... 29% 411M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 27650K .......... .......... .......... .......... .......... 29% 98.5M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 27700K .......... .......... .......... .......... .......... 29% 355M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 27750K .......... .......... .......... .......... .......... 29% 63.8M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 27800K .......... .......... .......... .......... .......... 29% 365M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 27850K .......... .......... .......... .......... .......... 30% 167M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 27900K .......... .......... .......... .......... .......... 30% 341M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 27950K .......... .......... .......... .......... .......... 30% 234M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 28000K .......... .......... .......... .......... .......... 30% 216M 1s 2024-09-12T00:39:38.678 INFO:teuthology.orchestra.run.smithi133.stderr: 28050K .......... .......... .......... .......... .......... 30% 313M 1s 2024-09-12T00:39:38.679 INFO:teuthology.orchestra.run.smithi133.stderr: 28100K .......... .......... .......... .......... .......... 30% 344M 1s 2024-09-12T00:39:38.679 INFO:teuthology.orchestra.run.smithi133.stderr: 28150K .......... .......... .......... .......... .......... 30% 394M 1s 2024-09-12T00:39:38.679 INFO:teuthology.orchestra.run.smithi133.stderr: 28200K .......... .......... .......... .......... .......... 30% 319M 1s 2024-09-12T00:39:38.679 INFO:teuthology.orchestra.run.smithi133.stderr: 28250K .......... .......... .......... .......... .......... 30% 415M 1s 2024-09-12T00:39:38.679 INFO:teuthology.orchestra.run.smithi133.stderr: 28300K .......... .......... .......... .......... .......... 30% 210M 1s 2024-09-12T00:39:38.679 INFO:teuthology.orchestra.run.smithi133.stderr: 28350K .......... .......... .......... .......... .......... 30% 422M 1s 2024-09-12T00:39:38.679 INFO:teuthology.orchestra.run.smithi133.stderr: 28400K .......... .......... .......... .......... .......... 30% 446M 1s 2024-09-12T00:39:38.679 INFO:teuthology.orchestra.run.smithi133.stderr: 28450K .......... .......... .......... .......... .......... 30% 41.0M 1s 2024-09-12T00:39:38.679 INFO:teuthology.orchestra.run.smithi133.stderr: 28500K .......... .......... .......... .......... .......... 30% 353M 1s 2024-09-12T00:39:38.679 INFO:teuthology.orchestra.run.smithi133.stderr: 28550K .......... .......... .......... .......... .......... 30% 158M 1s 2024-09-12T00:39:38.679 INFO:teuthology.orchestra.run.smithi133.stderr: 28600K .......... .......... .......... .......... .......... 30% 412M 1s 2024-09-12T00:39:38.679 INFO:teuthology.orchestra.run.smithi133.stderr: 28650K .......... .......... .......... .......... .......... 30% 387M 1s 2024-09-12T00:39:38.679 INFO:teuthology.orchestra.run.smithi133.stderr: 28700K .......... .......... .......... .......... .......... 30% 393M 1s 2024-09-12T00:39:38.679 INFO:teuthology.orchestra.run.smithi133.stderr: 28750K .......... .......... .......... .......... .......... 31% 39.5M 1s 2024-09-12T00:39:38.680 INFO:teuthology.orchestra.run.smithi133.stderr: 28800K .......... .......... .......... .......... .......... 31% 254M 1s 2024-09-12T00:39:38.680 INFO:teuthology.orchestra.run.smithi133.stderr: 28850K .......... .......... .......... .......... .......... 31% 367M 1s 2024-09-12T00:39:38.680 INFO:teuthology.orchestra.run.smithi133.stderr: 28900K .......... .......... .......... .......... .......... 31% 243M 1s 2024-09-12T00:39:38.680 INFO:teuthology.orchestra.run.smithi133.stderr: 28950K .......... .......... .......... .......... .......... 31% 76.5M 1s 2024-09-12T00:39:38.680 INFO:teuthology.orchestra.run.smithi133.stderr: 29000K .......... .......... .......... .......... .......... 31% 67.1M 1s 2024-09-12T00:39:38.680 INFO:teuthology.orchestra.run.smithi133.stderr: 29050K .......... .......... .......... .......... .......... 31% 250M 1s 2024-09-12T00:39:38.680 INFO:teuthology.orchestra.run.smithi133.stderr: 29100K .......... .......... .......... .......... .......... 31% 142M 1s 2024-09-12T00:39:38.680 INFO:teuthology.orchestra.run.smithi133.stderr: 29150K .......... .......... .......... .......... .......... 31% 115M 1s 2024-09-12T00:39:38.680 INFO:teuthology.orchestra.run.smithi133.stderr: 29200K .......... .......... .......... .......... .......... 31% 430M 1s 2024-09-12T00:39:38.680 INFO:teuthology.orchestra.run.smithi133.stderr: 29250K .......... .......... .......... .......... .......... 31% 89.2M 1s 2024-09-12T00:39:38.680 INFO:teuthology.orchestra.run.smithi133.stderr: 29300K .......... .......... .......... .......... .......... 31% 326M 1s 2024-09-12T00:39:38.680 INFO:teuthology.orchestra.run.smithi133.stderr: 29350K .......... .......... .......... .......... .......... 31% 303M 1s 2024-09-12T00:39:38.680 INFO:teuthology.orchestra.run.smithi133.stderr: 29400K .......... .......... .......... .......... .......... 31% 409M 1s 2024-09-12T00:39:38.681 INFO:teuthology.orchestra.run.smithi133.stderr: 29450K .......... .......... .......... .......... .......... 31% 13.2M 1s 2024-09-12T00:39:38.681 INFO:teuthology.orchestra.run.smithi133.stderr: 29500K .......... .......... .......... .......... .......... 31% 338M 1s 2024-09-12T00:39:38.681 INFO:teuthology.orchestra.run.smithi133.stderr: 29550K .......... .......... .......... .......... .......... 31% 98.0M 1s 2024-09-12T00:39:38.681 INFO:teuthology.orchestra.run.smithi133.stderr: 29600K .......... .......... .......... .......... .......... 31% 369M 1s 2024-09-12T00:39:38.681 INFO:teuthology.orchestra.run.smithi133.stderr: 29650K .......... .......... .......... .......... .......... 31% 41.2M 1s 2024-09-12T00:39:38.681 INFO:teuthology.orchestra.run.smithi133.stderr: 29700K .......... .......... .......... .......... .......... 32% 350M 1s 2024-09-12T00:39:38.681 INFO:teuthology.orchestra.run.smithi133.stderr: 29750K .......... .......... .......... .......... .......... 32% 413M 1s 2024-09-12T00:39:38.681 INFO:teuthology.orchestra.run.smithi133.stderr: 29800K .......... .......... .......... .......... .......... 32% 127M 1s 2024-09-12T00:39:38.681 INFO:teuthology.orchestra.run.smithi133.stderr: 29850K .......... .......... .......... .......... .......... 32% 199M 1s 2024-09-12T00:39:38.681 INFO:teuthology.orchestra.run.smithi133.stderr: 29900K .......... .......... .......... .......... .......... 32% 343M 1s 2024-09-12T00:39:38.681 INFO:teuthology.orchestra.run.smithi133.stderr: 29950K .......... .......... .......... .......... .......... 32% 85.1M 1s 2024-09-12T00:39:38.681 INFO:teuthology.orchestra.run.smithi133.stderr: 30000K .......... .......... .......... .......... .......... 32% 373M 1s 2024-09-12T00:39:38.681 INFO:teuthology.orchestra.run.smithi133.stderr: 30050K .......... .......... .......... .......... .......... 32% 207M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30100K .......... .......... .......... .......... .......... 32% 369M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30150K .......... .......... .......... .......... .......... 32% 363M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30200K .......... .......... .......... .......... .......... 32% 8.87M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30250K .......... .......... .......... .......... .......... 32% 102M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30300K .......... .......... .......... .......... .......... 32% 309M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30350K .......... .......... .......... .......... .......... 32% 424M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30400K .......... .......... .......... .......... .......... 32% 316M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30450K .......... .......... .......... .......... .......... 32% 389M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30500K .......... .......... .......... .......... .......... 32% 251M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30550K .......... .......... .......... .......... .......... 32% 296M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30600K .......... .......... .......... .......... .......... 32% 283M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30650K .......... .......... .......... .......... .......... 33% 344M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30700K .......... .......... .......... .......... .......... 33% 15.6M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30750K .......... .......... .......... .......... .......... 33% 413M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30800K .......... .......... .......... .......... .......... 33% 81.2M 1s 2024-09-12T00:39:38.682 INFO:teuthology.orchestra.run.smithi133.stderr: 30850K .......... .......... .......... .......... .......... 33% 264M 1s 2024-09-12T00:39:38.683 INFO:teuthology.orchestra.run.smithi133.stderr: 30900K .......... .......... .......... .......... .......... 33% 38.4M 1s 2024-09-12T00:39:38.683 INFO:teuthology.orchestra.run.smithi133.stderr: 30950K .......... .......... .......... .......... .......... 33% 305M 1s 2024-09-12T00:39:38.683 INFO:teuthology.orchestra.run.smithi133.stderr: 31000K .......... .......... .......... .......... .......... 33% 410M 1s 2024-09-12T00:39:38.683 INFO:teuthology.orchestra.run.smithi133.stderr: 31050K .......... .......... .......... .......... .......... 33% 94.0M 1s 2024-09-12T00:39:38.683 INFO:teuthology.orchestra.run.smithi133.stderr: 31100K .......... .......... .......... .......... .......... 33% 440M 1s 2024-09-12T00:39:38.683 INFO:teuthology.orchestra.run.smithi133.stderr: 31150K .......... .......... .......... .......... .......... 33% 326M 1s 2024-09-12T00:39:38.683 INFO:teuthology.orchestra.run.smithi133.stderr: 31200K .......... .......... .......... .......... .......... 33% 372M 1s 2024-09-12T00:39:38.683 INFO:teuthology.orchestra.run.smithi133.stderr: 31250K .......... .......... .......... .......... .......... 33% 415M 1s 2024-09-12T00:39:38.683 INFO:teuthology.orchestra.run.smithi133.stderr: 31300K .......... .......... .......... .......... .......... 33% 440M 1s 2024-09-12T00:39:38.683 INFO:teuthology.orchestra.run.smithi133.stderr: 31350K .......... .......... .......... .......... .......... 33% 380M 1s 2024-09-12T00:39:38.683 INFO:teuthology.orchestra.run.smithi133.stderr: 31400K .......... .......... .......... .......... .......... 33% 30.1M 1s 2024-09-12T00:39:38.683 INFO:teuthology.orchestra.run.smithi133.stderr: 31450K .......... .......... .......... .......... .......... 33% 86.6M 1s 2024-09-12T00:39:38.683 INFO:teuthology.orchestra.run.smithi133.stderr: 31500K .......... .......... .......... .......... .......... 33% 399M 1s 2024-09-12T00:39:38.683 INFO:teuthology.orchestra.run.smithi133.stderr: 31550K .......... .......... .......... .......... .......... 34% 72.0M 1s 2024-09-12T00:39:38.684 INFO:teuthology.orchestra.run.smithi133.stderr: 31600K .......... .......... .......... .......... .......... 34% 80.6M 1s 2024-09-12T00:39:38.684 INFO:teuthology.orchestra.run.smithi133.stderr: 31650K .......... .......... .......... .......... .......... 34% 312M 1s 2024-09-12T00:39:38.684 INFO:teuthology.orchestra.run.smithi133.stderr: 31700K .......... .......... .......... .......... .......... 34% 18.8M 1s 2024-09-12T00:39:38.684 INFO:teuthology.orchestra.run.smithi133.stderr: 31750K .......... .......... .......... .......... .......... 34% 331M 1s 2024-09-12T00:39:38.684 INFO:teuthology.orchestra.run.smithi133.stderr: 31800K .......... .......... .......... .......... .......... 34% 386M 1s 2024-09-12T00:39:38.684 INFO:teuthology.orchestra.run.smithi133.stderr: 31850K .......... .......... .......... .......... .......... 34% 101M 1s 2024-09-12T00:39:38.684 INFO:teuthology.orchestra.run.smithi133.stderr: 31900K .......... .......... .......... .......... .......... 34% 414M 1s 2024-09-12T00:39:38.684 INFO:teuthology.orchestra.run.smithi133.stderr: 31950K .......... .......... .......... .......... .......... 34% 325M 1s 2024-09-12T00:39:38.684 INFO:teuthology.orchestra.run.smithi133.stderr: 32000K .......... .......... .......... .......... .......... 34% 259M 1s 2024-09-12T00:39:38.684 INFO:teuthology.orchestra.run.smithi133.stderr: 32050K .......... .......... .......... .......... .......... 34% 253M 1s 2024-09-12T00:39:38.684 INFO:teuthology.orchestra.run.smithi133.stderr: 32100K .......... .......... .......... .......... .......... 34% 423M 1s 2024-09-12T00:39:38.684 INFO:teuthology.orchestra.run.smithi133.stderr: 32150K .......... .......... .......... .......... .......... 34% 326M 1s 2024-09-12T00:39:38.684 INFO:teuthology.orchestra.run.smithi133.stderr: 32200K .......... .......... .......... .......... .......... 34% 424M 1s 2024-09-12T00:39:38.684 INFO:teuthology.orchestra.run.smithi133.stderr: 32250K .......... .......... .......... .......... .......... 34% 240M 1s 2024-09-12T00:39:38.685 INFO:teuthology.orchestra.run.smithi133.stderr: 32300K .......... .......... .......... .......... .......... 34% 409M 1s 2024-09-12T00:39:38.685 INFO:teuthology.orchestra.run.smithi133.stderr: 32350K .......... .......... .......... .......... .......... 34% 329M 1s 2024-09-12T00:39:38.685 INFO:teuthology.orchestra.run.smithi133.stderr: 32400K .......... .......... .......... .......... .......... 34% 118M 1s 2024-09-12T00:39:38.685 INFO:teuthology.orchestra.run.smithi133.stderr: 32450K .......... .......... .......... .......... .......... 34% 407M 1s 2024-09-12T00:39:38.685 INFO:teuthology.orchestra.run.smithi133.stderr: 32500K .......... .......... .......... .......... .......... 35% 434M 1s 2024-09-12T00:39:38.685 INFO:teuthology.orchestra.run.smithi133.stderr: 32550K .......... .......... .......... .......... .......... 35% 299M 1s 2024-09-12T00:39:38.685 INFO:teuthology.orchestra.run.smithi133.stderr: 32600K .......... .......... .......... .......... .......... 35% 159M 1s 2024-09-12T00:39:38.685 INFO:teuthology.orchestra.run.smithi133.stderr: 32650K .......... .......... .......... .......... .......... 35% 323M 1s 2024-09-12T00:39:38.685 INFO:teuthology.orchestra.run.smithi133.stderr: 32700K .......... .......... .......... .......... .......... 35% 255M 1s 2024-09-12T00:39:38.685 INFO:teuthology.orchestra.run.smithi133.stderr: 32750K .......... .......... .......... .......... .......... 35% 116M 1s 2024-09-12T00:39:38.685 INFO:teuthology.orchestra.run.smithi133.stderr: 32800K .......... .......... .......... .......... .......... 35% 35.4M 1s 2024-09-12T00:39:38.685 INFO:teuthology.orchestra.run.smithi133.stderr: 32850K .......... .......... .......... .......... .......... 35% 409M 1s 2024-09-12T00:39:38.685 INFO:teuthology.orchestra.run.smithi133.stderr: 32900K .......... .......... .......... .......... .......... 35% 424M 1s 2024-09-12T00:39:38.685 INFO:teuthology.orchestra.run.smithi133.stderr: 32950K .......... .......... .......... .......... .......... 35% 353M 1s 2024-09-12T00:39:38.685 INFO:teuthology.orchestra.run.smithi133.stderr: 33000K .......... .......... .......... .......... .......... 35% 431M 1s 2024-09-12T00:39:38.686 INFO:teuthology.orchestra.run.smithi133.stderr: 33050K .......... .......... .......... .......... .......... 35% 410M 1s 2024-09-12T00:39:38.686 INFO:teuthology.orchestra.run.smithi133.stderr: 33100K .......... .......... .......... .......... .......... 35% 401M 1s 2024-09-12T00:39:38.686 INFO:teuthology.orchestra.run.smithi133.stderr: 33150K .......... .......... .......... .......... .......... 35% 409M 1s 2024-09-12T00:39:38.686 INFO:teuthology.orchestra.run.smithi133.stderr: 33200K .......... .......... .......... .......... .......... 35% 107M 1s 2024-09-12T00:39:38.686 INFO:teuthology.orchestra.run.smithi133.stderr: 33250K .......... .......... .......... .......... .......... 35% 239M 1s 2024-09-12T00:39:38.686 INFO:teuthology.orchestra.run.smithi133.stderr: 33300K .......... .......... .......... .......... .......... 35% 400M 1s 2024-09-12T00:39:38.686 INFO:teuthology.orchestra.run.smithi133.stderr: 33350K .......... .......... .......... .......... .......... 35% 328M 1s 2024-09-12T00:39:38.686 INFO:teuthology.orchestra.run.smithi133.stderr: 33400K .......... .......... .......... .......... .......... 36% 436M 1s 2024-09-12T00:39:38.686 INFO:teuthology.orchestra.run.smithi133.stderr: 33450K .......... .......... .......... .......... .......... 36% 390M 1s 2024-09-12T00:39:38.686 INFO:teuthology.orchestra.run.smithi133.stderr: 33500K .......... .......... .......... .......... .......... 36% 451M 1s 2024-09-12T00:39:38.686 INFO:teuthology.orchestra.run.smithi133.stderr: 33550K .......... .......... .......... .......... .......... 36% 406M 1s 2024-09-12T00:39:38.686 INFO:teuthology.orchestra.run.smithi133.stderr: 33600K .......... .......... .......... .......... .......... 36% 140M 1s 2024-09-12T00:39:38.686 INFO:teuthology.orchestra.run.smithi133.stderr: 33650K .......... .......... .......... .......... .......... 36% 321M 1s 2024-09-12T00:39:38.686 INFO:teuthology.orchestra.run.smithi133.stderr: 33700K .......... .......... .......... .......... .......... 36% 388M 1s 2024-09-12T00:39:38.687 INFO:teuthology.orchestra.run.smithi133.stderr: 33750K .......... .......... .......... .......... .......... 36% 65.8M 1s 2024-09-12T00:39:38.687 INFO:teuthology.orchestra.run.smithi133.stderr: 33800K .......... .......... .......... .......... .......... 36% 339M 1s 2024-09-12T00:39:38.687 INFO:teuthology.orchestra.run.smithi133.stderr: 33850K .......... .......... .......... .......... .......... 36% 398M 1s 2024-09-12T00:39:38.687 INFO:teuthology.orchestra.run.smithi133.stderr: 33900K .......... .......... .......... .......... .......... 36% 414M 1s 2024-09-12T00:39:38.687 INFO:teuthology.orchestra.run.smithi133.stderr: 33950K .......... .......... .......... .......... .......... 36% 381M 1s 2024-09-12T00:39:38.687 INFO:teuthology.orchestra.run.smithi133.stderr: 34000K .......... .......... .......... .......... .......... 36% 426M 1s 2024-09-12T00:39:38.687 INFO:teuthology.orchestra.run.smithi133.stderr: 34050K .......... .......... .......... .......... .......... 36% 436M 1s 2024-09-12T00:39:38.687 INFO:teuthology.orchestra.run.smithi133.stderr: 34100K .......... .......... .......... .......... .......... 36% 404M 1s 2024-09-12T00:39:38.687 INFO:teuthology.orchestra.run.smithi133.stderr: 34150K .......... .......... .......... .......... .......... 36% 398M 1s 2024-09-12T00:39:38.687 INFO:teuthology.orchestra.run.smithi133.stderr: 34200K .......... .......... .......... .......... .......... 36% 428M 1s 2024-09-12T00:39:38.687 INFO:teuthology.orchestra.run.smithi133.stderr: 34250K .......... .......... .......... .......... .......... 36% 456M 1s 2024-09-12T00:39:38.687 INFO:teuthology.orchestra.run.smithi133.stderr: 34300K .......... .......... .......... .......... .......... 36% 33.5M 1s 2024-09-12T00:39:38.687 INFO:teuthology.orchestra.run.smithi133.stderr: 34350K .......... .......... .......... .......... .......... 37% 331M 1s 2024-09-12T00:39:38.687 INFO:teuthology.orchestra.run.smithi133.stderr: 34400K .......... .......... .......... .......... .......... 37% 24.0M 1s 2024-09-12T00:39:38.688 INFO:teuthology.orchestra.run.smithi133.stderr: 34450K .......... .......... .......... .......... .......... 37% 323M 1s 2024-09-12T00:39:38.688 INFO:teuthology.orchestra.run.smithi133.stderr: 34500K .......... .......... .......... .......... .......... 37% 420M 1s 2024-09-12T00:39:38.688 INFO:teuthology.orchestra.run.smithi133.stderr: 34550K .......... .......... .......... .......... .......... 37% 261M 1s 2024-09-12T00:39:38.688 INFO:teuthology.orchestra.run.smithi133.stderr: 34600K .......... .......... .......... .......... .......... 37% 281M 1s 2024-09-12T00:39:38.688 INFO:teuthology.orchestra.run.smithi133.stderr: 34650K .......... .......... .......... .......... .......... 37% 428M 1s 2024-09-12T00:39:38.688 INFO:teuthology.orchestra.run.smithi133.stderr: 34700K .......... .......... .......... .......... .......... 37% 423M 1s 2024-09-12T00:39:38.688 INFO:teuthology.orchestra.run.smithi133.stderr: 34750K .......... .......... .......... .......... .......... 37% 195M 1s 2024-09-12T00:39:38.688 INFO:teuthology.orchestra.run.smithi133.stderr: 34800K .......... .......... .......... .......... .......... 37% 413M 1s 2024-09-12T00:39:38.688 INFO:teuthology.orchestra.run.smithi133.stderr: 34850K .......... .......... .......... .......... .......... 37% 116M 1s 2024-09-12T00:39:38.688 INFO:teuthology.orchestra.run.smithi133.stderr: 34900K .......... .......... .......... .......... .......... 37% 350M 1s 2024-09-12T00:39:38.688 INFO:teuthology.orchestra.run.smithi133.stderr: 34950K .......... .......... .......... .......... .......... 37% 363M 1s 2024-09-12T00:39:38.688 INFO:teuthology.orchestra.run.smithi133.stderr: 35000K .......... .......... .......... .......... .......... 37% 424M 1s 2024-09-12T00:39:38.688 INFO:teuthology.orchestra.run.smithi133.stderr: 35050K .......... .......... .......... .......... .......... 37% 108M 1s 2024-09-12T00:39:38.688 INFO:teuthology.orchestra.run.smithi133.stderr: 35100K .......... .......... .......... .......... .......... 37% 54.1M 1s 2024-09-12T00:39:38.688 INFO:teuthology.orchestra.run.smithi133.stderr: 35150K .......... .......... .......... .......... .......... 37% 331M 1s 2024-09-12T00:39:38.689 INFO:teuthology.orchestra.run.smithi133.stderr: 35200K .......... .......... .......... .......... .......... 37% 229M 1s 2024-09-12T00:39:38.689 INFO:teuthology.orchestra.run.smithi133.stderr: 35250K .......... .......... .......... .......... .......... 37% 93.0M 1s 2024-09-12T00:39:38.689 INFO:teuthology.orchestra.run.smithi133.stderr: 35300K .......... .......... .......... .......... .......... 38% 285M 1s 2024-09-12T00:39:38.689 INFO:teuthology.orchestra.run.smithi133.stderr: 35350K .......... .......... .......... .......... .......... 38% 62.4M 1s 2024-09-12T00:39:38.689 INFO:teuthology.orchestra.run.smithi133.stderr: 35400K .......... .......... .......... .......... .......... 38% 316M 1s 2024-09-12T00:39:38.689 INFO:teuthology.orchestra.run.smithi133.stderr: 35450K .......... .......... .......... .......... .......... 38% 337M 1s 2024-09-12T00:39:38.689 INFO:teuthology.orchestra.run.smithi133.stderr: 35500K .......... .......... .......... .......... .......... 38% 324M 1s 2024-09-12T00:39:38.689 INFO:teuthology.orchestra.run.smithi133.stderr: 35550K .......... .......... .......... .......... .......... 38% 256M 1s 2024-09-12T00:39:38.689 INFO:teuthology.orchestra.run.smithi133.stderr: 35600K .......... .......... .......... .......... .......... 38% 93.6M 1s 2024-09-12T00:39:38.689 INFO:teuthology.orchestra.run.smithi133.stderr: 35650K .......... .......... .......... .......... .......... 38% 176M 1s 2024-09-12T00:39:38.689 INFO:teuthology.orchestra.run.smithi133.stderr: 35700K .......... .......... .......... .......... .......... 38% 37.5M 1s 2024-09-12T00:39:38.689 INFO:teuthology.orchestra.run.smithi133.stderr: 35750K .......... .......... .......... .......... .......... 38% 237M 1s 2024-09-12T00:39:38.689 INFO:teuthology.orchestra.run.smithi133.stderr: 35800K .......... .......... .......... .......... .......... 38% 406M 1s 2024-09-12T00:39:38.689 INFO:teuthology.orchestra.run.smithi133.stderr: 35850K .......... .......... .......... .......... .......... 38% 369M 1s 2024-09-12T00:39:38.690 INFO:teuthology.orchestra.run.smithi133.stderr: 35900K .......... .......... .......... .......... .......... 38% 426M 1s 2024-09-12T00:39:38.690 INFO:teuthology.orchestra.run.smithi133.stderr: 35950K .......... .......... .......... .......... .......... 38% 315M 1s 2024-09-12T00:39:38.690 INFO:teuthology.orchestra.run.smithi133.stderr: 36000K .......... .......... .......... .......... .......... 38% 47.1M 1s 2024-09-12T00:39:38.690 INFO:teuthology.orchestra.run.smithi133.stderr: 36050K .......... .......... .......... .......... .......... 38% 343M 1s 2024-09-12T00:39:38.690 INFO:teuthology.orchestra.run.smithi133.stderr: 36100K .......... .......... .......... .......... .......... 38% 401M 1s 2024-09-12T00:39:38.690 INFO:teuthology.orchestra.run.smithi133.stderr: 36150K .......... .......... .......... .......... .......... 38% 86.1M 1s 2024-09-12T00:39:38.690 INFO:teuthology.orchestra.run.smithi133.stderr: 36200K .......... .......... .......... .......... .......... 39% 406M 1s 2024-09-12T00:39:38.690 INFO:teuthology.orchestra.run.smithi133.stderr: 36250K .......... .......... .......... .......... .......... 39% 333M 1s 2024-09-12T00:39:38.690 INFO:teuthology.orchestra.run.smithi133.stderr: 36300K .......... .......... .......... .......... .......... 39% 384M 1s 2024-09-12T00:39:38.690 INFO:teuthology.orchestra.run.smithi133.stderr: 36350K .......... .......... .......... .......... .......... 39% 340M 1s 2024-09-12T00:39:38.690 INFO:teuthology.orchestra.run.smithi133.stderr: 36400K .......... .......... .......... .......... .......... 39% 217M 1s 2024-09-12T00:39:38.690 INFO:teuthology.orchestra.run.smithi133.stderr: 36450K .......... .......... .......... .......... .......... 39% 39.7M 1s 2024-09-12T00:39:38.690 INFO:teuthology.orchestra.run.smithi133.stderr: 36500K .......... .......... .......... .......... .......... 39% 16.5M 1s 2024-09-12T00:39:38.691 INFO:teuthology.orchestra.run.smithi133.stderr: 36550K .......... .......... .......... .......... .......... 39% 309M 1s 2024-09-12T00:39:38.691 INFO:teuthology.orchestra.run.smithi133.stderr: 36600K .......... .......... .......... .......... .......... 39% 36.3M 1s 2024-09-12T00:39:38.691 INFO:teuthology.orchestra.run.smithi133.stderr: 36650K .......... .......... .......... .......... .......... 39% 32.3M 1s 2024-09-12T00:39:38.691 INFO:teuthology.orchestra.run.smithi133.stderr: 36700K .......... .......... .......... .......... .......... 39% 190M 1s 2024-09-12T00:39:38.691 INFO:teuthology.orchestra.run.smithi133.stderr: 36750K .......... .......... .......... .......... .......... 39% 46.7M 1s 2024-09-12T00:39:38.691 INFO:teuthology.orchestra.run.smithi133.stderr: 36800K .......... .......... .......... .......... .......... 39% 271M 1s 2024-09-12T00:39:38.691 INFO:teuthology.orchestra.run.smithi133.stderr: 36850K .......... .......... .......... .......... .......... 39% 395M 1s 2024-09-12T00:39:38.691 INFO:teuthology.orchestra.run.smithi133.stderr: 36900K .......... .......... .......... .......... .......... 39% 386M 1s 2024-09-12T00:39:38.691 INFO:teuthology.orchestra.run.smithi133.stderr: 36950K .......... .......... .......... .......... .......... 39% 72.2M 1s 2024-09-12T00:39:38.691 INFO:teuthology.orchestra.run.smithi133.stderr: 37000K .......... .......... .......... .......... .......... 39% 376M 1s 2024-09-12T00:39:38.691 INFO:teuthology.orchestra.run.smithi133.stderr: 37050K .......... .......... .......... .......... .......... 39% 407M 1s 2024-09-12T00:39:38.691 INFO:teuthology.orchestra.run.smithi133.stderr: 37100K .......... .......... .......... .......... .......... 39% 117M 1s 2024-09-12T00:39:38.691 INFO:teuthology.orchestra.run.smithi133.stderr: 37150K .......... .......... .......... .......... .......... 40% 262M 1s 2024-09-12T00:39:38.691 INFO:teuthology.orchestra.run.smithi133.stderr: 37200K .......... .......... .......... .......... .......... 40% 158M 1s 2024-09-12T00:39:38.692 INFO:teuthology.orchestra.run.smithi133.stderr: 37250K .......... .......... .......... .......... .......... 40% 318M 1s 2024-09-12T00:39:38.692 INFO:teuthology.orchestra.run.smithi133.stderr: 37300K .......... .......... .......... .......... .......... 40% 350M 1s 2024-09-12T00:39:38.692 INFO:teuthology.orchestra.run.smithi133.stderr: 37350K .......... .......... .......... .......... .......... 40% 391M 1s 2024-09-12T00:39:38.692 INFO:teuthology.orchestra.run.smithi133.stderr: 37400K .......... .......... .......... .......... .......... 40% 16.0M 1s 2024-09-12T00:39:38.692 INFO:teuthology.orchestra.run.smithi133.stderr: 37450K .......... .......... .......... .......... .......... 40% 148M 1s 2024-09-12T00:39:38.692 INFO:teuthology.orchestra.run.smithi133.stderr: 37500K .......... .......... .......... .......... .......... 40% 384M 1s 2024-09-12T00:39:38.692 INFO:teuthology.orchestra.run.smithi133.stderr: 37550K .......... .......... .......... .......... .......... 40% 354M 1s 2024-09-12T00:39:38.692 INFO:teuthology.orchestra.run.smithi133.stderr: 37600K .......... .......... .......... .......... .......... 40% 376M 1s 2024-09-12T00:39:38.692 INFO:teuthology.orchestra.run.smithi133.stderr: 37650K .......... .......... .......... .......... .......... 40% 451M 1s 2024-09-12T00:39:38.692 INFO:teuthology.orchestra.run.smithi133.stderr: 37700K .......... .......... .......... .......... .......... 40% 463M 1s 2024-09-12T00:39:38.692 INFO:teuthology.orchestra.run.smithi133.stderr: 37750K .......... .......... .......... .......... .......... 40% 387M 1s 2024-09-12T00:39:38.692 INFO:teuthology.orchestra.run.smithi133.stderr: 37800K .......... .......... .......... .......... .......... 40% 436M 1s 2024-09-12T00:39:38.692 INFO:teuthology.orchestra.run.smithi133.stderr: 37850K .......... .......... .......... .......... .......... 40% 39.8M 1s 2024-09-12T00:39:38.692 INFO:teuthology.orchestra.run.smithi133.stderr: 37900K .......... .......... .......... .......... .......... 40% 395M 1s 2024-09-12T00:39:38.693 INFO:teuthology.orchestra.run.smithi133.stderr: 37950K .......... .......... .......... .......... .......... 40% 299M 1s 2024-09-12T00:39:38.693 INFO:teuthology.orchestra.run.smithi133.stderr: 38000K .......... .......... .......... .......... .......... 40% 419M 1s 2024-09-12T00:39:38.693 INFO:teuthology.orchestra.run.smithi133.stderr: 38050K .......... .......... .......... .......... .......... 41% 428M 1s 2024-09-12T00:39:38.693 INFO:teuthology.orchestra.run.smithi133.stderr: 38100K .......... .......... .......... .......... .......... 41% 419M 1s 2024-09-12T00:39:38.693 INFO:teuthology.orchestra.run.smithi133.stderr: 38150K .......... .......... .......... .......... .......... 41% 388M 1s 2024-09-12T00:39:38.693 INFO:teuthology.orchestra.run.smithi133.stderr: 38200K .......... .......... .......... .......... .......... 41% 381M 1s 2024-09-12T00:39:38.693 INFO:teuthology.orchestra.run.smithi133.stderr: 38250K .......... .......... .......... .......... .......... 41% 312M 1s 2024-09-12T00:39:38.693 INFO:teuthology.orchestra.run.smithi133.stderr: 38300K .......... .......... .......... .......... .......... 41% 25.8M 1s 2024-09-12T00:39:38.693 INFO:teuthology.orchestra.run.smithi133.stderr: 38350K .......... .......... .......... .......... .......... 41% 279M 1s 2024-09-12T00:39:38.693 INFO:teuthology.orchestra.run.smithi133.stderr: 38400K .......... .......... .......... .......... .......... 41% 367M 1s 2024-09-12T00:39:38.693 INFO:teuthology.orchestra.run.smithi133.stderr: 38450K .......... .......... .......... .......... .......... 41% 418M 1s 2024-09-12T00:39:38.693 INFO:teuthology.orchestra.run.smithi133.stderr: 38500K .......... .......... .......... .......... .......... 41% 57.1M 1s 2024-09-12T00:39:38.693 INFO:teuthology.orchestra.run.smithi133.stderr: 38550K .......... .......... .......... .......... .......... 41% 284M 1s 2024-09-12T00:39:38.694 INFO:teuthology.orchestra.run.smithi133.stderr: 38600K .......... .......... .......... .......... .......... 41% 428M 1s 2024-09-12T00:39:38.694 INFO:teuthology.orchestra.run.smithi133.stderr: 38650K .......... .......... .......... .......... .......... 41% 87.8M 1s 2024-09-12T00:39:38.694 INFO:teuthology.orchestra.run.smithi133.stderr: 38700K .......... .......... .......... .......... .......... 41% 218M 1s 2024-09-12T00:39:38.694 INFO:teuthology.orchestra.run.smithi133.stderr: 38750K .......... .......... .......... .......... .......... 41% 394M 1s 2024-09-12T00:39:38.694 INFO:teuthology.orchestra.run.smithi133.stderr: 38800K .......... .......... .......... .......... .......... 41% 311M 1s 2024-09-12T00:39:38.694 INFO:teuthology.orchestra.run.smithi133.stderr: 38850K .......... .......... .......... .......... .......... 41% 249M 1s 2024-09-12T00:39:38.694 INFO:teuthology.orchestra.run.smithi133.stderr: 38900K .......... .......... .......... .......... .......... 41% 420M 1s 2024-09-12T00:39:38.694 INFO:teuthology.orchestra.run.smithi133.stderr: 38950K .......... .......... .......... .......... .......... 41% 439M 1s 2024-09-12T00:39:38.694 INFO:teuthology.orchestra.run.smithi133.stderr: 39000K .......... .......... .......... .......... .......... 42% 367M 1s 2024-09-12T00:39:38.694 INFO:teuthology.orchestra.run.smithi133.stderr: 39050K .......... .......... .......... .......... .......... 42% 356M 1s 2024-09-12T00:39:38.694 INFO:teuthology.orchestra.run.smithi133.stderr: 39100K .......... .......... .......... .......... .......... 42% 421M 1s 2024-09-12T00:39:38.694 INFO:teuthology.orchestra.run.smithi133.stderr: 39150K .......... .......... .......... .......... .......... 42% 396M 1s 2024-09-12T00:39:38.694 INFO:teuthology.orchestra.run.smithi133.stderr: 39200K .......... .......... .......... .......... .......... 42% 364M 1s 2024-09-12T00:39:38.694 INFO:teuthology.orchestra.run.smithi133.stderr: 39250K .......... .......... .......... .......... .......... 42% 280M 1s 2024-09-12T00:39:38.695 INFO:teuthology.orchestra.run.smithi133.stderr: 39300K .......... .......... .......... .......... .......... 42% 351M 1s 2024-09-12T00:39:38.695 INFO:teuthology.orchestra.run.smithi133.stderr: 39350K .......... .......... .......... .......... .......... 42% 357M 1s 2024-09-12T00:39:38.695 INFO:teuthology.orchestra.run.smithi133.stderr: 39400K .......... .......... .......... .......... .......... 42% 397M 1s 2024-09-12T00:39:38.695 INFO:teuthology.orchestra.run.smithi133.stderr: 39450K .......... .......... .......... .......... .......... 42% 442M 1s 2024-09-12T00:39:38.695 INFO:teuthology.orchestra.run.smithi133.stderr: 39500K .......... .......... .......... .......... .......... 42% 443M 1s 2024-09-12T00:39:38.695 INFO:teuthology.orchestra.run.smithi133.stderr: 39550K .......... .......... .......... .......... .......... 42% 344M 1s 2024-09-12T00:39:38.695 INFO:teuthology.orchestra.run.smithi133.stderr: 39600K .......... .......... .......... .......... .......... 42% 337M 1s 2024-09-12T00:39:38.695 INFO:teuthology.orchestra.run.smithi133.stderr: 39650K .......... .......... .......... .......... .......... 42% 264M 1s 2024-09-12T00:39:38.695 INFO:teuthology.orchestra.run.smithi133.stderr: 39700K .......... .......... .......... .......... .......... 42% 414M 1s 2024-09-12T00:39:38.695 INFO:teuthology.orchestra.run.smithi133.stderr: 39750K .......... .......... .......... .......... .......... 42% 403M 1s 2024-09-12T00:39:38.695 INFO:teuthology.orchestra.run.smithi133.stderr: 39800K .......... .......... .......... .......... .......... 42% 447M 1s 2024-09-12T00:39:38.695 INFO:teuthology.orchestra.run.smithi133.stderr: 39850K .......... .......... .......... .......... .......... 42% 403M 1s 2024-09-12T00:39:38.695 INFO:teuthology.orchestra.run.smithi133.stderr: 39900K .......... .......... .......... .......... .......... 43% 428M 1s 2024-09-12T00:39:38.695 INFO:teuthology.orchestra.run.smithi133.stderr: 39950K .......... .......... .......... .......... .......... 43% 368M 1s 2024-09-12T00:39:38.696 INFO:teuthology.orchestra.run.smithi133.stderr: 40000K .......... .......... .......... .......... .......... 43% 69.9M 1s 2024-09-12T00:39:38.696 INFO:teuthology.orchestra.run.smithi133.stderr: 40050K .......... .......... .......... .......... .......... 43% 330M 1s 2024-09-12T00:39:38.696 INFO:teuthology.orchestra.run.smithi133.stderr: 40100K .......... .......... .......... .......... .......... 43% 427M 1s 2024-09-12T00:39:38.696 INFO:teuthology.orchestra.run.smithi133.stderr: 40150K .......... .......... .......... .......... .......... 43% 386M 1s 2024-09-12T00:39:38.696 INFO:teuthology.orchestra.run.smithi133.stderr: 40200K .......... .......... .......... .......... .......... 43% 443M 1s 2024-09-12T00:39:38.696 INFO:teuthology.orchestra.run.smithi133.stderr: 40250K .......... .......... .......... .......... .......... 43% 9.70M 1s 2024-09-12T00:39:38.696 INFO:teuthology.orchestra.run.smithi133.stderr: 40300K .......... .......... .......... .......... .......... 43% 30.2M 1s 2024-09-12T00:39:38.696 INFO:teuthology.orchestra.run.smithi133.stderr: 40350K .......... .......... .......... .......... .......... 43% 60.4M 1s 2024-09-12T00:39:38.696 INFO:teuthology.orchestra.run.smithi133.stderr: 40400K .......... .......... .......... .......... .......... 43% 271M 1s 2024-09-12T00:39:38.696 INFO:teuthology.orchestra.run.smithi133.stderr: 40450K .......... .......... .......... .......... .......... 43% 337M 1s 2024-09-12T00:39:38.696 INFO:teuthology.orchestra.run.smithi133.stderr: 40500K .......... .......... .......... .......... .......... 43% 394M 1s 2024-09-12T00:39:38.696 INFO:teuthology.orchestra.run.smithi133.stderr: 40550K .......... .......... .......... .......... .......... 43% 385M 1s 2024-09-12T00:39:38.696 INFO:teuthology.orchestra.run.smithi133.stderr: 40600K .......... .......... .......... .......... .......... 43% 422M 1s 2024-09-12T00:39:38.696 INFO:teuthology.orchestra.run.smithi133.stderr: 40650K .......... .......... .......... .......... .......... 43% 428M 1s 2024-09-12T00:39:38.697 INFO:teuthology.orchestra.run.smithi133.stderr: 40700K .......... .......... .......... .......... .......... 43% 417M 1s 2024-09-12T00:39:38.697 INFO:teuthology.orchestra.run.smithi133.stderr: 40750K .......... .......... .......... .......... .......... 43% 339M 1s 2024-09-12T00:39:38.697 INFO:teuthology.orchestra.run.smithi133.stderr: 40800K .......... .......... .......... .......... .......... 43% 442M 1s 2024-09-12T00:39:38.697 INFO:teuthology.orchestra.run.smithi133.stderr: 40850K .......... .......... .......... .......... .......... 44% 422M 1s 2024-09-12T00:39:38.697 INFO:teuthology.orchestra.run.smithi133.stderr: 40900K .......... .......... .......... .......... .......... 44% 412M 1s 2024-09-12T00:39:38.697 INFO:teuthology.orchestra.run.smithi133.stderr: 40950K .......... .......... .......... .......... .......... 44% 24.1M 1s 2024-09-12T00:39:38.697 INFO:teuthology.orchestra.run.smithi133.stderr: 41000K .......... .......... .......... .......... .......... 44% 372M 1s 2024-09-12T00:39:38.697 INFO:teuthology.orchestra.run.smithi133.stderr: 41050K .......... .......... .......... .......... .......... 44% 322M 1s 2024-09-12T00:39:38.697 INFO:teuthology.orchestra.run.smithi133.stderr: 41100K .......... .......... .......... .......... .......... 44% 269M 1s 2024-09-12T00:39:38.697 INFO:teuthology.orchestra.run.smithi133.stderr: 41150K .......... .......... .......... .......... .......... 44% 318M 1s 2024-09-12T00:39:38.697 INFO:teuthology.orchestra.run.smithi133.stderr: 41200K .......... .......... .......... .......... .......... 44% 400M 1s 2024-09-12T00:39:38.697 INFO:teuthology.orchestra.run.smithi133.stderr: 41250K .......... .......... .......... .......... .......... 44% 426M 1s 2024-09-12T00:39:38.698 INFO:teuthology.orchestra.run.smithi133.stderr: 41300K .......... .......... .......... .......... .......... 44% 367M 1s 2024-09-12T00:39:38.698 INFO:teuthology.orchestra.run.smithi133.stderr: 41350K .......... .......... .......... .......... .......... 44% 421M 1s 2024-09-12T00:39:38.698 INFO:teuthology.orchestra.run.smithi133.stderr: 41400K .......... .......... .......... .......... .......... 44% 358M 1s 2024-09-12T00:39:38.698 INFO:teuthology.orchestra.run.smithi133.stderr: 41450K .......... .......... .......... .......... .......... 44% 388M 1s 2024-09-12T00:39:38.698 INFO:teuthology.orchestra.run.smithi133.stderr: 41500K .......... .......... .......... .......... .......... 44% 334M 1s 2024-09-12T00:39:38.698 INFO:teuthology.orchestra.run.smithi133.stderr: 41550K .......... .......... .......... .......... .......... 44% 335M 1s 2024-09-12T00:39:38.698 INFO:teuthology.orchestra.run.smithi133.stderr: 41600K .......... .......... .......... .......... .......... 44% 394M 1s 2024-09-12T00:39:38.698 INFO:teuthology.orchestra.run.smithi133.stderr: 41650K .......... .......... .......... .......... .......... 44% 203M 1s 2024-09-12T00:39:38.698 INFO:teuthology.orchestra.run.smithi133.stderr: 41700K .......... .......... .......... .......... .......... 44% 286M 1s 2024-09-12T00:39:38.698 INFO:teuthology.orchestra.run.smithi133.stderr: 41750K .......... .......... .......... .......... .......... 44% 422M 1s 2024-09-12T00:39:38.698 INFO:teuthology.orchestra.run.smithi133.stderr: 41800K .......... .......... .......... .......... .......... 45% 419M 1s 2024-09-12T00:39:38.698 INFO:teuthology.orchestra.run.smithi133.stderr: 41850K .......... .......... .......... .......... .......... 45% 425M 1s 2024-09-12T00:39:38.698 INFO:teuthology.orchestra.run.smithi133.stderr: 41900K .......... .......... .......... .......... .......... 45% 348M 1s 2024-09-12T00:39:38.698 INFO:teuthology.orchestra.run.smithi133.stderr: 41950K .......... .......... .......... .......... .......... 45% 418M 1s 2024-09-12T00:39:38.698 INFO:teuthology.orchestra.run.smithi133.stderr: 42000K .......... .......... .......... .......... .......... 45% 401M 1s 2024-09-12T00:39:38.699 INFO:teuthology.orchestra.run.smithi133.stderr: 42050K .......... .......... .......... .......... .......... 45% 450M 1s 2024-09-12T00:39:38.699 INFO:teuthology.orchestra.run.smithi133.stderr: 42100K .......... .......... .......... .......... .......... 45% 156M 1s 2024-09-12T00:39:38.699 INFO:teuthology.orchestra.run.smithi133.stderr: 42150K .......... .......... .......... .......... .......... 45% 349M 1s 2024-09-12T00:39:38.699 INFO:teuthology.orchestra.run.smithi133.stderr: 42200K .......... .......... .......... .......... .......... 45% 374M 1s 2024-09-12T00:39:38.699 INFO:teuthology.orchestra.run.smithi133.stderr: 42250K .......... .......... .......... .......... .......... 45% 379M 1s 2024-09-12T00:39:38.699 INFO:teuthology.orchestra.run.smithi133.stderr: 42300K .......... .......... .......... .......... .......... 45% 115M 1s 2024-09-12T00:39:38.699 INFO:teuthology.orchestra.run.smithi133.stderr: 42350K .......... .......... .......... .......... .......... 45% 84.5M 1s 2024-09-12T00:39:38.699 INFO:teuthology.orchestra.run.smithi133.stderr: 42400K .......... .......... .......... .......... .......... 45% 402M 1s 2024-09-12T00:39:38.699 INFO:teuthology.orchestra.run.smithi133.stderr: 42450K .......... .......... .......... .......... .......... 45% 323M 1s 2024-09-12T00:39:38.699 INFO:teuthology.orchestra.run.smithi133.stderr: 42500K .......... .......... .......... .......... .......... 45% 362M 1s 2024-09-12T00:39:38.699 INFO:teuthology.orchestra.run.smithi133.stderr: 42550K .......... .......... .......... .......... .......... 45% 432M 1s 2024-09-12T00:39:38.699 INFO:teuthology.orchestra.run.smithi133.stderr: 42600K .......... .......... .......... .......... .......... 45% 423M 1s 2024-09-12T00:39:38.699 INFO:teuthology.orchestra.run.smithi133.stderr: 42650K .......... .......... .......... .......... .......... 45% 271M 1s 2024-09-12T00:39:38.699 INFO:teuthology.orchestra.run.smithi133.stderr: 42700K .......... .......... .......... .......... .......... 46% 228M 1s 2024-09-12T00:39:38.700 INFO:teuthology.orchestra.run.smithi133.stderr: 42750K .......... .......... .......... .......... .......... 46% 405M 1s 2024-09-12T00:39:38.700 INFO:teuthology.orchestra.run.smithi133.stderr: 42800K .......... .......... .......... .......... .......... 46% 408M 1s 2024-09-12T00:39:38.700 INFO:teuthology.orchestra.run.smithi133.stderr: 42850K .......... .......... .......... .......... .......... 46% 176M 1s 2024-09-12T00:39:38.700 INFO:teuthology.orchestra.run.smithi133.stderr: 42900K .......... .......... .......... .......... .......... 46% 357M 1s 2024-09-12T00:39:38.700 INFO:teuthology.orchestra.run.smithi133.stderr: 42950K .......... .......... .......... .......... .......... 46% 288M 1s 2024-09-12T00:39:38.700 INFO:teuthology.orchestra.run.smithi133.stderr: 43000K .......... .......... .......... .......... .......... 46% 317M 1s 2024-09-12T00:39:38.700 INFO:teuthology.orchestra.run.smithi133.stderr: 43050K .......... .......... .......... .......... .......... 46% 324M 1s 2024-09-12T00:39:38.700 INFO:teuthology.orchestra.run.smithi133.stderr: 43100K .......... .......... .......... .......... .......... 46% 241M 1s 2024-09-12T00:39:38.700 INFO:teuthology.orchestra.run.smithi133.stderr: 43150K .......... .......... .......... .......... .......... 46% 76.8M 1s 2024-09-12T00:39:38.700 INFO:teuthology.orchestra.run.smithi133.stderr: 43200K .......... .......... .......... .......... .......... 46% 142M 1s 2024-09-12T00:39:38.700 INFO:teuthology.orchestra.run.smithi133.stderr: 43250K .......... .......... .......... .......... .......... 46% 25.1M 1s 2024-09-12T00:39:38.700 INFO:teuthology.orchestra.run.smithi133.stderr: 43300K .......... .......... .......... .......... .......... 46% 362M 1s 2024-09-12T00:39:38.700 INFO:teuthology.orchestra.run.smithi133.stderr: 43350K .......... .......... .......... .......... .......... 46% 413M 1s 2024-09-12T00:39:38.700 INFO:teuthology.orchestra.run.smithi133.stderr: 43400K .......... .......... .......... .......... .......... 46% 427M 1s 2024-09-12T00:39:38.701 INFO:teuthology.orchestra.run.smithi133.stderr: 43450K .......... .......... .......... .......... .......... 46% 404M 1s 2024-09-12T00:39:38.701 INFO:teuthology.orchestra.run.smithi133.stderr: 43500K .......... .......... .......... .......... .......... 46% 333M 1s 2024-09-12T00:39:38.701 INFO:teuthology.orchestra.run.smithi133.stderr: 43550K .......... .......... .......... .......... .......... 46% 413M 1s 2024-09-12T00:39:38.701 INFO:teuthology.orchestra.run.smithi133.stderr: 43600K .......... .......... .......... .......... .......... 46% 16.9M 1s 2024-09-12T00:39:38.701 INFO:teuthology.orchestra.run.smithi133.stderr: 43650K .......... .......... .......... .......... .......... 47% 402M 1s 2024-09-12T00:39:38.701 INFO:teuthology.orchestra.run.smithi133.stderr: 43700K .......... .......... .......... .......... .......... 47% 355M 1s 2024-09-12T00:39:38.701 INFO:teuthology.orchestra.run.smithi133.stderr: 43750K .......... .......... .......... .......... .......... 47% 380M 1s 2024-09-12T00:39:38.701 INFO:teuthology.orchestra.run.smithi133.stderr: 43800K .......... .......... .......... .......... .......... 47% 398M 1s 2024-09-12T00:39:38.701 INFO:teuthology.orchestra.run.smithi133.stderr: 43850K .......... .......... .......... .......... .......... 47% 316M 1s 2024-09-12T00:39:38.701 INFO:teuthology.orchestra.run.smithi133.stderr: 43900K .......... .......... .......... .......... .......... 47% 357M 1s 2024-09-12T00:39:38.701 INFO:teuthology.orchestra.run.smithi133.stderr: 43950K .......... .......... .......... .......... .......... 47% 8.77M 1s 2024-09-12T00:39:38.701 INFO:teuthology.orchestra.run.smithi133.stderr: 44000K .......... .......... .......... .......... .......... 47% 264M 1s 2024-09-12T00:39:38.701 INFO:teuthology.orchestra.run.smithi133.stderr: 44050K .......... .......... .......... .......... .......... 47% 420M 1s 2024-09-12T00:39:38.701 INFO:teuthology.orchestra.run.smithi133.stderr: 44100K .......... .......... .......... .......... .......... 47% 254M 1s 2024-09-12T00:39:38.702 INFO:teuthology.orchestra.run.smithi133.stderr: 44150K .......... .......... .......... .......... .......... 47% 178M 1s 2024-09-12T00:39:38.702 INFO:teuthology.orchestra.run.smithi133.stderr: 44200K .......... .......... .......... .......... .......... 47% 431M 1s 2024-09-12T00:39:38.702 INFO:teuthology.orchestra.run.smithi133.stderr: 44250K .......... .......... .......... .......... .......... 47% 347M 1s 2024-09-12T00:39:38.702 INFO:teuthology.orchestra.run.smithi133.stderr: 44300K .......... .......... .......... .......... .......... 47% 358M 1s 2024-09-12T00:39:38.702 INFO:teuthology.orchestra.run.smithi133.stderr: 44350K .......... .......... .......... .......... .......... 47% 438M 1s 2024-09-12T00:39:38.702 INFO:teuthology.orchestra.run.smithi133.stderr: 44400K .......... .......... .......... .......... .......... 47% 430M 1s 2024-09-12T00:39:38.702 INFO:teuthology.orchestra.run.smithi133.stderr: 44450K .......... .......... .......... .......... .......... 47% 220M 1s 2024-09-12T00:39:38.702 INFO:teuthology.orchestra.run.smithi133.stderr: 44500K .......... .......... .......... .......... .......... 47% 385M 1s 2024-09-12T00:39:38.702 INFO:teuthology.orchestra.run.smithi133.stderr: 44550K .......... .......... .......... .......... .......... 48% 436M 1s 2024-09-12T00:39:38.702 INFO:teuthology.orchestra.run.smithi133.stderr: 44600K .......... .......... .......... .......... .......... 48% 430M 1s 2024-09-12T00:39:38.702 INFO:teuthology.orchestra.run.smithi133.stderr: 44650K .......... .......... .......... .......... .......... 48% 459M 1s 2024-09-12T00:39:38.702 INFO:teuthology.orchestra.run.smithi133.stderr: 44700K .......... .......... .......... .......... .......... 48% 69.3M 1s 2024-09-12T00:39:38.702 INFO:teuthology.orchestra.run.smithi133.stderr: 44750K .......... .......... .......... .......... .......... 48% 415M 1s 2024-09-12T00:39:38.702 INFO:teuthology.orchestra.run.smithi133.stderr: 44800K .......... .......... .......... .......... .......... 48% 325M 1s 2024-09-12T00:39:38.703 INFO:teuthology.orchestra.run.smithi133.stderr: 44850K .......... .......... .......... .......... .......... 48% 433M 0s 2024-09-12T00:39:38.703 INFO:teuthology.orchestra.run.smithi133.stderr: 44900K .......... .......... .......... .......... .......... 48% 392M 0s 2024-09-12T00:39:38.703 INFO:teuthology.orchestra.run.smithi133.stderr: 44950K .......... .......... .......... .......... .......... 48% 139M 0s 2024-09-12T00:39:38.703 INFO:teuthology.orchestra.run.smithi133.stderr: 45000K .......... .......... .......... .......... .......... 48% 219M 0s 2024-09-12T00:39:38.703 INFO:teuthology.orchestra.run.smithi133.stderr: 45050K .......... .......... .......... .......... .......... 48% 392M 0s 2024-09-12T00:39:38.703 INFO:teuthology.orchestra.run.smithi133.stderr: 45100K .......... .......... .......... .......... .......... 48% 228M 0s 2024-09-12T00:39:38.703 INFO:teuthology.orchestra.run.smithi133.stderr: 45150K .......... .......... .......... .......... .......... 48% 297M 0s 2024-09-12T00:39:38.703 INFO:teuthology.orchestra.run.smithi133.stderr: 45200K .......... .......... .......... .......... .......... 48% 434M 0s 2024-09-12T00:39:38.703 INFO:teuthology.orchestra.run.smithi133.stderr: 45250K .......... .......... .......... .......... .......... 48% 413M 0s 2024-09-12T00:39:38.703 INFO:teuthology.orchestra.run.smithi133.stderr: 45300K .......... .......... .......... .......... .......... 48% 370M 0s 2024-09-12T00:39:38.703 INFO:teuthology.orchestra.run.smithi133.stderr: 45350K .......... .......... .......... .......... .......... 48% 410M 0s 2024-09-12T00:39:38.703 INFO:teuthology.orchestra.run.smithi133.stderr: 45400K .......... .......... .......... .......... .......... 48% 351M 0s 2024-09-12T00:39:38.703 INFO:teuthology.orchestra.run.smithi133.stderr: 45450K .......... .......... .......... .......... .......... 48% 433M 0s 2024-09-12T00:39:38.703 INFO:teuthology.orchestra.run.smithi133.stderr: 45500K .......... .......... .......... .......... .......... 49% 19.7M 0s 2024-09-12T00:39:38.704 INFO:teuthology.orchestra.run.smithi133.stderr: 45550K .......... .......... .......... .......... .......... 49% 318M 0s 2024-09-12T00:39:38.704 INFO:teuthology.orchestra.run.smithi133.stderr: 45600K .......... .......... .......... .......... .......... 49% 301M 0s 2024-09-12T00:39:38.704 INFO:teuthology.orchestra.run.smithi133.stderr: 45650K .......... .......... .......... .......... .......... 49% 322M 0s 2024-09-12T00:39:38.704 INFO:teuthology.orchestra.run.smithi133.stderr: 45700K .......... .......... .......... .......... .......... 49% 51.8M 0s 2024-09-12T00:39:38.704 INFO:teuthology.orchestra.run.smithi133.stderr: 45750K .......... .......... .......... .......... .......... 49% 326M 0s 2024-09-12T00:39:38.704 INFO:teuthology.orchestra.run.smithi133.stderr: 45800K .......... .......... .......... .......... .......... 49% 216M 0s 2024-09-12T00:39:38.704 INFO:teuthology.orchestra.run.smithi133.stderr: 45850K .......... .......... .......... .......... .......... 49% 399M 0s 2024-09-12T00:39:38.704 INFO:teuthology.orchestra.run.smithi133.stderr: 45900K .......... .......... .......... .......... .......... 49% 306M 0s 2024-09-12T00:39:38.704 INFO:teuthology.orchestra.run.smithi133.stderr: 45950K .......... .......... .......... .......... .......... 49% 275M 0s 2024-09-12T00:39:38.704 INFO:teuthology.orchestra.run.smithi133.stderr: 46000K .......... .......... .......... .......... .......... 49% 302M 0s 2024-09-12T00:39:38.704 INFO:teuthology.orchestra.run.smithi133.stderr: 46050K .......... .......... .......... .......... .......... 49% 336M 0s 2024-09-12T00:39:38.704 INFO:teuthology.orchestra.run.smithi133.stderr: 46100K .......... .......... .......... .......... .......... 49% 352M 0s 2024-09-12T00:39:38.704 INFO:teuthology.orchestra.run.smithi133.stderr: 46150K .......... .......... .......... .......... .......... 49% 299M 0s 2024-09-12T00:39:38.705 INFO:teuthology.orchestra.run.smithi133.stderr: 46200K .......... .......... .......... .......... .......... 49% 390M 0s 2024-09-12T00:39:38.705 INFO:teuthology.orchestra.run.smithi133.stderr: 46250K .......... .......... .......... .......... .......... 49% 269M 0s 2024-09-12T00:39:38.705 INFO:teuthology.orchestra.run.smithi133.stderr: 46300K .......... .......... .......... .......... .......... 49% 184M 0s 2024-09-12T00:39:38.705 INFO:teuthology.orchestra.run.smithi133.stderr: 46350K .......... .......... .......... .......... .......... 49% 361M 0s 2024-09-12T00:39:38.705 INFO:teuthology.orchestra.run.smithi133.stderr: 46400K .......... .......... .......... .......... .......... 49% 433M 0s 2024-09-12T00:39:38.705 INFO:teuthology.orchestra.run.smithi133.stderr: 46450K .......... .......... .......... .......... .......... 50% 438M 0s 2024-09-12T00:39:38.705 INFO:teuthology.orchestra.run.smithi133.stderr: 46500K .......... .......... .......... .......... .......... 50% 275M 0s 2024-09-12T00:39:38.705 INFO:teuthology.orchestra.run.smithi133.stderr: 46550K .......... .......... .......... .......... .......... 50% 403M 0s 2024-09-12T00:39:38.705 INFO:teuthology.orchestra.run.smithi133.stderr: 46600K .......... .......... .......... .......... .......... 50% 411M 0s 2024-09-12T00:39:38.705 INFO:teuthology.orchestra.run.smithi133.stderr: 46650K .......... .......... .......... .......... .......... 50% 431M 0s 2024-09-12T00:39:38.705 INFO:teuthology.orchestra.run.smithi133.stderr: 46700K .......... .......... .......... .......... .......... 50% 393M 0s 2024-09-12T00:39:38.705 INFO:teuthology.orchestra.run.smithi133.stderr: 46750K .......... .......... .......... .......... .......... 50% 221M 0s 2024-09-12T00:39:38.705 INFO:teuthology.orchestra.run.smithi133.stderr: 46800K .......... .......... .......... .......... .......... 50% 257M 0s 2024-09-12T00:39:38.706 INFO:teuthology.orchestra.run.smithi133.stderr: 46850K .......... .......... .......... .......... .......... 50% 363M 0s 2024-09-12T00:39:38.706 INFO:teuthology.orchestra.run.smithi133.stderr: 46900K .......... .......... .......... .......... .......... 50% 292M 0s 2024-09-12T00:39:38.706 INFO:teuthology.orchestra.run.smithi133.stderr: 46950K .......... .......... .......... .......... .......... 50% 421M 0s 2024-09-12T00:39:38.706 INFO:teuthology.orchestra.run.smithi133.stderr: 47000K .......... .......... .......... .......... .......... 50% 415M 0s 2024-09-12T00:39:38.706 INFO:teuthology.orchestra.run.smithi133.stderr: 47050K .......... .......... .......... .......... .......... 50% 432M 0s 2024-09-12T00:39:38.706 INFO:teuthology.orchestra.run.smithi133.stderr: 47100K .......... .......... .......... .......... .......... 50% 371M 0s 2024-09-12T00:39:38.706 INFO:teuthology.orchestra.run.smithi133.stderr: 47150K .......... .......... .......... .......... .......... 50% 397M 0s 2024-09-12T00:39:38.706 INFO:teuthology.orchestra.run.smithi133.stderr: 47200K .......... .......... .......... .......... .......... 50% 365M 0s 2024-09-12T00:39:38.706 INFO:teuthology.orchestra.run.smithi133.stderr: 47250K .......... .......... .......... .......... .......... 50% 403M 0s 2024-09-12T00:39:38.706 INFO:teuthology.orchestra.run.smithi133.stderr: 47300K .......... .......... .......... .......... .......... 50% 381M 0s 2024-09-12T00:39:38.706 INFO:teuthology.orchestra.run.smithi133.stderr: 47350K .......... .......... .......... .......... .......... 51% 433M 0s 2024-09-12T00:39:38.706 INFO:teuthology.orchestra.run.smithi133.stderr: 47400K .......... .......... .......... .......... .......... 51% 430M 0s 2024-09-12T00:39:38.706 INFO:teuthology.orchestra.run.smithi133.stderr: 47450K .......... .......... .......... .......... .......... 51% 420M 0s 2024-09-12T00:39:38.706 INFO:teuthology.orchestra.run.smithi133.stderr: 47500K .......... .......... .......... .......... .......... 51% 371M 0s 2024-09-12T00:39:38.706 INFO:teuthology.orchestra.run.smithi133.stderr: 47550K .......... .......... .......... .......... .......... 51% 451M 0s 2024-09-12T00:39:38.707 INFO:teuthology.orchestra.run.smithi133.stderr: 47600K .......... .......... .......... .......... .......... 51% 351M 0s 2024-09-12T00:39:38.707 INFO:teuthology.orchestra.run.smithi133.stderr: 47650K .......... .......... .......... .......... .......... 51% 374M 0s 2024-09-12T00:39:38.707 INFO:teuthology.orchestra.run.smithi133.stderr: 47700K .......... .......... .......... .......... .......... 51% 309M 0s 2024-09-12T00:39:38.707 INFO:teuthology.orchestra.run.smithi133.stderr: 47750K .......... .......... .......... .......... .......... 51% 428M 0s 2024-09-12T00:39:38.707 INFO:teuthology.orchestra.run.smithi133.stderr: 47800K .......... .......... .......... .......... .......... 51% 351M 0s 2024-09-12T00:39:38.707 INFO:teuthology.orchestra.run.smithi133.stderr: 47850K .......... .......... .......... .......... .......... 51% 414M 0s 2024-09-12T00:39:38.707 INFO:teuthology.orchestra.run.smithi133.stderr: 47900K .......... .......... .......... .......... .......... 51% 354M 0s 2024-09-12T00:39:38.707 INFO:teuthology.orchestra.run.smithi133.stderr: 47950K .......... .......... .......... .......... .......... 51% 465M 0s 2024-09-12T00:39:38.707 INFO:teuthology.orchestra.run.smithi133.stderr: 48000K .......... .......... .......... .......... .......... 51% 459M 0s 2024-09-12T00:39:38.707 INFO:teuthology.orchestra.run.smithi133.stderr: 48050K .......... .......... .......... .......... .......... 51% 436M 0s 2024-09-12T00:39:38.707 INFO:teuthology.orchestra.run.smithi133.stderr: 48100K .......... .......... .......... .......... .......... 51% 151M 0s 2024-09-12T00:39:38.707 INFO:teuthology.orchestra.run.smithi133.stderr: 48150K .......... .......... .......... .......... .......... 51% 428M 0s 2024-09-12T00:39:38.707 INFO:teuthology.orchestra.run.smithi133.stderr: 48200K .......... .......... .......... .......... .......... 51% 427M 0s 2024-09-12T00:39:38.707 INFO:teuthology.orchestra.run.smithi133.stderr: 48250K .......... .......... .......... .......... .......... 51% 442M 0s 2024-09-12T00:39:38.708 INFO:teuthology.orchestra.run.smithi133.stderr: 48300K .......... .......... .......... .......... .......... 52% 362M 0s 2024-09-12T00:39:38.708 INFO:teuthology.orchestra.run.smithi133.stderr: 48350K .......... .......... .......... .......... .......... 52% 425M 0s 2024-09-12T00:39:38.708 INFO:teuthology.orchestra.run.smithi133.stderr: 48400K .......... .......... .......... .......... .......... 52% 230M 0s 2024-09-12T00:39:38.708 INFO:teuthology.orchestra.run.smithi133.stderr: 48450K .......... .......... .......... .......... .......... 52% 437M 0s 2024-09-12T00:39:38.708 INFO:teuthology.orchestra.run.smithi133.stderr: 48500K .......... .......... .......... .......... .......... 52% 407M 0s 2024-09-12T00:39:38.708 INFO:teuthology.orchestra.run.smithi133.stderr: 48550K .......... .......... .......... .......... .......... 52% 22.2M 0s 2024-09-12T00:39:38.708 INFO:teuthology.orchestra.run.smithi133.stderr: 48600K .......... .......... .......... .......... .......... 52% 179M 0s 2024-09-12T00:39:38.708 INFO:teuthology.orchestra.run.smithi133.stderr: 48650K .......... .......... .......... .......... .......... 52% 231M 0s 2024-09-12T00:39:38.708 INFO:teuthology.orchestra.run.smithi133.stderr: 48700K .......... .......... .......... .......... .......... 52% 287M 0s 2024-09-12T00:39:38.708 INFO:teuthology.orchestra.run.smithi133.stderr: 48750K .......... .......... .......... .......... .......... 52% 448M 0s 2024-09-12T00:39:38.708 INFO:teuthology.orchestra.run.smithi133.stderr: 48800K .......... .......... .......... .......... .......... 52% 54.3M 0s 2024-09-12T00:39:38.708 INFO:teuthology.orchestra.run.smithi133.stderr: 48850K .......... .......... .......... .......... .......... 52% 170M 0s 2024-09-12T00:39:38.708 INFO:teuthology.orchestra.run.smithi133.stderr: 48900K .......... .......... .......... .......... .......... 52% 246M 0s 2024-09-12T00:39:38.708 INFO:teuthology.orchestra.run.smithi133.stderr: 48950K .......... .......... .......... .......... .......... 52% 439M 0s 2024-09-12T00:39:38.709 INFO:teuthology.orchestra.run.smithi133.stderr: 49000K .......... .......... .......... .......... .......... 52% 415M 0s 2024-09-12T00:39:38.709 INFO:teuthology.orchestra.run.smithi133.stderr: 49050K .......... .......... .......... .......... .......... 52% 239M 0s 2024-09-12T00:39:38.709 INFO:teuthology.orchestra.run.smithi133.stderr: 49100K .......... .......... .......... .......... .......... 52% 121M 0s 2024-09-12T00:39:38.709 INFO:teuthology.orchestra.run.smithi133.stderr: 49150K .......... .......... .......... .......... .......... 52% 367M 0s 2024-09-12T00:39:38.709 INFO:teuthology.orchestra.run.smithi133.stderr: 49200K .......... .......... .......... .......... .......... 53% 374M 0s 2024-09-12T00:39:38.709 INFO:teuthology.orchestra.run.smithi133.stderr: 49250K .......... .......... .......... .......... .......... 53% 366M 0s 2024-09-12T00:39:38.709 INFO:teuthology.orchestra.run.smithi133.stderr: 49300K .......... .......... .......... .......... .......... 53% 351M 0s 2024-09-12T00:39:38.709 INFO:teuthology.orchestra.run.smithi133.stderr: 49350K .......... .......... .......... .......... .......... 53% 275M 0s 2024-09-12T00:39:38.709 INFO:teuthology.orchestra.run.smithi133.stderr: 49400K .......... .......... .......... .......... .......... 53% 371M 0s 2024-09-12T00:39:38.709 INFO:teuthology.orchestra.run.smithi133.stderr: 49450K .......... .......... .......... .......... .......... 53% 459M 0s 2024-09-12T00:39:38.709 INFO:teuthology.orchestra.run.smithi133.stderr: 49500K .......... .......... .......... .......... .......... 53% 343M 0s 2024-09-12T00:39:38.709 INFO:teuthology.orchestra.run.smithi133.stderr: 49550K .......... .......... .......... .......... .......... 53% 435M 0s 2024-09-12T00:39:38.709 INFO:teuthology.orchestra.run.smithi133.stderr: 49600K .......... .......... .......... .......... .......... 53% 413M 0s 2024-09-12T00:39:38.709 INFO:teuthology.orchestra.run.smithi133.stderr: 49650K .......... .......... .......... .......... .......... 53% 421M 0s 2024-09-12T00:39:38.710 INFO:teuthology.orchestra.run.smithi133.stderr: 49700K .......... .......... .......... .......... .......... 53% 374M 0s 2024-09-12T00:39:38.710 INFO:teuthology.orchestra.run.smithi133.stderr: 49750K .......... .......... .......... .......... .......... 53% 158M 0s 2024-09-12T00:39:38.710 INFO:teuthology.orchestra.run.smithi133.stderr: 49800K .......... .......... .......... .......... .......... 53% 293M 0s 2024-09-12T00:39:38.710 INFO:teuthology.orchestra.run.smithi133.stderr: 49850K .......... .......... .......... .......... .......... 53% 262M 0s 2024-09-12T00:39:38.710 INFO:teuthology.orchestra.run.smithi133.stderr: 49900K .......... .......... .......... .......... .......... 53% 200M 0s 2024-09-12T00:39:38.710 INFO:teuthology.orchestra.run.smithi133.stderr: 49950K .......... .......... .......... .......... .......... 53% 404M 0s 2024-09-12T00:39:38.710 INFO:teuthology.orchestra.run.smithi133.stderr: 50000K .......... .......... .......... .......... .......... 53% 441M 0s 2024-09-12T00:39:38.710 INFO:teuthology.orchestra.run.smithi133.stderr: 50050K .......... .......... .......... .......... .......... 53% 432M 0s 2024-09-12T00:39:38.710 INFO:teuthology.orchestra.run.smithi133.stderr: 50100K .......... .......... .......... .......... .......... 53% 379M 0s 2024-09-12T00:39:38.710 INFO:teuthology.orchestra.run.smithi133.stderr: 50150K .......... .......... .......... .......... .......... 54% 396M 0s 2024-09-12T00:39:38.710 INFO:teuthology.orchestra.run.smithi133.stderr: 50200K .......... .......... .......... .......... .......... 54% 391M 0s 2024-09-12T00:39:38.710 INFO:teuthology.orchestra.run.smithi133.stderr: 50250K .......... .......... .......... .......... .......... 54% 396M 0s 2024-09-12T00:39:38.710 INFO:teuthology.orchestra.run.smithi133.stderr: 50300K .......... .......... .......... .......... .......... 54% 324M 0s 2024-09-12T00:39:38.710 INFO:teuthology.orchestra.run.smithi133.stderr: 50350K .......... .......... .......... .......... .......... 54% 403M 0s 2024-09-12T00:39:38.711 INFO:teuthology.orchestra.run.smithi133.stderr: 50400K .......... .......... .......... .......... .......... 54% 363M 0s 2024-09-12T00:39:38.711 INFO:teuthology.orchestra.run.smithi133.stderr: 50450K .......... .......... .......... .......... .......... 54% 390M 0s 2024-09-12T00:39:38.711 INFO:teuthology.orchestra.run.smithi133.stderr: 50500K .......... .......... .......... .......... .......... 54% 362M 0s 2024-09-12T00:39:38.711 INFO:teuthology.orchestra.run.smithi133.stderr: 50550K .......... .......... .......... .......... .......... 54% 403M 0s 2024-09-12T00:39:38.711 INFO:teuthology.orchestra.run.smithi133.stderr: 50600K .......... .......... .......... .......... .......... 54% 434M 0s 2024-09-12T00:39:38.711 INFO:teuthology.orchestra.run.smithi133.stderr: 50650K .......... .......... .......... .......... .......... 54% 431M 0s 2024-09-12T00:39:38.711 INFO:teuthology.orchestra.run.smithi133.stderr: 50700K .......... .......... .......... .......... .......... 54% 339M 0s 2024-09-12T00:39:38.711 INFO:teuthology.orchestra.run.smithi133.stderr: 50750K .......... .......... .......... .......... .......... 54% 425M 0s 2024-09-12T00:39:38.711 INFO:teuthology.orchestra.run.smithi133.stderr: 50800K .......... .......... .......... .......... .......... 54% 418M 0s 2024-09-12T00:39:38.711 INFO:teuthology.orchestra.run.smithi133.stderr: 50850K .......... .......... .......... .......... .......... 54% 421M 0s 2024-09-12T00:39:38.711 INFO:teuthology.orchestra.run.smithi133.stderr: 50900K .......... .......... .......... .......... .......... 54% 390M 0s 2024-09-12T00:39:38.711 INFO:teuthology.orchestra.run.smithi133.stderr: 50950K .......... .......... .......... .......... .......... 54% 452M 0s 2024-09-12T00:39:38.711 INFO:teuthology.orchestra.run.smithi133.stderr: 51000K .......... .......... .......... .......... .......... 54% 158M 0s 2024-09-12T00:39:38.711 INFO:teuthology.orchestra.run.smithi133.stderr: 51050K .......... .......... .......... .......... .......... 55% 316M 0s 2024-09-12T00:39:38.712 INFO:teuthology.orchestra.run.smithi133.stderr: 51100K .......... .......... .......... .......... .......... 55% 353M 0s 2024-09-12T00:39:38.712 INFO:teuthology.orchestra.run.smithi133.stderr: 51150K .......... .......... .......... .......... .......... 55% 454M 0s 2024-09-12T00:39:38.712 INFO:teuthology.orchestra.run.smithi133.stderr: 51200K .......... .......... .......... .......... .......... 55% 400M 0s 2024-09-12T00:39:38.712 INFO:teuthology.orchestra.run.smithi133.stderr: 51250K .......... .......... .......... .......... .......... 55% 449M 0s 2024-09-12T00:39:38.712 INFO:teuthology.orchestra.run.smithi133.stderr: 51300K .......... .......... .......... .......... .......... 55% 395M 0s 2024-09-12T00:39:38.712 INFO:teuthology.orchestra.run.smithi133.stderr: 51350K .......... .......... .......... .......... .......... 55% 410M 0s 2024-09-12T00:39:38.712 INFO:teuthology.orchestra.run.smithi133.stderr: 51400K .......... .......... .......... .......... .......... 55% 427M 0s 2024-09-12T00:39:38.712 INFO:teuthology.orchestra.run.smithi133.stderr: 51450K .......... .......... .......... .......... .......... 55% 414M 0s 2024-09-12T00:39:38.712 INFO:teuthology.orchestra.run.smithi133.stderr: 51500K .......... .......... .......... .......... .......... 55% 358M 0s 2024-09-12T00:39:38.712 INFO:teuthology.orchestra.run.smithi133.stderr: 51550K .......... .......... .......... .......... .......... 55% 10.2M 0s 2024-09-12T00:39:38.712 INFO:teuthology.orchestra.run.smithi133.stderr: 51600K .......... .......... .......... .......... .......... 55% 308M 0s 2024-09-12T00:39:38.712 INFO:teuthology.orchestra.run.smithi133.stderr: 51650K .......... .......... .......... .......... .......... 55% 125M 0s 2024-09-12T00:39:38.712 INFO:teuthology.orchestra.run.smithi133.stderr: 51700K .......... .......... .......... .......... .......... 55% 8.46M 0s 2024-09-12T00:39:38.713 INFO:teuthology.orchestra.run.smithi133.stderr: 51750K .......... .......... .......... .......... .......... 55% 60.8M 0s 2024-09-12T00:39:38.713 INFO:teuthology.orchestra.run.smithi133.stderr: 51800K .......... .......... .......... .......... .......... 55% 274M 0s 2024-09-12T00:39:38.713 INFO:teuthology.orchestra.run.smithi133.stderr: 51850K .......... .......... .......... .......... .......... 55% 439M 0s 2024-09-12T00:39:38.713 INFO:teuthology.orchestra.run.smithi133.stderr: 51900K .......... .......... .......... .......... .......... 55% 10.3M 0s 2024-09-12T00:39:38.713 INFO:teuthology.orchestra.run.smithi133.stderr: 51950K .......... .......... .......... .......... .......... 55% 45.2M 0s 2024-09-12T00:39:38.713 INFO:teuthology.orchestra.run.smithi133.stderr: 52000K .......... .......... .......... .......... .......... 56% 400M 0s 2024-09-12T00:39:38.713 INFO:teuthology.orchestra.run.smithi133.stderr: 52050K .......... .......... .......... .......... .......... 56% 409M 0s 2024-09-12T00:39:38.713 INFO:teuthology.orchestra.run.smithi133.stderr: 52100K .......... .......... .......... .......... .......... 56% 385M 0s 2024-09-12T00:39:38.713 INFO:teuthology.orchestra.run.smithi133.stderr: 52150K .......... .......... .......... .......... .......... 56% 46.9M 0s 2024-09-12T00:39:38.713 INFO:teuthology.orchestra.run.smithi133.stderr: 52200K .......... .......... .......... .......... .......... 56% 393M 0s 2024-09-12T00:39:38.713 INFO:teuthology.orchestra.run.smithi133.stderr: 52250K .......... .......... .......... .......... .......... 56% 410M 0s 2024-09-12T00:39:38.713 INFO:teuthology.orchestra.run.smithi133.stderr: 52300K .......... .......... .......... .......... .......... 56% 348M 0s 2024-09-12T00:39:38.713 INFO:teuthology.orchestra.run.smithi133.stderr: 52350K .......... .......... .......... .......... .......... 56% 387M 0s 2024-09-12T00:39:38.713 INFO:teuthology.orchestra.run.smithi133.stderr: 52400K .......... .......... .......... .......... .......... 56% 72.4M 0s 2024-09-12T00:39:38.714 INFO:teuthology.orchestra.run.smithi133.stderr: 52450K .......... .......... .......... .......... .......... 56% 387M 0s 2024-09-12T00:39:38.714 INFO:teuthology.orchestra.run.smithi133.stderr: 52500K .......... .......... .......... .......... .......... 56% 206M 0s 2024-09-12T00:39:38.714 INFO:teuthology.orchestra.run.smithi133.stderr: 52550K .......... .......... .......... .......... .......... 56% 426M 0s 2024-09-12T00:39:38.714 INFO:teuthology.orchestra.run.smithi133.stderr: 52600K .......... .......... .......... .......... .......... 56% 36.0M 0s 2024-09-12T00:39:38.714 INFO:teuthology.orchestra.run.smithi133.stderr: 52650K .......... .......... .......... .......... .......... 56% 94.0M 0s 2024-09-12T00:39:38.714 INFO:teuthology.orchestra.run.smithi133.stderr: 52700K .......... .......... .......... .......... .......... 56% 139M 0s 2024-09-12T00:39:38.714 INFO:teuthology.orchestra.run.smithi133.stderr: 52750K .......... .......... .......... .......... .......... 56% 396M 0s 2024-09-12T00:39:38.714 INFO:teuthology.orchestra.run.smithi133.stderr: 52800K .......... .......... .......... .......... .......... 56% 430M 0s 2024-09-12T00:39:38.714 INFO:teuthology.orchestra.run.smithi133.stderr: 52850K .......... .......... .......... .......... .......... 56% 453M 0s 2024-09-12T00:39:38.714 INFO:teuthology.orchestra.run.smithi133.stderr: 52900K .......... .......... .......... .......... .......... 56% 87.3M 0s 2024-09-12T00:39:38.714 INFO:teuthology.orchestra.run.smithi133.stderr: 52950K .......... .......... .......... .......... .......... 57% 337M 0s 2024-09-12T00:39:38.714 INFO:teuthology.orchestra.run.smithi133.stderr: 53000K .......... .......... .......... .......... .......... 57% 391M 0s 2024-09-12T00:39:38.714 INFO:teuthology.orchestra.run.smithi133.stderr: 53050K .......... .......... .......... .......... .......... 57% 412M 0s 2024-09-12T00:39:38.714 INFO:teuthology.orchestra.run.smithi133.stderr: 53100K .......... .......... .......... .......... .......... 57% 355M 0s 2024-09-12T00:39:38.715 INFO:teuthology.orchestra.run.smithi133.stderr: 53150K .......... .......... .......... .......... .......... 57% 373M 0s 2024-09-12T00:39:38.715 INFO:teuthology.orchestra.run.smithi133.stderr: 53200K .......... .......... .......... .......... .......... 57% 430M 0s 2024-09-12T00:39:38.715 INFO:teuthology.orchestra.run.smithi133.stderr: 53250K .......... .......... .......... .......... .......... 57% 441M 0s 2024-09-12T00:39:38.715 INFO:teuthology.orchestra.run.smithi133.stderr: 53300K .......... .......... .......... .......... .......... 57% 7.18M 0s 2024-09-12T00:39:38.715 INFO:teuthology.orchestra.run.smithi133.stderr: 53350K .......... .......... .......... .......... .......... 57% 153M 0s 2024-09-12T00:39:38.715 INFO:teuthology.orchestra.run.smithi133.stderr: 53400K .......... .......... .......... .......... .......... 57% 163M 0s 2024-09-12T00:39:38.715 INFO:teuthology.orchestra.run.smithi133.stderr: 53450K .......... .......... .......... .......... .......... 57% 399M 0s 2024-09-12T00:39:38.715 INFO:teuthology.orchestra.run.smithi133.stderr: 53500K .......... .......... .......... .......... .......... 57% 184M 0s 2024-09-12T00:39:38.715 INFO:teuthology.orchestra.run.smithi133.stderr: 53550K .......... .......... .......... .......... .......... 57% 77.7M 0s 2024-09-12T00:39:38.715 INFO:teuthology.orchestra.run.smithi133.stderr: 53600K .......... .......... .......... .......... .......... 57% 417M 0s 2024-09-12T00:39:38.715 INFO:teuthology.orchestra.run.smithi133.stderr: 53650K .......... .......... .......... .......... .......... 57% 432M 0s 2024-09-12T00:39:38.715 INFO:teuthology.orchestra.run.smithi133.stderr: 53700K .......... .......... .......... .......... .......... 57% 288M 0s 2024-09-12T00:39:38.715 INFO:teuthology.orchestra.run.smithi133.stderr: 53750K .......... .......... .......... .......... .......... 57% 45.2M 0s 2024-09-12T00:39:38.715 INFO:teuthology.orchestra.run.smithi133.stderr: 53800K .......... .......... .......... .......... .......... 57% 417M 0s 2024-09-12T00:39:38.716 INFO:teuthology.orchestra.run.smithi133.stderr: 53850K .......... .......... .......... .......... .......... 58% 413M 0s 2024-09-12T00:39:38.716 INFO:teuthology.orchestra.run.smithi133.stderr: 53900K .......... .......... .......... .......... .......... 58% 86.7M 0s 2024-09-12T00:39:38.716 INFO:teuthology.orchestra.run.smithi133.stderr: 53950K .......... .......... .......... .......... .......... 58% 268M 0s 2024-09-12T00:39:38.716 INFO:teuthology.orchestra.run.smithi133.stderr: 54000K .......... .......... .......... .......... .......... 58% 398M 0s 2024-09-12T00:39:38.716 INFO:teuthology.orchestra.run.smithi133.stderr: 54050K .......... .......... .......... .......... .......... 58% 424M 0s 2024-09-12T00:39:38.716 INFO:teuthology.orchestra.run.smithi133.stderr: 54100K .......... .......... .......... .......... .......... 58% 375M 0s 2024-09-12T00:39:38.716 INFO:teuthology.orchestra.run.smithi133.stderr: 54150K .......... .......... .......... .......... .......... 58% 416M 0s 2024-09-12T00:39:38.716 INFO:teuthology.orchestra.run.smithi133.stderr: 54200K .......... .......... .......... .......... .......... 58% 390M 0s 2024-09-12T00:39:38.716 INFO:teuthology.orchestra.run.smithi133.stderr: 54250K .......... .......... .......... .......... .......... 58% 417M 0s 2024-09-12T00:39:38.716 INFO:teuthology.orchestra.run.smithi133.stderr: 54300K .......... .......... .......... .......... .......... 58% 179M 0s 2024-09-12T00:39:38.716 INFO:teuthology.orchestra.run.smithi133.stderr: 54350K .......... .......... .......... .......... .......... 58% 359M 0s 2024-09-12T00:39:38.716 INFO:teuthology.orchestra.run.smithi133.stderr: 54400K .......... .......... .......... .......... .......... 58% 441M 0s 2024-09-12T00:39:38.716 INFO:teuthology.orchestra.run.smithi133.stderr: 54450K .......... .......... .......... .......... .......... 58% 369M 0s 2024-09-12T00:39:38.716 INFO:teuthology.orchestra.run.smithi133.stderr: 54500K .......... .......... .......... .......... .......... 58% 149M 0s 2024-09-12T00:39:38.717 INFO:teuthology.orchestra.run.smithi133.stderr: 54550K .......... .......... .......... .......... .......... 58% 383M 0s 2024-09-12T00:39:38.717 INFO:teuthology.orchestra.run.smithi133.stderr: 54600K .......... .......... .......... .......... .......... 58% 411M 0s 2024-09-12T00:39:38.717 INFO:teuthology.orchestra.run.smithi133.stderr: 54650K .......... .......... .......... .......... .......... 58% 439M 0s 2024-09-12T00:39:38.717 INFO:teuthology.orchestra.run.smithi133.stderr: 54700K .......... .......... .......... .......... .......... 58% 246M 0s 2024-09-12T00:39:38.717 INFO:teuthology.orchestra.run.smithi133.stderr: 54750K .......... .......... .......... .......... .......... 58% 135M 0s 2024-09-12T00:39:38.717 INFO:teuthology.orchestra.run.smithi133.stderr: 54800K .......... .......... .......... .......... .......... 59% 221M 0s 2024-09-12T00:39:38.717 INFO:teuthology.orchestra.run.smithi133.stderr: 54850K .......... .......... .......... .......... .......... 59% 295M 0s 2024-09-12T00:39:38.717 INFO:teuthology.orchestra.run.smithi133.stderr: 54900K .......... .......... .......... .......... .......... 59% 174M 0s 2024-09-12T00:39:38.717 INFO:teuthology.orchestra.run.smithi133.stderr: 54950K .......... .......... .......... .......... .......... 59% 422M 0s 2024-09-12T00:39:38.717 INFO:teuthology.orchestra.run.smithi133.stderr: 55000K .......... .......... .......... .......... .......... 59% 422M 0s 2024-09-12T00:39:38.717 INFO:teuthology.orchestra.run.smithi133.stderr: 55050K .......... .......... .......... .......... .......... 59% 134M 0s 2024-09-12T00:39:38.717 INFO:teuthology.orchestra.run.smithi133.stderr: 55100K .......... .......... .......... .......... .......... 59% 49.4M 0s 2024-09-12T00:39:38.717 INFO:teuthology.orchestra.run.smithi133.stderr: 55150K .......... .......... .......... .......... .......... 59% 377M 0s 2024-09-12T00:39:38.717 INFO:teuthology.orchestra.run.smithi133.stderr: 55200K .......... .......... .......... .......... .......... 59% 301M 0s 2024-09-12T00:39:38.718 INFO:teuthology.orchestra.run.smithi133.stderr: 55250K .......... .......... .......... .......... .......... 59% 424M 0s 2024-09-12T00:39:38.718 INFO:teuthology.orchestra.run.smithi133.stderr: 55300K .......... .......... .......... .......... .......... 59% 181M 0s 2024-09-12T00:39:38.718 INFO:teuthology.orchestra.run.smithi133.stderr: 55350K .......... .......... .......... .......... .......... 59% 332M 0s 2024-09-12T00:39:38.718 INFO:teuthology.orchestra.run.smithi133.stderr: 55400K .......... .......... .......... .......... .......... 59% 401M 0s 2024-09-12T00:39:38.718 INFO:teuthology.orchestra.run.smithi133.stderr: 55450K .......... .......... .......... .......... .......... 59% 383M 0s 2024-09-12T00:39:38.718 INFO:teuthology.orchestra.run.smithi133.stderr: 55500K .......... .......... .......... .......... .......... 59% 123M 0s 2024-09-12T00:39:38.718 INFO:teuthology.orchestra.run.smithi133.stderr: 55550K .......... .......... .......... .......... .......... 59% 411M 0s 2024-09-12T00:39:38.718 INFO:teuthology.orchestra.run.smithi133.stderr: 55600K .......... .......... .......... .......... .......... 59% 429M 0s 2024-09-12T00:39:38.718 INFO:teuthology.orchestra.run.smithi133.stderr: 55650K .......... .......... .......... .......... .......... 59% 182M 0s 2024-09-12T00:39:38.718 INFO:teuthology.orchestra.run.smithi133.stderr: 55700K .......... .......... .......... .......... .......... 60% 225M 0s 2024-09-12T00:39:38.718 INFO:teuthology.orchestra.run.smithi133.stderr: 55750K .......... .......... .......... .......... .......... 60% 439M 0s 2024-09-12T00:39:38.718 INFO:teuthology.orchestra.run.smithi133.stderr: 55800K .......... .......... .......... .......... .......... 60% 424M 0s 2024-09-12T00:39:38.718 INFO:teuthology.orchestra.run.smithi133.stderr: 55850K .......... .......... .......... .......... .......... 60% 17.0M 0s 2024-09-12T00:39:38.718 INFO:teuthology.orchestra.run.smithi133.stderr: 55900K .......... .......... .......... .......... .......... 60% 345M 0s 2024-09-12T00:39:38.719 INFO:teuthology.orchestra.run.smithi133.stderr: 55950K .......... .......... .......... .......... .......... 60% 158M 0s 2024-09-12T00:39:38.719 INFO:teuthology.orchestra.run.smithi133.stderr: 56000K .......... .......... .......... .......... .......... 60% 402M 0s 2024-09-12T00:39:38.719 INFO:teuthology.orchestra.run.smithi133.stderr: 56050K .......... .......... .......... .......... .......... 60% 394M 0s 2024-09-12T00:39:38.719 INFO:teuthology.orchestra.run.smithi133.stderr: 56100K .......... .......... .......... .......... .......... 60% 345M 0s 2024-09-12T00:39:38.719 INFO:teuthology.orchestra.run.smithi133.stderr: 56150K .......... .......... .......... .......... .......... 60% 150M 0s 2024-09-12T00:39:38.719 INFO:teuthology.orchestra.run.smithi133.stderr: 56200K .......... .......... .......... .......... .......... 60% 422M 0s 2024-09-12T00:39:38.719 INFO:teuthology.orchestra.run.smithi133.stderr: 56250K .......... .......... .......... .......... .......... 60% 187M 0s 2024-09-12T00:39:38.719 INFO:teuthology.orchestra.run.smithi133.stderr: 56300K .......... .......... .......... .......... .......... 60% 184M 0s 2024-09-12T00:39:38.719 INFO:teuthology.orchestra.run.smithi133.stderr: 56350K .......... .......... .......... .......... .......... 60% 412M 0s 2024-09-12T00:39:38.719 INFO:teuthology.orchestra.run.smithi133.stderr: 56400K .......... .......... .......... .......... .......... 60% 424M 0s 2024-09-12T00:39:38.719 INFO:teuthology.orchestra.run.smithi133.stderr: 56450K .......... .......... .......... .......... .......... 60% 397M 0s 2024-09-12T00:39:38.719 INFO:teuthology.orchestra.run.smithi133.stderr: 56500K .......... .......... .......... .......... .......... 60% 389M 0s 2024-09-12T00:39:38.719 INFO:teuthology.orchestra.run.smithi133.stderr: 56550K .......... .......... .......... .......... .......... 60% 88.4M 0s 2024-09-12T00:39:38.719 INFO:teuthology.orchestra.run.smithi133.stderr: 56600K .......... .......... .......... .......... .......... 60% 163M 0s 2024-09-12T00:39:38.720 INFO:teuthology.orchestra.run.smithi133.stderr: 56650K .......... .......... .......... .......... .......... 61% 390M 0s 2024-09-12T00:39:38.720 INFO:teuthology.orchestra.run.smithi133.stderr: 56700K .......... .......... .......... .......... .......... 61% 344M 0s 2024-09-12T00:39:38.720 INFO:teuthology.orchestra.run.smithi133.stderr: 56750K .......... .......... .......... .......... .......... 61% 216M 0s 2024-09-12T00:39:38.720 INFO:teuthology.orchestra.run.smithi133.stderr: 56800K .......... .......... .......... .......... .......... 61% 263M 0s 2024-09-12T00:39:38.720 INFO:teuthology.orchestra.run.smithi133.stderr: 56850K .......... .......... .......... .......... .......... 61% 2.29M 0s 2024-09-12T00:39:38.720 INFO:teuthology.orchestra.run.smithi133.stderr: 56900K .......... .......... .......... .......... .......... 61% 369M 0s 2024-09-12T00:39:38.720 INFO:teuthology.orchestra.run.smithi133.stderr: 56950K .......... .......... .......... .......... .......... 61% 10.0M 0s 2024-09-12T00:39:38.720 INFO:teuthology.orchestra.run.smithi133.stderr: 57000K .......... .......... .......... .......... .......... 61% 175M 0s 2024-09-12T00:39:38.720 INFO:teuthology.orchestra.run.smithi133.stderr: 57050K .......... .......... .......... .......... .......... 61% 407M 0s 2024-09-12T00:39:38.720 INFO:teuthology.orchestra.run.smithi133.stderr: 57100K .......... .......... .......... .......... .......... 61% 59.0M 0s 2024-09-12T00:39:38.720 INFO:teuthology.orchestra.run.smithi133.stderr: 57150K .......... .......... .......... .......... .......... 61% 391M 0s 2024-09-12T00:39:38.720 INFO:teuthology.orchestra.run.smithi133.stderr: 57200K .......... .......... .......... .......... .......... 61% 378M 0s 2024-09-12T00:39:38.720 INFO:teuthology.orchestra.run.smithi133.stderr: 57250K .......... .......... .......... .......... .......... 61% 92.0M 0s 2024-09-12T00:39:38.720 INFO:teuthology.orchestra.run.smithi133.stderr: 57300K .......... .......... .......... .......... .......... 61% 51.3M 0s 2024-09-12T00:39:38.721 INFO:teuthology.orchestra.run.smithi133.stderr: 57350K .......... .......... .......... .......... .......... 61% 219M 0s 2024-09-12T00:39:38.721 INFO:teuthology.orchestra.run.smithi133.stderr: 57400K .......... .......... .......... .......... .......... 61% 407M 0s 2024-09-12T00:39:38.721 INFO:teuthology.orchestra.run.smithi133.stderr: 57450K .......... .......... .......... .......... .......... 61% 172M 0s 2024-09-12T00:39:38.721 INFO:teuthology.orchestra.run.smithi133.stderr: 57500K .......... .......... .......... .......... .......... 61% 53.5M 0s 2024-09-12T00:39:38.721 INFO:teuthology.orchestra.run.smithi133.stderr: 57550K .......... .......... .......... .......... .......... 62% 326M 0s 2024-09-12T00:39:38.721 INFO:teuthology.orchestra.run.smithi133.stderr: 57600K .......... .......... .......... .......... .......... 62% 100M 0s 2024-09-12T00:39:38.721 INFO:teuthology.orchestra.run.smithi133.stderr: 57650K .......... .......... .......... .......... .......... 62% 364M 0s 2024-09-12T00:39:38.721 INFO:teuthology.orchestra.run.smithi133.stderr: 57700K .......... .......... .......... .......... .......... 62% 42.2M 0s 2024-09-12T00:39:38.721 INFO:teuthology.orchestra.run.smithi133.stderr: 57750K .......... .......... .......... .......... .......... 62% 324M 0s 2024-09-12T00:39:38.721 INFO:teuthology.orchestra.run.smithi133.stderr: 57800K .......... .......... .......... .......... .......... 62% 199M 0s 2024-09-12T00:39:38.721 INFO:teuthology.orchestra.run.smithi133.stderr: 57850K .......... .......... .......... .......... .......... 62% 429M 0s 2024-09-12T00:39:38.721 INFO:teuthology.orchestra.run.smithi133.stderr: 57900K .......... .......... .......... .......... .......... 62% 18.5M 0s 2024-09-12T00:39:38.721 INFO:teuthology.orchestra.run.smithi133.stderr: 57950K .......... .......... .......... .......... .......... 62% 359M 0s 2024-09-12T00:39:38.721 INFO:teuthology.orchestra.run.smithi133.stderr: 58000K .......... .......... .......... .......... .......... 62% 392M 0s 2024-09-12T00:39:38.722 INFO:teuthology.orchestra.run.smithi133.stderr: 58050K .......... .......... .......... .......... .......... 62% 39.0M 0s 2024-09-12T00:39:38.722 INFO:teuthology.orchestra.run.smithi133.stderr: 58100K .......... .......... .......... .......... .......... 62% 274M 0s 2024-09-12T00:39:38.722 INFO:teuthology.orchestra.run.smithi133.stderr: 58150K .......... .......... .......... .......... .......... 62% 394M 0s 2024-09-12T00:39:38.722 INFO:teuthology.orchestra.run.smithi133.stderr: 58200K .......... .......... .......... .......... .......... 62% 172M 0s 2024-09-12T00:39:38.722 INFO:teuthology.orchestra.run.smithi133.stderr: 58250K .......... .......... .......... .......... .......... 62% 78.2M 0s 2024-09-12T00:39:38.722 INFO:teuthology.orchestra.run.smithi133.stderr: 58300K .......... .......... .......... .......... .......... 62% 66.2M 0s 2024-09-12T00:39:38.722 INFO:teuthology.orchestra.run.smithi133.stderr: 58350K .......... .......... .......... .......... .......... 62% 337M 0s 2024-09-12T00:39:38.722 INFO:teuthology.orchestra.run.smithi133.stderr: 58400K .......... .......... .......... .......... .......... 62% 366M 0s 2024-09-12T00:39:38.722 INFO:teuthology.orchestra.run.smithi133.stderr: 58450K .......... .......... .......... .......... .......... 62% 95.0M 0s 2024-09-12T00:39:38.722 INFO:teuthology.orchestra.run.smithi133.stderr: 58500K .......... .......... .......... .......... .......... 63% 38.1M 0s 2024-09-12T00:39:38.722 INFO:teuthology.orchestra.run.smithi133.stderr: 58550K .......... .......... .......... .......... .......... 63% 387M 0s 2024-09-12T00:39:38.722 INFO:teuthology.orchestra.run.smithi133.stderr: 58600K .......... .......... .......... .......... .......... 63% 84.5M 0s 2024-09-12T00:39:38.722 INFO:teuthology.orchestra.run.smithi133.stderr: 58650K .......... .......... .......... .......... .......... 63% 352M 0s 2024-09-12T00:39:38.723 INFO:teuthology.orchestra.run.smithi133.stderr: 58700K .......... .......... .......... .......... .......... 63% 24.7M 0s 2024-09-12T00:39:38.723 INFO:teuthology.orchestra.run.smithi133.stderr: 58750K .......... .......... .......... .......... .......... 63% 396M 0s 2024-09-12T00:39:38.723 INFO:teuthology.orchestra.run.smithi133.stderr: 58800K .......... .......... .......... .......... .......... 63% 159M 0s 2024-09-12T00:39:38.723 INFO:teuthology.orchestra.run.smithi133.stderr: 58850K .......... .......... .......... .......... .......... 63% 423M 0s 2024-09-12T00:39:38.723 INFO:teuthology.orchestra.run.smithi133.stderr: 58900K .......... .......... .......... .......... .......... 63% 174M 0s 2024-09-12T00:39:38.723 INFO:teuthology.orchestra.run.smithi133.stderr: 58950K .......... .......... .......... .......... .......... 63% 420M 0s 2024-09-12T00:39:38.723 INFO:teuthology.orchestra.run.smithi133.stderr: 59000K .......... .......... .......... .......... .......... 63% 116M 0s 2024-09-12T00:39:38.723 INFO:teuthology.orchestra.run.smithi133.stderr: 59050K .......... .......... .......... .......... .......... 63% 66.1M 0s 2024-09-12T00:39:38.723 INFO:teuthology.orchestra.run.smithi133.stderr: 59100K .......... .......... .......... .......... .......... 63% 339M 0s 2024-09-12T00:39:38.723 INFO:teuthology.orchestra.run.smithi133.stderr: 59150K .......... .......... .......... .......... .......... 63% 424M 0s 2024-09-12T00:39:38.723 INFO:teuthology.orchestra.run.smithi133.stderr: 59200K .......... .......... .......... .......... .......... 63% 268M 0s 2024-09-12T00:39:38.723 INFO:teuthology.orchestra.run.smithi133.stderr: 59250K .......... .......... .......... .......... .......... 63% 322M 0s 2024-09-12T00:39:38.723 INFO:teuthology.orchestra.run.smithi133.stderr: 59300K .......... .......... .......... .......... .......... 63% 407M 0s 2024-09-12T00:39:38.723 INFO:teuthology.orchestra.run.smithi133.stderr: 59350K .......... .......... .......... .......... .......... 63% 414M 0s 2024-09-12T00:39:38.723 INFO:teuthology.orchestra.run.smithi133.stderr: 59400K .......... .......... .......... .......... .......... 63% 199M 0s 2024-09-12T00:39:38.724 INFO:teuthology.orchestra.run.smithi133.stderr: 59450K .......... .......... .......... .......... .......... 64% 153M 0s 2024-09-12T00:39:38.724 INFO:teuthology.orchestra.run.smithi133.stderr: 59500K .......... .......... .......... .......... .......... 64% 283M 0s 2024-09-12T00:39:38.724 INFO:teuthology.orchestra.run.smithi133.stderr: 59550K .......... .......... .......... .......... .......... 64% 390M 0s 2024-09-12T00:39:38.724 INFO:teuthology.orchestra.run.smithi133.stderr: 59600K .......... .......... .......... .......... .......... 64% 293M 0s 2024-09-12T00:39:38.724 INFO:teuthology.orchestra.run.smithi133.stderr: 59650K .......... .......... .......... .......... .......... 64% 424M 0s 2024-09-12T00:39:38.724 INFO:teuthology.orchestra.run.smithi133.stderr: 59700K .......... .......... .......... .......... .......... 64% 434M 0s 2024-09-12T00:39:38.724 INFO:teuthology.orchestra.run.smithi133.stderr: 59750K .......... .......... .......... .......... .......... 64% 410M 0s 2024-09-12T00:39:38.724 INFO:teuthology.orchestra.run.smithi133.stderr: 59800K .......... .......... .......... .......... .......... 64% 355M 0s 2024-09-12T00:39:38.724 INFO:teuthology.orchestra.run.smithi133.stderr: 59850K .......... .......... .......... .......... .......... 64% 318M 0s 2024-09-12T00:39:38.724 INFO:teuthology.orchestra.run.smithi133.stderr: 59900K .......... .......... .......... .......... .......... 64% 366M 0s 2024-09-12T00:39:38.724 INFO:teuthology.orchestra.run.smithi133.stderr: 59950K .......... .......... .......... .......... .......... 64% 128M 0s 2024-09-12T00:39:38.724 INFO:teuthology.orchestra.run.smithi133.stderr: 60000K .......... .......... .......... .......... .......... 64% 241M 0s 2024-09-12T00:39:38.724 INFO:teuthology.orchestra.run.smithi133.stderr: 60050K .......... .......... .......... .......... .......... 64% 404M 0s 2024-09-12T00:39:38.724 INFO:teuthology.orchestra.run.smithi133.stderr: 60100K .......... .......... .......... .......... .......... 64% 412M 0s 2024-09-12T00:39:38.725 INFO:teuthology.orchestra.run.smithi133.stderr: 60150K .......... .......... .......... .......... .......... 64% 385M 0s 2024-09-12T00:39:38.725 INFO:teuthology.orchestra.run.smithi133.stderr: 60200K .......... .......... .......... .......... .......... 64% 343M 0s 2024-09-12T00:39:38.725 INFO:teuthology.orchestra.run.smithi133.stderr: 60250K .......... .......... .......... .......... .......... 64% 260M 0s 2024-09-12T00:39:38.725 INFO:teuthology.orchestra.run.smithi133.stderr: 60300K .......... .......... .......... .......... .......... 64% 430M 0s 2024-09-12T00:39:38.725 INFO:teuthology.orchestra.run.smithi133.stderr: 60350K .......... .......... .......... .......... .......... 65% 331M 0s 2024-09-12T00:39:38.725 INFO:teuthology.orchestra.run.smithi133.stderr: 60400K .......... .......... .......... .......... .......... 65% 367M 0s 2024-09-12T00:39:38.725 INFO:teuthology.orchestra.run.smithi133.stderr: 60450K .......... .......... .......... .......... .......... 65% 303M 0s 2024-09-12T00:39:38.725 INFO:teuthology.orchestra.run.smithi133.stderr: 60500K .......... .......... .......... .......... .......... 65% 426M 0s 2024-09-12T00:39:38.725 INFO:teuthology.orchestra.run.smithi133.stderr: 60550K .......... .......... .......... .......... .......... 65% 418M 0s 2024-09-12T00:39:38.725 INFO:teuthology.orchestra.run.smithi133.stderr: 60600K .......... .......... .......... .......... .......... 65% 118M 0s 2024-09-12T00:39:38.725 INFO:teuthology.orchestra.run.smithi133.stderr: 60650K .......... .......... .......... .......... .......... 65% 279M 0s 2024-09-12T00:39:38.725 INFO:teuthology.orchestra.run.smithi133.stderr: 60700K .......... .......... .......... .......... .......... 65% 164M 0s 2024-09-12T00:39:38.725 INFO:teuthology.orchestra.run.smithi133.stderr: 60750K .......... .......... .......... .......... .......... 65% 337M 0s 2024-09-12T00:39:38.726 INFO:teuthology.orchestra.run.smithi133.stderr: 60800K .......... .......... .......... .......... .......... 65% 121M 0s 2024-09-12T00:39:38.726 INFO:teuthology.orchestra.run.smithi133.stderr: 60850K .......... .......... .......... .......... .......... 65% 252M 0s 2024-09-12T00:39:38.726 INFO:teuthology.orchestra.run.smithi133.stderr: 60900K .......... .......... .......... .......... .......... 65% 192M 0s 2024-09-12T00:39:38.726 INFO:teuthology.orchestra.run.smithi133.stderr: 60950K .......... .......... .......... .......... .......... 65% 426M 0s 2024-09-12T00:39:38.726 INFO:teuthology.orchestra.run.smithi133.stderr: 61000K .......... .......... .......... .......... .......... 65% 24.7M 0s 2024-09-12T00:39:38.726 INFO:teuthology.orchestra.run.smithi133.stderr: 61050K .......... .......... .......... .......... .......... 65% 398M 0s 2024-09-12T00:39:38.726 INFO:teuthology.orchestra.run.smithi133.stderr: 61100K .......... .......... .......... .......... .......... 65% 50.0M 0s 2024-09-12T00:39:38.726 INFO:teuthology.orchestra.run.smithi133.stderr: 61150K .......... .......... .......... .......... .......... 65% 392M 0s 2024-09-12T00:39:38.726 INFO:teuthology.orchestra.run.smithi133.stderr: 61200K .......... .......... .......... .......... .......... 65% 120M 0s 2024-09-12T00:39:38.726 INFO:teuthology.orchestra.run.smithi133.stderr: 61250K .......... .......... .......... .......... .......... 65% 415M 0s 2024-09-12T00:39:38.726 INFO:teuthology.orchestra.run.smithi133.stderr: 61300K .......... .......... .......... .......... .......... 66% 89.4M 0s 2024-09-12T00:39:38.726 INFO:teuthology.orchestra.run.smithi133.stderr: 61350K .......... .......... .......... .......... .......... 66% 413M 0s 2024-09-12T00:39:38.726 INFO:teuthology.orchestra.run.smithi133.stderr: 61400K .......... .......... .......... .......... .......... 66% 6.17M 0s 2024-09-12T00:39:38.726 INFO:teuthology.orchestra.run.smithi133.stderr: 61450K .......... .......... .......... .......... .......... 66% 369M 0s 2024-09-12T00:39:38.726 INFO:teuthology.orchestra.run.smithi133.stderr: 61500K .......... .......... .......... .......... .......... 66% 65.0M 0s 2024-09-12T00:39:38.727 INFO:teuthology.orchestra.run.smithi133.stderr: 61550K .......... .......... .......... .......... .......... 66% 54.2M 0s 2024-09-12T00:39:38.727 INFO:teuthology.orchestra.run.smithi133.stderr: 61600K .......... .......... .......... .......... .......... 66% 47.8M 0s 2024-09-12T00:39:38.727 INFO:teuthology.orchestra.run.smithi133.stderr: 61650K .......... .......... .......... .......... .......... 66% 399M 0s 2024-09-12T00:39:38.727 INFO:teuthology.orchestra.run.smithi133.stderr: 61700K .......... .......... .......... .......... .......... 66% 340M 0s 2024-09-12T00:39:38.727 INFO:teuthology.orchestra.run.smithi133.stderr: 61750K .......... .......... .......... .......... .......... 66% 95.5M 0s 2024-09-12T00:39:38.727 INFO:teuthology.orchestra.run.smithi133.stderr: 61800K .......... .......... .......... .......... .......... 66% 93.8M 0s 2024-09-12T00:39:38.727 INFO:teuthology.orchestra.run.smithi133.stderr: 61850K .......... .......... .......... .......... .......... 66% 309M 0s 2024-09-12T00:39:38.727 INFO:teuthology.orchestra.run.smithi133.stderr: 61900K .......... .......... .......... .......... .......... 66% 371M 0s 2024-09-12T00:39:38.727 INFO:teuthology.orchestra.run.smithi133.stderr: 61950K .......... .......... .......... .......... .......... 66% 34.3M 0s 2024-09-12T00:39:38.727 INFO:teuthology.orchestra.run.smithi133.stderr: 62000K .......... .......... .......... .......... .......... 66% 338M 0s 2024-09-12T00:39:38.727 INFO:teuthology.orchestra.run.smithi133.stderr: 62050K .......... .......... .......... .......... .......... 66% 291M 0s 2024-09-12T00:39:38.727 INFO:teuthology.orchestra.run.smithi133.stderr: 62100K .......... .......... .......... .......... .......... 66% 174M 0s 2024-09-12T00:39:38.727 INFO:teuthology.orchestra.run.smithi133.stderr: 62150K .......... .......... .......... .......... .......... 66% 409M 0s 2024-09-12T00:39:38.727 INFO:teuthology.orchestra.run.smithi133.stderr: 62200K .......... .......... .......... .......... .......... 67% 101M 0s 2024-09-12T00:39:38.727 INFO:teuthology.orchestra.run.smithi133.stderr: 62250K .......... .......... .......... .......... .......... 67% 49.2M 0s 2024-09-12T00:39:38.728 INFO:teuthology.orchestra.run.smithi133.stderr: 62300K .......... .......... .......... .......... .......... 67% 18.8M 0s 2024-09-12T00:39:38.728 INFO:teuthology.orchestra.run.smithi133.stderr: 62350K .......... .......... .......... .......... .......... 67% 443M 0s 2024-09-12T00:39:38.728 INFO:teuthology.orchestra.run.smithi133.stderr: 62400K .......... .......... .......... .......... .......... 67% 64.9M 0s 2024-09-12T00:39:38.728 INFO:teuthology.orchestra.run.smithi133.stderr: 62450K .......... .......... .......... .......... .......... 67% 356M 0s 2024-09-12T00:39:38.728 INFO:teuthology.orchestra.run.smithi133.stderr: 62500K .......... .......... .......... .......... .......... 67% 334M 0s 2024-09-12T00:39:38.728 INFO:teuthology.orchestra.run.smithi133.stderr: 62550K .......... .......... .......... .......... .......... 67% 294M 0s 2024-09-12T00:39:38.728 INFO:teuthology.orchestra.run.smithi133.stderr: 62600K .......... .......... .......... .......... .......... 67% 23.3M 0s 2024-09-12T00:39:38.728 INFO:teuthology.orchestra.run.smithi133.stderr: 62650K .......... .......... .......... .......... .......... 67% 406M 0s 2024-09-12T00:39:38.728 INFO:teuthology.orchestra.run.smithi133.stderr: 62700K .......... .......... .......... .......... .......... 67% 26.6M 0s 2024-09-12T00:39:38.728 INFO:teuthology.orchestra.run.smithi133.stderr: 62750K .......... .......... .......... .......... .......... 67% 60.3M 0s 2024-09-12T00:39:38.728 INFO:teuthology.orchestra.run.smithi133.stderr: 62800K .......... .......... .......... .......... .......... 67% 165M 0s 2024-09-12T00:39:38.728 INFO:teuthology.orchestra.run.smithi133.stderr: 62850K .......... .......... .......... .......... .......... 67% 406M 0s 2024-09-12T00:39:38.728 INFO:teuthology.orchestra.run.smithi133.stderr: 62900K .......... .......... .......... .......... .......... 67% 410M 0s 2024-09-12T00:39:38.729 INFO:teuthology.orchestra.run.smithi133.stderr: 62950K .......... .......... .......... .......... .......... 67% 183M 0s 2024-09-12T00:39:38.729 INFO:teuthology.orchestra.run.smithi133.stderr: 63000K .......... .......... .......... .......... .......... 67% 410M 0s 2024-09-12T00:39:38.729 INFO:teuthology.orchestra.run.smithi133.stderr: 63050K .......... .......... .......... .......... .......... 67% 319M 0s 2024-09-12T00:39:38.729 INFO:teuthology.orchestra.run.smithi133.stderr: 63100K .......... .......... .......... .......... .......... 67% 269M 0s 2024-09-12T00:39:38.729 INFO:teuthology.orchestra.run.smithi133.stderr: 63150K .......... .......... .......... .......... .......... 68% 323M 0s 2024-09-12T00:39:38.729 INFO:teuthology.orchestra.run.smithi133.stderr: 63200K .......... .......... .......... .......... .......... 68% 89.5M 0s 2024-09-12T00:39:38.729 INFO:teuthology.orchestra.run.smithi133.stderr: 63250K .......... .......... .......... .......... .......... 68% 327M 0s 2024-09-12T00:39:38.729 INFO:teuthology.orchestra.run.smithi133.stderr: 63300K .......... .......... .......... .......... .......... 68% 450M 0s 2024-09-12T00:39:38.729 INFO:teuthology.orchestra.run.smithi133.stderr: 63350K .......... .......... .......... .......... .......... 68% 402M 0s 2024-09-12T00:39:38.729 INFO:teuthology.orchestra.run.smithi133.stderr: 63400K .......... .......... .......... .......... .......... 68% 169M 0s 2024-09-12T00:39:38.729 INFO:teuthology.orchestra.run.smithi133.stderr: 63450K .......... .......... .......... .......... .......... 68% 307M 0s 2024-09-12T00:39:38.729 INFO:teuthology.orchestra.run.smithi133.stderr: 63500K .......... .......... .......... .......... .......... 68% 392M 0s 2024-09-12T00:39:38.729 INFO:teuthology.orchestra.run.smithi133.stderr: 63550K .......... .......... .......... .......... .......... 68% 364M 0s 2024-09-12T00:39:38.729 INFO:teuthology.orchestra.run.smithi133.stderr: 63600K .......... .......... .......... .......... .......... 68% 147M 0s 2024-09-12T00:39:38.730 INFO:teuthology.orchestra.run.smithi133.stderr: 63650K .......... .......... .......... .......... .......... 68% 257M 0s 2024-09-12T00:39:38.730 INFO:teuthology.orchestra.run.smithi133.stderr: 63700K .......... .......... .......... .......... .......... 68% 440M 0s 2024-09-12T00:39:38.730 INFO:teuthology.orchestra.run.smithi133.stderr: 63750K .......... .......... .......... .......... .......... 68% 380M 0s 2024-09-12T00:39:38.730 INFO:teuthology.orchestra.run.smithi133.stderr: 63800K .......... .......... .......... .......... .......... 68% 407M 0s 2024-09-12T00:39:38.730 INFO:teuthology.orchestra.run.smithi133.stderr: 63850K .......... .......... .......... .......... .......... 68% 430M 0s 2024-09-12T00:39:38.730 INFO:teuthology.orchestra.run.smithi133.stderr: 63900K .......... .......... .......... .......... .......... 68% 452M 0s 2024-09-12T00:39:38.730 INFO:teuthology.orchestra.run.smithi133.stderr: 63950K .......... .......... .......... .......... .......... 68% 367M 0s 2024-09-12T00:39:38.730 INFO:teuthology.orchestra.run.smithi133.stderr: 64000K .......... .......... .......... .......... .......... 68% 464M 0s 2024-09-12T00:39:38.730 INFO:teuthology.orchestra.run.smithi133.stderr: 64050K .......... .......... .......... .......... .......... 68% 442M 0s 2024-09-12T00:39:38.730 INFO:teuthology.orchestra.run.smithi133.stderr: 64100K .......... .......... .......... .......... .......... 69% 457M 0s 2024-09-12T00:39:38.730 INFO:teuthology.orchestra.run.smithi133.stderr: 64150K .......... .......... .......... .......... .......... 69% 354M 0s 2024-09-12T00:39:38.730 INFO:teuthology.orchestra.run.smithi133.stderr: 64200K .......... .......... .......... .......... .......... 69% 397M 0s 2024-09-12T00:39:38.730 INFO:teuthology.orchestra.run.smithi133.stderr: 64250K .......... .......... .......... .......... .......... 69% 380M 0s 2024-09-12T00:39:38.730 INFO:teuthology.orchestra.run.smithi133.stderr: 64300K .......... .......... .......... .......... .......... 69% 172M 0s 2024-09-12T00:39:38.731 INFO:teuthology.orchestra.run.smithi133.stderr: 64350K .......... .......... .......... .......... .......... 69% 53.1M 0s 2024-09-12T00:39:38.731 INFO:teuthology.orchestra.run.smithi133.stderr: 64400K .......... .......... .......... .......... .......... 69% 258M 0s 2024-09-12T00:39:38.731 INFO:teuthology.orchestra.run.smithi133.stderr: 64450K .......... .......... .......... .......... .......... 69% 57.2M 0s 2024-09-12T00:39:38.731 INFO:teuthology.orchestra.run.smithi133.stderr: 64500K .......... .......... .......... .......... .......... 69% 231M 0s 2024-09-12T00:39:38.731 INFO:teuthology.orchestra.run.smithi133.stderr: 64550K .......... .......... .......... .......... .......... 69% 402M 0s 2024-09-12T00:39:38.731 INFO:teuthology.orchestra.run.smithi133.stderr: 64600K .......... .......... .......... .......... .......... 69% 441M 0s 2024-09-12T00:39:38.731 INFO:teuthology.orchestra.run.smithi133.stderr: 64650K .......... .......... .......... .......... .......... 69% 403M 0s 2024-09-12T00:39:38.731 INFO:teuthology.orchestra.run.smithi133.stderr: 64700K .......... .......... .......... .......... .......... 69% 449M 0s 2024-09-12T00:39:38.731 INFO:teuthology.orchestra.run.smithi133.stderr: 64750K .......... .......... .......... .......... .......... 69% 369M 0s 2024-09-12T00:39:38.731 INFO:teuthology.orchestra.run.smithi133.stderr: 64800K .......... .......... .......... .......... .......... 69% 17.9M 0s 2024-09-12T00:39:38.731 INFO:teuthology.orchestra.run.smithi133.stderr: 64850K .......... .......... .......... .......... .......... 69% 40.6M 0s 2024-09-12T00:39:38.731 INFO:teuthology.orchestra.run.smithi133.stderr: 64900K .......... .......... .......... .......... .......... 69% 161M 0s 2024-09-12T00:39:38.731 INFO:teuthology.orchestra.run.smithi133.stderr: 64950K .......... .......... .......... .......... .......... 69% 324M 0s 2024-09-12T00:39:38.731 INFO:teuthology.orchestra.run.smithi133.stderr: 65000K .......... .......... .......... .......... .......... 70% 209M 0s 2024-09-12T00:39:38.732 INFO:teuthology.orchestra.run.smithi133.stderr: 65050K .......... .......... .......... .......... .......... 70% 151M 0s 2024-09-12T00:39:38.732 INFO:teuthology.orchestra.run.smithi133.stderr: 65100K .......... .......... .......... .......... .......... 70% 356M 0s 2024-09-12T00:39:38.732 INFO:teuthology.orchestra.run.smithi133.stderr: 65150K .......... .......... .......... .......... .......... 70% 344M 0s 2024-09-12T00:39:38.732 INFO:teuthology.orchestra.run.smithi133.stderr: 65200K .......... .......... .......... .......... .......... 70% 58.3M 0s 2024-09-12T00:39:38.732 INFO:teuthology.orchestra.run.smithi133.stderr: 65250K .......... .......... .......... .......... .......... 70% 100M 0s 2024-09-12T00:39:38.732 INFO:teuthology.orchestra.run.smithi133.stderr: 65300K .......... .......... .......... .......... .......... 70% 353M 0s 2024-09-12T00:39:38.732 INFO:teuthology.orchestra.run.smithi133.stderr: 65350K .......... .......... .......... .......... .......... 70% 386M 0s 2024-09-12T00:39:38.732 INFO:teuthology.orchestra.run.smithi133.stderr: 65400K .......... .......... .......... .......... .......... 70% 152M 0s 2024-09-12T00:39:38.732 INFO:teuthology.orchestra.run.smithi133.stderr: 65450K .......... .......... .......... .......... .......... 70% 237M 0s 2024-09-12T00:39:38.732 INFO:teuthology.orchestra.run.smithi133.stderr: 65500K .......... .......... .......... .......... .......... 70% 324M 0s 2024-09-12T00:39:38.732 INFO:teuthology.orchestra.run.smithi133.stderr: 65550K .......... .......... .......... .......... .......... 70% 244M 0s 2024-09-12T00:39:38.732 INFO:teuthology.orchestra.run.smithi133.stderr: 65600K .......... .......... .......... .......... .......... 70% 256M 0s 2024-09-12T00:39:38.732 INFO:teuthology.orchestra.run.smithi133.stderr: 65650K .......... .......... .......... .......... .......... 70% 58.2M 0s 2024-09-12T00:39:38.732 INFO:teuthology.orchestra.run.smithi133.stderr: 65700K .......... .......... .......... .......... .......... 70% 361M 0s 2024-09-12T00:39:38.733 INFO:teuthology.orchestra.run.smithi133.stderr: 65750K .......... .......... .......... .......... .......... 70% 144M 0s 2024-09-12T00:39:38.733 INFO:teuthology.orchestra.run.smithi133.stderr: 65800K .......... .......... .......... .......... .......... 70% 383M 0s 2024-09-12T00:39:38.733 INFO:teuthology.orchestra.run.smithi133.stderr: 65850K .......... .......... .......... .......... .......... 70% 105M 0s 2024-09-12T00:39:38.733 INFO:teuthology.orchestra.run.smithi133.stderr: 65900K .......... .......... .......... .......... .......... 70% 259M 0s 2024-09-12T00:39:38.733 INFO:teuthology.orchestra.run.smithi133.stderr: 65950K .......... .......... .......... .......... .......... 71% 225M 0s 2024-09-12T00:39:38.733 INFO:teuthology.orchestra.run.smithi133.stderr: 66000K .......... .......... .......... .......... .......... 71% 98.7M 0s 2024-09-12T00:39:38.733 INFO:teuthology.orchestra.run.smithi133.stderr: 66050K .......... .......... .......... .......... .......... 71% 370M 0s 2024-09-12T00:39:38.733 INFO:teuthology.orchestra.run.smithi133.stderr: 66100K .......... .......... .......... .......... .......... 71% 224M 0s 2024-09-12T00:39:38.733 INFO:teuthology.orchestra.run.smithi133.stderr: 66150K .......... .......... .......... .......... .......... 71% 122M 0s 2024-09-12T00:39:38.733 INFO:teuthology.orchestra.run.smithi133.stderr: 66200K .......... .......... .......... .......... .......... 71% 127M 0s 2024-09-12T00:39:38.733 INFO:teuthology.orchestra.run.smithi133.stderr: 66250K .......... .......... .......... .......... .......... 71% 345M 0s 2024-09-12T00:39:38.733 INFO:teuthology.orchestra.run.smithi133.stderr: 66300K .......... .......... .......... .......... .......... 71% 226M 0s 2024-09-12T00:39:38.733 INFO:teuthology.orchestra.run.smithi133.stderr: 66350K .......... .......... .......... .......... .......... 71% 216M 0s 2024-09-12T00:39:38.733 INFO:teuthology.orchestra.run.smithi133.stderr: 66400K .......... .......... .......... .......... .......... 71% 26.2M 0s 2024-09-12T00:39:38.734 INFO:teuthology.orchestra.run.smithi133.stderr: 66450K .......... .......... .......... .......... .......... 71% 349M 0s 2024-09-12T00:39:38.734 INFO:teuthology.orchestra.run.smithi133.stderr: 66500K .......... .......... .......... .......... .......... 71% 361M 0s 2024-09-12T00:39:38.734 INFO:teuthology.orchestra.run.smithi133.stderr: 66550K .......... .......... .......... .......... .......... 71% 370M 0s 2024-09-12T00:39:38.734 INFO:teuthology.orchestra.run.smithi133.stderr: 66600K .......... .......... .......... .......... .......... 71% 387M 0s 2024-09-12T00:39:38.734 INFO:teuthology.orchestra.run.smithi133.stderr: 66650K .......... .......... .......... .......... .......... 71% 311M 0s 2024-09-12T00:39:38.734 INFO:teuthology.orchestra.run.smithi133.stderr: 66700K .......... .......... .......... .......... .......... 71% 318M 0s 2024-09-12T00:39:38.734 INFO:teuthology.orchestra.run.smithi133.stderr: 66750K .......... .......... .......... .......... .......... 71% 71.1M 0s 2024-09-12T00:39:38.734 INFO:teuthology.orchestra.run.smithi133.stderr: 66800K .......... .......... .......... .......... .......... 71% 334M 0s 2024-09-12T00:39:38.734 INFO:teuthology.orchestra.run.smithi133.stderr: 66850K .......... .......... .......... .......... .......... 72% 327M 0s 2024-09-12T00:39:38.734 INFO:teuthology.orchestra.run.smithi133.stderr: 66900K .......... .......... .......... .......... .......... 72% 375M 0s 2024-09-12T00:39:38.734 INFO:teuthology.orchestra.run.smithi133.stderr: 66950K .......... .......... .......... .......... .......... 72% 377M 0s 2024-09-12T00:39:38.734 INFO:teuthology.orchestra.run.smithi133.stderr: 67000K .......... .......... .......... .......... .......... 72% 389M 0s 2024-09-12T00:39:38.734 INFO:teuthology.orchestra.run.smithi133.stderr: 67050K .......... .......... .......... .......... .......... 72% 327M 0s 2024-09-12T00:39:38.735 INFO:teuthology.orchestra.run.smithi133.stderr: 67100K .......... .......... .......... .......... .......... 72% 369M 0s 2024-09-12T00:39:38.735 INFO:teuthology.orchestra.run.smithi133.stderr: 67150K .......... .......... .......... .......... .......... 72% 386M 0s 2024-09-12T00:39:38.735 INFO:teuthology.orchestra.run.smithi133.stderr: 67200K .......... .......... .......... .......... .......... 72% 398M 0s 2024-09-12T00:39:38.735 INFO:teuthology.orchestra.run.smithi133.stderr: 67250K .......... .......... .......... .......... .......... 72% 342M 0s 2024-09-12T00:39:38.735 INFO:teuthology.orchestra.run.smithi133.stderr: 67300K .......... .......... .......... .......... .......... 72% 399M 0s 2024-09-12T00:39:38.735 INFO:teuthology.orchestra.run.smithi133.stderr: 67350K .......... .......... .......... .......... .......... 72% 382M 0s 2024-09-12T00:39:38.735 INFO:teuthology.orchestra.run.smithi133.stderr: 67400K .......... .......... .......... .......... .......... 72% 388M 0s 2024-09-12T00:39:38.735 INFO:teuthology.orchestra.run.smithi133.stderr: 67450K .......... .......... .......... .......... .......... 72% 280M 0s 2024-09-12T00:39:38.735 INFO:teuthology.orchestra.run.smithi133.stderr: 67500K .......... .......... .......... .......... .......... 72% 334M 0s 2024-09-12T00:39:38.735 INFO:teuthology.orchestra.run.smithi133.stderr: 67550K .......... .......... .......... .......... .......... 72% 354M 0s 2024-09-12T00:39:38.735 INFO:teuthology.orchestra.run.smithi133.stderr: 67600K .......... .......... .......... .......... .......... 72% 312M 0s 2024-09-12T00:39:38.735 INFO:teuthology.orchestra.run.smithi133.stderr: 67650K .......... .......... .......... .......... .......... 72% 347M 0s 2024-09-12T00:39:38.735 INFO:teuthology.orchestra.run.smithi133.stderr: 67700K .......... .......... .......... .......... .......... 72% 390M 0s 2024-09-12T00:39:38.735 INFO:teuthology.orchestra.run.smithi133.stderr: 67750K .......... .......... .......... .......... .......... 72% 375M 0s 2024-09-12T00:39:38.736 INFO:teuthology.orchestra.run.smithi133.stderr: 67800K .......... .......... .......... .......... .......... 73% 405M 0s 2024-09-12T00:39:38.736 INFO:teuthology.orchestra.run.smithi133.stderr: 67850K .......... .......... .......... .......... .......... 73% 289M 0s 2024-09-12T00:39:38.736 INFO:teuthology.orchestra.run.smithi133.stderr: 67900K .......... .......... .......... .......... .......... 73% 383M 0s 2024-09-12T00:39:38.736 INFO:teuthology.orchestra.run.smithi133.stderr: 67950K .......... .......... .......... .......... .......... 73% 407M 0s 2024-09-12T00:39:38.736 INFO:teuthology.orchestra.run.smithi133.stderr: 68000K .......... .......... .......... .......... .......... 73% 400M 0s 2024-09-12T00:39:38.736 INFO:teuthology.orchestra.run.smithi133.stderr: 68050K .......... .......... .......... .......... .......... 73% 366M 0s 2024-09-12T00:39:38.736 INFO:teuthology.orchestra.run.smithi133.stderr: 68100K .......... .......... .......... .......... .......... 73% 383M 0s 2024-09-12T00:39:38.736 INFO:teuthology.orchestra.run.smithi133.stderr: 68150K .......... .......... .......... .......... .......... 73% 397M 0s 2024-09-12T00:39:38.736 INFO:teuthology.orchestra.run.smithi133.stderr: 68200K .......... .......... .......... .......... .......... 73% 106M 0s 2024-09-12T00:39:38.736 INFO:teuthology.orchestra.run.smithi133.stderr: 68250K .......... .......... .......... .......... .......... 73% 40.5M 0s 2024-09-12T00:39:38.736 INFO:teuthology.orchestra.run.smithi133.stderr: 68300K .......... .......... .......... .......... .......... 73% 301M 0s 2024-09-12T00:39:38.736 INFO:teuthology.orchestra.run.smithi133.stderr: 68350K .......... .......... .......... .......... .......... 73% 204M 0s 2024-09-12T00:39:38.736 INFO:teuthology.orchestra.run.smithi133.stderr: 68400K .......... .......... .......... .......... .......... 73% 254M 0s 2024-09-12T00:39:38.736 INFO:teuthology.orchestra.run.smithi133.stderr: 68450K .......... .......... .......... .......... .......... 73% 358M 0s 2024-09-12T00:39:38.737 INFO:teuthology.orchestra.run.smithi133.stderr: 68500K .......... .......... .......... .......... .......... 73% 349M 0s 2024-09-12T00:39:38.737 INFO:teuthology.orchestra.run.smithi133.stderr: 68550K .......... .......... .......... .......... .......... 73% 364M 0s 2024-09-12T00:39:38.737 INFO:teuthology.orchestra.run.smithi133.stderr: 68600K .......... .......... .......... .......... .......... 73% 367M 0s 2024-09-12T00:39:38.737 INFO:teuthology.orchestra.run.smithi133.stderr: 68650K .......... .......... .......... .......... .......... 73% 330M 0s 2024-09-12T00:39:38.737 INFO:teuthology.orchestra.run.smithi133.stderr: 68700K .......... .......... .......... .......... .......... 74% 349M 0s 2024-09-12T00:39:38.737 INFO:teuthology.orchestra.run.smithi133.stderr: 68750K .......... .......... .......... .......... .......... 74% 345M 0s 2024-09-12T00:39:38.737 INFO:teuthology.orchestra.run.smithi133.stderr: 68800K .......... .......... .......... .......... .......... 74% 303M 0s 2024-09-12T00:39:38.737 INFO:teuthology.orchestra.run.smithi133.stderr: 68850K .......... .......... .......... .......... .......... 74% 147M 0s 2024-09-12T00:39:38.737 INFO:teuthology.orchestra.run.smithi133.stderr: 68900K .......... .......... .......... .......... .......... 74% 291M 0s 2024-09-12T00:39:38.737 INFO:teuthology.orchestra.run.smithi133.stderr: 68950K .......... .......... .......... .......... .......... 74% 174M 0s 2024-09-12T00:39:38.737 INFO:teuthology.orchestra.run.smithi133.stderr: 69000K .......... .......... .......... .......... .......... 74% 226M 0s 2024-09-12T00:39:38.737 INFO:teuthology.orchestra.run.smithi133.stderr: 69050K .......... .......... .......... .......... .......... 74% 399M 0s 2024-09-12T00:39:38.737 INFO:teuthology.orchestra.run.smithi133.stderr: 69100K .......... .......... .......... .......... .......... 74% 402M 0s 2024-09-12T00:39:38.737 INFO:teuthology.orchestra.run.smithi133.stderr: 69150K .......... .......... .......... .......... .......... 74% 294M 0s 2024-09-12T00:39:38.737 INFO:teuthology.orchestra.run.smithi133.stderr: 69200K .......... .......... .......... .......... .......... 74% 285M 0s 2024-09-12T00:39:38.738 INFO:teuthology.orchestra.run.smithi133.stderr: 69250K .......... .......... .......... .......... .......... 74% 380M 0s 2024-09-12T00:39:38.738 INFO:teuthology.orchestra.run.smithi133.stderr: 69300K .......... .......... .......... .......... .......... 74% 394M 0s 2024-09-12T00:39:38.738 INFO:teuthology.orchestra.run.smithi133.stderr: 69350K .......... .......... .......... .......... .......... 74% 342M 0s 2024-09-12T00:39:38.738 INFO:teuthology.orchestra.run.smithi133.stderr: 69400K .......... .......... .......... .......... .......... 74% 394M 0s 2024-09-12T00:39:38.738 INFO:teuthology.orchestra.run.smithi133.stderr: 69450K .......... .......... .......... .......... .......... 74% 381M 0s 2024-09-12T00:39:38.738 INFO:teuthology.orchestra.run.smithi133.stderr: 69500K .......... .......... .......... .......... .......... 74% 57.4M 0s 2024-09-12T00:39:38.738 INFO:teuthology.orchestra.run.smithi133.stderr: 69550K .......... .......... .......... .......... .......... 74% 302M 0s 2024-09-12T00:39:38.738 INFO:teuthology.orchestra.run.smithi133.stderr: 69600K .......... .......... .......... .......... .......... 74% 188M 0s 2024-09-12T00:39:38.738 INFO:teuthology.orchestra.run.smithi133.stderr: 69650K .......... .......... .......... .......... .......... 75% 337M 0s 2024-09-12T00:39:38.738 INFO:teuthology.orchestra.run.smithi133.stderr: 69700K .......... .......... .......... .......... .......... 75% 355M 0s 2024-09-12T00:39:38.738 INFO:teuthology.orchestra.run.smithi133.stderr: 69750K .......... .......... .......... .......... .......... 75% 369M 0s 2024-09-12T00:39:38.738 INFO:teuthology.orchestra.run.smithi133.stderr: 69800K .......... .......... .......... .......... .......... 75% 117M 0s 2024-09-12T00:39:38.738 INFO:teuthology.orchestra.run.smithi133.stderr: 69850K .......... .......... .......... .......... .......... 75% 119M 0s 2024-09-12T00:39:38.739 INFO:teuthology.orchestra.run.smithi133.stderr: 69900K .......... .......... .......... .......... .......... 75% 405M 0s 2024-09-12T00:39:38.739 INFO:teuthology.orchestra.run.smithi133.stderr: 69950K .......... .......... .......... .......... .......... 75% 291M 0s 2024-09-12T00:39:38.739 INFO:teuthology.orchestra.run.smithi133.stderr: 70000K .......... .......... .......... .......... .......... 75% 395M 0s 2024-09-12T00:39:38.739 INFO:teuthology.orchestra.run.smithi133.stderr: 70050K .......... .......... .......... .......... .......... 75% 290M 0s 2024-09-12T00:39:38.739 INFO:teuthology.orchestra.run.smithi133.stderr: 70100K .......... .......... .......... .......... .......... 75% 212M 0s 2024-09-12T00:39:38.739 INFO:teuthology.orchestra.run.smithi133.stderr: 70150K .......... .......... .......... .......... .......... 75% 272M 0s 2024-09-12T00:39:38.739 INFO:teuthology.orchestra.run.smithi133.stderr: 70200K .......... .......... .......... .......... .......... 75% 215M 0s 2024-09-12T00:39:38.739 INFO:teuthology.orchestra.run.smithi133.stderr: 70250K .......... .......... .......... .......... .......... 75% 261M 0s 2024-09-12T00:39:38.739 INFO:teuthology.orchestra.run.smithi133.stderr: 70300K .......... .......... .......... .......... .......... 75% 322M 0s 2024-09-12T00:39:38.739 INFO:teuthology.orchestra.run.smithi133.stderr: 70350K .......... .......... .......... .......... .......... 75% 292M 0s 2024-09-12T00:39:38.739 INFO:teuthology.orchestra.run.smithi133.stderr: 70400K .......... .......... .......... .......... .......... 75% 309M 0s 2024-09-12T00:39:38.739 INFO:teuthology.orchestra.run.smithi133.stderr: 70450K .......... .......... .......... .......... .......... 75% 375M 0s 2024-09-12T00:39:38.739 INFO:teuthology.orchestra.run.smithi133.stderr: 70500K .......... .......... .......... .......... .......... 75% 327M 0s 2024-09-12T00:39:38.739 INFO:teuthology.orchestra.run.smithi133.stderr: 70550K .......... .......... .......... .......... .......... 75% 343M 0s 2024-09-12T00:39:38.739 INFO:teuthology.orchestra.run.smithi133.stderr: 70600K .......... .......... .......... .......... .......... 76% 335M 0s 2024-09-12T00:39:38.740 INFO:teuthology.orchestra.run.smithi133.stderr: 70650K .......... .......... .......... .......... .......... 76% 367M 0s 2024-09-12T00:39:38.740 INFO:teuthology.orchestra.run.smithi133.stderr: 70700K .......... .......... .......... .......... .......... 76% 107M 0s 2024-09-12T00:39:38.740 INFO:teuthology.orchestra.run.smithi133.stderr: 70750K .......... .......... .......... .......... .......... 76% 265M 0s 2024-09-12T00:39:38.740 INFO:teuthology.orchestra.run.smithi133.stderr: 70800K .......... .......... .......... .......... .......... 76% 396M 0s 2024-09-12T00:39:38.740 INFO:teuthology.orchestra.run.smithi133.stderr: 70850K .......... .......... .......... .......... .......... 76% 390M 0s 2024-09-12T00:39:38.740 INFO:teuthology.orchestra.run.smithi133.stderr: 70900K .......... .......... .......... .......... .......... 76% 347M 0s 2024-09-12T00:39:38.740 INFO:teuthology.orchestra.run.smithi133.stderr: 70950K .......... .......... .......... .......... .......... 76% 313M 0s 2024-09-12T00:39:38.740 INFO:teuthology.orchestra.run.smithi133.stderr: 71000K .......... .......... .......... .......... .......... 76% 398M 0s 2024-09-12T00:39:38.740 INFO:teuthology.orchestra.run.smithi133.stderr: 71050K .......... .......... .......... .......... .......... 76% 392M 0s 2024-09-12T00:39:38.740 INFO:teuthology.orchestra.run.smithi133.stderr: 71100K .......... .......... .......... .......... .......... 76% 379M 0s 2024-09-12T00:39:38.740 INFO:teuthology.orchestra.run.smithi133.stderr: 71150K .......... .......... .......... .......... .......... 76% 116M 0s 2024-09-12T00:39:38.740 INFO:teuthology.orchestra.run.smithi133.stderr: 71200K .......... .......... .......... .......... .......... 76% 374M 0s 2024-09-12T00:39:38.740 INFO:teuthology.orchestra.run.smithi133.stderr: 71250K .......... .......... .......... .......... .......... 76% 13.4M 0s 2024-09-12T00:39:38.741 INFO:teuthology.orchestra.run.smithi133.stderr: 71300K .......... .......... .......... .......... .......... 76% 360M 0s 2024-09-12T00:39:38.741 INFO:teuthology.orchestra.run.smithi133.stderr: 71350K .......... .......... .......... .......... .......... 76% 110M 0s 2024-09-12T00:39:38.741 INFO:teuthology.orchestra.run.smithi133.stderr: 71400K .......... .......... .......... .......... .......... 76% 97.0M 0s 2024-09-12T00:39:38.741 INFO:teuthology.orchestra.run.smithi133.stderr: 71450K .......... .......... .......... .......... .......... 76% 380M 0s 2024-09-12T00:39:38.741 INFO:teuthology.orchestra.run.smithi133.stderr: 71500K .......... .......... .......... .......... .......... 77% 372M 0s 2024-09-12T00:39:38.741 INFO:teuthology.orchestra.run.smithi133.stderr: 71550K .......... .......... .......... .......... .......... 77% 311M 0s 2024-09-12T00:39:38.741 INFO:teuthology.orchestra.run.smithi133.stderr: 71600K .......... .......... .......... .......... .......... 77% 36.7M 0s 2024-09-12T00:39:38.741 INFO:teuthology.orchestra.run.smithi133.stderr: 71650K .......... .......... .......... .......... .......... 77% 23.6M 0s 2024-09-12T00:39:38.741 INFO:teuthology.orchestra.run.smithi133.stderr: 71700K .......... .......... .......... .......... .......... 77% 339M 0s 2024-09-12T00:39:38.741 INFO:teuthology.orchestra.run.smithi133.stderr: 71750K .......... .......... .......... .......... .......... 77% 415M 0s 2024-09-12T00:39:38.741 INFO:teuthology.orchestra.run.smithi133.stderr: 71800K .......... .......... .......... .......... .......... 77% 331M 0s 2024-09-12T00:39:38.741 INFO:teuthology.orchestra.run.smithi133.stderr: 71850K .......... .......... .......... .......... .......... 77% 380M 0s 2024-09-12T00:39:38.741 INFO:teuthology.orchestra.run.smithi133.stderr: 71900K .......... .......... .......... .......... .......... 77% 289M 0s 2024-09-12T00:39:38.741 INFO:teuthology.orchestra.run.smithi133.stderr: 71950K .......... .......... .......... .......... .......... 77% 358M 0s 2024-09-12T00:39:38.742 INFO:teuthology.orchestra.run.smithi133.stderr: 72000K .......... .......... .......... .......... .......... 77% 384M 0s 2024-09-12T00:39:38.742 INFO:teuthology.orchestra.run.smithi133.stderr: 72050K .......... .......... .......... .......... .......... 77% 257M 0s 2024-09-12T00:39:38.742 INFO:teuthology.orchestra.run.smithi133.stderr: 72100K .......... .......... .......... .......... .......... 77% 318M 0s 2024-09-12T00:39:38.742 INFO:teuthology.orchestra.run.smithi133.stderr: 72150K .......... .......... .......... .......... .......... 77% 275M 0s 2024-09-12T00:39:38.742 INFO:teuthology.orchestra.run.smithi133.stderr: 72200K .......... .......... .......... .......... .......... 77% 388M 0s 2024-09-12T00:39:38.742 INFO:teuthology.orchestra.run.smithi133.stderr: 72250K .......... .......... .......... .......... .......... 77% 363M 0s 2024-09-12T00:39:38.742 INFO:teuthology.orchestra.run.smithi133.stderr: 72300K .......... .......... .......... .......... .......... 77% 322M 0s 2024-09-12T00:39:38.742 INFO:teuthology.orchestra.run.smithi133.stderr: 72350K .......... .......... .......... .......... .......... 77% 306M 0s 2024-09-12T00:39:38.742 INFO:teuthology.orchestra.run.smithi133.stderr: 72400K .......... .......... .......... .......... .......... 77% 196M 0s 2024-09-12T00:39:38.742 INFO:teuthology.orchestra.run.smithi133.stderr: 72450K .......... .......... .......... .......... .......... 78% 370M 0s 2024-09-12T00:39:38.742 INFO:teuthology.orchestra.run.smithi133.stderr: 72500K .......... .......... .......... .......... .......... 78% 342M 0s 2024-09-12T00:39:38.742 INFO:teuthology.orchestra.run.smithi133.stderr: 72550K .......... .......... .......... .......... .......... 78% 342M 0s 2024-09-12T00:39:38.742 INFO:teuthology.orchestra.run.smithi133.stderr: 72600K .......... .......... .......... .......... .......... 78% 250M 0s 2024-09-12T00:39:38.742 INFO:teuthology.orchestra.run.smithi133.stderr: 72650K .......... .......... .......... .......... .......... 78% 14.6M 0s 2024-09-12T00:39:38.743 INFO:teuthology.orchestra.run.smithi133.stderr: 72700K .......... .......... .......... .......... .......... 78% 85.2M 0s 2024-09-12T00:39:38.743 INFO:teuthology.orchestra.run.smithi133.stderr: 72750K .......... .......... .......... .......... .......... 78% 16.9M 0s 2024-09-12T00:39:38.743 INFO:teuthology.orchestra.run.smithi133.stderr: 72800K .......... .......... .......... .......... .......... 78% 258M 0s 2024-09-12T00:39:38.743 INFO:teuthology.orchestra.run.smithi133.stderr: 72850K .......... .......... .......... .......... .......... 78% 269M 0s 2024-09-12T00:39:38.743 INFO:teuthology.orchestra.run.smithi133.stderr: 72900K .......... .......... .......... .......... .......... 78% 250M 0s 2024-09-12T00:39:38.743 INFO:teuthology.orchestra.run.smithi133.stderr: 72950K .......... .......... .......... .......... .......... 78% 69.3M 0s 2024-09-12T00:39:38.743 INFO:teuthology.orchestra.run.smithi133.stderr: 73000K .......... .......... .......... .......... .......... 78% 281M 0s 2024-09-12T00:39:38.743 INFO:teuthology.orchestra.run.smithi133.stderr: 73050K .......... .......... .......... .......... .......... 78% 11.1M 0s 2024-09-12T00:39:38.743 INFO:teuthology.orchestra.run.smithi133.stderr: 73100K .......... .......... .......... .......... .......... 78% 230M 0s 2024-09-12T00:39:38.743 INFO:teuthology.orchestra.run.smithi133.stderr: 73150K .......... .......... .......... .......... .......... 78% 66.6M 0s 2024-09-12T00:39:38.743 INFO:teuthology.orchestra.run.smithi133.stderr: 73200K .......... .......... .......... .......... .......... 78% 217M 0s 2024-09-12T00:39:38.743 INFO:teuthology.orchestra.run.smithi133.stderr: 73250K .......... .......... .......... .......... .......... 78% 33.2M 0s 2024-09-12T00:39:38.743 INFO:teuthology.orchestra.run.smithi133.stderr: 73300K .......... .......... .......... .......... .......... 78% 39.4M 0s 2024-09-12T00:39:38.744 INFO:teuthology.orchestra.run.smithi133.stderr: 73350K .......... .......... .......... .......... .......... 79% 263M 0s 2024-09-12T00:39:38.744 INFO:teuthology.orchestra.run.smithi133.stderr: 73400K .......... .......... .......... .......... .......... 79% 246M 0s 2024-09-12T00:39:38.744 INFO:teuthology.orchestra.run.smithi133.stderr: 73450K .......... .......... .......... .......... .......... 79% 269M 0s 2024-09-12T00:39:38.744 INFO:teuthology.orchestra.run.smithi133.stderr: 73500K .......... .......... .......... .......... .......... 79% 102M 0s 2024-09-12T00:39:38.744 INFO:teuthology.orchestra.run.smithi133.stderr: 73550K .......... .......... .......... .......... .......... 79% 283M 0s 2024-09-12T00:39:38.744 INFO:teuthology.orchestra.run.smithi133.stderr: 73600K .......... .......... .......... .......... .......... 79% 233M 0s 2024-09-12T00:39:38.744 INFO:teuthology.orchestra.run.smithi133.stderr: 73650K .......... .......... .......... .......... .......... 79% 289M 0s 2024-09-12T00:39:38.744 INFO:teuthology.orchestra.run.smithi133.stderr: 73700K .......... .......... .......... .......... .......... 79% 277M 0s 2024-09-12T00:39:38.744 INFO:teuthology.orchestra.run.smithi133.stderr: 73750K .......... .......... .......... .......... .......... 79% 280M 0s 2024-09-12T00:39:38.744 INFO:teuthology.orchestra.run.smithi133.stderr: 73800K .......... .......... .......... .......... .......... 79% 263M 0s 2024-09-12T00:39:38.744 INFO:teuthology.orchestra.run.smithi133.stderr: 73850K .......... .......... .......... .......... .......... 79% 86.6M 0s 2024-09-12T00:39:38.744 INFO:teuthology.orchestra.run.smithi133.stderr: 73900K .......... .......... .......... .......... .......... 79% 260M 0s 2024-09-12T00:39:38.744 INFO:teuthology.orchestra.run.smithi133.stderr: 73950K .......... .......... .......... .......... .......... 79% 288M 0s 2024-09-12T00:39:38.745 INFO:teuthology.orchestra.run.smithi133.stderr: 74000K .......... .......... .......... .......... .......... 79% 236M 0s 2024-09-12T00:39:38.745 INFO:teuthology.orchestra.run.smithi133.stderr: 74050K .......... .......... .......... .......... .......... 79% 53.0M 0s 2024-09-12T00:39:38.745 INFO:teuthology.orchestra.run.smithi133.stderr: 74100K .......... .......... .......... .......... .......... 79% 272M 0s 2024-09-12T00:39:38.745 INFO:teuthology.orchestra.run.smithi133.stderr: 74150K .......... .......... .......... .......... .......... 79% 283M 0s 2024-09-12T00:39:38.745 INFO:teuthology.orchestra.run.smithi133.stderr: 74200K .......... .......... .......... .......... .......... 79% 105M 0s 2024-09-12T00:39:38.745 INFO:teuthology.orchestra.run.smithi133.stderr: 74250K .......... .......... .......... .......... .......... 79% 72.5M 0s 2024-09-12T00:39:38.745 INFO:teuthology.orchestra.run.smithi133.stderr: 74300K .......... .......... .......... .......... .......... 80% 232M 0s 2024-09-12T00:39:38.745 INFO:teuthology.orchestra.run.smithi133.stderr: 74350K .......... .......... .......... .......... .......... 80% 280M 0s 2024-09-12T00:39:38.745 INFO:teuthology.orchestra.run.smithi133.stderr: 74400K .......... .......... .......... .......... .......... 80% 194M 0s 2024-09-12T00:39:38.745 INFO:teuthology.orchestra.run.smithi133.stderr: 74450K .......... .......... .......... .......... .......... 80% 61.0M 0s 2024-09-12T00:39:38.745 INFO:teuthology.orchestra.run.smithi133.stderr: 74500K .......... .......... .......... .......... .......... 80% 350M 0s 2024-09-12T00:39:38.745 INFO:teuthology.orchestra.run.smithi133.stderr: 74550K .......... .......... .......... .......... .......... 80% 385M 0s 2024-09-12T00:39:38.745 INFO:teuthology.orchestra.run.smithi133.stderr: 74600K .......... .......... .......... .......... .......... 80% 45.6M 0s 2024-09-12T00:39:38.745 INFO:teuthology.orchestra.run.smithi133.stderr: 74650K .......... .......... .......... .......... .......... 80% 389M 0s 2024-09-12T00:39:38.745 INFO:teuthology.orchestra.run.smithi133.stderr: 74700K .......... .......... .......... .......... .......... 80% 397M 0s 2024-09-12T00:39:38.746 INFO:teuthology.orchestra.run.smithi133.stderr: 74750K .......... .......... .......... .......... .......... 80% 136M 0s 2024-09-12T00:39:38.746 INFO:teuthology.orchestra.run.smithi133.stderr: 74800K .......... .......... .......... .......... .......... 80% 51.9M 0s 2024-09-12T00:39:38.746 INFO:teuthology.orchestra.run.smithi133.stderr: 74850K .......... .......... .......... .......... .......... 80% 346M 0s 2024-09-12T00:39:38.746 INFO:teuthology.orchestra.run.smithi133.stderr: 74900K .......... .......... .......... .......... .......... 80% 326M 0s 2024-09-12T00:39:38.746 INFO:teuthology.orchestra.run.smithi133.stderr: 74950K .......... .......... .......... .......... .......... 80% 407M 0s 2024-09-12T00:39:38.746 INFO:teuthology.orchestra.run.smithi133.stderr: 75000K .......... .......... .......... .......... .......... 80% 66.0M 0s 2024-09-12T00:39:38.746 INFO:teuthology.orchestra.run.smithi133.stderr: 75050K .......... .......... .......... .......... .......... 80% 372M 0s 2024-09-12T00:39:38.746 INFO:teuthology.orchestra.run.smithi133.stderr: 75100K .......... .......... .......... .......... .......... 80% 326M 0s 2024-09-12T00:39:38.746 INFO:teuthology.orchestra.run.smithi133.stderr: 75150K .......... .......... .......... .......... .......... 80% 352M 0s 2024-09-12T00:39:38.746 INFO:teuthology.orchestra.run.smithi133.stderr: 75200K .......... .......... .......... .......... .......... 81% 98.6M 0s 2024-09-12T00:39:38.746 INFO:teuthology.orchestra.run.smithi133.stderr: 75250K .......... .......... .......... .......... .......... 81% 391M 0s 2024-09-12T00:39:38.746 INFO:teuthology.orchestra.run.smithi133.stderr: 75300K .......... .......... .......... .......... .......... 81% 356M 0s 2024-09-12T00:39:38.746 INFO:teuthology.orchestra.run.smithi133.stderr: 75350K .......... .......... .......... .......... .......... 81% 415M 0s 2024-09-12T00:39:38.746 INFO:teuthology.orchestra.run.smithi133.stderr: 75400K .......... .......... .......... .......... .......... 81% 183M 0s 2024-09-12T00:39:38.747 INFO:teuthology.orchestra.run.smithi133.stderr: 75450K .......... .......... .......... .......... .......... 81% 386M 0s 2024-09-12T00:39:38.747 INFO:teuthology.orchestra.run.smithi133.stderr: 75500K .......... .......... .......... .......... .......... 81% 381M 0s 2024-09-12T00:39:38.747 INFO:teuthology.orchestra.run.smithi133.stderr: 75550K .......... .......... .......... .......... .......... 81% 374M 0s 2024-09-12T00:39:38.747 INFO:teuthology.orchestra.run.smithi133.stderr: 75600K .......... .......... .......... .......... .......... 81% 131M 0s 2024-09-12T00:39:38.747 INFO:teuthology.orchestra.run.smithi133.stderr: 75650K .......... .......... .......... .......... .......... 81% 293M 0s 2024-09-12T00:39:38.747 INFO:teuthology.orchestra.run.smithi133.stderr: 75700K .......... .......... .......... .......... .......... 81% 342M 0s 2024-09-12T00:39:38.747 INFO:teuthology.orchestra.run.smithi133.stderr: 75750K .......... .......... .......... .......... .......... 81% 394M 0s 2024-09-12T00:39:38.747 INFO:teuthology.orchestra.run.smithi133.stderr: 75800K .......... .......... .......... .......... .......... 81% 254M 0s 2024-09-12T00:39:38.747 INFO:teuthology.orchestra.run.smithi133.stderr: 75850K .......... .......... .......... .......... .......... 81% 335M 0s 2024-09-12T00:39:38.747 INFO:teuthology.orchestra.run.smithi133.stderr: 75900K .......... .......... .......... .......... .......... 81% 304M 0s 2024-09-12T00:39:38.747 INFO:teuthology.orchestra.run.smithi133.stderr: 75950K .......... .......... .......... .......... .......... 81% 378M 0s 2024-09-12T00:39:38.747 INFO:teuthology.orchestra.run.smithi133.stderr: 76000K .......... .......... .......... .......... .......... 81% 192M 0s 2024-09-12T00:39:38.747 INFO:teuthology.orchestra.run.smithi133.stderr: 76050K .......... .......... .......... .......... .......... 81% 205M 0s 2024-09-12T00:39:38.747 INFO:teuthology.orchestra.run.smithi133.stderr: 76100K .......... .......... .......... .......... .......... 81% 316M 0s 2024-09-12T00:39:38.748 INFO:teuthology.orchestra.run.smithi133.stderr: 76150K .......... .......... .......... .......... .......... 82% 358M 0s 2024-09-12T00:39:38.748 INFO:teuthology.orchestra.run.smithi133.stderr: 76200K .......... .......... .......... .......... .......... 82% 297M 0s 2024-09-12T00:39:38.748 INFO:teuthology.orchestra.run.smithi133.stderr: 76250K .......... .......... .......... .......... .......... 82% 307M 0s 2024-09-12T00:39:38.748 INFO:teuthology.orchestra.run.smithi133.stderr: 76300K .......... .......... .......... .......... .......... 82% 331M 0s 2024-09-12T00:39:38.748 INFO:teuthology.orchestra.run.smithi133.stderr: 76350K .......... .......... .......... .......... .......... 82% 256M 0s 2024-09-12T00:39:38.748 INFO:teuthology.orchestra.run.smithi133.stderr: 76400K .......... .......... .......... .......... .......... 82% 393M 0s 2024-09-12T00:39:38.748 INFO:teuthology.orchestra.run.smithi133.stderr: 76450K .......... .......... .......... .......... .......... 82% 338M 0s 2024-09-12T00:39:38.748 INFO:teuthology.orchestra.run.smithi133.stderr: 76500K .......... .......... .......... .......... .......... 82% 340M 0s 2024-09-12T00:39:38.748 INFO:teuthology.orchestra.run.smithi133.stderr: 76550K .......... .......... .......... .......... .......... 82% 352M 0s 2024-09-12T00:39:38.748 INFO:teuthology.orchestra.run.smithi133.stderr: 76600K .......... .......... .......... .......... .......... 82% 415M 0s 2024-09-12T00:39:38.748 INFO:teuthology.orchestra.run.smithi133.stderr: 76650K .......... .......... .......... .......... .......... 82% 345M 0s 2024-09-12T00:39:38.748 INFO:teuthology.orchestra.run.smithi133.stderr: 76700K .......... .......... .......... .......... .......... 82% 355M 0s 2024-09-12T00:39:38.748 INFO:teuthology.orchestra.run.smithi133.stderr: 76750K .......... .......... .......... .......... .......... 82% 370M 0s 2024-09-12T00:39:38.748 INFO:teuthology.orchestra.run.smithi133.stderr: 76800K .......... .......... .......... .......... .......... 82% 371M 0s 2024-09-12T00:39:38.749 INFO:teuthology.orchestra.run.smithi133.stderr: 76850K .......... .......... .......... .......... .......... 82% 337M 0s 2024-09-12T00:39:38.749 INFO:teuthology.orchestra.run.smithi133.stderr: 76900K .......... .......... .......... .......... .......... 82% 337M 0s 2024-09-12T00:39:38.749 INFO:teuthology.orchestra.run.smithi133.stderr: 76950K .......... .......... .......... .......... .......... 82% 418M 0s 2024-09-12T00:39:38.749 INFO:teuthology.orchestra.run.smithi133.stderr: 77000K .......... .......... .......... .......... .......... 82% 388M 0s 2024-09-12T00:39:38.749 INFO:teuthology.orchestra.run.smithi133.stderr: 77050K .......... .......... .......... .......... .......... 82% 411M 0s 2024-09-12T00:39:38.749 INFO:teuthology.orchestra.run.smithi133.stderr: 77100K .......... .......... .......... .......... .......... 83% 323M 0s 2024-09-12T00:39:38.749 INFO:teuthology.orchestra.run.smithi133.stderr: 77150K .......... .......... .......... .......... .......... 83% 438M 0s 2024-09-12T00:39:38.749 INFO:teuthology.orchestra.run.smithi133.stderr: 77200K .......... .......... .......... .......... .......... 83% 375M 0s 2024-09-12T00:39:38.749 INFO:teuthology.orchestra.run.smithi133.stderr: 77250K .......... .......... .......... .......... .......... 83% 380M 0s 2024-09-12T00:39:38.749 INFO:teuthology.orchestra.run.smithi133.stderr: 77300K .......... .......... .......... .......... .......... 83% 16.5M 0s 2024-09-12T00:39:38.749 INFO:teuthology.orchestra.run.smithi133.stderr: 77350K .......... .......... .......... .......... .......... 83% 378M 0s 2024-09-12T00:39:38.749 INFO:teuthology.orchestra.run.smithi133.stderr: 77400K .......... .......... .......... .......... .......... 83% 395M 0s 2024-09-12T00:39:38.749 INFO:teuthology.orchestra.run.smithi133.stderr: 77450K .......... .......... .......... .......... .......... 83% 125M 0s 2024-09-12T00:39:38.749 INFO:teuthology.orchestra.run.smithi133.stderr: 77500K .......... .......... .......... .......... .......... 83% 332M 0s 2024-09-12T00:39:38.749 INFO:teuthology.orchestra.run.smithi133.stderr: 77550K .......... .......... .......... .......... .......... 83% 341M 0s 2024-09-12T00:39:38.750 INFO:teuthology.orchestra.run.smithi133.stderr: 77600K .......... .......... .......... .......... .......... 83% 358M 0s 2024-09-12T00:39:38.750 INFO:teuthology.orchestra.run.smithi133.stderr: 77650K .......... .......... .......... .......... .......... 83% 355M 0s 2024-09-12T00:39:38.750 INFO:teuthology.orchestra.run.smithi133.stderr: 77700K .......... .......... .......... .......... .......... 83% 333M 0s 2024-09-12T00:39:38.750 INFO:teuthology.orchestra.run.smithi133.stderr: 77750K .......... .......... .......... .......... .......... 83% 402M 0s 2024-09-12T00:39:38.750 INFO:teuthology.orchestra.run.smithi133.stderr: 77800K .......... .......... .......... .......... .......... 83% 375M 0s 2024-09-12T00:39:38.750 INFO:teuthology.orchestra.run.smithi133.stderr: 77850K .......... .......... .......... .......... .......... 83% 393M 0s 2024-09-12T00:39:38.750 INFO:teuthology.orchestra.run.smithi133.stderr: 77900K .......... .......... .......... .......... .......... 83% 331M 0s 2024-09-12T00:39:38.750 INFO:teuthology.orchestra.run.smithi133.stderr: 77950K .......... .......... .......... .......... .......... 83% 368M 0s 2024-09-12T00:39:38.750 INFO:teuthology.orchestra.run.smithi133.stderr: 78000K .......... .......... .......... .......... .......... 84% 248M 0s 2024-09-12T00:39:38.750 INFO:teuthology.orchestra.run.smithi133.stderr: 78050K .......... .......... .......... .......... .......... 84% 276M 0s 2024-09-12T00:39:38.750 INFO:teuthology.orchestra.run.smithi133.stderr: 78100K .......... .......... .......... .......... .......... 84% 346M 0s 2024-09-12T00:39:38.750 INFO:teuthology.orchestra.run.smithi133.stderr: 78150K .......... .......... .......... .......... .......... 84% 386M 0s 2024-09-12T00:39:38.750 INFO:teuthology.orchestra.run.smithi133.stderr: 78200K .......... .......... .......... .......... .......... 84% 403M 0s 2024-09-12T00:39:38.751 INFO:teuthology.orchestra.run.smithi133.stderr: 78250K .......... .......... .......... .......... .......... 84% 403M 0s 2024-09-12T00:39:38.751 INFO:teuthology.orchestra.run.smithi133.stderr: 78300K .......... .......... .......... .......... .......... 84% 293M 0s 2024-09-12T00:39:38.751 INFO:teuthology.orchestra.run.smithi133.stderr: 78350K .......... .......... .......... .......... .......... 84% 436M 0s 2024-09-12T00:39:38.751 INFO:teuthology.orchestra.run.smithi133.stderr: 78400K .......... .......... .......... .......... .......... 84% 398M 0s 2024-09-12T00:39:38.751 INFO:teuthology.orchestra.run.smithi133.stderr: 78450K .......... .......... .......... .......... .......... 84% 386M 0s 2024-09-12T00:39:38.751 INFO:teuthology.orchestra.run.smithi133.stderr: 78500K .......... .......... .......... .......... .......... 84% 351M 0s 2024-09-12T00:39:38.751 INFO:teuthology.orchestra.run.smithi133.stderr: 78550K .......... .......... .......... .......... .......... 84% 290M 0s 2024-09-12T00:39:38.751 INFO:teuthology.orchestra.run.smithi133.stderr: 78600K .......... .......... .......... .......... .......... 84% 410M 0s 2024-09-12T00:39:38.751 INFO:teuthology.orchestra.run.smithi133.stderr: 78650K .......... .......... .......... .......... .......... 84% 343M 0s 2024-09-12T00:39:38.751 INFO:teuthology.orchestra.run.smithi133.stderr: 78700K .......... .......... .......... .......... .......... 84% 206M 0s 2024-09-12T00:39:38.751 INFO:teuthology.orchestra.run.smithi133.stderr: 78750K .......... .......... .......... .......... .......... 84% 409M 0s 2024-09-12T00:39:38.751 INFO:teuthology.orchestra.run.smithi133.stderr: 78800K .......... .......... .......... .......... .......... 84% 6.35M 0s 2024-09-12T00:39:38.751 INFO:teuthology.orchestra.run.smithi133.stderr: 78850K .......... .......... .......... .......... .......... 84% 365M 0s 2024-09-12T00:39:38.751 INFO:teuthology.orchestra.run.smithi133.stderr: 78900K .......... .......... .......... .......... .......... 84% 321M 0s 2024-09-12T00:39:38.752 INFO:teuthology.orchestra.run.smithi133.stderr: 78950K .......... .......... .......... .......... .......... 85% 24.1M 0s 2024-09-12T00:39:38.752 INFO:teuthology.orchestra.run.smithi133.stderr: 79000K .......... .......... .......... .......... .......... 85% 307M 0s 2024-09-12T00:39:38.752 INFO:teuthology.orchestra.run.smithi133.stderr: 79050K .......... .......... .......... .......... .......... 85% 337M 0s 2024-09-12T00:39:38.752 INFO:teuthology.orchestra.run.smithi133.stderr: 79100K .......... .......... .......... .......... .......... 85% 148M 0s 2024-09-12T00:39:38.752 INFO:teuthology.orchestra.run.smithi133.stderr: 79150K .......... .......... .......... .......... .......... 85% 272M 0s 2024-09-12T00:39:38.752 INFO:teuthology.orchestra.run.smithi133.stderr: 79200K .......... .......... .......... .......... .......... 85% 383M 0s 2024-09-12T00:39:38.752 INFO:teuthology.orchestra.run.smithi133.stderr: 79250K .......... .......... .......... .......... .......... 85% 363M 0s 2024-09-12T00:39:38.752 INFO:teuthology.orchestra.run.smithi133.stderr: 79300K .......... .......... .......... .......... .......... 85% 90.5M 0s 2024-09-12T00:39:38.752 INFO:teuthology.orchestra.run.smithi133.stderr: 79350K .......... .......... .......... .......... .......... 85% 370M 0s 2024-09-12T00:39:38.752 INFO:teuthology.orchestra.run.smithi133.stderr: 79400K .......... .......... .......... .......... .......... 85% 381M 0s 2024-09-12T00:39:38.752 INFO:teuthology.orchestra.run.smithi133.stderr: 79450K .......... .......... .......... .......... .......... 85% 363M 0s 2024-09-12T00:39:38.752 INFO:teuthology.orchestra.run.smithi133.stderr: 79500K .......... .......... .......... .......... .......... 85% 282M 0s 2024-09-12T00:39:38.752 INFO:teuthology.orchestra.run.smithi133.stderr: 79550K .......... .......... .......... .......... .......... 85% 376M 0s 2024-09-12T00:39:38.752 INFO:teuthology.orchestra.run.smithi133.stderr: 79600K .......... .......... .......... .......... .......... 85% 331M 0s 2024-09-12T00:39:38.753 INFO:teuthology.orchestra.run.smithi133.stderr: 79650K .......... .......... .......... .......... .......... 85% 354M 0s 2024-09-12T00:39:38.753 INFO:teuthology.orchestra.run.smithi133.stderr: 79700K .......... .......... .......... .......... .......... 85% 270M 0s 2024-09-12T00:39:38.753 INFO:teuthology.orchestra.run.smithi133.stderr: 79750K .......... .......... .......... .......... .......... 85% 398M 0s 2024-09-12T00:39:38.753 INFO:teuthology.orchestra.run.smithi133.stderr: 79800K .......... .......... .......... .......... .......... 85% 362M 0s 2024-09-12T00:39:38.753 INFO:teuthology.orchestra.run.smithi133.stderr: 79850K .......... .......... .......... .......... .......... 86% 368M 0s 2024-09-12T00:39:38.753 INFO:teuthology.orchestra.run.smithi133.stderr: 79900K .......... .......... .......... .......... .......... 86% 320M 0s 2024-09-12T00:39:38.753 INFO:teuthology.orchestra.run.smithi133.stderr: 79950K .......... .......... .......... .......... .......... 86% 413M 0s 2024-09-12T00:39:38.753 INFO:teuthology.orchestra.run.smithi133.stderr: 80000K .......... .......... .......... .......... .......... 86% 382M 0s 2024-09-12T00:39:38.753 INFO:teuthology.orchestra.run.smithi133.stderr: 80050K .......... .......... .......... .......... .......... 86% 354M 0s 2024-09-12T00:39:38.753 INFO:teuthology.orchestra.run.smithi133.stderr: 80100K .......... .......... .......... .......... .......... 86% 339M 0s 2024-09-12T00:39:38.753 INFO:teuthology.orchestra.run.smithi133.stderr: 80150K .......... .......... .......... .......... .......... 86% 388M 0s 2024-09-12T00:39:38.753 INFO:teuthology.orchestra.run.smithi133.stderr: 80200K .......... .......... .......... .......... .......... 86% 410M 0s 2024-09-12T00:39:38.753 INFO:teuthology.orchestra.run.smithi133.stderr: 80250K .......... .......... .......... .......... .......... 86% 386M 0s 2024-09-12T00:39:38.754 INFO:teuthology.orchestra.run.smithi133.stderr: 80300K .......... .......... .......... .......... .......... 86% 343M 0s 2024-09-12T00:39:38.754 INFO:teuthology.orchestra.run.smithi133.stderr: 80350K .......... .......... .......... .......... .......... 86% 379M 0s 2024-09-12T00:39:38.754 INFO:teuthology.orchestra.run.smithi133.stderr: 80400K .......... .......... .......... .......... .......... 86% 383M 0s 2024-09-12T00:39:38.754 INFO:teuthology.orchestra.run.smithi133.stderr: 80450K .......... .......... .......... .......... .......... 86% 393M 0s 2024-09-12T00:39:38.754 INFO:teuthology.orchestra.run.smithi133.stderr: 80500K .......... .......... .......... .......... .......... 86% 381M 0s 2024-09-12T00:39:38.754 INFO:teuthology.orchestra.run.smithi133.stderr: 80550K .......... .......... .......... .......... .......... 86% 394M 0s 2024-09-12T00:39:38.754 INFO:teuthology.orchestra.run.smithi133.stderr: 80600K .......... .......... .......... .......... .......... 86% 389M 0s 2024-09-12T00:39:38.754 INFO:teuthology.orchestra.run.smithi133.stderr: 80650K .......... .......... .......... .......... .......... 86% 385M 0s 2024-09-12T00:39:38.754 INFO:teuthology.orchestra.run.smithi133.stderr: 80700K .......... .......... .......... .......... .......... 86% 340M 0s 2024-09-12T00:39:38.754 INFO:teuthology.orchestra.run.smithi133.stderr: 80750K .......... .......... .......... .......... .......... 86% 432M 0s 2024-09-12T00:39:38.754 INFO:teuthology.orchestra.run.smithi133.stderr: 80800K .......... .......... .......... .......... .......... 87% 374M 0s 2024-09-12T00:39:38.754 INFO:teuthology.orchestra.run.smithi133.stderr: 80850K .......... .......... .......... .......... .......... 87% 413M 0s 2024-09-12T00:39:38.754 INFO:teuthology.orchestra.run.smithi133.stderr: 80900K .......... .......... .......... .......... .......... 87% 389M 0s 2024-09-12T00:39:38.755 INFO:teuthology.orchestra.run.smithi133.stderr: 80950K .......... .......... .......... .......... .......... 87% 366M 0s 2024-09-12T00:39:38.755 INFO:teuthology.orchestra.run.smithi133.stderr: 81000K .......... .......... .......... .......... .......... 87% 396M 0s 2024-09-12T00:39:38.755 INFO:teuthology.orchestra.run.smithi133.stderr: 81050K .......... .......... .......... .......... .......... 87% 389M 0s 2024-09-12T00:39:38.755 INFO:teuthology.orchestra.run.smithi133.stderr: 81100K .......... .......... .......... .......... .......... 87% 319M 0s 2024-09-12T00:39:38.755 INFO:teuthology.orchestra.run.smithi133.stderr: 81150K .......... .......... .......... .......... .......... 87% 398M 0s 2024-09-12T00:39:38.755 INFO:teuthology.orchestra.run.smithi133.stderr: 81200K .......... .......... .......... .......... .......... 87% 382M 0s 2024-09-12T00:39:38.755 INFO:teuthology.orchestra.run.smithi133.stderr: 81250K .......... .......... .......... .......... .......... 87% 342M 0s 2024-09-12T00:39:38.755 INFO:teuthology.orchestra.run.smithi133.stderr: 81300K .......... .......... .......... .......... .......... 87% 373M 0s 2024-09-12T00:39:38.755 INFO:teuthology.orchestra.run.smithi133.stderr: 81350K .......... .......... .......... .......... .......... 87% 400M 0s 2024-09-12T00:39:38.755 INFO:teuthology.orchestra.run.smithi133.stderr: 81400K .......... .......... .......... .......... .......... 87% 397M 0s 2024-09-12T00:39:38.755 INFO:teuthology.orchestra.run.smithi133.stderr: 81450K .......... .......... .......... .......... .......... 87% 422M 0s 2024-09-12T00:39:38.755 INFO:teuthology.orchestra.run.smithi133.stderr: 81500K .......... .......... .......... .......... .......... 87% 347M 0s 2024-09-12T00:39:38.755 INFO:teuthology.orchestra.run.smithi133.stderr: 81550K .......... .......... .......... .......... .......... 87% 389M 0s 2024-09-12T00:39:38.756 INFO:teuthology.orchestra.run.smithi133.stderr: 81600K .......... .......... .......... .......... .......... 87% 361M 0s 2024-09-12T00:39:38.756 INFO:teuthology.orchestra.run.smithi133.stderr: 81650K .......... .......... .......... .......... .......... 87% 331M 0s 2024-09-12T00:39:38.756 INFO:teuthology.orchestra.run.smithi133.stderr: 81700K .......... .......... .......... .......... .......... 87% 233M 0s 2024-09-12T00:39:38.756 INFO:teuthology.orchestra.run.smithi133.stderr: 81750K .......... .......... .......... .......... .......... 88% 393M 0s 2024-09-12T00:39:38.756 INFO:teuthology.orchestra.run.smithi133.stderr: 81800K .......... .......... .......... .......... .......... 88% 357M 0s 2024-09-12T00:39:38.756 INFO:teuthology.orchestra.run.smithi133.stderr: 81850K .......... .......... .......... .......... .......... 88% 68.3M 0s 2024-09-12T00:39:38.756 INFO:teuthology.orchestra.run.smithi133.stderr: 81900K .......... .......... .......... .......... .......... 88% 350M 0s 2024-09-12T00:39:38.756 INFO:teuthology.orchestra.run.smithi133.stderr: 81950K .......... .......... .......... .......... .......... 88% 19.5M 0s 2024-09-12T00:39:38.756 INFO:teuthology.orchestra.run.smithi133.stderr: 82000K .......... .......... .......... .......... .......... 88% 157M 0s 2024-09-12T00:39:38.756 INFO:teuthology.orchestra.run.smithi133.stderr: 82050K .......... .......... .......... .......... .......... 88% 371M 0s 2024-09-12T00:39:38.756 INFO:teuthology.orchestra.run.smithi133.stderr: 82100K .......... .......... .......... .......... .......... 88% 342M 0s 2024-09-12T00:39:38.756 INFO:teuthology.orchestra.run.smithi133.stderr: 82150K .......... .......... .......... .......... .......... 88% 388M 0s 2024-09-12T00:39:38.756 INFO:teuthology.orchestra.run.smithi133.stderr: 82200K .......... .......... .......... .......... .......... 88% 349M 0s 2024-09-12T00:39:38.756 INFO:teuthology.orchestra.run.smithi133.stderr: 82250K .......... .......... .......... .......... .......... 88% 357M 0s 2024-09-12T00:39:38.757 INFO:teuthology.orchestra.run.smithi133.stderr: 82300K .......... .......... .......... .......... .......... 88% 334M 0s 2024-09-12T00:39:38.757 INFO:teuthology.orchestra.run.smithi133.stderr: 82350K .......... .......... .......... .......... .......... 88% 48.6M 0s 2024-09-12T00:39:38.757 INFO:teuthology.orchestra.run.smithi133.stderr: 82400K .......... .......... .......... .......... .......... 88% 363M 0s 2024-09-12T00:39:38.757 INFO:teuthology.orchestra.run.smithi133.stderr: 82450K .......... .......... .......... .......... .......... 88% 358M 0s 2024-09-12T00:39:38.757 INFO:teuthology.orchestra.run.smithi133.stderr: 82500K .......... .......... .......... .......... .......... 88% 331M 0s 2024-09-12T00:39:38.757 INFO:teuthology.orchestra.run.smithi133.stderr: 82550K .......... .......... .......... .......... .......... 88% 372M 0s 2024-09-12T00:39:38.757 INFO:teuthology.orchestra.run.smithi133.stderr: 82600K .......... .......... .......... .......... .......... 88% 381M 0s 2024-09-12T00:39:38.757 INFO:teuthology.orchestra.run.smithi133.stderr: 82650K .......... .......... .......... .......... .......... 89% 332M 0s 2024-09-12T00:39:38.757 INFO:teuthology.orchestra.run.smithi133.stderr: 82700K .......... .......... .......... .......... .......... 89% 313M 0s 2024-09-12T00:39:38.757 INFO:teuthology.orchestra.run.smithi133.stderr: 82750K .......... .......... .......... .......... .......... 89% 363M 0s 2024-09-12T00:39:38.757 INFO:teuthology.orchestra.run.smithi133.stderr: 82800K .......... .......... .......... .......... .......... 89% 350M 0s 2024-09-12T00:39:38.757 INFO:teuthology.orchestra.run.smithi133.stderr: 82850K .......... .......... .......... .......... .......... 89% 139M 0s 2024-09-12T00:39:38.757 INFO:teuthology.orchestra.run.smithi133.stderr: 82900K .......... .......... .......... .......... .......... 89% 280M 0s 2024-09-12T00:39:38.758 INFO:teuthology.orchestra.run.smithi133.stderr: 82950K .......... .......... .......... .......... .......... 89% 165M 0s 2024-09-12T00:39:38.758 INFO:teuthology.orchestra.run.smithi133.stderr: 83000K .......... .......... .......... .......... .......... 89% 372M 0s 2024-09-12T00:39:38.758 INFO:teuthology.orchestra.run.smithi133.stderr: 83050K .......... .......... .......... .......... .......... 89% 313M 0s 2024-09-12T00:39:38.758 INFO:teuthology.orchestra.run.smithi133.stderr: 83100K .......... .......... .......... .......... .......... 89% 326M 0s 2024-09-12T00:39:38.758 INFO:teuthology.orchestra.run.smithi133.stderr: 83150K .......... .......... .......... .......... .......... 89% 394M 0s 2024-09-12T00:39:38.758 INFO:teuthology.orchestra.run.smithi133.stderr: 83200K .......... .......... .......... .......... .......... 89% 335M 0s 2024-09-12T00:39:38.758 INFO:teuthology.orchestra.run.smithi133.stderr: 83250K .......... .......... .......... .......... .......... 89% 146M 0s 2024-09-12T00:39:38.758 INFO:teuthology.orchestra.run.smithi133.stderr: 83300K .......... .......... .......... .......... .......... 89% 345M 0s 2024-09-12T00:39:38.758 INFO:teuthology.orchestra.run.smithi133.stderr: 83350K .......... .......... .......... .......... .......... 89% 397M 0s 2024-09-12T00:39:38.758 INFO:teuthology.orchestra.run.smithi133.stderr: 83400K .......... .......... .......... .......... .......... 89% 324M 0s 2024-09-12T00:39:38.758 INFO:teuthology.orchestra.run.smithi133.stderr: 83450K .......... .......... .......... .......... .......... 89% 258M 0s 2024-09-12T00:39:38.758 INFO:teuthology.orchestra.run.smithi133.stderr: 83500K .......... .......... .......... .......... .......... 89% 283M 0s 2024-09-12T00:39:38.758 INFO:teuthology.orchestra.run.smithi133.stderr: 83550K .......... .......... .......... .......... .......... 89% 402M 0s 2024-09-12T00:39:38.758 INFO:teuthology.orchestra.run.smithi133.stderr: 83600K .......... .......... .......... .......... .......... 90% 446M 0s 2024-09-12T00:39:38.759 INFO:teuthology.orchestra.run.smithi133.stderr: 83650K .......... .......... .......... .......... .......... 90% 215M 0s 2024-09-12T00:39:38.759 INFO:teuthology.orchestra.run.smithi133.stderr: 83700K .......... .......... .......... .......... .......... 90% 263M 0s 2024-09-12T00:39:38.759 INFO:teuthology.orchestra.run.smithi133.stderr: 83750K .......... .......... .......... .......... .......... 90% 365M 0s 2024-09-12T00:39:38.759 INFO:teuthology.orchestra.run.smithi133.stderr: 83800K .......... .......... .......... .......... .......... 90% 409M 0s 2024-09-12T00:39:38.759 INFO:teuthology.orchestra.run.smithi133.stderr: 83850K .......... .......... .......... .......... .......... 90% 373M 0s 2024-09-12T00:39:38.759 INFO:teuthology.orchestra.run.smithi133.stderr: 83900K .......... .......... .......... .......... .......... 90% 341M 0s 2024-09-12T00:39:38.759 INFO:teuthology.orchestra.run.smithi133.stderr: 83950K .......... .......... .......... .......... .......... 90% 232M 0s 2024-09-12T00:39:38.759 INFO:teuthology.orchestra.run.smithi133.stderr: 84000K .......... .......... .......... .......... .......... 90% 393M 0s 2024-09-12T00:39:38.759 INFO:teuthology.orchestra.run.smithi133.stderr: 84050K .......... .......... .......... .......... .......... 90% 418M 0s 2024-09-12T00:39:38.759 INFO:teuthology.orchestra.run.smithi133.stderr: 84100K .......... .......... .......... .......... .......... 90% 348M 0s 2024-09-12T00:39:38.759 INFO:teuthology.orchestra.run.smithi133.stderr: 84150K .......... .......... .......... .......... .......... 90% 262M 0s 2024-09-12T00:39:38.759 INFO:teuthology.orchestra.run.smithi133.stderr: 84200K .......... .......... .......... .......... .......... 90% 270M 0s 2024-09-12T00:39:38.759 INFO:teuthology.orchestra.run.smithi133.stderr: 84250K .......... .......... .......... .......... .......... 90% 415M 0s 2024-09-12T00:39:38.759 INFO:teuthology.orchestra.run.smithi133.stderr: 84300K .......... .......... .......... .......... .......... 90% 318M 0s 2024-09-12T00:39:38.760 INFO:teuthology.orchestra.run.smithi133.stderr: 84350K .......... .......... .......... .......... .......... 90% 399M 0s 2024-09-12T00:39:38.760 INFO:teuthology.orchestra.run.smithi133.stderr: 84400K .......... .......... .......... .......... .......... 90% 225M 0s 2024-09-12T00:39:38.760 INFO:teuthology.orchestra.run.smithi133.stderr: 84450K .......... .......... .......... .......... .......... 90% 212M 0s 2024-09-12T00:39:38.760 INFO:teuthology.orchestra.run.smithi133.stderr: 84500K .......... .......... .......... .......... .......... 91% 353M 0s 2024-09-12T00:39:38.760 INFO:teuthology.orchestra.run.smithi133.stderr: 84550K .......... .......... .......... .......... .......... 91% 176M 0s 2024-09-12T00:39:38.760 INFO:teuthology.orchestra.run.smithi133.stderr: 84600K .......... .......... .......... .......... .......... 91% 347M 0s 2024-09-12T00:39:38.760 INFO:teuthology.orchestra.run.smithi133.stderr: 84650K .......... .......... .......... .......... .......... 91% 342M 0s 2024-09-12T00:39:38.760 INFO:teuthology.orchestra.run.smithi133.stderr: 84700K .......... .......... .......... .......... .......... 91% 234M 0s 2024-09-12T00:39:38.760 INFO:teuthology.orchestra.run.smithi133.stderr: 84750K .......... .......... .......... .......... .......... 91% 407M 0s 2024-09-12T00:39:38.760 INFO:teuthology.orchestra.run.smithi133.stderr: 84800K .......... .......... .......... .......... .......... 91% 353M 0s 2024-09-12T00:39:38.760 INFO:teuthology.orchestra.run.smithi133.stderr: 84850K .......... .......... .......... .......... .......... 91% 357M 0s 2024-09-12T00:39:38.760 INFO:teuthology.orchestra.run.smithi133.stderr: 84900K .......... .......... .......... .......... .......... 91% 389M 0s 2024-09-12T00:39:38.760 INFO:teuthology.orchestra.run.smithi133.stderr: 84950K .......... .......... .......... .......... .......... 91% 384M 0s 2024-09-12T00:39:38.760 INFO:teuthology.orchestra.run.smithi133.stderr: 85000K .......... .......... .......... .......... .......... 91% 62.8M 0s 2024-09-12T00:39:38.761 INFO:teuthology.orchestra.run.smithi133.stderr: 85050K .......... .......... .......... .......... .......... 91% 39.5M 0s 2024-09-12T00:39:38.761 INFO:teuthology.orchestra.run.smithi133.stderr: 85100K .......... .......... .......... .......... .......... 91% 222M 0s 2024-09-12T00:39:38.761 INFO:teuthology.orchestra.run.smithi133.stderr: 85150K .......... .......... .......... .......... .......... 91% 348M 0s 2024-09-12T00:39:38.761 INFO:teuthology.orchestra.run.smithi133.stderr: 85200K .......... .......... .......... .......... .......... 91% 409M 0s 2024-09-12T00:39:38.761 INFO:teuthology.orchestra.run.smithi133.stderr: 85250K .......... .......... .......... .......... .......... 91% 431M 0s 2024-09-12T00:39:38.761 INFO:teuthology.orchestra.run.smithi133.stderr: 85300K .......... .......... .......... .......... .......... 91% 378M 0s 2024-09-12T00:39:38.761 INFO:teuthology.orchestra.run.smithi133.stderr: 85350K .......... .......... .......... .......... .......... 91% 84.2M 0s 2024-09-12T00:39:38.761 INFO:teuthology.orchestra.run.smithi133.stderr: 85400K .......... .......... .......... .......... .......... 91% 213M 0s 2024-09-12T00:39:38.761 INFO:teuthology.orchestra.run.smithi133.stderr: 85450K .......... .......... .......... .......... .......... 92% 376M 0s 2024-09-12T00:39:38.761 INFO:teuthology.orchestra.run.smithi133.stderr: 85500K .......... .......... .......... .......... .......... 92% 357M 0s 2024-09-12T00:39:38.761 INFO:teuthology.orchestra.run.smithi133.stderr: 85550K .......... .......... .......... .......... .......... 92% 376M 0s 2024-09-12T00:39:38.761 INFO:teuthology.orchestra.run.smithi133.stderr: 85600K .......... .......... .......... .......... .......... 92% 137M 0s 2024-09-12T00:39:38.761 INFO:teuthology.orchestra.run.smithi133.stderr: 85650K .......... .......... .......... .......... .......... 92% 181M 0s 2024-09-12T00:39:38.761 INFO:teuthology.orchestra.run.smithi133.stderr: 85700K .......... .......... .......... .......... .......... 92% 317M 0s 2024-09-12T00:39:38.762 INFO:teuthology.orchestra.run.smithi133.stderr: 85750K .......... .......... .......... .......... .......... 92% 401M 0s 2024-09-12T00:39:38.762 INFO:teuthology.orchestra.run.smithi133.stderr: 85800K .......... .......... .......... .......... .......... 92% 237M 0s 2024-09-12T00:39:38.762 INFO:teuthology.orchestra.run.smithi133.stderr: 85850K .......... .......... .......... .......... .......... 92% 401M 0s 2024-09-12T00:39:38.762 INFO:teuthology.orchestra.run.smithi133.stderr: 85900K .......... .......... .......... .......... .......... 92% 372M 0s 2024-09-12T00:39:38.762 INFO:teuthology.orchestra.run.smithi133.stderr: 85950K .......... .......... .......... .......... .......... 92% 366M 0s 2024-09-12T00:39:38.762 INFO:teuthology.orchestra.run.smithi133.stderr: 86000K .......... .......... .......... .......... .......... 92% 170M 0s 2024-09-12T00:39:38.762 INFO:teuthology.orchestra.run.smithi133.stderr: 86050K .......... .......... .......... .......... .......... 92% 447M 0s 2024-09-12T00:39:38.762 INFO:teuthology.orchestra.run.smithi133.stderr: 86100K .......... .......... .......... .......... .......... 92% 297M 0s 2024-09-12T00:39:38.762 INFO:teuthology.orchestra.run.smithi133.stderr: 86150K .......... .......... .......... .......... .......... 92% 427M 0s 2024-09-12T00:39:38.762 INFO:teuthology.orchestra.run.smithi133.stderr: 86200K .......... .......... .......... .......... .......... 92% 427M 0s 2024-09-12T00:39:38.762 INFO:teuthology.orchestra.run.smithi133.stderr: 86250K .......... .......... .......... .......... .......... 92% 176M 0s 2024-09-12T00:39:38.762 INFO:teuthology.orchestra.run.smithi133.stderr: 86300K .......... .......... .......... .......... .......... 92% 343M 0s 2024-09-12T00:39:38.762 INFO:teuthology.orchestra.run.smithi133.stderr: 86350K .......... .......... .......... .......... .......... 93% 256M 0s 2024-09-12T00:39:38.762 INFO:teuthology.orchestra.run.smithi133.stderr: 86400K .......... .......... .......... .......... .......... 93% 399M 0s 2024-09-12T00:39:38.763 INFO:teuthology.orchestra.run.smithi133.stderr: 86450K .......... .......... .......... .......... .......... 93% 232M 0s 2024-09-12T00:39:38.763 INFO:teuthology.orchestra.run.smithi133.stderr: 86500K .......... .......... .......... .......... .......... 93% 240M 0s 2024-09-12T00:39:38.763 INFO:teuthology.orchestra.run.smithi133.stderr: 86550K .......... .......... .......... .......... .......... 93% 397M 0s 2024-09-12T00:39:38.763 INFO:teuthology.orchestra.run.smithi133.stderr: 86600K .......... .......... .......... .......... .......... 93% 453M 0s 2024-09-12T00:39:38.763 INFO:teuthology.orchestra.run.smithi133.stderr: 86650K .......... .......... .......... .......... .......... 93% 330M 0s 2024-09-12T00:39:38.763 INFO:teuthology.orchestra.run.smithi133.stderr: 86700K .......... .......... .......... .......... .......... 93% 210M 0s 2024-09-12T00:39:38.763 INFO:teuthology.orchestra.run.smithi133.stderr: 86750K .......... .......... .......... .......... .......... 93% 380M 0s 2024-09-12T00:39:38.763 INFO:teuthology.orchestra.run.smithi133.stderr: 86800K .......... .......... .......... .......... .......... 93% 106M 0s 2024-09-12T00:39:38.763 INFO:teuthology.orchestra.run.smithi133.stderr: 86850K .......... .......... .......... .......... .......... 93% 382M 0s 2024-09-12T00:39:38.763 INFO:teuthology.orchestra.run.smithi133.stderr: 86900K .......... .......... .......... .......... .......... 93% 242M 0s 2024-09-12T00:39:38.763 INFO:teuthology.orchestra.run.smithi133.stderr: 86950K .......... .......... .......... .......... .......... 93% 384M 0s 2024-09-12T00:39:38.763 INFO:teuthology.orchestra.run.smithi133.stderr: 87000K .......... .......... .......... .......... .......... 93% 397M 0s 2024-09-12T00:39:38.763 INFO:teuthology.orchestra.run.smithi133.stderr: 87050K .......... .......... .......... .......... .......... 93% 347M 0s 2024-09-12T00:39:38.763 INFO:teuthology.orchestra.run.smithi133.stderr: 87100K .......... .......... .......... .......... .......... 93% 310M 0s 2024-09-12T00:39:38.763 INFO:teuthology.orchestra.run.smithi133.stderr: 87150K .......... .......... .......... .......... .......... 93% 319M 0s 2024-09-12T00:39:38.764 INFO:teuthology.orchestra.run.smithi133.stderr: 87200K .......... .......... .......... .......... .......... 93% 182M 0s 2024-09-12T00:39:38.764 INFO:teuthology.orchestra.run.smithi133.stderr: 87250K .......... .......... .......... .......... .......... 93% 234M 0s 2024-09-12T00:39:38.764 INFO:teuthology.orchestra.run.smithi133.stderr: 87300K .......... .......... .......... .......... .......... 94% 345M 0s 2024-09-12T00:39:38.764 INFO:teuthology.orchestra.run.smithi133.stderr: 87350K .......... .......... .......... .......... .......... 94% 375M 0s 2024-09-12T00:39:38.764 INFO:teuthology.orchestra.run.smithi133.stderr: 87400K .......... .......... .......... .......... .......... 94% 322M 0s 2024-09-12T00:39:38.764 INFO:teuthology.orchestra.run.smithi133.stderr: 87450K .......... .......... .......... .......... .......... 94% 252M 0s 2024-09-12T00:39:38.764 INFO:teuthology.orchestra.run.smithi133.stderr: 87500K .......... .......... .......... .......... .......... 94% 105M 0s 2024-09-12T00:39:38.764 INFO:teuthology.orchestra.run.smithi133.stderr: 87550K .......... .......... .......... .......... .......... 94% 267M 0s 2024-09-12T00:39:38.764 INFO:teuthology.orchestra.run.smithi133.stderr: 87600K .......... .......... .......... .......... .......... 94% 104M 0s 2024-09-12T00:39:38.764 INFO:teuthology.orchestra.run.smithi133.stderr: 87650K .......... .......... .......... .......... .......... 94% 402M 0s 2024-09-12T00:39:38.764 INFO:teuthology.orchestra.run.smithi133.stderr: 87700K .......... .......... .......... .......... .......... 94% 359M 0s 2024-09-12T00:39:38.764 INFO:teuthology.orchestra.run.smithi133.stderr: 87750K .......... .......... .......... .......... .......... 94% 282M 0s 2024-09-12T00:39:38.764 INFO:teuthology.orchestra.run.smithi133.stderr: 87800K .......... .......... .......... .......... .......... 94% 337M 0s 2024-09-12T00:39:38.764 INFO:teuthology.orchestra.run.smithi133.stderr: 87850K .......... .......... .......... .......... .......... 94% 412M 0s 2024-09-12T00:39:38.765 INFO:teuthology.orchestra.run.smithi133.stderr: 87900K .......... .......... .......... .......... .......... 94% 330M 0s 2024-09-12T00:39:38.765 INFO:teuthology.orchestra.run.smithi133.stderr: 87950K .......... .......... .......... .......... .......... 94% 374M 0s 2024-09-12T00:39:38.765 INFO:teuthology.orchestra.run.smithi133.stderr: 88000K .......... .......... .......... .......... .......... 94% 395M 0s 2024-09-12T00:39:38.765 INFO:teuthology.orchestra.run.smithi133.stderr: 88050K .......... .......... .......... .......... .......... 94% 394M 0s 2024-09-12T00:39:38.765 INFO:teuthology.orchestra.run.smithi133.stderr: 88100K .......... .......... .......... .......... .......... 94% 124M 0s 2024-09-12T00:39:38.765 INFO:teuthology.orchestra.run.smithi133.stderr: 88150K .......... .......... .......... .......... .......... 94% 51.5M 0s 2024-09-12T00:39:38.765 INFO:teuthology.orchestra.run.smithi133.stderr: 88200K .......... .......... .......... .......... .......... 94% 314M 0s 2024-09-12T00:39:38.765 INFO:teuthology.orchestra.run.smithi133.stderr: 88250K .......... .......... .......... .......... .......... 95% 393M 0s 2024-09-12T00:39:38.765 INFO:teuthology.orchestra.run.smithi133.stderr: 88300K .......... .......... .......... .......... .......... 95% 303M 0s 2024-09-12T00:39:38.765 INFO:teuthology.orchestra.run.smithi133.stderr: 88350K .......... .......... .......... .......... .......... 95% 435M 0s 2024-09-12T00:39:38.765 INFO:teuthology.orchestra.run.smithi133.stderr: 88400K .......... .......... .......... .......... .......... 95% 412M 0s 2024-09-12T00:39:38.765 INFO:teuthology.orchestra.run.smithi133.stderr: 88450K .......... .......... .......... .......... .......... 95% 312M 0s 2024-09-12T00:39:38.765 INFO:teuthology.orchestra.run.smithi133.stderr: 88500K .......... .......... .......... .......... .......... 95% 299M 0s 2024-09-12T00:39:38.765 INFO:teuthology.orchestra.run.smithi133.stderr: 88550K .......... .......... .......... .......... .......... 95% 335M 0s 2024-09-12T00:39:38.765 INFO:teuthology.orchestra.run.smithi133.stderr: 88600K .......... .......... .......... .......... .......... 95% 141M 0s 2024-09-12T00:39:38.766 INFO:teuthology.orchestra.run.smithi133.stderr: 88650K .......... .......... .......... .......... .......... 95% 383M 0s 2024-09-12T00:39:38.766 INFO:teuthology.orchestra.run.smithi133.stderr: 88700K .......... .......... .......... .......... .......... 95% 98.6M 0s 2024-09-12T00:39:38.766 INFO:teuthology.orchestra.run.smithi133.stderr: 88750K .......... .......... .......... .......... .......... 95% 425M 0s 2024-09-12T00:39:38.766 INFO:teuthology.orchestra.run.smithi133.stderr: 88800K .......... .......... .......... .......... .......... 95% 171M 0s 2024-09-12T00:39:38.766 INFO:teuthology.orchestra.run.smithi133.stderr: 88850K .......... .......... .......... .......... .......... 95% 402M 0s 2024-09-12T00:39:38.766 INFO:teuthology.orchestra.run.smithi133.stderr: 88900K .......... .......... .......... .......... .......... 95% 408M 0s 2024-09-12T00:39:38.766 INFO:teuthology.orchestra.run.smithi133.stderr: 88950K .......... .......... .......... .......... .......... 95% 446M 0s 2024-09-12T00:39:38.766 INFO:teuthology.orchestra.run.smithi133.stderr: 89000K .......... .......... .......... .......... .......... 95% 425M 0s 2024-09-12T00:39:38.766 INFO:teuthology.orchestra.run.smithi133.stderr: 89050K .......... .......... .......... .......... .......... 95% 368M 0s 2024-09-12T00:39:38.766 INFO:teuthology.orchestra.run.smithi133.stderr: 89100K .......... .......... .......... .......... .......... 95% 377M 0s 2024-09-12T00:39:38.766 INFO:teuthology.orchestra.run.smithi133.stderr: 89150K .......... .......... .......... .......... .......... 96% 441M 0s 2024-09-12T00:39:38.766 INFO:teuthology.orchestra.run.smithi133.stderr: 89200K .......... .......... .......... .......... .......... 96% 344M 0s 2024-09-12T00:39:38.766 INFO:teuthology.orchestra.run.smithi133.stderr: 89250K .......... .......... .......... .......... .......... 96% 61.1M 0s 2024-09-12T00:39:38.767 INFO:teuthology.orchestra.run.smithi133.stderr: 89300K .......... .......... .......... .......... .......... 96% 314M 0s 2024-09-12T00:39:38.767 INFO:teuthology.orchestra.run.smithi133.stderr: 89350K .......... .......... .......... .......... .......... 96% 120M 0s 2024-09-12T00:39:38.767 INFO:teuthology.orchestra.run.smithi133.stderr: 89400K .......... .......... .......... .......... .......... 96% 335M 0s 2024-09-12T00:39:38.767 INFO:teuthology.orchestra.run.smithi133.stderr: 89450K .......... .......... .......... .......... .......... 96% 457M 0s 2024-09-12T00:39:38.767 INFO:teuthology.orchestra.run.smithi133.stderr: 89500K .......... .......... .......... .......... .......... 96% 361M 0s 2024-09-12T00:39:38.767 INFO:teuthology.orchestra.run.smithi133.stderr: 89550K .......... .......... .......... .......... .......... 96% 114M 0s 2024-09-12T00:39:38.767 INFO:teuthology.orchestra.run.smithi133.stderr: 89600K .......... .......... .......... .......... .......... 96% 435M 0s 2024-09-12T00:39:38.767 INFO:teuthology.orchestra.run.smithi133.stderr: 89650K .......... .......... .......... .......... .......... 96% 438M 0s 2024-09-12T00:39:38.767 INFO:teuthology.orchestra.run.smithi133.stderr: 89700K .......... .......... .......... .......... .......... 96% 365M 0s 2024-09-12T00:39:38.767 INFO:teuthology.orchestra.run.smithi133.stderr: 89750K .......... .......... .......... .......... .......... 96% 73.4M 0s 2024-09-12T00:39:38.767 INFO:teuthology.orchestra.run.smithi133.stderr: 89800K .......... .......... .......... .......... .......... 96% 408M 0s 2024-09-12T00:39:38.767 INFO:teuthology.orchestra.run.smithi133.stderr: 89850K .......... .......... .......... .......... .......... 96% 315M 0s 2024-09-12T00:39:38.767 INFO:teuthology.orchestra.run.smithi133.stderr: 89900K .......... .......... .......... .......... .......... 96% 155M 0s 2024-09-12T00:39:38.767 INFO:teuthology.orchestra.run.smithi133.stderr: 89950K .......... .......... .......... .......... .......... 96% 279M 0s 2024-09-12T00:39:38.768 INFO:teuthology.orchestra.run.smithi133.stderr: 90000K .......... .......... .......... .......... .......... 96% 419M 0s 2024-09-12T00:39:38.768 INFO:teuthology.orchestra.run.smithi133.stderr: 90050K .......... .......... .......... .......... .......... 96% 434M 0s 2024-09-12T00:39:38.768 INFO:teuthology.orchestra.run.smithi133.stderr: 90100K .......... .......... .......... .......... .......... 97% 76.0M 0s 2024-09-12T00:39:38.768 INFO:teuthology.orchestra.run.smithi133.stderr: 90150K .......... .......... .......... .......... .......... 97% 395M 0s 2024-09-12T00:39:38.768 INFO:teuthology.orchestra.run.smithi133.stderr: 90200K .......... .......... .......... .......... .......... 97% 346M 0s 2024-09-12T00:39:38.768 INFO:teuthology.orchestra.run.smithi133.stderr: 90250K .......... .......... .......... .......... .......... 97% 233M 0s 2024-09-12T00:39:38.768 INFO:teuthology.orchestra.run.smithi133.stderr: 90300K .......... .......... .......... .......... .......... 97% 51.9M 0s 2024-09-12T00:39:38.768 INFO:teuthology.orchestra.run.smithi133.stderr: 90350K .......... .......... .......... .......... .......... 97% 414M 0s 2024-09-12T00:39:38.768 INFO:teuthology.orchestra.run.smithi133.stderr: 90400K .......... .......... .......... .......... .......... 97% 387M 0s 2024-09-12T00:39:38.768 INFO:teuthology.orchestra.run.smithi133.stderr: 90450K .......... .......... .......... .......... .......... 97% 281M 0s 2024-09-12T00:39:38.768 INFO:teuthology.orchestra.run.smithi133.stderr: 90500K .......... .......... .......... .......... .......... 97% 74.2M 0s 2024-09-12T00:39:38.768 INFO:teuthology.orchestra.run.smithi133.stderr: 90550K .......... .......... .......... .......... .......... 97% 428M 0s 2024-09-12T00:39:38.768 INFO:teuthology.orchestra.run.smithi133.stderr: 90600K .......... .......... .......... .......... .......... 97% 246M 0s 2024-09-12T00:39:38.768 INFO:teuthology.orchestra.run.smithi133.stderr: 90650K .......... .......... .......... .......... .......... 97% 446M 0s 2024-09-12T00:39:38.769 INFO:teuthology.orchestra.run.smithi133.stderr: 90700K .......... .......... .......... .......... .......... 97% 11.2M 0s 2024-09-12T00:39:38.769 INFO:teuthology.orchestra.run.smithi133.stderr: 90750K .......... .......... .......... .......... .......... 97% 186M 0s 2024-09-12T00:39:38.769 INFO:teuthology.orchestra.run.smithi133.stderr: 90800K .......... .......... .......... .......... .......... 97% 391M 0s 2024-09-12T00:39:38.769 INFO:teuthology.orchestra.run.smithi133.stderr: 90850K .......... .......... .......... .......... .......... 97% 114M 0s 2024-09-12T00:39:38.769 INFO:teuthology.orchestra.run.smithi133.stderr: 90900K .......... .......... .......... .......... .......... 97% 391M 0s 2024-09-12T00:39:38.769 INFO:teuthology.orchestra.run.smithi133.stderr: 90950K .......... .......... .......... .......... .......... 97% 418M 0s 2024-09-12T00:39:38.769 INFO:teuthology.orchestra.run.smithi133.stderr: 91000K .......... .......... .......... .......... .......... 98% 444M 0s 2024-09-12T00:39:38.769 INFO:teuthology.orchestra.run.smithi133.stderr: 91050K .......... .......... .......... .......... .......... 98% 125M 0s 2024-09-12T00:39:38.769 INFO:teuthology.orchestra.run.smithi133.stderr: 91100K .......... .......... .......... .......... .......... 98% 231M 0s 2024-09-12T00:39:38.769 INFO:teuthology.orchestra.run.smithi133.stderr: 91150K .......... .......... .......... .......... .......... 98% 436M 0s 2024-09-12T00:39:38.769 INFO:teuthology.orchestra.run.smithi133.stderr: 91200K .......... .......... .......... .......... .......... 98% 372M 0s 2024-09-12T00:39:38.769 INFO:teuthology.orchestra.run.smithi133.stderr: 91250K .......... .......... .......... .......... .......... 98% 434M 0s 2024-09-12T00:39:38.769 INFO:teuthology.orchestra.run.smithi133.stderr: 91300K .......... .......... .......... .......... .......... 98% 104M 0s 2024-09-12T00:39:38.769 INFO:teuthology.orchestra.run.smithi133.stderr: 91350K .......... .......... .......... .......... .......... 98% 327M 0s 2024-09-12T00:39:38.770 INFO:teuthology.orchestra.run.smithi133.stderr: 91400K .......... .......... .......... .......... .......... 98% 424M 0s 2024-09-12T00:39:38.770 INFO:teuthology.orchestra.run.smithi133.stderr: 91450K .......... .......... .......... .......... .......... 98% 402M 0s 2024-09-12T00:39:38.770 INFO:teuthology.orchestra.run.smithi133.stderr: 91500K .......... .......... .......... .......... .......... 98% 177M 0s 2024-09-12T00:39:38.770 INFO:teuthology.orchestra.run.smithi133.stderr: 91550K .......... .......... .......... .......... .......... 98% 403M 0s 2024-09-12T00:39:38.770 INFO:teuthology.orchestra.run.smithi133.stderr: 91600K .......... .......... .......... .......... .......... 98% 389M 0s 2024-09-12T00:39:38.770 INFO:teuthology.orchestra.run.smithi133.stderr: 91650K .......... .......... .......... .......... .......... 98% 429M 0s 2024-09-12T00:39:38.770 INFO:teuthology.orchestra.run.smithi133.stderr: 91700K .......... .......... .......... .......... .......... 98% 193M 0s 2024-09-12T00:39:38.770 INFO:teuthology.orchestra.run.smithi133.stderr: 91750K .......... .......... .......... .......... .......... 98% 386M 0s 2024-09-12T00:39:38.770 INFO:teuthology.orchestra.run.smithi133.stderr: 91800K .......... .......... .......... .......... .......... 98% 366M 0s 2024-09-12T00:39:38.770 INFO:teuthology.orchestra.run.smithi133.stderr: 91850K .......... .......... .......... .......... .......... 98% 431M 0s 2024-09-12T00:39:38.770 INFO:teuthology.orchestra.run.smithi133.stderr: 91900K .......... .......... .......... .......... .......... 98% 183M 0s 2024-09-12T00:39:38.770 INFO:teuthology.orchestra.run.smithi133.stderr: 91950K .......... .......... .......... .......... .......... 99% 429M 0s 2024-09-12T00:39:38.770 INFO:teuthology.orchestra.run.smithi133.stderr: 92000K .......... .......... .......... .......... .......... 99% 378M 0s 2024-09-12T00:39:38.770 INFO:teuthology.orchestra.run.smithi133.stderr: 92050K .......... .......... .......... .......... .......... 99% 145M 0s 2024-09-12T00:39:38.770 INFO:teuthology.orchestra.run.smithi133.stderr: 92100K .......... .......... .......... .......... .......... 99% 391M 0s 2024-09-12T00:39:38.771 INFO:teuthology.orchestra.run.smithi133.stderr: 92150K .......... .......... .......... .......... .......... 99% 23.3M 0s 2024-09-12T00:39:38.771 INFO:teuthology.orchestra.run.smithi133.stderr: 92200K .......... .......... .......... .......... .......... 99% 150M 0s 2024-09-12T00:39:38.771 INFO:teuthology.orchestra.run.smithi133.stderr: 92250K .......... .......... .......... .......... .......... 99% 249M 0s 2024-09-12T00:39:38.771 INFO:teuthology.orchestra.run.smithi133.stderr: 92300K .......... .......... .......... .......... .......... 99% 417M 0s 2024-09-12T00:39:38.771 INFO:teuthology.orchestra.run.smithi133.stderr: 92350K .......... .......... .......... .......... .......... 99% 182M 0s 2024-09-12T00:39:38.771 INFO:teuthology.orchestra.run.smithi133.stderr: 92400K .......... .......... .......... .......... .......... 99% 401M 0s 2024-09-12T00:39:38.771 INFO:teuthology.orchestra.run.smithi133.stderr: 92450K .......... .......... .......... .......... .......... 99% 384M 0s 2024-09-12T00:39:38.771 INFO:teuthology.orchestra.run.smithi133.stderr: 92500K .......... .......... .......... .......... .......... 99% 435M 0s 2024-09-12T00:39:38.771 INFO:teuthology.orchestra.run.smithi133.stderr: 92550K .......... .......... .......... .......... .......... 99% 76.2M 0s 2024-09-12T00:39:38.771 INFO:teuthology.orchestra.run.smithi133.stderr: 92600K .......... .......... .......... .......... .......... 99% 86.6M 0s 2024-09-12T00:39:38.771 INFO:teuthology.orchestra.run.smithi133.stderr: 92650K .......... .......... .......... .......... .......... 99% 353M 0s 2024-09-12T00:39:38.771 INFO:teuthology.orchestra.run.smithi133.stderr: 92700K .......... .......... .......... .......... .......... 99% 297M 0s 2024-09-12T00:39:38.771 INFO:teuthology.orchestra.run.smithi133.stderr: 92750K .......... .......... .......... .......... .......... 99% 418M 0s 2024-09-12T00:39:38.771 INFO:teuthology.orchestra.run.smithi133.stderr: 92800K .......... .......... .......... .......... .......... 99% 76.6M 0s 2024-09-12T00:39:38.772 INFO:teuthology.orchestra.run.smithi133.stderr: 92850K .......... .......... .......... .......... .......... 99% 180M 0s 2024-09-12T00:39:38.772 INFO:teuthology.orchestra.run.smithi133.stderr: 92900K 100% 134G=0.8s 2024-09-12T00:39:38.772 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-09-12T00:39:38.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12 00:39:37 (115 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-12T00:39:38.772 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-09-12T00:39:38.801 INFO:teuthology.orchestra.run.smithi133.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T00:39:38.801 INFO:teuthology.orchestra.run.smithi133.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T00:39:38.801 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T00:39:38.801 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T00:39:38.801 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T00:39:38.802 INFO:teuthology.orchestra.run.smithi133.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T00:39:38.802 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T00:39:38.802 INFO:teuthology.orchestra.run.smithi133.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T00:39:38.802 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T00:39:38.802 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T00:39:38.802 INFO:teuthology.orchestra.run.smithi133.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T00:39:38.802 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T00:39:38.802 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T00:39:38.802 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T00:39:38.802 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T00:39:38.802 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T00:39:38.802 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T00:39:38.802 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T00:39:38.802 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T00:39:38.803 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T00:39:38.803 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T00:39:38.803 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T00:39:38.803 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T00:39:38.803 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T00:39:38.803 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T00:39:38.803 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T00:39:38.803 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T00:39:38.803 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T00:39:38.803 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T00:39:38.803 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T00:39:38.803 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T00:39:38.803 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T00:39:38.804 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T00:39:38.804 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T00:39:38.804 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T00:39:38.804 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T00:39:38.804 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T00:39:38.804 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T00:39:38.804 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T00:39:38.804 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T00:39:38.804 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T00:39:38.804 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T00:39:38.804 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T00:39:38.804 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T00:39:38.804 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T00:39:38.804 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T00:39:38.805 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T00:39:38.805 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T00:39:38.805 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T00:39:38.805 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:39:38.805 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T00:39:38.805 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T00:39:38.805 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T00:39:38.805 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T00:39:38.805 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T00:39:38.805 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T00:39:38.805 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T00:39:38.805 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T00:39:38.805 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T00:39:38.805 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T00:39:38.806 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T00:39:38.806 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T00:39:38.806 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T00:39:38.806 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T00:39:38.806 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T00:39:38.806 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T00:39:38.806 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T00:39:38.806 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T00:39:38.806 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T00:39:38.806 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T00:39:38.806 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T00:39:38.806 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T00:39:38.806 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T00:39:38.806 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T00:39:38.807 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T00:39:38.807 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T00:39:38.807 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T00:39:38.807 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T00:39:38.807 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T00:39:38.807 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T00:39:38.807 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T00:39:38.807 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T00:39:38.807 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T00:39:38.807 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T00:39:38.807 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T00:39:38.807 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T00:39:38.807 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T00:39:38.808 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T00:39:38.808 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T00:39:38.808 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T00:39:38.808 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T00:39:38.808 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T00:39:38.808 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T00:39:38.808 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T00:39:38.808 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T00:39:38.808 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T00:39:38.808 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T00:39:38.808 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T00:39:38.808 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T00:39:38.808 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T00:39:38.808 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T00:39:38.809 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T00:39:38.809 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T00:39:38.809 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T00:39:38.809 INFO:teuthology.orchestra.run.smithi133.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T00:39:38.809 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T00:39:38.809 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T00:39:38.809 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T00:39:38.809 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T00:39:38.809 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T00:39:38.809 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T00:39:38.809 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T00:39:38.809 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T00:39:38.809 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T00:39:38.810 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T00:39:38.810 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T00:39:38.810 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T00:39:38.810 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T00:39:38.810 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T00:39:38.810 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T00:39:38.810 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T00:39:38.810 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T00:39:38.810 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T00:39:38.810 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T00:39:38.810 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T00:39:38.810 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T00:39:38.810 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T00:39:38.810 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T00:39:38.811 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T00:39:38.811 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T00:39:38.811 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T00:39:38.811 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T00:39:38.811 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T00:39:38.811 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T00:39:38.811 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T00:39:38.811 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T00:39:38.811 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T00:39:38.811 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T00:39:38.811 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T00:39:38.811 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T00:39:38.811 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T00:39:38.812 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T00:39:38.812 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T00:39:38.812 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T00:39:38.812 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T00:39:38.812 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T00:39:38.812 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T00:39:38.812 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T00:39:38.812 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T00:39:38.812 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T00:39:38.812 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T00:39:38.812 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T00:39:38.812 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T00:39:38.812 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T00:39:38.812 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T00:39:38.813 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T00:39:38.813 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T00:39:38.813 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T00:39:38.813 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T00:39:38.813 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T00:39:38.813 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T00:39:38.813 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T00:39:38.813 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T00:39:38.813 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T00:39:38.813 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T00:39:38.813 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T00:39:38.813 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T00:39:38.813 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T00:39:38.814 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T00:39:38.814 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T00:39:38.814 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T00:39:38.814 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T00:39:38.814 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T00:39:38.814 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T00:39:38.814 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T00:39:38.814 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T00:39:38.814 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T00:39:38.814 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T00:39:38.814 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T00:39:38.814 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T00:39:38.814 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T00:39:38.814 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T00:39:38.815 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T00:39:38.815 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T00:39:38.815 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T00:39:38.815 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T00:39:38.815 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T00:39:38.815 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T00:39:38.815 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T00:39:38.815 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T00:39:38.815 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T00:39:38.815 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T00:39:38.815 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T00:39:38.815 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T00:39:38.815 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T00:39:38.815 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T00:39:38.816 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T00:39:38.816 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T00:39:38.816 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T00:39:38.816 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T00:39:38.816 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T00:39:38.816 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T00:39:38.816 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T00:39:38.816 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T00:39:38.816 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T00:39:38.816 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T00:39:38.816 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T00:39:38.816 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T00:39:38.816 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T00:39:38.817 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T00:39:38.817 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T00:39:38.817 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T00:39:38.817 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T00:39:38.817 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T00:39:38.817 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T00:39:38.817 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T00:39:38.817 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T00:39:38.817 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T00:39:38.817 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T00:39:38.817 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T00:39:38.817 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T00:39:38.817 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T00:39:38.818 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T00:39:38.818 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T00:39:38.818 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T00:39:38.818 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T00:39:38.818 INFO:teuthology.orchestra.run.smithi133.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T00:39:38.818 INFO:teuthology.orchestra.run.smithi133.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-12T00:39:39.014 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:39:39.014 INFO:teuthology.orchestra.run.smithi133.stdout:Welcome to Gradle 6.0.1! 2024-09-12T00:39:39.014 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:39:39.014 INFO:teuthology.orchestra.run.smithi133.stdout:Here are the highlights of this release: 2024-09-12T00:39:39.014 INFO:teuthology.orchestra.run.smithi133.stdout: - Substantial improvements in dependency management, including 2024-09-12T00:39:39.014 INFO:teuthology.orchestra.run.smithi133.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T00:39:39.014 INFO:teuthology.orchestra.run.smithi133.stdout: - Advanced control of transitive versions 2024-09-12T00:39:39.014 INFO:teuthology.orchestra.run.smithi133.stdout: - Support for optional features and dependencies 2024-09-12T00:39:39.014 INFO:teuthology.orchestra.run.smithi133.stdout: - Rules to tweak published metadata 2024-09-12T00:39:39.015 INFO:teuthology.orchestra.run.smithi133.stdout: - Support for Java 13 2024-09-12T00:39:39.015 INFO:teuthology.orchestra.run.smithi133.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T00:39:39.015 INFO:teuthology.orchestra.run.smithi133.stdout: - New Zinc compiler for Scala 2024-09-12T00:39:39.015 INFO:teuthology.orchestra.run.smithi133.stdout: - VS2019 support 2024-09-12T00:39:39.015 INFO:teuthology.orchestra.run.smithi133.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T00:39:39.015 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:39:39.015 INFO:teuthology.orchestra.run.smithi133.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T00:39:39.015 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:39:39.015 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:39:39.015 INFO:teuthology.orchestra.run.smithi133.stdout:------------------------------------------------------------ 2024-09-12T00:39:39.018 INFO:teuthology.orchestra.run.smithi133.stdout:Gradle 6.0.1 2024-09-12T00:39:39.018 INFO:teuthology.orchestra.run.smithi133.stdout:------------------------------------------------------------ 2024-09-12T00:39:39.018 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:39:39.018 INFO:teuthology.orchestra.run.smithi133.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T00:39:39.018 INFO:teuthology.orchestra.run.smithi133.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T00:39:39.018 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:39:39.018 INFO:teuthology.orchestra.run.smithi133.stdout:Kotlin: 1.3.50 2024-09-12T00:39:39.018 INFO:teuthology.orchestra.run.smithi133.stdout:Groovy: 2.5.8 2024-09-12T00:39:39.019 INFO:teuthology.orchestra.run.smithi133.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T00:39:39.019 INFO:teuthology.orchestra.run.smithi133.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-12T00:39:39.019 INFO:teuthology.orchestra.run.smithi133.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-12T00:39:39.019 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:39:39.033 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T00:39:39.033 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:39:39.033 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi133.front.sepia.ceph.com 2024-09-12T00:39:39.033 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:39:39.033 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi160.front.sepia.ceph.com 2024-09-12T00:39:39.033 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T00:39:39.371 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T00:39:39.371 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T00:39:39.371 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'IRIGVXECCHGZAUSQZZQH', 'access_secret': '+GqqY9LWaPat8gpsqQDr2Tyy2tMu8vMyRIqNooaWNk12MRNCe5+U6w==', 'region': 'mexico', 'endpoint': 'smithi133.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi133.front.sepia.ceph.com'} 2024-09-12T00:39:39.371 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T00:39:39.371 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'IRIGVXECCHGZAUSQZZQH', '--secret', '+GqqY9LWaPat8gpsqQDr2Tyy2tMu8vMyRIqNooaWNk12MRNCe5+U6w==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T00:39:39.372 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key IRIGVXECCHGZAUSQZZQH --secret +GqqY9LWaPat8gpsqQDr2Tyy2tMu8vMyRIqNooaWNk12MRNCe5+U6w== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T00:39:39.436 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:39.436 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:39.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.472+0000 7f91d7540800 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.474+0000 7f91d7540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:39.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.474+0000 7f91d7540800 20 realm 2024-09-12T00:39:39.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.474+0000 7f91d7540800 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.474+0000 7f91d7540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:39.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.474+0000 7f91d7540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:39.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.474+0000 7f91d7540800 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.474+0000 7f91d7540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:39.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.474+0000 7f91d7540800 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.475+0000 7f91d7540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:39.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.475+0000 7f91d7540800 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.476+0000 7f91d7540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:39.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.476+0000 7f91d7540800 20 searching for the correct realm 2024-09-12T00:39:39.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.478+0000 7f91cbfff640 0 -- 172.21.15.133:0/190729003 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f91bc044020 msgr2=0x7f91bc06c570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:39.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.684+0000 7f91cbfff640 0 -- 172.21.15.133:0/190729003 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f91c4074020 msgr2=0x7f91c40a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:39.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.892+0000 7f91d7540800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:39.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.892+0000 7f91d7540800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.892+0000 7f91d7540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.892+0000 7f91d7540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.892+0000 7f91d7540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.892+0000 7f91d7540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.892+0000 7f91d7540800 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.892+0000 7f91d7540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.892+0000 7f91d7540800 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.893+0000 7f91d7540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:39.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.893+0000 7f91d7540800 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.893+0000 7f91d7540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.893+0000 7f91d7540800 20 zone default found 2024-09-12T00:39:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.893+0000 7f91d7540800 4 Realm: () 2024-09-12T00:39:39.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.893+0000 7f91d7540800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.893+0000 7f91d7540800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.893+0000 7f91d7540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.893+0000 7f91d7540800 20 zonegroup default 2024-09-12T00:39:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.893+0000 7f91d7540800 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.894+0000 7f91d7540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.894+0000 7f91d7540800 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.894+0000 7f91d7540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.894+0000 7f91d7540800 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.894+0000 7f91d7540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.894+0000 7f91d7540800 20 started sync module instance, tier type = 2024-09-12T00:39:39.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.894+0000 7f91d7540800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.904+0000 7f91d7540800 20 add_watcher() i=0 2024-09-12T00:39:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.904+0000 7f91d7540800 20 add_watcher() i=1 2024-09-12T00:39:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.904+0000 7f91d7540800 20 add_watcher() i=2 2024-09-12T00:39:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.904+0000 7f91d7540800 20 add_watcher() i=3 2024-09-12T00:39:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.904+0000 7f91d7540800 20 add_watcher() i=4 2024-09-12T00:39:39.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.904+0000 7f91d7540800 20 add_watcher() i=5 2024-09-12T00:39:39.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.904+0000 7f91d7540800 20 add_watcher() i=6 2024-09-12T00:39:39.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.905+0000 7f91d7540800 20 add_watcher() i=7 2024-09-12T00:39:39.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.905+0000 7f91d7540800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:39.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.907+0000 7f9089fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:39.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.908+0000 7f91d7540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:39.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.908+0000 7f91d7540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:39.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.908+0000 7f91d7540800 5 note: GC not initialized 2024-09-12T00:39:39.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.908+0000 7f9088fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:39.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.908+0000 7f91d7540800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:39.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.908+0000 7f91d7540800 20 Filter name: none 2024-09-12T00:39:39.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.908+0000 7f90027fc640 20 reqs_thread_entry: start 2024-09-12T00:39:39.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.908+0000 7f91d7540800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T00:39:39.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.908+0000 7f91d7540800 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.908+0000 7f91d7540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:39.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.908+0000 7f91d7540800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T00:39:39.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.908+0000 7f91d7540800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:39:39.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.908+0000 7f91d7540800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T00:39:39.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.908+0000 7f91d7540800 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.909+0000 7f91d7540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:39.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.909+0000 7f91d7540800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T00:39:39.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.909+0000 7f91d7540800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:39:39.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.909+0000 7f91d7540800 10 cache get: name=default.rgw.meta+users.keys+IRIGVXECCHGZAUSQZZQH : miss 2024-09-12T00:39:39.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.909+0000 7f91d7540800 20 rados->read ofs=0 len=0 2024-09-12T00:39:39.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.909+0000 7f91d7540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:39.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.909+0000 7f91d7540800 10 cache put: name=default.rgw.meta+users.keys+IRIGVXECCHGZAUSQZZQH info.flags=0x0 2024-09-12T00:39:39.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.909+0000 7f91d7540800 10 adding default.rgw.meta+users.keys+IRIGVXECCHGZAUSQZZQH to cache LRU end 2024-09-12T00:39:39.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.909+0000 7f91d7540800 10 cache get: name=default.rgw.meta+users.keys+IRIGVXECCHGZAUSQZZQH : hit (negative entry) 2024-09-12T00:39:39.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.909+0000 7f91d7540800 10 cache get: name=default.rgw.meta+users.keys+IRIGVXECCHGZAUSQZZQH : hit (negative entry) 2024-09-12T00:39:39.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.910+0000 7f91d7540800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:39:39.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.910+0000 7f91d7540800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:39:39.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.910+0000 7f91d7540800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T00:39:39.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.911+0000 7f90b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497099 cookie 93896528495696 notifier 8309 bl.length()=670 2024-09-12T00:39:39.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.911+0000 7f90b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:39:39.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.911+0000 7f90b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:39:39.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.914+0000 7f91d7540800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:39:39.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.914+0000 7f91d7540800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:39:39.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.914+0000 7f91d7540800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T00:39:39.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.914+0000 7f90b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 93896528486080 notifier 8309 bl.length()=200 2024-09-12T00:39:39.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.914+0000 7f90b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:39:39.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.914+0000 7f90b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:39:39.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.917+0000 7f91d7540800 10 cache put: name=default.rgw.meta+users.keys+IRIGVXECCHGZAUSQZZQH info.flags=0x7 2024-09-12T00:39:39.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.917+0000 7f91d7540800 10 moving default.rgw.meta+users.keys+IRIGVXECCHGZAUSQZZQH to cache LRU end 2024-09-12T00:39:39.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.917+0000 7f91d7540800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:IRIGVXECCHGZAUSQZZQH, ofs0, ns] 2024-09-12T00:39:39.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.917+0000 7f90b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497013 cookie 93896528486080 notifier 8309 bl.length()=189 2024-09-12T00:39:39.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.917+0000 7f90b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+IRIGVXECCHGZAUSQZZQH info.flags=0x7 2024-09-12T00:39:39.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.917+0000 7f90b67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+IRIGVXECCHGZAUSQZZQH to cache LRU end 2024-09-12T00:39:39.918 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T00:39:39.918 INFO:teuthology.orchestra.run.smithi133.stdout: "user_id": "tester.client.0", 2024-09-12T00:39:39.918 INFO:teuthology.orchestra.run.smithi133.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T00:39:39.918 INFO:teuthology.orchestra.run.smithi133.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T00:39:39.918 INFO:teuthology.orchestra.run.smithi133.stdout: "suspended": 0, 2024-09-12T00:39:39.918 INFO:teuthology.orchestra.run.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:39:39.918 INFO:teuthology.orchestra.run.smithi133.stdout: "subusers": [], 2024-09-12T00:39:39.919 INFO:teuthology.orchestra.run.smithi133.stdout: "keys": [ 2024-09-12T00:39:39.919 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-09-12T00:39:39.919 INFO:teuthology.orchestra.run.smithi133.stdout: "user": "tester.client.0", 2024-09-12T00:39:39.919 INFO:teuthology.orchestra.run.smithi133.stdout: "access_key": "IRIGVXECCHGZAUSQZZQH", 2024-09-12T00:39:39.919 INFO:teuthology.orchestra.run.smithi133.stdout: "secret_key": "+GqqY9LWaPat8gpsqQDr2Tyy2tMu8vMyRIqNooaWNk12MRNCe5+U6w==", 2024-09-12T00:39:39.919 INFO:teuthology.orchestra.run.smithi133.stdout: "active": true, 2024-09-12T00:39:39.920 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:39:39.910505Z" 2024-09-12T00:39:39.920 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-09-12T00:39:39.920 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-09-12T00:39:39.920 INFO:teuthology.orchestra.run.smithi133.stdout: "swift_keys": [], 2024-09-12T00:39:39.920 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": [], 2024-09-12T00:39:39.920 INFO:teuthology.orchestra.run.smithi133.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:39.920 INFO:teuthology.orchestra.run.smithi133.stdout: "default_placement": "", 2024-09-12T00:39:39.921 INFO:teuthology.orchestra.run.smithi133.stdout: "default_storage_class": "", 2024-09-12T00:39:39.921 INFO:teuthology.orchestra.run.smithi133.stdout: "placement_tags": [], 2024-09-12T00:39:39.921 INFO:teuthology.orchestra.run.smithi133.stdout: "bucket_quota": { 2024-09-12T00:39:39.921 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:39:39.921 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:39:39.921 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:39:39.921 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:39:39.921 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:39:39.922 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:39:39.922 INFO:teuthology.orchestra.run.smithi133.stdout: "user_quota": { 2024-09-12T00:39:39.922 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:39:39.922 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:39:39.922 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:39:39.922 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:39:39.923 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:39:39.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:39:39.923 INFO:teuthology.orchestra.run.smithi133.stdout: "temp_url_keys": [], 2024-09-12T00:39:39.923 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "rgw", 2024-09-12T00:39:39.923 INFO:teuthology.orchestra.run.smithi133.stdout: "mfa_ids": [], 2024-09-12T00:39:39.923 INFO:teuthology.orchestra.run.smithi133.stdout: "account_id": "", 2024-09-12T00:39:39.923 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/", 2024-09-12T00:39:39.924 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:39:39.910494Z", 2024-09-12T00:39:39.924 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2024-09-12T00:39:39.924 INFO:teuthology.orchestra.run.smithi133.stdout: "group_ids": [] 2024-09-12T00:39:39.924 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T00:39:39.924 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:39:39.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.919+0000 7f9089fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:39.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.922+0000 7f91d7540800 20 remove_watcher() i=0 2024-09-12T00:39:39.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.922+0000 7f91d7540800 2 removed watcher, disabling cache 2024-09-12T00:39:39.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.922+0000 7f91d7540800 20 remove_watcher() i=1 2024-09-12T00:39:39.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.924+0000 7f91d7540800 20 remove_watcher() i=2 2024-09-12T00:39:39.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.925+0000 7f91d7540800 20 remove_watcher() i=3 2024-09-12T00:39:39.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.926+0000 7f91d7540800 20 remove_watcher() i=4 2024-09-12T00:39:39.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.927+0000 7f91d7540800 20 remove_watcher() i=5 2024-09-12T00:39:39.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.930+0000 7f91d7540800 20 remove_watcher() i=6 2024-09-12T00:39:39.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:39.931+0000 7f91d7540800 20 remove_watcher() i=7 2024-09-12T00:39:39.944 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:39:39.944 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T00:39:39.975 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T00:39:39.975 DEBUG:teuthology.orchestra.run.smithi133:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T00:39:40.042 DEBUG:teuthology.orchestra.run.smithi133:> radosgw-admin gc process --include-all 2024-09-12T00:39:40.135 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:40.135 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:40.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.173+0000 7f82b652a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.174+0000 7f82b652a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.174+0000 7f82b652a800 20 realm 2024-09-12T00:39:40.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.174+0000 7f82b652a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.175+0000 7f82b652a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.175+0000 7f82b652a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:40.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.175+0000 7f82b652a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.175+0000 7f82b652a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.175+0000 7f82b652a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.175+0000 7f82b652a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:40.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.175+0000 7f82b652a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.176+0000 7f82b652a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:40.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.176+0000 7f82b652a800 20 searching for the correct realm 2024-09-12T00:39:40.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.178+0000 7f82b1ad9640 0 -- 172.21.15.133:0/3800541902 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f82a8079940 msgr2=0x7f82a80614f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:40.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.182+0000 7f82b22da640 0 -- 172.21.15.133:0/3800541902 >> [v2:172.21.15.160:6818/507321805,v1:172.21.15.160:6819/507321805] conn(0x7f82a801b040 msgr2=0x7f82a8098ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:40.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.390+0000 7f82b652a800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:40.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.390+0000 7f82b652a800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:40.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.390+0000 7f82b652a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:40.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.390+0000 7f82b652a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:40.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.390+0000 7f82b652a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:40.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.390+0000 7f82b652a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:40.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.390+0000 7f82b652a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.390+0000 7f82b652a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.390+0000 7f82b652a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.390+0000 7f82b652a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:40.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.390+0000 7f82b652a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.391+0000 7f82b652a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:40.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.391+0000 7f82b652a800 20 zone default found 2024-09-12T00:39:40.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.391+0000 7f82b652a800 4 Realm: () 2024-09-12T00:39:40.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.391+0000 7f82b652a800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:40.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.391+0000 7f82b652a800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:40.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.391+0000 7f82b652a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:40.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.391+0000 7f82b652a800 20 zonegroup default 2024-09-12T00:39:40.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.391+0000 7f82b652a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.391+0000 7f82b652a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.391+0000 7f82b652a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.391+0000 7f82b652a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.391+0000 7f82b652a800 20 rados->read ofs=0 len=0 2024-09-12T00:39:40.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.392+0000 7f82b652a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:40.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.392+0000 7f82b652a800 20 started sync module instance, tier type = 2024-09-12T00:39:40.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.392+0000 7f82b652a800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:40.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.401+0000 7f82b652a800 20 add_watcher() i=0 2024-09-12T00:39:40.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.401+0000 7f82b652a800 20 add_watcher() i=1 2024-09-12T00:39:40.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.401+0000 7f82b652a800 20 add_watcher() i=2 2024-09-12T00:39:40.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.401+0000 7f82b652a800 20 add_watcher() i=3 2024-09-12T00:39:40.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.401+0000 7f82b652a800 20 add_watcher() i=4 2024-09-12T00:39:40.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.401+0000 7f82b652a800 20 add_watcher() i=5 2024-09-12T00:39:40.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.401+0000 7f82b652a800 20 add_watcher() i=6 2024-09-12T00:39:40.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.402+0000 7f82b652a800 20 add_watcher() i=7 2024-09-12T00:39:40.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.402+0000 7f82b652a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:40.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.404+0000 7f8168fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:40.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.405+0000 7f82b652a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:40.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.405+0000 7f82b652a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:40.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.442+0000 7f80e37fe640 20 reqs_thread_entry: start 2024-09-12T00:39:40.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.442+0000 7f82b652a800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:40.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.442+0000 7f82b652a800 20 Filter name: none 2024-09-12T00:39:40.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.442+0000 7f80e17fa640 20 reqs_thread_entry: start 2024-09-12T00:39:40.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.442+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:39:40.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.444+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.444+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:39:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3248664661156768130', time=2024-09-12T02:31:51.897107+0000, chain.objs.size()=1 2024-09-12T00:39:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.BJ_lK_OdN1GyBC7KVfxjM8XnxJQAVV5_0 2024-09-12T00:39:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.616067278450272237', time=2024-09-12T02:32:26.502514+0000, chain.objs.size()=1 2024-09-12T00:39:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.PPx9SNTYs02a8igY0NkRZf4Feorq3Bx_0 2024-09-12T00:39:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4318291998240083603', time=2024-09-12T02:32:33.932583+0000, chain.objs.size()=1 2024-09-12T00:39:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.vgPEiWTWWbkT-rC_v81wWEnkcVvA-eJ_0 2024-09-12T00:39:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.230649094982925688', time=2024-09-12T02:33:08.849465+0000, chain.objs.size()=1 2024-09-12T00:39:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.X86p_-uETaF_FWZbGsDmEgkKr0ZNya8_0 2024-09-12T00:39:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.68494241335076251', time=2024-09-12T02:33:11.362833+0000, chain.objs.size()=1 2024-09-12T00:39:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.ZPW9S5VKcvwIMSef9VvbpVOeAIBTqbo_0 2024-09-12T00:39:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6375626573921259008', time=2024-09-12T02:33:45.240742+0000, chain.objs.size()=1 2024-09-12T00:39:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.qEtkWzv0rs5-HOWQ4lHgJylhmqGihzx_0 2024-09-12T00:39:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14228524531425429604', time=2024-09-12T02:34:22.452345+0000, chain.objs.size()=1 2024-09-12T00:39:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.Kx9l-hvYGH3EeQ9jedJLWFyfjAUrnFI_0 2024-09-12T00:39:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17008987233192141785', time=2024-09-12T02:34:25.370095+0000, chain.objs.size()=1 2024-09-12T00:39:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_._h7tqRx7SokwQfUAAN1oT4Na58rS785_0 2024-09-12T00:39:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10148522200702950073', time=2024-09-12T02:35:04.737988+0000, chain.objs.size()=1 2024-09-12T00:39:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.WdFMBGsFAlfV-9wACyBd3eF3VMuetTq_0 2024-09-12T00:39:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4934365927499258782', time=2024-09-12T02:35:38.686725+0000, chain.objs.size()=1 2024-09-12T00:39:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.Ju3398h0tunhEw57GeC-OawOKpyrg0H_0 2024-09-12T00:39:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15599543629211170652', time=2024-09-12T02:35:41.927860+0000, chain.objs.size()=1 2024-09-12T00:39:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.cIPFPxzGEK1qBrWLiW7bgesX2qJ1Htg_0 2024-09-12T00:39:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2722624338352573287', time=2024-09-12T02:39:05.487079+0000, chain.objs.size()=1 2024-09-12T00:39:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.445+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18__shadow_.ntVextQObRLftPlXtXpVOd9t0oBpmre_0 2024-09-12T00:39:40.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.451+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.454+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:39:40.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.455+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.455+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T00:39:40.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='_gj6QdmiAH9E4iYkC7wIgjvthd5u92W8', time=2024-09-12T02:30:41.258447+0000, chain.objs.size()=1 2024-09-12T00:39:40.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.SHsDqO4Q5Vk9lA7LiauxW-Kz7TMqpic_0 2024-09-12T00:39:40.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='_twF7FYq1ii30GlxoOQHWp8Lt7aKTIiP', time=2024-09-12T02:30:41.298282+0000, chain.objs.size()=3 2024-09-12T00:39:40.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.YaQg5p3IsNQaPs0wyXDZTYa5yHnSL2n_0 2024-09-12T00:39:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.YaQg5p3IsNQaPs0wyXDZTYa5yHnSL2n_1 2024-09-12T00:39:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.YaQg5p3IsNQaPs0wyXDZTYa5yHnSL2n_2 2024-09-12T00:39:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='_ZYLQW2Ikv4JqKpQKaZBsobyaI36j3NO', time=2024-09-12T02:30:41.302527+0000, chain.objs.size()=3 2024-09-12T00:39:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.L0uQCmWDDlUeB9eJbu6Gtzivp-6BbHW_0 2024-09-12T00:39:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.L0uQCmWDDlUeB9eJbu6Gtzivp-6BbHW_1 2024-09-12T00:39:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.L0uQCmWDDlUeB9eJbu6Gtzivp-6BbHW_2 2024-09-12T00:39:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='_RrdlT1noVzrbTB15RJ5ubi8cm_XsxJT', time=2024-09-12T02:30:41.333544+0000, chain.objs.size()=3 2024-09-12T00:39:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.I9rIwUW-umRdHyyJsGaWT2gR9FlD-sG_0 2024-09-12T00:39:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.I9rIwUW-umRdHyyJsGaWT2gR9FlD-sG_1 2024-09-12T00:39:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.I9rIwUW-umRdHyyJsGaWT2gR9FlD-sG_2 2024-09-12T00:39:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11503908148030030891', time=2024-09-12T02:31:51.853437+0000, chain.objs.size()=1 2024-09-12T00:39:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.EK1YqRXwtt3y3kM_loVOhBoxLFZ0JCn_0 2024-09-12T00:39:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13491675975552308301', time=2024-09-12T02:32:26.500701+0000, chain.objs.size()=1 2024-09-12T00:39:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.456+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.ctUcyyHtOZj9zLtwInHd36heGnukGhN_0 2024-09-12T00:39:40.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.458+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8470595839490991121', time=2024-09-12T02:33:05.352343+0000, chain.objs.size()=1 2024-09-12T00:39:40.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.458+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.lKvaxzkseIRfENJgSuR1OMjed3nobnF_0 2024-09-12T00:39:40.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.460+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14215795961229654860', time=2024-09-12T02:33:05.427935+0000, chain.objs.size()=1 2024-09-12T00:39:40.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.460+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.GgxR2ywmrAXXOMM_4XcdG01FtVNEVIq_0 2024-09-12T00:39:40.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.460+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1379220481473768989', time=2024-09-12T02:33:08.848767+0000, chain.objs.size()=1 2024-09-12T00:39:40.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.460+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.3V5rY7VNqX3TIZMwUNKaDyofT2t9u1F_0 2024-09-12T00:39:40.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.460+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8600705094372082322', time=2024-09-12T02:33:11.347718+0000, chain.objs.size()=1 2024-09-12T00:39:40.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.460+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.RGLomp7kqVyUnsqOMZtNvEjFK0tHhcS_0 2024-09-12T00:39:40.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10823592288180543171', time=2024-09-12T02:33:51.053423+0000, chain.objs.size()=1 2024-09-12T00:39:40.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.ugzSKLumyIgtQQnoswwJZtV6wcf8EuA_0 2024-09-12T00:39:40.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12047303122081125190', time=2024-09-12T02:34:22.466039+0000, chain.objs.size()=1 2024-09-12T00:39:40.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.DS3c-ETCsKi2K_uxrtmDF-5H8P_FA0I_0 2024-09-12T00:39:40.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.580760794735451761', time=2024-09-12T02:34:22.515310+0000, chain.objs.size()=1 2024-09-12T00:39:40.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.06JdZCJvyJM0gytpPntrTxaahaTQbsN_0 2024-09-12T00:39:40.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11338069463514868158', time=2024-09-12T02:34:22.541406+0000, chain.objs.size()=1 2024-09-12T00:39:40.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.V2IflxK4FsIzrHwlsGXMwOqCnpD9rr5_0 2024-09-12T00:39:40.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10425266667057191055', time=2024-09-12T02:34:25.316830+0000, chain.objs.size()=1 2024-09-12T00:39:40.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.ypgueAogA6VWmYT6J5LCpwL6YI_tt3V_0 2024-09-12T00:39:40.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8476219831790185362', time=2024-09-12T02:34:27.618514+0000, chain.objs.size()=1 2024-09-12T00:39:40.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.1uLyGj3iyibIKHHusp1BzLraY2dFUgK_0 2024-09-12T00:39:40.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12613189358007969865', time=2024-09-12T02:35:41.876657+0000, chain.objs.size()=1 2024-09-12T00:39:40.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.sQtU9oFxqdrGT0Q6wsNCcZTvf2iCFaR_0 2024-09-12T00:39:40.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3356774002265788967', time=2024-09-12T02:36:19.144872+0000, chain.objs.size()=1 2024-09-12T00:39:40.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.461+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.zDwWTIGmm6VyYro-5uW5W0BWwGjizDe_0 2024-09-12T00:39:40.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.463+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2716421777218800439', time=2024-09-12T02:36:21.233302+0000, chain.objs.size()=1 2024-09-12T00:39:40.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.463+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.DnSSpAHPSucHagKn_w-9vfz5woj2dMT_0 2024-09-12T00:39:40.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.465+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14905481631846209156', time=2024-09-12T02:36:21.243110+0000, chain.objs.size()=1 2024-09-12T00:39:40.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.465+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.hwr10n2R9jO_NZvT2eRbm1V9syfqgMU_0 2024-09-12T00:39:40.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.465+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9078521589385861433', time=2024-09-12T02:36:21.303535+0000, chain.objs.size()=1 2024-09-12T00:39:40.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.465+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.C9NzZLNsa4iSaEwp_nkZgOWTjDwQycT_0 2024-09-12T00:39:40.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.467+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.470+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:39:40.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.471+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:39:40.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16899509571366899361', time=2024-09-12T02:30:41.117678+0000, chain.objs.size()=1 2024-09-12T00:39:40.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.pa06x53BMdxjtO5jISeBc_os8uGVASc_0 2024-09-12T00:39:40.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16870324681576255468', time=2024-09-12T02:33:11.338707+0000, chain.objs.size()=1 2024-09-12T00:39:40.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.S-XN0nfJj4ZlNcbNYkrOxS_Pqkz1O_R_0 2024-09-12T00:39:40.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17905836639628589586', time=2024-09-12T02:33:48.893193+0000, chain.objs.size()=1 2024-09-12T00:39:40.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.faM9ZpYFsmCfa8rsVQBW8_1FN-VXoLX_0 2024-09-12T00:39:40.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9517231538502988601', time=2024-09-12T02:33:48.927581+0000, chain.objs.size()=1 2024-09-12T00:39:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.BfClh1uN5uG2O6V0bbHSEXW2Zmg-Fgl_0 2024-09-12T00:39:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.268346161169657041', time=2024-09-12T02:35:38.726635+0000, chain.objs.size()=1 2024-09-12T00:39:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.KcHm8KkpAf6zVr_Zn1NYEWL6vsQmKld_0 2024-09-12T00:39:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10861904007651981696', time=2024-09-12T02:35:41.926679+0000, chain.objs.size()=1 2024-09-12T00:39:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.JgmuA4_OMur6Vse3Lght5NdYU8tYS7c_0 2024-09-12T00:39:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8974248452891296054', time=2024-09-12T02:36:54.656094+0000, chain.objs.size()=1 2024-09-12T00:39:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.s6u8FuGndng6CMhET8c4nrR40wIZo4I_0 2024-09-12T00:39:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13300592613602930441', time=2024-09-12T02:39:05.487622+0000, chain.objs.size()=1 2024-09-12T00:39:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18__shadow_.kABig9JiIGA1jkoVc7x_pCl8CduIUY-_0 2024-09-12T00:39:40.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12087289546158431618', time=2024-09-12T02:39:05.488434+0000, chain.objs.size()=1 2024-09-12T00:39:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.472+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18__shadow_.zLZKJsX2bVzbCUQqxGhb6o75YW9YJxg_0 2024-09-12T00:39:40.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.475+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.478+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:39:40.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.479+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.480+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.480+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:39:40.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.480+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4652721994696224376', time=2024-09-12T02:30:41.113203+0000, chain.objs.size()=1 2024-09-12T00:39:40.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.480+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.o5tL5xlzvv8KHvLnnsw7XqsPeNjCzOo_0 2024-09-12T00:39:40.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.480+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14257137041477800436', time=2024-09-12T02:30:41.187226+0000, chain.objs.size()=4 2024-09-12T00:39:40.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.480+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11__multipart_foo.2~rL-CMEWiti9aKTugfsGupgl5DrhyCiY.1 2024-09-12T00:39:40.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.480+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11__multipart_foo.2~rL-CMEWiti9aKTugfsGupgl5DrhyCiY.2 2024-09-12T00:39:40.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.480+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11__multipart_foo.2~rL-CMEWiti9aKTugfsGupgl5DrhyCiY.3 2024-09-12T00:39:40.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.480+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11__multipart_foo.2~rL-CMEWiti9aKTugfsGupgl5DrhyCiY.4 2024-09-12T00:39:40.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.480+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5495384825731587366', time=2024-09-12T02:30:41.386285+0000, chain.objs.size()=3 2024-09-12T00:39:40.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.480+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14__shadow_.CWAo7IkBr1XLG9PuPFHWIKch3e5UGMb_0 2024-09-12T00:39:40.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.480+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14__shadow_.CWAo7IkBr1XLG9PuPFHWIKch3e5UGMb_1 2024-09-12T00:39:40.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.480+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14__shadow_.CWAo7IkBr1XLG9PuPFHWIKch3e5UGMb_2 2024-09-12T00:39:40.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.481+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14297162369673313412', time=2024-09-12T02:32:26.530376+0000, chain.objs.size()=1 2024-09-12T00:39:40.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.481+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.HSpCQ8nZxCURDLY-nOg6UXwjnhphLpU_0 2024-09-12T00:39:40.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.481+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10813888596928030067', time=2024-09-12T02:32:29.504890+0000, chain.objs.size()=1 2024-09-12T00:39:40.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.481+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.NWTwTX-mxF7mihLPExDJTvdG3-2iFUi_0 2024-09-12T00:39:40.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.481+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16338462845823700803', time=2024-09-12T02:32:29.505616+0000, chain.objs.size()=1 2024-09-12T00:39:40.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.481+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.BTri68vGMIf_43EDP8zQBLiE2IyQGxw_0 2024-09-12T00:39:40.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.481+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12602699318662031786', time=2024-09-12T02:32:31.784923+0000, chain.objs.size()=1 2024-09-12T00:39:40.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.481+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.aYIuNE-DatZ5MPCCN3N558NZm5puw-E_0 2024-09-12T00:39:40.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.484+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1364379762977317083', time=2024-09-12T02:33:48.893194+0000, chain.objs.size()=1 2024-09-12T00:39:40.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.484+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.-X5gG_CaQtheBy6jGy66L0dwyDKztyr_0 2024-09-12T00:39:40.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.484+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3935077871797818516', time=2024-09-12T02:34:22.476865+0000, chain.objs.size()=1 2024-09-12T00:39:40.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.484+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.ngfbKNcygORPBskqFEKA3Htq6jWKt6z_0 2024-09-12T00:39:40.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.484+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9515992377054029052', time=2024-09-12T02:34:25.313024+0000, chain.objs.size()=1 2024-09-12T00:39:40.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.484+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.39IswEQis3SgZIzszGE_LbVA1oY1-8W_0 2024-09-12T00:39:40.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.484+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12092871494693740219', time=2024-09-12T02:35:01.176135+0000, chain.objs.size()=1 2024-09-12T00:39:40.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.484+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.HEE8e7gSOjG5kXk5GoIfOoReutiEtcR_0 2024-09-12T00:39:40.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.484+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.850840345255855836', time=2024-09-12T02:35:04.664427+0000, chain.objs.size()=1 2024-09-12T00:39:40.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.484+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.PtgcIehjGL4dYseaBO--gEm0rHEL18k_0 2024-09-12T00:39:40.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.484+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11519000349567048168', time=2024-09-12T02:35:38.677679+0000, chain.objs.size()=1 2024-09-12T00:39:40.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.484+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.Ydp1LLeJn0GHgqqPgrP68Lr6S7MF0oG_0 2024-09-12T00:39:40.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.485+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2382983721959486662', time=2024-09-12T02:36:15.922062+0000, chain.objs.size()=1 2024-09-12T00:39:40.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.485+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.kDzQXTjhsO7877PvNVLrWnvCgatNTPs_0 2024-09-12T00:39:40.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.485+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18232657582414167042', time=2024-09-12T02:36:19.158242+0000, chain.objs.size()=1 2024-09-12T00:39:40.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.485+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.IogkOSPDkMKUeY9AoAafw_TcZfC_Pma_0 2024-09-12T00:39:40.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.485+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28432302551840531', time=2024-09-12T02:36:19.201528+0000, chain.objs.size()=1 2024-09-12T00:39:40.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.485+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.Pk1Cu0hJRLN2-d_dIi_VT_hUfZZQSNe_0 2024-09-12T00:39:40.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.485+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6913703626027756050', time=2024-09-12T02:39:05.505626+0000, chain.objs.size()=1 2024-09-12T00:39:40.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.485+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18__shadow_.To_TN3cySn2I9W-8rCn1aVjUDkmpgjm_0 2024-09-12T00:39:40.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.490+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.492+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:39:40.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.494+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.494+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.494+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:39:40.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.494+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3144152497124264780', time=2024-09-12T02:31:51.814555+0000, chain.objs.size()=1 2024-09-12T00:39:40.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.494+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.GPGoh6uczyK1Ua5obLgtq8y5YsprOfL_0 2024-09-12T00:39:40.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.494+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10408269196675653177', time=2024-09-12T02:32:29.578956+0000, chain.objs.size()=1 2024-09-12T00:39:40.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.494+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.ZYMIGmrK36z1qu0Y9QZltljs91zfJs6_0 2024-09-12T00:39:40.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.494+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15013803910510147661', time=2024-09-12T02:32:31.803794+0000, chain.objs.size()=1 2024-09-12T00:39:40.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.494+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.6Qqkx1XzkdO2EVo2-VuO3R4is20344R_0 2024-09-12T00:39:40.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.495+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12213993002760892139', time=2024-09-12T02:33:05.382766+0000, chain.objs.size()=1 2024-09-12T00:39:40.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.495+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.4HF7x6sIkNwaW-YONCaS1pLQMO4ZRdw_0 2024-09-12T00:39:40.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.495+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10004861865772531086', time=2024-09-12T02:34:24.437923+0000, chain.objs.size()=1 2024-09-12T00:39:40.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.495+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.kyvJrdTvZjPhKofbmbcPwHZ8a4XsKV2_0 2024-09-12T00:39:40.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.495+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10868313851971979463', time=2024-09-12T02:35:01.195583+0000, chain.objs.size()=1 2024-09-12T00:39:40.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.495+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_._qma4rKDS7S0n0ZavFVih3Fla4o0Ezt_0 2024-09-12T00:39:40.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.495+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1085425926681890723', time=2024-09-12T02:35:04.684124+0000, chain.objs.size()=1 2024-09-12T00:39:40.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.495+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.3vuLt16nNCnOQIOIKcYktUobDvbCld3_0 2024-09-12T00:39:40.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.495+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1483371880462654704', time=2024-09-12T02:35:04.745750+0000, chain.objs.size()=1 2024-09-12T00:39:40.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.495+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.3KN-DexdRixsJDWviCH3nassQWmi-FJ_0 2024-09-12T00:39:40.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.495+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1903634860817381747', time=2024-09-12T02:36:15.874180+0000, chain.objs.size()=1 2024-09-12T00:39:40.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.495+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.v9zRwsGzclIZl3t7erHAA-OxQcvK43b_0 2024-09-12T00:39:40.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.495+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4277054857013880033', time=2024-09-12T02:36:21.228648+0000, chain.objs.size()=1 2024-09-12T00:39:40.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.495+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.1XWD0IySYEHHTn7JoVCW0R2Mwn_EYa7_0 2024-09-12T00:39:40.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.499+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.501+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:39:40.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:39:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12284669044426321348', time=2024-09-12T02:30:41.107606+0000, chain.objs.size()=1 2024-09-12T00:39:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.0rYdvxHjANjvMM93I9uqKrL8r4DId8C_0 2024-09-12T00:39:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13490213931473816435', time=2024-09-12T02:30:41.438393+0000, chain.objs.size()=1 2024-09-12T00:39:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8__shadow_.4_13PlF3k6CR8hRyBzE09PgafxJM9dS_0 2024-09-12T00:39:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.714825902218754121', time=2024-09-12T02:31:48.523062+0000, chain.objs.size()=1 2024-09-12T00:39:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.83G_KfiJsq4O0J3B14VTlN_WbaqOzUB_0 2024-09-12T00:39:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14403015765851307401', time=2024-09-12T02:32:26.501111+0000, chain.objs.size()=1 2024-09-12T00:39:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.dwrj2ZJBN5CM1xH40Bgv4z8vZrH0zTD_0 2024-09-12T00:39:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5447517205988828003', time=2024-09-12T02:33:08.811104+0000, chain.objs.size()=1 2024-09-12T00:39:40.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.PMlwJ8tuty8CFv60bcFC6RQyF-st8K4_0 2024-09-12T00:39:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1315334063140966044', time=2024-09-12T02:33:48.959449+0000, chain.objs.size()=1 2024-09-12T00:39:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.VyJAaadEMHCFp-2ih2r1GToDIWK5KKe_0 2024-09-12T00:39:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16326772239906927685', time=2024-09-12T02:34:27.646930+0000, chain.objs.size()=1 2024-09-12T00:39:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.503+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.vrTrhf2t2-Bh-mmuXs9Gqe1d-VHYInB_0 2024-09-12T00:39:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.504+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2535284911513170481', time=2024-09-12T02:34:27.698574+0000, chain.objs.size()=1 2024-09-12T00:39:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.504+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.MGIpxFSdFlGEk8Ch_5gyRAdKbgKlB6w_0 2024-09-12T00:39:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.504+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10875262036000586594', time=2024-09-12T02:35:01.189758+0000, chain.objs.size()=1 2024-09-12T00:39:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.504+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.75fGwQujmbHC57Mk6V3Q310vAcemshy_0 2024-09-12T00:39:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.504+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13450374508097535569', time=2024-09-12T02:35:01.190399+0000, chain.objs.size()=1 2024-09-12T00:39:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.504+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.YsumzMDUULAAGyxHL3C3hLBS8bCOdWI_0 2024-09-12T00:39:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.504+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15814112848543668985', time=2024-09-12T02:35:41.913940+0000, chain.objs.size()=1 2024-09-12T00:39:40.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.504+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.JHQy4xtsT_X84UE16rQksvoM3pD-FYY_0 2024-09-12T00:39:40.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.504+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13244304960266003683', time=2024-09-12T02:35:41.914513+0000, chain.objs.size()=1 2024-09-12T00:39:40.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.504+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.VjQlgmd7PFyplNUxhG8xfMD65bMy4me_0 2024-09-12T00:39:40.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.506+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13417676803638169841', time=2024-09-12T02:36:15.922710+0000, chain.objs.size()=1 2024-09-12T00:39:40.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.506+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.uhAaycKqFkoHwGO_2ecaKvefMqVXmK2_0 2024-09-12T00:39:40.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.506+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12989908781649836890', time=2024-09-12T02:36:21.201152+0000, chain.objs.size()=1 2024-09-12T00:39:40.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.506+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.sx2e6TQObkGqPzzsYtlzX3Sythrl2Gk_0 2024-09-12T00:39:40.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.506+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16582043834197807628', time=2024-09-12T02:36:21.214248+0000, chain.objs.size()=1 2024-09-12T00:39:40.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.506+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.N4KvhmN9jbTx8_VE84-bOk_hnZqsl18_0 2024-09-12T00:39:40.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.507+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12935327306685417203', time=2024-09-12T02:36:21.243140+0000, chain.objs.size()=1 2024-09-12T00:39:40.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.507+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_._CU1pC8rg20ZW43IWqkg0G8QTE1FeFo_0 2024-09-12T00:39:40.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.511+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.516+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:39:40.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.518+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:39:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16914219391120722299', time=2024-09-12T02:30:41.238743+0000, chain.objs.size()=2 2024-09-12T00:39:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.35Rw128e5WnR61U7Kzb6vD6w3UsGQsr_0 2024-09-12T00:39:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.35Rw128e5WnR61U7Kzb6vD6w3UsGQsr_1 2024-09-12T00:39:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2508204870669164003', time=2024-09-12T02:31:51.833247+0000, chain.objs.size()=1 2024-09-12T00:39:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.YZ_ijr-irGr7x3rVfEkIsi1az1xiUIg_0 2024-09-12T00:39:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5297314429322907152', time=2024-09-12T02:32:31.785016+0000, chain.objs.size()=1 2024-09-12T00:39:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.QUEBNzh3LxOP6O-iLaTLVKUlpBpg8Ii_0 2024-09-12T00:39:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10654442194474177273', time=2024-09-12T02:33:05.411301+0000, chain.objs.size()=1 2024-09-12T00:39:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.RwDVUWsD91034OYdhm9CZ3VC5KSd0ID_0 2024-09-12T00:39:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17602595331275914207', time=2024-09-12T02:33:45.251259+0000, chain.objs.size()=1 2024-09-12T00:39:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.PbCEZUMdcHnC6js4itMgyc6HNRh2auT_0 2024-09-12T00:39:40.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7945866935083514724', time=2024-09-12T02:33:45.252031+0000, chain.objs.size()=1 2024-09-12T00:39:40.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.J0ltDkqcDzxtyqE0rX_iutCXvolDDls_0 2024-09-12T00:39:40.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14308337349993768547', time=2024-09-12T02:35:01.220953+0000, chain.objs.size()=1 2024-09-12T00:39:40.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.ic7S1a473pQU2lEkn1PrM-PoLo8Cz3o_0 2024-09-12T00:39:40.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16824681019745258712', time=2024-09-12T02:35:03.593086+0000, chain.objs.size()=1 2024-09-12T00:39:40.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.RqASOTzp008BlI_XP2Opg5TK9Cfm03R_0 2024-09-12T00:39:40.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13277801650858943485', time=2024-09-12T02:35:04.691836+0000, chain.objs.size()=1 2024-09-12T00:39:40.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.mVf8Pu_5Pi4z2L0-bNofIAMDeFxbV4J_0 2024-09-12T00:39:40.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9868448161598657646', time=2024-09-12T02:36:15.948465+0000, chain.objs.size()=1 2024-09-12T00:39:40.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.TMUCJwvBzng9nfX2LIEaw38dne9kK1d_0 2024-09-12T00:39:40.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13077880656672275144', time=2024-09-12T02:36:15.956844+0000, chain.objs.size()=1 2024-09-12T00:39:40.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.519+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.t912HHB6kZ7zPA3venpy2wzHNJwd82R_0 2024-09-12T00:39:40.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.522+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8644353730429624889', time=2024-09-12T02:39:05.488406+0000, chain.objs.size()=1 2024-09-12T00:39:40.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.522+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18__shadow_.N1X0CAmc0tQXYHcwdJjeml3sjirbEe__0 2024-09-12T00:39:40.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.524+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.526+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:39:40.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.528+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.528+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.528+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:39:40.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.528+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9329403142990424513', time=2024-09-12T02:30:41.125565+0000, chain.objs.size()=1 2024-09-12T00:39:40.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.528+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.J8I043CoBER0uQcMgyCUGjiEQKMG6Ic_0 2024-09-12T00:39:40.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2974108519239273126', time=2024-09-12T02:31:48.519150+0000, chain.objs.size()=1 2024-09-12T00:39:40.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.IUE7ifxkboaoVM7bcqS81iDntsOP8LG_0 2024-09-12T00:39:40.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6905227102434172490', time=2024-09-12T02:31:51.838668+0000, chain.objs.size()=1 2024-09-12T00:39:40.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.nacHty9SjmA864tMkdwDhSyHBiFCXVe_0 2024-09-12T00:39:40.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4753430937573729895', time=2024-09-12T02:31:51.839354+0000, chain.objs.size()=1 2024-09-12T00:39:40.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.C14NEvGeJzVnmg37FV-LEffzCMCUBMW_0 2024-09-12T00:39:40.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14940040416033257298', time=2024-09-12T02:32:29.511138+0000, chain.objs.size()=1 2024-09-12T00:39:40.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.vdC_dSlTRVuhxXdAellkARfDXah8NeI_0 2024-09-12T00:39:40.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4561999392785854914', time=2024-09-12T02:32:31.861710+0000, chain.objs.size()=1 2024-09-12T00:39:40.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.ploRLNiJ0ByecXb0LuY7PnkqQGLJCdC_0 2024-09-12T00:39:40.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8960878512357678365', time=2024-09-12T02:33:08.837469+0000, chain.objs.size()=1 2024-09-12T00:39:40.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.rH8lt3sbtL-HP5SH_9dFyRVZVg7s7LM_0 2024-09-12T00:39:40.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12901988425163282912', time=2024-09-12T02:33:45.236681+0000, chain.objs.size()=1 2024-09-12T00:39:40.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.-tiTQMgNSfyGt6OsYiMpLuG4diJvvlO_0 2024-09-12T00:39:40.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13352170560073592214', time=2024-09-12T02:33:45.294196+0000, chain.objs.size()=1 2024-09-12T00:39:40.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.T6s8exbRrUxj1M-CeYAjD95aqWfWP4r_0 2024-09-12T00:39:40.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6704414092394289309', time=2024-09-12T02:34:22.496745+0000, chain.objs.size()=1 2024-09-12T00:39:40.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.Ns84mGKoBMOLxI3RmezNKxqYhWFBz3X_0 2024-09-12T00:39:40.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13421626029053983042', time=2024-09-12T02:34:25.345715+0000, chain.objs.size()=1 2024-09-12T00:39:40.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.JQD3RrfFrzcu-cQ-2ZeT5GYDnGJXNUW_0 2024-09-12T00:39:40.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17017807281695706296', time=2024-09-12T02:35:01.165894+0000, chain.objs.size()=1 2024-09-12T00:39:40.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.529+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.68b52IA77ujz4RWlSNTcfaCV96fin_u_0 2024-09-12T00:39:40.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.531+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16548259977696775407', time=2024-09-12T02:35:01.172758+0000, chain.objs.size()=1 2024-09-12T00:39:40.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.531+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.luqTeLOQGFgUDiWb1vZzufRIkm-3RMi_0 2024-09-12T00:39:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.532+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14254091211520119328', time=2024-09-12T02:35:38.650373+0000, chain.objs.size()=1 2024-09-12T00:39:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.532+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.oGd9Nz4LRKmz2pclqp5wp2kGj7IdA8N_0 2024-09-12T00:39:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.532+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17577697369937336383', time=2024-09-12T02:35:41.910770+0000, chain.objs.size()=1 2024-09-12T00:39:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.532+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.pST9jOEVnFFdsH435kmXFWhtP8n5E_W_0 2024-09-12T00:39:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.532+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11953461509840154546', time=2024-09-12T02:36:19.137290+0000, chain.objs.size()=1 2024-09-12T00:39:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.532+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.IDoRHecBe5ObxuOnDnU8NNAZF2SDMkE_0 2024-09-12T00:39:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.535+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.537+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:39:40.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.539+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.539+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.539+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:39:40.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.539+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11935203261270097221', time=2024-09-12T02:30:41.434363+0000, chain.objs.size()=1 2024-09-12T00:39:40.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.539+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8__shadow_.SeNPJLDsHQ01LUj-qcddQvrl3MNJf94_0 2024-09-12T00:39:40.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.539+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7258241761086742034', time=2024-09-12T02:30:41.465615+0000, chain.objs.size()=1 2024-09-12T00:39:40.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.539+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9__shadow_.lX3BiT0iFQe7cKh6cQfDPm2nm7-io4Z_0 2024-09-12T00:39:40.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.539+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17839101104527117592', time=2024-09-12T02:31:51.840237+0000, chain.objs.size()=1 2024-09-12T00:39:40.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.539+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.47h_wS8FtG_yc6N95cXEaICCI6sotx1_0 2024-09-12T00:39:40.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5680470667742977977', time=2024-09-12T02:33:05.426054+0000, chain.objs.size()=1 2024-09-12T00:39:40.539 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.B7kJaoqHSm-QRW7hWGudCp2hYnwMp_j_0 2024-09-12T00:39:40.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10232024684897316307', time=2024-09-12T02:33:08.847092+0000, chain.objs.size()=1 2024-09-12T00:39:40.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.kEiZM-DbtwxbrDxdYpvwMNpAOutIP38_0 2024-09-12T00:39:40.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18389301801721751102', time=2024-09-12T02:33:08.847726+0000, chain.objs.size()=1 2024-09-12T00:39:40.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.cHXd1JJn3vmcgBOkH8Nh3Z3xOleTg3n_0 2024-09-12T00:39:40.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6607782752509677331', time=2024-09-12T02:33:11.316055+0000, chain.objs.size()=1 2024-09-12T00:39:40.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.HL9Xdn4nvaxt2AWqysCjYGk0GFWH8RV_0 2024-09-12T00:39:40.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9015880259603268317', time=2024-09-12T02:33:45.212059+0000, chain.objs.size()=1 2024-09-12T00:39:40.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.bdYhFhkTHLUs3N031cb2kjM6D_up0Ga_0 2024-09-12T00:39:40.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8460157894211041916', time=2024-09-12T02:33:45.251630+0000, chain.objs.size()=1 2024-09-12T00:39:40.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.VMVDdgqAww5Y9xYPls1T74rJgoMBR6a_0 2024-09-12T00:39:40.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3126489404682285034', time=2024-09-12T02:34:25.297698+0000, chain.objs.size()=1 2024-09-12T00:39:40.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.XDDZ06VOprlZiCWpBd9px6jmtgUtdaX_0 2024-09-12T00:39:40.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8338570183123030967', time=2024-09-12T02:34:25.326066+0000, chain.objs.size()=1 2024-09-12T00:39:40.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.FxMPCIAk6zdBGjRF8YefsEXII5kWDP5_0 2024-09-12T00:39:40.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17830832727414957863', time=2024-09-12T02:35:01.191496+0000, chain.objs.size()=1 2024-09-12T00:39:40.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.540+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.j089YIy7q3ulZrwJdPp_EAOvfWUdspa_0 2024-09-12T00:39:40.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.542+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12361347925388393499', time=2024-09-12T02:35:38.652136+0000, chain.objs.size()=1 2024-09-12T00:39:40.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.542+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.CBJ-0OAtkXTBB1GwacSJGLeU7czDsgM_0 2024-09-12T00:39:40.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.542+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11337405256657224817', time=2024-09-12T02:35:38.680317+0000, chain.objs.size()=1 2024-09-12T00:39:40.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.542+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.b61YNK_2z7Kwrj3Q_aEKf9j7Ur5uksf_0 2024-09-12T00:39:40.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.542+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8074725088413110890', time=2024-09-12T02:36:21.251568+0000, chain.objs.size()=1 2024-09-12T00:39:40.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.542+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.9k8S1vvBM96oANtpzZiuPbfWUVN1lNT_0 2024-09-12T00:39:40.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.542+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17866753181509324651', time=2024-09-12T02:36:54.640032+0000, chain.objs.size()=1 2024-09-12T00:39:40.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.542+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.3n2m10h7u6mL1dKaYPH0qsAaxHwNRjk_0 2024-09-12T00:39:40.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.546+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.548+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:39:40.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.549+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.549+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:39:40.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10914922018533998880', time=2024-09-12T02:31:47.614609+0000, chain.objs.size()=1 2024-09-12T00:39:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.hxpGVR6eNsYxdHWs2c1qjgTTqB3buMn_0 2024-09-12T00:39:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11054933902667101358', time=2024-09-12T02:31:48.495269+0000, chain.objs.size()=1 2024-09-12T00:39:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.ikREqgo4uNYUhhaJ5WJk-A9Qbm03y6X_0 2024-09-12T00:39:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17266108821813365756', time=2024-09-12T02:31:51.829742+0000, chain.objs.size()=1 2024-09-12T00:39:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.XMyxmm8Fca49jTQgSoXfRz4pCTow4r6_0 2024-09-12T00:39:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10072985418464379583', time=2024-09-12T02:32:29.539893+0000, chain.objs.size()=1 2024-09-12T00:39:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.XdNsnhz2BJy1w7cytDrZ2KUrp3SEfsZ_0 2024-09-12T00:39:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.839013177637775995', time=2024-09-12T02:32:29.568493+0000, chain.objs.size()=1 2024-09-12T00:39:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.cjWt-KlQRk6rojCQ_ue1iKnQ16Q44Wp_0 2024-09-12T00:39:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3665703534656207817', time=2024-09-12T02:33:05.370618+0000, chain.objs.size()=1 2024-09-12T00:39:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.dIRmQXCxb_tvENUtg5r9gDbKcv8zNkC_0 2024-09-12T00:39:40.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10810779544557012639', time=2024-09-12T02:33:11.347737+0000, chain.objs.size()=1 2024-09-12T00:39:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.Lj4gyaVTbrcHKepKL1_1UP8umgLNcj2_0 2024-09-12T00:39:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10911848099270392532', time=2024-09-12T02:34:22.479498+0000, chain.objs.size()=1 2024-09-12T00:39:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.gbZsyWuKy6ctewyOW6fBTM6bJgAMqBv_0 2024-09-12T00:39:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10002359909632093111', time=2024-09-12T02:34:27.572900+0000, chain.objs.size()=1 2024-09-12T00:39:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.I7fBqANRpxxLErsHtjD0pM_P1mMuM55_0 2024-09-12T00:39:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12033725836083769445', time=2024-09-12T02:35:01.221087+0000, chain.objs.size()=1 2024-09-12T00:39:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.u8KR05xVGKOsMBsF23gkZZ-85MSNode_0 2024-09-12T00:39:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13714541317702819123', time=2024-09-12T02:35:38.694225+0000, chain.objs.size()=1 2024-09-12T00:39:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.ayIjPoU8s1I2uxw8hBt_Gl7nVhOXjYl_0 2024-09-12T00:39:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17620601072447706886', time=2024-09-12T02:36:15.868813+0000, chain.objs.size()=1 2024-09-12T00:39:40.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.550+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.oalcpmMppcJKs-KuZLW-PovfY7QTZVF_0 2024-09-12T00:39:40.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.553+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8608450426273875759', time=2024-09-12T02:36:15.952101+0000, chain.objs.size()=1 2024-09-12T00:39:40.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.553+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.6dJOH53c4YxEYu3NxUVn50IIbFrMKfd_0 2024-09-12T00:39:40.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.553+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6176137807150799589', time=2024-09-12T02:36:21.233298+0000, chain.objs.size()=1 2024-09-12T00:39:40.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.553+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.ASQ89XFG52QlBBQnR7IzdejWgVsyRNu_0 2024-09-12T00:39:40.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.555+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.557+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:39:40.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.558+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:39:40.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='_zcSHuUNK1jMJT6g7951lLT28w-RdtGC', time=2024-09-12T02:30:41.250384+0000, chain.objs.size()=2 2024-09-12T00:39:40.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.wNpJ0SrQNnzhIF_5GN4zcDh1CB3mCHk_0 2024-09-12T00:39:40.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.wNpJ0SrQNnzhIF_5GN4zcDh1CB3mCHk_1 2024-09-12T00:39:40.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='_RsQqYd6poNW1REWUvfBE-p3vj-tRUMm', time=2024-09-12T02:30:41.313571+0000, chain.objs.size()=3 2024-09-12T00:39:40.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.Yo_K28yTSOhQi9w8OeMD4vo1obMUKrx_0 2024-09-12T00:39:40.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.Yo_K28yTSOhQi9w8OeMD4vo1obMUKrx_1 2024-09-12T00:39:40.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.Yo_K28yTSOhQi9w8OeMD4vo1obMUKrx_2 2024-09-12T00:39:40.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14834982602200619378', time=2024-09-12T02:30:41.461604+0000, chain.objs.size()=1 2024-09-12T00:39:40.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9__shadow_.Hc80lzODCD9yh3KQ3zfBwelPgBQrD59_0 2024-09-12T00:39:40.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18176672640741111970', time=2024-09-12T02:31:48.493206+0000, chain.objs.size()=1 2024-09-12T00:39:40.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.vrCJqb9pv3TUE5PcsPKVQvktuXP1bV8_0 2024-09-12T00:39:40.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12433122514468120723', time=2024-09-12T02:31:48.571652+0000, chain.objs.size()=1 2024-09-12T00:39:40.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.BloRQ0TT-RQeLjdIYqSdshDpMCXG7dD_0 2024-09-12T00:39:40.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17268096773720327763', time=2024-09-12T02:32:26.506362+0000, chain.objs.size()=1 2024-09-12T00:39:40.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.6Bx6dcHrzQWNvhVGRaNgFpIZJoutKgD_0 2024-09-12T00:39:40.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7304688721232239294', time=2024-09-12T02:32:31.776356+0000, chain.objs.size()=1 2024-09-12T00:39:40.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.LmcVmgVNcVYWlMEQg1-8l7xuhyny5z3_0 2024-09-12T00:39:40.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5864109465966524121', time=2024-09-12T02:33:45.256796+0000, chain.objs.size()=1 2024-09-12T00:39:40.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.2ap-2_-iv8tTwEXhccVj9vP6uyhfEw1_0 2024-09-12T00:39:40.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.648547973693827797', time=2024-09-12T02:33:48.885321+0000, chain.objs.size()=1 2024-09-12T00:39:40.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.559+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.8SBRMdwspQdGc1wjEQsXADicWpri7EN_0 2024-09-12T00:39:40.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11773461659724437192', time=2024-09-12T02:33:48.886106+0000, chain.objs.size()=1 2024-09-12T00:39:40.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.YJcrKEzyqQrZC25AbogjJn8cGqeKD2X_0 2024-09-12T00:39:40.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17584072639500057656', time=2024-09-12T02:34:25.351659+0000, chain.objs.size()=1 2024-09-12T00:39:40.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.RCvoCGhBjZem2VmQT-89I93NeP_bBZz_0 2024-09-12T00:39:40.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14128601719743803307', time=2024-09-12T02:34:27.662554+0000, chain.objs.size()=1 2024-09-12T00:39:40.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.chlYhqNcg6cgQu4pFW9P77IBRsxnaJZ_0 2024-09-12T00:39:40.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16675525916207904306', time=2024-09-12T02:34:27.709954+0000, chain.objs.size()=1 2024-09-12T00:39:40.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.aAlubcPOrjQUT4n2FxW5Q3COHMa6lJi_0 2024-09-12T00:39:40.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3843994749658899868', time=2024-09-12T02:35:07.014913+0000, chain.objs.size()=1 2024-09-12T00:39:40.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.cbsA-VopspBy6z-dOyUfi7LmRZ30y-y_0 2024-09-12T00:39:40.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14866334019298394493', time=2024-09-12T02:36:18.055689+0000, chain.objs.size()=1 2024-09-12T00:39:40.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.e70dooXwhJ2x4279U-6lqU46Jq62HhR_0 2024-09-12T00:39:40.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12374701093943456452', time=2024-09-12T02:36:21.231430+0000, chain.objs.size()=1 2024-09-12T00:39:40.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.gfUY_yFOB2BS2NJBvGH0yjtzTKEsf6A_0 2024-09-12T00:39:40.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17113342859474107800', time=2024-09-12T02:36:54.629776+0000, chain.objs.size()=1 2024-09-12T00:39:40.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.YiQTr00J8VWLlpAUsZLQGiUyYcRAh9l_0 2024-09-12T00:39:40.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8120181971392207971', time=2024-09-12T02:39:05.492239+0000, chain.objs.size()=1 2024-09-12T00:39:40.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.563+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18__shadow_.n_2Kly4gViWpRXZtQVeHvOdPgOGdF-U_0 2024-09-12T00:39:40.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.567+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.569+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:39:40.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.570+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:39:40.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18169384713550838427', time=2024-09-12T02:30:41.308290+0000, chain.objs.size()=5 2024-09-12T00:39:40.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.1 2024-09-12T00:39:40.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.1_1 2024-09-12T00:39:40.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.2 2024-09-12T00:39:40.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.2_1 2024-09-12T00:39:40.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.3 2024-09-12T00:39:40.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16935365514547641223', time=2024-09-12T02:31:48.522415+0000, chain.objs.size()=1 2024-09-12T00:39:40.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.ldC5uFOqsR5p3yussybePS537hxDh2w_0 2024-09-12T00:39:40.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12417984339241405622', time=2024-09-12T02:31:48.567124+0000, chain.objs.size()=1 2024-09-12T00:39:40.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.5Kn6MJHYFxtXGm6_uLVQlms55QrSKF0_0 2024-09-12T00:39:40.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.891512174167793974', time=2024-09-12T02:32:26.500562+0000, chain.objs.size()=1 2024-09-12T00:39:40.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.RP5Y0yqjHhBqH3MemnUl4At3NJXXjav_0 2024-09-12T00:39:40.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14589273370009940156', time=2024-09-12T02:32:26.501671+0000, chain.objs.size()=1 2024-09-12T00:39:40.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.ppc2de9qHcFodHADo8Tx4H567zrUmun_0 2024-09-12T00:39:40.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9945281963243409217', time=2024-09-12T02:32:29.509306+0000, chain.objs.size()=1 2024-09-12T00:39:40.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.em6YMaCltwT5H4b_CqFQNLhgTo12Cde_0 2024-09-12T00:39:40.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1210055273659198071', time=2024-09-12T02:32:31.784456+0000, chain.objs.size()=1 2024-09-12T00:39:40.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.0f9_LrnznE9GXdy4NXn6PVzSZxAe3Tc_0 2024-09-12T00:39:40.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15027738244227853704', time=2024-09-12T02:32:31.800216+0000, chain.objs.size()=1 2024-09-12T00:39:40.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.571+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.-beorretfod_6qHE9Uc4j-xOGPCncne_0 2024-09-12T00:39:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.573+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18226599172248318625', time=2024-09-12T02:33:13.978634+0000, chain.objs.size()=1 2024-09-12T00:39:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.573+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.atXsiEwVEIPBIF8uinpGlpzUj_c7XJN_0 2024-09-12T00:39:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.573+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8599830451797532252', time=2024-09-12T02:35:01.221034+0000, chain.objs.size()=1 2024-09-12T00:39:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.573+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.bChvLXbzreQ1Yo3wvoasOqCIzmn81i9_0 2024-09-12T00:39:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.573+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9402974801251848386', time=2024-09-12T02:35:41.913406+0000, chain.objs.size()=1 2024-09-12T00:39:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.573+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.kI33RcUrGsQTGAt7JGqDVD4GGdK-jxE_0 2024-09-12T00:39:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.574+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15029853386144162348', time=2024-09-12T02:35:44.030370+0000, chain.objs.size()=1 2024-09-12T00:39:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.574+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.N2NlGiqlMenlmky7B0HKAH-lypMrJSM_0 2024-09-12T00:39:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.574+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6548536341768436803', time=2024-09-12T02:36:15.902364+0000, chain.objs.size()=1 2024-09-12T00:39:40.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.574+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.KIqPhlHqhl7YM9rJ5WNqkMRJwmQ3Zph_0 2024-09-12T00:39:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.575+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9866597031240573981', time=2024-09-12T02:36:19.144925+0000, chain.objs.size()=1 2024-09-12T00:39:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.575+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.e-V2uNPWSmJ0bMICzsWFFCj2gHcQPzc_0 2024-09-12T00:39:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.575+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1658795954725358871', time=2024-09-12T02:36:54.592982+0000, chain.objs.size()=1 2024-09-12T00:39:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.575+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.X-MbGgMCFSKxkk8iVDezzHhM2GpMOKk_0 2024-09-12T00:39:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.575+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10885071470175405418', time=2024-09-12T02:39:19.866140+0000, chain.objs.size()=1 2024-09-12T00:39:40.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.575+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19__shadow:3iZiDDft9tqxBje9N3RqpVQ2YGokbAw_.FzK2otuLHwNUqPBBGvBaxiRakjN7jt__0 2024-09-12T00:39:40.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.579+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.582+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:39:40.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.584+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.584+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:39:40.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='_YSpHda2ATjt5HS5kqnC5gYCRmnkt7me', time=2024-09-12T02:30:41.230565+0000, chain.objs.size()=2 2024-09-12T00:39:40.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.pwN7rv4ncB2FpOKe4otOfmwUcBqx7uB_0 2024-09-12T00:39:40.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.pwN7rv4ncB2FpOKe4otOfmwUcBqx7uB_1 2024-09-12T00:39:40.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10169134219292169755', time=2024-09-12T02:30:41.337320+0000, chain.objs.size()=5 2024-09-12T00:39:40.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.1 2024-09-12T00:39:40.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.1_1 2024-09-12T00:39:40.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.2 2024-09-12T00:39:40.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.2_1 2024-09-12T00:39:40.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.3 2024-09-12T00:39:40.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14178558814477457058', time=2024-09-12T02:30:41.353777+0000, chain.objs.size()=5 2024-09-12T00:39:40.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-FROZEN.2~-yLdGTv4btq77xK5FiWLD6f6GcJhKnf.1 2024-09-12T00:39:40.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__shadow_foo-FROZEN.2~-yLdGTv4btq77xK5FiWLD6f6GcJhKnf.1_1 2024-09-12T00:39:40.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-FROZEN.2~-yLdGTv4btq77xK5FiWLD6f6GcJhKnf.2 2024-09-12T00:39:40.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__shadow_foo-FROZEN.2~-yLdGTv4btq77xK5FiWLD6f6GcJhKnf.2_1 2024-09-12T00:39:40.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.585+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-FROZEN.2~-yLdGTv4btq77xK5FiWLD6f6GcJhKnf.3 2024-09-12T00:39:40.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.587+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9264588123986689420', time=2024-09-12T02:31:48.522471+0000, chain.objs.size()=1 2024-09-12T00:39:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.587+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.xb9TYBpsB1P6j-Z19bCG1-c0JG-a_9U_0 2024-09-12T00:39:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.588+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3729598749150866250', time=2024-09-12T02:31:48.525528+0000, chain.objs.size()=1 2024-09-12T00:39:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.588+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.GoqOKTmuigtYL8wfxvRUFGRY4Es-nEU_0 2024-09-12T00:39:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.588+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4032005528089953146', time=2024-09-12T02:31:51.844038+0000, chain.objs.size()=1 2024-09-12T00:39:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.588+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.eHtZp2MasEL0gwmbonyvOQzGcu8mc-F_0 2024-09-12T00:39:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.588+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9122837425916678823', time=2024-09-12T02:33:48.927330+0000, chain.objs.size()=1 2024-09-12T00:39:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.588+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.R01u02_1zWax8ncUwdbZD22aomqcicL_0 2024-09-12T00:39:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.588+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1473770981466824898', time=2024-09-12T02:33:48.928149+0000, chain.objs.size()=1 2024-09-12T00:39:40.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.588+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.tBv4cMbQpm4H1814fD5ITW35cE-jGqu_0 2024-09-12T00:39:40.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.589+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12989986007913644029', time=2024-09-12T02:34:27.718592+0000, chain.objs.size()=1 2024-09-12T00:39:40.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.589+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.kdKaOVQIJv-tTR02Wg9pQo8bwz42D79_0 2024-09-12T00:39:40.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.589+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8340566368546729776', time=2024-09-12T02:35:38.638808+0000, chain.objs.size()=1 2024-09-12T00:39:40.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.589+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.y6beMGG_pNPUKqJj2ciEykr8BY0yX-7_0 2024-09-12T00:39:40.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.589+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16833902631506063758', time=2024-09-12T02:35:38.677369+0000, chain.objs.size()=1 2024-09-12T00:39:40.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.589+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.W7HRLlvzpvpu-3CgYvJb6pkc5rgX_XT_0 2024-09-12T00:39:40.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.589+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16310190940080711648', time=2024-09-12T02:36:19.190342+0000, chain.objs.size()=1 2024-09-12T00:39:40.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.589+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.5q6-NI3EBTy0J67wBa3ZMByV3JJL54R_0 2024-09-12T00:39:40.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.592+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12055091221454456928', time=2024-09-12T02:36:54.632350+0000, chain.objs.size()=1 2024-09-12T00:39:40.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.592+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.0UxP1TVa4uEaERUaOcWTp_vGxvbpw_S_0 2024-09-12T00:39:40.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.595+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.597+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:39:40.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.598+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T00:39:40.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5757522840118793306', time=2024-09-12T02:30:41.097528+0000, chain.objs.size()=1 2024-09-12T00:39:40.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.9Yb_rsVXbnmAwfT17MbvJ85mviUQrHg_0 2024-09-12T00:39:40.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3345736107636751087', time=2024-09-12T02:30:41.167480+0000, chain.objs.size()=4 2024-09-12T00:39:40.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13__multipart_foo.2~RCLKBPWNyni7JjgwSoZafLQ3MBTRPhU.1 2024-09-12T00:39:40.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13__multipart_foo.2~RCLKBPWNyni7JjgwSoZafLQ3MBTRPhU.2 2024-09-12T00:39:40.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13__multipart_foo.2~RCLKBPWNyni7JjgwSoZafLQ3MBTRPhU.3 2024-09-12T00:39:40.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13__multipart_foo.2~RCLKBPWNyni7JjgwSoZafLQ3MBTRPhU.4 2024-09-12T00:39:40.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18355379725649062442', time=2024-09-12T02:30:41.317755+0000, chain.objs.size()=5 2024-09-12T00:39:40.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.1 2024-09-12T00:39:40.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.1_1 2024-09-12T00:39:40.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.2 2024-09-12T00:39:40.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.2_1 2024-09-12T00:39:40.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-LUKEWARM.2~rONtne9jWWLOJsGq_7nMoEzqJuR68VM.3 2024-09-12T00:39:40.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10553166184774519415', time=2024-09-12T02:32:26.464042+0000, chain.objs.size()=1 2024-09-12T00:39:40.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.KNbgfMc0O91Gajez-5O29zqIQxoGCRW_0 2024-09-12T00:39:40.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14789162628434914063', time=2024-09-12T02:32:26.514997+0000, chain.objs.size()=1 2024-09-12T00:39:40.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.599+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.qBkD-EBLkzzZ68jKY2g1VYNbjFvWxj6_0 2024-09-12T00:39:40.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.601+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17998118818645524814', time=2024-09-12T02:32:31.825430+0000, chain.objs.size()=1 2024-09-12T00:39:40.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.601+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.4wDo-zma86IkbpAwPlDSA88syGiyXS__0 2024-09-12T00:39:40.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9062498850132486596', time=2024-09-12T02:33:08.815238+0000, chain.objs.size()=1 2024-09-12T00:39:40.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.1193-8yMSseJgYHTEzf_N9YSo3of1mv_0 2024-09-12T00:39:40.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5234770991200980394', time=2024-09-12T02:33:11.357093+0000, chain.objs.size()=1 2024-09-12T00:39:40.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.KPP9kzJoFjQPVN_ZC15zzBSXXlcSThY_0 2024-09-12T00:39:40.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2920612345906357350', time=2024-09-12T02:33:11.402309+0000, chain.objs.size()=1 2024-09-12T00:39:40.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.Ik8Ydxi6DBb1bJgFAVa-03ZTs5tsCP3_0 2024-09-12T00:39:40.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17819076693601883194', time=2024-09-12T02:33:11.410365+0000, chain.objs.size()=1 2024-09-12T00:39:40.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.K8z28y63CfgU57QncACccA2D_tObHao_0 2024-09-12T00:39:40.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2968667126756130634', time=2024-09-12T02:33:11.411113+0000, chain.objs.size()=1 2024-09-12T00:39:40.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.4sm165Pz72TCneqeZESO-HIQ6I4MAHp_0 2024-09-12T00:39:40.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1360520406160477832', time=2024-09-12T02:33:45.233879+0000, chain.objs.size()=1 2024-09-12T00:39:40.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.ty60wkTzRuJ7-Dl2sEOv2qmA3n1MuAs_0 2024-09-12T00:39:40.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18307702533361472401', time=2024-09-12T02:33:47.821199+0000, chain.objs.size()=1 2024-09-12T00:39:40.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.MyfM_U3VAjP0QAWgL8cy5a9t0W1KoRc_0 2024-09-12T00:39:40.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10778497566120374981', time=2024-09-12T02:33:48.962846+0000, chain.objs.size()=1 2024-09-12T00:39:40.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.jK3RbEvviebYhASeu7Ulx0A13pRxzj9_0 2024-09-12T00:39:40.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14289988509117084611', time=2024-09-12T02:34:25.370571+0000, chain.objs.size()=1 2024-09-12T00:39:40.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.wOrboZ6KJZ_4B9pa31df3p04ChjbQ7E_0 2024-09-12T00:39:40.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16729746531638686426', time=2024-09-12T02:34:25.389245+0000, chain.objs.size()=1 2024-09-12T00:39:40.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.603+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.gLa5clCE_gw_Kn2aKcnOtOvF4cK1Mme_0 2024-09-12T00:39:40.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.605+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16108911873049983436', time=2024-09-12T02:34:27.639741+0000, chain.objs.size()=1 2024-09-12T00:39:40.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.605+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.7ItkWf-LTZe1twayHRK7f93FoYB8h2K_0 2024-09-12T00:39:40.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.607+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6037471301986596105', time=2024-09-12T02:34:27.662070+0000, chain.objs.size()=1 2024-09-12T00:39:40.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.607+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.dwuBbjVLNYPUI6aRppK0ZUIQyXht3kI_0 2024-09-12T00:39:40.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.607+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10896837197805524929', time=2024-09-12T02:35:04.686483+0000, chain.objs.size()=1 2024-09-12T00:39:40.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.607+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.BBncnSQTEjVNn09N8bo0R4ywKPifPyF_0 2024-09-12T00:39:40.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.607+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8017995662020478431', time=2024-09-12T02:35:41.952941+0000, chain.objs.size()=1 2024-09-12T00:39:40.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.607+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.ZKEPxTF-RTlD9V3FTgXJi2OYIUmGIiU_0 2024-09-12T00:39:40.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.608+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6803735290413975856', time=2024-09-12T02:36:19.146805+0000, chain.objs.size()=1 2024-09-12T00:39:40.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.608+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.hZt8nkK07TY4TwrdVHqPeuuj0QkiM1U_0 2024-09-12T00:39:40.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.608+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13230438098865030447', time=2024-09-12T02:36:54.611171+0000, chain.objs.size()=1 2024-09-12T00:39:40.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.608+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.g7pfAUaRRij82qwBavPu7rlsE9lJljR_0 2024-09-12T00:39:40.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.608+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12713685238775531442', time=2024-09-12T02:36:54.642546+0000, chain.objs.size()=1 2024-09-12T00:39:40.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.608+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.8-42qhvbGZvrezXc_or--VDR68namPD_0 2024-09-12T00:39:40.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.608+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12879977969311488771', time=2024-09-12T02:39:05.477848+0000, chain.objs.size()=1 2024-09-12T00:39:40.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.608+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18__shadow_.dC7LUIAYSOahvh7N-8GHTZvT--Lx_O8_0 2024-09-12T00:39:40.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.613+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.619+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:39:40.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.620+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:39:40.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7381272173716664678', time=2024-09-12T02:30:41.226869+0000, chain.objs.size()=2 2024-09-12T00:39:40.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.dS5rykLtH5IZ-oIsBBylGKPaZ7phD0F_0 2024-09-12T00:39:40.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.dS5rykLtH5IZ-oIsBBylGKPaZ7phD0F_1 2024-09-12T00:39:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7360621792179352604', time=2024-09-12T02:30:41.457788+0000, chain.objs.size()=1 2024-09-12T00:39:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9__shadow_.Av1ojUhSWwWytB2qis_BRaTLv_pFczP_0 2024-09-12T00:39:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16256327086752719577', time=2024-09-12T02:32:26.492368+0000, chain.objs.size()=1 2024-09-12T00:39:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.fLNvxWq4Cd4lcxi-nyIh9y3moErf0mZ_0 2024-09-12T00:39:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9820724226816224413', time=2024-09-12T02:32:26.493828+0000, chain.objs.size()=1 2024-09-12T00:39:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.g9EuuqaILmeUS2lKALjJoOtf0VEBlyb_0 2024-09-12T00:39:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12679472584416513740', time=2024-09-12T02:32:31.804958+0000, chain.objs.size()=1 2024-09-12T00:39:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.JCHb-zuyIQa39HP1kqTL3qJYm8b128-_0 2024-09-12T00:39:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.383893657863174648', time=2024-09-12T02:32:31.865166+0000, chain.objs.size()=1 2024-09-12T00:39:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.-piX_yiDIc3JmchF5tvimBJSgHpk1eQ_0 2024-09-12T00:39:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5418060599408350573', time=2024-09-12T02:33:05.380860+0000, chain.objs.size()=1 2024-09-12T00:39:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.LsKiYi9rGZ2YQZ9_E01Tk1GUIWF5d-M_0 2024-09-12T00:39:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7803799895164274057', time=2024-09-12T02:33:05.382268+0000, chain.objs.size()=1 2024-09-12T00:39:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.C_e2i4gm98usCClFUFSmkm0OcBSFsFm_0 2024-09-12T00:39:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10278940257559197668', time=2024-09-12T02:33:05.403400+0000, chain.objs.size()=1 2024-09-12T00:39:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.KFXQDFDfsRkg1ie_Tg3zzWo_9aVWkSd_0 2024-09-12T00:39:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5047327206577064053', time=2024-09-12T02:33:11.387666+0000, chain.objs.size()=1 2024-09-12T00:39:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.M5qY1wdGnyvJB6TCaByTBsrnUF4TBT2_0 2024-09-12T00:39:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7350244015567095553', time=2024-09-12T02:33:11.388129+0000, chain.objs.size()=1 2024-09-12T00:39:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.621+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.IHSBoeRrBmOR2Q4NXH29M5j4VJyTSny_0 2024-09-12T00:39:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.622+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4732618812744782414', time=2024-09-12T02:33:48.926058+0000, chain.objs.size()=1 2024-09-12T00:39:40.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.622+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.2RBpAFfMC12YrpCunO29nYQ1Jz7xBN2_0 2024-09-12T00:39:40.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.623+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9910126968505561073', time=2024-09-12T02:33:48.927387+0000, chain.objs.size()=1 2024-09-12T00:39:40.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.623+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.tmkvoAi1vJWtG07povKgtH30VdmnlNU_0 2024-09-12T00:39:40.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.624+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14116606261105223668', time=2024-09-12T02:34:22.495888+0000, chain.objs.size()=1 2024-09-12T00:39:40.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.624+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.wGEByZIHxWc98mAXfEkT25swH82uKZw_0 2024-09-12T00:39:40.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.625+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14156774316475843930', time=2024-09-12T02:34:25.316486+0000, chain.objs.size()=1 2024-09-12T00:39:40.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.625+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.cpwZ4oGZm77ilEMUJcDIF_vLrkC0RES_0 2024-09-12T00:39:40.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.625+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6033757382490435826', time=2024-09-12T02:34:25.392937+0000, chain.objs.size()=1 2024-09-12T00:39:40.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.625+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.Pd2k3euPUMtH0nL6G4TDHU4RGwd6mWX_0 2024-09-12T00:39:40.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.625+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4082228556394720505', time=2024-09-12T02:36:15.890371+0000, chain.objs.size()=1 2024-09-12T00:39:40.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.625+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.KuuV5nLZvByU7tCahibtvHkrmSVATd6_0 2024-09-12T00:39:40.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.626+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8754667828648858060', time=2024-09-12T02:36:54.600756+0000, chain.objs.size()=1 2024-09-12T00:39:40.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.626+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.HoB5VUp1iC-HzUfIyuM511r4NcA2vh0_0 2024-09-12T00:39:40.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.629+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.631+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:39:40.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.632+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T00:39:40.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='_0NwEG3Bxw3IH8rVx6R7AbPAfRRYeeH4', time=2024-09-12T02:30:41.321902+0000, chain.objs.size()=3 2024-09-12T00:39:40.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.kCNN4IZHhyicmX4hTjMQI44uMke-N0y_0 2024-09-12T00:39:40.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.kCNN4IZHhyicmX4hTjMQI44uMke-N0y_1 2024-09-12T00:39:40.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.kCNN4IZHhyicmX4hTjMQI44uMke-N0y_2 2024-09-12T00:39:40.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15382335956461941211', time=2024-09-12T02:31:48.522468+0000, chain.objs.size()=1 2024-09-12T00:39:40.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.H4GwW9WecVYtpoaJPQmpaWD5m71Y12Q_0 2024-09-12T00:39:40.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4830800151883956585', time=2024-09-12T02:31:48.523934+0000, chain.objs.size()=1 2024-09-12T00:39:40.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.i7shozVynXFq611XX4r9uchRuK0apN2_0 2024-09-12T00:39:40.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5863942111256205025', time=2024-09-12T02:32:26.473511+0000, chain.objs.size()=1 2024-09-12T00:39:40.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.WU7trBS2XNPNFq6EDC-jbbl-drRpxFz_0 2024-09-12T00:39:40.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6359964387108973765', time=2024-09-12T02:32:29.511448+0000, chain.objs.size()=1 2024-09-12T00:39:40.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.CtYDPTjR26OV1iZ_x9qVdwSo9Y9a183_0 2024-09-12T00:39:40.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2590114865165021792', time=2024-09-12T02:32:29.513123+0000, chain.objs.size()=1 2024-09-12T00:39:40.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.RScaULlnLmZZc6FPlDwAC_wv4XVC4vt_0 2024-09-12T00:39:40.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9912894896872104004', time=2024-09-12T02:32:31.811799+0000, chain.objs.size()=1 2024-09-12T00:39:40.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.6fqFunYdKi_Nnqvteenhq9e8fB-fqQ1_0 2024-09-12T00:39:40.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10927431268803509640', time=2024-09-12T02:33:08.833139+0000, chain.objs.size()=1 2024-09-12T00:39:40.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.vAHf7viqT1p3e4agZ023WOWD_igaN48_0 2024-09-12T00:39:40.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1305458492394679373', time=2024-09-12T02:33:08.833819+0000, chain.objs.size()=1 2024-09-12T00:39:40.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.pGaVaV-koW1qBNUb9Lkhwvfcr85_aLk_0 2024-09-12T00:39:40.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15213245930490746176', time=2024-09-12T02:33:11.339179+0000, chain.objs.size()=1 2024-09-12T00:39:40.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.633+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.cJfkM7sql6771vv2uTeBDIJBUf-FmWb_0 2024-09-12T00:39:40.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.635+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10237981080201645412', time=2024-09-12T02:33:11.344877+0000, chain.objs.size()=1 2024-09-12T00:39:40.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.635+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.H90LmWtzeoOTBmeMB-Sn-rp3_lZBo1G_0 2024-09-12T00:39:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16703435972419547061', time=2024-09-12T02:33:11.416910+0000, chain.objs.size()=1 2024-09-12T00:39:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.ZqjHlUETnLdmTI_7MYXtCKbxWeSfcai_0 2024-09-12T00:39:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11585088295169382135', time=2024-09-12T02:33:45.250061+0000, chain.objs.size()=1 2024-09-12T00:39:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.UnP-MyvS9fkptXU7E8TwC9LbmFio4uK_0 2024-09-12T00:39:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3494136205849792053', time=2024-09-12T02:33:45.250820+0000, chain.objs.size()=1 2024-09-12T00:39:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.7qufESV4PWflELIgB-_lyhtaE6DfHMJ_0 2024-09-12T00:39:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2979479750735132461', time=2024-09-12T02:34:22.493974+0000, chain.objs.size()=1 2024-09-12T00:39:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.2Z6w10gkwNNnYzMBU_zgB56IylhGncL_0 2024-09-12T00:39:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5449807040624486838', time=2024-09-12T02:34:25.334595+0000, chain.objs.size()=1 2024-09-12T00:39:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.P_gbzX7CQE3_1i9uIoFcn-T-ZsJCi9g_0 2024-09-12T00:39:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3470444982998334384', time=2024-09-12T02:34:27.661042+0000, chain.objs.size()=1 2024-09-12T00:39:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_._1vA3NpDyE_EgqzlofQ0phrf6amCOCo_0 2024-09-12T00:39:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7139024042236298598', time=2024-09-12T02:34:27.711545+0000, chain.objs.size()=1 2024-09-12T00:39:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.iMnHQXO0fQNOiLqcq-pE_sbRGY95aiA_0 2024-09-12T00:39:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17319888016378499661', time=2024-09-12T02:35:01.251024+0000, chain.objs.size()=1 2024-09-12T00:39:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.ZKayPDzyvF1hsYpSqomuPYUMW1EePex_0 2024-09-12T00:39:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11864648330040198594', time=2024-09-12T02:35:01.253598+0000, chain.objs.size()=1 2024-09-12T00:39:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.7QT04QaNZbkk9obKpOmf_O6X6gExXiA_0 2024-09-12T00:39:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6457978397307834276', time=2024-09-12T02:35:04.749374+0000, chain.objs.size()=1 2024-09-12T00:39:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.x4dxXCv2h_KDqkfdKCerbvhcpjjYerI_0 2024-09-12T00:39:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15283190372439315998', time=2024-09-12T02:35:41.911032+0000, chain.objs.size()=1 2024-09-12T00:39:40.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.638+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.H0DCDEOPHxFfVuZqkrbo8VxWdCgoEW8_0 2024-09-12T00:39:40.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.642+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17376701470168873910', time=2024-09-12T02:36:21.207298+0000, chain.objs.size()=1 2024-09-12T00:39:40.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.642+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.T9K17yW7ayKapL1B-SCTBlscatyLaNX_0 2024-09-12T00:39:40.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.642+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3622862191264008334', time=2024-09-12T02:36:23.178759+0000, chain.objs.size()=1 2024-09-12T00:39:40.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.642+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.e6qIhmz5u9m9A59M8eu5cSfMHPZ73N2_0 2024-09-12T00:39:40.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.642+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16851498505036364151', time=2024-09-12T02:36:54.613039+0000, chain.objs.size()=1 2024-09-12T00:39:40.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.642+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.EwlVBpI10bpa0rbIoocwHHbtaqyeqBO_0 2024-09-12T00:39:40.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.642+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15486038203583547911', time=2024-09-12T02:36:54.675879+0000, chain.objs.size()=1 2024-09-12T00:39:40.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.642+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.MiyJfPsM68c2v2qvm8b3ZZCEYC_zTNd_0 2024-09-12T00:39:40.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.645+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.648+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:39:40.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:39:40.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14812803827410802744', time=2024-09-12T02:31:48.486633+0000, chain.objs.size()=1 2024-09-12T00:39:40.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.MVWAydM01qgGVFIaDPElOA4WbHCWoww_0 2024-09-12T00:39:40.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9491592257860501112', time=2024-09-12T02:32:29.508813+0000, chain.objs.size()=1 2024-09-12T00:39:40.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.Izcir1jDTry2MkK4OEl_44l2jC7-vm2_0 2024-09-12T00:39:40.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13809128005226008535', time=2024-09-12T02:32:31.803020+0000, chain.objs.size()=1 2024-09-12T00:39:40.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.VB4olTZS-N1UusOppp97Cghxnf7i-Hq_0 2024-09-12T00:39:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17696119607374928235', time=2024-09-12T02:33:08.847966+0000, chain.objs.size()=1 2024-09-12T00:39:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.41qN5k_Niovav36HEL_PMblc5u3htCZ_0 2024-09-12T00:39:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17542740080533709584', time=2024-09-12T02:33:08.848678+0000, chain.objs.size()=1 2024-09-12T00:39:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.woEw99YtBgefkD_nJ0qVNcj5_diOoAV_0 2024-09-12T00:39:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14671752507960888335', time=2024-09-12T02:33:48.926608+0000, chain.objs.size()=1 2024-09-12T00:39:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.j9RFPPKY2YIgsSxPtMtOy9K3oOLQ_ER_0 2024-09-12T00:39:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10912133506375613944', time=2024-09-12T02:34:22.503690+0000, chain.objs.size()=1 2024-09-12T00:39:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.HmVOOshX0DgcdUPDiSmQMV_wJ3ZVLv9_0 2024-09-12T00:39:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12494526548979631141', time=2024-09-12T02:34:25.351615+0000, chain.objs.size()=1 2024-09-12T00:39:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.rs7EHdioKNB8EG9Q2QHrQ0HtNFieMBA_0 2024-09-12T00:39:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13045348865950424549', time=2024-09-12T02:34:27.622825+0000, chain.objs.size()=1 2024-09-12T00:39:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.6hfx7eog33eViFDufDxPK9gGJAUPaBT_0 2024-09-12T00:39:40.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5526195454970253503', time=2024-09-12T02:35:01.173035+0000, chain.objs.size()=1 2024-09-12T00:39:40.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.etwScdGCEJLa6MUQIn1_AsJE7pOsSmI_0 2024-09-12T00:39:40.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6573848094231817738', time=2024-09-12T02:35:04.690971+0000, chain.objs.size()=1 2024-09-12T00:39:40.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.LWeCbgevUEFalDGG1bERS1Bo0ityHwm_0 2024-09-12T00:39:40.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1496559936297888299', time=2024-09-12T02:35:38.652978+0000, chain.objs.size()=1 2024-09-12T00:39:40.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.651+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.lYOxh-CQ-FyMtIfjuiv1jsP8rNVVJJx_0 2024-09-12T00:39:40.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.655+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4865830241552956890', time=2024-09-12T02:35:41.853492+0000, chain.objs.size()=1 2024-09-12T00:39:40.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.655+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.-X1tTeQ-DChOCXNN4WK_xlENy-yPEL-_0 2024-09-12T00:39:40.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.655+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2415909293396919314', time=2024-09-12T02:35:41.925949+0000, chain.objs.size()=1 2024-09-12T00:39:40.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.655+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.6UA_h6AbqVLQEofXsAZGOwH0lRsCD6K_0 2024-09-12T00:39:40.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.655+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20075804906092400', time=2024-09-12T02:36:15.930872+0000, chain.objs.size()=1 2024-09-12T00:39:40.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.655+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.SrD7kwP4lDgdRk0fT-aC1Rgq8axst1M_0 2024-09-12T00:39:40.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.655+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16109080050252976031', time=2024-09-12T02:36:54.661154+0000, chain.objs.size()=1 2024-09-12T00:39:40.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.655+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.YlwlpjLAZBPgEDgFJnCVIer4WgMrJiU_0 2024-09-12T00:39:40.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.655+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4994478438058264152', time=2024-09-12T02:39:19.858104+0000, chain.objs.size()=1 2024-09-12T00:39:40.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.655+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19__shadow:ji6Fguh7NO7XT.5r0.dR638UothAUH8_.vWu4OLnw-XrLlBka2IsklcFNQK-MCuo_0 2024-09-12T00:39:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.661+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.666+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:39:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.667+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:39:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15433927485872968209', time=2024-09-12T02:31:51.818334+0000, chain.objs.size()=1 2024-09-12T00:39:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.H63KmJ5chxo3eefZvuwu4qxasOtbZIo_0 2024-09-12T00:39:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14234775323271876379', time=2024-09-12T02:32:29.509981+0000, chain.objs.size()=1 2024-09-12T00:39:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.rGYaU3vhvB1INi3ALDM6GcX_aAqXcCr_0 2024-09-12T00:39:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13574181675936359637', time=2024-09-12T02:32:29.572518+0000, chain.objs.size()=1 2024-09-12T00:39:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.yQSGiaeyEKXokptI6nOkCzx30JdE4LB_0 2024-09-12T00:39:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16614327603649806282', time=2024-09-12T02:35:01.232267+0000, chain.objs.size()=1 2024-09-12T00:39:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.1VXFHmrZIOAeYiUKlfb0Q2X0eiUY5Fj_0 2024-09-12T00:39:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13512941927357020978', time=2024-09-12T02:35:04.691910+0000, chain.objs.size()=1 2024-09-12T00:39:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.Zhld3_kpq4WQOt2vuirvO4RWG_aRbsY_0 2024-09-12T00:39:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11825911162811498074', time=2024-09-12T02:35:38.730077+0000, chain.objs.size()=1 2024-09-12T00:39:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.67GSWdDdyDrM8w30xqP9bBKdXqtVyyi_0 2024-09-12T00:39:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4116388558337614747', time=2024-09-12T02:35:41.963317+0000, chain.objs.size()=1 2024-09-12T00:39:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.SqWCdM4z2ut1RBpVlICvZe26C3wyiYE_0 2024-09-12T00:39:40.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.69989683340629979', time=2024-09-12T02:36:15.923499+0000, chain.objs.size()=1 2024-09-12T00:39:40.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.yUvVoKyJ4BqgMl1ZPNHJFo6LTuxTIsN_0 2024-09-12T00:39:40.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13834561175217518443', time=2024-09-12T02:36:19.145508+0000, chain.objs.size()=1 2024-09-12T00:39:40.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.dF2mzVRSghJ2_dFdk-S7JBXNNBeUnlV_0 2024-09-12T00:39:40.669 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16114158107134475453', time=2024-09-12T02:36:21.298640+0000, chain.objs.size()=1 2024-09-12T00:39:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.668+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.pQv8Kktu21cbPUNwX3H9zq570PQJlZJ_0 2024-09-12T00:39:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.672+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.677+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:39:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.678+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.678+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T00:39:40.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8056015692947853713', time=2024-09-12T02:30:41.469606+0000, chain.objs.size()=1 2024-09-12T00:39:40.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9__shadow_.X5xjzrrM536EKJRcy09fCwlTQn8vW-A_0 2024-09-12T00:39:40.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7600811153630301290', time=2024-09-12T02:31:51.834589+0000, chain.objs.size()=1 2024-09-12T00:39:40.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.OVkXE7FDrKEN338WnPqJR1CBDiTGRcZ_0 2024-09-12T00:39:40.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8284327568697608315', time=2024-09-12T02:31:51.835223+0000, chain.objs.size()=1 2024-09-12T00:39:40.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.y07EB5r6IonFs3DxDe3j0IsxDfnh3jn_0 2024-09-12T00:39:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6906664959215062217', time=2024-09-12T02:32:26.554084+0000, chain.objs.size()=1 2024-09-12T00:39:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.4J4wqC1WNb8AYDV3paYimzGhbX5xxXE_0 2024-09-12T00:39:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10144081176208378536', time=2024-09-12T02:32:31.860135+0000, chain.objs.size()=1 2024-09-12T00:39:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.S8ZlMrjZYRjwLuhAg9ARGHZLW3BiXQV_0 2024-09-12T00:39:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3995450826916762820', time=2024-09-12T02:33:05.361745+0000, chain.objs.size()=1 2024-09-12T00:39:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.iF-LATAxxyi8YBnSS_a8NLe7w42jChz_0 2024-09-12T00:39:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4061959506512864447', time=2024-09-12T02:33:11.347157+0000, chain.objs.size()=1 2024-09-12T00:39:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.on-9fsVpLaZyGOLCKGNTZsuccpa6yYL_0 2024-09-12T00:39:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17979641640994252339', time=2024-09-12T02:35:01.260091+0000, chain.objs.size()=1 2024-09-12T00:39:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.VDcBr77MUX_Y_Rq5LhbnM05ePidB90j_0 2024-09-12T00:39:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13389861909614117681', time=2024-09-12T02:35:38.650438+0000, chain.objs.size()=1 2024-09-12T00:39:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.0e5L8gw2fXmBqdOqPZTSzIAWlvtunSh_0 2024-09-12T00:39:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7246277623742252594', time=2024-09-12T02:36:19.092908+0000, chain.objs.size()=1 2024-09-12T00:39:40.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.gVyrQcbgsW4kiBjUNFjz6oP4sAZl9tO_0 2024-09-12T00:39:40.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11863329483439430027', time=2024-09-12T02:39:05.488354+0000, chain.objs.size()=1 2024-09-12T00:39:40.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.679+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18__shadow_.yMTUwXe3oOuKN4cWg2nXtNFAaKJzbBm_0 2024-09-12T00:39:40.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.684+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.686+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:39:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.687+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:39:40.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16667403786024111136', time=2024-09-12T02:30:41.129731+0000, chain.objs.size()=1 2024-09-12T00:39:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.lDMYvZG87z2XogDxtdg-BpckcSZhlVP_0 2024-09-12T00:39:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16613242334230809166', time=2024-09-12T02:30:41.150106+0000, chain.objs.size()=4 2024-09-12T00:39:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12__multipart_foo.2~XnzwfkrSOFeLzfU7C49mNLf3YdIEPm9.1 2024-09-12T00:39:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12__multipart_foo.2~XnzwfkrSOFeLzfU7C49mNLf3YdIEPm9.2 2024-09-12T00:39:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12__multipart_foo.2~XnzwfkrSOFeLzfU7C49mNLf3YdIEPm9.3 2024-09-12T00:39:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12__multipart_foo.2~XnzwfkrSOFeLzfU7C49mNLf3YdIEPm9.4 2024-09-12T00:39:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='_SMGZJ9NlZKZ3XlBBW6ABEMBsiKlLU0t', time=2024-09-12T02:30:41.234821+0000, chain.objs.size()=2 2024-09-12T00:39:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.9JJ8BHveJDtkOjv-xrwo8tqX8ML5_3N_0 2024-09-12T00:39:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.9JJ8BHveJDtkOjv-xrwo8tqX8ML5_3N_1 2024-09-12T00:39:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='_15qlzNMTsWnlZ6z3gLMr1FCmPvzwyeY', time=2024-09-12T02:30:41.329396+0000, chain.objs.size()=3 2024-09-12T00:39:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.1vZij-WBkO43PIpSFHqiW58r5FOkBhV_0 2024-09-12T00:39:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.1vZij-WBkO43PIpSFHqiW58r5FOkBhV_1 2024-09-12T00:39:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_.1vZij-WBkO43PIpSFHqiW58r5FOkBhV_2 2024-09-12T00:39:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2890959427719469378', time=2024-09-12T02:31:48.519091+0000, chain.objs.size()=1 2024-09-12T00:39:40.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.v4BZSTOSlYfsoWjPZpQrMfJ4Ib9AmLh_0 2024-09-12T00:39:40.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3503880278700823369', time=2024-09-12T02:31:48.519637+0000, chain.objs.size()=1 2024-09-12T00:39:40.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.688+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.VGlDcnW4YCcqpr_7Wtjy_UcyNpqjUM1_0 2024-09-12T00:39:40.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.691+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9949515429671697851', time=2024-09-12T02:32:29.511141+0000, chain.objs.size()=1 2024-09-12T00:39:40.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.691+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.shSXxqI-L9DwHWj-YHSDNmb-ps7tIGp_0 2024-09-12T00:39:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.692+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16099950564114121038', time=2024-09-12T02:32:29.511871+0000, chain.objs.size()=1 2024-09-12T00:39:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.692+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.FBwWBJ6Fj9O5xAlPTxWwM45HPX9Nlnt_0 2024-09-12T00:39:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.692+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4839106879059205988', time=2024-09-12T02:33:08.837405+0000, chain.objs.size()=1 2024-09-12T00:39:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.692+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.7YAs5DR0P4Y_jQ15Jpb7etJCoI6QiWV_0 2024-09-12T00:39:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.692+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15570395354303267215', time=2024-09-12T02:33:48.930959+0000, chain.objs.size()=1 2024-09-12T00:39:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.692+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.pJ1O52g4wmJcp7zeIeNXE2nFjUl1XPI_0 2024-09-12T00:39:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.692+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10718522300167837194', time=2024-09-12T02:34:22.467026+0000, chain.objs.size()=1 2024-09-12T00:39:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.692+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.AvEdFoqz1RfXF8Qk_S9j5mOak0pvM-Z_0 2024-09-12T00:39:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.692+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6974584477888871184', time=2024-09-12T02:34:25.326575+0000, chain.objs.size()=1 2024-09-12T00:39:40.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.692+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.uvX-uMxKiceA-7VvSl77tetHozBLXzD_0 2024-09-12T00:39:40.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.692+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11117052245221823607', time=2024-09-12T02:34:25.345715+0000, chain.objs.size()=1 2024-09-12T00:39:40.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.692+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.YrLvQ2fVvCDpCIheQoGhiv3mMYu1BbT_0 2024-09-12T00:39:40.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.693+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3362976694397089448', time=2024-09-12T02:34:27.581061+0000, chain.objs.size()=1 2024-09-12T00:39:40.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.693+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.qji0G_IT2GJNRaz_O6G2Q4Ncx3JQliC_0 2024-09-12T00:39:40.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.693+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9641868979409520112', time=2024-09-12T02:34:27.672161+0000, chain.objs.size()=1 2024-09-12T00:39:40.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.694+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.OL0Df2qUVsEyNLMHNZqILL0y6pzT2s-_0 2024-09-12T00:39:40.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.694+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5203298927527755739', time=2024-09-12T02:35:04.666410+0000, chain.objs.size()=1 2024-09-12T00:39:40.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.694+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.XQUMGVjjggHidKJDxeNtlume3enFK6b_0 2024-09-12T00:39:40.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.694+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6669880081772466975', time=2024-09-12T02:35:41.910770+0000, chain.objs.size()=1 2024-09-12T00:39:40.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.694+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.qCE2lwtZwaP114kYlCBT_Eunl4yhXua_0 2024-09-12T00:39:40.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.694+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14655181750214379269', time=2024-09-12T02:36:21.214052+0000, chain.objs.size()=1 2024-09-12T00:39:40.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.694+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.xARqZsNnxgDW2SOo1zs9eKxkWwIcCra_0 2024-09-12T00:39:40.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.696+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11953103998259723206', time=2024-09-12T02:36:54.576090+0000, chain.objs.size()=1 2024-09-12T00:39:40.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.696+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.JpTKVjKTRbzhZ1th1C_xyCWY9A-KBQJ_0 2024-09-12T00:39:40.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.700+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.702+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:39:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.703+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:39:40.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='_u2cMmktziLv_xFLFqLaP_FGCuCZDbvN', time=2024-09-12T02:30:41.242613+0000, chain.objs.size()=2 2024-09-12T00:39:40.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.ZePIsvvRk2Ze6ZLmwu-6J9e2f3soAv0_0 2024-09-12T00:39:40.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.ZePIsvvRk2Ze6ZLmwu-6J9e2f3soAv0_1 2024-09-12T00:39:40.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4302274082272743010', time=2024-09-12T02:30:41.430566+0000, chain.objs.size()=1 2024-09-12T00:39:40.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8__shadow_.LRNwxNAfUF0oPQ2AyHJrXnKw7L_ciaB_0 2024-09-12T00:39:40.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.112651006064838572', time=2024-09-12T02:31:48.514763+0000, chain.objs.size()=1 2024-09-12T00:39:40.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.5mnlngJOlChTiupCXmca8DqQ5X5Wf-Q_0 2024-09-12T00:39:40.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15339566236504866990', time=2024-09-12T02:31:48.524500+0000, chain.objs.size()=1 2024-09-12T00:39:40.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.g_-XnBEgLhN0SkkJJ9Xx0Qyc_q-6oFX_0 2024-09-12T00:39:40.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6487639027168848971', time=2024-09-12T02:31:48.573127+0000, chain.objs.size()=1 2024-09-12T00:39:40.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.d7x9vyZlGcybt7SKXvThEfcXamo2_sz_0 2024-09-12T00:39:40.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7266059334903774391', time=2024-09-12T02:31:51.844014+0000, chain.objs.size()=1 2024-09-12T00:39:40.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.9cEzsDeUyijQ4RqcOUWq-7j46Jq9gfP_0 2024-09-12T00:39:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9355758542019022518', time=2024-09-12T02:32:29.510504+0000, chain.objs.size()=1 2024-09-12T00:39:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.3kat1REbwWop7BhozmSxpJcx2Cwi4p3_0 2024-09-12T00:39:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3140192521321200667', time=2024-09-12T02:32:29.512214+0000, chain.objs.size()=1 2024-09-12T00:39:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.2yVnEOECl56Hyv5OU0OU8-4JCois2qv_0 2024-09-12T00:39:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7296623504105451530', time=2024-09-12T02:32:31.801402+0000, chain.objs.size()=1 2024-09-12T00:39:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.8HeRLNQ_2WfeG1UyfNYJTQ2erp2xag2_0 2024-09-12T00:39:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15778767890210732561', time=2024-09-12T02:32:31.813336+0000, chain.objs.size()=1 2024-09-12T00:39:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.VIxt6mmINTSSIX4-PI-oBEIlANFaa0m_0 2024-09-12T00:39:40.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13660717845973345264', time=2024-09-12T02:34:22.493244+0000, chain.objs.size()=1 2024-09-12T00:39:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.704+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.HgQ81HSYcDDbzFcO1vnBphLq31PILAL_0 2024-09-12T00:39:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.707+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11506417055629418421', time=2024-09-12T02:34:22.495019+0000, chain.objs.size()=1 2024-09-12T00:39:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.707+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.2jxoDnaS9z89pRoMLuZcprh6Sb5Im_U_0 2024-09-12T00:39:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.707+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17106634224826065525', time=2024-09-12T02:34:22.542920+0000, chain.objs.size()=1 2024-09-12T00:39:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.707+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.ZKBY2xDneSAQFm0jxFXotEnpK0GMwd__0 2024-09-12T00:39:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.707+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9970535486232007057', time=2024-09-12T02:35:38.721760+0000, chain.objs.size()=1 2024-09-12T00:39:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.707+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.CgO-rmgmUeUYuxk8VNIzMPorXbmk4Ge_0 2024-09-12T00:39:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.707+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6369809562133848674', time=2024-09-12T02:35:41.959902+0000, chain.objs.size()=1 2024-09-12T00:39:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.707+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.x-YEIdvUk35TC9b4HQewiZiCBUghlsi_0 2024-09-12T00:39:40.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.708+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10212736389882410761', time=2024-09-12T02:36:15.914237+0000, chain.objs.size()=1 2024-09-12T00:39:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.708+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.etqbgMbFOdcBg5q-vLODp5GuzvgJrdD_0 2024-09-12T00:39:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.708+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12009002221716985685', time=2024-09-12T02:36:21.216174+0000, chain.objs.size()=1 2024-09-12T00:39:40.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.708+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.C779o_UPZqtmuIR3GEY2jeE703jtwx1_0 2024-09-12T00:39:40.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.711+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.713+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:39:40.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:39:40.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13396176621811548001', time=2024-09-12T02:30:41.266738+0000, chain.objs.size()=1 2024-09-12T00:39:40.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.lVS-faxMZfcS8pgRKbItJDyX5VneK8j_0 2024-09-12T00:39:40.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13336723316581647741', time=2024-09-12T02:32:31.776363+0000, chain.objs.size()=1 2024-09-12T00:39:40.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.yu0VpkAdA8rBHPouENoiB79D8kp4u45_0 2024-09-12T00:39:40.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13739440975566754817', time=2024-09-12T02:33:05.427693+0000, chain.objs.size()=1 2024-09-12T00:39:40.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.NRxzsBJ9J2dRWW8PhYLH0CSMeMEASxd_0 2024-09-12T00:39:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1345093643380370426', time=2024-09-12T02:33:11.317148+0000, chain.objs.size()=1 2024-09-12T00:39:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.aM2vsF4i-tx7f-QTRA-w4pre_iFm0ik_0 2024-09-12T00:39:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18213937745801707379', time=2024-09-12T02:33:11.355361+0000, chain.objs.size()=1 2024-09-12T00:39:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.-m4sFTLHv87pMYINBetOErPxgZ-hpdL_0 2024-09-12T00:39:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3498005161993656214', time=2024-09-12T02:34:22.464025+0000, chain.objs.size()=1 2024-09-12T00:39:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.MhhOatC8dWsl-2z9B150MQvJCLDnaeu_0 2024-09-12T00:39:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3781997727994769401', time=2024-09-12T02:34:25.352505+0000, chain.objs.size()=1 2024-09-12T00:39:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.KDWNwIgh0Qrh_f0KnJR-6XuhnV0tk0F_0 2024-09-12T00:39:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14588745980406157445', time=2024-09-12T02:34:27.622136+0000, chain.objs.size()=1 2024-09-12T00:39:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.715+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.5dxXGk9XTEITtucDN6i6NF0RzAi6-6t_0 2024-09-12T00:39:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.716+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15596219966382365863', time=2024-09-12T02:34:27.637152+0000, chain.objs.size()=1 2024-09-12T00:39:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.716+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.MBSYamn0M169FXXvw56N67ZQPYROjNW_0 2024-09-12T00:39:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.716+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11960737136147850111', time=2024-09-12T02:34:27.662570+0000, chain.objs.size()=1 2024-09-12T00:39:40.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.716+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.KTaA3ZPOQKjlWQ8pwZICN073qJaRZep_0 2024-09-12T00:39:40.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.716+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15133946731753285308', time=2024-09-12T02:34:59.897220+0000, chain.objs.size()=1 2024-09-12T00:39:40.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.716+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.OKkZRE5ZoxiHeKVA3j56zWhle6Sky-H_0 2024-09-12T00:39:40.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.716+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14235467990953040135', time=2024-09-12T02:35:04.691799+0000, chain.objs.size()=1 2024-09-12T00:39:40.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.716+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.O8orDtn6QHZAAKaga8OPT1GctKBTeym_0 2024-09-12T00:39:40.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.719+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4244074204337328384', time=2024-09-12T02:36:21.231513+0000, chain.objs.size()=1 2024-09-12T00:39:40.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.719+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.9YmqLCcZ6E16jgbOzPAoQXzqEGuYkBY_0 2024-09-12T00:39:40.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.719+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10044959180330729075', time=2024-09-12T02:36:54.661770+0000, chain.objs.size()=1 2024-09-12T00:39:40.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.719+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.X1JJNv5HqcW9kYbZTS8uXLV1vjK5zTw_0 2024-09-12T00:39:40.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.719+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7373198727368141018', time=2024-09-12T02:36:54.679213+0000, chain.objs.size()=1 2024-09-12T00:39:40.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.719+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.R_u2nrDy9Gj4-pk71yx3ZQpQcX-imOQ_0 2024-09-12T00:39:40.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.721+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.724+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:39:40.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.725+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.725+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:39:40.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2131088183065980155', time=2024-09-12T02:30:41.207423+0000, chain.objs.size()=4 2024-09-12T00:39:40.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10__multipart_foo.2~pHpOyd8cEylQjqSQO-Qc-1bQRlwQ156.1 2024-09-12T00:39:40.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10__multipart_foo.2~pHpOyd8cEylQjqSQO-Qc-1bQRlwQ156.2 2024-09-12T00:39:40.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10__multipart_foo.2~pHpOyd8cEylQjqSQO-Qc-1bQRlwQ156.3 2024-09-12T00:39:40.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10__multipart_foo.2~pHpOyd8cEylQjqSQO-Qc-1bQRlwQ156.4 2024-09-12T00:39:40.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.718079189310196841', time=2024-09-12T02:31:51.906611+0000, chain.objs.size()=1 2024-09-12T00:39:40.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.N1l-NjK9R8YyOGsl30pTj7JCn6Ylv8w_0 2024-09-12T00:39:40.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.714007549926078087', time=2024-09-12T02:31:55.009878+0000, chain.objs.size()=1 2024-09-12T00:39:40.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.JOH-2MQKrcIBgoTuEiYDnXI9OVwORAB_0 2024-09-12T00:39:40.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.282193853981586799', time=2024-09-12T02:32:29.529362+0000, chain.objs.size()=1 2024-09-12T00:39:40.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.xE0iWVBwUVD4gMC8UdkeXqfHKO9cECd_0 2024-09-12T00:39:40.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13931362597138024828', time=2024-09-12T02:33:05.428013+0000, chain.objs.size()=1 2024-09-12T00:39:40.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.B0msnFNu7T2cTc0GEsSLypvOGGP-d2y_0 2024-09-12T00:39:40.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2121427585705057402', time=2024-09-12T02:33:05.448906+0000, chain.objs.size()=1 2024-09-12T00:39:40.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.rSa9GcuZb9oezOIDhUGtm5YXLwFxJgH_0 2024-09-12T00:39:40.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17738228187105005999', time=2024-09-12T02:33:48.888076+0000, chain.objs.size()=1 2024-09-12T00:39:40.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.DdRA7VLpduggpFGaeCcug17ugp6i5tg_0 2024-09-12T00:39:40.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3910538220909840548', time=2024-09-12T02:33:48.922979+0000, chain.objs.size()=1 2024-09-12T00:39:40.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.EKISkNMTfKSs41QgvNa3S78xp91bJqK_0 2024-09-12T00:39:40.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7331066430643043516', time=2024-09-12T02:33:48.923672+0000, chain.objs.size()=1 2024-09-12T00:39:40.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.726+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.V--0zD_Ces5TZ3KJjz6BHcITeqWAwTh_0 2024-09-12T00:39:40.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.728+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10324646248443359102', time=2024-09-12T02:35:01.189727+0000, chain.objs.size()=1 2024-09-12T00:39:40.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.728+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.DEYL7vv5QbwRXxwb38jff8fqAQupMrU_0 2024-09-12T00:39:40.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.728+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15493451145365209202', time=2024-09-12T02:35:38.693269+0000, chain.objs.size()=1 2024-09-12T00:39:40.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.728+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.DXlonP_Xf7BclDxQ_DhyRlX2-3K7J4G_0 2024-09-12T00:39:40.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.729+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4402725930690999469', time=2024-09-12T02:36:21.243175+0000, chain.objs.size()=1 2024-09-12T00:39:40.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.729+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.pdsa6lSpdmerAD9RCM1V5TO3M5-eTDa_0 2024-09-12T00:39:40.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.731+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.734+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:39:40.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.735+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.735+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:39:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7436775280713046528', time=2024-09-12T02:30:41.133961+0000, chain.objs.size()=1 2024-09-12T00:39:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.pBOgYi3wBjvdEJ4YW4_ch0NrZyEMaPh_0 2024-09-12T00:39:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18156474396096708581', time=2024-09-12T02:30:41.254479+0000, chain.objs.size()=1 2024-09-12T00:39:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.lVS-faxMZfcS8pgRKbItJDyX5VneK8j_0 2024-09-12T00:39:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.216165153621750196', time=2024-09-12T02:32:31.864949+0000, chain.objs.size()=1 2024-09-12T00:39:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.cCHVbTnIwITIiwwLNKIHrv87JmJmS8j_0 2024-09-12T00:39:40.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1481774623313123793', time=2024-09-12T02:33:05.451110+0000, chain.objs.size()=1 2024-09-12T00:39:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.2-vEKbBS_2F_iYW2PTfCoLhgzjeuEnh_0 2024-09-12T00:39:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11241175812892406783', time=2024-09-12T02:33:45.218485+0000, chain.objs.size()=1 2024-09-12T00:39:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.eizXqXqS_oQak0I1YYh7pU5kSJkYiR2_0 2024-09-12T00:39:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5508349481389679471', time=2024-09-12T02:33:45.240675+0000, chain.objs.size()=1 2024-09-12T00:39:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.qdyk8i9_jX4cr2Tb9DWCzZ1sDc_SlP7_0 2024-09-12T00:39:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14248123202533340399', time=2024-09-12T02:33:48.969161+0000, chain.objs.size()=1 2024-09-12T00:39:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.FjyF0wMaX2rfM5pLZDghblkBGOM8s4e_0 2024-09-12T00:39:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15925381046854230032', time=2024-09-12T02:34:25.326061+0000, chain.objs.size()=1 2024-09-12T00:39:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.QQC0t2wI2-LU7JXsdcoXKicyEt5UnYX_0 2024-09-12T00:39:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5149922896107683048', time=2024-09-12T02:35:38.679368+0000, chain.objs.size()=1 2024-09-12T00:39:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.SxwFBaQ2E5I-qU3YKMhvdX4WRyu0R1U_0 2024-09-12T00:39:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4634657695482079293', time=2024-09-12T02:35:41.912186+0000, chain.objs.size()=1 2024-09-12T00:39:40.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.5xrHXkAj6Vxda9_NMneMGroC85GXrav_0 2024-09-12T00:39:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5783641646874983848', time=2024-09-12T02:36:15.867797+0000, chain.objs.size()=1 2024-09-12T00:39:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.J_mCOjWLmNhZ8LlfMnGozMYrOff_b0j_0 2024-09-12T00:39:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8659116752359687255', time=2024-09-12T02:36:19.135611+0000, chain.objs.size()=1 2024-09-12T00:39:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.736+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.lvQZw9_iqd47AtlKYrSLyspPPVPmQsa_0 2024-09-12T00:39:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.738+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4282553461056607704', time=2024-09-12T02:36:21.204682+0000, chain.objs.size()=1 2024-09-12T00:39:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.738+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.zTq3qq93MLtGeCnjTBlgD036HYDHFCV_0 2024-09-12T00:39:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.738+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.130252776631382903', time=2024-09-12T02:36:54.639956+0000, chain.objs.size()=1 2024-09-12T00:39:40.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.738+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.jmYdS3nyuLyVn9HGThKfOx_kE7LR1Tj_0 2024-09-12T00:39:40.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.738+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13835544659557544719', time=2024-09-12T02:39:05.474639+0000, chain.objs.size()=1 2024-09-12T00:39:40.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.738+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18__shadow_.-UaLxPnoTDBcueiBwHz_77IClN1TpdQ_0 2024-09-12T00:39:40.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.740+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9493425059302235228', time=2024-09-12T02:39:19.861475+0000, chain.objs.size()=1 2024-09-12T00:39:40.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.740+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19__shadow:1prMKg2DdRvEi.sOCS6LMuG5x3PO1-n_.9Yvwjhlze0v3B87ORdCA1dLEJjhpFt6_0 2024-09-12T00:39:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.743+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.746+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:39:40.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.747+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.747+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:39:40.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8739048697073155014', time=2024-09-12T02:30:41.293580+0000, chain.objs.size()=5 2024-09-12T00:39:40.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.1 2024-09-12T00:39:40.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.1_1 2024-09-12T00:39:40.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.2 2024-09-12T00:39:40.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.2_1 2024-09-12T00:39:40.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.3 2024-09-12T00:39:40.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13971694358615694539', time=2024-09-12T02:31:51.839003+0000, chain.objs.size()=1 2024-09-12T00:39:40.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.WH-vJ3xQqCPoj5auS4R7UzJnlXfm68A_0 2024-09-12T00:39:40.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17742901008503490256', time=2024-09-12T02:31:51.865877+0000, chain.objs.size()=1 2024-09-12T00:39:40.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.Ww86L8UQyl3pgdXwib5z4IJDAJiQP3__0 2024-09-12T00:39:40.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13781508194438107801', time=2024-09-12T02:32:26.506978+0000, chain.objs.size()=1 2024-09-12T00:39:40.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.wGyLgJAu_UYqk9dZlxlpicVA07ePWUw_0 2024-09-12T00:39:40.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4488827397243770671', time=2024-09-12T02:32:29.508813+0000, chain.objs.size()=1 2024-09-12T00:39:40.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.85M0UNJQPydgs74PZGeBlUQu68IPqmH_0 2024-09-12T00:39:40.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13799103327080751909', time=2024-09-12T02:33:07.742957+0000, chain.objs.size()=1 2024-09-12T00:39:40.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.AeQXUTM_wUkxqhPcEBQ93zpYfQnAI-G_0 2024-09-12T00:39:40.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9545688215184970682', time=2024-09-12T02:33:08.847922+0000, chain.objs.size()=1 2024-09-12T00:39:40.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.Kf1l894on5yylbDAKT2fHhp8xTuG8Bu_0 2024-09-12T00:39:40.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12394132268606018253', time=2024-09-12T02:33:11.355378+0000, chain.objs.size()=1 2024-09-12T00:39:40.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.748+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.vkMu_4vo5gibuksqNvwuq3id7ErTezQ_0 2024-09-12T00:39:40.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.750+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3676585993202457557', time=2024-09-12T02:33:45.287048+0000, chain.objs.size()=1 2024-09-12T00:39:40.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.750+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.emzebfeFTCPmKfB1KomP7Sxk1RdFltC_0 2024-09-12T00:39:40.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.750+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18443848038351237512', time=2024-09-12T02:33:48.926534+0000, chain.objs.size()=1 2024-09-12T00:39:40.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.750+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.QcM2gPhC3W8vrOUyTd2l5bQZa1ThZwn_0 2024-09-12T00:39:40.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.750+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4472637969005233974', time=2024-09-12T02:33:48.927155+0000, chain.objs.size()=1 2024-09-12T00:39:40.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.750+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.29__shadow_.m6mMjjUhTDVEMNeTMvWBkW1XnteP1mY_0 2024-09-12T00:39:40.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.750+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2179961125080872350', time=2024-09-12T02:34:25.386138+0000, chain.objs.size()=1 2024-09-12T00:39:40.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.750+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.sOMozDelAwTO4vww1wWAq95jrrRb_UM_0 2024-09-12T00:39:40.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.750+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14303819621078016756', time=2024-09-12T02:35:04.690979+0000, chain.objs.size()=1 2024-09-12T00:39:40.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.750+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.Isbtbyk0flg-OILkF6X_LELxqyWJEDY_0 2024-09-12T00:39:40.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.750+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4295346696786039990', time=2024-09-12T02:35:41.925771+0000, chain.objs.size()=1 2024-09-12T00:39:40.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.750+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.EmN4pcnFABQbWhTaD819G9zmxg_IN_f_0 2024-09-12T00:39:40.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.751+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18035819836233089687', time=2024-09-12T02:36:15.930120+0000, chain.objs.size()=1 2024-09-12T00:39:40.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.751+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.mjs8Y4fyAfxAgMFS60olV6iwKi-daAN_0 2024-09-12T00:39:40.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.751+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18292795920961103837', time=2024-09-12T02:36:19.170163+0000, chain.objs.size()=1 2024-09-12T00:39:40.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.751+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.a48j9C87-wfBVQX4wpbkUpEWqsnJmU6_0 2024-09-12T00:39:40.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.752+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8795439559281869758', time=2024-09-12T02:36:19.190472+0000, chain.objs.size()=1 2024-09-12T00:39:40.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.752+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.S8KWfkVTAmcZvk6TWFAjIfEseB4sKFP_0 2024-09-12T00:39:40.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.752+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2714044315974657392', time=2024-09-12T02:36:19.196640+0000, chain.objs.size()=1 2024-09-12T00:39:40.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.752+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.SdD_tTs4PBROGk16KYlQpX52XEO_SFl_0 2024-09-12T00:39:40.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.752+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.255316294512809138', time=2024-09-12T02:36:54.614744+0000, chain.objs.size()=1 2024-09-12T00:39:40.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.752+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.P0yKaObbIFKrZxpag-ZjLxRqASrj08v_0 2024-09-12T00:39:40.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.756+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10680231405008308216', time=2024-09-12T02:39:05.461895+0000, chain.objs.size()=1 2024-09-12T00:39:40.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.756+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18__shadow_._5aVHQDbSPJm6ZY7pZTB-U6fYY6-trD_0 2024-09-12T00:39:40.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.759+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.763+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:39:40.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.764+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:39:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10243045416702750617', time=2024-09-12T02:30:41.121738+0000, chain.objs.size()=1 2024-09-12T00:39:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.wwL-Lkr4gMF9ksWRfrPzLvhDTL0nSeZ_0 2024-09-12T00:39:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8064800264743934664', time=2024-09-12T02:30:41.223099+0000, chain.objs.size()=2 2024-09-12T00:39:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.dS5rykLtH5IZ-oIsBBylGKPaZ7phD0F_0 2024-09-12T00:39:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.dS5rykLtH5IZ-oIsBBylGKPaZ7phD0F_1 2024-09-12T00:39:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16761251531526375548', time=2024-09-12T02:31:48.523657+0000, chain.objs.size()=1 2024-09-12T00:39:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.SUbzRgFdyZx5OS6g_aEtD8HK8Y0GTs4_0 2024-09-12T00:39:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8392239142194894670', time=2024-09-12T02:31:51.906993+0000, chain.objs.size()=1 2024-09-12T00:39:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.nK8uO6DFhIAQW_oWFAo8NMAVhbWFh1H_0 2024-09-12T00:39:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7356135588570234047', time=2024-09-12T02:32:26.548819+0000, chain.objs.size()=1 2024-09-12T00:39:40.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.q1-Sqs5w39QzpNpk1PRCJORogPnZBwq_0 2024-09-12T00:39:40.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3655893155581172867', time=2024-09-12T02:32:28.624743+0000, chain.objs.size()=1 2024-09-12T00:39:40.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.0f5525FQx4VliiMJ9owjuZbj8Fx5wrX_0 2024-09-12T00:39:40.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294740238828930835', time=2024-09-12T02:32:31.780101+0000, chain.objs.size()=1 2024-09-12T00:39:40.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.yw70Qmb8gl0zM7E4J_-08BYvbkGYd-f_0 2024-09-12T00:39:40.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11659074629325795755', time=2024-09-12T02:32:31.780694+0000, chain.objs.size()=1 2024-09-12T00:39:40.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.KgEyKQnTHOwC4-RWF2Nd_fNfIk2OZxF_0 2024-09-12T00:39:40.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8004635376648897430', time=2024-09-12T02:33:05.424834+0000, chain.objs.size()=1 2024-09-12T00:39:40.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.lg3ft_OXTTwxd_7SrxrsnikBVAX1aJe_0 2024-09-12T00:39:40.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11320156322562625645', time=2024-09-12T02:33:05.426025+0000, chain.objs.size()=1 2024-09-12T00:39:40.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.YWaR3ewa9AaFRNBv5wkAjxjhP78sGbu_0 2024-09-12T00:39:40.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35366001689875371', time=2024-09-12T02:33:05.427082+0000, chain.objs.size()=1 2024-09-12T00:39:40.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.765+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.MdRg97g_FE1qlQ1u2o6RUxpL_0LcDuO_0 2024-09-12T00:39:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.768+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2474854725507153727', time=2024-09-12T02:35:04.689421+0000, chain.objs.size()=1 2024-09-12T00:39:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.768+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.SJKpWmHjolEexavC8zCDEnfQ37whH01_0 2024-09-12T00:39:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.768+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.360406859874855761', time=2024-09-12T02:35:04.713735+0000, chain.objs.size()=1 2024-09-12T00:39:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.768+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.9Zg2-C4tUr26TqJ_leNnwHlvW1QnRA4_0 2024-09-12T00:39:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.768+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1516538283338389041', time=2024-09-12T02:35:38.677925+0000, chain.objs.size()=1 2024-09-12T00:39:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.768+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.XdagL91bDF9Gynv6mvth6RAMSAJ9CdF_0 2024-09-12T00:39:40.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.768+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10315602282215043928', time=2024-09-12T02:35:38.680267+0000, chain.objs.size()=1 2024-09-12T00:39:40.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.768+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.hX-L0RZmAFfhoHT-H_IU8HSHQcyxQ64_0 2024-09-12T00:39:40.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.770+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17883142086769939612', time=2024-09-12T02:35:40.818555+0000, chain.objs.size()=1 2024-09-12T00:39:40.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.770+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.YVBp-R4Fs5HSdBrePWeK5FsXm1ySYb7_0 2024-09-12T00:39:40.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.770+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6078565707447673771', time=2024-09-12T02:36:21.251533+0000, chain.objs.size()=1 2024-09-12T00:39:40.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.770+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.tfSc8dt2s5mHlnXNfpHE5nAYXN2g757_0 2024-09-12T00:39:40.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.770+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11096615486292073708', time=2024-09-12T02:36:21.288139+0000, chain.objs.size()=1 2024-09-12T00:39:40.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.770+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.WC3RB0VzZV0Imbuy_2rR2qafprbKttX_0 2024-09-12T00:39:40.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.770+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17187077994060032651', time=2024-09-12T02:36:54.671625+0000, chain.objs.size()=1 2024-09-12T00:39:40.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.770+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.TvNQtsD51Coxa9IIZTjiJeA5eEGbRE2_0 2024-09-12T00:39:40.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.775+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.782+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:39:40.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.783+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.783+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:39:40.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6769206184683188174', time=2024-09-12T02:32:26.498465+0000, chain.objs.size()=1 2024-09-12T00:39:40.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.h9UdxusLW56K4tGa0jetlhmOjYt8eDh_0 2024-09-12T00:39:40.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2533185321795159269', time=2024-09-12T02:33:08.840383+0000, chain.objs.size()=1 2024-09-12T00:39:40.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.6iECAQH7evrPpb0R77f0Uyliq54chJf_0 2024-09-12T00:39:40.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14971459904600391607', time=2024-09-12T02:33:08.895053+0000, chain.objs.size()=1 2024-09-12T00:39:40.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.mbFacYT154c3Jy_4qksOssXDtpVFmBE_0 2024-09-12T00:39:40.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2715666494866945368', time=2024-09-12T02:33:11.308846+0000, chain.objs.size()=1 2024-09-12T00:39:40.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.ybwuQ_BSuC1C87j2rVb-TSTiYeyBUkA_0 2024-09-12T00:39:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17166513295643294824', time=2024-09-12T02:33:45.249647+0000, chain.objs.size()=1 2024-09-12T00:39:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.Y29-_lyz964pyzUaU1Og3AfEV7gGCe8_0 2024-09-12T00:39:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18152311052000711756', time=2024-09-12T02:35:41.926661+0000, chain.objs.size()=1 2024-09-12T00:39:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.CjsFTagmmY_JvHDp0gEtdVQ6gah7XKZ_0 2024-09-12T00:39:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17618654051899379059', time=2024-09-12T02:36:19.149048+0000, chain.objs.size()=1 2024-09-12T00:39:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.gR5TK-5X5lYKErTSSHKH3Lza5BoXnOf_0 2024-09-12T00:39:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5853055905321681606', time=2024-09-12T02:36:21.293708+0000, chain.objs.size()=1 2024-09-12T00:39:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39__shadow_.lqKd-QdUiUYPxC39gHuu3d16oX_7rkz_0 2024-09-12T00:39:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.681045000678345228', time=2024-09-12T02:39:14.469996+0000, chain.objs.size()=1 2024-09-12T00:39:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.784+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.19__shadow:TmeQRvNDqwktfJ32cZ0XBKRghuSrwZx_.QV8ok6QElvIUhae6VJsDM7LOOed2oIC_0 2024-09-12T00:39:40.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.788+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.790+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:39:40.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.791+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:39:40.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16835165361772494982', time=2024-09-12T02:30:41.246577+0000, chain.objs.size()=2 2024-09-12T00:39:40.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.35Rw128e5WnR61U7Kzb6vD6w3UsGQsr_0 2024-09-12T00:39:40.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.35Rw128e5WnR61U7Kzb6vD6w3UsGQsr_1 2024-09-12T00:39:40.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14869163355440390959', time=2024-09-12T02:31:48.523673+0000, chain.objs.size()=1 2024-09-12T00:39:40.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.20__shadow_.BZbZwzTIrhTMaLwBuzRQ9mN8P_60cFK_0 2024-09-12T00:39:40.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9068944454630044525', time=2024-09-12T02:31:51.897631+0000, chain.objs.size()=1 2024-09-12T00:39:40.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.5p2fMzPjI5Ksy0B4a0l0EDpi_LdPFJi_0 2024-09-12T00:39:40.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7244043082948257603', time=2024-09-12T02:32:29.540738+0000, chain.objs.size()=1 2024-09-12T00:39:40.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.23__shadow_.XQeb0P3SS57hyVmXwVpvkh_U_JfVPO5_0 2024-09-12T00:39:40.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18204175502949326424', time=2024-09-12T02:32:31.810022+0000, chain.objs.size()=1 2024-09-12T00:39:40.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24__shadow_.7Pea6TSPM9FGvytmOqNj9mxqYucJInM_0 2024-09-12T00:39:40.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17925768680116839095', time=2024-09-12T02:33:45.251574+0000, chain.objs.size()=1 2024-09-12T00:39:40.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.mbT3IVbOR47qIEtsKiIFyPgLcpV8uac_0 2024-09-12T00:39:40.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14344097821746888194', time=2024-09-12T02:34:22.503529+0000, chain.objs.size()=1 2024-09-12T00:39:40.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.OUDl2WRm7lpSGK5Lpmke0iv7Hlm2qnP_0 2024-09-12T00:39:40.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10273842282611013477', time=2024-09-12T02:35:04.716662+0000, chain.objs.size()=1 2024-09-12T00:39:40.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.sUWt07S3GLOk5klSPwgQzGrL_2MHMtk_0 2024-09-12T00:39:40.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.865197536845294362', time=2024-09-12T02:35:41.912168+0000, chain.objs.size()=1 2024-09-12T00:39:40.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.ZDsXcCPQcX1lg9hD88Jjyfs3Mgdgbs-_0 2024-09-12T00:39:40.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9328928863220344945', time=2024-09-12T02:36:15.912184+0000, chain.objs.size()=1 2024-09-12T00:39:40.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.hGX0taxxI7PS6X4bRQ4xUSsPQojwlGV_0 2024-09-12T00:39:40.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12190857110641611164', time=2024-09-12T02:36:19.135587+0000, chain.objs.size()=1 2024-09-12T00:39:40.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.792+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.oyjPxlMFviNU1S9rJRB4hAE-xt-MLcK_0 2024-09-12T00:39:40.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.795+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13005340558843518857', time=2024-09-12T02:36:19.206377+0000, chain.objs.size()=1 2024-09-12T00:39:40.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.796+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.lofVyCEe2Ej9mLApumuyyDOVxJ_43sa_0 2024-09-12T00:39:40.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.796+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16363231205509923271', time=2024-09-12T02:39:05.486298+0000, chain.objs.size()=1 2024-09-12T00:39:40.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.796+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18__shadow_.xjJH4X1CprwDMJFBpc0Eq_U2qEjglg-_0 2024-09-12T00:39:40.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.798+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.800+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:39:40.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.801+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:39:40.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12666281498458140962', time=2024-09-12T02:30:41.390067+0000, chain.objs.size()=1 2024-09-12T00:39:40.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14__shadow_.PY7YhWkdkMpBMb-TSpSMRik9zXZMGny_0 2024-09-12T00:39:40.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14363711518915451824', time=2024-09-12T02:31:51.812374+0000, chain.objs.size()=1 2024-09-12T00:39:40.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.JP1h5d2gnstr--Tse0ZQiYOC6emTW6b_0 2024-09-12T00:39:40.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12718714444316709214', time=2024-09-12T02:32:26.553668+0000, chain.objs.size()=1 2024-09-12T00:39:40.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.ZxtzGZR-kLlHg3Sj0RDxFq0VYI-oZb8_0 2024-09-12T00:39:40.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8804907394854613972', time=2024-09-12T02:33:08.847967+0000, chain.objs.size()=1 2024-09-12T00:39:40.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.g3JbuS4lT0-r8dhbHTS1JELWix6MVVe_0 2024-09-12T00:39:40.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10462298845628635466', time=2024-09-12T02:33:08.879814+0000, chain.objs.size()=1 2024-09-12T00:39:40.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.hyP_oQZ-PtWISSDk5fBnwAkJQQztsp9_0 2024-09-12T00:39:40.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1740424757659367681', time=2024-09-12T02:33:11.355389+0000, chain.objs.size()=1 2024-09-12T00:39:40.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27__shadow_.FzHxMn_MRF2i35v0K_VbgmFAeYvGuXq_0 2024-09-12T00:39:40.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.620195304753802218', time=2024-09-12T02:34:27.662605+0000, chain.objs.size()=1 2024-09-12T00:39:40.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.DB9heyt2k7WpWMP_kfL0k0YHOh_S9TP_0 2024-09-12T00:39:40.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10677305068418333387', time=2024-09-12T02:35:04.691001+0000, chain.objs.size()=1 2024-09-12T00:39:40.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.mx8SSd9HQ7WZNr26OvOjBrXPegtFrZy_0 2024-09-12T00:39:40.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7361733873141505425', time=2024-09-12T02:35:38.679066+0000, chain.objs.size()=1 2024-09-12T00:39:40.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.FIX421MdaQlo_27IEHyO8nMUK_ncVYc_0 2024-09-12T00:39:40.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14294994946858476483', time=2024-09-12T02:35:41.926162+0000, chain.objs.size()=1 2024-09-12T00:39:40.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.36__shadow_.G7wAiE_F5ccm9sOuiscRRt1e8JMj890_0 2024-09-12T00:39:40.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9166571955549840031', time=2024-09-12T02:36:15.884326+0000, chain.objs.size()=1 2024-09-12T00:39:40.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.2EO8ma1YdCugQ6kJqYr5ZggrMuALJbo_0 2024-09-12T00:39:40.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2677340979852596771', time=2024-09-12T02:36:19.170052+0000, chain.objs.size()=1 2024-09-12T00:39:40.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.802+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.7SXp7J3QbVtfZneClVoOVXLOK5FaPo-_0 2024-09-12T00:39:40.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.807+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.809+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:39:40.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.811+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.811+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T00:39:40.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1530065523985204880', time=2024-09-12T02:30:41.101681+0000, chain.objs.size()=1 2024-09-12T00:39:40.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5__shadow_.IfWOauh44qTXSXFgVz2FKYmakCpeRuj_0 2024-09-12T00:39:40.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8371394538569112823', time=2024-09-12T02:30:41.357831+0000, chain.objs.size()=5 2024-09-12T00:39:40.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-LUKEWARM.2~WHuuw37x1jDBWj97OEF_2lYzVkuh5PK.1 2024-09-12T00:39:40.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__shadow_foo-LUKEWARM.2~WHuuw37x1jDBWj97OEF_2lYzVkuh5PK.1_1 2024-09-12T00:39:40.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-LUKEWARM.2~WHuuw37x1jDBWj97OEF_2lYzVkuh5PK.2 2024-09-12T00:39:40.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__shadow_foo-LUKEWARM.2~WHuuw37x1jDBWj97OEF_2lYzVkuh5PK.2_1 2024-09-12T00:39:40.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-LUKEWARM.2~WHuuw37x1jDBWj97OEF_2lYzVkuh5PK.3 2024-09-12T00:39:40.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16144857130774582374', time=2024-09-12T02:30:41.379526+0000, chain.objs.size()=3 2024-09-12T00:39:40.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14__shadow_.jgXk_uPqgVDqM0Everzyrpo-4Es8WLp_0 2024-09-12T00:39:40.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14__shadow_.jgXk_uPqgVDqM0Everzyrpo-4Es8WLp_1 2024-09-12T00:39:40.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14__shadow_.jgXk_uPqgVDqM0Everzyrpo-4Es8WLp_2 2024-09-12T00:39:40.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.860311045594221158', time=2024-09-12T02:33:05.375655+0000, chain.objs.size()=1 2024-09-12T00:39:40.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.qXHSdoSClixsLTr1b9c_s1lbT9RLHBJ_0 2024-09-12T00:39:40.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4950850926962677746', time=2024-09-12T02:34:27.682279+0000, chain.objs.size()=1 2024-09-12T00:39:40.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.re-vxWNMBTzm58ced7VEdAFlrPzCBQK_0 2024-09-12T00:39:40.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17120011387403689847', time=2024-09-12T02:35:01.221492+0000, chain.objs.size()=1 2024-09-12T00:39:40.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.812+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.poAIOUVSNNeuaUJhXw4H60AjhYjx7lx_0 2024-09-12T00:39:40.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.814+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2684516526196664371', time=2024-09-12T02:35:01.232974+0000, chain.objs.size()=1 2024-09-12T00:39:40.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.814+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.VmR4Fu-t_KT4w9ELWjaY2u_kpHJzFzQ_0 2024-09-12T00:39:40.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.816+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6148890847539082780', time=2024-09-12T02:35:04.720297+0000, chain.objs.size()=1 2024-09-12T00:39:40.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.816+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.D5mYt0qYTSt1Lh0wpBwjXG-VRIB32TQ_0 2024-09-12T00:39:40.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.816+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9112515671148739183', time=2024-09-12T02:36:15.904633+0000, chain.objs.size()=1 2024-09-12T00:39:40.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.816+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.02vCAOxS96yj-TvX7VjfCNPWrXt3qT8_0 2024-09-12T00:39:40.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.816+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17890114402261137104', time=2024-09-12T02:36:54.601185+0000, chain.objs.size()=1 2024-09-12T00:39:40.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.816+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.d8yjfv3_R3fDBSvWqjXleNKJIrxDdrQ_0 2024-09-12T00:39:40.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.816+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17180879590487136811', time=2024-09-12T02:36:54.638659+0000, chain.objs.size()=1 2024-09-12T00:39:40.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.816+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.40__shadow_.etuVdrzRSzvy4Puy-_xnVNfwJrYAAjW_0 2024-09-12T00:39:40.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.820+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.825+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:39:40.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.827+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.827+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.827+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:39:40.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.827+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15561279657264820935', time=2024-09-12T02:30:41.289787+0000, chain.objs.size()=5 2024-09-12T00:39:40.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.827+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.1 2024-09-12T00:39:40.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.827+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.1_1 2024-09-12T00:39:40.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.2 2024-09-12T00:39:40.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.2_1 2024-09-12T00:39:40.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-FROZEN.2~gmyZf5w2izMWQgFo9rrEn7ULPETH33x.3 2024-09-12T00:39:40.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10656722004577721504', time=2024-09-12T02:31:51.839054+0000, chain.objs.size()=1 2024-09-12T00:39:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.21__shadow_.l9Kbvud13U6gm_Au0esVoOhICyYbXD4_0 2024-09-12T00:39:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14461080697005755960', time=2024-09-12T02:32:26.506393+0000, chain.objs.size()=1 2024-09-12T00:39:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.N8qSjpiLJGNm2BSm43i9YfYfFq27BbN_0 2024-09-12T00:39:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8165969885123650449', time=2024-09-12T02:33:08.849330+0000, chain.objs.size()=1 2024-09-12T00:39:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.QJC4dMMJngsYnJKXiKnuXI5TLbrt9Ht_0 2024-09-12T00:39:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1669829298800936844', time=2024-09-12T02:33:45.202325+0000, chain.objs.size()=1 2024-09-12T00:39:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.Ne3yamCRUMVaMa6PjyTrhS4eQ21kOaw_0 2024-09-12T00:39:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8047337284984184076', time=2024-09-12T02:33:45.215479+0000, chain.objs.size()=1 2024-09-12T00:39:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.RspJUEKjvcsiGhsMfnAhG8i_4r-I_wC_0 2024-09-12T00:39:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14298990435876531857', time=2024-09-12T02:35:04.692532+0000, chain.objs.size()=1 2024-09-12T00:39:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.4Moe_88Xsevu57aenruSOo11PZQYNW2_0 2024-09-12T00:39:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12776160968355658757', time=2024-09-12T02:35:38.652215+0000, chain.objs.size()=1 2024-09-12T00:39:40.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.828+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.35__shadow_.vp6NfYJEOKEna1eU7--DWIpHPLnTkEq_0 2024-09-12T00:39:40.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.830+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8887686502111355356', time=2024-09-12T02:36:15.930120+0000, chain.objs.size()=1 2024-09-12T00:39:40.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.830+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.COZf7nKiS7FjAoyS1ssTQerrWKJbWfP_0 2024-09-12T00:39:40.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.831+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1029985213163670335', time=2024-09-12T02:36:19.170052+0000, chain.objs.size()=1 2024-09-12T00:39:40.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.831+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.AZ6efSc-wJHDzH7Np74aKx-iwLIoU6i_0 2024-09-12T00:39:40.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.831+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3400103906306080468', time=2024-09-12T02:36:19.170942+0000, chain.objs.size()=1 2024-09-12T00:39:40.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.831+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.38__shadow_.Niqthfu-zkRHio3Hqsim_ucR8ShE--F_0 2024-09-12T00:39:40.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.831+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7421453672440137526', time=2024-09-12T02:39:05.492290+0000, chain.objs.size()=1 2024-09-12T00:39:40.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.831+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18__shadow_.q6MJSuaQpvYbhVl8UcEZiUmTzqLjSLd_0 2024-09-12T00:39:40.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.835+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.837 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.838+0000 7f82b652a800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:39:40.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.839+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:40.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.840+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:40.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.840+0000 7f82b652a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:39:40.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.840+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='_b88QZv_CINSPaVMAReynZV0UYdKtOC5', time=2024-09-12T02:30:41.262846+0000, chain.objs.size()=1 2024-09-12T00:39:40.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.840+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16__shadow_.3GzaNe6HxEkKyP9bTSoIZR-gNr0byr__0 2024-09-12T00:39:40.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.840+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11877829241141441864', time=2024-09-12T02:30:41.325856+0000, chain.objs.size()=5 2024-09-12T00:39:40.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.840+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.1 2024-09-12T00:39:40.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.840+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.1_1 2024-09-12T00:39:40.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.840+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.2 2024-09-12T00:39:40.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.840+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__shadow_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.2_1 2024-09-12T00:39:40.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.840+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17__multipart_foo-STANDARD.2~0MZJDD4wGk2l0kgtts8b2gl-x6Vdf9_.3 2024-09-12T00:39:40.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.840+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.441489104616038382', time=2024-09-12T02:30:41.363294+0000, chain.objs.size()=3 2024-09-12T00:39:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.840+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-STANDARD.2~LOmRhTtdxsIYc9SzrAxJ7iJfK6zPXzd.1 2024-09-12T00:39:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.840+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-STANDARD.2~LOmRhTtdxsIYc9SzrAxJ7iJfK6zPXzd.2 2024-09-12T00:39:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.840+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15__multipart_foo-STANDARD.2~LOmRhTtdxsIYc9SzrAxJ7iJfK6zPXzd.3 2024-09-12T00:39:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.841+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15462176321018590785', time=2024-09-12T02:30:41.442164+0000, chain.objs.size()=1 2024-09-12T00:39:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.841+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8__shadow_.92-4EwbAbJKkNUOASYm48jJaLp8F37b_0 2024-09-12T00:39:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.841+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11493206732361987669', time=2024-09-12T02:32:26.495132+0000, chain.objs.size()=1 2024-09-12T00:39:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.841+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.22__shadow_.268_hQgVCORHQSIqcAYSBtM2WS8vt2u_0 2024-09-12T00:39:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.841+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6249931171211507535', time=2024-09-12T02:33:05.379528+0000, chain.objs.size()=1 2024-09-12T00:39:40.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.841+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.25__shadow_.-jdYJ5Ju8fT2EKeumYXsEAVI7D_pZUJ_0 2024-09-12T00:39:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.842+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101715186427332688', time=2024-09-12T02:33:08.891915+0000, chain.objs.size()=1 2024-09-12T00:39:40.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.842+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.26__shadow_.b9mExRoYBFWC6RVHTtNfJZ398YWgZ82_0 2024-09-12T00:39:40.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.844+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13213041569211797038', time=2024-09-12T02:33:45.293781+0000, chain.objs.size()=1 2024-09-12T00:39:40.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.844+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.28__shadow_.4GrSRBclgnFS7v00ujGpdL0rcuNLAeH_0 2024-09-12T00:39:40.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.844+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7332133330343165670', time=2024-09-12T02:34:22.491838+0000, chain.objs.size()=1 2024-09-12T00:39:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.844+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.1SyUyMR6Ma8evWXGmJtrSm3ypHE_Cd8_0 2024-09-12T00:39:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.845+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3978189100161965127', time=2024-09-12T02:34:22.496681+0000, chain.objs.size()=1 2024-09-12T00:39:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.845+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.ICbBkYya5cICgzhBQj_BIL3FKgTlLRK_0 2024-09-12T00:39:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.845+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14553931441800142915', time=2024-09-12T02:34:22.550035+0000, chain.objs.size()=1 2024-09-12T00:39:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.845+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.30__shadow_.J9uX-CFQahs6ZARQ2PG0jVhKA3oTwTY_0 2024-09-12T00:39:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.845+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4500594078364091314', time=2024-09-12T02:34:25.318197+0000, chain.objs.size()=1 2024-09-12T00:39:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.845+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.31__shadow_.pLSdQTse1gGwQZn7onFYHILj0uRFjR1_0 2024-09-12T00:39:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.845+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17075159221224703907', time=2024-09-12T02:34:27.637117+0000, chain.objs.size()=1 2024-09-12T00:39:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.845+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.32__shadow_.a43p8J_LAsAPdCQKelsxoXeeeeh9uMj_0 2024-09-12T00:39:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.845+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10184355893631515208', time=2024-09-12T02:35:01.237037+0000, chain.objs.size()=1 2024-09-12T00:39:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.845+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.33__shadow_.17V0OFSUdzaEQTD6BL5YXL2i-FxdjaZ_0 2024-09-12T00:39:40.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.845+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3235833549961846283', time=2024-09-12T02:35:04.699298+0000, chain.objs.size()=1 2024-09-12T00:39:40.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.845+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.34__shadow_.xUKcML-SxIi5tjMA6g9fGGSMZTF2_gi_0 2024-09-12T00:39:40.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.845+0000 7f82b652a800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18058506166312505124', time=2024-09-12T02:36:15.868726+0000, chain.objs.size()=1 2024-09-12T00:39:40.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.845+0000 7f82b652a800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.37__shadow_.2Y1-CjSHVNUzuDb2qJTI9bXiTRV214__0 2024-09-12T00:39:40.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.849+0000 7f82b652a800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:40.851 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.852+0000 7f8168fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:40.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.854+0000 7f82b652a800 20 remove_watcher() i=0 2024-09-12T00:39:40.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.854+0000 7f82b652a800 2 removed watcher, disabling cache 2024-09-12T00:39:40.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.855+0000 7f82b652a800 20 remove_watcher() i=1 2024-09-12T00:39:40.854 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.856+0000 7f82b652a800 20 remove_watcher() i=2 2024-09-12T00:39:40.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.857+0000 7f82b652a800 20 remove_watcher() i=3 2024-09-12T00:39:40.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.858+0000 7f82b652a800 20 remove_watcher() i=4 2024-09-12T00:39:40.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.859+0000 7f82b652a800 20 remove_watcher() i=5 2024-09-12T00:39:40.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.860+0000 7f82b652a800 20 remove_watcher() i=6 2024-09-12T00:39:40.859 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:40.861+0000 7f82b652a800 20 remove_watcher() i=7 2024-09-12T00:39:40.871 DEBUG:teuthology.orchestra.run.smithi133:> radosgw-admin gc process --include-all 2024-09-12T00:39:40.965 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:40.965 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:41.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.004+0000 7f8782120800 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.005+0000 7f8782120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.005+0000 7f8782120800 20 realm 2024-09-12T00:39:41.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.005+0000 7f8782120800 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.006+0000 7f8782120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.006+0000 7f8782120800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:41.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.006+0000 7f8782120800 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.006+0000 7f8782120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.006+0000 7f8782120800 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.007+0000 7f8782120800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:41.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.007+0000 7f8782120800 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.007+0000 7f8782120800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:41.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.007+0000 7f8782120800 20 searching for the correct realm 2024-09-12T00:39:41.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.009+0000 7f8777fff640 0 -- 172.21.15.133:0/905786524 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f87680671d0 msgr2=0x7f8768028950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:41.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.214+0000 7f8777fff640 0 -- 172.21.15.133:0/905786524 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f8770075070 msgr2=0x7f87700a4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:41.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.420+0000 7f8782120800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:39:41.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.420+0000 7f8782120800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:39:41.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.420+0000 7f8782120800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:41.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.420+0000 7f8782120800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:41.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.420+0000 7f8782120800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:41.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.420+0000 7f8782120800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:41.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.420+0000 7f8782120800 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.420+0000 7f8782120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.420+0000 7f8782120800 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.421+0000 7f8782120800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:41.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.421+0000 7f8782120800 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.421+0000 7f8782120800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:41.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.421+0000 7f8782120800 20 zone default found 2024-09-12T00:39:41.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.421+0000 7f8782120800 4 Realm: () 2024-09-12T00:39:41.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.421+0000 7f8782120800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:39:41.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.421+0000 7f8782120800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:39:41.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.421+0000 7f8782120800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:41.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.421+0000 7f8782120800 20 zonegroup default 2024-09-12T00:39:41.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.421+0000 7f8782120800 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.421+0000 7f8782120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.421+0000 7f8782120800 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.422+0000 7f8782120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.422+0000 7f8782120800 20 rados->read ofs=0 len=0 2024-09-12T00:39:41.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.422+0000 7f8782120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:41.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.422+0000 7f8782120800 20 started sync module instance, tier type = 2024-09-12T00:39:41.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.422+0000 7f8782120800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:39:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.430+0000 7f8782120800 20 add_watcher() i=0 2024-09-12T00:39:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.430+0000 7f8782120800 20 add_watcher() i=1 2024-09-12T00:39:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.430+0000 7f8782120800 20 add_watcher() i=2 2024-09-12T00:39:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.430+0000 7f8782120800 20 add_watcher() i=3 2024-09-12T00:39:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.430+0000 7f8782120800 20 add_watcher() i=4 2024-09-12T00:39:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.430+0000 7f8782120800 20 add_watcher() i=5 2024-09-12T00:39:41.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.430+0000 7f8782120800 20 add_watcher() i=6 2024-09-12T00:39:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.431+0000 7f8782120800 20 add_watcher() i=7 2024-09-12T00:39:41.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.431+0000 7f8782120800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:41.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.433+0000 7f862f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:41.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.433+0000 7f8782120800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:41.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.433+0000 7f8782120800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:41.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.468+0000 7f862e7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:41.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.468+0000 7f8782120800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:41.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.468+0000 7f8782120800 20 Filter name: none 2024-09-12T00:39:41.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.468+0000 7f85a3fff640 20 reqs_thread_entry: start 2024-09-12T00:39:41.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.468+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:39:41.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.469+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.470+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.471+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.472+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:39:41.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.473+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.473+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.474+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.474+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:39:41.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.476+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.476+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.476+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.477+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:39:41.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.479+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.479+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.479+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.480+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:39:41.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.482+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.482+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.482+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.483+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:39:41.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.485+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.485+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.485+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.486+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:39:41.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.487+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.488+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.488+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.489+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:39:41.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.491+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.491+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.492+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.493+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:39:41.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.494+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.494+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.495+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.496+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:39:41.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.497+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.497+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.497+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.498+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:39:41.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.499+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.500+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.500+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.501+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:39:41.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.502+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.503+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.503+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.504+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:39:41.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.505+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.506+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.506+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.507+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:39:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.508+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.509+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.509+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.510+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:39:41.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.511+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.512+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.512+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.513+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:39:41.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.514+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.515+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.515+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.516+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:39:41.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.517+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.518+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.518+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.519+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:39:41.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.520+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.521+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.521+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.522+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:39:41.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.523+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.524+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.524+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.525+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:39:41.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.527+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.527+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.527+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.528+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:39:41.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.530+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.530+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.530+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.531+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:39:41.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.532+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.533+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.533+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.534+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:39:41.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.535+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.536+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.536+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.537+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:39:41.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.538+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.539+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.539+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.540+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:39:41.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.541+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.542+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.542+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.543+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:39:41.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.544+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.543 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.545+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.545+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.546+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:39:41.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.548+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.548+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.548+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.549+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:39:41.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.551+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.551+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.551+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.552+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:39:41.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.553+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.554+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.554+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.555+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:39:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.557+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.558+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.558+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.559+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:39:41.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.560+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.560+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.561+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.562+0000 7f8782120800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:39:41.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.563+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.563+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:41.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.564+0000 7f8782120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:41.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.566+0000 7f862f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:41.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.568+0000 7f8782120800 20 remove_watcher() i=0 2024-09-12T00:39:41.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.568+0000 7f8782120800 2 removed watcher, disabling cache 2024-09-12T00:39:41.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.569+0000 7f8782120800 20 remove_watcher() i=1 2024-09-12T00:39:41.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.570+0000 7f8782120800 20 remove_watcher() i=2 2024-09-12T00:39:41.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.571+0000 7f8782120800 20 remove_watcher() i=3 2024-09-12T00:39:41.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.572+0000 7f8782120800 20 remove_watcher() i=4 2024-09-12T00:39:41.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.574+0000 7f8782120800 20 remove_watcher() i=5 2024-09-12T00:39:41.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.575+0000 7f8782120800 20 remove_watcher() i=6 2024-09-12T00:39:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:39:41.576+0000 7f8782120800 20 remove_watcher() i=7 2024-09-12T00:39:41.585 DEBUG:teuthology.orchestra.run.smithi133:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T00:39:42.080 INFO:teuthology.orchestra.run.smithi133.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T00:39:45.580 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :clean UP-TO-DATE 2024-09-12T00:40:03.580 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :compileJava 2024-09-12T00:40:03.580 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :processResources 2024-09-12T00:40:03.580 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :classes 2024-09-12T00:40:04.379 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:04.379 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :compileTestJava 2024-09-12T00:40:04.379 INFO:teuthology.orchestra.run.smithi133.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:40:04.379 INFO:teuthology.orchestra.run.smithi133.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:40:04.380 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:04.380 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:40:04.380 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :testClasses 2024-09-12T00:40:10.179 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:10.179 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :test 2024-09-12T00:40:10.179 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:10.179 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T00:40:14.379 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:14.379 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T00:40:14.678 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:14.679 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T00:40:14.779 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:14.779 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T00:40:15.079 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:15.079 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T00:40:19.878 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:19.879 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T00:40:20.279 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:20.279 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:40:20.279 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:20.279 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:40:20.479 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:20.479 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T00:40:20.479 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:20.479 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T00:40:20.778 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:20.778 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T00:40:24.579 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:24.579 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T00:40:25.178 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:25.179 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:40:25.379 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:25.379 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T00:40:25.379 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12 00:40:25,361 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:40:51.779 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:51.780 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:40:52.278 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:52.278 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T00:40:52.378 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:52.379 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T00:40:52.678 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:52.679 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T00:40:52.779 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:52.779 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T00:40:53.278 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:53.279 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T00:40:57.579 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:57.579 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T00:40:57.879 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:57.879 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:40:57.979 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:57.979 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:40:58.078 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:40:58.079 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T00:41:12.379 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:41:12.379 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T00:41:12.778 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:41:12.779 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:41:20.579 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:41:20.579 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:41:21.078 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:41:21.079 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T00:41:22.979 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:41:22.979 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T00:41:23.378 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:41:23.379 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:43:11.679 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:11.680 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:43:12.078 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:12.079 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T00:43:17.079 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:17.079 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T00:43:17.378 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:17.379 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T00:43:29.679 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:29.679 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T00:43:29.978 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:29.979 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T00:43:31.378 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:31.379 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T00:43:35.979 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:35.979 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T00:43:36.079 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:36.079 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T00:43:36.479 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:36.479 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T00:43:36.479 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:36.479 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T00:43:36.879 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:36.879 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T00:43:36.979 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:36.979 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T00:43:37.279 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:37.360 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T00:43:37.378 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:37.379 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T00:43:37.779 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:37.780 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T00:43:37.780 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:37.780 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T00:43:38.178 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:38.179 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T00:43:38.278 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:38.279 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T00:43:38.578 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:38.579 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T00:43:38.679 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:38.679 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T00:43:38.978 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:38.978 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T00:43:48.279 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:48.279 INFO:teuthology.orchestra.run.smithi133.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T00:43:48.679 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:48.680 INFO:teuthology.orchestra.run.smithi133.stdout:---------------------------------------------------------------------- 2024-09-12T00:43:48.680 INFO:teuthology.orchestra.run.smithi133.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T00:43:48.680 INFO:teuthology.orchestra.run.smithi133.stdout:---------------------------------------------------------------------- 2024-09-12T00:43:48.680 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:48.680 INFO:teuthology.orchestra.run.smithi133.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:43:48.680 INFO:teuthology.orchestra.run.smithi133.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:43:48.680 INFO:teuthology.orchestra.run.smithi133.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:43:48.680 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:48.680 INFO:teuthology.orchestra.run.smithi133.stdout:BUILD SUCCESSFUL in 4m 7s 2024-09-12T00:43:48.681 INFO:teuthology.orchestra.run.smithi133.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T00:43:49.012 DEBUG:teuthology.orchestra.run.smithi133:> radosgw-admin gc process --include-all 2024-09-12T00:43:49.065 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:49.065 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:49.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.103+0000 7f82a04bb800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.105+0000 7f82a04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.105+0000 7f82a04bb800 20 realm 2024-09-12T00:43:49.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.105+0000 7f82a04bb800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.105+0000 7f82a04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.105+0000 7f82a04bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:49.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.105+0000 7f82a04bb800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.105+0000 7f82a04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.105+0000 7f82a04bb800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.106+0000 7f82a04bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.106+0000 7f82a04bb800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.107+0000 7f82a04bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:49.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.107+0000 7f82a04bb800 20 searching for the correct realm 2024-09-12T00:43:49.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.109+0000 7f82957a4640 0 -- 172.21.15.133:0/2288214539 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f8288036060 msgr2=0x7f8288066ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:49.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.314+0000 7f82957a4640 0 -- 172.21.15.133:0/2288214539 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f82900d1070 msgr2=0x7f8290055a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:49.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.521+0000 7f82a04bb800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:43:49.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.521+0000 7f82a04bb800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:43:49.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.521+0000 7f82a04bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:49.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.521+0000 7f82a04bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:49.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.521+0000 7f82a04bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:49.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.521+0000 7f82a04bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:49.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.521+0000 7f82a04bb800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.521+0000 7f82a04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.521+0000 7f82a04bb800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.522+0000 7f82a04bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.522+0000 7f82a04bb800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.522+0000 7f82a04bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:49.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.522+0000 7f82a04bb800 20 zone default found 2024-09-12T00:43:49.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.522+0000 7f82a04bb800 4 Realm: () 2024-09-12T00:43:49.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.522+0000 7f82a04bb800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:43:49.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.522+0000 7f82a04bb800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:43:49.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.522+0000 7f82a04bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:49.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.522+0000 7f82a04bb800 20 zonegroup default 2024-09-12T00:43:49.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.522+0000 7f82a04bb800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.522+0000 7f82a04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.523+0000 7f82a04bb800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.523+0000 7f82a04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.523+0000 7f82a04bb800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.523+0000 7f82a04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.523+0000 7f82a04bb800 20 started sync module instance, tier type = 2024-09-12T00:43:49.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.523+0000 7f82a04bb800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:43:49.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.533+0000 7f82a04bb800 20 add_watcher() i=0 2024-09-12T00:43:49.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.533+0000 7f82a04bb800 20 add_watcher() i=1 2024-09-12T00:43:49.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.533+0000 7f82a04bb800 20 add_watcher() i=2 2024-09-12T00:43:49.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.533+0000 7f82a04bb800 20 add_watcher() i=3 2024-09-12T00:43:49.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.533+0000 7f82a04bb800 20 add_watcher() i=4 2024-09-12T00:43:49.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.533+0000 7f82a04bb800 20 add_watcher() i=5 2024-09-12T00:43:49.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.533+0000 7f82a04bb800 20 add_watcher() i=6 2024-09-12T00:43:49.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.535+0000 7f82a04bb800 20 add_watcher() i=7 2024-09-12T00:43:49.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.535+0000 7f82a04bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:49.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.536+0000 7f814ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:49.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.537+0000 7f82a04bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:49.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.537+0000 7f82a04bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:49.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.578+0000 7f814effd640 20 reqs_thread_entry: start 2024-09-12T00:43:49.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.578+0000 7f82a04bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:43:49.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.578+0000 7f82a04bb800 20 Filter name: none 2024-09-12T00:43:49.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.578+0000 7f814cff9640 20 reqs_thread_entry: start 2024-09-12T00:43:49.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.578+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:43:49.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.580+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.580+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.580+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.581+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:43:49.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.582+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.583+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.583+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.584+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:43:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.586+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.587+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.587+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:43:49.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.587+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4746837950120082576', time=2024-09-12T02:40:52.078137+0000, chain.objs.size()=7 2024-09-12T00:43:49.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.587+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~KrFncimkm9_TVzWG1KVuYpvSTVt0XcK.1 2024-09-12T00:43:49.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.587+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~KrFncimkm9_TVzWG1KVuYpvSTVt0XcK.1_1 2024-09-12T00:43:49.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.587+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~KrFncimkm9_TVzWG1KVuYpvSTVt0XcK.1_2 2024-09-12T00:43:49.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.587+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~KrFncimkm9_TVzWG1KVuYpvSTVt0XcK.2 2024-09-12T00:43:49.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.587+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~KrFncimkm9_TVzWG1KVuYpvSTVt0XcK.2_1 2024-09-12T00:43:49.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.587+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~KrFncimkm9_TVzWG1KVuYpvSTVt0XcK.2_2 2024-09-12T00:43:49.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.587+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~KrFncimkm9_TVzWG1KVuYpvSTVt0XcK.3 2024-09-12T00:43:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.588+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~WtbXU0RJVX1C0OgH8FfdFZM6j0rxib4', time=2024-09-12T02:41:23.182538+0000, chain.objs.size()=5 2024-09-12T00:43:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.588+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.55__multipart_key1.2~WtbXU0RJVX1C0OgH8FfdFZM6j0rxib4.7 2024-09-12T00:43:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.588+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.55__shadow_key1.2~WtbXU0RJVX1C0OgH8FfdFZM6j0rxib4.7_1 2024-09-12T00:43:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.588+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.55__multipart_key1.2~WtbXU0RJVX1C0OgH8FfdFZM6j0rxib4.10 2024-09-12T00:43:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.588+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.55__shadow_key1.2~WtbXU0RJVX1C0OgH8FfdFZM6j0rxib4.10_1 2024-09-12T00:43:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.589+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.55__multipart_key1.2~WtbXU0RJVX1C0OgH8FfdFZM6j0rxib4.13 2024-09-12T00:43:49.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.593+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU', time=2024-09-12T02:43:34.368409+0000, chain.objs.size()=41 2024-09-12T00:43:49.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.593+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.1 2024-09-12T00:43:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.593+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.2 2024-09-12T00:43:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.593+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.3 2024-09-12T00:43:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.593+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.4 2024-09-12T00:43:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.594+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.5 2024-09-12T00:43:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.594+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.6 2024-09-12T00:43:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.594+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.7 2024-09-12T00:43:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.594+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.8 2024-09-12T00:43:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.594+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.9 2024-09-12T00:43:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.594+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.10 2024-09-12T00:43:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.595+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.11 2024-09-12T00:43:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.595+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.12 2024-09-12T00:43:49.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.597+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.13 2024-09-12T00:43:49.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.597+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.14 2024-09-12T00:43:49.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.597+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.15 2024-09-12T00:43:49.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.597+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.16 2024-09-12T00:43:49.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.597+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.17 2024-09-12T00:43:49.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.597+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.18 2024-09-12T00:43:49.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.598+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.19 2024-09-12T00:43:49.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.598+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.20 2024-09-12T00:43:49.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.598+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.21 2024-09-12T00:43:49.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.599+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.22 2024-09-12T00:43:49.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.599+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.23 2024-09-12T00:43:49.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.600+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.24 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.602+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.25 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.602+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.26 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.602+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.27 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.602+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.28 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.602+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.29 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.602+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.30 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.602+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.31 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.602+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.32 2024-09-12T00:43:49.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.602+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.33 2024-09-12T00:43:49.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.602+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.34 2024-09-12T00:43:49.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.607+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.35 2024-09-12T00:43:49.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.608+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.36 2024-09-12T00:43:49.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.608+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.37 2024-09-12T00:43:49.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.609+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.38 2024-09-12T00:43:49.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.609+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.39 2024-09-12T00:43:49.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.609+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.40 2024-09-12T00:43:49.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.609+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.59__multipart_key1.2~08Em9V7z6hvb_CIi06O-9RlXGAbXaNU.41 2024-09-12T00:43:49.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.612+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.614+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:43:49.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.615+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.616+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.616+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.617+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:43:49.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.618+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:43:49.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2998493191462042637', time=2024-09-12T02:40:57.651272+0000, chain.objs.size()=9 2024-09-12T00:43:49.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.52__multipart_key1.2~M8j-iMNDAqqfBXy6vAD_5qnGZiXhsvg.1 2024-09-12T00:43:49.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.52__shadow_key1.2~M8j-iMNDAqqfBXy6vAD_5qnGZiXhsvg.1_1 2024-09-12T00:43:49.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.52__multipart_key1.2~M8j-iMNDAqqfBXy6vAD_5qnGZiXhsvg.2 2024-09-12T00:43:49.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.52__shadow_key1.2~M8j-iMNDAqqfBXy6vAD_5qnGZiXhsvg.2_1 2024-09-12T00:43:49.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.52__multipart_key1.2~M8j-iMNDAqqfBXy6vAD_5qnGZiXhsvg.3 2024-09-12T00:43:49.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.52__shadow_key1.2~M8j-iMNDAqqfBXy6vAD_5qnGZiXhsvg.3_1 2024-09-12T00:43:49.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.52__multipart_key1.2~M8j-iMNDAqqfBXy6vAD_5qnGZiXhsvg.4 2024-09-12T00:43:49.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.52__shadow_key1.2~M8j-iMNDAqqfBXy6vAD_5qnGZiXhsvg.4_1 2024-09-12T00:43:49.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.52__multipart_key1.2~M8j-iMNDAqqfBXy6vAD_5qnGZiXhsvg.5 2024-09-12T00:43:49.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15477210744055920097', time=2024-09-12T02:41:20.742707+0000, chain.objs.size()=9 2024-09-12T00:43:49.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__multipart_file2.mpg.2~cGBJ0XmwrQoaL4PiZuPhYoQHnyPOGMN.1 2024-09-12T00:43:49.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__shadow_file2.mpg.2~cGBJ0XmwrQoaL4PiZuPhYoQHnyPOGMN.1_1 2024-09-12T00:43:49.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.619+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__multipart_file2.mpg.2~cGBJ0XmwrQoaL4PiZuPhYoQHnyPOGMN.2 2024-09-12T00:43:49.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.622+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__shadow_file2.mpg.2~cGBJ0XmwrQoaL4PiZuPhYoQHnyPOGMN.2_1 2024-09-12T00:43:49.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.623+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__multipart_file2.mpg.2~cGBJ0XmwrQoaL4PiZuPhYoQHnyPOGMN.3 2024-09-12T00:43:49.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.625+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__shadow_file2.mpg.2~cGBJ0XmwrQoaL4PiZuPhYoQHnyPOGMN.3_1 2024-09-12T00:43:49.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.625+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__multipart_file2.mpg.2~cGBJ0XmwrQoaL4PiZuPhYoQHnyPOGMN.4 2024-09-12T00:43:49.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.625+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__shadow_file2.mpg.2~cGBJ0XmwrQoaL4PiZuPhYoQHnyPOGMN.4_1 2024-09-12T00:43:49.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.625+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__multipart_file2.mpg.2~cGBJ0XmwrQoaL4PiZuPhYoQHnyPOGMN.5 2024-09-12T00:43:49.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.629+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.632+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:43:49.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.634+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.634+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.634+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.635+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:43:49.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.636+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.637+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.637+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.637+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10017665321456602393', time=2024-09-12T02:41:20.670907+0000, chain.objs.size()=9 2024-09-12T00:43:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.637+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__multipart_file.mpg.2~9pcZgxGsZn30wF-Rg7BZfq36Ul8MsvC.1 2024-09-12T00:43:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.637+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__shadow_file.mpg.2~9pcZgxGsZn30wF-Rg7BZfq36Ul8MsvC.1_1 2024-09-12T00:43:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.637+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__multipart_file.mpg.2~9pcZgxGsZn30wF-Rg7BZfq36Ul8MsvC.2 2024-09-12T00:43:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.637+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__shadow_file.mpg.2~9pcZgxGsZn30wF-Rg7BZfq36Ul8MsvC.2_1 2024-09-12T00:43:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.637+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__multipart_file.mpg.2~9pcZgxGsZn30wF-Rg7BZfq36Ul8MsvC.3 2024-09-12T00:43:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.637+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__shadow_file.mpg.2~9pcZgxGsZn30wF-Rg7BZfq36Ul8MsvC.3_1 2024-09-12T00:43:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.637+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__multipart_file.mpg.2~9pcZgxGsZn30wF-Rg7BZfq36Ul8MsvC.4 2024-09-12T00:43:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.637+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__shadow_file.mpg.2~9pcZgxGsZn30wF-Rg7BZfq36Ul8MsvC.4_1 2024-09-12T00:43:49.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.637+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__multipart_file.mpg.2~9pcZgxGsZn30wF-Rg7BZfq36Ul8MsvC.5 2024-09-12T00:43:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.641+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.644+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:43:49.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.646+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.646+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.646+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.646+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7607945538833186239', time=2024-09-12T02:43:37.054005+0000, chain.objs.size()=1 2024-09-12T00:43:49.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.646+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.62__shadow_.3annmM89Y6vXyxaJj9SLhW0x0WMQSnA_0 2024-09-12T00:43:49.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.647+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.649+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:43:49.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.651+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.651+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.652+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.652+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5197637334643129921', time=2024-09-12T02:40:51.635783+0000, chain.objs.size()=7 2024-09-12T00:43:49.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.652+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~U_HAhrCkmX8w_cVSIZPGbshistZGAxw.1 2024-09-12T00:43:49.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.652+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~U_HAhrCkmX8w_cVSIZPGbshistZGAxw.1_1 2024-09-12T00:43:49.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.652+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~U_HAhrCkmX8w_cVSIZPGbshistZGAxw.1_2 2024-09-12T00:43:49.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.652+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~U_HAhrCkmX8w_cVSIZPGbshistZGAxw.2 2024-09-12T00:43:49.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.652+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~U_HAhrCkmX8w_cVSIZPGbshistZGAxw.2_1 2024-09-12T00:43:49.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.652+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~U_HAhrCkmX8w_cVSIZPGbshistZGAxw.2_2 2024-09-12T00:43:49.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.652+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~U_HAhrCkmX8w_cVSIZPGbshistZGAxw.3 2024-09-12T00:43:49.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.655+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.657+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:43:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.659+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.659+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.659+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.659+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15189496707947070689', time=2024-09-12T02:43:17.144357+0000, chain.objs.size()=9 2024-09-12T00:43:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.659+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.57__multipart_key1.2~98zOvncs0yEznLOKT_WtCIzZ4W4cVzu.1 2024-09-12T00:43:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.659+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.57__shadow_key1.2~98zOvncs0yEznLOKT_WtCIzZ4W4cVzu.1_1 2024-09-12T00:43:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.659+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.57__multipart_key1.2~98zOvncs0yEznLOKT_WtCIzZ4W4cVzu.2 2024-09-12T00:43:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.659+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.57__shadow_key1.2~98zOvncs0yEznLOKT_WtCIzZ4W4cVzu.2_1 2024-09-12T00:43:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.659+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.57__multipart_key1.2~98zOvncs0yEznLOKT_WtCIzZ4W4cVzu.3 2024-09-12T00:43:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.659+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.57__shadow_key1.2~98zOvncs0yEznLOKT_WtCIzZ4W4cVzu.3_1 2024-09-12T00:43:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.659+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.57__multipart_key1.2~98zOvncs0yEznLOKT_WtCIzZ4W4cVzu.4 2024-09-12T00:43:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.659+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.57__shadow_key1.2~98zOvncs0yEznLOKT_WtCIzZ4W4cVzu.4_1 2024-09-12T00:43:49.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.659+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.57__multipart_key1.2~98zOvncs0yEznLOKT_WtCIzZ4W4cVzu.5 2024-09-12T00:43:49.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.663+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.666+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:43:49.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.667+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.667+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.667+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.667+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10814446126700670633', time=2024-09-12T02:40:51.851154+0000, chain.objs.size()=6 2024-09-12T00:43:49.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.667+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.47__shadow_.x74W5S8xJBdP3vYT6vz60tjE0vTEUNU_0 2024-09-12T00:43:49.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.667+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.47__shadow_.x74W5S8xJBdP3vYT6vz60tjE0vTEUNU_1 2024-09-12T00:43:49.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.668+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.47__shadow_.x74W5S8xJBdP3vYT6vz60tjE0vTEUNU_2 2024-09-12T00:43:49.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.668+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.47__shadow_.x74W5S8xJBdP3vYT6vz60tjE0vTEUNU_3 2024-09-12T00:43:49.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.668+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.47__shadow_.x74W5S8xJBdP3vYT6vz60tjE0vTEUNU_4 2024-09-12T00:43:49.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.668+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.47__shadow_.x74W5S8xJBdP3vYT6vz60tjE0vTEUNU_5 2024-09-12T00:43:49.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.671+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.673+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:43:49.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.674+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.675+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.675+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.675+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6295365911313433733', time=2024-09-12T02:43:11.786265+0000, chain.objs.size()=16 2024-09-12T00:43:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.675+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.1 2024-09-12T00:43:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.675+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.1_1 2024-09-12T00:43:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.675+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.1_2 2024-09-12T00:43:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.675+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.2 2024-09-12T00:43:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.675+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.2_1 2024-09-12T00:43:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.675+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.2_2 2024-09-12T00:43:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.675+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.3 2024-09-12T00:43:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.675+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.3_1 2024-09-12T00:43:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.675+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.3_2 2024-09-12T00:43:49.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.675+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.4 2024-09-12T00:43:49.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.675+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.4_1 2024-09-12T00:43:49.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.675+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.4_2 2024-09-12T00:43:49.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.678+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.5 2024-09-12T00:43:49.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.679+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.5_1 2024-09-12T00:43:49.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.679+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.5_2 2024-09-12T00:43:49.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.682+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~fGeYC3g39t3h548NYdtviFiB_QHUTLW.6 2024-09-12T00:43:49.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.684+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.686+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:43:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.687+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.688+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.688+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.688+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6529325824924938011', time=2024-09-12T02:40:33.184301+0000, chain.objs.size()=9 2024-09-12T00:43:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.688+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~oyf952Qf4u_QH4GGP1L3xA8ooQwaH5p.1 2024-09-12T00:43:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.688+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~oyf952Qf4u_QH4GGP1L3xA8ooQwaH5p.1_1 2024-09-12T00:43:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.688+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~oyf952Qf4u_QH4GGP1L3xA8ooQwaH5p.2 2024-09-12T00:43:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.688+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~oyf952Qf4u_QH4GGP1L3xA8ooQwaH5p.2_1 2024-09-12T00:43:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.688+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~oyf952Qf4u_QH4GGP1L3xA8ooQwaH5p.3 2024-09-12T00:43:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.688+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~oyf952Qf4u_QH4GGP1L3xA8ooQwaH5p.3_1 2024-09-12T00:43:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.688+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~oyf952Qf4u_QH4GGP1L3xA8ooQwaH5p.4 2024-09-12T00:43:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.688+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~oyf952Qf4u_QH4GGP1L3xA8ooQwaH5p.4_1 2024-09-12T00:43:49.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.688+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~oyf952Qf4u_QH4GGP1L3xA8ooQwaH5p.5 2024-09-12T00:43:49.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.692+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.695+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:43:49.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.696+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.696+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.696 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.697+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.697+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5535124933654418341', time=2024-09-12T02:41:20.812044+0000, chain.objs.size()=1 2024-09-12T00:43:49.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.697+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__shadow_.I65sRPU7CIwbG1WWCHcl88QS0H5lTse_0 2024-09-12T00:43:49.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.698+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.700+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:43:49.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.701+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.702+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.702+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:43:49.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.702+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17677613462090045243', time=2024-09-12T02:42:43.913255+0000, chain.objs.size()=16 2024-09-12T00:43:49.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.702+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.1 2024-09-12T00:43:49.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.702+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.1_1 2024-09-12T00:43:49.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.702+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.1_2 2024-09-12T00:43:49.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.702+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.2 2024-09-12T00:43:49.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.702+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.2_1 2024-09-12T00:43:49.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.702+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.2_2 2024-09-12T00:43:49.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.702+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.3 2024-09-12T00:43:49.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.702+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.3_1 2024-09-12T00:43:49.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.702+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.3_2 2024-09-12T00:43:49.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.702+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.4 2024-09-12T00:43:49.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.702+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.4_1 2024-09-12T00:43:49.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.702+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.4_2 2024-09-12T00:43:49.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.706+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.5 2024-09-12T00:43:49.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.706+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.5_1 2024-09-12T00:43:49.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.706+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.5_2 2024-09-12T00:43:49.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.706+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~qWrn3Ub7hhse8oZQCVFyuAhxcZfX47k.6 2024-09-12T00:43:49.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.706+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15465028931770513671', time=2024-09-12T02:43:15.996843+0000, chain.objs.size()=1 2024-09-12T00:43:49.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.706+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.57__shadow_.CsyGM_KdhzpTKEQx1kBJEfHewW5elIm_0 2024-09-12T00:43:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.710+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.712+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:43:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.713+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.714+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.714+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.714+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16254854253631935033', time=2024-09-12T02:43:38.348295+0000, chain.objs.size()=1 2024-09-12T00:43:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.714+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.65__shadow_.zgnKQqggF__k2LAGxWs6PMEHEUvD1_D_0 2024-09-12T00:43:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.715+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.718+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:43:49.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.719+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.719+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.720+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.721+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:43:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.723+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.723+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.723+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:43:49.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.723+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='2~OFmO2rovf1nLSPhm873Cb20SlBH9Cjn', time=2024-09-12T02:40:14.285335+0000, chain.objs.size()=9 2024-09-12T00:43:49.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.723+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.41__multipart_key1.2~OFmO2rovf1nLSPhm873Cb20SlBH9Cjn.1 2024-09-12T00:43:49.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.723+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.41__shadow_key1.2~OFmO2rovf1nLSPhm873Cb20SlBH9Cjn.1_1 2024-09-12T00:43:49.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.723+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.41__multipart_key1.2~OFmO2rovf1nLSPhm873Cb20SlBH9Cjn.2 2024-09-12T00:43:49.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.723+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.41__shadow_key1.2~OFmO2rovf1nLSPhm873Cb20SlBH9Cjn.2_1 2024-09-12T00:43:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.723+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.41__multipart_key1.2~OFmO2rovf1nLSPhm873Cb20SlBH9Cjn.3 2024-09-12T00:43:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.724+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.41__shadow_key1.2~OFmO2rovf1nLSPhm873Cb20SlBH9Cjn.3_1 2024-09-12T00:43:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.724+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.41__multipart_key1.2~OFmO2rovf1nLSPhm873Cb20SlBH9Cjn.4 2024-09-12T00:43:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.724+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.41__shadow_key1.2~OFmO2rovf1nLSPhm873Cb20SlBH9Cjn.4_1 2024-09-12T00:43:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.724+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.41__multipart_key1.2~OFmO2rovf1nLSPhm873Cb20SlBH9Cjn.5 2024-09-12T00:43:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.724+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6372760247083959617', time=2024-09-12T02:40:24.935967+0000, chain.objs.size()=9 2024-09-12T00:43:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.724+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__multipart_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.1 2024-09-12T00:43:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.724+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__shadow_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.1_1 2024-09-12T00:43:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.724+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__multipart_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.2 2024-09-12T00:43:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.726+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__shadow_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.2_1 2024-09-12T00:43:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.726+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__multipart_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.3 2024-09-12T00:43:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.727+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__shadow_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.3_1 2024-09-12T00:43:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.729+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__multipart_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.4 2024-09-12T00:43:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.729+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__shadow_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.4_1 2024-09-12T00:43:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.729+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__multipart_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.5 2024-09-12T00:43:49.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.731+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.735+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:43:49.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.736+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.736+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.737+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:43:49.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.737+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17133604573494416410', time=2024-09-12T02:41:59.204077+0000, chain.objs.size()=21 2024-09-12T00:43:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.737+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.1 2024-09-12T00:43:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.737+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.1_1 2024-09-12T00:43:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.737+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.2 2024-09-12T00:43:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.737+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.2_1 2024-09-12T00:43:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.737+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.3 2024-09-12T00:43:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.737+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.3_1 2024-09-12T00:43:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.737+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.4 2024-09-12T00:43:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.737+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.4_1 2024-09-12T00:43:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.737+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.5 2024-09-12T00:43:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.737+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.5_1 2024-09-12T00:43:49.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.737+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.6 2024-09-12T00:43:49.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.737+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.6_1 2024-09-12T00:43:49.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.740+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.7 2024-09-12T00:43:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.740+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.7_1 2024-09-12T00:43:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.740+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.8 2024-09-12T00:43:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.740+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.8_1 2024-09-12T00:43:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.742+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.9 2024-09-12T00:43:49.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.742+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.9_1 2024-09-12T00:43:49.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.742+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.10 2024-09-12T00:43:49.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.742+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.10_1 2024-09-12T00:43:49.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.742+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~xmi9hyMWAF5mw5YlD9HHK3nHc_YNb_B.11 2024-09-12T00:43:49.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.742+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15556358881169015586', time=2024-09-12T02:42:07.444111+0000, chain.objs.size()=21 2024-09-12T00:43:49.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.742+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.1 2024-09-12T00:43:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.742+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.1_1 2024-09-12T00:43:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.745+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.2 2024-09-12T00:43:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.745+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.2_1 2024-09-12T00:43:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.745+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.3 2024-09-12T00:43:49.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.745+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.3_1 2024-09-12T00:43:49.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.745+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.4 2024-09-12T00:43:49.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.745+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.4_1 2024-09-12T00:43:49.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.747+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.5 2024-09-12T00:43:49.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.747+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.5_1 2024-09-12T00:43:49.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.747+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.6 2024-09-12T00:43:49.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.747+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.6_1 2024-09-12T00:43:49.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.747+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.7 2024-09-12T00:43:49.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.749+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.7_1 2024-09-12T00:43:49.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.749+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.8 2024-09-12T00:43:49.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.750+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.8_1 2024-09-12T00:43:49.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.750+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.9 2024-09-12T00:43:49.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.751+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.9_1 2024-09-12T00:43:49.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.751+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.10 2024-09-12T00:43:49.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.751+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.10_1 2024-09-12T00:43:49.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.751+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~8D-t3s4fBNQwKIGq2zmgD4rkaRrYrbd.11 2024-09-12T00:43:49.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.755+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.758+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:43:49.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.759+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.760+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.760+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.761+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:43:49.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14720567993601160515', time=2024-09-12T02:42:35.053602+0000, chain.objs.size()=19 2024-09-12T00:43:49.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.1 2024-09-12T00:43:49.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.1_1 2024-09-12T00:43:49.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.2 2024-09-12T00:43:49.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.2_1 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.3 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.3_1 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.4 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.4_1 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.5 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.5_1 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.6 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.763+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.6_1 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.766+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.7 2024-09-12T00:43:49.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.766+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.7_1 2024-09-12T00:43:49.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.767+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.8 2024-09-12T00:43:49.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.767+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.8_1 2024-09-12T00:43:49.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.767+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.9 2024-09-12T00:43:49.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.767+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.9_1 2024-09-12T00:43:49.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.767+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~yGAnKJAb6amRyy4AlS2RINVCwYIwU5P.10 2024-09-12T00:43:49.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.773+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.775+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:43:49.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.776+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.776+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.777+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:43:49.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.777+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17577343161212601757', time=2024-09-12T02:43:29.766277+0000, chain.objs.size()=9 2024-09-12T00:43:49.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.777+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.58__multipart_key1.2~rwRQWKUvVmNTtIkwzWX0CQHtORLfWdY.1 2024-09-12T00:43:49.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.777+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.58__shadow_key1.2~rwRQWKUvVmNTtIkwzWX0CQHtORLfWdY.1_1 2024-09-12T00:43:49.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.777+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.58__multipart_key1.2~rwRQWKUvVmNTtIkwzWX0CQHtORLfWdY.2 2024-09-12T00:43:49.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.777+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.58__shadow_key1.2~rwRQWKUvVmNTtIkwzWX0CQHtORLfWdY.2_1 2024-09-12T00:43:49.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.777+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.58__multipart_key1.2~rwRQWKUvVmNTtIkwzWX0CQHtORLfWdY.3 2024-09-12T00:43:49.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.777+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.58__shadow_key1.2~rwRQWKUvVmNTtIkwzWX0CQHtORLfWdY.3_1 2024-09-12T00:43:49.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.777+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.58__multipart_key1.2~rwRQWKUvVmNTtIkwzWX0CQHtORLfWdY.4 2024-09-12T00:43:49.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.777+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.58__shadow_key1.2~rwRQWKUvVmNTtIkwzWX0CQHtORLfWdY.4_1 2024-09-12T00:43:49.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.777+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.58__multipart_key1.2~rwRQWKUvVmNTtIkwzWX0CQHtORLfWdY.5 2024-09-12T00:43:49.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.777+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1646096083725638019', time=2024-09-12T02:43:36.195047+0000, chain.objs.size()=1 2024-09-12T00:43:49.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.777+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.60__shadow_.8DjL3Ti8Rf-cmQJmDmguM6NYARKbVRz_0 2024-09-12T00:43:49.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.780+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.783+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:43:49.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.784+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.785+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.785+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:43:49.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.785+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17407106127331886309', time=2024-09-12T02:40:24.706950+0000, chain.objs.size()=9 2024-09-12T00:43:49.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.785+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__multipart_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.1 2024-09-12T00:43:49.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.785+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__shadow_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.1_1 2024-09-12T00:43:49.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.785+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__multipart_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.2 2024-09-12T00:43:49.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.785+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__shadow_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.2_1 2024-09-12T00:43:49.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.785+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__multipart_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.3 2024-09-12T00:43:49.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.785+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__shadow_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.3_1 2024-09-12T00:43:49.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.785+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__multipart_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.4 2024-09-12T00:43:49.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.785+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__shadow_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.4_1 2024-09-12T00:43:49.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.785+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45__multipart_key1.2~KLP0jUFMzx_nUoDXlbWagMsO52nK1i1.5 2024-09-12T00:43:49.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.785+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10561118808452556389', time=2024-09-12T02:43:37.486846+0000, chain.objs.size()=1 2024-09-12T00:43:49.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.785+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.63__shadow_.iGhEqURelyRWZCfXOwCKXWG6cnbs8rc_0 2024-09-12T00:43:49.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.789+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.791+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:43:49.792 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.793+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.793+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.794+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.794+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4009893242061661845', time=2024-09-12T02:43:11.559465+0000, chain.objs.size()=16 2024-09-12T00:43:49.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.794+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.1 2024-09-12T00:43:49.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.794+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.1_1 2024-09-12T00:43:49.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.794+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.1_2 2024-09-12T00:43:49.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.794+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.2 2024-09-12T00:43:49.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.794+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.2_1 2024-09-12T00:43:49.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.794+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.2_2 2024-09-12T00:43:49.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.794+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.3 2024-09-12T00:43:49.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.794+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.3_1 2024-09-12T00:43:49.794 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.794+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.3_2 2024-09-12T00:43:49.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.794+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.4 2024-09-12T00:43:49.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.794+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.4_1 2024-09-12T00:43:49.795 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.794+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.4_2 2024-09-12T00:43:49.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.796+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.5 2024-09-12T00:43:49.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.797+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.5_1 2024-09-12T00:43:49.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.797+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__shadow_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.5_2 2024-09-12T00:43:49.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.797+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.56__multipart_key1.2~BQjwS_t8iXPkv8QKDTiT7x5Cc6UCBrP.6 2024-09-12T00:43:49.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.802+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.804+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:43:49.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.806+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.806+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.806+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.806+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11497225708592497504', time=2024-09-12T02:40:49.276250+0000, chain.objs.size()=7 2024-09-12T00:43:49.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.806+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~5XMJNApz8vQkraxNneaRV33v_QnEgYP.1 2024-09-12T00:43:49.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.806+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~5XMJNApz8vQkraxNneaRV33v_QnEgYP.1_1 2024-09-12T00:43:49.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.806+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~5XMJNApz8vQkraxNneaRV33v_QnEgYP.1_2 2024-09-12T00:43:49.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.806+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~5XMJNApz8vQkraxNneaRV33v_QnEgYP.2 2024-09-12T00:43:49.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.806+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~5XMJNApz8vQkraxNneaRV33v_QnEgYP.2_1 2024-09-12T00:43:49.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.806+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~5XMJNApz8vQkraxNneaRV33v_QnEgYP.2_2 2024-09-12T00:43:49.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.806+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~5XMJNApz8vQkraxNneaRV33v_QnEgYP.3 2024-09-12T00:43:49.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.810+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.813+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:43:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.814+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.815+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.815+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.815+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10617549251242103570', time=2024-09-12T02:40:38.337638+0000, chain.objs.size()=9 2024-09-12T00:43:49.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.815+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~6twASXlaDIBWzLqhmgAQJK-Q71CqH7C.1 2024-09-12T00:43:49.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.815+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~6twASXlaDIBWzLqhmgAQJK-Q71CqH7C.1_1 2024-09-12T00:43:49.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.815+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~6twASXlaDIBWzLqhmgAQJK-Q71CqH7C.2 2024-09-12T00:43:49.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.815+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~6twASXlaDIBWzLqhmgAQJK-Q71CqH7C.2_1 2024-09-12T00:43:49.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.815+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~6twASXlaDIBWzLqhmgAQJK-Q71CqH7C.3 2024-09-12T00:43:49.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.815+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~6twASXlaDIBWzLqhmgAQJK-Q71CqH7C.3_1 2024-09-12T00:43:49.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.815+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~6twASXlaDIBWzLqhmgAQJK-Q71CqH7C.4 2024-09-12T00:43:49.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.815+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~6twASXlaDIBWzLqhmgAQJK-Q71CqH7C.4_1 2024-09-12T00:43:49.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.815+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~6twASXlaDIBWzLqhmgAQJK-Q71CqH7C.5 2024-09-12T00:43:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.819+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.822+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:43:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.823+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.823+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.824+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.824+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3806790579923658334', time=2024-09-12T02:40:20.044150+0000, chain.objs.size()=9 2024-09-12T00:43:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.824+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.43__multipart_key1.2~Vvywk0kEHE5r1Ojtz-47KygyXXAL2-p.1 2024-09-12T00:43:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.824+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.43__shadow_key1.2~Vvywk0kEHE5r1Ojtz-47KygyXXAL2-p.1_1 2024-09-12T00:43:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.824+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.43__multipart_key1.2~Vvywk0kEHE5r1Ojtz-47KygyXXAL2-p.2 2024-09-12T00:43:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.824+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.43__shadow_key1.2~Vvywk0kEHE5r1Ojtz-47KygyXXAL2-p.2_1 2024-09-12T00:43:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.824+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.43__multipart_key1.2~Vvywk0kEHE5r1Ojtz-47KygyXXAL2-p.3 2024-09-12T00:43:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.824+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.43__shadow_key1.2~Vvywk0kEHE5r1Ojtz-47KygyXXAL2-p.3_1 2024-09-12T00:43:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.824+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.43__multipart_key1.2~Vvywk0kEHE5r1Ojtz-47KygyXXAL2-p.4 2024-09-12T00:43:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.824+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.43__shadow_key1.2~Vvywk0kEHE5r1Ojtz-47KygyXXAL2-p.4_1 2024-09-12T00:43:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.824+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.43__multipart_key1.2~Vvywk0kEHE5r1Ojtz-47KygyXXAL2-p.5 2024-09-12T00:43:49.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.827+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.830+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:43:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.831+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.831+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.832+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:43:49.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.832+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15098468031387136950', time=2024-09-12T02:41:12.500163+0000, chain.objs.size()=9 2024-09-12T00:43:49.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.832+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.53__multipart_key1.2~DNLjYKWIQuFHVy7R2xuuAwHBRar7re2.1 2024-09-12T00:43:49.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.832+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.53__shadow_key1.2~DNLjYKWIQuFHVy7R2xuuAwHBRar7re2.1_1 2024-09-12T00:43:49.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.832+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.53__multipart_key1.2~DNLjYKWIQuFHVy7R2xuuAwHBRar7re2.2 2024-09-12T00:43:49.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.832+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.53__shadow_key1.2~DNLjYKWIQuFHVy7R2xuuAwHBRar7re2.2_1 2024-09-12T00:43:49.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.832+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.53__multipart_key1.2~DNLjYKWIQuFHVy7R2xuuAwHBRar7re2.3 2024-09-12T00:43:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.832+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.53__shadow_key1.2~DNLjYKWIQuFHVy7R2xuuAwHBRar7re2.3_1 2024-09-12T00:43:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.832+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.53__multipart_key1.2~DNLjYKWIQuFHVy7R2xuuAwHBRar7re2.4 2024-09-12T00:43:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.832+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.53__shadow_key1.2~DNLjYKWIQuFHVy7R2xuuAwHBRar7re2.4_1 2024-09-12T00:43:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.832+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.53__multipart_key1.2~DNLjYKWIQuFHVy7R2xuuAwHBRar7re2.5 2024-09-12T00:43:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.832+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.53995843000851163', time=2024-09-12T02:41:20.777169+0000, chain.objs.size()=1 2024-09-12T00:43:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.832+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__shadow_.bw-inS9U0fgC898LVy7OD1onMi-XG3G_0 2024-09-12T00:43:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.832+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12807689850595885692', time=2024-09-12T02:43:36.621187+0000, chain.objs.size()=1 2024-09-12T00:43:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.832+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.61__shadow_.3GE266kbPpmoEepo3ZO9I6DWPJQXJGJ_0 2024-09-12T00:43:49.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.836+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.839+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:43:49.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.841+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.841+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.842+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:43:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.842+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2165056623673465891', time=2024-09-12T02:43:37.919389+0000, chain.objs.size()=1 2024-09-12T00:43:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.842+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.64__shadow_.X63x57DCiR5n2GmSXBkFOLydZ59Lsk4_0 2024-09-12T00:43:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.842+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1771961461096244442', time=2024-09-12T02:43:48.394582+0000, chain.objs.size()=21 2024-09-12T00:43:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.842+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__multipart_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.1 2024-09-12T00:43:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.842+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__shadow_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.1_1 2024-09-12T00:43:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.842+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__multipart_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.2 2024-09-12T00:43:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.842+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__shadow_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.2_1 2024-09-12T00:43:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.842+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__multipart_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.3 2024-09-12T00:43:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.842+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__shadow_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.3_1 2024-09-12T00:43:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.842+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__multipart_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.4 2024-09-12T00:43:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.842+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__shadow_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.4_1 2024-09-12T00:43:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.842+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__multipart_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.5 2024-09-12T00:43:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.842+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__shadow_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.5_1 2024-09-12T00:43:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.842+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__multipart_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.6 2024-09-12T00:43:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.847+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__shadow_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.6_1 2024-09-12T00:43:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.847+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__multipart_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.7 2024-09-12T00:43:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.847+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__shadow_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.7_1 2024-09-12T00:43:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.847+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__multipart_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.8 2024-09-12T00:43:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.848+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__shadow_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.8_1 2024-09-12T00:43:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.848+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__multipart_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.9 2024-09-12T00:43:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.848+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__shadow_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.9_1 2024-09-12T00:43:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.848+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__multipart_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.10 2024-09-12T00:43:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.848+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__shadow_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.10_1 2024-09-12T00:43:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.848+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.67__multipart_key1.2~HIuUleLzSrEHQmpLAReP1B9QSkjoH3T.11 2024-09-12T00:43:49.852 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.853+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.855+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:43:49.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.856+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.857+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.857+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.857+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3995956767286020967', time=2024-09-12T02:41:20.704498+0000, chain.objs.size()=1 2024-09-12T00:43:49.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.857+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.54__shadow_.akT1vv18aY2yYMimFeM73oPfdGoUBYr_0 2024-09-12T00:43:49.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.858+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.860+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:43:49.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.862+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.862+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.862+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.863+0000 7f82a04bb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:43:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.865+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.865+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.865+0000 7f82a04bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:49.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.865+0000 7f82a04bb800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7502309411718523619', time=2024-09-12T02:40:36.175512+0000, chain.objs.size()=9 2024-09-12T00:43:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.865+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~43sLLWcXUwQgX3PShmVZmnS9fuFzHH4.1 2024-09-12T00:43:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.865+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~43sLLWcXUwQgX3PShmVZmnS9fuFzHH4.1_1 2024-09-12T00:43:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.865+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~43sLLWcXUwQgX3PShmVZmnS9fuFzHH4.2 2024-09-12T00:43:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.865+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~43sLLWcXUwQgX3PShmVZmnS9fuFzHH4.2_1 2024-09-12T00:43:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.865+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~43sLLWcXUwQgX3PShmVZmnS9fuFzHH4.3 2024-09-12T00:43:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.865+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~43sLLWcXUwQgX3PShmVZmnS9fuFzHH4.3_1 2024-09-12T00:43:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.865+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~43sLLWcXUwQgX3PShmVZmnS9fuFzHH4.4 2024-09-12T00:43:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.865+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__shadow_key1.2~43sLLWcXUwQgX3PShmVZmnS9fuFzHH4.4_1 2024-09-12T00:43:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.865+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.48__multipart_key1.2~43sLLWcXUwQgX3PShmVZmnS9fuFzHH4.5 2024-09-12T00:43:49.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.869+0000 7f82a04bb800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:49.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.872+0000 7f814ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.874+0000 7f82a04bb800 20 remove_watcher() i=0 2024-09-12T00:43:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.874+0000 7f82a04bb800 2 removed watcher, disabling cache 2024-09-12T00:43:49.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.875+0000 7f82a04bb800 20 remove_watcher() i=1 2024-09-12T00:43:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.877+0000 7f82a04bb800 20 remove_watcher() i=2 2024-09-12T00:43:49.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.877+0000 7f82a04bb800 20 remove_watcher() i=3 2024-09-12T00:43:49.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.878+0000 7f82a04bb800 20 remove_watcher() i=4 2024-09-12T00:43:49.879 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.879+0000 7f82a04bb800 20 remove_watcher() i=5 2024-09-12T00:43:49.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.880+0000 7f82a04bb800 20 remove_watcher() i=6 2024-09-12T00:43:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.881+0000 7f82a04bb800 20 remove_watcher() i=7 2024-09-12T00:43:49.892 DEBUG:teuthology.orchestra.run.smithi133:> radosgw-admin gc process --include-all 2024-09-12T00:43:49.943 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:49.943 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:49.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.981+0000 7f68a4523800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.982+0000 7f68a4523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.982+0000 7f68a4523800 20 realm 2024-09-12T00:43:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.982+0000 7f68a4523800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.982+0000 7f68a4523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.982+0000 7f68a4523800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.982+0000 7f68a4523800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.983+0000 7f68a4523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.983+0000 7f68a4523800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.983+0000 7f68a4523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.983+0000 7f68a4523800 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.984+0000 7f68a4523800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.984+0000 7f68a4523800 20 searching for the correct realm 2024-09-12T00:43:49.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.986+0000 7f6897fff640 0 -- 172.21.15.133:0/3666672685 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f6888061440 msgr2=0x7f6888061880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:49.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:49.989+0000 7f6897fff640 0 -- 172.21.15.133:0/3666672685 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f689002c040 msgr2=0x7f689003a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:50.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.196+0000 7f68a4523800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:43:50.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.196+0000 7f68a4523800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:43:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.196+0000 7f68a4523800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.196+0000 7f68a4523800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.196+0000 7f68a4523800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.196+0000 7f68a4523800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.196+0000 7f68a4523800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.196+0000 7f68a4523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.196+0000 7f68a4523800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.196+0000 7f68a4523800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.196+0000 7f68a4523800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.197+0000 7f68a4523800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.197+0000 7f68a4523800 20 zone default found 2024-09-12T00:43:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.197+0000 7f68a4523800 4 Realm: () 2024-09-12T00:43:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.197+0000 7f68a4523800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:43:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.197+0000 7f68a4523800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:43:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.197+0000 7f68a4523800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.197+0000 7f68a4523800 20 zonegroup default 2024-09-12T00:43:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.197+0000 7f68a4523800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.197+0000 7f68a4523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.197+0000 7f68a4523800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.197+0000 7f68a4523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.197+0000 7f68a4523800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.198+0000 7f68a4523800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.198+0000 7f68a4523800 20 started sync module instance, tier type = 2024-09-12T00:43:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.198+0000 7f68a4523800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:43:50.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.206+0000 7f68a4523800 20 add_watcher() i=0 2024-09-12T00:43:50.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.206+0000 7f68a4523800 20 add_watcher() i=1 2024-09-12T00:43:50.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.206+0000 7f68a4523800 20 add_watcher() i=2 2024-09-12T00:43:50.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.206+0000 7f68a4523800 20 add_watcher() i=3 2024-09-12T00:43:50.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.206+0000 7f68a4523800 20 add_watcher() i=4 2024-09-12T00:43:50.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.206+0000 7f68a4523800 20 add_watcher() i=5 2024-09-12T00:43:50.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.206+0000 7f68a4523800 20 add_watcher() i=6 2024-09-12T00:43:50.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.207+0000 7f68a4523800 20 add_watcher() i=7 2024-09-12T00:43:50.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.207+0000 7f68a4523800 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:50.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.208+0000 7f67567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:50.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.209+0000 7f68a4523800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:50.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.209+0000 7f68a4523800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:50.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.242+0000 7f67557e2640 20 reqs_thread_entry: start 2024-09-12T00:43:50.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.242+0000 7f68a4523800 20 init_complete bucket index max shards: 1 2024-09-12T00:43:50.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.242+0000 7f68a4523800 20 Filter name: none 2024-09-12T00:43:50.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.242+0000 7f66c6ffd640 20 reqs_thread_entry: start 2024-09-12T00:43:50.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.242+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:43:50.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.243+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.243+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.244+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.245+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:43:50.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.247+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.247+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.247+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.248+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:43:50.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.249+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.249+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.250+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.251+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:43:50.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.252+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.252+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.252+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.253+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:43:50.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.254+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.255+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.255+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.256+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:43:50.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.257+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.258+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.258+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.259+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:43:50.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.260+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.261+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.261+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.262+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:43:50.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.263+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.263+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.263+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.264+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:43:50.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.265+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.266+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.266+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.267+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:43:50.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.269+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.269+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.269+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.271+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:43:50.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.271+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.271+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.272+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.272+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:43:50.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.274+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.274+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.274+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.275+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:43:50.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.277+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.277+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.277+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.278+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:43:50.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.280+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.280+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.280+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.281+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:43:50.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.282+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.283+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.283+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.284+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:43:50.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.285+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.286+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.286+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.287+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:43:50.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.288+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.288+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.288+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.289+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:43:50.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.291+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.291+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.291+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.293+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:43:50.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.294+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.294+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.294+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.295+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:43:50.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.297+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.297+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.297+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.298+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:43:50.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.299+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.300+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.300+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.301+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:43:50.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.303+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.303+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.303+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.304+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:43:50.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.305+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.306+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.307+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.307+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:43:50.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.309+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.309+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.309+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.310+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:43:50.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.312+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.312+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.313+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.313+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:43:50.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.314+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.315+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.315+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.316+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:43:50.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.317+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.318+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.318+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.319+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:43:50.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.320+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.320+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.321+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.321+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:43:50.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.323+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.324+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.324+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.325+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:43:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.327+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.327+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.327+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.327+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:43:50.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.329+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.329+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.330+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.330+0000 7f68a4523800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:43:50.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.332+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.333+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.333+0000 7f68a4523800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.335+0000 7f67567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.337+0000 7f68a4523800 20 remove_watcher() i=0 2024-09-12T00:43:50.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.337+0000 7f68a4523800 2 removed watcher, disabling cache 2024-09-12T00:43:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.338+0000 7f68a4523800 20 remove_watcher() i=1 2024-09-12T00:43:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.339+0000 7f68a4523800 20 remove_watcher() i=2 2024-09-12T00:43:50.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.340+0000 7f68a4523800 20 remove_watcher() i=3 2024-09-12T00:43:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.341+0000 7f68a4523800 20 remove_watcher() i=4 2024-09-12T00:43:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.342+0000 7f68a4523800 20 remove_watcher() i=5 2024-09-12T00:43:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.343+0000 7f68a4523800 20 remove_watcher() i=6 2024-09-12T00:43:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.344+0000 7f68a4523800 20 remove_watcher() i=7 2024-09-12T00:43:50.355 DEBUG:teuthology.orchestra.run.smithi133:> radosgw-admin gc process --include-all 2024-09-12T00:43:50.407 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:50.408 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:50.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.445+0000 7f815092a800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.446+0000 7f815092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.446+0000 7f815092a800 20 realm 2024-09-12T00:43:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.446+0000 7f815092a800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.447+0000 7f815092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.447+0000 7f815092a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.447+0000 7f815092a800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.447+0000 7f815092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.447+0000 7f815092a800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.447+0000 7f815092a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:50.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.447+0000 7f815092a800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.448+0000 7f815092a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:50.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.448+0000 7f815092a800 20 searching for the correct realm 2024-09-12T00:43:50.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.450+0000 7f8143fff640 0 -- 172.21.15.133:0/312330478 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f8134018070 msgr2=0x7f8134061990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:50.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.454+0000 7f8143fff640 0 -- 172.21.15.133:0/312330478 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f813c018c20 msgr2=0x7f813c041920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:50.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.661+0000 7f815092a800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:43:50.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.661+0000 7f815092a800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:43:50.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.661+0000 7f815092a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:50.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.661+0000 7f815092a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:50.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.661+0000 7f815092a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:50.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.661+0000 7f815092a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:50.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.661+0000 7f815092a800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.661+0000 7f815092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.661+0000 7f815092a800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.662+0000 7f815092a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.662+0000 7f815092a800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.662+0000 7f815092a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.662+0000 7f815092a800 20 zone default found 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.662+0000 7f815092a800 4 Realm: () 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.662+0000 7f815092a800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.662+0000 7f815092a800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.662+0000 7f815092a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.662+0000 7f815092a800 20 zonegroup default 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.662+0000 7f815092a800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.662+0000 7f815092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.662+0000 7f815092a800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.663+0000 7f815092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.663+0000 7f815092a800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.663+0000 7f815092a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.663+0000 7f815092a800 20 started sync module instance, tier type = 2024-09-12T00:43:50.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.663+0000 7f815092a800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:43:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.672+0000 7f815092a800 20 add_watcher() i=0 2024-09-12T00:43:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.672+0000 7f815092a800 20 add_watcher() i=1 2024-09-12T00:43:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.672+0000 7f815092a800 20 add_watcher() i=2 2024-09-12T00:43:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.672+0000 7f815092a800 20 add_watcher() i=3 2024-09-12T00:43:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.672+0000 7f815092a800 20 add_watcher() i=4 2024-09-12T00:43:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.672+0000 7f815092a800 20 add_watcher() i=5 2024-09-12T00:43:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.672+0000 7f815092a800 20 add_watcher() i=6 2024-09-12T00:43:50.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.673+0000 7f815092a800 20 add_watcher() i=7 2024-09-12T00:43:50.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.673+0000 7f815092a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.675+0000 7f8002fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.675+0000 7f815092a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.675+0000 7f815092a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.710+0000 7f8001fdb640 20 reqs_thread_entry: start 2024-09-12T00:43:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.710+0000 7f815092a800 20 init_complete bucket index max shards: 1 2024-09-12T00:43:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.710+0000 7f815092a800 20 Filter name: none 2024-09-12T00:43:50.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.710+0000 7f7f737fe640 20 reqs_thread_entry: start 2024-09-12T00:43:50.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.710+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:43:50.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.711+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.712+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.712+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.713+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:43:50.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.714+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.715+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.715+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.717+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:43:50.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.718+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.718+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.719+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.719+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:43:50.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.721+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.721+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.722+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.723+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:43:50.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.724+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.725+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.725+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.726+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:43:50.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.727+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.728+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.728+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.729+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:43:50.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.731+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.731+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.732+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.731 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.733+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:43:50.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.734+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.734+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.734+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.735+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:43:50.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.737+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.737+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.737+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.738+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:43:50.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.740+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.741+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.741+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.742+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:43:50.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.743+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.744+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.744+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.745+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:43:50.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.747+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.747+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.748+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.749+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:43:50.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.750+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.750+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.751+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.752+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:43:50.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.753+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.753+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.754+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.755+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:43:50.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.757+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.757+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.757+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.758+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:43:50.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.760+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.760+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.760+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.762+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:43:50.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.763+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.764+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.764+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.766+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:43:50.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.767+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.767+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.768+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.768+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:43:50.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.770+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.770+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.770+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.771+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:43:50.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.773+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.773+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.773+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.774+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:43:50.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.776+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.776+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.776+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.777+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:43:50.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.779+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.779+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.779+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.780+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:43:50.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.781+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.782+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.782+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.782 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.783+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:43:50.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.785+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.786+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.786+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.787+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:43:50.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.788+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.789+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.789+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.790+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:43:50.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.791+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.792+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.792+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.791 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.793+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:43:50.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.794+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.795+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.795+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.796+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:43:50.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.797+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.798+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.798+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.799+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:43:50.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.800+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.800+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.801+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.802+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:43:50.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.803+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.803+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.804+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.805+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:43:50.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.806+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.807+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.807+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.808+0000 7f815092a800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:43:50.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.809+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.810+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:50.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.810+0000 7f815092a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:50.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.812+0000 7f8002fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:50.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.814+0000 7f815092a800 20 remove_watcher() i=0 2024-09-12T00:43:50.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.814+0000 7f815092a800 2 removed watcher, disabling cache 2024-09-12T00:43:50.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.815+0000 7f815092a800 20 remove_watcher() i=1 2024-09-12T00:43:50.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.816+0000 7f815092a800 20 remove_watcher() i=2 2024-09-12T00:43:50.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.817+0000 7f815092a800 20 remove_watcher() i=3 2024-09-12T00:43:50.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.817+0000 7f815092a800 20 remove_watcher() i=4 2024-09-12T00:43:50.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.818+0000 7f815092a800 20 remove_watcher() i=5 2024-09-12T00:43:50.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.819+0000 7f815092a800 20 remove_watcher() i=6 2024-09-12T00:43:50.819 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.820+0000 7f815092a800 20 remove_watcher() i=7 2024-09-12T00:43:50.830 DEBUG:teuthology.orchestra.run.smithi133:> radosgw-admin gc process --include-all 2024-09-12T00:43:50.882 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:50.883 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.921+0000 7fd18f323800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.923+0000 7fd18f323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.923+0000 7fd18f323800 20 realm 2024-09-12T00:43:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.923+0000 7fd18f323800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.923+0000 7fd18f323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.923+0000 7fd18f323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.923+0000 7fd18f323800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.923+0000 7fd18f323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.923+0000 7fd18f323800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.924+0000 7fd18f323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:50.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.924+0000 7fd18f323800 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.924+0000 7fd18f323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:50.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.924+0000 7fd18f323800 20 searching for the correct realm 2024-09-12T00:43:50.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:50.926+0000 7fd183fff640 0 -- 172.21.15.133:0/492017015 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fd174085030 msgr2=0x7fd1740b7a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:51.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.132+0000 7fd183fff640 0 -- 172.21.15.133:0/492017015 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fd17c071f70 msgr2=0x7fd17c08d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.339+0000 7fd18f323800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:43:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.339+0000 7fd18f323800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:43:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.339+0000 7fd18f323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.339+0000 7fd18f323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.339+0000 7fd18f323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.339+0000 7fd18f323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.339+0000 7fd18f323800 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.339+0000 7fd18f323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.339+0000 7fd18f323800 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.340+0000 7fd18f323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.340+0000 7fd18f323800 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.340+0000 7fd18f323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.340+0000 7fd18f323800 20 zone default found 2024-09-12T00:43:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.340+0000 7fd18f323800 4 Realm: () 2024-09-12T00:43:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.340+0000 7fd18f323800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:43:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.340+0000 7fd18f323800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:43:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.340+0000 7fd18f323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.340+0000 7fd18f323800 20 zonegroup default 2024-09-12T00:43:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.340+0000 7fd18f323800 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.340+0000 7fd18f323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.340+0000 7fd18f323800 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.340+0000 7fd18f323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.340+0000 7fd18f323800 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.341+0000 7fd18f323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.341+0000 7fd18f323800 20 started sync module instance, tier type = 2024-09-12T00:43:51.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.341+0000 7fd18f323800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:43:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.349+0000 7fd18f323800 20 add_watcher() i=0 2024-09-12T00:43:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.349+0000 7fd18f323800 20 add_watcher() i=1 2024-09-12T00:43:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.349+0000 7fd18f323800 20 add_watcher() i=2 2024-09-12T00:43:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.349+0000 7fd18f323800 20 add_watcher() i=3 2024-09-12T00:43:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.349+0000 7fd18f323800 20 add_watcher() i=4 2024-09-12T00:43:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.349+0000 7fd18f323800 20 add_watcher() i=5 2024-09-12T00:43:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.349+0000 7fd18f323800 20 add_watcher() i=6 2024-09-12T00:43:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.350+0000 7fd18f323800 20 add_watcher() i=7 2024-09-12T00:43:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.350+0000 7fd18f323800 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:51.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.352+0000 7fd041fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:51.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.353+0000 7fd18f323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:51.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.353+0000 7fd18f323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.389+0000 7fd040fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.389+0000 7fd18f323800 20 init_complete bucket index max shards: 1 2024-09-12T00:43:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.389+0000 7fd18f323800 20 Filter name: none 2024-09-12T00:43:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.389+0000 7fcfba7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:51.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.389+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:43:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.390+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.391+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.391+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.392+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:43:51.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.393+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.394+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.394+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.395+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:43:51.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.396+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.397+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.397+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.398+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:43:51.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.399+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.400+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.400+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.401+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:43:51.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.402+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.403+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.403+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.404+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:43:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.405+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.406+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.406+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.407+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:43:51.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.409+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.409+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.410+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.411+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:43:51.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.412+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.412+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.413+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.414+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:43:51.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.415+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.415+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.415+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.417+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:43:51.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.418+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.418+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.418+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.419+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:43:51.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.421+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.421+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.421+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.422+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:43:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.424+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.424+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.425+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.426+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:43:51.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.427+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.427+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.428+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.429+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:43:51.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.430+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.430+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.431+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.431+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:43:51.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.433+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.433+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.433+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.435+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:43:51.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.436+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.436+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.437+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.438+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:43:51.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.439+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.439+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.440+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.441+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:43:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.442+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.442+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.442+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.443+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:43:51.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.444+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.445+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.445+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.446+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:43:51.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.448+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.448+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.449+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.450+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:43:51.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.451+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.451+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.452+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.453+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:43:51.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.454+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.455+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.455+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.456+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:43:51.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.457+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.458+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.458+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.459+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:43:51.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.460+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.461+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.461+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.462+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:43:51.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.463+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.463+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.464+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.465+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:43:51.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.466+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.467+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.467+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.468+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:43:51.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.469+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.470+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.470+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.471+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:43:51.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.472+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.473+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.473+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.474+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:43:51.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.476+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.476+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.477+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.478+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:43:51.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.479+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.480+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.480+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.481+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:43:51.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.482+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.482+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.483+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.483+0000 7fd18f323800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:43:51.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.485+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.485+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:51.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.485+0000 7fd18f323800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:51.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.487+0000 7fd041fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.489+0000 7fd18f323800 20 remove_watcher() i=0 2024-09-12T00:43:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.489+0000 7fd18f323800 2 removed watcher, disabling cache 2024-09-12T00:43:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.490+0000 7fd18f323800 20 remove_watcher() i=1 2024-09-12T00:43:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.491+0000 7fd18f323800 20 remove_watcher() i=2 2024-09-12T00:43:51.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.492+0000 7fd18f323800 20 remove_watcher() i=3 2024-09-12T00:43:51.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.493+0000 7fd18f323800 20 remove_watcher() i=4 2024-09-12T00:43:51.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.494+0000 7fd18f323800 20 remove_watcher() i=5 2024-09-12T00:43:51.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.495+0000 7fd18f323800 20 remove_watcher() i=6 2024-09-12T00:43:51.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:51.496+0000 7fd18f323800 20 remove_watcher() i=7 2024-09-12T00:43:51.505 DEBUG:teuthology.orchestra.run.smithi133:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T00:43:52.004 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :clean 2024-09-12T00:43:52.701 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :compileJava 2024-09-12T00:43:52.701 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :processResources 2024-09-12T00:43:52.702 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :classes 2024-09-12T00:43:53.201 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:53.201 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :compileTestJava 2024-09-12T00:43:53.202 INFO:teuthology.orchestra.run.smithi133.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:43:53.202 INFO:teuthology.orchestra.run.smithi133.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:43:53.203 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:53.203 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:43:53.203 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :testClasses 2024-09-12T00:43:55.202 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:55.202 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :test 2024-09-12T00:43:55.202 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:55.202 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T00:43:55.203 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12 00:43:54,443 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:43:55.203 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:55.203 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T00:43:55.203 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:55.203 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T00:43:55.203 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:55.203 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T00:43:55.203 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:55.203 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T00:43:55.203 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:55.203 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T00:43:55.301 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:55.301 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T00:43:55.600 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:55.601 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T00:43:55.700 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:55.701 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T00:43:55.800 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:55.801 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T00:43:55.900 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:55.901 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T00:43:56.201 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:56.201 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T00:43:56.301 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:56.301 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T00:43:56.401 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:56.401 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T00:43:56.501 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:56.501 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T00:43:57.001 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:57.001 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T00:43:57.101 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:57.101 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T00:43:57.300 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:57.300 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T00:43:57.400 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:57.401 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T00:43:57.502 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:57.502 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------- 2024-09-12T00:43:57.503 INFO:teuthology.orchestra.run.smithi133.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T00:43:57.503 INFO:teuthology.orchestra.run.smithi133.stdout:-------------------------------------------------------------------- 2024-09-12T00:43:57.503 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:57.503 INFO:teuthology.orchestra.run.smithi133.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:43:57.503 INFO:teuthology.orchestra.run.smithi133.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:43:57.503 INFO:teuthology.orchestra.run.smithi133.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:43:57.503 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:43:57.503 INFO:teuthology.orchestra.run.smithi133.stdout:BUILD SUCCESSFUL in 5s 2024-09-12T00:43:57.503 INFO:teuthology.orchestra.run.smithi133.stdout:5 actionable tasks: 5 executed 2024-09-12T00:43:57.514 DEBUG:teuthology.orchestra.run.smithi133:> radosgw-admin gc process --include-all 2024-09-12T00:43:57.566 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:57.566 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:57.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:57.808+0000 7fd3e100e800 20 rados->read ofs=0 len=0 2024-09-12T00:43:57.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:57.809+0000 7fd3e100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:57.808 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:57.809+0000 7fd3e100e800 20 realm 2024-09-12T00:43:57.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:57.809+0000 7fd3e100e800 20 rados->read ofs=0 len=0 2024-09-12T00:43:57.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:57.809+0000 7fd3e100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:57.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:57.809+0000 7fd3e100e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:57.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:57.809+0000 7fd3e100e800 20 rados->read ofs=0 len=0 2024-09-12T00:43:57.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:57.810+0000 7fd3e100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:57.809 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:57.810+0000 7fd3e100e800 20 rados->read ofs=0 len=0 2024-09-12T00:43:57.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:57.810+0000 7fd3e100e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:57.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:57.810+0000 7fd3e100e800 20 rados->read ofs=0 len=0 2024-09-12T00:43:57.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:57.811+0000 7fd3e100e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:57.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:57.811+0000 7fd3e100e800 20 searching for the correct realm 2024-09-12T00:43:57.812 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:57.813+0000 7fd3d3f6a640 0 -- 172.21.15.133:0/2930062067 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fd3c4093940 msgr2=0x7fd3c4088430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:58.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.019+0000 7fd3d3f6a640 0 -- 172.21.15.133:0/2930062067 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fd3cc029060 msgr2=0x7fd3cc083220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.227+0000 7fd3e100e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:43:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.227+0000 7fd3e100e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:43:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.227+0000 7fd3e100e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.227+0000 7fd3e100e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.227+0000 7fd3e100e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.227+0000 7fd3e100e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.227+0000 7fd3e100e800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.227+0000 7fd3e100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.227+0000 7fd3e100e800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.227+0000 7fd3e100e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:58.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.227+0000 7fd3e100e800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.228+0000 7fd3e100e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:58.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.228+0000 7fd3e100e800 20 zone default found 2024-09-12T00:43:58.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.228+0000 7fd3e100e800 4 Realm: () 2024-09-12T00:43:58.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.228+0000 7fd3e100e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:43:58.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.228+0000 7fd3e100e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:43:58.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.228+0000 7fd3e100e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:58.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.228+0000 7fd3e100e800 20 zonegroup default 2024-09-12T00:43:58.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.228+0000 7fd3e100e800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.228+0000 7fd3e100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:58.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.228+0000 7fd3e100e800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.228+0000 7fd3e100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:58.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.228+0000 7fd3e100e800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.229+0000 7fd3e100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:58.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.229+0000 7fd3e100e800 20 started sync module instance, tier type = 2024-09-12T00:43:58.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.229+0000 7fd3e100e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:43:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.239+0000 7fd3e100e800 20 add_watcher() i=0 2024-09-12T00:43:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.239+0000 7fd3e100e800 20 add_watcher() i=1 2024-09-12T00:43:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.239+0000 7fd3e100e800 20 add_watcher() i=2 2024-09-12T00:43:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.239+0000 7fd3e100e800 20 add_watcher() i=3 2024-09-12T00:43:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.239+0000 7fd3e100e800 20 add_watcher() i=4 2024-09-12T00:43:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.239+0000 7fd3e100e800 20 add_watcher() i=5 2024-09-12T00:43:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.239+0000 7fd3e100e800 20 add_watcher() i=6 2024-09-12T00:43:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.240+0000 7fd3e100e800 20 add_watcher() i=7 2024-09-12T00:43:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.240+0000 7fd3e100e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.242+0000 7fd292fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.242+0000 7fd3e100e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.242+0000 7fd3e100e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:58.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.281+0000 7fd291fe3640 20 reqs_thread_entry: start 2024-09-12T00:43:58.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.281+0000 7fd3e100e800 20 init_complete bucket index max shards: 1 2024-09-12T00:43:58.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.281+0000 7fd3e100e800 20 Filter name: none 2024-09-12T00:43:58.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.281+0000 7fd28affd640 20 reqs_thread_entry: start 2024-09-12T00:43:58.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.281+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:43:58.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.283+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.283+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.282 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.284+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.285+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:43:58.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.286+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.287+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.287+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.288+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:43:58.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.289+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.290+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.290+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.291+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:43:58.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.292+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.293+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.293+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.294+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:43:58.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.295+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.296+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.296+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.297+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:43:58.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.298+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.299+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.299+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.300+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:43:58.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.301+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.302+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.302+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.303+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:43:58.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.304+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.305+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.304 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.305+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.306+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:43:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.307+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.308+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.308+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.309+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:43:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.311+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.312+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.312+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.313+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:43:58.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.314+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.315+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.315+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.316+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:43:58.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.318+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.318+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.318+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.319+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:43:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.321+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.321+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.321+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.322+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:43:58.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.324+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.324+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.324+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.325+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:43:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.327+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.327+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.327+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.329+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:43:58.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.330+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.330+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.331+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.331+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:43:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.333+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.334+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.334+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.335+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:43:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.336+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.337+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.337+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.338+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:43:58.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.339+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.339+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.340+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.341+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:43:58.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.342+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.343+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.343+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.344+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:43:58.343 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.345+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.345+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.346+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.346+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:43:58.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.348+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.348+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.349+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.350+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:43:58.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.351+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.351+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.352+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.352+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:43:58.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.354+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.354+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.355+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.356+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:43:58.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.357+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.357+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.358+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:58.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.358+0000 7fd3e100e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7006261696575388641', time=2024-09-12T02:43:56.764033+0000, chain.objs.size()=1 2024-09-12T00:43:58.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.358+0000 7fd3e100e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.73__shadow_._9xagUYTIPLRhb9Vh1DMQtUm6su-HQX_0 2024-09-12T00:43:58.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.359+0000 7fd3e100e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.361+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:43:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.362+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.362+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.363+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.364+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:43:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.365+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.366+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.366+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.367+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:43:58.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.368+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.369+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.369+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.370+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:43:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.372+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.372+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.372+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.373+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:43:58.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.375+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.375+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.375+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:58.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.375+0000 7fd3e100e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14433706534499689796', time=2024-09-12T02:43:55.995369+0000, chain.objs.size()=1 2024-09-12T00:43:58.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.375+0000 7fd3e100e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.72__shadow_.1VZzygGxUXuy9z2D-ZnGVAiai85VSEd_0 2024-09-12T00:43:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.377+0000 7fd3e100e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:58.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.379+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:43:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.382+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.382+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.382+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.383+0000 7fd3e100e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:43:58.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.384+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.385+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.385+0000 7fd3e100e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.387+0000 7fd292fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.389+0000 7fd3e100e800 20 remove_watcher() i=0 2024-09-12T00:43:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.389+0000 7fd3e100e800 2 removed watcher, disabling cache 2024-09-12T00:43:58.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.390+0000 7fd3e100e800 20 remove_watcher() i=1 2024-09-12T00:43:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.391+0000 7fd3e100e800 20 remove_watcher() i=2 2024-09-12T00:43:58.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.392+0000 7fd3e100e800 20 remove_watcher() i=3 2024-09-12T00:43:58.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.393+0000 7fd3e100e800 20 remove_watcher() i=4 2024-09-12T00:43:58.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.394+0000 7fd3e100e800 20 remove_watcher() i=5 2024-09-12T00:43:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.395+0000 7fd3e100e800 20 remove_watcher() i=6 2024-09-12T00:43:58.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.396+0000 7fd3e100e800 20 remove_watcher() i=7 2024-09-12T00:43:58.406 DEBUG:teuthology.orchestra.run.smithi133:> radosgw-admin gc process --include-all 2024-09-12T00:43:58.458 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:58.458 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:58.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.496+0000 7f0df1936800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.498+0000 7f0df1936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.498+0000 7f0df1936800 20 realm 2024-09-12T00:43:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.498+0000 7f0df1936800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.498+0000 7f0df1936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.498+0000 7f0df1936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.498+0000 7f0df1936800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.498+0000 7f0df1936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.498+0000 7f0df1936800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.499+0000 7f0df1936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:58.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.499+0000 7f0df1936800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.499+0000 7f0df1936800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:58.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.500+0000 7f0df1936800 20 searching for the correct realm 2024-09-12T00:43:58.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.501+0000 7f0deceb6640 0 -- 172.21.15.133:0/4007926006 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f0de409b920 msgr2=0x7f0de408f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:58.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.707+0000 7f0deceb6640 0 -- 172.21.15.133:0/4007926006 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f0de0041270 msgr2=0x7f0de0087140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:58.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.914+0000 7f0df1936800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:43:58.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.914+0000 7f0df1936800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:43:58.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.914+0000 7f0df1936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:58.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.914+0000 7f0df1936800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:58.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.914+0000 7f0df1936800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:58.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.914+0000 7f0df1936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:58.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.914+0000 7f0df1936800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.914+0000 7f0df1936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:58.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.914+0000 7f0df1936800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.914+0000 7f0df1936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:58.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.914+0000 7f0df1936800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.915+0000 7f0df1936800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:58.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.915+0000 7f0df1936800 20 zone default found 2024-09-12T00:43:58.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.915+0000 7f0df1936800 4 Realm: () 2024-09-12T00:43:58.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.915+0000 7f0df1936800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:43:58.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.915+0000 7f0df1936800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:43:58.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.915+0000 7f0df1936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:58.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.915+0000 7f0df1936800 20 zonegroup default 2024-09-12T00:43:58.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.915+0000 7f0df1936800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.915+0000 7f0df1936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:58.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.915+0000 7f0df1936800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.915+0000 7f0df1936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:58.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.915+0000 7f0df1936800 20 rados->read ofs=0 len=0 2024-09-12T00:43:58.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.916+0000 7f0df1936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:58.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.916+0000 7f0df1936800 20 started sync module instance, tier type = 2024-09-12T00:43:58.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.916+0000 7f0df1936800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:43:58.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.925+0000 7f0df1936800 20 add_watcher() i=0 2024-09-12T00:43:58.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.925+0000 7f0df1936800 20 add_watcher() i=1 2024-09-12T00:43:58.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.925+0000 7f0df1936800 20 add_watcher() i=2 2024-09-12T00:43:58.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.925+0000 7f0df1936800 20 add_watcher() i=3 2024-09-12T00:43:58.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.925+0000 7f0df1936800 20 add_watcher() i=4 2024-09-12T00:43:58.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.925+0000 7f0df1936800 20 add_watcher() i=5 2024-09-12T00:43:58.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.925+0000 7f0df1936800 20 add_watcher() i=6 2024-09-12T00:43:58.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.926+0000 7f0df1936800 20 add_watcher() i=7 2024-09-12T00:43:58.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.926+0000 7f0df1936800 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:58.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.928+0000 7f0ca37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:58.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.928+0000 7f0df1936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:58.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.928+0000 7f0df1936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.965+0000 7f0ca27e4640 20 reqs_thread_entry: start 2024-09-12T00:43:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.965+0000 7f0df1936800 20 init_complete bucket index max shards: 1 2024-09-12T00:43:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.965+0000 7f0df1936800 20 Filter name: none 2024-09-12T00:43:58.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.965+0000 7f0c13fff640 20 reqs_thread_entry: start 2024-09-12T00:43:58.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.965+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:43:58.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.967+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.967+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.967+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.968+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:43:58.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.969+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.970+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.970+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.971+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:43:58.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.972+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.973+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.973+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.974+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:43:58.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.975+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.976+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.976+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.977+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:43:58.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.979+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.979+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.979+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.980+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:43:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.982+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.982+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.982+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.983+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:43:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.985+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.985+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.986+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.987+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:43:58.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.988+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.988+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.989+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.990+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:43:58.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.991+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.991+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.992+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.993+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:43:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.994+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.995+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.995+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.996+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:43:58.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.997+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.998+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.998+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:58.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:58.999+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:43:59.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.000+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.001+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.001+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.002+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:43:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.004+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.004+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.004+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.005+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:43:59.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.007+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.007+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.007+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.008+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:43:59.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.010+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.010+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.010+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.011+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:43:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.012+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.013+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.013+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.014+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:43:59.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.016+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.016+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.017+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.018+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:43:59.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.019+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.019+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.019+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.020+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:43:59.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.022+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.022+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.022+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.023+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:43:59.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.025+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.025+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.025+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.026+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:43:59.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.027+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.028+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.028+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.029+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:43:59.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.031+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.031+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.031+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.032+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:43:59.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.034+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.034+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.034+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.035+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:43:59.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.036+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.037+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.037+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.036 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.038+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:43:59.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.039+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.040+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.040+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.041+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:43:59.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.043+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.044+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.044+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.045+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:43:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.046+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.046+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.047+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.048+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:43:59.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.049+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.049+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.049+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.051+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:43:59.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.052+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.052+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.053+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.054+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:43:59.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.055+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.055+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.055+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.056+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:43:59.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.058+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.058+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.058+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.059+0000 7f0df1936800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:43:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.060+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.061+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.061+0000 7f0df1936800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.063+0000 7f0ca37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.065+0000 7f0df1936800 20 remove_watcher() i=0 2024-09-12T00:43:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.065+0000 7f0df1936800 2 removed watcher, disabling cache 2024-09-12T00:43:59.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.066+0000 7f0df1936800 20 remove_watcher() i=1 2024-09-12T00:43:59.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.067+0000 7f0df1936800 20 remove_watcher() i=2 2024-09-12T00:43:59.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.067+0000 7f0df1936800 20 remove_watcher() i=3 2024-09-12T00:43:59.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.068+0000 7f0df1936800 20 remove_watcher() i=4 2024-09-12T00:43:59.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.069+0000 7f0df1936800 20 remove_watcher() i=5 2024-09-12T00:43:59.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.070+0000 7f0df1936800 20 remove_watcher() i=6 2024-09-12T00:43:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.071+0000 7f0df1936800 20 remove_watcher() i=7 2024-09-12T00:43:59.081 DEBUG:teuthology.orchestra.run.smithi133:> radosgw-admin gc process --include-all 2024-09-12T00:43:59.134 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:59.134 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:59.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.172+0000 7efe1a8b9800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.173+0000 7efe1a8b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:59.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.173+0000 7efe1a8b9800 20 realm 2024-09-12T00:43:59.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.173+0000 7efe1a8b9800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.173+0000 7efe1a8b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:59.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.173+0000 7efe1a8b9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:59.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.173+0000 7efe1a8b9800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.173+0000 7efe1a8b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:59.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.173+0000 7efe1a8b9800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.174+0000 7efe1a8b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:59.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.174+0000 7efe1a8b9800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.175+0000 7efe1a8b9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:59.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.175+0000 7efe1a8b9800 20 searching for the correct realm 2024-09-12T00:43:59.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.177+0000 7efe18ba4640 0 -- 172.21.15.133:0/1664130101 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x55ccde128470 msgr2=0x55ccde12a880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:59.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.180+0000 7efe0ffff640 0 -- 172.21.15.133:0/1664130101 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7efe0806e2c0 msgr2=0x7efe08068b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.386+0000 7efe1a8b9800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:43:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.386+0000 7efe1a8b9800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:43:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.386+0000 7efe1a8b9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.386+0000 7efe1a8b9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.386+0000 7efe1a8b9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.386+0000 7efe1a8b9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.386+0000 7efe1a8b9800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.387+0000 7efe1a8b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.387+0000 7efe1a8b9800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.387+0000 7efe1a8b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:59.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.387+0000 7efe1a8b9800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.387+0000 7efe1a8b9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.387+0000 7efe1a8b9800 20 zone default found 2024-09-12T00:43:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.387+0000 7efe1a8b9800 4 Realm: () 2024-09-12T00:43:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.387+0000 7efe1a8b9800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:43:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.387+0000 7efe1a8b9800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:43:59.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.387+0000 7efe1a8b9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:59.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.387+0000 7efe1a8b9800 20 zonegroup default 2024-09-12T00:43:59.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.387+0000 7efe1a8b9800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.388+0000 7efe1a8b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:59.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.388+0000 7efe1a8b9800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.388+0000 7efe1a8b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:59.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.388+0000 7efe1a8b9800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.388+0000 7efe1a8b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:59.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.388+0000 7efe1a8b9800 20 started sync module instance, tier type = 2024-09-12T00:43:59.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.388+0000 7efe1a8b9800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:43:59.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.397+0000 7efe1a8b9800 20 add_watcher() i=0 2024-09-12T00:43:59.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.397+0000 7efe1a8b9800 20 add_watcher() i=1 2024-09-12T00:43:59.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.397+0000 7efe1a8b9800 20 add_watcher() i=2 2024-09-12T00:43:59.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.397+0000 7efe1a8b9800 20 add_watcher() i=3 2024-09-12T00:43:59.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.397+0000 7efe1a8b9800 20 add_watcher() i=4 2024-09-12T00:43:59.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.397+0000 7efe1a8b9800 20 add_watcher() i=5 2024-09-12T00:43:59.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.397+0000 7efe1a8b9800 20 add_watcher() i=6 2024-09-12T00:43:59.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.398+0000 7efe1a8b9800 20 add_watcher() i=7 2024-09-12T00:43:59.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.398+0000 7efe1a8b9800 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:59.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.400+0000 7efccefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.400+0000 7efe1a8b9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.400+0000 7efe1a8b9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.433+0000 7efccdfdb640 20 reqs_thread_entry: start 2024-09-12T00:43:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.433+0000 7efe1a8b9800 20 init_complete bucket index max shards: 1 2024-09-12T00:43:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.433+0000 7efe1a8b9800 20 Filter name: none 2024-09-12T00:43:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.433+0000 7efc3f7fe640 20 reqs_thread_entry: start 2024-09-12T00:43:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.433+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:43:59.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.435+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.435+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.435+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.437+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:43:59.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.438+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.439+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.439+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.441+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:43:59.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.442+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.442+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.442+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.443+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:43:59.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.445+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.445+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.445+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.446+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:43:59.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.447+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.448+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.448+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.449+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:43:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.450+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.451+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.451+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.452+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:43:59.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.453+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.453+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.454+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.455+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:43:59.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.456+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.456+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.457+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.458+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:43:59.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.459+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.459+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.460+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.461+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:43:59.460 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.462+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.462+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.462+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.463+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:43:59.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.464+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.465+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.465+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.466+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:43:59.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.467+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.468+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.468+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.469+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:43:59.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.471+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.471+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.471+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.472+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:43:59.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.474+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.474+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.474+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.475+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:43:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.476+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.476+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.477+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.478+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:43:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.479+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.480+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.480+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.481+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:43:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.482+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.483+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.483+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.484+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:43:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.485+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.485+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.485+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.486+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:43:59.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.488+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.488+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.488+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.489+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:43:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.491+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.491+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.491+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.492+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:43:59.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.494+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.494+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.494+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.495+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:43:59.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.496+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.497+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.497+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.498+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:43:59.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.499+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.500+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.500+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.501+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:43:59.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.502+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.502+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.503+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.503+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:43:59.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.505+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.506+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.506+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.507+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:43:59.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.509+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.509+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.509+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.510+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:43:59.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.512+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.512+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.512+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.513+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:43:59.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.515+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.515+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.515+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.516+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:43:59.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.518+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.518+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.518+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.519+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:43:59.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.521+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.521+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.521+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.522+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:43:59.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.524+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.524+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.524+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.525+0000 7efe1a8b9800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:43:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.526+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.527+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.527+0000 7efe1a8b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.529+0000 7efccefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.532+0000 7efe1a8b9800 20 remove_watcher() i=0 2024-09-12T00:43:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.532+0000 7efe1a8b9800 2 removed watcher, disabling cache 2024-09-12T00:43:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.533+0000 7efe1a8b9800 20 remove_watcher() i=1 2024-09-12T00:43:59.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.534+0000 7efe1a8b9800 20 remove_watcher() i=2 2024-09-12T00:43:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.535+0000 7efe1a8b9800 20 remove_watcher() i=3 2024-09-12T00:43:59.534 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.536+0000 7efe1a8b9800 20 remove_watcher() i=4 2024-09-12T00:43:59.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.537+0000 7efe1a8b9800 20 remove_watcher() i=5 2024-09-12T00:43:59.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.538+0000 7efe1a8b9800 20 remove_watcher() i=6 2024-09-12T00:43:59.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.539+0000 7efe1a8b9800 20 remove_watcher() i=7 2024-09-12T00:43:59.549 DEBUG:teuthology.orchestra.run.smithi133:> radosgw-admin gc process --include-all 2024-09-12T00:43:59.602 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:59.602 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:59.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.641+0000 7f45f3f32800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.642+0000 7f45f3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:59.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.642+0000 7f45f3f32800 20 realm 2024-09-12T00:43:59.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.642+0000 7f45f3f32800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.642+0000 7f45f3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:59.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.642+0000 7f45f3f32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:59.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.642+0000 7f45f3f32800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.643+0000 7f45f3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:59.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.643+0000 7f45f3f32800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.643+0000 7f45f3f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:59.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.643+0000 7f45f3f32800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.644+0000 7f45f3f32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:59.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.644+0000 7f45f3f32800 20 searching for the correct realm 2024-09-12T00:43:59.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.646+0000 7f45e7fff640 0 -- 172.21.15.133:0/4153956596 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f45d8008410 msgr2=0x7f45d8008890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:59.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.649+0000 7f45e7fff640 0 -- 172.21.15.133:0/4153956596 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f45e00b5c50 msgr2=0x7f45e00a6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:59.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.856+0000 7f45f3f32800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:43:59.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.856+0000 7f45f3f32800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:43:59.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.856+0000 7f45f3f32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:59.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.856+0000 7f45f3f32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.856+0000 7f45f3f32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.856+0000 7f45f3f32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.856+0000 7f45f3f32800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.856+0000 7f45f3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.856+0000 7f45f3f32800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.856+0000 7f45f3f32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.856+0000 7f45f3f32800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.857+0000 7f45f3f32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.857+0000 7f45f3f32800 20 zone default found 2024-09-12T00:43:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.857+0000 7f45f3f32800 4 Realm: () 2024-09-12T00:43:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.857+0000 7f45f3f32800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:43:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.857+0000 7f45f3f32800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:43:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.857+0000 7f45f3f32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.857+0000 7f45f3f32800 20 zonegroup default 2024-09-12T00:43:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.857+0000 7f45f3f32800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.857+0000 7f45f3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:59.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.857+0000 7f45f3f32800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.858+0000 7f45f3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:59.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.858+0000 7f45f3f32800 20 rados->read ofs=0 len=0 2024-09-12T00:43:59.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.858+0000 7f45f3f32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:59.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.858+0000 7f45f3f32800 20 started sync module instance, tier type = 2024-09-12T00:43:59.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.858+0000 7f45f3f32800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:43:59.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.867+0000 7f45f3f32800 20 add_watcher() i=0 2024-09-12T00:43:59.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.867+0000 7f45f3f32800 20 add_watcher() i=1 2024-09-12T00:43:59.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.867+0000 7f45f3f32800 20 add_watcher() i=2 2024-09-12T00:43:59.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.867+0000 7f45f3f32800 20 add_watcher() i=3 2024-09-12T00:43:59.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.867+0000 7f45f3f32800 20 add_watcher() i=4 2024-09-12T00:43:59.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.867+0000 7f45f3f32800 20 add_watcher() i=5 2024-09-12T00:43:59.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.867+0000 7f45f3f32800 20 add_watcher() i=6 2024-09-12T00:43:59.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.868+0000 7f45f3f32800 20 add_watcher() i=7 2024-09-12T00:43:59.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.868+0000 7f45f3f32800 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:59.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.869+0000 7f44a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:59.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.870+0000 7f45f3f32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:59.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.870+0000 7f45f3f32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:59.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.905+0000 7f44a4fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:59.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.905+0000 7f45f3f32800 20 init_complete bucket index max shards: 1 2024-09-12T00:43:59.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.905+0000 7f45f3f32800 20 Filter name: none 2024-09-12T00:43:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.905+0000 7f441e7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.905+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:43:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.906+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.907+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.907+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.908+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:43:59.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.909+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.910+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.910+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.911+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:43:59.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.912+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.912+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.913+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.914+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:43:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.915+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.915+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.915+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.916+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:43:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.918+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.918+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.918+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.919+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:43:59.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.920+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.921+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.921+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.922+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:43:59.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.923+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.924+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.924+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.925+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:43:59.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.926+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.926+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.927+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.928+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:43:59.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.929+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.930+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.930+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.931+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:43:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.932+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.932+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.932+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.934+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:43:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.935+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.935+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.936+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.937+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:43:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.938+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.938+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.938+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.939+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:43:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.940+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.941+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.941+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.942+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:43:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.943+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.943+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.944+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.945+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:43:59.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.946+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.946+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.946+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.947+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:43:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.949+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.949+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.949+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.950+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:43:59.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.952+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.953+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.953+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.954+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:43:59.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.955+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.956+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.956+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.957+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:43:59.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.958+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.958+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.959+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.959+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:43:59.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.961+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.961+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.962+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.963+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:43:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.964+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.965+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.965+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.966+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:43:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.967+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.968+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.968+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.969+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:43:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.970+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.971+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.971+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.972+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:43:59.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.973+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.973+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.974+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.975+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:43:59.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.976+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.977+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.977+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.978+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:43:59.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.979+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.980+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.980+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.981+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:43:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.982+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.983+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.983+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.984+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:43:59.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.985+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.986+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.986+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.987+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:43:59.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.989+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.989+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.989+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.990+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:43:59.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.992+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.992+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.992+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.993+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:43:59.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.994+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.995+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.995+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.996+0000 7f45f3f32800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:43:59.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.997+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.998+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:59.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:43:59.998+0000 7f45f3f32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:59.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:44:00.000+0000 7f44a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:00.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:44:00.002+0000 7f45f3f32800 20 remove_watcher() i=0 2024-09-12T00:44:00.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:44:00.002+0000 7f45f3f32800 2 removed watcher, disabling cache 2024-09-12T00:44:00.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:44:00.003+0000 7f45f3f32800 20 remove_watcher() i=1 2024-09-12T00:44:00.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:44:00.004+0000 7f45f3f32800 20 remove_watcher() i=2 2024-09-12T00:44:00.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:44:00.005+0000 7f45f3f32800 20 remove_watcher() i=3 2024-09-12T00:44:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:44:00.006+0000 7f45f3f32800 20 remove_watcher() i=4 2024-09-12T00:44:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:44:00.007+0000 7f45f3f32800 20 remove_watcher() i=5 2024-09-12T00:44:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:44:00.008+0000 7f45f3f32800 20 remove_watcher() i=6 2024-09-12T00:44:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:44:00.009+0000 7f45f3f32800 20 remove_watcher() i=7 2024-09-12T00:44:00.019 DEBUG:teuthology.orchestra.run.smithi133:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T00:44:00.506 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :clean 2024-09-12T00:44:01.202 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :compileJava 2024-09-12T00:44:01.202 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :processResources 2024-09-12T00:44:01.202 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :classes 2024-09-12T00:44:01.702 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:01.702 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :compileTestJava 2024-09-12T00:44:01.702 INFO:teuthology.orchestra.run.smithi133.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:44:01.703 INFO:teuthology.orchestra.run.smithi133.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:44:01.704 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:01.704 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:44:01.704 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :testClasses 2024-09-12T00:44:03.702 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:03.703 INFO:teuthology.orchestra.run.smithi133.stdout:> Task :test 2024-09-12T00:44:03.703 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:03.703 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests STANDARD_OUT 2024-09-12T00:44:03.703 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12 00:44:02,953 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:44:03.703 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:03.703 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T00:44:03.703 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:03.704 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T00:44:03.704 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:03.704 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T00:44:03.802 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:03.802 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T00:44:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:04.101 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T00:44:04.202 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:04.202 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T00:44:04.401 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:04.402 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T00:44:06.902 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:06.902 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T00:44:07.102 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:07.102 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T00:44:07.212 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:07.212 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T00:44:07.502 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:07.502 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T00:44:07.702 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:07.702 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T00:44:08.002 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:08.002 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T00:44:08.002 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:08.002 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T00:44:08.102 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:08.102 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T00:44:08.102 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:08.102 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T00:44:08.401 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:08.402 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T00:44:10.002 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:10.002 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T00:44:10.302 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:10.302 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T00:44:10.302 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:10.303 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T00:44:10.601 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:10.602 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T00:44:10.701 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:10.702 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T00:44:11.001 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:11.001 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T00:44:11.102 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:11.102 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T00:44:11.301 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:11.302 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T00:44:11.402 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:11.402 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T00:44:11.701 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:11.702 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T00:44:11.801 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:11.801 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T00:44:12.102 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:12.102 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T00:44:12.102 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:12.102 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T00:44:12.402 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:12.402 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T00:44:12.602 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:12.602 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T00:44:12.901 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:12.902 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T00:44:14.901 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:14.902 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T00:44:15.401 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:15.402 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T00:44:44.502 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:44.503 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T00:44:44.901 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:44.902 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T00:44:45.002 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:45.002 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T00:44:45.301 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:45.302 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T00:44:45.302 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:45.302 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T00:44:45.801 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:45.802 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T00:44:47.901 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:47.901 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T00:44:48.201 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:48.202 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T00:44:48.301 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:48.302 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T00:44:48.401 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:48.402 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T00:44:51.402 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:51.402 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T00:44:51.701 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:44:51.702 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:45:04.101 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:45:04.102 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:45:04.601 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:45:04.602 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T00:45:14.702 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:45:14.702 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T00:45:15.001 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:45:15.001 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T00:46:01.002 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:01.003 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T00:46:01.401 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:01.402 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T00:46:04.501 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:04.502 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T00:46:04.801 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:04.802 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T00:46:06.701 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:06.702 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T00:46:07.001 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:07.001 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T00:46:09.101 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:09.101 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T00:46:16.602 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:16.602 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T00:46:16.901 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:16.901 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T00:46:17.501 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:17.501 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T00:46:17.601 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T00:46:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:17.902 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T00:46:17.902 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:17.902 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T00:46:18.201 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:18.202 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T00:46:18.302 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:18.302 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T00:46:18.602 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:18.602 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T00:46:18.602 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:18.602 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T00:46:18.901 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:18.902 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T00:46:19.002 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:19.002 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T00:46:19.301 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:19.302 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T00:46:19.401 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:19.402 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T00:46:19.701 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:19.702 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T00:46:19.901 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:19.902 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T00:46:20.201 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:20.201 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T00:46:20.501 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:20.502 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T00:46:20.801 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:20.802 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T00:46:21.001 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:21.002 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T00:46:21.401 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:21.401 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T00:46:21.601 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:21.601 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T00:46:22.001 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:22.001 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T00:46:22.201 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:22.201 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T00:46:22.601 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:22.602 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T00:46:22.801 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:22.801 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T00:46:23.201 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:23.202 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T00:46:23.401 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:23.402 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T00:46:23.701 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:23.701 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T00:46:23.901 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:23.901 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T00:46:24.301 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:24.301 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T00:46:24.501 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:24.501 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T00:46:24.901 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:24.901 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T00:46:25.101 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:25.102 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T00:46:25.501 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:25.501 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T00:46:25.701 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:25.701 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T00:46:26.102 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:26.102 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T00:46:26.201 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:26.201 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T00:46:26.601 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:26.602 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T00:46:26.801 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:26.802 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T00:46:27.101 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:27.102 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T00:46:27.301 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:27.302 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T00:46:27.701 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:27.702 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T00:46:27.901 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:27.902 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T00:46:28.301 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:28.302 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T00:46:28.501 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:28.502 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T00:46:28.901 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:28.901 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T00:46:29.101 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:29.101 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T00:46:29.401 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:29.401 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T00:46:29.701 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:29.702 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T00:46:30.001 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:30.001 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T00:46:30.201 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:30.201 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T00:46:30.501 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:30.501 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T00:46:30.701 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:30.702 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T00:46:31.101 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:31.101 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T00:46:31.301 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:31.301 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T00:46:31.601 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:31.601 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T00:46:31.801 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:31.802 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T00:46:32.101 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:32.101 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T00:46:32.201 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:32.202 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T00:46:32.502 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:32.502 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T00:46:32.601 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:32.602 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T00:46:32.801 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:32.802 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T00:46:32.902 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:32.902 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T00:46:33.201 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:33.201 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T00:46:33.301 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:33.302 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T00:46:33.501 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:33.502 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T00:46:33.801 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:33.802 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T00:46:34.101 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:34.102 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T00:46:34.102 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:34.102 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T00:46:34.201 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:34.201 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T00:46:34.301 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:34.302 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T00:46:34.605 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:34.605 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T00:46:34.801 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:34.801 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T00:46:35.101 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:35.102 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T00:46:35.401 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:35.402 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T00:46:35.701 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:35.701 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T00:46:35.801 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:35.802 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T00:46:36.101 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:36.101 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T00:46:38.101 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:38.102 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T00:46:38.401 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:38.401 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T00:46:49.201 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:49.202 INFO:teuthology.orchestra.run.smithi133.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T00:46:49.502 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:49.502 INFO:teuthology.orchestra.run.smithi133.stdout:---------------------------------------------------------------------- 2024-09-12T00:46:49.503 INFO:teuthology.orchestra.run.smithi133.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T00:46:49.503 INFO:teuthology.orchestra.run.smithi133.stdout:---------------------------------------------------------------------- 2024-09-12T00:46:49.503 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:49.503 INFO:teuthology.orchestra.run.smithi133.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:46:49.503 INFO:teuthology.orchestra.run.smithi133.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:46:49.503 INFO:teuthology.orchestra.run.smithi133.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:46:49.503 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:49.503 INFO:teuthology.orchestra.run.smithi133.stdout:BUILD SUCCESSFUL in 2m 49s 2024-09-12T00:46:49.503 INFO:teuthology.orchestra.run.smithi133.stdout:5 actionable tasks: 5 executed 2024-09-12T00:46:49.513 DEBUG:teuthology.orchestra.run.smithi133:> radosgw-admin gc process --include-all 2024-09-12T00:46:49.565 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:49.566 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:49.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.604+0000 7f60c3136800 20 rados->read ofs=0 len=0 2024-09-12T00:46:49.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.606+0000 7f60c3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:49.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.606+0000 7f60c3136800 20 realm 2024-09-12T00:46:49.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.606+0000 7f60c3136800 20 rados->read ofs=0 len=0 2024-09-12T00:46:49.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.606+0000 7f60c3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:49.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.606+0000 7f60c3136800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:49.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.606+0000 7f60c3136800 20 rados->read ofs=0 len=0 2024-09-12T00:46:49.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.606+0000 7f60c3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:49.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.606+0000 7f60c3136800 20 rados->read ofs=0 len=0 2024-09-12T00:46:49.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.607+0000 7f60c3136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:49.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.607+0000 7f60c3136800 20 rados->read ofs=0 len=0 2024-09-12T00:46:49.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.608+0000 7f60c3136800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:49.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.608+0000 7f60c3136800 20 searching for the correct realm 2024-09-12T00:46:49.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.610+0000 7f60be6b6640 0 -- 172.21.15.133:0/2726629760 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f60b406b030 msgr2=0x7f60b40569e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:49.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.614+0000 7f60be6b6640 0 -- 172.21.15.133:0/2726629760 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f60b0027040 msgr2=0x7f60b0028430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.821+0000 7f60c3136800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:46:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.821+0000 7f60c3136800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:46:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.821+0000 7f60c3136800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.821+0000 7f60c3136800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.821+0000 7f60c3136800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.821+0000 7f60c3136800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.821+0000 7f60c3136800 20 rados->read ofs=0 len=0 2024-09-12T00:46:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.822+0000 7f60c3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.822+0000 7f60c3136800 20 rados->read ofs=0 len=0 2024-09-12T00:46:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.822+0000 7f60c3136800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.822+0000 7f60c3136800 20 rados->read ofs=0 len=0 2024-09-12T00:46:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.822+0000 7f60c3136800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.822+0000 7f60c3136800 20 zone default found 2024-09-12T00:46:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.822+0000 7f60c3136800 4 Realm: () 2024-09-12T00:46:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.822+0000 7f60c3136800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:46:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.822+0000 7f60c3136800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:46:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.822+0000 7f60c3136800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.822+0000 7f60c3136800 20 zonegroup default 2024-09-12T00:46:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.822+0000 7f60c3136800 20 rados->read ofs=0 len=0 2024-09-12T00:46:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.823+0000 7f60c3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.823+0000 7f60c3136800 20 rados->read ofs=0 len=0 2024-09-12T00:46:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.823+0000 7f60c3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.823+0000 7f60c3136800 20 rados->read ofs=0 len=0 2024-09-12T00:46:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.823+0000 7f60c3136800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.823+0000 7f60c3136800 20 started sync module instance, tier type = 2024-09-12T00:46:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.823+0000 7f60c3136800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:46:49.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.833+0000 7f60c3136800 20 add_watcher() i=0 2024-09-12T00:46:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.833+0000 7f60c3136800 20 add_watcher() i=1 2024-09-12T00:46:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.833+0000 7f60c3136800 20 add_watcher() i=2 2024-09-12T00:46:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.833+0000 7f60c3136800 20 add_watcher() i=3 2024-09-12T00:46:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.833+0000 7f60c3136800 20 add_watcher() i=4 2024-09-12T00:46:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.833+0000 7f60c3136800 20 add_watcher() i=5 2024-09-12T00:46:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.833+0000 7f60c3136800 20 add_watcher() i=6 2024-09-12T00:46:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.835+0000 7f60c3136800 20 add_watcher() i=7 2024-09-12T00:46:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.835+0000 7f60c3136800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:49.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.836+0000 7f5f757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:49.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.837+0000 7f60c3136800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:49.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.837+0000 7f60c3136800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:49.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.874+0000 7f5eeffff640 20 reqs_thread_entry: start 2024-09-12T00:46:49.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.874+0000 7f60c3136800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.874+0000 7f60c3136800 20 Filter name: none 2024-09-12T00:46:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.874+0000 7f5eedffb640 20 reqs_thread_entry: start 2024-09-12T00:46:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.874+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:46:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.876+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:49.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.876+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:49.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.876+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:46:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.876+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9874613240259523832', time=2024-09-12T02:46:21.694914+0000, chain.objs.size()=1 2024-09-12T00:46:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.876+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.116__shadow_.tNfO5r_VhseDkiNcdGUg_ZOq9-EqtRg_0 2024-09-12T00:46:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.876+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11521653131106784886', time=2024-09-12T02:46:24.050201+0000, chain.objs.size()=1 2024-09-12T00:46:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.876+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.120__shadow_.Gs0K0R09IWBwFEV2iU15gMyzyIZJV7d_0 2024-09-12T00:46:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.876+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16585600934620871229', time=2024-09-12T02:46:26.876578+0000, chain.objs.size()=1 2024-09-12T00:46:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.876+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.125__shadow_._73vFr8KPERBVe6P2kKwF_TqWhH5B4C_0 2024-09-12T00:46:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.876+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18002584764882853416', time=2024-09-12T02:46:29.814943+0000, chain.objs.size()=1 2024-09-12T00:46:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.876+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.130__shadow_.YKc3HnGzmUvoJ73IY3_2OUrc_9ArHEc_0 2024-09-12T00:46:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.876+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6816421849058405367', time=2024-09-12T02:46:34.838372+0000, chain.objs.size()=1 2024-09-12T00:46:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.876+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.141__shadow_.aaoLpmXR2HfwggzA4lVHTIquPo05rjB_0 2024-09-12T00:46:49.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.879+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:49.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.881+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:46:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.882+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.883+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:49.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.883+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:49.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.884+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:46:49.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.885+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:49.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:49.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:46:49.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14640739403789494740', time=2024-09-12T02:44:44.730432+0000, chain.objs.size()=6 2024-09-12T00:46:49.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.94__shadow_.tAlcmBxmVrF55zvl29dQ6Tqa1EisKr__0 2024-09-12T00:46:49.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.94__shadow_.tAlcmBxmVrF55zvl29dQ6Tqa1EisKr__1 2024-09-12T00:46:49.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.94__shadow_.tAlcmBxmVrF55zvl29dQ6Tqa1EisKr__2 2024-09-12T00:46:49.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.94__shadow_.tAlcmBxmVrF55zvl29dQ6Tqa1EisKr__3 2024-09-12T00:46:49.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.94__shadow_.tAlcmBxmVrF55zvl29dQ6Tqa1EisKr__4 2024-09-12T00:46:49.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.94__shadow_.tAlcmBxmVrF55zvl29dQ6Tqa1EisKr__5 2024-09-12T00:46:49.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14354143360711528456', time=2024-09-12T02:45:36.055956+0000, chain.objs.size()=9 2024-09-12T00:46:49.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~FWYAIAOwstUuxBHd25bmIH86-Qifb4x.1 2024-09-12T00:46:49.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~FWYAIAOwstUuxBHd25bmIH86-Qifb4x.1_1 2024-09-12T00:46:49.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~FWYAIAOwstUuxBHd25bmIH86-Qifb4x.2 2024-09-12T00:46:49.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~FWYAIAOwstUuxBHd25bmIH86-Qifb4x.2_1 2024-09-12T00:46:49.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~FWYAIAOwstUuxBHd25bmIH86-Qifb4x.3 2024-09-12T00:46:49.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.886+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~FWYAIAOwstUuxBHd25bmIH86-Qifb4x.3_1 2024-09-12T00:46:49.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.890+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~FWYAIAOwstUuxBHd25bmIH86-Qifb4x.4 2024-09-12T00:46:49.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.890+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~FWYAIAOwstUuxBHd25bmIH86-Qifb4x.4_1 2024-09-12T00:46:49.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.890+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~FWYAIAOwstUuxBHd25bmIH86-Qifb4x.5 2024-09-12T00:46:49.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.890+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6621979923102843756', time=2024-09-12T02:45:46.586201+0000, chain.objs.size()=9 2024-09-12T00:46:49.889 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.890+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~JmTJldz107AlZ1DPIkrIV8JgVnuQt1Z.1 2024-09-12T00:46:49.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.891+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~JmTJldz107AlZ1DPIkrIV8JgVnuQt1Z.1_1 2024-09-12T00:46:49.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.891+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~JmTJldz107AlZ1DPIkrIV8JgVnuQt1Z.2 2024-09-12T00:46:49.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.891+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~JmTJldz107AlZ1DPIkrIV8JgVnuQt1Z.2_1 2024-09-12T00:46:49.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.891+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~JmTJldz107AlZ1DPIkrIV8JgVnuQt1Z.3 2024-09-12T00:46:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.891+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~JmTJldz107AlZ1DPIkrIV8JgVnuQt1Z.3_1 2024-09-12T00:46:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.891+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~JmTJldz107AlZ1DPIkrIV8JgVnuQt1Z.4 2024-09-12T00:46:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.891+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~JmTJldz107AlZ1DPIkrIV8JgVnuQt1Z.4_1 2024-09-12T00:46:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.892+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~JmTJldz107AlZ1DPIkrIV8JgVnuQt1Z.5 2024-09-12T00:46:49.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.893+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5788039240320393913', time=2024-09-12T02:46:22.277850+0000, chain.objs.size()=1 2024-09-12T00:46:49.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.893+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.117__shadow_.5Xak8UGTu6FttMZjIvdJrtfIwG5_1bz_0 2024-09-12T00:46:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.896+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9235316138020173206', time=2024-09-12T02:46:27.408452+0000, chain.objs.size()=1 2024-09-12T00:46:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.896+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.126__shadow_.ZmiepCjgNymohpPzTesc1u2NGMxRjXC_0 2024-09-12T00:46:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.896+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1187325293485591762', time=2024-09-12T02:46:30.870178+0000, chain.objs.size()=1 2024-09-12T00:46:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.896+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.132__shadow_.JK12LbNn9Aq-55101yXwhexPf3TiXJu_0 2024-09-12T00:46:49.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.899+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:49.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.901+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:46:49.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.902+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:49.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:49.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:46:49.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4106521446595612443', time=2024-09-12T02:46:03.459294+0000, chain.objs.size()=1 2024-09-12T00:46:49.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.104__shadow_.yoYxVV0eXn474OXxS3Vouu493vKHEeu_0 2024-09-12T00:46:49.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4', time=2024-09-12T02:46:14.692078+0000, chain.objs.size()=1 2024-09-12T00:46:49.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.15 2024-09-12T00:46:49.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4', time=2024-09-12T02:46:14.721047+0000, chain.objs.size()=1 2024-09-12T00:46:49.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.18 2024-09-12T00:46:49.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4', time=2024-09-12T02:46:14.766997+0000, chain.objs.size()=1 2024-09-12T00:46:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.20 2024-09-12T00:46:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4', time=2024-09-12T02:46:14.818584+0000, chain.objs.size()=38 2024-09-12T00:46:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.1 2024-09-12T00:46:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.2 2024-09-12T00:46:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.3 2024-09-12T00:46:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.4 2024-09-12T00:46:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.5 2024-09-12T00:46:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.6 2024-09-12T00:46:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.7 2024-09-12T00:46:49.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.903+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.8 2024-09-12T00:46:49.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.907+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.9 2024-09-12T00:46:49.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.907+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.10 2024-09-12T00:46:49.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.907+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.11 2024-09-12T00:46:49.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.907+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.12 2024-09-12T00:46:49.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.907+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.13 2024-09-12T00:46:49.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.908+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.14 2024-09-12T00:46:49.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.908+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.mKspo4B5DbaLk0Q4COfcTjlG7ix_9qSJ.15 2024-09-12T00:46:49.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.908+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.16 2024-09-12T00:46:49.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.908+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.17 2024-09-12T00:46:49.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.908+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.763guoHRU4y5hHUxK1-H20LRPcEkhIa0.18 2024-09-12T00:46:49.907 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.908+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.19 2024-09-12T00:46:49.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.910+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.dAuIodVMMSfni6owiVaDEBKXKrtHntBF.20 2024-09-12T00:46:49.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.910+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.21 2024-09-12T00:46:49.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.912+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.22 2024-09-12T00:46:49.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.912+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.23 2024-09-12T00:46:49.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.913+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.24 2024-09-12T00:46:49.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.913+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.25 2024-09-12T00:46:49.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.914+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.26 2024-09-12T00:46:49.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.914+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.27 2024-09-12T00:46:49.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.914+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.28 2024-09-12T00:46:49.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.914+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.29 2024-09-12T00:46:49.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.914+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.30 2024-09-12T00:46:49.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.914+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.31 2024-09-12T00:46:49.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.914+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.32 2024-09-12T00:46:49.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.917+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.33 2024-09-12T00:46:49.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.917+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.34 2024-09-12T00:46:49.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.917+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.35 2024-09-12T00:46:49.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.917+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.36 2024-09-12T00:46:49.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.917+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.37 2024-09-12T00:46:49.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.919+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.106__multipart_key1.2~FUCxP3JQ_FGACh5Xw8G69CPYxHgJyg4.38 2024-09-12T00:46:49.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.920+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2724146463051238734', time=2024-09-12T02:46:25.822395+0000, chain.objs.size()=1 2024-09-12T00:46:49.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.920+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.123__shadow_.JDnpuJKZeHfvLsLCcBiNPA-Mhu9tZu3_0 2024-09-12T00:46:49.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.920+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12680412012784729914', time=2024-09-12T02:46:27.434415+0000, chain.objs.size()=1 2024-09-12T00:46:49.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.920+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.126__shadow_.K41L7FjDpsQvVVG1_wG0TFCqCSKUNdH_0 2024-09-12T00:46:49.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.920+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16585675083516512413', time=2024-09-12T02:46:28.562186+0000, chain.objs.size()=1 2024-09-12T00:46:49.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.920+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.128__shadow_.ItTxGLpK6wxCgObKIjXXUvBbkd_5eqx_0 2024-09-12T00:46:49.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.921+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8657404329055862860', time=2024-09-12T02:46:30.340805+0000, chain.objs.size()=1 2024-09-12T00:46:49.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.921+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.131__shadow_.ETnKXC7kd20h7QuGgSpIX-A5k2xUItL_0 2024-09-12T00:46:49.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.924+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:49.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.926+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:46:49.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.927+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:49.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:49.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:46:49.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2159119053358107784', time=2024-09-12T02:44:12.458755+0000, chain.objs.size()=1 2024-09-12T00:46:49.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.91__shadow_.-AYcYj3EP6FfguaV73gkNSOLvn8CdB-_0 2024-09-12T00:46:49.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6808258042333304020', time=2024-09-12T02:46:00.947172+0000, chain.objs.size()=7 2024-09-12T00:46:49.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~mxw_GX4_8PWORs8Ms5EV7qGlPHARWTL.1 2024-09-12T00:46:49.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~mxw_GX4_8PWORs8Ms5EV7qGlPHARWTL.1_1 2024-09-12T00:46:49.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~mxw_GX4_8PWORs8Ms5EV7qGlPHARWTL.1_2 2024-09-12T00:46:49.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~mxw_GX4_8PWORs8Ms5EV7qGlPHARWTL.2 2024-09-12T00:46:49.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~mxw_GX4_8PWORs8Ms5EV7qGlPHARWTL.2_1 2024-09-12T00:46:49.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~mxw_GX4_8PWORs8Ms5EV7qGlPHARWTL.2_2 2024-09-12T00:46:49.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~mxw_GX4_8PWORs8Ms5EV7qGlPHARWTL.3 2024-09-12T00:46:49.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.361105630752306943', time=2024-09-12T02:46:04.558622+0000, chain.objs.size()=9 2024-09-12T00:46:49.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.104__multipart_key1.2~1lwRf3FiKz4CyqWR7iikkMc0Jz0ZtVz.1 2024-09-12T00:46:49.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.104__shadow_key1.2~1lwRf3FiKz4CyqWR7iikkMc0Jz0ZtVz.1_1 2024-09-12T00:46:49.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.104__multipart_key1.2~1lwRf3FiKz4CyqWR7iikkMc0Jz0ZtVz.2 2024-09-12T00:46:49.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.928+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.104__shadow_key1.2~1lwRf3FiKz4CyqWR7iikkMc0Jz0ZtVz.2_1 2024-09-12T00:46:49.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.932+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.104__multipart_key1.2~1lwRf3FiKz4CyqWR7iikkMc0Jz0ZtVz.3 2024-09-12T00:46:49.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.932+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.104__shadow_key1.2~1lwRf3FiKz4CyqWR7iikkMc0Jz0ZtVz.3_1 2024-09-12T00:46:49.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.932+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.104__multipart_key1.2~1lwRf3FiKz4CyqWR7iikkMc0Jz0ZtVz.4 2024-09-12T00:46:49.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.932+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.104__shadow_key1.2~1lwRf3FiKz4CyqWR7iikkMc0Jz0ZtVz.4_1 2024-09-12T00:46:49.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.932+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.104__multipart_key1.2~1lwRf3FiKz4CyqWR7iikkMc0Jz0ZtVz.5 2024-09-12T00:46:49.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.932+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10024944774610105204', time=2024-09-12T02:46:23.496295+0000, chain.objs.size()=1 2024-09-12T00:46:49.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.932+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.119__shadow_.FtsSZ1FqFA9ZxuC0h-OsXE7FjnpOF9S_0 2024-09-12T00:46:49.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.932+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15006778313385227592', time=2024-09-12T02:46:26.846543+0000, chain.objs.size()=1 2024-09-12T00:46:49.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.932+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.125__shadow_.tYf9OKxS8KbJcC7jaFSilhNcm9m2gx1_0 2024-09-12T00:46:49.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.932+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15893593886882004434', time=2024-09-12T02:46:30.314271+0000, chain.objs.size()=1 2024-09-12T00:46:49.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.932+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.131__shadow_.uARWc1GHi5sTxscJjvD6sQPyYtP0s07_0 2024-09-12T00:46:49.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.937+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:49.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.939+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:46:49.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.940+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:49.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.941+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:49.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.941+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:46:49.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.941+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14208328756406547165', time=2024-09-12T02:45:04.288740+0000, chain.objs.size()=9 2024-09-12T00:46:49.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.941+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__multipart_file2.mpg.2~_4N6L8qkNBIlu-dgi0-A1uXGWHn1rCN.1 2024-09-12T00:46:49.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.941+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__shadow_file2.mpg.2~_4N6L8qkNBIlu-dgi0-A1uXGWHn1rCN.1_1 2024-09-12T00:46:49.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.941+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__multipart_file2.mpg.2~_4N6L8qkNBIlu-dgi0-A1uXGWHn1rCN.2 2024-09-12T00:46:49.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.941+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__shadow_file2.mpg.2~_4N6L8qkNBIlu-dgi0-A1uXGWHn1rCN.2_1 2024-09-12T00:46:49.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.941+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__multipart_file2.mpg.2~_4N6L8qkNBIlu-dgi0-A1uXGWHn1rCN.3 2024-09-12T00:46:49.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.941+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__shadow_file2.mpg.2~_4N6L8qkNBIlu-dgi0-A1uXGWHn1rCN.3_1 2024-09-12T00:46:49.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.941+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__multipart_file2.mpg.2~_4N6L8qkNBIlu-dgi0-A1uXGWHn1rCN.4 2024-09-12T00:46:49.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.942+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__shadow_file2.mpg.2~_4N6L8qkNBIlu-dgi0-A1uXGWHn1rCN.4_1 2024-09-12T00:46:49.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.942+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__multipart_file2.mpg.2~_4N6L8qkNBIlu-dgi0-A1uXGWHn1rCN.5 2024-09-12T00:46:49.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.942+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15713361803919782401', time=2024-09-12T02:46:22.864173+0000, chain.objs.size()=1 2024-09-12T00:46:49.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.942+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.118__shadow_.pYjC65wnj3Nw3bGO1lqgPI4GWXEpI0q_0 2024-09-12T00:46:49.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.942+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7157102087600843334', time=2024-09-12T02:46:22.889669+0000, chain.objs.size()=1 2024-09-12T00:46:49.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.942+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.118__shadow_.D8nGRedmORJZ0okwvLJQtnNv0EPdaXA_0 2024-09-12T00:46:49.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.942+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11155041742987758135', time=2024-09-12T02:46:24.665293+0000, chain.objs.size()=1 2024-09-12T00:46:49.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.942+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.121__shadow_.y9wuzZiUecCFfMfKHVbShS2TOLy3QjZ_0 2024-09-12T00:46:49.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.946+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14728985830302347685', time=2024-09-12T02:46:25.269026+0000, chain.objs.size()=1 2024-09-12T00:46:49.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.946+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.122__shadow_.-ZNgvGw8e9B-11VoPHjrR5XEqbxeBcM_0 2024-09-12T00:46:49.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.948+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:49.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.950+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:46:49.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.951+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:49.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:49.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:49.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.891054501018717455', time=2024-09-12T02:44:38.843212+0000, chain.objs.size()=9 2024-09-12T00:46:49.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~nAO3UUi1Iid05SRiVaCsGJZH6iCLUzt.1 2024-09-12T00:46:49.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~nAO3UUi1Iid05SRiVaCsGJZH6iCLUzt.1_1 2024-09-12T00:46:49.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~nAO3UUi1Iid05SRiVaCsGJZH6iCLUzt.2 2024-09-12T00:46:49.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~nAO3UUi1Iid05SRiVaCsGJZH6iCLUzt.2_1 2024-09-12T00:46:49.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~nAO3UUi1Iid05SRiVaCsGJZH6iCLUzt.3 2024-09-12T00:46:49.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~nAO3UUi1Iid05SRiVaCsGJZH6iCLUzt.3_1 2024-09-12T00:46:49.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~nAO3UUi1Iid05SRiVaCsGJZH6iCLUzt.4 2024-09-12T00:46:49.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~nAO3UUi1Iid05SRiVaCsGJZH6iCLUzt.4_1 2024-09-12T00:46:49.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~nAO3UUi1Iid05SRiVaCsGJZH6iCLUzt.5 2024-09-12T00:46:49.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13539731351259690260', time=2024-09-12T02:45:59.024294+0000, chain.objs.size()=7 2024-09-12T00:46:49.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~DSDzDh861EOqekeD-7mZpQQCXEiy0ZK.1 2024-09-12T00:46:49.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~DSDzDh861EOqekeD-7mZpQQCXEiy0ZK.1_1 2024-09-12T00:46:49.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.952+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~DSDzDh861EOqekeD-7mZpQQCXEiy0ZK.1_2 2024-09-12T00:46:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.957+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~DSDzDh861EOqekeD-7mZpQQCXEiy0ZK.2 2024-09-12T00:46:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.957+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~DSDzDh861EOqekeD-7mZpQQCXEiy0ZK.2_1 2024-09-12T00:46:49.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.957+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~DSDzDh861EOqekeD-7mZpQQCXEiy0ZK.2_2 2024-09-12T00:46:49.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.957+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~DSDzDh861EOqekeD-7mZpQQCXEiy0ZK.3 2024-09-12T00:46:49.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.957+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2591250098329558406', time=2024-09-12T02:46:25.243267+0000, chain.objs.size()=1 2024-09-12T00:46:49.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.957+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.122__shadow_.HftxoTTpv9JACQg9-KmfEv7AZXPMzab_0 2024-09-12T00:46:49.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.957+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3800898394882890735', time=2024-09-12T02:46:29.152301+0000, chain.objs.size()=1 2024-09-12T00:46:49.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.957+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.129__shadow_.kJvyJOSLu5jXhL1G4o5xeN6VzPookBj_0 2024-09-12T00:46:49.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.960+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:49.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.963+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:46:49.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.964+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:49.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:49.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:49.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3580786116100770372', time=2024-09-12T02:44:51.447750+0000, chain.objs.size()=9 2024-09-12T00:46:49.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.100__multipart_key1.2~tfDBlFWDs8sIz8rGR4FLXoKi8K2Q0R9.1 2024-09-12T00:46:49.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.100__shadow_key1.2~tfDBlFWDs8sIz8rGR4FLXoKi8K2Q0R9.1_1 2024-09-12T00:46:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.100__multipart_key1.2~tfDBlFWDs8sIz8rGR4FLXoKi8K2Q0R9.2 2024-09-12T00:46:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.100__shadow_key1.2~tfDBlFWDs8sIz8rGR4FLXoKi8K2Q0R9.2_1 2024-09-12T00:46:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.100__multipart_key1.2~tfDBlFWDs8sIz8rGR4FLXoKi8K2Q0R9.3 2024-09-12T00:46:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.100__shadow_key1.2~tfDBlFWDs8sIz8rGR4FLXoKi8K2Q0R9.3_1 2024-09-12T00:46:49.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.100__multipart_key1.2~tfDBlFWDs8sIz8rGR4FLXoKi8K2Q0R9.4 2024-09-12T00:46:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.100__shadow_key1.2~tfDBlFWDs8sIz8rGR4FLXoKi8K2Q0R9.4_1 2024-09-12T00:46:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.100__multipart_key1.2~tfDBlFWDs8sIz8rGR4FLXoKi8K2Q0R9.5 2024-09-12T00:46:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15866248930382099070', time=2024-09-12T02:46:19.950349+0000, chain.objs.size()=1 2024-09-12T00:46:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.113__shadow_.iLY8hyvTaGeQRQqrJp9OCutWf1ibMmI_0 2024-09-12T00:46:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10428221318440621883', time=2024-09-12T02:46:20.003911+0000, chain.objs.size()=1 2024-09-12T00:46:49.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.113__shadow_.ncoMmaIRp3xxvWSjR10Km0gbOYcCUCq_0 2024-09-12T00:46:49.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2324393879416794960', time=2024-09-12T02:46:25.769714+0000, chain.objs.size()=1 2024-09-12T00:46:49.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.965+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.123__shadow_.Jh-jbFirKSlAE8vck6O9aM9bi0J30EC_0 2024-09-12T00:46:49.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.971+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:49.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.973+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:46:49.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.975+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:49.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.975+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:49.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.975+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:46:49.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.975+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='2~0-sojFiA0qsddwsLb3m8zvS_YElXlg0', time=2024-09-12T02:44:06.800784+0000, chain.objs.size()=9 2024-09-12T00:46:49.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.975+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.80__multipart_key1.2~0-sojFiA0qsddwsLb3m8zvS_YElXlg0.1 2024-09-12T00:46:49.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.975+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.80__shadow_key1.2~0-sojFiA0qsddwsLb3m8zvS_YElXlg0.1_1 2024-09-12T00:46:49.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.975+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.80__multipart_key1.2~0-sojFiA0qsddwsLb3m8zvS_YElXlg0.2 2024-09-12T00:46:49.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.975+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.80__shadow_key1.2~0-sojFiA0qsddwsLb3m8zvS_YElXlg0.2_1 2024-09-12T00:46:49.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.975+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.80__multipart_key1.2~0-sojFiA0qsddwsLb3m8zvS_YElXlg0.3 2024-09-12T00:46:49.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.975+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.80__shadow_key1.2~0-sojFiA0qsddwsLb3m8zvS_YElXlg0.3_1 2024-09-12T00:46:49.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.975+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.80__multipart_key1.2~0-sojFiA0qsddwsLb3m8zvS_YElXlg0.4 2024-09-12T00:46:49.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.975+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.80__shadow_key1.2~0-sojFiA0qsddwsLb3m8zvS_YElXlg0.4_1 2024-09-12T00:46:49.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.975+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.80__multipart_key1.2~0-sojFiA0qsddwsLb3m8zvS_YElXlg0.5 2024-09-12T00:46:49.975 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.975+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14053727007599925423', time=2024-09-12T02:46:28.036413+0000, chain.objs.size()=1 2024-09-12T00:46:49.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.975+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.127__shadow_.moAZitXZzBCz2a9OzpmwTJFU31b8AWO_0 2024-09-12T00:46:49.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.979+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:49.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.982+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:46:49.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.983+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.983+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4556518250069310586', time=2024-09-12T02:46:06.796005+0000, chain.objs.size()=9 2024-09-12T00:46:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.105__multipart_key1.2~Z22uR5Lxc0jaN7zyZzkTrmFqwybrRa8.1 2024-09-12T00:46:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.105__shadow_key1.2~Z22uR5Lxc0jaN7zyZzkTrmFqwybrRa8.1_1 2024-09-12T00:46:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.105__multipart_key1.2~Z22uR5Lxc0jaN7zyZzkTrmFqwybrRa8.2 2024-09-12T00:46:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.105__shadow_key1.2~Z22uR5Lxc0jaN7zyZzkTrmFqwybrRa8.2_1 2024-09-12T00:46:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.105__multipart_key1.2~Z22uR5Lxc0jaN7zyZzkTrmFqwybrRa8.3 2024-09-12T00:46:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.105__shadow_key1.2~Z22uR5Lxc0jaN7zyZzkTrmFqwybrRa8.3_1 2024-09-12T00:46:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.105__multipart_key1.2~Z22uR5Lxc0jaN7zyZzkTrmFqwybrRa8.4 2024-09-12T00:46:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.105__shadow_key1.2~Z22uR5Lxc0jaN7zyZzkTrmFqwybrRa8.4_1 2024-09-12T00:46:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.105__multipart_key1.2~Z22uR5Lxc0jaN7zyZzkTrmFqwybrRa8.5 2024-09-12T00:46:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8607885957927271550', time=2024-09-12T02:46:21.722335+0000, chain.objs.size()=1 2024-09-12T00:46:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.116__shadow_.XZ2dDQ1lnHQlmMpOjzf398m_jPii1M-_0 2024-09-12T00:46:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12701589122495701981', time=2024-09-12T02:46:31.885760+0000, chain.objs.size()=1 2024-09-12T00:46:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.134__shadow_.4MhM-aANS97Nw5NGQ2Dt39WL4rPmtQE_0 2024-09-12T00:46:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4614021027882660077', time=2024-09-12T02:46:49.271395+0000, chain.objs.size()=9 2024-09-12T00:46:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.984+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.145__multipart_key1/data/file.mpg.2~XBAvPzzUs8mWUW9oTeIu1gkEixqDAMH.1 2024-09-12T00:46:49.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.987+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.145__shadow_key1/data/file.mpg.2~XBAvPzzUs8mWUW9oTeIu1gkEixqDAMH.1_1 2024-09-12T00:46:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.989+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.145__multipart_key1/data/file.mpg.2~XBAvPzzUs8mWUW9oTeIu1gkEixqDAMH.2 2024-09-12T00:46:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.989+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.145__shadow_key1/data/file.mpg.2~XBAvPzzUs8mWUW9oTeIu1gkEixqDAMH.2_1 2024-09-12T00:46:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.989+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.145__multipart_key1/data/file.mpg.2~XBAvPzzUs8mWUW9oTeIu1gkEixqDAMH.3 2024-09-12T00:46:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.989+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.145__shadow_key1/data/file.mpg.2~XBAvPzzUs8mWUW9oTeIu1gkEixqDAMH.3_1 2024-09-12T00:46:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.989+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.145__multipart_key1/data/file.mpg.2~XBAvPzzUs8mWUW9oTeIu1gkEixqDAMH.4 2024-09-12T00:46:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.989+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.145__shadow_key1/data/file.mpg.2~XBAvPzzUs8mWUW9oTeIu1gkEixqDAMH.4_1 2024-09-12T00:46:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.989+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.145__multipart_key1/data/file.mpg.2~XBAvPzzUs8mWUW9oTeIu1gkEixqDAMH.5 2024-09-12T00:46:49.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.993+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:49.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.995+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:46:49.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.996+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:49.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:49.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:46:49.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11653797262927253403', time=2024-09-12T02:44:15.225036+0000, chain.objs.size()=9 2024-09-12T00:46:49.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__multipart_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.1 2024-09-12T00:46:49.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__shadow_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.1_1 2024-09-12T00:46:49.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__multipart_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.2 2024-09-12T00:46:49.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__shadow_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.2_1 2024-09-12T00:46:49.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__multipart_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.3 2024-09-12T00:46:49.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__shadow_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.3_1 2024-09-12T00:46:49.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__multipart_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.4 2024-09-12T00:46:49.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__shadow_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.4_1 2024-09-12T00:46:49.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__multipart_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.5 2024-09-12T00:46:49.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='2~Q2qbMskM6r-jkPGvH7es1mM3Blzyzne', time=2024-09-12T02:45:14.879075+0000, chain.objs.size()=9 2024-09-12T00:46:49.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.102__multipart_key1.2~Q2qbMskM6r-jkPGvH7es1mM3Blzyzne.7 2024-09-12T00:46:49.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.102__shadow_key1.2~Q2qbMskM6r-jkPGvH7es1mM3Blzyzne.7_1 2024-09-12T00:46:49.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:49.997+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.102__multipart_key1.2~Q2qbMskM6r-jkPGvH7es1mM3Blzyzne.8 2024-09-12T00:46:49.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.000+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.102__shadow_key1.2~Q2qbMskM6r-jkPGvH7es1mM3Blzyzne.8_1 2024-09-12T00:46:49.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.001+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.102__multipart_key1.2~Q2qbMskM6r-jkPGvH7es1mM3Blzyzne.9 2024-09-12T00:46:49.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.001+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.102__shadow_key1.2~Q2qbMskM6r-jkPGvH7es1mM3Blzyzne.9_1 2024-09-12T00:46:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.003+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.102__multipart_key1.2~Q2qbMskM6r-jkPGvH7es1mM3Blzyzne.10 2024-09-12T00:46:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.003+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.102__shadow_key1.2~Q2qbMskM6r-jkPGvH7es1mM3Blzyzne.10_1 2024-09-12T00:46:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.003+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.102__multipart_key1.2~Q2qbMskM6r-jkPGvH7es1mM3Blzyzne.11 2024-09-12T00:46:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.003+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15430006783558188560', time=2024-09-12T02:46:01.134480+0000, chain.objs.size()=7 2024-09-12T00:46:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.003+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~XY-anBMW06uqONC4NqD7X1lYr0iY5XY.1 2024-09-12T00:46:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.003+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~XY-anBMW06uqONC4NqD7X1lYr0iY5XY.1_1 2024-09-12T00:46:50.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.003+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~XY-anBMW06uqONC4NqD7X1lYr0iY5XY.1_2 2024-09-12T00:46:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.003+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~XY-anBMW06uqONC4NqD7X1lYr0iY5XY.2 2024-09-12T00:46:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.003+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~XY-anBMW06uqONC4NqD7X1lYr0iY5XY.2_1 2024-09-12T00:46:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.004+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~XY-anBMW06uqONC4NqD7X1lYr0iY5XY.2_2 2024-09-12T00:46:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.004+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~XY-anBMW06uqONC4NqD7X1lYr0iY5XY.3 2024-09-12T00:46:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.004+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2749979748884683855', time=2024-09-12T02:46:21.168683+0000, chain.objs.size()=1 2024-09-12T00:46:50.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.004+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.115__shadow_.j34Ccg2g7mD9tUTmaMngfezckWIoEH-_0 2024-09-12T00:46:50.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.008+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12075566339037281507', time=2024-09-12T02:46:21.747737+0000, chain.objs.size()=1 2024-09-12T00:46:50.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.008+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.116__shadow_.3gh3hfqmi0PMz4203Xy05X2l7Jq_bMI_0 2024-09-12T00:46:50.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.008+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9829258730774538520', time=2024-09-12T02:46:29.209043+0000, chain.objs.size()=1 2024-09-12T00:46:50.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.008+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.129__shadow_.rZQI78Weu4PESlf40dJhriyOvSCBeQp_0 2024-09-12T00:46:50.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.010+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.012+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:46:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.014+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.014+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.015+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:46:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.015+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3325249473008980263', time=2024-09-12T02:46:17.634879+0000, chain.objs.size()=1 2024-09-12T00:46:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.015+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.107__shadow_.jVjSTPX_MPXGkwlTZh9-xAJzQGQS5Jq_0 2024-09-12T00:46:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.015+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7144835998807642570', time=2024-09-12T02:46:22.332489+0000, chain.objs.size()=1 2024-09-12T00:46:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.015+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.117__shadow_.J6h2zNpAt6TklW3iQN4_CuKt6ocAW7-_0 2024-09-12T00:46:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.015+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16453594528446971767', time=2024-09-12T02:46:32.951010+0000, chain.objs.size()=1 2024-09-12T00:46:50.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.015+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.137__shadow_.W8CFTrUHD5RKwA8jYZWO60i-HivIgb7_0 2024-09-12T00:46:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.016+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.019+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:46:50.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.020+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.020+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.020+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.020+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5998562517259177284', time=2024-09-12T02:45:04.257749+0000, chain.objs.size()=1 2024-09-12T00:46:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.020+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__shadow_.uEAc_gLC8U0vpecWVPGIanyPfdEN3e-_0 2024-09-12T00:46:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.020+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17711511561320192964', time=2024-09-12T02:45:04.342464+0000, chain.objs.size()=1 2024-09-12T00:46:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.020+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__shadow_.dD46hZehGLHFgJM6LTHcd7W_biiizlY_0 2024-09-12T00:46:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.020+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13299374038093296544', time=2024-09-12T02:46:27.485515+0000, chain.objs.size()=1 2024-09-12T00:46:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.020+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.126__shadow_.-e7JyYc1VzWN-bgf2re1CaQaIoK5hmC_0 2024-09-12T00:46:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.020+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10923463834731355452', time=2024-09-12T02:46:33.286783+0000, chain.objs.size()=1 2024-09-12T00:46:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.020+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.138__shadow_.nKzVQpPTbPwZkZfcE5yWcZKpW9wOZAl_0 2024-09-12T00:46:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.023+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.025+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:46:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.026+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.026+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.027+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:46:50.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.027+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15563260883200364146', time=2024-09-12T02:46:29.730909+0000, chain.objs.size()=1 2024-09-12T00:46:50.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.027+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.130__shadow_.ZDLb2dfyZjq0BzqSD24dM-7L4hx1UAE_0 2024-09-12T00:46:50.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.027+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16784208072997790163', time=2024-09-12T02:46:29.761895+0000, chain.objs.size()=1 2024-09-12T00:46:50.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.027+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.130__shadow_.D-h9C-zwcI7UVMgtc4S6wcXtLiz5av7_0 2024-09-12T00:46:50.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.027+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12962948126798530847', time=2024-09-12T02:46:31.388486+0000, chain.objs.size()=1 2024-09-12T00:46:50.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.027+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.133__shadow_.LyAoKN4ARekD1dW1nQ-g3ixftGbNgqE_0 2024-09-12T00:46:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.029+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.031+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:46:50.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.032+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.232568713425473235', time=2024-09-12T02:44:10.410769+0000, chain.objs.size()=1 2024-09-12T00:46:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.85__shadow_.0XYzIBIkz_mJUYwLQwVkbU-5md_q5Fj_0 2024-09-12T00:46:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4626098057178463274', time=2024-09-12T02:45:04.230541+0000, chain.objs.size()=9 2024-09-12T00:46:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__multipart_file.mpg.2~Dsv0c_gKnh5n4yqdwwIsopVAE8rGF5J.1 2024-09-12T00:46:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__shadow_file.mpg.2~Dsv0c_gKnh5n4yqdwwIsopVAE8rGF5J.1_1 2024-09-12T00:46:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__multipart_file.mpg.2~Dsv0c_gKnh5n4yqdwwIsopVAE8rGF5J.2 2024-09-12T00:46:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__shadow_file.mpg.2~Dsv0c_gKnh5n4yqdwwIsopVAE8rGF5J.2_1 2024-09-12T00:46:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__multipart_file.mpg.2~Dsv0c_gKnh5n4yqdwwIsopVAE8rGF5J.3 2024-09-12T00:46:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__shadow_file.mpg.2~Dsv0c_gKnh5n4yqdwwIsopVAE8rGF5J.3_1 2024-09-12T00:46:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__multipart_file.mpg.2~Dsv0c_gKnh5n4yqdwwIsopVAE8rGF5J.4 2024-09-12T00:46:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__shadow_file.mpg.2~Dsv0c_gKnh5n4yqdwwIsopVAE8rGF5J.4_1 2024-09-12T00:46:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__multipart_file.mpg.2~Dsv0c_gKnh5n4yqdwwIsopVAE8rGF5J.5 2024-09-12T00:46:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11487541909636680539', time=2024-09-12T02:46:20.029585+0000, chain.objs.size()=1 2024-09-12T00:46:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.113__shadow_.eAugwIPhpHw0JnnmFvEEnyffHAMp4Th_0 2024-09-12T00:46:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1011508370522485334', time=2024-09-12T02:46:22.917180+0000, chain.objs.size()=1 2024-09-12T00:46:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.033+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.118__shadow_.pCNbyrY25hJz2eAP3lzW4eZY0ewMTdM_0 2024-09-12T00:46:50.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.039+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.041+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:46:50.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.042+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.043+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.043+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:46:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.043+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.300701429501754683', time=2024-09-12T02:46:28.640620+0000, chain.objs.size()=1 2024-09-12T00:46:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.043+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.128__shadow_.s1F89rrrUks_dkZ4GI7B-HUg_hQxx-o_0 2024-09-12T00:46:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.044+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.046+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:46:50.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.048+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.048+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.048+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:46:50.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.048+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3857083114228087491', time=2024-09-12T02:46:20.585508+0000, chain.objs.size()=1 2024-09-12T00:46:50.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.048+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.114__shadow_.GxatMxnVikFuFZTz2YS-6fwqWj_tvcD_0 2024-09-12T00:46:50.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.048+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7521758913149951322', time=2024-09-12T02:46:22.358536+0000, chain.objs.size()=1 2024-09-12T00:46:50.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.048+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.117__shadow_.c_UPBGemvB_1HufEea2NzZBxrgkG5WH_0 2024-09-12T00:46:50.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.048+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1280761696013552677', time=2024-09-12T02:46:24.639365+0000, chain.objs.size()=1 2024-09-12T00:46:50.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.048+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.121__shadow_.XSMmdpb5b81BselMBEdGiizoAYpJ5iZ_0 2024-09-12T00:46:50.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.050+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.052+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:46:50.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.054+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.054+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.054+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:46:50.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.054+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3469582621978875021', time=2024-09-12T02:44:03.857202+0000, chain.objs.size()=1 2024-09-12T00:46:50.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.054+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.78__shadow_.ierBPvehHNbhLbBB05kH5FIvy6Hm6gq_0 2024-09-12T00:46:50.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.054+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1907395095455811877', time=2024-09-12T02:44:32.624561+0000, chain.objs.size()=9 2024-09-12T00:46:50.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.054+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~Jx2XZ01rel2uvbsH7J9xknj23kkYpTE.1 2024-09-12T00:46:50.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.054+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~Jx2XZ01rel2uvbsH7J9xknj23kkYpTE.1_1 2024-09-12T00:46:50.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.054+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~Jx2XZ01rel2uvbsH7J9xknj23kkYpTE.2 2024-09-12T00:46:50.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.054+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~Jx2XZ01rel2uvbsH7J9xknj23kkYpTE.2_1 2024-09-12T00:46:50.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.054+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~Jx2XZ01rel2uvbsH7J9xknj23kkYpTE.3 2024-09-12T00:46:50.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.054+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~Jx2XZ01rel2uvbsH7J9xknj23kkYpTE.3_1 2024-09-12T00:46:50.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.055+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~Jx2XZ01rel2uvbsH7J9xknj23kkYpTE.4 2024-09-12T00:46:50.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.055+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~Jx2XZ01rel2uvbsH7J9xknj23kkYpTE.4_1 2024-09-12T00:46:50.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.055+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~Jx2XZ01rel2uvbsH7J9xknj23kkYpTE.5 2024-09-12T00:46:50.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.055+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9162051140675937279', time=2024-09-12T02:46:38.231257+0000, chain.objs.size()=9 2024-09-12T00:46:50.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.055+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.144__multipart_key1.2~jW6xE7QIe52E-5P22iVQUn0qfPvoJZf.1 2024-09-12T00:46:50.055 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.055+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.144__shadow_key1.2~jW6xE7QIe52E-5P22iVQUn0qfPvoJZf.1_1 2024-09-12T00:46:50.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.058+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.144__multipart_key1.2~jW6xE7QIe52E-5P22iVQUn0qfPvoJZf.2 2024-09-12T00:46:50.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.059+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.144__shadow_key1.2~jW6xE7QIe52E-5P22iVQUn0qfPvoJZf.2_1 2024-09-12T00:46:50.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.059+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.144__multipart_key1.2~jW6xE7QIe52E-5P22iVQUn0qfPvoJZf.3 2024-09-12T00:46:50.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.059+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.144__shadow_key1.2~jW6xE7QIe52E-5P22iVQUn0qfPvoJZf.3_1 2024-09-12T00:46:50.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.059+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.144__multipart_key1.2~jW6xE7QIe52E-5P22iVQUn0qfPvoJZf.4 2024-09-12T00:46:50.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.059+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.144__shadow_key1.2~jW6xE7QIe52E-5P22iVQUn0qfPvoJZf.4_1 2024-09-12T00:46:50.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.059+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.144__multipart_key1.2~jW6xE7QIe52E-5P22iVQUn0qfPvoJZf.5 2024-09-12T00:46:50.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.063+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.065+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:46:50.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.066+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4815146224358413580', time=2024-09-12T02:44:10.043240+0000, chain.objs.size()=3 2024-09-12T00:46:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.84__shadow_.NztsC0gOsrjt5WStiOo6j9VpUYr0LzD_0 2024-09-12T00:46:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.84__shadow_.NztsC0gOsrjt5WStiOo6j9VpUYr0LzD_1 2024-09-12T00:46:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.84__shadow_.NztsC0gOsrjt5WStiOo6j9VpUYr0LzD_2 2024-09-12T00:46:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1597092848563244602', time=2024-09-12T02:45:48.532778+0000, chain.objs.size()=9 2024-09-12T00:46:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~PQLetRICubRsx8YK3kRj3FZ-ErJvNe7.1 2024-09-12T00:46:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~PQLetRICubRsx8YK3kRj3FZ-ErJvNe7.1_1 2024-09-12T00:46:50.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~PQLetRICubRsx8YK3kRj3FZ-ErJvNe7.2 2024-09-12T00:46:50.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~PQLetRICubRsx8YK3kRj3FZ-ErJvNe7.2_1 2024-09-12T00:46:50.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~PQLetRICubRsx8YK3kRj3FZ-ErJvNe7.3 2024-09-12T00:46:50.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~PQLetRICubRsx8YK3kRj3FZ-ErJvNe7.3_1 2024-09-12T00:46:50.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~PQLetRICubRsx8YK3kRj3FZ-ErJvNe7.4 2024-09-12T00:46:50.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__shadow_key1.2~PQLetRICubRsx8YK3kRj3FZ-ErJvNe7.4_1 2024-09-12T00:46:50.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.067+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.103__multipart_key1.2~PQLetRICubRsx8YK3kRj3FZ-ErJvNe7.5 2024-09-12T00:46:50.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.071+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16312860774921562445', time=2024-09-12T02:46:21.774624+0000, chain.objs.size()=1 2024-09-12T00:46:50.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.071+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.116__shadow_.67N8S-AdWjdW7S2L6-bdcklwHrMfgXD_0 2024-09-12T00:46:50.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.071+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15676591480816091351', time=2024-09-12T02:46:31.338307+0000, chain.objs.size()=1 2024-09-12T00:46:50.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.071+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.133__shadow_.tJ9T4wyVsn7eY0EgGGUMHhGGDTs4uJu_0 2024-09-12T00:46:50.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.076+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.078+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:46:50.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.080+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.079 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.080+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.080+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T00:46:50.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.080+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5520993802995182572', time=2024-09-12T02:44:44.354438+0000, chain.objs.size()=7 2024-09-12T00:46:50.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.080+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~Ek0dU9wEvmwhk28Eo69bc2qfvGFM_xv.1 2024-09-12T00:46:50.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.080+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~Ek0dU9wEvmwhk28Eo69bc2qfvGFM_xv.1_1 2024-09-12T00:46:50.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.080+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~Ek0dU9wEvmwhk28Eo69bc2qfvGFM_xv.1_2 2024-09-12T00:46:50.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.080+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~Ek0dU9wEvmwhk28Eo69bc2qfvGFM_xv.2 2024-09-12T00:46:50.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.080+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~Ek0dU9wEvmwhk28Eo69bc2qfvGFM_xv.2_1 2024-09-12T00:46:50.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.080+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~Ek0dU9wEvmwhk28Eo69bc2qfvGFM_xv.2_2 2024-09-12T00:46:50.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.081+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~Ek0dU9wEvmwhk28Eo69bc2qfvGFM_xv.3 2024-09-12T00:46:50.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.081+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13717956869928524135', time=2024-09-12T02:46:21.116646+0000, chain.objs.size()=1 2024-09-12T00:46:50.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.081+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.115__shadow_.Jy2swD7IEfQFjq8MShrjaaP2C7jrja__0 2024-09-12T00:46:50.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.081+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14218017443073395158', time=2024-09-12T02:46:22.942324+0000, chain.objs.size()=1 2024-09-12T00:46:50.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.081+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.118__shadow_.qPjYx_bHdJdpfNGsjlw4xHSMjTo1uwx_0 2024-09-12T00:46:50.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.081+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9766333222256983108', time=2024-09-12T02:46:25.796082+0000, chain.objs.size()=1 2024-09-12T00:46:50.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.081+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.123__shadow_.ogi8Yc9In7TXIxO9b2nTRluRTsiAf6D_0 2024-09-12T00:46:50.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.081+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15352643485611709885', time=2024-09-12T02:46:28.009404+0000, chain.objs.size()=1 2024-09-12T00:46:50.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.081+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.127__shadow_.OTowJuu7I2RuLdrkfr9A-3D5_21IaUx_0 2024-09-12T00:46:50.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.081+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17786734116997462782', time=2024-09-12T02:46:30.843969+0000, chain.objs.size()=1 2024-09-12T00:46:50.081 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.081+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.132__shadow_.KeI9t2PKKskYnoho8cUeHT0u76sxCZG_0 2024-09-12T00:46:50.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.083+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9925411047060570253', time=2024-09-12T02:46:31.860275+0000, chain.objs.size()=1 2024-09-12T00:46:50.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.083+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.134__shadow_._nnaF2nANbzTys4JaT1OkD8M5IChAID_0 2024-09-12T00:46:50.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.086+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.089+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:46:50.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.090+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.090+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.091+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:46:50.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.091+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17855209376576034966', time=2024-09-12T02:44:41.688575+0000, chain.objs.size()=7 2024-09-12T00:46:50.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.091+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~I4E9ziPZVV-Dda-iDH1hw2a6aeNfAFL.1 2024-09-12T00:46:50.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.091+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~I4E9ziPZVV-Dda-iDH1hw2a6aeNfAFL.1_1 2024-09-12T00:46:50.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.091+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~I4E9ziPZVV-Dda-iDH1hw2a6aeNfAFL.1_2 2024-09-12T00:46:50.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.091+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~I4E9ziPZVV-Dda-iDH1hw2a6aeNfAFL.2 2024-09-12T00:46:50.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.091+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~I4E9ziPZVV-Dda-iDH1hw2a6aeNfAFL.2_1 2024-09-12T00:46:50.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.091+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~I4E9ziPZVV-Dda-iDH1hw2a6aeNfAFL.2_2 2024-09-12T00:46:50.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.091+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~I4E9ziPZVV-Dda-iDH1hw2a6aeNfAFL.3 2024-09-12T00:46:50.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.091+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12700347800661269908', time=2024-09-12T02:46:21.194014+0000, chain.objs.size()=1 2024-09-12T00:46:50.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.091+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.115__shadow_.KEReMjD8xF4hGr3q6rGRnpWmcs5hn1S_0 2024-09-12T00:46:50.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.091+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3128975778559419235', time=2024-09-12T02:46:25.190925+0000, chain.objs.size()=1 2024-09-12T00:46:50.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.091+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.122__shadow_.J9de-l_lGHMLG3Zs_llY_4-IWNdhmXE_0 2024-09-12T00:46:50.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.095+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.097+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:46:50.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.098+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.099+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.099+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:46:50.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.099+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14129052759263980509', time=2024-09-12T02:46:20.533103+0000, chain.objs.size()=1 2024-09-12T00:46:50.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.099+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.114__shadow_.nfL00AR_VP-Re_ZsgrcQg_DvlS_RbdK_0 2024-09-12T00:46:50.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.099+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8892020250368297731', time=2024-09-12T02:46:25.217859+0000, chain.objs.size()=1 2024-09-12T00:46:50.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.099+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.122__shadow_.Mc6dn8PVu87bMI2jN09rhFf1kwOtpjO_0 2024-09-12T00:46:50.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.099+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7599572784609008898', time=2024-09-12T02:46:28.063149+0000, chain.objs.size()=1 2024-09-12T00:46:50.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.099+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.127__shadow_.M45YQ43wtjXj2Prwhm678121OBVbEoI_0 2024-09-12T00:46:50.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.099+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12007233939778861501', time=2024-09-12T02:46:30.817781+0000, chain.objs.size()=1 2024-09-12T00:46:50.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.099+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.132__shadow_.WgOCLEhHjsIsbwuNqjn1-S2EnmBCRvg_0 2024-09-12T00:46:50.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.099+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5537885923446997629', time=2024-09-12T02:46:49.298087+0000, chain.objs.size()=1 2024-09-12T00:46:50.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.099+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.145__shadow_.qrCXZkRa-_mvpK4SdEM3HJKWXMGdkxD_0 2024-09-12T00:46:50.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.101+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.103+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:46:50.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.104+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:46:50.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16513417182279800303', time=2024-09-12T02:44:35.990775+0000, chain.objs.size()=9 2024-09-12T00:46:50.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~NWSHVGhdmgkylshiX6WCKEFRhKVtuD7.1 2024-09-12T00:46:50.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~NWSHVGhdmgkylshiX6WCKEFRhKVtuD7.1_1 2024-09-12T00:46:50.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~NWSHVGhdmgkylshiX6WCKEFRhKVtuD7.2 2024-09-12T00:46:50.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~NWSHVGhdmgkylshiX6WCKEFRhKVtuD7.2_1 2024-09-12T00:46:50.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~NWSHVGhdmgkylshiX6WCKEFRhKVtuD7.3 2024-09-12T00:46:50.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~NWSHVGhdmgkylshiX6WCKEFRhKVtuD7.3_1 2024-09-12T00:46:50.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~NWSHVGhdmgkylshiX6WCKEFRhKVtuD7.4 2024-09-12T00:46:50.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~NWSHVGhdmgkylshiX6WCKEFRhKVtuD7.4_1 2024-09-12T00:46:50.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~NWSHVGhdmgkylshiX6WCKEFRhKVtuD7.5 2024-09-12T00:46:50.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12624969205453567851', time=2024-09-12T02:46:24.024328+0000, chain.objs.size()=1 2024-09-12T00:46:50.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.120__shadow_.DREHC_g2X7djHhRGo9eeMmWz7RDZ5rE_0 2024-09-12T00:46:50.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.755456647299509110', time=2024-09-12T02:46:31.363267+0000, chain.objs.size()=1 2024-09-12T00:46:50.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.105+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.133__shadow_.NTW5eVivlvpMxlCuKKfrjhoJGqelzRX_0 2024-09-12T00:46:50.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.111+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.113+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:46:50.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.115+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.116+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.116+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:46:50.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.116+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17278731818739370567', time=2024-09-12T02:46:26.320832+0000, chain.objs.size()=1 2024-09-12T00:46:50.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.116+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.124__shadow_.rkENroO-9x37cC9Gtt37uMjbmdsdcAu_0 2024-09-12T00:46:50.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.116+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8373686585130238248', time=2024-09-12T02:46:26.346123+0000, chain.objs.size()=1 2024-09-12T00:46:50.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.116+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.124__shadow_.l6j5Qt8y1vBX39R_WuRWvxq2xV1mjGM_0 2024-09-12T00:46:50.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.117+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.120+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:46:50.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.121+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.122+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.122+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:46:50.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.122+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17288152615462192269', time=2024-09-12T02:44:10.774547+0000, chain.objs.size()=1 2024-09-12T00:46:50.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.122+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.86__shadow_.QYZrpq2IV2nv5ObIsY1WLCOkOP8tmEA_0 2024-09-12T00:46:50.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.122+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7940872220547112585', time=2024-09-12T02:46:20.559175+0000, chain.objs.size()=1 2024-09-12T00:46:50.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.122+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.114__shadow_.COyBb22oDGRYCfTt9yP8opoadtxfsFa_0 2024-09-12T00:46:50.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.122+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14106785833875569131', time=2024-09-12T02:46:21.143488+0000, chain.objs.size()=1 2024-09-12T00:46:50.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.122+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.115__shadow_.QUkKdy8XJEHLZVY7eXrG_EtKViwoXxe_0 2024-09-12T00:46:50.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.122+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16936208228085456089', time=2024-09-12T02:46:23.444421+0000, chain.objs.size()=1 2024-09-12T00:46:50.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.122+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.119__shadow_.0_ZyRGwkccgGG91bbLB_dROh32VfgTv_0 2024-09-12T00:46:50.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.122+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13789766965780741261', time=2024-09-12T02:46:23.522041+0000, chain.objs.size()=1 2024-09-12T00:46:50.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.122+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.119__shadow_.C_ibZfNwae6_sCntU0qebyfK1Ruvs4i_0 2024-09-12T00:46:50.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.125+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.127+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:46:50.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.128+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.129+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.129+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:46:50.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.129+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6171089426578076980', time=2024-09-12T02:46:22.305210+0000, chain.objs.size()=1 2024-09-12T00:46:50.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.129+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.117__shadow_.LVkiV8Bazp4ERqcDM_zB48Pm7ghP-Kl_0 2024-09-12T00:46:50.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.129+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3454292657125124168', time=2024-09-12T02:46:24.113009+0000, chain.objs.size()=1 2024-09-12T00:46:50.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.129+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.120__shadow_.lgwZTWLjBBttYV519tc75I3EDJafFC3_0 2024-09-12T00:46:50.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.129+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8365357485295269491', time=2024-09-12T02:46:24.690706+0000, chain.objs.size()=1 2024-09-12T00:46:50.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.129+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.121__shadow_.I6ojwSBrdEvTZOa25Y5GGiN2fmje8ka_0 2024-09-12T00:46:50.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.129+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16546027477028193960', time=2024-09-12T02:46:25.850189+0000, chain.objs.size()=1 2024-09-12T00:46:50.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.129+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.123__shadow_.8RcvG5Ae-g2kt6u4fDeHfXDY-A2LN2q_0 2024-09-12T00:46:50.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.129+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9268203696552087305', time=2024-09-12T02:46:26.372184+0000, chain.objs.size()=1 2024-09-12T00:46:50.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.129+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.124__shadow_.EsSrjBu7UVxXRL4JMnlbmGZKwrcKDMn_0 2024-09-12T00:46:50.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.129+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9212038008355871422', time=2024-09-12T02:46:26.904065+0000, chain.objs.size()=1 2024-09-12T00:46:50.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.129+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.125__shadow_.czzas-OE4Hsp7ZIvOqFxpnIHNPb6iCq_0 2024-09-12T00:46:50.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.132+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.134+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:46:50.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.135+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.136+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.136+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:50.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.136+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12640456113278879234', time=2024-09-12T02:44:07.758465+0000, chain.objs.size()=1 2024-09-12T00:46:50.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.136+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.82__shadow_.9z_UvsdjZhPPyg5oxZZ0CFxqXhLTD7i_0 2024-09-12T00:46:50.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.136+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1129953186779840028', time=2024-09-12T02:46:19.976676+0000, chain.objs.size()=1 2024-09-12T00:46:50.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.136+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.113__shadow_.lyGeyGYVgLLzbbVI3_B7nVLofP-KVNc_0 2024-09-12T00:46:50.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.136+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3036270395923195397', time=2024-09-12T02:46:30.287549+0000, chain.objs.size()=1 2024-09-12T00:46:50.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.136+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.131__shadow_.HaBQ7xagSut5sywuNN3-f0G7U4G0GcZ_0 2024-09-12T00:46:50.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.136+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5998271936825364595', time=2024-09-12T02:46:31.911033+0000, chain.objs.size()=1 2024-09-12T00:46:50.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.136+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.134__shadow_.UurZgKkUeRHZHsnekm74S8-8MM3AqzO_0 2024-09-12T00:46:50.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.138+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.141+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:46:50.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.142+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.142+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:50.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11371816803918197567', time=2024-09-12T02:44:15.031572+0000, chain.objs.size()=9 2024-09-12T00:46:50.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__multipart_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.1 2024-09-12T00:46:50.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__shadow_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.1_1 2024-09-12T00:46:50.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__multipart_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.2 2024-09-12T00:46:50.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__shadow_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.2_1 2024-09-12T00:46:50.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__multipart_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.3 2024-09-12T00:46:50.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__shadow_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.3_1 2024-09-12T00:46:50.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__multipart_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.4 2024-09-12T00:46:50.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__shadow_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.4_1 2024-09-12T00:46:50.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.92__multipart_key1.2~HaHAfi6WrOnjTVc-4ezKMwRmBD90OjR.5 2024-09-12T00:46:50.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16173478567986336327', time=2024-09-12T02:46:27.983483+0000, chain.objs.size()=1 2024-09-12T00:46:50.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.127__shadow_.o-LvrK0nhJQRZZ6Db6N61r6PP0xX4Dd_0 2024-09-12T00:46:50.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16926671709005723576', time=2024-09-12T02:46:29.235341+0000, chain.objs.size()=1 2024-09-12T00:46:50.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.129__shadow_.9Ar-9ugWH86lvBdEvF_bYfACQaX4ThY_0 2024-09-12T00:46:50.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1429016625343454490', time=2024-09-12T02:46:29.789059+0000, chain.objs.size()=1 2024-09-12T00:46:50.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.143+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.130__shadow_.4TROoB---Gvd88ytErEoAlBmAQt5yrx_0 2024-09-12T00:46:50.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.147+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.150+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:46:50.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.151+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.151+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:46:50.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3674014924054940683', time=2024-09-12T02:44:48.023342+0000, chain.objs.size()=9 2024-09-12T00:46:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.99__multipart_key1.2~1lzv5O-VxnB8_N4nJuO0pJz5zHNzODe.1 2024-09-12T00:46:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.99__shadow_key1.2~1lzv5O-VxnB8_N4nJuO0pJz5zHNzODe.1_1 2024-09-12T00:46:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.99__multipart_key1.2~1lzv5O-VxnB8_N4nJuO0pJz5zHNzODe.2 2024-09-12T00:46:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.99__shadow_key1.2~1lzv5O-VxnB8_N4nJuO0pJz5zHNzODe.2_1 2024-09-12T00:46:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.99__multipart_key1.2~1lzv5O-VxnB8_N4nJuO0pJz5zHNzODe.3 2024-09-12T00:46:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.99__shadow_key1.2~1lzv5O-VxnB8_N4nJuO0pJz5zHNzODe.3_1 2024-09-12T00:46:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.99__multipart_key1.2~1lzv5O-VxnB8_N4nJuO0pJz5zHNzODe.4 2024-09-12T00:46:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.99__shadow_key1.2~1lzv5O-VxnB8_N4nJuO0pJz5zHNzODe.4_1 2024-09-12T00:46:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.99__multipart_key1.2~1lzv5O-VxnB8_N4nJuO0pJz5zHNzODe.5 2024-09-12T00:46:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17307521894866697704', time=2024-09-12T02:46:23.470952+0000, chain.objs.size()=1 2024-09-12T00:46:50.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.119__shadow_.8cYQb_F8v58socOFr34Pd0yLYY8iH23_0 2024-09-12T00:46:50.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15676993295330868081', time=2024-09-12T02:46:24.082967+0000, chain.objs.size()=1 2024-09-12T00:46:50.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.120__shadow_.izq_EXhpf0mI2uTleNvL-2jgG04XOFx_0 2024-09-12T00:46:50.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10309281786798893679', time=2024-09-12T02:46:24.613774+0000, chain.objs.size()=1 2024-09-12T00:46:50.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.152+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.121__shadow_.hICscskvUV47lVeu8qqNKM9y6-qYZFT_0 2024-09-12T00:46:50.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.156+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.756380012364336844', time=2024-09-12T02:46:33.601111+0000, chain.objs.size()=1 2024-09-12T00:46:50.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.156+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.139__shadow_._QNyipuH0O2-hnWNdr29KSVTxXh8-gv_0 2024-09-12T00:46:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.158+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.161+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:46:50.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.162+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.162+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.163+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:46:50.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.163+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10313682086094874524', time=2024-09-12T02:45:04.314831+0000, chain.objs.size()=1 2024-09-12T00:46:50.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.163+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.101__shadow_.oZlMaSiF5uMw-fix232vTTXC5_U6Fma_0 2024-09-12T00:46:50.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.163+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16200694358776478294', time=2024-09-12T02:46:27.460184+0000, chain.objs.size()=1 2024-09-12T00:46:50.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.163+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.126__shadow_.d5A_t8YUvz36rTeQoJP3w6U8aBcGjNO_0 2024-09-12T00:46:50.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.163+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11424761387464725775', time=2024-09-12T02:46:29.182940+0000, chain.objs.size()=1 2024-09-12T00:46:50.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.163+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.129__shadow_.nY947SrmXiU7Xpi7LpLggKp0LK0JGoo_0 2024-09-12T00:46:50.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.165+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.167+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:46:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.168+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.169+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.169+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:46:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.169+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13788338439889319819', time=2024-09-12T02:44:44.540082+0000, chain.objs.size()=7 2024-09-12T00:46:50.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.169+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~cUefpKKsa5sZZdqhVOllXyWhuAn2RNV.1 2024-09-12T00:46:50.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.169+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~cUefpKKsa5sZZdqhVOllXyWhuAn2RNV.1_1 2024-09-12T00:46:50.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.169+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~cUefpKKsa5sZZdqhVOllXyWhuAn2RNV.1_2 2024-09-12T00:46:50.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.169+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~cUefpKKsa5sZZdqhVOllXyWhuAn2RNV.2 2024-09-12T00:46:50.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.169+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~cUefpKKsa5sZZdqhVOllXyWhuAn2RNV.2_1 2024-09-12T00:46:50.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.169+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__shadow_key1.2~cUefpKKsa5sZZdqhVOllXyWhuAn2RNV.2_2 2024-09-12T00:46:50.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.169+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.95__multipart_key1.2~cUefpKKsa5sZZdqhVOllXyWhuAn2RNV.3 2024-09-12T00:46:50.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.169+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3845862471605500217', time=2024-09-12T02:46:33.687145+0000, chain.objs.size()=1 2024-09-12T00:46:50.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.169+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.139__shadow_.3xArSn4RX7ezXrKh_SBmJ3jjQZAXhfD_0 2024-09-12T00:46:50.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.173+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.175+0000 7f60c3136800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:46:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.176+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.177+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.177+0000 7f60c3136800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:46:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.177+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8804248616878115815', time=2024-09-12T02:46:20.611476+0000, chain.objs.size()=1 2024-09-12T00:46:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.177+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.114__shadow_.1wrK7Wta1RF9iDjgVNUNThgamZO6m5O_0 2024-09-12T00:46:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.177+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5239680565934422895', time=2024-09-12T02:46:28.589041+0000, chain.objs.size()=1 2024-09-12T00:46:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.177+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.128__shadow_.O6lWZR6EW4yM_Uy1KVQOCAmvIT0TrxA_0 2024-09-12T00:46:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.177+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8729012265657935925', time=2024-09-12T02:46:28.614539+0000, chain.objs.size()=1 2024-09-12T00:46:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.177+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.128__shadow_.yMNUsAE_oZcyThUoBKE14nenV7ew4oE_0 2024-09-12T00:46:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.177+0000 7f60c3136800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11447953589193384863', time=2024-09-12T02:46:34.422322+0000, chain.objs.size()=1 2024-09-12T00:46:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.177+0000 7f60c3136800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.140__shadow_.He72CIfynhbVra4s63Ldxivgol3P9zN_0 2024-09-12T00:46:50.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.179+0000 7f60c3136800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:46:50.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.182+0000 7f5f757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.184+0000 7f60c3136800 20 remove_watcher() i=0 2024-09-12T00:46:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.184+0000 7f60c3136800 2 removed watcher, disabling cache 2024-09-12T00:46:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.185+0000 7f60c3136800 20 remove_watcher() i=1 2024-09-12T00:46:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.186+0000 7f60c3136800 20 remove_watcher() i=2 2024-09-12T00:46:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.187+0000 7f60c3136800 20 remove_watcher() i=3 2024-09-12T00:46:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.188+0000 7f60c3136800 20 remove_watcher() i=4 2024-09-12T00:46:50.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.189+0000 7f60c3136800 20 remove_watcher() i=5 2024-09-12T00:46:50.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.190+0000 7f60c3136800 20 remove_watcher() i=6 2024-09-12T00:46:50.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.191+0000 7f60c3136800 20 remove_watcher() i=7 2024-09-12T00:46:50.201 DEBUG:teuthology.orchestra.run.smithi133:> radosgw-admin gc process --include-all 2024-09-12T00:46:50.253 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:50.253 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:50.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.291+0000 7f8c58932800 20 rados->read ofs=0 len=0 2024-09-12T00:46:50.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.293+0000 7f8c58932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:50.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.293+0000 7f8c58932800 20 realm 2024-09-12T00:46:50.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.293+0000 7f8c58932800 20 rados->read ofs=0 len=0 2024-09-12T00:46:50.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.293+0000 7f8c58932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:50.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.293+0000 7f8c58932800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:50.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.293+0000 7f8c58932800 20 rados->read ofs=0 len=0 2024-09-12T00:46:50.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.293+0000 7f8c58932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:50.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.293+0000 7f8c58932800 20 rados->read ofs=0 len=0 2024-09-12T00:46:50.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.294+0000 7f8c58932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:50.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.294+0000 7f8c58932800 20 rados->read ofs=0 len=0 2024-09-12T00:46:50.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.295+0000 7f8c58932800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:50.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.295+0000 7f8c58932800 20 searching for the correct realm 2024-09-12T00:46:50.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.297+0000 7f8c53dbb640 0 -- 172.21.15.133:0/1691243663 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f8c48034030 msgr2=0x7f8c48034920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:50.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.301+0000 7f8c53dbb640 0 -- 172.21.15.133:0/1691243663 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f8c4406e410 msgr2=0x7f8c4406e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:50.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.508+0000 7f8c58932800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:46:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.508+0000 7f8c58932800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:46:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.508+0000 7f8c58932800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.508+0000 7f8c58932800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.508+0000 7f8c58932800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.508+0000 7f8c58932800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.508+0000 7f8c58932800 20 rados->read ofs=0 len=0 2024-09-12T00:46:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.509+0000 7f8c58932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.509+0000 7f8c58932800 20 rados->read ofs=0 len=0 2024-09-12T00:46:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.509+0000 7f8c58932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:50.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.509+0000 7f8c58932800 20 rados->read ofs=0 len=0 2024-09-12T00:46:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.509+0000 7f8c58932800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.509+0000 7f8c58932800 20 zone default found 2024-09-12T00:46:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.509+0000 7f8c58932800 4 Realm: () 2024-09-12T00:46:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.509+0000 7f8c58932800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:46:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.509+0000 7f8c58932800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:46:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.509+0000 7f8c58932800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.509+0000 7f8c58932800 20 zonegroup default 2024-09-12T00:46:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.509+0000 7f8c58932800 20 rados->read ofs=0 len=0 2024-09-12T00:46:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.509+0000 7f8c58932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:50.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.509+0000 7f8c58932800 20 rados->read ofs=0 len=0 2024-09-12T00:46:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.510+0000 7f8c58932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.510+0000 7f8c58932800 20 rados->read ofs=0 len=0 2024-09-12T00:46:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.511+0000 7f8c58932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.511+0000 7f8c58932800 20 started sync module instance, tier type = 2024-09-12T00:46:50.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.511+0000 7f8c58932800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:46:50.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.520+0000 7f8c58932800 20 add_watcher() i=0 2024-09-12T00:46:50.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.520+0000 7f8c58932800 20 add_watcher() i=1 2024-09-12T00:46:50.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.520+0000 7f8c58932800 20 add_watcher() i=2 2024-09-12T00:46:50.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.520+0000 7f8c58932800 20 add_watcher() i=3 2024-09-12T00:46:50.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.520+0000 7f8c58932800 20 add_watcher() i=4 2024-09-12T00:46:50.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.520+0000 7f8c58932800 20 add_watcher() i=5 2024-09-12T00:46:50.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.520+0000 7f8c58932800 20 add_watcher() i=6 2024-09-12T00:46:50.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.521+0000 7f8c58932800 20 add_watcher() i=7 2024-09-12T00:46:50.520 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.521+0000 7f8c58932800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:50.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.523+0000 7f8b0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:50.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.523+0000 7f8c58932800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:50.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.523+0000 7f8c58932800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:50.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.558+0000 7f8b09fdb640 20 reqs_thread_entry: start 2024-09-12T00:46:50.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.558+0000 7f8c58932800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:50.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.558+0000 7f8c58932800 20 Filter name: none 2024-09-12T00:46:50.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.558+0000 7f8a7b7fe640 20 reqs_thread_entry: start 2024-09-12T00:46:50.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.558+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:46:50.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.559+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.560+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.560+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.561+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:46:50.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.562+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.563+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.563+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.564+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:46:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.565+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.566+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.566+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.567+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:46:50.567 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.568+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.569+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.569+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.570+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:46:50.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.572+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.572+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.573+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.573+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:46:50.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.575+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.575+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.575+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.576+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:46:50.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.577+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.578+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.578+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.579+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:46:50.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.580+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.581+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.581+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.582+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:46:50.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.584+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.584+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.584+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.585+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:46:50.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.586+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.587+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.587+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.588+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:46:50.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.589+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.590+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.590+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.591+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:46:50.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.593+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.593+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.594+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.595+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:46:50.594 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.596+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.596+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.597+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.598+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:46:50.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.599+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.599+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.599+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.600+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:46:50.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.602+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.602+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.602+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.603+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:46:50.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.605+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.606+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.606+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.607+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:46:50.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.609+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.610+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.610+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.611+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:46:50.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.612+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.613+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.613+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.614+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:46:50.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.615+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.616+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.616+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.617+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:46:50.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.618+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.619+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.619+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.620+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:46:50.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.622+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.622+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.622+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.623+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:46:50.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.624+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.625+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.625+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.626+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:46:50.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.628+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.628+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.629+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.630+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:46:50.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.631+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.631+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.632+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.632+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:46:50.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.634+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.634+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.635+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.636+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:46:50.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.637+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.637+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.637+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.638+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:46:50.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.639+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.640+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.640+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.641+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:46:50.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.643+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.643+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.643+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.644+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:46:50.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.646+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.647+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.647+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.648+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:46:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.649+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.650+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.650+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.651+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:46:50.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.652+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.653+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.653+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.654+0000 7f8c58932800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:46:50.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.655+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.656+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:46:50.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.656+0000 7f8c58932800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:46:50.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.658+0000 7f8b0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.660+0000 7f8c58932800 20 remove_watcher() i=0 2024-09-12T00:46:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.660+0000 7f8c58932800 2 removed watcher, disabling cache 2024-09-12T00:46:50.660 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.661+0000 7f8c58932800 20 remove_watcher() i=1 2024-09-12T00:46:50.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.662+0000 7f8c58932800 20 remove_watcher() i=2 2024-09-12T00:46:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.663+0000 7f8c58932800 20 remove_watcher() i=3 2024-09-12T00:46:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.664+0000 7f8c58932800 20 remove_watcher() i=4 2024-09-12T00:46:50.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.665+0000 7f8c58932800 20 remove_watcher() i=5 2024-09-12T00:46:50.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.666+0000 7f8c58932800 20 remove_watcher() i=6 2024-09-12T00:46:50.665 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:50.667+0000 7f8c58932800 20 remove_watcher() i=7 2024-09-12T00:46:50.677 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T00:46:50.698 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T00:46:50.698 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T00:46:50.698 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T00:46:50.699 DEBUG:teuthology.orchestra.run.smithi133:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:46:50.727 INFO:teuthology.orchestra.run.smithi133.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T00:46:51.569 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T00:46:51.569 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-12T00:46:51.670 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:51.670 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:51.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:51.705+0000 7f7c6d539800 20 rados->read ofs=0 len=0 2024-09-12T00:46:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:51.707+0000 7f7c6d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:51.707+0000 7f7c6d539800 20 realm 2024-09-12T00:46:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:51.707+0000 7f7c6d539800 20 rados->read ofs=0 len=0 2024-09-12T00:46:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:51.707+0000 7f7c6d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:51.707+0000 7f7c6d539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:51.707+0000 7f7c6d539800 20 rados->read ofs=0 len=0 2024-09-12T00:46:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:51.707+0000 7f7c6d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:51.707+0000 7f7c6d539800 20 rados->read ofs=0 len=0 2024-09-12T00:46:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:51.708+0000 7f7c6d539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:51.708+0000 7f7c6d539800 20 rados->read ofs=0 len=0 2024-09-12T00:46:51.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:51.709+0000 7f7c6d539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:51.708 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:51.709+0000 7f7c6d539800 20 searching for the correct realm 2024-09-12T00:46:51.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:51.710+0000 7f7c609c6640 0 -- 172.21.15.133:0/3150205202 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f7c5402f070 msgr2=0x7f7c54049430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:51.914 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:51.915+0000 7f7c609c6640 0 -- 172.21.15.133:0/3150205202 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f7c5c02a060 msgr2=0x7f7c5c061330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:52.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.122+0000 7f7c6d539800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:46:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.122+0000 7f7c6d539800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:46:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.122+0000 7f7c6d539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.122+0000 7f7c6d539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.122+0000 7f7c6d539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.122+0000 7f7c6d539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.122+0000 7f7c6d539800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.122+0000 7f7c6d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.122+0000 7f7c6d539800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.123+0000 7f7c6d539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:52.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.123+0000 7f7c6d539800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.123+0000 7f7c6d539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.123+0000 7f7c6d539800 20 zone default found 2024-09-12T00:46:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.123+0000 7f7c6d539800 4 Realm: () 2024-09-12T00:46:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.123+0000 7f7c6d539800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:46:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.123+0000 7f7c6d539800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:46:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.123+0000 7f7c6d539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.123+0000 7f7c6d539800 20 zonegroup default 2024-09-12T00:46:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.123+0000 7f7c6d539800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.123+0000 7f7c6d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.123+0000 7f7c6d539800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.124+0000 7f7c6d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.124+0000 7f7c6d539800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.124+0000 7f7c6d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.124+0000 7f7c6d539800 20 started sync module instance, tier type = 2024-09-12T00:46:52.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.124+0000 7f7c6d539800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:46:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.134+0000 7f7c6d539800 20 add_watcher() i=0 2024-09-12T00:46:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.134+0000 7f7c6d539800 20 add_watcher() i=1 2024-09-12T00:46:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.134+0000 7f7c6d539800 20 add_watcher() i=2 2024-09-12T00:46:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.134+0000 7f7c6d539800 20 add_watcher() i=3 2024-09-12T00:46:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.134+0000 7f7c6d539800 20 add_watcher() i=4 2024-09-12T00:46:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.134+0000 7f7c6d539800 20 add_watcher() i=5 2024-09-12T00:46:52.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.134+0000 7f7c6d539800 20 add_watcher() i=6 2024-09-12T00:46:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.135+0000 7f7c6d539800 20 add_watcher() i=7 2024-09-12T00:46:52.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.135+0000 7f7c6d539800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:52.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.136+0000 7f7b1ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:52.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.136+0000 7f7c6d539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:52.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.136+0000 7f7c6d539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:52.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.136+0000 7f7c6d539800 5 note: GC not initialized 2024-09-12T00:46:52.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.137+0000 7f7b1efe5640 20 reqs_thread_entry: start 2024-09-12T00:46:52.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.137+0000 7f7c6d539800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:52.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.137+0000 7f7c6d539800 20 Filter name: none 2024-09-12T00:46:52.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.137+0000 7f7b1cfe1640 20 reqs_thread_entry: start 2024-09-12T00:46:52.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.137+0000 7f7c6d539800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-12T00:46:52.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.137+0000 7f7c6d539800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.137+0000 7f7c6d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.137+0000 7f7c6d539800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-12T00:46:52.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.137+0000 7f7c6d539800 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T00:46:52.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.137+0000 7f7c6d539800 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-12T00:46:52.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.137+0000 7f7c6d539800 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-12T00:46:52.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.137+0000 7f7c6d539800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.138+0000 7f7c6d539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.138+0000 7f7c6d539800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-12T00:46:52.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.138+0000 7f7c6d539800 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:46:52.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.138+0000 7f7c6d539800 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-12T00:46:52.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.139+0000 7f7c6d539800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T00:46:52.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.139+0000 7f7c6d539800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T00:46:52.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.139+0000 7f7c6d539800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-12T00:46:52.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.140+0000 7f7b4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497188 cookie 94364192550320 notifier 8531 bl.length()=384 2024-09-12T00:46:52.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.140+0000 7f7b4cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T00:46:52.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.140+0000 7f7b4cff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T00:46:52.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.143+0000 7f7c6d539800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T00:46:52.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.143+0000 7f7c6d539800 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T00:46:52.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.143+0000 7f7c6d539800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-12T00:46:52.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.143+0000 7f7b4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497189 cookie 94364192560608 notifier 8531 bl.length()=225 2024-09-12T00:46:52.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.143+0000 7f7b4cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T00:46:52.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.143+0000 7f7b4cff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T00:46:52.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.145+0000 7f7c6d539800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T00:46:52.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.145+0000 7f7c6d539800 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:46:52.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.145+0000 7f7c6d539800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-12T00:46:52.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.146+0000 7f7b4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497057 cookie 94364192557968 notifier 8531 bl.length()=234 2024-09-12T00:46:52.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.146+0000 7f7b4cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T00:46:52.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.146+0000 7f7b4cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:46:52.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.148+0000 7f7b1ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:52.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.150+0000 7f7c6d539800 20 remove_watcher() i=0 2024-09-12T00:46:52.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.150+0000 7f7c6d539800 2 removed watcher, disabling cache 2024-09-12T00:46:52.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.152+0000 7f7c6d539800 20 remove_watcher() i=1 2024-09-12T00:46:52.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.153+0000 7f7c6d539800 20 remove_watcher() i=2 2024-09-12T00:46:52.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.154+0000 7f7c6d539800 20 remove_watcher() i=3 2024-09-12T00:46:52.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.155+0000 7f7c6d539800 20 remove_watcher() i=4 2024-09-12T00:46:52.155 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.156+0000 7f7c6d539800 20 remove_watcher() i=5 2024-09-12T00:46:52.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.157+0000 7f7c6d539800 20 remove_watcher() i=6 2024-09-12T00:46:52.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.158+0000 7f7c6d539800 20 remove_watcher() i=7 2024-09-12T00:46:52.165 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T00:46:52.166 INFO:teuthology.orchestra.run.smithi133.stdout: "id": "RGW11111111111111111", 2024-09-12T00:46:52.166 INFO:teuthology.orchestra.run.smithi133.stdout: "tenant": "", 2024-09-12T00:46:52.166 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "Mr.RGW11111111111111111", 2024-09-12T00:46:52.166 INFO:teuthology.orchestra.run.smithi133.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-12T00:46:52.166 INFO:teuthology.orchestra.run.smithi133.stdout: "quota": { 2024-09-12T00:46:52.166 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:52.166 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:52.166 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:52.166 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:52.166 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:52.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:52.166 INFO:teuthology.orchestra.run.smithi133.stdout: "bucket_quota": { 2024-09-12T00:46:52.166 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:52.166 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:52.167 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:52.167 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:52.167 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:52.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:52.167 INFO:teuthology.orchestra.run.smithi133.stdout: "max_users": 1000, 2024-09-12T00:46:52.167 INFO:teuthology.orchestra.run.smithi133.stdout: "max_roles": 1000, 2024-09-12T00:46:52.167 INFO:teuthology.orchestra.run.smithi133.stdout: "max_groups": 1000, 2024-09-12T00:46:52.167 INFO:teuthology.orchestra.run.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:46:52.167 INFO:teuthology.orchestra.run.smithi133.stdout: "max_access_keys": 4 2024-09-12T00:46:52.167 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T00:46:52.168 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-12T00:46:52.169 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key QZMPBHNZZNLXMJZWHARL --secret zUjUrU3htjPITDvQoG2vvCzvWnO5bTgQNX3t24Of02wKDEew9tucQw== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-12T00:46:52.238 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:52.238 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:52.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.272+0000 7f43fb2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.274+0000 7f43fb2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.274+0000 7f43fb2bb800 20 realm 2024-09-12T00:46:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.274+0000 7f43fb2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.274+0000 7f43fb2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.274+0000 7f43fb2bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.274+0000 7f43fb2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.274+0000 7f43fb2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.274+0000 7f43fb2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.275+0000 7f43fb2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:52.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.275+0000 7f43fb2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.276+0000 7f43fb2bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:52.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.276+0000 7f43fb2bb800 20 searching for the correct realm 2024-09-12T00:46:52.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.278+0000 7f43f95a6640 0 -- 172.21.15.133:0/4197086181 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f43f0047a70 msgr2=0x7f43f0065a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.483+0000 7f43f8da5640 0 -- 172.21.15.133:0/4197086181 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x55f4e26294c0 msgr2=0x55f4e262b950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:52.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.487+0000 7f43fb2bb800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:46:52.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.487+0000 7f43fb2bb800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:46:52.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.487+0000 7f43fb2bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:52.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.487+0000 7f43fb2bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:52.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.487+0000 7f43fb2bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:52.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.487+0000 7f43fb2bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.487+0000 7f43fb2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.488+0000 7f43fb2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.488+0000 7f43fb2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.488+0000 7f43fb2bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:52.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.488+0000 7f43fb2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.488+0000 7f43fb2bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.488+0000 7f43fb2bb800 20 zone default found 2024-09-12T00:46:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.488+0000 7f43fb2bb800 4 Realm: () 2024-09-12T00:46:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.488+0000 7f43fb2bb800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:46:52.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.488+0000 7f43fb2bb800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:46:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.488+0000 7f43fb2bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.488+0000 7f43fb2bb800 20 zonegroup default 2024-09-12T00:46:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.488+0000 7f43fb2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.489+0000 7f43fb2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.489+0000 7f43fb2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.489+0000 7f43fb2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.489+0000 7f43fb2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.489+0000 7f43fb2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.489+0000 7f43fb2bb800 20 started sync module instance, tier type = 2024-09-12T00:46:52.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.489+0000 7f43fb2bb800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:46:52.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.499+0000 7f43fb2bb800 20 add_watcher() i=0 2024-09-12T00:46:52.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.499+0000 7f43fb2bb800 20 add_watcher() i=1 2024-09-12T00:46:52.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.499+0000 7f43fb2bb800 20 add_watcher() i=2 2024-09-12T00:46:52.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.499+0000 7f43fb2bb800 20 add_watcher() i=3 2024-09-12T00:46:52.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.499+0000 7f43fb2bb800 20 add_watcher() i=4 2024-09-12T00:46:52.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.499+0000 7f43fb2bb800 20 add_watcher() i=5 2024-09-12T00:46:52.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.499+0000 7f43fb2bb800 20 add_watcher() i=6 2024-09-12T00:46:52.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.500+0000 7f43fb2bb800 20 add_watcher() i=7 2024-09-12T00:46:52.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.500+0000 7f43fb2bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:52.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.502+0000 7f42af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:52.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.502+0000 7f43fb2bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:52.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.502+0000 7f43fb2bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:52.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.502+0000 7f43fb2bb800 5 note: GC not initialized 2024-09-12T00:46:52.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.503+0000 7f42ae7e4640 20 reqs_thread_entry: start 2024-09-12T00:46:52.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.503+0000 7f43fb2bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:52.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.503+0000 7f43fb2bb800 20 Filter name: none 2024-09-12T00:46:52.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.503+0000 7f42a7fff640 20 reqs_thread_entry: start 2024-09-12T00:46:52.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.503+0000 7f43fb2bb800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:46:52.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.503+0000 7f43fb2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.503+0000 7f43fb2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.503+0000 7f43fb2bb800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T00:46:52.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.504+0000 7f43fb2bb800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:46:52.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.504+0000 7f43fb2bb800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T00:46:52.507 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.504+0000 7f43fb2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.504+0000 7f43fb2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.504+0000 7f43fb2bb800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T00:46:52.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.504+0000 7f43fb2bb800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:46:52.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.504+0000 7f43fb2bb800 10 cache get: name=default.rgw.meta+users.keys+QZMPBHNZZNLXMJZWHARL : miss 2024-09-12T00:46:52.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.504+0000 7f43fb2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.504+0000 7f43fb2bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.504+0000 7f43fb2bb800 10 cache put: name=default.rgw.meta+users.keys+QZMPBHNZZNLXMJZWHARL info.flags=0x0 2024-09-12T00:46:52.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.504+0000 7f43fb2bb800 10 adding default.rgw.meta+users.keys+QZMPBHNZZNLXMJZWHARL to cache LRU end 2024-09-12T00:46:52.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.504+0000 7f43fb2bb800 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-12T00:46:52.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.504+0000 7f43fb2bb800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.505+0000 7f43fb2bb800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:46:52.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.505+0000 7f43fb2bb800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T00:46:52.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.505+0000 7f43fb2bb800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T00:46:52.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.505+0000 7f43fb2bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:52.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.505+0000 7f43fb2bb800 10 cache get: name=default.rgw.meta+users.keys+QZMPBHNZZNLXMJZWHARL : hit (negative entry) 2024-09-12T00:46:52.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.505+0000 7f43fb2bb800 10 cache get: name=default.rgw.meta+users.keys+QZMPBHNZZNLXMJZWHARL : hit (negative entry) 2024-09-12T00:46:52.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.506+0000 7f43fb2bb800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:46:52.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.506+0000 7f43fb2bb800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:46:52.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.506+0000 7f43fb2bb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:46:52.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.507+0000 7f42cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497032 cookie 94510258500736 notifier 8546 bl.length()=673 2024-09-12T00:46:52.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.507+0000 7f42cffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:46:52.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.507+0000 7f42cffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:46:52.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.510+0000 7f43fb2bb800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:46:52.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.510+0000 7f43fb2bb800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:46:52.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.510+0000 7f43fb2bb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T00:46:52.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.510+0000 7f42cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497190 cookie 94510258552944 notifier 8546 bl.length()=185 2024-09-12T00:46:52.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.510+0000 7f42cffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:46:52.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.510+0000 7f42cffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:46:52.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.513+0000 7f43fb2bb800 10 cache put: name=default.rgw.meta+users.keys+QZMPBHNZZNLXMJZWHARL info.flags=0x7 2024-09-12T00:46:52.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.513+0000 7f43fb2bb800 10 moving default.rgw.meta+users.keys+QZMPBHNZZNLXMJZWHARL to cache LRU end 2024-09-12T00:46:52.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.513+0000 7f43fb2bb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:QZMPBHNZZNLXMJZWHARL, ofs0, ns] 2024-09-12T00:46:52.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.513+0000 7f42cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497033 cookie 94510258500736 notifier 8546 bl.length()=186 2024-09-12T00:46:52.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.513+0000 7f42cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QZMPBHNZZNLXMJZWHARL info.flags=0x7 2024-09-12T00:46:52.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.513+0000 7f42cf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QZMPBHNZZNLXMJZWHARL to cache LRU end 2024-09-12T00:46:52.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.515+0000 7f43fb2bb800 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-12T00:46:52.515 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T00:46:52.515 INFO:teuthology.orchestra.run.smithi133.stdout: "user_id": "foo.client.0", 2024-09-12T00:46:52.515 INFO:teuthology.orchestra.run.smithi133.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-12T00:46:52.515 INFO:teuthology.orchestra.run.smithi133.stdout: "email": "foo+test@test.test", 2024-09-12T00:46:52.515 INFO:teuthology.orchestra.run.smithi133.stdout: "suspended": 0, 2024-09-12T00:46:52.515 INFO:teuthology.orchestra.run.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:46:52.515 INFO:teuthology.orchestra.run.smithi133.stdout: "subusers": [], 2024-09-12T00:46:52.515 INFO:teuthology.orchestra.run.smithi133.stdout: "keys": [ 2024-09-12T00:46:52.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-09-12T00:46:52.516 INFO:teuthology.orchestra.run.smithi133.stdout: "user": "foo.client.0", 2024-09-12T00:46:52.516 INFO:teuthology.orchestra.run.smithi133.stdout: "access_key": "QZMPBHNZZNLXMJZWHARL", 2024-09-12T00:46:52.516 INFO:teuthology.orchestra.run.smithi133.stdout: "secret_key": "zUjUrU3htjPITDvQoG2vvCzvWnO5bTgQNX3t24Of02wKDEew9tucQw==", 2024-09-12T00:46:52.516 INFO:teuthology.orchestra.run.smithi133.stdout: "active": true, 2024-09-12T00:46:52.516 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:46:52.506147Z" 2024-09-12T00:46:52.516 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-09-12T00:46:52.516 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-09-12T00:46:52.516 INFO:teuthology.orchestra.run.smithi133.stdout: "swift_keys": [], 2024-09-12T00:46:52.516 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": [], 2024-09-12T00:46:52.517 INFO:teuthology.orchestra.run.smithi133.stdout: "op_mask": "read, write, delete", 2024-09-12T00:46:52.517 INFO:teuthology.orchestra.run.smithi133.stdout: "default_placement": "", 2024-09-12T00:46:52.517 INFO:teuthology.orchestra.run.smithi133.stdout: "default_storage_class": "", 2024-09-12T00:46:52.517 INFO:teuthology.orchestra.run.smithi133.stdout: "placement_tags": [], 2024-09-12T00:46:52.517 INFO:teuthology.orchestra.run.smithi133.stdout: "bucket_quota": { 2024-09-12T00:46:52.517 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:52.517 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:52.517 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:52.517 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:52.517 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:52.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:52.518 INFO:teuthology.orchestra.run.smithi133.stdout: "user_quota": { 2024-09-12T00:46:52.518 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:52.518 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:52.518 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:52.518 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:52.518 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:52.518 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:52.518 INFO:teuthology.orchestra.run.smithi133.stdout: "temp_url_keys": [], 2024-09-12T00:46:52.518 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "root", 2024-09-12T00:46:52.519 INFO:teuthology.orchestra.run.smithi133.stdout: "mfa_ids": [], 2024-09-12T00:46:52.519 INFO:teuthology.orchestra.run.smithi133.stdout: "account_id": "RGW11111111111111111", 2024-09-12T00:46:52.519 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/", 2024-09-12T00:46:52.519 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:46:52.506135Z", 2024-09-12T00:46:52.519 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2024-09-12T00:46:52.519 INFO:teuthology.orchestra.run.smithi133.stdout: "group_ids": [] 2024-09-12T00:46:52.519 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T00:46:52.519 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:52.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.516+0000 7f42af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:52.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.518+0000 7f43fb2bb800 20 remove_watcher() i=0 2024-09-12T00:46:52.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.518+0000 7f43fb2bb800 2 removed watcher, disabling cache 2024-09-12T00:46:52.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.519+0000 7f43fb2bb800 20 remove_watcher() i=1 2024-09-12T00:46:52.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.521+0000 7f43fb2bb800 20 remove_watcher() i=2 2024-09-12T00:46:52.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.522+0000 7f43fb2bb800 20 remove_watcher() i=3 2024-09-12T00:46:52.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.523+0000 7f43fb2bb800 20 remove_watcher() i=4 2024-09-12T00:46:52.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.524+0000 7f43fb2bb800 20 remove_watcher() i=5 2024-09-12T00:46:52.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.525+0000 7f43fb2bb800 20 remove_watcher() i=6 2024-09-12T00:46:52.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.526+0000 7f43fb2bb800 20 remove_watcher() i=7 2024-09-12T00:46:52.537 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 9562026114 --totp-seed 5NPF2FWWBHXUVIV6SNQOYT2MCDGEMTIB36OWR2VX7ZAWV2RV2WKMUYE3NR3DON6R --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:46:52.603 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:52.604 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:52.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.638+0000 7f2baae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.639+0000 7f2baae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.639+0000 7f2baae0e800 20 realm 2024-09-12T00:46:52.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.639+0000 7f2baae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.640+0000 7f2baae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.640+0000 7f2baae0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:52.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.640+0000 7f2baae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.640+0000 7f2baae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.640+0000 7f2baae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.640+0000 7f2baae0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:52.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.640+0000 7f2baae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.641+0000 7f2baae0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:52.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.641+0000 7f2baae0e800 20 searching for the correct realm 2024-09-12T00:46:52.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.644+0000 7f2ba6d6c640 0 -- 172.21.15.133:0/438219405 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f2ba0017070 msgr2=0x7f2ba0017960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:52.848 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.850+0000 7f2ba6d6c640 0 -- 172.21.15.133:0/438219405 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x562751437520 msgr2=0x5627514399b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.854+0000 7f2baae0e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:46:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.854+0000 7f2baae0e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:46:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.854+0000 7f2baae0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.854+0000 7f2baae0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.854+0000 7f2baae0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.854+0000 7f2baae0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.854+0000 7f2baae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.854+0000 7f2baae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.854+0000 7f2baae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.854+0000 7f2baae0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.854+0000 7f2baae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.855+0000 7f2baae0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.855+0000 7f2baae0e800 20 zone default found 2024-09-12T00:46:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.855+0000 7f2baae0e800 4 Realm: () 2024-09-12T00:46:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.855+0000 7f2baae0e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:46:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.855+0000 7f2baae0e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:46:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.855+0000 7f2baae0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.855+0000 7f2baae0e800 20 zonegroup default 2024-09-12T00:46:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.855+0000 7f2baae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.855+0000 7f2baae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.855+0000 7f2baae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.855+0000 7f2baae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.855+0000 7f2baae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.856+0000 7f2baae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.856+0000 7f2baae0e800 20 started sync module instance, tier type = 2024-09-12T00:46:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.856+0000 7f2baae0e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:46:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.866+0000 7f2baae0e800 20 add_watcher() i=0 2024-09-12T00:46:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.866+0000 7f2baae0e800 20 add_watcher() i=1 2024-09-12T00:46:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.866+0000 7f2baae0e800 20 add_watcher() i=2 2024-09-12T00:46:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.866+0000 7f2baae0e800 20 add_watcher() i=3 2024-09-12T00:46:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.866+0000 7f2baae0e800 20 add_watcher() i=4 2024-09-12T00:46:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.866+0000 7f2baae0e800 20 add_watcher() i=5 2024-09-12T00:46:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.866+0000 7f2baae0e800 20 add_watcher() i=6 2024-09-12T00:46:52.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.867+0000 7f2baae0e800 20 add_watcher() i=7 2024-09-12T00:46:52.866 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.867+0000 7f2baae0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:52.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.869+0000 7f2a5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:52.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.869+0000 7f2baae0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:52.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.869+0000 7f2baae0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:52.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.869+0000 7f2baae0e800 5 note: GC not initialized 2024-09-12T00:46:52.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.869+0000 7f29d77fe640 20 reqs_thread_entry: start 2024-09-12T00:46:52.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.869+0000 7f2baae0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:52.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.870+0000 7f2baae0e800 20 Filter name: none 2024-09-12T00:46:52.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.870+0000 7f29d57fa640 20 reqs_thread_entry: start 2024-09-12T00:46:52.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.870+0000 7f2baae0e800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:46:52.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.870+0000 7f2baae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:52.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.870+0000 7f2baae0e800 20 rados_obj.operate() r=0 bl.length=488 2024-09-12T00:46:52.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.870+0000 7f2baae0e800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T00:46:52.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.870+0000 7f2baae0e800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:46:52.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:52.870+0000 7f2baae0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:54.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.892+0000 7f2baae0e800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:46:54.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.892+0000 7f2baae0e800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:46:54.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.892+0000 7f2baae0e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:46:54.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.893+0000 7f2a897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431626 cookie 94726867096704 notifier 8564 bl.length()=687 2024-09-12T00:46:54.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.893+0000 7f2a897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:46:54.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.893+0000 7f2a897fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:46:54.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.896+0000 7f2a5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:54.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.898+0000 7f2baae0e800 20 remove_watcher() i=0 2024-09-12T00:46:54.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.898+0000 7f2baae0e800 2 removed watcher, disabling cache 2024-09-12T00:46:54.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.900+0000 7f2baae0e800 20 remove_watcher() i=1 2024-09-12T00:46:54.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.901+0000 7f2baae0e800 20 remove_watcher() i=2 2024-09-12T00:46:54.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.902+0000 7f2baae0e800 20 remove_watcher() i=3 2024-09-12T00:46:54.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.903+0000 7f2baae0e800 20 remove_watcher() i=4 2024-09-12T00:46:54.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.904+0000 7f2baae0e800 20 remove_watcher() i=5 2024-09-12T00:46:54.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.906+0000 7f2baae0e800 20 remove_watcher() i=6 2024-09-12T00:46:54.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:54.907+0000 7f2baae0e800 20 remove_watcher() i=7 2024-09-12T00:46:54.918 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T00:46:54.918 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key CWBMOYTMHTJCHSFGOFRH --secret NrcTdrbeAXPPAkNQERk+z5qpH3BVsqZu24mOIh0rOnFn87lCecE85g== --cluster ceph 2024-09-12T00:46:54.985 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:54.985 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:55.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.021+0000 7ff44b20e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.023+0000 7ff44b20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.023+0000 7ff44b20e800 20 realm 2024-09-12T00:46:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.023+0000 7ff44b20e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.023+0000 7ff44b20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.023+0000 7ff44b20e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.023+0000 7ff44b20e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.023+0000 7ff44b20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.023+0000 7ff44b20e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.024+0000 7ff44b20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.024+0000 7ff44b20e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.025+0000 7ff44b20e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.025+0000 7ff44b20e800 20 searching for the correct realm 2024-09-12T00:46:55.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.026+0000 7ff43ffff640 0 -- 172.21.15.133:0/200904040 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff430018070 msgr2=0x7ff430086980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:55.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.231+0000 7ff43ffff640 0 -- 172.21.15.133:0/200904040 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff43800a440 msgr2=0x7ff43800a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.438+0000 7ff44b20e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:46:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.438+0000 7ff44b20e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:46:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.438+0000 7ff44b20e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.438+0000 7ff44b20e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.438+0000 7ff44b20e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.438+0000 7ff44b20e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.438+0000 7ff44b20e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.438+0000 7ff44b20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.438+0000 7ff44b20e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.438+0000 7ff44b20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.439+0000 7ff44b20e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.439+0000 7ff44b20e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.439+0000 7ff44b20e800 20 zone default found 2024-09-12T00:46:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.439+0000 7ff44b20e800 4 Realm: () 2024-09-12T00:46:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.439+0000 7ff44b20e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:46:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.439+0000 7ff44b20e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:46:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.439+0000 7ff44b20e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.439+0000 7ff44b20e800 20 zonegroup default 2024-09-12T00:46:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.439+0000 7ff44b20e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.439+0000 7ff44b20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.439+0000 7ff44b20e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.439+0000 7ff44b20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.439+0000 7ff44b20e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.440+0000 7ff44b20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.440+0000 7ff44b20e800 20 started sync module instance, tier type = 2024-09-12T00:46:55.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.440+0000 7ff44b20e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:46:55.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.450+0000 7ff44b20e800 20 add_watcher() i=0 2024-09-12T00:46:55.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.450+0000 7ff44b20e800 20 add_watcher() i=1 2024-09-12T00:46:55.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.450+0000 7ff44b20e800 20 add_watcher() i=2 2024-09-12T00:46:55.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.450+0000 7ff44b20e800 20 add_watcher() i=3 2024-09-12T00:46:55.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.450+0000 7ff44b20e800 20 add_watcher() i=4 2024-09-12T00:46:55.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.450+0000 7ff44b20e800 20 add_watcher() i=5 2024-09-12T00:46:55.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.450+0000 7ff44b20e800 20 add_watcher() i=6 2024-09-12T00:46:55.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.451+0000 7ff44b20e800 20 add_watcher() i=7 2024-09-12T00:46:55.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.451+0000 7ff44b20e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.453+0000 7ff2fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.453+0000 7ff44b20e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.453+0000 7ff44b20e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.453+0000 7ff44b20e800 5 note: GC not initialized 2024-09-12T00:46:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.453+0000 7ff277fff640 20 reqs_thread_entry: start 2024-09-12T00:46:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.453+0000 7ff44b20e800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.454+0000 7ff44b20e800 20 Filter name: none 2024-09-12T00:46:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.454+0000 7ff275ffb640 20 reqs_thread_entry: start 2024-09-12T00:46:55.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.454+0000 7ff44b20e800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:46:55.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.454+0000 7ff44b20e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.454+0000 7ff44b20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.454+0000 7ff44b20e800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T00:46:55.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.454+0000 7ff44b20e800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:46:55.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.454+0000 7ff44b20e800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T00:46:55.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.454+0000 7ff44b20e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.454+0000 7ff44b20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.454+0000 7ff44b20e800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T00:46:55.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.454+0000 7ff44b20e800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:46:55.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.454+0000 7ff44b20e800 10 cache get: name=default.rgw.meta+users.keys+CWBMOYTMHTJCHSFGOFRH : miss 2024-09-12T00:46:55.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.454+0000 7ff44b20e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.455+0000 7ff44b20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.455+0000 7ff44b20e800 10 cache put: name=default.rgw.meta+users.keys+CWBMOYTMHTJCHSFGOFRH info.flags=0x0 2024-09-12T00:46:55.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.455+0000 7ff44b20e800 10 adding default.rgw.meta+users.keys+CWBMOYTMHTJCHSFGOFRH to cache LRU end 2024-09-12T00:46:55.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.455+0000 7ff44b20e800 10 cache get: name=default.rgw.meta+users.keys+CWBMOYTMHTJCHSFGOFRH : hit (negative entry) 2024-09-12T00:46:55.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.455+0000 7ff44b20e800 10 cache get: name=default.rgw.meta+users.keys+CWBMOYTMHTJCHSFGOFRH : hit (negative entry) 2024-09-12T00:46:55.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.456+0000 7ff44b20e800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:46:55.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.456+0000 7ff44b20e800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:46:55.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.456+0000 7ff44b20e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:46:55.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.456+0000 7ff32a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431783 cookie 94203570390848 notifier 8582 bl.length()=645 2024-09-12T00:46:55.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.456+0000 7ff32a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:46:55.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.456+0000 7ff32a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:46:55.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.459+0000 7ff44b20e800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:46:55.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.459+0000 7ff44b20e800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:46:55.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.459+0000 7ff44b20e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T00:46:55.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.459+0000 7ff32a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431855 cookie 94203570403728 notifier 8582 bl.length()=185 2024-09-12T00:46:55.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.459+0000 7ff32a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:46:55.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.459+0000 7ff32a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:46:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.462+0000 7ff44b20e800 10 cache put: name=default.rgw.meta+users.keys+CWBMOYTMHTJCHSFGOFRH info.flags=0x7 2024-09-12T00:46:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.462+0000 7ff44b20e800 10 moving default.rgw.meta+users.keys+CWBMOYTMHTJCHSFGOFRH to cache LRU end 2024-09-12T00:46:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.462+0000 7ff44b20e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:CWBMOYTMHTJCHSFGOFRH, ofs0, ns] 2024-09-12T00:46:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.462+0000 7ff32a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431650 cookie 94203570398496 notifier 8582 bl.length()=186 2024-09-12T00:46:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.462+0000 7ff32a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CWBMOYTMHTJCHSFGOFRH info.flags=0x7 2024-09-12T00:46:55.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.462+0000 7ff32a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CWBMOYTMHTJCHSFGOFRH to cache LRU end 2024-09-12T00:46:55.462 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T00:46:55.462 INFO:teuthology.orchestra.run.smithi133.stdout: "user_id": "bar.client.0", 2024-09-12T00:46:55.462 INFO:teuthology.orchestra.run.smithi133.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T00:46:55.462 INFO:teuthology.orchestra.run.smithi133.stdout: "email": "bar+test@test.test", 2024-09-12T00:46:55.462 INFO:teuthology.orchestra.run.smithi133.stdout: "suspended": 0, 2024-09-12T00:46:55.462 INFO:teuthology.orchestra.run.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:46:55.463 INFO:teuthology.orchestra.run.smithi133.stdout: "subusers": [], 2024-09-12T00:46:55.463 INFO:teuthology.orchestra.run.smithi133.stdout: "keys": [ 2024-09-12T00:46:55.463 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-09-12T00:46:55.463 INFO:teuthology.orchestra.run.smithi133.stdout: "user": "bar.client.0", 2024-09-12T00:46:55.463 INFO:teuthology.orchestra.run.smithi133.stdout: "access_key": "CWBMOYTMHTJCHSFGOFRH", 2024-09-12T00:46:55.463 INFO:teuthology.orchestra.run.smithi133.stdout: "secret_key": "NrcTdrbeAXPPAkNQERk+z5qpH3BVsqZu24mOIh0rOnFn87lCecE85g==", 2024-09-12T00:46:55.463 INFO:teuthology.orchestra.run.smithi133.stdout: "active": true, 2024-09-12T00:46:55.463 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:46:55.455928Z" 2024-09-12T00:46:55.463 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-09-12T00:46:55.463 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-09-12T00:46:55.463 INFO:teuthology.orchestra.run.smithi133.stdout: "swift_keys": [], 2024-09-12T00:46:55.463 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": [], 2024-09-12T00:46:55.463 INFO:teuthology.orchestra.run.smithi133.stdout: "op_mask": "read, write, delete", 2024-09-12T00:46:55.463 INFO:teuthology.orchestra.run.smithi133.stdout: "default_placement": "", 2024-09-12T00:46:55.464 INFO:teuthology.orchestra.run.smithi133.stdout: "default_storage_class": "", 2024-09-12T00:46:55.464 INFO:teuthology.orchestra.run.smithi133.stdout: "placement_tags": [], 2024-09-12T00:46:55.464 INFO:teuthology.orchestra.run.smithi133.stdout: "bucket_quota": { 2024-09-12T00:46:55.464 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:55.464 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:55.464 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:55.464 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:55.464 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:55.464 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:55.464 INFO:teuthology.orchestra.run.smithi133.stdout: "user_quota": { 2024-09-12T00:46:55.464 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:55.464 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:55.464 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:55.464 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:55.465 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:55.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:55.465 INFO:teuthology.orchestra.run.smithi133.stdout: "temp_url_keys": [], 2024-09-12T00:46:55.465 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "rgw", 2024-09-12T00:46:55.465 INFO:teuthology.orchestra.run.smithi133.stdout: "mfa_ids": [], 2024-09-12T00:46:55.465 INFO:teuthology.orchestra.run.smithi133.stdout: "account_id": "", 2024-09-12T00:46:55.465 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/", 2024-09-12T00:46:55.465 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:46:55.455913Z", 2024-09-12T00:46:55.465 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2024-09-12T00:46:55.465 INFO:teuthology.orchestra.run.smithi133.stdout: "group_ids": [] 2024-09-12T00:46:55.465 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T00:46:55.465 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:55.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.464+0000 7ff2fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:55.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.467+0000 7ff44b20e800 20 remove_watcher() i=0 2024-09-12T00:46:55.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.467+0000 7ff44b20e800 2 removed watcher, disabling cache 2024-09-12T00:46:55.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.468+0000 7ff44b20e800 20 remove_watcher() i=1 2024-09-12T00:46:55.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.469+0000 7ff44b20e800 20 remove_watcher() i=2 2024-09-12T00:46:55.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.470+0000 7ff44b20e800 20 remove_watcher() i=3 2024-09-12T00:46:55.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.471+0000 7ff44b20e800 20 remove_watcher() i=4 2024-09-12T00:46:55.471 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.472+0000 7ff44b20e800 20 remove_watcher() i=5 2024-09-12T00:46:55.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.473+0000 7ff44b20e800 20 remove_watcher() i=6 2024-09-12T00:46:55.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.474+0000 7ff44b20e800 20 remove_watcher() i=7 2024-09-12T00:46:55.485 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 9300275371 --totp-seed ECWG2WACV7IQDNDTWQUSUYWWB4I725EWP6GOJIAM6VFU63X3JHYKPWZOEWTYORZD --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:46:55.551 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:55.551 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:55.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.585+0000 7f888fbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.587+0000 7f888fbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.587+0000 7f888fbaf800 20 realm 2024-09-12T00:46:55.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.587+0000 7f888fbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.587+0000 7f888fbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.587+0000 7f888fbaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:55.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.587+0000 7f888fbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.586 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.587+0000 7f888fbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.587+0000 7f888fbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.588+0000 7f888fbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:55.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.588+0000 7f888fbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.589+0000 7f888fbaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.589+0000 7f888fbaf800 20 searching for the correct realm 2024-09-12T00:46:55.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.591+0000 7f888dea1640 0 -- 172.21.15.133:0/2891773017 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x560c5cac4080 msgr2=0x560c5cac6490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:55.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.594+0000 7f888d6a0640 0 -- 172.21.15.133:0/2891773017 >> [v2:172.21.15.160:6818/507321805,v1:172.21.15.160:6819/507321805] conn(0x7f8884081070 msgr2=0x7f888403c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:55.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.803+0000 7f888fbaf800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:46:55.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.803+0000 7f888fbaf800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:46:55.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.803+0000 7f888fbaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:55.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.803+0000 7f888fbaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:55.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.803+0000 7f888fbaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:55.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.803+0000 7f888fbaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:55.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.803+0000 7f888fbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.803+0000 7f888fbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.803+0000 7f888fbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.803+0000 7f888fbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:55.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.803+0000 7f888fbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.803+0000 7f888fbaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:55.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.804+0000 7f888fbaf800 20 zone default found 2024-09-12T00:46:55.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.804+0000 7f888fbaf800 4 Realm: () 2024-09-12T00:46:55.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.804+0000 7f888fbaf800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:46:55.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.804+0000 7f888fbaf800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:46:55.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.804+0000 7f888fbaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:55.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.804+0000 7f888fbaf800 20 zonegroup default 2024-09-12T00:46:55.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.804+0000 7f888fbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.806 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.804+0000 7f888fbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.804+0000 7f888fbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.804+0000 7f888fbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.804+0000 7f888fbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.805+0000 7f888fbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.805+0000 7f888fbaf800 20 started sync module instance, tier type = 2024-09-12T00:46:55.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.805+0000 7f888fbaf800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:46:55.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.814+0000 7f888fbaf800 20 add_watcher() i=0 2024-09-12T00:46:55.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.814+0000 7f888fbaf800 20 add_watcher() i=1 2024-09-12T00:46:55.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.814+0000 7f888fbaf800 20 add_watcher() i=2 2024-09-12T00:46:55.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.814+0000 7f888fbaf800 20 add_watcher() i=3 2024-09-12T00:46:55.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.814+0000 7f888fbaf800 20 add_watcher() i=4 2024-09-12T00:46:55.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.814+0000 7f888fbaf800 20 add_watcher() i=5 2024-09-12T00:46:55.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.814+0000 7f888fbaf800 20 add_watcher() i=6 2024-09-12T00:46:55.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.815+0000 7f888fbaf800 20 add_watcher() i=7 2024-09-12T00:46:55.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.815+0000 7f888fbaf800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:55.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.817+0000 7f87437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:55.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.817+0000 7f888fbaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:55.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.817+0000 7f888fbaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:55.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.817+0000 7f888fbaf800 5 note: GC not initialized 2024-09-12T00:46:55.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.817+0000 7f87427e4640 20 reqs_thread_entry: start 2024-09-12T00:46:55.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.817+0000 7f888fbaf800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:55.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.818+0000 7f888fbaf800 20 Filter name: none 2024-09-12T00:46:55.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.818+0000 7f86b3fff640 20 reqs_thread_entry: start 2024-09-12T00:46:55.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.818+0000 7f888fbaf800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:46:55.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.818+0000 7f888fbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.818+0000 7f888fbaf800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:46:55.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.818+0000 7f888fbaf800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T00:46:55.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.818+0000 7f888fbaf800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:46:55.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.818+0000 7f888fbaf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:55.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.821+0000 7f888fbaf800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:46:55.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.821+0000 7f888fbaf800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:46:55.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.821+0000 7f888fbaf800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:46:55.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.821+0000 7f8770ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431784 cookie 94611094392624 notifier 9225 bl.length()=659 2024-09-12T00:46:55.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.821+0000 7f8770ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:46:55.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.821+0000 7f8770ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:46:55.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.823+0000 7f87437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:55.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.826+0000 7f888fbaf800 20 remove_watcher() i=0 2024-09-12T00:46:55.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.826+0000 7f888fbaf800 2 removed watcher, disabling cache 2024-09-12T00:46:55.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.827+0000 7f888fbaf800 20 remove_watcher() i=1 2024-09-12T00:46:55.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.828+0000 7f888fbaf800 20 remove_watcher() i=2 2024-09-12T00:46:55.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.829+0000 7f888fbaf800 20 remove_watcher() i=3 2024-09-12T00:46:55.828 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.830+0000 7f888fbaf800 20 remove_watcher() i=4 2024-09-12T00:46:55.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.831+0000 7f888fbaf800 20 remove_watcher() i=5 2024-09-12T00:46:55.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.832+0000 7f888fbaf800 20 remove_watcher() i=6 2024-09-12T00:46:55.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.833+0000 7f888fbaf800 20 remove_watcher() i=7 2024-09-12T00:46:55.843 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-12T00:46:55.907 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:55.907 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:55.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.950+0000 7fa9ef746800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.952+0000 7fa9ef746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.952+0000 7fa9ef746800 20 realm 2024-09-12T00:46:55.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.952+0000 7fa9ef746800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.952+0000 7fa9ef746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.952+0000 7fa9ef746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:55.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.952+0000 7fa9ef746800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.952+0000 7fa9ef746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:55.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.952+0000 7fa9ef746800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.953+0000 7fa9ef746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.953+0000 7fa9ef746800 20 rados->read ofs=0 len=0 2024-09-12T00:46:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.954+0000 7fa9ef746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.954+0000 7fa9ef746800 20 searching for the correct realm 2024-09-12T00:46:55.954 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:55.955+0000 7fa9e7fff640 0 -- 172.21.15.133:0/1713024689 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fa9d808e2d0 msgr2=0x7fa9d808cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:56.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.165+0000 7fa9e7fff640 0 -- 172.21.15.133:0/1713024689 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fa9e0064940 msgr2=0x7fa9e00733f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:56.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.371+0000 7fa9ef746800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:46:56.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.371+0000 7fa9ef746800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:46:56.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.371+0000 7fa9ef746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:56.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.371+0000 7fa9ef746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:56.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.371+0000 7fa9ef746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:56.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.371+0000 7fa9ef746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:56.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.371+0000 7fa9ef746800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.372+0000 7fa9ef746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.372+0000 7fa9ef746800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.372+0000 7fa9ef746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:56.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.372+0000 7fa9ef746800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.372+0000 7fa9ef746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:56.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.372+0000 7fa9ef746800 20 zone default found 2024-09-12T00:46:56.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.372+0000 7fa9ef746800 4 Realm: () 2024-09-12T00:46:56.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.372+0000 7fa9ef746800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:46:56.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.372+0000 7fa9ef746800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:46:56.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.372+0000 7fa9ef746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:56.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.372+0000 7fa9ef746800 20 zonegroup default 2024-09-12T00:46:56.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.372+0000 7fa9ef746800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.373+0000 7fa9ef746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.373+0000 7fa9ef746800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.373+0000 7fa9ef746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.373+0000 7fa9ef746800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.373+0000 7fa9ef746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.373+0000 7fa9ef746800 20 started sync module instance, tier type = 2024-09-12T00:46:56.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.373+0000 7fa9ef746800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:46:56.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.383+0000 7fa9ef746800 20 add_watcher() i=0 2024-09-12T00:46:56.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.383+0000 7fa9ef746800 20 add_watcher() i=1 2024-09-12T00:46:56.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.383+0000 7fa9ef746800 20 add_watcher() i=2 2024-09-12T00:46:56.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.383+0000 7fa9ef746800 20 add_watcher() i=3 2024-09-12T00:46:56.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.383+0000 7fa9ef746800 20 add_watcher() i=4 2024-09-12T00:46:56.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.383+0000 7fa9ef746800 20 add_watcher() i=5 2024-09-12T00:46:56.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.383+0000 7fa9ef746800 20 add_watcher() i=6 2024-09-12T00:46:56.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.385+0000 7fa9ef746800 20 add_watcher() i=7 2024-09-12T00:46:56.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.385+0000 7fa9ef746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:56.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.387+0000 7fa8a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:56.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.387+0000 7fa9ef746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:56.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.387+0000 7fa9ef746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:56.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.387+0000 7fa9ef746800 5 note: GC not initialized 2024-09-12T00:46:56.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.387+0000 7fa8a27e4640 20 reqs_thread_entry: start 2024-09-12T00:46:56.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.387+0000 7fa9ef746800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:56.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.387+0000 7fa9ef746800 20 Filter name: none 2024-09-12T00:46:56.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.387+0000 7fa813fff640 20 reqs_thread_entry: start 2024-09-12T00:46:56.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.387+0000 7fa9ef746800 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-12T00:46:56.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.387+0000 7fa9ef746800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.388+0000 7fa9ef746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.388+0000 7fa9ef746800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-12T00:46:56.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.388+0000 7fa9ef746800 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T00:46:56.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.388+0000 7fa9ef746800 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-12T00:46:56.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.388+0000 7fa9ef746800 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-12T00:46:56.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.388+0000 7fa9ef746800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.388+0000 7fa9ef746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.388+0000 7fa9ef746800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-12T00:46:56.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.388+0000 7fa9ef746800 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T00:46:56.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.388+0000 7fa9ef746800 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-12T00:46:56.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.389+0000 7fa9ef746800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T00:46:56.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.389+0000 7fa9ef746800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T00:46:56.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.389+0000 7fa9ef746800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-12T00:46:56.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.390+0000 7fa8d0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399081 cookie 94580224871456 notifier 9243 bl.length()=389 2024-09-12T00:46:56.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.390+0000 7fa8d0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T00:46:56.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.390+0000 7fa8d0ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T00:46:56.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.392+0000 7fa9ef746800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T00:46:56.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.392+0000 7fa9ef746800 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T00:46:56.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.392+0000 7fa9ef746800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-12T00:46:56.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.392+0000 7fa8d0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399082 cookie 94580224877968 notifier 9243 bl.length()=230 2024-09-12T00:46:56.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.392+0000 7fa8d0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T00:46:56.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.392+0000 7fa8d0ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T00:46:56.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.395+0000 7fa9ef746800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T00:46:56.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.395+0000 7fa9ef746800 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T00:46:56.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.395+0000 7fa9ef746800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-12T00:46:56.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.395+0000 7fa8d0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398947 cookie 94580224874416 notifier 9243 bl.length()=234 2024-09-12T00:46:56.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.395+0000 7fa8d0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T00:46:56.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.395+0000 7fa8d0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T00:46:56.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.398+0000 7fa8a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:56.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.400+0000 7fa9ef746800 20 remove_watcher() i=0 2024-09-12T00:46:56.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.400+0000 7fa9ef746800 2 removed watcher, disabling cache 2024-09-12T00:46:56.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.401+0000 7fa9ef746800 20 remove_watcher() i=1 2024-09-12T00:46:56.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.402+0000 7fa9ef746800 20 remove_watcher() i=2 2024-09-12T00:46:56.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.403+0000 7fa9ef746800 20 remove_watcher() i=3 2024-09-12T00:46:56.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.404+0000 7fa9ef746800 20 remove_watcher() i=4 2024-09-12T00:46:56.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.405+0000 7fa9ef746800 20 remove_watcher() i=5 2024-09-12T00:46:56.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.407+0000 7fa9ef746800 20 remove_watcher() i=6 2024-09-12T00:46:56.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.408+0000 7fa9ef746800 20 remove_watcher() i=7 2024-09-12T00:46:56.415 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T00:46:56.415 INFO:teuthology.orchestra.run.smithi133.stdout: "id": "RGW33333333333333333", 2024-09-12T00:46:56.415 INFO:teuthology.orchestra.run.smithi133.stdout: "tenant": "testx", 2024-09-12T00:46:56.415 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "Mr.RGW33333333333333333", 2024-09-12T00:46:56.415 INFO:teuthology.orchestra.run.smithi133.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-12T00:46:56.415 INFO:teuthology.orchestra.run.smithi133.stdout: "quota": { 2024-09-12T00:46:56.415 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:56.415 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:56.416 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:56.416 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:56.416 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:56.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:56.416 INFO:teuthology.orchestra.run.smithi133.stdout: "bucket_quota": { 2024-09-12T00:46:56.416 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:56.416 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:56.416 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:56.416 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:56.416 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:56.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:56.416 INFO:teuthology.orchestra.run.smithi133.stdout: "max_users": 1000, 2024-09-12T00:46:56.416 INFO:teuthology.orchestra.run.smithi133.stdout: "max_roles": 1000, 2024-09-12T00:46:56.416 INFO:teuthology.orchestra.run.smithi133.stdout: "max_groups": 1000, 2024-09-12T00:46:56.417 INFO:teuthology.orchestra.run.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:46:56.417 INFO:teuthology.orchestra.run.smithi133.stdout: "max_access_keys": 4 2024-09-12T00:46:56.417 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T00:46:56.418 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-12T00:46:56.418 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key BMQDZYLMDWZOXJCCGSWN --secret dkKodNr7t++2iHpa+dmhgkKTEF89XMbf0N0sPts+cts/aQMjndpZ7g== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-12T00:46:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:56.485 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:56.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.520+0000 7ffb05d40800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.522+0000 7ffb05d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.522+0000 7ffb05d40800 20 realm 2024-09-12T00:46:56.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.522+0000 7ffb05d40800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.522+0000 7ffb05d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.522+0000 7ffb05d40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:56.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.522+0000 7ffb05d40800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.522+0000 7ffb05d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.522+0000 7ffb05d40800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.523+0000 7ffb05d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:56.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.523+0000 7ffb05d40800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.524+0000 7ffb05d40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:56.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.524+0000 7ffb05d40800 20 searching for the correct realm 2024-09-12T00:46:56.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.526+0000 7ffafbfff640 0 -- 172.21.15.133:0/1596055176 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ffaec01e020 msgr2=0x7ffaec067bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:56.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.529+0000 7ffafbfff640 0 -- 172.21.15.133:0/1596055176 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ffaf40acd60 msgr2=0x7ffaf40b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.737+0000 7ffb05d40800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:46:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.737+0000 7ffb05d40800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:46:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.737+0000 7ffb05d40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.737+0000 7ffb05d40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.737+0000 7ffb05d40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.737+0000 7ffb05d40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:56.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.737+0000 7ffb05d40800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.737+0000 7ffb05d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.737+0000 7ffb05d40800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.738+0000 7ffb05d40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.738+0000 7ffb05d40800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.738+0000 7ffb05d40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.738+0000 7ffb05d40800 20 zone default found 2024-09-12T00:46:56.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.738+0000 7ffb05d40800 4 Realm: () 2024-09-12T00:46:56.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.738+0000 7ffb05d40800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:46:56.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.738+0000 7ffb05d40800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:46:56.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.738+0000 7ffb05d40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:56.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.738+0000 7ffb05d40800 20 zonegroup default 2024-09-12T00:46:56.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.738+0000 7ffb05d40800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.738+0000 7ffb05d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.738+0000 7ffb05d40800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.739+0000 7ffb05d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.739+0000 7ffb05d40800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.739+0000 7ffb05d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.739+0000 7ffb05d40800 20 started sync module instance, tier type = 2024-09-12T00:46:56.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.739+0000 7ffb05d40800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:46:56.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.749+0000 7ffb05d40800 20 add_watcher() i=0 2024-09-12T00:46:56.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.749+0000 7ffb05d40800 20 add_watcher() i=1 2024-09-12T00:46:56.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.749+0000 7ffb05d40800 20 add_watcher() i=2 2024-09-12T00:46:56.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.749+0000 7ffb05d40800 20 add_watcher() i=3 2024-09-12T00:46:56.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.749+0000 7ffb05d40800 20 add_watcher() i=4 2024-09-12T00:46:56.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.749+0000 7ffb05d40800 20 add_watcher() i=5 2024-09-12T00:46:56.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.749+0000 7ffb05d40800 20 add_watcher() i=6 2024-09-12T00:46:56.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.752+0000 7ffb05d40800 20 add_watcher() i=7 2024-09-12T00:46:56.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.752+0000 7ffb05d40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:56.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.754+0000 7ff9b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:56.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.755+0000 7ffb05d40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:56.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.755+0000 7ffb05d40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.755+0000 7ffb05d40800 5 note: GC not initialized 2024-09-12T00:46:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.755+0000 7ff9b27fc640 20 reqs_thread_entry: start 2024-09-12T00:46:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.755+0000 7ffb05d40800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.755+0000 7ffb05d40800 20 Filter name: none 2024-09-12T00:46:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.755+0000 7ff923fff640 20 reqs_thread_entry: start 2024-09-12T00:46:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.755+0000 7ffb05d40800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:46:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.755+0000 7ffb05d40800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.756+0000 7ffb05d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.756+0000 7ffb05d40800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T00:46:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.756+0000 7ffb05d40800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:46:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.756+0000 7ffb05d40800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T00:46:56.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.756+0000 7ffb05d40800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.756+0000 7ffb05d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.756+0000 7ffb05d40800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T00:46:56.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.756+0000 7ffb05d40800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:46:56.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.756+0000 7ffb05d40800 10 cache get: name=default.rgw.meta+users.keys+BMQDZYLMDWZOXJCCGSWN : miss 2024-09-12T00:46:56.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.756+0000 7ffb05d40800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.756+0000 7ffb05d40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.756+0000 7ffb05d40800 10 cache put: name=default.rgw.meta+users.keys+BMQDZYLMDWZOXJCCGSWN info.flags=0x0 2024-09-12T00:46:56.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.756+0000 7ffb05d40800 10 adding default.rgw.meta+users.keys+BMQDZYLMDWZOXJCCGSWN to cache LRU end 2024-09-12T00:46:56.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.756+0000 7ffb05d40800 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-12T00:46:56.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.756+0000 7ffb05d40800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.757+0000 7ffb05d40800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:46:56.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.757+0000 7ffb05d40800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T00:46:56.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.757+0000 7ffb05d40800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T00:46:56.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.757+0000 7ffb05d40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:56.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.757+0000 7ffb05d40800 10 cache get: name=default.rgw.meta+users.keys+BMQDZYLMDWZOXJCCGSWN : hit (negative entry) 2024-09-12T00:46:56.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.757+0000 7ffb05d40800 10 cache get: name=default.rgw.meta+users.keys+BMQDZYLMDWZOXJCCGSWN : hit (negative entry) 2024-09-12T00:46:56.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.759+0000 7ffb05d40800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:46:56.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.759+0000 7ffb05d40800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:46:56.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.759+0000 7ffb05d40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:46:56.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.759+0000 7ff9e57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399152 cookie 94910447554352 notifier 8636 bl.length()=732 2024-09-12T00:46:56.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.759+0000 7ff9e57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:46:56.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.759+0000 7ff9e57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:46:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.762+0000 7ffb05d40800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:46:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.762+0000 7ffb05d40800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:46:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.762+0000 7ffb05d40800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T00:46:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.762+0000 7ff9e57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399153 cookie 94910447561488 notifier 8636 bl.length()=215 2024-09-12T00:46:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.762+0000 7ff9e57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:46:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.762+0000 7ff9e57fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:46:56.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.765+0000 7ffb05d40800 10 cache put: name=default.rgw.meta+users.keys+BMQDZYLMDWZOXJCCGSWN info.flags=0x7 2024-09-12T00:46:56.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.765+0000 7ffb05d40800 10 moving default.rgw.meta+users.keys+BMQDZYLMDWZOXJCCGSWN to cache LRU end 2024-09-12T00:46:56.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.765+0000 7ffb05d40800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:BMQDZYLMDWZOXJCCGSWN, ofs0, ns] 2024-09-12T00:46:56.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.765+0000 7ff9e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398948 cookie 94910447550192 notifier 8636 bl.length()=201 2024-09-12T00:46:56.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.765+0000 7ff9e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BMQDZYLMDWZOXJCCGSWN info.flags=0x7 2024-09-12T00:46:56.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.765+0000 7ff9e4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BMQDZYLMDWZOXJCCGSWN to cache LRU end 2024-09-12T00:46:56.767 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.768+0000 7ffb05d40800 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-12T00:46:56.767 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T00:46:56.767 INFO:teuthology.orchestra.run.smithi133.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T00:46:56.767 INFO:teuthology.orchestra.run.smithi133.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-12T00:46:56.767 INFO:teuthology.orchestra.run.smithi133.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T00:46:56.767 INFO:teuthology.orchestra.run.smithi133.stdout: "suspended": 0, 2024-09-12T00:46:56.767 INFO:teuthology.orchestra.run.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:46:56.767 INFO:teuthology.orchestra.run.smithi133.stdout: "subusers": [], 2024-09-12T00:46:56.767 INFO:teuthology.orchestra.run.smithi133.stdout: "keys": [ 2024-09-12T00:46:56.768 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-09-12T00:46:56.768 INFO:teuthology.orchestra.run.smithi133.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T00:46:56.768 INFO:teuthology.orchestra.run.smithi133.stdout: "access_key": "BMQDZYLMDWZOXJCCGSWN", 2024-09-12T00:46:56.768 INFO:teuthology.orchestra.run.smithi133.stdout: "secret_key": "dkKodNr7t++2iHpa+dmhgkKTEF89XMbf0N0sPts+cts/aQMjndpZ7g==", 2024-09-12T00:46:56.768 INFO:teuthology.orchestra.run.smithi133.stdout: "active": true, 2024-09-12T00:46:56.768 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:46:56.758035Z" 2024-09-12T00:46:56.768 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-09-12T00:46:56.768 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-09-12T00:46:56.768 INFO:teuthology.orchestra.run.smithi133.stdout: "swift_keys": [], 2024-09-12T00:46:56.768 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": [], 2024-09-12T00:46:56.768 INFO:teuthology.orchestra.run.smithi133.stdout: "op_mask": "read, write, delete", 2024-09-12T00:46:56.769 INFO:teuthology.orchestra.run.smithi133.stdout: "default_placement": "", 2024-09-12T00:46:56.769 INFO:teuthology.orchestra.run.smithi133.stdout: "default_storage_class": "", 2024-09-12T00:46:56.769 INFO:teuthology.orchestra.run.smithi133.stdout: "placement_tags": [], 2024-09-12T00:46:56.769 INFO:teuthology.orchestra.run.smithi133.stdout: "bucket_quota": { 2024-09-12T00:46:56.769 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:56.769 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:56.769 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:56.769 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:56.769 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:56.769 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:56.769 INFO:teuthology.orchestra.run.smithi133.stdout: "user_quota": { 2024-09-12T00:46:56.770 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:56.770 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:56.770 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:56.770 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:56.770 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:56.770 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:56.770 INFO:teuthology.orchestra.run.smithi133.stdout: "temp_url_keys": [], 2024-09-12T00:46:56.770 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "root", 2024-09-12T00:46:56.770 INFO:teuthology.orchestra.run.smithi133.stdout: "mfa_ids": [], 2024-09-12T00:46:56.770 INFO:teuthology.orchestra.run.smithi133.stdout: "account_id": "RGW33333333333333333", 2024-09-12T00:46:56.770 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/", 2024-09-12T00:46:56.771 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:46:56.758021Z", 2024-09-12T00:46:56.771 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2024-09-12T00:46:56.771 INFO:teuthology.orchestra.run.smithi133.stdout: "group_ids": [] 2024-09-12T00:46:56.771 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T00:46:56.771 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.769+0000 7ff9b37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.772+0000 7ffb05d40800 20 remove_watcher() i=0 2024-09-12T00:46:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.772+0000 7ffb05d40800 2 removed watcher, disabling cache 2024-09-12T00:46:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.773+0000 7ffb05d40800 20 remove_watcher() i=1 2024-09-12T00:46:56.773 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.774+0000 7ffb05d40800 20 remove_watcher() i=2 2024-09-12T00:46:56.774 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.775+0000 7ffb05d40800 20 remove_watcher() i=3 2024-09-12T00:46:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.776+0000 7ffb05d40800 20 remove_watcher() i=4 2024-09-12T00:46:56.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.777+0000 7ffb05d40800 20 remove_watcher() i=5 2024-09-12T00:46:56.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.778+0000 7ffb05d40800 20 remove_watcher() i=6 2024-09-12T00:46:56.778 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.779+0000 7ffb05d40800 20 remove_watcher() i=7 2024-09-12T00:46:56.789 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 1944793106 --totp-seed JTZWX23DB3767FB7F6PAGVQ4MJSG4FJCATBGH4BQFFAAW2LDUKERZWWKR32XCSJ6 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:46:56.855 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:56.855 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:56.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.890+0000 7f0762124800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.891+0000 7f0762124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.891+0000 7f0762124800 20 realm 2024-09-12T00:46:56.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.891+0000 7f0762124800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.892+0000 7f0762124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.892+0000 7f0762124800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:56.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.892+0000 7f0762124800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.892+0000 7f0762124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:56.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.892+0000 7f0762124800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.893+0000 7f0762124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:56.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.893+0000 7f0762124800 20 rados->read ofs=0 len=0 2024-09-12T00:46:56.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.894+0000 7f0762124800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:56.893 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.894+0000 7f0762124800 20 searching for the correct realm 2024-09-12T00:46:56.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.896+0000 7f075e669640 0 -- 172.21.15.133:0/1799086576 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x559433125f90 msgr2=0x559433128380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:56.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:56.900+0000 7f0755667640 0 -- 172.21.15.133:0/1799086576 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f075001f070 msgr2=0x7f0750061330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.107+0000 7f0762124800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:46:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.107+0000 7f0762124800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:46:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.107+0000 7f0762124800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.107+0000 7f0762124800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.107+0000 7f0762124800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.107+0000 7f0762124800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.107+0000 7f0762124800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.107+0000 7f0762124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.107+0000 7f0762124800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.108+0000 7f0762124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:57.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.108+0000 7f0762124800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.108+0000 7f0762124800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:57.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.108+0000 7f0762124800 20 zone default found 2024-09-12T00:46:57.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.108+0000 7f0762124800 4 Realm: () 2024-09-12T00:46:57.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.108+0000 7f0762124800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:46:57.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.108+0000 7f0762124800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:46:57.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.108+0000 7f0762124800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:57.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.108+0000 7f0762124800 20 zonegroup default 2024-09-12T00:46:57.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.108+0000 7f0762124800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.108+0000 7f0762124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.108+0000 7f0762124800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.109+0000 7f0762124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.109+0000 7f0762124800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.109+0000 7f0762124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.109+0000 7f0762124800 20 started sync module instance, tier type = 2024-09-12T00:46:57.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.109+0000 7f0762124800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:46:57.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.119+0000 7f0762124800 20 add_watcher() i=0 2024-09-12T00:46:57.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.119+0000 7f0762124800 20 add_watcher() i=1 2024-09-12T00:46:57.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.119+0000 7f0762124800 20 add_watcher() i=2 2024-09-12T00:46:57.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.119+0000 7f0762124800 20 add_watcher() i=3 2024-09-12T00:46:57.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.119+0000 7f0762124800 20 add_watcher() i=4 2024-09-12T00:46:57.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.119+0000 7f0762124800 20 add_watcher() i=5 2024-09-12T00:46:57.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.119+0000 7f0762124800 20 add_watcher() i=6 2024-09-12T00:46:57.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.120+0000 7f0762124800 20 add_watcher() i=7 2024-09-12T00:46:57.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.120+0000 7f0762124800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:57.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.122+0000 7f060f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:57.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.122+0000 7f0762124800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:57.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.122+0000 7f0762124800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:57.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.122+0000 7f0762124800 5 note: GC not initialized 2024-09-12T00:46:57.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.122+0000 7f060e7fc640 20 reqs_thread_entry: start 2024-09-12T00:46:57.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.122+0000 7f0762124800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:57.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.122+0000 7f0762124800 20 Filter name: none 2024-09-12T00:46:57.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.122+0000 7f057ffff640 20 reqs_thread_entry: start 2024-09-12T00:46:57.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.122+0000 7f0762124800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:46:57.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.122+0000 7f0762124800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.123+0000 7f0762124800 20 rados_obj.operate() r=0 bl.length=532 2024-09-12T00:46:57.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.123+0000 7f0762124800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T00:46:57.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.123+0000 7f0762124800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:46:57.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.123+0000 7f0762124800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:57.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.126+0000 7f0762124800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:46:57.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.126+0000 7f0762124800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:46:57.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.126+0000 7f0762124800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:46:57.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.127+0000 7f06417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399154 cookie 94095000387856 notifier 8651 bl.length()=746 2024-09-12T00:46:57.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.127+0000 7f06417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:46:57.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.127+0000 7f06417fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:46:57.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.129+0000 7f060f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.131+0000 7f0762124800 20 remove_watcher() i=0 2024-09-12T00:46:57.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.131+0000 7f0762124800 2 removed watcher, disabling cache 2024-09-12T00:46:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.132+0000 7f0762124800 20 remove_watcher() i=1 2024-09-12T00:46:57.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.133+0000 7f0762124800 20 remove_watcher() i=2 2024-09-12T00:46:57.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.134+0000 7f0762124800 20 remove_watcher() i=3 2024-09-12T00:46:57.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.135+0000 7f0762124800 20 remove_watcher() i=4 2024-09-12T00:46:57.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.137+0000 7f0762124800 20 remove_watcher() i=5 2024-09-12T00:46:57.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.138+0000 7f0762124800 20 remove_watcher() i=6 2024-09-12T00:46:57.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.139+0000 7f0762124800 20 remove_watcher() i=7 2024-09-12T00:46:57.149 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T00:46:57.149 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key HMFMMLFPHNJNCSBVQQWC --secret wFClc0+R/wAGhMdCUj1RnuvRJk2TrgJ6lu2VD1MquHnBISNDapWgyg== --cluster ceph 2024-09-12T00:46:57.217 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:57.217 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:57.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.249+0000 7f9cae613800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.251+0000 7f9cae613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.251+0000 7f9cae613800 20 realm 2024-09-12T00:46:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.251+0000 7f9cae613800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.251+0000 7f9cae613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.251+0000 7f9cae613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.251+0000 7f9cae613800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.251+0000 7f9cae613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.251+0000 7f9cae613800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.252+0000 7f9cae613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:57.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.252+0000 7f9cae613800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.253+0000 7f9cae613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.253+0000 7f9cae613800 20 searching for the correct realm 2024-09-12T00:46:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.255+0000 7f9ca1591640 0 -- 172.21.15.133:0/4074095683 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f9c9401a040 msgr2=0x7f9c94082880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:57.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.259+0000 7f9ca1591640 0 -- 172.21.15.133:0/4074095683 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f9c9c07f040 msgr2=0x7f9c9c064940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:57.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.465+0000 7f9cae613800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:46:57.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.465+0000 7f9cae613800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:46:57.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.465+0000 7f9cae613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:57.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.465+0000 7f9cae613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:57.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.465+0000 7f9cae613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:57.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.465+0000 7f9cae613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:57.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.465+0000 7f9cae613800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.466+0000 7f9cae613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.466+0000 7f9cae613800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.466+0000 7f9cae613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:57.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.466+0000 7f9cae613800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.466+0000 7f9cae613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:57.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.466+0000 7f9cae613800 20 zone default found 2024-09-12T00:46:57.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.466+0000 7f9cae613800 4 Realm: () 2024-09-12T00:46:57.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.466+0000 7f9cae613800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:46:57.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.466+0000 7f9cae613800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:46:57.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.466+0000 7f9cae613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:57.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.466+0000 7f9cae613800 20 zonegroup default 2024-09-12T00:46:57.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.466+0000 7f9cae613800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.467+0000 7f9cae613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.467+0000 7f9cae613800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.467+0000 7f9cae613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.467+0000 7f9cae613800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.467+0000 7f9cae613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.467+0000 7f9cae613800 20 started sync module instance, tier type = 2024-09-12T00:46:57.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.467+0000 7f9cae613800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:46:57.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.477+0000 7f9cae613800 20 add_watcher() i=0 2024-09-12T00:46:57.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.477+0000 7f9cae613800 20 add_watcher() i=1 2024-09-12T00:46:57.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.477+0000 7f9cae613800 20 add_watcher() i=2 2024-09-12T00:46:57.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.477+0000 7f9cae613800 20 add_watcher() i=3 2024-09-12T00:46:57.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.477+0000 7f9cae613800 20 add_watcher() i=4 2024-09-12T00:46:57.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.477+0000 7f9cae613800 20 add_watcher() i=5 2024-09-12T00:46:57.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.477+0000 7f9cae613800 20 add_watcher() i=6 2024-09-12T00:46:57.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.479+0000 7f9cae613800 20 add_watcher() i=7 2024-09-12T00:46:57.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.479+0000 7f9cae613800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:57.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.480+0000 7f9b5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:57.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.481+0000 7f9cae613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:57.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.481+0000 7f9cae613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:57.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.481+0000 7f9cae613800 5 note: GC not initialized 2024-09-12T00:46:57.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.481+0000 7f9b5a7fc640 20 reqs_thread_entry: start 2024-09-12T00:46:57.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.481+0000 7f9cae613800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:57.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.481+0000 7f9cae613800 20 Filter name: none 2024-09-12T00:46:57.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.481+0000 7f9acbfff640 20 reqs_thread_entry: start 2024-09-12T00:46:57.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.481+0000 7f9cae613800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:46:57.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.481+0000 7f9cae613800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.481+0000 7f9cae613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.481+0000 7f9cae613800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T00:46:57.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.481+0000 7f9cae613800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:57.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.481+0000 7f9cae613800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T00:46:57.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.481+0000 7f9cae613800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.482+0000 7f9cae613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.482+0000 7f9cae613800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T00:46:57.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.482+0000 7f9cae613800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:46:57.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.482+0000 7f9cae613800 10 cache get: name=default.rgw.meta+users.keys+HMFMMLFPHNJNCSBVQQWC : miss 2024-09-12T00:46:57.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.482+0000 7f9cae613800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.482+0000 7f9cae613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.482+0000 7f9cae613800 10 cache put: name=default.rgw.meta+users.keys+HMFMMLFPHNJNCSBVQQWC info.flags=0x0 2024-09-12T00:46:57.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.482+0000 7f9cae613800 10 adding default.rgw.meta+users.keys+HMFMMLFPHNJNCSBVQQWC to cache LRU end 2024-09-12T00:46:57.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.482+0000 7f9cae613800 10 cache get: name=default.rgw.meta+users.keys+HMFMMLFPHNJNCSBVQQWC : hit (negative entry) 2024-09-12T00:46:57.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.482+0000 7f9cae613800 10 cache get: name=default.rgw.meta+users.keys+HMFMMLFPHNJNCSBVQQWC : hit (negative entry) 2024-09-12T00:46:57.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.484+0000 7f9cae613800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:46:57.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.484+0000 7f9cae613800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:57.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.484+0000 7f9cae613800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:46:57.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.484+0000 7f9b8d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399155 cookie 94345312499504 notifier 8669 bl.length()=660 2024-09-12T00:46:57.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.484+0000 7f9b8d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:46:57.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.484+0000 7f9b8d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:57.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.487+0000 7f9cae613800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:46:57.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.487+0000 7f9cae613800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:46:57.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.487+0000 7f9cae613800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T00:46:57.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.487+0000 7f9b8d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399083 cookie 94345312482688 notifier 8669 bl.length()=191 2024-09-12T00:46:57.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.487+0000 7f9b8d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:46:57.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.487+0000 7f9b8d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:46:57.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.490+0000 7f9cae613800 10 cache put: name=default.rgw.meta+users.keys+HMFMMLFPHNJNCSBVQQWC info.flags=0x7 2024-09-12T00:46:57.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.490+0000 7f9cae613800 10 moving default.rgw.meta+users.keys+HMFMMLFPHNJNCSBVQQWC to cache LRU end 2024-09-12T00:46:57.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.490+0000 7f9cae613800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:HMFMMLFPHNJNCSBVQQWC, ofs0, ns] 2024-09-12T00:46:57.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.490+0000 7f9b8cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398949 cookie 94345312488032 notifier 8669 bl.length()=189 2024-09-12T00:46:57.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.490+0000 7f9b8cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+HMFMMLFPHNJNCSBVQQWC info.flags=0x7 2024-09-12T00:46:57.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.490+0000 7f9b8cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+HMFMMLFPHNJNCSBVQQWC to cache LRU end 2024-09-12T00:46:57.490 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T00:46:57.490 INFO:teuthology.orchestra.run.smithi133.stdout: "user_id": "foobar.client.0", 2024-09-12T00:46:57.490 INFO:teuthology.orchestra.run.smithi133.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:46:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: "email": "foobar+test@test.test", 2024-09-12T00:46:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: "suspended": 0, 2024-09-12T00:46:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:46:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: "subusers": [], 2024-09-12T00:46:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: "keys": [ 2024-09-12T00:46:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-09-12T00:46:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: "user": "foobar.client.0", 2024-09-12T00:46:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: "access_key": "HMFMMLFPHNJNCSBVQQWC", 2024-09-12T00:46:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: "secret_key": "wFClc0+R/wAGhMdCUj1RnuvRJk2TrgJ6lu2VD1MquHnBISNDapWgyg==", 2024-09-12T00:46:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: "active": true, 2024-09-12T00:46:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:46:57.483548Z" 2024-09-12T00:46:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-09-12T00:46:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-09-12T00:46:57.491 INFO:teuthology.orchestra.run.smithi133.stdout: "swift_keys": [], 2024-09-12T00:46:57.492 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": [], 2024-09-12T00:46:57.492 INFO:teuthology.orchestra.run.smithi133.stdout: "op_mask": "read, write, delete", 2024-09-12T00:46:57.492 INFO:teuthology.orchestra.run.smithi133.stdout: "default_placement": "", 2024-09-12T00:46:57.492 INFO:teuthology.orchestra.run.smithi133.stdout: "default_storage_class": "", 2024-09-12T00:46:57.492 INFO:teuthology.orchestra.run.smithi133.stdout: "placement_tags": [], 2024-09-12T00:46:57.492 INFO:teuthology.orchestra.run.smithi133.stdout: "bucket_quota": { 2024-09-12T00:46:57.492 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:57.492 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:57.492 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:57.492 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:57.492 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:57.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:57.492 INFO:teuthology.orchestra.run.smithi133.stdout: "user_quota": { 2024-09-12T00:46:57.493 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:57.493 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:57.493 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:57.493 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:57.493 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:57.493 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:57.493 INFO:teuthology.orchestra.run.smithi133.stdout: "temp_url_keys": [], 2024-09-12T00:46:57.493 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "rgw", 2024-09-12T00:46:57.493 INFO:teuthology.orchestra.run.smithi133.stdout: "mfa_ids": [], 2024-09-12T00:46:57.493 INFO:teuthology.orchestra.run.smithi133.stdout: "account_id": "", 2024-09-12T00:46:57.493 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/", 2024-09-12T00:46:57.493 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:46:57.483522Z", 2024-09-12T00:46:57.493 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2024-09-12T00:46:57.494 INFO:teuthology.orchestra.run.smithi133.stdout: "group_ids": [] 2024-09-12T00:46:57.494 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T00:46:57.494 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:57.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.492+0000 7f9b5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:57.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.495+0000 7f9cae613800 20 remove_watcher() i=0 2024-09-12T00:46:57.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.495+0000 7f9cae613800 2 removed watcher, disabling cache 2024-09-12T00:46:57.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.496+0000 7f9cae613800 20 remove_watcher() i=1 2024-09-12T00:46:57.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.497+0000 7f9cae613800 20 remove_watcher() i=2 2024-09-12T00:46:57.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.498+0000 7f9cae613800 20 remove_watcher() i=3 2024-09-12T00:46:57.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.499+0000 7f9cae613800 20 remove_watcher() i=4 2024-09-12T00:46:57.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.500+0000 7f9cae613800 20 remove_watcher() i=5 2024-09-12T00:46:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.501+0000 7f9cae613800 20 remove_watcher() i=6 2024-09-12T00:46:57.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.502+0000 7f9cae613800 20 remove_watcher() i=7 2024-09-12T00:46:57.513 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 1563191578 --totp-seed ZFZKC75IFT6QC4SR7SKVNPBZSC6BV7ULXOQONJOHPKDOMFDY5DOU4TZZ4SKLP4YB --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:46:57.579 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:57.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.615+0000 7f54c760e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.616+0000 7f54c760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.616+0000 7f54c760e800 20 realm 2024-09-12T00:46:57.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.616+0000 7f54c760e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.616+0000 7f54c760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.616+0000 7f54c760e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:57.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.616+0000 7f54c760e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.616+0000 7f54c760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.616+0000 7f54c760e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.617+0000 7f54c760e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:57.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.617+0000 7f54c760e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.618+0000 7f54c760e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:57.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.618+0000 7f54c760e800 20 searching for the correct realm 2024-09-12T00:46:57.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.620+0000 7f54c2458640 0 -- 172.21.15.133:0/751664497 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f54b8018070 msgr2=0x7f54b8019400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:57.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:57.825+0000 7f54c2458640 0 -- 172.21.15.133:0/751664497 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f54b4060940 msgr2=0x7f54b408f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:58.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.033+0000 7f54c760e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:46:58.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.033+0000 7f54c760e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:46:58.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.033+0000 7f54c760e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:58.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.033+0000 7f54c760e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:58.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.033+0000 7f54c760e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:58.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.033+0000 7f54c760e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:58.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.033+0000 7f54c760e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.033+0000 7f54c760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.033+0000 7f54c760e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.033+0000 7f54c760e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:58.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.033+0000 7f54c760e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.034+0000 7f54c760e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:58.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.034+0000 7f54c760e800 20 zone default found 2024-09-12T00:46:58.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.034+0000 7f54c760e800 4 Realm: () 2024-09-12T00:46:58.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.034+0000 7f54c760e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:46:58.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.034+0000 7f54c760e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:46:58.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.034+0000 7f54c760e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:58.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.034+0000 7f54c760e800 20 zonegroup default 2024-09-12T00:46:58.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.034+0000 7f54c760e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.034+0000 7f54c760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.034+0000 7f54c760e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.034+0000 7f54c760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.034+0000 7f54c760e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.035+0000 7f54c760e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.035+0000 7f54c760e800 20 started sync module instance, tier type = 2024-09-12T00:46:58.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.035+0000 7f54c760e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:46:58.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.044+0000 7f54c760e800 20 add_watcher() i=0 2024-09-12T00:46:58.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.044+0000 7f54c760e800 20 add_watcher() i=1 2024-09-12T00:46:58.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.044+0000 7f54c760e800 20 add_watcher() i=2 2024-09-12T00:46:58.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.044+0000 7f54c760e800 20 add_watcher() i=3 2024-09-12T00:46:58.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.044+0000 7f54c760e800 20 add_watcher() i=4 2024-09-12T00:46:58.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.044+0000 7f54c760e800 20 add_watcher() i=5 2024-09-12T00:46:58.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.044+0000 7f54c760e800 20 add_watcher() i=6 2024-09-12T00:46:58.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.046+0000 7f54c760e800 20 add_watcher() i=7 2024-09-12T00:46:58.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.046+0000 7f54c760e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:58.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.047+0000 7f53797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:58.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.048+0000 7f54c760e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:58.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.048+0000 7f54c760e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:58.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.048+0000 7f54c760e800 5 note: GC not initialized 2024-09-12T00:46:58.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.048+0000 7f52f3fff640 20 reqs_thread_entry: start 2024-09-12T00:46:58.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.048+0000 7f54c760e800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:58.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.048+0000 7f54c760e800 20 Filter name: none 2024-09-12T00:46:58.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.048+0000 7f52f1ffb640 20 reqs_thread_entry: start 2024-09-12T00:46:58.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.048+0000 7f54c760e800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:46:58.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.048+0000 7f54c760e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.049+0000 7f54c760e800 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T00:46:58.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.049+0000 7f54c760e800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:46:58.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.049+0000 7f54c760e800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:58.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.049+0000 7f54c760e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:58.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.052+0000 7f54c760e800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:46:58.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.052+0000 7f54c760e800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:58.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.052+0000 7f54c760e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:46:58.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.052+0000 7f53a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399156 cookie 94024981971200 notifier 8687 bl.length()=674 2024-09-12T00:46:58.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.052+0000 7f53a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:46:58.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.052+0000 7f53a67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:58.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.055+0000 7f53797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:58.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.057+0000 7f54c760e800 20 remove_watcher() i=0 2024-09-12T00:46:58.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.057+0000 7f54c760e800 2 removed watcher, disabling cache 2024-09-12T00:46:58.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.058+0000 7f54c760e800 20 remove_watcher() i=1 2024-09-12T00:46:58.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.059+0000 7f54c760e800 20 remove_watcher() i=2 2024-09-12T00:46:58.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.060+0000 7f54c760e800 20 remove_watcher() i=3 2024-09-12T00:46:58.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.062+0000 7f54c760e800 20 remove_watcher() i=4 2024-09-12T00:46:58.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.063+0000 7f54c760e800 20 remove_watcher() i=5 2024-09-12T00:46:58.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.064+0000 7f54c760e800 20 remove_watcher() i=6 2024-09-12T00:46:58.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.065+0000 7f54c760e800 20 remove_watcher() i=7 2024-09-12T00:46:58.075 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T00:46:58.136 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:58.137 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:58.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.169+0000 7f9ab7521800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.171+0000 7f9ab7521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.171+0000 7f9ab7521800 20 realm 2024-09-12T00:46:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.171+0000 7f9ab7521800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.171+0000 7f9ab7521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.171+0000 7f9ab7521800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.171+0000 7f9ab7521800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.171+0000 7f9ab7521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.171+0000 7f9ab7521800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.172+0000 7f9ab7521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.172+0000 7f9ab7521800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.173+0000 7f9ab7521800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.173+0000 7f9ab7521800 20 searching for the correct realm 2024-09-12T00:46:58.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.175+0000 7f9aabfff640 0 -- 172.21.15.133:0/775022096 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f9a9c003c30 msgr2=0x7f9a9c0b1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:58.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.380+0000 7f9aabfff640 0 -- 172.21.15.133:0/775022096 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f9aa403b450 msgr2=0x7f9aa403b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.587+0000 7f9ab7521800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:46:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.587+0000 7f9ab7521800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:46:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.587+0000 7f9ab7521800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.587+0000 7f9ab7521800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.587+0000 7f9ab7521800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.587+0000 7f9ab7521800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.587+0000 7f9ab7521800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.588+0000 7f9ab7521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.588+0000 7f9ab7521800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.588+0000 7f9ab7521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:58.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.588+0000 7f9ab7521800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.588+0000 7f9ab7521800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.588+0000 7f9ab7521800 20 zone default found 2024-09-12T00:46:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.588+0000 7f9ab7521800 4 Realm: () 2024-09-12T00:46:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.588+0000 7f9ab7521800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:46:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.588+0000 7f9ab7521800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:46:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.588+0000 7f9ab7521800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.588+0000 7f9ab7521800 20 zonegroup default 2024-09-12T00:46:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.588+0000 7f9ab7521800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.589+0000 7f9ab7521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.589+0000 7f9ab7521800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.589+0000 7f9ab7521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.589+0000 7f9ab7521800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.589+0000 7f9ab7521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.589+0000 7f9ab7521800 20 started sync module instance, tier type = 2024-09-12T00:46:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.589+0000 7f9ab7521800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:46:58.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.599+0000 7f9ab7521800 20 add_watcher() i=0 2024-09-12T00:46:58.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.599+0000 7f9ab7521800 20 add_watcher() i=1 2024-09-12T00:46:58.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.599+0000 7f9ab7521800 20 add_watcher() i=2 2024-09-12T00:46:58.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.599+0000 7f9ab7521800 20 add_watcher() i=3 2024-09-12T00:46:58.598 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.599+0000 7f9ab7521800 20 add_watcher() i=4 2024-09-12T00:46:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.599+0000 7f9ab7521800 20 add_watcher() i=5 2024-09-12T00:46:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.599+0000 7f9ab7521800 20 add_watcher() i=6 2024-09-12T00:46:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.600+0000 7f9ab7521800 20 add_watcher() i=7 2024-09-12T00:46:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.600+0000 7f9ab7521800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.602+0000 7f9969fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.602+0000 7f9ab7521800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.602+0000 7f9ab7521800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.602+0000 7f9ab7521800 5 note: GC not initialized 2024-09-12T00:46:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.603+0000 7f9968fe1640 20 reqs_thread_entry: start 2024-09-12T00:46:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.603+0000 7f9ab7521800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.603+0000 7f9ab7521800 20 Filter name: none 2024-09-12T00:46:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.603+0000 7f98e27fc640 20 reqs_thread_entry: start 2024-09-12T00:46:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.603+0000 7f9ab7521800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:46:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.603+0000 7f9ab7521800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.604+0000 7f9ab7521800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:46:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.604+0000 7f9ab7521800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:46:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.604+0000 7f9ab7521800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.604+0000 7f9ab7521800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:58.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.605+0000 7f9ab7521800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:46:58.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.605+0000 7f9ab7521800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:58.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.605+0000 7f9ab7521800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:46:58.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.605+0000 7f9996ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399157 cookie 94544809323184 notifier 9339 bl.length()=727 2024-09-12T00:46:58.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.606+0000 7f9996ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:46:58.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.606+0000 7f9996ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:46:58.606 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T00:46:58.606 INFO:teuthology.orchestra.run.smithi133.stdout: "user_id": "foobar.client.0", 2024-09-12T00:46:58.606 INFO:teuthology.orchestra.run.smithi133.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:46:58.606 INFO:teuthology.orchestra.run.smithi133.stdout: "email": "foobar+test@test.test", 2024-09-12T00:46:58.606 INFO:teuthology.orchestra.run.smithi133.stdout: "suspended": 0, 2024-09-12T00:46:58.606 INFO:teuthology.orchestra.run.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:46:58.606 INFO:teuthology.orchestra.run.smithi133.stdout: "subusers": [], 2024-09-12T00:46:58.607 INFO:teuthology.orchestra.run.smithi133.stdout: "keys": [ 2024-09-12T00:46:58.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-09-12T00:46:58.607 INFO:teuthology.orchestra.run.smithi133.stdout: "user": "foobar.client.0", 2024-09-12T00:46:58.607 INFO:teuthology.orchestra.run.smithi133.stdout: "access_key": "HMFMMLFPHNJNCSBVQQWC", 2024-09-12T00:46:58.607 INFO:teuthology.orchestra.run.smithi133.stdout: "secret_key": "wFClc0+R/wAGhMdCUj1RnuvRJk2TrgJ6lu2VD1MquHnBISNDapWgyg==", 2024-09-12T00:46:58.607 INFO:teuthology.orchestra.run.smithi133.stdout: "active": true, 2024-09-12T00:46:58.607 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:46:57.483548Z" 2024-09-12T00:46:58.607 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-09-12T00:46:58.607 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-09-12T00:46:58.607 INFO:teuthology.orchestra.run.smithi133.stdout: "swift_keys": [], 2024-09-12T00:46:58.607 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": [ 2024-09-12T00:46:58.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-09-12T00:46:58.607 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "oidc-provider", 2024-09-12T00:46:58.607 INFO:teuthology.orchestra.run.smithi133.stdout: "perm": "*" 2024-09-12T00:46:58.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:58.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-09-12T00:46:58.608 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "roles", 2024-09-12T00:46:58.608 INFO:teuthology.orchestra.run.smithi133.stdout: "perm": "*" 2024-09-12T00:46:58.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:58.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-09-12T00:46:58.608 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "user-policy", 2024-09-12T00:46:58.608 INFO:teuthology.orchestra.run.smithi133.stdout: "perm": "*" 2024-09-12T00:46:58.608 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-09-12T00:46:58.608 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-09-12T00:46:58.608 INFO:teuthology.orchestra.run.smithi133.stdout: "op_mask": "read, write, delete", 2024-09-12T00:46:58.608 INFO:teuthology.orchestra.run.smithi133.stdout: "default_placement": "", 2024-09-12T00:46:58.608 INFO:teuthology.orchestra.run.smithi133.stdout: "default_storage_class": "", 2024-09-12T00:46:58.608 INFO:teuthology.orchestra.run.smithi133.stdout: "placement_tags": [], 2024-09-12T00:46:58.608 INFO:teuthology.orchestra.run.smithi133.stdout: "bucket_quota": { 2024-09-12T00:46:58.608 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "user_quota": { 2024-09-12T00:46:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "temp_url_keys": [], 2024-09-12T00:46:58.609 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "rgw", 2024-09-12T00:46:58.610 INFO:teuthology.orchestra.run.smithi133.stdout: "mfa_ids": [ 2024-09-12T00:46:58.610 INFO:teuthology.orchestra.run.smithi133.stdout: "1563191578" 2024-09-12T00:46:58.610 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-09-12T00:46:58.610 INFO:teuthology.orchestra.run.smithi133.stdout: "account_id": "", 2024-09-12T00:46:58.610 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/", 2024-09-12T00:46:58.610 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:46:57.483522Z", 2024-09-12T00:46:58.610 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2024-09-12T00:46:58.610 INFO:teuthology.orchestra.run.smithi133.stdout: "group_ids": [] 2024-09-12T00:46:58.610 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T00:46:58.610 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:46:58.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.608+0000 7f9969fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:58.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.610+0000 7f9ab7521800 20 remove_watcher() i=0 2024-09-12T00:46:58.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.610+0000 7f9ab7521800 2 removed watcher, disabling cache 2024-09-12T00:46:58.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.612+0000 7f9ab7521800 20 remove_watcher() i=1 2024-09-12T00:46:58.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.613+0000 7f9ab7521800 20 remove_watcher() i=2 2024-09-12T00:46:58.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.614+0000 7f9ab7521800 20 remove_watcher() i=3 2024-09-12T00:46:58.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.615+0000 7f9ab7521800 20 remove_watcher() i=4 2024-09-12T00:46:58.615 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.616+0000 7f9ab7521800 20 remove_watcher() i=5 2024-09-12T00:46:58.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.617+0000 7f9ab7521800 20 remove_watcher() i=6 2024-09-12T00:46:58.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.618+0000 7f9ab7521800 20 remove_watcher() i=7 2024-09-12T00:46:58.628 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T00:46:58.688 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:58.689 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:58.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.926+0000 7fdc6600f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.928+0000 7fdc6600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.928+0000 7fdc6600f800 20 realm 2024-09-12T00:46:58.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.928+0000 7fdc6600f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.928+0000 7fdc6600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.928+0000 7fdc6600f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:58.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.928+0000 7fdc6600f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.928+0000 7fdc6600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.928 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.928+0000 7fdc6600f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.929+0000 7fdc6600f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:58.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.929+0000 7fdc6600f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.930+0000 7fdc6600f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:58.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.930+0000 7fdc6600f800 20 searching for the correct realm 2024-09-12T00:46:58.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:58.932+0000 7fdc632ff640 0 -- 172.21.15.133:0/2273405621 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fdc5806b020 msgr2=0x7fdc580b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:59.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.138+0000 7fdc632ff640 0 -- 172.21.15.133:0/2273405621 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fdc5403d410 msgr2=0x7fdc5403d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:59.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.345+0000 7fdc6600f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:46:59.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.345+0000 7fdc6600f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:46:59.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.345+0000 7fdc6600f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:59.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.345+0000 7fdc6600f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:59.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.345+0000 7fdc6600f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:59.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.345+0000 7fdc6600f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:59.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.345+0000 7fdc6600f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.345+0000 7fdc6600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.345+0000 7fdc6600f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.346+0000 7fdc6600f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:59.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.346+0000 7fdc6600f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.346+0000 7fdc6600f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:59.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.346+0000 7fdc6600f800 20 zone default found 2024-09-12T00:46:59.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.346+0000 7fdc6600f800 4 Realm: () 2024-09-12T00:46:59.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.346+0000 7fdc6600f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:46:59.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.346+0000 7fdc6600f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:46:59.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.346+0000 7fdc6600f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:59.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.346+0000 7fdc6600f800 20 zonegroup default 2024-09-12T00:46:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.346+0000 7fdc6600f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.346+0000 7fdc6600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.346+0000 7fdc6600f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.346+0000 7fdc6600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.346+0000 7fdc6600f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.347+0000 7fdc6600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.347+0000 7fdc6600f800 20 started sync module instance, tier type = 2024-09-12T00:46:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.347+0000 7fdc6600f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:46:59.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.357+0000 7fdc6600f800 20 add_watcher() i=0 2024-09-12T00:46:59.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.357+0000 7fdc6600f800 20 add_watcher() i=1 2024-09-12T00:46:59.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.357+0000 7fdc6600f800 20 add_watcher() i=2 2024-09-12T00:46:59.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.357+0000 7fdc6600f800 20 add_watcher() i=3 2024-09-12T00:46:59.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.357+0000 7fdc6600f800 20 add_watcher() i=4 2024-09-12T00:46:59.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.357+0000 7fdc6600f800 20 add_watcher() i=5 2024-09-12T00:46:59.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.357+0000 7fdc6600f800 20 add_watcher() i=6 2024-09-12T00:46:59.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.358+0000 7fdc6600f800 20 add_watcher() i=7 2024-09-12T00:46:59.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.358+0000 7fdc6600f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:59.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.360+0000 7fdb19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:59.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.360+0000 7fdc6600f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.360+0000 7fdc6600f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.360+0000 7fdc6600f800 5 note: GC not initialized 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.360+0000 7fdb18fe1640 20 reqs_thread_entry: start 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.360+0000 7fdc6600f800 20 init_complete bucket index max shards: 1 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.360+0000 7fdc6600f800 20 Filter name: none 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.361+0000 7fda927fc640 20 reqs_thread_entry: start 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.361+0000 7fdc6600f800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.361+0000 7fdc6600f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.361+0000 7fdc6600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.361+0000 7fdc6600f800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.361+0000 7fdc6600f800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:46:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.361+0000 7fdc6600f800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T00:46:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.361+0000 7fdc6600f800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T00:46:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.361+0000 7fdc6600f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.361+0000 7fdc6600f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.361+0000 7fdc6600f800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T00:46:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.361+0000 7fdc6600f800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:46:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.361+0000 7fdc6600f800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T00:46:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.363+0000 7fdc6600f800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:46:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.363+0000 7fdc6600f800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:46:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.363+0000 7fdc6600f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T00:46:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.363+0000 7fdb42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399084 cookie 94099972922080 notifier 8717 bl.length()=384 2024-09-12T00:46:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.363+0000 7fdb42ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:46:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.363+0000 7fdb42ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:46:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.367+0000 7fdc6600f800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:46:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.367+0000 7fdc6600f800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:46:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.367+0000 7fdc6600f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T00:46:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.367+0000 7fdb427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399085 cookie 94099972930144 notifier 8717 bl.length()=225 2024-09-12T00:46:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.367+0000 7fdb427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:46:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.367+0000 7fdb427fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:46:59.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.369+0000 7fdc6600f800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:46:59.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.369+0000 7fdc6600f800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:46:59.368 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.369+0000 7fdc6600f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T00:46:59.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.370+0000 7fdb427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398950 cookie 94099972927504 notifier 8717 bl.length()=234 2024-09-12T00:46:59.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.370+0000 7fdb427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:46:59.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.370+0000 7fdb427fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:46:59.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.372+0000 7fdb19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:59.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.375+0000 7fdc6600f800 20 remove_watcher() i=0 2024-09-12T00:46:59.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.375+0000 7fdc6600f800 2 removed watcher, disabling cache 2024-09-12T00:46:59.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.376+0000 7fdc6600f800 20 remove_watcher() i=1 2024-09-12T00:46:59.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.377+0000 7fdc6600f800 20 remove_watcher() i=2 2024-09-12T00:46:59.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.378+0000 7fdc6600f800 20 remove_watcher() i=3 2024-09-12T00:46:59.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.379+0000 7fdc6600f800 20 remove_watcher() i=4 2024-09-12T00:46:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.380+0000 7fdc6600f800 20 remove_watcher() i=5 2024-09-12T00:46:59.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.381+0000 7fdc6600f800 20 remove_watcher() i=6 2024-09-12T00:46:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.382+0000 7fdc6600f800 20 remove_watcher() i=7 2024-09-12T00:46:59.389 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T00:46:59.390 INFO:teuthology.orchestra.run.smithi133.stdout: "id": "RGW88888888888888888", 2024-09-12T00:46:59.390 INFO:teuthology.orchestra.run.smithi133.stdout: "tenant": "", 2024-09-12T00:46:59.390 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T00:46:59.390 INFO:teuthology.orchestra.run.smithi133.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T00:46:59.390 INFO:teuthology.orchestra.run.smithi133.stdout: "quota": { 2024-09-12T00:46:59.390 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:59.390 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:59.390 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:59.390 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:59.390 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:59.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:59.390 INFO:teuthology.orchestra.run.smithi133.stdout: "bucket_quota": { 2024-09-12T00:46:59.390 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:46:59.391 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:46:59.391 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:46:59.391 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:46:59.391 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:46:59.391 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:46:59.391 INFO:teuthology.orchestra.run.smithi133.stdout: "max_users": 1000, 2024-09-12T00:46:59.391 INFO:teuthology.orchestra.run.smithi133.stdout: "max_roles": 1000, 2024-09-12T00:46:59.391 INFO:teuthology.orchestra.run.smithi133.stdout: "max_groups": 1000, 2024-09-12T00:46:59.391 INFO:teuthology.orchestra.run.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:46:59.391 INFO:teuthology.orchestra.run.smithi133.stdout: "max_access_keys": 4 2024-09-12T00:46:59.391 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T00:46:59.392 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T00:46:59.393 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key XIGKSNUBHOLKXIIDNLHB --secret d5U2plnoLVV0sE/Mw1LYLn+5snKLq3JGuLJUjIesrt+h08p3WZug5A== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T00:46:59.460 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:59.460 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:59.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.495+0000 7f67dc60f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.496+0000 7f67dc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.496+0000 7f67dc60f800 20 realm 2024-09-12T00:46:59.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.496+0000 7f67dc60f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.496+0000 7f67dc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.497+0000 7f67dc60f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:59.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.497+0000 7f67dc60f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.497+0000 7f67dc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.497+0000 7f67dc60f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.497+0000 7f67dc60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:59.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.497+0000 7f67dc60f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.498+0000 7f67dc60f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:59.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.498+0000 7f67dc60f800 20 searching for the correct realm 2024-09-12T00:46:59.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:46:59.701+0000 7f67d98f8640 0 -- 172.21.15.133:0/3993488459 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f67d0027070 msgr2=0x7f67d0041940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.106+0000 7f67d98f8640 0 -- 172.21.15.133:0/3993488459 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f67cc084210 msgr2=0x7f67cc0616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:00.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.312+0000 7f67dc60f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:47:00.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.312+0000 7f67dc60f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:47:00.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.312+0000 7f67dc60f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:00.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.312+0000 7f67dc60f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:00.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.312+0000 7f67dc60f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:00.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.312+0000 7f67dc60f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:00.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.313+0000 7f67dc60f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.313+0000 7f67dc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.313+0000 7f67dc60f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.313+0000 7f67dc60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:00.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.313+0000 7f67dc60f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.314+0000 7f67dc60f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:00.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.314+0000 7f67dc60f800 20 zone default found 2024-09-12T00:47:00.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.314+0000 7f67dc60f800 4 Realm: () 2024-09-12T00:47:00.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.314+0000 7f67dc60f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:47:00.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.314+0000 7f67dc60f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:47:00.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.314+0000 7f67dc60f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:00.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.314+0000 7f67dc60f800 20 zonegroup default 2024-09-12T00:47:00.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.314+0000 7f67dc60f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.314+0000 7f67dc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.314+0000 7f67dc60f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.314+0000 7f67dc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.314+0000 7f67dc60f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.315+0000 7f67dc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.315+0000 7f67dc60f800 20 started sync module instance, tier type = 2024-09-12T00:47:00.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.315+0000 7f67dc60f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:47:00.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.325+0000 7f67dc60f800 20 add_watcher() i=0 2024-09-12T00:47:00.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.325+0000 7f67dc60f800 20 add_watcher() i=1 2024-09-12T00:47:00.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.325+0000 7f67dc60f800 20 add_watcher() i=2 2024-09-12T00:47:00.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.325+0000 7f67dc60f800 20 add_watcher() i=3 2024-09-12T00:47:00.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.325+0000 7f67dc60f800 20 add_watcher() i=4 2024-09-12T00:47:00.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.325+0000 7f67dc60f800 20 add_watcher() i=5 2024-09-12T00:47:00.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.325+0000 7f67dc60f800 20 add_watcher() i=6 2024-09-12T00:47:00.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.326+0000 7f67dc60f800 20 add_watcher() i=7 2024-09-12T00:47:00.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.326+0000 7f67dc60f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:00.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.328+0000 7f6690fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:00.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.328+0000 7f67dc60f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:00.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.328+0000 7f67dc60f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:00.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.328+0000 7f67dc60f800 5 note: GC not initialized 2024-09-12T00:47:00.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.328+0000 7f660b7fe640 20 reqs_thread_entry: start 2024-09-12T00:47:00.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.328+0000 7f67dc60f800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:00.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.328+0000 7f67dc60f800 20 Filter name: none 2024-09-12T00:47:00.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.328+0000 7f66097fa640 20 reqs_thread_entry: start 2024-09-12T00:47:00.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.328+0000 7f67dc60f800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:47:00.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.328+0000 7f67dc60f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.329+0000 7f67dc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.329+0000 7f67dc60f800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T00:47:00.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.329+0000 7f67dc60f800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:47:00.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.329+0000 7f67dc60f800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T00:47:00.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.329+0000 7f67dc60f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.329+0000 7f67dc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.329+0000 7f67dc60f800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T00:47:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.329+0000 7f67dc60f800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:47:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.329+0000 7f67dc60f800 10 cache get: name=default.rgw.meta+users.keys+XIGKSNUBHOLKXIIDNLHB : miss 2024-09-12T00:47:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.329+0000 7f67dc60f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.329+0000 7f67dc60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.329+0000 7f67dc60f800 10 cache put: name=default.rgw.meta+users.keys+XIGKSNUBHOLKXIIDNLHB info.flags=0x0 2024-09-12T00:47:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.329+0000 7f67dc60f800 10 adding default.rgw.meta+users.keys+XIGKSNUBHOLKXIIDNLHB to cache LRU end 2024-09-12T00:47:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.329+0000 7f67dc60f800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T00:47:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.329+0000 7f67dc60f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.330+0000 7f67dc60f800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:47:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.330+0000 7f67dc60f800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:47:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.330+0000 7f67dc60f800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:47:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.330+0000 7f67dc60f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:00.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.330+0000 7f67dc60f800 10 cache get: name=default.rgw.meta+users.keys+XIGKSNUBHOLKXIIDNLHB : hit (negative entry) 2024-09-12T00:47:00.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.330+0000 7f67dc60f800 10 cache get: name=default.rgw.meta+users.keys+XIGKSNUBHOLKXIIDNLHB : hit (negative entry) 2024-09-12T00:47:00.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.331+0000 7f67dc60f800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:47:00.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.331+0000 7f67dc60f800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:47:00.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.331+0000 7f67dc60f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:47:00.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.332+0000 7f66bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399086 cookie 93986211229488 notifier 9381 bl.length()=681 2024-09-12T00:47:00.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.332+0000 7f66bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:47:00.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.332+0000 7f66bdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:47:00.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.335+0000 7f67dc60f800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:47:00.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.335+0000 7f67dc60f800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:47:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.335+0000 7f67dc60f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T00:47:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.335+0000 7f66bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399158 cookie 93986211237776 notifier 9381 bl.length()=189 2024-09-12T00:47:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.335+0000 7f66bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:47:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.335+0000 7f66bdffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:47:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.337+0000 7f67dc60f800 10 cache put: name=default.rgw.meta+users.keys+XIGKSNUBHOLKXIIDNLHB info.flags=0x7 2024-09-12T00:47:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.337+0000 7f67dc60f800 10 moving default.rgw.meta+users.keys+XIGKSNUBHOLKXIIDNLHB to cache LRU end 2024-09-12T00:47:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.337+0000 7f67dc60f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:XIGKSNUBHOLKXIIDNLHB, ofs0, ns] 2024-09-12T00:47:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.338+0000 7f66bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399087 cookie 93986211229488 notifier 9381 bl.length()=188 2024-09-12T00:47:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.338+0000 7f66bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XIGKSNUBHOLKXIIDNLHB info.flags=0x7 2024-09-12T00:47:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.338+0000 7f66bdffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XIGKSNUBHOLKXIIDNLHB to cache LRU end 2024-09-12T00:47:00.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.340+0000 7f67dc60f800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T00:47:00.340 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T00:47:00.340 INFO:teuthology.orchestra.run.smithi133.stdout: "user_id": "root1.client.0", 2024-09-12T00:47:00.340 INFO:teuthology.orchestra.run.smithi133.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T00:47:00.340 INFO:teuthology.orchestra.run.smithi133.stdout: "email": "root1+test@test.test", 2024-09-12T00:47:00.341 INFO:teuthology.orchestra.run.smithi133.stdout: "suspended": 0, 2024-09-12T00:47:00.341 INFO:teuthology.orchestra.run.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:47:00.341 INFO:teuthology.orchestra.run.smithi133.stdout: "subusers": [], 2024-09-12T00:47:00.341 INFO:teuthology.orchestra.run.smithi133.stdout: "keys": [ 2024-09-12T00:47:00.341 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-09-12T00:47:00.341 INFO:teuthology.orchestra.run.smithi133.stdout: "user": "root1.client.0", 2024-09-12T00:47:00.341 INFO:teuthology.orchestra.run.smithi133.stdout: "access_key": "XIGKSNUBHOLKXIIDNLHB", 2024-09-12T00:47:00.341 INFO:teuthology.orchestra.run.smithi133.stdout: "secret_key": "d5U2plnoLVV0sE/Mw1LYLn+5snKLq3JGuLJUjIesrt+h08p3WZug5A==", 2024-09-12T00:47:00.341 INFO:teuthology.orchestra.run.smithi133.stdout: "active": true, 2024-09-12T00:47:00.342 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:47:00.331088Z" 2024-09-12T00:47:00.342 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-09-12T00:47:00.342 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-09-12T00:47:00.342 INFO:teuthology.orchestra.run.smithi133.stdout: "swift_keys": [], 2024-09-12T00:47:00.342 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": [], 2024-09-12T00:47:00.342 INFO:teuthology.orchestra.run.smithi133.stdout: "op_mask": "read, write, delete", 2024-09-12T00:47:00.342 INFO:teuthology.orchestra.run.smithi133.stdout: "default_placement": "", 2024-09-12T00:47:00.342 INFO:teuthology.orchestra.run.smithi133.stdout: "default_storage_class": "", 2024-09-12T00:47:00.342 INFO:teuthology.orchestra.run.smithi133.stdout: "placement_tags": [], 2024-09-12T00:47:00.342 INFO:teuthology.orchestra.run.smithi133.stdout: "bucket_quota": { 2024-09-12T00:47:00.343 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:47:00.343 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:47:00.343 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:47:00.343 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:47:00.343 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:47:00.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:47:00.343 INFO:teuthology.orchestra.run.smithi133.stdout: "user_quota": { 2024-09-12T00:47:00.343 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:47:00.343 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:47:00.343 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:47:00.343 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:47:00.343 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:47:00.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:47:00.343 INFO:teuthology.orchestra.run.smithi133.stdout: "temp_url_keys": [], 2024-09-12T00:47:00.344 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "root", 2024-09-12T00:47:00.344 INFO:teuthology.orchestra.run.smithi133.stdout: "mfa_ids": [], 2024-09-12T00:47:00.344 INFO:teuthology.orchestra.run.smithi133.stdout: "account_id": "RGW88888888888888888", 2024-09-12T00:47:00.344 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/", 2024-09-12T00:47:00.344 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:47:00.331076Z", 2024-09-12T00:47:00.344 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2024-09-12T00:47:00.344 INFO:teuthology.orchestra.run.smithi133.stdout: "group_ids": [] 2024-09-12T00:47:00.344 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T00:47:00.344 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:47:00.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.341+0000 7f6690fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:00.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.343+0000 7f67dc60f800 20 remove_watcher() i=0 2024-09-12T00:47:00.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.343+0000 7f67dc60f800 2 removed watcher, disabling cache 2024-09-12T00:47:00.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.344+0000 7f67dc60f800 20 remove_watcher() i=1 2024-09-12T00:47:00.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.345+0000 7f67dc60f800 20 remove_watcher() i=2 2024-09-12T00:47:00.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.346+0000 7f67dc60f800 20 remove_watcher() i=3 2024-09-12T00:47:00.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.348+0000 7f67dc60f800 20 remove_watcher() i=4 2024-09-12T00:47:00.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.349+0000 7f67dc60f800 20 remove_watcher() i=5 2024-09-12T00:47:00.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.350+0000 7f67dc60f800 20 remove_watcher() i=6 2024-09-12T00:47:00.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.351+0000 7f67dc60f800 20 remove_watcher() i=7 2024-09-12T00:47:00.362 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 3077433976 --totp-seed DBP2LGOIYLDDHVQIJBSP5HVSZ2CL6XJ2NTYJ2X27VTFEOAI25GVE5RVVONBJER5D --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:47:00.429 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:00.429 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:00.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.464+0000 7fafa6c98800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.466+0000 7fafa6c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.466+0000 7fafa6c98800 20 realm 2024-09-12T00:47:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.466+0000 7fafa6c98800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.466+0000 7fafa6c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.466+0000 7fafa6c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.466+0000 7fafa6c98800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.467+0000 7fafa6c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.467+0000 7fafa6c98800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.467+0000 7fafa6c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:00.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.467+0000 7fafa6c98800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.468+0000 7fafa6c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:00.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.468+0000 7fafa6c98800 20 searching for the correct realm 2024-09-12T00:47:00.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.470+0000 7fafa3f81640 0 -- 172.21.15.133:0/1788640519 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7faf98018070 msgr2=0x7faf9805f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:00.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.676+0000 7fafa3f81640 0 -- 172.21.15.133:0/1788640519 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7faf940b5940 msgr2=0x7faf940b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:00.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.884+0000 7fafa6c98800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:47:00.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.884+0000 7fafa6c98800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:47:00.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.884+0000 7fafa6c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:00.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.884+0000 7fafa6c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:00.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.884+0000 7fafa6c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:00.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.884+0000 7fafa6c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:00.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.884+0000 7fafa6c98800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.884+0000 7fafa6c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.884+0000 7fafa6c98800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.885+0000 7fafa6c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:00.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.885+0000 7fafa6c98800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.885+0000 7fafa6c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:00.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.885+0000 7fafa6c98800 20 zone default found 2024-09-12T00:47:00.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.885+0000 7fafa6c98800 4 Realm: () 2024-09-12T00:47:00.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.885+0000 7fafa6c98800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:47:00.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.885+0000 7fafa6c98800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:47:00.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.885+0000 7fafa6c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:00.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.885+0000 7fafa6c98800 20 zonegroup default 2024-09-12T00:47:00.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.885+0000 7fafa6c98800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.885+0000 7fafa6c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.885+0000 7fafa6c98800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.886+0000 7fafa6c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.886+0000 7fafa6c98800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.886+0000 7fafa6c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.886+0000 7fafa6c98800 20 started sync module instance, tier type = 2024-09-12T00:47:00.886 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.886+0000 7fafa6c98800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:47:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.896+0000 7fafa6c98800 20 add_watcher() i=0 2024-09-12T00:47:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.896+0000 7fafa6c98800 20 add_watcher() i=1 2024-09-12T00:47:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.896+0000 7fafa6c98800 20 add_watcher() i=2 2024-09-12T00:47:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.896+0000 7fafa6c98800 20 add_watcher() i=3 2024-09-12T00:47:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.896+0000 7fafa6c98800 20 add_watcher() i=4 2024-09-12T00:47:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.896+0000 7fafa6c98800 20 add_watcher() i=5 2024-09-12T00:47:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.896+0000 7fafa6c98800 20 add_watcher() i=6 2024-09-12T00:47:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.897+0000 7fafa6c98800 20 add_watcher() i=7 2024-09-12T00:47:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.897+0000 7fafa6c98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:00.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.899+0000 7fae5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:00.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.899+0000 7fafa6c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:00.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.899+0000 7fafa6c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:00.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.900+0000 7fafa6c98800 5 note: GC not initialized 2024-09-12T00:47:00.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.900+0000 7fae59fdb640 20 reqs_thread_entry: start 2024-09-12T00:47:00.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.900+0000 7fafa6c98800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:00.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.900+0000 7fafa6c98800 20 Filter name: none 2024-09-12T00:47:00.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.900+0000 7fadcb7fe640 20 reqs_thread_entry: start 2024-09-12T00:47:00.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.900+0000 7fafa6c98800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:47:00.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.900+0000 7fafa6c98800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.901+0000 7fafa6c98800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:47:00.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.901+0000 7fafa6c98800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T00:47:00.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.901+0000 7fafa6c98800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:47:00.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.901+0000 7fafa6c98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:00.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.904+0000 7fafa6c98800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:47:00.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.904+0000 7fafa6c98800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:47:00.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.904+0000 7fafa6c98800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:47:00.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.904+0000 7fae7b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399088 cookie 94106655302720 notifier 8747 bl.length()=695 2024-09-12T00:47:00.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.905+0000 7fae7b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:47:00.904 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.905+0000 7fae7b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:47:00.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.907+0000 7fae5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:00.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.909+0000 7fafa6c98800 20 remove_watcher() i=0 2024-09-12T00:47:00.908 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.909+0000 7fafa6c98800 2 removed watcher, disabling cache 2024-09-12T00:47:00.909 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.910+0000 7fafa6c98800 20 remove_watcher() i=1 2024-09-12T00:47:00.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.911+0000 7fafa6c98800 20 remove_watcher() i=2 2024-09-12T00:47:00.911 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.913+0000 7fafa6c98800 20 remove_watcher() i=3 2024-09-12T00:47:00.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.914+0000 7fafa6c98800 20 remove_watcher() i=4 2024-09-12T00:47:00.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.916+0000 7fafa6c98800 20 remove_watcher() i=5 2024-09-12T00:47:00.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.917+0000 7fafa6c98800 20 remove_watcher() i=6 2024-09-12T00:47:00.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:00.918+0000 7fafa6c98800 20 remove_watcher() i=7 2024-09-12T00:47:00.929 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T00:47:00.990 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:00.990 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:01.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.026+0000 7f30a0414800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.026 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.027+0000 7f30a0414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.027+0000 7f30a0414800 20 realm 2024-09-12T00:47:01.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.027+0000 7f30a0414800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.027+0000 7f30a0414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.027+0000 7f30a0414800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:01.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.027+0000 7f30a0414800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.028+0000 7f30a0414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.028+0000 7f30a0414800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.028+0000 7f30a0414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.028+0000 7f30a0414800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.029+0000 7f30a0414800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:01.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.029+0000 7f30a0414800 20 searching for the correct realm 2024-09-12T00:47:01.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.031+0000 7f3093fff640 0 -- 172.21.15.133:0/1854908464 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7f3084040020 msgr2=0x7f308406b7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:01.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.034+0000 7f3093fff640 0 -- 172.21.15.133:0/1854908464 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f308c06b020 msgr2=0x7f308c056a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:01.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.242+0000 7f30a0414800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:47:01.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.242+0000 7f30a0414800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:47:01.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.242+0000 7f30a0414800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:01.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.242+0000 7f30a0414800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:01.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.242+0000 7f30a0414800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:01.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.242+0000 7f30a0414800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:01.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.242+0000 7f30a0414800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.242+0000 7f30a0414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.242+0000 7f30a0414800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.242+0000 7f30a0414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:01.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.242+0000 7f30a0414800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.243+0000 7f30a0414800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.243+0000 7f30a0414800 20 zone default found 2024-09-12T00:47:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.243+0000 7f30a0414800 4 Realm: () 2024-09-12T00:47:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.243+0000 7f30a0414800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:47:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.243+0000 7f30a0414800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:47:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.243+0000 7f30a0414800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.243+0000 7f30a0414800 20 zonegroup default 2024-09-12T00:47:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.243+0000 7f30a0414800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.243+0000 7f30a0414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.243+0000 7f30a0414800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.243+0000 7f30a0414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.243+0000 7f30a0414800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.244+0000 7f30a0414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.244+0000 7f30a0414800 20 started sync module instance, tier type = 2024-09-12T00:47:01.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.244+0000 7f30a0414800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:47:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.254+0000 7f30a0414800 20 add_watcher() i=0 2024-09-12T00:47:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.254+0000 7f30a0414800 20 add_watcher() i=1 2024-09-12T00:47:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.254+0000 7f30a0414800 20 add_watcher() i=2 2024-09-12T00:47:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.254+0000 7f30a0414800 20 add_watcher() i=3 2024-09-12T00:47:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.254+0000 7f30a0414800 20 add_watcher() i=4 2024-09-12T00:47:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.254+0000 7f30a0414800 20 add_watcher() i=5 2024-09-12T00:47:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.254+0000 7f30a0414800 20 add_watcher() i=6 2024-09-12T00:47:01.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.255+0000 7f30a0414800 20 add_watcher() i=7 2024-09-12T00:47:01.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.255+0000 7f30a0414800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.257+0000 7f2f51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.257+0000 7f30a0414800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:01.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.257+0000 7f30a0414800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.257+0000 7f30a0414800 5 note: GC not initialized 2024-09-12T00:47:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.258+0000 7f2f50fe1640 20 reqs_thread_entry: start 2024-09-12T00:47:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.258+0000 7f30a0414800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.258+0000 7f30a0414800 20 Filter name: none 2024-09-12T00:47:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.258+0000 7f2eca7fc640 20 reqs_thread_entry: start 2024-09-12T00:47:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.258+0000 7f30a0414800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T00:47:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.258+0000 7f30a0414800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.258+0000 7f30a0414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.258+0000 7f30a0414800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T00:47:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.258+0000 7f30a0414800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:47:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.258+0000 7f30a0414800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T00:47:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.258+0000 7f30a0414800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T00:47:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.258+0000 7f30a0414800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.259+0000 7f30a0414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.259+0000 7f30a0414800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T00:47:01.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.259+0000 7f30a0414800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:47:01.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.259+0000 7f30a0414800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T00:47:01.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.260+0000 7f30a0414800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:47:01.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.260+0000 7f30a0414800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:47:01.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.260+0000 7f30a0414800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T00:47:01.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.260+0000 7f2f7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399089 cookie 94059946081088 notifier 9423 bl.length()=384 2024-09-12T00:47:01.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.260+0000 7f2f7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:47:01.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.260+0000 7f2f7affd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:47:01.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.263+0000 7f30a0414800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:47:01.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.263+0000 7f30a0414800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:47:01.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.263+0000 7f30a0414800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T00:47:01.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.263+0000 7f2f7a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399090 cookie 94059946089952 notifier 9423 bl.length()=225 2024-09-12T00:47:01.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.263+0000 7f2f7a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:47:01.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.263+0000 7f2f7a7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:47:01.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.266+0000 7f30a0414800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:47:01.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.266+0000 7f30a0414800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:47:01.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.266+0000 7f30a0414800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T00:47:01.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.266+0000 7f2f7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398951 cookie 94059946085152 notifier 9423 bl.length()=234 2024-09-12T00:47:01.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.266+0000 7f2f7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:47:01.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.266+0000 7f2f7affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:47:01.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.268+0000 7f2f7a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398952 cookie 94059946085152 notifier 9423 bl.length()=234 2024-09-12T00:47:01.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.268+0000 7f2f7a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:47:01.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.268+0000 7f2f7a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:47:01.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.270+0000 7f2f51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:01.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.272+0000 7f30a0414800 20 remove_watcher() i=0 2024-09-12T00:47:01.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.272+0000 7f30a0414800 2 removed watcher, disabling cache 2024-09-12T00:47:01.272 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.273+0000 7f30a0414800 20 remove_watcher() i=1 2024-09-12T00:47:01.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.275+0000 7f30a0414800 20 remove_watcher() i=2 2024-09-12T00:47:01.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.276+0000 7f30a0414800 20 remove_watcher() i=3 2024-09-12T00:47:01.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.277+0000 7f30a0414800 20 remove_watcher() i=4 2024-09-12T00:47:01.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.278+0000 7f30a0414800 20 remove_watcher() i=5 2024-09-12T00:47:01.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.279+0000 7f30a0414800 20 remove_watcher() i=6 2024-09-12T00:47:01.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.280+0000 7f30a0414800 20 remove_watcher() i=7 2024-09-12T00:47:01.287 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T00:47:01.288 INFO:teuthology.orchestra.run.smithi133.stdout: "id": "RGW99999999999999999", 2024-09-12T00:47:01.288 INFO:teuthology.orchestra.run.smithi133.stdout: "tenant": "", 2024-09-12T00:47:01.288 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T00:47:01.288 INFO:teuthology.orchestra.run.smithi133.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T00:47:01.288 INFO:teuthology.orchestra.run.smithi133.stdout: "quota": { 2024-09-12T00:47:01.288 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:47:01.288 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:47:01.288 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:47:01.288 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:47:01.288 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:47:01.288 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:47:01.288 INFO:teuthology.orchestra.run.smithi133.stdout: "bucket_quota": { 2024-09-12T00:47:01.289 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:47:01.289 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:47:01.289 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:47:01.289 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:47:01.289 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:47:01.289 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:47:01.289 INFO:teuthology.orchestra.run.smithi133.stdout: "max_users": 1000, 2024-09-12T00:47:01.289 INFO:teuthology.orchestra.run.smithi133.stdout: "max_roles": 1000, 2024-09-12T00:47:01.289 INFO:teuthology.orchestra.run.smithi133.stdout: "max_groups": 1000, 2024-09-12T00:47:01.289 INFO:teuthology.orchestra.run.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:47:01.289 INFO:teuthology.orchestra.run.smithi133.stdout: "max_access_keys": 4 2024-09-12T00:47:01.289 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T00:47:01.290 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T00:47:01.291 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key ASBHSOEYJEICXYKTZRDT --secret FDKsqSbBfqL6GNxo244JrXZNNoZ4Fep3s5ay5FPCKgNAB/NURFSi0w== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T00:47:01.358 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:01.358 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:01.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.393+0000 7fc26580f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.395+0000 7fc26580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.395+0000 7fc26580f800 20 realm 2024-09-12T00:47:01.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.395+0000 7fc26580f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.395+0000 7fc26580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.395+0000 7fc26580f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:01.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.395+0000 7fc26580f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.396+0000 7fc26580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.396+0000 7fc26580f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.396+0000 7fc26580f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:01.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.396+0000 7fc26580f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.397+0000 7fc26580f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:01.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.397+0000 7fc26580f800 20 searching for the correct realm 2024-09-12T00:47:01.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.399+0000 7fc262af8640 0 -- 172.21.15.133:0/823524008 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fc24c039070 msgr2=0x7fc24c0727c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:01.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.402+0000 7fc262af8640 0 -- 172.21.15.133:0/823524008 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fc2540ac920 msgr2=0x7fc2540ab390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:01.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.610+0000 7fc26580f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:47:01.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.610+0000 7fc26580f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:47:01.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.610+0000 7fc26580f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:01.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.610+0000 7fc26580f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:01.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.610+0000 7fc26580f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:01.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.610+0000 7fc26580f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:01.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.610+0000 7fc26580f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.610+0000 7fc26580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.610+0000 7fc26580f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.611+0000 7fc26580f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:01.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.611+0000 7fc26580f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.611+0000 7fc26580f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:01.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.611+0000 7fc26580f800 20 zone default found 2024-09-12T00:47:01.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.611+0000 7fc26580f800 4 Realm: () 2024-09-12T00:47:01.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.611+0000 7fc26580f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:47:01.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.611+0000 7fc26580f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:47:01.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.611+0000 7fc26580f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:01.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.611+0000 7fc26580f800 20 zonegroup default 2024-09-12T00:47:01.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.611+0000 7fc26580f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.611+0000 7fc26580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.611+0000 7fc26580f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.612+0000 7fc26580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.612+0000 7fc26580f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.612+0000 7fc26580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.612+0000 7fc26580f800 20 started sync module instance, tier type = 2024-09-12T00:47:01.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.612+0000 7fc26580f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:47:01.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.622+0000 7fc26580f800 20 add_watcher() i=0 2024-09-12T00:47:01.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.622+0000 7fc26580f800 20 add_watcher() i=1 2024-09-12T00:47:01.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.622+0000 7fc26580f800 20 add_watcher() i=2 2024-09-12T00:47:01.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.622+0000 7fc26580f800 20 add_watcher() i=3 2024-09-12T00:47:01.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.622+0000 7fc26580f800 20 add_watcher() i=4 2024-09-12T00:47:01.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.622+0000 7fc26580f800 20 add_watcher() i=5 2024-09-12T00:47:01.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.622+0000 7fc26580f800 20 add_watcher() i=6 2024-09-12T00:47:01.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.623+0000 7fc26580f800 20 add_watcher() i=7 2024-09-12T00:47:01.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.623+0000 7fc26580f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:01.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.625+0000 7fc119fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:01.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.625+0000 7fc26580f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:01.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.625+0000 7fc26580f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:01.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.625+0000 7fc26580f800 5 note: GC not initialized 2024-09-12T00:47:01.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.625+0000 7fc118fe1640 20 reqs_thread_entry: start 2024-09-12T00:47:01.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.625+0000 7fc26580f800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:01.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.625+0000 7fc26580f800 20 Filter name: none 2024-09-12T00:47:01.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.626+0000 7fc0927fc640 20 reqs_thread_entry: start 2024-09-12T00:47:01.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.626+0000 7fc26580f800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:47:01.625 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.626+0000 7fc26580f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.626+0000 7fc26580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.626+0000 7fc26580f800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T00:47:01.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.626+0000 7fc26580f800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:47:01.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.626+0000 7fc26580f800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T00:47:01.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.626+0000 7fc26580f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.627+0000 7fc26580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.627+0000 7fc26580f800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T00:47:01.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.627+0000 7fc26580f800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:47:01.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.627+0000 7fc26580f800 10 cache get: name=default.rgw.meta+users.keys+ASBHSOEYJEICXYKTZRDT : miss 2024-09-12T00:47:01.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.627+0000 7fc26580f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.627+0000 7fc26580f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.627+0000 7fc26580f800 10 cache put: name=default.rgw.meta+users.keys+ASBHSOEYJEICXYKTZRDT info.flags=0x0 2024-09-12T00:47:01.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.627+0000 7fc26580f800 10 adding default.rgw.meta+users.keys+ASBHSOEYJEICXYKTZRDT to cache LRU end 2024-09-12T00:47:01.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.627+0000 7fc26580f800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T00:47:01.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.627+0000 7fc26580f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.627+0000 7fc26580f800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:47:01.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.627+0000 7fc26580f800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:47:01.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.627+0000 7fc26580f800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:47:01.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.627+0000 7fc26580f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:01.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.628+0000 7fc26580f800 10 cache get: name=default.rgw.meta+users.keys+ASBHSOEYJEICXYKTZRDT : hit (negative entry) 2024-09-12T00:47:01.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.628+0000 7fc26580f800 10 cache get: name=default.rgw.meta+users.keys+ASBHSOEYJEICXYKTZRDT : hit (negative entry) 2024-09-12T00:47:01.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.629+0000 7fc26580f800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:47:01.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.629+0000 7fc26580f800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:47:01.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.629+0000 7fc26580f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:47:01.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.629+0000 7fc146ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399091 cookie 94274145050320 notifier 9444 bl.length()=681 2024-09-12T00:47:01.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.629+0000 7fc146ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:47:01.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.629+0000 7fc146ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:47:01.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.633+0000 7fc26580f800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:47:01.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.633+0000 7fc26580f800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:47:01.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.633+0000 7fc26580f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T00:47:01.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.633+0000 7fc146ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399159 cookie 94274145061872 notifier 9444 bl.length()=189 2024-09-12T00:47:01.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.633+0000 7fc146ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:47:01.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.633+0000 7fc146ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:47:01.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.636+0000 7fc26580f800 10 cache put: name=default.rgw.meta+users.keys+ASBHSOEYJEICXYKTZRDT info.flags=0x7 2024-09-12T00:47:01.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.636+0000 7fc26580f800 10 moving default.rgw.meta+users.keys+ASBHSOEYJEICXYKTZRDT to cache LRU end 2024-09-12T00:47:01.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.636+0000 7fc26580f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:ASBHSOEYJEICXYKTZRDT, ofs0, ns] 2024-09-12T00:47:01.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.637+0000 7fc146ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399004 cookie 94274145052896 notifier 9444 bl.length()=188 2024-09-12T00:47:01.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.637+0000 7fc146ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ASBHSOEYJEICXYKTZRDT info.flags=0x7 2024-09-12T00:47:01.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.637+0000 7fc146ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ASBHSOEYJEICXYKTZRDT to cache LRU end 2024-09-12T00:47:01.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.639+0000 7fc26580f800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T00:47:01.638 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T00:47:01.638 INFO:teuthology.orchestra.run.smithi133.stdout: "user_id": "root2.client.0", 2024-09-12T00:47:01.638 INFO:teuthology.orchestra.run.smithi133.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T00:47:01.638 INFO:teuthology.orchestra.run.smithi133.stdout: "email": "root2+test@test.test", 2024-09-12T00:47:01.639 INFO:teuthology.orchestra.run.smithi133.stdout: "suspended": 0, 2024-09-12T00:47:01.639 INFO:teuthology.orchestra.run.smithi133.stdout: "max_buckets": 1000, 2024-09-12T00:47:01.639 INFO:teuthology.orchestra.run.smithi133.stdout: "subusers": [], 2024-09-12T00:47:01.639 INFO:teuthology.orchestra.run.smithi133.stdout: "keys": [ 2024-09-12T00:47:01.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2024-09-12T00:47:01.639 INFO:teuthology.orchestra.run.smithi133.stdout: "user": "root2.client.0", 2024-09-12T00:47:01.639 INFO:teuthology.orchestra.run.smithi133.stdout: "access_key": "ASBHSOEYJEICXYKTZRDT", 2024-09-12T00:47:01.639 INFO:teuthology.orchestra.run.smithi133.stdout: "secret_key": "FDKsqSbBfqL6GNxo244JrXZNNoZ4Fep3s5ay5FPCKgNAB/NURFSi0w==", 2024-09-12T00:47:01.639 INFO:teuthology.orchestra.run.smithi133.stdout: "active": true, 2024-09-12T00:47:01.639 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:47:01.628874Z" 2024-09-12T00:47:01.639 INFO:teuthology.orchestra.run.smithi133.stdout: } 2024-09-12T00:47:01.639 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2024-09-12T00:47:01.639 INFO:teuthology.orchestra.run.smithi133.stdout: "swift_keys": [], 2024-09-12T00:47:01.640 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": [], 2024-09-12T00:47:01.640 INFO:teuthology.orchestra.run.smithi133.stdout: "op_mask": "read, write, delete", 2024-09-12T00:47:01.640 INFO:teuthology.orchestra.run.smithi133.stdout: "default_placement": "", 2024-09-12T00:47:01.640 INFO:teuthology.orchestra.run.smithi133.stdout: "default_storage_class": "", 2024-09-12T00:47:01.640 INFO:teuthology.orchestra.run.smithi133.stdout: "placement_tags": [], 2024-09-12T00:47:01.640 INFO:teuthology.orchestra.run.smithi133.stdout: "bucket_quota": { 2024-09-12T00:47:01.640 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:47:01.640 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:47:01.640 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:47:01.640 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:47:01.640 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:47:01.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:47:01.640 INFO:teuthology.orchestra.run.smithi133.stdout: "user_quota": { 2024-09-12T00:47:01.640 INFO:teuthology.orchestra.run.smithi133.stdout: "enabled": false, 2024-09-12T00:47:01.641 INFO:teuthology.orchestra.run.smithi133.stdout: "check_on_raw": false, 2024-09-12T00:47:01.641 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size": -1, 2024-09-12T00:47:01.641 INFO:teuthology.orchestra.run.smithi133.stdout: "max_size_kb": 0, 2024-09-12T00:47:01.641 INFO:teuthology.orchestra.run.smithi133.stdout: "max_objects": -1 2024-09-12T00:47:01.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2024-09-12T00:47:01.641 INFO:teuthology.orchestra.run.smithi133.stdout: "temp_url_keys": [], 2024-09-12T00:47:01.641 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "root", 2024-09-12T00:47:01.641 INFO:teuthology.orchestra.run.smithi133.stdout: "mfa_ids": [], 2024-09-12T00:47:01.641 INFO:teuthology.orchestra.run.smithi133.stdout: "account_id": "RGW99999999999999999", 2024-09-12T00:47:01.641 INFO:teuthology.orchestra.run.smithi133.stdout: "path": "/", 2024-09-12T00:47:01.641 INFO:teuthology.orchestra.run.smithi133.stdout: "create_date": "2024-09-12T00:47:01.628860Z", 2024-09-12T00:47:01.641 INFO:teuthology.orchestra.run.smithi133.stdout: "tags": [], 2024-09-12T00:47:01.641 INFO:teuthology.orchestra.run.smithi133.stdout: "group_ids": [] 2024-09-12T00:47:01.642 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T00:47:01.642 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:47:01.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.640+0000 7fc119fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:01.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.643+0000 7fc26580f800 20 remove_watcher() i=0 2024-09-12T00:47:01.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.643+0000 7fc26580f800 2 removed watcher, disabling cache 2024-09-12T00:47:01.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.644+0000 7fc26580f800 20 remove_watcher() i=1 2024-09-12T00:47:01.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.645+0000 7fc26580f800 20 remove_watcher() i=2 2024-09-12T00:47:01.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.647+0000 7fc26580f800 20 remove_watcher() i=3 2024-09-12T00:47:01.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.648+0000 7fc26580f800 20 remove_watcher() i=4 2024-09-12T00:47:01.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.649+0000 7fc26580f800 20 remove_watcher() i=5 2024-09-12T00:47:01.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.650+0000 7fc26580f800 20 remove_watcher() i=6 2024-09-12T00:47:01.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.651+0000 7fc26580f800 20 remove_watcher() i=7 2024-09-12T00:47:01.661 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 6502908788 --totp-seed XXJ6NZGG2CIL4ZP2SAJF3CIP4BGBXCD6KHSRMGNBYGPVVEL7JXWERF57HWD46CBE --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:47:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:01.727 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:01.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.762+0000 7f8d13a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.763+0000 7f8d13a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.763+0000 7f8d13a2f800 20 realm 2024-09-12T00:47:01.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.763+0000 7f8d13a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.764+0000 7f8d13a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.764+0000 7f8d13a2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:01.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.764+0000 7f8d13a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.764+0000 7f8d13a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.764+0000 7f8d13a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.765+0000 7f8d13a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:01.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.765+0000 7f8d13a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.765+0000 7f8d13a2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:01.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.765+0000 7f8d13a2f800 20 searching for the correct realm 2024-09-12T00:47:01.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.768+0000 7f8d11d1a640 0 -- 172.21.15.133:0/512226337 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x55d1a427bce0 msgr2=0x55d1a427e0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:01.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.771+0000 7f8d10d18640 0 -- 172.21.15.133:0/512226337 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f8d040a5180 msgr2=0x7f8d040a3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.977+0000 7f8d13a2f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.977+0000 7f8d13a2f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.977+0000 7f8d13a2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.977+0000 7f8d13a2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.977+0000 7f8d13a2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.977+0000 7f8d13a2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.977+0000 7f8d13a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.978+0000 7f8d13a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.978+0000 7f8d13a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.978+0000 7f8d13a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:01.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.978+0000 7f8d13a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.978+0000 7f8d13a2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.978+0000 7f8d13a2f800 20 zone default found 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.978+0000 7f8d13a2f800 4 Realm: () 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.978+0000 7f8d13a2f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.978+0000 7f8d13a2f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.978+0000 7f8d13a2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.978+0000 7f8d13a2f800 20 zonegroup default 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.978+0000 7f8d13a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.979+0000 7f8d13a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.979+0000 7f8d13a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.979+0000 7f8d13a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.979+0000 7f8d13a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.979+0000 7f8d13a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.979+0000 7f8d13a2f800 20 started sync module instance, tier type = 2024-09-12T00:47:01.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.979+0000 7f8d13a2f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T00:47:01.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.989+0000 7f8d13a2f800 20 add_watcher() i=0 2024-09-12T00:47:01.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.989+0000 7f8d13a2f800 20 add_watcher() i=1 2024-09-12T00:47:01.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.989+0000 7f8d13a2f800 20 add_watcher() i=2 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.989+0000 7f8d13a2f800 20 add_watcher() i=3 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.989+0000 7f8d13a2f800 20 add_watcher() i=4 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.989+0000 7f8d13a2f800 20 add_watcher() i=5 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.989+0000 7f8d13a2f800 20 add_watcher() i=6 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.991+0000 7f8d13a2f800 20 add_watcher() i=7 2024-09-12T00:47:01.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.991+0000 7f8d13a2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.992+0000 7f8bc7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.993+0000 7f8d13a2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.993+0000 7f8d13a2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.993+0000 7f8d13a2f800 5 note: GC not initialized 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.993+0000 7f8bc6fe5640 20 reqs_thread_entry: start 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.993+0000 7f8d13a2f800 20 init_complete bucket index max shards: 1 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.993+0000 7f8d13a2f800 20 Filter name: none 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.993+0000 7f8bc4fe1640 20 reqs_thread_entry: start 2024-09-12T00:47:01.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.993+0000 7f8d13a2f800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.993+0000 7f8d13a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.994+0000 7f8d13a2f800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.994+0000 7f8d13a2f800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.994+0000 7f8d13a2f800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:47:01.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.994+0000 7f8d13a2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:01.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.997+0000 7f8d13a2f800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.997+0000 7f8d13a2f800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.997+0000 7f8d13a2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.997+0000 7f8bf4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399092 cookie 94358890615376 notifier 8792 bl.length()=695 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.997+0000 7f8bf4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:47:01.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.997+0000 7f8bf4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:47:01.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:01.999+0000 7f8bc7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:02.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:02.001+0000 7f8d13a2f800 20 remove_watcher() i=0 2024-09-12T00:47:02.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:02.001+0000 7f8d13a2f800 2 removed watcher, disabling cache 2024-09-12T00:47:02.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:02.002+0000 7f8d13a2f800 20 remove_watcher() i=1 2024-09-12T00:47:02.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:02.004+0000 7f8d13a2f800 20 remove_watcher() i=2 2024-09-12T00:47:02.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:02.005+0000 7f8d13a2f800 20 remove_watcher() i=3 2024-09-12T00:47:02.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:02.006+0000 7f8d13a2f800 20 remove_watcher() i=4 2024-09-12T00:47:02.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:02.008+0000 7f8d13a2f800 20 remove_watcher() i=5 2024-09-12T00:47:02.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:02.010+0000 7f8d13a2f800 20 remove_watcher() i=6 2024-09-12T00:47:02.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T00:47:02.012+0000 7f8d13a2f800 20 remove_watcher() i=7 2024-09-12T00:47:02.022 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T00:47:02.023 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:47:02.023 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T00:47:02.052 INFO:tasks.s3tests:Configuring boto... 2024-09-12T00:47:02.053 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T00:47:02.053 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T00:47:02.122 DEBUG:teuthology.orchestra.run.smithi133:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:47:02.299 INFO:teuthology.orchestra.run.smithi133.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T00:47:02.477 INFO:teuthology.orchestra.run.smithi133.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T00:47:02.738 INFO:teuthology.orchestra.run.smithi133.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:48:59.614 INFO:teuthology.orchestra.run.smithi133.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T00:49:01.031 INFO:teuthology.orchestra.run.smithi133.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=17df5abc7aa8dae63d14582302852bc7321781a7d849d67b4f1fd4f9b8e18aff,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T00:49:01.031 INFO:teuthology.orchestra.run.smithi133.stdout:py run-test-pre: PYTHONHASHSEED='1567448214' 2024-09-12T00:49:01.032 INFO:teuthology.orchestra.run.smithi133.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:49:01.176 INFO:teuthology.orchestra.run.smithi133.stdout:============================= test session starts ============================== 2024-09-12T00:49:01.176 INFO:teuthology.orchestra.run.smithi133.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T00:49:01.176 INFO:teuthology.orchestra.run.smithi133.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:49:01.176 INFO:teuthology.orchestra.run.smithi133.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:49:01.176 INFO:teuthology.orchestra.run.smithi133.stdout:configfile: pytest.ini 2024-09-12T00:49:02.945 INFO:teuthology.orchestra.run.smithi133.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T00:49:02.946 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T00:49:03.250 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T00:49:03.473 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T00:49:03.765 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T00:49:04.051 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T00:49:04.273 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T00:49:04.529 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T00:49:04.867 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T00:49:05.084 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T00:49:05.204 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T00:49:05.324 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T00:49:05.558 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T00:49:05.783 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T00:49:06.005 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T00:49:06.230 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T00:49:06.353 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T00:49:06.473 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T00:49:06.553 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T00:49:06.628 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T00:49:06.703 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T00:49:06.779 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T00:49:06.854 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T00:49:06.929 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T00:49:07.005 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:49:07.080 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:49:07.155 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:49:07.229 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:49:07.305 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:49:07.380 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:49:07.455 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T00:49:07.531 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T00:49:07.607 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:49:07.684 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:49:07.760 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:49:07.836 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:49:07.911 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:49:07.984 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:49:08.062 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T00:49:08.138 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T00:49:08.214 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:49:08.289 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:49:08.364 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T00:49:08.440 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:49:08.515 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:49:08.590 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:49:08.665 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T00:49:08.741 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:49:08.816 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:49:08.891 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:49:08.966 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:49:09.041 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:49:09.116 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:49:09.191 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T00:49:09.265 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T00:49:09.740 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T00:49:13.319 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T00:49:17.155 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T00:49:22.017 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T00:49:28.306 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T00:49:30.026 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T00:49:32.737 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T00:49:33.374 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T00:49:33.555 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T00:49:33.859 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T00:49:34.164 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T00:49:34.773 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T00:49:35.093 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T00:49:35.261 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T00:49:35.262 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:49:35.263 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:49:35.264 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:49:35.265 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:49:35.265 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:49:35.266 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:49:35.267 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T00:49:35.268 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:49:35.269 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:49:35.269 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:49:35.270 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:49:35.271 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T00:49:35.272 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:49:35.273 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:49:35.274 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:49:35.274 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:49:35.275 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:49:35.276 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:49:35.277 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:49:35.278 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T00:49:35.278 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T00:49:35.279 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T00:49:35.280 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T00:49:35.281 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T00:49:35.282 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T00:49:35.282 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T00:49:35.283 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T00:49:35.367 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T00:49:35.378 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T00:49:35.996 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T00:49:40.814 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T00:49:41.247 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T00:49:41.756 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T00:49:42.260 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T00:49:42.765 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T00:49:43.271 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T00:49:43.647 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T00:49:44.188 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T00:49:44.657 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T00:49:45.122 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T00:49:45.516 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T00:49:45.882 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T00:49:46.256 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T00:49:46.474 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T00:49:46.913 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T00:49:47.405 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T00:49:47.932 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T00:49:48.314 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T00:49:48.699 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T00:49:49.086 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T00:49:49.466 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T00:49:49.843 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T00:49:50.198 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T00:49:50.556 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T00:49:50.775 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T00:49:51.036 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T00:49:51.256 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T00:49:51.476 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T00:49:51.707 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T00:49:52.162 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T00:49:52.394 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:49:52.658 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T00:49:53.076 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T00:49:53.476 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T00:49:53.745 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:49:54.146 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T00:49:54.536 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:49:55.088 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:49:55.420 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T00:49:55.803 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T00:49:56.197 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T00:49:56.924 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:49:57.453 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:49:57.970 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:49:58.540 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:49:59.246 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:50:00.372 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:50:01.597 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:50:02.300 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:50:03.013 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:50:03.529 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T00:50:04.205 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T00:50:04.641 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T00:50:05.934 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T00:50:06.747 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T00:50:07.751 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T00:50:09.904 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T00:50:12.806 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T00:50:14.407 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T00:50:15.838 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T00:50:16.875 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T00:50:17.508 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T00:50:18.786 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T00:50:19.641 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T00:50:20.835 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T00:50:21.642 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T00:50:23.267 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T00:50:24.420 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T00:50:26.181 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T00:50:27.908 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T00:50:29.069 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T00:50:30.125 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T00:50:30.949 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T00:50:33.105 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T00:50:34.668 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T00:50:36.456 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T00:50:38.124 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T00:50:39.672 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T00:50:41.239 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T00:50:42.517 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T00:50:43.389 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T00:50:44.392 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T00:50:46.395 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T00:50:48.994 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T00:50:50.010 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T00:50:51.629 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T00:50:53.250 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T00:50:54.735 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T00:50:56.248 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T00:50:57.875 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T00:50:59.353 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T00:51:00.818 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T00:51:01.838 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T00:51:02.628 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T00:51:03.409 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T00:51:04.198 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T00:51:05.567 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T00:51:06.967 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T00:51:08.359 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T00:51:09.679 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T00:51:11.079 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T00:51:12.449 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T00:51:13.776 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T00:51:15.166 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T00:51:16.479 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T00:51:17.871 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T00:51:19.190 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T00:51:20.612 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T00:51:21.437 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T00:51:22.274 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T00:51:23.036 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T00:51:23.802 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T00:51:24.349 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T00:51:24.996 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T00:51:25.621 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T00:51:26.245 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T00:51:26.907 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T00:51:27.516 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T00:51:28.121 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T00:51:28.759 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T00:51:29.359 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T00:51:30.191 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T00:51:31.015 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T00:51:31.504 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T00:51:32.031 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T00:51:32.630 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T00:51:33.226 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T00:51:34.052 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T00:51:34.885 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T00:51:35.515 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T00:51:36.126 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T00:51:36.732 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T00:51:37.349 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T00:51:37.952 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T00:51:38.545 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T00:51:39.140 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T00:51:39.774 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T00:51:40.370 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T00:51:40.974 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T00:51:41.578 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T00:51:42.197 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T00:51:42.758 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T00:51:43.324 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T00:51:43.919 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T00:51:44.523 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T00:51:45.121 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T00:52:32.229 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T00:52:32.785 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T00:52:33.346 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T00:52:33.909 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T00:52:34.462 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T00:52:35.059 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T00:52:35.619 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T00:52:36.174 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T00:52:36.737 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T00:52:37.303 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T00:52:37.855 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T00:52:38.412 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T00:52:39.009 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T00:52:39.615 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T00:52:40.219 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T00:52:40.820 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T00:52:41.419 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T00:52:42.017 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T00:52:42.626 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T00:52:43.265 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:52:43.864 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:52:44.463 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:52:45.059 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:52:45.716 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T00:52:46.381 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T00:52:47.025 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T00:52:47.629 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T00:52:48.236 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T00:52:48.841 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T00:52:49.095 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T00:52:49.583 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T00:52:51.625 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T00:52:53.524 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T00:52:54.122 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T00:52:54.721 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T00:52:55.318 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T00:52:55.920 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T00:52:56.626 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T00:52:57.305 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T00:52:57.901 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T00:52:58.500 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T00:52:59.099 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T00:52:59.696 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T00:53:00.295 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T00:53:00.931 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T00:53:01.779 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T00:53:02.875 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T00:53:03.295 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T00:53:03.708 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T00:53:04.092 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T00:53:04.473 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T00:53:04.741 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T00:53:04.972 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T00:53:05.201 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T00:53:05.691 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T00:53:07.249 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T00:53:07.483 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T00:53:07.958 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T00:53:08.332 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T00:53:08.726 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T00:53:09.122 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T00:53:11.039 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T00:53:11.808 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T00:53:12.538 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T00:53:59.988 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T00:54:47.350 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T00:54:47.830 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T00:54:48.300 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T00:54:48.792 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T00:54:49.282 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T00:54:49.902 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T00:54:50.396 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T00:54:50.934 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T00:54:51.528 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T00:54:52.070 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T00:54:52.619 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T00:54:53.168 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T00:54:53.764 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T00:54:54.294 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T00:54:54.687 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T00:54:55.148 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T00:54:55.640 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T00:54:56.325 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T00:54:56.821 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T00:54:57.292 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T00:54:57.775 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T00:54:58.268 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T00:54:58.809 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T00:54:59.199 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T00:54:59.584 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T00:54:59.975 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T00:55:00.398 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T00:55:00.791 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T00:55:01.185 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T00:55:01.676 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T00:55:02.074 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T00:55:02.460 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T00:55:02.878 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T00:55:03.271 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T00:55:03.860 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T00:55:04.255 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T00:55:04.640 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T00:55:05.026 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T00:55:05.419 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T00:55:05.810 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T00:55:06.206 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T00:55:06.605 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T00:55:07.685 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T00:55:08.075 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T00:55:08.649 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T00:55:09.178 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T00:55:09.671 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T00:55:10.208 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T00:55:10.743 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T00:55:12.267 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T00:55:12.816 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T00:55:13.349 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T00:55:13.986 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T00:55:14.688 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T00:55:15.325 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T00:55:15.836 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T00:55:16.564 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T00:55:17.258 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T00:55:17.810 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T00:55:18.495 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T00:55:18.976 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T00:55:19.401 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T00:55:19.790 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T00:55:20.250 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T00:55:20.639 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T00:55:20.868 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T00:55:21.500 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T00:55:21.979 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T00:55:22.466 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T00:55:25.433 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T00:55:25.920 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T00:55:26.414 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T00:55:26.906 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T00:55:27.397 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T00:55:27.855 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T00:55:28.360 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T00:55:28.869 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T00:55:29.414 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T00:55:29.892 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T00:55:30.371 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T00:55:30.841 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T00:55:31.328 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T00:55:31.826 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T00:55:32.308 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T00:55:32.815 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T00:55:33.342 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T00:55:33.815 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T00:55:34.044 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T00:55:34.278 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T00:55:34.517 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T00:55:34.893 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T00:55:35.261 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T00:55:35.637 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T00:55:36.009 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T00:55:36.441 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T00:55:36.672 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T00:55:36.906 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T00:55:37.275 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T00:55:37.508 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T00:55:37.738 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T00:55:37.971 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T00:55:38.204 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T00:55:38.616 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T00:55:39.036 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T00:55:39.428 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T00:55:39.897 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T00:55:40.327 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T00:55:40.714 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T00:55:41.139 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T00:55:41.642 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T00:55:42.066 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T00:55:42.492 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T00:55:43.044 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T00:55:43.569 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T00:55:44.195 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T00:55:44.721 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T00:55:45.251 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T00:55:45.883 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T00:55:46.474 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T00:55:47.095 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T00:55:47.671 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T00:55:48.094 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T00:55:48.717 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T00:55:49.340 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T00:55:49.959 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T00:55:50.609 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T00:55:51.275 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T00:55:51.951 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T00:55:52.531 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T00:55:53.120 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T00:55:53.774 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T00:55:54.386 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T00:55:54.804 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T00:55:55.344 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T00:55:55.899 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T00:55:56.382 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T00:55:56.809 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T00:55:57.452 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T00:55:58.304 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T00:55:59.115 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T00:55:59.925 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T00:56:00.743 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T00:56:01.559 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T00:56:02.423 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T00:56:03.238 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T00:56:04.064 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T00:56:04.887 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T00:56:05.725 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T00:56:06.567 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T00:56:07.460 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T00:56:08.553 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T00:56:09.600 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T00:56:09.825 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T00:56:10.051 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T00:56:10.279 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T00:56:10.693 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T00:56:11.102 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T00:56:11.471 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T00:56:11.884 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T00:56:12.489 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T00:56:14.592 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T00:56:15.278 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T00:56:15.906 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T00:56:19.726 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T00:56:20.369 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T00:56:21.043 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T00:56:21.603 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T00:56:22.185 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T00:56:23.026 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T00:56:23.698 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T00:56:24.409 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T00:56:25.102 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T00:56:26.259 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T00:56:27.413 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T00:56:27.808 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T00:56:28.210 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T00:56:30.101 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T00:56:30.827 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T00:56:41.490 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T00:56:41.925 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T00:56:42.545 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T00:56:44.530 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T00:56:45.132 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T00:56:46.182 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T00:56:52.411 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T00:57:01.414 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T00:57:15.818 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T00:58:08.368 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T00:58:15.606 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T00:58:26.763 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T00:58:27.757 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T00:58:30.796 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T00:58:34.586 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T00:58:36.416 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T00:58:36.965 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T00:58:39.877 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T00:58:40.519 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T00:58:41.109 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T00:58:41.649 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T00:59:00.066 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T00:59:02.911 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T00:59:03.506 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T00:59:03.921 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T00:59:04.520 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T00:59:08.376 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T00:59:11.880 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T00:59:15.326 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T00:59:15.845 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T00:59:16.363 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T00:59:16.891 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T00:59:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T00:59:17.966 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T00:59:18.486 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T00:59:19.043 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T00:59:19.966 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T00:59:21.566 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T00:59:24.969 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T00:59:26.139 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T00:59:28.104 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T00:59:31.175 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T00:59:32.360 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T00:59:35.309 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T00:59:40.395 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T00:59:41.383 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T00:59:42.086 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T00:59:43.046 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T00:59:43.603 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T00:59:49.220 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T00:59:49.752 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T00:59:50.286 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T00:59:50.814 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T00:59:51.341 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T00:59:52.081 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T01:00:03.165 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T01:00:04.285 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T01:00:04.969 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T01:00:05.900 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T01:00:06.841 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T01:00:11.458 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T01:00:12.433 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T01:00:18.012 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T01:00:39.429 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T01:00:50.791 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T01:00:52.964 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T01:00:55.054 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T01:00:55.888 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T01:00:56.781 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T01:00:57.437 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T01:00:58.501 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T01:00:59.397 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T01:01:01.039 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T01:01:01.507 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T01:01:01.999 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T01:01:02.470 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T01:01:02.863 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T01:01:03.293 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T01:01:03.806 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T01:01:04.225 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T01:01:04.646 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T01:01:05.195 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T01:01:05.609 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T01:01:06.026 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T01:01:06.443 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T01:01:06.853 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T01:01:07.288 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T01:01:07.844 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T01:01:08.393 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T01:01:09.171 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T01:01:09.729 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T01:01:10.267 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T01:01:10.796 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T01:01:11.329 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T01:01:11.814 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T01:01:12.246 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T01:01:12.682 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T01:01:13.120 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T01:01:39.754 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T01:02:06.142 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T01:02:13.301 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T01:02:13.809 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T01:03:14.970 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T01:04:16.309 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T01:04:16.901 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T01:04:17.442 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T01:04:17.874 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T01:04:18.274 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T01:04:36.923 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T01:04:43.306 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T01:04:49.629 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T01:04:50.174 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T01:04:50.719 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T01:04:51.264 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T01:04:52.042 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T01:04:52.583 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T01:04:53.151 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T01:04:53.688 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T01:04:54.223 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T01:04:54.878 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T01:04:55.487 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T01:04:56.021 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T01:04:56.547 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T01:04:57.450 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T01:04:58.359 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T01:05:00.259 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T01:05:01.678 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T01:05:03.186 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T01:05:04.559 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T01:05:05.995 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T01:05:07.877 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T01:05:09.312 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T01:05:10.822 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T01:05:12.368 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T01:05:12.962 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T01:05:13.466 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T01:05:14.066 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T01:05:15.448 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T01:05:16.850 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T01:05:18.869 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T01:05:20.131 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T01:05:33.095 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T01:05:33.952 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T01:05:34.863 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:05:35.724 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:05:36.902 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T01:05:37.936 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T01:05:38.511 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T01:05:39.461 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T01:05:39.848 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T01:05:40.236 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T01:05:40.626 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T01:05:41.021 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T01:05:41.612 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T01:05:42.210 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T01:05:43.120 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T01:05:43.618 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T01:05:44.066 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T01:05:44.500 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T01:05:44.926 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T01:05:45.354 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T01:05:45.843 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T01:05:46.318 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T01:05:46.755 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T01:05:47.212 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T01:05:47.641 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T01:05:48.239 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T01:05:48.799 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T01:05:49.415 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T01:05:49.987 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T01:05:50.525 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T01:05:51.057 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T01:05:51.773 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T01:05:52.379 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T01:05:52.993 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T01:05:53.572 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T01:05:54.212 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T01:05:54.776 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:05:55.478 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T01:05:56.188 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T01:05:56.811 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:05:57.370 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T01:05:57.933 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T01:05:58.477 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T01:05:59.183 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T01:05:59.706 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T01:06:00.307 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:06:01.047 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:06:01.548 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T01:06:02.155 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T01:06:02.697 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T01:06:13.079 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T01:06:13.631 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T01:06:23.340 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T01:06:23.991 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T01:06:24.611 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T01:06:25.006 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T01:06:25.464 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:06:25.920 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:06:26.407 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:06:26.935 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T01:06:27.397 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T01:06:27.800 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T01:06:28.265 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T01:06:28.826 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T01:06:29.285 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T01:06:29.907 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T01:06:30.479 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T01:06:30.947 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T01:06:31.432 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T01:06:32.153 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T01:06:42.846 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T01:06:43.256 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:06:43.742 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:06:44.288 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:06:44.825 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T01:06:46.221 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T01:06:46.831 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T01:06:47.877 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T01:06:51.168 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T01:06:52.144 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T01:06:56.711 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T01:07:00.579 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T01:07:00.974 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T01:07:01.598 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T01:07:14.591 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T01:07:34.908 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T01:07:37.354 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T01:07:39.975 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T01:07:41.700 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T01:07:43.062 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T01:07:43.490 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T01:07:46.769 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T01:07:50.578 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T01:08:05.994 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T01:08:08.329 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T01:08:09.927 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T01:08:11.371 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T01:08:11.949 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T01:08:16.679 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T01:08:19.263 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T01:08:19.842 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T01:08:20.697 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T01:08:25.382 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T01:08:28.219 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T01:08:32.050 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T01:08:33.386 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T01:08:33.595 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T01:08:36.550 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T01:08:39.745 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T01:08:41.585 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T01:08:44.763 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T01:08:46.219 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T01:09:20.288 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T01:09:20.504 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T01:09:21.452 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T01:09:22.210 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T01:09:22.880 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T01:09:23.701 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T01:09:23.717 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T01:09:23.717 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.717 INFO:teuthology.orchestra.run.smithi133.stdout:=============================== warnings summary =============================== 2024-09-12T01:09:23.717 INFO:teuthology.orchestra.run.smithi133.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T01:09:23.718 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T01:09:23.718 INFO:teuthology.orchestra.run.smithi133.stdout: import imp 2024-09-12T01:09:23.718 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.718 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py:120 2024-09-12T01:09:23.718 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:09:23.718 INFO:teuthology.orchestra.run.smithi133.stdout: if boto_type is 'S3Connection': 2024-09-12T01:09:23.718 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.718 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_headers.py:124 2024-09-12T01:09:23.718 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:09:23.718 INFO:teuthology.orchestra.run.smithi133.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T01:09:23.718 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.718 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3.py:359 2024-09-12T01:09:23.719 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-12T01:09:23.719 INFO:teuthology.orchestra.run.smithi133.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T01:09:23.719 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.719 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T01:09:23.719 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:09:23.719 INFO:teuthology.orchestra.run.smithi133.stdout: if k is 'BucketName': 2024-09-12T01:09:23.719 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.719 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T01:09:23.719 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T01:09:23.719 INFO:teuthology.orchestra.run.smithi133.stdout: @pytest.mark.timeout(10) 2024-09-12T01:09:23.719 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.719 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T01:09:23.720 INFO:teuthology.orchestra.run.smithi133.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T01:09:23.720 INFO:teuthology.orchestra.run.smithi133.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T01:09:23.720 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.720 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T01:09:23.720 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:23.720 INFO:teuthology.orchestra.run.smithi133.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:09:23.720 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.720 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T01:09:23.720 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:23.720 INFO:teuthology.orchestra.run.smithi133.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:09:23.720 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.721 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T01:09:23.721 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:23.721 INFO:teuthology.orchestra.run.smithi133.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T01:09:23.721 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.721 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T01:09:23.721 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:23.721 INFO:teuthology.orchestra.run.smithi133.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:09:23.721 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.721 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T01:09:23.721 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:23.721 INFO:teuthology.orchestra.run.smithi133.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:09:23.721 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.722 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T01:09:23.722 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:23.722 INFO:teuthology.orchestra.run.smithi133.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:09:23.722 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.722 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T01:09:23.722 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:23.722 INFO:teuthology.orchestra.run.smithi133.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T01:09:23.722 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.722 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T01:09:23.722 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:23.722 INFO:teuthology.orchestra.run.smithi133.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:09:23.723 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.723 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T01:09:23.723 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:23.723 INFO:teuthology.orchestra.run.smithi133.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:09:23.723 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.723 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T01:09:23.723 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:23.723 INFO:teuthology.orchestra.run.smithi133.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:09:23.723 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.723 INFO:teuthology.orchestra.run.smithi133.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T01:09:23.723 INFO:teuthology.orchestra.run.smithi133.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:09:23.723 INFO:teuthology.orchestra.run.smithi133.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:09:23.724 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:09:23.724 INFO:teuthology.orchestra.run.smithi133.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T01:09:23.724 INFO:teuthology.orchestra.run.smithi133.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 1222.54s (0:20:22) = 2024-09-12T01:09:23.843 INFO:teuthology.orchestra.run.smithi133.stdout:___________________________________ summary ____________________________________ 2024-09-12T01:09:23.843 INFO:teuthology.orchestra.run.smithi133.stdout: py: commands succeeded 2024-09-12T01:09:23.844 INFO:teuthology.orchestra.run.smithi133.stdout: congratulations :) 2024-09-12T01:09:23.862 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T01:09:23.862 DEBUG:teuthology.orchestra.run.smithi133:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:09:23.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:09:23.975 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T01:09:23.975 DEBUG:teuthology.orchestra.run.smithi133:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T01:09:24.005 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T01:09:24.006 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:09:24.200 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T01:09:24.212 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:09:24.212 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T01:09:24.212 DEBUG:teuthology.orchestra.run.smithi133:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:09:24.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:09:24.242 INFO:teuthology.orchestra.run.smithi133.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T01:09:24.242 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:09:24.311 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T01:09:24.312 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T01:09:24.381 INFO:tasks.workunit:timeout=3h 2024-09-12T01:09:24.381 INFO:tasks.workunit:cleanup=True 2024-09-12T01:09:24.382 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:09:24.450 INFO:tasks.workunit.client.0.smithi133.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T01:10:14.339 INFO:tasks.workunit.client.0.smithi133.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T01:10:14.339 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T01:10:14.340 INFO:tasks.workunit.client.0.smithi133.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:10:14.340 INFO:tasks.workunit.client.0.smithi133.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:10:14.340 INFO:tasks.workunit.client.0.smithi133.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:10:14.340 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T01:10:14.340 INFO:tasks.workunit.client.0.smithi133.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:10:14.340 INFO:tasks.workunit.client.0.smithi133.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:10:14.340 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T01:10:14.340 INFO:tasks.workunit.client.0.smithi133.stderr: git switch -c 2024-09-12T01:10:14.340 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T01:10:14.340 INFO:tasks.workunit.client.0.smithi133.stderr:Or undo this operation with: 2024-09-12T01:10:14.340 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T01:10:14.340 INFO:tasks.workunit.client.0.smithi133.stderr: git switch - 2024-09-12T01:10:14.340 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T01:10:14.341 INFO:tasks.workunit.client.0.smithi133.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:10:14.341 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T01:10:14.341 INFO:tasks.workunit.client.0.smithi133.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T01:10:14.343 DEBUG:teuthology.orchestra.run.smithi133:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T01:10:14.412 INFO:tasks.workunit.client.0.smithi133.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T01:10:14.414 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:10:14.414 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T01:10:14.462 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T01:10:14.510 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T01:10:14.549 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:10:14.551 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:10:14.551 INFO:tasks.workunit.client.0.smithi133.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T01:10:14.589 INFO:tasks.workunit.client.0.smithi133.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:10:14.593 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2024-09-12T01:10:14.593 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T01:10:14.662 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T01:10:14.663 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T01:10:14.664 DEBUG:teuthology.orchestra.run.smithi133:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:10:14.737 INFO:tasks.workunit.client.0.smithi133.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:10:14.737 INFO:tasks.workunit.client.0.smithi133.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:10:14.737 INFO:tasks.workunit.client.0.smithi133.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:10:17.127 INFO:tasks.workunit.client.0.smithi133.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T01:10:17.128 INFO:tasks.workunit.client.0.smithi133.stderr:++ deactivate nondestructive 2024-09-12T01:10:17.128 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T01:10:17.128 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T01:10:17.128 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:10:17.128 INFO:tasks.workunit.client.0.smithi133.stderr:++ hash -r 2024-09-12T01:10:17.128 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T01:10:17.128 INFO:tasks.workunit.client.0.smithi133.stderr:++ unset VIRTUAL_ENV 2024-09-12T01:10:17.128 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T01:10:17.128 INFO:tasks.workunit.client.0.smithi133.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:10:17.128 INFO:tasks.workunit.client.0.smithi133.stderr:++ export VIRTUAL_ENV 2024-09-12T01:10:17.128 INFO:tasks.workunit.client.0.smithi133.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:10:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:10:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:++ export PATH 2024-09-12T01:10:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n '' ']' 2024-09-12T01:10:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -z '' ']' 2024-09-12T01:10:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T01:10:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:++ PS1='(rgw) ' 2024-09-12T01:10:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:++ export PS1 2024-09-12T01:10:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:10:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:++ hash -r 2024-09-12T01:10:17.129 INFO:tasks.workunit.client.0.smithi133.stderr:+ pip install pip --upgrade 2024-09-12T01:10:17.353 INFO:tasks.workunit.client.0.smithi133.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T01:10:17.536 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting pip 2024-09-12T01:10:17.544 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T01:10:17.586 INFO:tasks.workunit.client.0.smithi133.stdout:Installing collected packages: pip 2024-09-12T01:10:17.587 INFO:tasks.workunit.client.0.smithi133.stdout: Attempting uninstall: pip 2024-09-12T01:10:17.587 INFO:tasks.workunit.client.0.smithi133.stdout: Found existing installation: pip 21.3.1 2024-09-12T01:10:17.738 INFO:tasks.workunit.client.0.smithi133.stdout: Uninstalling pip-21.3.1: 2024-09-12T01:10:17.743 INFO:tasks.workunit.client.0.smithi133.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T01:10:18.469 INFO:tasks.workunit.client.0.smithi133.stdout:Successfully installed pip-24.2 2024-09-12T01:10:18.520 INFO:tasks.workunit.client.0.smithi133.stderr:+ pip install boto3 2024-09-12T01:10:19.298 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting boto3 2024-09-12T01:10:19.299 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T01:10:19.883 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T01:10:19.885 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T01:10:19.939 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T01:10:19.940 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T01:10:19.994 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T01:10:19.995 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T01:10:20.046 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:10:20.047 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T01:10:20.125 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:10:20.126 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T01:10:20.326 INFO:tasks.workunit.client.0.smithi133.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:10:20.327 INFO:tasks.workunit.client.0.smithi133.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T01:10:20.331 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T01:10:20.332 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T01:10:20.342 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T01:10:20.343 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T01:10:20.344 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T01:10:20.346 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T01:10:20.347 INFO:tasks.workunit.client.0.smithi133.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T01:10:20.420 INFO:tasks.workunit.client.0.smithi133.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T01:10:21.404 INFO:tasks.workunit.client.0.smithi133.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T01:10:21.526 INFO:tasks.workunit.client.0.smithi133.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T01:10:21.649 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T01:10:21.684 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:10:21.685 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:10:21.722 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.723+0000 7f21b8d39800 20 rados->read ofs=0 len=0 2024-09-12T01:10:21.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.724+0000 7f21b8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:21.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.724+0000 7f21b8d39800 20 realm 2024-09-12T01:10:21.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.724+0000 7f21b8d39800 20 rados->read ofs=0 len=0 2024-09-12T01:10:21.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.724+0000 7f21b8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:21.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.724+0000 7f21b8d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:10:21.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.724+0000 7f21b8d39800 20 rados->read ofs=0 len=0 2024-09-12T01:10:21.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.725+0000 7f21b8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:21.724 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.725+0000 7f21b8d39800 20 rados->read ofs=0 len=0 2024-09-12T01:10:21.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.725+0000 7f21b8d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:21.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.725+0000 7f21b8d39800 20 rados->read ofs=0 len=0 2024-09-12T01:10:21.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.726+0000 7f21b8d39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:10:21.725 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.726+0000 7f21b8d39800 20 searching for the correct realm 2024-09-12T01:10:21.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.729+0000 7f21b51c8640 0 -- 172.21.15.133:0/1407876926 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f21b0034920 msgr2=0x7f21b00403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:21.933 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.934+0000 7f21b51c8640 0 -- 172.21.15.133:0/1407876926 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x563e72aa1d20 msgr2=0x563e72aa41e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:21.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T01:10:21.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T01:10:21.938 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:10:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:10:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:10:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:10:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 20 rados->read ofs=0 len=0 2024-09-12T01:10:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 20 rados->read ofs=0 len=0 2024-09-12T01:10:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 20 rados->read ofs=0 len=0 2024-09-12T01:10:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:10:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 20 zone default found 2024-09-12T01:10:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 4 Realm: () 2024-09-12T01:10:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T01:10:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T01:10:21.939 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:10:21.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 20 zonegroup default 2024-09-12T01:10:21.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.939+0000 7f21b8d39800 20 rados->read ofs=0 len=0 2024-09-12T01:10:21.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.940+0000 7f21b8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:21.940 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.940+0000 7f21b8d39800 20 rados->read ofs=0 len=0 2024-09-12T01:10:21.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.940+0000 7f21b8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:21.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.940+0000 7f21b8d39800 20 rados->read ofs=0 len=0 2024-09-12T01:10:21.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.940+0000 7f21b8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:21.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.940+0000 7f21b8d39800 20 started sync module instance, tier type = 2024-09-12T01:10:21.941 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.940+0000 7f21b8d39800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T01:10:21.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.950+0000 7f21b8d39800 20 add_watcher() i=0 2024-09-12T01:10:21.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.950+0000 7f21b8d39800 20 add_watcher() i=1 2024-09-12T01:10:21.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.950+0000 7f21b8d39800 20 add_watcher() i=2 2024-09-12T01:10:21.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.950+0000 7f21b8d39800 20 add_watcher() i=3 2024-09-12T01:10:21.949 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.950+0000 7f21b8d39800 20 add_watcher() i=4 2024-09-12T01:10:21.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.950+0000 7f21b8d39800 20 add_watcher() i=5 2024-09-12T01:10:21.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.950+0000 7f21b8d39800 20 add_watcher() i=6 2024-09-12T01:10:21.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.951+0000 7f21b8d39800 20 add_watcher() i=7 2024-09-12T01:10:21.950 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.951+0000 7f21b8d39800 2 all 8 watchers are set, enabling cache 2024-09-12T01:10:21.952 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.953+0000 7f206b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:21.953 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.954+0000 7f21b8d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:10:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.954+0000 7f21b8d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:10:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.954+0000 7f21b8d39800 5 note: GC not initialized 2024-09-12T01:10:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.954+0000 7f206a7e4640 20 reqs_thread_entry: start 2024-09-12T01:10:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.954+0000 7f21b8d39800 20 init_complete bucket index max shards: 1 2024-09-12T01:10:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.954+0000 7f21b8d39800 20 Filter name: none 2024-09-12T01:10:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.954+0000 7f2063fff640 20 reqs_thread_entry: start 2024-09-12T01:10:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.954+0000 7f21b8d39800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T01:10:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.954+0000 7f21b8d39800 20 rados->read ofs=0 len=0 2024-09-12T01:10:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.955+0000 7f21b8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.955+0000 7f21b8d39800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T01:10:21.954 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.955+0000 7f21b8d39800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:10:21.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.955+0000 7f21b8d39800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T01:10:21.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.955+0000 7f21b8d39800 20 rados->read ofs=0 len=0 2024-09-12T01:10:21.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.955+0000 7f21b8d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:21.955 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.955+0000 7f21b8d39800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T01:10:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.955+0000 7f21b8d39800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:10:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.955+0000 7f21b8d39800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:10:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.955+0000 7f21b8d39800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:10:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.956+0000 7f21b8d39800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:10:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.956+0000 7f21b8d39800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:10:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.956+0000 7f21b8d39800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T01:10:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.957+0000 7f208bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399602 cookie 94826211780688 notifier 8807 bl.length()=613 2024-09-12T01:10:21.956 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.957+0000 7f208bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:10:21.957 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.957+0000 7f208bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:10:21.959 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.960+0000 7f21b8d39800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:10:21.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.960+0000 7f21b8d39800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:10:21.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.960+0000 7f21b8d39800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T01:10:21.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.960+0000 7f208bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399603 cookie 94826211778048 notifier 8807 bl.length()=191 2024-09-12T01:10:21.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.960+0000 7f208bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:10:21.960 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.960+0000 7f208bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:10:21.962 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.963+0000 7f206b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:21.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.965+0000 7f21b8d39800 20 remove_watcher() i=0 2024-09-12T01:10:21.964 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.965+0000 7f21b8d39800 2 removed watcher, disabling cache 2024-09-12T01:10:21.965 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.966+0000 7f21b8d39800 20 remove_watcher() i=1 2024-09-12T01:10:21.966 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.967+0000 7f21b8d39800 20 remove_watcher() i=2 2024-09-12T01:10:21.967 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.968+0000 7f21b8d39800 20 remove_watcher() i=3 2024-09-12T01:10:21.969 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.970+0000 7f21b8d39800 20 remove_watcher() i=4 2024-09-12T01:10:21.970 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.971+0000 7f21b8d39800 20 remove_watcher() i=5 2024-09-12T01:10:21.971 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.972+0000 7f21b8d39800 20 remove_watcher() i=6 2024-09-12T01:10:21.972 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:21.973+0000 7f21b8d39800 20 remove_watcher() i=7 2024-09-12T01:10:22.232 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T01:10:22.233 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T01:10:22.352 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:10:22.380 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:10:22.381 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:10:22.417 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.418+0000 7f3262128800 20 rados->read ofs=0 len=0 2024-09-12T01:10:22.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.420+0000 7f3262128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:22.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.420+0000 7f3262128800 20 realm 2024-09-12T01:10:22.419 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.420+0000 7f3262128800 20 rados->read ofs=0 len=0 2024-09-12T01:10:22.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.420+0000 7f3262128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:22.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.420+0000 7f3262128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:10:22.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.420+0000 7f3262128800 20 rados->read ofs=0 len=0 2024-09-12T01:10:22.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.420+0000 7f3262128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:22.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.420+0000 7f3262128800 20 rados->read ofs=0 len=0 2024-09-12T01:10:22.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.421+0000 7f3262128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:22.420 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.421+0000 7f3262128800 20 rados->read ofs=0 len=0 2024-09-12T01:10:22.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.422+0000 7f3262128800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:10:22.421 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.422+0000 7f3262128800 20 searching for the correct realm 2024-09-12T01:10:22.423 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.424+0000 7f325e670640 0 -- 172.21.15.133:0/3077035488 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x5577768b1010 msgr2=0x5577768b3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:22.426 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.427+0000 7f3257fff640 0 -- 172.21.15.133:0/3077035488 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f325000fb70 msgr2=0x7f325002e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:22.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.633+0000 7f3262128800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T01:10:22.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.633+0000 7f3262128800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T01:10:22.634 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.633+0000 7f3262128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:10:22.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.633+0000 7f3262128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:10:22.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.633+0000 7f3262128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:10:22.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.633+0000 7f3262128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:10:22.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.633+0000 7f3262128800 20 rados->read ofs=0 len=0 2024-09-12T01:10:22.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.634+0000 7f3262128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:22.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.634+0000 7f3262128800 20 rados->read ofs=0 len=0 2024-09-12T01:10:22.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.634+0000 7f3262128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:22.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.634+0000 7f3262128800 20 rados->read ofs=0 len=0 2024-09-12T01:10:22.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.634+0000 7f3262128800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:10:22.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.634+0000 7f3262128800 20 zone default found 2024-09-12T01:10:22.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.634+0000 7f3262128800 4 Realm: () 2024-09-12T01:10:22.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.634+0000 7f3262128800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T01:10:22.635 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.634+0000 7f3262128800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T01:10:22.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.634+0000 7f3262128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:10:22.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.634+0000 7f3262128800 20 zonegroup default 2024-09-12T01:10:22.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.634+0000 7f3262128800 20 rados->read ofs=0 len=0 2024-09-12T01:10:22.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.635+0000 7f3262128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:22.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.635+0000 7f3262128800 20 rados->read ofs=0 len=0 2024-09-12T01:10:22.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.635+0000 7f3262128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:22.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.635+0000 7f3262128800 20 rados->read ofs=0 len=0 2024-09-12T01:10:22.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.635+0000 7f3262128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:22.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.635+0000 7f3262128800 20 started sync module instance, tier type = 2024-09-12T01:10:22.636 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.635+0000 7f3262128800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T01:10:22.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.645+0000 7f3262128800 20 add_watcher() i=0 2024-09-12T01:10:22.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.645+0000 7f3262128800 20 add_watcher() i=1 2024-09-12T01:10:22.644 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.645+0000 7f3262128800 20 add_watcher() i=2 2024-09-12T01:10:22.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.645+0000 7f3262128800 20 add_watcher() i=3 2024-09-12T01:10:22.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.645+0000 7f3262128800 20 add_watcher() i=4 2024-09-12T01:10:22.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.645+0000 7f3262128800 20 add_watcher() i=5 2024-09-12T01:10:22.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.645+0000 7f3262128800 20 add_watcher() i=6 2024-09-12T01:10:22.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.646+0000 7f3262128800 20 add_watcher() i=7 2024-09-12T01:10:22.645 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.646+0000 7f3262128800 2 all 8 watchers are set, enabling cache 2024-09-12T01:10:22.647 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.648+0000 7f310f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:22.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.648+0000 7f3262128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:10:22.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.648+0000 7f3262128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:10:22.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.648+0000 7f3262128800 5 note: GC not initialized 2024-09-12T01:10:22.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.648+0000 7f310e7fc640 20 reqs_thread_entry: start 2024-09-12T01:10:22.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.648+0000 7f3262128800 20 init_complete bucket index max shards: 1 2024-09-12T01:10:22.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.648+0000 7f3262128800 20 Filter name: none 2024-09-12T01:10:22.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.649+0000 7f307ffff640 20 reqs_thread_entry: start 2024-09-12T01:10:22.648 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.649+0000 7f3262128800 20 rados->read ofs=0 len=0 2024-09-12T01:10:22.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.649+0000 7f3262128800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:10:22.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.649+0000 7f3262128800 20 rados->read ofs=0 len=0 2024-09-12T01:10:22.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.650+0000 7f3262128800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:10:22.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.650+0000 7f3262128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:10:22.649 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.650+0000 7f3262128800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T01:10:22.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.650+0000 7f3262128800 20 INFO: main: starting shard=0 2024-09-12T01:10:22.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.650+0000 7f3262128800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.783.0 2024-09-12T01:10:22.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.651+0000 7f3262128800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:10:22.650 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.651+0000 7f3262128800 20 INFO: main: done 2024-09-12T01:10:22.651 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.652+0000 7f310f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:22.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.654+0000 7f3262128800 20 remove_watcher() i=0 2024-09-12T01:10:22.653 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.654+0000 7f3262128800 2 removed watcher, disabling cache 2024-09-12T01:10:22.654 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.655+0000 7f3262128800 20 remove_watcher() i=1 2024-09-12T01:10:22.655 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.656+0000 7f3262128800 20 remove_watcher() i=2 2024-09-12T01:10:22.656 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.657+0000 7f3262128800 20 remove_watcher() i=3 2024-09-12T01:10:22.657 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.658+0000 7f3262128800 20 remove_watcher() i=4 2024-09-12T01:10:22.658 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.659+0000 7f3262128800 20 remove_watcher() i=5 2024-09-12T01:10:22.660 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.660+0000 7f3262128800 20 remove_watcher() i=6 2024-09-12T01:10:22.661 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.661+0000 7f3262128800 20 remove_watcher() i=7 2024-09-12T01:10:22.673 INFO:tasks.workunit.client.0.smithi133.stderr:rados -p default.rgw.buckets.data ls | grep 452896d2-e514-43f9-a265-583efb179a02 2024-09-12T01:10:22.696 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:10:22.696 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:10:22.775 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:22.776+0000 7fd7b1a6d640 0 -- 172.21.15.133:0/3081107072 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x5575e59272c0 msgr2=0x5575e5a5e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:10:22.787 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T01:10:22.788 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T01:10:22.789 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:10:24.222 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:10:24.634 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:10:24.662 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:10:24.662 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:10:24.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.702+0000 7f2548498800 20 rados->read ofs=0 len=0 2024-09-12T01:10:24.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.704+0000 7f2548498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:24.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.704+0000 7f2548498800 20 realm 2024-09-12T01:10:24.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.704+0000 7f2548498800 20 rados->read ofs=0 len=0 2024-09-12T01:10:24.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.704+0000 7f2548498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:24.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.704+0000 7f2548498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:10:24.703 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.704+0000 7f2548498800 20 rados->read ofs=0 len=0 2024-09-12T01:10:24.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.704+0000 7f2548498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:24.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.704+0000 7f2548498800 20 rados->read ofs=0 len=0 2024-09-12T01:10:24.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.705+0000 7f2548498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:24.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.705+0000 7f2548498800 20 rados->read ofs=0 len=0 2024-09-12T01:10:24.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.706+0000 7f2548498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:10:24.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.706+0000 7f2548498800 20 searching for the correct realm 2024-09-12T01:10:24.705 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.706+0000 7f2546783640 0 -- 172.21.15.133:0/2745807840 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x5633f9f60690 msgr2=0x5633f9f62a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:24.708 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.709+0000 7f2546783640 0 -- 172.21.15.133:0/2745807840 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x5633f9d1e9f0 msgr2=0x7f25400b2030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:24.716 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.717+0000 7f2548498800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T01:10:24.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.717+0000 7f2548498800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T01:10:24.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.717+0000 7f2548498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:10:24.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.717+0000 7f2548498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:10:24.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.717+0000 7f2548498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:10:24.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.717+0000 7f2548498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:10:24.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.717+0000 7f2548498800 20 rados->read ofs=0 len=0 2024-09-12T01:10:24.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.718+0000 7f2548498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:24.717 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.718+0000 7f2548498800 20 rados->read ofs=0 len=0 2024-09-12T01:10:24.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.718+0000 7f2548498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:24.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.718+0000 7f2548498800 20 rados->read ofs=0 len=0 2024-09-12T01:10:24.718 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.718+0000 7f2548498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:10:24.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.718+0000 7f2548498800 20 zone default found 2024-09-12T01:10:24.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.718+0000 7f2548498800 4 Realm: () 2024-09-12T01:10:24.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.718+0000 7f2548498800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T01:10:24.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.718+0000 7f2548498800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T01:10:24.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.718+0000 7f2548498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:10:24.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.718+0000 7f2548498800 20 zonegroup default 2024-09-12T01:10:24.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.718+0000 7f2548498800 20 rados->read ofs=0 len=0 2024-09-12T01:10:24.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.718+0000 7f2548498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:24.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.718+0000 7f2548498800 20 rados->read ofs=0 len=0 2024-09-12T01:10:24.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.719+0000 7f2548498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:24.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.719+0000 7f2548498800 20 rados->read ofs=0 len=0 2024-09-12T01:10:24.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.719+0000 7f2548498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:24.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.719+0000 7f2548498800 20 started sync module instance, tier type = 2024-09-12T01:10:24.719 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.719+0000 7f2548498800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T01:10:24.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.729+0000 7f2548498800 20 add_watcher() i=0 2024-09-12T01:10:24.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.729+0000 7f2548498800 20 add_watcher() i=1 2024-09-12T01:10:24.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.729+0000 7f2548498800 20 add_watcher() i=2 2024-09-12T01:10:24.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.729+0000 7f2548498800 20 add_watcher() i=3 2024-09-12T01:10:24.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.729+0000 7f2548498800 20 add_watcher() i=4 2024-09-12T01:10:24.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.729+0000 7f2548498800 20 add_watcher() i=5 2024-09-12T01:10:24.728 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.729+0000 7f2548498800 20 add_watcher() i=6 2024-09-12T01:10:24.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.730+0000 7f2548498800 20 add_watcher() i=7 2024-09-12T01:10:24.729 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.730+0000 7f2548498800 2 all 8 watchers are set, enabling cache 2024-09-12T01:10:24.731 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.732+0000 7f23f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:24.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.732+0000 7f2548498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:10:24.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.732+0000 7f2548498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:10:24.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.732+0000 7f2548498800 5 note: GC not initialized 2024-09-12T01:10:24.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.732+0000 7f23f67fc640 20 reqs_thread_entry: start 2024-09-12T01:10:24.732 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.732+0000 7f2548498800 20 init_complete bucket index max shards: 1 2024-09-12T01:10:24.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.732+0000 7f2548498800 20 Filter name: none 2024-09-12T01:10:24.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.732+0000 7f236bfff640 20 reqs_thread_entry: start 2024-09-12T01:10:24.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.733+0000 7f2548498800 20 rados->read ofs=0 len=0 2024-09-12T01:10:24.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.733+0000 7f2548498800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:10:24.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.733+0000 7f2548498800 20 rados->read ofs=0 len=0 2024-09-12T01:10:24.733 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.733+0000 7f2548498800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:10:24.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.733+0000 7f2548498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:10:24.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.733+0000 7f2548498800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T01:10:24.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.733+0000 7f2548498800 20 INFO: main: starting shard=0 2024-09-12T01:10:24.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.733+0000 7f2548498800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.783.0 2024-09-12T01:10:24.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.734+0000 7f2548498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:10:24.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.734+0000 7f2548498800 20 INFO: main: done 2024-09-12T01:10:24.734 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.735+0000 7f23f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:24.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.737+0000 7f2548498800 20 remove_watcher() i=0 2024-09-12T01:10:24.736 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.737+0000 7f2548498800 2 removed watcher, disabling cache 2024-09-12T01:10:24.737 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.738+0000 7f2548498800 20 remove_watcher() i=1 2024-09-12T01:10:24.738 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.739+0000 7f2548498800 20 remove_watcher() i=2 2024-09-12T01:10:24.739 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.740+0000 7f2548498800 20 remove_watcher() i=3 2024-09-12T01:10:24.740 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.741+0000 7f2548498800 20 remove_watcher() i=4 2024-09-12T01:10:24.741 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.742+0000 7f2548498800 20 remove_watcher() i=5 2024-09-12T01:10:24.742 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.743+0000 7f2548498800 20 remove_watcher() i=6 2024-09-12T01:10:24.743 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:24.744+0000 7f2548498800 20 remove_watcher() i=7 2024-09-12T01:10:24.755 INFO:tasks.workunit.client.0.smithi133.stderr:rados -p default.rgw.buckets.data ls | grep 65e3c905-c744-4551-8e54-3d577909807d 2024-09-12T01:10:24.779 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:10:24.779 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:10:25.062 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:25.063+0000 7f0d2da04640 0 -- 172.21.15.133:0/2132168938 >> [v2:172.21.15.160:6810/170425375,v1:172.21.15.160:6811/170425375] conn(0x7f0d180153d0 msgr2=0x7f0d180157b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:25.073 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T01:10:25.074 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T01:10:25.192 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:10:26.685 INFO:tasks.workunit.client.0.smithi133.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T01:10:26.687 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:10:27.147 INFO:tasks.workunit.client.0.smithi133.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T01:10:27.147 INFO:tasks.workunit.client.0.smithi133.stderr: 2024-09-12T01:10:27.308 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T01:10:30.791 INFO:tasks.workunit.client.0.smithi133.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T01:10:31.188 INFO:tasks.workunit.client.0.smithi133.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T01:10:31.218 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:10:31.218 INFO:tasks.workunit.client.0.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:10:31.255 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.256+0000 7f1f42f26800 20 rados->read ofs=0 len=0 2024-09-12T01:10:31.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.258+0000 7f1f42f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:31.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.258+0000 7f1f42f26800 20 realm 2024-09-12T01:10:31.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.258+0000 7f1f42f26800 20 rados->read ofs=0 len=0 2024-09-12T01:10:31.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.258+0000 7f1f42f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:31.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.258+0000 7f1f42f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:10:31.257 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.258+0000 7f1f42f26800 20 rados->read ofs=0 len=0 2024-09-12T01:10:31.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.258+0000 7f1f42f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:31.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.258+0000 7f1f42f26800 20 rados->read ofs=0 len=0 2024-09-12T01:10:31.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.259+0000 7f1f42f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:31.258 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.259+0000 7f1f42f26800 20 rados->read ofs=0 len=0 2024-09-12T01:10:31.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.260+0000 7f1f42f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:10:31.259 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.260+0000 7f1f42f26800 20 searching for the correct realm 2024-09-12T01:10:31.262 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.262+0000 7f1f3f35e640 0 -- 172.21.15.133:0/2067659758 >> [v2:172.21.15.160:6800/2429451477,v1:172.21.15.160:6801/2429451477] conn(0x7f1f38081070 msgr2=0x7f1f3808e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:31.468 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.468+0000 7f1f3e35c640 0 -- 172.21.15.133:0/2067659758 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7f1f300608a0 msgr2=0x7f1f3005f310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:31.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.675+0000 7f1f42f26800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T01:10:31.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.675+0000 7f1f42f26800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T01:10:31.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.675+0000 7f1f42f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:10:31.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.675+0000 7f1f42f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:10:31.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.675+0000 7f1f42f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:10:31.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.675+0000 7f1f42f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:10:31.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.675+0000 7f1f42f26800 20 rados->read ofs=0 len=0 2024-09-12T01:10:31.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.675+0000 7f1f42f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:31.677 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.675+0000 7f1f42f26800 20 rados->read ofs=0 len=0 2024-09-12T01:10:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.676+0000 7f1f42f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.676+0000 7f1f42f26800 20 rados->read ofs=0 len=0 2024-09-12T01:10:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.676+0000 7f1f42f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:10:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.676+0000 7f1f42f26800 20 zone default found 2024-09-12T01:10:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.676+0000 7f1f42f26800 4 Realm: () 2024-09-12T01:10:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.676+0000 7f1f42f26800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T01:10:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.676+0000 7f1f42f26800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T01:10:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.676+0000 7f1f42f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:10:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.676+0000 7f1f42f26800 20 zonegroup default 2024-09-12T01:10:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.676+0000 7f1f42f26800 20 rados->read ofs=0 len=0 2024-09-12T01:10:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.676+0000 7f1f42f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.676+0000 7f1f42f26800 20 rados->read ofs=0 len=0 2024-09-12T01:10:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.677+0000 7f1f42f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.677+0000 7f1f42f26800 20 rados->read ofs=0 len=0 2024-09-12T01:10:31.678 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.677+0000 7f1f42f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:31.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.677+0000 7f1f42f26800 20 started sync module instance, tier type = 2024-09-12T01:10:31.679 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.677+0000 7f1f42f26800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T01:10:31.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.687+0000 7f1f42f26800 20 add_watcher() i=0 2024-09-12T01:10:31.686 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.687+0000 7f1f42f26800 20 add_watcher() i=1 2024-09-12T01:10:31.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.687+0000 7f1f42f26800 20 add_watcher() i=2 2024-09-12T01:10:31.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.687+0000 7f1f42f26800 20 add_watcher() i=3 2024-09-12T01:10:31.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.687+0000 7f1f42f26800 20 add_watcher() i=4 2024-09-12T01:10:31.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.687+0000 7f1f42f26800 20 add_watcher() i=5 2024-09-12T01:10:31.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.687+0000 7f1f42f26800 20 add_watcher() i=6 2024-09-12T01:10:31.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.688+0000 7f1f42f26800 20 add_watcher() i=7 2024-09-12T01:10:31.687 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.688+0000 7f1f42f26800 2 all 8 watchers are set, enabling cache 2024-09-12T01:10:31.689 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.690+0000 7f1df57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:31.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.691+0000 7f1f42f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:10:31.690 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.691+0000 7f1f42f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:10:31.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.691+0000 7f1f42f26800 5 note: GC not initialized 2024-09-12T01:10:31.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.691+0000 7f1d6ffff640 20 reqs_thread_entry: start 2024-09-12T01:10:31.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.691+0000 7f1f42f26800 20 init_complete bucket index max shards: 1 2024-09-12T01:10:31.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.691+0000 7f1f42f26800 20 Filter name: none 2024-09-12T01:10:31.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.691+0000 7f1d6dffb640 20 reqs_thread_entry: start 2024-09-12T01:10:31.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.691+0000 7f1f42f26800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T01:10:31.691 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.691+0000 7f1f42f26800 20 rados->read ofs=0 len=0 2024-09-12T01:10:31.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.692+0000 7f1f42f26800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:10:31.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.692+0000 7f1f42f26800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T01:10:31.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.692+0000 7f1f42f26800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T01:10:31.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.692+0000 7f1f42f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.783 : miss 2024-09-12T01:10:31.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.692+0000 7f1f42f26800 20 rados->read ofs=0 len=0 2024-09-12T01:10:31.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.692+0000 7f1f42f26800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:10:31.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.693+0000 7f1f42f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.783 info.flags=0x17 2024-09-12T01:10:31.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.693+0000 7f1f42f26800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.783 to cache LRU end 2024-09-12T01:10:31.692 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.693+0000 7f1f42f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:10:31.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.693+0000 7f1f42f26800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T01:10:31.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.693+0000 7f1f42f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.783 2024-09-12T01:10:31.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.693+0000 7f1f42f26800 20 bucket index object: :.dir.dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.783.0 2024-09-12T01:10:31.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.693+0000 7f1f42f26800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T01:10:31.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.693+0000 7f1f42f26800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T01:10:31.693 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.694+0000 7f1df57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:31.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.697+0000 7f1f42f26800 20 remove_watcher() i=0 2024-09-12T01:10:31.696 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.697+0000 7f1f42f26800 2 removed watcher, disabling cache 2024-09-12T01:10:31.697 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.698+0000 7f1f42f26800 20 remove_watcher() i=1 2024-09-12T01:10:31.698 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.699+0000 7f1f42f26800 20 remove_watcher() i=2 2024-09-12T01:10:31.699 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.700+0000 7f1f42f26800 20 remove_watcher() i=3 2024-09-12T01:10:31.700 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.701+0000 7f1f42f26800 20 remove_watcher() i=4 2024-09-12T01:10:31.701 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.702+0000 7f1f42f26800 20 remove_watcher() i=5 2024-09-12T01:10:31.702 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.703+0000 7f1f42f26800 20 remove_watcher() i=6 2024-09-12T01:10:31.704 INFO:tasks.workunit.client.0.smithi133.stderr:2024-09-12T01:10:31.705+0000 7f1f42f26800 20 remove_watcher() i=7 2024-09-12T01:10:31.715 INFO:tasks.workunit.client.0.smithi133.stderr:Deleting bucket versioning-bucket 2024-09-12T01:10:31.818 INFO:tasks.workunit.client.0.smithi133.stderr:Completed bucket versioning tests 2024-09-12T01:10:31.818 INFO:tasks.workunit.client.0.smithi133.stdout:connected to http://localhost:80 2024-09-12T01:10:31.877 INFO:tasks.workunit.client.0.smithi133.stderr:+ deactivate 2024-09-12T01:10:31.878 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T01:10:31.878 INFO:tasks.workunit.client.0.smithi133.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:10:31.878 INFO:tasks.workunit.client.0.smithi133.stderr:+ export PATH 2024-09-12T01:10:31.878 INFO:tasks.workunit.client.0.smithi133.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T01:10:31.878 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n '' ']' 2024-09-12T01:10:31.878 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:10:31.878 INFO:tasks.workunit.client.0.smithi133.stderr:+ hash -r 2024-09-12T01:10:31.878 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' -n '' ']' 2024-09-12T01:10:31.878 INFO:tasks.workunit.client.0.smithi133.stderr:+ unset VIRTUAL_ENV 2024-09-12T01:10:31.878 INFO:tasks.workunit.client.0.smithi133.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T01:10:31.878 INFO:tasks.workunit.client.0.smithi133.stderr:+ unset -f deactivate 2024-09-12T01:10:31.878 INFO:tasks.workunit.client.0.smithi133.stderr:+ echo OK. 2024-09-12T01:10:31.879 INFO:tasks.workunit.client.0.smithi133.stdout:OK. 2024-09-12T01:10:31.880 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T01:10:31.880 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:10:31.961 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T01:10:31.961 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T01:10:32.332 DEBUG:teuthology.parallel:result is None 2024-09-12T01:10:32.333 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:10:32.371 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:10:32.371 DEBUG:teuthology.orchestra.run.smithi133:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:10:32.440 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:10:32.441 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T01:10:32.455 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T01:10:32.576 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T01:10:32.576 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T01:10:32.576 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T01:10:32.640 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T01:10:32.641 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T01:10:32.698 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:10:32.698 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:10:32.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.733+0000 7fc05962f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:32.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.734+0000 7fc05962f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:32.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.734+0000 7fc05962f800 20 realm 2024-09-12T01:10:32.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.734+0000 7fc05962f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:32.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.735+0000 7fc05962f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:32.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.735+0000 7fc05962f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:10:32.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.735+0000 7fc05962f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:32.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.735+0000 7fc05962f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:32.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.735+0000 7fc05962f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:32.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.736+0000 7fc05962f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:32.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.736+0000 7fc05962f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:32.735 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.736+0000 7fc05962f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:10:32.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.736+0000 7fc05962f800 20 searching for the correct realm 2024-09-12T01:10:32.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.739+0000 7fc04e918640 0 -- 172.21.15.133:0/3224597738 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7fc040016970 msgr2=0x7fc04003c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:32.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.742+0000 7fc04e918640 0 -- 172.21.15.133:0/3224597738 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7fc04807ac20 msgr2=0x7fc04808f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:32.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.949+0000 7fc05962f800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T01:10:32.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.949+0000 7fc05962f800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T01:10:32.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.949+0000 7fc05962f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:10:32.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.949+0000 7fc05962f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:10:32.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.949+0000 7fc05962f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:10:32.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.949+0000 7fc05962f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:10:32.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.949+0000 7fc05962f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:32.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.950+0000 7fc05962f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:32.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.950+0000 7fc05962f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:32.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.950+0000 7fc05962f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:32.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.950+0000 7fc05962f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:32.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.950+0000 7fc05962f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:10:32.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.950+0000 7fc05962f800 20 zone default found 2024-09-12T01:10:32.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.950+0000 7fc05962f800 4 Realm: () 2024-09-12T01:10:32.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.950+0000 7fc05962f800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T01:10:32.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.950+0000 7fc05962f800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T01:10:32.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.950+0000 7fc05962f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:10:32.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.950+0000 7fc05962f800 20 zonegroup default 2024-09-12T01:10:32.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.950+0000 7fc05962f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:32.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.951+0000 7fc05962f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:32.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.951+0000 7fc05962f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:32.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.951+0000 7fc05962f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:32.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.951+0000 7fc05962f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:32.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.952+0000 7fc05962f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:32.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.952+0000 7fc05962f800 20 started sync module instance, tier type = 2024-09-12T01:10:32.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.952+0000 7fc05962f800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T01:10:32.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.961+0000 7fc05962f800 20 add_watcher() i=0 2024-09-12T01:10:32.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.961+0000 7fc05962f800 20 add_watcher() i=1 2024-09-12T01:10:32.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.961+0000 7fc05962f800 20 add_watcher() i=2 2024-09-12T01:10:32.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.961+0000 7fc05962f800 20 add_watcher() i=3 2024-09-12T01:10:32.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.961+0000 7fc05962f800 20 add_watcher() i=4 2024-09-12T01:10:32.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.961+0000 7fc05962f800 20 add_watcher() i=5 2024-09-12T01:10:32.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.961+0000 7fc05962f800 20 add_watcher() i=6 2024-09-12T01:10:32.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.963+0000 7fc05962f800 20 add_watcher() i=7 2024-09-12T01:10:32.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.963+0000 7fc05962f800 2 all 8 watchers are set, enabling cache 2024-09-12T01:10:32.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.964+0000 7fbf0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:32.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.964+0000 7fc05962f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:10:32.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:32.964+0000 7fc05962f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:10:33.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.001+0000 7fbf0cfe1640 20 reqs_thread_entry: start 2024-09-12T01:10:33.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.001+0000 7fc05962f800 20 init_complete bucket index max shards: 1 2024-09-12T01:10:33.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.001+0000 7fc05962f800 20 Filter name: none 2024-09-12T01:10:33.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.001+0000 7fbe867fc640 20 reqs_thread_entry: start 2024-09-12T01:10:33.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.001+0000 7fc05962f800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T01:10:33.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.001+0000 7fc05962f800 20 rados->read ofs=0 len=0 2024-09-12T01:10:33.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.001+0000 7fc05962f800 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T01:10:33.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.001+0000 7fc05962f800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T01:10:33.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.001+0000 7fc05962f800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T01:10:33.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.001+0000 7fc05962f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:10:33.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.002+0000 7fc05962f800 10 removing key index: IRIGVXECCHGZAUSQZZQH 2024-09-12T01:10:33.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.003+0000 7fc05962f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:IRIGVXECCHGZAUSQZZQH, ofs0, ns] 2024-09-12T01:10:33.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.003+0000 7fbf3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400346 cookie 94249588566608 notifier 9612 bl.length()=170 2024-09-12T01:10:33.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.005+0000 7fc05962f800 10 removing email index: tester.client.0_test@test.test 2024-09-12T01:10:33.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.006+0000 7fc05962f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T01:10:33.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.006+0000 7fbf3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576400347 cookie 94249588566608 notifier 9612 bl.length()=181 2024-09-12T01:10:33.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.007+0000 7fc05962f800 10 removing user buckets index 2024-09-12T01:10:33.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.009+0000 7fc05962f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T01:10:33.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.009+0000 7fbf3a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399611 cookie 94249588577808 notifier 9612 bl.length()=172 2024-09-12T01:10:33.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.010+0000 7fc05962f800 10 removing user index: tester.client.0 2024-09-12T01:10:33.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.011+0000 7fc05962f800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T01:10:33.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.011+0000 7fc05962f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T01:10:33.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.011+0000 7fbf3a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399612 cookie 94249588575712 notifier 9612 bl.length()=164 2024-09-12T01:10:33.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.014+0000 7fbf0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:33.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.016+0000 7fc05962f800 20 remove_watcher() i=0 2024-09-12T01:10:33.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.016+0000 7fc05962f800 2 removed watcher, disabling cache 2024-09-12T01:10:33.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.017+0000 7fc05962f800 20 remove_watcher() i=1 2024-09-12T01:10:33.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.018+0000 7fc05962f800 20 remove_watcher() i=2 2024-09-12T01:10:33.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.019+0000 7fc05962f800 20 remove_watcher() i=3 2024-09-12T01:10:33.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.020+0000 7fc05962f800 20 remove_watcher() i=4 2024-09-12T01:10:33.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.022+0000 7fc05962f800 20 remove_watcher() i=5 2024-09-12T01:10:33.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.023+0000 7fc05962f800 20 remove_watcher() i=6 2024-09-12T01:10:33.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:33.024+0000 7fc05962f800 20 remove_watcher() i=7 2024-09-12T01:10:33.034 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T01:10:33.043 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T01:10:33.053 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T01:10:33.110 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T01:10:33.120 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T01:10:33.120 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:10:33.129 INFO:tasks.rgw.client.0.smithi133.stdout:2024-09-12T01:10:33.125+0000 f874640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 46768) UID: 0 2024-09-12T01:10:33.129 INFO:tasks.rgw.client.0.smithi133.stdout:2024-09-12T01:10:33.128+0000 a1be240 -1 shutting down 2024-09-12T01:10:52.279 INFO:tasks.rgw.client.0.smithi133.stderr:==00:00:58:03.294 46771== could not unlink /tmp/vgdb-pipe-from-vgdb-to-46771-by-root-on-??? 2024-09-12T01:10:52.279 INFO:tasks.rgw.client.0.smithi133.stderr:==00:00:58:03.294 46771== could not unlink /tmp/vgdb-pipe-to-vgdb-from-46771-by-root-on-??? 2024-09-12T01:10:52.279 INFO:tasks.rgw.client.0.smithi133.stderr:==00:00:58:03.294 46771== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-46771-by-root-on-??? 2024-09-12T01:10:53.201 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-12T01:10:57.525 INFO:tasks.rgw.client.0:Stopped 2024-09-12T01:10:57.526 DEBUG:teuthology.orchestra.run.smithi133:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T01:10:57.562 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T01:10:57.644 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T01:10:57.725 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T01:10:57.725 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T01:10:57.725 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T01:10:57.824 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:10:57.824 INFO:teuthology.orchestra.run.smithi133.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:10:57.858 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.859+0000 7ff8fac0e800 20 rados->read ofs=0 len=0 2024-09-12T01:10:57.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.861+0000 7ff8fac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:57.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.861+0000 7ff8fac0e800 20 realm 2024-09-12T01:10:57.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.861+0000 7ff8fac0e800 20 rados->read ofs=0 len=0 2024-09-12T01:10:57.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.861+0000 7ff8fac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:57.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.861+0000 7ff8fac0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:10:57.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.861+0000 7ff8fac0e800 20 rados->read ofs=0 len=0 2024-09-12T01:10:57.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.861+0000 7ff8fac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:57.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.861+0000 7ff8fac0e800 20 rados->read ofs=0 len=0 2024-09-12T01:10:57.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.862+0000 7ff8fac0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:57.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.862+0000 7ff8fac0e800 20 rados->read ofs=0 len=0 2024-09-12T01:10:57.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.863+0000 7ff8fac0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:10:57.862 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.863+0000 7ff8fac0e800 20 searching for the correct realm 2024-09-12T01:10:57.863 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.864+0000 7ff8f636b640 0 -- 172.21.15.133:0/840329185 >> [v2:172.21.15.160:6826/253795424,v1:172.21.15.160:6827/253795424] conn(0x5621d3b50a70 msgr2=0x5621d3b52f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:57.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.867+0000 7ff8edb6a640 0 -- 172.21.15.133:0/840329185 >> [v2:172.21.15.133:6824/186004193,v1:172.21.15.133:6825/186004193] conn(0x5621d3b54cf0 msgr2=0x5621d3b57100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.874+0000 7ff8fac0e800 20 RGWRados::pool_iterate: got zone_info.dc288c8f-59ac-48eb-bf10-42b042d6f57a 2024-09-12T01:10:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.874+0000 7ff8fac0e800 20 RGWRados::pool_iterate: got zonegroup_info.de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e 2024-09-12T01:10:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.874+0000 7ff8fac0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:10:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.874+0000 7ff8fac0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:10:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.874+0000 7ff8fac0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:10:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.874+0000 7ff8fac0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:10:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.874+0000 7ff8fac0e800 20 rados->read ofs=0 len=0 2024-09-12T01:10:57.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.874+0000 7ff8fac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:57.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.874+0000 7ff8fac0e800 20 rados->read ofs=0 len=0 2024-09-12T01:10:57.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.875+0000 7ff8fac0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:10:57.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.875+0000 7ff8fac0e800 20 rados->read ofs=0 len=0 2024-09-12T01:10:57.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.875+0000 7ff8fac0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:10:57.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.875+0000 7ff8fac0e800 20 zone default found 2024-09-12T01:10:57.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.875+0000 7ff8fac0e800 4 Realm: () 2024-09-12T01:10:57.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.875+0000 7ff8fac0e800 4 ZoneGroup: default (de5ca27e-e9d3-43a6-a0cd-f5ea69cafa9e) 2024-09-12T01:10:57.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.875+0000 7ff8fac0e800 4 Zone: default (dc288c8f-59ac-48eb-bf10-42b042d6f57a) 2024-09-12T01:10:57.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.875+0000 7ff8fac0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:10:57.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.875+0000 7ff8fac0e800 20 zonegroup default 2024-09-12T01:10:57.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.875+0000 7ff8fac0e800 20 rados->read ofs=0 len=0 2024-09-12T01:10:57.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.875+0000 7ff8fac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:57.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.875+0000 7ff8fac0e800 20 rados->read ofs=0 len=0 2024-09-12T01:10:57.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.875+0000 7ff8fac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:57.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.875+0000 7ff8fac0e800 20 rados->read ofs=0 len=0 2024-09-12T01:10:57.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.876+0000 7ff8fac0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:10:57.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.876+0000 7ff8fac0e800 20 started sync module instance, tier type = 2024-09-12T01:10:57.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.876+0000 7ff8fac0e800 20 started zone id=dc288c8f-59ac-48eb-bf10-42b042d6f57a (name=default) with tier type = 2024-09-12T01:10:57.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.885+0000 7ff8fac0e800 20 add_watcher() i=0 2024-09-12T01:10:57.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.885+0000 7ff8fac0e800 20 add_watcher() i=1 2024-09-12T01:10:57.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.885+0000 7ff8fac0e800 20 add_watcher() i=2 2024-09-12T01:10:57.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.885+0000 7ff8fac0e800 20 add_watcher() i=3 2024-09-12T01:10:57.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.885+0000 7ff8fac0e800 20 add_watcher() i=4 2024-09-12T01:10:57.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.885+0000 7ff8fac0e800 20 add_watcher() i=5 2024-09-12T01:10:57.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.885+0000 7ff8fac0e800 20 add_watcher() i=6 2024-09-12T01:10:57.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.886+0000 7ff8fac0e800 20 add_watcher() i=7 2024-09-12T01:10:57.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.886+0000 7ff8fac0e800 2 all 8 watchers are set, enabling cache 2024-09-12T01:10:57.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.889+0000 7ff7acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:10:57.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.889+0000 7ff8fac0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:10:57.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.889+0000 7ff8fac0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:10:57.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.925+0000 7ff7277fe640 20 reqs_thread_entry: start 2024-09-12T01:10:57.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.925+0000 7ff8fac0e800 20 init_complete bucket index max shards: 1 2024-09-12T01:10:57.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.925+0000 7ff8fac0e800 20 Filter name: none 2024-09-12T01:10:57.925 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.925+0000 7ff7257fa640 20 reqs_thread_entry: start 2024-09-12T01:10:57.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.925+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:10:57.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.927+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:57.926 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.928+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:57.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48486' 2024-09-12T01:10:57.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9944354895887800511', time=2024-09-12T02:49:44.865368+0000, chain.objs.size()=1 2024-09-12T01:10:57.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.184__shadow_.je0PjtMOltSEIAWMtvz1G1b7o2YqVmG_0 2024-09-12T01:10:57.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~qwqZUzK18rknv5V18ZDKNwquSFkCab1', time=2024-09-12T02:50:01.292268+0000, chain.objs.size()=1 2024-09-12T01:10:57.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.203__multipart_mymultipart.2~qwqZUzK18rknv5V18ZDKNwquSFkCab1.1 2024-09-12T01:10:57.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2517263789943150222', time=2024-09-12T02:51:32.388988+0000, chain.objs.size()=1 2024-09-12T01:10:57.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.242__shadow_._hAgA_H6lTpssTyqeFTbY1-ojVtwPW-_0 2024-09-12T01:10:57.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11962540652125889860', time=2024-09-12T02:51:32.393967+0000, chain.objs.size()=1 2024-09-12T01:10:57.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.242__shadow_.j8zaGYC16yYlF9PjGuf0IrVGxwEU9ZG_0 2024-09-12T01:10:57.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17852040533497388306', time=2024-09-12T02:51:37.706239+0000, chain.objs.size()=1 2024-09-12T01:10:57.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.250__shadow_.1QzzJqudaPVKgOCqNJ5ID23lqLGyBbB_0 2024-09-12T01:10:57.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7841803463353176641', time=2024-09-12T02:51:41.955115+0000, chain.objs.size()=1 2024-09-12T01:10:57.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.257__shadow_.VnEnJXrRX5TS1uuTQGDqb5miWlJ0-kr_0 2024-09-12T01:10:57.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9351602239577027886', time=2024-09-12T02:51:41.960356+0000, chain.objs.size()=1 2024-09-12T01:10:57.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.257__shadow_.NNi22mcRyD82tFaZ40HEwe579ym9dSF_0 2024-09-12T01:10:57.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3102448038324450268', time=2024-09-12T02:51:43.082926+0000, chain.objs.size()=1 2024-09-12T01:10:57.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.259__shadow_.xNuNQN2MKUV2BJrZO4UzU5sZnmb5a8T_0 2024-09-12T01:10:57.930 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11719452800723340396', time=2024-09-12T02:52:21.600490+0000, chain.objs.size()=1 2024-09-12T01:10:57.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.w50OxyLfrqeRf9vehwohWckgs9GTNs6_0 2024-09-12T01:10:57.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16717485841661624504', time=2024-09-12T02:52:21.764714+0000, chain.objs.size()=1 2024-09-12T01:10:57.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.WSNnAX0L1Uv2ppM3awtzEGVLFzJRNzX_0 2024-09-12T01:10:57.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.318420865913136596', time=2024-09-12T02:52:22.052063+0000, chain.objs.size()=1 2024-09-12T01:10:57.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.6jHfOx17wNuD61eOSJNy0WNIDersFL7_0 2024-09-12T01:10:57.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4250876497922644154', time=2024-09-12T02:52:22.757628+0000, chain.objs.size()=1 2024-09-12T01:10:57.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.929+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Xyy1OrpepgRDCx0kQn7eipQ6qMUt1eV_0 2024-09-12T01:10:57.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.932+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7983343661281250112', time=2024-09-12T02:52:22.891497+0000, chain.objs.size()=1 2024-09-12T01:10:57.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.932+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.RyfLpPGQP-ChZRt_T7IroVGh5z903Pb_0 2024-09-12T01:10:57.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.932+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7455226924583932833', time=2024-09-12T02:52:23.119221+0000, chain.objs.size()=1 2024-09-12T01:10:57.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.932+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.FRUVjh8uxuh0UkG5cSFIA_VD-PXA6y6_0 2024-09-12T01:10:57.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.932+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5445313241306282826', time=2024-09-12T02:52:23.262126+0000, chain.objs.size()=1 2024-09-12T01:10:57.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.932+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vF5N0sTZvhUAaEg9ITHfbo9htdgPF2B_0 2024-09-12T01:10:57.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9194318320686953314', time=2024-09-12T02:52:23.456107+0000, chain.objs.size()=1 2024-09-12T01:10:57.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.YSD1mxxOdKr03M8Z2UZIXzcM_WV7dKL_0 2024-09-12T01:10:57.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17988602885505117953', time=2024-09-12T02:52:23.653928+0000, chain.objs.size()=1 2024-09-12T01:10:57.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Fi97wC9pchd0PbZEY4pj66LqTGYbHAn_0 2024-09-12T01:10:57.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12038502523489163500', time=2024-09-12T02:52:24.217856+0000, chain.objs.size()=1 2024-09-12T01:10:57.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Ix_6e8JaN5qdKd-SbsSODttGnf5BQUm_0 2024-09-12T01:10:57.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14702092336380208764', time=2024-09-12T02:52:24.511353+0000, chain.objs.size()=1 2024-09-12T01:10:57.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.bGcYEmLU5Fy-XKMboFIBF4NQ4XR22qU_0 2024-09-12T01:10:57.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8732117815455714510', time=2024-09-12T02:52:24.648797+0000, chain.objs.size()=1 2024-09-12T01:10:57.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.934+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.LUn-vkULp1EJZd45gsLz_m_wnWNr4NB_0 2024-09-12T01:10:57.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.934+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14020054170429828749', time=2024-09-12T02:52:24.829669+0000, chain.objs.size()=1 2024-09-12T01:10:57.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.934+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.S-HGYnOBFqa8DI5MPOC3uAFxIv-pk7e_0 2024-09-12T01:10:57.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.934+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17767202735668763095', time=2024-09-12T02:52:24.897093+0000, chain.objs.size()=1 2024-09-12T01:10:57.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.934+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.c9JJRyhXbgOG6T6uvs3YucOpq-IpCxD_0 2024-09-12T01:10:57.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.934+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12614630137536992931', time=2024-09-12T02:52:26.276889+0000, chain.objs.size()=1 2024-09-12T01:10:57.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.934+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Q8qWCSqwPveMHVj8VW4PCBjbu6UTomV_0 2024-09-12T01:10:57.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.936+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9463601414829316950', time=2024-09-12T02:52:26.277416+0000, chain.objs.size()=1 2024-09-12T01:10:57.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.936+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.6mRGgH1_UIAPgOqEwuW6UbbbRV4plTa_0 2024-09-12T01:10:57.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.936+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11038313619265145206', time=2024-09-12T02:52:26.485568+0000, chain.objs.size()=1 2024-09-12T01:10:57.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.936+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.W2TNr08wBFTx7SBn1IUxUATErNvIDbZ_0 2024-09-12T01:10:57.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6974946522842758807', time=2024-09-12T02:52:26.511195+0000, chain.objs.size()=1 2024-09-12T01:10:57.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.MMze8EZa8sXnBLDHsanNiMLK18DP4SS_0 2024-09-12T01:10:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9126201912729095142', time=2024-09-12T02:52:27.604205+0000, chain.objs.size()=1 2024-09-12T01:10:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.aOyBuFb698raUE0bw5Pqx3YuugTbppQ_0 2024-09-12T01:10:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3883143942767031133', time=2024-09-12T02:52:27.638248+0000, chain.objs.size()=1 2024-09-12T01:10:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.B5t9L3lPTxeqE7WTEDQa58JF3SKXaDI_0 2024-09-12T01:10:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12088663171200772115', time=2024-09-12T02:52:27.938936+0000, chain.objs.size()=1 2024-09-12T01:10:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.OJS_jjdT5CtfCIPMiVpyB4zP_GfhJgT_0 2024-09-12T01:10:57.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11232780492733469318', time=2024-09-12T02:52:28.809353+0000, chain.objs.size()=1 2024-09-12T01:10:57.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.HHZ87oqa5gq0948dPxhSTNBgvDTzyyE_0 2024-09-12T01:10:57.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14704714172438434558', time=2024-09-12T02:52:29.188841+0000, chain.objs.size()=1 2024-09-12T01:10:57.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.UjK4T0WEF-JKx9MeP7GZU-slgRtsWoQ_0 2024-09-12T01:10:57.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.922115580350231070', time=2024-09-12T02:52:30.014337+0000, chain.objs.size()=1 2024-09-12T01:10:57.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.WG_a1zeaFmX7GPyLswZXeXQeFCfRjOo_0 2024-09-12T01:10:57.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1281057737541017345', time=2024-09-12T02:52:30.117288+0000, chain.objs.size()=1 2024-09-12T01:10:57.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1arGiaBzv7vxcfRRAvPiyPgAYD8Ezaa_0 2024-09-12T01:10:57.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8160969080275963602', time=2024-09-12T02:52:30.144980+0000, chain.objs.size()=1 2024-09-12T01:10:57.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.j6C_xIf6P4NsRyi2BkFklOXlh1C2InY_0 2024-09-12T01:10:57.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.940+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1333803045930493065', time=2024-09-12T02:52:30.145466+0000, chain.objs.size()=1 2024-09-12T01:10:57.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.940+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.GMihBE-vNaobAuUvCrk-Z6c1RUffi8S_0 2024-09-12T01:10:57.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.941+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11635940042886807010', time=2024-09-12T02:52:30.145906+0000, chain.objs.size()=1 2024-09-12T01:10:57.940 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.941+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.mv3-yLziO7COG2APJRjvMSbW0_MMhxP_0 2024-09-12T01:10:57.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.942+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1941260924196635561', time=2024-09-12T02:52:30.467951+0000, chain.objs.size()=1 2024-09-12T01:10:57.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.942+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.n64EUWGoIsZxslHxHFKeezX-m68gAqy_0 2024-09-12T01:10:57.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.942+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6703842966796280800', time=2024-09-12T02:52:30.468870+0000, chain.objs.size()=1 2024-09-12T01:10:57.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.942+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0aZ2pBsgnVVaXY0SPfWklcRgelJEOdC_0 2024-09-12T01:10:57.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.942+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18242461701525381497', time=2024-09-12T02:52:31.144991+0000, chain.objs.size()=1 2024-09-12T01:10:57.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.942+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.IE3OqTwWhSvbAp5N3Bo4eyWWffABr_j_0 2024-09-12T01:10:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.942+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17882365161908519207', time=2024-09-12T02:52:31.428494+0000, chain.objs.size()=1 2024-09-12T01:10:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.942+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.BboDQwQouorge7sbZfbWDdkpUAA61xf_0 2024-09-12T01:10:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.943+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2748859084363220393', time=2024-09-12T02:52:35.927864+0000, chain.objs.size()=1 2024-09-12T01:10:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.943+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.270__shadow_.UDMMq1cjp_JxmS7fvz33NIF9Z7sqleU_0 2024-09-12T01:10:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.944+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7088503282321210060', time=2024-09-12T02:52:39.372493+0000, chain.objs.size()=1 2024-09-12T01:10:57.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.944+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.276__shadow_.FJx3neJhVemFIkAscoKO28L7io88Tn4_0 2024-09-12T01:10:57.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.944+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12816751351165399611', time=2024-09-12T02:52:40.579580+0000, chain.objs.size()=1 2024-09-12T01:10:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.944+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.278__shadow_.xLLinCyHhL9gR9Np6YglB1sbuKAdtKC_0 2024-09-12T01:10:57.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.944+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7047595962804596848', time=2024-09-12T02:52:42.383186+0000, chain.objs.size()=1 2024-09-12T01:10:57.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.944+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.281__shadow_.48JvX-hy-NCxzo9U_vlb88wikxb0iwR_0 2024-09-12T01:10:57.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.944+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8701956231721493534', time=2024-09-12T02:52:44.824585+0000, chain.objs.size()=1 2024-09-12T01:10:57.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.944+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.285__shadow_.gn1VtFoOi_PHAw0mfjA5POj75GyYNfK_0 2024-09-12T01:10:57.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.944+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2152738146606714192', time=2024-09-12T02:52:53.142027+0000, chain.objs.size()=1 2024-09-12T01:10:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.944+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.W4zaPKj5-jWt5HtUv9R90JpjXIZT-Ah_0 2024-09-12T01:10:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.945+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15359643478088745641', time=2024-09-12T02:53:11.266834+0000, chain.objs.size()=1 2024-09-12T01:10:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.945+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.322__shadow_.to24fMEc16aLv3UIfppiz1p31SG25B8_0 2024-09-12T01:10:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.946+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6063159004469297838', time=2024-09-12T02:53:49.446419+0000, chain.objs.size()=1 2024-09-12T01:10:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.946+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0feCY1OGZFQzhBj22fvDFcsvgD5qMvJ_0 2024-09-12T01:10:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.946+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14844122237426615249', time=2024-09-12T02:53:49.446947+0000, chain.objs.size()=1 2024-09-12T01:10:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.946+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.jsyaNJaaE2-yjwiBXAdWCsLU8PryOQ4_0 2024-09-12T01:10:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.946+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16777276493442702434', time=2024-09-12T02:53:49.603769+0000, chain.objs.size()=1 2024-09-12T01:10:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.946+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.o2Hc5voWcAxL6dDW3J3h0pQv6evPU2-_0 2024-09-12T01:10:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.946+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11515790102679667668', time=2024-09-12T02:53:49.689554+0000, chain.objs.size()=1 2024-09-12T01:10:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.947+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.x-Rol4h-MbN5ZbJE6Yhrt3sF3RXLpVF_0 2024-09-12T01:10:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.948+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12240224160298265476', time=2024-09-12T02:53:49.843747+0000, chain.objs.size()=1 2024-09-12T01:10:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.948+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.DNhb11LBZrvGL-vwEBdxbcdCgI6EWAC_0 2024-09-12T01:10:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.948+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11899162673852872354', time=2024-09-12T02:53:50.162133+0000, chain.objs.size()=1 2024-09-12T01:10:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.948+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.utLvQ5qcxt3zLPVeOY9_g3fEJSY0nGf_0 2024-09-12T01:10:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.948+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11481095841279041568', time=2024-09-12T02:53:50.245416+0000, chain.objs.size()=1 2024-09-12T01:10:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.948+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.oqLoMB7jC4WIbS_ZR-ACNBi2bPcGE_4_0 2024-09-12T01:10:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.948+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16989268531841411461', time=2024-09-12T02:53:50.275290+0000, chain.objs.size()=1 2024-09-12T01:10:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.948+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.kP7MGFNcnZF5nZrl9HwO18_6Vmm4lhN_0 2024-09-12T01:10:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.948+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3845290955162392456', time=2024-09-12T02:53:51.673392+0000, chain.objs.size()=1 2024-09-12T01:10:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.948+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.eQzRDZPucT5Wgh_0WNan2EOqVUl2ZID_0 2024-09-12T01:10:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.949+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12195988758396915201', time=2024-09-12T02:53:51.782307+0000, chain.objs.size()=1 2024-09-12T01:10:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.949+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.XdZemqoBAoh3zg-w52yH96EN3NxWCxl_0 2024-09-12T01:10:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.949+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9173517927652980572', time=2024-09-12T02:53:52.393160+0000, chain.objs.size()=1 2024-09-12T01:10:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.949+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.6fG66P4PgjnTpatEz8T5-yJixA8wiOi_0 2024-09-12T01:10:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.949+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8226773285233410879', time=2024-09-12T02:53:52.701238+0000, chain.objs.size()=1 2024-09-12T01:10:57.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.949+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.w-L85TTrnfjMqrEOtBv_Rb-_zhz1OFT_0 2024-09-12T01:10:57.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.951+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11665230662714753905', time=2024-09-12T02:53:52.812326+0000, chain.objs.size()=1 2024-09-12T01:10:57.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.951+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.6cwRUekSsUU5wlwX4Vrd6LvprGcCdRK_0 2024-09-12T01:10:57.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.951+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4005435741943614892', time=2024-09-12T02:53:53.890642+0000, chain.objs.size()=1 2024-09-12T01:10:57.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.951+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ZYdgPaJoCS15GZrCMtZ6tF-GIW4PxbH_0 2024-09-12T01:10:57.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.951+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16021095457732855111', time=2024-09-12T02:53:54.268254+0000, chain.objs.size()=1 2024-09-12T01:10:57.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.951+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nq4txNDimn50DL7IbHnXtRT2S-uumfe_0 2024-09-12T01:10:57.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.952+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16066478127391297418', time=2024-09-12T02:53:55.048539+0000, chain.objs.size()=1 2024-09-12T01:10:57.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.952+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Xe5CEgpXCp9xlFl9GyH0PHiF2YD9MGD_0 2024-09-12T01:10:57.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.953+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13619027719591554074', time=2024-09-12T02:53:55.212372+0000, chain.objs.size()=1 2024-09-12T01:10:57.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.953+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.xdqbK7odLcrAWjxK_V2aN2WCPLHm0sE_0 2024-09-12T01:10:57.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.953+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9252531865315267639', time=2024-09-12T02:53:55.255037+0000, chain.objs.size()=1 2024-09-12T01:10:57.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.953+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.8mc3kcfX8MBoFRqlQQgIJ8a-I6ZGxfA_0 2024-09-12T01:10:57.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.953+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2699141523977594715', time=2024-09-12T02:53:55.497607+0000, chain.objs.size()=1 2024-09-12T01:10:57.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.953+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.1hxVXuAeaqtPOrLhOUCiQql1xD2uQt1_0 2024-09-12T01:10:57.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8989185937758160140', time=2024-09-12T02:53:55.596800+0000, chain.objs.size()=1 2024-09-12T01:10:57.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.z2Sxag9vCRTibacO-62mojz-UUn5r62_0 2024-09-12T01:10:57.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6627817125689513196', time=2024-09-12T02:53:55.741904+0000, chain.objs.size()=1 2024-09-12T01:10:57.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Zn0QxOHJJVa--fjYKYGw5SPPcM1aPxJ_0 2024-09-12T01:10:57.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1454450860495189086', time=2024-09-12T02:53:55.845122+0000, chain.objs.size()=1 2024-09-12T01:10:57.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cDvPAEdVZo_G2RLa4x0aHTj63YM5LQH_0 2024-09-12T01:10:57.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4414482593721706867', time=2024-09-12T02:53:55.981456+0000, chain.objs.size()=1 2024-09-12T01:10:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.D8HLMDmtVLZXab3in8Q-2wQgB9vp4eb_0 2024-09-12T01:10:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14538909684720502203', time=2024-09-12T02:53:56.030468+0000, chain.objs.size()=1 2024-09-12T01:10:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.c0kbXxgljdopVE-Rbg0oq9CVjbivHdW_0 2024-09-12T01:10:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8261465598851142914', time=2024-09-12T02:53:56.894453+0000, chain.objs.size()=1 2024-09-12T01:10:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.-4qI4kir0sqA6CAwb2cJs2OjAlURPb-_0 2024-09-12T01:10:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5956889714763540445', time=2024-09-12T02:53:56.909194+0000, chain.objs.size()=1 2024-09-12T01:10:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.K1t_wvC5PVzbnZqW2FTWPjpn7R8_pFm_0 2024-09-12T01:10:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11424412764388669402', time=2024-09-12T02:53:57.018799+0000, chain.objs.size()=1 2024-09-12T01:10:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tTgrS1tVoLSwOrGDwJFqbWrfq_Fs5uc_0 2024-09-12T01:10:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.957+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14815630951627332620', time=2024-09-12T02:53:57.060234+0000, chain.objs.size()=1 2024-09-12T01:10:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.957+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.81H6OL5xsABrasBjrb1xM1j-C2X7lPu_0 2024-09-12T01:10:57.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.957+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16497057377797807139', time=2024-09-12T02:53:58.097249+0000, chain.objs.size()=1 2024-09-12T01:10:57.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.957+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.QC2bkLcjCNg0sLPhoUrXOV8nff7fFZI_0 2024-09-12T01:10:57.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.957+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7686516384874472656', time=2024-09-12T02:53:58.097831+0000, chain.objs.size()=1 2024-09-12T01:10:57.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.957+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.9AoO2KSR37qdjJeW5asbkYkV_OJoXrX_0 2024-09-12T01:10:57.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.960+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17374815883166005054', time=2024-09-12T02:53:58.331435+0000, chain.objs.size()=1 2024-09-12T01:10:57.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.960+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.sPKN6dvUUN-bdylPJHwQkOmzeVr-ct4_0 2024-09-12T01:10:57.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.960+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6852583272031102832', time=2024-09-12T02:53:58.365297+0000, chain.objs.size()=1 2024-09-12T01:10:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.960+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0teCqIMxG1zryiNy2e5Xl1Tj5QlmQbv_0 2024-09-12T01:10:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.960+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11562352239716977483', time=2024-09-12T02:53:58.672010+0000, chain.objs.size()=1 2024-09-12T01:10:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.960+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.VLr2ebWqp-PpS9dkCDExKSRjW77TUIu_0 2024-09-12T01:10:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.960+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16420377577705557910', time=2024-09-12T02:53:59.162999+0000, chain.objs.size()=1 2024-09-12T01:10:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.960+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dMTi4hQhhAx_KhDKJpUnDxowxpwwNhF_0 2024-09-12T01:10:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.961+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16322440527480431560', time=2024-09-12T02:53:59.496799+0000, chain.objs.size()=1 2024-09-12T01:10:57.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.961+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0-eX4i5ulzz8QVBF87_VkPd_Yvm2_L7_0 2024-09-12T01:10:57.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4334827347999123605', time=2024-09-12T02:53:59.608990+0000, chain.objs.size()=1 2024-09-12T01:10:57.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.rTHbEb3kCCJdiLMu923NIl9lopkI8Sx_0 2024-09-12T01:10:57.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8845735959087114315', time=2024-09-12T02:53:59.609756+0000, chain.objs.size()=1 2024-09-12T01:10:57.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.WIVzycFKt5NJaHH4RWkfggClIBhNkOr_0 2024-09-12T01:10:57.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5522249873862725849', time=2024-09-12T02:54:36.639888+0000, chain.objs.size()=1 2024-09-12T01:10:57.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6ZX4x0j6sk2mNLBqsJjsaBzDIANe-p-_0 2024-09-12T01:10:57.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2949819376426671673', time=2024-09-12T02:54:36.640495+0000, chain.objs.size()=1 2024-09-12T01:10:57.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.cyNznapu7cx6qpTswVA7jQtqjGqnBux_0 2024-09-12T01:10:57.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12983269876341503525', time=2024-09-12T02:54:36.641104+0000, chain.objs.size()=1 2024-09-12T01:10:57.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.PJxlkOnewoK6G4tAxDTW3Cb2z0o0WNA_0 2024-09-12T01:10:57.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.434121747826509728', time=2024-09-12T02:54:36.992667+0000, chain.objs.size()=1 2024-09-12T01:10:57.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:57.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Cxv-IrA1-FzO5yZ3JAioNhZ6aTMX-MD_0 2024-09-12T01:10:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4510602295918358889', time=2024-09-12T02:54:36.994269+0000, chain.objs.size()=1 2024-09-12T01:10:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.H9_Il_vndE3BGdiADUGcdYsQyKl9_kv_0 2024-09-12T01:10:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17696661348724238345', time=2024-09-12T02:54:37.247788+0000, chain.objs.size()=1 2024-09-12T01:10:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9ztfqLySz7Hn27bUI5JeckKirpDI9wk_0 2024-09-12T01:10:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2355306280849429220', time=2024-09-12T02:54:37.629215+0000, chain.objs.size()=1 2024-09-12T01:10:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nVHLGV_D6vpni6TJIsKrgDsMdOQ1pv5_0 2024-09-12T01:10:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10188637792637503545', time=2024-09-12T02:54:38.331489+0000, chain.objs.size()=1 2024-09-12T01:10:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.XtDepY6GvbZ6fFcGBiXgDzEFb9EqNpY_0 2024-09-12T01:10:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5363867815583456139', time=2024-09-12T02:54:38.517192+0000, chain.objs.size()=1 2024-09-12T01:10:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ubu5vji9u5terCNsT8saaXttjdOQeby_0 2024-09-12T01:10:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1631298783393344867', time=2024-09-12T02:54:38.675777+0000, chain.objs.size()=1 2024-09-12T01:10:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.2jt3F2bBsMsHsEh2Sl04o9gjNC5TCyT_0 2024-09-12T01:10:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9387837704070360691', time=2024-09-12T02:54:38.883708+0000, chain.objs.size()=1 2024-09-12T01:10:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.7Fv6zyALIbXgEtZt2hOrRsJgoavaSyc_0 2024-09-12T01:10:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6743765028137510365', time=2024-09-12T02:54:40.034677+0000, chain.objs.size()=1 2024-09-12T01:10:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.yuYvbKgHZXdYCcAu47TkRLIghbJJidJ_0 2024-09-12T01:10:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5813531717831914322', time=2024-09-12T02:54:40.073735+0000, chain.objs.size()=1 2024-09-12T01:10:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.qiOeXFKCx0keGbHb2GqIOi4yQZ0o9UE_0 2024-09-12T01:10:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18297088334129326868', time=2024-09-12T02:54:40.471272+0000, chain.objs.size()=1 2024-09-12T01:10:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.jEyTCJBtoD1pBiaQ9OHsw0jfvSD1dly_0 2024-09-12T01:10:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3460903919807643323', time=2024-09-12T02:54:40.956761+0000, chain.objs.size()=1 2024-09-12T01:10:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.157+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.MQOWvlGGgTkw186LfMTJskk7-7Ivucs_0 2024-09-12T01:10:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.159+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9375584637719906919', time=2024-09-12T02:54:41.212149+0000, chain.objs.size()=1 2024-09-12T01:10:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.159+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.J_XtCsneL0IWomDoJ0HL7eUIgsB0JcX_0 2024-09-12T01:10:58.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/48486 2024-09-12T01:10:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-12T01:10:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15334859929131802298', time=2024-09-12T02:54:41.347478+0000, chain.objs.size()=1 2024-09-12T01:10:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Smo4TdpvY39mLGjMMXWJjdho3tHyExD_0 2024-09-12T01:10:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10510603977786218584', time=2024-09-12T02:54:41.482039+0000, chain.objs.size()=1 2024-09-12T01:10:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.uEpRi4c5CF9NkIGZLeVKBwbWsq_nYRL_0 2024-09-12T01:10:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7601212573005011474', time=2024-09-12T02:54:42.259520+0000, chain.objs.size()=1 2024-09-12T01:10:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.VKQYv3ovzemFEyaLVPcgtD6eQ2aKLCf_0 2024-09-12T01:10:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11506196578200393464', time=2024-09-12T02:54:42.374110+0000, chain.objs.size()=1 2024-09-12T01:10:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.hLn1fZNtCOPr3mzLoRab4GFWoHEx6fk_0 2024-09-12T01:10:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15501699262958095329', time=2024-09-12T02:54:42.836000+0000, chain.objs.size()=1 2024-09-12T01:10:58.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.c7e1yBROcb_SpUDW8WcUnhNLTiiXIPZ_0 2024-09-12T01:10:58.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17136062527350555609', time=2024-09-12T02:54:43.026975+0000, chain.objs.size()=1 2024-09-12T01:10:58.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.bboHE0c0snYHXc_agS_0fd85d_L9zwh_0 2024-09-12T01:10:58.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10677241521732428664', time=2024-09-12T02:54:44.649073+0000, chain.objs.size()=1 2024-09-12T01:10:58.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.c1nhgik4obewHqkT6cDnPGJuy-LWuVH_0 2024-09-12T01:10:58.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16718047286327590889', time=2024-09-12T02:54:45.546746+0000, chain.objs.size()=1 2024-09-12T01:10:58.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.zHVw_SGZeMESRyaECOCGtnkXlqZSXgh_0 2024-09-12T01:10:58.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6717552143681474799', time=2024-09-12T02:54:45.673520+0000, chain.objs.size()=1 2024-09-12T01:10:58.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.mDh5LY1l3FSdrrkYJ9JqUKMdTW8A2Pa_0 2024-09-12T01:10:58.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3178234420245688848', time=2024-09-12T02:54:45.706575+0000, chain.objs.size()=1 2024-09-12T01:10:58.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.y_8QD0H0rQUTe-zdTSiDXMj3xv5KulO_0 2024-09-12T01:10:58.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6427682360717751423', time=2024-09-12T02:54:45.897546+0000, chain.objs.size()=1 2024-09-12T01:10:58.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.C7uQ-v5sycoBTzT1hRJPrvmMCKhTuOY_0 2024-09-12T01:10:58.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5811885905697141081', time=2024-09-12T02:54:46.619461+0000, chain.objs.size()=1 2024-09-12T01:10:58.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.qCw5PBgpwTRohwLzyzXOi7tMeMq-6XH_0 2024-09-12T01:10:58.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.169+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11964448463610946813', time=2024-09-12T02:54:46.938756+0000, chain.objs.size()=1 2024-09-12T01:10:58.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.169+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.LHumVCFvXH0qNoar0RilyxdkZR3P1yY_0 2024-09-12T01:10:58.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.169+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18411354462399964858', time=2024-09-12T02:54:47.035144+0000, chain.objs.size()=1 2024-09-12T01:10:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.169+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.vtHLUw21gQnlFR2v_4AYoMMZSCpdkc5_0 2024-09-12T01:10:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3328087465725319578', time=2024-09-12T02:54:51.658224+0000, chain.objs.size()=1 2024-09-12T01:10:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.334__shadow_.6QD3r-91TvoXBxWRwx-lMEddIy05ibV_0 2024-09-12T01:10:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.198159348024960733', time=2024-09-12T02:54:56.071125+0000, chain.objs.size()=1 2024-09-12T01:10:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.342__shadow_.j0uEbms_meU3Pb_0U0ceMo3mD2uL8jm_0 2024-09-12T01:10:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12637356829887422503', time=2024-09-12T02:54:58.014781+0000, chain.objs.size()=1 2024-09-12T01:10:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.346__shadow_.rIibLdeEGZG-acKH2bPQJfiRqMQoqYM_0 2024-09-12T01:10:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10322633862276242861', time=2024-09-12T02:55:14.434632+0000, chain.objs.size()=1 2024-09-12T01:10:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.379__shadow_.Xu1KS9KwVpgkT9b6CxhcH1y1K8UETYz_0 2024-09-12T01:10:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12017500190250092903', time=2024-09-12T02:55:46.832130+0000, chain.objs.size()=1 2024-09-12T01:10:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.437__shadow_.y8qf83uq9mg4ij1v6i4Ynp0L_SsEvPX_0 2024-09-12T01:10:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15143839826103268459', time=2024-09-12T02:56:05.485597+0000, chain.objs.size()=1 2024-09-12T01:10:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.465__shadow_.ee7Mk7qzqzJ94YhHxGc6IY_Divo7Tcv_0 2024-09-12T01:10:58.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11645309417711281627', time=2024-09-12T02:56:21.737805+0000, chain.objs.size()=1 2024-09-12T01:10:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.491__shadow_.BPSKPHnMoCzlszHaW84rUR-_7tqMw11_0 2024-09-12T01:10:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11645309417711281627', time=2024-09-12T02:56:21.930159+0000, chain.objs.size()=1 2024-09-12T01:10:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.491__shadow_.BPSKPHnMoCzlszHaW84rUR-_7tqMw11_0 2024-09-12T01:10:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16665197308766035949', time=2024-09-12T02:56:26.986868+0000, chain.objs.size()=1 2024-09-12T01:10:58.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.500__shadow_.T1HXAW_Zm-5Z71M_a7ox0L4PwOU_ExI_0 2024-09-12T01:10:58.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.174+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14499990976393490069', time=2024-09-12T02:56:41.247407+0000, chain.objs.size()=6 2024-09-12T01:10:58.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.174+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.1 2024-09-12T01:10:58.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.174+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.2 2024-09-12T01:10:58.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.174+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.3 2024-09-12T01:10:58.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.174+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.4 2024-09-12T01:10:58.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.174+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.5 2024-09-12T01:10:58.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.175+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.6 2024-09-12T01:10:58.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.175+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16655752676935669594', time=2024-09-12T02:56:42.287070+0000, chain.objs.size()=1 2024-09-12T01:10:58.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.175+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.512__multipart_mymultipart.2~20u-9vkZK2ZtrzhBopGSADdnyi4rDU3.1 2024-09-12T01:10:58.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.175+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14678997790087166204', time=2024-09-12T02:56:52.148133+0000, chain.objs.size()=1 2024-09-12T01:10:58.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.175+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.519__multipart_mymultipart.2~SR7Jg0vkDM4Vv4SKBUAdFGBlCVyVlmC.1 2024-09-12T01:10:58.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.175+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3659694620080800144', time=2024-09-12T02:59:27.850796+0000, chain.objs.size()=1 2024-09-12T01:10:58.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.175+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.555__shadow_.G8SoRCjWtqwf4zfaoTppJ9gqzhv8KS8_0 2024-09-12T01:10:58.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.175+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17420401259687206937', time=2024-09-12T03:00:02.768006+0000, chain.objs.size()=1 2024-09-12T01:10:58.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.175+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:N563TGN1JhpkRpwWrVkJScBDJsfP9qO_.49nNriinGzPagFxUy5lw6cXtDMogzmG_0 2024-09-12T01:10:58.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.176+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8811437385382472536', time=2024-09-12T03:00:22.435425+0000, chain.objs.size()=1 2024-09-12T01:10:58.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.176+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:icGq--YlGeZWhpQbH8-T.zd3Z9BxOQt_.TSiIeDpq5aTRqML6fGhbn8XBITDqgCw_0 2024-09-12T01:10:58.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.177+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14639459738334474352', time=2024-09-12T03:00:22.808141+0000, chain.objs.size()=1 2024-09-12T01:10:58.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.177+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:uHislpCsbWk3Nc5cEe8-XChGZZidarf_.OKTY99HBm52alWPcFvKYsWVEcXnNZNj_0 2024-09-12T01:10:58.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.177+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18304732997652385024', time=2024-09-12T03:00:31.534966+0000, chain.objs.size()=1 2024-09-12T01:10:58.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.177+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:OeNoZIYKpXtoNwVT9twadbHIyriNaiv_.XFaZAANxZ7RcSbTQyxMVX9SlN7L_Vee_0 2024-09-12T01:10:58.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.177+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6295474171106270369', time=2024-09-12T03:00:32.096735+0000, chain.objs.size()=1 2024-09-12T01:10:58.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.177+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:DjjxcDQv1tDPUCgtE83d98oYU0Vail4_.EmIatkTMzz9k4-k6kxDQqfzFCrawQpI_0 2024-09-12T01:10:58.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.177+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8414816731441371999', time=2024-09-12T03:00:52.652360+0000, chain.objs.size()=1 2024-09-12T01:10:58.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.177+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.580__shadow:sFF8biWGfCZLP-.C7ZlKDxEAso-pGNw_.ZTzQO30pZJdABPbq-Jrpl0zgCKC1O5b_0 2024-09-12T01:10:58.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.177+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10892737982368072396', time=2024-09-12T03:00:59.094248+0000, chain.objs.size()=1 2024-09-12T01:10:58.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.177+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.587__shadow:-GQ9amBsaol0ASrxMI-.s4BJ6coHTBo_.KQbxZzOAV-sAMr6QprdDJ2Y27ARN4hk_0 2024-09-12T01:10:58.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.177+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16097119733311792478', time=2024-09-12T03:01:00.440465+0000, chain.objs.size()=1 2024-09-12T01:10:58.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.177+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.588__shadow:2XpRkqy1Q-Q1V0lwMDHsZMSRd0yHQc-_.ZoTjair5H0KYop76BBYjRMIWSiD3L-B_0 2024-09-12T01:10:58.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.179+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3991591457214920851', time=2024-09-12T03:06:23.710044+0000, chain.objs.size()=1 2024-09-12T01:10:58.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.179+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.719__shadow_.EuZkCk1aoKW4NLgqyakZI-HnfH65gPR_0 2024-09-12T01:10:58.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.179+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7323414710433496802', time=2024-09-12T03:07:01.321783+0000, chain.objs.size()=1 2024-09-12T01:10:58.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.180+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.746__shadow_.GL9nHPWbqFL4N5Slhddm8ivYhi2oA8e_0 2024-09-12T01:10:58.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.182+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:58.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.186+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:10:58.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.187+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:58.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.187+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:58.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50970' 2024-09-12T01:10:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8059627812332523174', time=2024-09-12T02:49:43.933409+0000, chain.objs.size()=1 2024-09-12T01:10:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.182__shadow_.8bkifocgBNC6sPGkCfM-lx4IdXb4qoa_0 2024-09-12T01:10:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11088701040877106974', time=2024-09-12T02:51:25.380735+0000, chain.objs.size()=1 2024-09-12T01:10:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.231__shadow_.MiidhnmNg7kHa2B7xKupLYNNsp4c2Sj_0 2024-09-12T01:10:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18306138384226425391', time=2024-09-12T02:51:29.123356+0000, chain.objs.size()=1 2024-09-12T01:10:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.237__shadow_.GoCqHnoazHVCwa2GSwNCfRGjBTvvQft_0 2024-09-12T01:10:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5385672704101870502', time=2024-09-12T02:52:21.123762+0000, chain.objs.size()=1 2024-09-12T01:10:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.8ZwTyk5N5yoV4GKvFKkcGdoX57EILts_0 2024-09-12T01:10:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7902451158942592306', time=2024-09-12T02:52:21.317792+0000, chain.objs.size()=1 2024-09-12T01:10:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Y8iULjDgNLrEv4l_RI3OpTgJLsuy6jw_0 2024-09-12T01:10:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.275975004056877946', time=2024-09-12T02:52:21.493755+0000, chain.objs.size()=1 2024-09-12T01:10:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.QQumaB0EitEJMHt15MI1JZBHvqtkzCQ_0 2024-09-12T01:10:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10768635689984477091', time=2024-09-12T02:52:21.734880+0000, chain.objs.size()=1 2024-09-12T01:10:58.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.8Vq6mF92opZJAAXRYlvqlD1Qa4ySxb1_0 2024-09-12T01:10:58.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16544518400542280941', time=2024-09-12T02:52:21.767688+0000, chain.objs.size()=1 2024-09-12T01:10:58.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.c3seZP_xpgohOdgfAtK9pHU4GSMjkua_0 2024-09-12T01:10:58.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16881833084964577448', time=2024-09-12T02:52:22.023775+0000, chain.objs.size()=1 2024-09-12T01:10:58.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Nq_eEttMD-bFgBpgn16IGaT74HrD74T_0 2024-09-12T01:10:58.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6161664238216812087', time=2024-09-12T02:52:22.884541+0000, chain.objs.size()=1 2024-09-12T01:10:58.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0CEpoU38nNjfF6tcVTJuDXPaCCxlAxN_0 2024-09-12T01:10:58.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17193383162765449839', time=2024-09-12T02:52:22.886595+0000, chain.objs.size()=1 2024-09-12T01:10:58.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wATlw5o4utgJdqnjWfUyazwbsSDYp7__0 2024-09-12T01:10:58.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9297074044098847129', time=2024-09-12T02:52:24.588625+0000, chain.objs.size()=1 2024-09-12T01:10:58.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ARmGWweHxtZOFvW2-JIWoKW8sM9u7Dq_0 2024-09-12T01:10:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.191+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11836456038581520314', time=2024-09-12T02:52:24.721120+0000, chain.objs.size()=1 2024-09-12T01:10:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.191+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4F0epJgcDZU-xsxSGQmAlyfX9Cjchnk_0 2024-09-12T01:10:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.192+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13346558086966827865', time=2024-09-12T02:52:24.722773+0000, chain.objs.size()=1 2024-09-12T01:10:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.192+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._JIG5zGWYZKPteqq3Ovo99UuRbDriXg_0 2024-09-12T01:10:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.192+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6174261619757413514', time=2024-09-12T02:52:25.061419+0000, chain.objs.size()=1 2024-09-12T01:10:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.192+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.k6mQP0DKVQeiFc0te_nps_zqQKQEb5I_0 2024-09-12T01:10:58.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.192+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11104989297086490731', time=2024-09-12T02:52:25.966996+0000, chain.objs.size()=1 2024-09-12T01:10:58.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.192+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.AaMB-7NpEfcy5VvrhkI-trwYz6GbS9w_0 2024-09-12T01:10:58.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.192+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11539915678972765923', time=2024-09-12T02:52:26.007204+0000, chain.objs.size()=1 2024-09-12T01:10:58.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.192+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ipNzIFKSKOKBdvntL1H0a0gDDyorEej_0 2024-09-12T01:10:58.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.192+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4762374359978336062', time=2024-09-12T02:52:26.561729+0000, chain.objs.size()=1 2024-09-12T01:10:58.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.192+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ly3SANL7SMTZjTg0-jjU9hq_8ls6URN_0 2024-09-12T01:10:58.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.192+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6565104724379444851', time=2024-09-12T02:52:27.387560+0000, chain.objs.size()=1 2024-09-12T01:10:58.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.192+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.JjvbWfxJK24168CGuTo4cpJq2FZyBXj_0 2024-09-12T01:10:58.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.192+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13861148716897618908', time=2024-09-12T02:52:27.714412+0000, chain.objs.size()=1 2024-09-12T01:10:58.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.192+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vp8pna9FsbXvhzTHS650IUsRolq3n8Q_0 2024-09-12T01:10:58.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.193+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13275295406160100869', time=2024-09-12T02:52:27.802911+0000, chain.objs.size()=1 2024-09-12T01:10:58.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.193+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.3KlLQyY9Wph_neno0ehDilF_TXUTwW9_0 2024-09-12T01:10:58.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.193+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14276786176698839472', time=2024-09-12T02:52:27.860743+0000, chain.objs.size()=1 2024-09-12T01:10:58.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.193+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.T0PamgqUBTkfNiStX2WL-2I48WooDra_0 2024-09-12T01:10:58.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.193+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17646575099018323462', time=2024-09-12T02:52:28.087339+0000, chain.objs.size()=1 2024-09-12T01:10:58.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.193+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.C8iWy55UjST781Rl3hB_jLF_AUv8wSK_0 2024-09-12T01:10:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.196+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8205005960792920392', time=2024-09-12T02:52:28.424824+0000, chain.objs.size()=1 2024-09-12T01:10:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.196+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Qs3Sq9SjSfwN2VjgmWVAY7aaiASQjxp_0 2024-09-12T01:10:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.196+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4643854651790183446', time=2024-09-12T02:52:28.550758+0000, chain.objs.size()=1 2024-09-12T01:10:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.196+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Fv6oRZkSpIrJCHLz4jsbEecSMiLvHnD_0 2024-09-12T01:10:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.196+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12622974403020160774', time=2024-09-12T02:52:28.830279+0000, chain.objs.size()=1 2024-09-12T01:10:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.196+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.mWJh1hbVtlqiK9M0WIyb4_F0wvg-Uy5_0 2024-09-12T01:10:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.196+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10015599312203174742', time=2024-09-12T02:52:29.177616+0000, chain.objs.size()=1 2024-09-12T01:10:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.196+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ptNAgmR4QJDl6feg4yWv0zshndpjF1i_0 2024-09-12T01:10:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.196+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13999310585225339216', time=2024-09-12T02:52:29.487109+0000, chain.objs.size()=1 2024-09-12T01:10:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.196+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.zigl5p6cGMUQ7zP-lL8hc8Jw5OTyyzQ_0 2024-09-12T01:10:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.196+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17591411713708620300', time=2024-09-12T02:52:29.576287+0000, chain.objs.size()=1 2024-09-12T01:10:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.196+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.g-fHOroViAqY47tHxjw1i7iiJFSSKWP_0 2024-09-12T01:10:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.196+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15367419274431965336', time=2024-09-12T02:52:30.057872+0000, chain.objs.size()=1 2024-09-12T01:10:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.196+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._dt3_dvo710_peR74LevGXKCcZ6fJap_0 2024-09-12T01:10:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.197+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10329410843273702314', time=2024-09-12T02:52:30.149660+0000, chain.objs.size()=1 2024-09-12T01:10:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.197+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.2IFwJvZSinG5Quwd-YvFYFYl7y8Z7wr_0 2024-09-12T01:10:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.197+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1637028460632332597', time=2024-09-12T02:52:30.520620+0000, chain.objs.size()=1 2024-09-12T01:10:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.197+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.QfJuG8qocppfQpJHOUmm8NrEbblB82j_0 2024-09-12T01:10:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.197+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2775752932622934059', time=2024-09-12T02:52:30.545615+0000, chain.objs.size()=1 2024-09-12T01:10:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.197+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.utDVn47c9O7X8zsAD3jJjJ_ocla7gt0_0 2024-09-12T01:10:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.197+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2830058191784054368', time=2024-09-12T02:52:31.506398+0000, chain.objs.size()=1 2024-09-12T01:10:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.197+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Saycjd7ZwsMjKx6KmVnkcT-q7ub5X0N_0 2024-09-12T01:10:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3005110995430924824', time=2024-09-12T02:52:32.538097+0000, chain.objs.size()=1 2024-09-12T01:10:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.264__shadow_.gDWhQYcuB6BbZ-_34--MdDJxxIZUPeu_0 2024-09-12T01:10:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11386689069196320849', time=2024-09-12T02:52:37.066298+0000, chain.objs.size()=1 2024-09-12T01:10:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.272__shadow_.I20lPpNP50pqoPu0Zhqg8NZYOY_Ix5U_0 2024-09-12T01:10:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18291384987393393371', time=2024-09-12T02:52:41.771751+0000, chain.objs.size()=1 2024-09-12T01:10:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.280__shadow_.zkkzrQ7S6ybJJPNGp24ScFxK2WQKATc_0 2024-09-12T01:10:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10406184869243344630', time=2024-09-12T02:52:43.628962+0000, chain.objs.size()=1 2024-09-12T01:10:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.283__shadow_.P6l_cKVGAUYDrYmmLjWUkvjo45oowob_0 2024-09-12T01:10:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10389607832205527798', time=2024-09-12T02:52:43.629486+0000, chain.objs.size()=1 2024-09-12T01:10:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.283__shadow_.l_x-VA2RIDp339PUbP_NtLpaNSOOs5W_0 2024-09-12T01:10:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15078898748822942266', time=2024-09-12T02:52:46.745101+0000, chain.objs.size()=1 2024-09-12T01:10:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.288__shadow_.H7KY6hrib_Sw28mmCanG96mOwuGA2u__0 2024-09-12T01:10:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17140689394386846119', time=2024-09-12T02:52:54.479132+0000, chain.objs.size()=1 2024-09-12T01:10:58.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.296__shadow_.tAW4KM3QN9hNAQYNkXcCavwz6zlXW9c_0 2024-09-12T01:10:58.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2298307149874887685', time=2024-09-12T02:52:55.076222+0000, chain.objs.size()=1 2024-09-12T01:10:58.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.200+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.297__shadow_.JvRiEAS4lS2IxZ06S93OHy6D_3VvqqQ_0 2024-09-12T01:10:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.203+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13712853547704195168', time=2024-09-12T02:52:59.457334+0000, chain.objs.size()=1 2024-09-12T01:10:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.203+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.304__shadow_.X-L5IW25dRiIV3EsaiVZLBMM98Reuk1_0 2024-09-12T01:10:58.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.203+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3431464100238206994', time=2024-09-12T02:53:00.691884+0000, chain.objs.size()=1 2024-09-12T01:10:58.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.203+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.306__shadow_.7mA5YAM0zopcekeES_oAOVCi2WK3G1B_0 2024-09-12T01:10:58.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.203+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15460072187189621025', time=2024-09-12T02:53:07.696833+0000, chain.objs.size()=1 2024-09-12T01:10:58.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.203+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.316__shadow_.foX3eEBjHRX5gY2KKjXkEd_2oou-Okf_0 2024-09-12T01:10:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15676707196730500803', time=2024-09-12T02:53:12.030981+0000, chain.objs.size()=1 2024-09-12T01:10:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.323__shadow_.67-C1h3ohTZ8cOE24NOQ0c_CcgYzYOA_0 2024-09-12T01:10:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7212741947426089030', time=2024-09-12T02:53:49.522652+0000, chain.objs.size()=1 2024-09-12T01:10:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.DHx13LraB1H-glNC4iOJQtsDQtosWTG_0 2024-09-12T01:10:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1843691040713994045', time=2024-09-12T02:53:49.551335+0000, chain.objs.size()=1 2024-09-12T01:10:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.V-9rQKcXgd71gdSTRhpoyQuAc2unAg6_0 2024-09-12T01:10:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17405976275803468107', time=2024-09-12T02:53:49.596408+0000, chain.objs.size()=1 2024-09-12T01:10:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.9Fv02xECG4DwQxCWdldLeNFBAByrbuo_0 2024-09-12T01:10:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3702377752819626211', time=2024-09-12T02:53:49.766569+0000, chain.objs.size()=1 2024-09-12T01:10:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.VMbQNhwD1E_nq9C6WHrVqfnDs1NqvLo_0 2024-09-12T01:10:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6796907364263253078', time=2024-09-12T02:53:49.869526+0000, chain.objs.size()=1 2024-09-12T01:10:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.U1W76SowP5qpEfN9QWGnTp-2e0NyQS8_0 2024-09-12T01:10:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5331763132636734514', time=2024-09-12T02:53:49.911793+0000, chain.objs.size()=1 2024-09-12T01:10:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.g67_-yPQjQ9sz9TsBPw9sO6G6rh1Sc2_0 2024-09-12T01:10:58.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12693509519263362764', time=2024-09-12T02:53:51.149760+0000, chain.objs.size()=1 2024-09-12T01:10:58.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.205+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.pFjhmTd8VKflWDFrPq3yQx7FseccyoA_0 2024-09-12T01:10:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.207+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7640076021850350206', time=2024-09-12T02:53:51.809262+0000, chain.objs.size()=1 2024-09-12T01:10:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.207+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.2jy4tUAWAwkXynkjAOp5CpY27puhiQk_0 2024-09-12T01:10:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.207+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18393149377351105195', time=2024-09-12T02:53:52.292454+0000, chain.objs.size()=1 2024-09-12T01:10:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.207+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.26zh82sSskf9_T909XcbAqg19GTTiU-_0 2024-09-12T01:10:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.207+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9541959626113232766', time=2024-09-12T02:53:53.895165+0000, chain.objs.size()=1 2024-09-12T01:10:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.208+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.jJptUwsM3iTRe7hCgdokBjFCV-auo0A_0 2024-09-12T01:10:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.208+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5955336560830812795', time=2024-09-12T02:53:54.170968+0000, chain.objs.size()=1 2024-09-12T01:10:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.208+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.yc5wVxmmZlepaHabTYIzDWrMEVGU2s5_0 2024-09-12T01:10:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.208+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10081958744812793775', time=2024-09-12T02:53:54.335299+0000, chain.objs.size()=1 2024-09-12T01:10:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.208+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qqXqOZUKluwCMX5dPD6GAtvJWHlsq0J_0 2024-09-12T01:10:58.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.209+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10550461328496281094', time=2024-09-12T02:53:54.366485+0000, chain.objs.size()=1 2024-09-12T01:10:58.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.209+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dS5gh0OK2FrbHGM0spczICfdQgWwEG4_0 2024-09-12T01:10:58.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.209+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13377205332223529309', time=2024-09-12T02:53:54.367859+0000, chain.objs.size()=1 2024-09-12T01:10:58.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.209+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.2CH45AvYNE2EJvR_NtTs5obMGqkvk4q_0 2024-09-12T01:10:58.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.209+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10946266303782769582', time=2024-09-12T02:53:55.484129+0000, chain.objs.size()=1 2024-09-12T01:10:58.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.209+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.4K-Oayrv-uWk_TV9wZXiBMyOqTyfys9_0 2024-09-12T01:10:58.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.209+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9075865992473014026', time=2024-09-12T02:53:55.816203+0000, chain.objs.size()=1 2024-09-12T01:10:58.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.209+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qgdO2ebWSzKFbIC2LpQCiaHIJ8tK9mT_0 2024-09-12T01:10:58.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.209+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8271827642875081287', time=2024-09-12T02:53:56.481102+0000, chain.objs.size()=1 2024-09-12T01:10:58.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.209+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.WgR3ymXhxx_nD-YXg2q2g0nGT15STUd_0 2024-09-12T01:10:58.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.209+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14172308570243642604', time=2024-09-12T02:53:56.735378+0000, chain.objs.size()=1 2024-09-12T01:10:58.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.209+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.2OO8rcQN_X6CMDUaQE71QLBCP_Bxnml_0 2024-09-12T01:10:58.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.212+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15103353886978076066', time=2024-09-12T02:53:58.157366+0000, chain.objs.size()=1 2024-09-12T01:10:58.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.212+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.W-rfiK1XtHw90e-RmY__nWMvuhBvVki_0 2024-09-12T01:10:58.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.212+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16767572059155032592', time=2024-09-12T02:53:58.543604+0000, chain.objs.size()=1 2024-09-12T01:10:58.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.212+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lRRUEupoh6aaQmXiRIr7vWD9WDB153m_0 2024-09-12T01:10:58.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.212+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12116678040467024441', time=2024-09-12T02:53:58.673958+0000, chain.objs.size()=1 2024-09-12T01:10:58.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.212+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hbrPhyi_NblKk49I8FHhHN-EQ25CI4I_0 2024-09-12T01:10:58.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.212+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14689770356740218222', time=2024-09-12T02:53:58.950634+0000, chain.objs.size()=1 2024-09-12T01:10:58.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.212+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.u15JoBdKtGg0jv-cMIXXIzJabrbTHTR_0 2024-09-12T01:10:58.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.212+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.718540322082503143', time=2024-09-12T02:53:59.378941+0000, chain.objs.size()=1 2024-09-12T01:10:58.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.212+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.9Rja8EhMsbJ-dAa_wPfIiG4pdd9Ia9s_0 2024-09-12T01:10:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16122182867500229150', time=2024-09-12T02:54:37.336683+0000, chain.objs.size()=1 2024-09-12T01:10:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.a8yG7hPacS-AFWnZ7CES_3w2pM5OCes_0 2024-09-12T01:10:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5759248240767871986', time=2024-09-12T02:54:37.370995+0000, chain.objs.size()=1 2024-09-12T01:10:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.qpeo3Ei4kF91aHtCFXUG2t-5-CAYcC1_0 2024-09-12T01:10:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5571222043283549362', time=2024-09-12T02:54:37.505755+0000, chain.objs.size()=1 2024-09-12T01:10:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.R0QiPB-WvDwi2QcvDj5WBuh6J9Cuy5q_0 2024-09-12T01:10:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1794840510013829358', time=2024-09-12T02:54:37.590170+0000, chain.objs.size()=1 2024-09-12T01:10:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.EBI_VrvQMvwKYuedaqeVP8qq3ay1ce2_0 2024-09-12T01:10:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8215506578726089949', time=2024-09-12T02:54:38.128513+0000, chain.objs.size()=1 2024-09-12T01:10:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.DvFZrvGTwvdfSqUGyTPdV19M2YUxbKP_0 2024-09-12T01:10:58.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14758828941866872408', time=2024-09-12T02:54:38.365239+0000, chain.objs.size()=1 2024-09-12T01:10:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.7uUuUDT6yiXybXfE_48z_4IEPnPxdpl_0 2024-09-12T01:10:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.214+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7152540556118334896', time=2024-09-12T02:54:38.409827+0000, chain.objs.size()=1 2024-09-12T01:10:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.214+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.PVpQdrdqrTwCztgKnr5gfm-KUb3yPYw_0 2024-09-12T01:10:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.215+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4285215846218387044', time=2024-09-12T02:54:38.866456+0000, chain.objs.size()=1 2024-09-12T01:10:58.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.215+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Ok_doNTHkIsxCz2kcb4ZR4Fc7AHJwGO_0 2024-09-12T01:10:58.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.215+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14208251302507708814', time=2024-09-12T02:54:39.000871+0000, chain.objs.size()=1 2024-09-12T01:10:58.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.215+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.R4ZZtqTdtN0pky4MLw9mhBX1rmTN_Vx_0 2024-09-12T01:10:58.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.216+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11783437450021864467', time=2024-09-12T02:54:39.063095+0000, chain.objs.size()=1 2024-09-12T01:10:58.215 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.216+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.syyWtAoGFgycbVfiVL1aTaklfUkC9Cn_0 2024-09-12T01:10:58.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.218+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2881378599262890116', time=2024-09-12T02:54:39.512510+0000, chain.objs.size()=1 2024-09-12T01:10:58.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.218+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.DhU-nEqwSBESxtX73DZ8bIs1L8O8B-6_0 2024-09-12T01:10:58.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.218+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12998035453797104961', time=2024-09-12T02:54:39.513868+0000, chain.objs.size()=1 2024-09-12T01:10:58.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.218+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.FVNaJIy7C4A6XAUUTT5wroaowbH8vDU_0 2024-09-12T01:10:58.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.218+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14161375282509170807', time=2024-09-12T02:54:39.639321+0000, chain.objs.size()=1 2024-09-12T01:10:58.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.218+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._mP-hJsNpO6ZEk_B85GTfnwb7HGSXZO_0 2024-09-12T01:10:58.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.218+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17507980816441854821', time=2024-09-12T02:54:41.467048+0000, chain.objs.size()=1 2024-09-12T01:10:58.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.218+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.g3sD1GuGpeRx5ySDZf1T8cdetGJj9a6_0 2024-09-12T01:10:58.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.218+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.42696870299223908', time=2024-09-12T02:54:41.579769+0000, chain.objs.size()=1 2024-09-12T01:10:58.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.218+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.njchHVN5rbMaj-ZfgSuzfN0RJ2hUnPq_0 2024-09-12T01:10:58.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.218+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3168636495537986447', time=2024-09-12T02:54:41.702454+0000, chain.objs.size()=1 2024-09-12T01:10:58.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.218+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fEg2yD7Dfgu-B1S9tV5EVOSZnFdYCWJ_0 2024-09-12T01:10:58.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.218+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12348453847332689239', time=2024-09-12T02:54:43.351161+0000, chain.objs.size()=1 2024-09-12T01:10:58.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.218+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6uNCWpxGCbX0Sxa0xQR0rUea89YHk_k_0 2024-09-12T01:10:58.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.220+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7499875600062477046', time=2024-09-12T02:54:44.113026+0000, chain.objs.size()=1 2024-09-12T01:10:58.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.220+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.rQ0x7Ogb9CiIZnyazxN6KrJH-rXYj0f_0 2024-09-12T01:10:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.220+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16589359513536435290', time=2024-09-12T02:54:44.123910+0000, chain.objs.size()=1 2024-09-12T01:10:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.220+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.XmUwVczRhsaReKr692G4jNXYQKAU5yC_0 2024-09-12T01:10:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.220+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15812707006699532582', time=2024-09-12T02:54:44.280051+0000, chain.objs.size()=1 2024-09-12T01:10:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.220+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.askLYjZEAh9dDtjvWRiOr8Q3QZtSvSx_0 2024-09-12T01:10:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.220+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8299423960008009395', time=2024-09-12T02:54:44.380691+0000, chain.objs.size()=1 2024-09-12T01:10:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.220+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.k-kwaMYtSoUYKfBtIT0qrKZ0GCt4qkm_0 2024-09-12T01:10:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.220+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10525635662760470321', time=2024-09-12T02:54:45.097050+0000, chain.objs.size()=1 2024-09-12T01:10:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.220+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ylPfJmp8yK7qdw06qEa63qiLC43iaNX_0 2024-09-12T01:10:58.220 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.221+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1258308466370824931', time=2024-09-12T02:54:46.435378+0000, chain.objs.size()=1 2024-09-12T01:10:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.221+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.UlcknJeS5irWdXoGYSebUUvrzQsOesA_0 2024-09-12T01:10:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.222+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9170501464763994239', time=2024-09-12T02:54:46.436134+0000, chain.objs.size()=1 2024-09-12T01:10:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.222+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.utljMf9lZ8WuY0LCJSBWWx3r_Vv6Qb7_0 2024-09-12T01:10:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.222+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10816208513750034526', time=2024-09-12T02:55:10.486787+0000, chain.objs.size()=1 2024-09-12T01:10:58.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.222+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.374__shadow_.J4l7UCBDZclPdREHlbVvady45TT2o3P_0 2024-09-12T01:10:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.222+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1423348209849906297', time=2024-09-12T02:55:42.784587+0000, chain.objs.size()=1 2024-09-12T01:10:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.222+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.430__shadow_.mINF6rDzobQfKxN-mhGNaixQ1r6NatS_0 2024-09-12T01:10:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.222+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5640671999630294145', time=2024-09-12T02:56:29.490069+0000, chain.objs.size()=1 2024-09-12T01:10:58.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.222+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.504__shadow:IjSk329PwyZ.TikPwkNaT-eseYUSzXd_.b_0nQhQp9blBOoB3SP2J2YjUhbBu0Hw_0 2024-09-12T01:10:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.223+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16939887798311870633', time=2024-09-12T02:59:42.784123+0000, chain.objs.size()=1 2024-09-12T01:10:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.223+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.562__multipart_mymultipart.x2OkOP42_Wo4Pmtzez7Y9SNpMsGb14ry.1 2024-09-12T01:10:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.224+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18082137671471348963', time=2024-09-12T03:00:15.830039+0000, chain.objs.size()=1 2024-09-12T01:10:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.224+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.577__shadow:LymiePkamcsuK6wUU1CkH191wcHmTeE_.Fmp6MbDBIvLN57JDjhmNPdZyvFbEYZa_0 2024-09-12T01:10:58.223 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.224+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8917999074454943115', time=2024-09-12T03:00:17.670516+0000, chain.objs.size()=1 2024-09-12T01:10:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.224+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.577__shadow:UZ8bg3nD26kTzmEFi.vf30P14rFMutP_.8Ms9Ga8Ij4y7CzHQEVApurxRQETBNcO_0 2024-09-12T01:10:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.224+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7396312337022704859', time=2024-09-12T03:01:11.072558+0000, chain.objs.size()=1 2024-09-12T01:10:58.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.224+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.609__shadow_.pXaGcqVVOh0Q6b1qHsBLt9M5jYkH9Yb_0 2024-09-12T01:10:58.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.228+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/50970 2024-09-12T01:10:58.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.230+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:10:58.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.230+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13429807945650404538', time=2024-09-12T03:04:52.859702+0000, chain.objs.size()=1 2024-09-12T01:10:58.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.230+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.632__shadow_.Z6RHynnik2pbtkDFm89QvQrZLluFkbr_0 2024-09-12T01:10:58.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.230+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10068695081929094603', time=2024-09-12T03:05:33.698782+0000, chain.objs.size()=1 2024-09-12T01:10:58.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.230+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.664__shadow_.SM2-yk3YAP4wz1mieGccP2YniqaDXo6_0 2024-09-12T01:10:58.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.230+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13969235137734304876', time=2024-09-12T03:05:56.474360+0000, chain.objs.size()=1 2024-09-12T01:10:58.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.230+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.705__shadow:ZcsVXZYZky6tcM6tJhHKRjI97EwxVFU_.DLVVUEjzOgxAwgjfbLSfo1NpGEI-KWJ_0 2024-09-12T01:10:58.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.232+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.234+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:10:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.235+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:58.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.236+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44473' 2024-09-12T01:10:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='_QxrxaST7m5qYzNqkO_8gPit5IHrYp8c', time=2024-09-12T02:49:19.923837+0000, chain.objs.size()=3 2024-09-12T01:10:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.ZrmjPeIp0WmlNFsdlkn_9C_CaOyRlaq_0 2024-09-12T01:10:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.ZrmjPeIp0WmlNFsdlkn_9C_CaOyRlaq_1 2024-09-12T01:10:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.ZrmjPeIp0WmlNFsdlkn_9C_CaOyRlaq_2 2024-09-12T01:10:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5542756538227221804', time=2024-09-12T02:49:27.396657+0000, chain.objs.size()=5 2024-09-12T01:10:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__multipart_foo-FROZEN.2~_xijjpQHnW3hlBBCUHaSfjPfo7nAXFl.1 2024-09-12T01:10:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_foo-FROZEN.2~_xijjpQHnW3hlBBCUHaSfjPfo7nAXFl.1_1 2024-09-12T01:10:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__multipart_foo-FROZEN.2~_xijjpQHnW3hlBBCUHaSfjPfo7nAXFl.2 2024-09-12T01:10:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_foo-FROZEN.2~_xijjpQHnW3hlBBCUHaSfjPfo7nAXFl.2_1 2024-09-12T01:10:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__multipart_foo-FROZEN.2~_xijjpQHnW3hlBBCUHaSfjPfo7nAXFl.3 2024-09-12T01:10:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='_AfFKMgKXge3jwERNbkxpWH_Nuuuzp1C', time=2024-09-12T02:49:28.229273+0000, chain.objs.size()=1 2024-09-12T01:10:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_.Zz-2E2LhzM4chUx884C7FueTyEkFVLy_0 2024-09-12T01:10:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3058697655842945014', time=2024-09-12T02:49:43.015422+0000, chain.objs.size()=1 2024-09-12T01:10:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.180__shadow_.aaYzCpvCspdfKDfnnJfCVm9gq24sRe9_0 2024-09-12T01:10:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12063753009912120798', time=2024-09-12T02:51:32.985791+0000, chain.objs.size()=1 2024-09-12T01:10:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.243__shadow_.pwEfOB51lpBwpfOrglTFU-jEDd9pvu__0 2024-09-12T01:10:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10497660528695099854', time=2024-09-12T02:51:41.954210+0000, chain.objs.size()=1 2024-09-12T01:10:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.237+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.257__shadow_.IwqWBIz4O5eo9W41u-V1Qx0AjRZVqQZ_0 2024-09-12T01:10:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.239+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2246550391778990061', time=2024-09-12T02:52:21.314914+0000, chain.objs.size()=1 2024-09-12T01:10:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.239+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.FmUoTXmNFSBiMlHTjD0C9foXc80FBia_0 2024-09-12T01:10:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.239+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.425760789822303910', time=2024-09-12T02:52:21.452802+0000, chain.objs.size()=1 2024-09-12T01:10:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.239+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ThnocBjmeK2eoMNrnL9wPOoimnX8PIY_0 2024-09-12T01:10:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4122560704422471756', time=2024-09-12T02:52:21.476508+0000, chain.objs.size()=1 2024-09-12T01:10:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.aOLJVooXu8JFoBHoJ47Z3TN_Xa6M8LZ_0 2024-09-12T01:10:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2627788972424410122', time=2024-09-12T02:52:21.527041+0000, chain.objs.size()=1 2024-09-12T01:10:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.M07A5dM5UsSwFgiYFvyMAs4tf2z0oVM_0 2024-09-12T01:10:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2450396409051349487', time=2024-09-12T02:52:21.598560+0000, chain.objs.size()=1 2024-09-12T01:10:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.evN4olfnw1jFdHnO1_OxOFhsocZb3qS_0 2024-09-12T01:10:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7563382514262709478', time=2024-09-12T02:52:21.734680+0000, chain.objs.size()=1 2024-09-12T01:10:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.m-B3PeuGzWDKYpgSi9CrxcjuUrLps2r_0 2024-09-12T01:10:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1953550508792292598', time=2024-09-12T02:52:22.758012+0000, chain.objs.size()=1 2024-09-12T01:10:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Y-Gtn2emPper34stnwjiidEUs6VVauf_0 2024-09-12T01:10:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4487939777323983122', time=2024-09-12T02:52:22.888604+0000, chain.objs.size()=1 2024-09-12T01:10:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.AEbUrCe6P0U71GuL5O3rdU_fKwHBX69_0 2024-09-12T01:10:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17265827771986563481', time=2024-09-12T02:52:22.889357+0000, chain.objs.size()=1 2024-09-12T01:10:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.woqq_dYQp-m48PUd5FXAR_AC0AYa5bQ_0 2024-09-12T01:10:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10160766876769133974', time=2024-09-12T02:52:23.019726+0000, chain.objs.size()=1 2024-09-12T01:10:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0_2XsRzcHLhVI8qz_-XotnaL74wc3X-_0 2024-09-12T01:10:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2303282783869764919', time=2024-09-12T02:52:23.177505+0000, chain.objs.size()=1 2024-09-12T01:10:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.241+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.S_jK6MgCkHF6MWru094CJ7dj4Poxvll_0 2024-09-12T01:10:58.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.242+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16098810600006086465', time=2024-09-12T02:52:23.568213+0000, chain.objs.size()=1 2024-09-12T01:10:58.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.242+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.gHQcuM6hC22M8HqR0Qot61NjG4EHicj_0 2024-09-12T01:10:58.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.242+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14681756791294326014', time=2024-09-12T02:52:24.185755+0000, chain.objs.size()=1 2024-09-12T01:10:58.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.242+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.UvJVWn00HnVunVqRgnSB-WH_uICacyD_0 2024-09-12T01:10:58.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.244+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4962923281149994762', time=2024-09-12T02:52:24.332414+0000, chain.objs.size()=1 2024-09-12T01:10:58.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.244+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.eWckfP61vX_B9IGIaslnJB-kYJoldzy_0 2024-09-12T01:10:58.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.244+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2855094488659329899', time=2024-09-12T02:52:24.461358+0000, chain.objs.size()=1 2024-09-12T01:10:58.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.244+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.2uWuBG_Fb6DaYp63jvl4dp3w0I7MCb1_0 2024-09-12T01:10:58.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.244+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16421192831155080265', time=2024-09-12T02:52:24.684249+0000, chain.objs.size()=1 2024-09-12T01:10:58.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.244+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.kyJr29N5eBwA7D2oNz92LriBvWHHBWv_0 2024-09-12T01:10:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.245+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.257346970941283580', time=2024-09-12T02:52:25.020110+0000, chain.objs.size()=1 2024-09-12T01:10:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.245+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ReITZy4DyfGPVOAy8syWIjYMrp-Sg8k_0 2024-09-12T01:10:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.245+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16294154265696914100', time=2024-09-12T02:52:25.048213+0000, chain.objs.size()=1 2024-09-12T01:10:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.245+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.LpW1uxWnsOgpMEPgwtp4ZYl3fcmyEUg_0 2024-09-12T01:10:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.245+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7704378647245982693', time=2024-09-12T02:52:25.876923+0000, chain.objs.size()=1 2024-09-12T01:10:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.245+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wwQGBGuClzM2YMUfN_P2S68aU8_iqqv_0 2024-09-12T01:10:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.245+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7827558652609977670', time=2024-09-12T02:52:26.052915+0000, chain.objs.size()=1 2024-09-12T01:10:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.245+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.beTkkcuImTdf-Rs-RwECc5TtPDNmp0Z_0 2024-09-12T01:10:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.245+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10759859776910222636', time=2024-09-12T02:52:26.547918+0000, chain.objs.size()=1 2024-09-12T01:10:58.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.245+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.EEpb4DhyCL757ZOBj6aOaoHgTk7pC_p_0 2024-09-12T01:10:58.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.247+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6103873497772735727', time=2024-09-12T02:52:26.560623+0000, chain.objs.size()=1 2024-09-12T01:10:58.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.247+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pBR9Whma8QO6kVxtrVm9onCHfoPbJEF_0 2024-09-12T01:10:58.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.247+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4552413013040587841', time=2024-09-12T02:52:27.506722+0000, chain.objs.size()=1 2024-09-12T01:10:58.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.247+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ROxE6JmWslfZePaDa-mv7aHxocMUUC0_0 2024-09-12T01:10:58.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.247+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4431915963745211491', time=2024-09-12T02:52:27.714461+0000, chain.objs.size()=1 2024-09-12T01:10:58.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.247+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.orST_NozvIKDVwNFKXOyG1tctjptAY-_0 2024-09-12T01:10:58.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.248+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4389611985096398904', time=2024-09-12T02:52:27.865357+0000, chain.objs.size()=1 2024-09-12T01:10:58.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.248+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.m6uAhzSO2vSdWnuB_z0kJmDbrt2BKGB_0 2024-09-12T01:10:58.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.249+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1476510646579905896', time=2024-09-12T02:52:28.011192+0000, chain.objs.size()=1 2024-09-12T01:10:58.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.249+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.mmbIKQ0n5uNCzR6tp06ISA0gxndv0Mg_0 2024-09-12T01:10:58.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.249+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5009345892935355908', time=2024-09-12T02:52:28.520453+0000, chain.objs.size()=1 2024-09-12T01:10:58.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.249+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.14cf37rNPO3uhIVAiNmrBC8zAZnKg_Q_0 2024-09-12T01:10:58.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.249+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5457909121744067606', time=2024-09-12T02:52:28.585837+0000, chain.objs.size()=1 2024-09-12T01:10:58.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.249+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.bm3wXdIWMj2iTft-Tdf46tz4sOqk-m5_0 2024-09-12T01:10:58.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.250+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8912704231697697443', time=2024-09-12T02:52:28.586653+0000, chain.objs.size()=1 2024-09-12T01:10:58.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.250+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.l45w0esRgI61G34MGumnQ8rgcymLDKL_0 2024-09-12T01:10:58.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.250+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5688209759008454996', time=2024-09-12T02:52:28.649911+0000, chain.objs.size()=1 2024-09-12T01:10:58.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.250+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.-T-637Nx9Xbcl8T6yobOwDpN2kw4aKp_0 2024-09-12T01:10:58.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.251+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3815563413482263187', time=2024-09-12T02:52:28.848207+0000, chain.objs.size()=1 2024-09-12T01:10:58.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.251+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1ebQuXD_z-YmxRWDL1KO0nEI_0-sRuk_0 2024-09-12T01:10:58.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.252+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11308428401677981199', time=2024-09-12T02:52:29.509041+0000, chain.objs.size()=1 2024-09-12T01:10:58.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.252+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.2Rup-INLEGgAv-N85mdoPjzXhZyzCU5_0 2024-09-12T01:10:58.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.252+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1930018860257012806', time=2024-09-12T02:52:29.863184+0000, chain.objs.size()=1 2024-09-12T01:10:58.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.252+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.omS9wuOwEESP8sp3dibDnfF5sigLW6Q_0 2024-09-12T01:10:58.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.252+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3302030975137290996', time=2024-09-12T02:52:30.786992+0000, chain.objs.size()=1 2024-09-12T01:10:58.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.252+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.qh6Sv4F0ayQRYWy8qwSdfmkQvMx5jSI_0 2024-09-12T01:10:58.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.252+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11621100677315640494', time=2024-09-12T02:52:31.117738+0000, chain.objs.size()=1 2024-09-12T01:10:58.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.252+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.8-GbtgV7PFr0-tWRhPY3glf-b9mqYWs_0 2024-09-12T01:10:58.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.252+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2877280506968174502', time=2024-09-12T02:52:31.118607+0000, chain.objs.size()=1 2024-09-12T01:10:58.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.252+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.yiaJtVXMsijDtAd3uWkTb20_2J73hjp_0 2024-09-12T01:10:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.253+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2652644015966434741', time=2024-09-12T02:52:31.299712+0000, chain.objs.size()=1 2024-09-12T01:10:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.253+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._HKWnMImdMmol-4qNj-n-rr0EhhyE1U_0 2024-09-12T01:10:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.253+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.319717941154329455', time=2024-09-12T02:52:31.466337+0000, chain.objs.size()=1 2024-09-12T01:10:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.253+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0sLmHmchnTU4V-UykYgZISNHdv9hv_C_0 2024-09-12T01:10:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.253+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3904975178968520159', time=2024-09-12T02:52:31.768629+0000, chain.objs.size()=1 2024-09-12T01:10:58.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.253+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.v4EwuSyuQq2GaK0og3v-lrCyvLyv60Q_0 2024-09-12T01:10:58.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.253+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7645308524816928935', time=2024-09-12T02:52:31.794743+0000, chain.objs.size()=1 2024-09-12T01:10:58.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.253+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.AOFgqSdE1KtMhbX93wX9YHXvDG14WhG_0 2024-09-12T01:10:58.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.254+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3203697393248485490', time=2024-09-12T02:52:31.831325+0000, chain.objs.size()=1 2024-09-12T01:10:58.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.254+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.n-kKn5ioPZtK5ihIuMDdo7_9fD7LsNX_0 2024-09-12T01:10:58.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.254+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4696855819826147751', time=2024-09-12T02:52:31.961012+0000, chain.objs.size()=1 2024-09-12T01:10:58.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.254+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uPKHsM2lGH4F4HFvdkEzxyVb--XeH9k_0 2024-09-12T01:10:58.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.256+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17701054827558780462', time=2024-09-12T02:52:36.487958+0000, chain.objs.size()=1 2024-09-12T01:10:58.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.256+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.271__shadow_.rmUQ6Rc0vSZ8XXwM4ze21mNjOzSwAWZ_0 2024-09-12T01:10:58.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6931488329272905539', time=2024-09-12T02:52:36.492485+0000, chain.objs.size()=1 2024-09-12T01:10:58.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.271__shadow_.XUXCKbxD79esiSy7BnTz9X3nTxMzsTg_0 2024-09-12T01:10:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13354281950306592661', time=2024-09-12T02:52:43.020109+0000, chain.objs.size()=1 2024-09-12T01:10:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.282__shadow_.FKdAN5evGLKIK4JUzN0ZcOBNoZLUQCY_0 2024-09-12T01:10:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2132009490825373915', time=2024-09-12T02:52:46.140286+0000, chain.objs.size()=1 2024-09-12T01:10:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.287__shadow_.2gAD0fKq7OaCPh60gMICM8DnOpMRvLF_0 2024-09-12T01:10:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16469362868354149253', time=2024-09-12T02:52:51.126684+0000, chain.objs.size()=1 2024-09-12T01:10:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.Of2OXxtKwWpLyKumiM5m6E4fnB23KyR_0 2024-09-12T01:10:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14861102184204456647', time=2024-09-12T02:52:58.253506+0000, chain.objs.size()=1 2024-09-12T01:10:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.302__shadow_.Dr6VPM0T39xp_yYYQ6FNCHwswCaokuA_0 2024-09-12T01:10:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16577768457150678246', time=2024-09-12T02:53:49.656554+0000, chain.objs.size()=1 2024-09-12T01:10:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Ea_NhqBtd9NE5rUzHXNxdygfm10TGx2_0 2024-09-12T01:10:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.615094694822545390', time=2024-09-12T02:53:49.736643+0000, chain.objs.size()=1 2024-09-12T01:10:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.MgN5dJBCmrLQNDZMrSlD6WqUVBj35jI_0 2024-09-12T01:10:58.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6513933604689617110', time=2024-09-12T02:53:49.844300+0000, chain.objs.size()=1 2024-09-12T01:10:58.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.sZEdGBWQyHmghDXvi2U-7iAqIFRpion_0 2024-09-12T01:10:58.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16152571504309862169', time=2024-09-12T02:53:49.989231+0000, chain.objs.size()=1 2024-09-12T01:10:58.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cMeJZrQVSesLNJ0W6_DhNGxdZAjlj1T_0 2024-09-12T01:10:58.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.39818094401798476', time=2024-09-12T02:53:50.110562+0000, chain.objs.size()=1 2024-09-12T01:10:58.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hmneOD0fQGGSOIAq7D1vIaJezzt3pTm_0 2024-09-12T01:10:58.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15450556342096732737', time=2024-09-12T02:53:50.247055+0000, chain.objs.size()=1 2024-09-12T01:10:58.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.258+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.p7vpMPozeByiqPX5chT19qsTRqwfMg-_0 2024-09-12T01:10:58.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.261+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14277446554563191920', time=2024-09-12T02:53:51.484441+0000, chain.objs.size()=1 2024-09-12T01:10:58.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.261+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nL0Yh1_p1j19F426zzNwKVBIBFGHr_7_0 2024-09-12T01:10:58.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.262+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5233927087947914566', time=2024-09-12T02:53:52.642947+0000, chain.objs.size()=1 2024-09-12T01:10:58.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.262+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.y6JrUj5ngxuJDUyLZcIbfqpE7_L-Gfk_0 2024-09-12T01:10:58.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.262+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6976957435824581096', time=2024-09-12T02:53:53.110499+0000, chain.objs.size()=1 2024-09-12T01:10:58.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.262+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.9XmvY5RWMtskyeF5tIliE4QvOaIvf_j_0 2024-09-12T01:10:58.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.262+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13804869123129858646', time=2024-09-12T02:53:53.111076+0000, chain.objs.size()=1 2024-09-12T01:10:58.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.262+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.otnr8NIPHO0tY4KECsZ0VtaB60gj36q_0 2024-09-12T01:10:58.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.262+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1358580403643630409', time=2024-09-12T02:53:53.764991+0000, chain.objs.size()=1 2024-09-12T01:10:58.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.262+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ZSx4ZEVailWt7owokynDFd0AaPm3udU_0 2024-09-12T01:10:58.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.262+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5262081370796092005', time=2024-09-12T02:53:53.919339+0000, chain.objs.size()=1 2024-09-12T01:10:58.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.262+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tlEbTmxPOMgqzb94QJiAeqtb_oiO3S1_0 2024-09-12T01:10:58.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.262+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13326299360119649378', time=2024-09-12T02:53:53.920186+0000, chain.objs.size()=1 2024-09-12T01:10:58.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.262+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.d3Q8n_FBKcCNSItbe0obX2_mVEm54WL_0 2024-09-12T01:10:58.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.264+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12422741389902657445', time=2024-09-12T02:53:54.016304+0000, chain.objs.size()=1 2024-09-12T01:10:58.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.264+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.as7xCJIrprNrJML-nuLPkE1u2g_QzZY_0 2024-09-12T01:10:58.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.264+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8197947358733521360', time=2024-09-12T02:53:54.109044+0000, chain.objs.size()=1 2024-09-12T01:10:58.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.264+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hSHBdmyjY5cTfrtd8uH0-2FcA9wI6FW_0 2024-09-12T01:10:58.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.264+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3187458014149412013', time=2024-09-12T02:53:54.109781+0000, chain.objs.size()=1 2024-09-12T01:10:58.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.264+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5jcR6OOBlD-1f9A_OPcLyFQnXt1N8Be_0 2024-09-12T01:10:58.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.264+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9931220972096485687', time=2024-09-12T02:53:54.414600+0000, chain.objs.size()=1 2024-09-12T01:10:58.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.264+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Niyqa3u8o-L_ylEUY5fBcN-o4nq5bZa_0 2024-09-12T01:10:58.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.265+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9958759177867172421', time=2024-09-12T02:53:54.530284+0000, chain.objs.size()=1 2024-09-12T01:10:58.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.265+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.uFNARPbK_jBsq442jPjdFW1SsRTzrJV_0 2024-09-12T01:10:58.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.266+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8140187911666046116', time=2024-09-12T02:53:55.112145+0000, chain.objs.size()=1 2024-09-12T01:10:58.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.266+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.92pmmCnjHb7P5QyXsmvr-2Tg6Dw0jb3_0 2024-09-12T01:10:58.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.266+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17360485449432227714', time=2024-09-12T02:53:55.112783+0000, chain.objs.size()=1 2024-09-12T01:10:58.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.266+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.aYjQxGVLRbbJEbqm77QmegKU-8HvCIo_0 2024-09-12T01:10:58.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.266+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7178271805615239369', time=2024-09-12T02:53:55.187519+0000, chain.objs.size()=1 2024-09-12T01:10:58.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.266+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.zp0Slpm-s4ztQDCb8YWJfD-euJPtMJX_0 2024-09-12T01:10:58.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.267+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4772341684828977611', time=2024-09-12T02:53:55.308483+0000, chain.objs.size()=1 2024-09-12T01:10:58.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.267+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.OPwVeyohF4mDtoWwUKFS8VvoLkOW3vR_0 2024-09-12T01:10:58.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.267+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10562595103344054363', time=2024-09-12T02:53:55.398083+0000, chain.objs.size()=1 2024-09-12T01:10:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.267+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qIhDgYyCywoZchFoQuqaL_BrZcgAJOw_0 2024-09-12T01:10:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.267+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9512387389518364004', time=2024-09-12T02:53:55.426426+0000, chain.objs.size()=1 2024-09-12T01:10:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.267+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.XiYFW6oLSeUu3bzPXsm_RR8oVs8jaM6_0 2024-09-12T01:10:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.267+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15838917874652625975', time=2024-09-12T02:53:55.547698+0000, chain.objs.size()=1 2024-09-12T01:10:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.267+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.mvtdDzrq294XlUYzbphfcsu9TQgQ0d0_0 2024-09-12T01:10:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.267+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7402297893235685251', time=2024-09-12T02:53:55.907027+0000, chain.objs.size()=1 2024-09-12T01:10:58.269 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.267+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.kEY7wGfxDvhwp3rt9kklkzttZJ7RA0F_0 2024-09-12T01:10:58.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.268+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15890940272112075146', time=2024-09-12T02:53:56.355801+0000, chain.objs.size()=1 2024-09-12T01:10:58.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.268+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.6jdCqcemMFaVVWK7oFVGb75CJkG7K7f_0 2024-09-12T01:10:58.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.268+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4493729653295669348', time=2024-09-12T02:53:56.776760+0000, chain.objs.size()=1 2024-09-12T01:10:58.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.268+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.gkO4Qg7k7grq8Jhu91Zu1gRfnxQo6Cy_0 2024-09-12T01:10:58.270 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.270+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4195734506012453778', time=2024-09-12T02:53:57.358727+0000, chain.objs.size()=1 2024-09-12T01:10:58.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.270+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dMDu5jgCY0MtOFw11wIfPGw448n6JF5_0 2024-09-12T01:10:58.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.270+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7929470002466189643', time=2024-09-12T02:53:57.731423+0000, chain.objs.size()=1 2024-09-12T01:10:58.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.270+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.GVjMWL4UtSAvLF-07qybhXWWO_hVfBs_0 2024-09-12T01:10:58.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.270+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17401865577681110189', time=2024-09-12T02:53:57.896897+0000, chain.objs.size()=1 2024-09-12T01:10:58.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.270+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.GImbPXrDoibkqL4eU5j9baBKmylPKBV_0 2024-09-12T01:10:58.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.271+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16818997451488497345', time=2024-09-12T02:53:58.270603+0000, chain.objs.size()=1 2024-09-12T01:10:58.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.271+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.rDpkcIm-YYH1VyTCWJfc9eiF_aLDPcr_0 2024-09-12T01:10:58.273 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.271+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6172986534920876181', time=2024-09-12T02:53:58.439247+0000, chain.objs.size()=1 2024-09-12T01:10:58.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.271+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.j8VAdUmmw0OJ_eEi3NpD7g4KnfqS5YW_0 2024-09-12T01:10:58.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.271+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4118278695893943510', time=2024-09-12T02:53:58.948019+0000, chain.objs.size()=1 2024-09-12T01:10:58.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.271+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.T7tyk_AEsv1hPBwFWV82ODdKrLy_NXQ_0 2024-09-12T01:10:58.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.273+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2491182953142469173', time=2024-09-12T02:53:59.008403+0000, chain.objs.size()=1 2024-09-12T01:10:58.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.273+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.G9YM2pBAICI9MihpkZ6sABL_zbwSj-C_0 2024-09-12T01:10:58.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.273+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13931429201864591429', time=2024-09-12T02:53:59.419487+0000, chain.objs.size()=1 2024-09-12T01:10:58.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.273+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ACDc_EtE-7WGniXAfsze-gEM439lZqv_0 2024-09-12T01:10:58.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.273+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11175115754730972280', time=2024-09-12T02:53:59.734192+0000, chain.objs.size()=1 2024-09-12T01:10:58.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.273+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.v9sjTG1utX68AbIHfE7-vNcqU_-aBfi_0 2024-09-12T01:10:58.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.273+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18009676623134267606', time=2024-09-12T02:54:36.843925+0000, chain.objs.size()=1 2024-09-12T01:10:58.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.273+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Z1Z84281rv4ZlPjnB8Mq-VL8pyh5FB6_0 2024-09-12T01:10:58.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.273+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9065007852221894058', time=2024-09-12T02:54:36.887416+0000, chain.objs.size()=1 2024-09-12T01:10:58.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.273+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Ji83hYx-tTsR8dmxnPQNuFdAVChNWGt_0 2024-09-12T01:10:58.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.273+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8453364888565185371', time=2024-09-12T02:54:36.946111+0000, chain.objs.size()=1 2024-09-12T01:10:58.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.273+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.7ay4Gjm_PG37ewzRmfKPSBUEfWj5E22_0 2024-09-12T01:10:58.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.274+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15335152839603623298', time=2024-09-12T02:54:36.994543+0000, chain.objs.size()=1 2024-09-12T01:10:58.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.274+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.JnmRrmH8X0NOi0CPf58De4MXLZHeV3v_0 2024-09-12T01:10:58.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.274+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6224094309789824975', time=2024-09-12T02:54:37.372504+0000, chain.objs.size()=1 2024-09-12T01:10:58.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.274+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Es8ME8jInMOg6kJ9xAa4I7KRm6SVmIu_0 2024-09-12T01:10:58.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.276+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17163254487328170635', time=2024-09-12T02:54:37.640451+0000, chain.objs.size()=1 2024-09-12T01:10:58.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.276+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.55bp1rR6mlXVRv_3sIGG8ctjYQcb4HG_0 2024-09-12T01:10:58.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.276+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1882697182374449621', time=2024-09-12T02:54:38.088689+0000, chain.objs.size()=1 2024-09-12T01:10:58.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.276+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.uTXNY7cnhea0opes4xWP5T-e4UTnHYC_0 2024-09-12T01:10:58.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.276+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13939124645183361223', time=2024-09-12T02:54:38.207974+0000, chain.objs.size()=1 2024-09-12T01:10:58.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.276+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.n-fZVoNSXJnUFNsm1QajLZBxxqnZJyW_0 2024-09-12T01:10:58.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.279+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5999831486014441279', time=2024-09-12T02:54:38.516614+0000, chain.objs.size()=1 2024-09-12T01:10:58.279 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.279+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.jr-zr-GKOqfUcVwMOlLzZTL6BIi7grG_0 2024-09-12T01:10:58.280 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.280+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/44473 2024-09-12T01:10:58.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=39, truncated=0, next_marker='' 2024-09-12T01:10:58.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16066185283492007267', time=2024-09-12T02:54:38.517531+0000, chain.objs.size()=1 2024-09-12T01:10:58.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.2xmMM9p775K_m5a3FX04J3R4pExXbnW_0 2024-09-12T01:10:58.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1957309059790367576', time=2024-09-12T02:54:38.872192+0000, chain.objs.size()=1 2024-09-12T01:10:58.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.kR1lGl1G-4Y1zAHaFAPctzSxMcXAJB6_0 2024-09-12T01:10:58.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1400524246466458090', time=2024-09-12T02:54:39.005555+0000, chain.objs.size()=1 2024-09-12T01:10:58.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.UkwudCBbTYU5sShe0UVkKu_k2aJlyD7_0 2024-09-12T01:10:58.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7699768717545764994', time=2024-09-12T02:54:39.526564+0000, chain.objs.size()=1 2024-09-12T01:10:58.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.4pNICSKfNvrhuWjgipmbTiDLa_8SELL_0 2024-09-12T01:10:58.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13530061614136839539', time=2024-09-12T02:54:39.527368+0000, chain.objs.size()=1 2024-09-12T01:10:58.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.c--b_b9pAt6FgX0v0vWpK1IZclJwHzI_0 2024-09-12T01:10:58.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10386509367011726854', time=2024-09-12T02:54:39.810014+0000, chain.objs.size()=1 2024-09-12T01:10:58.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.m89nmTON1fvIYvgb-_FA4JgEbWfGAHK_0 2024-09-12T01:10:58.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17440419481516135789', time=2024-09-12T02:54:39.856211+0000, chain.objs.size()=1 2024-09-12T01:10:58.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.iP0ZRlRTxgv_LoXhZXYR-7244omAzH__0 2024-09-12T01:10:58.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16099821690464419249', time=2024-09-12T02:54:40.084232+0000, chain.objs.size()=1 2024-09-12T01:10:58.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.7XRv7Lw_4IgyouM6lROl8ITgUgs4AY2_0 2024-09-12T01:10:58.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16849998138812271694', time=2024-09-12T02:54:40.120061+0000, chain.objs.size()=1 2024-09-12T01:10:58.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.tfQizaIpEPvh55acxrDxu5Dr4yZ50KX_0 2024-09-12T01:10:58.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6046596024969446344', time=2024-09-12T02:54:41.134580+0000, chain.objs.size()=1 2024-09-12T01:10:58.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.qwvMKZYvMyFPIeEVkvTzJyemOq21YsD_0 2024-09-12T01:10:58.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.309111627543847338', time=2024-09-12T02:54:41.579233+0000, chain.objs.size()=1 2024-09-12T01:10:58.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.KqqTYjpggaX0eVYE4N6N-4BhZaC0I6q_0 2024-09-12T01:10:58.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1298520466043231738', time=2024-09-12T02:54:42.373648+0000, chain.objs.size()=1 2024-09-12T01:10:58.285 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.283+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dqbBZNcDDQsCOYobv_tbn7UwwWh4j5H_0 2024-09-12T01:10:58.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.286+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.228663419426443861', time=2024-09-12T02:54:42.374383+0000, chain.objs.size()=1 2024-09-12T01:10:58.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.286+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.VioPjfR32lo95hDqBNhJ971gSkXRK1S_0 2024-09-12T01:10:58.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10541860043716380046', time=2024-09-12T02:54:42.375124+0000, chain.objs.size()=1 2024-09-12T01:10:58.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.3b-nEWnrKxtMMC2LjN_XZMFReEePoTx_0 2024-09-12T01:10:58.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2925791855004257398', time=2024-09-12T02:54:42.836861+0000, chain.objs.size()=1 2024-09-12T01:10:58.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.EJlJtUoWKq5SB0jvocqNxXEJAbB5489_0 2024-09-12T01:10:58.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3695847313464172970', time=2024-09-12T02:54:43.432047+0000, chain.objs.size()=1 2024-09-12T01:10:58.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Xgio44p9_FnYKfN0-CbVLIQy5qLbk8n_0 2024-09-12T01:10:58.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12217510602060606452', time=2024-09-12T02:54:43.495788+0000, chain.objs.size()=1 2024-09-12T01:10:58.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.IwRgqlU-9iGL9zRT9dJHEBIKRwK9_Y4_0 2024-09-12T01:10:58.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12848198969840984573', time=2024-09-12T02:54:43.977215+0000, chain.objs.size()=1 2024-09-12T01:10:58.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.oBYigdrmSKTubbwKc5IDEOF-CG3xnXR_0 2024-09-12T01:10:58.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16859741580298186634', time=2024-09-12T02:54:44.126849+0000, chain.objs.size()=1 2024-09-12T01:10:58.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.QE0ixDOmkVpWfGfNDbKFClDw5Wqu4yZ_0 2024-09-12T01:10:58.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2693424772543850398', time=2024-09-12T02:54:44.311532+0000, chain.objs.size()=1 2024-09-12T01:10:58.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.1qvVRbZ0OevPRO1shtUMxGxJnJz3s6r_0 2024-09-12T01:10:58.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12682912229449800959', time=2024-09-12T02:54:44.795952+0000, chain.objs.size()=1 2024-09-12T01:10:58.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ytRwqwZk2mBPcglMc4dIN4BSPE6bTEA_0 2024-09-12T01:10:58.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1021880555043562773', time=2024-09-12T02:54:45.127262+0000, chain.objs.size()=1 2024-09-12T01:10:58.288 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.T3tS5V-76yar95Duxousn1j4cW0YFXW_0 2024-09-12T01:10:58.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1754822880607440387', time=2024-09-12T02:54:45.248893+0000, chain.objs.size()=1 2024-09-12T01:10:58.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.287+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.EFukacqlmNMFNcdwvaDx1GGZ1tD2R48_0 2024-09-12T01:10:58.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.289+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13249557130041730986', time=2024-09-12T02:54:45.249674+0000, chain.objs.size()=1 2024-09-12T01:10:58.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.289+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.hbl0nJSRB14GTbo5Zp6ixFaSiLQ90MG_0 2024-09-12T01:10:58.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.290+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14195279330315556532', time=2024-09-12T02:54:45.602216+0000, chain.objs.size()=1 2024-09-12T01:10:58.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.290+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fu5WK4QcllfYW8bGMuaGXoZBui-vgbd_0 2024-09-12T01:10:58.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.290+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2999357740784463607', time=2024-09-12T02:54:45.705292+0000, chain.objs.size()=1 2024-09-12T01:10:58.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.290+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.wtws7SoEF90Ey2leIqAe2_hYsG2f9Eg_0 2024-09-12T01:10:58.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.291+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9262472621290304672', time=2024-09-12T02:54:46.058484+0000, chain.objs.size()=1 2024-09-12T01:10:58.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.291+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.UVkD883VqrJ4fhObGOwaNVAM6u84mdv_0 2024-09-12T01:10:58.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.291+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17081125054793523947', time=2024-09-12T02:54:46.469975+0000, chain.objs.size()=1 2024-09-12T01:10:58.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.291+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Zf9DU9XdJ1kdcFDXQb1MD_pwNNY966p_0 2024-09-12T01:10:58.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.291+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2586110384562552901', time=2024-09-12T02:54:47.073846+0000, chain.objs.size()=1 2024-09-12T01:10:58.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.291+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Rr4lpLwqrmWWJ8u-mX40UCnSOH1pkXd_0 2024-09-12T01:10:58.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.293+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2217524066979311135', time=2024-09-12T02:54:57.498611+0000, chain.objs.size()=1 2024-09-12T01:10:58.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.293+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.345__shadow_.Sbes5zS7PRfSmmGblF5KC6G4P2Abnit_0 2024-09-12T01:10:58.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.293+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2858051291838214633', time=2024-09-12T02:55:17.534617+0000, chain.objs.size()=1 2024-09-12T01:10:58.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.293+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.384__shadow_.N76YAua6IV6RnaQgNrLXvfBTONP4tbJ_0 2024-09-12T01:10:58.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.293+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6449221590545110162', time=2024-09-12T02:55:58.054063+0000, chain.objs.size()=1 2024-09-12T01:10:58.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.293+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.456__shadow_.TOXExazyshKhtnaNWANL3X7Xicb1T6Q_0 2024-09-12T01:10:58.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.293+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5269667308771745617', time=2024-09-12T02:56:14.334953+0000, chain.objs.size()=1 2024-09-12T01:10:58.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.293+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.484__shadow_.flUWbIWYang190JehSD4HgX1r2xdFYR_0 2024-09-12T01:10:58.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.293+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.834048272555161949', time=2024-09-12T02:56:23.295678+0000, chain.objs.size()=1 2024-09-12T01:10:58.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.293+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.494__shadow_.8Ti_cSDsjVjBEdqsK6LyHKUMdC2srb5_0 2024-09-12T01:10:58.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.293+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9929651617420340605', time=2024-09-12T02:59:49.497193+0000, chain.objs.size()=1 2024-09-12T01:10:58.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.293+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.565__shadow_.g_pIRbEuftTVk53GktQ8Jrgr3Q-Oisd_0 2024-09-12T01:10:58.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.294+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14293479395658680863', time=2024-09-12T03:00:03.833063+0000, chain.objs.size()=1 2024-09-12T01:10:58.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.294+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.571__shadow:KcRzGNks2dpMXBGlvutEyFo3gyqQnRI_.nWD4ibPZBb9du096YNa8oqs-1hjynuQ_0 2024-09-12T01:10:58.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.294+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6082356131647472175', time=2024-09-12T03:05:33.703671+0000, chain.objs.size()=1 2024-09-12T01:10:58.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.294+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.664__shadow_.kyY7P3vPeRKhMqLYAEsiXDiMfxyBmem_0 2024-09-12T01:10:58.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.295+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18267163254620011588', time=2024-09-12T03:05:42.871729+0000, chain.objs.size()=1 2024-09-12T01:10:58.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.295+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.680__shadow_.I5_NazeNJ6b8Jsn_7cFAQ4XvdUkeL4s_0 2024-09-12T01:10:58.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.295+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12052318282969340342', time=2024-09-12T03:05:57.676697+0000, chain.objs.size()=1 2024-09-12T01:10:58.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.295+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.707__shadow_.QJ_ZpT6J0bg1LhTYW2cJ4jZnAQmnrui_0 2024-09-12T01:10:58.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.299+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:58.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.301+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:10:58.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.303+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:58.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.304+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:58.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/59770' 2024-09-12T01:10:58.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='_z9ImUiq7QYv21bnrrYD2S5u1ouRB3WQ', time=2024-09-12T02:49:21.915203+0000, chain.objs.size()=3 2024-09-12T01:10:58.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.VeBRH_-zqY3s0d42h2dN5dpfXoDjS2s_0 2024-09-12T01:10:58.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.VeBRH_-zqY3s0d42h2dN5dpfXoDjS2s_1 2024-09-12T01:10:58.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.VeBRH_-zqY3s0d42h2dN5dpfXoDjS2s_2 2024-09-12T01:10:58.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='_7mRvSdvoBxelavwESwabmD2TIthD-iZ', time=2024-09-12T02:49:23.432909+0000, chain.objs.size()=1 2024-09-12T01:10:58.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_.0sas5FmY9AsoHrvvA1JrcKlDHAmByw8_0 2024-09-12T01:10:58.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13833556344722989348', time=2024-09-12T02:51:29.118417+0000, chain.objs.size()=1 2024-09-12T01:10:58.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.237__shadow_.JpqQ2RPkKY5SKd9K0Aj-mkt-rZjf8rd_0 2024-09-12T01:10:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1693848659721629719', time=2024-09-12T02:51:38.899905+0000, chain.objs.size()=1 2024-09-12T01:10:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.252__shadow_.6J4ybAqhtE_NgvGfS2uUxnNjEAGbctY_0 2024-09-12T01:10:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15661913903634052949', time=2024-09-12T02:51:41.335520+0000, chain.objs.size()=1 2024-09-12T01:10:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.256__shadow_.dNzfDM_xNWWmbkELQosBvL4aU8HEuXb_0 2024-09-12T01:10:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3031172547677521127', time=2024-09-12T02:51:44.281611+0000, chain.objs.size()=1 2024-09-12T01:10:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.261__shadow_.levi5PxDEPwe6FAT9nQGsvN72H4mNOi_0 2024-09-12T01:10:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11860278460825653565', time=2024-09-12T02:52:21.217689+0000, chain.objs.size()=1 2024-09-12T01:10:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.HiEEpW5BFf7YlE5XZ2xTHwFTDnid1D-_0 2024-09-12T01:10:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11372189884876929963', time=2024-09-12T02:52:21.290903+0000, chain.objs.size()=1 2024-09-12T01:10:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5t2p2UIffLaFpmxA1r1Ur2GzcFKRHCe_0 2024-09-12T01:10:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13669121704594100663', time=2024-09-12T02:52:22.764728+0000, chain.objs.size()=1 2024-09-12T01:10:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.YWSCNwvI6BcszTb4n1bU9cuOtWUUNdi_0 2024-09-12T01:10:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10807362547063502758', time=2024-09-12T02:52:23.262461+0000, chain.objs.size()=1 2024-09-12T01:10:58.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.305+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._0s12kDmO49J9KphLapIUGcmsweTmmu_0 2024-09-12T01:10:58.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.307+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12018222819857560109', time=2024-09-12T02:52:23.290417+0000, chain.objs.size()=1 2024-09-12T01:10:58.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.307+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.X8W6QsBINIfqjM2ioDezUIsPJcziBOt_0 2024-09-12T01:10:58.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9111359205647223758', time=2024-09-12T02:52:23.446128+0000, chain.objs.size()=1 2024-09-12T01:10:58.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xjHp7f6-Yw-rIrV8R_g6_EPi-b3gDMl_0 2024-09-12T01:10:58.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6799774779883298946', time=2024-09-12T02:52:23.616423+0000, chain.objs.size()=1 2024-09-12T01:10:58.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.XahgIacZHun54wm-Vxva53A26M4WQEi_0 2024-09-12T01:10:58.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3801083803629501396', time=2024-09-12T02:52:24.274238+0000, chain.objs.size()=1 2024-09-12T01:10:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.I6DKyY__oMnUi4x0riPY_IUZsY6aH7R_0 2024-09-12T01:10:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11554923434349469881', time=2024-09-12T02:52:24.295770+0000, chain.objs.size()=1 2024-09-12T01:10:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.QoK1GbJZKVCgDXrseoZGivIbx6HtBPd_0 2024-09-12T01:10:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13750221545953995166', time=2024-09-12T02:52:24.722759+0000, chain.objs.size()=1 2024-09-12T01:10:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xlC2QeRyrL4DzLb8qbSYicUf9EVaewI_0 2024-09-12T01:10:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2752392710458815445', time=2024-09-12T02:52:24.906565+0000, chain.objs.size()=1 2024-09-12T01:10:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.7Nd4CJopZCXGA4eF0Q-MRnWAt0vIOAt_0 2024-09-12T01:10:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13271526592257377810', time=2024-09-12T02:52:25.060255+0000, chain.objs.size()=1 2024-09-12T01:10:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.dJioZBzL0swBnUCrZ9SETgMEPPORyUD_0 2024-09-12T01:10:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17025521769048493294', time=2024-09-12T02:52:25.198250+0000, chain.objs.size()=1 2024-09-12T01:10:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.DFtYnYMWtYZICEbBPWcH_9EtucR9_nu_0 2024-09-12T01:10:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2987722295564343053', time=2024-09-12T02:52:25.597178+0000, chain.objs.size()=1 2024-09-12T01:10:58.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.oFhrBPETo33JwMGCVG4pPFgcVUlns9s_0 2024-09-12T01:10:58.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5335958227526912138', time=2024-09-12T02:52:26.162403+0000, chain.objs.size()=1 2024-09-12T01:10:58.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.309+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5rCtcnL6Nf79T0BqH_T8c_wSTD9AA4O_0 2024-09-12T01:10:58.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.311+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5053982168746284499', time=2024-09-12T02:52:26.229698+0000, chain.objs.size()=1 2024-09-12T01:10:58.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.311+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.hPw_mPo0Qff3nCCV_UjjbNdhe8VMxr9_0 2024-09-12T01:10:58.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.311+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11657026953283735365', time=2024-09-12T02:52:26.316355+0000, chain.objs.size()=1 2024-09-12T01:10:58.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.311+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4jOi7suamc_CYLzQRR8y5l4L9yndpa4_0 2024-09-12T01:10:58.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.312+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8336385380587027909', time=2024-09-12T02:52:27.091913+0000, chain.objs.size()=1 2024-09-12T01:10:58.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.312+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ofdO5udu751AHH_0EIQiIZw3xwJHwCM_0 2024-09-12T01:10:58.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.313+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13294835755450709090', time=2024-09-12T02:52:27.387469+0000, chain.objs.size()=1 2024-09-12T01:10:58.312 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.313+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ez8x-RbwUhRlhN4tH2DiDTKtm37Roif_0 2024-09-12T01:10:58.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.313+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14161975906173401724', time=2024-09-12T02:52:27.830328+0000, chain.objs.size()=1 2024-09-12T01:10:58.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.313+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.3wOtn31anlpjsWjN5bcuqg8-9Yx45uY_0 2024-09-12T01:10:58.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.313+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8382218956620602526', time=2024-09-12T02:52:28.550781+0000, chain.objs.size()=1 2024-09-12T01:10:58.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.313+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.2FT2fX7RXG1eFZjua3hSC71liD8KxIy_0 2024-09-12T01:10:58.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.313+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3832863458087643759', time=2024-09-12T02:52:28.784954+0000, chain.objs.size()=1 2024-09-12T01:10:58.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.313+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.NNauBFkmQGhaLuTFeUL16WbvGFX4SRp_0 2024-09-12T01:10:58.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.313+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6834994199634737090', time=2024-09-12T02:52:29.510367+0000, chain.objs.size()=1 2024-09-12T01:10:58.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.313+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.H_ObNgi577PRM1OV19Y20aB3ZPtyWg2_0 2024-09-12T01:10:58.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.313+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14816238088660437486', time=2024-09-12T02:52:30.087357+0000, chain.objs.size()=1 2024-09-12T01:10:58.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.313+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.jZ0odSis-sofXyTMB9OfYpuL6gJfQWR_0 2024-09-12T01:10:58.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.313+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13117458467248353838', time=2024-09-12T02:52:30.373713+0000, chain.objs.size()=1 2024-09-12T01:10:58.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.313+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.iZn-W_vGdnSSgC62bNO4DAL-pSpYkcz_0 2024-09-12T01:10:58.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.314+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2366822556974411898', time=2024-09-12T02:52:30.545617+0000, chain.objs.size()=1 2024-09-12T01:10:58.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.314+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.7YWSZsp8l_Jcyc40woPjwPyQzU1hyHJ_0 2024-09-12T01:10:58.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.315+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7519058676145187404', time=2024-09-12T02:52:30.597763+0000, chain.objs.size()=1 2024-09-12T01:10:58.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.315+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5vdHv7nH39cjZ1T1uU5KZQ9y2q8-50h_0 2024-09-12T01:10:58.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.315+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14368759268123058057', time=2024-09-12T02:52:31.125375+0000, chain.objs.size()=1 2024-09-12T01:10:58.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.315+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xu3DJZqo8R9UNIPxql1O4zkblbIP4iY_0 2024-09-12T01:10:58.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.315+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9161645604542875500', time=2024-09-12T02:52:31.506492+0000, chain.objs.size()=1 2024-09-12T01:10:58.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.315+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.jPzxhoL5eYx1eXmp3WIGM3GzqeCZUIZ_0 2024-09-12T01:10:58.316 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.317+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8569656869978280365', time=2024-09-12T02:52:31.604856+0000, chain.objs.size()=1 2024-09-12T01:10:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.317+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.XIT678Ifuzbo1tcKVls_fkgvaxg11fo_0 2024-09-12T01:10:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.317+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12232083123527509', time=2024-09-12T02:52:31.858351+0000, chain.objs.size()=1 2024-09-12T01:10:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.317+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.jfZ54c6diwzMa_vuBCtI6PYaFpb_hnD_0 2024-09-12T01:10:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.317+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9199403921737527319', time=2024-09-12T02:52:31.858870+0000, chain.objs.size()=1 2024-09-12T01:10:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.317+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wxh4Drt4FDA_ItootL0g9hPIey16MB7_0 2024-09-12T01:10:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.317+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.891216727497937981', time=2024-09-12T02:52:53.174852+0000, chain.objs.size()=1 2024-09-12T01:10:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.317+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.ufDs94VeOVU6TDPELLJALauaqpY-9hh_0 2024-09-12T01:10:58.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.318+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12485930912125921483', time=2024-09-12T02:52:56.386408+0000, chain.objs.size()=1 2024-09-12T01:10:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.318+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.299__shadow_.SsQGjhSD7961jmpfK-xuIruOYAJjDQR_0 2024-09-12T01:10:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.318+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2258841827520037584', time=2024-09-12T02:53:00.685066+0000, chain.objs.size()=1 2024-09-12T01:10:58.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.318+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.306__shadow_.AjRMYQUzwtzrboXNgnzwoRC5FpPnmUZ_0 2024-09-12T01:10:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.319+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1202461374899365188', time=2024-09-12T02:53:49.706876+0000, chain.objs.size()=1 2024-09-12T01:10:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.319+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.krI2u54ejpFXzWXljW_WN91FUHekQp-_0 2024-09-12T01:10:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.320+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15840410099702501109', time=2024-09-12T02:53:50.365251+0000, chain.objs.size()=1 2024-09-12T01:10:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.320+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.CFvC6HRbdlVtTQ-9GJy9W2GA_VHcZ5k_0 2024-09-12T01:10:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.320+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11318414119870019499', time=2024-09-12T02:53:51.308995+0000, chain.objs.size()=1 2024-09-12T01:10:58.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.320+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.7-i_m087EYis2bG0ryLzGNMBCoaiWMt_0 2024-09-12T01:10:58.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.321+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8596608597670203287', time=2024-09-12T02:53:51.409592+0000, chain.objs.size()=1 2024-09-12T01:10:58.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.321+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.eJTVY2DqqgwMYyTi3vlnE6zkyyMeAQm_0 2024-09-12T01:10:58.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.321+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17535569346738157157', time=2024-09-12T02:53:51.534460+0000, chain.objs.size()=1 2024-09-12T01:10:58.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.321+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.YCx-4fgUfeteDqUM-qW_m_rKhC8FFM-_0 2024-09-12T01:10:58.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.321+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15756338673918070261', time=2024-09-12T02:53:51.621918+0000, chain.objs.size()=1 2024-09-12T01:10:58.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.321+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.reUgV1gWHZBhiQSE2YMh4wDEJJ_fS0v_0 2024-09-12T01:10:58.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.322+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523434586556881996', time=2024-09-12T02:53:51.839309+0000, chain.objs.size()=1 2024-09-12T01:10:58.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.322+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lT_rA-n2Ag3gRlIEdySJQQtWeT7yjFi_0 2024-09-12T01:10:58.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.322+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14766331299124895260', time=2024-09-12T02:53:52.287697+0000, chain.objs.size()=1 2024-09-12T01:10:58.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.322+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.KtM2p485V9cKCPEsCBNG7QnBchHasyp_0 2024-09-12T01:10:58.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.323+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8148315127130928796', time=2024-09-12T02:53:52.486587+0000, chain.objs.size()=1 2024-09-12T01:10:58.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.323+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.aoOaWWKuz8aUIdIZ2Pe1mEHFx2oj8Kg_0 2024-09-12T01:10:58.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.324+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18140760078710909957', time=2024-09-12T02:53:52.761934+0000, chain.objs.size()=1 2024-09-12T01:10:58.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.324+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.KNCDXYgcSQVY9AhVSIFm08HMSVwh_mD_0 2024-09-12T01:10:58.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.324+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16143614889809973223', time=2024-09-12T02:53:53.273607+0000, chain.objs.size()=1 2024-09-12T01:10:58.323 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.324+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.u2na-a7IG7nOfqbhC2lGhdwohanO3pj_0 2024-09-12T01:10:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.324+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4880854442488113116', time=2024-09-12T02:53:54.367833+0000, chain.objs.size()=1 2024-09-12T01:10:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.324+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cXlUke-FeewMThLMcblRutgDXHLybbe_0 2024-09-12T01:10:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.324+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9668442916674234015', time=2024-09-12T02:53:54.389620+0000, chain.objs.size()=1 2024-09-12T01:10:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.324+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.eLEWJl2U0unAbcSS54bp0BYu_mthv1V_0 2024-09-12T01:10:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.324+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14750450696484036746', time=2024-09-12T02:53:54.646525+0000, chain.objs.size()=1 2024-09-12T01:10:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.324+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.-XbbmPRFrABTOira-dMsTzIoQWK5h10_0 2024-09-12T01:10:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.324+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12416232573729282267', time=2024-09-12T02:53:54.690051+0000, chain.objs.size()=1 2024-09-12T01:10:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.324+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.-3vNA95z9GfrfQmWJ1sPaGb1OG0TGOo_0 2024-09-12T01:10:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.324+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10548186543543796883', time=2024-09-12T02:53:54.705102+0000, chain.objs.size()=1 2024-09-12T01:10:58.324 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.324+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.2DeeM6SQKH_54TTF12XJ4YkOvmG48g9_0 2024-09-12T01:10:58.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.326+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1071158865686481413', time=2024-09-12T02:53:55.623482+0000, chain.objs.size()=1 2024-09-12T01:10:58.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.326+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.mj7heFSh2brUSLs7FFKcT0HxQtFYCoG_0 2024-09-12T01:10:58.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.326+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3100078812744544476', time=2024-09-12T02:53:55.712484+0000, chain.objs.size()=1 2024-09-12T01:10:58.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.326+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hNH1qJ17Se0nQBoV9-K1R-we7W6hs7i_0 2024-09-12T01:10:58.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.326+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14310159098250671072', time=2024-09-12T02:53:55.766746+0000, chain.objs.size()=1 2024-09-12T01:10:58.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.326+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qkay92o8sXZpf2CCb-G2yq5TgQ4XV5s_0 2024-09-12T01:10:58.326 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.326+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10337635029121540209', time=2024-09-12T02:53:55.894654+0000, chain.objs.size()=1 2024-09-12T01:10:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.326+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.beXDJDis0b1M1h7BZObeYZP86yolx1g_0 2024-09-12T01:10:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.327+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3572925860712234640', time=2024-09-12T02:53:56.372873+0000, chain.objs.size()=1 2024-09-12T01:10:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.327+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.pC-WoHrMs1gm83iEPoNp1R4XUF1TSJy_0 2024-09-12T01:10:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.327+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8187318257995749266', time=2024-09-12T02:53:56.518215+0000, chain.objs.size()=1 2024-09-12T01:10:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.327+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ZRqGKBwrbfHPRoIxWzNw-Ap23XciHFv_0 2024-09-12T01:10:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.327+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12566833763269262296', time=2024-09-12T02:53:56.821278+0000, chain.objs.size()=1 2024-09-12T01:10:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.327+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Pfg_IQyDsx2G60osBJXzFL2sLG4ErrF_0 2024-09-12T01:10:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.327+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17098507097408701418', time=2024-09-12T02:53:57.272867+0000, chain.objs.size()=1 2024-09-12T01:10:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.327+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.R63fdPO35CeRisbw-Qt88JJEa-fOrrt_0 2024-09-12T01:10:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.327+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9433494869384205911', time=2024-09-12T02:53:57.358790+0000, chain.objs.size()=1 2024-09-12T01:10:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.327+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.gHyhy3RVqi09lrHByPeruW9PqQnrMyT_0 2024-09-12T01:10:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.327+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3262679616336480699', time=2024-09-12T02:53:57.682425+0000, chain.objs.size()=1 2024-09-12T01:10:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.327+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Ehj90lhupB6EOZGMSV99xbnHx-tmXTm_0 2024-09-12T01:10:58.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.328+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1696032770762486911', time=2024-09-12T02:53:58.095684+0000, chain.objs.size()=1 2024-09-12T01:10:58.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.328+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.3mKOGS2N0xyRl-iTEQ1oyczUq9FMImw_0 2024-09-12T01:10:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.330+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.193175467628343979', time=2024-09-12T02:53:58.996572+0000, chain.objs.size()=1 2024-09-12T01:10:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.330+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Vu1a97Q_6MC1274kvj9LAwsLRBGoLzE_0 2024-09-12T01:10:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.330+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9796337005510417191', time=2024-09-12T02:53:59.040140+0000, chain.objs.size()=1 2024-09-12T01:10:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.330+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.1NAXj0qDdanOIcBV2CDlm3R1fzS7y1S_0 2024-09-12T01:10:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16366835986885544831', time=2024-09-12T02:53:59.064767+0000, chain.objs.size()=1 2024-09-12T01:10:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.k0exg7e7uBCLv6VngLkCbEEssefkDIp_0 2024-09-12T01:10:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10323605150961179743', time=2024-09-12T02:53:59.065319+0000, chain.objs.size()=1 2024-09-12T01:10:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.C6lVwB8cZoMiUDSzgVWiUZ_3kEkor5b_0 2024-09-12T01:10:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13846438974453795472', time=2024-09-12T02:53:59.282765+0000, chain.objs.size()=1 2024-09-12T01:10:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.mfRFhi7Ekahbk_IATnRX-jJ3kEON63O_0 2024-09-12T01:10:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2138853974204589323', time=2024-09-12T02:53:59.663636+0000, chain.objs.size()=1 2024-09-12T01:10:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.f2FKrGw-e2_t9lO_sIwh-YRT0GsYzLo_0 2024-09-12T01:10:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9450768718779060789', time=2024-09-12T02:54:36.737904+0000, chain.objs.size()=1 2024-09-12T01:10:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.RmJrxUhyofm_X3cd2QyKrUcK48OFV-k_0 2024-09-12T01:10:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10451442700405436335', time=2024-09-12T02:54:36.987019+0000, chain.objs.size()=1 2024-09-12T01:10:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.uVSA3EpY7jljp8TCJtSIdliw2bbUrap_0 2024-09-12T01:10:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14260217250770233621', time=2024-09-12T02:54:37.397512+0000, chain.objs.size()=1 2024-09-12T01:10:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.OI8bySg0aIJyhSWzlYYuH9wRq6isc-o_0 2024-09-12T01:10:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7828564376464678407', time=2024-09-12T02:54:38.128523+0000, chain.objs.size()=1 2024-09-12T01:10:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.FE-J2WqWeQ6C6d4ihhpOlH6SfyW6niZ_0 2024-09-12T01:10:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1731206197496723154', time=2024-09-12T02:54:38.237010+0000, chain.objs.size()=1 2024-09-12T01:10:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.331+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.8o5zFrNlmfBH14dPQGoYqyjh1VVSVVm_0 2024-09-12T01:10:58.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.334+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3214631198530566460', time=2024-09-12T02:54:38.349366+0000, chain.objs.size()=1 2024-09-12T01:10:58.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.334+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.iuA62GneNW16wmr-sC868MIU0BHlqGP_0 2024-09-12T01:10:58.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.334+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3477635662778111081', time=2024-09-12T02:54:38.606992+0000, chain.objs.size()=1 2024-09-12T01:10:58.334 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.334+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.zoPq2GktzdnLY7Eg_ri3W5QhMagKvag_0 2024-09-12T01:10:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.335+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14431684123800458951', time=2024-09-12T02:54:38.702561+0000, chain.objs.size()=1 2024-09-12T01:10:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.335+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.eRPfPf051FT2zb2lU74BAIau4zGXa3O_0 2024-09-12T01:10:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.335+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.321460667837046133', time=2024-09-12T02:54:39.063107+0000, chain.objs.size()=1 2024-09-12T01:10:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.335+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.unw75h6TJjFA5wtW0-FvwE55_gLVk8E_0 2024-09-12T01:10:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.335+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5230252843522640268', time=2024-09-12T02:54:39.516968+0000, chain.objs.size()=1 2024-09-12T01:10:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.335+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.X8I2L7yMTiFiannR6Yk9stQUuqqdQa5_0 2024-09-12T01:10:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.335+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1767181513785162733', time=2024-09-12T02:54:39.537509+0000, chain.objs.size()=1 2024-09-12T01:10:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.335+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.GXb6fcosGlruVyjqY0L_JGcqVJhHtrw_0 2024-09-12T01:10:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.335+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2802233548107945588', time=2024-09-12T02:54:39.604597+0000, chain.objs.size()=1 2024-09-12T01:10:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.335+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.o6U0wGi5Q2DhUfYmo_5xhNpCDu5zD4W_0 2024-09-12T01:10:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.335+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15790282957292960200', time=2024-09-12T02:54:39.893324+0000, chain.objs.size()=1 2024-09-12T01:10:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.335+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.M-th_NyZeL1O1bv6-r6cZGKN7oqcbAL_0 2024-09-12T01:10:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.335+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5099934046284830786', time=2024-09-12T02:54:40.868151+0000, chain.objs.size()=1 2024-09-12T01:10:58.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.335+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.TpYF2XllyLxUGGSz94RYeGw6JuEG55P_0 2024-09-12T01:10:58.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.337+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6394739340839138146', time=2024-09-12T02:54:40.868965+0000, chain.objs.size()=1 2024-09-12T01:10:58.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.337+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Ld1k1jEz-fcGr7jizYg1HepZgvLDOQR_0 2024-09-12T01:10:58.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.337+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11936578157632705894', time=2024-09-12T02:54:41.243438+0000, chain.objs.size()=1 2024-09-12T01:10:58.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.337+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.BX25ohEcQN2E7HtZCZJiD0vlX9NJlZI_0 2024-09-12T01:10:58.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.337+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8871643376636196996', time=2024-09-12T02:54:41.511577+0000, chain.objs.size()=1 2024-09-12T01:10:58.336 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.337+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.bGvYeQ4bVTI9HB8efdX93JzCvManVs-_0 2024-09-12T01:10:58.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.339+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6922003515561563101', time=2024-09-12T02:54:41.717019+0000, chain.objs.size()=1 2024-09-12T01:10:58.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.339+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._Eutdox01Q_ftAh6_dq8nYAJYTd1tO2_0 2024-09-12T01:10:58.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.339+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1657097730694529712', time=2024-09-12T02:54:42.618215+0000, chain.objs.size()=1 2024-09-12T01:10:58.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.339+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.l7GyWuy2ToanXLET-jhzge8wAF6u_gJ_0 2024-09-12T01:10:58.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3346790377886709148', time=2024-09-12T02:54:42.652882+0000, chain.objs.size()=1 2024-09-12T01:10:58.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.xgXzg38j4l05f745KujVRoASEacplC6_0 2024-09-12T01:10:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6799890558075221535', time=2024-09-12T02:54:43.803702+0000, chain.objs.size()=1 2024-09-12T01:10:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Mo5jv7R8MfMaZwmhK6qqEA7s-bW7Tcs_0 2024-09-12T01:10:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3193157072326940869', time=2024-09-12T02:54:43.949181+0000, chain.objs.size()=1 2024-09-12T01:10:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.YZqb8vliCysgpDgldgH26B7dsYuko6o_0 2024-09-12T01:10:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8378393573260929735', time=2024-09-12T02:54:44.775596+0000, chain.objs.size()=1 2024-09-12T01:10:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.MnddDZoBrl_8zMs2m5NEGdoGi8-gOM6_0 2024-09-12T01:10:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5837258355113325608', time=2024-09-12T02:54:45.203749+0000, chain.objs.size()=1 2024-09-12T01:10:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.H7Ezd3y07g1xEY0hGjXxHMuJUB7vpIZ_0 2024-09-12T01:10:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2493850288292792678', time=2024-09-12T02:54:45.665439+0000, chain.objs.size()=1 2024-09-12T01:10:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.298Vqqk_CfKO_Pcse5j1qdD4ItcyNiI_0 2024-09-12T01:10:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8789044034494892595', time=2024-09-12T02:54:46.309627+0000, chain.objs.size()=1 2024-09-12T01:10:58.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.QG9HWNzh6HVRDA2lR3HHpiYz28lToYX_0 2024-09-12T01:10:58.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.345+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/59770 2024-09-12T01:10:58.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T01:10:58.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17893696624144499899', time=2024-09-12T02:54:46.434182+0000, chain.objs.size()=1 2024-09-12T01:10:58.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.bYf9dlz00zrup9VMR1yP3gIoC8DSply_0 2024-09-12T01:10:58.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11738434724733602344', time=2024-09-12T02:54:46.540447+0000, chain.objs.size()=1 2024-09-12T01:10:58.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.HRt6qGC3ujYE-0mF-JdBcsXmi4m4eMz_0 2024-09-12T01:10:58.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16451224942086973065', time=2024-09-12T02:54:46.605397+0000, chain.objs.size()=1 2024-09-12T01:10:58.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.JN59ZMH2TuqEUTlTeXN6IW3RhYO0psu_0 2024-09-12T01:10:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14847549229387216586', time=2024-09-12T02:54:46.948707+0000, chain.objs.size()=1 2024-09-12T01:10:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nx-ELYA1BWYK3BuMmnNsg2mE2nRwMLc_0 2024-09-12T01:10:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11183320656024725429', time=2024-09-12T02:54:48.533415+0000, chain.objs.size()=1 2024-09-12T01:10:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.328__shadow_.LCXSvi2FG-VxwHSsWNAYJOUqtqYdSRD_0 2024-09-12T01:10:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14791435918727082986', time=2024-09-12T02:55:12.540059+0000, chain.objs.size()=1 2024-09-12T01:10:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.376__shadow_.767WgIFZxTPzaYtMyRvolfWQnHuomf8_0 2024-09-12T01:10:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8891502253931496442', time=2024-09-12T02:55:25.189313+0000, chain.objs.size()=1 2024-09-12T01:10:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.395__shadow:HAz6KyTMy3y1dn-5mdp-Lya8pLFrKUE_.wxxA_ILclQXz8zUVsv6kiaDXirykyN0_0 2024-09-12T01:10:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11950851036206842381', time=2024-09-12T02:56:04.631659+0000, chain.objs.size()=1 2024-09-12T01:10:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.464__shadow_.xcJaBiv0iV6DiEX6mPuUJ7w_vqAKkLr_0 2024-09-12T01:10:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7011522117047873176', time=2024-09-12T02:56:50.150116+0000, chain.objs.size()=1 2024-09-12T01:10:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.519__multipart_mymultipart.2~twXQeU4HSSDBu3a66TlOEWf4mLlvYR8.1 2024-09-12T01:10:58.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1943875647733361019', time=2024-09-12T02:59:31.902637+0000, chain.objs.size()=1 2024-09-12T01:10:58.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.557__shadow_.898YRpaUs5lu0_3Ftc3CNKkk19M1ngP_0 2024-09-12T01:10:58.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11911277984491750729', time=2024-09-12T03:00:49.049400+0000, chain.objs.size()=7 2024-09-12T01:10:58.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.579__multipart_testobj.2~yLvCX6EjZNri-v5M5CyYGctzkwIsNJs.1 2024-09-12T01:10:58.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.347+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.579__shadow_testobj.2~yLvCX6EjZNri-v5M5CyYGctzkwIsNJs.1_1 2024-09-12T01:10:58.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.349+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.579__multipart_testobj.2~yLvCX6EjZNri-v5M5CyYGctzkwIsNJs.2 2024-09-12T01:10:58.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.350+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.579__shadow_testobj.2~yLvCX6EjZNri-v5M5CyYGctzkwIsNJs.2_1 2024-09-12T01:10:58.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.350+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.579__multipart_testobj.2~yLvCX6EjZNri-v5M5CyYGctzkwIsNJs.3 2024-09-12T01:10:58.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.352+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.579__shadow_testobj.2~yLvCX6EjZNri-v5M5CyYGctzkwIsNJs.3_1 2024-09-12T01:10:58.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.352+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.579__multipart_testobj.2~yLvCX6EjZNri-v5M5CyYGctzkwIsNJs.4 2024-09-12T01:10:58.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.352+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15956360609216031414', time=2024-09-12T03:04:58.120282+0000, chain.objs.size()=1 2024-09-12T01:10:58.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.352+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.642__shadow_._9ciZeULNtbymWyfdGNm-dx5renJbfc_0 2024-09-12T01:10:58.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.355+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:58.357 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.358+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:10:58.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.359+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:58.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.359+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43537' 2024-09-12T01:10:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15090693263696634242', time=2024-09-12T02:49:21.147254+0000, chain.objs.size()=3 2024-09-12T01:10:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.BqxOm3KYnGPZnr3-g2SCL0eYNz5ftWb_0 2024-09-12T01:10:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.BqxOm3KYnGPZnr3-g2SCL0eYNz5ftWb_1 2024-09-12T01:10:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.BqxOm3KYnGPZnr3-g2SCL0eYNz5ftWb_2 2024-09-12T01:10:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3592048098107094702', time=2024-09-12T02:51:27.276398+0000, chain.objs.size()=1 2024-09-12T01:10:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.234__shadow_.ScINp2B8OyNvOZpAps-Y5qF_bi28j9E_0 2024-09-12T01:10:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3654142998546888809', time=2024-09-12T02:51:31.791827+0000, chain.objs.size()=1 2024-09-12T01:10:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.241__shadow_.TvEXKWfHwDn_oR8-K8iXv2b7HR5dk5g_0 2024-09-12T01:10:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3736480092227856950', time=2024-09-12T02:52:21.598598+0000, chain.objs.size()=1 2024-09-12T01:10:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.FCuyNlqtaxBMizDOxldhrkXOK09OSY4_0 2024-09-12T01:10:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6358116682014095829', time=2024-09-12T02:52:21.703847+0000, chain.objs.size()=1 2024-09-12T01:10:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.2XyU78Vj71r3BsdRLFt8nzBdJsQYpTY_0 2024-09-12T01:10:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3577736590294809651', time=2024-09-12T02:52:21.883028+0000, chain.objs.size()=1 2024-09-12T01:10:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.lkCbHYF_Cta2pjgYWxUhlBaZQC-X2w4_0 2024-09-12T01:10:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15955999438294828162', time=2024-09-12T02:52:23.163340+0000, chain.objs.size()=1 2024-09-12T01:10:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wY1YDgJzG-RAaDsc8ZKcyb2JSAuKySa_0 2024-09-12T01:10:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5861655600951247434', time=2024-09-12T02:52:23.307767+0000, chain.objs.size()=1 2024-09-12T01:10:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KGwt2jY_7v-ZANMvybHnOY-7bmlt4fE_0 2024-09-12T01:10:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9394331532838091188', time=2024-09-12T02:52:25.876927+0000, chain.objs.size()=1 2024-09-12T01:10:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5rXrgQxFh58WZM2KHc4GFi7JFCGH0kG_0 2024-09-12T01:10:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4919931634201073003', time=2024-09-12T02:52:26.011653+0000, chain.objs.size()=1 2024-09-12T01:10:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.360+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.iByn3zGcwaFuGI3CNQPK4l3o1MvR5iF_0 2024-09-12T01:10:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.363+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12989829575390628891', time=2024-09-12T02:52:26.313241+0000, chain.objs.size()=1 2024-09-12T01:10:58.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.363+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.P8mFac3taAKRrkda9jRl0X6sggXIPzL_0 2024-09-12T01:10:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3041848148242618836', time=2024-09-12T02:52:26.485158+0000, chain.objs.size()=1 2024-09-12T01:10:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.dSEdH4Wmv_PRgLIIqLrUlJ07dB0Goob_0 2024-09-12T01:10:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7150010291626942281', time=2024-09-12T02:52:27.227054+0000, chain.objs.size()=1 2024-09-12T01:10:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5f2LHurz7oFeIOHOIxedj67WjBSiO8P_0 2024-09-12T01:10:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3769693868963601273', time=2024-09-12T02:52:27.489765+0000, chain.objs.size()=1 2024-09-12T01:10:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.mbEMMsJvOSkUXra3CW20Pu-3gGg862A_0 2024-09-12T01:10:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1359049250237547081', time=2024-09-12T02:52:27.603178+0000, chain.objs.size()=1 2024-09-12T01:10:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.gu9VG0q39KE-F-pyXfmYOPbpTXZfdE2_0 2024-09-12T01:10:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8152462066470948348', time=2024-09-12T02:52:27.604505+0000, chain.objs.size()=1 2024-09-12T01:10:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pWj1s9_gOxGlkpFmK9X2KQpa9RmtQ5U_0 2024-09-12T01:10:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5744030749759408977', time=2024-09-12T02:52:27.714423+0000, chain.objs.size()=1 2024-09-12T01:10:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5PIvVy1GkaR5elVdSmiq_PHfRKFZb9J_0 2024-09-12T01:10:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5523400884713090654', time=2024-09-12T02:52:28.425707+0000, chain.objs.size()=1 2024-09-12T01:10:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.qL33vZGabtFoHOK1sHbZE2bnMpy8NSb_0 2024-09-12T01:10:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11438075905306652440', time=2024-09-12T02:52:28.691796+0000, chain.objs.size()=1 2024-09-12T01:10:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Wb44eexnOTNcB6XSPCOhhj131bUqSRE_0 2024-09-12T01:10:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11779670199499471192', time=2024-09-12T02:52:28.848097+0000, chain.objs.size()=1 2024-09-12T01:10:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.F7XGJtP6EbfDMdRSpqvpzqmUesXGWUr_0 2024-09-12T01:10:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4432041708486753259', time=2024-09-12T02:52:28.848640+0000, chain.objs.size()=1 2024-09-12T01:10:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.364+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.XOlNhqr9aShORPCmholW78hyqIW6Fcg_0 2024-09-12T01:10:58.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.367+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9082306917567068062', time=2024-09-12T02:52:28.905557+0000, chain.objs.size()=1 2024-09-12T01:10:58.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.367+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.AxJ9O2zF2ncp5cCx9ubl4xgobpycDoo_0 2024-09-12T01:10:58.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.367+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1644144216268770965', time=2024-09-12T02:52:29.218910+0000, chain.objs.size()=1 2024-09-12T01:10:58.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.367+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.EDuARuAyiI7-huZoALuwdUlXdTCt-Md_0 2024-09-12T01:10:58.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.367+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6580694147433864289', time=2024-09-12T02:52:29.433288+0000, chain.objs.size()=1 2024-09-12T01:10:58.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.367+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Xq7hoMmMQF1NpvrYPqXH8Wrs-jrY07U_0 2024-09-12T01:10:58.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.367+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5927881766125237840', time=2024-09-12T02:52:29.987244+0000, chain.objs.size()=1 2024-09-12T01:10:58.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.367+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.blCqaLbDCejPYm7RlkFuFrEmoXxEuBc_0 2024-09-12T01:10:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.369+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4547979856987676096', time=2024-09-12T02:52:30.159838+0000, chain.objs.size()=1 2024-09-12T01:10:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.369+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ki8QGfZXlcNqFjyNfJZERO40vF_0uUz_0 2024-09-12T01:10:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.369+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7952332633742794568', time=2024-09-12T02:52:30.333531+0000, chain.objs.size()=1 2024-09-12T01:10:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.369+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.W6W_5y5PPJfmdu370acZ-S7X3FI0EFf_0 2024-09-12T01:10:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.369+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9592576602638617516', time=2024-09-12T02:52:30.544072+0000, chain.objs.size()=1 2024-09-12T01:10:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.369+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xe5CYhp1OIT9P4K0sjtX7MBAHBkQwcC_0 2024-09-12T01:10:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.369+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4449061981028101091', time=2024-09-12T02:52:30.614197+0000, chain.objs.size()=1 2024-09-12T01:10:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.369+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.QJIAH0xMoUHcDEseZyEIyV0eu-Ya4kM_0 2024-09-12T01:10:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.369+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12203302552230161935', time=2024-09-12T02:52:30.704086+0000, chain.objs.size()=1 2024-09-12T01:10:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.369+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.aGRXFU8bqEr2QfgYCgkYwA00EGLkLF2_0 2024-09-12T01:10:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.369+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18428762025910525781', time=2024-09-12T02:52:30.737286+0000, chain.objs.size()=1 2024-09-12T01:10:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.369+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.SNo1Z3pNpJcUjfgIuVJ2EwLb_CTNcQe_0 2024-09-12T01:10:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.369+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10407819422033242792', time=2024-09-12T02:52:31.117728+0000, chain.objs.size()=1 2024-09-12T01:10:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.369+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.FfzYkfwaMQ-T0UCA_CRII9ApemU7e5Z_0 2024-09-12T01:10:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.370+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3640719709807017694', time=2024-09-12T02:52:31.299712+0000, chain.objs.size()=1 2024-09-12T01:10:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.370+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.SfcPztPh1303GwUrqGhOz0Hg-gVnQJm_0 2024-09-12T01:10:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.372+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.976562121418687408', time=2024-09-12T02:52:31.794713+0000, chain.objs.size()=1 2024-09-12T01:10:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.372+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1ivh37tMaYYOXHyj3pY3NtUTsD9-Go8_0 2024-09-12T01:10:58.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.373+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.473999501938376191', time=2024-09-12T02:52:31.940848+0000, chain.objs.size()=1 2024-09-12T01:10:58.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.373+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Ztv6coBioty5o0k7DKFJ4epOL4hQxyV_0 2024-09-12T01:10:58.372 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.373+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13916447910135969790', time=2024-09-12T02:52:33.666863+0000, chain.objs.size()=1 2024-09-12T01:10:58.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.373+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.266__shadow_.wHoWdipNhVojsy0jLX_7MLFKr0I1YOZ_0 2024-09-12T01:10:58.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.373+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6551108357963653450', time=2024-09-12T02:52:42.392132+0000, chain.objs.size()=1 2024-09-12T01:10:58.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.373+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.281__shadow_.LuNDovNLudNhr_Tg83VuGAgfBs41Qe1_0 2024-09-12T01:10:58.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.374+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13477116837315270561', time=2024-09-12T02:52:43.020108+0000, chain.objs.size()=1 2024-09-12T01:10:58.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.374+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.282__shadow_.zJkaXvCqb1rtT1omqJt-6KECZtPjmM0_0 2024-09-12T01:10:58.373 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.374+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14141350832928928255', time=2024-09-12T02:52:46.742621+0000, chain.objs.size()=1 2024-09-12T01:10:58.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.374+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.288__shadow_.Vue4gPOYftf-BZfOnijx-Ytwf0hq1j2_0 2024-09-12T01:10:58.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.374+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7363452461919130383', time=2024-09-12T02:52:49.329624+0000, chain.objs.size()=1 2024-09-12T01:10:58.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.374+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.292__shadow_.iP0Seym3kfBf3DyxGYNbz3O15ED-8-J_0 2024-09-12T01:10:58.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.375+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10199286259534377599', time=2024-09-12T02:52:51.165132+0000, chain.objs.size()=1 2024-09-12T01:10:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.375+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_._GGL3lN_Hf9TaN4U-hJAcGs26bscOYu_0 2024-09-12T01:10:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.375+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15242976162988959860', time=2024-09-12T02:52:53.143366+0000, chain.objs.size()=1 2024-09-12T01:10:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.375+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.xDnzsEPm9sSyYGu_K61biErquVpMGFF_0 2024-09-12T01:10:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.375+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1070517785261216429', time=2024-09-12T02:52:53.197180+0000, chain.objs.size()=1 2024-09-12T01:10:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.375+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.FlsAl9E8N0SJsASj1dhs2iQZCjpubpr_0 2024-09-12T01:10:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.375+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9502539197255352630', time=2024-09-12T02:52:53.274637+0000, chain.objs.size()=1 2024-09-12T01:10:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.375+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.ExEZR5Y3U5ekoD0D6goR41vCaLvKtbP_0 2024-09-12T01:10:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.376+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10725784380042675235', time=2024-09-12T02:52:55.686996+0000, chain.objs.size()=1 2024-09-12T01:10:58.376 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.376+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.298__shadow_.-rzpVGAzveFZyFI7OFHMuFl45Z_Utg0_0 2024-09-12T01:10:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12727037260565352493', time=2024-09-12T02:52:57.046390+0000, chain.objs.size()=1 2024-09-12T01:10:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.300__shadow_.yqka7Nmo4Yf5_9DlCeKHn50wl4cpoKJ_0 2024-09-12T01:10:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7438845838372450439', time=2024-09-12T02:53:05.434813+0000, chain.objs.size()=1 2024-09-12T01:10:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.314__shadow_.qTSP4uoyTdzCdaqfmm9odYEEGj2pvEV_0 2024-09-12T01:10:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9031248288245986173', time=2024-09-12T02:53:50.359473+0000, chain.objs.size()=1 2024-09-12T01:10:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.7asK0eGIqShRwKImX9c2P3B6jsIwAoS_0 2024-09-12T01:10:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3418788229703548870', time=2024-09-12T02:53:51.168544+0000, chain.objs.size()=1 2024-09-12T01:10:58.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.M8egjbhko-rZYbSaDSV8_BctVKsNZVu_0 2024-09-12T01:10:58.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.380+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7338851970195818472', time=2024-09-12T02:53:51.310236+0000, chain.objs.size()=1 2024-09-12T01:10:58.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.380+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.SwOja_uOoInFV7DVoJApN3Jxl0e89S-_0 2024-09-12T01:10:58.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.380+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6670524482233449103', time=2024-09-12T02:53:51.518928+0000, chain.objs.size()=1 2024-09-12T01:10:58.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.380+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.3GUV-Qo7YqSoJ5oTvhv2TtpWWNmKrYC_0 2024-09-12T01:10:58.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.380+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16510502278982237246', time=2024-09-12T02:53:51.580870+0000, chain.objs.size()=1 2024-09-12T01:10:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.380+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Rln4y0SECcDcRhDikbDGvXxvRvfM_w2_0 2024-09-12T01:10:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.380+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6217725826328551988', time=2024-09-12T02:53:52.518778+0000, chain.objs.size()=1 2024-09-12T01:10:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.380+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ToxFHiemkPQTbSNwUbH3sNt7dAR5x-v_0 2024-09-12T01:10:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.380+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4680644094090407555', time=2024-09-12T02:53:52.810936+0000, chain.objs.size()=1 2024-09-12T01:10:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.380+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.F2q8wdDl9MOQ0-vGzRC7g7UIGeaytgk_0 2024-09-12T01:10:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.380+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8542345659300510249', time=2024-09-12T02:53:52.992663+0000, chain.objs.size()=1 2024-09-12T01:10:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.380+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lvoHoY9dCVjTmGcf87Cl3ZKW56J_hZa_0 2024-09-12T01:10:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.380+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6891237543594817099', time=2024-09-12T02:53:53.239394+0000, chain.objs.size()=1 2024-09-12T01:10:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.380+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.NmJrI-hu2uSNXztzSaRtoqiK_MzTJ1V_0 2024-09-12T01:10:58.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.381+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7184077616040286855', time=2024-09-12T02:53:54.109824+0000, chain.objs.size()=1 2024-09-12T01:10:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.381+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.FXDza5GtlNAUL5Vtft5KI6-PRnUMahY_0 2024-09-12T01:10:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.382+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6952840941310898578', time=2024-09-12T02:53:54.530270+0000, chain.objs.size()=1 2024-09-12T01:10:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.382+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Bop1No1ZMOKr1zsgHN-hRRU3LNcLj2j_0 2024-09-12T01:10:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.382+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11622392854108300060', time=2024-09-12T02:53:54.658676+0000, chain.objs.size()=1 2024-09-12T01:10:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.382+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.PW8j_oqqQGRHf8hTUbcRCdGAcxeICZG_0 2024-09-12T01:10:58.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.382+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5259698712600835892', time=2024-09-12T02:53:55.346678+0000, chain.objs.size()=1 2024-09-12T01:10:58.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.382+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.oe1bxznbrx-csGtaftQ4QQhWyRvrlF2_0 2024-09-12T01:10:58.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.382+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15741111038117484086', time=2024-09-12T02:53:55.427720+0000, chain.objs.size()=1 2024-09-12T01:10:58.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.382+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.NZvt4A3nsz0ZQFq7eA6fcuCV5X2Juy0_0 2024-09-12T01:10:58.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.383+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5571351159600802340', time=2024-09-12T02:53:55.497789+0000, chain.objs.size()=1 2024-09-12T01:10:58.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.383+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.3X9XYyP2U9DJ9PuMY_u2ByXayc1uvXQ_0 2024-09-12T01:10:58.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.383+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10961465418629856270', time=2024-09-12T02:53:56.391965+0000, chain.objs.size()=1 2024-09-12T01:10:58.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.383+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.TGHZ2aoKIiStb_AXsdYC4WdQ3U1YniS_0 2024-09-12T01:10:58.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.383+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16057575093027710822', time=2024-09-12T02:53:56.693034+0000, chain.objs.size()=1 2024-09-12T01:10:58.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.383+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.3WsxQR4p8ulnTYRVlnNCDq_OEUJ8qI9_0 2024-09-12T01:10:58.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.383+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.229326836003920498', time=2024-09-12T02:53:56.938350+0000, chain.objs.size()=1 2024-09-12T01:10:58.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.383+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.P0E2lX7QTsnokBavmAspKNECG7FKdlV_0 2024-09-12T01:10:58.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.383+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11238478075578170157', time=2024-09-12T02:53:57.275573+0000, chain.objs.size()=1 2024-09-12T01:10:58.383 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.383+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.imovz6J86CODFAi4RwlRYSeabYo5h2S_0 2024-09-12T01:10:58.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.385+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9225432550654695486', time=2024-09-12T02:53:57.410273+0000, chain.objs.size()=1 2024-09-12T01:10:58.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.385+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.XD6Je_LFzsNKNOIe-7fFueq_6C2zCKM_0 2024-09-12T01:10:58.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.385+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.822038996898650902', time=2024-09-12T02:53:57.731381+0000, chain.objs.size()=1 2024-09-12T01:10:58.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.385+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.EtXAqtRkh1EbvFKPFDtp-qzh3feea9z_0 2024-09-12T01:10:58.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.385+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7834139521718568710', time=2024-09-12T02:53:58.216100+0000, chain.objs.size()=1 2024-09-12T01:10:58.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.385+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.kZjBtEe23fpvL7vCbKqfhyWwvHUQmjV_0 2024-09-12T01:10:58.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.386+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16310452746155954590', time=2024-09-12T02:53:58.666152+0000, chain.objs.size()=1 2024-09-12T01:10:58.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.386+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qZhA22USAwg_Vx-R8VT4HbjSHLkqs_D_0 2024-09-12T01:10:58.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.387+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8849505357109977396', time=2024-09-12T02:53:58.947949+0000, chain.objs.size()=1 2024-09-12T01:10:58.386 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.387+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.8zMS-HvO04tSaWNs73Hbi7yu3kChQN-_0 2024-09-12T01:10:58.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.387+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.461072839858298562', time=2024-09-12T02:53:59.073021+0000, chain.objs.size()=1 2024-09-12T01:10:58.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.387+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.14vKVWBKL98fwrRIh0k-AfIyKOcAGR-_0 2024-09-12T01:10:58.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.387+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6457113510827842185', time=2024-09-12T02:53:59.211483+0000, chain.objs.size()=1 2024-09-12T01:10:58.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.387+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.L3Wka5kxUZQ1GsJVCfL4CrAF8PKugCF_0 2024-09-12T01:10:58.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.388+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6287519247455248232', time=2024-09-12T02:53:59.522771+0000, chain.objs.size()=1 2024-09-12T01:10:58.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.388+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.4APFPrZWGTztEPvBe92_3A5fYM7Ziga_0 2024-09-12T01:10:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.389+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2667442213953917247', time=2024-09-12T02:53:59.646009+0000, chain.objs.size()=1 2024-09-12T01:10:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.389+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.A_I4MJHEYmW5Vi4NftS3Rlmesjl7vmt_0 2024-09-12T01:10:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.389+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8587962118743268854', time=2024-09-12T02:54:36.683967+0000, chain.objs.size()=1 2024-09-12T01:10:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.389+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.kVMn_Yw3Q9n_NnMUp__kSyrp26CrT7U_0 2024-09-12T01:10:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.389+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.317798180976752010', time=2024-09-12T02:54:36.843898+0000, chain.objs.size()=1 2024-09-12T01:10:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.389+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.FIBxCLzX69iyB7OPPY1ZQf6Q2g8VbB0_0 2024-09-12T01:10:58.388 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.389+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3736760051124429101', time=2024-09-12T02:54:36.845401+0000, chain.objs.size()=1 2024-09-12T01:10:58.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.389+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.l4_1Jxfsc2Mtscm7CRVmqahQUlOkAWU_0 2024-09-12T01:10:58.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.389+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12019807771829495330', time=2024-09-12T02:54:38.152552+0000, chain.objs.size()=1 2024-09-12T01:10:58.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.389+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fxlU_3YNJikwJpydMJzxtUGSpW8_6YW_0 2024-09-12T01:10:58.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.390+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1675222297361387787', time=2024-09-12T02:54:38.331493+0000, chain.objs.size()=1 2024-09-12T01:10:58.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.390+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.If-ewGQ53x9v6a30rXwZKOwmN2kbN9q_0 2024-09-12T01:10:58.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.390+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12911538630263419200', time=2024-09-12T02:54:38.466157+0000, chain.objs.size()=1 2024-09-12T01:10:58.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.390+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.kIrCOxBeDYEOJkg9jpel5KoX8aYrn8s_0 2024-09-12T01:10:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.391+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4306133668872130732', time=2024-09-12T02:54:38.674404+0000, chain.objs.size()=1 2024-09-12T01:10:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.391+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.WpMyxtoepRcjbk04ElNwfUcBmIdzw2R_0 2024-09-12T01:10:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.391+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8346098529431536025', time=2024-09-12T02:54:39.689997+0000, chain.objs.size()=1 2024-09-12T01:10:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.391+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dR3xY8uLa1xLS-I0w-vb0RTd8ZU4txv_0 2024-09-12T01:10:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.391+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10209371808579974510', time=2024-09-12T02:54:40.298675+0000, chain.objs.size()=1 2024-09-12T01:10:58.390 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.391+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.lj-s3Of30qZO9_9TiVJft32hqtfVBvU_0 2024-09-12T01:10:58.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.391+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16423377760393593244', time=2024-09-12T02:54:40.437100+0000, chain.objs.size()=1 2024-09-12T01:10:58.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.391+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nNA0LXhX-TjgYHRbAJZtQgj-O0k6MHV_0 2024-09-12T01:10:58.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.392+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15542843453922191700', time=2024-09-12T02:54:40.877978+0000, chain.objs.size()=1 2024-09-12T01:10:58.391 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.392+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ooJasqEhdF_kxl0Bk5hrViqYUprO8tR_0 2024-09-12T01:10:58.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.394+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13635024048884341111', time=2024-09-12T02:54:41.208221+0000, chain.objs.size()=1 2024-09-12T01:10:58.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.394+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.DvGdLGZEr6HxCwUe_SuEHm-4TcaZlJ7_0 2024-09-12T01:10:58.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.394+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3359439063213132745', time=2024-09-12T02:54:41.350533+0000, chain.objs.size()=1 2024-09-12T01:10:58.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.394+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6Jgkvw8dDm_Dyox6k4nUf7tc1mM92lY_0 2024-09-12T01:10:58.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.394+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.863202519661825179', time=2024-09-12T02:54:41.456417+0000, chain.objs.size()=1 2024-09-12T01:10:58.393 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.394+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Z6_iXnkSlV6xfQJpAeDjVPxT4wwCNH5_0 2024-09-12T01:10:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.395+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14565646084689486462', time=2024-09-12T02:54:41.724978+0000, chain.objs.size()=1 2024-09-12T01:10:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.395+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.2Lo9P99RfqcxDIEoQLJfUqlCW0fnvwP_0 2024-09-12T01:10:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.395+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2384141370733751690', time=2024-09-12T02:54:42.374177+0000, chain.objs.size()=1 2024-09-12T01:10:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.395+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.TiA1bk4bzDInihm1xu1dqClk3KTlomN_0 2024-09-12T01:10:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.395+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.868533324461656789', time=2024-09-12T02:54:45.667540+0000, chain.objs.size()=1 2024-09-12T01:10:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.395+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.YOwAxtbKF6C7eEBXNrwCRI0hEcCgiEG_0 2024-09-12T01:10:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.395+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9433275394837892505', time=2024-09-12T02:54:45.876387+0000, chain.objs.size()=1 2024-09-12T01:10:58.394 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.395+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.z-Cl6AF-X0kug9AJsojb42td0DzEk8a_0 2024-09-12T01:10:58.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.397+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13192190484429631231', time=2024-09-12T02:54:46.058484+0000, chain.objs.size()=1 2024-09-12T01:10:58.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.397+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.1EWgkJR_XcDMv0u7JE-lOGgMkZLC7W2_0 2024-09-12T01:10:58.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.397+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16875724762593200405', time=2024-09-12T02:54:46.769708+0000, chain.objs.size()=1 2024-09-12T01:10:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.397+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.5bCqzb5JxecQ-ImxUIPLW5Y6uSVFZLr_0 2024-09-12T01:10:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.397+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11108209401000950501', time=2024-09-12T02:54:46.977994+0000, chain.objs.size()=1 2024-09-12T01:10:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.397+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.NTNLwG9ZSBUIhqIl-IJK2L6J9u_3IbR_0 2024-09-12T01:10:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.397+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7367362175474092031', time=2024-09-12T02:54:50.139501+0000, chain.objs.size()=1 2024-09-12T01:10:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.397+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.331__shadow_.sexPRJwov3KtwvqP2lN1rbQqM4UdMFC_0 2024-09-12T01:10:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.397+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3180600334379912920', time=2024-09-12T02:55:13.539611+0000, chain.objs.size()=1 2024-09-12T01:10:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.397+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.378__shadow_.-uFzCIL81dHO-7_K-HvCBEo18gyAKDu_0 2024-09-12T01:10:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.397+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13004516653114671365', time=2024-09-12T02:55:33.085989+0000, chain.objs.size()=1 2024-09-12T01:10:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.397+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.411__shadow_.qtPNV8vQAV-mq_JuLPy0cMwuCSkvSKA_0 2024-09-12T01:10:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.397+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3120193251183769540', time=2024-09-12T02:55:44.463972+0000, chain.objs.size()=1 2024-09-12T01:10:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.397+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.433__shadow_.uqWn-bcSqBfvhjZ-BMn9FvyAg9msLG1_0 2024-09-12T01:10:58.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.402+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/43537 2024-09-12T01:10:58.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T01:10:58.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9998913680362433800', time=2024-09-12T02:56:02.166840+0000, chain.objs.size()=1 2024-09-12T01:10:58.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.461__shadow_.ukOcD8lDLGGfCj_9PHcSM528WwB4C_U_0 2024-09-12T01:10:58.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10800687217999986060', time=2024-09-12T02:56:05.245866+0000, chain.objs.size()=1 2024-09-12T01:10:58.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.465__shadow_.n1KWjPX9nHUeQGhLd_LpsEZ9Z6U3JkO_0 2024-09-12T01:10:58.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10651076341851472846', time=2024-09-12T02:56:06.322288+0000, chain.objs.size()=1 2024-09-12T01:10:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.466__shadow_.e0tknAaZtB4kJFSZbQLW_YsSJUs9WVj_0 2024-09-12T01:10:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3806807029777128314', time=2024-09-12T02:56:14.334984+0000, chain.objs.size()=1 2024-09-12T01:10:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.484__shadow_.nTZsPro_9It20RHUTbajhdinsyTA0tr_0 2024-09-12T01:10:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17227429952779462827', time=2024-09-12T02:56:24.845202+0000, chain.objs.size()=1 2024-09-12T01:10:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.497__shadow_.irI35RwRYGYN6_ZirVqbD-VICrbMxci_0 2024-09-12T01:10:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11502041828401226351', time=2024-09-12T02:56:25.838214+0000, chain.objs.size()=1 2024-09-12T01:10:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.498__shadow_._rMoGe-4kW3scvQLHCm6_pVmSG4tL0n_0 2024-09-12T01:10:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.207810906556476809', time=2024-09-12T02:56:40.879838+0000, chain.objs.size()=6 2024-09-12T01:10:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.1 2024-09-12T01:10:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.2 2024-09-12T01:10:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.3 2024-09-12T01:10:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.4 2024-09-12T01:10:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.5 2024-09-12T01:10:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.405+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.6 2024-09-12T01:10:58.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.407+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17856485633947819637', time=2024-09-12T02:56:51.989544+0000, chain.objs.size()=2 2024-09-12T01:10:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.407+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.518__shadow_.EnDn0ZiVi4ks_0C_EZNlSESa52w_wKn_0 2024-09-12T01:10:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.407+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.518__shadow_.EnDn0ZiVi4ks_0C_EZNlSESa52w_wKn_1 2024-09-12T01:10:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.407+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12994015002233767109', time=2024-09-12T02:57:01.162028+0000, chain.objs.size()=12 2024-09-12T01:10:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.407+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.520__multipart_mymultipart.2~Q301B1PjtmNtngZwSX_1JkHI5ZdaRfl.1 2024-09-12T01:10:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.407+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.520__shadow_mymultipart.2~Q301B1PjtmNtngZwSX_1JkHI5ZdaRfl.1_1 2024-09-12T01:10:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.408+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.520__multipart_mymultipart.2~Q301B1PjtmNtngZwSX_1JkHI5ZdaRfl.2 2024-09-12T01:10:58.407 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.408+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.520__shadow_mymultipart.2~Q301B1PjtmNtngZwSX_1JkHI5ZdaRfl.2_1 2024-09-12T01:10:58.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.408+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.520__multipart_mymultipart.2~Q301B1PjtmNtngZwSX_1JkHI5ZdaRfl.3 2024-09-12T01:10:58.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.408+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.520__shadow_mymultipart.2~Q301B1PjtmNtngZwSX_1JkHI5ZdaRfl.3_1 2024-09-12T01:10:58.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.408+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.520__multipart_mymultipart.2~Q301B1PjtmNtngZwSX_1JkHI5ZdaRfl.4 2024-09-12T01:10:58.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.409+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.520__shadow_mymultipart.2~Q301B1PjtmNtngZwSX_1JkHI5ZdaRfl.4_1 2024-09-12T01:10:58.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.409+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.520__multipart_mymultipart.2~Q301B1PjtmNtngZwSX_1JkHI5ZdaRfl.5 2024-09-12T01:10:58.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.411+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.520__shadow_mymultipart.2~Q301B1PjtmNtngZwSX_1JkHI5ZdaRfl.5_1 2024-09-12T01:10:58.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.411+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.520__multipart_mymultipart.2~Q301B1PjtmNtngZwSX_1JkHI5ZdaRfl.6 2024-09-12T01:10:58.411 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.412+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.520__shadow_mymultipart.2~Q301B1PjtmNtngZwSX_1JkHI5ZdaRfl.6_1 2024-09-12T01:10:58.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.412+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~ajQLRbV1uAG1gctGBazQtjdYp7WHBxt', time=2024-09-12T02:57:41.988553+0000, chain.objs.size()=1 2024-09-12T01:10:58.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.412+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~ajQLRbV1uAG1gctGBazQtjdYp7WHBxt.3 2024-09-12T01:10:58.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.412+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2747328453415243807', time=2024-09-12T02:58:15.209506+0000, chain.objs.size()=3 2024-09-12T01:10:58.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.412+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.524__multipart_mymultipart.2~LapHLfmEen5zWRBbR-ijZLlfpxAf07m.1 2024-09-12T01:10:58.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.412+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.524__multipart_mymultipart.2~LapHLfmEen5zWRBbR-ijZLlfpxAf07m.2 2024-09-12T01:10:58.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.412+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.524__multipart_mymultipart.2~LapHLfmEen5zWRBbR-ijZLlfpxAf07m.3 2024-09-12T01:10:58.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.412+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15665660774377164060', time=2024-09-12T02:58:33.937059+0000, chain.objs.size()=1 2024-09-12T01:10:58.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.412+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.529__shadow_.tH6irBfPZGrqBEm7NyISODqsc1y47dl_0 2024-09-12T01:10:58.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.412+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12234595553020614544', time=2024-09-12T02:59:25.878697+0000, chain.objs.size()=1 2024-09-12T01:10:58.412 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.412+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.554__shadow_.mw0scYWRdnVm9AqlUptNQzWE49nOcgn_0 2024-09-12T01:10:58.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.413+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1196687935896146224', time=2024-09-12T02:59:58.675096+0000, chain.objs.size()=1 2024-09-12T01:10:58.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.413+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:.DK01S33tx3dATU2fd5bn2nxswk4lJl_.3vIuqd84804Ngz_bCPXR2EaaN8y9dJl_0 2024-09-12T01:10:58.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.415+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1222473736199557803', time=2024-09-12T03:01:08.131274+0000, chain.objs.size()=1 2024-09-12T01:10:58.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.415+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.604__shadow_.mmexwbZpSIumZkB7wZGiKQCMTHDHeCo_0 2024-09-12T01:10:58.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.416+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8514404878799886423', time=2024-09-12T03:04:53.963525+0000, chain.objs.size()=1 2024-09-12T01:10:58.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.416+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.634__shadow_.rKuKcJXW_NSkeCXiMPXWfpXX9JRDY26_0 2024-09-12T01:10:58.418 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.419+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:58.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.421+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:10:58.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.422+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:58.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.422+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:58.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51238' 2024-09-12T01:10:58.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9152380181625328801', time=2024-09-12T02:49:32.510417+0000, chain.objs.size()=2 2024-09-12T01:10:58.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.165__multipart_foo.2~58nOs28y-3nzO98l1N6lAyELF53Ep2q.1 2024-09-12T01:10:58.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.165__multipart_foo.2~58nOs28y-3nzO98l1N6lAyELF53Ep2q.2 2024-09-12T01:10:58.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1944619183257754986', time=2024-09-12T02:51:26.007198+0000, chain.objs.size()=1 2024-09-12T01:10:58.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.232__shadow_.xeAhLfDjDnNo6NVFkCK6gtUaycGBW_2_0 2024-09-12T01:10:58.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13428287412249557958', time=2024-09-12T02:51:30.775408+0000, chain.objs.size()=1 2024-09-12T01:10:58.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.239__shadow_.t3uhH3ZIRjOP12z-fz3eBrZFdi0Y9SA_0 2024-09-12T01:10:58.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13851934829695943303', time=2024-09-12T02:51:32.985975+0000, chain.objs.size()=1 2024-09-12T01:10:58.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.243__shadow_.QT7Ilwjr_HHBtISF1RXLEkKPv3Mt-i4_0 2024-09-12T01:10:58.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7895019484514479496', time=2024-09-12T02:51:44.278063+0000, chain.objs.size()=1 2024-09-12T01:10:58.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.261__shadow_.iYIU9epK6brsGaq_bNm_1fyfke9Scab_0 2024-09-12T01:10:58.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8410997251560444505', time=2024-09-12T02:52:21.471075+0000, chain.objs.size()=1 2024-09-12T01:10:58.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.CSNZkvPuxPntC6tH1hprD2mburARmLz_0 2024-09-12T01:10:58.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12882761363976294208', time=2024-09-12T02:52:21.805053+0000, chain.objs.size()=1 2024-09-12T01:10:58.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.kCKbkLMlrCbiWOp3OwIyVPJwG8li7or_0 2024-09-12T01:10:58.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4414133678585588886', time=2024-09-12T02:52:22.038117+0000, chain.objs.size()=1 2024-09-12T01:10:58.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.yhlVT8MOW7wOMPYzNfAjEXMdieTuOGd_0 2024-09-12T01:10:58.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1075358171825064176', time=2024-09-12T02:52:22.205047+0000, chain.objs.size()=1 2024-09-12T01:10:58.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.rcT7E6SIzu5vJ_KwgVu1RFzVF4Yg3GE_0 2024-09-12T01:10:58.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10780114359081526833', time=2024-09-12T02:52:22.222886+0000, chain.objs.size()=1 2024-09-12T01:10:58.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.rRsiskAhmTbRK-NlUs3EtrZDSm9Xuaa_0 2024-09-12T01:10:58.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11026449299889228465', time=2024-09-12T02:52:22.763026+0000, chain.objs.size()=1 2024-09-12T01:10:58.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.423+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Y24K-HDCmH37qoVkjB1dDrCnw7nE64V_0 2024-09-12T01:10:58.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.426+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17606306338761460218', time=2024-09-12T02:52:22.893689+0000, chain.objs.size()=1 2024-09-12T01:10:58.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.426+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Zx5ZS0a3bfugcxlRBVDdJ09150niMnq_0 2024-09-12T01:10:58.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.426+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4581994924124997368', time=2024-09-12T02:52:22.932035+0000, chain.objs.size()=1 2024-09-12T01:10:58.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.426+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.aDbHM8q97wswUzgUlqso5ZD7MYqLKtF_0 2024-09-12T01:10:58.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.426+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12032150882873943392', time=2024-09-12T02:52:23.307426+0000, chain.objs.size()=1 2024-09-12T01:10:58.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.426+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.iihQ5Ekf9zXTtwoLdPvqlHZoK7VMPO0_0 2024-09-12T01:10:58.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.426+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13611444435926460370', time=2024-09-12T02:52:23.312749+0000, chain.objs.size()=1 2024-09-12T01:10:58.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.426+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.FIE98C0E62yZT-T_uv8AvqCxzVm76yI_0 2024-09-12T01:10:58.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.426+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2225069846696510453', time=2024-09-12T02:52:23.395589+0000, chain.objs.size()=1 2024-09-12T01:10:58.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.426+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4gGUrXyfRXbjgHFLx5OYzM79yNDj_FM_0 2024-09-12T01:10:58.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.428+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9094615389429209234', time=2024-09-12T02:52:23.455536+0000, chain.objs.size()=1 2024-09-12T01:10:58.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.428+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.bDxkSRUFgJhSnYOes6d8QRR7IHdF9KC_0 2024-09-12T01:10:58.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.428+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1143941991846536416', time=2024-09-12T02:52:23.465050+0000, chain.objs.size()=1 2024-09-12T01:10:58.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.428+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KtpFdLnuTJYmKALuj_t_tsxg4diTJv3_0 2024-09-12T01:10:58.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.428+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12995646799780584072', time=2024-09-12T02:52:23.469161+0000, chain.objs.size()=1 2024-09-12T01:10:58.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.428+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.dP21nOyF_i9IR7d1Ep7QpyxJt3scBZK_0 2024-09-12T01:10:58.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.428+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.456183518201628304', time=2024-09-12T02:52:23.617771+0000, chain.objs.size()=1 2024-09-12T01:10:58.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.428+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.X-mnpwjhnnt1M_JfN70tyhiHSEzdYsJ_0 2024-09-12T01:10:58.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.428+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3623901319488272292', time=2024-09-12T02:52:23.670595+0000, chain.objs.size()=1 2024-09-12T01:10:58.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.428+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.QwNr4uHLZXtguxOV4m76ULxp0W_F5X2_0 2024-09-12T01:10:58.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.428+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17491656117149783654', time=2024-09-12T02:52:24.202810+0000, chain.objs.size()=1 2024-09-12T01:10:58.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.428+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.EHEKpeiudSNceIWOX2PxozKRIGfl553_0 2024-09-12T01:10:58.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.429+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2390291008866360806', time=2024-09-12T02:52:24.648533+0000, chain.objs.size()=1 2024-09-12T01:10:58.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.429+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Ye0ejP9NU70A7af9zxASBVoEmiZOm-H_0 2024-09-12T01:10:58.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.429+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14632631868018763352', time=2024-09-12T02:52:24.856179+0000, chain.objs.size()=1 2024-09-12T01:10:58.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.429+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.mr3YIlaf3xGFEWfsMyjEspyjxM5KaaI_0 2024-09-12T01:10:58.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.429+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13504576824676940870', time=2024-09-12T02:52:25.024805+0000, chain.objs.size()=1 2024-09-12T01:10:58.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.429+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.cbnvXLhAIrBbo7BUWHHZNehueqHsYR1_0 2024-09-12T01:10:58.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.429+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14537831845653072467', time=2024-09-12T02:52:25.184139+0000, chain.objs.size()=1 2024-09-12T01:10:58.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.429+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.CyBs71YoXKikhHSGj5ITBHgMGpSWVF__0 2024-09-12T01:10:58.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.431+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14161620170575845015', time=2024-09-12T02:52:26.092128+0000, chain.objs.size()=1 2024-09-12T01:10:58.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.431+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pcbccI10n18eKFAlBKBJr2_yA_Pp3eM_0 2024-09-12T01:10:58.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.432+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12852156862568609276', time=2024-09-12T02:52:26.133129+0000, chain.objs.size()=1 2024-09-12T01:10:58.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.432+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.79DWyG3YCS02R3uz_GntBxDZPR014X8_0 2024-09-12T01:10:58.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.432+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4748607778258532920', time=2024-09-12T02:52:26.159926+0000, chain.objs.size()=1 2024-09-12T01:10:58.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.sG7hm12CavW0zbeC_4h0qe6PHB66aG7_0 2024-09-12T01:10:58.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4404684408154244051', time=2024-09-12T02:52:26.167597+0000, chain.objs.size()=1 2024-09-12T01:10:58.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.NDUUUC0Efh6yT8hLx3zzx5ewykAl3Pu_0 2024-09-12T01:10:58.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8364545822466504552', time=2024-09-12T02:52:26.191806+0000, chain.objs.size()=1 2024-09-12T01:10:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.lCIcAiZ02fp_lujiEL3C6rRT8IoLK7r_0 2024-09-12T01:10:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3506375622687349751', time=2024-09-12T02:52:26.547135+0000, chain.objs.size()=1 2024-09-12T01:10:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.7kdaVmRe78EoJ-xil4aLfz9KVSpmRhc_0 2024-09-12T01:10:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4795663883350058601', time=2024-09-12T02:52:27.048210+0000, chain.objs.size()=1 2024-09-12T01:10:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Q88bT4R4wtixtpxpZa0Jj1ADIqTuwE8_0 2024-09-12T01:10:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8843966633463786779', time=2024-09-12T02:52:27.716849+0000, chain.objs.size()=1 2024-09-12T01:10:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.YJPH7pNCWlkK4iJvGgT-Kx6RHBidHs7_0 2024-09-12T01:10:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6099063923545387624', time=2024-09-12T02:52:27.721437+0000, chain.objs.size()=1 2024-09-12T01:10:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1lAyWKD6MHoYeGJnFsH1OHtdqtRWI19_0 2024-09-12T01:10:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.531147802589400818', time=2024-09-12T02:52:28.011848+0000, chain.objs.size()=1 2024-09-12T01:10:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.fSjL1Ymco-ZGF7eBoFv38yRaARsT6yY_0 2024-09-12T01:10:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3991341831762247325', time=2024-09-12T02:52:28.432944+0000, chain.objs.size()=1 2024-09-12T01:10:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.433+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.38KG9qyf5ukvVDGDUtNxQHNfWkn8Eas_0 2024-09-12T01:10:58.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.434+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18144401412691758836', time=2024-09-12T02:52:30.410527+0000, chain.objs.size()=1 2024-09-12T01:10:58.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.434+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wk1gYipuWaLLoq_Dpz5BxPvpvI7xaOA_0 2024-09-12T01:10:58.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.436+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9726874868541102992', time=2024-09-12T02:52:30.461266+0000, chain.objs.size()=1 2024-09-12T01:10:58.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.436+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Op2fHzKUiH9Vme7eu6pIhLx-hRT5fC0_0 2024-09-12T01:10:58.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.436+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.716947347048875514', time=2024-09-12T02:52:30.545277+0000, chain.objs.size()=1 2024-09-12T01:10:58.435 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.436+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.rZ4oyl2yNOXkQOc4knHeZhyB9AzfPoG_0 2024-09-12T01:10:58.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17994712249414214701', time=2024-09-12T02:52:30.545910+0000, chain.objs.size()=1 2024-09-12T01:10:58.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.JnUE0oZ-4-WOZnY-nI8YU3tGDn65BCN_0 2024-09-12T01:10:58.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.27175069886568987', time=2024-09-12T02:52:30.831390+0000, chain.objs.size()=1 2024-09-12T01:10:58.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.c-WGAS-iaVLLDjqXHAn5N1Oe7VDeYKd_0 2024-09-12T01:10:58.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14056744280096582537', time=2024-09-12T02:52:30.862562+0000, chain.objs.size()=1 2024-09-12T01:10:58.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.6C9ENrLnoq1e5Zab7amJgOD1jtoZzGI_0 2024-09-12T01:10:58.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7883877985873587084', time=2024-09-12T02:52:31.128016+0000, chain.objs.size()=1 2024-09-12T01:10:58.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.E374yhCvvqMbBDvraXbt5-LfjydSWA__0 2024-09-12T01:10:58.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9101933216268306702', time=2024-09-12T02:52:31.939080+0000, chain.objs.size()=1 2024-09-12T01:10:58.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0uGLAJm8avTd6f5Xanl3EuEs799-AK5_0 2024-09-12T01:10:58.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16426256010153424497', time=2024-09-12T02:52:40.581620+0000, chain.objs.size()=1 2024-09-12T01:10:58.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.278__shadow_.PMtOmqfBAWp0yBMjeEAkFV4Gf2qwh8s_0 2024-09-12T01:10:58.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4986408348252931725', time=2024-09-12T02:52:44.814525+0000, chain.objs.size()=1 2024-09-12T01:10:58.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.285__shadow_.rOvW-pir-79YTJnmtKtZjVxKCucZfUM_0 2024-09-12T01:10:58.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17884748451468891696', time=2024-09-12T02:52:46.746573+0000, chain.objs.size()=1 2024-09-12T01:10:58.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.288__shadow_.aBDWvqiF68XsmMS7GmcIUcY3WPE2fqe_0 2024-09-12T01:10:58.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18307455980981947118', time=2024-09-12T02:52:48.596406+0000, chain.objs.size()=1 2024-09-12T01:10:58.438 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.437+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.291__shadow_.696ULt2MJpjz_t8_O3nhGw1hTpF1Qua_0 2024-09-12T01:10:58.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.439+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5170840869086458446', time=2024-09-12T02:52:53.173783+0000, chain.objs.size()=1 2024-09-12T01:10:58.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.439+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.gWYqhIttxx4SK9sFK_ZA_9Dt0Dpmbr__0 2024-09-12T01:10:58.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.440+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3867545081448120760', time=2024-09-12T02:52:53.266860+0000, chain.objs.size()=1 2024-09-12T01:10:58.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.440+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.0UlRKhLGxOheCzdYJhZHF1lwlGkFv5w_0 2024-09-12T01:10:58.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.440+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10120517405361322770', time=2024-09-12T02:53:12.035925+0000, chain.objs.size()=1 2024-09-12T01:10:58.439 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.440+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.323__shadow_.Onm0i_o0BK6_n3HkO8tsOwIPoQ1oRQ5_0 2024-09-12T01:10:58.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15364062896581259545', time=2024-09-12T02:53:49.402118+0000, chain.objs.size()=1 2024-09-12T01:10:58.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.a23JvKmBgx716W-jUn2tmAntLWybK-b_0 2024-09-12T01:10:58.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2763438009669432075', time=2024-09-12T02:53:49.962907+0000, chain.objs.size()=1 2024-09-12T01:10:58.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.yjJUZ7eoI7w_yDKHiPzIY2V6LYV1RzQ_0 2024-09-12T01:10:58.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17763157081040108835', time=2024-09-12T02:53:50.289409+0000, chain.objs.size()=1 2024-09-12T01:10:58.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.8zp-9kk7thYGnEaroOup38bZVvn9orO_0 2024-09-12T01:10:58.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8472936026569788253', time=2024-09-12T02:53:51.808158+0000, chain.objs.size()=1 2024-09-12T01:10:58.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.KvY6bwNyoVmVpS26ath3iIEQqIVQ8D0_0 2024-09-12T01:10:58.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11189237056280617862', time=2024-09-12T02:53:51.898558+0000, chain.objs.size()=1 2024-09-12T01:10:58.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.H41kKuseESJ36YoiH_FrfxyXICmTA-M_0 2024-09-12T01:10:58.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15056750120644484846', time=2024-09-12T02:53:52.372463+0000, chain.objs.size()=1 2024-09-12T01:10:58.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.JGIsBdNvL1QH6KH7W78q1YJckdw3UeL_0 2024-09-12T01:10:58.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2931028279306663305', time=2024-09-12T02:53:52.425449+0000, chain.objs.size()=1 2024-09-12T01:10:58.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.iF8-CEPNN6_3IUEVivAF45A1QyClHro_0 2024-09-12T01:10:58.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7910879464708504657', time=2024-09-12T02:53:52.474029+0000, chain.objs.size()=1 2024-09-12T01:10:58.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.2KrPSa9cvBrnPZqM41VRBjib3l-65zt_0 2024-09-12T01:10:58.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.442+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15755626154742735779', time=2024-09-12T02:53:52.518296+0000, chain.objs.size()=1 2024-09-12T01:10:58.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.442+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Msg-M-gp3TYqtXiH6UARXQRiAM0s6f__0 2024-09-12T01:10:58.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.443+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5253222355896807809', time=2024-09-12T02:53:52.571688+0000, chain.objs.size()=1 2024-09-12T01:10:58.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.443+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.iMb5L7FHFXI1uMe_vMBJPhLwhzp11d0_0 2024-09-12T01:10:58.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.444+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2809803463582736173', time=2024-09-12T02:53:52.603217+0000, chain.objs.size()=1 2024-09-12T01:10:58.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.444+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Vlxh7J75Do55TjYn78YZgdT8r5yIfhY_0 2024-09-12T01:10:58.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.445+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6289205146980977624', time=2024-09-12T02:53:52.752855+0000, chain.objs.size()=1 2024-09-12T01:10:58.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.445+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.zNF8oXWGwAxhGcj6pXsGuOR9Ar853RA_0 2024-09-12T01:10:58.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.445+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16352959779562616945', time=2024-09-12T02:53:52.792592+0000, chain.objs.size()=1 2024-09-12T01:10:58.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.445+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_._2QY7VWTqQKgPdKHseDP12wxn857Krb_0 2024-09-12T01:10:58.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13034145603049003404', time=2024-09-12T02:53:52.961847+0000, chain.objs.size()=1 2024-09-12T01:10:58.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.T-mwKxtKi1G-M8fKgdMvIoGKPegJF1B_0 2024-09-12T01:10:58.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9933269537203750425', time=2024-09-12T02:53:53.876967+0000, chain.objs.size()=1 2024-09-12T01:10:58.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.BVnGBxkemjlI7laRzATiSkPFwz-v5vD_0 2024-09-12T01:10:58.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15453934804842097180', time=2024-09-12T02:53:54.480436+0000, chain.objs.size()=1 2024-09-12T01:10:58.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.XceV-jN-bG9Kj0L2hmxIfcphFtofAjt_0 2024-09-12T01:10:58.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8801160148298940392', time=2024-09-12T02:53:54.481181+0000, chain.objs.size()=1 2024-09-12T01:10:58.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.k8m0-hZ9HQY154nS8AvkaB3wCoFt7B8_0 2024-09-12T01:10:58.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13989501821070644922', time=2024-09-12T02:53:55.261117+0000, chain.objs.size()=1 2024-09-12T01:10:58.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.HcD7NuLiGETg6ykv6vToOe3SzmACVTK_0 2024-09-12T01:10:58.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1620513501390093830', time=2024-09-12T02:53:56.355618+0000, chain.objs.size()=1 2024-09-12T01:10:58.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.itogTNkd2ZX1TygDEAwZmZTifQ219bL_0 2024-09-12T01:10:58.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2663838130515942912', time=2024-09-12T02:53:57.217526+0000, chain.objs.size()=1 2024-09-12T01:10:58.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.EDyLl7Fg6K3M75n8uuWwgClIY68kvZs_0 2024-09-12T01:10:58.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11670762323231954605', time=2024-09-12T02:53:58.137809+0000, chain.objs.size()=1 2024-09-12T01:10:58.447 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.446+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nlCW7-Dx-E-mygsCCztV1MVqNebXzv7_0 2024-09-12T01:10:58.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.447+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1898488257868923018', time=2024-09-12T02:53:58.158379+0000, chain.objs.size()=1 2024-09-12T01:10:58.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.447+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tuHEgf3w27fK0Y8zrotvZssxoJ2vXIc_0 2024-09-12T01:10:58.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.449+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10999932986504169911', time=2024-09-12T02:53:58.324318+0000, chain.objs.size()=1 2024-09-12T01:10:58.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.449+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.RmMDLS6w8nwN3QB5xHds00uqAWL2gNl_0 2024-09-12T01:10:58.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.449+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9449855315968834522', time=2024-09-12T02:53:59.093751+0000, chain.objs.size()=1 2024-09-12T01:10:58.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.449+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bdoJNEojTU6-2S9z8sBicQTNUdWS1h0_0 2024-09-12T01:10:58.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.449+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3052565279318977112', time=2024-09-12T02:53:59.457798+0000, chain.objs.size()=1 2024-09-12T01:10:58.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.449+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.eB7aCqYlXbAuAPI3aKrvY25mPG91Dal_0 2024-09-12T01:10:58.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.451+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5474040286147797154', time=2024-09-12T02:53:59.517304+0000, chain.objs.size()=1 2024-09-12T01:10:58.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.451+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.YAEirTi3hcojowzqb54CszIK6JBOfyM_0 2024-09-12T01:10:58.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.451+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9334232085524358223', time=2024-09-12T02:54:36.771637+0000, chain.objs.size()=1 2024-09-12T01:10:58.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.451+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.HZG9YLPzuHUIUMh6ZI5Q9u6ziCpH7KD_0 2024-09-12T01:10:58.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.451+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13201559315936491239', time=2024-09-12T02:54:37.282511+0000, chain.objs.size()=1 2024-09-12T01:10:58.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.451+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.g7Ydcjr79cBluqPsQvBwYdLv2BVEPxV_0 2024-09-12T01:10:58.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.451+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1580566453881110416', time=2024-09-12T02:54:37.458344+0000, chain.objs.size()=1 2024-09-12T01:10:58.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.451+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.TX1NFjcKV1Cd7zfN4WIvyE6Uiy9QwSo_0 2024-09-12T01:10:58.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.451+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8086383857635668283', time=2024-09-12T02:54:37.609715+0000, chain.objs.size()=1 2024-09-12T01:10:58.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.451+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6vJppPqLPO960LjEedn1B1g0crgmjvu_0 2024-09-12T01:10:58.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.451+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8112698196455604928', time=2024-09-12T02:54:38.082630+0000, chain.objs.size()=1 2024-09-12T01:10:58.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.451+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.d9IKkbkQNfT4zpOJ1SLmMbXIKpC-M_p_0 2024-09-12T01:10:58.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.451+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7564911401440301422', time=2024-09-12T02:54:38.125317+0000, chain.objs.size()=1 2024-09-12T01:10:58.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.451+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.XK6r-C8s4Ldhxt8YNqG9sbH-q0mWEmx_0 2024-09-12T01:10:58.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.453+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8401744322800533360', time=2024-09-12T02:54:38.193135+0000, chain.objs.size()=1 2024-09-12T01:10:58.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.453+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9RehB2wLTQMuSYrCFgSfi1tMl3cARuL_0 2024-09-12T01:10:58.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.455+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3381386507106634960', time=2024-09-12T02:54:38.546317+0000, chain.objs.size()=1 2024-09-12T01:10:58.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.455+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.2Y5deUG71sXoe10BpxMtoXe_U92yYRE_0 2024-09-12T01:10:58.454 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.455+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1568235766126782959', time=2024-09-12T02:54:38.559153+0000, chain.objs.size()=1 2024-09-12T01:10:58.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.455+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.1AdQ4IyIb05it7CjwZ9sjMXQ4euUu9f_0 2024-09-12T01:10:58.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.455+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11761069738142192893', time=2024-09-12T02:54:39.666626+0000, chain.objs.size()=1 2024-09-12T01:10:58.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.455+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6pGO9xRp5xEaYMoMF4JZtXZE8gfKie9_0 2024-09-12T01:10:58.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.456+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8948842182490460424', time=2024-09-12T02:54:39.667371+0000, chain.objs.size()=1 2024-09-12T01:10:58.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.456+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.WKnxgvJYjH_wVCcfFRLJ2oerlVjOeQQ_0 2024-09-12T01:10:58.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.456+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6356459163854353285', time=2024-09-12T02:54:40.103779+0000, chain.objs.size()=1 2024-09-12T01:10:58.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.456+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.j1dvnBzVA0ec7qO88YarE4j3tc8z3Lp_0 2024-09-12T01:10:58.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.456+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12071331940593813077', time=2024-09-12T02:54:40.254728+0000, chain.objs.size()=1 2024-09-12T01:10:58.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.456+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.blH8Dsz3onoLxR1PwmPim27UWwYnPii_0 2024-09-12T01:10:58.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.456+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4221349474802312854', time=2024-09-12T02:54:40.911189+0000, chain.objs.size()=1 2024-09-12T01:10:58.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.456+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.5lVp6HdqCtLWl0-YGKUPizTcJBp3HUh_0 2024-09-12T01:10:58.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.456+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5936881609809245676', time=2024-09-12T02:54:40.911913+0000, chain.objs.size()=1 2024-09-12T01:10:58.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.456+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.lB1dNs7atvwjy9XFPjuBegM3_1_qs1U_0 2024-09-12T01:10:58.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.456+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18117469727621546957', time=2024-09-12T02:54:41.172009+0000, chain.objs.size()=1 2024-09-12T01:10:58.456 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.456+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.V5sSUtIUXy6Crn-o9NRa3b00LrLyuHh_0 2024-09-12T01:10:58.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.456+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6471363381082125230', time=2024-09-12T02:54:41.188984+0000, chain.objs.size()=1 2024-09-12T01:10:58.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.456+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.gtNUmh8AtwIABUpiT1_biuqd_u97Ssk_0 2024-09-12T01:10:58.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.457+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17223873582506553246', time=2024-09-12T02:54:42.215481+0000, chain.objs.size()=1 2024-09-12T01:10:58.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.457+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.1lzLAEUPRypAOM9WYOJjZi9468FLS6A_0 2024-09-12T01:10:58.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.458+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9859632801088582034', time=2024-09-12T02:54:42.958615+0000, chain.objs.size()=1 2024-09-12T01:10:58.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.458+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.PQdANJKDeYZl-ASscH7DJbr1ReSOEgm_0 2024-09-12T01:10:58.457 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.458+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7444543363234655853', time=2024-09-12T02:54:42.989622+0000, chain.objs.size()=1 2024-09-12T01:10:58.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.458+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.JuoitNoKiGSsqREpHltZXJ_3XL_VKhI_0 2024-09-12T01:10:58.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.460+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8822187317380749934', time=2024-09-12T02:54:43.468482+0000, chain.objs.size()=1 2024-09-12T01:10:58.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.460+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.3Ion64j_ZylfwbFJMpUW8cuhWf2cgGo_0 2024-09-12T01:10:58.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.460+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10065868868252756799', time=2024-09-12T02:54:43.803417+0000, chain.objs.size()=1 2024-09-12T01:10:58.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.460+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.f15N8r99Q2R-KBtZn1x654XAsVvkNaa_0 2024-09-12T01:10:58.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.462+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/51238 2024-09-12T01:10:58.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T01:10:58.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3251996546764807456', time=2024-09-12T02:54:43.826637+0000, chain.objs.size()=1 2024-09-12T01:10:58.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.vKCK2-B80KI0eAZNzJrf48tnv4edMD6_0 2024-09-12T01:10:58.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15901221595888986155', time=2024-09-12T02:54:43.827421+0000, chain.objs.size()=1 2024-09-12T01:10:58.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Ve_NBPFGSpspXgDpPOH-W3UuoNfflh1_0 2024-09-12T01:10:58.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10246841379306200502', time=2024-09-12T02:54:44.178340+0000, chain.objs.size()=1 2024-09-12T01:10:58.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nSJh5rRv0-sWCdJWA1peAmd0Kmqmv0N_0 2024-09-12T01:10:58.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.762041444186428687', time=2024-09-12T02:54:44.216553+0000, chain.objs.size()=1 2024-09-12T01:10:58.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.2FZRs33xlOCcG-sO3zf9XBOZJ1j17pP_0 2024-09-12T01:10:58.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10060200536511709467', time=2024-09-12T02:54:44.523479+0000, chain.objs.size()=1 2024-09-12T01:10:58.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.cQcT9b2iwLYLF5nccr71_K8c6gJTLRw_0 2024-09-12T01:10:58.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12426045710194882063', time=2024-09-12T02:54:45.099006+0000, chain.objs.size()=1 2024-09-12T01:10:58.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.2j84AP0b2YV7qCKK8lWDPR0bgovTOo3_0 2024-09-12T01:10:58.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10235572203173358622', time=2024-09-12T02:54:45.763619+0000, chain.objs.size()=1 2024-09-12T01:10:58.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.BrhWnDe3H8EiuZndNnz2qrnlxZyu0nT_0 2024-09-12T01:10:58.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7476461847154583307', time=2024-09-12T02:54:45.984227+0000, chain.objs.size()=1 2024-09-12T01:10:58.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ozhzDZ2gIe09-FU-RN9ddAb1XyiUjXi_0 2024-09-12T01:10:58.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11692257381122495587', time=2024-09-12T02:54:45.985010+0000, chain.objs.size()=1 2024-09-12T01:10:58.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._Ghgex218EEO07xGTivsuXzT9jTCKvf_0 2024-09-12T01:10:58.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7459342596317356705', time=2024-09-12T02:54:46.018109+0000, chain.objs.size()=1 2024-09-12T01:10:58.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.D2Hgd-RLEGGXaWUlX2uYXNWG_OvUzxh_0 2024-09-12T01:10:58.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15748423075295360266', time=2024-09-12T02:54:46.420316+0000, chain.objs.size()=1 2024-09-12T01:10:58.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.5e5Cs64f_BZK-NE8YK3aes0AihYnxRO_0 2024-09-12T01:10:58.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5578150816055561826', time=2024-09-12T02:54:46.610250+0000, chain.objs.size()=1 2024-09-12T01:10:58.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.DUi7pcA8tjk5Mx0h_xYBySqG2IdOZ5O_0 2024-09-12T01:10:58.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.467+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13618203994252744634', time=2024-09-12T02:54:46.611519+0000, chain.objs.size()=1 2024-09-12T01:10:58.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.467+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.bNclIfC6JXsXAr4SXKARj4JH1H1p19E_0 2024-09-12T01:10:58.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.467+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5265408218368068593', time=2024-09-12T02:54:46.798609+0000, chain.objs.size()=1 2024-09-12T01:10:58.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.468+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.pDb4akdWx93fLuT8wCKzAZrJKdkDI5y_0 2024-09-12T01:10:58.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.468+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9147286136602956794', time=2024-09-12T02:54:46.901504+0000, chain.objs.size()=1 2024-09-12T01:10:58.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.468+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.pt4XpLza1wxXK9Zvk-syRhxihwNG2mX_0 2024-09-12T01:10:58.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.468+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8372692277387928853', time=2024-09-12T02:54:46.984022+0000, chain.objs.size()=1 2024-09-12T01:10:58.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.468+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.7aqUDhKAGPBMTT5BP7kEew9uJHgjjr__0 2024-09-12T01:10:58.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.468+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12477886598768526415', time=2024-09-12T02:54:47.091779+0000, chain.objs.size()=1 2024-09-12T01:10:58.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.468+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.sN-T5NciWhCW5vX36yjX7W-3jqY-5k5_0 2024-09-12T01:10:58.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.469+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14885197583821189346', time=2024-09-12T02:54:52.343977+0000, chain.objs.size()=1 2024-09-12T01:10:58.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.469+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.335__shadow_.Fuhfb4xZ2RbCYK36BpGAHHUvKZMsRW0_0 2024-09-12T01:10:58.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.469+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15791996316906982103', time=2024-09-12T02:54:56.563768+0000, chain.objs.size()=1 2024-09-12T01:10:58.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.469+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.343__shadow_.huRKL7pbk7QSLfFjIGC_s3MRuXj3tl9_0 2024-09-12T01:10:58.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.470+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8709296289485280458', time=2024-09-12T02:55:16.994849+0000, chain.objs.size()=1 2024-09-12T01:10:58.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.470+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.383__shadow_.KCmIXdhT6haR7wE6a9pTUHTzuWtE28F_0 2024-09-12T01:10:58.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.470+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13213877324848144184', time=2024-09-12T02:55:47.417408+0000, chain.objs.size()=1 2024-09-12T01:10:58.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.470+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.438__shadow_.IUZmzENxGRkMCGyjDLO38mW345CeE_9_0 2024-09-12T01:10:58.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.470+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9500756683831726415', time=2024-09-12T02:56:14.319915+0000, chain.objs.size()=1 2024-09-12T01:10:58.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.470+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.484__shadow_.sBGULPTA-FzNT5LVKH-0aupXymboF1l_0 2024-09-12T01:10:58.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.470+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5769277765821634227', time=2024-09-12T02:56:20.112031+0000, chain.objs.size()=1 2024-09-12T01:10:58.469 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.470+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.488__shadow_.bF49oQ8hiY8PxwJe-srRAoCecTTmwIA_0 2024-09-12T01:10:58.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.471+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7150026256145309883', time=2024-09-12T02:56:29.496073+0000, chain.objs.size()=1 2024-09-12T01:10:58.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.471+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.504__shadow:IjSk329PwyZ.TikPwkNaT-eseYUSzXd_.b_0nQhQp9blBOoB3SP2J2YjUhbBu0Hw_0 2024-09-12T01:10:58.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.471+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1058782552137529518', time=2024-09-12T02:59:27.594728+0000, chain.objs.size()=1 2024-09-12T01:10:58.470 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.471+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.555__shadow_.yxW46d3mKae-WMDVZbX1xv15GgakamQ_0 2024-09-12T01:10:58.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.473+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12646624129720348318', time=2024-09-12T03:00:00.988686+0000, chain.objs.size()=1 2024-09-12T01:10:58.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.473+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:9DHuZvKLVoRZd2w2PKuFAeGb0obvIOW_.Gta1VP2yLNdQ6zrmh7l1W__3cdLqVYq_0 2024-09-12T01:10:58.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.473+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4174179464139242794', time=2024-09-12T03:00:32.596865+0000, chain.objs.size()=1 2024-09-12T01:10:58.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.473+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:p8ZDBZfSonKqHkHTrY.DzxNjQpQh46y_.1-VHfpLk9JwiLimijFyTlGYQAaf_-E8_0 2024-09-12T01:10:58.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.473+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10307891598085559193', time=2024-09-12T03:04:49.913899+0000, chain.objs.size()=1 2024-09-12T01:10:58.472 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.473+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.627__shadow_.zTUsGyIINl0SIJ--fwTymNcaH8qUIkJ_0 2024-09-12T01:10:58.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.473+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4414103340846672549', time=2024-09-12T03:04:55.765109+0000, chain.objs.size()=1 2024-09-12T01:10:58.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.473+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.637__shadow_.YNX4CfBJOM1glAq-LNEXJMjn3_CFac9_0 2024-09-12T01:10:58.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.473+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11465830849708058652', time=2024-09-12T03:05:36.641965+0000, chain.objs.size()=1 2024-09-12T01:10:58.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.473+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.667__shadow_.v3v1ZZRrduYwH4PjXz2PWFW6WxTVTYo_0 2024-09-12T01:10:58.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.474+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11001765631178370958', time=2024-09-12T03:05:38.252182+0000, chain.objs.size()=1 2024-09-12T01:10:58.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.474+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.671__shadow_.fYZ7gNMYTr_TkLPjM4HyYtdmJLpb1Jr_0 2024-09-12T01:10:58.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.474+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14464609875627929655', time=2024-09-12T03:06:23.082359+0000, chain.objs.size()=1 2024-09-12T01:10:58.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.474+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.718__shadow:5BcsONfDQp25Map-p8wuIRRghLmkHQt_.zdjIxUMbzPHYMBqn1V3jDHGkkaWV0X9_0 2024-09-12T01:10:58.473 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.474+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4182790380458675547', time=2024-09-12T03:10:27.258886+0000, chain.objs.size()=1 2024-09-12T01:10:58.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.474+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.783__shadow_.z3ic-f7pZShkmVMBAuftoj_cr_LRQge_0 2024-09-12T01:10:58.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.478+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:58.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.481+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:10:58.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.482+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:58.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.482+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:58.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44950' 2024-09-12T01:10:58.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15410511901147188061', time=2024-09-12T02:51:44.284919+0000, chain.objs.size()=1 2024-09-12T01:10:58.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.261__shadow_.9vsUJ1cy9XLezbEDmZIv5nCJ9mAgGX9_0 2024-09-12T01:10:58.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.345505294100568553', time=2024-09-12T02:52:21.127901+0000, chain.objs.size()=1 2024-09-12T01:10:58.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.O_Nj0uNHYbGES1-TF_eZr4j16xlLQzb_0 2024-09-12T01:10:58.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13006189824405215826', time=2024-09-12T02:52:21.450980+0000, chain.objs.size()=1 2024-09-12T01:10:58.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.25xoyHW20eMAhZ7z9NOtvYCrgEVO-gW_0 2024-09-12T01:10:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11314386985285271911', time=2024-09-12T02:52:21.913440+0000, chain.objs.size()=1 2024-09-12T01:10:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.213-aqca1K7bong8srpJCbztCoZa9q3_0 2024-09-12T01:10:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3185900852980839065', time=2024-09-12T02:52:22.096810+0000, chain.objs.size()=1 2024-09-12T01:10:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Nz1owe1enhB0bU5eNyPP3_bMflsRmAA_0 2024-09-12T01:10:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10413170829952420484', time=2024-09-12T02:52:22.135370+0000, chain.objs.size()=1 2024-09-12T01:10:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Yu69MQWegFKp28NZYXQ8fmy5CKVRTqc_0 2024-09-12T01:10:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4472365496295240981', time=2024-09-12T02:52:22.828941+0000, chain.objs.size()=1 2024-09-12T01:10:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.f3l-qrPSysnORgIa0kx8m4MNlF0rfVv_0 2024-09-12T01:10:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.61219759645138941', time=2024-09-12T02:52:23.102851+0000, chain.objs.size()=1 2024-09-12T01:10:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.TkT5sRZ2Rqgn30CT0ZFHodJkg_23PGk_0 2024-09-12T01:10:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4159722233388701716', time=2024-09-12T02:52:23.310372+0000, chain.objs.size()=1 2024-09-12T01:10:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.JdhQ3oepSKFk1oL-aCOPcaQD5lAg91-_0 2024-09-12T01:10:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2784942997602067729', time=2024-09-12T02:52:23.631470+0000, chain.objs.size()=1 2024-09-12T01:10:58.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5_jxmqfURtD_vrJfT2Ehq7VQuB0RPly_0 2024-09-12T01:10:58.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17255700898589749491', time=2024-09-12T02:52:24.588227+0000, chain.objs.size()=1 2024-09-12T01:10:58.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.eOjDglNdeQE-sMH6lPMoYGb_LU5txlm_0 2024-09-12T01:10:58.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11733387933311214955', time=2024-09-12T02:52:24.807869+0000, chain.objs.size()=1 2024-09-12T01:10:58.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.484+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.z98sLttR5ZmiWvDrBcDzqFaMEcMWLsG_0 2024-09-12T01:10:58.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.486+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3015791260367006449', time=2024-09-12T02:52:24.849828+0000, chain.objs.size()=1 2024-09-12T01:10:58.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.486+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pFMSVjagh4TMeqSUbghqAmht1xmade-_0 2024-09-12T01:10:58.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.486+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4346385128865361414', time=2024-09-12T02:52:25.019246+0000, chain.objs.size()=1 2024-09-12T01:10:58.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.486+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.z1alPoiucb8tVjAQqYvHvyTgOgCDdmd_0 2024-09-12T01:10:58.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.486+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6160890057860953810', time=2024-09-12T02:52:25.122648+0000, chain.objs.size()=1 2024-09-12T01:10:58.486 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.486+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.nxYlMhVQe7G7qDeg7i2CyqWaf78rFqx_0 2024-09-12T01:10:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.487+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2342998912802520890', time=2024-09-12T02:52:25.823729+0000, chain.objs.size()=1 2024-09-12T01:10:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.487+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.sbd0d6F6AeUuEiOABO_jEaXPHQCgfZY_0 2024-09-12T01:10:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.487+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2631729427448373271', time=2024-09-12T02:52:25.893263+0000, chain.objs.size()=1 2024-09-12T01:10:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.487+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._kZZSJ-_fsWTOM_MB2iNGOYNXKwyQMF_0 2024-09-12T01:10:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.487+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2850527141745594737', time=2024-09-12T02:52:26.259014+0000, chain.objs.size()=1 2024-09-12T01:10:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.487+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.LXgc7EKkEfBwGE-viAD4t21ggUnp3q9_0 2024-09-12T01:10:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.487+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1132471968586310452', time=2024-09-12T02:52:26.405514+0000, chain.objs.size()=1 2024-09-12T01:10:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.487+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pelT6nLTBcahXGleV01zOTJ-s0kjf2p_0 2024-09-12T01:10:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.487+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11618855345331869178', time=2024-09-12T02:52:26.406164+0000, chain.objs.size()=1 2024-09-12T01:10:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.487+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.lMkvCzaOLBmVuub-6D4JJvxikI0MHv3_0 2024-09-12T01:10:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.488+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9750789472242198074', time=2024-09-12T02:52:26.538680+0000, chain.objs.size()=1 2024-09-12T01:10:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.488+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uc2Tsy6D_hzlZ7c9qC3jvkQTU0XCCjA_0 2024-09-12T01:10:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.488+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14386196303929835952', time=2024-09-12T02:52:26.549651+0000, chain.objs.size()=1 2024-09-12T01:10:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.488+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.9YWQSBNM_k-MDJC8DrcS1T4MrzVWxZB_0 2024-09-12T01:10:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.488+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13047823407100062720', time=2024-09-12T02:52:27.115357+0000, chain.objs.size()=1 2024-09-12T01:10:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.488+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.8_09yxYdeKguBQzu5qk_2WQqZ97Dv3d_0 2024-09-12T01:10:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.489+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10779978654232884051', time=2024-09-12T02:52:27.238308+0000, chain.objs.size()=1 2024-09-12T01:10:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.489+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wpODmKG5Iwfxfg-26YiUHupjpKAbJo6_0 2024-09-12T01:10:58.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.490+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10244625607666164731', time=2024-09-12T02:52:27.504101+0000, chain.objs.size()=1 2024-09-12T01:10:58.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.490+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ryxa7LN7AZ6PKuF_TjqnWFo5sm1o4_8_0 2024-09-12T01:10:58.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.490+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10148219476154075669', time=2024-09-12T02:52:27.830111+0000, chain.objs.size()=1 2024-09-12T01:10:58.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.490+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.L8-dC6mJpBSir25gBTeFG1NmrI3Lsc0_0 2024-09-12T01:10:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.490+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6468458238174121058', time=2024-09-12T02:52:28.013595+0000, chain.objs.size()=1 2024-09-12T01:10:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.490+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.MNiAy9rsifq8Y76xv4-2i9Ux9xfndQ-_0 2024-09-12T01:10:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.491+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18283103912111055053', time=2024-09-12T02:52:28.033019+0000, chain.objs.size()=1 2024-09-12T01:10:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.491+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ahPvZk9IpDu8wxhNMvygc0-HTjwUTT__0 2024-09-12T01:10:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.491+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8361602997368051589', time=2024-09-12T02:52:28.708063+0000, chain.objs.size()=1 2024-09-12T01:10:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.491+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.9VusGGENXFHca169Ydb2iL_PfC7-1Cg_0 2024-09-12T01:10:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.491+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7210158199435897644', time=2024-09-12T02:52:28.807618+0000, chain.objs.size()=1 2024-09-12T01:10:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.491+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xKnGY2dInRT_SOH1Mb3zI5Ns9SFBpZa_0 2024-09-12T01:10:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.491+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14580203384666136434', time=2024-09-12T02:52:28.812283+0000, chain.objs.size()=1 2024-09-12T01:10:58.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.491+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4aJeyCPlCjLcQBfh9Sd04pJ4jTFj_9-_0 2024-09-12T01:10:58.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.491+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6224106048027301073', time=2024-09-12T02:52:28.949509+0000, chain.objs.size()=1 2024-09-12T01:10:58.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.491+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.qy_6SEErjIqxoewtnmNwNmrA4O39xNs_0 2024-09-12T01:10:58.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.491+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3621638435983281801', time=2024-09-12T02:52:29.471843+0000, chain.objs.size()=1 2024-09-12T01:10:58.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.491+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0Fss5NuqlycEo3YneqYx4AtvE0l1Gx3_0 2024-09-12T01:10:58.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.493+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17168738391730297521', time=2024-09-12T02:52:29.863889+0000, chain.objs.size()=1 2024-09-12T01:10:58.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.493+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.hjHKNVmdql_k0Ef9KR3TgfAqh0Eqxkd_0 2024-09-12T01:10:58.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.493+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16003525665595556403', time=2024-09-12T02:52:30.062497+0000, chain.objs.size()=1 2024-09-12T01:10:58.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.493+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.hDX8MoOOfsIkqbQ0oIFp2U5tITfZJlo_0 2024-09-12T01:10:58.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.493+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2523240751859300902', time=2024-09-12T02:52:30.305267+0000, chain.objs.size()=1 2024-09-12T01:10:58.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.493+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1CQAQgEu0zIIUDmsed-RgIIDRS0IrrH_0 2024-09-12T01:10:58.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.494+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4684666922936730072', time=2024-09-12T02:52:30.470187+0000, chain.objs.size()=1 2024-09-12T01:10:58.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.494+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.q5Z3UNZzCxrvt4_4N-xhgO1mdcqPBPU_0 2024-09-12T01:10:58.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1757558143344592735', time=2024-09-12T02:52:31.429726+0000, chain.objs.size()=1 2024-09-12T01:10:58.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.gaXrniVeSFwCxA5E6MatcL3lfHcrnuh_0 2024-09-12T01:10:58.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.122654320875588754', time=2024-09-12T02:52:31.542478+0000, chain.objs.size()=1 2024-09-12T01:10:58.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.TXJj6yYNL-c6JF6O8KAfpAvNl9ALsCm_0 2024-09-12T01:10:58.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8329483479488200640', time=2024-09-12T02:52:31.859477+0000, chain.objs.size()=1 2024-09-12T01:10:58.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.LK9FUOaidtM4FbaLlvxwaNsqgmRyRLJ_0 2024-09-12T01:10:58.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5793332397289767174', time=2024-09-12T02:52:33.103093+0000, chain.objs.size()=1 2024-09-12T01:10:58.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.265__shadow_.qSn0fc31Kx5feCs779Zgi54aUoN7QHG_0 2024-09-12T01:10:58.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4893201313805854381', time=2024-09-12T02:52:40.577144+0000, chain.objs.size()=1 2024-09-12T01:10:58.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.278__shadow_.05JeFnJhzjCUVQaismVlZyTqBhuSYz2_0 2024-09-12T01:10:58.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2876031250119568594', time=2024-09-12T02:52:44.217061+0000, chain.objs.size()=1 2024-09-12T01:10:58.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.284__shadow_.jFBbVnP_eGx6RD76_N5tTee3ZqR72Qj_0 2024-09-12T01:10:58.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7633397894593743249', time=2024-09-12T02:52:51.133353+0000, chain.objs.size()=1 2024-09-12T01:10:58.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_._dhZs3BDtLC3MAAOu6dcxXbfH45ceeA_0 2024-09-12T01:10:58.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4518392834852188429', time=2024-09-12T02:52:53.199359+0000, chain.objs.size()=1 2024-09-12T01:10:58.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.495+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.IbMPUHi-U8bCTfHMjq0D1U8i0Q1Tnot_0 2024-09-12T01:10:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.498+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3181558931337172572', time=2024-09-12T02:52:53.275185+0000, chain.objs.size()=1 2024-09-12T01:10:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.498+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.Z3IL5EmQ9w2DPOqQA1J5MBEBhtCRHD7_0 2024-09-12T01:10:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.498+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3827613195292318720', time=2024-09-12T02:52:54.481765+0000, chain.objs.size()=1 2024-09-12T01:10:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.498+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.296__shadow_.dhcQY7CuZl8zOAObvwYU3A0HuJkLiRE_0 2024-09-12T01:10:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.498+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5782534303298830345', time=2024-09-12T02:53:49.797976+0000, chain.objs.size()=1 2024-09-12T01:10:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.498+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.khXFwq-LcrkbANgl2I9lrI80PA_nd5P_0 2024-09-12T01:10:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.498+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15858478457692502362', time=2024-09-12T02:53:49.874729+0000, chain.objs.size()=1 2024-09-12T01:10:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.498+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ljjslMtcO04xLA-Vm_DdtfrDiWOXt7p_0 2024-09-12T01:10:58.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.499+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15738140168810615396', time=2024-09-12T02:53:49.980685+0000, chain.objs.size()=1 2024-09-12T01:10:58.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.499+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.XLN4ng_q3_tj8NwmH5vnJYtOlJsDoQo_0 2024-09-12T01:10:58.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.499+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5978146647066333716', time=2024-09-12T02:53:50.367031+0000, chain.objs.size()=1 2024-09-12T01:10:58.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.499+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.gxUtAWciKttuP5f4dxivp9Rb6xhBuyd_0 2024-09-12T01:10:58.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.499+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4368028222552146304', time=2024-09-12T02:53:50.894619+0000, chain.objs.size()=1 2024-09-12T01:10:58.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.499+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5BLe_JJp1RiXieqogrR3RLn6h21pYI4_0 2024-09-12T01:10:58.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.499+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6397902027033969249', time=2024-09-12T02:53:50.914808+0000, chain.objs.size()=1 2024-09-12T01:10:58.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.499+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.3Eq4MYfkwVPKmF2IxeWms6IeOk6SJ1t_0 2024-09-12T01:10:58.499 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.500+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15804604807467426899', time=2024-09-12T02:53:50.915353+0000, chain.objs.size()=1 2024-09-12T01:10:58.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.500+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.TPfF4BXavJXwsmLeQha68UnWzVWP1l4_0 2024-09-12T01:10:58.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.500+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13226338172604927971', time=2024-09-12T02:53:51.005979+0000, chain.objs.size()=1 2024-09-12T01:10:58.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.500+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.UHBvoFl3DRllVRlKx71wmFTP8bwxg8u_0 2024-09-12T01:10:58.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.500+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11613502734812437806', time=2024-09-12T02:53:51.437528+0000, chain.objs.size()=1 2024-09-12T01:10:58.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.500+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lDIIjFxo8yQ_6ztGgwNtcrhhu4ClfUd_0 2024-09-12T01:10:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.502+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3117212855564891342', time=2024-09-12T02:53:52.377300+0000, chain.objs.size()=1 2024-09-12T01:10:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.502+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.05dwvLxXeG37pqB6TD1-tSVSE4cnxzJ_0 2024-09-12T01:10:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.502+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18184722651417208847', time=2024-09-12T02:53:52.599569+0000, chain.objs.size()=1 2024-09-12T01:10:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.502+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.F0I1N-E7AfDKqaqfs1xpO-xZRCbMA--_0 2024-09-12T01:10:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.502+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10923601740767962559', time=2024-09-12T02:53:53.276163+0000, chain.objs.size()=1 2024-09-12T01:10:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.502+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dcdKGyhLYymw59Rkf8WepcGpT8QQgsZ_0 2024-09-12T01:10:58.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.502+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6177836604564249699', time=2024-09-12T02:53:53.323909+0000, chain.objs.size()=1 2024-09-12T01:10:58.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.502+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.6fMLP_3NzUajR3vkZOKzVJqM4iANvQR_0 2024-09-12T01:10:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.503+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7507297430348513304', time=2024-09-12T02:53:54.039804+0000, chain.objs.size()=1 2024-09-12T01:10:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.504+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Z3LnWgHbmIIwCzEZ7xUH-l1dN9BMR0f_0 2024-09-12T01:10:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.504+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2003640310463956743', time=2024-09-12T02:53:54.133362+0000, chain.objs.size()=1 2024-09-12T01:10:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.504+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.rK6soAKYcVH2_7Xm3RJQgjDHhZKV-6d_0 2024-09-12T01:10:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.504+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10626157609888513606', time=2024-09-12T02:53:54.379940+0000, chain.objs.size()=1 2024-09-12T01:10:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.504+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0c-x9Hjcfn2yIbdcESkSZjf21jIyJCe_0 2024-09-12T01:10:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.504+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11631654587620051699', time=2024-09-12T02:53:54.491032+0000, chain.objs.size()=1 2024-09-12T01:10:58.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.504+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0ZvaG_vPafGV_buOvBNdcFoXDzICPHR_0 2024-09-12T01:10:58.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.504+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10603763917548344832', time=2024-09-12T02:53:54.635098+0000, chain.objs.size()=1 2024-09-12T01:10:58.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.504+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.8w6nokZ56Ngqu42_552fxQR2BetL1hx_0 2024-09-12T01:10:58.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.504+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14972938879572454925', time=2024-09-12T02:53:55.079167+0000, chain.objs.size()=1 2024-09-12T01:10:58.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.504+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ySM-JrjHXS91V3LZ8ZRH2oLbITwv4zF_0 2024-09-12T01:10:58.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.504+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9369748051465867490', time=2024-09-12T02:53:55.192522+0000, chain.objs.size()=1 2024-09-12T01:10:58.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.504+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cpAvdC-J-UC_E5iz3bpQxYyMArUTfqx_0 2024-09-12T01:10:58.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.505+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17868732429596950649', time=2024-09-12T02:53:55.267004+0000, chain.objs.size()=1 2024-09-12T01:10:58.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.505+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5tZVJrBsP8H1tDlqRUgnCLCCBzsFwwX_0 2024-09-12T01:10:58.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.506+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7859084893424630609', time=2024-09-12T02:53:55.373627+0000, chain.objs.size()=1 2024-09-12T01:10:58.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.506+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.npc7slP_VHnj_utQ5QcSJYw3Th8JWI4_0 2024-09-12T01:10:58.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.506+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3745886264472593722', time=2024-09-12T02:53:55.574365+0000, chain.objs.size()=1 2024-09-12T01:10:58.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.506+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.NfdjHfDqeqIHgWkzO6vnpu8NnqdOBGT_0 2024-09-12T01:10:58.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.506+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13403099237699744908', time=2024-09-12T02:53:55.993141+0000, chain.objs.size()=1 2024-09-12T01:10:58.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.506+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cyYwsmtvGjW_0IsV6SD0zjO5CqauWXP_0 2024-09-12T01:10:58.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.507+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.975737030269589860', time=2024-09-12T02:53:56.014756+0000, chain.objs.size()=1 2024-09-12T01:10:58.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.507+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.zlkRSmhkXG88RkeD70CRcVodh0SMT7S_0 2024-09-12T01:10:58.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.508+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15147140661002257858', time=2024-09-12T02:53:56.559744+0000, chain.objs.size()=1 2024-09-12T01:10:58.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.508+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.BhtK4xV-lXQCY-yDjl1vA6d0b8Ulk0u_0 2024-09-12T01:10:58.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.508+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4722527203452907137', time=2024-09-12T02:53:56.606208+0000, chain.objs.size()=1 2024-09-12T01:10:58.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.508+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.l6lS6JiqBs65lRPf9_QATc9P8xjm9fb_0 2024-09-12T01:10:58.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.508+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18403787482558293524', time=2024-09-12T02:53:56.705089+0000, chain.objs.size()=1 2024-09-12T01:10:58.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.508+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.IERIc88WnuQLkwAH4G7O6dWCkxDHsbu_0 2024-09-12T01:10:58.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.508+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2506533707291543097', time=2024-09-12T02:53:57.057614+0000, chain.objs.size()=1 2024-09-12T01:10:58.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.508+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lNenAcInCs2-BKU5ThQan2qn62S4XH5_0 2024-09-12T01:10:58.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.508+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13537308405955935867', time=2024-09-12T02:53:57.182809+0000, chain.objs.size()=1 2024-09-12T01:10:58.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.508+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.LALZGNcckQml73wQkrXEG4ecVuAzv_a_0 2024-09-12T01:10:58.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.508+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1582246207260543322', time=2024-09-12T02:53:57.388299+0000, chain.objs.size()=1 2024-09-12T01:10:58.508 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.508+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.CqCPre_8cDdWzywtiHxSewbW1Y1-MKX_0 2024-09-12T01:10:58.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.509+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3003315891213067', time=2024-09-12T02:53:57.727640+0000, chain.objs.size()=1 2024-09-12T01:10:58.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.509+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.-t59M3CqWLtrMuN1YAlNNBi2NVjlnnM_0 2024-09-12T01:10:58.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.511+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2633972869631745947', time=2024-09-12T02:53:58.220743+0000, chain.objs.size()=1 2024-09-12T01:10:58.510 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.511+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Fxn2fLswplRFdvMbzFLy9TvdSiGFx_v_0 2024-09-12T01:10:58.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1656889938550680626', time=2024-09-12T02:53:59.477192+0000, chain.objs.size()=1 2024-09-12T01:10:58.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.yuvpMcvoRO5bYBZIuxpe3puj0Qer9Hd_0 2024-09-12T01:10:58.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16805640947865230883', time=2024-09-12T02:53:59.509299+0000, chain.objs.size()=1 2024-09-12T01:10:58.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.3OWNp8ZNg7K1-NC2nYrNwGg4Ix97r9X_0 2024-09-12T01:10:58.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12486970927267855724', time=2024-09-12T02:53:59.693477+0000, chain.objs.size()=1 2024-09-12T01:10:58.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_._3FUDdf_Jewgq4eeqJkDa6daCI5UBnJ_0 2024-09-12T01:10:58.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17744628928170600305', time=2024-09-12T02:54:37.201875+0000, chain.objs.size()=1 2024-09-12T01:10:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.i-U9sKXnZzSfsZ5SXy0jdKaFqEP3sNZ_0 2024-09-12T01:10:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14630403859921146387', time=2024-09-12T02:54:37.585908+0000, chain.objs.size()=1 2024-09-12T01:10:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.0D8UWjiEH1FOucHFVkxavaHkf18kk5g_0 2024-09-12T01:10:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7653004092690725003', time=2024-09-12T02:54:38.199194+0000, chain.objs.size()=1 2024-09-12T01:10:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.-E-1zkncPlxerY_3J8rwqDeuk-8M95Z_0 2024-09-12T01:10:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.365336913172618070', time=2024-09-12T02:54:38.558944+0000, chain.objs.size()=1 2024-09-12T01:10:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.WelSy4brYVVGxAl5pGpssLpDcMh7Pno_0 2024-09-12T01:10:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5337935008136517639', time=2024-09-12T02:54:39.667422+0000, chain.objs.size()=1 2024-09-12T01:10:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.X4RKkcHoD22D0zXE1BlpDc8wbToDfjn_0 2024-09-12T01:10:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3202444842134201486', time=2024-09-12T02:54:39.763597+0000, chain.objs.size()=1 2024-09-12T01:10:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.WmDTVlXEXcH3s3UWTS72OwdjzFYSmJc_0 2024-09-12T01:10:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9179151465591671592', time=2024-09-12T02:54:39.974823+0000, chain.objs.size()=1 2024-09-12T01:10:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.512+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.hVoar99n8vxh0yTLFeTNWEJFyMx3oOO_0 2024-09-12T01:10:58.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.514+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1404102285018938441', time=2024-09-12T02:54:40.155139+0000, chain.objs.size()=1 2024-09-12T01:10:58.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.514+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Z5y78lbSDinihGZUKrnyIX7FjFc1siN_0 2024-09-12T01:10:58.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15563625326912257770', time=2024-09-12T02:54:40.868417+0000, chain.objs.size()=1 2024-09-12T01:10:58.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.515+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.VNc3Oo_J8r_NMBzK_Aj0ibqxx6iHX2c_0 2024-09-12T01:10:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11668778069320772664', time=2024-09-12T02:54:40.874543+0000, chain.objs.size()=1 2024-09-12T01:10:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.515+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.hS70LTOackEzw9f86eqT6O2KNY7mnTs_0 2024-09-12T01:10:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8398677266948374800', time=2024-09-12T02:54:41.031881+0000, chain.objs.size()=1 2024-09-12T01:10:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.515+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.bx6SGBG4h6NW_0gR52fyRwL_NOtVI--_0 2024-09-12T01:10:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.516+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16619614973105475514', time=2024-09-12T02:54:41.843880+0000, chain.objs.size()=1 2024-09-12T01:10:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.516+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.3DRVthAdiUQJ9fKH-wKtWYExCsg5DiS_0 2024-09-12T01:10:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.516+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7985242234219358259', time=2024-09-12T02:54:43.848858+0000, chain.objs.size()=1 2024-09-12T01:10:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.516+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.soB5cM0rNkce-sQ2xjDEdqAK8z1WwLE_0 2024-09-12T01:10:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.516+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3573098944953745534', time=2024-09-12T02:54:43.966317+0000, chain.objs.size()=1 2024-09-12T01:10:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.516+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.J9dSmYzaJ3qXNj2KHpM0Y1lSws_7gwY_0 2024-09-12T01:10:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.516+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.783863512708467050', time=2024-09-12T02:54:43.972762+0000, chain.objs.size()=1 2024-09-12T01:10:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.516+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.e2XzLIoUiSKKYxj51tr2SDVruGikEc2_0 2024-09-12T01:10:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.516+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17755395722342434659', time=2024-09-12T02:54:44.182670+0000, chain.objs.size()=1 2024-09-12T01:10:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.516+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.26zXl1UNsF0lUCaC9qlRYsc2G_CPRIe_0 2024-09-12T01:10:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.516+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3006815956170691850', time=2024-09-12T02:54:44.459696+0000, chain.objs.size()=1 2024-09-12T01:10:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.516+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.MIAogbcbJgcxsmBRPbp_iFUyhq9UfPD_0 2024-09-12T01:10:58.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.520+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/44950 2024-09-12T01:10:58.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T01:10:58.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1211478765809574487', time=2024-09-12T02:54:44.794002+0000, chain.objs.size()=1 2024-09-12T01:10:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.joo_MYFd424DUvBaYsG3eDtIV6Nl6RS_0 2024-09-12T01:10:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14499429705675060377', time=2024-09-12T02:54:45.612694+0000, chain.objs.size()=1 2024-09-12T01:10:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ohEh985V6-viO734oIrTEad1eKNNkyF_0 2024-09-12T01:10:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3050996246767916786', time=2024-09-12T02:54:46.023345+0000, chain.objs.size()=1 2024-09-12T01:10:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nslq9bTj7I2n6AiUd8kvvn2fGBbLw-L_0 2024-09-12T01:10:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13046112697501599819', time=2024-09-12T02:54:46.317972+0000, chain.objs.size()=1 2024-09-12T01:10:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.wJeCWDeNBqF2gjA2MBnVm2uqws3W6Yf_0 2024-09-12T01:10:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11903936174367610963', time=2024-09-12T02:54:46.531219+0000, chain.objs.size()=1 2024-09-12T01:10:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.FbkrrZOcp_VKnLFrm5ceUKMoIcKZxvG_0 2024-09-12T01:10:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5864564882092624537', time=2024-09-12T02:54:46.606168+0000, chain.objs.size()=1 2024-09-12T01:10:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.JWZpT6WRhN88fPSw4W9XfKYDvAwPo0r_0 2024-09-12T01:10:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6161046539776479367', time=2024-09-12T02:54:46.780472+0000, chain.objs.size()=1 2024-09-12T01:10:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.PqNAAyJQ-VblUYBxzGNb1042mSuiLW0_0 2024-09-12T01:10:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6767584053035926970', time=2024-09-12T02:55:13.093780+0000, chain.objs.size()=1 2024-09-12T01:10:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.377__shadow_.CKV9lXeSiaGHKZ9ps2U121V5aA89nc2_0 2024-09-12T01:10:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13150232229731263467', time=2024-09-12T02:56:15.403992+0000, chain.objs.size()=1 2024-09-12T01:10:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.486__shadow_.PI3kgrBXnexlT6XBbl-OYB9FnDryKT3_0 2024-09-12T01:10:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9062394037077877025', time=2024-09-12T02:56:27.158173+0000, chain.objs.size()=1 2024-09-12T01:10:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.501__shadow_.RCqGTrvQ-VeD5NjASoASa7-v4eTzo0O_0 2024-09-12T01:10:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7743493647851901292', time=2024-09-12T02:56:40.873533+0000, chain.objs.size()=6 2024-09-12T01:10:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.1 2024-09-12T01:10:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.2 2024-09-12T01:10:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.525+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.3 2024-09-12T01:10:58.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.526+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.4 2024-09-12T01:10:58.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.526+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.5 2024-09-12T01:10:58.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.526+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.6 2024-09-12T01:10:58.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.526+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7730024035379758514', time=2024-09-12T02:57:15.356969+0000, chain.objs.size()=1 2024-09-12T01:10:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.526+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.521__shadow:.gajuCAWBf3BjDVa3fmpz5qDCTrkGQi_.zJP-wgWmAACbHE1ls85X9fm6qSf18dE_0 2024-09-12T01:10:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.526+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9992379656828724502', time=2024-09-12T02:57:31.844127+0000, chain.objs.size()=6 2024-09-12T01:10:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.526+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.V8l_Ewq_8RI4bRmh3yeZxIPVdldYgH8i.1 2024-09-12T01:10:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.526+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~bfNbWifSqYqd1qC585rCUg1TSlihMkW.2 2024-09-12T01:10:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.526+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~bfNbWifSqYqd1qC585rCUg1TSlihMkW.3 2024-09-12T01:10:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.526+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~bfNbWifSqYqd1qC585rCUg1TSlihMkW.4 2024-09-12T01:10:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.526+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~bfNbWifSqYqd1qC585rCUg1TSlihMkW.5 2024-09-12T01:10:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.527+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~bfNbWifSqYqd1qC585rCUg1TSlihMkW.6 2024-09-12T01:10:58.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.530+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2572097703585820059', time=2024-09-12T02:58:30.536335+0000, chain.objs.size()=4 2024-09-12T01:10:58.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.530+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.528__multipart_mymultipart.2~9PaCK-w1y42ts2sUo3XimBWOR8eBuJx.1 2024-09-12T01:10:58.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.530+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.528__multipart_mymultipart.2~9PaCK-w1y42ts2sUo3XimBWOR8eBuJx.2 2024-09-12T01:10:58.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.530+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.528__multipart_mymultipart.2~9PaCK-w1y42ts2sUo3XimBWOR8eBuJx.3 2024-09-12T01:10:58.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.530+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.528__multipart_mymultipart.2~9PaCK-w1y42ts2sUo3XimBWOR8eBuJx.4 2024-09-12T01:10:58.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.530+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~GURStzFgTHBK2nyYDqwWzVF0WTcysnX', time=2024-09-12T02:58:39.306514+0000, chain.objs.size()=3 2024-09-12T01:10:58.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.530+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.532__multipart_mymultipart.2~GURStzFgTHBK2nyYDqwWzVF0WTcysnX.1 2024-09-12T01:10:58.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.530+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.532__shadow_mymultipart.2~GURStzFgTHBK2nyYDqwWzVF0WTcysnX.1_1 2024-09-12T01:10:58.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.531+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.532__multipart_mymultipart.2~GURStzFgTHBK2nyYDqwWzVF0WTcysnX.2 2024-09-12T01:10:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.532+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17427296840692201027', time=2024-09-12T02:59:02.652972+0000, chain.objs.size()=1 2024-09-12T01:10:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.532+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.537__multipart_mymultipart.2~jLN8oo_-Ylu8xRGesA6UukKA0Z0B9au.1 2024-09-12T01:10:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.532+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5242616252741370086', time=2024-09-12T02:59:55.411804+0000, chain.objs.size()=1 2024-09-12T01:10:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.532+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:2z5EyoLzTkIu7cAW2KENNSxBAonrJC4_.y7jIiGy9Tx7u4lw2Z43RqRDr-Ewdpwj_0 2024-09-12T01:10:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.532+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12331331282902246852', time=2024-09-12T03:00:09.722092+0000, chain.objs.size()=1 2024-09-12T01:10:58.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.532+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.575__shadow:u5dwmaOUBAb.qRf8E0XOD.AxfDwXSln_.b88sTo_IAfrrS6QLeipb8GqAPytUjIx_0 2024-09-12T01:10:58.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.533+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13732247033733806819', time=2024-09-12T03:00:28.824976+0000, chain.objs.size()=1 2024-09-12T01:10:58.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.533+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:R.i9VYIS30y.Yl3gamkdkZt4XByMmy7_.3v2EdatPWP-QKec083vYINyVdq-WCfo_0 2024-09-12T01:10:58.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.533+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4488479274535303041', time=2024-09-12T03:00:36.009174+0000, chain.objs.size()=1 2024-09-12T01:10:58.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.533+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:pl8jlc1HrBWn0NYLpFwkROFEG.DzI8y_.9xB7YQXEtm7YotgcBO6mkUvlIgY2vVz_0 2024-09-12T01:10:58.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.533+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9090951929751209902', time=2024-09-12T03:00:52.478775+0000, chain.objs.size()=1 2024-09-12T01:10:58.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.533+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.580__shadow:UqFidc9Wam1fdrfMTXMmqb6Pl62I0Nk_.9V95mS0ysZ7rQwzGvyfcBmweuPci7bk_0 2024-09-12T01:10:58.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.533+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4875303999931950478', time=2024-09-12T03:00:56.256743+0000, chain.objs.size()=1 2024-09-12T01:10:58.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.533+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.584__shadow:0OLvchgHu.rzZJLRcClsHtqOLKIdGjK_.15pKZM-kEwNdpvIH056mMXIRG2nRj9R_0 2024-09-12T01:10:58.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.534+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16280130106330243167', time=2024-09-12T03:04:16.042455+0000, chain.objs.size()=1 2024-09-12T01:10:58.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.534+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.619__shadow_.-YIxo2uejI8IV09dYdVsEanFqXT9CaM_0 2024-09-12T01:10:58.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.535+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13925470755697329709', time=2024-09-12T03:04:17.179378+0000, chain.objs.size()=1 2024-09-12T01:10:58.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.535+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.621__shadow_.vbTy4UmYPZzohhaBDEnddFFulcmiMRd_0 2024-09-12T01:10:58.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.535+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15583289133856408508', time=2024-09-12T03:05:34.620293+0000, chain.objs.size()=1 2024-09-12T01:10:58.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.535+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.665__shadow_.s_DFdMEA7oK6YY05zx4z9QECnQys7WX_0 2024-09-12T01:10:58.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.535+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1843279884572229959', time=2024-09-12T03:06:42.588114+0000, chain.objs.size()=10 2024-09-12T01:10:58.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.535+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.736__multipart_foo.2~MvIIcTd3RAQQMz9fSKgiTxYDRb5TrN-.1 2024-09-12T01:10:58.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.535+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.736__multipart_foo.2~MvIIcTd3RAQQMz9fSKgiTxYDRb5TrN-.2 2024-09-12T01:10:58.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.536+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.736__multipart_foo.2~MvIIcTd3RAQQMz9fSKgiTxYDRb5TrN-.3 2024-09-12T01:10:58.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.536+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.736__multipart_foo.2~MvIIcTd3RAQQMz9fSKgiTxYDRb5TrN-.4 2024-09-12T01:10:58.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.537+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.736__multipart_foo.2~MvIIcTd3RAQQMz9fSKgiTxYDRb5TrN-.5 2024-09-12T01:10:58.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.538+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.736__multipart_foo.2~MvIIcTd3RAQQMz9fSKgiTxYDRb5TrN-.6 2024-09-12T01:10:58.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.538+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.736__multipart_foo.2~MvIIcTd3RAQQMz9fSKgiTxYDRb5TrN-.7 2024-09-12T01:10:58.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.538+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.736__multipart_foo.2~MvIIcTd3RAQQMz9fSKgiTxYDRb5TrN-.8 2024-09-12T01:10:58.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.538+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.736__multipart_foo.2~MvIIcTd3RAQQMz9fSKgiTxYDRb5TrN-.9 2024-09-12T01:10:58.538 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.539+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.736__multipart_foo.2~MvIIcTd3RAQQMz9fSKgiTxYDRb5TrN-.10 2024-09-12T01:10:58.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.542+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:58.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.545+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:10:58.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.546+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:58.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.547+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:58.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.547+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51621' 2024-09-12T01:10:58.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.547+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4075917716140606944', time=2024-09-12T02:49:03.684933+0000, chain.objs.size()=1 2024-09-12T01:10:58.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.547+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.148__shadow_.ou_8_0Qb9up86dxwjaC8HLH-dIA3S_9_0 2024-09-12T01:10:58.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.547+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9697886298946905065', time=2024-09-12T02:49:17.028683+0000, chain.objs.size()=5 2024-09-12T01:10:58.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.547+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.160__multipart_mymultipart-FROZEN.2~93ASnzDINeW02msWyzL-ZREYsEdftSU.1 2024-09-12T01:10:58.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.160__shadow_mymultipart-FROZEN.2~93ASnzDINeW02msWyzL-ZREYsEdftSU.1_1 2024-09-12T01:10:58.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.160__multipart_mymultipart-FROZEN.2~93ASnzDINeW02msWyzL-ZREYsEdftSU.2 2024-09-12T01:10:58.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.160__shadow_mymultipart-FROZEN.2~93ASnzDINeW02msWyzL-ZREYsEdftSU.2_1 2024-09-12T01:10:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.160__multipart_mymultipart-FROZEN.2~93ASnzDINeW02msWyzL-ZREYsEdftSU.3 2024-09-12T01:10:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10016992541777150676', time=2024-09-12T02:51:27.876960+0000, chain.objs.size()=1 2024-09-12T01:10:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.235__shadow_.vDX85LFQzAzHWleBG8Cobx22ZEXqIvu_0 2024-09-12T01:10:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16007921906115681078', time=2024-09-12T02:51:32.388641+0000, chain.objs.size()=1 2024-09-12T01:10:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.242__shadow_.lfWsB6JdkoicBiy2LXKgzDYbmUDJNBl_0 2024-09-12T01:10:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17197527907360006425', time=2024-09-12T02:51:38.306575+0000, chain.objs.size()=1 2024-09-12T01:10:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.251__shadow_.qZg4XSIjMnOMf2-jURXiml7xFPsFxW__0 2024-09-12T01:10:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11837294444233426462', time=2024-09-12T02:51:38.904146+0000, chain.objs.size()=1 2024-09-12T01:10:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.252__shadow_.rfe0MatFmtjvS1ghxXp_1V1QdJsAP-l_0 2024-09-12T01:10:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9737242596998740456', time=2024-09-12T02:51:40.727591+0000, chain.objs.size()=1 2024-09-12T01:10:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.255__shadow_.yRuD1dLQjj-S8zGvyZYmdd4rrD66jC5_0 2024-09-12T01:10:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11620067121855052071', time=2024-09-12T02:52:21.217924+0000, chain.objs.size()=1 2024-09-12T01:10:58.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.548+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uy07n3g0OquDdRQ1NgU9Q7O0J_qC5N3_0 2024-09-12T01:10:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.550+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9842009087362408949', time=2024-09-12T02:52:21.772236+0000, chain.objs.size()=1 2024-09-12T01:10:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.550+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ameYEI6bETcq9dbVwbTa-YBzJjED7Oi_0 2024-09-12T01:10:58.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.551+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6232520609790314224', time=2024-09-12T02:52:22.230218+0000, chain.objs.size()=1 2024-09-12T01:10:58.550 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.551+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.H5Ou-FGZ3UTM0jQi_tPqiWNVGtNBfnz_0 2024-09-12T01:10:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.551+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6734595549097702347', time=2024-09-12T02:52:22.724839+0000, chain.objs.size()=1 2024-09-12T01:10:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.551+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0TxWmqBfj5IfKslsO1J0m0ks7RaG4bG_0 2024-09-12T01:10:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.551+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17359496770288605632', time=2024-09-12T02:52:24.218260+0000, chain.objs.size()=1 2024-09-12T01:10:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.551+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.UNx9gfGOF7hCpwpODWR01N8euPi8vly_0 2024-09-12T01:10:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.552+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15634039734302497083', time=2024-09-12T02:52:24.371264+0000, chain.objs.size()=1 2024-09-12T01:10:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.552+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.TyO0nvHGC1e5aBGarWi6nSUcfnwX1Wz_0 2024-09-12T01:10:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.552+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8782444039747267137', time=2024-09-12T02:52:24.547710+0000, chain.objs.size()=1 2024-09-12T01:10:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.552+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.t96T_qb2Qm-giQoH4kSoQLW-ml7_TZB_0 2024-09-12T01:10:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.552+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6605011252849881061', time=2024-09-12T02:52:27.093581+0000, chain.objs.size()=1 2024-09-12T01:10:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.552+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.swibf5Fa7c3mFdRH6ZVrcET_PzAKo2L_0 2024-09-12T01:10:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.552+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1201247330615687121', time=2024-09-12T02:52:27.766767+0000, chain.objs.size()=1 2024-09-12T01:10:58.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.552+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xKEXG_pEHlPwP80azk33RT28Qdx938t_0 2024-09-12T01:10:58.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.552+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8549778611491392594', time=2024-09-12T02:52:28.971715+0000, chain.objs.size()=1 2024-09-12T01:10:58.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.552+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wMtVzviAaaA_x8yrvb-sM9KCWclZqej_0 2024-09-12T01:10:58.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.552+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7991926866254854159', time=2024-09-12T02:52:29.138977+0000, chain.objs.size()=1 2024-09-12T01:10:58.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.552+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.dOqtE0AN6903omzK7pPyCJkmIVHOJj4_0 2024-09-12T01:10:58.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.552+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16709327966332791149', time=2024-09-12T02:52:29.179181+0000, chain.objs.size()=1 2024-09-12T01:10:58.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.552+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.3Geoh-vcaDLaf2Uq-iwZgZAvCAOXE2h_0 2024-09-12T01:10:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.553+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7942869535556049672', time=2024-09-12T02:52:29.311127+0000, chain.objs.size()=1 2024-09-12T01:10:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.553+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.JV7VlhlwbtIfWjAhiFpaVPxk59ZGa8T_0 2024-09-12T01:10:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.554+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.340433415577872412', time=2024-09-12T02:52:29.864021+0000, chain.objs.size()=1 2024-09-12T01:10:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.554+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0xUgJ1M2q0S7Vah_n9rCfub4jwCi5Qp_0 2024-09-12T01:10:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.554+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12597680622988070996', time=2024-09-12T02:52:29.964965+0000, chain.objs.size()=1 2024-09-12T01:10:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.554+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KiH-kh1almNclEGQUkcPQpMNZioEKb3_0 2024-09-12T01:10:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.554+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4243874815362751887', time=2024-09-12T02:52:30.396091+0000, chain.objs.size()=1 2024-09-12T01:10:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.554+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vR_XAZ20up48jYgmiBvtfN0j4DBMMcY_0 2024-09-12T01:10:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.554+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.109693487768286183', time=2024-09-12T02:52:31.325596+0000, chain.objs.size()=1 2024-09-12T01:10:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.554+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.W0emoFsNgBTJ3Fu1TFGBMnJ5ToQb05V_0 2024-09-12T01:10:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.555+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12014359541704893680', time=2024-09-12T02:52:31.709445+0000, chain.objs.size()=1 2024-09-12T01:10:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.555+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.w1q3cKWljbUFU8-NS2326W0FtZDRgHB_0 2024-09-12T01:10:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.555+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6414466101759068579', time=2024-09-12T02:52:31.770782+0000, chain.objs.size()=1 2024-09-12T01:10:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.556+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.6DyelT3Eu9Wbxo9YdxLemurHprtkhwt_0 2024-09-12T01:10:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.556+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14341467303344330921', time=2024-09-12T02:52:40.570648+0000, chain.objs.size()=1 2024-09-12T01:10:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.556+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.278__shadow_.RpO_fFNYQPYGdXVduxuOvA-xp9QAA2k_0 2024-09-12T01:10:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.556+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8948450104742737596', time=2024-09-12T02:52:45.479172+0000, chain.objs.size()=1 2024-09-12T01:10:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.556+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.286__shadow_.-tgYp7k0xgLQXsxFXorTuWj98DJqL1i_0 2024-09-12T01:10:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.556+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14016081998971675243', time=2024-09-12T02:52:51.096468+0000, chain.objs.size()=1 2024-09-12T01:10:58.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.556+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.DzYlwpVGympXZZjezcM3QPLmintODJz_0 2024-09-12T01:10:58.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.556+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11902674049696290679', time=2024-09-12T02:52:51.371005+0000, chain.objs.size()=1 2024-09-12T01:10:58.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.556+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.OZAc3K_u0pA0beLPdeW-yHbD2s3bcbb_0 2024-09-12T01:10:58.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.556+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12658590599250329716', time=2024-09-12T02:52:55.686686+0000, chain.objs.size()=1 2024-09-12T01:10:58.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.556+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.298__shadow_.LE8OCzaCMklubi6L0geBTnCA5YpUMuO_0 2024-09-12T01:10:58.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.557+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2835246801988874230', time=2024-09-12T02:53:00.692980+0000, chain.objs.size()=1 2024-09-12T01:10:58.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.557+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.306__shadow_.-YsNodSX9L97pp25-txrpCQjMrLupG3_0 2024-09-12T01:10:58.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15320877676088988013', time=2024-09-12T02:53:10.102045+0000, chain.objs.size()=1 2024-09-12T01:10:58.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.320__shadow:3Ybtac3.TgGwjLyZbqZo2ThLXVTnvHm_.1kJDY7jHATmBI0G6VzyfhIkWoUvAWeo_0 2024-09-12T01:10:58.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2854925682238704575', time=2024-09-12T02:53:49.448680+0000, chain.objs.size()=1 2024-09-12T01:10:58.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.OUCulGFDxH_ax3z0ykw9RpDs051aWgd_0 2024-09-12T01:10:58.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12763479557269831893', time=2024-09-12T02:53:49.842826+0000, chain.objs.size()=1 2024-09-12T01:10:58.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.FIJeCjz19YQbf4XkW9oz6JZ0YRImgGt_0 2024-09-12T01:10:58.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12626119041621201671', time=2024-09-12T02:53:50.020618+0000, chain.objs.size()=1 2024-09-12T01:10:58.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dwbXTbpVJXEiuFJNErFkBxLYIHU78Cu_0 2024-09-12T01:10:58.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6267379069075593510', time=2024-09-12T02:53:50.058342+0000, chain.objs.size()=1 2024-09-12T01:10:58.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.NFI0WepMFWb0-SavLvZnv0LxPuNEhHn_0 2024-09-12T01:10:58.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7391918570423102040', time=2024-09-12T02:53:50.059009+0000, chain.objs.size()=1 2024-09-12T01:10:58.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qKqmMlVBu2gT_kBU--gG0gp0bXE7fdg_0 2024-09-12T01:10:58.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7677835840147835478', time=2024-09-12T02:53:50.165391+0000, chain.objs.size()=1 2024-09-12T01:10:58.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.H-TpIbbKvNSTrbeA98Kqrb2xjsUpr6D_0 2024-09-12T01:10:58.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13889086177362525590', time=2024-09-12T02:53:50.268782+0000, chain.objs.size()=1 2024-09-12T01:10:58.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Md1gR1j70JVsuBRN94PhU4gfjhXeV0j_0 2024-09-12T01:10:58.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1208023499857992146', time=2024-09-12T02:53:50.976563+0000, chain.objs.size()=1 2024-09-12T01:10:58.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.zjiWYJlCYaFdXmoZT7H15b-dz1tMJ8G_0 2024-09-12T01:10:58.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10447781852087987851', time=2024-09-12T02:53:51.260012+0000, chain.objs.size()=1 2024-09-12T01:10:58.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.VAHsRVS7oILKN6Hn9AHLVXqSbzfbiH4_0 2024-09-12T01:10:58.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7021920810314525641', time=2024-09-12T02:53:51.782385+0000, chain.objs.size()=1 2024-09-12T01:10:58.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.560+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tr6Q6lelZMTwPzGnB-H0vkuqJmVe4qS_0 2024-09-12T01:10:58.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.846352374253881266', time=2024-09-12T02:53:51.851522+0000, chain.objs.size()=1 2024-09-12T01:10:58.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.f3-JVD-fjOREVxfQx6Wz6JJkK77bTEM_0 2024-09-12T01:10:58.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4567328004987724011', time=2024-09-12T02:53:52.839221+0000, chain.objs.size()=1 2024-09-12T01:10:58.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nlDiw0vfW45GthU89wcbP8MJPFmbyrE_0 2024-09-12T01:10:58.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8016683575751119102', time=2024-09-12T02:53:53.035519+0000, chain.objs.size()=1 2024-09-12T01:10:58.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.HdUqgT5CcsXVn84CboI0socL09JhHcP_0 2024-09-12T01:10:58.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16577258503103073442', time=2024-09-12T02:53:54.391485+0000, chain.objs.size()=1 2024-09-12T01:10:58.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0EUYl_o191QHEwE_d_jAox_du_Hi0ZL_0 2024-09-12T01:10:58.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12771342683866490092', time=2024-09-12T02:53:55.345190+0000, chain.objs.size()=1 2024-09-12T01:10:58.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.iakaEYuh0J7yGcHoDIlGgNF70Vv1YgR_0 2024-09-12T01:10:58.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5693313188607789807', time=2024-09-12T02:53:56.490864+0000, chain.objs.size()=1 2024-09-12T01:10:58.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qqaleLGFE24YABtMKICfohlI5qS1ej8_0 2024-09-12T01:10:58.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5897867670574645257', time=2024-09-12T02:53:56.702711+0000, chain.objs.size()=1 2024-09-12T01:10:58.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.AGnuT6-vhj6cWdykDiOobJKJ1jL3aVA_0 2024-09-12T01:10:58.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2879620066976822552', time=2024-09-12T02:53:56.796974+0000, chain.objs.size()=1 2024-09-12T01:10:58.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.p-vKUmhLi3NMmvGAp21lCFk6WLJyo2K_0 2024-09-12T01:10:58.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.788792786463564920', time=2024-09-12T02:53:56.977751+0000, chain.objs.size()=1 2024-09-12T01:10:58.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.PBxIFouYJ1QTetcHEV5UmLrqn4KIp_K_0 2024-09-12T01:10:58.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15084087335405257145', time=2024-09-12T02:53:57.059972+0000, chain.objs.size()=1 2024-09-12T01:10:58.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Cqg6N4rCcIDo7_YiGraw1Gzw00miKtb_0 2024-09-12T01:10:58.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1997226048735510349', time=2024-09-12T02:53:57.097503+0000, chain.objs.size()=1 2024-09-12T01:10:58.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.wJJYQ4T54vpHLVmwPElmQ8k0z5-RYut_0 2024-09-12T01:10:58.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.568+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2266880838698797389', time=2024-09-12T02:53:57.272343+0000, chain.objs.size()=1 2024-09-12T01:10:58.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.568+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.VhzfXr7ScbGP-bxFBjCmkLR4V5e41lF_0 2024-09-12T01:10:58.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.568+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14029376549354389914', time=2024-09-12T02:53:57.385619+0000, chain.objs.size()=1 2024-09-12T01:10:58.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.568+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.r1szAbHWMDHvVc4kQ8U2Ja7diP71NyP_0 2024-09-12T01:10:58.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.568+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8671375273361291647', time=2024-09-12T02:53:57.732705+0000, chain.objs.size()=1 2024-09-12T01:10:58.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bsxu1oln3LNFou2cfU9asOAu-1UyzyY_0 2024-09-12T01:10:58.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17360100142753416389', time=2024-09-12T02:53:57.886638+0000, chain.objs.size()=1 2024-09-12T01:10:58.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.LyQLaWOCaLRbH7amdiOOsVUVTjJppaa_0 2024-09-12T01:10:58.568 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18260247944528355787', time=2024-09-12T02:53:58.048011+0000, chain.objs.size()=1 2024-09-12T01:10:58.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.C_uIje_agfLCcx_UpjG_QplEou4nMYb_0 2024-09-12T01:10:58.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9257130000942997462', time=2024-09-12T02:53:58.086129+0000, chain.objs.size()=1 2024-09-12T01:10:58.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qb5bIigMf2SEcmyye_npWuH4CmgsQpQ_0 2024-09-12T01:10:58.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6913918829195668439', time=2024-09-12T02:53:58.216487+0000, chain.objs.size()=1 2024-09-12T01:10:58.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.GPpf8cYEovMt1vbTqG6s1SgRc3LVuEY_0 2024-09-12T01:10:58.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14919486994141398174', time=2024-09-12T02:53:58.488200+0000, chain.objs.size()=1 2024-09-12T01:10:58.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.N0UYB6Lzpp3y6t7BHs9P7PJbGRb_xUp_0 2024-09-12T01:10:58.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5641939218172672139', time=2024-09-12T02:53:58.516932+0000, chain.objs.size()=1 2024-09-12T01:10:58.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.YSUX4iqrze_AkKW2xHGd9bdIynbyL1f_0 2024-09-12T01:10:58.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6199292839941601347', time=2024-09-12T02:53:59.007843+0000, chain.objs.size()=1 2024-09-12T01:10:58.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dMxqNB3wlxEpLJShgeBa7A5tR4BSYLb_0 2024-09-12T01:10:58.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16117518953933623937', time=2024-09-12T02:53:59.723291+0000, chain.objs.size()=1 2024-09-12T01:10:58.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.569+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.vVFJwvdC3Y_XojPOi_hGQmKaBtEg1Jd_0 2024-09-12T01:10:58.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.571+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3204447972574365297', time=2024-09-12T02:54:36.793568+0000, chain.objs.size()=1 2024-09-12T01:10:58.570 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.571+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.UITsdD2yjfv2k1KrJk--14Hct7O8vZ0_0 2024-09-12T01:10:58.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.571+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17062393999638681006', time=2024-09-12T02:54:37.225823+0000, chain.objs.size()=1 2024-09-12T01:10:58.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.571+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.DCigK5KW1ZUiLdymsvO6tWk4ZtLhejY_0 2024-09-12T01:10:58.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.573+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15510922264151693466', time=2024-09-12T02:54:37.357467+0000, chain.objs.size()=1 2024-09-12T01:10:58.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.573+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.MmGP20KvWhNE412AvcKJFG71gAhAyg0_0 2024-09-12T01:10:58.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.573+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6427278795990088692', time=2024-09-12T02:54:37.416968+0000, chain.objs.size()=1 2024-09-12T01:10:58.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.573+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.kFOKkPeS-ffRMrXyTKdHF5tef9fPgsp_0 2024-09-12T01:10:58.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.573+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8233622699273666375', time=2024-09-12T02:54:37.447714+0000, chain.objs.size()=1 2024-09-12T01:10:58.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.573+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ThCfeIpqKWnAF27zoKBqTU3KK7ho72s_0 2024-09-12T01:10:58.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.573+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3472475925716881804', time=2024-09-12T02:54:38.285233+0000, chain.objs.size()=1 2024-09-12T01:10:58.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.573+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.BdR6wx2Y-xO9X7hRovkj2ihmGyEZjar_0 2024-09-12T01:10:58.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.573+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.720621320889109540', time=2024-09-12T02:54:38.285917+0000, chain.objs.size()=1 2024-09-12T01:10:58.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.573+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.LYvBNFK6F0MAlTp_Dr-2h967Guzf3uB_0 2024-09-12T01:10:58.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.573+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8830697951871528946', time=2024-09-12T02:54:38.317331+0000, chain.objs.size()=1 2024-09-12T01:10:58.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.573+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.BYLbgQYCdKzAf2nc5spkNkwVLaCbM0z_0 2024-09-12T01:10:58.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.573+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5905450739489710467', time=2024-09-12T02:54:38.424667+0000, chain.objs.size()=1 2024-09-12T01:10:58.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.573+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.QaoVwf1a_IqRPzJFkHb_NrSJb_uL-N-_0 2024-09-12T01:10:58.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.574+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10924476868677615007', time=2024-09-12T02:54:38.425410+0000, chain.objs.size()=1 2024-09-12T01:10:58.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.574+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.pWHDzkal-dqdQoxBtR6ketHS6h0mtqA_0 2024-09-12T01:10:58.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.574+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2605959011838206984', time=2024-09-12T02:54:38.721937+0000, chain.objs.size()=1 2024-09-12T01:10:58.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.574+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.z6ThXDmMHEu7XahiLzrkafEK7gUjNpB_0 2024-09-12T01:10:58.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.575+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15735365606815173148', time=2024-09-12T02:54:38.874935+0000, chain.objs.size()=1 2024-09-12T01:10:58.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.575+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.jYEj6HALkc7nzF0e5EeeVOw2jFoWE8l_0 2024-09-12T01:10:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.576+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5156042812834005838', time=2024-09-12T02:54:39.074085+0000, chain.objs.size()=1 2024-09-12T01:10:58.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.576+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.CJp8zloDzPmruK0uC6qLjM-13MeOAmt_0 2024-09-12T01:10:58.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.577+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13661009244604830546', time=2024-09-12T02:54:39.080234+0000, chain.objs.size()=1 2024-09-12T01:10:58.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.577+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.cqxAI1jrVpGtowJjYszmxF54sD4cquX_0 2024-09-12T01:10:58.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.577+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13141512263338810568', time=2024-09-12T02:54:39.893425+0000, chain.objs.size()=1 2024-09-12T01:10:58.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.577+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.4Oiqm250WUU-r1YLB7Cc79iQ6daZiKs_0 2024-09-12T01:10:58.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.577+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17504632163150278471', time=2024-09-12T02:54:40.184800+0000, chain.objs.size()=1 2024-09-12T01:10:58.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.577+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.jTyFS3yWttJDRoTR0RnU1kB5Mdgqxpp_0 2024-09-12T01:10:58.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.578+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11525044197532324792', time=2024-09-12T02:54:40.890042+0000, chain.objs.size()=1 2024-09-12T01:10:58.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.578+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.79L_gb5Q4_HX6c39sHqAlXfZxhHZ-_G_0 2024-09-12T01:10:58.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.578+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11828431772140854001', time=2024-09-12T02:54:41.064167+0000, chain.objs.size()=1 2024-09-12T01:10:58.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.578+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.QulZsLfXofHqGRmonWLJpokDQPOo4jr_0 2024-09-12T01:10:58.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.578+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10879691702365262214', time=2024-09-12T02:54:41.555928+0000, chain.objs.size()=1 2024-09-12T01:10:58.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.578+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.FHPsVj_cX_sD51HZia_8AAYTcKcoha2_0 2024-09-12T01:10:58.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9654522172339394556', time=2024-09-12T02:54:42.990049+0000, chain.objs.size()=1 2024-09-12T01:10:58.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Y_hyUMFShPK-WD2GiN7HbZQW6ZBjtc2_0 2024-09-12T01:10:58.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8734452947318445280', time=2024-09-12T02:54:43.465103+0000, chain.objs.size()=1 2024-09-12T01:10:58.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.f5XUjD880aQfgk97guveTtVNtGwZa9M_0 2024-09-12T01:10:58.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8430714039488271206', time=2024-09-12T02:54:44.090976+0000, chain.objs.size()=1 2024-09-12T01:10:58.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.hmY4B_XHhE8KXZSL4P5AakMn_EglRX9_0 2024-09-12T01:10:58.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7129158944849721208', time=2024-09-12T02:54:44.186761+0000, chain.objs.size()=1 2024-09-12T01:10:58.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.MMIOcimdAP7B5OEduG-0VwOdVH9SlaF_0 2024-09-12T01:10:58.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4133566964222336493', time=2024-09-12T02:54:44.306952+0000, chain.objs.size()=1 2024-09-12T01:10:58.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.wlGxiyXfYVab_qJ3cgR3Pd0CWeOQUeW_0 2024-09-12T01:10:58.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3306334273985293478', time=2024-09-12T02:54:44.307538+0000, chain.objs.size()=1 2024-09-12T01:10:58.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.3P7vVsHzsFXX_9vvirQPVSkRg0PxMQ3_0 2024-09-12T01:10:58.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3819652922217668160', time=2024-09-12T02:54:44.424394+0000, chain.objs.size()=1 2024-09-12T01:10:58.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.biGUbem8qwz-8ZvElQ1O7DO6S1Q9HyI_0 2024-09-12T01:10:58.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.580+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17430666552373219495', time=2024-09-12T02:54:45.124928+0000, chain.objs.size()=1 2024-09-12T01:10:58.580 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.580+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.bEcFArOAtAsnwnnWojr9epIqjU17pT7_0 2024-09-12T01:10:58.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.581+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11005226815641184961', time=2024-09-12T02:54:45.371037+0000, chain.objs.size()=1 2024-09-12T01:10:58.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.581+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.5P7x9XXGBQv1c4LJHALHtHNedUfp-5m_0 2024-09-12T01:10:58.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.582+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4370785696886484031', time=2024-09-12T02:54:45.371945+0000, chain.objs.size()=1 2024-09-12T01:10:58.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.582+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.qLnszH5VckqCbKQdpQ5ZLElbFFGu9PC_0 2024-09-12T01:10:58.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.582+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11632855688918499535', time=2024-09-12T02:54:45.420363+0000, chain.objs.size()=1 2024-09-12T01:10:58.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.582+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.t92qUSgEhc1slB6HS7dbok5IRF_fLiF_0 2024-09-12T01:10:58.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.582+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8199165534808070999', time=2024-09-12T02:54:45.549552+0000, chain.objs.size()=1 2024-09-12T01:10:58.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.582+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.xLCPaPR0wdp6V9LPwTuft2YVaJiMR3C_0 2024-09-12T01:10:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.583+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5585013308373576092', time=2024-09-12T02:54:45.832426+0000, chain.objs.size()=1 2024-09-12T01:10:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.583+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.bib2sFlf-5zQP-cI8BXKnZQ1pMqTMpm_0 2024-09-12T01:10:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.583+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4574890374145905948', time=2024-09-12T02:54:46.035136+0000, chain.objs.size()=1 2024-09-12T01:10:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.583+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fXZGpoI0zStTOFDIfPa6N5U_6mz7Uts_0 2024-09-12T01:10:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.584+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11723672323431187701', time=2024-09-12T02:54:47.093471+0000, chain.objs.size()=1 2024-09-12T01:10:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.584+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ymYZ5Ueehw2ol6vjzQBoOvu7MP4Ipa8_0 2024-09-12T01:10:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.584+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1520274133109175356', time=2024-09-12T02:55:13.729075+0000, chain.objs.size()=1 2024-09-12T01:10:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.584+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.378__shadow_.nR4uccQ_swy2422wJWCqFVMbzaEjtjM_0 2024-09-12T01:10:58.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.586+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/51621 2024-09-12T01:10:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T01:10:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8480935147927633583', time=2024-09-12T02:55:32.540650+0000, chain.objs.size()=1 2024-09-12T01:10:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.410__shadow_.fNgD4_0qV0yNiEAgDJYYCWXJ2ts_eIQ_0 2024-09-12T01:10:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15877162967922510175', time=2024-09-12T02:55:59.675109+0000, chain.objs.size()=1 2024-09-12T01:10:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.458__shadow_.nhAPcPLIogdFTV4_xtO3-lnefoADsmo_0 2024-09-12T01:10:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7243181731254011150', time=2024-09-12T02:56:15.028728+0000, chain.objs.size()=1 2024-09-12T01:10:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.485__shadow_.dg5yAKCPHJIdddIayIVPoP-8yAEXKWO_0 2024-09-12T01:10:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8601472922421600625', time=2024-09-12T02:56:15.029431+0000, chain.objs.size()=1 2024-09-12T01:10:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.485__shadow_.gRhkP9BE3kRlmjAEBBegonpX3kkOrqp_0 2024-09-12T01:10:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.221721110959092944', time=2024-09-12T02:56:20.788349+0000, chain.objs.size()=1 2024-09-12T01:10:58.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.489__shadow_.bjbMPWsPgMg9pUasZ80kydtY4qzegJd_0 2024-09-12T01:10:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9160112785291937307', time=2024-09-12T02:59:21.090238+0000, chain.objs.size()=1 2024-09-12T01:10:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.552__shadow_.Ro1JVZvRrKj2OeIldqeVGr_jzSfkJkt_0 2024-09-12T01:10:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24972750189370808', time=2024-09-12T02:59:57.189502+0000, chain.objs.size()=1 2024-09-12T01:10:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:z5boGIC0G.t202mhP2Jl875cHb3SDac_.xelGYEKXdT9o9jLiWlUVYIh4hqZ2Oca_0 2024-09-12T01:10:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6882510140408295461', time=2024-09-12T02:59:58.978391+0000, chain.objs.size()=1 2024-09-12T01:10:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:1BSFTQ6grslgTz3BBZTpo10NU4Cta63_.w9QcZ3neRedIv2powsATpOgGd-PtRAx_0 2024-09-12T01:10:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9723800844049974447', time=2024-09-12T03:00:35.319059+0000, chain.objs.size()=1 2024-09-12T01:10:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:QayeeuFxyajYow3aqrS8eDOZ-s6Esib_.kQQx0AK-6TT7hanvbclrbFWhlRgklUm_0 2024-09-12T01:10:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15642270491501721158', time=2024-09-12T03:00:38.517042+0000, chain.objs.size()=1 2024-09-12T01:10:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:Cso5pjrf87vvvrScbSmf5CEuS3uof1O_.SVwor_w-n9nelhRjJTXoIcg6Zelg-Zc_0 2024-09-12T01:10:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1908280159850060356', time=2024-09-12T03:00:55.349924+0000, chain.objs.size()=1 2024-09-12T01:10:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.583__shadow:44E0rInPswEbjWvn-uVIcwsVlumRe7r_.kLZD3aps3Mu_kBljt8QNZs9DK-b_mDr_0 2024-09-12T01:10:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1187137436588447875', time=2024-09-12T03:01:00.605484+0000, chain.objs.size()=1 2024-09-12T01:10:58.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.589+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.588__shadow:XRu6Ga1DBYOsYbYo19nSE37ySGbIegK_.pu-6No7Sv--i-S_0_21WVXNm5WV37eb_0 2024-09-12T01:10:58.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.592+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10610871684483114846', time=2024-09-12T03:05:50.793087+0000, chain.objs.size()=1 2024-09-12T01:10:58.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.592+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.696__shadow_.tyk4Xl5xLG6YrSL0O2o5Xa8LPDyhW9H_0 2024-09-12T01:10:58.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.594+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:58.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.596+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:10:58.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.597+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:58.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.598+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46808' 2024-09-12T01:10:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9205284621945889080', time=2024-09-12T02:49:17.055153+0000, chain.objs.size()=5 2024-09-12T01:10:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.160__multipart_mymultipart-LUKEWARM.2~GXH2Wshkp6x6M7R6JdrDUr5kACnVw36.1 2024-09-12T01:10:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.160__shadow_mymultipart-LUKEWARM.2~GXH2Wshkp6x6M7R6JdrDUr5kACnVw36.1_1 2024-09-12T01:10:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.160__multipart_mymultipart-LUKEWARM.2~GXH2Wshkp6x6M7R6JdrDUr5kACnVw36.2 2024-09-12T01:10:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.160__shadow_mymultipart-LUKEWARM.2~GXH2Wshkp6x6M7R6JdrDUr5kACnVw36.2_1 2024-09-12T01:10:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.160__multipart_mymultipart-LUKEWARM.2~GXH2Wshkp6x6M7R6JdrDUr5kACnVw36.3 2024-09-12T01:10:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6496325842596808909', time=2024-09-12T02:51:27.276356+0000, chain.objs.size()=1 2024-09-12T01:10:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.234__shadow_.97292m4fYe6J_n_TkvDyMOAfaUGVqCL_0 2024-09-12T01:10:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9670096103325562858', time=2024-09-12T02:51:36.483627+0000, chain.objs.size()=1 2024-09-12T01:10:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.248__shadow_.KZ3taqQRAI7h1Tw86xqqpeU_wKfTK8x_0 2024-09-12T01:10:58.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11478185108427358237', time=2024-09-12T02:51:37.102725+0000, chain.objs.size()=1 2024-09-12T01:10:58.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.249__shadow_.jcJQ825SF0WEMn0rrLHHSFP9iEfISIF_0 2024-09-12T01:10:58.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16680531737616666167', time=2024-09-12T02:51:37.708699+0000, chain.objs.size()=1 2024-09-12T01:10:58.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.250__shadow_.-J85VvoupyXbzsJniV4PRI2_5Dw1uRx_0 2024-09-12T01:10:58.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16124884094502701901', time=2024-09-12T02:51:38.896025+0000, chain.objs.size()=1 2024-09-12T01:10:58.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.252__shadow_.pCNyyxCTJSw_EpU36Owz6_mr-yFnq_1_0 2024-09-12T01:10:58.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2022353945095108142', time=2024-09-12T02:51:43.080340+0000, chain.objs.size()=1 2024-09-12T01:10:58.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.259__shadow_.zpT7GxUf5xoOJZ-VX_oRmauVMhNUSjA_0 2024-09-12T01:10:58.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3830431211959427423', time=2024-09-12T02:52:21.566002+0000, chain.objs.size()=1 2024-09-12T01:10:58.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.599+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.YDZzLte7rFu9zl4eXgCnQIaIJVpfl77_0 2024-09-12T01:10:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.733661323748095603', time=2024-09-12T02:52:21.764761+0000, chain.objs.size()=1 2024-09-12T01:10:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.3Izt1h2w-gH6T-RVSYWkrwzXae702d4_0 2024-09-12T01:10:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7667133271272048995', time=2024-09-12T02:52:22.051913+0000, chain.objs.size()=1 2024-09-12T01:10:58.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.adVJ6oX6KHMR8Fv4_nHLOvejPnj5fpO_0 2024-09-12T01:10:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8465394436625972738', time=2024-09-12T02:52:22.052571+0000, chain.objs.size()=1 2024-09-12T01:10:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xEqRHNQcL_rXClcsFy0csak2Q6ddisk_0 2024-09-12T01:10:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7464329562672124420', time=2024-09-12T02:52:22.053253+0000, chain.objs.size()=1 2024-09-12T01:10:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xAOgqoIvcI_YQfiU4sRKRE_3kvT9oH6_0 2024-09-12T01:10:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4689200440275829125', time=2024-09-12T02:52:22.054754+0000, chain.objs.size()=1 2024-09-12T01:10:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.8c95h4o69vNcNp12uswkRMpckw3QXWL_0 2024-09-12T01:10:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5686067595093946253', time=2024-09-12T02:52:22.756904+0000, chain.objs.size()=1 2024-09-12T01:10:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.w--r1cx_GusBWfyw0E23aM1bsFjTf0K_0 2024-09-12T01:10:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15404412143007617582', time=2024-09-12T02:52:23.548211+0000, chain.objs.size()=1 2024-09-12T01:10:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xJERBW2fZTPp7xmDDWSaO_qHGA626Oj_0 2024-09-12T01:10:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14662606685786070565', time=2024-09-12T02:52:23.722932+0000, chain.objs.size()=1 2024-09-12T01:10:58.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.WW2u2vGUpU5IrZ8fhjgsdbMVzXDZw-U_0 2024-09-12T01:10:58.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3549427799084039768', time=2024-09-12T02:52:23.755292+0000, chain.objs.size()=1 2024-09-12T01:10:58.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.HQ9LWH9BfeAw6-elBQy3h8IpjwFnzZk_0 2024-09-12T01:10:58.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15707146325570784758', time=2024-09-12T02:52:24.331221+0000, chain.objs.size()=1 2024-09-12T01:10:58.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.slvZr4l4Hry7HjY4Ov5KW4PD0A-nIKl_0 2024-09-12T01:10:58.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1436546346052266274', time=2024-09-12T02:52:24.511326+0000, chain.objs.size()=1 2024-09-12T01:10:58.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.603+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.LkuDAjxxVcD7HHraf0kxTsvARMsZK4V_0 2024-09-12T01:10:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1103304310339301431', time=2024-09-12T02:52:25.888216+0000, chain.objs.size()=1 2024-09-12T01:10:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.DITO7LsEH42m7TF_gYvuD5B75tuGIEt_0 2024-09-12T01:10:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10282104176419305599', time=2024-09-12T02:52:26.006669+0000, chain.objs.size()=1 2024-09-12T01:10:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.EuYnCLY2a-AzRfB7mw147oAY4oKv5ta_0 2024-09-12T01:10:58.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7650455812818032171', time=2024-09-12T02:52:26.165963+0000, chain.objs.size()=1 2024-09-12T01:10:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.3LzdQphkML5urT1_tr6nznYbX5Pwrnp_0 2024-09-12T01:10:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14146629889410327118', time=2024-09-12T02:52:26.343039+0000, chain.objs.size()=1 2024-09-12T01:10:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.JNstPkV0XtvkTVmA7TTHgRcPSXQR6Mg_0 2024-09-12T01:10:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12171013143441956897', time=2024-09-12T02:52:27.119085+0000, chain.objs.size()=1 2024-09-12T01:10:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.2CMtfPJQCF17ozrmhqp5rAr-ZYZbaHb_0 2024-09-12T01:10:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4783458165089609379', time=2024-09-12T02:52:27.248042+0000, chain.objs.size()=1 2024-09-12T01:10:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.dFVkY4duRu982ZiDRNzV6BHMns_Bzgt_0 2024-09-12T01:10:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7204194895622628044', time=2024-09-12T02:52:27.490652+0000, chain.objs.size()=1 2024-09-12T01:10:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._BaIVpqUhn39rWQgQ65qCXlhD5rOYmx_0 2024-09-12T01:10:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10518889590737014091', time=2024-09-12T02:52:27.712568+0000, chain.objs.size()=1 2024-09-12T01:10:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.r6y3c0kHH974-1kYAffmcTjHb2IAyu3_0 2024-09-12T01:10:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.396321416932978611', time=2024-09-12T02:52:28.066770+0000, chain.objs.size()=1 2024-09-12T01:10:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.H5P084TS16wz4zByqb0IAZx72KYdeMS_0 2024-09-12T01:10:58.607 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16176670539644844991', time=2024-09-12T02:52:28.427603+0000, chain.objs.size()=1 2024-09-12T01:10:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.PmF8TGMyCeDiqJ3eIVKjBYgWdPaKXwi_0 2024-09-12T01:10:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9639108120614468457', time=2024-09-12T02:52:29.511194+0000, chain.objs.size()=1 2024-09-12T01:10:58.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.607+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ooBpNeHXtfhXoPkPoSxY2Ote01lZEQV_0 2024-09-12T01:10:58.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.610+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7212144764057583819', time=2024-09-12T02:52:29.558206+0000, chain.objs.size()=1 2024-09-12T01:10:58.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.610+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uadsYZyTjX5UUBMBE98mGk4ofwG6K7m_0 2024-09-12T01:10:58.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.611+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7250283601152537226', time=2024-09-12T02:52:29.988047+0000, chain.objs.size()=1 2024-09-12T01:10:58.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.611+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._AmBkA5ydbjDIk-V7jscFnTL1whQnwk_0 2024-09-12T01:10:58.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.611+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16875505532861938641', time=2024-09-12T02:52:30.208519+0000, chain.objs.size()=1 2024-09-12T01:10:58.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.611+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.A7ny8X4WCAqifkO4NuswFIcSJM6BVqL_0 2024-09-12T01:10:58.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.611+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1331092546021081066', time=2024-09-12T02:52:30.431352+0000, chain.objs.size()=1 2024-09-12T01:10:58.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.611+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.jCx4jpQqD7vgDJN_UGuhTEyLqtPx5GN_0 2024-09-12T01:10:58.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.611+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8808917847655842656', time=2024-09-12T02:52:30.706031+0000, chain.objs.size()=1 2024-09-12T01:10:58.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.611+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.SdWKbVRonfEOdj6MZMs_g7_rF7j1E_v_0 2024-09-12T01:10:58.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.612+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16720082206216977265', time=2024-09-12T02:52:30.790528+0000, chain.objs.size()=1 2024-09-12T01:10:58.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.612+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ycQlwp_OQ607MQZMh9zJamSKacVap9k_0 2024-09-12T01:10:58.611 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.612+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9335949639206764835', time=2024-09-12T02:52:30.819989+0000, chain.objs.size()=1 2024-09-12T01:10:58.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.612+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.sSdzJrkr3UCC_7uQfF-fOTM7bO7xnMU_0 2024-09-12T01:10:58.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.612+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12044654912569836103', time=2024-09-12T02:52:31.145010+0000, chain.objs.size()=1 2024-09-12T01:10:58.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.612+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.x90Cg3-DQFArmWpPcmxt_RMsMOOlDvQ_0 2024-09-12T01:10:58.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.612+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4486098821823028965', time=2024-09-12T02:52:31.275743+0000, chain.objs.size()=1 2024-09-12T01:10:58.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.612+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.EX6jh4DdM1eAwRphTogKVFX_N1x0vYk_0 2024-09-12T01:10:58.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.612+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11669364405664489772', time=2024-09-12T02:52:31.315880+0000, chain.objs.size()=1 2024-09-12T01:10:58.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.612+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.QhU-yihZWtiiJRCd3UpaEytoWewcD7m_0 2024-09-12T01:10:58.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.612+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15745322677351151622', time=2024-09-12T02:52:31.939410+0000, chain.objs.size()=1 2024-09-12T01:10:58.612 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.612+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.LnEB8K1hDoUTkKVaZcek_tEQzwjPtLN_0 2024-09-12T01:10:58.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.613+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7931448509666159356', time=2024-09-12T02:52:36.493098+0000, chain.objs.size()=1 2024-09-12T01:10:58.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.613+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.271__shadow_.JSBBbFYXF1_6fo3QQRDm35laH-2XqeE_0 2024-09-12T01:10:58.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.613+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10028201555684801761', time=2024-09-12T02:52:38.167808+0000, chain.objs.size()=1 2024-09-12T01:10:58.613 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.613+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.274__shadow_.XCQ_tl9oA17REfU_K9pq15jiX9uZ2VJ_0 2024-09-12T01:10:58.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.614+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13109843480034072495', time=2024-09-12T02:52:38.767481+0000, chain.objs.size()=1 2024-09-12T01:10:58.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.614+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.275__shadow_.fL6fHMJdCDDgbcifNsTIFS7ZAgeurFf_0 2024-09-12T01:10:58.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.614+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4406992728473819116', time=2024-09-12T02:52:44.226527+0000, chain.objs.size()=1 2024-09-12T01:10:58.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.614+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.284__shadow_.6Y9bZ0-46QVaG-I6iVEbjSVCKYzN0Nq_0 2024-09-12T01:10:58.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.615+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13073107117502545187', time=2024-09-12T02:52:46.132530+0000, chain.objs.size()=1 2024-09-12T01:10:58.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.615+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.287__shadow_.TkQHDB38gL3L90693zCBRssPgCitLCa_0 2024-09-12T01:10:58.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.615+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6071521266006278627', time=2024-09-12T02:52:46.135445+0000, chain.objs.size()=1 2024-09-12T01:10:58.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.615+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.287__shadow_.FVh5qS53fCoH5TdZTi0dlH6RLzyQLFn_0 2024-09-12T01:10:58.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.617+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17546042206080471236', time=2024-09-12T02:52:51.131828+0000, chain.objs.size()=1 2024-09-12T01:10:58.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.BSKdhRMw_IOGojt0YsoDwTJbXk7-6FD_0 2024-09-12T01:10:58.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.617+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1766896512557526938', time=2024-09-12T02:52:51.186809+0000, chain.objs.size()=1 2024-09-12T01:10:58.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.awshj9o9WccDZ5smQl1UXAakxePYN_h_0 2024-09-12T01:10:58.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.617+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2592818673463039049', time=2024-09-12T02:52:53.225213+0000, chain.objs.size()=1 2024-09-12T01:10:58.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.Ql6KE-mT2Zn2N5G8rGAqbxei0NbkfJQ_0 2024-09-12T01:10:58.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.617+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3750345839076078273', time=2024-09-12T02:52:59.457604+0000, chain.objs.size()=1 2024-09-12T01:10:58.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.304__shadow_.9ftBZONACBc14Iwhn94pSa2v-ExHXND_0 2024-09-12T01:10:58.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.617+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4200038423340586724', time=2024-09-12T02:53:02.623128+0000, chain.objs.size()=1 2024-09-12T01:10:58.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.308__shadow:xwFiZwGU8CqoTlJJV9cJCm3K.7BOmw8_.TlJYNw0uoNxZp4ATiu-5EyXpo2QU1if_0 2024-09-12T01:10:58.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.617+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.610565208341813424', time=2024-09-12T02:53:49.445179+0000, chain.objs.size()=1 2024-09-12T01:10:58.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.p5vEH8wqqa9bRqY2HkJlWq5dZodDL_y_0 2024-09-12T01:10:58.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.617+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4591413929832458074', time=2024-09-12T02:53:49.524905+0000, chain.objs.size()=1 2024-09-12T01:10:58.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.HGB9d50PJDg_xoRIZqlhgz1k0naRkow_0 2024-09-12T01:10:58.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.618+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1406359073917626512', time=2024-09-12T02:53:49.604105+0000, chain.objs.size()=1 2024-09-12T01:10:58.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.618+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.IiZlNfH5TkE6L5Y_iPDKjdkx-jlHM6h_0 2024-09-12T01:10:58.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.619+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8678766982805974127', time=2024-09-12T02:53:49.689015+0000, chain.objs.size()=1 2024-09-12T01:10:58.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.619+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qTETfVyV-g81ttd_qK-hhGiRlCj1L_L_0 2024-09-12T01:10:58.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.619+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2010605440418621691', time=2024-09-12T02:53:49.931346+0000, chain.objs.size()=1 2024-09-12T01:10:58.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.619+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Hkd3GdJruY4XXDv_z9mp3arFIpWjXuZ_0 2024-09-12T01:10:58.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.620+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9966824251111429834', time=2024-09-12T02:53:51.073395+0000, chain.objs.size()=1 2024-09-12T01:10:58.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.620+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.7XEVCtvbxzA0mJ2iLChMrKQ7m4svKFQ_0 2024-09-12T01:10:58.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14246488986901013358', time=2024-09-12T02:53:51.074189+0000, chain.objs.size()=1 2024-09-12T01:10:58.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Y8uYE544THRorNPVUIctEzyxMl2xiNo_0 2024-09-12T01:10:58.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5154906445789230040', time=2024-09-12T02:53:51.360643+0000, chain.objs.size()=1 2024-09-12T01:10:58.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.k6FDS_FWNgBf85xI6RU4AmLOcjeB3rx_0 2024-09-12T01:10:58.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5887695603030797882', time=2024-09-12T02:53:51.387562+0000, chain.objs.size()=1 2024-09-12T01:10:58.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qto31NXTQKyMhQSv0m_UWxh4d9vH0Mq_0 2024-09-12T01:10:58.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4242684906836681893', time=2024-09-12T02:53:51.539204+0000, chain.objs.size()=1 2024-09-12T01:10:58.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.DTZO7F5L0-309mHlOV9OOg5Td0wxnKg_0 2024-09-12T01:10:58.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8009844995850648991', time=2024-09-12T02:53:51.593397+0000, chain.objs.size()=1 2024-09-12T01:10:58.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nniBO_F27aYQcmAEc5PTA0h-MitO8yQ_0 2024-09-12T01:10:58.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11327817481036663294', time=2024-09-12T02:53:51.594024+0000, chain.objs.size()=1 2024-09-12T01:10:58.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.n6eKdOKPYnBYsOfmx3YaO5WPGI3Ikb3_0 2024-09-12T01:10:58.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7715804157116802067', time=2024-09-12T02:53:51.782560+0000, chain.objs.size()=1 2024-09-12T01:10:58.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.XAhJGHkHPL5AlW-EyVWaux11MTApSWZ_0 2024-09-12T01:10:58.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15205179989656305751', time=2024-09-12T02:53:51.859415+0000, chain.objs.size()=1 2024-09-12T01:10:58.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.06nb4-FUNB6u94vhBQQ5PJLM81TZ20v_0 2024-09-12T01:10:58.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18323897547248687351', time=2024-09-12T02:53:52.563711+0000, chain.objs.size()=1 2024-09-12T01:10:58.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.kIBsy38ZOluP14g2g4dNId_VW4b8aHZ_0 2024-09-12T01:10:58.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5446426170531114582', time=2024-09-12T02:53:52.619996+0000, chain.objs.size()=1 2024-09-12T01:10:58.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.621+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.uK7fYcs3C0zK_XnlITbnPQp-Xkep8Lk_0 2024-09-12T01:10:58.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.624+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3838131399106697894', time=2024-09-12T02:53:52.872769+0000, chain.objs.size()=1 2024-09-12T01:10:58.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.624+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.sb7Lkuk2egnYedcO4yqjBWQF-oLBBL1_0 2024-09-12T01:10:58.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.625+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1153135952391491828', time=2024-09-12T02:53:53.111712+0000, chain.objs.size()=1 2024-09-12T01:10:58.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.625+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.FcNuPpRuFnD6tfzv-C1Onhi3qfA0HZ3_0 2024-09-12T01:10:58.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.625+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12089672172141180936', time=2024-09-12T02:53:53.732820+0000, chain.objs.size()=1 2024-09-12T01:10:58.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.625+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.HMFUEz7T9JVbGpxQ1S4K_iGvyziR4vv_0 2024-09-12T01:10:58.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7287849317621561287', time=2024-09-12T02:53:54.391215+0000, chain.objs.size()=1 2024-09-12T01:10:58.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5S6qJ3qmC7dn_TKf-APmShIDCa-322T_0 2024-09-12T01:10:58.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8091877805897413850', time=2024-09-12T02:53:54.391890+0000, chain.objs.size()=1 2024-09-12T01:10:58.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0wKVfF3HsEL7NTbH3xahooUmeAy6nkv_0 2024-09-12T01:10:58.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4865324762896296138', time=2024-09-12T02:53:55.110304+0000, chain.objs.size()=1 2024-09-12T01:10:58.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Ctp1DwPT3NXtf82-OjqZGiGQCzcNDsm_0 2024-09-12T01:10:58.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1587606986871681100', time=2024-09-12T02:53:55.407646+0000, chain.objs.size()=1 2024-09-12T01:10:58.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Bl8lEiMFuZhjdSayGdI1VqizQV4TPJL_0 2024-09-12T01:10:58.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8256574002991492929', time=2024-09-12T02:53:56.376260+0000, chain.objs.size()=1 2024-09-12T01:10:58.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.GbVp0yUtWvUZZl2Sg4xvNf9RcchZH4T_0 2024-09-12T01:10:58.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16696568124235403013', time=2024-09-12T02:53:56.626996+0000, chain.objs.size()=1 2024-09-12T01:10:58.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.uCk-wRz6XKPjOLbd8J5TFniRPZi6T0G_0 2024-09-12T01:10:58.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17434901403939300314', time=2024-09-12T02:53:56.738950+0000, chain.objs.size()=1 2024-09-12T01:10:58.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.oFyeMH5_9Tq0JJOjBR1gM-s5T5fvqn9_0 2024-09-12T01:10:58.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5018418040812115801', time=2024-09-12T02:53:56.992040+0000, chain.objs.size()=1 2024-09-12T01:10:58.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.aupK4ivPVVNrzlQQ8ztI038E_ASg1uR_0 2024-09-12T01:10:58.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4674220406982472944', time=2024-09-12T02:53:57.117627+0000, chain.objs.size()=1 2024-09-12T01:10:58.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.7DpNNrZOQgZNeAp21Yi3JMNT-W8H9b9_0 2024-09-12T01:10:58.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4473178350986757335', time=2024-09-12T02:53:57.131171+0000, chain.objs.size()=1 2024-09-12T01:10:58.628 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.627+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.FhIKibx3s1cfglcd44LKZNtCmpi0kiR_0 2024-09-12T01:10:58.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.630+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2365418555538163716', time=2024-09-12T02:53:57.274776+0000, chain.objs.size()=1 2024-09-12T01:10:58.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.630+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.EDXH8N6jOfJcULi-XbSiEfRw3intd_z_0 2024-09-12T01:10:58.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.630+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10931540152288001579', time=2024-09-12T02:53:58.670773+0000, chain.objs.size()=1 2024-09-12T01:10:58.629 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.630+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.-GN0x0vHyqBW_uTwA_vD5fakdR2dhPc_0 2024-09-12T01:10:58.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.631+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17588210802005725797', time=2024-09-12T02:53:58.673114+0000, chain.objs.size()=1 2024-09-12T01:10:58.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.631+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Zr5BE1XoCEnP4NgsCSlnqXXMFOheP0d_0 2024-09-12T01:10:58.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.631+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14946633528041930891', time=2024-09-12T02:53:58.673726+0000, chain.objs.size()=1 2024-09-12T01:10:58.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.631+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.mT_p3KH5XF31icYJGPYNmfckrkCa3yr_0 2024-09-12T01:10:58.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.632+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16396467299070375170', time=2024-09-12T02:53:59.609072+0000, chain.objs.size()=1 2024-09-12T01:10:58.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.632+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.txebFvnTAr1aQeI_deGctosd7FCLdd2_0 2024-09-12T01:10:58.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.632+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.45508633445013475', time=2024-09-12T02:53:59.689889+0000, chain.objs.size()=1 2024-09-12T01:10:58.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.632+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lWRqfarCCy2kLoURG8czPcS9ahrAgfe_0 2024-09-12T01:10:58.631 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.632+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18380584360789830931', time=2024-09-12T02:53:59.735329+0000, chain.objs.size()=1 2024-09-12T01:10:58.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.632+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.KYIWZejQwZp7wdkP9RtSD17YBF7maby_0 2024-09-12T01:10:58.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.632+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14050016788247062469', time=2024-09-12T02:54:36.640614+0000, chain.objs.size()=1 2024-09-12T01:10:58.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.632+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.4ElUiGMWADw6_5jC6swtVe4ykx0Xck1_0 2024-09-12T01:10:58.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.632+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13396160700243189459', time=2024-09-12T02:54:37.248342+0000, chain.objs.size()=1 2024-09-12T01:10:58.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.632+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.DtY8s5F8K7zlbnukiqZa5Z4NIWv7Vcw_0 2024-09-12T01:10:58.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.632+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17686251499192715739', time=2024-09-12T02:54:38.208559+0000, chain.objs.size()=1 2024-09-12T01:10:58.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.632+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ujlTHBQV3wsLrmBTFKYR96MihYFx5Du_0 2024-09-12T01:10:58.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.632+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.760327176179698359', time=2024-09-12T02:54:38.330767+0000, chain.objs.size()=1 2024-09-12T01:10:58.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.632+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.wJvqaZy1hXfbTngdMEYFcgDfdfcNYNl_0 2024-09-12T01:10:58.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.634+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9421840753795146975', time=2024-09-12T02:54:38.573553+0000, chain.objs.size()=1 2024-09-12T01:10:58.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.634+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.7UeflYP_xdXUWLpSd0XzYCAmQbIDqGF_0 2024-09-12T01:10:58.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.634+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18195441197696365650', time=2024-09-12T02:54:38.883574+0000, chain.objs.size()=1 2024-09-12T01:10:58.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.634+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.-fMW7j67yhJq0jSPv3Z9Z2ZWGhGLya0_0 2024-09-12T01:10:58.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.634+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15725164466410193059', time=2024-09-12T02:54:39.542153+0000, chain.objs.size()=1 2024-09-12T01:10:58.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.634+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.SstVaMTPfXOtZWN7QmzTciAB7OlrGtL_0 2024-09-12T01:10:58.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.635+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10220180874150725716', time=2024-09-12T02:54:39.807798+0000, chain.objs.size()=1 2024-09-12T01:10:58.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.635+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fetyBSvQYwfbfbSQ2iA1u_vYgNhvTSQ_0 2024-09-12T01:10:58.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.635+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15347685480448051328', time=2024-09-12T02:54:39.808546+0000, chain.objs.size()=1 2024-09-12T01:10:58.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.635+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.owohM_fblH7eC6XFnQ-wuwPzU10S453_0 2024-09-12T01:10:58.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.635+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6567273929619657770', time=2024-09-12T02:54:39.895654+0000, chain.objs.size()=1 2024-09-12T01:10:58.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.635+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.EhwiPUwghvoNiIxAXBfE0Bvd1OUnZbX_0 2024-09-12T01:10:58.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.635+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13545906415797662896', time=2024-09-12T02:54:39.933554+0000, chain.objs.size()=1 2024-09-12T01:10:58.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.635+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Zu7Oe1SGgdbUaj2k6g9GT_pegHRS4tB_0 2024-09-12T01:10:58.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.637+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2101817687464778323', time=2024-09-12T02:54:40.299279+0000, chain.objs.size()=1 2024-09-12T01:10:58.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.637+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Oz3yFUcuMh3yHctjMZq-04d4WixAj34_0 2024-09-12T01:10:58.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.639+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/46808 2024-09-12T01:10:58.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=41, truncated=0, next_marker='' 2024-09-12T01:10:58.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13028205109985528764', time=2024-09-12T02:54:41.067241+0000, chain.objs.size()=1 2024-09-12T01:10:58.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.1fVZPS3VI-D2TYbAe5xqym5z6uOyO03_0 2024-09-12T01:10:58.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6128618219921472024', time=2024-09-12T02:54:41.348537+0000, chain.objs.size()=1 2024-09-12T01:10:58.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.N9_NXTLy6aA-Ch4L93KfSlLTvNPXu80_0 2024-09-12T01:10:58.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4431763263578000473', time=2024-09-12T02:54:41.689939+0000, chain.objs.size()=1 2024-09-12T01:10:58.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.rqD9z2jRk4IaFbLbBqAlByvivkh5jQu_0 2024-09-12T01:10:58.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14017468771011789006', time=2024-09-12T02:54:41.789002+0000, chain.objs.size()=1 2024-09-12T01:10:58.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.vZvqa6MchP2EsPk6aOS5ypsr_iaKmIC_0 2024-09-12T01:10:58.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13662193608284747700', time=2024-09-12T02:54:41.844856+0000, chain.objs.size()=1 2024-09-12T01:10:58.641 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.olGp7jFYNcKkMjc_aZD0KfjgBNOqrZK_0 2024-09-12T01:10:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15261522331239768607', time=2024-09-12T02:54:42.285093+0000, chain.objs.size()=1 2024-09-12T01:10:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.D6x7YO0QI1MocarkW5Wah8v7yXiF5MW_0 2024-09-12T01:10:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2191892560288463506', time=2024-09-12T02:54:42.559006+0000, chain.objs.size()=1 2024-09-12T01:10:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.f7l6JCbUAgpWaPVQCQ-bAlCv2Bj7E0q_0 2024-09-12T01:10:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8989981049800933808', time=2024-09-12T02:54:42.688161+0000, chain.objs.size()=1 2024-09-12T01:10:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.cdIEDC9fJbDs_kUcNNnis56Fv63qKMg_0 2024-09-12T01:10:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9959107837450736495', time=2024-09-12T02:54:42.688976+0000, chain.objs.size()=1 2024-09-12T01:10:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.zmmrvmXvpH377ZiWxmlu0pSdggtbBLH_0 2024-09-12T01:10:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4424793984652443523', time=2024-09-12T02:54:42.732635+0000, chain.objs.size()=1 2024-09-12T01:10:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._Wp0kOl-H8rh6jS2yGplQaTsCzc8x1__0 2024-09-12T01:10:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3003851525070181254', time=2024-09-12T02:54:42.933982+0000, chain.objs.size()=1 2024-09-12T01:10:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fEwdctZUuX-kEKSC9_aSq8LtzeI89fR_0 2024-09-12T01:10:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3752060369077863867', time=2024-09-12T02:54:43.027164+0000, chain.objs.size()=1 2024-09-12T01:10:58.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.641+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.n_1MZKx8RpRH7M-wSVJ0Lvv3XB1YDuB_0 2024-09-12T01:10:58.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.644+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15136441390687167183', time=2024-09-12T02:54:43.351820+0000, chain.objs.size()=1 2024-09-12T01:10:58.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.644+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.HstTIhSeflLv8igLwWHv6LhyY4Kj_Ds_0 2024-09-12T01:10:58.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.644+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10989891669525403441', time=2024-09-12T02:54:43.426340+0000, chain.objs.size()=1 2024-09-12T01:10:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.644+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.0r34kMQneyuxpTmIHjokbH3HJduXGun_0 2024-09-12T01:10:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11323259727007451683', time=2024-09-12T02:54:43.882021+0000, chain.objs.size()=1 2024-09-12T01:10:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.O5fEJyC-qijgPecGs7fcbdEE9AbiS9s_0 2024-09-12T01:10:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1443535650419530643', time=2024-09-12T02:54:43.977982+0000, chain.objs.size()=1 2024-09-12T01:10:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.refsrqJL8w-lnZok_hejuIM9YpdcA1v_0 2024-09-12T01:10:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18073760008061119258', time=2024-09-12T02:54:44.234032+0000, chain.objs.size()=1 2024-09-12T01:10:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.o43NH_-8sa8zp5hKl1fSCFD4-pjMUsE_0 2024-09-12T01:10:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8129462409632922046', time=2024-09-12T02:54:44.652318+0000, chain.objs.size()=1 2024-09-12T01:10:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.4YrBPGVHvpBRHuzc6PxKysjECtcSgri_0 2024-09-12T01:10:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5364027739942191049', time=2024-09-12T02:54:44.796496+0000, chain.objs.size()=1 2024-09-12T01:10:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nKsj9ADahD-7mV1AClBwuoz8bwc9_3U_0 2024-09-12T01:10:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9667777352596287572', time=2024-09-12T02:54:45.248159+0000, chain.objs.size()=1 2024-09-12T01:10:58.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.LLzvd3kr2KfBtGQ5sl2iiWtA_FKB1tF_0 2024-09-12T01:10:58.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12106623870698046766', time=2024-09-12T02:54:45.874139+0000, chain.objs.size()=1 2024-09-12T01:10:58.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.s-RjrdcWsb2lee9Un5MvR0fnVZE_sfA_0 2024-09-12T01:10:58.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2208753932828775703', time=2024-09-12T02:54:46.511621+0000, chain.objs.size()=1 2024-09-12T01:10:58.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.TmjBphgncjvgUlPUnqBgQOCZQPWliLz_0 2024-09-12T01:10:58.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16217444969685926110', time=2024-09-12T02:54:46.812551+0000, chain.objs.size()=1 2024-09-12T01:10:58.646 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.645+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.PraXz2mw3GT5JZN7Si2YXpjbkT4GU90_0 2024-09-12T01:10:58.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.648+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7935510178205691637', time=2024-09-12T02:54:57.035827+0000, chain.objs.size()=1 2024-09-12T01:10:58.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.648+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.344__shadow_.yaqOmsWou4FSMQcGKstrouKwEpi6SDl_0 2024-09-12T01:10:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5223949328392571890', time=2024-09-12T02:54:58.557775+0000, chain.objs.size()=1 2024-09-12T01:10:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.347__shadow_.WmkHs5fiwdqm4ym90xSiTTIAk-KmdkG_0 2024-09-12T01:10:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8753205136025229388', time=2024-09-12T02:55:43.313111+0000, chain.objs.size()=1 2024-09-12T01:10:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.431__shadow_.BD6e6ih8iBDDvTxmUBPsZ8ZOJpLvsUS_0 2024-09-12T01:10:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10664533984156090602', time=2024-09-12T02:55:51.012172+0000, chain.objs.size()=1 2024-09-12T01:10:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.444__shadow_.ZCixtMKyRKDnb1fCH3nFLz3VGpo7Nfg_0 2024-09-12T01:10:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18014458178923188612', time=2024-09-12T02:56:05.139851+0000, chain.objs.size()=1 2024-09-12T01:10:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.465__shadow_.n0zcaqOWt5pX3FDn2MBjeH4xL67fivy_0 2024-09-12T01:10:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10367565239009437706', time=2024-09-12T02:56:22.773043+0000, chain.objs.size()=1 2024-09-12T01:10:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.492__shadow_.pPx5vox7aTyYSBIcISquH_YZZsmvWbG_0 2024-09-12T01:10:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1142095158636842398', time=2024-09-12T02:56:29.501228+0000, chain.objs.size()=1 2024-09-12T01:10:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.504__shadow:IjSk329PwyZ.TikPwkNaT-eseYUSzXd_.b_0nQhQp9blBOoB3SP2J2YjUhbBu0Hw_0 2024-09-12T01:10:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13515198329705627509', time=2024-09-12T02:56:44.092583+0000, chain.objs.size()=1 2024-09-12T01:10:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.513__shadow_.fUGRC88fOcz22pZEJ5XyVRWkg_5sVc8_0 2024-09-12T01:10:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11313071501670195936', time=2024-09-12T02:59:54.305863+0000, chain.objs.size()=1 2024-09-12T01:10:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.649+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:UAv.GIn.UREPZABYoL2ggTLuyiVQfUB_.APJ3122OE1bYq2I-CrS-HkD-ggIYs15_0 2024-09-12T01:10:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.650+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8784313372319190430', time=2024-09-12T03:00:00.448460+0000, chain.objs.size()=1 2024-09-12T01:10:58.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.650+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:AGxz-cRzEeSZ.GcQzWUK1MVbvtDzh84_.L9ArbZY9JDQiW97dw63ZUW3YwlfqcXi_0 2024-09-12T01:10:58.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.650+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1248807198511028413', time=2024-09-12T03:00:06.388591+0000, chain.objs.size()=1 2024-09-12T01:10:58.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.650+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.574__shadow_.Tet6ySF37j4IztsTM8sPMek5QtPw-gE_0 2024-09-12T01:10:58.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.653+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2492333637572781928', time=2024-09-12T03:00:52.612703+0000, chain.objs.size()=1 2024-09-12T01:10:58.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.580__shadow:sRmt8LJI2n85Fh80vM-HI4FAXrkTuwX_.Qr5Lkwj0u5o9_5VWipVgKa-05ljqpLz_0 2024-09-12T01:10:58.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.653+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6649120821962187801', time=2024-09-12T03:00:54.816692+0000, chain.objs.size()=1 2024-09-12T01:10:58.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.581__shadow:aDRUb.RRDirULd5AY29FjCQWI0-EF.I_.J66xqumdfxy9Yh_zOAhsKygR1ITQZJV_0 2024-09-12T01:10:58.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.653+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9867442935964062005', time=2024-09-12T03:02:05.853380+0000, chain.objs.size()=12 2024-09-12T01:10:58.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.615__multipart_multipart_enc.2~3CRhxiwV-LtZ7pZqkwhOUfhIoA5wif2.1 2024-09-12T01:10:58.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.615__shadow_multipart_enc.2~3CRhxiwV-LtZ7pZqkwhOUfhIoA5wif2.1_1 2024-09-12T01:10:58.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.615__multipart_multipart_enc.2~3CRhxiwV-LtZ7pZqkwhOUfhIoA5wif2.2 2024-09-12T01:10:58.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.615__shadow_multipart_enc.2~3CRhxiwV-LtZ7pZqkwhOUfhIoA5wif2.2_1 2024-09-12T01:10:58.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.615__multipart_multipart_enc.2~3CRhxiwV-LtZ7pZqkwhOUfhIoA5wif2.3 2024-09-12T01:10:58.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.615__shadow_multipart_enc.2~3CRhxiwV-LtZ7pZqkwhOUfhIoA5wif2.3_1 2024-09-12T01:10:58.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.615__multipart_multipart_enc.2~3CRhxiwV-LtZ7pZqkwhOUfhIoA5wif2.4 2024-09-12T01:10:58.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.615__shadow_multipart_enc.2~3CRhxiwV-LtZ7pZqkwhOUfhIoA5wif2.4_1 2024-09-12T01:10:58.654 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.615__multipart_multipart_enc.2~3CRhxiwV-LtZ7pZqkwhOUfhIoA5wif2.5 2024-09-12T01:10:58.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.656+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.615__shadow_multipart_enc.2~3CRhxiwV-LtZ7pZqkwhOUfhIoA5wif2.5_1 2024-09-12T01:10:58.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.656+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.615__multipart_multipart_enc.2~3CRhxiwV-LtZ7pZqkwhOUfhIoA5wif2.6 2024-09-12T01:10:58.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.657+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.615__shadow_multipart_enc.2~3CRhxiwV-LtZ7pZqkwhOUfhIoA5wif2.6_1 2024-09-12T01:10:58.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.657+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15842184044599303048', time=2024-09-12T03:05:32.841338+0000, chain.objs.size()=6 2024-09-12T01:10:58.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.657+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.663__multipart_foo.2~aeHIUU6x9xkRtY6jBY3EaFLUJOqaHme.1 2024-09-12T01:10:58.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.659+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.663__multipart_foo.2~aeHIUU6x9xkRtY6jBY3EaFLUJOqaHme.2 2024-09-12T01:10:58.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.659+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.663__multipart_foo.2~aeHIUU6x9xkRtY6jBY3EaFLUJOqaHme.3 2024-09-12T01:10:58.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.659+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.663__multipart_foo.2~aeHIUU6x9xkRtY6jBY3EaFLUJOqaHme.4 2024-09-12T01:10:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.661+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.663__multipart_foo.2~aeHIUU6x9xkRtY6jBY3EaFLUJOqaHme.5 2024-09-12T01:10:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.661+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.663__multipart_foo.2~aeHIUU6x9xkRtY6jBY3EaFLUJOqaHme.6 2024-09-12T01:10:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.661+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18325068306513217944', time=2024-09-12T03:05:42.868655+0000, chain.objs.size()=1 2024-09-12T01:10:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.661+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.680__shadow_.bItzlQDOFQS7EYpirHY4g5_p69oA9Nm_0 2024-09-12T01:10:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.661+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2536435814988512636', time=2024-09-12T03:05:53.879609+0000, chain.objs.size()=1 2024-09-12T01:10:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.661+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.701__shadow:QGVPTY2BvT-E9vRrL6o2W9kstU59zp6_.8l5dIwj1tSX5skN0rPR-LMfkRd6nH-j_0 2024-09-12T01:10:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.661+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1912088107653555240', time=2024-09-12T03:05:57.121822+0000, chain.objs.size()=1 2024-09-12T01:10:58.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.661+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.706__shadow:5WItgBUqXBdIGnQCaj2nQWy4wBtSGaf_.kXpTTOcJ9waKeioyoPgybHTUYnOfZYL_0 2024-09-12T01:10:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.665+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:58.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.667+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:10:58.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.669+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:58.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:58.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50483' 2024-09-12T01:10:58.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5621465086292555487', time=2024-09-12T02:49:59.010065+0000, chain.objs.size()=1 2024-09-12T01:10:58.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.201__shadow_.Yr30-G1DDSpGvY6DlF1SMucZAvAhACd_0 2024-09-12T01:10:58.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12693288406174203719', time=2024-09-12T02:51:28.516507+0000, chain.objs.size()=1 2024-09-12T01:10:58.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.236__shadow_.j9mYpVdMRS5vtwpA1c-lEFilMfIB61f_0 2024-09-12T01:10:58.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1755686145724590463', time=2024-09-12T02:51:30.775309+0000, chain.objs.size()=1 2024-09-12T01:10:58.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.239__shadow_.VZ2WD7wWYC6EpcIBR8qKv_c-l_m96qI_0 2024-09-12T01:10:58.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7451459620374011427', time=2024-09-12T02:51:32.388988+0000, chain.objs.size()=1 2024-09-12T01:10:58.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.242__shadow_.r7wvNisJkcdzrUjcCCg_nrsv0o2G0IG_0 2024-09-12T01:10:58.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13584017144259186986', time=2024-09-12T02:51:37.114810+0000, chain.objs.size()=1 2024-09-12T01:10:58.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.249__shadow_.voq9qOmguNQLY3LdXM3zlpDrlrSfvLR_0 2024-09-12T01:10:58.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8260392939554805814', time=2024-09-12T02:51:38.310175+0000, chain.objs.size()=1 2024-09-12T01:10:58.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.251__shadow_.Av831mhP-sUHjn9nRLTyTTWjdeRic6z_0 2024-09-12T01:10:58.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4188138116152078609', time=2024-09-12T02:51:41.330359+0000, chain.objs.size()=1 2024-09-12T01:10:58.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.256__shadow_.t-A59ujYNlvrtNGr1uCQwO6xTUb3NcH_0 2024-09-12T01:10:58.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4040770632794427652', time=2024-09-12T02:51:43.676756+0000, chain.objs.size()=1 2024-09-12T01:10:58.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.260__shadow_.IL-_65Gupjcz5yKFkQMpwinpLs7gLt3_0 2024-09-12T01:10:58.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4587425948475969582', time=2024-09-12T02:52:21.147325+0000, chain.objs.size()=1 2024-09-12T01:10:58.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.lLTVAeXfGm7DQPfnp_DJim_Cj3VIbvY_0 2024-09-12T01:10:58.671 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14382514386485443085', time=2024-09-12T02:52:21.567014+0000, chain.objs.size()=1 2024-09-12T01:10:58.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.RyKBXQRb5i5gadnn27n8qA2RJdxhh_I_0 2024-09-12T01:10:58.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10913902020243787052', time=2024-09-12T02:52:21.670721+0000, chain.objs.size()=1 2024-09-12T01:10:58.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.spuDKn9Kw1UjSVdSod4ktD4WoQbNBSt_0 2024-09-12T01:10:58.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17762549475851905215', time=2024-09-12T02:52:21.823717+0000, chain.objs.size()=1 2024-09-12T01:10:58.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.670+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.p8ErZMSJ1TVCjzpwvhTC9vq7Fh2pf4W_0 2024-09-12T01:10:58.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.673+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2736781032857201568', time=2024-09-12T02:52:21.885267+0000, chain.objs.size()=1 2024-09-12T01:10:58.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.673+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.OGR2hPXWNArM704RDJB1Nuc1Z6WDLaP_0 2024-09-12T01:10:58.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7809486405496656034', time=2024-09-12T02:52:21.915648+0000, chain.objs.size()=1 2024-09-12T01:10:58.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.GgJfXGb-dFWScIxQxz8qxLLLm_jks30_0 2024-09-12T01:10:58.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8684902971425687169', time=2024-09-12T02:52:21.916907+0000, chain.objs.size()=1 2024-09-12T01:10:58.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.9ebn0o5_e6qJKlIM0oWIlJTXVjYYJ-B_0 2024-09-12T01:10:58.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4463548041972223694', time=2024-09-12T02:52:22.184688+0000, chain.objs.size()=1 2024-09-12T01:10:58.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.fD1G-GPkFBzgD7w2FHOgd26XMlV3ZJC_0 2024-09-12T01:10:58.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5552664087402754098', time=2024-09-12T02:52:22.891511+0000, chain.objs.size()=1 2024-09-12T01:10:58.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.RZSSGrS2k_ruCNn2MoHiHrfoRrMNbDW_0 2024-09-12T01:10:58.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1187118212164392619', time=2024-09-12T02:52:22.963032+0000, chain.objs.size()=1 2024-09-12T01:10:58.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.A6rus6IqAWgB8CCMGyJjVKlLas4UqiQ_0 2024-09-12T01:10:58.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2068951021964788267', time=2024-09-12T02:52:23.735560+0000, chain.objs.size()=1 2024-09-12T01:10:58.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.3wDoUx6NFBIGnxPJ2TdSk7tA6AXxWhd_0 2024-09-12T01:10:58.674 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17576805534474159595', time=2024-09-12T02:52:24.440296+0000, chain.objs.size()=1 2024-09-12T01:10:58.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.IxCHvDyL0P608_f-M_MKF_5gtY2OLdL_0 2024-09-12T01:10:58.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13350371682696514139', time=2024-09-12T02:52:24.721554+0000, chain.objs.size()=1 2024-09-12T01:10:58.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.m4iDbEwc10u-uDirWLyN-ZzKJ75yJDQ_0 2024-09-12T01:10:58.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18362899849178332963', time=2024-09-12T02:52:24.949710+0000, chain.objs.size()=1 2024-09-12T01:10:58.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5a2oOdKhnT_j7Rvn_f1nbmL4NukA3ab_0 2024-09-12T01:10:58.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17671505526268749740', time=2024-09-12T02:52:25.106420+0000, chain.objs.size()=1 2024-09-12T01:10:58.675 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.674+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.19crG4-kK6AAX7f6ex75LGYdiOrqqsu_0 2024-09-12T01:10:58.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.677+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15536151344290135260', time=2024-09-12T02:52:26.005303+0000, chain.objs.size()=1 2024-09-12T01:10:58.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.677+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.RhKElPxlvQG2zZ0AFEZy5jPo-m21N25_0 2024-09-12T01:10:58.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.677+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17971084377826137338', time=2024-09-12T02:52:26.190731+0000, chain.objs.size()=1 2024-09-12T01:10:58.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.677+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.XsIeZqIyajReZOTORJbfbIj1nMFcJDN_0 2024-09-12T01:10:58.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.678+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1661348847429024747', time=2024-09-12T02:52:27.766118+0000, chain.objs.size()=1 2024-09-12T01:10:58.677 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.678+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KOVJjvo3MiI3b65M7w3dy_EjKHqHhHA_0 2024-09-12T01:10:58.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7311229726289921295', time=2024-09-12T02:52:28.066778+0000, chain.objs.size()=1 2024-09-12T01:10:58.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.MXKIEC7e8rqZ5DFqBaO7C8uWrAEy3Lp_0 2024-09-12T01:10:58.678 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12574477606447130600', time=2024-09-12T02:52:28.453320+0000, chain.objs.size()=1 2024-09-12T01:10:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.UEk7j8nwVbGOlgzBYUB7kHsKgW7Ow6u_0 2024-09-12T01:10:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7368958322365888741', time=2024-09-12T02:52:28.585487+0000, chain.objs.size()=1 2024-09-12T01:10:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4bDhOhjIiGjtotp8Jvi2yc0sXXUksht_0 2024-09-12T01:10:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5820882124400367447', time=2024-09-12T02:52:28.661096+0000, chain.objs.size()=1 2024-09-12T01:10:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.MmZGZ2V2-P2XKHQMmqUledIhV-sJSm8_0 2024-09-12T01:10:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11254306594890558868', time=2024-09-12T02:52:29.517476+0000, chain.objs.size()=1 2024-09-12T01:10:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Zm-JXS95UMTxJwPhEDYiamDC_TVxgY9_0 2024-09-12T01:10:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9783019869865438319', time=2024-09-12T02:52:30.208538+0000, chain.objs.size()=1 2024-09-12T01:10:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.rGjdGFT4wV1RpZmsPs3OpYy_3PW9Aaz_0 2024-09-12T01:10:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.765388632882696091', time=2024-09-12T02:52:30.241584+0000, chain.objs.size()=1 2024-09-12T01:10:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.AWgcQTup--aCzJuZJE6Hcd8M0a80b9R_0 2024-09-12T01:10:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4525129281778614313', time=2024-09-12T02:52:30.468906+0000, chain.objs.size()=1 2024-09-12T01:10:58.679 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wLUnP5rGKhGDTUXXnA4Z72q6ncXvD9i_0 2024-09-12T01:10:58.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6143806401843735683', time=2024-09-12T02:52:30.676128+0000, chain.objs.size()=1 2024-09-12T01:10:58.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.679+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.8TZ0N0tWPz6PYnay87RJhyAXICiQaFa_0 2024-09-12T01:10:58.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.681+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10382938191870694291', time=2024-09-12T02:52:31.679719+0000, chain.objs.size()=1 2024-09-12T01:10:58.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.681+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.r5SZ2-X7sqTDXUW_W_awv-slchzOCsG_0 2024-09-12T01:10:58.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.681+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2322674015023884114', time=2024-09-12T02:52:31.680403+0000, chain.objs.size()=1 2024-09-12T01:10:58.680 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.681+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.7h0angPNlBFQZyo8dh3HrY5uCCqTZWr_0 2024-09-12T01:10:58.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.683+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5472670730618815092', time=2024-09-12T02:52:47.992135+0000, chain.objs.size()=1 2024-09-12T01:10:58.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.683+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.290__shadow_.V_LIrh8AY329XemP4qgSqHv8QuAJ3GO_0 2024-09-12T01:10:58.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.683+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14997830314657156082', time=2024-09-12T02:53:02.614293+0000, chain.objs.size()=1 2024-09-12T01:10:58.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.683+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.308__shadow:xXKDXNJvlC5QoDnr2vhhO8RLBpvC2vX_.D53ERGpMaV_FWxdE4reskwaLANfBlmk_0 2024-09-12T01:10:58.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.683+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3474990425407448946', time=2024-09-12T02:53:49.404295+0000, chain.objs.size()=1 2024-09-12T01:10:58.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.683+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ugEY2gQlWKP1jHQBRttaIQ_v_FJ2Mur_0 2024-09-12T01:10:58.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.683+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15637805728537142159', time=2024-09-12T02:53:49.688487+0000, chain.objs.size()=1 2024-09-12T01:10:58.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.683+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.N8szgEocxpNy1cc1xoZXImQ7_qzRt5a_0 2024-09-12T01:10:58.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.683+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1000503794362975749', time=2024-09-12T02:53:50.915986+0000, chain.objs.size()=1 2024-09-12T01:10:58.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.683+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0iNSWwSiNYOIOkWpp8qyQcTUivYrzDN_0 2024-09-12T01:10:58.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.683+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11800433679148140511', time=2024-09-12T02:53:51.118719+0000, chain.objs.size()=1 2024-09-12T01:10:58.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.683+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.CRIc1nVt3o5ffxUCrj6rFxr8SJvP_C2_0 2024-09-12T01:10:58.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.683+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3333309364334661393', time=2024-09-12T02:53:51.119465+0000, chain.objs.size()=1 2024-09-12T01:10:58.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.683+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cX99Xo--uIrL7rQb2ivl3-UZBfVaabw_0 2024-09-12T01:10:58.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.685+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1669290158074675317', time=2024-09-12T02:53:51.463385+0000, chain.objs.size()=1 2024-09-12T01:10:58.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.685+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ab7FqcsZjbcLD0U5cSnZrxYNO-2MceO_0 2024-09-12T01:10:58.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.685+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16755262266580112825', time=2024-09-12T02:53:51.624000+0000, chain.objs.size()=1 2024-09-12T01:10:58.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.685+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.P5GaaVULJfHAfoNy3Yc0os9o55V2Um0_0 2024-09-12T01:10:58.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.685+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3881581941132453929', time=2024-09-12T02:53:51.624634+0000, chain.objs.size()=1 2024-09-12T01:10:58.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.685+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.D_8Sxd53wX20WsUHjq4X_EJCLFJA90f_0 2024-09-12T01:10:58.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.685+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5217101509945152973', time=2024-09-12T02:53:52.732328+0000, chain.objs.size()=1 2024-09-12T01:10:58.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.685+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nnpj2VWyy0OjrdJ6AjeMzHS0RagifhS_0 2024-09-12T01:10:58.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.686+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17540011567390481015', time=2024-09-12T02:53:52.970716+0000, chain.objs.size()=1 2024-09-12T01:10:58.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.686+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.t8EUGb9yzWJf49287xXShYCRgaTSzcq_0 2024-09-12T01:10:58.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.687+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11257191652226826131', time=2024-09-12T02:53:53.035460+0000, chain.objs.size()=1 2024-09-12T01:10:58.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.687+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hUaw5cdnHq_YxPbNCg1SJObiG5ltlbB_0 2024-09-12T01:10:58.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.688+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3941372979463613399', time=2024-09-12T02:53:53.960198+0000, chain.objs.size()=1 2024-09-12T01:10:58.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.688+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.RxGgGEB6mp8X5nWuKsrJNuZ8L4HFS_I_0 2024-09-12T01:10:58.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.688+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9793541838248111602', time=2024-09-12T02:53:53.997176+0000, chain.objs.size()=1 2024-09-12T01:10:58.687 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.688+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tDd-Pp44rDjfjIJNYTu6P138c607CiQ_0 2024-09-12T01:10:58.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4490007736507822097', time=2024-09-12T02:53:54.110868+0000, chain.objs.size()=1 2024-09-12T01:10:58.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.rNXfMK46tJd16rfKIu28MKj1ijU7oFm_0 2024-09-12T01:10:58.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5095982999788633441', time=2024-09-12T02:53:55.181185+0000, chain.objs.size()=1 2024-09-12T01:10:58.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.AeIKlHgoIVTkEwpzDqPLGPzq0sRxr5J_0 2024-09-12T01:10:58.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11237377372073417330', time=2024-09-12T02:53:55.781870+0000, chain.objs.size()=1 2024-09-12T01:10:58.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.vV9eooAhPySXCFwNUUicGtZLnrXs6jy_0 2024-09-12T01:10:58.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8049046916537419571', time=2024-09-12T02:53:56.009961+0000, chain.objs.size()=1 2024-09-12T01:10:58.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.6W3P6ue7JwvGQuqP3E8hsiS0pB9lDEd_0 2024-09-12T01:10:58.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10428261255506563130', time=2024-09-12T02:53:56.441886+0000, chain.objs.size()=1 2024-09-12T01:10:58.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.NSPnnzs_9Cs4lfSA5X8IgNomHgotPL9_0 2024-09-12T01:10:58.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16920422774747168646', time=2024-09-12T02:53:56.792195+0000, chain.objs.size()=1 2024-09-12T01:10:58.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Aw5Z_bwvjyV4Nd47wtaJ86GsXLAyie__0 2024-09-12T01:10:58.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.424073649041312684', time=2024-09-12T02:53:57.732191+0000, chain.objs.size()=1 2024-09-12T01:10:58.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.iJCKKpNawaE0Ffj_adasRVLT1nUScRv_0 2024-09-12T01:10:58.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14239655380611592395', time=2024-09-12T02:53:58.097796+0000, chain.objs.size()=1 2024-09-12T01:10:58.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cXq4wi2H3NTXt8QD6h94eKhX6_JsjOF_0 2024-09-12T01:10:58.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10712694939575743853', time=2024-09-12T02:53:59.209537+0000, chain.objs.size()=1 2024-09-12T01:10:58.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ezsewJK8ODA3dhaMmZih-j53GkeJoAG_0 2024-09-12T01:10:58.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7796633207259575082', time=2024-09-12T02:53:59.292721+0000, chain.objs.size()=1 2024-09-12T01:10:58.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ERNrSRBBaWljoGRSDffPBLNEyMlvhVf_0 2024-09-12T01:10:58.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.690+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1302054407821410187', time=2024-09-12T02:53:59.374399+0000, chain.objs.size()=1 2024-09-12T01:10:58.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.691+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.BrXxrQp17DpPE1TL7ddqcF7mN_lLmoT_0 2024-09-12T01:10:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10338377860265785592', time=2024-09-12T02:54:36.641101+0000, chain.objs.size()=1 2024-09-12T01:10:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.l_mcsjcGt7SKRoKgNyySpvMpj82Z3qQ_0 2024-09-12T01:10:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12791650470361517364', time=2024-09-12T02:54:37.448728+0000, chain.objs.size()=1 2024-09-12T01:10:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.F_4pPdXyWYb6tdJ_cQsGaZ2S3djpdYZ_0 2024-09-12T01:10:58.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6105650702575225320', time=2024-09-12T02:54:37.616184+0000, chain.objs.size()=1 2024-09-12T01:10:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.8e8l7tKnM77VfM4dQzlWh_q6mGEE8GI_0 2024-09-12T01:10:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2828236271727132409', time=2024-09-12T02:54:37.628461+0000, chain.objs.size()=1 2024-09-12T01:10:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Ibq0LkPruXI4kA18P5bWqIJkBu_FqQF_0 2024-09-12T01:10:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6311386365626309772', time=2024-09-12T02:54:38.573478+0000, chain.objs.size()=1 2024-09-12T01:10:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9Rqsvy9b-yYhHZA9UJpFVUlLZ1nGyJA_0 2024-09-12T01:10:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8889556979301036904', time=2024-09-12T02:54:38.984999+0000, chain.objs.size()=1 2024-09-12T01:10:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.QPH4nQsGAzdZVGprrpHOrm-2s_DPlrG_0 2024-09-12T01:10:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10610136882843063230', time=2024-09-12T02:54:39.022062+0000, chain.objs.size()=1 2024-09-12T01:10:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.KI8ETtQruscORZYHs57cRCy3NenenCw_0 2024-09-12T01:10:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6026239971254237444', time=2024-09-12T02:54:39.933282+0000, chain.objs.size()=1 2024-09-12T01:10:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.51RLJz8oNenGqqfzsWsc9250ftpJAqp_0 2024-09-12T01:10:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9679977931888169571', time=2024-09-12T02:54:39.977190+0000, chain.objs.size()=1 2024-09-12T01:10:58.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.eSTQhSI0fRfYYteaAlhGfHYHRnArVUw_0 2024-09-12T01:10:58.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15061278634307511603', time=2024-09-12T02:54:40.094133+0000, chain.objs.size()=1 2024-09-12T01:10:58.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.694+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.MbS1ihIloiJtWjIXgI2nGdUDYizhOsi_0 2024-09-12T01:10:58.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.695+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.147338434119023226', time=2024-09-12T02:54:40.471349+0000, chain.objs.size()=1 2024-09-12T01:10:58.695 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.695+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Ybn3hHkEIfPQ9AebB4apnWdRj6dlXU5_0 2024-09-12T01:10:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.698+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4403294730546017379', time=2024-09-12T02:54:41.033797+0000, chain.objs.size()=1 2024-09-12T01:10:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.698+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.4CswutiE2SdkbDC1eskfJDVek2u_J-h_0 2024-09-12T01:10:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.698+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.254013433905395897', time=2024-09-12T02:54:41.066022+0000, chain.objs.size()=1 2024-09-12T01:10:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.698+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.QfvnzBXOQboqwJ32TfkZ0V80TUzkEVN_0 2024-09-12T01:10:58.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.698+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4208384950141748382', time=2024-09-12T02:54:41.067167+0000, chain.objs.size()=1 2024-09-12T01:10:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.698+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.TdrbJ44s_z6ze2m-_acXXXZ8RWWuxOn_0 2024-09-12T01:10:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.698+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9794807852042752269', time=2024-09-12T02:54:41.069703+0000, chain.objs.size()=1 2024-09-12T01:10:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.698+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.BEqe5jHJnLRo3tIrGATTboQ3Iqc2zbq_0 2024-09-12T01:10:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.700+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9376808760223210915', time=2024-09-12T02:54:41.349369+0000, chain.objs.size()=1 2024-09-12T01:10:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.700+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.YQfec7JTM8XzUjZVeLiNduXQ1JDLe_a_0 2024-09-12T01:10:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.700+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14099775593526371659', time=2024-09-12T02:54:41.472359+0000, chain.objs.size()=1 2024-09-12T01:10:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.700+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.GzSyFkmyAEjJidXFpm0C8TuIO6FyanU_0 2024-09-12T01:10:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.700+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8574218057860716323', time=2024-09-12T02:54:42.559589+0000, chain.objs.size()=1 2024-09-12T01:10:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.700+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ddlc9arngsoszZGvTmP5dKM3a7ubM1k_0 2024-09-12T01:10:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.700+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6854724089462827544', time=2024-09-12T02:54:42.836203+0000, chain.objs.size()=1 2024-09-12T01:10:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.700+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.WUcFUWVsVCz39YGhIugadVQ3tqJcPlt_0 2024-09-12T01:10:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.700+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10898099264494332982', time=2024-09-12T02:54:43.426629+0000, chain.objs.size()=1 2024-09-12T01:10:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.700+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.U8YGPxonK0bcB6BXITW1pvuqAeHdpZ__0 2024-09-12T01:10:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.700+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4262807293175083510', time=2024-09-12T02:54:43.483236+0000, chain.objs.size()=1 2024-09-12T01:10:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.700+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dPi3vb8-jAW7QxIbGcUvM6Rgy1zGzHp_0 2024-09-12T01:10:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.700+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6225259028135581279', time=2024-09-12T02:54:44.126270+0000, chain.objs.size()=1 2024-09-12T01:10:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.700+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.aA-4x8U1CL4AoVQd8TYLF1kfHX4UJhB_0 2024-09-12T01:10:58.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.702+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4169445159802789147', time=2024-09-12T02:54:44.646633+0000, chain.objs.size()=1 2024-09-12T01:10:58.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.702+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.19mNOgLQIzuXKJd1JkGjrkoM794eZCi_0 2024-09-12T01:10:58.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.702+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4898370289414032464', time=2024-09-12T02:54:45.547934+0000, chain.objs.size()=1 2024-09-12T01:10:58.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.702+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.VrTeFIYuQUtDGW20LnnpODFFERvM1u9_0 2024-09-12T01:10:58.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.702+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15108338314987308335', time=2024-09-12T02:54:45.832235+0000, chain.objs.size()=1 2024-09-12T01:10:58.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.702+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.mKQfCu3fV1dvvcgHnZl__cD3fRG-Afy_0 2024-09-12T01:10:58.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.702+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1283536069028955061', time=2024-09-12T02:54:46.308101+0000, chain.objs.size()=1 2024-09-12T01:10:58.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.702+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.hNPynBHA5jOUa8e2W4QhYil_gA4Ycss_0 2024-09-12T01:10:58.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.702+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9992693333629909206', time=2024-09-12T02:54:46.619503+0000, chain.objs.size()=1 2024-09-12T01:10:58.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.702+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.C68t_3CpmFgLk7KvSu5uVSdNudlJxhv_0 2024-09-12T01:10:58.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.704+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4707653720542043810', time=2024-09-12T02:54:46.938852+0000, chain.objs.size()=1 2024-09-12T01:10:58.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.704+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.iN9UQnZmubFJB-bopK3hpy9EjUeRSSO_0 2024-09-12T01:10:58.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.704+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13969630743825271983', time=2024-09-12T02:54:48.040386+0000, chain.objs.size()=1 2024-09-12T01:10:58.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.704+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.327__shadow_._96g9OtBi6giQEyzZyE_Bh0Q75Y3J7C_0 2024-09-12T01:10:58.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.704+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13010741589055647214', time=2024-09-12T02:55:07.410321+0000, chain.objs.size()=2 2024-09-12T01:10:58.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.704+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.368__shadow_.SqaU9V558ClmeFFlU19SQr1yAAjG269_0 2024-09-12T01:10:58.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.704+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.368__shadow_.SqaU9V558ClmeFFlU19SQr1yAAjG269_1 2024-09-12T01:10:58.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.704+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16976118675744235830', time=2024-09-12T02:55:16.024627+0000, chain.objs.size()=1 2024-09-12T01:10:58.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.704+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.382__shadow_.1kwEpZ91ag8qrilgwGyA-Bliic2sZuO_0 2024-09-12T01:10:58.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.706+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11388378821337862923', time=2024-09-12T02:55:32.044483+0000, chain.objs.size()=1 2024-09-12T01:10:58.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.706+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.409__shadow_.4Q93dzA6eVrbdYS9IsfRqha9X1p8krT_0 2024-09-12T01:10:58.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.706+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1710577011788882190', time=2024-09-12T02:56:44.860065+0000, chain.objs.size()=1 2024-09-12T01:10:58.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.706+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.515__shadow_.aHm0jzFFJulZlgEgBVCQ8kfGZs7CVac_0 2024-09-12T01:10:58.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.706+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18083674882360696735', time=2024-09-12T02:59:39.917037+0000, chain.objs.size()=1 2024-09-12T01:10:58.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.706+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.559__shadow_.geLFim-IMUgWpnbWm-1KTmXvtKUjGhB_0 2024-09-12T01:10:58.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.706+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15976919187256478191', time=2024-09-12T03:00:20.313503+0000, chain.objs.size()=1 2024-09-12T01:10:58.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.706+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:.LVAb2ebiwh604F1McTuOQ0pyNJL5w5_.pIupMO5Zp8_ikMPNMrQUXsYMx_xzsZq_0 2024-09-12T01:10:58.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.707+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17140352498810746773', time=2024-09-12T03:00:27.876931+0000, chain.objs.size()=1 2024-09-12T01:10:58.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.707+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:nKqF7A.Kj7bEcAGxQGziFbhXB8LTePQ_.TRuucdxK2MQyC0IKPbPybgIgPWu8qdA_0 2024-09-12T01:10:58.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.707+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14820424853396374729', time=2024-09-12T03:00:28.250531+0000, chain.objs.size()=1 2024-09-12T01:10:58.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.707+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:4MSkvvBqLvUbQ8K9ves2rs9gNKca14j_.5Mbbbbchxs02bFHvxtOQdO4Xa8-432-_0 2024-09-12T01:10:58.709 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.710+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/50483 2024-09-12T01:10:58.711 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.712+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:10:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.712+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7334152786081773187', time=2024-09-12T03:00:49.893949+0000, chain.objs.size()=4 2024-09-12T01:10:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.712+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.579__multipart_testobj.2~wd1vf-ExVfLy3BpwerMV2BVYRsBdGr1.1 2024-09-12T01:10:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.712+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.579__multipart_testobj.2~wd1vf-ExVfLy3BpwerMV2BVYRsBdGr1.2 2024-09-12T01:10:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.712+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.579__multipart_testobj.2~wd1vf-ExVfLy3BpwerMV2BVYRsBdGr1.3 2024-09-12T01:10:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.712+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.579__multipart_testobj.2~wd1vf-ExVfLy3BpwerMV2BVYRsBdGr1.4 2024-09-12T01:10:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.712+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15355764104420183977', time=2024-09-12T03:00:54.809796+0000, chain.objs.size()=1 2024-09-12T01:10:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.712+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.581__shadow:vhn4Imu.J.ZHMkQvM3lrOfQJ10EtQ8h_.ZAG0In-Pi5LY8nVo2YJpTml6dtN5_-A_0 2024-09-12T01:10:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.712+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15959531971312709443', time=2024-09-12T03:05:42.872521+0000, chain.objs.size()=1 2024-09-12T01:10:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.712+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.680__shadow_.0O76A1Hc1IRKcoiD14g-oxxMGkjjS-g_0 2024-09-12T01:10:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.712+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15055647982609429415', time=2024-09-12T03:05:49.655851+0000, chain.objs.size()=1 2024-09-12T01:10:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.712+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.694__shadow:vi643amqBYmGMqN9D3N9-1PCC9Yyc7R_.G32fMSdJuoGNBpm2Arfce4I4zNgU47j_0 2024-09-12T01:10:58.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.715+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:58.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.718+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:10:58.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.719+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:58.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.719+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:58.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44803' 2024-09-12T01:10:58.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='_EMynTWVNre57b9JIF3feBaLSAEcfNK7', time=2024-09-12T02:49:28.177772+0000, chain.objs.size()=3 2024-09-12T01:10:58.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_.kclQo4tz-Bfw9YAGSlDV6LyxwpsVXwH_0 2024-09-12T01:10:58.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_.kclQo4tz-Bfw9YAGSlDV6LyxwpsVXwH_1 2024-09-12T01:10:58.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_.kclQo4tz-Bfw9YAGSlDV6LyxwpsVXwH_2 2024-09-12T01:10:58.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='_Yat5yHfi0G52koqlH2StsugCdO0rWkJ', time=2024-09-12T02:49:29.948479+0000, chain.objs.size()=1 2024-09-12T01:10:58.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.164__shadow_.b0Fxlpxjyw585HavjYMPGgKXML-0Eex_0 2024-09-12T01:10:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14349081534638469614', time=2024-09-12T02:50:02.698523+0000, chain.objs.size()=1 2024-09-12T01:10:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.205__shadow_.XXEaroNLtbd6jJ9pH9EMYQic9f3qhwW_0 2024-09-12T01:10:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12143491604422302702', time=2024-09-12T02:51:25.380079+0000, chain.objs.size()=1 2024-09-12T01:10:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.231__shadow_.XJgETSymqiAkI7UyEg7RJ8MUVk6qe7X_0 2024-09-12T01:10:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11657006189101855308', time=2024-09-12T02:51:35.875542+0000, chain.objs.size()=1 2024-09-12T01:10:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.247__shadow_.SuoV1hZRsNzEwy_2tbJMflRWsDaMqBf_0 2024-09-12T01:10:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6851980741386469651', time=2024-09-12T02:51:35.884282+0000, chain.objs.size()=1 2024-09-12T01:10:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.247__shadow_.tD_RHBcnbPoIAx1FWCcPAtcmTk1N4Da_0 2024-09-12T01:10:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5784350873932123881', time=2024-09-12T02:51:44.884115+0000, chain.objs.size()=1 2024-09-12T01:10:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.262__shadow_.6295c7sqljLUakMLedVF0Kr-ACgztXA_0 2024-09-12T01:10:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17139319858185368134', time=2024-09-12T02:52:21.229002+0000, chain.objs.size()=1 2024-09-12T01:10:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.cK4jgKnXb7rLOopDw25rSjZUlhaInSG_0 2024-09-12T01:10:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8153314654215846108', time=2024-09-12T02:52:21.255395+0000, chain.objs.size()=1 2024-09-12T01:10:58.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.bvl14RfI8CE5CN9Yeg55wsMG68u37w1_0 2024-09-12T01:10:58.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8995756352834545976', time=2024-09-12T02:52:22.925415+0000, chain.objs.size()=1 2024-09-12T01:10:58.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.720+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.2DZB53HT7JXZloIUT5FCVLIkXAbtJqC_0 2024-09-12T01:10:58.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.723+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.306731363811596320', time=2024-09-12T02:52:23.003744+0000, chain.objs.size()=1 2024-09-12T01:10:58.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.723+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.dxWxKPVWubOJkfldtNVLerSKnR5Xet3_0 2024-09-12T01:10:58.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.723+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3186620076652604619', time=2024-09-12T02:52:23.012193+0000, chain.objs.size()=1 2024-09-12T01:10:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.723+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KWPPxu-DynSDSTEN9-0-7_FOP4pGkbT_0 2024-09-12T01:10:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.723+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4754300411114689594', time=2024-09-12T02:52:23.021419+0000, chain.objs.size()=1 2024-09-12T01:10:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.723+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.V1OvWLKbSU-owexgTVIE0gSnKSJp0xJ_0 2024-09-12T01:10:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.723+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11424325255892710105', time=2024-09-12T02:52:23.313366+0000, chain.objs.size()=1 2024-09-12T01:10:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.723+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.UwUvtppXV_It1jQO_rlh5Kqm3aAxZ_6_0 2024-09-12T01:10:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.723+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13468449695138960556', time=2024-09-12T02:52:24.343232+0000, chain.objs.size()=1 2024-09-12T01:10:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.723+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.82VvD_7MvMQvU3vH-lFR5uoAqjbDqlS_0 2024-09-12T01:10:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.724+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4384933129221641717', time=2024-09-12T02:52:24.449593+0000, chain.objs.size()=1 2024-09-12T01:10:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.724+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.gcsgIxJj3ZBI-UCowiGgxLjnylwWTRn_0 2024-09-12T01:10:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.724+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7404247432802044447', time=2024-09-12T02:52:24.529373+0000, chain.objs.size()=1 2024-09-12T01:10:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.724+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1-ddmEKFBFHJPpce_rLYZqULcmcxrk5_0 2024-09-12T01:10:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.724+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13858966295939618227', time=2024-09-12T02:52:24.750416+0000, chain.objs.size()=1 2024-09-12T01:10:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.724+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pOnIE3Cn3deBDxz2GoswmqfKfNQCMi7_0 2024-09-12T01:10:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.724+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17452463048459880340', time=2024-09-12T02:52:24.831972+0000, chain.objs.size()=1 2024-09-12T01:10:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.724+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.q9n3kpCXgoy0OANsztlGu7gEt8l77hq_0 2024-09-12T01:10:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.724+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7107010917971407434', time=2024-09-12T02:52:24.944952+0000, chain.objs.size()=1 2024-09-12T01:10:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.724+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.iOTsb59XuMUKT5kv0WXGin9sAU06bAV_0 2024-09-12T01:10:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.724+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6001262698428929424', time=2024-09-12T02:52:25.746579+0000, chain.objs.size()=1 2024-09-12T01:10:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.724+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0OQIPig3ftzUB8jWjUDerqj5e4LmeEu_0 2024-09-12T01:10:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.728+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13256263432504281303', time=2024-09-12T02:52:27.126428+0000, chain.objs.size()=1 2024-09-12T01:10:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.728+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.mp2g6ISyk0HIphj0IR3LB34RhUH4unH_0 2024-09-12T01:10:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.728+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10376443899242882752', time=2024-09-12T02:52:27.236713+0000, chain.objs.size()=1 2024-09-12T01:10:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.728+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.iPk9u1Ae50joE2KxMYFHsX-tGsXPJbw_0 2024-09-12T01:10:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.728+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13767956130833572541', time=2024-09-12T02:52:27.311517+0000, chain.objs.size()=1 2024-09-12T01:10:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.728+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.3om-XZypoy5O2NDrhOTW3F9TsQ3K4rn_0 2024-09-12T01:10:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.728+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14214520043162924957', time=2024-09-12T02:52:27.923374+0000, chain.objs.size()=1 2024-09-12T01:10:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.728+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KceBf11TF2EE7TxXY2hsfWvP62dCHXT_0 2024-09-12T01:10:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.728+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8866796113775898743', time=2024-09-12T02:52:28.020033+0000, chain.objs.size()=1 2024-09-12T01:10:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.728+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.DYjb5SdpNT3HQr_kdqDTURkhxY35LRg_0 2024-09-12T01:10:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.729+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4648339287723954507', time=2024-09-12T02:52:28.048452+0000, chain.objs.size()=1 2024-09-12T01:10:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.729+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.VQV6uPr6HdE2C376FtA61lvpaemiWOK_0 2024-09-12T01:10:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.729+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4791753559904968301', time=2024-09-12T02:52:28.428906+0000, chain.objs.size()=1 2024-09-12T01:10:58.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.729+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.86un_5wYZNZ7jP9cIGAfmMYuHOnbWfN_0 2024-09-12T01:10:58.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.729+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11403988826036640719', time=2024-09-12T02:52:28.832031+0000, chain.objs.size()=1 2024-09-12T01:10:58.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.729+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.RLNdVhMav3ATNhg1_5fMDoDnOOA5KMO_0 2024-09-12T01:10:58.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.729+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9349106659365451674', time=2024-09-12T02:52:29.364648+0000, chain.objs.size()=1 2024-09-12T01:10:58.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.729+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xbNxNRlp2RQt_6Z9VRQAo8rfybYpJMW_0 2024-09-12T01:10:58.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.729+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1666216625361150509', time=2024-09-12T02:52:29.512027+0000, chain.objs.size()=1 2024-09-12T01:10:58.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.729+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.s-CwgMVKFqbmohQRGnw-WJl0lSjO7N-_0 2024-09-12T01:10:58.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.729+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14809015142686371270', time=2024-09-12T02:52:29.972194+0000, chain.objs.size()=1 2024-09-12T01:10:58.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.729+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.frP1uG1GubjBkLzcCAlLNw0DeHeTcU8_0 2024-09-12T01:10:58.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.730+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9114993502269088156', time=2024-09-12T02:52:30.016661+0000, chain.objs.size()=1 2024-09-12T01:10:58.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.730+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Ad2NAEriliN6fkxhCXCQuwNBvXh1ecW_0 2024-09-12T01:10:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.732+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3684379124169333868', time=2024-09-12T02:52:30.146873+0000, chain.objs.size()=1 2024-09-12T01:10:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.732+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.q_aVrVnsmygXsKr3hU7GMR8jiEl4BT9_0 2024-09-12T01:10:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.732+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12628227906393669390', time=2024-09-12T02:52:30.331649+0000, chain.objs.size()=1 2024-09-12T01:10:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.732+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Znp1UWXiJ8UWHv64C8hIvX5z-IjZseT_0 2024-09-12T01:10:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.732+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15865393295334058503', time=2024-09-12T02:52:30.414583+0000, chain.objs.size()=1 2024-09-12T01:10:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.732+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.W80cGFABU3_R3ogiH1k2QzkY0AauGLh_0 2024-09-12T01:10:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.732+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5395662006472164859', time=2024-09-12T02:52:31.326532+0000, chain.objs.size()=1 2024-09-12T01:10:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.732+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ZQ-MyaS1TokyOkfzkFe_rwhWs6J4HzB_0 2024-09-12T01:10:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.732+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14767423824947923063', time=2024-09-12T02:52:31.606224+0000, chain.objs.size()=1 2024-09-12T01:10:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.732+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ICAH5parDCIZbIprPMR17uJ6btVdmlN_0 2024-09-12T01:10:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.733+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1254069274706345405', time=2024-09-12T02:52:37.614615+0000, chain.objs.size()=1 2024-09-12T01:10:58.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.733+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.273__shadow_.TjnVdc9jBzFsvWp1p407siMpA70cjaL_0 2024-09-12T01:10:58.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.733+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10419941458643539963', time=2024-09-12T02:52:43.626445+0000, chain.objs.size()=1 2024-09-12T01:10:58.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.733+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.283__shadow_.QtUP_WGbo9F-3tjuAM6Y2Xp-jExZm_p_0 2024-09-12T01:10:58.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.733+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12590762020778220746', time=2024-09-12T02:52:47.395540+0000, chain.objs.size()=1 2024-09-12T01:10:58.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.733+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.289__shadow_.L1VxtKbiP53yc78ODxaLHmRCG7r34dU_0 2024-09-12T01:10:58.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.734+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14118323548497574108', time=2024-09-12T02:52:51.386826+0000, chain.objs.size()=1 2024-09-12T01:10:58.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.734+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.33KL9Bi0fA_C_49IdKCP_b5Fhrl58I6_0 2024-09-12T01:10:58.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.734+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13910458874972255538', time=2024-09-12T02:52:53.126384+0000, chain.objs.size()=1 2024-09-12T01:10:58.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.734+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.uSDpmkpeycso-N3Bokg1ReJniQpmck7_0 2024-09-12T01:10:58.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.734+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10226527944884981840', time=2024-09-12T02:52:58.848222+0000, chain.objs.size()=1 2024-09-12T01:10:58.734 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.734+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.303__shadow_.fnq6RIY0nXDHubTOaZGSi2pHhK7hCuj_0 2024-09-12T01:10:58.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.736+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2958639281047705833', time=2024-09-12T02:53:49.386473+0000, chain.objs.size()=1 2024-09-12T01:10:58.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.736+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.8bFrNmjiAKEYTzzyIvCZalCBg2JeaKG_0 2024-09-12T01:10:58.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.736+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5281537847308991052', time=2024-09-12T02:53:49.442218+0000, chain.objs.size()=1 2024-09-12T01:10:58.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.736+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dlpmqnycLLUAU9PKzuS9xy4tS2G1_ry_0 2024-09-12T01:10:58.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10476534140797344000', time=2024-09-12T02:53:49.527012+0000, chain.objs.size()=1 2024-09-12T01:10:58.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cWvpQG7Z6duLNpJGz5sN0F7VwhR5aPL_0 2024-09-12T01:10:58.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16405590037762823643', time=2024-09-12T02:53:49.953645+0000, chain.objs.size()=1 2024-09-12T01:10:58.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.W8-ei58_FfZSVQjSRcXXbeWGMsSHhZj_0 2024-09-12T01:10:58.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1875546776818185292', time=2024-09-12T02:53:50.194189+0000, chain.objs.size()=1 2024-09-12T01:10:58.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.wV7l7gy0aMau90wGyFOdTWc7pweo6S8_0 2024-09-12T01:10:58.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2148626913756726671', time=2024-09-12T02:53:50.385936+0000, chain.objs.size()=1 2024-09-12T01:10:58.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.52EArEzh95UOKwzWYF5gEVuuydoHX3k_0 2024-09-12T01:10:58.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3084061440094801686', time=2024-09-12T02:53:50.885105+0000, chain.objs.size()=1 2024-09-12T01:10:58.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.BW-O6lZwrMspmTrIR2U_5FOyRlytDw5_0 2024-09-12T01:10:58.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2003258495620881996', time=2024-09-12T02:53:50.906067+0000, chain.objs.size()=1 2024-09-12T01:10:58.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.uprCZ4EpWZ1yD7suq0E3u7etec8hYVG_0 2024-09-12T01:10:58.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.739+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.312500432651393429', time=2024-09-12T02:53:51.226154+0000, chain.objs.size()=1 2024-09-12T01:10:58.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.739+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.XtVz6AjIxyPvGutzFYumTXuihrD3OkC_0 2024-09-12T01:10:58.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.739+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7773969698667473676', time=2024-09-12T02:53:51.633469+0000, chain.objs.size()=1 2024-09-12T01:10:58.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.739+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.KEIcR8x-H-hcTDvtrATkBhPkyW1fhsV_0 2024-09-12T01:10:58.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.739+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8292708399671006195', time=2024-09-12T02:53:51.749695+0000, chain.objs.size()=1 2024-09-12T01:10:58.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.739+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.plpQvKeJMd1DQi-yHnycGZNPmAslsaE_0 2024-09-12T01:10:58.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.740+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15951665621317871291', time=2024-09-12T02:53:51.753690+0000, chain.objs.size()=1 2024-09-12T01:10:58.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.740+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.33BfrLqE6SNaWcSa6Jd5npf-sCJBlGg_0 2024-09-12T01:10:58.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.740+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5262825647208142257', time=2024-09-12T02:53:52.372687+0000, chain.objs.size()=1 2024-09-12T01:10:58.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.740+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.41BaxrfRzP7K9qxICFZxesNtJyU6-zz_0 2024-09-12T01:10:58.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.741+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2523404726403906976', time=2024-09-12T02:53:53.283106+0000, chain.objs.size()=1 2024-09-12T01:10:58.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.741+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.e0FyZl13fdoxbztmUmItSMWnjjTQiMP_0 2024-09-12T01:10:58.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.741+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17998801184766998723', time=2024-09-12T02:53:54.127604+0000, chain.objs.size()=1 2024-09-12T01:10:58.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.741+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.yscrFQOgI7MMlfuQANPeDa17CHTLORa_0 2024-09-12T01:10:58.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.742+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17218478369873135260', time=2024-09-12T02:53:54.479002+0000, chain.objs.size()=1 2024-09-12T01:10:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.742+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.w8M9-ur4vyI7ENTNhWfmNeJ8PsfVvFn_0 2024-09-12T01:10:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.742+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.331383028323202768', time=2024-09-12T02:53:54.636832+0000, chain.objs.size()=1 2024-09-12T01:10:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.742+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.eMZg6PWz27xrRlGaqotvfmfCRazt-4v_0 2024-09-12T01:10:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.742+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6497139549846005104', time=2024-09-12T02:53:55.037916+0000, chain.objs.size()=1 2024-09-12T01:10:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.742+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.WKpcSFETIzN6S1aGBYlNUioU-bBh3xo_0 2024-09-12T01:10:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.742+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1223321255843386483', time=2024-09-12T02:53:55.859446+0000, chain.objs.size()=1 2024-09-12T01:10:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.742+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Ahv9Oqj0so4Vhr5GGJ1laZe5ukPYIq5_0 2024-09-12T01:10:58.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.744+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10176075254291768849', time=2024-09-12T02:53:57.685437+0000, chain.objs.size()=1 2024-09-12T01:10:58.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.744+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.pIjldAIa0dondsOcZap6GuhqLJuFYjB_0 2024-09-12T01:10:58.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.744+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1094926848794131114', time=2024-09-12T02:53:57.932202+0000, chain.objs.size()=1 2024-09-12T01:10:58.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.744+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.jiogP0xTZs9UH8X_llKK6nqoI_lOE3e_0 2024-09-12T01:10:58.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.744+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9126699731251640043', time=2024-09-12T02:53:58.439914+0000, chain.objs.size()=1 2024-09-12T01:10:58.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.744+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.1NYyIPbOg3Jk9MpZSOdYZt-U2jlNeD__0 2024-09-12T01:10:58.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.744+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16705825835478822989', time=2024-09-12T02:53:58.930727+0000, chain.objs.size()=1 2024-09-12T01:10:58.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.744+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.gzTS1r3oUhe8nYwKRb_jMp-jjxVh7wv_0 2024-09-12T01:10:58.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.744+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10065028555620448387', time=2024-09-12T02:53:59.139460+0000, chain.objs.size()=1 2024-09-12T01:10:58.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.744+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tj2969QHESlP5HvYueKWpL2XpnyS6QO_0 2024-09-12T01:10:58.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.744+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16666879686391022421', time=2024-09-12T02:53:59.238690+0000, chain.objs.size()=1 2024-09-12T01:10:58.744 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.744+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.7UiijxThqxktYimYNyEkVsCMw5YFOHI_0 2024-09-12T01:10:58.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.745+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3746201461704099150', time=2024-09-12T02:53:59.374514+0000, chain.objs.size()=1 2024-09-12T01:10:58.745 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.745+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.VE-fVo8OlkiKKVs6y4nsD9GPxVKoBs6_0 2024-09-12T01:10:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.748+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10639391390303392477', time=2024-09-12T02:53:59.414857+0000, chain.objs.size()=1 2024-09-12T01:10:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.748+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.4xHib4PQiKuKanljEYn4NCeFZaEnS4C_0 2024-09-12T01:10:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.748+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10419918207656135332', time=2024-09-12T02:53:59.510361+0000, chain.objs.size()=1 2024-09-12T01:10:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.748+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5tXUHInd6EABPwfblBedk2u_rHZpByr_0 2024-09-12T01:10:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.748+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.452548366874600418', time=2024-09-12T02:53:59.723140+0000, chain.objs.size()=1 2024-09-12T01:10:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.748+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.pCL8tC6qA7NZtIYlUzXMZniVPWO-Yv6_0 2024-09-12T01:10:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.748+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3612121953082775778', time=2024-09-12T02:54:36.662378+0000, chain.objs.size()=1 2024-09-12T01:10:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.748+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.aSSd2P24p90G4Clc671ZrFbXPOcv-oT_0 2024-09-12T01:10:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.748+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9205967990950074540', time=2024-09-12T02:54:36.797936+0000, chain.objs.size()=1 2024-09-12T01:10:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.748+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.EiI44NkviILCT2Mo4W6G9TBGnczyMDG_0 2024-09-12T01:10:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.748+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6225588987285200629', time=2024-09-12T02:54:36.827901+0000, chain.objs.size()=1 2024-09-12T01:10:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.748+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.1hE7M8mRPWSn0kzULOj06U2sN-V8fsk_0 2024-09-12T01:10:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.748+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.785994157430545901', time=2024-09-12T02:54:36.918792+0000, chain.objs.size()=1 2024-09-12T01:10:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.748+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.meJEqaXhN0Mlv1QeBhe4dBFJw9nIgCx_0 2024-09-12T01:10:58.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.750+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14350838729031738153', time=2024-09-12T02:54:37.005027+0000, chain.objs.size()=1 2024-09-12T01:10:58.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.750+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.QLSoG92MJtbq8ikMBAl1UA4KUJz5oU-_0 2024-09-12T01:10:58.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.750+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13365833110428933871', time=2024-09-12T02:54:37.485565+0000, chain.objs.size()=1 2024-09-12T01:10:58.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.750+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.rVxaBuhyi-s5WFlEVDJBsiiY4PmisD-_0 2024-09-12T01:10:58.749 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.750+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16458047383521538881', time=2024-09-12T02:54:38.142678+0000, chain.objs.size()=1 2024-09-12T01:10:58.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.750+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.iiq-AJdLrJakAF22Ggt3N14L553tcfr_0 2024-09-12T01:10:58.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.750+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6103934750928156646', time=2024-09-12T02:54:38.193129+0000, chain.objs.size()=1 2024-09-12T01:10:58.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.750+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.JECWgdHusjrySn1QU_GRREXwimzulto_0 2024-09-12T01:10:58.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.752+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15813001783349230433', time=2024-09-12T02:54:38.236392+0000, chain.objs.size()=1 2024-09-12T01:10:58.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.752+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fcpUv7AZT_962mlGihe6saNEyWSmy-H_0 2024-09-12T01:10:58.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.752+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12163694917167775171', time=2024-09-12T02:54:38.702875+0000, chain.objs.size()=1 2024-09-12T01:10:58.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.752+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.SW_FXHAsOG9B23DLGvvqeTAn7aOR14__0 2024-09-12T01:10:58.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.752+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2996210078502801692', time=2024-09-12T02:54:38.972881+0000, chain.objs.size()=1 2024-09-12T01:10:58.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.752+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Bky--fTOOzKka3xDm2D_f_ALsJKzx_g_0 2024-09-12T01:10:58.751 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.752+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8845106584686818634', time=2024-09-12T02:54:39.625173+0000, chain.objs.size()=1 2024-09-12T01:10:58.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.752+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.wGVCzDMdOGgeJw1h1uong-6PjsHNqnT_0 2024-09-12T01:10:58.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.752+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14349024851364012679', time=2024-09-12T02:54:39.642505+0000, chain.objs.size()=1 2024-09-12T01:10:58.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.752+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.piaTZfsQoLKuWxE6C54e5QDC8T7JGT9_0 2024-09-12T01:10:58.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.752+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12877727539161642033', time=2024-09-12T02:54:39.908286+0000, chain.objs.size()=1 2024-09-12T01:10:58.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.752+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.AFOXnXMXhptgsPfsfhOX_8Jlfjnj-2b_0 2024-09-12T01:10:58.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.752+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10020067957848572765', time=2024-09-12T02:54:40.403698+0000, chain.objs.size()=1 2024-09-12T01:10:58.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.752+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.abr1lnxhsIbwx6AdsqL6TA5zx1y4oSW_0 2024-09-12T01:10:58.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.754+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9655012184697792802', time=2024-09-12T02:54:40.459994+0000, chain.objs.size()=1 2024-09-12T01:10:58.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.754+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ujEjVFubLK8D6Jv40JMry2Xi30PIK0t_0 2024-09-12T01:10:58.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.754+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13353114820317827638', time=2024-09-12T02:54:40.844066+0000, chain.objs.size()=1 2024-09-12T01:10:58.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.754+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fWBJeRBuK07VlZ_94NkIiFFEvSrcSCX_0 2024-09-12T01:10:58.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.754+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12406513643813537869', time=2024-09-12T02:54:41.020847+0000, chain.objs.size()=1 2024-09-12T01:10:58.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.754+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.0sPxUynTqcqUD1bUuOOc-7cOnB14su3_0 2024-09-12T01:10:58.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8580127429347609281', time=2024-09-12T02:54:41.153979+0000, chain.objs.size()=1 2024-09-12T01:10:58.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.JIEmKLnls6_1vuyM7ws3y_iir_3YKUq_0 2024-09-12T01:10:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10634505908377532183', time=2024-09-12T02:54:41.466454+0000, chain.objs.size()=1 2024-09-12T01:10:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ghRy9rxBMTX3iNGEq-wkacVmh8TKo7n_0 2024-09-12T01:10:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6512800553385540744', time=2024-09-12T02:54:41.740043+0000, chain.objs.size()=1 2024-09-12T01:10:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9EcM_byNGUBjT5KMoY-8zKuOmTXCThM_0 2024-09-12T01:10:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16486286164070040511', time=2024-09-12T02:54:41.756297+0000, chain.objs.size()=1 2024-09-12T01:10:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.iDhyn9mwUSpzQP28Z0vEVxpY_rh47WU_0 2024-09-12T01:10:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4966458148500851648', time=2024-09-12T02:54:42.193805+0000, chain.objs.size()=1 2024-09-12T01:10:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.MviRL2avb4-eeFNSqREOzVP-pJ3G4Q1_0 2024-09-12T01:10:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17466060937576582167', time=2024-09-12T02:54:42.360785+0000, chain.objs.size()=1 2024-09-12T01:10:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.l9cSns-HiDEj479qoGBchcpB-J6W6sp_0 2024-09-12T01:10:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10871084322979058746', time=2024-09-12T02:54:42.631939+0000, chain.objs.size()=1 2024-09-12T01:10:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.o0BCMafoC0Sqjjb5ZwTskoshACR3D_z_0 2024-09-12T01:10:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5713702453417521158', time=2024-09-12T02:54:42.643093+0000, chain.objs.size()=1 2024-09-12T01:10:58.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.1mAkli5x5gg8UMwSCjGvcN81yFWlr2g_0 2024-09-12T01:10:58.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13553331718591931655', time=2024-09-12T02:54:42.742770+0000, chain.objs.size()=1 2024-09-12T01:10:58.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.LpRbsrVpbS_Gny1gMHvo3IoW2hrCe-Z_0 2024-09-12T01:10:58.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.959+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/44803 2024-09-12T01:10:58.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T01:10:58.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3658217902131712929', time=2024-09-12T02:54:43.323602+0000, chain.objs.size()=1 2024-09-12T01:10:58.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.a5basIuiXTDSqg8v9uZH5q4vCcHE2j0_0 2024-09-12T01:10:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3712121527168094560', time=2024-09-12T02:54:43.896999+0000, chain.objs.size()=1 2024-09-12T01:10:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.N2IYiSuAy51nmlnzb2V_ncR-bnRrz8q_0 2024-09-12T01:10:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11014635534821475797', time=2024-09-12T02:54:43.947052+0000, chain.objs.size()=1 2024-09-12T01:10:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.57Sv5wMMVPb9IAAInUM24hja8rbtD4r_0 2024-09-12T01:10:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10816282325488121395', time=2024-09-12T02:54:44.271251+0000, chain.objs.size()=1 2024-09-12T01:10:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.TetzprikGdKuiTmP3W5Ppw2YwxGA0DF_0 2024-09-12T01:10:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9522815522868743452', time=2024-09-12T02:54:44.300166+0000, chain.objs.size()=1 2024-09-12T01:10:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.h8Yrc9UozuFScBNYaepdtyCjwmDmibE_0 2024-09-12T01:10:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14295487740229961364', time=2024-09-12T02:54:44.305117+0000, chain.objs.size()=1 2024-09-12T01:10:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.w8C_4RXg7plqNMkv9D_J60m73H2R-o__0 2024-09-12T01:10:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11250982912734250002', time=2024-09-12T02:54:44.611837+0000, chain.objs.size()=1 2024-09-12T01:10:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.8og9aCBfSd9U7lcE-luTLtqI4EW4myH_0 2024-09-12T01:10:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3706251963897098863', time=2024-09-12T02:54:45.073470+0000, chain.objs.size()=1 2024-09-12T01:10:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.P3ZuGyMCtbra5cHjY9NiVWaRVCLIBpl_0 2024-09-12T01:10:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9279504438794087832', time=2024-09-12T02:54:45.659881+0000, chain.objs.size()=1 2024-09-12T01:10:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.wHArXGaaBNK1qArWPeAwG3BmzOONtEl_0 2024-09-12T01:10:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7120965702335910590', time=2024-09-12T02:54:45.730972+0000, chain.objs.size()=1 2024-09-12T01:10:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.wJFno31lWEc3s19ULb8mZQ4zBbnorJ1_0 2024-09-12T01:10:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14368879852420994460', time=2024-09-12T02:54:45.748012+0000, chain.objs.size()=1 2024-09-12T01:10:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.0myqj4XCoJwNSn25_iWxKUUyutEkeDM_0 2024-09-12T01:10:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17741414871617416183', time=2024-09-12T02:54:46.004350+0000, chain.objs.size()=1 2024-09-12T01:10:58.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.962+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.JgJI7w6Xsrjp1dhSIJolFVffNtY34Dc_0 2024-09-12T01:10:58.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.964+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3067371788133212728', time=2024-09-12T02:54:46.456539+0000, chain.objs.size()=1 2024-09-12T01:10:58.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.964+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.VTg9LxA2O29rao12rRPB9KSj4_jV4Ze_0 2024-09-12T01:10:58.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.965+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6813541479715627003', time=2024-09-12T02:54:46.533069+0000, chain.objs.size()=1 2024-09-12T01:10:58.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.965+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.LCiaGXfMhtH9wU3xegZvFpst95MU4Y5_0 2024-09-12T01:10:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.966+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10534969088427361718', time=2024-09-12T02:54:46.809641+0000, chain.objs.size()=1 2024-09-12T01:10:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.966+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.xu2vqeZsoHXL1m9bI2XBBsbRsfV5JVk_0 2024-09-12T01:10:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.966+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10831062009874198588', time=2024-09-12T02:54:46.984243+0000, chain.objs.size()=1 2024-09-12T01:10:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.966+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.k3TcbmFlUpi0P1e9Y-I1Axg630QBgYT_0 2024-09-12T01:10:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.966+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12104579143174108345', time=2024-09-12T02:55:12.010236+0000, chain.objs.size()=1 2024-09-12T01:10:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.966+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.375__shadow_.kQTDm8DVdja0drBaGD_BWF6bAdFnw0Q_0 2024-09-12T01:10:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.966+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11647569479400660070', time=2024-09-12T02:55:51.691140+0000, chain.objs.size()=1 2024-09-12T01:10:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.966+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.445__shadow_.S1an-YvG4yrjVHz6WVvCpfZSKFUQwoY_0 2024-09-12T01:10:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.966+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3215773986601696728', time=2024-09-12T02:56:00.493417+0000, chain.objs.size()=1 2024-09-12T01:10:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.966+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.459__shadow_.MHyQAFpPr7R8BbMrkqZqYe5RroC463m_0 2024-09-12T01:10:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.966+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9414667651306594889', time=2024-09-12T02:57:42.008477+0000, chain.objs.size()=6 2024-09-12T01:10:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.966+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~iji-T0IOjE1Q2uTfHpq-93C46ztjU9w.1 2024-09-12T01:10:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.966+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.aJvwnmnHB7IMmicVNoWgqcEmUiNea1w6.2 2024-09-12T01:10:58.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.966+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~iji-T0IOjE1Q2uTfHpq-93C46ztjU9w.3 2024-09-12T01:10:58.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.966+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~iji-T0IOjE1Q2uTfHpq-93C46ztjU9w.4 2024-09-12T01:10:58.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.968+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~iji-T0IOjE1Q2uTfHpq-93C46ztjU9w.5 2024-09-12T01:10:58.967 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.968+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~iji-T0IOjE1Q2uTfHpq-93C46ztjU9w.6 2024-09-12T01:10:58.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.969+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10936857127184899063', time=2024-09-12T02:58:26.509615+0000, chain.objs.size()=2 2024-09-12T01:10:58.968 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.969+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.526__multipart_mymultipart.2~wpKjxLl5O1AcT0lzgtAqp3iA7MLJc_8.1 2024-09-12T01:10:58.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.970+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.526__multipart_mymultipart.2~wpKjxLl5O1AcT0lzgtAqp3iA7MLJc_8.2 2024-09-12T01:10:58.969 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.970+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~XB7SmD0DgbjjrWnPah4M633VhJVNItO', time=2024-09-12T02:58:36.015749+0000, chain.objs.size()=4 2024-09-12T01:10:58.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.970+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.530__multipart_mymultipart.2~XB7SmD0DgbjjrWnPah4M633VhJVNItO.1 2024-09-12T01:10:58.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.970+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.530__shadow_mymultipart.2~XB7SmD0DgbjjrWnPah4M633VhJVNItO.1_1 2024-09-12T01:10:58.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.970+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.530__multipart_mymultipart.2~XB7SmD0DgbjjrWnPah4M633VhJVNItO.2 2024-09-12T01:10:58.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.971+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.530__shadow_mymultipart.2~XB7SmD0DgbjjrWnPah4M633VhJVNItO.2_1 2024-09-12T01:10:58.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.971+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~0pHfqqY4bxPXs7IWgNfebs0dL17Ik7D', time=2024-09-12T02:58:40.892135+0000, chain.objs.size()=1 2024-09-12T01:10:58.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.971+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.534__multipart_mymultipart.2~0pHfqqY4bxPXs7IWgNfebs0dL17Ik7D.1 2024-09-12T01:10:58.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.971+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16885909964249818328', time=2024-09-12T02:59:03.247219+0000, chain.objs.size()=1 2024-09-12T01:10:58.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.971+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.538__shadow_.-kci9exqNvZ9KAGoxin-EiRGZEtGAIG_0 2024-09-12T01:10:58.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.971+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5469987959235252229', time=2024-09-12T02:59:33.510040+0000, chain.objs.size()=1 2024-09-12T01:10:58.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.971+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.558__shadow_.IzCOlz5bwiiZrXqblmDKt-dmPYqEapf_0 2024-09-12T01:10:58.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.971+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3877651933698194625', time=2024-09-12T02:59:56.519538+0000, chain.objs.size()=1 2024-09-12T01:10:58.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.971+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:Ek5oA.G0KsNfhFzd61nm7mqutzWLGSE_.aGUuYCQ7VA6_BCrt29vaY3hnLWMfNfe_0 2024-09-12T01:10:58.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.971+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3454663133165807075', time=2024-09-12T03:00:21.502237+0000, chain.objs.size()=1 2024-09-12T01:10:58.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.971+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:ScXVAY6SIjm-SNYhwSwYwVtrsJZdSuO_.5zL3ETQtcS4s5M12sq_G2UNAi45NyIR_0 2024-09-12T01:10:58.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.972+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12698917080024385500', time=2024-09-12T03:00:50.446578+0000, chain.objs.size()=4 2024-09-12T01:10:58.971 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.972+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.579__multipart_testobj.2~1XZQhv60XRIt8lJBzhCR6xa_GkIRGV7.1 2024-09-12T01:10:58.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.974+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.579__multipart_testobj.2~1XZQhv60XRIt8lJBzhCR6xa_GkIRGV7.2 2024-09-12T01:10:58.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.974+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.579__multipart_testobj.2~1XZQhv60XRIt8lJBzhCR6xa_GkIRGV7.3 2024-09-12T01:10:58.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.974+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.579__multipart_testobj.2~1XZQhv60XRIt8lJBzhCR6xa_GkIRGV7.4 2024-09-12T01:10:58.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.974+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.484216265409151855', time=2024-09-12T03:01:00.293217+0000, chain.objs.size()=1 2024-09-12T01:10:58.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.974+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.588__shadow:dO1IBroDpQPZvDSTLBqYnT44wz-JQ21_.ZPDI1q8bsG4bgl-7jSsqeUVD1bT5_Oo_0 2024-09-12T01:10:58.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.974+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14400433050808850714', time=2024-09-12T03:04:51.004565+0000, chain.objs.size()=1 2024-09-12T01:10:58.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.974+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.629__shadow_.XMLH88dMBvc6KH2loHoRk8naJbpwscJ_0 2024-09-12T01:10:58.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.974+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1394772276025267767', time=2024-09-12T03:05:34.615619+0000, chain.objs.size()=1 2024-09-12T01:10:58.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.974+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.665__shadow_.0rbs_iWhaaG3YFR-_5qTYGTQxtrUDDG_0 2024-09-12T01:10:58.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.978+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.981+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:10:58.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.982+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:58.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.982+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:58.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47275' 2024-09-12T01:10:58.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2540475192473342777', time=2024-09-12T02:49:23.291061+0000, chain.objs.size()=3 2024-09-12T01:10:58.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__multipart_foo-STANDARD.2~jzcYDASeUgilRWCGw3EGUcbDW6BBcJM.1 2024-09-12T01:10:58.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__multipart_foo-STANDARD.2~jzcYDASeUgilRWCGw3EGUcbDW6BBcJM.2 2024-09-12T01:10:58.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__multipart_foo-STANDARD.2~jzcYDASeUgilRWCGw3EGUcbDW6BBcJM.3 2024-09-12T01:10:58.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1257323244702948985', time=2024-09-12T02:49:47.675546+0000, chain.objs.size()=1 2024-09-12T01:10:58.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.190__shadow_.TjLHOlOMDfl2YvwGvjSau4CZke-j_xN_0 2024-09-12T01:10:58.983 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7079953151002099472', time=2024-09-12T02:51:29.943093+0000, chain.objs.size()=1 2024-09-12T01:10:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.238__shadow_.r9WEQMtkPgq6EwoJSL0TH5B7WmJfaOP_0 2024-09-12T01:10:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14240466190882677493', time=2024-09-12T02:51:30.774931+0000, chain.objs.size()=1 2024-09-12T01:10:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.239__shadow_.IpZefebTVPvnEXSCmnVgvm8stgGmLp-_0 2024-09-12T01:10:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5036032803756400782', time=2024-09-12T02:51:34.650655+0000, chain.objs.size()=1 2024-09-12T01:10:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.245__shadow_.5qWQet1ahlht3jU5R2BRAZqZPc9xvfT_0 2024-09-12T01:10:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11674495643247190480', time=2024-09-12T02:52:21.741016+0000, chain.objs.size()=1 2024-09-12T01:10:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.LrEzwe6bGhAw8xt_BT2bMYJUmlnNf4d_0 2024-09-12T01:10:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8218440103000080969', time=2024-09-12T02:52:22.750628+0000, chain.objs.size()=1 2024-09-12T01:10:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1JVqE6klkhSM_PFt5_Q4pbvdZZjQYIM_0 2024-09-12T01:10:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4280761964638586590', time=2024-09-12T02:52:22.751236+0000, chain.objs.size()=1 2024-09-12T01:10:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.s6QVC3asel6W69ca_dCHR9VpQq37_a4_0 2024-09-12T01:10:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15848695326103215076', time=2024-09-12T02:52:23.132553+0000, chain.objs.size()=1 2024-09-12T01:10:58.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.s65Jqw5aaOwDRiYTUQVcxOCYg9bF8P3_0 2024-09-12T01:10:58.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8724426697202857058', time=2024-09-12T02:52:23.183861+0000, chain.objs.size()=1 2024-09-12T01:10:58.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.983+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.cck_MQ4M0Sdf4yRoKMIpsNuaefu5Gp4_0 2024-09-12T01:10:58.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.986+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12854022471374763873', time=2024-09-12T02:52:23.320669+0000, chain.objs.size()=1 2024-09-12T01:10:58.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.986+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.nqFI7Bxc2q7yFqdPgdIKA5sC1-aEMtl_0 2024-09-12T01:10:58.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.986+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4208855448163513411', time=2024-09-12T02:52:23.625307+0000, chain.objs.size()=1 2024-09-12T01:10:58.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.986+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.rIGgu0vekl3vDoNM_JxgEdeRssSatEN_0 2024-09-12T01:10:58.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.986+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2418511623708530509', time=2024-09-12T02:52:24.282233+0000, chain.objs.size()=1 2024-09-12T01:10:58.985 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.986+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.AhwNB3ueFDgbWLVtVJZZQw-jI1DMugb_0 2024-09-12T01:10:58.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14889679294859343421', time=2024-09-12T02:52:25.607084+0000, chain.objs.size()=1 2024-09-12T01:10:58.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.VXZ9bHo3qDovfpHo8QKIPEJR7SVvMVO_0 2024-09-12T01:10:58.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2455652343395370899', time=2024-09-12T02:52:25.607720+0000, chain.objs.size()=1 2024-09-12T01:10:58.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.qIFFOvGeU9tifeVpI2hb5A-n6WRYMxo_0 2024-09-12T01:10:58.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3026647480752721435', time=2024-09-12T02:52:25.875693+0000, chain.objs.size()=1 2024-09-12T01:10:58.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.U4YFyZa5mxN6Mj2cAIPAIUvyg4A8jr0_0 2024-09-12T01:10:58.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9310068348148193352', time=2024-09-12T02:52:25.876300+0000, chain.objs.size()=1 2024-09-12T01:10:58.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.RGFYZjCU7CoTi7n6cso-odXfoNKrwO9_0 2024-09-12T01:10:58.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8428260803690627248', time=2024-09-12T02:52:25.975890+0000, chain.objs.size()=1 2024-09-12T01:10:58.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.IQgePpxsOXfVn9vyy3n7i4xFCcr0vC2_0 2024-09-12T01:10:58.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12408279806168714942', time=2024-09-12T02:52:26.430994+0000, chain.objs.size()=1 2024-09-12T01:10:58.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.cXmtaHbET-Dujq-0fN7v9Z8_RS-4rdN_0 2024-09-12T01:10:58.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9122160039848755421', time=2024-09-12T02:52:27.047045+0000, chain.objs.size()=1 2024-09-12T01:10:58.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.FPezSO5AB1iaVd9sgMgiQBg4uQ76R5v_0 2024-09-12T01:10:58.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9747246641959644658', time=2024-09-12T02:52:27.222837+0000, chain.objs.size()=1 2024-09-12T01:10:58.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.988+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.9mssZTszwztm8b-4hyLgVQgTf7QdvNn_0 2024-09-12T01:10:58.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.990+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.392754435860330757', time=2024-09-12T02:52:27.504506+0000, chain.objs.size()=1 2024-09-12T01:10:58.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.990+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Ee_y9n_3ZmuVXM--B_HrHAhzFJVxCcS_0 2024-09-12T01:10:58.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.990+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15525409291471019919', time=2024-09-12T02:52:27.505137+0000, chain.objs.size()=1 2024-09-12T01:10:58.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.990+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5lyQWkh1QbioQfN2PdB9iaNPYP1UoWT_0 2024-09-12T01:10:58.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10587206330422130821', time=2024-09-12T02:52:27.589454+0000, chain.objs.size()=1 2024-09-12T01:10:58.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.rrx8-9e9-e6I1hKEwj_9-Z9YcOL7_aR_0 2024-09-12T01:10:58.992 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5732973132486210745', time=2024-09-12T02:52:27.590010+0000, chain.objs.size()=1 2024-09-12T01:10:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.kPiNIbr7Na75Srp4_CV1xAwBVPnla7J_0 2024-09-12T01:10:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6913071397599358332', time=2024-09-12T02:52:27.766934+0000, chain.objs.size()=1 2024-09-12T01:10:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.tx3wpiLEH74F1thOxjQMHDXvt-vsvzc_0 2024-09-12T01:10:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.636140330260767085', time=2024-09-12T02:52:27.892498+0000, chain.objs.size()=1 2024-09-12T01:10:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.M_ksFfc6Nbrjws4YU_vWEPHSLvYBAMJ_0 2024-09-12T01:10:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3676287832092045778', time=2024-09-12T02:52:28.591914+0000, chain.objs.size()=1 2024-09-12T01:10:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.yYUClURvmNMP8YFHs3lhhHaPhPCeKdZ_0 2024-09-12T01:10:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3225307958745908789', time=2024-09-12T02:52:29.485285+0000, chain.objs.size()=1 2024-09-12T01:10:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.aHXZaUVwnzf3iF6oPqes5WSBtRAbJHw_0 2024-09-12T01:10:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5904824017252457435', time=2024-09-12T02:52:30.230293+0000, chain.objs.size()=1 2024-09-12T01:10:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.MQLfzQbfiFVfZsDTg5A9FqEzsn0LaqX_0 2024-09-12T01:10:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9082049586882769172', time=2024-09-12T02:52:30.370352+0000, chain.objs.size()=1 2024-09-12T01:10:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.GN4mzQ2GDIFROaBDLqoGINg5f0okdyO_0 2024-09-12T01:10:58.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16567350180827378068', time=2024-09-12T02:52:30.703905+0000, chain.objs.size()=1 2024-09-12T01:10:58.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.huY-D8JjYqxolF8QJjnq0cmxVeU_eIk_0 2024-09-12T01:10:58.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6040736954385664005', time=2024-09-12T02:52:30.855973+0000, chain.objs.size()=1 2024-09-12T01:10:58.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.B1S6qzaMZ_lNw4tP_MvqBAyZy67DR3w_0 2024-09-12T01:10:58.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6270397559205007475', time=2024-09-12T02:52:30.865121+0000, chain.objs.size()=1 2024-09-12T01:10:58.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.993+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.lt5QYjz-_m7phqCJwsjHmUgv0bKaFNR_0 2024-09-12T01:10:58.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6577357268887271738', time=2024-09-12T02:52:31.123235+0000, chain.objs.size()=1 2024-09-12T01:10:58.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.82CTWnKt_Ba4r-XNsl3ocshPywVc-K5_0 2024-09-12T01:10:58.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6527894120732846129', time=2024-09-12T02:52:31.428743+0000, chain.objs.size()=1 2024-09-12T01:10:58.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.MLHJQdD7S1XJ7thPRVocYc4R4m9f3tn_0 2024-09-12T01:10:58.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2167112503167256741', time=2024-09-12T02:52:31.607608+0000, chain.objs.size()=1 2024-09-12T01:10:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5rH1C5ub1NhDNXr_k37BB18a41z1F56_0 2024-09-12T01:10:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17825803397318753817', time=2024-09-12T02:52:31.680591+0000, chain.objs.size()=1 2024-09-12T01:10:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.LYv1JMS9uS3ucUdt7eKW1PwTT_1QkFF_0 2024-09-12T01:10:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17547016157665969838', time=2024-09-12T02:52:31.709401+0000, chain.objs.size()=1 2024-09-12T01:10:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.7TOhymyil7axRiBUo6AFtXInLqd5TBj_0 2024-09-12T01:10:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11244029108696974176', time=2024-09-12T02:52:35.378318+0000, chain.objs.size()=1 2024-09-12T01:10:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.269__shadow_.wiyqLY2WwPYRZNEiC4Pr0xtwX4UgnEi_0 2024-09-12T01:10:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3588366580097786093', time=2024-09-12T02:52:39.979330+0000, chain.objs.size()=1 2024-09-12T01:10:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.277__shadow_.WX3ybsSr2qU_15uDpICAe9sxinHRr3-_0 2024-09-12T01:10:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3283394253234863792', time=2024-09-12T02:52:41.773993+0000, chain.objs.size()=1 2024-09-12T01:10:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.997+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.280__shadow_.Q8NrVcshRGhGdQNwBkSt__xR3IFoKbZ_0 2024-09-12T01:10:58.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.998+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8587009388757229992', time=2024-09-12T02:52:47.396199+0000, chain.objs.size()=1 2024-09-12T01:10:58.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.998+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.289__shadow_._Jvnj26By4Wfd8NBJ6hukHQcuf-1R_M_0 2024-09-12T01:10:58.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.998+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2771989811743895097', time=2024-09-12T02:52:53.880747+0000, chain.objs.size()=1 2024-09-12T01:10:58.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.998+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.295__shadow_.G6B0kGAmduoete66hnvhcGZvJfxY-Y-_0 2024-09-12T01:10:58.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.998+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.47394433050427178', time=2024-09-12T02:52:58.259213+0000, chain.objs.size()=1 2024-09-12T01:10:58.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:58.998+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.302__shadow_.8uZfacCajkZHixqKNgemAKF40PhGzAr_0 2024-09-12T01:10:58.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.000+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2967275447677481766', time=2024-09-12T02:53:10.013848+0000, chain.objs.size()=1 2024-09-12T01:10:58.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.000+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.320__shadow:JTewbn58r2UvDAgln9lpH3MqWKse8sw_.KXvdLzhwYvfEyg-fyfbncFB7BJTmDTi_0 2024-09-12T01:10:59.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.001+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15256206840265684146', time=2024-09-12T02:53:49.842781+0000, chain.objs.size()=1 2024-09-12T01:10:59.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.001+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nvmmiNijh_XSECoIiL-sgzYo4K7TzXz_0 2024-09-12T01:10:59.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.002+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17911458250349781450', time=2024-09-12T02:53:49.987415+0000, chain.objs.size()=1 2024-09-12T01:10:59.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.002+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.kBaTqE3ThSDw6le2v1wOmO-VabvLC4F_0 2024-09-12T01:10:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14555728592586856778', time=2024-09-12T02:53:49.988164+0000, chain.objs.size()=1 2024-09-12T01:10:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.NPmmU8-ohGHclcWam0YkZ0XPalDh9AJ_0 2024-09-12T01:10:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9696264798664760237', time=2024-09-12T02:53:50.268658+0000, chain.objs.size()=1 2024-09-12T01:10:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.NgnK94vIBXyYKX1ZiDqSXKp3uRBtvSY_0 2024-09-12T01:10:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.868586810107939207', time=2024-09-12T02:53:50.399014+0000, chain.objs.size()=1 2024-09-12T01:10:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ljj9wMsRGSMmu3xj1cj_vMkTKetqxnG_0 2024-09-12T01:10:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11929029848159972942', time=2024-09-12T02:53:51.220360+0000, chain.objs.size()=1 2024-09-12T01:10:59.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dM6pRxk3dss-it7hQSuiXkmhsbaY0iw_0 2024-09-12T01:10:59.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16575242025947594236', time=2024-09-12T02:53:51.309736+0000, chain.objs.size()=1 2024-09-12T01:10:59.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.pdCRkmeohIaXi4cI-wJTJPrL1lFSOve_0 2024-09-12T01:10:59.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1436673289099044010', time=2024-09-12T02:53:51.874124+0000, chain.objs.size()=1 2024-09-12T01:10:59.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lOeNv_g6sIxzHBPgE3071SZM-R-IpUI_0 2024-09-12T01:10:59.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8061106690667082913', time=2024-09-12T02:53:52.733867+0000, chain.objs.size()=1 2024-09-12T01:10:59.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.F08hCym4_yvE-r_fUsJHW9qssg4nR2T_0 2024-09-12T01:10:59.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16577043942037796500', time=2024-09-12T02:53:53.131576+0000, chain.objs.size()=1 2024-09-12T01:10:59.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5PhaNm0L1HkZYRUZTKXb4ok87n7TrnL_0 2024-09-12T01:10:59.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8552003645300882154', time=2024-09-12T02:53:53.998623+0000, chain.objs.size()=1 2024-09-12T01:10:59.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.K_6nEB-olGlZwvRt77GI8WtWnwgIaud_0 2024-09-12T01:10:59.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.005+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.576608014194200049', time=2024-09-12T02:53:54.130133+0000, chain.objs.size()=1 2024-09-12T01:10:59.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.005+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dU4mUTea2JU6o2fB75Hb4Rfr9WAHARi_0 2024-09-12T01:10:59.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.005+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1056643736176227002', time=2024-09-12T02:53:54.676866+0000, chain.objs.size()=1 2024-09-12T01:10:59.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.005+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.UicGi4b-wPKACm1-zHiF2HxgsIbncox_0 2024-09-12T01:10:59.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.006+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1199218468825095464', time=2024-09-12T02:53:55.133624+0000, chain.objs.size()=1 2024-09-12T01:10:59.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.006+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.OtHh0-_F3981lPS62ai9hXKj4mw2RrU_0 2024-09-12T01:10:59.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.006+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12360304789928284243', time=2024-09-12T02:53:55.698502+0000, chain.objs.size()=1 2024-09-12T01:10:59.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.006+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.H8b7WbO_ounCMEK3BEKtQ8zN8Maf5CQ_0 2024-09-12T01:10:59.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.009+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1563804596511790239', time=2024-09-12T02:53:55.858789+0000, chain.objs.size()=1 2024-09-12T01:10:59.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.009+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.8b7_kaRyKyj7SRfC8M5TyuBdIwpn5rj_0 2024-09-12T01:10:59.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.009+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5978398467264470208', time=2024-09-12T02:53:55.912842+0000, chain.objs.size()=1 2024-09-12T01:10:59.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.009+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.3JAh3zMgIN1xoBD2YvGesv-GkUEHBYx_0 2024-09-12T01:10:59.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.009+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10622996607334020849', time=2024-09-12T02:53:55.981118+0000, chain.objs.size()=1 2024-09-12T01:10:59.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.009+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Y0sLHIveQo8wM2TjADZL5REPFlHksIi_0 2024-09-12T01:10:59.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.009+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5465734207517684557', time=2024-09-12T02:53:56.015845+0000, chain.objs.size()=1 2024-09-12T01:10:59.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.009+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.k9kCTun2FtRYcBT_wtK82e7J88GRnz4_0 2024-09-12T01:10:59.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.009+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9695352057284673494', time=2024-09-12T02:53:56.524624+0000, chain.objs.size()=1 2024-09-12T01:10:59.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.009+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.sMDoYIQ77UAV9tm-0ltiGb1MxhikRAT_0 2024-09-12T01:10:59.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.009+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.987426933953698041', time=2024-09-12T02:53:56.560637+0000, chain.objs.size()=1 2024-09-12T01:10:59.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.009+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nAmaXt7f0_418Z5Q7hdB0tSkqv9u-V4_0 2024-09-12T01:10:59.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.009+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14744510370925597440', time=2024-09-12T02:53:56.885456+0000, chain.objs.size()=1 2024-09-12T01:10:59.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.009+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.zIG84zoTCBE53fR4Q557mRIqw6LbUbM_0 2024-09-12T01:10:59.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.010+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15189950131192733915', time=2024-09-12T02:53:57.013140+0000, chain.objs.size()=1 2024-09-12T01:10:59.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.010+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.U3HT4a2bfL3u239UBKZ5Fm_hG0d86kU_0 2024-09-12T01:10:59.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.010+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8539981759521711091', time=2024-09-12T02:53:57.888776+0000, chain.objs.size()=1 2024-09-12T01:10:59.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.010+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lwbp66n6WiwoUJqKtcxMd2h2wYTOtQa_0 2024-09-12T01:10:59.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.010+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12214997704405377248', time=2024-09-12T02:53:57.995524+0000, chain.objs.size()=1 2024-09-12T01:10:59.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.010+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.XJwM1XS5el7zfLSE2dU_T8fenSirNPM_0 2024-09-12T01:10:59.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.010+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15088954778327295433', time=2024-09-12T02:53:57.996122+0000, chain.objs.size()=1 2024-09-12T01:10:59.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.010+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bJXuOx5N9PPwZoGEsLQmv_G-flAUxZz_0 2024-09-12T01:10:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.012+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10774647795745557922', time=2024-09-12T02:53:58.271301+0000, chain.objs.size()=1 2024-09-12T01:10:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.012+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.7_6m2wNwK2iMBkzt3Dp4w-GWnBoQU1Q_0 2024-09-12T01:10:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.012+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16257450837232334000', time=2024-09-12T02:53:59.159221+0000, chain.objs.size()=1 2024-09-12T01:10:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.012+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.xwufRBa88WiAFA6QN8WvwhdIAKuhZPi_0 2024-09-12T01:10:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.012+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3828251589194517001', time=2024-09-12T02:53:59.237168+0000, chain.objs.size()=1 2024-09-12T01:10:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.012+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.vH44litxge-4JUKwtOL0CTofMzdHZoP_0 2024-09-12T01:10:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.012+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.725287216598632872', time=2024-09-12T02:53:59.356511+0000, chain.objs.size()=1 2024-09-12T01:10:59.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.012+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tfVHLKH35rhoPVY1XPBa4d2wfg_U8AN_0 2024-09-12T01:10:59.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.012+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.402525831359625592', time=2024-09-12T02:53:59.434687+0000, chain.objs.size()=1 2024-09-12T01:10:59.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.012+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.t74zWP0GELnoM3c_-fiGLOQEhjlt5NF_0 2024-09-12T01:10:59.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.012+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3758776496354986659', time=2024-09-12T02:53:59.652460+0000, chain.objs.size()=1 2024-09-12T01:10:59.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.012+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.h51LCbzIhEp0swmi4khqXmhuhwD9Xix_0 2024-09-12T01:10:59.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.013+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.696121944224627134', time=2024-09-12T02:54:37.225818+0000, chain.objs.size()=1 2024-09-12T01:10:59.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.013+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.JM2yH-pkOtDN06tdu8LM06UZJed4vK3_0 2024-09-12T01:10:59.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.014+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4969653603405111884', time=2024-09-12T02:54:37.357689+0000, chain.objs.size()=1 2024-09-12T01:10:59.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.014+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.HZKaX7MVnrtQqCEnUhvrNAjOyg7zAX8_0 2024-09-12T01:10:59.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.014+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9503960030800151426', time=2024-09-12T02:54:37.447807+0000, chain.objs.size()=1 2024-09-12T01:10:59.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.014+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.0KqlMf-xfGS4sSANGD9v-aIRTYn9oAa_0 2024-09-12T01:10:59.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.015+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11343572388328507265', time=2024-09-12T02:54:37.592135+0000, chain.objs.size()=1 2024-09-12T01:10:59.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.015+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.lG3DYjPaTmc6qKRYIFseyQRK4YvzVdS_0 2024-09-12T01:10:59.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.015+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12831711904482146629', time=2024-09-12T02:54:38.424679+0000, chain.objs.size()=1 2024-09-12T01:10:59.014 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.015+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.YovlWJOwvYJXRdZtL6jL93SPhuApARi_0 2024-09-12T01:10:59.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.016+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16705703851010574424', time=2024-09-12T02:54:38.875036+0000, chain.objs.size()=1 2024-09-12T01:10:59.015 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.016+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.sOvQLk8Ekm7OlysYOOnnkIMrfWEP5Eh_0 2024-09-12T01:10:59.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.017+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11573062320549348560', time=2024-09-12T02:54:39.085835+0000, chain.objs.size()=1 2024-09-12T01:10:59.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.017+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.xmh4n8f0GaQN1rF4ae9kHwF9zzqt7mn_0 2024-09-12T01:10:59.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.017+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10171881308314316774', time=2024-09-12T02:54:39.931765+0000, chain.objs.size()=1 2024-09-12T01:10:59.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.017+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.-rcB-4KoPORsaV9BtRxODKgW0hykDcK_0 2024-09-12T01:10:59.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.017+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18223527316732647610', time=2024-09-12T02:54:40.134915+0000, chain.objs.size()=1 2024-09-12T01:10:59.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.017+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.coMN38t1hURhk8YL-SqK9QyLpyTCqHL_0 2024-09-12T01:10:59.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.017+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14108298208922177958', time=2024-09-12T02:54:40.469948+0000, chain.objs.size()=1 2024-09-12T01:10:59.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.017+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.RClFt4B5Cs7tzFbBAV5X_PNeAzlIKpo_0 2024-09-12T01:10:59.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.017+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4694879513814142363', time=2024-09-12T02:54:40.931994+0000, chain.objs.size()=1 2024-09-12T01:10:59.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.017+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.SElKwckw67EgnwCSqqaZPp0Sie-uzdy_0 2024-09-12T01:10:59.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.017+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11786339661591750294', time=2024-09-12T02:54:41.375423+0000, chain.objs.size()=1 2024-09-12T01:10:59.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.017+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.RZB9C0okj4hAm8GgWhD3Atrlj8sWHs7_0 2024-09-12T01:10:59.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.017+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15627057551046718056', time=2024-09-12T02:54:41.608473+0000, chain.objs.size()=1 2024-09-12T01:10:59.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.017+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.3VwL51G3c19sKkeWcx1We6NFU00LQ6Z_0 2024-09-12T01:10:59.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.020+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9084646537705745602', time=2024-09-12T02:54:41.609084+0000, chain.objs.size()=1 2024-09-12T01:10:59.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.020+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.mKrA9z6VU5ScnftFeGR-DfXuJht0mB-_0 2024-09-12T01:10:59.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.020+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15603587439136935785', time=2024-09-12T02:54:42.731104+0000, chain.objs.size()=1 2024-09-12T01:10:59.019 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.020+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.1vFwFMWxdazOfOhVFeT-8kq6bFtpcqy_0 2024-09-12T01:10:59.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.020+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6905611361132762751', time=2024-09-12T02:54:42.901192+0000, chain.objs.size()=1 2024-09-12T01:10:59.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.020+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.0I7muVw2vfwXGSMsr1Hlmi528RNbFoN_0 2024-09-12T01:10:59.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.022+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10239294313236246643', time=2024-09-12T02:54:42.974011+0000, chain.objs.size()=1 2024-09-12T01:10:59.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.022+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.E5OQoFsolfmilBgQJUfQ8Lyoq-aylXs_0 2024-09-12T01:10:59.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.022+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2195321143546900516', time=2024-09-12T02:54:43.851809+0000, chain.objs.size()=1 2024-09-12T01:10:59.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.022+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.QTYOcWXpewRfCVRWgliTyEsjFhF6nSx_0 2024-09-12T01:10:59.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.022+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8548425724860926718', time=2024-09-12T02:54:43.976695+0000, chain.objs.size()=1 2024-09-12T01:10:59.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.022+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.12d4jfT_9e-jjoLqNGq8hwx1MBDs3BM_0 2024-09-12T01:10:59.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.022+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3057598964546116648', time=2024-09-12T02:54:44.186758+0000, chain.objs.size()=1 2024-09-12T01:10:59.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.022+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.0QSPZ46S2lcBw_7oLI4_rqzW0_CKpeT_0 2024-09-12T01:10:59.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.022+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4944156102890031908', time=2024-09-12T02:54:44.352781+0000, chain.objs.size()=1 2024-09-12T01:10:59.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.022+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.2pySgTiepIAXKBARYIsIeDgC2iQC3eL_0 2024-09-12T01:10:59.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.022+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16884420279692995899', time=2024-09-12T02:54:44.588612+0000, chain.objs.size()=1 2024-09-12T01:10:59.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.022+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.GC_lhVvg4sjN4JGCDMERn5UZa8StQmm_0 2024-09-12T01:10:59.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.026+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/47275 2024-09-12T01:10:59.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T01:10:59.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13841467392792273049', time=2024-09-12T02:54:45.124933+0000, chain.objs.size()=1 2024-09-12T01:10:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.bDeNGBugd_5-zkXlZ7_pUOIK1b_HAc9_0 2024-09-12T01:10:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14040190008711067958', time=2024-09-12T02:54:45.238338+0000, chain.objs.size()=1 2024-09-12T01:10:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.imaJv2sO6yZGnN_6hjVM2wt5CqKaaDs_0 2024-09-12T01:10:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1225256669151765845', time=2024-09-12T02:54:45.420228+0000, chain.objs.size()=1 2024-09-12T01:10:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ke0zIV02br2KeLPrgO3QPedwvXtQZ1H_0 2024-09-12T01:10:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9609560575979808289', time=2024-09-12T02:54:45.549388+0000, chain.objs.size()=1 2024-09-12T01:10:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.aepD0dL2QrVR3d0pdVc73Xy7OCJ4ePk_0 2024-09-12T01:10:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2952959410786724532', time=2024-09-12T02:54:45.814081+0000, chain.objs.size()=1 2024-09-12T01:10:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.7_Hxgfcema0M_NPa0bvkrFaSpQ_IWUX_0 2024-09-12T01:10:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11073369953537181624', time=2024-09-12T02:54:46.036378+0000, chain.objs.size()=1 2024-09-12T01:10:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.jNSKGaF7qNc5j4PLRXiovUCHVNRwzSt_0 2024-09-12T01:10:59.028 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5401976437347035836', time=2024-09-12T02:54:46.502345+0000, chain.objs.size()=1 2024-09-12T01:10:59.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.IAv1-UPBYIXoh39JB5P0tmCZuMpBvQN_0 2024-09-12T01:10:59.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.904292428256971069', time=2024-09-12T02:54:46.669030+0000, chain.objs.size()=1 2024-09-12T01:10:59.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.YDcWeQqYZnbnIADkieSuRvae9bDrcjG_0 2024-09-12T01:10:59.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8700494761025622619', time=2024-09-12T02:54:46.669787+0000, chain.objs.size()=1 2024-09-12T01:10:59.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.OSXYUKubBBZ3yqdv4a6usRxDBOSehN7_0 2024-09-12T01:10:59.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17033957094993386502', time=2024-09-12T02:54:46.863412+0000, chain.objs.size()=1 2024-09-12T01:10:59.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.SbnGKgwfDb4gtEnd_tYahj9OfmbdZyx_0 2024-09-12T01:10:59.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16120312177708002755', time=2024-09-12T02:54:46.864199+0000, chain.objs.size()=1 2024-09-12T01:10:59.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.opdSUxnwRKobO1PDNe3bdPuT6Jws8Of_0 2024-09-12T01:10:59.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.478296197222502504', time=2024-09-12T02:54:46.982003+0000, chain.objs.size()=1 2024-09-12T01:10:59.029 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.028+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.qH4BkZ0fREEyl8xwKqLFoWiTqK6GpVQ_0 2024-09-12T01:10:59.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.030+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.931551817601309842', time=2024-09-12T02:54:47.070826+0000, chain.objs.size()=1 2024-09-12T01:10:59.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.030+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.1rRXKUJKhSDubYs5R4C0ZvAFOff5b8o_0 2024-09-12T01:10:59.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.030+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8330688255159906753', time=2024-09-12T02:55:01.419825+0000, chain.objs.size()=1 2024-09-12T01:10:59.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.030+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.354__shadow_.X8rOA_8v5CyoqWWFXundPOeTX6weIFT_0 2024-09-12T01:10:59.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.032+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18168911363648455008', time=2024-09-12T02:56:06.321584+0000, chain.objs.size()=1 2024-09-12T01:10:59.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.032+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.466__shadow_.W3G1DcfkCCkQRzqvgvTYX33dyny_FYy_0 2024-09-12T01:10:59.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.032+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18143757897000963344', time=2024-09-12T02:56:41.073496+0000, chain.objs.size()=6 2024-09-12T01:10:59.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.032+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.1 2024-09-12T01:10:59.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.032+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.2 2024-09-12T01:10:59.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.032+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.3 2024-09-12T01:10:59.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.032+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.4 2024-09-12T01:10:59.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.032+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.5 2024-09-12T01:10:59.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.032+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.6 2024-09-12T01:10:59.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.032+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13722310890589742830', time=2024-09-12T02:59:21.310466+0000, chain.objs.size()=1 2024-09-12T01:10:59.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.032+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.552__shadow_.JhFUfw7pkXH3CMMoTeAsimbhhBDM5TK_0 2024-09-12T01:10:59.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.032+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13365370841628904738', time=2024-09-12T02:59:56.886735+0000, chain.objs.size()=1 2024-09-12T01:10:59.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.032+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:1HjU0SBefndYSyNQGl6-zerEJ8gBQFL_._Xa2v5_Kn8SyrRptvnn8HWM-y9a0Fx6_0 2024-09-12T01:10:59.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.033+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6547221687088535686', time=2024-09-12T02:59:59.219342+0000, chain.objs.size()=1 2024-09-12T01:10:59.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.033+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:hIL3r6Ei7.OrgMmM-bznqBqy1EO3Ypa_.o56r6rX7TA95dcTJ7G8hFKh8uT33lgT_0 2024-09-12T01:10:59.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.035+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2392613388871384856', time=2024-09-12T03:00:38.147391+0000, chain.objs.size()=1 2024-09-12T01:10:59.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.035+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:FI5OvsHhCy7tIbWayGhc8ZpItxlHZoO_.Pv1kI-gZGTYwLsY72frVMTSG8gLpNwT_0 2024-09-12T01:10:59.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.035+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17362106543836786925', time=2024-09-12T03:00:52.596035+0000, chain.objs.size()=1 2024-09-12T01:10:59.034 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.035+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.580__shadow:UnorCqz2NakbU8UOlhui7kpBZfJW17D_.GoY6ynz9BYKtY8wcuasoa5C9iNMIn8__0 2024-09-12T01:10:59.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.036+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.404107005878263986', time=2024-09-12T03:00:54.816844+0000, chain.objs.size()=1 2024-09-12T01:10:59.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.036+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.581__shadow:-gmMr83rYz.t5LsfNxRueg9nfitRab6_.Vuw0fDRA9HpUoJBk4KYKe2gClDrO1k5_0 2024-09-12T01:10:59.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.036+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.482295077143773165', time=2024-09-12T03:05:35.482701+0000, chain.objs.size()=1 2024-09-12T01:10:59.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.036+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.666__shadow_.9KnIrlPkCUDg4wfZshEGPgy2wR_BLq__0 2024-09-12T01:10:59.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.036+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12931892839275738973', time=2024-09-12T03:05:52.655761+0000, chain.objs.size()=1 2024-09-12T01:10:59.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.036+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.699__shadow:KMm5.ThWttxZsh6GiCZtmRAuBUKKMyp_.c1ivCNRCvrTC2vMTvCJ_dLnpqWxvTqP_0 2024-09-12T01:10:59.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.039+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.040 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.041+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:10:59.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.042+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.043+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47579' 2024-09-12T01:10:59.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3103479330319561229', time=2024-09-12T02:49:18.126910+0000, chain.objs.size()=1 2024-09-12T01:10:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.3uTa8KFJ_0gierz-3S1vg8WDWhEkIZI_0 2024-09-12T01:10:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15001979629132676652', time=2024-09-12T02:50:01.997908+0000, chain.objs.size()=1 2024-09-12T01:10:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.204__shadow_.FewbMneOO69-NnNudbr73TzGyvL4Srz_0 2024-09-12T01:10:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14405299377030670248', time=2024-09-12T02:51:38.908685+0000, chain.objs.size()=1 2024-09-12T01:10:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.252__shadow_.VZXD9AOcNsTsr7m-5HmSUGOKMyDCxWf_0 2024-09-12T01:10:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13571253357203466689', time=2024-09-12T02:51:39.538866+0000, chain.objs.size()=1 2024-09-12T01:10:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.253__shadow_.Eef7fZv9WV7VTh5LfsDzK3ck-DMfIdb_0 2024-09-12T01:10:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5249111558989412247', time=2024-09-12T02:51:42.523214+0000, chain.objs.size()=1 2024-09-12T01:10:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.258__shadow_.MqH5JM-BfthBZQgTij7EaGkY5B5LrlS_0 2024-09-12T01:10:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8366214692313641654', time=2024-09-12T02:51:43.676119+0000, chain.objs.size()=1 2024-09-12T01:10:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.260__shadow_.WQbcql-sihURMbg5qPd5SGuhFEcd1BZ_0 2024-09-12T01:10:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1856144788834280214', time=2024-09-12T02:52:21.220710+0000, chain.objs.size()=1 2024-09-12T01:10:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.hrGXVSnR4QzCexDd9wWaMWV5QpeyWNQ_0 2024-09-12T01:10:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18011180302951542236', time=2024-09-12T02:52:22.166421+0000, chain.objs.size()=1 2024-09-12T01:10:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.gv5NiAO7hJJrgWzoxvPvwMaGumXjuZU_0 2024-09-12T01:10:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3414716175851825881', time=2024-09-12T02:52:23.430277+0000, chain.objs.size()=1 2024-09-12T01:10:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vH3ILacgYHFP8fTB6qR1zSFwfsinZbr_0 2024-09-12T01:10:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12196773897447585137', time=2024-09-12T02:52:23.447149+0000, chain.objs.size()=1 2024-09-12T01:10:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.yj5SqJTOaCA7fEipigU0k6Il8mQZF39_0 2024-09-12T01:10:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2189715033483995212', time=2024-09-12T02:52:23.629903+0000, chain.objs.size()=1 2024-09-12T01:10:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.2V-2Zl6fDQfRtGcjl25YpxQuQuMFtVm_0 2024-09-12T01:10:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10159123602979896179', time=2024-09-12T02:52:23.683212+0000, chain.objs.size()=1 2024-09-12T01:10:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.okgN7vK7mxrZ-0H46YX7_rw-qELgl53_0 2024-09-12T01:10:59.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.046+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7425792441553122209', time=2024-09-12T02:52:24.203045+0000, chain.objs.size()=1 2024-09-12T01:10:59.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.046+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.-Z1Tcq-33YuMnbqxiEOVhnHlKRSPov3_0 2024-09-12T01:10:59.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.046+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16435902326636334800', time=2024-09-12T02:52:24.460140+0000, chain.objs.size()=1 2024-09-12T01:10:59.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.046+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.s5tmFkKrJHOsnKUDo31XcQ7bGaObVCQ_0 2024-09-12T01:10:59.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.046+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9082077991871277809', time=2024-09-12T02:52:25.168208+0000, chain.objs.size()=1 2024-09-12T01:10:59.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.046+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Dd9VNn5m3O_n3Cv2hlT2ndhIRYd5vPT_0 2024-09-12T01:10:59.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.046+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10068455498188539305', time=2024-09-12T02:52:25.185075+0000, chain.objs.size()=1 2024-09-12T01:10:59.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.046+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.3PM0wc5tICPoWIg2Vj23-zT1YnxlFNg_0 2024-09-12T01:10:59.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.047+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11991295683193324490', time=2024-09-12T02:52:25.966866+0000, chain.objs.size()=1 2024-09-12T01:10:59.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.047+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.eE-3__8PqZ0G_0DnEmcrk2-AcTbK2W0_0 2024-09-12T01:10:59.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.048+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4041866431408145827', time=2024-09-12T02:52:26.046740+0000, chain.objs.size()=1 2024-09-12T01:10:59.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.048+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.MEsKTPaWC_IQ2O5w0qooQeAcVG5bwr2_0 2024-09-12T01:10:59.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.048+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7598969319801661856', time=2024-09-12T02:52:26.262737+0000, chain.objs.size()=1 2024-09-12T01:10:59.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.048+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.cerQ1sPcKfpytRMi0X-lXUVUr2T-dSd_0 2024-09-12T01:10:59.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.048+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13443351382745620097', time=2024-09-12T02:52:26.390733+0000, chain.objs.size()=1 2024-09-12T01:10:59.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.048+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.EgPTP-5uWtsjEqAynNyKAEUS7YlA2VC_0 2024-09-12T01:10:59.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.048+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14021561945530467250', time=2024-09-12T02:52:27.325749+0000, chain.objs.size()=1 2024-09-12T01:10:59.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.048+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.OB85RO4yDhAqJ7Fp6MRvzxO-DOg3hZw_0 2024-09-12T01:10:59.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.048+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1464752312793846064', time=2024-09-12T02:52:27.504889+0000, chain.objs.size()=1 2024-09-12T01:10:59.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.048+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.MUiZuoBvKSRv-ACzyHc9eX_3YjhM8w-_0 2024-09-12T01:10:59.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.048+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8292151705276041846', time=2024-09-12T02:52:27.828803+0000, chain.objs.size()=1 2024-09-12T01:10:59.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.048+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Nf37C2FIASFv9miPzmqICJBD93HpDbk_0 2024-09-12T01:10:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.049+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8562052064063629889', time=2024-09-12T02:52:28.710985+0000, chain.objs.size()=1 2024-09-12T01:10:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.049+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vSgUkcHkUP1dIJh-FlyAR9S1yUvTP68_0 2024-09-12T01:10:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.049+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5328417389208271979', time=2024-09-12T02:52:28.950277+0000, chain.objs.size()=1 2024-09-12T01:10:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.049+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.jV6aHu6C-PC7dXo9ET-Mi-xW_OXYqfD_0 2024-09-12T01:10:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.050+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6930185288275454246', time=2024-09-12T02:52:29.573702+0000, chain.objs.size()=1 2024-09-12T01:10:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.050+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pX5neHJqyQPyDWiMXNqJXelCpZVvl8L_0 2024-09-12T01:10:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.050+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4528425959116726704', time=2024-09-12T02:52:30.117932+0000, chain.objs.size()=1 2024-09-12T01:10:59.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.050+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.tdneF90b229wqH2bN4bRaTEUVoRXBSW_0 2024-09-12T01:10:59.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.050+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11268204799060643639', time=2024-09-12T02:52:30.304379+0000, chain.objs.size()=1 2024-09-12T01:10:59.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.050+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.k1eQPT7cEFOkfsEt6OIdVAvAcOY9D4D_0 2024-09-12T01:10:59.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.050+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9766249504099323356', time=2024-09-12T02:52:30.304982+0000, chain.objs.size()=1 2024-09-12T01:10:59.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.050+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.eaFtZow_QeIyp4s9_YC-bjKv2jne2Qg_0 2024-09-12T01:10:59.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.051+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16252841330589705542', time=2024-09-12T02:52:30.305706+0000, chain.objs.size()=1 2024-09-12T01:10:59.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.051+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Yc-lff-G_8Bb1IWd4dSeK6Gk5VqpIXh_0 2024-09-12T01:10:59.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.052+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10621796407985780079', time=2024-09-12T02:52:30.838419+0000, chain.objs.size()=1 2024-09-12T01:10:59.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.052+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pW9TF9u1j0HFIV7yHKAkHAOXnDdVT_N_0 2024-09-12T01:10:59.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.053+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15181094034746565346', time=2024-09-12T02:52:31.224055+0000, chain.objs.size()=1 2024-09-12T01:10:59.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.053+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.JMYNRH_ya7v_kTHM2ZLRNZC-fgn_zlo_0 2024-09-12T01:10:59.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.053+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6545398770591403535', time=2024-09-12T02:52:31.298408+0000, chain.objs.size()=1 2024-09-12T01:10:59.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.053+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.7TSGEIKEdDBSK1qqywITG8a06eQibZz_0 2024-09-12T01:10:59.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.053+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4191121591286606409', time=2024-09-12T02:52:31.376383+0000, chain.objs.size()=1 2024-09-12T01:10:59.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.053+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.fXnz7Ski-FqgNRfxcSOx8TFjME7YS-7_0 2024-09-12T01:10:59.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.053+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8429124942840461695', time=2024-09-12T02:52:31.462466+0000, chain.objs.size()=1 2024-09-12T01:10:59.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.053+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.DL25N8QavTmXDU5H1bA6RJ2XMhTDXR4_0 2024-09-12T01:10:59.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.055+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5060862901933146547', time=2024-09-12T02:52:31.536703+0000, chain.objs.size()=1 2024-09-12T01:10:59.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.055+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.hFIlxvtgGFMcuhbJumA4trQgi_XEB4g_0 2024-09-12T01:10:59.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.055+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.232139239104861865', time=2024-09-12T02:52:31.608224+0000, chain.objs.size()=1 2024-09-12T01:10:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.055+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.tHbybmPK9SWD6NStrISs8rBtiEuynAX_0 2024-09-12T01:10:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.055+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8033822444004983859', time=2024-09-12T02:52:31.750870+0000, chain.objs.size()=1 2024-09-12T01:10:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.055+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.nCjVfCCxiQWe6AggMB0bW4a4kKIPRnM_0 2024-09-12T01:10:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.055+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7356008284743380207', time=2024-09-12T02:52:31.885468+0000, chain.objs.size()=1 2024-09-12T01:10:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.055+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.TuRbfaO0mn77WUqVZGRaaxcAn-riRVQ_0 2024-09-12T01:10:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.055+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11430782358107676590', time=2024-09-12T02:52:33.667471+0000, chain.objs.size()=1 2024-09-12T01:10:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.055+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.266__shadow_.eDgIOPOvTty3BSx6_sOx63HFtOAa7cN_0 2024-09-12T01:10:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.056+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9530359657600578966', time=2024-09-12T02:52:35.931027+0000, chain.objs.size()=1 2024-09-12T01:10:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.056+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.270__shadow_.I70Kd57msucVOD-q3QLSroZUNpOBX7r_0 2024-09-12T01:10:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.056+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7362788654496571300', time=2024-09-12T02:52:51.131673+0000, chain.objs.size()=1 2024-09-12T01:10:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.056+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.ZgUVvI1Zp4SFn2nNjsngI_xjxm4RKMW_0 2024-09-12T01:10:59.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.056+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2901888139130475832', time=2024-09-12T02:52:51.216539+0000, chain.objs.size()=1 2024-09-12T01:10:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.056+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.0iPVjx6CpDAIlXt8aXDASxNu9V1SJef_0 2024-09-12T01:10:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.057+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3249191902583019584', time=2024-09-12T02:52:53.226440+0000, chain.objs.size()=1 2024-09-12T01:10:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.057+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.x3cZkMkncv-VTCHmCXcrDDGV5cuv_Y4_0 2024-09-12T01:10:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.057+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3868862119853507901', time=2024-09-12T02:52:56.386165+0000, chain.objs.size()=1 2024-09-12T01:10:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.057+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.299__shadow_.oheNxjewFQnUjx36Ox1mQLYFeWdRPkt_0 2024-09-12T01:10:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.057+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7894406038125043716', time=2024-09-12T02:52:57.056636+0000, chain.objs.size()=1 2024-09-12T01:10:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.057+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.300__shadow_.fvRS0E-2KzyzaKTcKqDayDEjhPbwpSP_0 2024-09-12T01:10:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.058+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15276939443152840231', time=2024-09-12T02:53:49.558409+0000, chain.objs.size()=1 2024-09-12T01:10:59.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.058+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.QYX3KBzr7_ddC9XGwQ3YIUv8s70r_nn_0 2024-09-12T01:10:59.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.059+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.778469408185299618', time=2024-09-12T02:53:49.688893+0000, chain.objs.size()=1 2024-09-12T01:10:59.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.059+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.6SNhnwerxYSQs2kYGI1uHG09E65SRc8_0 2024-09-12T01:10:59.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.059+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16618342357894442325', time=2024-09-12T02:53:49.762781+0000, chain.objs.size()=1 2024-09-12T01:10:59.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.059+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.E2Ga_K89RaV3zEfhtDu5FLwQoqgIk07_0 2024-09-12T01:10:59.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.059+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8254011465863292630', time=2024-09-12T02:53:49.990220+0000, chain.objs.size()=1 2024-09-12T01:10:59.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.059+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Rk2B1xWicu2DcNnCXMURMHqVMAQtWgr_0 2024-09-12T01:10:59.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.059+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7796601402777866152', time=2024-09-12T02:53:50.117430+0000, chain.objs.size()=1 2024-09-12T01:10:59.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.059+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dC_Cezw5Xq4h0ddUje-zHmbW5pacSGN_0 2024-09-12T01:10:59.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.059+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10763131401508050329', time=2024-09-12T02:53:50.244596+0000, chain.objs.size()=1 2024-09-12T01:10:59.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.059+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ZEVz8Y0KuGfvecnlKoGuCkvXhanqmkl_0 2024-09-12T01:10:59.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.061+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13722446217478289078', time=2024-09-12T02:53:50.275930+0000, chain.objs.size()=1 2024-09-12T01:10:59.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.061+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.VL0puiZo1AQMDGPeVCj1NxYKh35Md5v_0 2024-09-12T01:10:59.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.061+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2663306433026251483', time=2024-09-12T02:53:50.348298+0000, chain.objs.size()=1 2024-09-12T01:10:59.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.061+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.PVbxOpIPagvdjZWeT2hjlHrWg29XdHm_0 2024-09-12T01:10:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.061+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13443969448408530280', time=2024-09-12T02:53:51.215511+0000, chain.objs.size()=1 2024-09-12T01:10:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.061+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.g57uIUMCIstjCEQuWBGG6Q5Uu7X_pwH_0 2024-09-12T01:10:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.061+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18162462486360206707', time=2024-09-12T02:53:51.782856+0000, chain.objs.size()=1 2024-09-12T01:10:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.061+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Ru85WUIeK7c6DxKaw817LgV2I1elQFs_0 2024-09-12T01:10:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.061+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1352749241975735258', time=2024-09-12T02:53:53.781666+0000, chain.objs.size()=1 2024-09-12T01:10:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.061+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qbby_yuhuQrT1GRiE3D3VkbqQLv0fDC_0 2024-09-12T01:10:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.061+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3619520768606457235', time=2024-09-12T02:53:53.997072+0000, chain.objs.size()=1 2024-09-12T01:10:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.061+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5HU39ss5tF7f4nfjkkqVaj4w7vLV3r9_0 2024-09-12T01:10:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.062+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.152103561529495588', time=2024-09-12T02:53:54.112043+0000, chain.objs.size()=1 2024-09-12T01:10:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.062+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.s7ZyHiJi7_bTmagrM0tbQyO6b-OXpy2_0 2024-09-12T01:10:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.062+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6779212673499607890', time=2024-09-12T02:53:54.463238+0000, chain.objs.size()=1 2024-09-12T01:10:59.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.062+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.X8m_2-ORQMqpnXGu81fhLAUuc4QI9WE_0 2024-09-12T01:10:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.063+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.559796792231966761', time=2024-09-12T02:53:54.571802+0000, chain.objs.size()=1 2024-09-12T01:10:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.063+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dv3Kt2axP4SxcvoqwFoXmM4ip4jaI2v_0 2024-09-12T01:10:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.063+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8775531854268753645', time=2024-09-12T02:53:54.659786+0000, chain.objs.size()=1 2024-09-12T01:10:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.063+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.sSxvqKNm2Lp_ZIAGY5L8ri-3RRRPAnO_0 2024-09-12T01:10:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.063+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13259682768625784501', time=2024-09-12T02:53:55.211823+0000, chain.objs.size()=1 2024-09-12T01:10:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.063+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.JxH-AaAFFThHIrTCbTSu4SPofll2IJC_0 2024-09-12T01:10:59.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.064+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17175368326929238705', time=2024-09-12T02:53:55.469650+0000, chain.objs.size()=1 2024-09-12T01:10:59.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.064+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.8zEwqW9_yyo8toYpRVF9o1fRjhAwHE1_0 2024-09-12T01:10:59.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.064+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7211487429201373272', time=2024-09-12T02:53:55.662323+0000, chain.objs.size()=1 2024-09-12T01:10:59.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.065+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.4Zh-HTkFadyUbH4K-4toRR_0gtIpyd0_0 2024-09-12T01:10:59.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.066+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12831071079609435552', time=2024-09-12T02:53:56.376103+0000, chain.objs.size()=1 2024-09-12T01:10:59.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.066+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5c_t7NqLEMpWOELjJPF4uDiXCzQ8uxZ_0 2024-09-12T01:10:59.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.066+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11520894440671710904', time=2024-09-12T02:53:56.376698+0000, chain.objs.size()=1 2024-09-12T01:10:59.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.066+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.TJJqs7-TvK_Oyz58G90f7qadGy3GJvN_0 2024-09-12T01:10:59.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.066+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13312817966460021442', time=2024-09-12T02:53:56.844032+0000, chain.objs.size()=1 2024-09-12T01:10:59.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.066+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.o1wI3VUrfXEBogpQfSw_81bmWLuSK35_0 2024-09-12T01:10:59.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.066+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17109270038964723090', time=2024-09-12T02:53:57.117645+0000, chain.objs.size()=1 2024-09-12T01:10:59.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.066+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.VizZC1Zrfa0Mr_wjxPwLdQrwhvll9hV_0 2024-09-12T01:10:59.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.066+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9136347518772360651', time=2024-09-12T02:53:57.410611+0000, chain.objs.size()=1 2024-09-12T01:10:59.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.066+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hfJ6hHXTLvKVnT6HiPJC3HgRziyptFG_0 2024-09-12T01:10:59.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.066+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.584719316680709193', time=2024-09-12T02:53:57.732210+0000, chain.objs.size()=1 2024-09-12T01:10:59.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.066+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ECln3c5vVOpkalhoSULqUMBvCep6Kgn_0 2024-09-12T01:10:59.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.069+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5022037446665822291', time=2024-09-12T02:53:57.884399+0000, chain.objs.size()=1 2024-09-12T01:10:59.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.069+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.xZSfgfv6uC209CWMPznLQAV4SYryFjq_0 2024-09-12T01:10:59.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.069+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8328424403132228765', time=2024-09-12T02:53:58.565960+0000, chain.objs.size()=1 2024-09-12T01:10:59.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.069+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.1Nolqn2ccbHw_t0y6e9TuNqEeS_u1fI_0 2024-09-12T01:10:59.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.069+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11264909219095262731', time=2024-09-12T02:53:58.963573+0000, chain.objs.size()=1 2024-09-12T01:10:59.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.069+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.99XCCbB0yIYBjrrdGEbNVhkdj9UlVRB_0 2024-09-12T01:10:59.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.069+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2333763198406257799', time=2024-09-12T02:53:59.162180+0000, chain.objs.size()=1 2024-09-12T01:10:59.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.069+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.BEEv3j3Ci6ENKCesPcXKRTmJrbg7Y-7_0 2024-09-12T01:10:59.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.069+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6378666214782634570', time=2024-09-12T02:53:59.543212+0000, chain.objs.size()=1 2024-09-12T01:10:59.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.069+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.neEyFHFJuZ6oLd5M23r_apNY3Ri770s_0 2024-09-12T01:10:59.069 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.069+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17124695629209583158', time=2024-09-12T02:54:36.638421+0000, chain.objs.size()=1 2024-09-12T01:10:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.069+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.s6Choqg5cIHXjw_e_znK-abDE36-iDy_0 2024-09-12T01:10:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.070+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14995707830436798631', time=2024-09-12T02:54:36.837551+0000, chain.objs.size()=1 2024-09-12T01:10:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.070+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.RhorX-K97EMV2SocIWZ2g2-stadHy1O_0 2024-09-12T01:10:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.070+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13535629586739200016', time=2024-09-12T02:54:37.095197+0000, chain.objs.size()=1 2024-09-12T01:10:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.070+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nwCtXH4f12mKyKNAXBXjkO-2DasNmzc_0 2024-09-12T01:10:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.070+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8478879352186343594', time=2024-09-12T02:54:37.095755+0000, chain.objs.size()=1 2024-09-12T01:10:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.070+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.P4w2sm2DSfqgaevO_G7swhiWDhXmM0P_0 2024-09-12T01:10:59.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.070+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13977823131633902307', time=2024-09-12T02:54:37.147228+0000, chain.objs.size()=1 2024-09-12T01:10:59.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.070+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.AFSdG-_G4llP01EaF6w6qFKcKuJ5jJS_0 2024-09-12T01:10:59.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.070+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14713335411792544882', time=2024-09-12T02:54:37.248604+0000, chain.objs.size()=1 2024-09-12T01:10:59.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.070+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.IP-QFAu1X10CT2Jbpa577lI-IfDv450_0 2024-09-12T01:10:59.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.071+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5562921163752033478', time=2024-09-12T02:54:37.519445+0000, chain.objs.size()=1 2024-09-12T01:10:59.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.071+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.lEMmtaz6xPjH49Er0pB1uI1Ug3CrG0S_0 2024-09-12T01:10:59.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.074+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15681165137086157427', time=2024-09-12T02:54:37.629713+0000, chain.objs.size()=1 2024-09-12T01:10:59.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.074+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fnd184D0n6b0-urN7KquAGzSOC7iWsc_0 2024-09-12T01:10:59.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.074+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.683055922250152523', time=2024-09-12T02:54:38.151722+0000, chain.objs.size()=1 2024-09-12T01:10:59.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.074+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.U2wWELOEizJSQ5yk9MhM8YAVMA2sjnf_0 2024-09-12T01:10:59.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.074+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16345859410766907516', time=2024-09-12T02:54:38.465821+0000, chain.objs.size()=1 2024-09-12T01:10:59.073 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.074+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.TQPN9GMHMrKCCTn5xit3WM0m0U5wr-g_0 2024-09-12T01:10:59.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.075+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3123920225335166800', time=2024-09-12T02:54:38.573287+0000, chain.objs.size()=1 2024-09-12T01:10:59.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.075+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6fX4hVg0gDXuUNXl6FPHo1Lywqo7y8C_0 2024-09-12T01:10:59.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.075+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15059223826416446800', time=2024-09-12T02:54:38.883132+0000, chain.objs.size()=1 2024-09-12T01:10:59.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.075+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Eb3zNRb5EOEaNp8rmFxd3zcnrEGaQgG_0 2024-09-12T01:10:59.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.075+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8535131086430693474', time=2024-09-12T02:54:39.807206+0000, chain.objs.size()=1 2024-09-12T01:10:59.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.075+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.hZ0GqmLuyoV30AWpzM1HIwrcfvD4IxN_0 2024-09-12T01:10:59.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.076+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3425843945522339070', time=2024-09-12T02:54:39.807863+0000, chain.objs.size()=1 2024-09-12T01:10:59.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.076+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.qb5gy0iBlJHqIQf5XWgDck5CWRFfOF4_0 2024-09-12T01:10:59.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.076+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4687764808305408706', time=2024-09-12T02:54:39.933565+0000, chain.objs.size()=1 2024-09-12T01:10:59.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.076+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.iisB4pT2dkhGnxlSINVkTiSIcquT924_0 2024-09-12T01:10:59.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.076+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4663623222396433336', time=2024-09-12T02:54:39.977167+0000, chain.objs.size()=1 2024-09-12T01:10:59.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.076+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.L5jk6uRSo_7bTUy_HrLrwu3uuegrCdw_0 2024-09-12T01:10:59.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.076+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4915755196794831043', time=2024-09-12T02:54:40.233676+0000, chain.objs.size()=1 2024-09-12T01:10:59.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.076+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.mtr9W6K9KHDwyLXUr80pRIAFj4P5k7z_0 2024-09-12T01:10:59.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.076+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14175420813800333190', time=2024-09-12T02:54:40.299199+0000, chain.objs.size()=1 2024-09-12T01:10:59.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.076+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._LYDOPDhdj7Y624OvijWMDjGA1cTbEd_0 2024-09-12T01:10:59.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.077+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8951569336265902244', time=2024-09-12T02:54:42.222170+0000, chain.objs.size()=1 2024-09-12T01:10:59.076 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.077+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Wi5t6p_63UCXSz2xX8aczcwNMZ96Nm2_0 2024-09-12T01:10:59.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.077+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15367451433251249011', time=2024-09-12T02:54:42.458413+0000, chain.objs.size()=1 2024-09-12T01:10:59.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.077+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.DXuL6RxiZSzWZ1L9zUoUDdbx6e1eFs6_0 2024-09-12T01:10:59.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.077+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9675770976352973222', time=2024-09-12T02:54:42.836738+0000, chain.objs.size()=1 2024-09-12T01:10:59.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.077+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.4ceBw7WLv-g-_LIJLWlyz33R3cSyCnm_0 2024-09-12T01:10:59.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.077+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16956926809942171343', time=2024-09-12T02:54:43.426612+0000, chain.objs.size()=1 2024-09-12T01:10:59.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.077+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ODf5LNL6tT6bbyoPl9Zn_o7qjPQ8xBx_0 2024-09-12T01:10:59.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.078+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5987040032710384983', time=2024-09-12T02:54:43.827037+0000, chain.objs.size()=1 2024-09-12T01:10:59.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.078+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.byuktrdpwU45u3yPVyoKsYAFvkO-cza_0 2024-09-12T01:10:59.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.079+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12240735574646178320', time=2024-09-12T02:54:44.464916+0000, chain.objs.size()=1 2024-09-12T01:10:59.078 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.079+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.vGZDN36Ai21m-hH3BJbuj8VAXnvlzvl_0 2024-09-12T01:10:59.082 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.083+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/47579 2024-09-12T01:10:59.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T01:10:59.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4889997515862351046', time=2024-09-12T02:54:44.526743+0000, chain.objs.size()=1 2024-09-12T01:10:59.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.WBiZttiXXH6FAMUyHs4MOtBkYljgdzI_0 2024-09-12T01:10:59.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16886817633233835085', time=2024-09-12T02:54:44.757738+0000, chain.objs.size()=1 2024-09-12T01:10:59.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.5W0MIFwPZCOzd2eCcUr-knGuXYRgAVV_0 2024-09-12T01:10:59.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17317568849034136493', time=2024-09-12T02:54:44.796485+0000, chain.objs.size()=1 2024-09-12T01:10:59.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.3LTTj3uEyLbPKb68cS0XC9hFTPdq-zU_0 2024-09-12T01:10:59.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10837384725805817239', time=2024-09-12T02:54:45.428626+0000, chain.objs.size()=1 2024-09-12T01:10:59.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.uFYo5Y9FV-XKtdTXztQkGuYdq8mw2IK_0 2024-09-12T01:10:59.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9608908854689798690', time=2024-09-12T02:54:45.632552+0000, chain.objs.size()=1 2024-09-12T01:10:59.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._lnon5K_H7ffIQ8mg-_GnaT1zq9nHNh_0 2024-09-12T01:10:59.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17292235005233595547', time=2024-09-12T02:54:45.874051+0000, chain.objs.size()=1 2024-09-12T01:10:59.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9s8CYodYtU8A55uDtT9sp8aLw3OnpZ6_0 2024-09-12T01:10:59.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5467608318278132581', time=2024-09-12T02:54:45.986359+0000, chain.objs.size()=1 2024-09-12T01:10:59.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ulgaMxBoO5aGjcIJ1-fGxff2zdp-7Jr_0 2024-09-12T01:10:59.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6359533499733047515', time=2024-09-12T02:54:46.307731+0000, chain.objs.size()=1 2024-09-12T01:10:59.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.2KRh_46KUaInMGQ9TLLFCOizP4xKqKI_0 2024-09-12T01:10:59.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14050276457559354676', time=2024-09-12T02:54:46.364367+0000, chain.objs.size()=1 2024-09-12T01:10:59.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nUcP4P4J7jtWcQJSxljn5hMWCPcZuY4_0 2024-09-12T01:10:59.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16573406900910369974', time=2024-09-12T02:54:46.864335+0000, chain.objs.size()=1 2024-09-12T01:10:59.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.mNcX3Yf8qJQCj_K7JDCh9SvV-R4kA3i_0 2024-09-12T01:10:59.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4095882085100675915', time=2024-09-12T02:56:03.808497+0000, chain.objs.size()=1 2024-09-12T01:10:59.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.463__shadow_.ClhWc0LGSJIgd1yGN4juMeWY2zsAzFC_0 2024-09-12T01:10:59.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.720266360539199558', time=2024-09-12T02:56:21.337436+0000, chain.objs.size()=1 2024-09-12T01:10:59.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.490__shadow_.rYZcVuf2dhNJU1gnAxgSBqB6UDfKtF1_0 2024-09-12T01:10:59.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.088+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9202299357943483931', time=2024-09-12T02:58:08.104217+0000, chain.objs.size()=6 2024-09-12T01:10:59.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.088+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.Yu0fgZjWo6QFOMNp0_TnX_qRBcm49JIK.1 2024-09-12T01:10:59.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.088+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.3s6wYy8GZm5ydCZhWzg9IZ36Zj1mUOYG.2 2024-09-12T01:10:59.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.088+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.0uEoolcodlVirCd8u26uSp0r91yVALo8.3 2024-09-12T01:10:59.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.088+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.Bfj-FVNqPTsRsNZ6Ysdvo9rBGhoXH7PP.4 2024-09-12T01:10:59.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.088+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.ayWThimWZxb8t-cG9whpw1PM5QSh4fh8.5 2024-09-12T01:10:59.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.088+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.tsAZ-u_uI6g-Juz-uXAAh8mtaQmVpxqD.6 2024-09-12T01:10:59.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.088+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8741719242736655754', time=2024-09-12T02:58:15.343130+0000, chain.objs.size()=4 2024-09-12T01:10:59.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.088+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.524__multipart_mymultipart.2~ft6ihNVqk3TiPSIJV4DQyZ5F8vbhgl9.1 2024-09-12T01:10:59.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.088+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.524__shadow_mymultipart.2~ft6ihNVqk3TiPSIJV4DQyZ5F8vbhgl9.1_1 2024-09-12T01:10:59.089 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.089+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.524__multipart_mymultipart.2~ft6ihNVqk3TiPSIJV4DQyZ5F8vbhgl9.2 2024-09-12T01:10:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.089+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.524__shadow_mymultipart.2~ft6ihNVqk3TiPSIJV4DQyZ5F8vbhgl9.2_1 2024-09-12T01:10:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.089+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8394457860205568763', time=2024-09-12T02:59:40.131143+0000, chain.objs.size()=1 2024-09-12T01:10:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.089+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.559__shadow_.Srs5UFLXeQbXlXwOenpktQEsMOc6WA1_0 2024-09-12T01:10:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.091+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6036346329579223925', time=2024-09-12T03:00:04.517616+0000, chain.objs.size()=1 2024-09-12T01:10:59.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.091+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.572__shadow_.o5nUF_IoAZtqbfO80ErJe56xjS_T7_G_0 2024-09-12T01:10:59.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.092+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6593403989278205226', time=2024-09-12T03:00:07.553517+0000, chain.objs.size()=1 2024-09-12T01:10:59.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.092+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.575__shadow_.38YNA5t5vcY6DhjWe6ixWU1jZaAl_iY_0 2024-09-12T01:10:59.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.092+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4841173839655351124', time=2024-09-12T03:00:19.620271+0000, chain.objs.size()=1 2024-09-12T01:10:59.091 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.092+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:dfwnhDlgfVWG7zqA-lYQhqTB5bhGYkN_.7zWqtZjn638lXWhr1LSCdmu7owybQaa_0 2024-09-12T01:10:59.092 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.093+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2548435229322943507', time=2024-09-12T03:00:30.904661+0000, chain.objs.size()=1 2024-09-12T01:10:59.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.093+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:SMGChzMFnvAB8FrqEJ-NIRGz67jh85-_.lfjNsCvfF2Bb2lc4IQpzUh9GR7pmHFh_0 2024-09-12T01:10:59.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.093+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10082592830829083338', time=2024-09-12T03:00:34.562178+0000, chain.objs.size()=1 2024-09-12T01:10:59.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.093+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:uh19uyDNcuMgkCJ1NAzMvK2HVs5yE8a_.fjrBZQ-EyuuxFtxdQe6YGAUzfGiHyDg_0 2024-09-12T01:10:59.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.094+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14547807872175549572', time=2024-09-12T03:00:54.624645+0000, chain.objs.size()=1 2024-09-12T01:10:59.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.094+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.581__shadow:vhn4Imu.J.ZHMkQvM3lrOfQJ10EtQ8h_.ZAG0In-Pi5LY8nVo2YJpTml6dtN5_-A_0 2024-09-12T01:10:59.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.094+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16996081429783964145', time=2024-09-12T03:04:53.427181+0000, chain.objs.size()=1 2024-09-12T01:10:59.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.094+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.633__shadow_.p0Ucnqtyy5dCXxKttP_qVApU5sUH2lU_0 2024-09-12T01:10:59.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.094+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2986876017175776207', time=2024-09-12T03:04:57.192953+0000, chain.objs.size()=1 2024-09-12T01:10:59.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.094+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.640__shadow_.NvdD8OeVUwy-NEz598HcQhWZ9rgNJKD_0 2024-09-12T01:10:59.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.094+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10922954426148882516', time=2024-09-12T03:05:12.699074+0000, chain.objs.size()=1 2024-09-12T01:10:59.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.094+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.652__shadow_.HCzh94ZApKApLpcofx5Ugds7HQk3fqJ_0 2024-09-12T01:10:59.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.094+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.591805316550887599', time=2024-09-12T03:05:36.471646+0000, chain.objs.size()=1 2024-09-12T01:10:59.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.094+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.667__shadow_.y53UbUSDgK3YrJgLplBUGVMdmctd3qe_0 2024-09-12T01:10:59.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.094+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10428788932875406543', time=2024-09-12T03:06:31.896733+0000, chain.objs.size()=1 2024-09-12T01:10:59.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.094+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.735__shadow_.ldnWtv6M8unAxALe0_O9RAiY1dM9UBC_0 2024-09-12T01:10:59.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.100+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.102+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:10:59.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.104+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.104+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47921' 2024-09-12T01:10:59.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7004858704464353369', time=2024-09-12T02:49:17.082733+0000, chain.objs.size()=3 2024-09-12T01:10:59.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.160__multipart_mymultipart-STANDARD.2~cFxdnh7CbW9erJpRnySVZP1ZJazY_ty.1 2024-09-12T01:10:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.160__multipart_mymultipart-STANDARD.2~cFxdnh7CbW9erJpRnySVZP1ZJazY_ty.2 2024-09-12T01:10:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.160__multipart_mymultipart-STANDARD.2~cFxdnh7CbW9erJpRnySVZP1ZJazY_ty.3 2024-09-12T01:10:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3245106351690949490', time=2024-09-12T02:51:29.951632+0000, chain.objs.size()=1 2024-09-12T01:10:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.238__shadow_.LY09iub_3DTi-bb8wouqETfTkd9uSO3_0 2024-09-12T01:10:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1871679684704714335', time=2024-09-12T02:51:39.533925+0000, chain.objs.size()=1 2024-09-12T01:10:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.253__shadow_.VKcslW6K6rGtRMxJE6DnFCntICy2CQI_0 2024-09-12T01:10:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3053192774656393224', time=2024-09-12T02:51:40.727142+0000, chain.objs.size()=1 2024-09-12T01:10:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.255__shadow_._SultiQFrsB0CPFF41SEloeATRjbtFI_0 2024-09-12T01:10:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15699164253219035795', time=2024-09-12T02:51:44.274745+0000, chain.objs.size()=1 2024-09-12T01:10:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.261__shadow_.7ACze1QWtxmORWdjCIoUBTA0RAv7CoZ_0 2024-09-12T01:10:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3355020997645904231', time=2024-09-12T02:52:21.127881+0000, chain.objs.size()=1 2024-09-12T01:10:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vDYvyaTXWM7OcRpuAJQswVz4nrw7epu_0 2024-09-12T01:10:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17610476138243801955', time=2024-09-12T02:52:21.200849+0000, chain.objs.size()=1 2024-09-12T01:10:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ZcTLQmR_s7BktFQpd-fq52DFfrmvYlf_0 2024-09-12T01:10:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15609183245492667595', time=2024-09-12T02:52:21.839173+0000, chain.objs.size()=1 2024-09-12T01:10:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.mPZMBkv3pTd7ZWnh28aHhbWgWRw6tp0_0 2024-09-12T01:10:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.693237801723569655', time=2024-09-12T02:52:22.055875+0000, chain.objs.size()=1 2024-09-12T01:10:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.zFscSlswU92VrTHZWApvDzXjNMrV40A_0 2024-09-12T01:10:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8039695950086828070', time=2024-09-12T02:52:22.883516+0000, chain.objs.size()=1 2024-09-12T01:10:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.105+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.QTvEuOK2geDdJV8oKgGkX5DtYTMstNP_0 2024-09-12T01:10:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.107+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5245997964654919918', time=2024-09-12T02:52:23.158161+0000, chain.objs.size()=1 2024-09-12T01:10:59.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.107+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.PZQAitdDOIIQkfhfMFq-HaqxpHgzHj2_0 2024-09-12T01:10:59.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.108+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7251746555771221164', time=2024-09-12T02:52:23.181929+0000, chain.objs.size()=1 2024-09-12T01:10:59.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.108+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ATCy8ki-xd7vOkGkLuaGl0MCEQvNwm2_0 2024-09-12T01:10:59.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.108+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1397751705268942115', time=2024-09-12T02:52:23.749750+0000, chain.objs.size()=1 2024-09-12T01:10:59.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.108+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.3bVWXDNpTR6VTdaYEgGJOrHl_4gpunu_0 2024-09-12T01:10:59.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.110+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17073277300005108322', time=2024-09-12T02:52:24.344445+0000, chain.objs.size()=1 2024-09-12T01:10:59.109 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.110+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1wbK4tpJKg0VEj9hwlD_Omqodaw8RGz_0 2024-09-12T01:10:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4625467561782931127', time=2024-09-12T02:52:24.434320+0000, chain.objs.size()=1 2024-09-12T01:10:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.QPhKh-utXWXSoWmNDzWHihYyOSR_fWe_0 2024-09-12T01:10:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17432506178571393245', time=2024-09-12T02:52:24.673505+0000, chain.objs.size()=1 2024-09-12T01:10:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4Efc86u4DXZiIUGK5OSGh3i2f5ZvDeJ_0 2024-09-12T01:10:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8165174367203291164', time=2024-09-12T02:52:25.020557+0000, chain.objs.size()=1 2024-09-12T01:10:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.FVG6MtzGhFnfZ5a-bVFOnmpVmNekcH5_0 2024-09-12T01:10:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16347835156281294671', time=2024-09-12T02:52:25.145034+0000, chain.objs.size()=1 2024-09-12T01:10:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.2kmGHTcYycfk5VUbqC_vFSHIXut_pzN_0 2024-09-12T01:10:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3562855326989805105', time=2024-09-12T02:52:25.604274+0000, chain.objs.size()=1 2024-09-12T01:10:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4SxhRCVf6RglPlXi4qE0381uRFAU6R3_0 2024-09-12T01:10:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1500400350013231637', time=2024-09-12T02:52:25.748775+0000, chain.objs.size()=1 2024-09-12T01:10:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.D2JwtbR8vu5iQUROzhQ6b3v5D8_e8c8_0 2024-09-12T01:10:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.318877559802006547', time=2024-09-12T02:52:25.749485+0000, chain.objs.size()=1 2024-09-12T01:10:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.9M1QsyYQ8alKTfeAsPQdMoiarBpRRdd_0 2024-09-12T01:10:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17517380262715172797', time=2024-09-12T02:52:25.750106+0000, chain.objs.size()=1 2024-09-12T01:10:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.RgkiRlzkMOA2_yFFv-6zG7IW_5P9-Ax_0 2024-09-12T01:10:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8192516699457642962', time=2024-09-12T02:52:26.043240+0000, chain.objs.size()=1 2024-09-12T01:10:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KCw-Y6gPI-OPdIghfEg6EFO6laPQuad_0 2024-09-12T01:10:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12629856444034798699', time=2024-09-12T02:52:27.221063+0000, chain.objs.size()=1 2024-09-12T01:10:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vR9ukgWGkwL7Coln1d3LNGZ-hDTR5oq_0 2024-09-12T01:10:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7992160162114066267', time=2024-09-12T02:52:28.425850+0000, chain.objs.size()=1 2024-09-12T01:10:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.112+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.E6Xq9mZjEy5tVCE1BqQHKyNCya1eD7D_0 2024-09-12T01:10:59.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.116+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3497335034477247146', time=2024-09-12T02:52:28.438239+0000, chain.objs.size()=1 2024-09-12T01:10:59.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.116+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.FuLFcds3usjYq9qxlVuvhiDQgzeo-eu_0 2024-09-12T01:10:59.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.116+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3535522993497562475', time=2024-09-12T02:52:28.449368+0000, chain.objs.size()=1 2024-09-12T01:10:59.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.116+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.eCAXPYFTugdAwxMd-ZKkkxZtJcSsFiy_0 2024-09-12T01:10:59.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.116+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15993457161261071759', time=2024-09-12T02:52:28.587540+0000, chain.objs.size()=1 2024-09-12T01:10:59.115 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.116+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.k6FDb7sjejdSBZKkvFMkOxaXOGG1v-l_0 2024-09-12T01:10:59.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9279025028645426047', time=2024-09-12T02:52:29.147115+0000, chain.objs.size()=1 2024-09-12T01:10:59.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vdsr4CNtROG4GOf7kW7_L2x9wcRi0vg_0 2024-09-12T01:10:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13258434153879814040', time=2024-09-12T02:52:29.312914+0000, chain.objs.size()=1 2024-09-12T01:10:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.tugMDwXziSXrpvC7ZtoqOQ05cxIgv3o_0 2024-09-12T01:10:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2471834347724841575', time=2024-09-12T02:52:29.485087+0000, chain.objs.size()=1 2024-09-12T01:10:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.U15zWPgi7oGfU5vqz0In5dJ6sh4XGfS_0 2024-09-12T01:10:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.195326273084658788', time=2024-09-12T02:52:30.304913+0000, chain.objs.size()=1 2024-09-12T01:10:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.EpyvMi3qk6X0KihGGWobctyKKNYq04e_0 2024-09-12T01:10:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5316640990648401511', time=2024-09-12T02:52:30.631332+0000, chain.objs.size()=1 2024-09-12T01:10:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Y4O3hM_-9VX405GDZ20Ccm7vGWGB78a_0 2024-09-12T01:10:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12161120323972031730', time=2024-09-12T02:52:31.224242+0000, chain.objs.size()=1 2024-09-12T01:10:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Mi8uV754AKSioaRI7b7NXZ38IYh_QA1_0 2024-09-12T01:10:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6509909392852986055', time=2024-09-12T02:52:31.554316+0000, chain.objs.size()=1 2024-09-12T01:10:59.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.fXg_BmXfYFPHrS90KHMGjb4qjcH-5lx_0 2024-09-12T01:10:59.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9199362960313886797', time=2024-09-12T02:52:31.554881+0000, chain.objs.size()=1 2024-09-12T01:10:59.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.HbN7A_xfFsaS0wg9fcVe5nV3t6bwtt4_0 2024-09-12T01:10:59.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.120+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8540859180961847343', time=2024-09-12T02:52:31.855966+0000, chain.objs.size()=1 2024-09-12T01:10:59.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.120+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uh-e_s9clq_H8dJ0S342acVOEqWSJ8S_0 2024-09-12T01:10:59.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.120+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11676322347935138529', time=2024-09-12T02:52:31.945415+0000, chain.objs.size()=1 2024-09-12T01:10:59.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.120+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.h-nIgJM0Ame8RKHwR6-8qCoS0aEISeB_0 2024-09-12T01:10:59.119 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.120+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2715723876079049528', time=2024-09-12T02:52:34.218997+0000, chain.objs.size()=1 2024-09-12T01:10:59.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.120+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.267__shadow_.C12nwSqEm-VKvufxChpIu352lklBCt3_0 2024-09-12T01:10:59.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.120+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10699818801738823955', time=2024-09-12T02:52:53.174293+0000, chain.objs.size()=1 2024-09-12T01:10:59.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.120+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.CZyKZ68hH788PUa3QcXEsthEljx_ajS_0 2024-09-12T01:10:59.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.121+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11086385644543539274', time=2024-09-12T02:52:55.077956+0000, chain.objs.size()=1 2024-09-12T01:10:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.121+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.297__shadow_.XZ22fYGiVkIo6zZ5r2637JqQZIbPG3Z_0 2024-09-12T01:10:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.121+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11163428601994927586', time=2024-09-12T02:53:49.443803+0000, chain.objs.size()=1 2024-09-12T01:10:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.121+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.eUj6Fw4SfKlQhtaRdVyEKxaDBnQxwIA_0 2024-09-12T01:10:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.121+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11109318527002479994', time=2024-09-12T02:53:49.572026+0000, chain.objs.size()=1 2024-09-12T01:10:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.121+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lgZqtUAsspk2sgoMkPqekpML2XyJkpc_0 2024-09-12T01:10:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.121+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13903135902722089488', time=2024-09-12T02:53:49.637080+0000, chain.objs.size()=1 2024-09-12T01:10:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.121+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ME7rDbbG7l_CiPDld6LZEOXu0uuDu6e_0 2024-09-12T01:10:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.121+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17651698025774287866', time=2024-09-12T02:53:49.836570+0000, chain.objs.size()=1 2024-09-12T01:10:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.121+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ZWRzIBrHuJTQ1avfdO5dnApOF3Nuv3P_0 2024-09-12T01:10:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.121+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14734376080062218788', time=2024-09-12T02:53:49.951975+0000, chain.objs.size()=1 2024-09-12T01:10:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.121+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.oDgGf1lm4v4q-DW6KYWCJ2ekit-03Xr_0 2024-09-12T01:10:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.121+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16284718797250980696', time=2024-09-12T02:53:50.110897+0000, chain.objs.size()=1 2024-09-12T01:10:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.121+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bZDjuf4x20E4LTlGt1ZNDBnxOKsXRZp_0 2024-09-12T01:10:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.124+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4328920710280290510', time=2024-09-12T02:53:50.995053+0000, chain.objs.size()=1 2024-09-12T01:10:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.124+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.rKK8LY_00nDx1MoInn2XDIF8o5ZBUGx_0 2024-09-12T01:10:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.124+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15815756826713055364', time=2024-09-12T02:53:50.995748+0000, chain.objs.size()=1 2024-09-12T01:10:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.124+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0YeN90a_O3_Omarlv3IfLSVvqpDPlio_0 2024-09-12T01:10:59.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.125+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13934940446710482121', time=2024-09-12T02:53:51.117376+0000, chain.objs.size()=1 2024-09-12T01:10:59.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.125+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.re08mIFCqzIKuoNiKYxleFKWbiHJJIY_0 2024-09-12T01:10:59.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.125+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10875430893961205984', time=2024-09-12T02:53:51.276310+0000, chain.objs.size()=1 2024-09-12T01:10:59.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.125+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.n7ee3wcCCfAEax3NzAN0P24JzKTLtcT_0 2024-09-12T01:10:59.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.125+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18258513814289952468', time=2024-09-12T02:53:52.811444+0000, chain.objs.size()=1 2024-09-12T01:10:59.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.125+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.UKioMq7Qx6tcLMv3XLWzhJWCBMaMnuc_0 2024-09-12T01:10:59.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.126+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10786593163936088142', time=2024-09-12T02:53:52.881298+0000, chain.objs.size()=1 2024-09-12T01:10:59.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.127+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.CFq7LYoSaDjj3ZjTw9iXZeTZ3ELylB9_0 2024-09-12T01:10:59.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.127+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10307495405726968417', time=2024-09-12T02:53:53.233366+0000, chain.objs.size()=1 2024-09-12T01:10:59.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.127+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.29IbIbCCmj3rFUilvv9AlXnApSPBe3o_0 2024-09-12T01:10:59.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.127+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7038847110383550646', time=2024-09-12T02:53:53.275893+0000, chain.objs.size()=1 2024-09-12T01:10:59.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.127+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.sm18BrxZhXLpuSPLwFP9oDnOAHGGrt9_0 2024-09-12T01:10:59.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.127+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9355015176147164338', time=2024-09-12T02:53:53.282364+0000, chain.objs.size()=1 2024-09-12T01:10:59.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.127+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.gkH7SuZAshv1xl47i2BMB7ojMyInrQx_0 2024-09-12T01:10:59.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.127+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18206421511395757241', time=2024-09-12T02:53:53.697482+0000, chain.objs.size()=1 2024-09-12T01:10:59.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.127+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.TIdzoVAW_-5LW1ecMnpwri-cLJyr7pD_0 2024-09-12T01:10:59.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.127+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8591435097278570733', time=2024-09-12T02:53:53.774472+0000, chain.objs.size()=1 2024-09-12T01:10:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.127+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.v8E_wWw89LGSAe-MFx5DyKwy74ldFIU_0 2024-09-12T01:10:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.127+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14529365101776551869', time=2024-09-12T02:53:54.127201+0000, chain.objs.size()=1 2024-09-12T01:10:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.127+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.8wb_snOQYysv-qV_Xt3DbDNmdFAAHA6_0 2024-09-12T01:10:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.127+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11705298754086787470', time=2024-09-12T02:53:54.369202+0000, chain.objs.size()=1 2024-09-12T01:10:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.127+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.EeJgKfWiaYFHjKUX7Sq3eICv1RUni7K_0 2024-09-12T01:10:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.129+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10441853303422032797', time=2024-09-12T02:53:54.378790+0000, chain.objs.size()=1 2024-09-12T01:10:59.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.129+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dsZImuTbGuf88yYUZkQPCJBDRFaudIP_0 2024-09-12T01:10:59.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.129+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8480281627032227564', time=2024-09-12T02:53:54.595329+0000, chain.objs.size()=1 2024-09-12T01:10:59.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.129+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.pwZUQeReyO3Hg13NtN8J6JmXg0nSQrS_0 2024-09-12T01:10:59.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.129+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9354284821980567691', time=2024-09-12T02:53:54.689785+0000, chain.objs.size()=1 2024-09-12T01:10:59.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.129+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.sUFQujF4PkJr4WKO5HmJTn8znz2GvWb_0 2024-09-12T01:10:59.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.130+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5538131453616307284', time=2024-09-12T02:53:55.052596+0000, chain.objs.size()=1 2024-09-12T01:10:59.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.130+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Q9QEb2li0Dvx86Ya3TXSfOVAQcjDncO_0 2024-09-12T01:10:59.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.130+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17403159843991693718', time=2024-09-12T02:53:55.199791+0000, chain.objs.size()=1 2024-09-12T01:10:59.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.130+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5TYU5-bw5AITEyHklvADWYsR7_AtbHM_0 2024-09-12T01:10:59.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.130+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5603179985376817044', time=2024-09-12T02:53:55.214159+0000, chain.objs.size()=1 2024-09-12T01:10:59.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.130+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bdFEQmz2KcgSBS5PuDMNp99X_9AQIkH_0 2024-09-12T01:10:59.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.130+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11170436488683611764', time=2024-09-12T02:53:55.327336+0000, chain.objs.size()=1 2024-09-12T01:10:59.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.130+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.sKbLkCoz7jxMfTvrdngjNyz4pMzkD7n_0 2024-09-12T01:10:59.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.131+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11424067862930898078', time=2024-09-12T02:53:55.335534+0000, chain.objs.size()=1 2024-09-12T01:10:59.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.131+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cOLKfLbUDvoDOpyLzFgYrBCpM4U3Dtw_0 2024-09-12T01:10:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.131+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14227088637459953919', time=2024-09-12T02:53:55.628054+0000, chain.objs.size()=1 2024-09-12T01:10:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.131+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_._5nB0pYxg6DhWWOyd2bHY-lWtKk-ceE_0 2024-09-12T01:10:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.131+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1845799295596333112', time=2024-09-12T02:53:55.895026+0000, chain.objs.size()=1 2024-09-12T01:10:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.131+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.iJhGSCSWc0lK7JCDN8Onz528Upa9yOa_0 2024-09-12T01:10:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.131+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14971033730987959692', time=2024-09-12T02:53:55.973757+0000, chain.objs.size()=1 2024-09-12T01:10:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.131+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lB_HC6Sugh3DITfuo6CQBtDxtyaJFtZ_0 2024-09-12T01:10:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.132+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7760639446089744686', time=2024-09-12T02:53:56.019639+0000, chain.objs.size()=1 2024-09-12T01:10:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.132+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.9bnpCPWurYCtTWZv232vpG_VKOBltMe_0 2024-09-12T01:10:59.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.132+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3808819534056786276', time=2024-09-12T02:53:56.560320+0000, chain.objs.size()=1 2024-09-12T01:10:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.132+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hMDx3n7NEwxF5PvDi3hjPoefGG9HjQh_0 2024-09-12T01:10:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.133+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14998610142939205749', time=2024-09-12T02:53:56.928429+0000, chain.objs.size()=1 2024-09-12T01:10:59.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.133+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.CuzTATsxAySnGX7-NXdoReRSLPJDgPu_0 2024-09-12T01:10:59.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.134+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7579686898200495265', time=2024-09-12T02:53:57.185311+0000, chain.objs.size()=1 2024-09-12T01:10:59.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.134+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.1G50Z5KfhHVImjmbeIQqi5ZEmX4vmOc_0 2024-09-12T01:10:59.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.135+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3854824834964085038', time=2024-09-12T02:53:57.711704+0000, chain.objs.size()=1 2024-09-12T01:10:59.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.135+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.pQ8ZHRUS3iPkZjBG_vDSGx4P8PsqR2w_0 2024-09-12T01:10:59.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13125427530042358527', time=2024-09-12T02:53:57.973772+0000, chain.objs.size()=1 2024-09-12T01:10:59.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cqwSZk1EvAxaLAvvFRazyluKSBxKBlG_0 2024-09-12T01:10:59.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4214464429434541182', time=2024-09-12T02:53:58.343339+0000, chain.objs.size()=1 2024-09-12T01:10:59.135 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.9lRdZ33AQkvowUC6oVLpCdmfLqYuiEz_0 2024-09-12T01:10:59.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15563933473899775999', time=2024-09-12T02:53:58.649755+0000, chain.objs.size()=1 2024-09-12T01:10:59.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.WK6sGigr348rSJP_TmRU0GAh5D2eJmL_0 2024-09-12T01:10:59.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6307027706364112597', time=2024-09-12T02:53:59.008114+0000, chain.objs.size()=1 2024-09-12T01:10:59.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.8kgcOi3Q8Tec8z2CJvSI2ML6zc7b9cX_0 2024-09-12T01:10:59.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9380896087098155640', time=2024-09-12T02:53:59.092983+0000, chain.objs.size()=1 2024-09-12T01:10:59.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.r-ZUngCoN_0grytArABiAzGCjgZF6mM_0 2024-09-12T01:10:59.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12995678423872254950', time=2024-09-12T02:54:36.636189+0000, chain.objs.size()=1 2024-09-12T01:10:59.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._5r07J2qm0jeaH-XLP5RXN-cpx50nHq_0 2024-09-12T01:10:59.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4916322158389461185', time=2024-09-12T02:54:38.081960+0000, chain.objs.size()=1 2024-09-12T01:10:59.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.t44AS8HxDyW5IgDJWwmp-D7uA3LKRuV_0 2024-09-12T01:10:59.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8631141425019276018', time=2024-09-12T02:54:39.002737+0000, chain.objs.size()=1 2024-09-12T01:10:59.136 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.136+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.t_bc2vJwSYLXeatQhP1BDntsUX17Kgq_0 2024-09-12T01:10:59.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.137+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12507499128914394816', time=2024-09-12T02:54:39.063498+0000, chain.objs.size()=1 2024-09-12T01:10:59.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.137+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nm_46MUSnIBBQdMu7zKDoWcqgH3clnG_0 2024-09-12T01:10:59.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.137+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6253902191609401427', time=2024-09-12T02:54:39.974908+0000, chain.objs.size()=1 2024-09-12T01:10:59.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.137+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.yqyRWfQj8GP-dU_TEe6T1CpFEPWK4bv_0 2024-09-12T01:10:59.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.139+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13136701286793666656', time=2024-09-12T02:54:40.023433+0000, chain.objs.size()=1 2024-09-12T01:10:59.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.139+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6hhign0y8AygdVKu1Onbt0kBKYxghdM_0 2024-09-12T01:10:59.138 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.139+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3016010889533352471', time=2024-09-12T02:54:40.108955+0000, chain.objs.size()=1 2024-09-12T01:10:59.139 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.139+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.w1DWd_nVyLaUaXAF35b_3D9zroQsnaW_0 2024-09-12T01:10:59.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.140+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11294630077753982264', time=2024-09-12T02:54:40.406593+0000, chain.objs.size()=1 2024-09-12T01:10:59.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.140+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.05zpRl68YkfTLQT95-j5gBbI25FiVLZ_0 2024-09-12T01:10:59.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.140+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.497120217671939009', time=2024-09-12T02:54:40.407301+0000, chain.objs.size()=1 2024-09-12T01:10:59.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.140+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.qnD4MYaLXOO_1Hbq4AZYDi_8VLWknXB_0 2024-09-12T01:10:59.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.140+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11966501559944167381', time=2024-09-12T02:54:41.433715+0000, chain.objs.size()=1 2024-09-12T01:10:59.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.140+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.idFG1dR9xXlL4l-pvWP_09mCH--EGxp_0 2024-09-12T01:10:59.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.141+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16488519912436368345', time=2024-09-12T02:54:41.434259+0000, chain.objs.size()=1 2024-09-12T01:10:59.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.M-jnlOhRZxxnbgZz7MAjVwgG_y3YIwf_0 2024-09-12T01:10:59.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.141+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5099438304395223936', time=2024-09-12T02:54:41.798482+0000, chain.objs.size()=1 2024-09-12T01:10:59.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.gr1E4qf686W7iBdWP8HYRMUE_JrEpIW_0 2024-09-12T01:10:59.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.141+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15245619083206616402', time=2024-09-12T02:54:42.249544+0000, chain.objs.size()=1 2024-09-12T01:10:59.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.4U1r9wZY4KIg5DgIgoos_71hLyLYjxD_0 2024-09-12T01:10:59.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.141+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16580819256424407596', time=2024-09-12T02:54:42.309784+0000, chain.objs.size()=1 2024-09-12T01:10:59.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.T4SBQiimlUXcOrjyI0P22f5OboGksnb_0 2024-09-12T01:10:59.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.141+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17501857515254818103', time=2024-09-12T02:54:42.650794+0000, chain.objs.size()=1 2024-09-12T01:10:59.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.70RzkhLLAX5HSosGrGOauwM8QgmBoX2_0 2024-09-12T01:10:59.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.141+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17678638290108792674', time=2024-09-12T02:54:42.818146+0000, chain.objs.size()=1 2024-09-12T01:10:59.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.j3ir2ziYp3mQmba-WFUZhd8J1ws5s45_0 2024-09-12T01:10:59.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.141+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11268360958851084440', time=2024-09-12T02:54:44.447959+0000, chain.objs.size()=1 2024-09-12T01:10:59.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Dj8ZGOVefApnITGt37RY8yg05kuQUn6_0 2024-09-12T01:10:59.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.143+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12374638414847734741', time=2024-09-12T02:54:44.786278+0000, chain.objs.size()=1 2024-09-12T01:10:59.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.143+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.-Ac6Sxo5u9vJqnEEZPKTo-gUmI7crRn_0 2024-09-12T01:10:59.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.143+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3240199613805605402', time=2024-09-12T02:54:45.290462+0000, chain.objs.size()=1 2024-09-12T01:10:59.142 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.143+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Q8LyYOFP37lNtpSFREzveQKfA1vTDYb_0 2024-09-12T01:10:59.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.146+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/47921 2024-09-12T01:10:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T01:10:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6961306332262133786', time=2024-09-12T02:54:45.632675+0000, chain.objs.size()=1 2024-09-12T01:10:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.1K3Bx6IzQoqj6_AxtyVUm90q_yAGufA_0 2024-09-12T01:10:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15113151151267827739', time=2024-09-12T02:54:45.730318+0000, chain.objs.size()=1 2024-09-12T01:10:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.FZYQcNiDGVaGaK2lc4tHhaka-EOCFLL_0 2024-09-12T01:10:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18090865867085537758', time=2024-09-12T02:54:45.855824+0000, chain.objs.size()=1 2024-09-12T01:10:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fizPo2JPJ-cDW_DTGSx5ShmWGYkjkni_0 2024-09-12T01:10:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6595756440732072635', time=2024-09-12T02:54:46.533496+0000, chain.objs.size()=1 2024-09-12T01:10:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.C5vRL0ej9poWCGbFY8ClgYRhbLBMia5_0 2024-09-12T01:10:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11029368843935253649', time=2024-09-12T02:56:01.304927+0000, chain.objs.size()=1 2024-09-12T01:10:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.460__shadow_.IJAj0ETvjDcgD6QSfC4xAOQX7R7Kt5r_0 2024-09-12T01:10:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11069864567072526716', time=2024-09-12T02:56:12.231111+0000, chain.objs.size()=1 2024-09-12T01:10:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.482__shadow_.iol6VInm01UvpcS5TwCIw8r_EN1imiq_0 2024-09-12T01:10:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17803284722599704090', time=2024-09-12T02:56:20.109456+0000, chain.objs.size()=1 2024-09-12T01:10:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.488__shadow_.bF49oQ8hiY8PxwJe-srRAoCecTTmwIA_0 2024-09-12T01:10:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2987451624607230127', time=2024-09-12T02:56:20.791166+0000, chain.objs.size()=1 2024-09-12T01:10:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.148+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.489__shadow_.bjbMPWsPgMg9pUasZ80kydtY4qzegJd_0 2024-09-12T01:10:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.149+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5794240981108976909', time=2024-09-12T02:56:24.161641+0000, chain.objs.size()=1 2024-09-12T01:10:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.149+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.496__shadow_.b9C5e6YEY3hvTMiXng7ZSXEZMPB34d2_0 2024-09-12T01:10:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.149+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8822094029961071614', time=2024-09-12T02:56:51.997295+0000, chain.objs.size()=2 2024-09-12T01:10:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.149+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.518__shadow_.f-gzFGZckd29jH6aWOOIEGCBSPc0fuD_0 2024-09-12T01:10:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.149+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.518__shadow_.f-gzFGZckd29jH6aWOOIEGCBSPc0fuD_1 2024-09-12T01:10:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.149+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.742384779828784627', time=2024-09-12T02:58:24.218689+0000, chain.objs.size()=5 2024-09-12T01:10:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.149+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.526__multipart_mymultipart.2~b26gfhmKmKX4ozs5Qianm9cl7BGO7-9.1 2024-09-12T01:10:59.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.151+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.526__shadow_mymultipart.2~b26gfhmKmKX4ozs5Qianm9cl7BGO7-9.1_1 2024-09-12T01:10:59.150 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.151+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.526__multipart_mymultipart.2~b26gfhmKmKX4ozs5Qianm9cl7BGO7-9.2 2024-09-12T01:10:59.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.152+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.526__shadow_mymultipart.2~b26gfhmKmKX4ozs5Qianm9cl7BGO7-9.2_1 2024-09-12T01:10:59.151 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.152+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.526__multipart_mymultipart.2~b26gfhmKmKX4ozs5Qianm9cl7BGO7-9.3 2024-09-12T01:10:59.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.153+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13663626740564640827', time=2024-09-12T02:59:40.939826+0000, chain.objs.size()=1 2024-09-12T01:10:59.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.153+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.560__shadow_.xpj9Ksxg3mqN2SVSjgb71LLaEC61xFD_0 2024-09-12T01:10:59.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.153+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11752544859280909132', time=2024-09-12T02:59:42.327596+0000, chain.objs.size()=1 2024-09-12T01:10:59.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.153+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.562__multipart_mymultipart.2~DEb7tO0aNQb5YT-BqwQPNdU7R2q4OFt.1 2024-09-12T01:10:59.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.153+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6494643439201817001', time=2024-09-12T02:59:57.428912+0000, chain.objs.size()=1 2024-09-12T01:10:59.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.153+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:NqB7MO3j6d.dOQ9QgNyQ3JopIqPCw-r_.x6sMnVlkvxMoP3J5PZhBf8Cp9g_p9dr_0 2024-09-12T01:10:59.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.153+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13751019701004910735', time=2024-09-12T03:00:13.191997+0000, chain.objs.size()=1 2024-09-12T01:10:59.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.153+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.577__shadow:O2DFzloBM2mR9r07UypMtkCZh5c2WRF_.fpRD0epIcclU6YW463t7hs0G_1cDkK-_0 2024-09-12T01:10:59.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.153+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9139700172857297746', time=2024-09-12T03:00:17.128296+0000, chain.objs.size()=1 2024-09-12T01:10:59.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.153+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.577__shadow:nMUYtthqYpuqQEuVfCaAMgxeuKvOPfD_.qPfCbBGUTB7hXOBwrKmH3rL6sqxPmph_0 2024-09-12T01:10:59.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.153+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15677679331530632973', time=2024-09-12T03:00:33.394894+0000, chain.objs.size()=1 2024-09-12T01:10:59.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.153+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:LkCKvPTmi9.dqYO-xaqnvgPTcruLoMc_.7Ts3Tr7LGSJw8hiJXaCrIHy8BJ6mPUc_0 2024-09-12T01:10:59.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.153+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11928727005498573623', time=2024-09-12T03:00:59.117348+0000, chain.objs.size()=1 2024-09-12T01:10:59.153 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.153+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.587__shadow:CJcZUhGXeeyAdJ781CIzL7RpFP3rArg_.hsX_9TmHqM27obTfbZU64UvbX-1WSsi_0 2024-09-12T01:10:59.157 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.158+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.160+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:10:59.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.162+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.161 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.162+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44810' 2024-09-12T01:10:59.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12456240343961074709', time=2024-09-12T02:49:25.130281+0000, chain.objs.size()=5 2024-09-12T01:10:59.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__multipart_foo-LUKEWARM.2~6n_9xM4JLCBgChXmEjNmTtsjfCboYRy.1 2024-09-12T01:10:59.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_foo-LUKEWARM.2~6n_9xM4JLCBgChXmEjNmTtsjfCboYRy.1_1 2024-09-12T01:10:59.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__multipart_foo-LUKEWARM.2~6n_9xM4JLCBgChXmEjNmTtsjfCboYRy.2 2024-09-12T01:10:59.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_foo-LUKEWARM.2~6n_9xM4JLCBgChXmEjNmTtsjfCboYRy.2_1 2024-09-12T01:10:59.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__multipart_foo-LUKEWARM.2~6n_9xM4JLCBgChXmEjNmTtsjfCboYRy.3 2024-09-12T01:10:59.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15859812686839032574', time=2024-09-12T02:49:57.123949+0000, chain.objs.size()=1 2024-09-12T01:10:59.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.198__shadow_.pvdzYelE2Vd_riF5wN2-JH5WFFvjnXP_0 2024-09-12T01:10:59.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5972227708464922643', time=2024-09-12T02:51:33.809174+0000, chain.objs.size()=1 2024-09-12T01:10:59.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.244__shadow_.NsEKhhtPSJ58O74qEkkzdCk30wuWY8c_0 2024-09-12T01:10:59.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5747222302655346112', time=2024-09-12T02:51:35.884211+0000, chain.objs.size()=1 2024-09-12T01:10:59.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.247__shadow_.paGK5zZG2ajTEA3LaPccVkoMkaUj2XK_0 2024-09-12T01:10:59.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15908242928078006566', time=2024-09-12T02:52:21.408802+0000, chain.objs.size()=1 2024-09-12T01:10:59.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.PD3OBeTjX2O1x_2BHoBLMIZHWduPZMs_0 2024-09-12T01:10:59.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15376422633574214733', time=2024-09-12T02:52:21.424290+0000, chain.objs.size()=1 2024-09-12T01:10:59.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.d0jMxdrfvd--j6t2q34d06oZtQzkNUX_0 2024-09-12T01:10:59.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6424612268299952321', time=2024-09-12T02:52:21.531746+0000, chain.objs.size()=1 2024-09-12T01:10:59.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vXy3g3mdSCEOul1gvzYDKLXfangdKAc_0 2024-09-12T01:10:59.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13686241260376391591', time=2024-09-12T02:52:22.229351+0000, chain.objs.size()=1 2024-09-12T01:10:59.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.W4nBOiKFPNywcmiJ7WjTAOlQj5Q-kKp_0 2024-09-12T01:10:59.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15625310217975529693', time=2024-09-12T02:52:22.763376+0000, chain.objs.size()=1 2024-09-12T01:10:59.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1jGU055pmlubHC3vr4Jz8CqhCElFCrr_0 2024-09-12T01:10:59.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14362270494571393922', time=2024-09-12T02:52:22.926602+0000, chain.objs.size()=1 2024-09-12T01:10:59.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.DnzPLx4VV3p4nZ_TT720-5Fr5qNrppo_0 2024-09-12T01:10:59.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14967474714994508821', time=2024-09-12T02:52:23.313652+0000, chain.objs.size()=1 2024-09-12T01:10:59.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.OKpfXpZOuSOlbjJAdxAJwd_6Oba7Jcz_0 2024-09-12T01:10:59.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3912243593969677744', time=2024-09-12T02:52:23.617153+0000, chain.objs.size()=1 2024-09-12T01:10:59.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.YZHTaRtezYHVR5njAXfLBNmPMSWcJTN_0 2024-09-12T01:10:59.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16437378739640357689', time=2024-09-12T02:52:23.704515+0000, chain.objs.size()=1 2024-09-12T01:10:59.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.oKNb24-Tgh_WGINiu97esySn6L_0Cdp_0 2024-09-12T01:10:59.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15050220909659290721', time=2024-09-12T02:52:24.169041+0000, chain.objs.size()=1 2024-09-12T01:10:59.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KVvcWje6EGAKPKTREZhl1Pn49HlVeJB_0 2024-09-12T01:10:59.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9173141561018555086', time=2024-09-12T02:52:24.169770+0000, chain.objs.size()=1 2024-09-12T01:10:59.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.my1dqtKYwThZfvV02X0DH3zawBSkGNk_0 2024-09-12T01:10:59.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17149990665529454747', time=2024-09-12T02:52:24.669439+0000, chain.objs.size()=1 2024-09-12T01:10:59.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ZeH6foMnzbk6-RLaVw79w_qPHfNROpv_0 2024-09-12T01:10:59.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.167+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4641784411960846579', time=2024-09-12T02:52:24.854092+0000, chain.objs.size()=1 2024-09-12T01:10:59.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.167+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.m_vn2COGIWaxWVY7XfCcu-b_XaZimlV_0 2024-09-12T01:10:59.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.167+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3600791440041978506', time=2024-09-12T02:52:24.854675+0000, chain.objs.size()=1 2024-09-12T01:10:59.166 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.167+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.BIbh3E961JsJoJVhXVtS1gxSGMxqMeU_0 2024-09-12T01:10:59.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.167+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3420547818559822504', time=2024-09-12T02:52:25.184513+0000, chain.objs.size()=1 2024-09-12T01:10:59.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.167+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.61iGBWso_AK9sBXgQfQkbzibQ8Whbv3_0 2024-09-12T01:10:59.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18233664264054086623', time=2024-09-12T02:52:25.860909+0000, chain.objs.size()=1 2024-09-12T01:10:59.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.d_OZDJUKGx0uhUi3x8d8U6hlnCT8wTw_0 2024-09-12T01:10:59.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16408346565049461597', time=2024-09-12T02:52:25.888104+0000, chain.objs.size()=1 2024-09-12T01:10:59.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.JyapM1xUx489iYqDZwN7lGUlhsNkesY_0 2024-09-12T01:10:59.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1244148958640620026', time=2024-09-12T02:52:26.047029+0000, chain.objs.size()=1 2024-09-12T01:10:59.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.g7huTahz2lq3FU-7w5cqekcq1GAeEkI_0 2024-09-12T01:10:59.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18071538775327431508', time=2024-09-12T02:52:26.700753+0000, chain.objs.size()=1 2024-09-12T01:10:59.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1dcveYTTSGh01NdQaiEm2TskqcwqLR9_0 2024-09-12T01:10:59.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6684538035095365863', time=2024-09-12T02:52:27.112351+0000, chain.objs.size()=1 2024-09-12T01:10:59.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.oR2PQsreFBebxULZuupFazbjZ-tNUUj_0 2024-09-12T01:10:59.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17164575225876855101', time=2024-09-12T02:52:27.581706+0000, chain.objs.size()=1 2024-09-12T01:10:59.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.RLb5pDTqnxhE9xXDlilybPht1GM1qfc_0 2024-09-12T01:10:59.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4399344716997554733', time=2024-09-12T02:52:27.860765+0000, chain.objs.size()=1 2024-09-12T01:10:59.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.XftaeYnN5JTTaOvlwJL_durSWHArDUk_0 2024-09-12T01:10:59.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2106598916833647279', time=2024-09-12T02:52:28.008103+0000, chain.objs.size()=1 2024-09-12T01:10:59.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.nMC9CUZc4u0_FRVa7O30ixIY2HU4aY1_0 2024-09-12T01:10:59.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5574032857234155509', time=2024-09-12T02:52:28.082736+0000, chain.objs.size()=1 2024-09-12T01:10:59.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.kzXrR_yZaThpRu-_7c0NT6ijMLWwEVX_0 2024-09-12T01:10:59.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2005945553415365853', time=2024-09-12T02:52:28.681742+0000, chain.objs.size()=1 2024-09-12T01:10:59.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ngGIDP5pZTbM6D6vj8uG48VVOhpB6rd_0 2024-09-12T01:10:59.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3669201127841718788', time=2024-09-12T02:52:28.830279+0000, chain.objs.size()=1 2024-09-12T01:10:59.171 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.170+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Yzulmndq-sLcdj4megC9P-KWBuaJyBr_0 2024-09-12T01:10:59.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.175+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1380555969055564659', time=2024-09-12T02:52:29.282107+0000, chain.objs.size()=1 2024-09-12T01:10:59.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.175+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.QzMJVaRFUy6hStzEy59NRnCfg5lmUIP_0 2024-09-12T01:10:59.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.175+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8459006322863058878', time=2024-09-12T02:52:29.314390+0000, chain.objs.size()=1 2024-09-12T01:10:59.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.175+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.VBw9QWmFjNc7OlsXaLxS08UJBEyOaeL_0 2024-09-12T01:10:59.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.175+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3187714771451089952', time=2024-09-12T02:52:29.357422+0000, chain.objs.size()=1 2024-09-12T01:10:59.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.175+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.o_NOL8UMABk5Yu_aL7N0NHcMV-jbdHp_0 2024-09-12T01:10:59.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.175+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10526086942800681453', time=2024-09-12T02:52:29.865476+0000, chain.objs.size()=1 2024-09-12T01:10:59.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.175+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.UFVzuUbBqu78qyD7TbpwIP4fzpMejzZ_0 2024-09-12T01:10:59.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.175+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6810762474541747498', time=2024-09-12T02:52:30.112660+0000, chain.objs.size()=1 2024-09-12T01:10:59.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.175+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.mAypnWkSu_DROE8Z73GJql3C-FAZRGK_0 2024-09-12T01:10:59.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.175+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13274561263802705130', time=2024-09-12T02:52:30.247510+0000, chain.objs.size()=1 2024-09-12T01:10:59.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.175+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.C2Ch5Duza75InpYz-nHHsJz8aHsdUdw_0 2024-09-12T01:10:59.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.175+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16235142808685235396', time=2024-09-12T02:52:30.313667+0000, chain.objs.size()=1 2024-09-12T01:10:59.175 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.175+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.erLXQOc6lLirr6xTd6Y0AgZ-31toEit_0 2024-09-12T01:10:59.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.176+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9074568629466760465', time=2024-09-12T02:52:30.612650+0000, chain.objs.size()=1 2024-09-12T01:10:59.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.176+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.LuZYdSz5byxHXPMdcc3u8Qcr3ARgvXo_0 2024-09-12T01:10:59.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.176+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16909330655731675710', time=2024-09-12T02:52:30.704545+0000, chain.objs.size()=1 2024-09-12T01:10:59.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.176+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.9_cvlwEbHY9nYbgTp1gPlfFW6HhlPqS_0 2024-09-12T01:10:59.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.176+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5855022667841673862', time=2024-09-12T02:52:31.223821+0000, chain.objs.size()=1 2024-09-12T01:10:59.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.176+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.WfjuwmIFzaGLLHyvYEnknqjVS78B_8d_0 2024-09-12T01:10:59.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.176+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9245837949635313420', time=2024-09-12T02:52:38.170058+0000, chain.objs.size()=1 2024-09-12T01:10:59.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.176+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.274__shadow_.3Tf7rjbcswnhd97Lc5hG9T19fo9Nqay_0 2024-09-12T01:10:59.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.178+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10625457217648220409', time=2024-09-12T02:52:48.588357+0000, chain.objs.size()=1 2024-09-12T01:10:59.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.178+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.291__shadow_.gvYIUIJ0P4zwY784geBQQbdAWEVjWQo_0 2024-09-12T01:10:59.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1310649290902460842', time=2024-09-12T02:52:48.602581+0000, chain.objs.size()=1 2024-09-12T01:10:59.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.291__shadow_.w7EboQNzrCauFwZPWXwQ8l3-Huapuca_0 2024-09-12T01:10:59.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11013694388452880417', time=2024-09-12T02:52:58.855419+0000, chain.objs.size()=1 2024-09-12T01:10:59.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.303__shadow_.--iXGVj282_Yiwt67izreKF-x9JZHt8_0 2024-09-12T01:10:59.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5416011327773453604', time=2024-09-12T02:53:00.052609+0000, chain.objs.size()=1 2024-09-12T01:10:59.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.305__shadow_.MKqTE634vr17biHa7f-_kn9JMz_ChSQ_0 2024-09-12T01:10:59.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3234376030666808888', time=2024-09-12T02:53:01.524145+0000, chain.objs.size()=1 2024-09-12T01:10:59.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.307__shadow_.LgQrUoroI7-Inx5iRvUZqGUhZNR8wG9_0 2024-09-12T01:10:59.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5067370805418846006', time=2024-09-12T02:53:02.619722+0000, chain.objs.size()=1 2024-09-12T01:10:59.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.308__shadow:eUlIA6xfMXYxQu4yTuKXZjjhDDXnD5J_.shjTcHfA1E0KcQubxVY9v2bnVKhzA0E_0 2024-09-12T01:10:59.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12408266478780903624', time=2024-09-12T02:53:49.708402+0000, chain.objs.size()=1 2024-09-12T01:10:59.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.PfzZb2fxM1q1AY70oZmZ6IfAf1_HrEz_0 2024-09-12T01:10:59.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1365014989316347189', time=2024-09-12T02:53:50.321438+0000, chain.objs.size()=1 2024-09-12T01:10:59.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.RQcW-NWatjYHhiaxu1Sj7XRMfwIV9By_0 2024-09-12T01:10:59.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12492861806628364705', time=2024-09-12T02:53:50.358164+0000, chain.objs.size()=1 2024-09-12T01:10:59.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.179+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.H9TrkCXTfGEuCzCSxY_FE4z9_sbpLI9_0 2024-09-12T01:10:59.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.180+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11802164085620775134', time=2024-09-12T02:53:50.890654+0000, chain.objs.size()=1 2024-09-12T01:10:59.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.180+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.pvFTsjyEjSjDiyjtIfk6RVQvYgICQ18_0 2024-09-12T01:10:59.179 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.180+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2020115775025347581', time=2024-09-12T02:53:50.907010+0000, chain.objs.size()=1 2024-09-12T01:10:59.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.180+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.UUgJLB7UiZQCZSD4GL-teuw9jB9QeF8_0 2024-09-12T01:10:59.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.182+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11243191426752720689', time=2024-09-12T02:53:50.982121+0000, chain.objs.size()=1 2024-09-12T01:10:59.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.182+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.IzKLwP9UF7Ca-lXDa9Fstd_g-4A8K5V_0 2024-09-12T01:10:59.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.182+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4166603619415701476', time=2024-09-12T02:53:51.451471+0000, chain.objs.size()=1 2024-09-12T01:10:59.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.182+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0MrZsruIVbR8WMs3xQiIEJu4SS675k1_0 2024-09-12T01:10:59.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.182+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4408424838543496615', time=2024-09-12T02:53:51.636716+0000, chain.objs.size()=1 2024-09-12T01:10:59.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.182+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hPphkOUpgRTq7e2Fs5DMUtw3svw3w16_0 2024-09-12T01:10:59.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.182+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5180975814937475263', time=2024-09-12T02:53:52.360391+0000, chain.objs.size()=1 2024-09-12T01:10:59.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.182+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.LgucGyQfQcwWKlbfsSB5UzG0wj2A-fn_0 2024-09-12T01:10:59.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.183+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15263448918321286139', time=2024-09-12T02:53:52.372314+0000, chain.objs.size()=1 2024-09-12T01:10:59.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.183+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.WBqfPxFC_l5qZeTrhsHaMY5WsbDYxxM_0 2024-09-12T01:10:59.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.183+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1407775088471408776', time=2024-09-12T02:53:52.463540+0000, chain.objs.size()=1 2024-09-12T01:10:59.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.183+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nY6pjeb51wEq_a9u8mN1vlOAkFD1MWb_0 2024-09-12T01:10:59.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.184+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17097299285171354763', time=2024-09-12T02:53:52.518619+0000, chain.objs.size()=1 2024-09-12T01:10:59.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.184+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.aaFIevZ1qsGt0a2zd-ikSc3Q2d8-Dod_0 2024-09-12T01:10:59.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.184+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.383993402816715139', time=2024-09-12T02:53:52.597461+0000, chain.objs.size()=1 2024-09-12T01:10:59.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.184+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bO3lMpCycLciHnHMslirylndk4ZXRTV_0 2024-09-12T01:10:59.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.184+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15575875051752006674', time=2024-09-12T02:53:52.603926+0000, chain.objs.size()=1 2024-09-12T01:10:59.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.184+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bojCiSn7OWzK3rm7dgzEx2TWIt2deQU_0 2024-09-12T01:10:59.183 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.184+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14263209726079159944', time=2024-09-12T02:53:52.776701+0000, chain.objs.size()=1 2024-09-12T01:10:59.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.184+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.YsJRs8tOpngkC8VRSqsybNuyW90M5hg_0 2024-09-12T01:10:59.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.184+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1197755239326353542', time=2024-09-12T02:53:53.823854+0000, chain.objs.size()=1 2024-09-12T01:10:59.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.184+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.mj87jh9mCeHr1ekGRh-qHw2rgiXojjS_0 2024-09-12T01:10:59.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.185+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13609666803771363824', time=2024-09-12T02:53:53.830001+0000, chain.objs.size()=1 2024-09-12T01:10:59.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.185+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qFKgOz-wSIL8CObzkIkYkPgV3AP1w-h_0 2024-09-12T01:10:59.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.185+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12536460380155346936', time=2024-09-12T02:53:54.253188+0000, chain.objs.size()=1 2024-09-12T01:10:59.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.185+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.8KrG9kjCOyoWaueGndYLDeybmFYpoGL_0 2024-09-12T01:10:59.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.186+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9096313656410047453', time=2024-09-12T02:53:54.489054+0000, chain.objs.size()=1 2024-09-12T01:10:59.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.186+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_._LiOR3ORtnDJ9H_YGCz-g-ERUGNVw9B_0 2024-09-12T01:10:59.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.186+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16116962420601193563', time=2024-09-12T02:53:54.669630+0000, chain.objs.size()=1 2024-09-12T01:10:59.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.186+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.eezaOr4oaGpClDnwNHYZPPKqx-INNRW_0 2024-09-12T01:10:59.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.186+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6858588527265738593', time=2024-09-12T02:53:54.701911+0000, chain.objs.size()=1 2024-09-12T01:10:59.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.186+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.2mkFvCw7nQ0-ttHX1a87Q05257Ch92p_0 2024-09-12T01:10:59.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15689266696363111310', time=2024-09-12T02:53:55.046596+0000, chain.objs.size()=1 2024-09-12T01:10:59.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.9dBcQ6CNqLSlYbld5TimKCiu6ICbEAy_0 2024-09-12T01:10:59.187 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10549011671200402132', time=2024-09-12T02:53:55.517011+0000, chain.objs.size()=1 2024-09-12T01:10:59.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.mxED7guyL9aRYGvh2BRBXLG_qatIC_B_0 2024-09-12T01:10:59.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4306248450623843129', time=2024-09-12T02:53:55.546942+0000, chain.objs.size()=1 2024-09-12T01:10:59.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.kham08_DqvsfuSdVXM-H_zIdaj9GfIP_0 2024-09-12T01:10:59.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11132074380261560853', time=2024-09-12T02:53:55.622966+0000, chain.objs.size()=1 2024-09-12T01:10:59.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.OQsw8FebxvM6mQE7HvY1kK-OJUWxAOZ_0 2024-09-12T01:10:59.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.887557768980888137', time=2024-09-12T02:53:55.661913+0000, chain.objs.size()=1 2024-09-12T01:10:59.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.eU4XstYy0PqIL5hek1Rl6IDsR5v9ILT_0 2024-09-12T01:10:59.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7883175748930404760', time=2024-09-12T02:53:55.816708+0000, chain.objs.size()=1 2024-09-12T01:10:59.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Dvx-ZCcrlouyWDzTR42LjP_pT3HTapp_0 2024-09-12T01:10:59.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.188+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6025391773000265616', time=2024-09-12T02:53:55.924697+0000, chain.objs.size()=1 2024-09-12T01:10:59.188 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.188+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ULSDfJOGlp1Hqr0qeBtxgC8VCr_mWdN_0 2024-09-12T01:10:59.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.189+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4177834645202995811', time=2024-09-12T02:53:56.405334+0000, chain.objs.size()=1 2024-09-12T01:10:59.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.189+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bpNZM8VcDzfoaHEMrMJxJZw2DIq9Gwo_0 2024-09-12T01:10:59.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.189+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14190219106277835628', time=2024-09-12T02:53:56.690553+0000, chain.objs.size()=1 2024-09-12T01:10:59.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.189+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.s5XXbu3_D2oZCGccB3gRvXCVBrHZ9Db_0 2024-09-12T01:10:59.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.190+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7740408488570923942', time=2024-09-12T02:53:56.691390+0000, chain.objs.size()=1 2024-09-12T01:10:59.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.190+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.p5uz3n98TY1PRPvSKvC4CNx8CEEz_aM_0 2024-09-12T01:10:59.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.190+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9607113587260982108', time=2024-09-12T02:53:56.799256+0000, chain.objs.size()=1 2024-09-12T01:10:59.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.190+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bM4rSFlAcUbWq_sq1qlpWWnTKyoCxY1_0 2024-09-12T01:10:59.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.192+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2904712342746406434', time=2024-09-12T02:53:56.801368+0000, chain.objs.size()=1 2024-09-12T01:10:59.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.192+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lr9VfTN-7nJoGQeBtDqg7U1G96naDsV_0 2024-09-12T01:10:59.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15383944752131406091', time=2024-09-12T02:53:57.407144+0000, chain.objs.size()=1 2024-09-12T01:10:59.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.7Qgls2FbPU_Px7gxHC8ssIEkL5ZaMKv_0 2024-09-12T01:10:59.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12939039248333660269', time=2024-09-12T02:53:57.791475+0000, chain.objs.size()=1 2024-09-12T01:10:59.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.sjpLSrH5BYe8hdkee_OONw5pvL3DmaI_0 2024-09-12T01:10:59.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13197348069710532', time=2024-09-12T02:53:57.876352+0000, chain.objs.size()=1 2024-09-12T01:10:59.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.1Q-Tl90_yOZgxFy_1tBKWmqE7SEdjTo_0 2024-09-12T01:10:59.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2529070403834394400', time=2024-09-12T02:53:57.944600+0000, chain.objs.size()=1 2024-09-12T01:10:59.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.fETl7Qz-EjC-fl0MYP3XU9KtO1c87pc_0 2024-09-12T01:10:59.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6809305436286811575', time=2024-09-12T02:53:58.052435+0000, chain.objs.size()=1 2024-09-12T01:10:59.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.7QTLwlKeessQB-hOa30XqD-nFiEwkOD_0 2024-09-12T01:10:59.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2831576753779485094', time=2024-09-12T02:53:58.053769+0000, chain.objs.size()=1 2024-09-12T01:10:59.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.pr4YAe1wMLSjEwaVBIPHhYVTunxItAP_0 2024-09-12T01:10:59.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9315650137768485237', time=2024-09-12T02:53:58.318461+0000, chain.objs.size()=1 2024-09-12T01:10:59.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.RI3PuaAooJ__lMy_kNOu9SMPNDKJNXC_0 2024-09-12T01:10:59.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16356682976260717378', time=2024-09-12T02:53:58.440724+0000, chain.objs.size()=1 2024-09-12T01:10:59.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cntMTrADC4swdqPndREUnD0XFDHMoiz_0 2024-09-12T01:10:59.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15820996760031201473', time=2024-09-12T02:53:58.508064+0000, chain.objs.size()=1 2024-09-12T01:10:59.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.NP-1VNyVqLJtuipYVIPHQhoUmKLIAdy_0 2024-09-12T01:10:59.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9109227867282515394', time=2024-09-12T02:53:58.543446+0000, chain.objs.size()=1 2024-09-12T01:10:59.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.193+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.b1hjR_cDie7m70d-UJaNZPviNXcw1yZ_0 2024-09-12T01:10:59.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.195+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7689750441099358761', time=2024-09-12T02:53:59.145185+0000, chain.objs.size()=1 2024-09-12T01:10:59.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.195+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.sVGC4WtrTGPwYmVnjf5JFLcdDR73zBI_0 2024-09-12T01:10:59.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.196+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7772180014739851700', time=2024-09-12T02:53:59.377697+0000, chain.objs.size()=1 2024-09-12T01:10:59.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.196+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ukd8j6eVCELQwC__S9caFqZ8L0J7HJz_0 2024-09-12T01:10:59.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.196+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12908525165285065255', time=2024-09-12T02:53:59.638633+0000, chain.objs.size()=1 2024-09-12T01:10:59.195 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.196+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.OFRVcIBeHNd71vznBCTOEuckSow1Ozg_0 2024-09-12T01:10:59.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.196+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13398385959540226584', time=2024-09-12T02:54:36.986221+0000, chain.objs.size()=1 2024-09-12T01:10:59.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.196+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.NMFrLWdesQ0asOwjgeu6gA6vWlqGxdR_0 2024-09-12T01:10:59.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.199+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4460030936597596765', time=2024-09-12T02:54:37.505755+0000, chain.objs.size()=1 2024-09-12T01:10:59.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.199+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.-02e9tHat7DRv4unVnRmhsqZtsGEZju_0 2024-09-12T01:10:59.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.199+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4864161328755810728', time=2024-09-12T02:54:37.632905+0000, chain.objs.size()=1 2024-09-12T01:10:59.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.199+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.KLeL1ciNkcnmT-iJlJStTyGDCYlSblg_0 2024-09-12T01:10:59.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.199+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9346515736576246815', time=2024-09-12T02:54:38.381999+0000, chain.objs.size()=1 2024-09-12T01:10:59.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.199+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6GBcueAsT4ORcaH9bo9ow0g9l9nMJ0P_0 2024-09-12T01:10:59.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.199+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18227650468210149281', time=2024-09-12T02:54:39.517612+0000, chain.objs.size()=1 2024-09-12T01:10:59.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.199+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.NIr4tmU3cQ2nl3phYg7pvtJymmNlMlN_0 2024-09-12T01:10:59.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.199+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12673323530404044646', time=2024-09-12T02:54:39.793738+0000, chain.objs.size()=1 2024-09-12T01:10:59.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.199+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.NkRuDQE23mQeoBBP4OEKNONucZ1BqkX_0 2024-09-12T01:10:59.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.199+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3619111375562565062', time=2024-09-12T02:54:39.959686+0000, chain.objs.size()=1 2024-09-12T01:10:59.199 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.199+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.h2a59L8dvojxOZYYp_jKoJA0yYc5cGm_0 2024-09-12T01:10:59.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.202+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/44810 2024-09-12T01:10:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=44, truncated=0, next_marker='' 2024-09-12T01:10:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12804248644329785948', time=2024-09-12T02:54:40.057905+0000, chain.objs.size()=1 2024-09-12T01:10:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.qrcu8Y8_W95y-Tk8559gtaPIEfUD6Sd_0 2024-09-12T01:10:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5304456257762362199', time=2024-09-12T02:54:40.120692+0000, chain.objs.size()=1 2024-09-12T01:10:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.W21iYRXYdg5S-SfOfK0FwD_OnB5QWQz_0 2024-09-12T01:10:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9901121979410484655', time=2024-09-12T02:54:40.204309+0000, chain.objs.size()=1 2024-09-12T01:10:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.PF7hCP63fIIhWaogTtmea_Msbe0eCOp_0 2024-09-12T01:10:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10412024820630593910', time=2024-09-12T02:54:40.379371+0000, chain.objs.size()=1 2024-09-12T01:10:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.B0BiweS_0QXFEgp5YeUc7pMPz8LqrU4_0 2024-09-12T01:10:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8763732434504027017', time=2024-09-12T02:54:41.013956+0000, chain.objs.size()=1 2024-09-12T01:10:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.KtHAxsaH6aGHbj5ILOL7YcKix58UJHz_0 2024-09-12T01:10:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13491253708243217199', time=2024-09-12T02:54:41.206122+0000, chain.objs.size()=1 2024-09-12T01:10:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.lruNMjnAGyQ6dUoGM7GBI8ORqaXRxPe_0 2024-09-12T01:10:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.224222289704350127', time=2024-09-12T02:54:41.256644+0000, chain.objs.size()=1 2024-09-12T01:10:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._BZOG2c19o8sl9B-Ofi07-QQZpcTJS__0 2024-09-12T01:10:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10187603418979259335', time=2024-09-12T02:54:41.323822+0000, chain.objs.size()=1 2024-09-12T01:10:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9F2YLDlN240RC3Bl9Gx1z5pE0JmWclO_0 2024-09-12T01:10:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4384709155661879276', time=2024-09-12T02:54:41.331096+0000, chain.objs.size()=1 2024-09-12T01:10:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.OPV1Vh_Nx2WRDptQqKTohZbOqmDNBBE_0 2024-09-12T01:10:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2144496574595208809', time=2024-09-12T02:54:41.454391+0000, chain.objs.size()=1 2024-09-12T01:10:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Wyjc-8ntEHKcPepw74ut2MMfIiRuklQ_0 2024-09-12T01:10:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.240654898746700897', time=2024-09-12T02:54:41.679145+0000, chain.objs.size()=1 2024-09-12T01:10:59.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._o6Z3Rl3KR3GTznPaPvx7hDLLqJvPXB_0 2024-09-12T01:10:59.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12370721788488814886', time=2024-09-12T02:54:41.679917+0000, chain.objs.size()=1 2024-09-12T01:10:59.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.UXwu4JARHTNJG3xmIEEWC9y6-CGWUZN_0 2024-09-12T01:10:59.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.206+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4573764242088289148', time=2024-09-12T02:54:41.756400+0000, chain.objs.size()=1 2024-09-12T01:10:59.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.206+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._4TnoF3EU5SMgDk-si72IfVrPjlNJYY_0 2024-09-12T01:10:59.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.207+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6990395243815014944', time=2024-09-12T02:54:41.809061+0000, chain.objs.size()=1 2024-09-12T01:10:59.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.207+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.02Rps5nCHwyzsnWuHjZp_-RtiqByYqB_0 2024-09-12T01:10:59.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.207+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13324235195569110854', time=2024-09-12T02:54:42.487937+0000, chain.objs.size()=1 2024-09-12T01:10:59.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.207+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.VkN8hSCzJZOXkZy9Kbu1lJQyijSeeSr_0 2024-09-12T01:10:59.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.207+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6106744630716048932', time=2024-09-12T02:54:42.568705+0000, chain.objs.size()=1 2024-09-12T01:10:59.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.207+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.NckWXWquGwx7rSdDc-TkuJu7ReFhJex_0 2024-09-12T01:10:59.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.208+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13823466885079067524', time=2024-09-12T02:54:42.785665+0000, chain.objs.size()=1 2024-09-12T01:10:59.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.208+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.YTfiM-wZ17acqrhBLQ749Vg9xY8TX2c_0 2024-09-12T01:10:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.208+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17097783041860916614', time=2024-09-12T02:54:43.336065+0000, chain.objs.size()=1 2024-09-12T01:10:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.208+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.zjT6N3DdbizLAAbn3PQFkXA0uKTQ37k_0 2024-09-12T01:10:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.208+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4632871357360163091', time=2024-09-12T02:54:43.836924+0000, chain.objs.size()=1 2024-09-12T01:10:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.208+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.UIWXVF6T0geHFZ710dpwnfF0x0WFNvJ_0 2024-09-12T01:10:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.208+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5206434417776850050', time=2024-09-12T02:54:43.961058+0000, chain.objs.size()=1 2024-09-12T01:10:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.208+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.OFgQuEvfMF5IAmM_ZUfd0Qnx-t29nDH_0 2024-09-12T01:10:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.208+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18225614094462973030', time=2024-09-12T02:54:44.556279+0000, chain.objs.size()=1 2024-09-12T01:10:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.208+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.z1f6S5QOSbMwrxKzS10JegWxdlH2_87_0 2024-09-12T01:10:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.209+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10493589969503692153', time=2024-09-12T02:54:44.738752+0000, chain.objs.size()=1 2024-09-12T01:10:59.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.209+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.RDLpzWVLmDLezP38IX1yPTt2JI8BQE4_0 2024-09-12T01:10:59.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.209+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15033060255013330279', time=2024-09-12T02:54:45.121650+0000, chain.objs.size()=1 2024-09-12T01:10:59.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.209+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.GS1I5hyY7nVoI0scDKKy7d4v4tjdXPG_0 2024-09-12T01:10:59.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.210+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13954292000646231688', time=2024-09-12T02:54:45.285416+0000, chain.objs.size()=1 2024-09-12T01:10:59.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.210+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.e44HF7geDuH1J8rPw2efojA1lBaMt_c_0 2024-09-12T01:10:59.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.211+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12980550309685162154', time=2024-09-12T02:54:45.359237+0000, chain.objs.size()=1 2024-09-12T01:10:59.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.211+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.z9VSJ_ILQui60rNqOQBgn9NoqWWP6vR_0 2024-09-12T01:10:59.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.211+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11834181118336490758', time=2024-09-12T02:54:45.857611+0000, chain.objs.size()=1 2024-09-12T01:10:59.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.211+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.2R4xORHqgi8zjTW_f9SnVbxztKLJHg__0 2024-09-12T01:10:59.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13936632593315029290', time=2024-09-12T02:54:46.031860+0000, chain.objs.size()=1 2024-09-12T01:10:59.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.KoIwkeRS38ORqirpvKaS8oF5RAPtUep_0 2024-09-12T01:10:59.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16281363317055464259', time=2024-09-12T02:54:46.331252+0000, chain.objs.size()=1 2024-09-12T01:10:59.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.zQh_eM_KBl1aI1vGNMBvHP_bZLaiRuW_0 2024-09-12T01:10:59.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5905893073043034401', time=2024-09-12T02:54:46.794471+0000, chain.objs.size()=1 2024-09-12T01:10:59.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.U2M_pYnwREPEzRu_UAGH5xOsldm2zsg_0 2024-09-12T01:10:59.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8585491335719423433', time=2024-09-12T02:54:46.862459+0000, chain.objs.size()=1 2024-09-12T01:10:59.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.OePUF_xsbNjMI3yJasxDjEdJykFL8bp_0 2024-09-12T01:10:59.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15677256162271334805', time=2024-09-12T02:55:48.462200+0000, chain.objs.size()=1 2024-09-12T01:10:59.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.440__shadow_.lfnOsSutPhvKo4Zu1S3dw5BXT13ii0g_0 2024-09-12T01:10:59.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16154154119801287720', time=2024-09-12T02:55:58.862267+0000, chain.objs.size()=1 2024-09-12T01:10:59.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.457__shadow_.DVs3P8eE_IQyGw3hYC-wRRxbsozrk9T_0 2024-09-12T01:10:59.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2396889687196208575', time=2024-09-12T02:56:06.825963+0000, chain.objs.size()=1 2024-09-12T01:10:59.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.467__shadow_.fNJLmK52Et72Cp-Ll98_mu872xi1H_r_0 2024-09-12T01:10:59.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16404316488389093399', time=2024-09-12T02:56:26.983364+0000, chain.objs.size()=1 2024-09-12T01:10:59.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.500__shadow_.T1HXAW_Zm-5Z71M_a7ox0L4PwOU_ExI_0 2024-09-12T01:10:59.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12172496780637503678', time=2024-09-12T02:59:39.465159+0000, chain.objs.size()=1 2024-09-12T01:10:59.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.559__shadow_.avTRAK4Wc4-VfrHqo1zVoy5dlYMKrR9_0 2024-09-12T01:10:59.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.214+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7944744239026622724', time=2024-09-12T02:59:41.819661+0000, chain.objs.size()=1 2024-09-12T01:10:59.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.214+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.561__shadow_.s_s1DlaQpDz52wNBlDiFSuCZ6-0OBZV_0 2024-09-12T01:10:59.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.214+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14975576349433978559', time=2024-09-12T02:59:58.304550+0000, chain.objs.size()=1 2024-09-12T01:10:59.214 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.214+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:wGSEzdiQ07shPg87hqUiSeFyUFS5dGm_.P07jTu2CLJRYJul3BymOrQKJ9xlpFLW_0 2024-09-12T01:10:59.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.217+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2118514913660465012', time=2024-09-12T03:00:12.120742+0000, chain.objs.size()=1 2024-09-12T01:10:59.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.576__shadow:JCZI.CRhjlDC6p8jHumZQKwrv6QEa9p_.1CVUIJEWddj2YH9wNfBlEEsMxEwlyq6_0 2024-09-12T01:10:59.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.217+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11221786750713745118', time=2024-09-12T03:00:58.239502+0000, chain.objs.size()=1 2024-09-12T01:10:59.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.586__shadow:h3r2NsxMaKgZJHXFbDfqnFqYygIDBKX_.FUQ5Y8m38ikMlX5hvjhHBKeJxrzcHfx_0 2024-09-12T01:10:59.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.217+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~bxsWnMDgMEYkIKPS8hu_F7QcPpRQbUq', time=2024-09-12T03:04:49.412916+0000, chain.objs.size()=12 2024-09-12T01:10:59.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.626__multipart_multipart_enc.2~bxsWnMDgMEYkIKPS8hu_F7QcPpRQbUq.1 2024-09-12T01:10:59.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.626__shadow_multipart_enc.2~bxsWnMDgMEYkIKPS8hu_F7QcPpRQbUq.1_1 2024-09-12T01:10:59.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.626__multipart_multipart_enc.2~bxsWnMDgMEYkIKPS8hu_F7QcPpRQbUq.2 2024-09-12T01:10:59.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.626__shadow_multipart_enc.2~bxsWnMDgMEYkIKPS8hu_F7QcPpRQbUq.2_1 2024-09-12T01:10:59.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.626__multipart_multipart_enc.2~bxsWnMDgMEYkIKPS8hu_F7QcPpRQbUq.3 2024-09-12T01:10:59.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.626__shadow_multipart_enc.2~bxsWnMDgMEYkIKPS8hu_F7QcPpRQbUq.3_1 2024-09-12T01:10:59.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.626__multipart_multipart_enc.2~bxsWnMDgMEYkIKPS8hu_F7QcPpRQbUq.4 2024-09-12T01:10:59.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.626__shadow_multipart_enc.2~bxsWnMDgMEYkIKPS8hu_F7QcPpRQbUq.4_1 2024-09-12T01:10:59.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.219+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.626__multipart_multipart_enc.2~bxsWnMDgMEYkIKPS8hu_F7QcPpRQbUq.5 2024-09-12T01:10:59.219 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.220+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.626__shadow_multipart_enc.2~bxsWnMDgMEYkIKPS8hu_F7QcPpRQbUq.5_1 2024-09-12T01:10:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.223+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.626__multipart_multipart_enc.2~bxsWnMDgMEYkIKPS8hu_F7QcPpRQbUq.6 2024-09-12T01:10:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.223+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.626__shadow_multipart_enc.2~bxsWnMDgMEYkIKPS8hu_F7QcPpRQbUq.6_1 2024-09-12T01:10:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.223+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2523112088664660313', time=2024-09-12T03:05:07.621397+0000, chain.objs.size()=1 2024-09-12T01:10:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.223+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.648__shadow_.2kSljK2nEo2wGli06rWx1N6FeyX455Z_0 2024-09-12T01:10:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.223+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6917413680023100929', time=2024-09-12T03:05:53.236914+0000, chain.objs.size()=1 2024-09-12T01:10:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.223+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.700__shadow:6nkG3hGuDrun8-yJIgPY5i9Zd2sSJP2_.SxDpsqg03Iyr-irWxir1sfVWSCUsHpR_0 2024-09-12T01:10:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.223+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12513635781111764641', time=2024-09-12T03:06:12.828281+0000, chain.objs.size()=1 2024-09-12T01:10:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.223+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.716__shadow:rHYSMkjYI6Gj7PH8gaz2-z0e1sSjZYQ_.sey8Vad-wjKfn-PT45TXFvA5Cqg37VQ_0 2024-09-12T01:10:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.223+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16731255532962100396', time=2024-09-12T03:06:45.952596+0000, chain.objs.size()=1 2024-09-12T01:10:59.222 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.223+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.741__shadow_.6zOjijPDcRCrSO8MD-l-_OO9bkyn9jA_0 2024-09-12T01:10:59.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.227+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.229+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:10:59.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.231+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.231+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53508' 2024-09-12T01:10:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11135497171711276122', time=2024-09-12T02:51:31.251374+0000, chain.objs.size()=1 2024-09-12T01:10:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.240__shadow_.qlETSVAIfYiR99q4fNoSmeIFLbiraXA_0 2024-09-12T01:10:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12927630553391371079', time=2024-09-12T02:51:32.987615+0000, chain.objs.size()=1 2024-09-12T01:10:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.243__shadow_.FS488VgzJim7XDXB0cD_VHdv3v_eDqr_0 2024-09-12T01:10:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6336354455739680764', time=2024-09-12T02:51:33.815331+0000, chain.objs.size()=1 2024-09-12T01:10:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.244__shadow_.UwPpmp8k6VzN3XEPPNaq-4XW-LsE4Os_0 2024-09-12T01:10:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8050177062273383028', time=2024-09-12T02:51:40.730177+0000, chain.objs.size()=1 2024-09-12T01:10:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.255__shadow_.C8DDPofLGCD0BZyjfnu7cVHLtJNuFmr_0 2024-09-12T01:10:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2713497220906717953', time=2024-09-12T02:51:42.514406+0000, chain.objs.size()=1 2024-09-12T01:10:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.258__shadow_.b3lMrKen96Xzoyr-vHvKrJRpxHju1Lm_0 2024-09-12T01:10:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9189460472796922224', time=2024-09-12T02:52:21.123130+0000, chain.objs.size()=1 2024-09-12T01:10:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.EMsPmmUEVt31TbRE-FVRqR0O_Oxi7rL_0 2024-09-12T01:10:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13624351349592372211', time=2024-09-12T02:52:21.242733+0000, chain.objs.size()=1 2024-09-12T01:10:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ygal5B2SvfrsHJy_k7AUakKTWOfNi7S_0 2024-09-12T01:10:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15762548079135786820', time=2024-09-12T02:52:21.257185+0000, chain.objs.size()=1 2024-09-12T01:10:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.y7vhstxEfZqUf_ULw7mnq-WkNRrzOwR_0 2024-09-12T01:10:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6131444145832749126', time=2024-09-12T02:52:21.863649+0000, chain.objs.size()=1 2024-09-12T01:10:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.a5PQCD2TaPO5I5JPdR_jqVRVkeUJiXo_0 2024-09-12T01:10:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5874738588179317551', time=2024-09-12T02:52:22.013400+0000, chain.objs.size()=1 2024-09-12T01:10:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pkWJbWM88YH4O-2JVo_Ff_ccDn7ybin_0 2024-09-12T01:10:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11409883478555428815', time=2024-09-12T02:52:22.168215+0000, chain.objs.size()=1 2024-09-12T01:10:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.IKD5yTAjK0G0UCnvulJTvIeRMprjV39_0 2024-09-12T01:10:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15048916384739026405', time=2024-09-12T02:52:22.220862+0000, chain.objs.size()=1 2024-09-12T01:10:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.232+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.CrmJ43ioZpdHz9iJl5r9KdrfrRzV8VQ_0 2024-09-12T01:10:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.235+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6647492883473684879', time=2024-09-12T02:52:23.048792+0000, chain.objs.size()=1 2024-09-12T01:10:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.235+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xMIgZvnp8FnyDf5Vc2DkVlsPNTQM_se_0 2024-09-12T01:10:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10352075610301069178', time=2024-09-12T02:52:23.447627+0000, chain.objs.size()=1 2024-09-12T01:10:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.l664tJH-mT7ndDXVQBN0aRj87d3NmJi_0 2024-09-12T01:10:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16274132210579676643', time=2024-09-12T02:52:23.545112+0000, chain.objs.size()=1 2024-09-12T01:10:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KQXtG3uUplclrINHHKSixZFNMEvxuAp_0 2024-09-12T01:10:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16526755509459232573', time=2024-09-12T02:52:24.202580+0000, chain.objs.size()=1 2024-09-12T01:10:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.-W6JZJdsCwOBNh5XoivvFTHBucz4w1X_0 2024-09-12T01:10:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16274517175805899135', time=2024-09-12T02:52:24.371364+0000, chain.objs.size()=1 2024-09-12T01:10:59.235 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.152U1lOR0W51KnVKw3NhfeCa8le59yl_0 2024-09-12T01:10:59.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4984998280127903818', time=2024-09-12T02:52:24.963547+0000, chain.objs.size()=1 2024-09-12T01:10:59.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pjao017xgLNI0xnV41aAmGuqveFPACU_0 2024-09-12T01:10:59.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17493938645988901383', time=2024-09-12T02:52:25.052292+0000, chain.objs.size()=1 2024-09-12T01:10:59.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Srvhq3dreBmIKdHNpGpUKmc3xIcXtls_0 2024-09-12T01:10:59.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.935789679963025767', time=2024-09-12T02:52:25.188546+0000, chain.objs.size()=1 2024-09-12T01:10:59.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.eOEShzpt1cllU5xgPdgH-ap4kBeF5Mr_0 2024-09-12T01:10:59.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15932519913890560392', time=2024-09-12T02:52:25.745663+0000, chain.objs.size()=1 2024-09-12T01:10:59.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.57qxI9JW0E1BJeJ73EcQe0tCaFF18Z3_0 2024-09-12T01:10:59.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7494401606374940755', time=2024-09-12T02:52:25.746318+0000, chain.objs.size()=1 2024-09-12T01:10:59.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.x-hYz0NRSVPq829tSDA6kPrAygnIXY7_0 2024-09-12T01:10:59.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10864843609352254706', time=2024-09-12T02:52:26.126602+0000, chain.objs.size()=1 2024-09-12T01:10:59.236 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.236+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.awqN5IA0QEJqo_KS45XQQOZMZutXKwK_0 2024-09-12T01:10:59.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.239+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3069929229242854864', time=2024-09-12T02:52:27.098625+0000, chain.objs.size()=1 2024-09-12T01:10:59.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.239+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.VIUoXlxb6E7_rV0VHCqOptD9bs4aXuz_0 2024-09-12T01:10:59.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.239+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3061771188556469822', time=2024-09-12T02:52:27.894795+0000, chain.objs.size()=1 2024-09-12T01:10:59.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.239+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Z0cMk8ROmDq8PhEsT6g0peZJFlSVm5G_0 2024-09-12T01:10:59.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.239+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14282801200913035930', time=2024-09-12T02:52:29.293773+0000, chain.objs.size()=1 2024-09-12T01:10:59.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.239+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pnueEDVvSPZ73wTQ3RoFkuB2g-GHCR-_0 2024-09-12T01:10:59.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.239+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8875300189800294293', time=2024-09-12T02:52:29.335760+0000, chain.objs.size()=1 2024-09-12T01:10:59.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.239+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.eTq-Rgk8KlzsrFSrMpOTMrGOmHqeqti_0 2024-09-12T01:10:59.238 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.239+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6003628614710637143', time=2024-09-12T02:52:29.465159+0000, chain.objs.size()=1 2024-09-12T01:10:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.239+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1hBzpY7-khBHCjF8uC6g67weFUwnrz3_0 2024-09-12T01:10:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.240+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9200268477502449648', time=2024-09-12T02:52:30.192429+0000, chain.objs.size()=1 2024-09-12T01:10:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.240+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vUzyQAdC17WOvVwDsmF791ATMZ5QVec_0 2024-09-12T01:10:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.240+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18383812809891051059', time=2024-09-12T02:52:30.629936+0000, chain.objs.size()=1 2024-09-12T01:10:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.240+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vLJLTI19erm5xOy3SdAi5rRRuN9TaYu_0 2024-09-12T01:10:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.240+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17482289854053465434', time=2024-09-12T02:52:30.829718+0000, chain.objs.size()=1 2024-09-12T01:10:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.240+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wtjbCCyk03xKeJAjJpsImXLPIfXJov4_0 2024-09-12T01:10:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.240+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3126000064491528577', time=2024-09-12T02:52:31.297063+0000, chain.objs.size()=1 2024-09-12T01:10:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.240+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KYeOcEiY4qKuUsug9Kyy9mKyDHoNyMy_0 2024-09-12T01:10:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.240+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2180063573737499974', time=2024-09-12T02:52:31.588936+0000, chain.objs.size()=1 2024-09-12T01:10:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.240+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.fJ5L2kQmlGxjiXp2XGoRzBLqNLvY_pZ_0 2024-09-12T01:10:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.240+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13602836876150218850', time=2024-09-12T02:52:37.061603+0000, chain.objs.size()=1 2024-09-12T01:10:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.240+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.272__shadow_.Yyb4lupHPsEpLB7eDDqUS9KiMTbRWft_0 2024-09-12T01:10:59.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.243+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16878452564913779031', time=2024-09-12T02:52:41.176262+0000, chain.objs.size()=1 2024-09-12T01:10:59.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.243+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.279__shadow_.9HGbAiROO8kD0-yoRFwQZstXDXmF_5w_0 2024-09-12T01:10:59.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.243+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3628218856264278164', time=2024-09-12T02:52:44.220005+0000, chain.objs.size()=1 2024-09-12T01:10:59.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.243+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.284__shadow_.mHpbwAFZfMlZPFrO48HoPnPdNB40Ai5_0 2024-09-12T01:10:59.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.243+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2861326356731768032', time=2024-09-12T02:52:46.737801+0000, chain.objs.size()=1 2024-09-12T01:10:59.242 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.243+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.288__shadow_.lPzIt8ZKrskjocFEE7HDrYmz9lLnc0-_0 2024-09-12T01:10:59.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.244+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11144690775771173142', time=2024-09-12T02:52:51.083300+0000, chain.objs.size()=1 2024-09-12T01:10:59.243 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.244+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.D76_oUXLdW8x1CfMKTlOcdoqYMyv-nL_0 2024-09-12T01:10:59.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.245+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12882694370552162420', time=2024-09-12T02:53:00.681293+0000, chain.objs.size()=1 2024-09-12T01:10:59.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.245+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.306__shadow_.NSTiUdntvRMHnj8CFBP0OcXYU0g5K6E_0 2024-09-12T01:10:59.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.245+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11312436580276230156', time=2024-09-12T02:53:01.527834+0000, chain.objs.size()=1 2024-09-12T01:10:59.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.245+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.307__shadow_.la5mueHwKqIj6kQrLuqqvXBFD6QVANo_0 2024-09-12T01:10:59.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.245+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15389009649130129529', time=2024-09-12T02:53:49.602114+0000, chain.objs.size()=1 2024-09-12T01:10:59.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.245+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.1d6XeRMgii2BKMSB4B34wnPc4SLo9X8_0 2024-09-12T01:10:59.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.245+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13635402397661684716', time=2024-09-12T02:53:49.696630+0000, chain.objs.size()=1 2024-09-12T01:10:59.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.245+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.i3_WZdrFiiWw3B1ycO76VklRnrOAkBE_0 2024-09-12T01:10:59.244 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.245+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14805422827550879375', time=2024-09-12T02:53:49.753910+0000, chain.objs.size()=1 2024-09-12T01:10:59.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.245+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.y7lvZjwW0b_kiQxOzKMLSibiWdtqD5u_0 2024-09-12T01:10:59.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.245+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.734531881776784067', time=2024-09-12T02:53:50.268672+0000, chain.objs.size()=1 2024-09-12T01:10:59.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.245+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bovLpAioGDZlDUuusPsTXcEnWmM7i36_0 2024-09-12T01:10:59.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.245+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8116675968594923052', time=2024-09-12T02:53:50.367917+0000, chain.objs.size()=1 2024-09-12T01:10:59.245 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.245+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tRctb-_VIBZDqfXqEKgEaK4C3C3fVXf_0 2024-09-12T01:10:59.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.247+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14952536147787399617', time=2024-09-12T02:53:50.379345+0000, chain.objs.size()=1 2024-09-12T01:10:59.246 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.247+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.OLAITxggSCL66KW2tLvpfYfSJGbp6pZ_0 2024-09-12T01:10:59.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.248+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5392538026825481822', time=2024-09-12T02:53:50.976422+0000, chain.objs.size()=1 2024-09-12T01:10:59.247 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.248+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.-8FmbGpXOTBICCqk8PXmQUKGtueTgQM_0 2024-09-12T01:10:59.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.249+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7058367887355013419', time=2024-09-12T02:53:51.309384+0000, chain.objs.size()=1 2024-09-12T01:10:59.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.249+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.sPcHwdHKQmSQSiJDsADy_51MjAKb1UL_0 2024-09-12T01:10:59.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.249+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3689963903110239523', time=2024-09-12T02:53:51.459948+0000, chain.objs.size()=1 2024-09-12T01:10:59.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.249+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.PGfy1INwGawlhhzDBAM4hZZvuoCQBmu_0 2024-09-12T01:10:59.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.249+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9297786024251584714', time=2024-09-12T02:53:51.783001+0000, chain.objs.size()=1 2024-09-12T01:10:59.248 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.249+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.CSBPvOt2cRNQ8fJNL1O83INedHPUTln_0 2024-09-12T01:10:59.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.250+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8806084154235427053', time=2024-09-12T02:53:52.302245+0000, chain.objs.size()=1 2024-09-12T01:10:59.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.250+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nIQZeZOrzwZuGgWQ3Ys6kswmoUqi5bP_0 2024-09-12T01:10:59.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.250+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3702914275742835531', time=2024-09-12T02:53:52.414529+0000, chain.objs.size()=1 2024-09-12T01:10:59.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.250+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.MpbzjAu6NDvCvHIxXcz84g16oeGYwwH_0 2024-09-12T01:10:59.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.250+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17542448757064740157', time=2024-09-12T02:53:52.617584+0000, chain.objs.size()=1 2024-09-12T01:10:59.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.250+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.HtUktFxEXSxIx7OJ-OCeKaaSCDUh2Fj_0 2024-09-12T01:10:59.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.250+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13205867970650623503', time=2024-09-12T02:53:52.665709+0000, chain.objs.size()=1 2024-09-12T01:10:59.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.250+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qSz5iuotvC16URV-Jldqwk_m3foMHsE_0 2024-09-12T01:10:59.249 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.250+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7604477615513950722', time=2024-09-12T02:53:53.730087+0000, chain.objs.size()=1 2024-09-12T01:10:59.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.250+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lG_kQHACyKN75_24x3n7hJPpB_QDo6k_0 2024-09-12T01:10:59.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.250+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14955018102108601544', time=2024-09-12T02:53:53.883166+0000, chain.objs.size()=1 2024-09-12T01:10:59.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.250+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.76dk7qqSaL2Fe-YczAoKAD94pwirZAO_0 2024-09-12T01:10:59.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.250+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4000662258608896713', time=2024-09-12T02:53:55.111381+0000, chain.objs.size()=1 2024-09-12T01:10:59.250 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.250+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_._dqsq67di1KzMgxi0YonLY-D2Ec9LlU_0 2024-09-12T01:10:59.251 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.252+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3481026754973639617', time=2024-09-12T02:53:55.377425+0000, chain.objs.size()=1 2024-09-12T01:10:59.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.252+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.9XuHMHm2AZ3_Ax4aYUXldhg34LNwvY2_0 2024-09-12T01:10:59.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.252+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2437328512308962601', time=2024-09-12T02:53:55.410068+0000, chain.objs.size()=1 2024-09-12T01:10:59.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.252+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hvPx8AZAl14Tkv3-iBc_3W_TyBUnFms_0 2024-09-12T01:10:59.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.252+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9896388456764179094', time=2024-09-12T02:53:55.547059+0000, chain.objs.size()=1 2024-09-12T01:10:59.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.252+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.xRtd5702UwtRkPeapjS8LUlUYNxksOl_0 2024-09-12T01:10:59.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.252+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9210623801997470584', time=2024-09-12T02:53:55.738989+0000, chain.objs.size()=1 2024-09-12T01:10:59.252 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.252+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.rBPJrlMKOKqMhsE1QQV1_XTnMiaxFkZ_0 2024-09-12T01:10:59.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.253+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10426225444404488759', time=2024-09-12T02:53:55.820273+0000, chain.objs.size()=1 2024-09-12T01:10:59.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.253+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nMnrg1TuWkvwFJiHuVujdQx1par6yN9_0 2024-09-12T01:10:59.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.253+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13531955368083931154', time=2024-09-12T02:53:56.015870+0000, chain.objs.size()=1 2024-09-12T01:10:59.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.253+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.RSg7uLZqw2fuvGk_w9s1DQE2fShsKUk_0 2024-09-12T01:10:59.253 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.255+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12456777846144490597', time=2024-09-12T02:53:56.490922+0000, chain.objs.size()=1 2024-09-12T01:10:59.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.255+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.QbBK-6nPdTOZPI0tuTqLt1p-kz6qvWA_0 2024-09-12T01:10:59.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.255+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.199721598769590485', time=2024-09-12T02:53:56.729042+0000, chain.objs.size()=1 2024-09-12T01:10:59.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.255+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5JwQz1RvpdgIB_gc48rUb6fi35hWcYA_0 2024-09-12T01:10:59.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.255+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3355813305053086281', time=2024-09-12T02:53:56.977700+0000, chain.objs.size()=1 2024-09-12T01:10:59.254 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.255+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Mn5yGJtGQBZqvKVu2Y2zP--qdwHz9Vb_0 2024-09-12T01:10:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.255+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9181273589031952939', time=2024-09-12T02:53:58.668868+0000, chain.objs.size()=1 2024-09-12T01:10:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.255+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.GwsIhxw3_VwQQBWZJM5tnnqmUgWeHXY_0 2024-09-12T01:10:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.255+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17070026383754148908', time=2024-09-12T02:53:59.007873+0000, chain.objs.size()=1 2024-09-12T01:10:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.255+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.1tuXCMNeLXk2XnRRJx50sgqdwwUKpt4_0 2024-09-12T01:10:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.256+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4452817072402946286', time=2024-09-12T02:53:59.467532+0000, chain.objs.size()=1 2024-09-12T01:10:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.256+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.EwS8NARvx11GJa9gwIJ-LRVj7h2_5qO_0 2024-09-12T01:10:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.256+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8359075936947334850', time=2024-09-12T02:53:59.706861+0000, chain.objs.size()=1 2024-09-12T01:10:59.255 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.256+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.a1aBcCrlnXjUegcsi8LFvxSdc2t4A94_0 2024-09-12T01:10:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.256+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15317891482218903521', time=2024-09-12T02:54:37.089446+0000, chain.objs.size()=1 2024-09-12T01:10:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.256+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.OGD0A68zj8WuaUA_VyMavm_UMmfanc8_0 2024-09-12T01:10:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.256+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1759310183736774074', time=2024-09-12T02:54:37.186720+0000, chain.objs.size()=1 2024-09-12T01:10:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.256+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.4mx-8ucW3RJwsmHU1jubPDoGId6HxHM_0 2024-09-12T01:10:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.256+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2143283271199203833', time=2024-09-12T02:54:37.193640+0000, chain.objs.size()=1 2024-09-12T01:10:59.256 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.256+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.4pp6jlNoZj9qqOiTqbVxxcQ__57680n_0 2024-09-12T01:10:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.258+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11527012768247698474', time=2024-09-12T02:54:37.357578+0000, chain.objs.size()=1 2024-09-12T01:10:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.258+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.H_84RTW5gJ44gLMMkuofcz9tVBeJurE_0 2024-09-12T01:10:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.258+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7846199068213167228', time=2024-09-12T02:54:37.519412+0000, chain.objs.size()=1 2024-09-12T01:10:59.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.258+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._UN9qRkQvqbtBTNKOzlsGiScgxEksLK_0 2024-09-12T01:10:59.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.258+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6878513088009910303', time=2024-09-12T02:54:38.572501+0000, chain.objs.size()=1 2024-09-12T01:10:59.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.258+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.o0MYQtaRqV_q3EBm15Eq2DLsD3gLX30_0 2024-09-12T01:10:59.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.259+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3810024447168521381', time=2024-09-12T02:54:39.692192+0000, chain.objs.size()=1 2024-09-12T01:10:59.258 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.259+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9Ff-fU4RKwWutEbIU5JS9fwzHw3SE-U_0 2024-09-12T01:10:59.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.260+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18285928878089629664', time=2024-09-12T02:54:39.804881+0000, chain.objs.size()=1 2024-09-12T01:10:59.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.260+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.wue_f-JX-Dt9iABmIfsrf7paCgsE1Wg_0 2024-09-12T01:10:59.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.260+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12498100691966289750', time=2024-09-12T02:54:40.241883+0000, chain.objs.size()=1 2024-09-12T01:10:59.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.260+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.IaBj-0XidOyP28-b3nZJubRGi4QIiab_0 2024-09-12T01:10:59.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.260+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4578434452126222557', time=2024-09-12T02:54:40.375316+0000, chain.objs.size()=1 2024-09-12T01:10:59.259 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.260+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.xGcauVnJOUk-Vg1zqnw3ICO1wrFdPeK_0 2024-09-12T01:10:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.261+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1727594939259735346', time=2024-09-12T02:54:40.832912+0000, chain.objs.size()=1 2024-09-12T01:10:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.261+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._wi4J-YQHEHtSTkj_QaDMTCinAqgDUX_0 2024-09-12T01:10:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.261+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14056250344254873466', time=2024-09-12T02:54:41.032909+0000, chain.objs.size()=1 2024-09-12T01:10:59.260 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.261+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Qbb9-5C0x0B1hSUwW_gigaJuhU4BPL-_0 2024-09-12T01:10:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.261+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14477051698678200315', time=2024-09-12T02:54:41.354099+0000, chain.objs.size()=1 2024-09-12T01:10:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.261+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._OJqvqv-J3SwuHCQmPIIyl91_EkVUr2_0 2024-09-12T01:10:59.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.263+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10969899260651936455', time=2024-09-12T02:54:42.676430+0000, chain.objs.size()=1 2024-09-12T01:10:59.262 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.263+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.goPeqCcXtclQMd8CuS91sf3XPRBntub_0 2024-09-12T01:10:59.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.264+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8490823610119139613', time=2024-09-12T02:54:42.837889+0000, chain.objs.size()=1 2024-09-12T01:10:59.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.264+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.7nx2X8XjM61SJLkR-3WImmGImW_lrr1_0 2024-09-12T01:10:59.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.264+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3009723830699255432', time=2024-09-12T02:54:42.901192+0000, chain.objs.size()=1 2024-09-12T01:10:59.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.264+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.IJUfOmAaS5K0g86LpBbtbZJR60gyVrE_0 2024-09-12T01:10:59.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.264+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10230969203457119560', time=2024-09-12T02:54:42.974011+0000, chain.objs.size()=1 2024-09-12T01:10:59.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.264+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.lJB0iqFTKskoyvjdq5_86Eke99k_IiQ_0 2024-09-12T01:10:59.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.264+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15648512729853863634', time=2024-09-12T02:54:44.126577+0000, chain.objs.size()=1 2024-09-12T01:10:59.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.264+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.5MLCZ_M7Qu1eL0IAZrYuqUhweD4z_Id_0 2024-09-12T01:10:59.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.264+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6212589522792265847', time=2024-09-12T02:54:44.588616+0000, chain.objs.size()=1 2024-09-12T01:10:59.263 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.264+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.NJNttvjqum4YNgZ0vquQSi72aKXUz6b_0 2024-09-12T01:10:59.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.264+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2342011004611578241', time=2024-09-12T02:54:44.681382+0000, chain.objs.size()=1 2024-09-12T01:10:59.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.264+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dSo321TVfvNifyied3InBjeI4PkSqj7_0 2024-09-12T01:10:59.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.264+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12892019622832329699', time=2024-09-12T02:54:44.795464+0000, chain.objs.size()=1 2024-09-12T01:10:59.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.264+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.5snZ_loBK07Sbg7yXRGtmnQILeKl_6s_0 2024-09-12T01:10:59.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.265+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4510407358712221461', time=2024-09-12T02:54:45.420318+0000, chain.objs.size()=1 2024-09-12T01:10:59.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.265+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dgtAqQJ437JUbvXrFkUPI6bGKvofFSj_0 2024-09-12T01:10:59.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.265+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7345072870983459940', time=2024-09-12T02:54:45.671170+0000, chain.objs.size()=1 2024-09-12T01:10:59.264 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.265+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.TYSlK_JyncAwbvcMIrCAZY_yyC0XgxO_0 2024-09-12T01:10:59.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.265+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3154500664000275867', time=2024-09-12T02:54:45.888339+0000, chain.objs.size()=1 2024-09-12T01:10:59.265 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.265+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.p44ebyWrSxolurr7zBlyfTNgYtpxiz5_0 2024-09-12T01:10:59.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.267+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7526841937199998533', time=2024-09-12T02:54:46.382969+0000, chain.objs.size()=1 2024-09-12T01:10:59.266 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.267+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.S8y9StkMILQXnrz4zh03WNGPQoC-ZbM_0 2024-09-12T01:10:59.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.268+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8164111375953993470', time=2024-09-12T02:54:46.459264+0000, chain.objs.size()=1 2024-09-12T01:10:59.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.268+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.G-JiBhgiLzEuwUzKebEtw4IhFzLmvxl_0 2024-09-12T01:10:59.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.268+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12866891696407725564', time=2024-09-12T02:54:47.093541+0000, chain.objs.size()=1 2024-09-12T01:10:59.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.268+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6-kN7aQJyJTOymw29Nc4qcpOlRh8vI1_0 2024-09-12T01:10:59.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.268+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12685383792016310819', time=2024-09-12T02:54:49.023402+0000, chain.objs.size()=1 2024-09-12T01:10:59.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.268+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.329__shadow_.Crz6CDWGcSVCI5lgPxJYbYf9RhkIoiM_0 2024-09-12T01:10:59.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.268+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9086657147889987212', time=2024-09-12T02:54:50.672283+0000, chain.objs.size()=1 2024-09-12T01:10:59.267 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.268+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.332__shadow_.EQkPhRxJc_Us8wwqTelyCuXkOLGrXr__0 2024-09-12T01:10:59.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.268+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4789404108509216927', time=2024-09-12T02:55:08.919482+0000, chain.objs.size()=1 2024-09-12T01:10:59.268 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.268+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.371__shadow_.eEGkY9-DIBd0aKige83ecn560bvMNzo_0 2024-09-12T01:10:59.271 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.272+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/53508 2024-09-12T01:10:59.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T01:10:59.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16730232674201268366', time=2024-09-12T02:55:15.067312+0000, chain.objs.size()=1 2024-09-12T01:10:59.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.380__shadow_.IDzjY9bkT4AoLQER-FTupCqDIFBNDyQ_0 2024-09-12T01:10:59.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6908631302972482944', time=2024-09-12T02:56:19.477926+0000, chain.objs.size()=1 2024-09-12T01:10:59.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.487__shadow_.JNUjGuvKUCRJATHgXF4fSL5bt4KSLC9_0 2024-09-12T01:10:59.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1186756916688163093', time=2024-09-12T02:56:24.159282+0000, chain.objs.size()=1 2024-09-12T01:10:59.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.496__shadow_.b9C5e6YEY3hvTMiXng7ZSXEZMPB34d2_0 2024-09-12T01:10:59.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2230355865374377942', time=2024-09-12T02:58:12.344609+0000, chain.objs.size()=2 2024-09-12T01:10:59.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.524__multipart_mymultipart.2~jOkKy0Uff1IE1j_d_r20r2ZdFPudoMu.1 2024-09-12T01:10:59.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.524__multipart_mymultipart.2~jOkKy0Uff1IE1j_d_r20r2ZdFPudoMu.2 2024-09-12T01:10:59.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~78GyZS2eph8tfPmZ8OAvAFPKGV8PApd', time=2024-09-12T02:58:39.340034+0000, chain.objs.size()=2 2024-09-12T01:10:59.274 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.532__multipart_mymultipart2.2~78GyZS2eph8tfPmZ8OAvAFPKGV8PApd.1 2024-09-12T01:10:59.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.532__shadow_mymultipart2.2~78GyZS2eph8tfPmZ8OAvAFPKGV8PApd.1_1 2024-09-12T01:10:59.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11890724861102454572', time=2024-09-12T02:59:31.580840+0000, chain.objs.size()=1 2024-09-12T01:10:59.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.557__shadow_.CptxaZJ3t1Bf4565azYl_wR__lVwhTn_0 2024-09-12T01:10:59.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13049798819751896466', time=2024-09-12T02:59:43.318698+0000, chain.objs.size()=1 2024-09-12T01:10:59.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.563__shadow_._jX6yZGmdV7Z5poaFLmNNvmt0rknQ13_0 2024-09-12T01:10:59.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14582303309394235120', time=2024-09-12T03:00:05.327648+0000, chain.objs.size()=1 2024-09-12T01:10:59.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.573__shadow:lwSKIjrmvA8D703tMKj457YDK6KGAV-_.jtID8-txDBjkS5n7k8eE2stVRV_RoVX_0 2024-09-12T01:10:59.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6870861597582912060', time=2024-09-12T03:00:58.194482+0000, chain.objs.size()=1 2024-09-12T01:10:59.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.586__shadow:hfi1UEdeVyBVxinsPsbh6xDRr.pgMnq_.BqCqRwQmFwj_H3rrRD7nXx1alPSczSg_0 2024-09-12T01:10:59.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9147557567775230082', time=2024-09-12T03:01:07.583569+0000, chain.objs.size()=1 2024-09-12T01:10:59.275 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.274+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.603__shadow_.1IuIjBYszvYJLlkjdzYh6grQpKX2bjT_0 2024-09-12T01:10:59.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.277+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17064616422087619718', time=2024-09-12T03:04:51.787341+0000, chain.objs.size()=1 2024-09-12T01:10:59.276 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.277+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.630__shadow_.RyasOMXqmlvds7du9COwGWf4TxicS-z_0 2024-09-12T01:10:59.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.277+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12044844899787429366', time=2024-09-12T03:04:55.222541+0000, chain.objs.size()=1 2024-09-12T01:10:59.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.277+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.636__shadow_.BGyeKvQMPshlXZHJ_yL7TF3K3YLqSTW_0 2024-09-12T01:10:59.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.278+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5801230538881311538', time=2024-09-12T03:04:57.014978+0000, chain.objs.size()=1 2024-09-12T01:10:59.277 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.278+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.639__shadow_.hlbelKalc9lbYE2PgT_8sKh6wEAsu-v_0 2024-09-12T01:10:59.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.278+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17442647253388702924', time=2024-09-12T03:04:59.999837+0000, chain.objs.size()=1 2024-09-12T01:10:59.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.278+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.643__shadow_.Zf_j9da9HuSqHiNM5iLykMgK1U5jVEv_0 2024-09-12T01:10:59.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.278+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5861949896560843813', time=2024-09-12T03:05:47.903764+0000, chain.objs.size()=1 2024-09-12T01:10:59.278 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.278+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.691__shadow:p3Z2djwNa7t.CFu5N4YFp1qBBZXDUxL_.X7ovFLRI7vcDE-BK-h6YEHBnvYJjwEn_0 2024-09-12T01:10:59.281 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.282+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.283 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.284+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:10:59.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.285+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.284 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.285+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/58226' 2024-09-12T01:10:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5035524151094070496', time=2024-09-12T02:49:13.188932+0000, chain.objs.size()=3 2024-09-12T01:10:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.159__shadow_.XXieecKRKctWqpvuXQbDVuLoUArQ14c_0 2024-09-12T01:10:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.159__shadow_.XXieecKRKctWqpvuXQbDVuLoUArQ14c_1 2024-09-12T01:10:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.159__shadow_.XXieecKRKctWqpvuXQbDVuLoUArQ14c_2 2024-09-12T01:10:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='_Lt2EznPmYp7Lj_uwYR8qCUgdkIMl4N4', time=2024-09-12T02:49:21.890332+0000, chain.objs.size()=3 2024-09-12T01:10:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.yHApT5PDQ0WHs57ZbOvdVpLVczsKF2S_0 2024-09-12T01:10:59.286 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.yHApT5PDQ0WHs57ZbOvdVpLVczsKF2S_1 2024-09-12T01:10:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.yHApT5PDQ0WHs57ZbOvdVpLVczsKF2S_2 2024-09-12T01:10:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1660584734555290134', time=2024-09-12T02:51:34.655792+0000, chain.objs.size()=1 2024-09-12T01:10:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.245__shadow_.yXGepRwOrIpLuhkVzIy2PvGwxhGoulg_0 2024-09-12T01:10:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1439210758454473246', time=2024-09-12T02:51:42.511292+0000, chain.objs.size()=1 2024-09-12T01:10:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.258__shadow_.xmImS63TnB61w1pThW4Km4qgaSMNdUf_0 2024-09-12T01:10:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12807858169533908185', time=2024-09-12T02:51:43.086986+0000, chain.objs.size()=1 2024-09-12T01:10:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.259__shadow_.KabPXqnhqdDRXPmtt1j2m7G9FaKs99c_0 2024-09-12T01:10:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16509822592941328681', time=2024-09-12T02:52:21.763314+0000, chain.objs.size()=1 2024-09-12T01:10:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.TgcM1zMczJp5_qqSmWHUCB0GQGQw_8V_0 2024-09-12T01:10:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18444475634621158109', time=2024-09-12T02:52:22.888605+0000, chain.objs.size()=1 2024-09-12T01:10:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.cBJyu-SSVpoYitkZDfuIWt_zdhCnAlc_0 2024-09-12T01:10:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12804699056779814068', time=2024-09-12T02:52:23.019767+0000, chain.objs.size()=1 2024-09-12T01:10:59.287 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.286+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.HYcQ3lFwSYpTRlRvShP4zFsc6199u0N_0 2024-09-12T01:10:59.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2012610621721718117', time=2024-09-12T02:52:23.307802+0000, chain.objs.size()=1 2024-09-12T01:10:59.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.icSvWSgMESd4zb5MkvYoqxwvtKSFAJT_0 2024-09-12T01:10:59.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5265444393013199378', time=2024-09-12T02:52:23.736528+0000, chain.objs.size()=1 2024-09-12T01:10:59.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xgbcJVcSxt_dDcdZ3R4K_LJeDttenvH_0 2024-09-12T01:10:59.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6545932750874076503', time=2024-09-12T02:52:24.351923+0000, chain.objs.size()=1 2024-09-12T01:10:59.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.upWxcIPg2Bo1QQuxC9pD_AbFvxhRFAB_0 2024-09-12T01:10:59.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5045488085041496758', time=2024-09-12T02:52:24.512284+0000, chain.objs.size()=1 2024-09-12T01:10:59.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1_eYAfWENq8YiQCsje41FIA_Q-VjZrK_0 2024-09-12T01:10:59.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9956710131719806211', time=2024-09-12T02:52:24.662432+0000, chain.objs.size()=1 2024-09-12T01:10:59.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.kW8X10IzpRSrYZtWMKeuyLIBexMkEAX_0 2024-09-12T01:10:59.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12756331763074118412', time=2024-09-12T02:52:25.596045+0000, chain.objs.size()=1 2024-09-12T01:10:59.289 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._4hjBCgfXV0IlxUVPH0MU8cIGFvr9Kn_0 2024-09-12T01:10:59.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12782401761439996364', time=2024-09-12T02:52:26.053003+0000, chain.objs.size()=1 2024-09-12T01:10:59.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.lKo62Sq0tyGkk74j6xtbZrOlKDC62ch_0 2024-09-12T01:10:59.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15198359631297179345', time=2024-09-12T02:52:26.195250+0000, chain.objs.size()=1 2024-09-12T01:10:59.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1-1eqKqiA5J8cUjNj5omuprzdHo9O8O_0 2024-09-12T01:10:59.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17331762209961499296', time=2024-09-12T02:52:26.262951+0000, chain.objs.size()=1 2024-09-12T01:10:59.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.289+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1nXpEezgepKliGuhzDF5gUkO7kdM7zD_0 2024-09-12T01:10:59.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.290+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.593942455314336322', time=2024-09-12T02:52:26.276930+0000, chain.objs.size()=1 2024-09-12T01:10:59.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.290+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.I2Qr1EfZnFoSA-iPlzlonaH9kDxpsoJ_0 2024-09-12T01:10:59.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.290+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3174648178241478037', time=2024-09-12T02:52:26.329791+0000, chain.objs.size()=1 2024-09-12T01:10:59.290 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.290+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.7R1ngmG-ZHB-njYq7dJ_xDnWE4g6V5I_0 2024-09-12T01:10:59.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.292+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9718071813208623070', time=2024-09-12T02:52:27.304351+0000, chain.objs.size()=1 2024-09-12T01:10:59.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.292+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.e5PW4eX7WNGQQvytsZ399Zo9qP9Rv5l_0 2024-09-12T01:10:59.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.292+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16805511258165356954', time=2024-09-12T02:52:27.566230+0000, chain.objs.size()=1 2024-09-12T01:10:59.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.292+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._o-Vldb36w_AMvyprizc54rZp4xwdf0_0 2024-09-12T01:10:59.291 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.292+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13443454381162346883', time=2024-09-12T02:52:27.919369+0000, chain.objs.size()=1 2024-09-12T01:10:59.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.292+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5BeGs0oN-3JXCPHXfeicD2dA4MwG9Jk_0 2024-09-12T01:10:59.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.293+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3982193533519407246', time=2024-09-12T02:52:28.070536+0000, chain.objs.size()=1 2024-09-12T01:10:59.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.293+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4e9XcU5kI08LdowXzeBS0D7DfF4Lwdx_0 2024-09-12T01:10:59.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.293+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15403023631492136889', time=2024-09-12T02:52:28.075661+0000, chain.objs.size()=1 2024-09-12T01:10:59.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.293+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.swsy85c3l4RtnYten6V8-sZ2i4P8zAR_0 2024-09-12T01:10:59.292 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.293+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.97679418890764040', time=2024-09-12T02:52:28.425682+0000, chain.objs.size()=1 2024-09-12T01:10:59.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.293+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xB3mqf3OeX5DZKPjucWpYBq23shKuof_0 2024-09-12T01:10:59.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.293+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1034920839225108179', time=2024-09-12T02:52:29.388830+0000, chain.objs.size()=1 2024-09-12T01:10:59.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.293+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KLGTkn-ECb8sZoDnthjtqb2zNHqYKZZ_0 2024-09-12T01:10:59.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.293+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8808694048043616908', time=2024-09-12T02:52:30.544073+0000, chain.objs.size()=1 2024-09-12T01:10:59.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.293+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.g5g1GQno-icilij9166wkx83KHlC6V-_0 2024-09-12T01:10:59.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.293+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18149140286909176467', time=2024-09-12T02:52:30.704131+0000, chain.objs.size()=1 2024-09-12T01:10:59.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.293+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.n4AwqW3hN6DlpHW3a0czcUSx6ZnHngx_0 2024-09-12T01:10:59.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.294+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2666997631967602216', time=2024-09-12T02:52:31.275798+0000, chain.objs.size()=1 2024-09-12T01:10:59.293 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.294+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wKvbspK_BI2NxG42VE9wpcUjLdqoRgh_0 2024-09-12T01:10:59.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.294+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5689947965202718109', time=2024-09-12T02:52:41.182595+0000, chain.objs.size()=1 2024-09-12T01:10:59.294 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.294+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.279__shadow_.uNI83S3zIb1PpOGocYjIFLEm-F4xqgN_0 2024-09-12T01:10:59.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.296+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2163579873511871881', time=2024-09-12T02:52:43.627811+0000, chain.objs.size()=1 2024-09-12T01:10:59.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.296+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.283__shadow_.Q27WBoN2ANVScDZ1zUp6qLPkZUXwET8_0 2024-09-12T01:10:59.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.296+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1785374016628851463', time=2024-09-12T02:52:53.197184+0000, chain.objs.size()=1 2024-09-12T01:10:59.295 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.296+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.sJ0HHAtcY-j83sYPN8E3bGegGeaTO75_0 2024-09-12T01:10:59.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.297+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7868520604538115202', time=2024-09-12T02:52:55.075498+0000, chain.objs.size()=1 2024-09-12T01:10:59.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.297+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.297__shadow_.nitHdQRtKA6JIX0yU6AGLdR-jbuf9fm_0 2024-09-12T01:10:59.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.297+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10619634813487172592', time=2024-09-12T02:52:57.665947+0000, chain.objs.size()=1 2024-09-12T01:10:59.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.297+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.301__shadow_.a12YtWMR34omLGKGtRBVET3CRQnRmo4_0 2024-09-12T01:10:59.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.297+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13282051290113126856', time=2024-09-12T02:53:12.035989+0000, chain.objs.size()=1 2024-09-12T01:10:59.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.297+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.323__shadow_.rwmMSY8wXCy_sH8PjQmZUlwk1HgEZ9D_0 2024-09-12T01:10:59.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.297+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11598932150397985576', time=2024-09-12T02:53:49.556117+0000, chain.objs.size()=1 2024-09-12T01:10:59.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.297+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.xAOvGYmkvpVoh6EeOKLUDEzObzfoWAk_0 2024-09-12T01:10:59.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.297+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15877878865116057226', time=2024-09-12T02:53:50.076154+0000, chain.objs.size()=1 2024-09-12T01:10:59.296 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.297+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.MKUaPqEF7wqRvt1ue3VNstLTstR17sn_0 2024-09-12T01:10:59.297 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.298+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3564973011546650101', time=2024-09-12T02:53:50.162723+0000, chain.objs.size()=1 2024-09-12T01:10:59.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.298+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.eLDFxeqDw7jyijr_chAV5yT8PfRNm_7_0 2024-09-12T01:10:59.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.298+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7509810544901305067', time=2024-09-12T02:53:50.247013+0000, chain.objs.size()=1 2024-09-12T01:10:59.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.298+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5EKkFskAYQCE5hxyw90tWrt7vPkAehl_0 2024-09-12T01:10:59.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.298+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14496914239609289385', time=2024-09-12T02:53:50.391547+0000, chain.objs.size()=1 2024-09-12T01:10:59.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.298+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lXOiyvKEf1gn0x-im-cONYYAOgIAL-V_0 2024-09-12T01:10:59.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.298+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14978848491579415425', time=2024-09-12T02:53:51.127828+0000, chain.objs.size()=1 2024-09-12T01:10:59.298 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.298+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dbQpRWsr83hdn51x-GBJfmZ7ut2RyRx_0 2024-09-12T01:10:59.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.300+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3684215592009821112', time=2024-09-12T02:53:51.355568+0000, chain.objs.size()=1 2024-09-12T01:10:59.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.300+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.KOIRIZR2kqvdaxa8-VoqR1pCXaAkcFc_0 2024-09-12T01:10:59.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.300+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7339366923624477860', time=2024-09-12T02:53:51.636821+0000, chain.objs.size()=1 2024-09-12T01:10:59.299 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.300+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.DDnqM7SilJY5sm_08oSPL06TQtSKD6I_0 2024-09-12T01:10:59.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.301+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6605822810451123803', time=2024-09-12T02:53:52.391311+0000, chain.objs.size()=1 2024-09-12T01:10:59.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.301+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Em1R18MlQ0G1PqCtwGURCZBzogPzL5P_0 2024-09-12T01:10:59.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.301+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15278544510761518703', time=2024-09-12T02:53:52.518813+0000, chain.objs.size()=1 2024-09-12T01:10:59.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.301+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.XVe--3gdmlr0SAeamkq1mGofJUSaSrJ_0 2024-09-12T01:10:59.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.301+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11873242126486036837', time=2024-09-12T02:53:53.239432+0000, chain.objs.size()=1 2024-09-12T01:10:59.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.301+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.f3IymqJMnW9LN-CoSMbFa-vqp3xC7LS_0 2024-09-12T01:10:59.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.301+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4447813065632067210', time=2024-09-12T02:53:53.764950+0000, chain.objs.size()=1 2024-09-12T01:10:59.300 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.301+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.GL_wqzZ3Y37-h0sWofXaOyvMu_2SHmy_0 2024-09-12T01:10:59.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.301+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7287189113704745532', time=2024-09-12T02:53:53.963552+0000, chain.objs.size()=1 2024-09-12T01:10:59.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.301+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.FqC2D2OVuFro600d4KysHBUm-5GoFEN_0 2024-09-12T01:10:59.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.302+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10749599840090339860', time=2024-09-12T02:53:54.215651+0000, chain.objs.size()=1 2024-09-12T01:10:59.301 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.302+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.s0xJYBnBJ60LE8nc0tOiDiLqJ2M5fIT_0 2024-09-12T01:10:59.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.303+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9171701103614616776', time=2024-09-12T02:53:54.658677+0000, chain.objs.size()=1 2024-09-12T01:10:59.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.303+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.8LMZ93nXHeR-g-1piR3gL4jwBz26yyG_0 2024-09-12T01:10:59.302 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.303+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8410660746829444411', time=2024-09-12T02:53:55.632586+0000, chain.objs.size()=1 2024-09-12T01:10:59.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.303+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Ywlyv-6yiANjyK6Ee8q_mgMivsCEgeS_0 2024-09-12T01:10:59.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.303+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10635017034960384325', time=2024-09-12T02:53:55.633482+0000, chain.objs.size()=1 2024-09-12T01:10:59.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.303+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.4ixxbNNCeGul-p5zfi46lLHPoTa7qas_0 2024-09-12T01:10:59.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.303+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12257362914734623030', time=2024-09-12T02:53:55.778165+0000, chain.objs.size()=1 2024-09-12T01:10:59.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.303+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.YwhM29ZrvTQjsVALnzaMs3dvG-8miqV_0 2024-09-12T01:10:59.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.303+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10659401520350614425', time=2024-09-12T02:53:55.961811+0000, chain.objs.size()=1 2024-09-12T01:10:59.303 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.303+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.F0JKvBsw4qnh5_Bmao1dd-RU6Czl96t_0 2024-09-12T01:10:59.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12803254156197438501', time=2024-09-12T02:53:56.491318+0000, chain.objs.size()=1 2024-09-12T01:10:59.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ONl_yF-xyb3zaPGtSwDbaM1vRkMzmfn_0 2024-09-12T01:10:59.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12484622272594789219', time=2024-09-12T02:53:56.628070+0000, chain.objs.size()=1 2024-09-12T01:10:59.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Y9HrhyIcEo6bga0LV1Y9ZRl9mPqvgp__0 2024-09-12T01:10:59.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9183783980554153492', time=2024-09-12T02:53:56.839279+0000, chain.objs.size()=1 2024-09-12T01:10:59.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lOFQgnLGjoYLe_S51xZW9SSlV2GKknZ_0 2024-09-12T01:10:59.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10158741899806844988', time=2024-09-12T02:53:56.990719+0000, chain.objs.size()=1 2024-09-12T01:10:59.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Zsmsir2RDS5C5YF2XArsVDsCWUY2QLU_0 2024-09-12T01:10:59.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15314948738725467772', time=2024-09-12T02:53:57.275659+0000, chain.objs.size()=1 2024-09-12T01:10:59.305 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hivXclpzKoRA-uEVhJ4vE-Gxy1gFbYR_0 2024-09-12T01:10:59.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2862700780644277045', time=2024-09-12T02:53:58.376175+0000, chain.objs.size()=1 2024-09-12T01:10:59.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hCSdBu3cC-thOZPAZvqFtDT7WSbKwKs_0 2024-09-12T01:10:59.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17920052609440721573', time=2024-09-12T02:53:58.947931+0000, chain.objs.size()=1 2024-09-12T01:10:59.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.EFfCui9vwXZKLuvCO0ZBrEEsbz5La8L_0 2024-09-12T01:10:59.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4804800013855315176', time=2024-09-12T02:53:59.703069+0000, chain.objs.size()=1 2024-09-12T01:10:59.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.PEzoqV1uZC5ubS9_jZOmifwDPBeazWR_0 2024-09-12T01:10:59.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8487120999360364832', time=2024-09-12T02:54:37.002034+0000, chain.objs.size()=1 2024-09-12T01:10:59.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.zHrhWa48DJNmNWJ0VGVlPU6tBxL5XUb_0 2024-09-12T01:10:59.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11993091369384729407', time=2024-09-12T02:54:37.132682+0000, chain.objs.size()=1 2024-09-12T01:10:59.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.gVxo1ZO9vbPegmBRYUAcd8JU0F4MGr7_0 2024-09-12T01:10:59.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15578741204641769372', time=2024-09-12T02:54:37.372512+0000, chain.objs.size()=1 2024-09-12T01:10:59.306 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.306+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.0695jNmtn8r-0WZF9wFeixtklMt_cl9_0 2024-09-12T01:10:59.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.308+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3579109710674543693', time=2024-09-12T02:54:38.674425+0000, chain.objs.size()=1 2024-09-12T01:10:59.307 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.308+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Ot8n1YwW8b4EqIn0c692NK4o48MoFv1_0 2024-09-12T01:10:59.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.309+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18200010292675452748', time=2024-09-12T02:54:40.120097+0000, chain.objs.size()=1 2024-09-12T01:10:59.308 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.309+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Sc3i0WgVJwKN759Ttpqnn-2yKSLPKzq_0 2024-09-12T01:10:59.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.310+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13806550925224740520', time=2024-09-12T02:54:40.298764+0000, chain.objs.size()=1 2024-09-12T01:10:59.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.310+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.CwNkbHFJ1Ml0_N156QtLL0T7FiGU4hc_0 2024-09-12T01:10:59.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.310+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1701370080341173852', time=2024-09-12T02:54:40.954792+0000, chain.objs.size()=1 2024-09-12T01:10:59.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.310+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6E9Y0W1LPsuUtw_gpZqbaPYV3iuzrcX_0 2024-09-12T01:10:59.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.310+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10571184916176552291', time=2024-09-12T02:54:41.350532+0000, chain.objs.size()=1 2024-09-12T01:10:59.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.310+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fQ1KH3fzRSFAxA810tDTW7EdB91X8uP_0 2024-09-12T01:10:59.309 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.310+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11585738096593986752', time=2024-09-12T02:54:41.622335+0000, chain.objs.size()=1 2024-09-12T01:10:59.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.310+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.-heUoN2ehpaYI_POeBQKdHZdwssKEqE_0 2024-09-12T01:10:59.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.310+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.295400936670833974', time=2024-09-12T02:54:42.206939+0000, chain.objs.size()=1 2024-09-12T01:10:59.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.310+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.geL0ZLhd3TKqK4fWDGu8xk1v6Zdwj84_0 2024-09-12T01:10:59.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.310+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1811405334216569979', time=2024-09-12T02:54:42.207568+0000, chain.objs.size()=1 2024-09-12T01:10:59.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.310+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nMxcsY243iTF70h0KfJQ-f-Qqz0GIhJ_0 2024-09-12T01:10:59.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.311+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1210745067984755713', time=2024-09-12T02:54:42.208279+0000, chain.objs.size()=1 2024-09-12T01:10:59.310 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.311+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.8YsX2Mxdb0WOoW5mxdFVRIxwdTD4yWq_0 2024-09-12T01:10:59.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.311+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15680715356001245683', time=2024-09-12T02:54:42.532444+0000, chain.objs.size()=1 2024-09-12T01:10:59.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.311+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.oYFiefS4RdiCe1PJwq3l8TK0KG_ivRV_0 2024-09-12T01:10:59.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.311+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6633656205191578558', time=2024-09-12T02:54:42.533269+0000, chain.objs.size()=1 2024-09-12T01:10:59.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.311+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.RQmylnKLrk1vGaIaIjRR2hIoQsFE08__0 2024-09-12T01:10:59.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.311+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9386253843028655594', time=2024-09-12T02:54:42.698432+0000, chain.objs.size()=1 2024-09-12T01:10:59.311 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.311+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.UfB6Nw-8IK_kQ0uj3pJnA7KVq6OBcIf_0 2024-09-12T01:10:59.313 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2222130661611325325', time=2024-09-12T02:54:43.882948+0000, chain.objs.size()=1 2024-09-12T01:10:59.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.qHx87GU9PO46j8q0TE6AXSR0iigYebl_0 2024-09-12T01:10:59.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16415878046708628035', time=2024-09-12T02:54:43.977167+0000, chain.objs.size()=1 2024-09-12T01:10:59.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.mAxeBB3-EZZV7Do5d0ErGJ9-bryWnsD_0 2024-09-12T01:10:59.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18073169003051417328', time=2024-09-12T02:54:44.268777+0000, chain.objs.size()=1 2024-09-12T01:10:59.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.yYKFpEykBb84kstDVS2C0R0fc3VmI2E_0 2024-09-12T01:10:59.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9739751019263025608', time=2024-09-12T02:54:44.269624+0000, chain.objs.size()=1 2024-09-12T01:10:59.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Dzk_schIS81c_bwVvmlPr9N1PvlfUSV_0 2024-09-12T01:10:59.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14439839409243762794', time=2024-09-12T02:54:44.353287+0000, chain.objs.size()=1 2024-09-12T01:10:59.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ADY6DbIaRWtD35Mq6Wn6MTJhL2MMlY7_0 2024-09-12T01:10:59.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14493923441498216855', time=2024-09-12T02:54:44.499273+0000, chain.objs.size()=1 2024-09-12T01:10:59.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.QBOsJalQkhGr26aAgr9guPlKdyuhFWP_0 2024-09-12T01:10:59.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12094096216349670602', time=2024-09-12T02:54:44.536023+0000, chain.objs.size()=1 2024-09-12T01:10:59.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.7uWNohjH0BJkhXM-hAZpMVJebhWLoG-_0 2024-09-12T01:10:59.314 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10217001312897334939', time=2024-09-12T02:54:44.706266+0000, chain.objs.size()=1 2024-09-12T01:10:59.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.314+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.e_b2Mt_5-nKMcorqqiUjNdfYVtYWcbQ_0 2024-09-12T01:10:59.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.315+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12139457606426107326', time=2024-09-12T02:54:45.248846+0000, chain.objs.size()=1 2024-09-12T01:10:59.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.315+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ZJiLqr0Z_RJqsOKJAlXK04a2z2w0exP_0 2024-09-12T01:10:59.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.315+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9823001979614334670', time=2024-09-12T02:54:45.966054+0000, chain.objs.size()=1 2024-09-12T01:10:59.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.315+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.rKsRGzji8-zkDTsOUfENif8Ak6nno1f_0 2024-09-12T01:10:59.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.315+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7370487046333463063', time=2024-09-12T02:54:46.343901+0000, chain.objs.size()=1 2024-09-12T01:10:59.315 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.315+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.GPMBL3FQ9g58UdXT-mjurWYd66XHRNC_0 2024-09-12T01:10:59.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.318+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6932370844584116307', time=2024-09-12T02:54:46.673496+0000, chain.objs.size()=1 2024-09-12T01:10:59.317 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.318+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.H4zM6C8I3wclKK2GUemt-JihuV7DFq7_0 2024-09-12T01:10:59.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4792760810632491121', time=2024-09-12T02:54:49.474526+0000, chain.objs.size()=1 2024-09-12T01:10:59.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.330__shadow_.YHDXWxV2TbTg5Cj_8xJFoymX011B7b4_0 2024-09-12T01:10:59.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17998103491934774947', time=2024-09-12T02:55:49.081098+0000, chain.objs.size()=1 2024-09-12T01:10:59.318 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.441__shadow_.6Le_8AxCzFv6UJjSjErHihchpO62md8_0 2024-09-12T01:10:59.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6349907019711821573', time=2024-09-12T02:56:12.233799+0000, chain.objs.size()=1 2024-09-12T01:10:59.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.482__shadow_.5U1KjC_UTm4jp0NpRmzoKEGdYEqKnBW_0 2024-09-12T01:10:59.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4389491076525894098', time=2024-09-12T02:56:19.474312+0000, chain.objs.size()=1 2024-09-12T01:10:59.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.487__shadow_.JNUjGuvKUCRJATHgXF4fSL5bt4KSLC9_0 2024-09-12T01:10:59.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2178397540738461285', time=2024-09-12T02:56:29.493236+0000, chain.objs.size()=1 2024-09-12T01:10:59.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.504__shadow:IjSk329PwyZ.TikPwkNaT-eseYUSzXd_.b_0nQhQp9blBOoB3SP2J2YjUhbBu0Hw_0 2024-09-12T01:10:59.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11891418190213757852', time=2024-09-12T02:57:14.358938+0000, chain.objs.size()=3 2024-09-12T01:10:59.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.522__multipart_mymultipart.2~tIdfBm72FSUJsIPoM_mcOuXN6SqUpvy.1 2024-09-12T01:10:59.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.522__multipart_mymultipart.2~tIdfBm72FSUJsIPoM_mcOuXN6SqUpvy.2 2024-09-12T01:10:59.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.522__multipart_mymultipart.2~tIdfBm72FSUJsIPoM_mcOuXN6SqUpvy.3 2024-09-12T01:10:59.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16287205738068234489', time=2024-09-12T02:58:26.334848+0000, chain.objs.size()=1 2024-09-12T01:10:59.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.525__shadow_.qHhNYOpNvOKq-QLuReOJJS7Z3PPPtZS_0 2024-09-12T01:10:59.319 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14129115064694623398', time=2024-09-12T02:59:19.476232+0000, chain.objs.size()=1 2024-09-12T01:10:59.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.319+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.551__shadow_.qGJibVViLr07hgWmtRrRsWs95xOiS0y_0 2024-09-12T01:10:59.320 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.322+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15731033454151067352', time=2024-09-12T02:59:35.045095+0000, chain.objs.size()=1 2024-09-12T01:10:59.321 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.322+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.558__shadow_.AbrLf6o6sTMVAAUsCOtRMObU8HX4P-F_0 2024-09-12T01:10:59.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.323+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16349848547478622916', time=2024-09-12T02:59:52.952946+0000, chain.objs.size()=1 2024-09-12T01:10:59.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.323+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:C-u1o4t8F2vc3lyE-HyTttpJzmfCM-P_.IAJ1ptcEH9x3Q9-wzKavInasQWaWkeX_0 2024-09-12T01:10:59.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.323+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1277777117063792035', time=2024-09-12T02:59:55.649800+0000, chain.objs.size()=1 2024-09-12T01:10:59.322 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.323+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:nUbL3VVxH.x91jjndMs8oYU3VNmhdbh_.nqXUlkn5Kn4NbYsbHIV1l9i7llcNMr__0 2024-09-12T01:10:59.325 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.326+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/58226 2024-09-12T01:10:59.327 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T01:10:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8169276773826416855', time=2024-09-12T03:00:01.859010+0000, chain.objs.size()=1 2024-09-12T01:10:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:SRmPe5AVtn0D8Acs2FCrd68P4Rtp8Dc_.qxCy0Z5o773WC_EwPw1LdGSCFXpjrC__0 2024-09-12T01:10:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14343116847834891476', time=2024-09-12T03:00:09.224634+0000, chain.objs.size()=1 2024-09-12T01:10:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.575__shadow:PW3hS5W7-y53sJzNwdcgJnPTAXC-8pb_.sgCBolL5tjeywXeZivUehdNl2nzBwFG_0 2024-09-12T01:10:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1744147621494914705', time=2024-09-12T03:00:10.153453+0000, chain.objs.size()=1 2024-09-12T01:10:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.575__shadow:N84DwzwPQrKv.9JtvMkQTaweUdQnPyT_.ZW93hOszCcAShl-y_S-ITZBriU77cLL_0 2024-09-12T01:10:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5984618427446913262', time=2024-09-12T03:00:52.527068+0000, chain.objs.size()=1 2024-09-12T01:10:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.580__shadow:.U0CTVew2ABmzfWL7dL.s-s4mtDDj0p_.E3Fb2GMXGx6EpjrNV5vZh5SUY_B0h7F_0 2024-09-12T01:10:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2773702378930249843', time=2024-09-12T03:00:54.558078+0000, chain.objs.size()=1 2024-09-12T01:10:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.581__shadow:-gmMr83rYz.t5LsfNxRueg9nfitRab6_.Vuw0fDRA9HpUoJBk4KYKe2gClDrO1k5_0 2024-09-12T01:10:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7088863220577153290', time=2024-09-12T03:00:54.817096+0000, chain.objs.size()=1 2024-09-12T01:10:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.581__shadow:-gmMr83rYz.t5LsfNxRueg9nfitRab6_.Vuw0fDRA9HpUoJBk4KYKe2gClDrO1k5_0 2024-09-12T01:10:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4757351184618413508', time=2024-09-12T03:02:13.544060+0000, chain.objs.size()=1 2024-09-12T01:10:59.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.617__shadow_.cHe_rSG80qq8OCgKDBnT3t8KOej5Kru_0 2024-09-12T01:10:59.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2580088018044307636', time=2024-09-12T03:05:48.507124+0000, chain.objs.size()=1 2024-09-12T01:10:59.329 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.328+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.692__shadow_.nh5LFBNNTsdtpwcnWoj1VNkELKbsjMm_0 2024-09-12T01:10:59.331 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.332+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.333 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.334+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:10:59.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.336+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.335 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.336+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49823' 2024-09-12T01:10:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16156556887190785725', time=2024-09-12T02:49:13.215805+0000, chain.objs.size()=3 2024-09-12T01:10:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.159__shadow_.ux2_DEzH8FGm9S7YXRUyn4JyjHVDjTo_0 2024-09-12T01:10:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.159__shadow_.ux2_DEzH8FGm9S7YXRUyn4JyjHVDjTo_1 2024-09-12T01:10:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.159__shadow_.ux2_DEzH8FGm9S7YXRUyn4JyjHVDjTo_2 2024-09-12T01:10:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18266615418664415864', time=2024-09-12T02:49:44.396979+0000, chain.objs.size()=1 2024-09-12T01:10:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.183__shadow_.alrONPyG0xD_53X8hJ067dEh5z2iwmW_0 2024-09-12T01:10:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.954397702669399079', time=2024-09-12T02:51:27.275261+0000, chain.objs.size()=1 2024-09-12T01:10:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.234__shadow_.M4EP6G__Is5aMK9s_OKVQ0ToVnK5Q5G_0 2024-09-12T01:10:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10239622938788084680', time=2024-09-12T02:51:33.803083+0000, chain.objs.size()=1 2024-09-12T01:10:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.244__shadow_.mjDGWO_kCP3ssRXVI0ufUFaaR7S614E_0 2024-09-12T01:10:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6027744316796652504', time=2024-09-12T02:51:33.815331+0000, chain.objs.size()=1 2024-09-12T01:10:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.244__shadow_.5aCSf34yGZKFo1nlt9_pIHEwKd0nQL9_0 2024-09-12T01:10:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9381528714961637616', time=2024-09-12T02:51:36.483267+0000, chain.objs.size()=1 2024-09-12T01:10:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.248__shadow_.YbFLTUdJJJ4izLCO_wvxJbRD3fvEyer_0 2024-09-12T01:10:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1863341797297875096', time=2024-09-12T02:51:37.107218+0000, chain.objs.size()=1 2024-09-12T01:10:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.249__shadow_.oj09VpudrFYStQZK2FwRvg-9zFvq_Kg_0 2024-09-12T01:10:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13019174814745097388', time=2024-09-12T02:51:41.329826+0000, chain.objs.size()=1 2024-09-12T01:10:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.256__shadow_.CQCsr-YsSazfNKPUxcYiLcWX7MaNvFX_0 2024-09-12T01:10:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16531275942078071497', time=2024-09-12T02:51:43.675514+0000, chain.objs.size()=1 2024-09-12T01:10:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.260__shadow_.Ez9KQ6diQROyjDqOhZyYH39kkPiGih2_0 2024-09-12T01:10:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3176218119185246788', time=2024-09-12T02:52:21.451275+0000, chain.objs.size()=1 2024-09-12T01:10:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.337+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Wf7vJs8j_OYnV78ddR4sWFDt6gcRmAo_0 2024-09-12T01:10:59.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17850809221162584472', time=2024-09-12T02:52:22.168247+0000, chain.objs.size()=1 2024-09-12T01:10:59.339 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.lT7NAT8Nj6Evuq0eTkmmGUBRYdh4xOq_0 2024-09-12T01:10:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8293408145513646233', time=2024-09-12T02:52:22.220798+0000, chain.objs.size()=1 2024-09-12T01:10:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.v66Passqh3Bx3w3C8igolqLqS6PuvL6_0 2024-09-12T01:10:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11494225609656963031', time=2024-09-12T02:52:22.729481+0000, chain.objs.size()=1 2024-09-12T01:10:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.J3_ZaFQ5AblcynuPom_fKNRAwqSFop2_0 2024-09-12T01:10:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16559746341287931442', time=2024-09-12T02:52:23.098875+0000, chain.objs.size()=1 2024-09-12T01:10:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Zdyz8I1kea-nFSIlALOL-nXrsNPKVOk_0 2024-09-12T01:10:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.994405719863760422', time=2024-09-12T02:52:23.725656+0000, chain.objs.size()=1 2024-09-12T01:10:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.8stdJN732GfMv6T9XHHOoXYA0M_EUov_0 2024-09-12T01:10:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5257869072279768592', time=2024-09-12T02:52:23.738882+0000, chain.objs.size()=1 2024-09-12T01:10:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.HVKZSzXkF_IqBXbkOiRofvDKuCCPABh_0 2024-09-12T01:10:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.356828958762404402', time=2024-09-12T02:52:24.439080+0000, chain.objs.size()=1 2024-09-12T01:10:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1KepwQ1E6JsNQVmZusG4J11EdDMpgZO_0 2024-09-12T01:10:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15652967393123812174', time=2024-09-12T02:52:24.798880+0000, chain.objs.size()=1 2024-09-12T01:10:59.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.a8i4kmmA2uHLm4mvccX8evEy1YCbppe_0 2024-09-12T01:10:59.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14909015663819389825', time=2024-09-12T02:52:24.933898+0000, chain.objs.size()=1 2024-09-12T01:10:59.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.z1IkLz5MBJ8NziHsk6_4kRQtWptgUSz_0 2024-09-12T01:10:59.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6210067517587615470', time=2024-09-12T02:52:25.019637+0000, chain.objs.size()=1 2024-09-12T01:10:59.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.340+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Jjgpm2VAK4XkIkjsGFZh7rOdrfuyY-x_0 2024-09-12T01:10:59.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.341+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2264661551600520057', time=2024-09-12T02:52:25.102949+0000, chain.objs.size()=1 2024-09-12T01:10:59.341 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.341+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1KON4pa1A30OWjsWeVZtoM60-kLlhOG_0 2024-09-12T01:10:59.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.343+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6827943399444500613', time=2024-09-12T02:52:25.568255+0000, chain.objs.size()=1 2024-09-12T01:10:59.342 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.343+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ispPjxqyZAapy6UrHdFhyT1vsVpqI23_0 2024-09-12T01:10:59.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4357964090528567162', time=2024-09-12T02:52:25.709698+0000, chain.objs.size()=1 2024-09-12T01:10:59.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.3OU3jULQM4w-YzOSedzvzNKFHNQzpGA_0 2024-09-12T01:10:59.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4648190581907586069', time=2024-09-12T02:52:25.884369+0000, chain.objs.size()=1 2024-09-12T01:10:59.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Za2rBfLIMVF1vU_3K8x_wS8J83-j5EL_0 2024-09-12T01:10:59.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18323474770981972082', time=2024-09-12T02:52:26.009699+0000, chain.objs.size()=1 2024-09-12T01:10:59.344 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._tO4oV8rOdH08sIR2Vw5LiFzRsjxeiD_0 2024-09-12T01:10:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16751366105900510060', time=2024-09-12T02:52:26.126616+0000, chain.objs.size()=1 2024-09-12T01:10:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.QlvBlYB3hqBKAs6IBZu7IKKzx3UeBxx_0 2024-09-12T01:10:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16784637525843413809', time=2024-09-12T02:52:27.159274+0000, chain.objs.size()=1 2024-09-12T01:10:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.bydlxYQZwhYiJGQLBsWtAAGfXAOfHle_0 2024-09-12T01:10:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12499441722246754613', time=2024-09-12T02:52:29.180072+0000, chain.objs.size()=1 2024-09-12T01:10:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.m-kyTse3cRXDEzPfNmeGOHtCDTOUuyx_0 2024-09-12T01:10:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8664071166902588396', time=2024-09-12T02:52:29.438289+0000, chain.objs.size()=1 2024-09-12T01:10:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ZOrSSdVkuCh4jeitgy8J2ZPQpsJhYvQ_0 2024-09-12T01:10:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13766884244637398521', time=2024-09-12T02:52:29.863956+0000, chain.objs.size()=1 2024-09-12T01:10:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.O0He2psbjUAbLt75g9CTJVtKokdBNIB_0 2024-09-12T01:10:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1617840610656115220', time=2024-09-12T02:52:30.059807+0000, chain.objs.size()=1 2024-09-12T01:10:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KkudUpV_XniI7WMBEipLLSsDY-_ydKv_0 2024-09-12T01:10:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5057920343124766562', time=2024-09-12T02:52:30.629890+0000, chain.objs.size()=1 2024-09-12T01:10:59.345 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.345+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ZMkxpiNoFIQ_YRiu8pb4btNqpI0la8Q_0 2024-09-12T01:10:59.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.346+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3205672022062637085', time=2024-09-12T02:52:30.784845+0000, chain.objs.size()=1 2024-09-12T01:10:59.346 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.346+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.SIQgK6PrgnfM3B4V1AJg3rHFKYvtUMI_0 2024-09-12T01:10:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.348+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13767895077395693751', time=2024-09-12T02:52:31.122716+0000, chain.objs.size()=1 2024-09-12T01:10:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.348+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.I4DGyKB4AZBFGcq7FJT2iYx9WmqLlfj_0 2024-09-12T01:10:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.348+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3400377643893840278', time=2024-09-12T02:52:31.297039+0000, chain.objs.size()=1 2024-09-12T01:10:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.348+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.-zPDbIKTpiBsPKLpflFv-22_J3eb6mu_0 2024-09-12T01:10:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.348+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8279974913846677728', time=2024-09-12T02:52:31.325604+0000, chain.objs.size()=1 2024-09-12T01:10:59.347 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.348+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xAtPwpAwJdoEvvbl-KNTPBEP6FxdR0v_0 2024-09-12T01:10:59.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.349+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2142678771296638445', time=2024-09-12T02:52:38.764151+0000, chain.objs.size()=1 2024-09-12T01:10:59.348 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.349+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.275__shadow_.N5insNrAUF-t7E0fqUQN22eOD5bA79e_0 2024-09-12T01:10:59.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.349+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4945588193632205330', time=2024-09-12T02:52:44.820711+0000, chain.objs.size()=1 2024-09-12T01:10:59.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.349+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.285__shadow_.JZOmB4z2HmJChX12k6v3bzka2F979hG_0 2024-09-12T01:10:59.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.349+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1393664434229009168', time=2024-09-12T02:52:47.396944+0000, chain.objs.size()=1 2024-09-12T01:10:59.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.349+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.289__shadow_.8T2O6HiPw43DTtkK5PlnlFy1Vm9gGW1_0 2024-09-12T01:10:59.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.349+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17133873698251203176', time=2024-09-12T02:52:48.602767+0000, chain.objs.size()=1 2024-09-12T01:10:59.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.349+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.291__shadow_.fPRxh28wmG0XfwZ46UozubXR1FIVQw6_0 2024-09-12T01:10:59.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.349+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3151058499948957279', time=2024-09-12T02:52:51.370978+0000, chain.objs.size()=1 2024-09-12T01:10:59.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.349+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.3Klb8JaW532dEeu-zg-kyODJ4iS1gwE_0 2024-09-12T01:10:59.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.349+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1600985068579516112', time=2024-09-12T02:52:51.380828+0000, chain.objs.size()=1 2024-09-12T01:10:59.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.349+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.53M_ZghiWSc6yqbLKwMGXbBhBzngwUj_0 2024-09-12T01:10:59.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.349+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7725925893692532481', time=2024-09-12T02:52:53.196415+0000, chain.objs.size()=1 2024-09-12T01:10:59.349 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.349+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.RKjC6OojwJ2ETJA2u9KKUNPswyPNexO_0 2024-09-12T01:10:59.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.350+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2041882240465656868', time=2024-09-12T02:52:53.881242+0000, chain.objs.size()=1 2024-09-12T01:10:59.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.350+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.295__shadow_.ppAxlvyXhcFSCbdSnu4QaZfsC-Xjcgb_0 2024-09-12T01:10:59.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.351+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13161455898182005824', time=2024-09-12T02:52:55.686651+0000, chain.objs.size()=1 2024-09-12T01:10:59.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.351+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.298__shadow_.sa4H8uftCfGgy4hbAnPQN4O0NvCueBS_0 2024-09-12T01:10:59.350 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.351+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8983249982363142689', time=2024-09-12T02:52:57.662301+0000, chain.objs.size()=1 2024-09-12T01:10:59.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.351+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.301__shadow_.ABciFHEGtWIRjiUfeUejwx_j7A6lMIC_0 2024-09-12T01:10:59.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.352+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18271446779283859652', time=2024-09-12T02:53:49.602112+0000, chain.objs.size()=1 2024-09-12T01:10:59.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.352+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.aB1TA8PIupFqRaoG8zklsrHG1E5ntWC_0 2024-09-12T01:10:59.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.352+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9378618044387467422', time=2024-09-12T02:53:49.753925+0000, chain.objs.size()=1 2024-09-12T01:10:59.351 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.352+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.-K3zv2f1xy2rkERG1Z_iT4AK01iJQL__0 2024-09-12T01:10:59.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.352+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17000159835942027108', time=2024-09-12T02:53:50.269262+0000, chain.objs.size()=1 2024-09-12T01:10:59.352 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.352+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.M3CeqMlR30C_dSTuWQ-jaGyj77ykd5R_0 2024-09-12T01:10:59.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.353+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7403451017226495808', time=2024-09-12T02:53:51.259978+0000, chain.objs.size()=1 2024-09-12T01:10:59.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.353+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Bz6IlUVyLER1mTm4nGMEq-lO7ykq3G7_0 2024-09-12T01:10:59.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.353+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11183946300216751055', time=2024-09-12T02:53:51.260833+0000, chain.objs.size()=1 2024-09-12T01:10:59.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.353+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.2Sxdk9p5kHxBqcwLDv2tl2owWMyO-he_0 2024-09-12T01:10:59.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.353+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7427218489229037695', time=2024-09-12T02:53:51.460455+0000, chain.objs.size()=1 2024-09-12T01:10:59.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.353+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.d2ZL0TstdiWsAqibobJvZt7vIh3RHa1_0 2024-09-12T01:10:59.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.354+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9568816030555031118', time=2024-09-12T02:53:51.673751+0000, chain.objs.size()=1 2024-09-12T01:10:59.353 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.354+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_._jGHiAlWxX0d70RiXnntx_jXrcGUVju_0 2024-09-12T01:10:59.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.354+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4477404657648518861', time=2024-09-12T02:53:51.873523+0000, chain.objs.size()=1 2024-09-12T01:10:59.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.354+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.XpX4nT3U1MVeZHPxhAVraLTTVyjyz0Q_0 2024-09-12T01:10:59.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.354+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13062722533313852126', time=2024-09-12T02:53:53.312756+0000, chain.objs.size()=1 2024-09-12T01:10:59.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.354+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.HvV8Oz1soidkz9UoU-iC0VpwtTPKLQ2_0 2024-09-12T01:10:59.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.354+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3162071017565142058', time=2024-09-12T02:53:53.730058+0000, chain.objs.size()=1 2024-09-12T01:10:59.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.354+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.vKnXc1djsHc2l9CJxVWX0fHAdpJv0dL_0 2024-09-12T01:10:59.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.354+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12281037264675004672', time=2024-09-12T02:53:53.883143+0000, chain.objs.size()=1 2024-09-12T01:10:59.354 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.354+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.NhiFdDz_kGmhUtpF85r5_dRv4l1DnYP_0 2024-09-12T01:10:59.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.355+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15125961923485959223', time=2024-09-12T02:53:53.883770+0000, chain.objs.size()=1 2024-09-12T01:10:59.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.355+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Me5PdSaeBUlf-f4vk4TyRa3CiaWowEh_0 2024-09-12T01:10:59.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.356+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4347027723278445763', time=2024-09-12T02:53:53.961317+0000, chain.objs.size()=1 2024-09-12T01:10:59.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.356+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.rDAWFptvZPsxuxn8KVyPM2tdYdQYN-i_0 2024-09-12T01:10:59.355 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.356+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11731442508355723707', time=2024-09-12T02:53:54.220757+0000, chain.objs.size()=1 2024-09-12T01:10:59.356 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.356+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.I7ulfPPnLNqQQmDCIn6ilcY3CVSCCk5_0 2024-09-12T01:10:59.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5001861428651090646', time=2024-09-12T02:53:55.111374+0000, chain.objs.size()=1 2024-09-12T01:10:59.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5b2KAEs92olqB5jlY8ysyjuU7hKzT85_0 2024-09-12T01:10:59.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9920167237504106479', time=2024-09-12T02:53:55.345156+0000, chain.objs.size()=1 2024-09-12T01:10:59.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Z_yipfYpGunCXaC25BrvZm9WiLWBCjR_0 2024-09-12T01:10:59.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16646304838887143716', time=2024-09-12T02:53:55.345949+0000, chain.objs.size()=1 2024-09-12T01:10:59.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_._lv8YV5XFDv5FJqjOsx56i5VraSFADL_0 2024-09-12T01:10:59.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9532085588682269537', time=2024-09-12T02:53:55.738983+0000, chain.objs.size()=1 2024-09-12T01:10:59.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ckQ1xEPSs-pwf5YKBMJ_7FkmBdV5wGa_0 2024-09-12T01:10:59.358 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11709232259799267905', time=2024-09-12T02:53:56.016627+0000, chain.objs.size()=1 2024-09-12T01:10:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.P-nikXrq9iG0oXoPp9RMDAT2B3sMWTI_0 2024-09-12T01:10:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15576762504166758889', time=2024-09-12T02:53:57.012198+0000, chain.objs.size()=1 2024-09-12T01:10:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Dmbr1CN3dYIRggSkt85poicgJwDliG5_0 2024-09-12T01:10:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3899843350823178070', time=2024-09-12T02:53:57.059958+0000, chain.objs.size()=1 2024-09-12T01:10:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.fuNhkD2409dwvVZv4emeuSXqkv5yIdi_0 2024-09-12T01:10:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3156692130230184584', time=2024-09-12T02:53:57.887345+0000, chain.objs.size()=1 2024-09-12T01:10:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.PIjElTvRNSM6RScUCvhg9LiNSSKuJFC_0 2024-09-12T01:10:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8488776198219618136', time=2024-09-12T02:53:57.887973+0000, chain.objs.size()=1 2024-09-12T01:10:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.358+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dd4GrAqUrIfoQJW9N3762IgIC2ydDeT_0 2024-09-12T01:10:59.359 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.360+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6323043996673610269', time=2024-09-12T02:53:57.935219+0000, chain.objs.size()=1 2024-09-12T01:10:59.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.360+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Af_SkuxCLHNcjFs6pRMtMD5zR3cLXj6_0 2024-09-12T01:10:59.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.360+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16344036459909751311', time=2024-09-12T02:53:58.325893+0000, chain.objs.size()=1 2024-09-12T01:10:59.360 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.360+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.3JoSLvRl1VzB9iMtlgeYENLy9IUQBbq_0 2024-09-12T01:10:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.362+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15151134794947544195', time=2024-09-12T02:53:58.692208+0000, chain.objs.size()=1 2024-09-12T01:10:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.362+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ckN6PidtxQNPx4eaIlFAf_-5A8LlOjI_0 2024-09-12T01:10:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.362+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11066179791305014100', time=2024-09-12T02:53:59.094690+0000, chain.objs.size()=1 2024-09-12T01:10:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.362+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.fU8Pg36Ozx9n32LR6GljqpGwbQ9bI3v_0 2024-09-12T01:10:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.362+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8300288908765514623', time=2024-09-12T02:53:59.332212+0000, chain.objs.size()=1 2024-09-12T01:10:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.362+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.4vdJ3IaAs-7flyip58QbeTv7ENmH45W_0 2024-09-12T01:10:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.362+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4944283404569402101', time=2024-09-12T02:53:59.333331+0000, chain.objs.size()=1 2024-09-12T01:10:59.361 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.362+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dE7weZgZUhpH7V5I823mgTf8QGNm9lj_0 2024-09-12T01:10:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.363+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10423686370866237938', time=2024-09-12T02:54:37.089583+0000, chain.objs.size()=1 2024-09-12T01:10:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.363+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dg-LdxB2JE0U2Zl4M52m8W5pS01vAPI_0 2024-09-12T01:10:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.363+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17651976326800510301', time=2024-09-12T02:54:37.186779+0000, chain.objs.size()=1 2024-09-12T01:10:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.363+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dnJEmFZC0dqvgA_-NJTd0Zk1rvCZvQE_0 2024-09-12T01:10:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.363+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9751434529838302014', time=2024-09-12T02:54:37.325714+0000, chain.objs.size()=1 2024-09-12T01:10:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.363+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.n32Yl92kfJhNEbD6fGlSZd6UgnzX2Gw_0 2024-09-12T01:10:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.363+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15199748703310278271', time=2024-09-12T02:54:37.518658+0000, chain.objs.size()=1 2024-09-12T01:10:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.363+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.qY-C9nUt5i-sPcvrgCn4wz8et8Wsp6__0 2024-09-12T01:10:59.362 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.363+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12512365317696185358', time=2024-09-12T02:54:38.285359+0000, chain.objs.size()=1 2024-09-12T01:10:59.363 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.363+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.CETxYMudlcafPO5FruXXdHsEGkHdsWP_0 2024-09-12T01:10:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.365+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14342381597367245183', time=2024-09-12T02:54:38.500885+0000, chain.objs.size()=1 2024-09-12T01:10:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.365+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.0mieKGRU7P9y92DEcL8oV4xMawBFHzk_0 2024-09-12T01:10:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.365+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1762220785590929772', time=2024-09-12T02:54:38.572455+0000, chain.objs.size()=1 2024-09-12T01:10:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.365+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ElZATLM3nwzzONLAUps75qPJ_600FMX_0 2024-09-12T01:10:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.366+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4345080971167674561', time=2024-09-12T02:54:38.721909+0000, chain.objs.size()=1 2024-09-12T01:10:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.366+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nvzSHKqJz-PjK0CrWJCqdrwXiJqSL-u_0 2024-09-12T01:10:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.366+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16779030855282890272', time=2024-09-12T02:54:38.942283+0000, chain.objs.size()=1 2024-09-12T01:10:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.366+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.3QGhLlIXrrBqjtGqh3vKe8mWibXzrp7_0 2024-09-12T01:10:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.366+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10878634247372132354', time=2024-09-12T02:54:39.074102+0000, chain.objs.size()=1 2024-09-12T01:10:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.366+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.jsovsNTzoIZ_nmC6ujwvHvnLO-QXHaI_0 2024-09-12T01:10:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.366+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11823880561545539487', time=2024-09-12T02:54:40.134153+0000, chain.objs.size()=1 2024-09-12T01:10:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.366+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.yeluV_dg-o6Oh5phA8n7vyp2WK9qpbv_0 2024-09-12T01:10:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.366+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4706195204806796223', time=2024-09-12T02:54:40.470783+0000, chain.objs.size()=1 2024-09-12T01:10:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.366+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.38oh3-kFj2Dh1dLxumTcvFAn8qI_Jr6_0 2024-09-12T01:10:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.366+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14443407556409156627', time=2024-09-12T02:54:41.508026+0000, chain.objs.size()=1 2024-09-12T01:10:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.366+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.hKzTtJz9u2BvvrkAJcVO5HZ3QZ_insl_0 2024-09-12T01:10:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.366+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18300813835095430176', time=2024-09-12T02:54:41.647499+0000, chain.objs.size()=1 2024-09-12T01:10:59.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.366+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.g8hizMITI5E88l3BmikDkg2XetIbfvQ_0 2024-09-12T01:10:59.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.367+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7504195204881435963', time=2024-09-12T02:54:42.699704+0000, chain.objs.size()=1 2024-09-12T01:10:59.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.367+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.CNI9DY_EIWN0Srz050JX6E2sHr-_mWa_0 2024-09-12T01:10:59.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.368+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13952641640105498993', time=2024-09-12T02:54:44.247998+0000, chain.objs.size()=1 2024-09-12T01:10:59.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.368+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.tJTlLXzyBVoVxmUCUKsXAc6h_n9uhsa_0 2024-09-12T01:10:59.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.368+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3380419915005171983', time=2024-09-12T02:54:44.353946+0000, chain.objs.size()=1 2024-09-12T01:10:59.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.368+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.oHaSYhLqyP7s_hY4C8gO4aC3-tgY538_0 2024-09-12T01:10:59.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.368+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14531065894217922816', time=2024-09-12T02:54:44.769739+0000, chain.objs.size()=1 2024-09-12T01:10:59.367 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.368+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.uJ4GbEt9mkJeVSO0JnZpZegiZl27UhY_0 2024-09-12T01:10:59.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.370+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14837838831490788763', time=2024-09-12T02:54:45.125727+0000, chain.objs.size()=1 2024-09-12T01:10:59.369 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.370+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.FCCn1dr22P1pIXtdW9ENsAbmf8pMVYR_0 2024-09-12T01:10:59.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.371+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8351772384543748473', time=2024-09-12T02:54:45.239039+0000, chain.objs.size()=1 2024-09-12T01:10:59.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.371+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.qU7NQ6lin3-B1QLBYM8oL0vGFPncjlj_0 2024-09-12T01:10:59.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.371+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8778662529821849136', time=2024-09-12T02:54:45.239667+0000, chain.objs.size()=1 2024-09-12T01:10:59.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.371+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.QifeuIhmf7gc2eMAYbgo21EHTifsZJq_0 2024-09-12T01:10:59.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.371+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7320292330674668056', time=2024-09-12T02:54:45.420980+0000, chain.objs.size()=1 2024-09-12T01:10:59.370 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.371+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.UfEMPko1_dvcgvvlYHayHh9obisICRL_0 2024-09-12T01:10:59.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.372+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1792895147335851247', time=2024-09-12T02:54:45.634808+0000, chain.objs.size()=1 2024-09-12T01:10:59.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.372+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.hk2-YDirurSNM6BOoOWYDjMX2uibCZ__0 2024-09-12T01:10:59.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.372+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1131416895171182969', time=2024-09-12T02:54:45.671213+0000, chain.objs.size()=1 2024-09-12T01:10:59.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.372+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Ky2LMumIun-xsujOvCpxaM6pPgv-RJ-_0 2024-09-12T01:10:59.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.372+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11861920008024527148', time=2024-09-12T02:54:46.382970+0000, chain.objs.size()=1 2024-09-12T01:10:59.371 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.372+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.K1qOazDR0y9nkWJrYeKwI2co3T9fhZO_0 2024-09-12T01:10:59.374 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.376+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/49823 2024-09-12T01:10:59.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T01:10:59.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10408939083671994703', time=2024-09-12T02:54:46.695992+0000, chain.objs.size()=1 2024-09-12T01:10:59.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.L10KoGN-lXgBYgWecJKM4tB9KqT20Ed_0 2024-09-12T01:10:59.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2362794267034437402', time=2024-09-12T02:54:46.808902+0000, chain.objs.size()=1 2024-09-12T01:10:59.377 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.t4uqshBmNylwkrvj-9M52r-ZN23RROz_0 2024-09-12T01:10:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18373825650726225602', time=2024-09-12T02:54:46.982704+0000, chain.objs.size()=1 2024-09-12T01:10:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Rdex9A3MHTcdA8tXWS_U41Fm-LcXpJp_0 2024-09-12T01:10:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6945944200655659868', time=2024-09-12T02:54:51.098743+0000, chain.objs.size()=1 2024-09-12T01:10:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.333__shadow_.paKu2FUAXCJWAK_cmM2v46mZylTVZAR_0 2024-09-12T01:10:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6487429070344560067', time=2024-09-12T02:54:55.346091+0000, chain.objs.size()=1 2024-09-12T01:10:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.341__shadow_.xyHMMAb2M_RCZPSpZEqid5KVzns73-V_0 2024-09-12T01:10:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4904487697859842956', time=2024-09-12T02:55:09.416992+0000, chain.objs.size()=1 2024-09-12T01:10:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.372__shadow_.N1mlXLgLgQXWOcg4LzgYUprhINbg1WK_0 2024-09-12T01:10:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9857276660228936371', time=2024-09-12T02:56:04.631922+0000, chain.objs.size()=1 2024-09-12T01:10:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.464__shadow_.SmUmQuRKnDmONJSGDMOSulQ3CVJkHBy_0 2024-09-12T01:10:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6593089365429320749', time=2024-09-12T02:56:05.485875+0000, chain.objs.size()=1 2024-09-12T01:10:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.465__shadow_.YHRjmIaKJW3X61H8jrv4lvlhdWuPVW8_0 2024-09-12T01:10:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17659200108152252734', time=2024-09-12T02:56:06.085508+0000, chain.objs.size()=1 2024-09-12T01:10:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.466__shadow_.SsIW7XQTtLtYuOMnwZ3alqogyqDPsEy_0 2024-09-12T01:10:59.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5514781041234274780', time=2024-09-12T02:56:51.994949+0000, chain.objs.size()=2 2024-09-12T01:10:59.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.518__shadow_.cyr0WJUX19k20wBxwJMJ0toJso-rfnZ_0 2024-09-12T01:10:59.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.518__shadow_.cyr0WJUX19k20wBxwJMJ0toJso-rfnZ_1 2024-09-12T01:10:59.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14715951836149629116', time=2024-09-12T02:58:10.791452+0000, chain.objs.size()=2 2024-09-12T01:10:59.379 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.378+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.524__multipart_mymultipart.2~Uvz6D8b81dsgHmKINE2EY6UnVkQCB05.1 2024-09-12T01:10:59.380 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.381+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.524__multipart_mymultipart.2~Uvz6D8b81dsgHmKINE2EY6UnVkQCB05.2 2024-09-12T01:10:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.381+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15952058581688297108', time=2024-09-12T02:59:19.711017+0000, chain.objs.size()=1 2024-09-12T01:10:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.381+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.551__shadow_.dAgdFYA6sQGDfsghG7S1d80OJUU4CtQ_0 2024-09-12T01:10:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.381+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14681109620557776322', time=2024-09-12T02:59:53.319136+0000, chain.objs.size()=1 2024-09-12T01:10:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.381+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:2PLsnlzf-f820XfFsXTLB9Pryeavijo_.gxdZGYKNTtRUBLQeHIxCetkcvjQheG5_0 2024-09-12T01:10:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.381+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9432221977145631091', time=2024-09-12T03:00:02.226903+0000, chain.objs.size()=1 2024-09-12T01:10:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.381+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:XRKOM7.L2cZyPCTzwrRUpdiFYb4V-vC_.wZycH5jURcILL5SblJsrAilxUrxKkft_0 2024-09-12T01:10:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.381+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5661838788454072288', time=2024-09-12T03:00:23.113083+0000, chain.objs.size()=1 2024-09-12T01:10:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.381+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:lCCtP2IOARkhR4qzrkqA3t00ggNKWvK_.85xCC4Q45A4IauTbqeP08eh9u9_5mhN_0 2024-09-12T01:10:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.381+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4245286603635642647', time=2024-09-12T03:00:25.742525+0000, chain.objs.size()=1 2024-09-12T01:10:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.381+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:myqD.FM.7o35jZyO8qiqvWitApNOpSn_.sEL8xnkG9CyHx8jAFbX0SWIhRwdn0VU_0 2024-09-12T01:10:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.381+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15486958405380225182', time=2024-09-12T03:01:00.396052+0000, chain.objs.size()=1 2024-09-12T01:10:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.381+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.588__shadow:18BbgTQIc4KFpiJzB4SlRDsFBYbf3PR_.newi9WmOroHrnLuOGi84YYR3Zric31l_0 2024-09-12T01:10:59.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.382+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9566879333041380862', time=2024-09-12T03:01:00.576112+0000, chain.objs.size()=1 2024-09-12T01:10:59.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.382+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.588__shadow:iF8guF1LPZSImdpZWExcbwiI58K-36u_.LdcR0-XpRX49CDnr-tq1AlI8QIZKn_s_0 2024-09-12T01:10:59.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.382+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15996830669722891131', time=2024-09-12T03:02:13.043798+0000, chain.objs.size()=12 2024-09-12T01:10:59.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.382+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.616__multipart_multipart_enc.2~3KwM6ZK4x3sc0EZRhGjS4wx64lYGnz6.1 2024-09-12T01:10:59.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.382+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.616__shadow_multipart_enc.2~3KwM6ZK4x3sc0EZRhGjS4wx64lYGnz6.1_1 2024-09-12T01:10:59.382 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.382+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.616__multipart_multipart_enc.2~3KwM6ZK4x3sc0EZRhGjS4wx64lYGnz6.2 2024-09-12T01:10:59.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.385+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.616__shadow_multipart_enc.2~3KwM6ZK4x3sc0EZRhGjS4wx64lYGnz6.2_1 2024-09-12T01:10:59.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.385+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.616__multipart_multipart_enc.2~3KwM6ZK4x3sc0EZRhGjS4wx64lYGnz6.3 2024-09-12T01:10:59.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.385+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.616__shadow_multipart_enc.2~3KwM6ZK4x3sc0EZRhGjS4wx64lYGnz6.3_1 2024-09-12T01:10:59.384 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.385+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.616__multipart_multipart_enc.2~3KwM6ZK4x3sc0EZRhGjS4wx64lYGnz6.4 2024-09-12T01:10:59.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.386+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.616__shadow_multipart_enc.2~3KwM6ZK4x3sc0EZRhGjS4wx64lYGnz6.4_1 2024-09-12T01:10:59.385 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.386+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.616__multipart_multipart_enc.2~3KwM6ZK4x3sc0EZRhGjS4wx64lYGnz6.5 2024-09-12T01:10:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.387+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.616__shadow_multipart_enc.2~3KwM6ZK4x3sc0EZRhGjS4wx64lYGnz6.5_1 2024-09-12T01:10:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.387+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.616__multipart_multipart_enc.2~3KwM6ZK4x3sc0EZRhGjS4wx64lYGnz6.6 2024-09-12T01:10:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.387+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.616__shadow_multipart_enc.2~3KwM6ZK4x3sc0EZRhGjS4wx64lYGnz6.6_1 2024-09-12T01:10:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.387+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7170715814533402842', time=2024-09-12T03:05:18.606343+0000, chain.objs.size()=1 2024-09-12T01:10:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.387+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.657__shadow_.D3UG2ZuSPuZe40AtlGS7yLxSLmQSTde_0 2024-09-12T01:10:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.387+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1366996326921913956', time=2024-09-12T03:05:33.703993+0000, chain.objs.size()=1 2024-09-12T01:10:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.387+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.664__shadow_.byJg-gG4GWyxizmGlqvd3CM1Sim5V30_0 2024-09-12T01:10:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.388+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2913138900446933237', time=2024-09-12T03:05:35.483519+0000, chain.objs.size()=1 2024-09-12T01:10:59.387 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.388+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.666__shadow_.g0bZvNg68d7wSX_xMFyvhZ4l-SIG3SZ_0 2024-09-12T01:10:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.390+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8730715813342388071', time=2024-09-12T03:05:55.856628+0000, chain.objs.size()=1 2024-09-12T01:10:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.390+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.704__shadow:YU7ElLnRmPmvOiunS9amHO3OSIXzTuW_.dyh-T0HGfv77Yf5aYVV0rn82u5imScJ_0 2024-09-12T01:10:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.390+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.752789911301811992', time=2024-09-12T03:06:01.822773+0000, chain.objs.size()=1 2024-09-12T01:10:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.390+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.714__shadow:2ctpzSymjk9QqhvtyDT733rGrNEsgD6_.OlNi6xjsaVaGVA2gMxeIhnx9w4x3s20_0 2024-09-12T01:10:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.390+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13212913593217284603', time=2024-09-12T03:06:51.881701+0000, chain.objs.size()=1 2024-09-12T01:10:59.389 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.390+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.745__shadow_.TZRg-DS6l-aSPqQ4WBAjUs80kBKv8O2_0 2024-09-12T01:10:59.392 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.393+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.395 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.396+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:10:59.396 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.397+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.397 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.398+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52758' 2024-09-12T01:10:59.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7755421430161221895', time=2024-09-12T02:49:13.240388+0000, chain.objs.size()=1 2024-09-12T01:10:59.398 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.159__shadow_.sJMh0bWRc7i0Ctg3bG_QOfWr-3mY92p_0 2024-09-12T01:10:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11790666827759804224', time=2024-09-12T02:51:24.623507+0000, chain.objs.size()=1 2024-09-12T01:10:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.229__shadow_.ulhm42Zb9mfsVX2qzZgKrGmdFmXvGNU_0 2024-09-12T01:10:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2363166890575556503', time=2024-09-12T02:51:29.123243+0000, chain.objs.size()=1 2024-09-12T01:10:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.237__shadow_.AQ8ErKqt6i6nEQnpbJRIfPnEOMzgVlv_0 2024-09-12T01:10:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17188461276411910289', time=2024-09-12T02:51:40.129934+0000, chain.objs.size()=1 2024-09-12T01:10:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.254__shadow_.DicdpOH8O-Nu6CI2avvontHVwmm1sCj_0 2024-09-12T01:10:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11828249000524799624', time=2024-09-12T02:52:21.185304+0000, chain.objs.size()=1 2024-09-12T01:10:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.sF6VS440R0NWrAjJTpZWm41nrOcNLGr_0 2024-09-12T01:10:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4073740114173622795', time=2024-09-12T02:52:21.477074+0000, chain.objs.size()=1 2024-09-12T01:10:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.CDon6s2NDq5Y50GxymyTTNo6fhIt0n4_0 2024-09-12T01:10:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1593707352753896584', time=2024-09-12T02:52:22.142402+0000, chain.objs.size()=1 2024-09-12T01:10:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.adN98KoM-1_r2Y_2BQwGJmvt67DOjwP_0 2024-09-12T01:10:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13223332737130767793', time=2024-09-12T02:52:23.613599+0000, chain.objs.size()=1 2024-09-12T01:10:59.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.2wddv3dDJMqpT0E0nRKJlBiUl4U2-Gq_0 2024-09-12T01:10:59.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6994379598043221513', time=2024-09-12T02:52:24.169328+0000, chain.objs.size()=1 2024-09-12T01:10:59.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Wpc3z39N1dwdUaxRKgipyhYqdZBqYTX_0 2024-09-12T01:10:59.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15972012747873697070', time=2024-09-12T02:52:24.285175+0000, chain.objs.size()=1 2024-09-12T01:10:59.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.nbrhSaL1ouSYcGVANzc5T-kJ8bPZ0D-_0 2024-09-12T01:10:59.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3552112395843004487', time=2024-09-12T02:52:24.370833+0000, chain.objs.size()=1 2024-09-12T01:10:59.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0JFOF5iXr_s4gPMuycPPsRNxITeaaTG_0 2024-09-12T01:10:59.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13778251318873391312', time=2024-09-12T02:52:24.601379+0000, chain.objs.size()=1 2024-09-12T01:10:59.400 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.399+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.XIpCBm2E9LKHINjThaxVZjR65sKrVhW_0 2024-09-12T01:10:59.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.402+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1847620663745655456', time=2024-09-12T02:52:24.608970+0000, chain.objs.size()=1 2024-09-12T01:10:59.401 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.402+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.s2DPgZToKzWjFVY1hL40NMCgd6wBA_H_0 2024-09-12T01:10:59.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.402+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2483106901875896024', time=2024-09-12T02:52:24.653316+0000, chain.objs.size()=1 2024-09-12T01:10:59.402 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.402+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.NrhqVuFzVR_vXvl4cMiBXgWDMr9aVaK_0 2024-09-12T01:10:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11559461622502037403', time=2024-09-12T02:52:25.605290+0000, chain.objs.size()=1 2024-09-12T01:10:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.dA_OY9CVxAcM_OQmSwkHH5olnILi-on_0 2024-09-12T01:10:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5754539607651833501', time=2024-09-12T02:52:25.749252+0000, chain.objs.size()=1 2024-09-12T01:10:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.QJOihPBYRKfHm73_2Y0oSnoq28hvcMZ_0 2024-09-12T01:10:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1447139620039997775', time=2024-09-12T02:52:26.026524+0000, chain.objs.size()=1 2024-09-12T01:10:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.sOaGSB_m6K5JxeOQ0PUG2xAyX3xf79X_0 2024-09-12T01:10:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13472315451507166553', time=2024-09-12T02:52:26.176911+0000, chain.objs.size()=1 2024-09-12T01:10:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.2DW8omCIoyv_ct5YGoLtIuqF1IPC8e1_0 2024-09-12T01:10:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17025973152168742976', time=2024-09-12T02:52:27.047321+0000, chain.objs.size()=1 2024-09-12T01:10:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vJpGbvH2ZWDjj9L8_Ysq5EJUsz55TMk_0 2024-09-12T01:10:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15788844507801945445', time=2024-09-12T02:52:27.121184+0000, chain.objs.size()=1 2024-09-12T01:10:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.gjoa-qUCJjV5_ZOcpJkAQ5puLUkP66u_0 2024-09-12T01:10:59.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16874195396522990636', time=2024-09-12T02:52:27.379001+0000, chain.objs.size()=1 2024-09-12T01:10:59.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.WehPxaKB7grBPs3eC5O2wsksiklRVZQ_0 2024-09-12T01:10:59.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16116579059557792656', time=2024-09-12T02:52:27.713859+0000, chain.objs.size()=1 2024-09-12T01:10:59.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vL-5oRchhFwxtZ0brayW3cAtc_nVx42_0 2024-09-12T01:10:59.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.307631568084055255', time=2024-09-12T02:52:28.095310+0000, chain.objs.size()=1 2024-09-12T01:10:59.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.403+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.8wndJ2KZtLla4-Y9ZiYwyEO8K0iLsuh_0 2024-09-12T01:10:59.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.405+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7451845034427828596', time=2024-09-12T02:52:28.384854+0000, chain.objs.size()=1 2024-09-12T01:10:59.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.405+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.gkvIMDbs4qskzSAZy3a5SJBVoaL4rom_0 2024-09-12T01:10:59.404 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.405+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16556646707853900872', time=2024-09-12T02:52:28.450940+0000, chain.objs.size()=1 2024-09-12T01:10:59.405 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.405+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.XVpgy2iqaqfO1NsVaepVby4oLhOoEsC_0 2024-09-12T01:10:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.407+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9399924633343252218', time=2024-09-12T02:52:28.724162+0000, chain.objs.size()=1 2024-09-12T01:10:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.407+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uqvBrwizWHqT3irsTE7ll9BYmOF_FIS_0 2024-09-12T01:10:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.407+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5562896783179390569', time=2024-09-12T02:52:28.740118+0000, chain.objs.size()=1 2024-09-12T01:10:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.407+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.qocVt8OQnUQ2eLYIGXMiOttkFnoCAkl_0 2024-09-12T01:10:59.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.408+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7338231211567340227', time=2024-09-12T02:52:29.321750+0000, chain.objs.size()=1 2024-09-12T01:10:59.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.408+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.YDwWFlARjr_YxzuI6p4GVSlIXFoSYg7_0 2024-09-12T01:10:59.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.408+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13031255441104159360', time=2024-09-12T02:52:29.424620+0000, chain.objs.size()=1 2024-09-12T01:10:59.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.408+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.J4liFJeQLmQIFeWHOxVcPrbP2e-ii7O_0 2024-09-12T01:10:59.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.408+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13467939788336382524', time=2024-09-12T02:52:29.449863+0000, chain.objs.size()=1 2024-09-12T01:10:59.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.408+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.baTe7BUGr33oGQC1WG7k0VhfVMK1n4B_0 2024-09-12T01:10:59.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.408+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12726557412326615102', time=2024-09-12T02:52:29.553991+0000, chain.objs.size()=1 2024-09-12T01:10:59.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.408+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.HGsrrAc-GzSR8G8z2QMzrprKX6hSbEE_0 2024-09-12T01:10:59.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.408+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12712991529556647981', time=2024-09-12T02:52:29.887496+0000, chain.objs.size()=1 2024-09-12T01:10:59.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.408+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.SzKVT5XtWS3jEL0d3rOzLp3sjQvpGVK_0 2024-09-12T01:10:59.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.408+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8753564655518584283', time=2024-09-12T02:52:29.977872+0000, chain.objs.size()=1 2024-09-12T01:10:59.408 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.408+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.rJ_-902HpGT6-MZlfj-XIGiyMNcKriF_0 2024-09-12T01:10:59.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.408+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2858183038843522536', time=2024-09-12T02:52:30.156575+0000, chain.objs.size()=1 2024-09-12T01:10:59.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.408+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.3Ak68zmZ9wdvhQ0FRjxxVJP_kfOxlFu_0 2024-09-12T01:10:59.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.410+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12721942103137762638', time=2024-09-12T02:52:30.264064+0000, chain.objs.size()=1 2024-09-12T01:10:59.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.410+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.tfkDQ2h17EcALHlStT98wH3c0R-eA6A_0 2024-09-12T01:10:59.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.410+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14350450179627259604', time=2024-09-12T02:52:30.711018+0000, chain.objs.size()=1 2024-09-12T01:10:59.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.410+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.3jJcP6lIzqG94xoET4GyrSQQJXWMazL_0 2024-09-12T01:10:59.409 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.410+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6574509157148814693', time=2024-09-12T02:52:30.722790+0000, chain.objs.size()=1 2024-09-12T01:10:59.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.410+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.P6voJ0SpptvnXwYEDhaTzqJnn1wXFaq_0 2024-09-12T01:10:59.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.410+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14590765296557252323', time=2024-09-12T02:52:30.727495+0000, chain.objs.size()=1 2024-09-12T01:10:59.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.410+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.SRRHHaeec3cWkMI-l7CVY8uGlqga7BI_0 2024-09-12T01:10:59.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.411+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12372952682827040683', time=2024-09-12T02:52:30.830183+0000, chain.objs.size()=1 2024-09-12T01:10:59.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.411+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.nKz9BHyAv1L3sLJiMQ8sOquZsLvyZ3w_0 2024-09-12T01:10:59.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.411+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1811499830679003338', time=2024-09-12T02:52:30.839847+0000, chain.objs.size()=1 2024-09-12T01:10:59.410 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.411+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ejpu1ZnskBrv9OYDXjOVCNcN6Kz58_d_0 2024-09-12T01:10:59.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.413+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5277933826148529854', time=2024-09-12T02:52:33.103414+0000, chain.objs.size()=1 2024-09-12T01:10:59.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.413+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.265__shadow_.yxZcrrs1w1wWsoiVDd2xClvAbXMAgHt_0 2024-09-12T01:10:59.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.413+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17544418444480349399', time=2024-09-12T02:52:34.811977+0000, chain.objs.size()=1 2024-09-12T01:10:59.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.413+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.268__shadow_.34fM52XpsHDuOQgDGa-GFPDDqizD-i-_0 2024-09-12T01:10:59.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.413+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14807781042895979442', time=2024-09-12T02:52:37.066625+0000, chain.objs.size()=1 2024-09-12T01:10:59.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.413+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.272__shadow_.Xjcd-mVzBNIm0mt9x0h0dIRkLktELg8_0 2024-09-12T01:10:59.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.413+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5402658797026008386', time=2024-09-12T02:52:39.980088+0000, chain.objs.size()=1 2024-09-12T01:10:59.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.413+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.277__shadow_.4u6Dl1gPTOhhx2y0LB8co2IDgWxwjYn_0 2024-09-12T01:10:59.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.413+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5378598131081602509', time=2024-09-12T02:52:43.019504+0000, chain.objs.size()=1 2024-09-12T01:10:59.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.413+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.282__shadow_.4PZeVHxOz2lWnGDk0sdANozQUM8R4l2_0 2024-09-12T01:10:59.413 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.414+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.748544397395998834', time=2024-09-12T02:52:44.228094+0000, chain.objs.size()=1 2024-09-12T01:10:59.414 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.414+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.284__shadow_.n-iIaxApbjVk0Ix784yYsDLFFk9faoc_0 2024-09-12T01:10:59.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.416+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17159082911862954267', time=2024-09-12T02:53:00.055043+0000, chain.objs.size()=1 2024-09-12T01:10:59.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.416+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.305__shadow_.PaNpEZUiZSQXNDeRXhPAoFelViGMx2X_0 2024-09-12T01:10:59.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.416+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8406941267454611315', time=2024-09-12T02:53:11.265527+0000, chain.objs.size()=1 2024-09-12T01:10:59.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.416+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.322__shadow_.fajZHPI7ckDIa5HSsG_ZcfYvtqh4BCm_0 2024-09-12T01:10:59.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.416+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10658998402303062724', time=2024-09-12T02:53:49.402129+0000, chain.objs.size()=1 2024-09-12T01:10:59.415 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.416+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Vy9bpTNkWrEaotBI9j1CyWBr7w1IP5S_0 2024-09-12T01:10:59.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.416+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3904134460458626130', time=2024-09-12T02:53:49.429689+0000, chain.objs.size()=1 2024-09-12T01:10:59.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.416+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.G9IAAABPwVaR_SI5cA7nqJFY_LNnVtZ_0 2024-09-12T01:10:59.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.416+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2765828405308803541', time=2024-09-12T02:53:49.644796+0000, chain.objs.size()=1 2024-09-12T01:10:59.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.416+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tqbOjmI7PjDq2A_TDdTkxYdA-kOT8iP_0 2024-09-12T01:10:59.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.417+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11135295033936119785', time=2024-09-12T02:53:50.160044+0000, chain.objs.size()=1 2024-09-12T01:10:59.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.417+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.JNXID0GY2SaHfd6R91Gk5QgMnFJA-bw_0 2024-09-12T01:10:59.416 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.417+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16124185611390311421', time=2024-09-12T02:53:51.032244+0000, chain.objs.size()=1 2024-09-12T01:10:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.417+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.kyktQbYk89PppG9yso4ep0Wrk_d3tiD_0 2024-09-12T01:10:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.417+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5201913763965481273', time=2024-09-12T02:53:51.196573+0000, chain.objs.size()=1 2024-09-12T01:10:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.417+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lCOo7CPjBbRp1pDUUNuGmLKChvIzF5I_0 2024-09-12T01:10:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.417+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2634661613829565266', time=2024-09-12T02:53:51.451929+0000, chain.objs.size()=1 2024-09-12T01:10:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.417+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.IIN22S6KwQQzKQEYE41R8EjaS6luH6f_0 2024-09-12T01:10:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.417+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6910430723667158822', time=2024-09-12T02:53:51.502381+0000, chain.objs.size()=1 2024-09-12T01:10:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.417+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.jHofG4MGAbh8_hzSWghk7ePb_5RdwgV_0 2024-09-12T01:10:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.418+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7910008051974635899', time=2024-09-12T02:53:51.877712+0000, chain.objs.size()=1 2024-09-12T01:10:59.417 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.418+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.P7de72TivFXIk-yk9jsryy71Ngmo7ca_0 2024-09-12T01:10:59.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.420+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13605217152767472586', time=2024-09-12T02:53:52.560164+0000, chain.objs.size()=1 2024-09-12T01:10:59.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.420+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.O_LTmOiZvuDZIvy7MndjuB63UWCc15z_0 2024-09-12T01:10:59.419 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.420+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6126900945414124302', time=2024-09-12T02:53:52.676769+0000, chain.objs.size()=1 2024-09-12T01:10:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.420+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.myDGPKeTi2zIvMt011m5LcN71823FsL_0 2024-09-12T01:10:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.420+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15000525303170812868', time=2024-09-12T02:53:52.856641+0000, chain.objs.size()=1 2024-09-12T01:10:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.420+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.4n7lJBdkLqwVPGOJarBVVBavwD98q_u_0 2024-09-12T01:10:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.420+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10352197865354358015', time=2024-09-12T02:53:52.961867+0000, chain.objs.size()=1 2024-09-12T01:10:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.420+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.-hczvy4MF-WIuJ4yJRdWgIpyG-P6s8Q_0 2024-09-12T01:10:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.420+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5455581725177968542', time=2024-09-12T02:53:53.087272+0000, chain.objs.size()=1 2024-09-12T01:10:59.420 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.420+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.g5tSfkW1H1_PpjUP2ki93vVTnPtPyco_0 2024-09-12T01:10:59.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.421+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8558393852876737689', time=2024-09-12T02:53:53.685336+0000, chain.objs.size()=1 2024-09-12T01:10:59.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.421+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.1-yD7n3mswO_e0E7zWpmlJ3b9w5UgJi_0 2024-09-12T01:10:59.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.421+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10863056657045192140', time=2024-09-12T02:53:53.727888+0000, chain.objs.size()=1 2024-09-12T01:10:59.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.421+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.TZmp60RZ2USrK2c42TvaYQc2Ejo9_1o_0 2024-09-12T01:10:59.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.421+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7574980788397489055', time=2024-09-12T02:53:54.100663+0000, chain.objs.size()=1 2024-09-12T01:10:59.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.421+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tjLVdp8JsRaKQdeKLJA8A-USmU8GMZA_0 2024-09-12T01:10:59.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.421+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17545930349224375825', time=2024-09-12T02:53:54.107789+0000, chain.objs.size()=1 2024-09-12T01:10:59.421 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.421+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.pJD5TxIcFryRbbRGJBMslOEACLDaqBK_0 2024-09-12T01:10:59.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.423+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14686520535714506644', time=2024-09-12T02:53:54.367526+0000, chain.objs.size()=1 2024-09-12T01:10:59.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.423+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.aAOU_Yg2Qzjqjz5QQyr-9sjox2HbBkq_0 2024-09-12T01:10:59.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.423+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11583111486642253939', time=2024-09-12T02:53:54.581260+0000, chain.objs.size()=1 2024-09-12T01:10:59.422 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.423+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.4e_lc3ZsnCJ157Lr_200bHe2tl-i70Q_0 2024-09-12T01:10:59.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.423+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3109579537286726385', time=2024-09-12T02:53:55.335527+0000, chain.objs.size()=1 2024-09-12T01:10:59.423 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.423+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.fryk7XCSma8Sm3xGA0H5i9MjBaAnF0-_0 2024-09-12T01:10:59.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.425+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13580688995301919074', time=2024-09-12T02:53:55.467414+0000, chain.objs.size()=1 2024-09-12T01:10:59.424 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.425+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5kR0YFy-RZ-bYBSzcQiuevUP5s6_o_D_0 2024-09-12T01:10:59.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.425+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16716302714941985084', time=2024-09-12T02:53:55.624587+0000, chain.objs.size()=1 2024-09-12T01:10:59.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.425+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.k0gAQCL-BQulZnHYdJPIv8AwcF6XOK3_0 2024-09-12T01:10:59.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.425+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.658768147395322825', time=2024-09-12T02:53:55.664257+0000, chain.objs.size()=1 2024-09-12T01:10:59.425 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.425+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.OLYLtbHqjYKAYTLS_s7hFiaJ5tqQNeB_0 2024-09-12T01:10:59.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.425+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8509293670953894040', time=2024-09-12T02:53:55.810544+0000, chain.objs.size()=1 2024-09-12T01:10:59.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.425+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.eE-GbtUJsLXaXZVzQNiL6u0dyV4iXEc_0 2024-09-12T01:10:59.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.426+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7788333081500718201', time=2024-09-12T02:53:56.372964+0000, chain.objs.size()=1 2024-09-12T01:10:59.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.426+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.aONL7gNunj0H4WNygBdEOtULal99tH8_0 2024-09-12T01:10:59.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.426+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14512644031883335521', time=2024-09-12T02:53:56.909555+0000, chain.objs.size()=1 2024-09-12T01:10:59.426 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.426+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.xu7LU6nJ9L167aX_DX2sAQciqfjz41Q_0 2024-09-12T01:10:59.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.427+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9160190481858326847', time=2024-09-12T02:53:56.928939+0000, chain.objs.size()=1 2024-09-12T01:10:59.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.427+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.PvauVXEhpDGodNgydidwbt05dp3uvok_0 2024-09-12T01:10:59.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.427+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17943206476138777352', time=2024-09-12T02:53:57.324003+0000, chain.objs.size()=1 2024-09-12T01:10:59.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.427+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0bLhz5zCLBaYKaIlQpZVqZp8_0sadPI_0 2024-09-12T01:10:59.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.427+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11347329468288771938', time=2024-09-12T02:53:57.788432+0000, chain.objs.size()=1 2024-09-12T01:10:59.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.427+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.JrNXsj2woRBsPFa8OTJ7t4VekXQKP7a_0 2024-09-12T01:10:59.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.427+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7432569394633092579', time=2024-09-12T02:53:58.023713+0000, chain.objs.size()=1 2024-09-12T01:10:59.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.427+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.RUDgTFXlHr0jPtOJz5ad-ZSQHTmxBp3_0 2024-09-12T01:10:59.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.428+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1168177999055429290', time=2024-09-12T02:53:58.550044+0000, chain.objs.size()=1 2024-09-12T01:10:59.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.428+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.E7FFVhz0aJP6PILQLV-2NVVGU69lK-J_0 2024-09-12T01:10:59.427 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.428+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6133783310701330630', time=2024-09-12T02:53:58.649477+0000, chain.objs.size()=1 2024-09-12T01:10:59.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.428+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lOr6FYttoSj61WKmfdjKujfOZLzNXi4_0 2024-09-12T01:10:59.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.429+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1906098587154738610', time=2024-09-12T02:53:58.930671+0000, chain.objs.size()=1 2024-09-12T01:10:59.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.429+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.K2XjpsMScqfqeIuMEsBj_lQaxfwZExh_0 2024-09-12T01:10:59.428 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.429+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12957995733053555979', time=2024-09-12T02:53:59.347444+0000, chain.objs.size()=1 2024-09-12T01:10:59.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.429+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_._y9luQArq3168gXsez-fF7Rtd6_h2KK_0 2024-09-12T01:10:59.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.430+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17837562207849897409', time=2024-09-12T02:54:36.621341+0000, chain.objs.size()=1 2024-09-12T01:10:59.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.430+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Y4EEE0ldEf9mjm2rsSeM9v2fctbumst_0 2024-09-12T01:10:59.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.430+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11083065690448016816', time=2024-09-12T02:54:36.672760+0000, chain.objs.size()=1 2024-09-12T01:10:59.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.430+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9pFck1iHmFG5KGd0ik7ZH_pf88Pwz93_0 2024-09-12T01:10:59.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.430+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1610459067478577242', time=2024-09-12T02:54:37.113538+0000, chain.objs.size()=1 2024-09-12T01:10:59.429 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.430+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.yFKiiWMq744mMJ4eH6qd2b8Iz-P7rzX_0 2024-09-12T01:10:59.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.431+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3527916776675131184', time=2024-09-12T02:54:38.457029+0000, chain.objs.size()=1 2024-09-12T01:10:59.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.431+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fDXvjA2EMBB9TwuUPBKWVIzKzGT8sFS_0 2024-09-12T01:10:59.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.431+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16088099827678569522', time=2024-09-12T02:54:38.720612+0000, chain.objs.size()=1 2024-09-12T01:10:59.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.431+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.DAZCzQb_NoZTV6rORC70bnQseDUexXz_0 2024-09-12T01:10:59.430 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.431+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13792568478906885465', time=2024-09-12T02:54:38.976960+0000, chain.objs.size()=1 2024-09-12T01:10:59.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.431+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.-hyL9RkglF_fpdY7bXHfztY4TAkes50_0 2024-09-12T01:10:59.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.431+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4975515710554534765', time=2024-09-12T02:54:39.908348+0000, chain.objs.size()=1 2024-09-12T01:10:59.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.431+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.UyNzQJECadIczlvJyLw4VjnQF7GUEpu_0 2024-09-12T01:10:59.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.431+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17124171523133993084', time=2024-09-12T02:54:40.057182+0000, chain.objs.size()=1 2024-09-12T01:10:59.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.431+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.LvuvUQV_56IK1xDIqSVsfWnW498fvHq_0 2024-09-12T01:10:59.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.431+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15221854793799762667', time=2024-09-12T02:54:40.094049+0000, chain.objs.size()=1 2024-09-12T01:10:59.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.431+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.WTSVWwTOAap_aBJdfGxafjq7tnH69yr_0 2024-09-12T01:10:59.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.432+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2727467480159502233', time=2024-09-12T02:54:40.377334+0000, chain.objs.size()=1 2024-09-12T01:10:59.431 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.432+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.SYDyLcHXwOLAtYvkUHBrIsPmAy2jNrJ_0 2024-09-12T01:10:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.433+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12629770563344182776', time=2024-09-12T02:54:41.153511+0000, chain.objs.size()=1 2024-09-12T01:10:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.433+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Gti3nW0a5KY99SYWXe5oILb9L1mJVWj_0 2024-09-12T01:10:59.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.433+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14676789579796225446', time=2024-09-12T02:54:41.490964+0000, chain.objs.size()=1 2024-09-12T01:10:59.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.433+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.93QFbLsvgRQ4aiBBnqqlqYfjs-9Lzf3_0 2024-09-12T01:10:59.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.433+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2142182086654349534', time=2024-09-12T02:54:42.400550+0000, chain.objs.size()=1 2024-09-12T01:10:59.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.433+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.rrTYWACBYSVv8s5YMmhUyTm8snANTvI_0 2024-09-12T01:10:59.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.434+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9836294769046661075', time=2024-09-12T02:54:42.506436+0000, chain.objs.size()=1 2024-09-12T01:10:59.433 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.434+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.q8dGktTIEW0Jn8Fdj1RKNAEF2XpQJ73_0 2024-09-12T01:10:59.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.434+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11990002005297848277', time=2024-09-12T02:54:42.818226+0000, chain.objs.size()=1 2024-09-12T01:10:59.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.434+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.0PcHTPafNFE0KzYlOI7S3oE4_jfx1O-_0 2024-09-12T01:10:59.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.434+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16101301006889071400', time=2024-09-12T02:54:42.989556+0000, chain.objs.size()=1 2024-09-12T01:10:59.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.434+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.KVQQejaVQMi4RJrY0_iSPORBOZETFu9_0 2024-09-12T01:10:59.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.434+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13089131467381242968', time=2024-09-12T02:54:44.008365+0000, chain.objs.size()=1 2024-09-12T01:10:59.434 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.434+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.W6XV4-mPX9RKKKdm0z0I__RtZ7w7RoY_0 2024-09-12T01:10:59.437 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.438+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/52758 2024-09-12T01:10:59.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-12T01:10:59.440 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1313167774206368299', time=2024-09-12T02:54:44.285210+0000, chain.objs.size()=1 2024-09-12T01:10:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.s-PLwZy6LpfmPz98LAnJlz_CPOwf3rF_0 2024-09-12T01:10:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.936257463544235010', time=2024-09-12T02:54:44.410695+0000, chain.objs.size()=1 2024-09-12T01:10:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.cooqcFa65Cyc82Z9AIdI0UfBBABsnI7_0 2024-09-12T01:10:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3000027239083239946', time=2024-09-12T02:54:44.514115+0000, chain.objs.size()=1 2024-09-12T01:10:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.eYY2b85AhzV8yPy6yUXXyNTHdbGTlmB_0 2024-09-12T01:10:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5508813375847568331', time=2024-09-12T02:54:44.552554+0000, chain.objs.size()=1 2024-09-12T01:10:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.F8K0x92AhfFho7SCYAGGRcWZa6g7sPm_0 2024-09-12T01:10:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3810799450017053157', time=2024-09-12T02:54:44.574013+0000, chain.objs.size()=1 2024-09-12T01:10:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.N-JVRz-CqmS_OjHgdTfxM_XVDrTenrg_0 2024-09-12T01:10:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4203223149332583772', time=2024-09-12T02:54:45.092184+0000, chain.objs.size()=1 2024-09-12T01:10:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.3mmZjOiqpdflCEIkR44UH-q8WtWfxRr_0 2024-09-12T01:10:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7129520169458452591', time=2024-09-12T02:54:45.092694+0000, chain.objs.size()=1 2024-09-12T01:10:59.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.TqetNlAcvVDt4XnyOyfv9G7amv6Rg4__0 2024-09-12T01:10:59.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16053942789286283614', time=2024-09-12T02:54:45.264941+0000, chain.objs.size()=1 2024-09-12T01:10:59.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6ouMhfLJgOQmF3KplfNBRvYGtmW8ZUS_0 2024-09-12T01:10:59.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15422408832465000866', time=2024-09-12T02:54:45.464652+0000, chain.objs.size()=1 2024-09-12T01:10:59.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nDh-IexYmnTkYKr7SqiFTAZhraG1IE0_0 2024-09-12T01:10:59.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6018739941886688838', time=2024-09-12T02:54:45.537476+0000, chain.objs.size()=1 2024-09-12T01:10:59.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.aGyJ-tBkhsB5g0fTnAaV1w7O-Rlmb_8_0 2024-09-12T01:10:59.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10513445163835714704', time=2024-09-12T02:54:45.748031+0000, chain.objs.size()=1 2024-09-12T01:10:59.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9AmXiLyEx62PFVWS-zN9DeEPF39xJDK_0 2024-09-12T01:10:59.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8129950403340894472', time=2024-09-12T02:54:45.907040+0000, chain.objs.size()=1 2024-09-12T01:10:59.442 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.441+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.FfvmNfXLW8W7TBghJ494nGTRmlIsPkx_0 2024-09-12T01:10:59.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.444+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2442165602459614993', time=2024-09-12T02:54:45.985038+0000, chain.objs.size()=1 2024-09-12T01:10:59.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.444+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nJfRRl5rvAoZQf1qgf5GvFhiSVjht9b_0 2024-09-12T01:10:59.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.444+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7968016171004583537', time=2024-09-12T02:54:46.318239+0000, chain.objs.size()=1 2024-09-12T01:10:59.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.444+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.wrhAbaYPjCnI6cos5zmNZ1Rji6K16i9_0 2024-09-12T01:10:59.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.444+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7560784678669546412', time=2024-09-12T02:54:46.455178+0000, chain.objs.size()=1 2024-09-12T01:10:59.443 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.444+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.rrU6uDanqYG1_Kx30-FTyb0Ypw2UDzb_0 2024-09-12T01:10:59.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11978583850616080428', time=2024-09-12T02:54:46.695873+0000, chain.objs.size()=1 2024-09-12T01:10:59.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6psQ10urKD7_qyIGGtQ4ZEPufeiW5OP_0 2024-09-12T01:10:59.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13303839133920462564', time=2024-09-12T02:54:46.708708+0000, chain.objs.size()=1 2024-09-12T01:10:59.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.jeDM_Ib2QHI11j0gfaRdMVz-bUYBEUc_0 2024-09-12T01:10:59.444 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16151084813368654416', time=2024-09-12T02:54:46.984054+0000, chain.objs.size()=1 2024-09-12T01:10:59.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nggOSTgCep_I2k6mpBo1AaizVMG8Cfx_0 2024-09-12T01:10:59.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4394731078564054703', time=2024-09-12T02:55:16.213202+0000, chain.objs.size()=1 2024-09-12T01:10:59.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.382__shadow_.mC_j-X1DFG90mzChP35RmZAUOdiPh4J_0 2024-09-12T01:10:59.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15776036024819296859', time=2024-09-12T02:55:55.085109+0000, chain.objs.size()=1 2024-09-12T01:10:59.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.451__shadow_.dMhneWAkVSreHSZkp_iHvylXcCSJbfY_0 2024-09-12T01:10:59.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9864852812045025662', time=2024-09-12T02:55:59.673045+0000, chain.objs.size()=1 2024-09-12T01:10:59.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.458__shadow_.mNWo5i7NEOp4i6ol2F-twRmrcAOGGTe_0 2024-09-12T01:10:59.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15406729006083977875', time=2024-09-12T02:56:14.319822+0000, chain.objs.size()=1 2024-09-12T01:10:59.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.484__shadow_.KBM4COuyReDEMMCpF2ATytr3WsCSsA4_0 2024-09-12T01:10:59.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9994880960129007959', time=2024-09-12T02:56:14.330918+0000, chain.objs.size()=1 2024-09-12T01:10:59.445 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.445+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.484__shadow_.nYRSv0U9lrju1vg7i3UubI6UR0P5EZ9_0 2024-09-12T01:10:59.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.447+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7434247994804782224', time=2024-09-12T02:56:48.763321+0000, chain.objs.size()=1 2024-09-12T01:10:59.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.447+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.519__multipart_mymultipart.2~-Bu604EW1h0xGSGI1n5JkpS-1g5RVgQ.1 2024-09-12T01:10:59.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.447+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6054770934271889701', time=2024-09-12T02:58:09.953861+0000, chain.objs.size()=1 2024-09-12T01:10:59.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.447+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.524__multipart_mymultipart.2~ZFu4QZgiH1AdS6BqZyS2CP7sZ54ND7_.1 2024-09-12T01:10:59.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.447+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9672598134628499882', time=2024-09-12T02:59:32.099747+0000, chain.objs.size()=1 2024-09-12T01:10:59.446 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.447+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.557__shadow_.w98w6-xqnDuExxXA0IPNmHf6yH4tRzk_0 2024-09-12T01:10:59.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.449+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10545876981968959984', time=2024-09-12T02:59:34.051662+0000, chain.objs.size()=1 2024-09-12T01:10:59.448 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.449+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.558__shadow_.7yN4qCu2r5ZZGqQbfusHYywZyGdzPjl_0 2024-09-12T01:10:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4174221765603165988', time=2024-09-12T03:00:07.654239+0000, chain.objs.size()=1 2024-09-12T01:10:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.575__shadow_.K_MV1cRW2MZoVdqNdtVODHfJXBoFYz7_0 2024-09-12T01:10:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.959819245805871298', time=2024-09-12T03:00:30.215143+0000, chain.objs.size()=1 2024-09-12T01:10:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:-OhTcrnXxzy9JJ3t--S8iy9eFWCO7i2_.JDSMtvG1OJVuOiUaQYPb77Oriib14f5_0 2024-09-12T01:10:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5280154665889634705', time=2024-09-12T03:00:38.822374+0000, chain.objs.size()=1 2024-09-12T01:10:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:URSMwls7kcuTikYfTJSLH8PaKjr5uKy_.ElL3jOFcb6CCJAp6rT_0YIAy_zqoXHZ_0 2024-09-12T01:10:59.449 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4455170084354431928', time=2024-09-12T03:00:54.551850+0000, chain.objs.size()=1 2024-09-12T01:10:59.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.581__shadow:aDRUb.RRDirULd5AY29FjCQWI0-EF.I_.J66xqumdfxy9Yh_zOAhsKygR1ITQZJV_0 2024-09-12T01:10:59.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14663677425217002683', time=2024-09-12T03:00:54.610729+0000, chain.objs.size()=1 2024-09-12T01:10:59.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.581__shadow:aDRUb.RRDirULd5AY29FjCQWI0-EF.I_.J66xqumdfxy9Yh_zOAhsKygR1ITQZJV_0 2024-09-12T01:10:59.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4735888884699782588', time=2024-09-12T03:00:55.368263+0000, chain.objs.size()=1 2024-09-12T01:10:59.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.583__shadow:DJ3oWGpLgV0Xbqo-Z5nPWrXelQ-lJQ5_.zowQ4IMrclKF-_DQZh5QJ9Oqd9Rs6_C_0 2024-09-12T01:10:59.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9674384122707842245', time=2024-09-12T03:00:59.138715+0000, chain.objs.size()=1 2024-09-12T01:10:59.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.587__shadow:kEWUb6TXJ7ilg5c6aUT0E1bCu6qPH31_.VMIENsO5-tUrVJVYggSuNj2cEcAj0BW_0 2024-09-12T01:10:59.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4860671496636936899', time=2024-09-12T03:03:14.672005+0000, chain.objs.size()=1 2024-09-12T01:10:59.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.618__shadow_.thS5uKlex13JNgliPQMI-JFRT9cOD0L_0 2024-09-12T01:10:59.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12200610282452078647', time=2024-09-12T03:05:01.418554+0000, chain.objs.size()=2 2024-09-12T01:10:59.450 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.450+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.644__shadow_.cmka8MY4WVw-FL4DY82iFGIWEg2FKmN_0 2024-09-12T01:10:59.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.451+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.644__shadow_.cmka8MY4WVw-FL4DY82iFGIWEg2FKmN_1 2024-09-12T01:10:59.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.452+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4141192229373802700', time=2024-09-12T03:05:13.805899+0000, chain.objs.size()=1 2024-09-12T01:10:59.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.452+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.654__shadow_.dIX7agKOgAalGDPBLZrGPUNkXP-FUns_0 2024-09-12T01:10:59.451 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.452+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8880751991218149282', time=2024-09-12T03:05:37.502614+0000, chain.objs.size()=1 2024-09-12T01:10:59.452 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.452+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.669__shadow_.Yy2rBAB26FUn8enuu7auPkBHRrL91vv_0 2024-09-12T01:10:59.455 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.456+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.458 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.459+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:10:59.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.460+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.459 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.460+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/63399' 2024-09-12T01:10:59.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13791813056967484143', time=2024-09-12T02:49:19.541236+0000, chain.objs.size()=3 2024-09-12T01:10:59.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.Hypv4eULTMfRwr3B-V_brd8_X7N_93D_0 2024-09-12T01:10:59.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.Hypv4eULTMfRwr3B-V_brd8_X7N_93D_1 2024-09-12T01:10:59.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.Hypv4eULTMfRwr3B-V_brd8_X7N_93D_2 2024-09-12T01:10:59.461 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18288192203979713473', time=2024-09-12T02:49:41.512502+0000, chain.objs.size()=1 2024-09-12T01:10:59.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.177__shadow_.Ly5-VDvqsFFBU0YuJpQTN_xLosgMuqV_0 2024-09-12T01:10:59.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10256384278609795684', time=2024-09-12T02:49:47.148744+0000, chain.objs.size()=1 2024-09-12T01:10:59.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.189__shadow_.c4osvpwB3VrYJ5dfe2PbVZEYKfY7CrX_0 2024-09-12T01:10:59.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6195045593002922618', time=2024-09-12T02:51:26.006660+0000, chain.objs.size()=1 2024-09-12T01:10:59.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.232__shadow_.uT9u5rKX2TfVr6uSmNxsi2AL5d326e__0 2024-09-12T01:10:59.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15951523342970358682', time=2024-09-12T02:51:27.878900+0000, chain.objs.size()=1 2024-09-12T01:10:59.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.235__shadow_.tlOZZ3Yxw2EvsIFfH0d4QRuBx67wir5_0 2024-09-12T01:10:59.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17418649513502587659', time=2024-09-12T02:51:33.800671+0000, chain.objs.size()=1 2024-09-12T01:10:59.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.244__shadow_.g1_kh94u8jbbrezjws3fLFN7Cd8H4GF_0 2024-09-12T01:10:59.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13150676184647429416', time=2024-09-12T02:51:34.646577+0000, chain.objs.size()=1 2024-09-12T01:10:59.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.245__shadow_.SPHRh8epKHlyxWDDqSVPRu7HBBnSFGW_0 2024-09-12T01:10:59.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7627402333176152330', time=2024-09-12T02:51:40.135579+0000, chain.objs.size()=1 2024-09-12T01:10:59.462 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.254__shadow_.M9XIWvhqsemqckZ913einDpiPOCA8V1_0 2024-09-12T01:10:59.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11583166982348977171', time=2024-09-12T02:51:41.334203+0000, chain.objs.size()=1 2024-09-12T01:10:59.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.256__shadow_.xmxCtXCtvkciTu26bpAE3lfUWu71QKm_0 2024-09-12T01:10:59.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8035645545187171774', time=2024-09-12T02:52:23.030930+0000, chain.objs.size()=1 2024-09-12T01:10:59.463 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.461+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.IVt-xirNlEb-gI6R4_x1xYHKxYMarbY_0 2024-09-12T01:10:59.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5766940961056067376', time=2024-09-12T02:52:23.479256+0000, chain.objs.size()=1 2024-09-12T01:10:59.464 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.CAQxFK0T6jN3RWcxTGq_S9ChPbzA-jE_0 2024-09-12T01:10:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5352824260143224151', time=2024-09-12T02:52:23.652832+0000, chain.objs.size()=1 2024-09-12T01:10:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.rYwTQZw2SHj-9NsWNypfiv2cPIujb5b_0 2024-09-12T01:10:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11327675589239232225', time=2024-09-12T02:52:23.704210+0000, chain.objs.size()=1 2024-09-12T01:10:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.w4FKHWSDFAr78mrcRLeTC_IwTM-C6G3_0 2024-09-12T01:10:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6274668473746178717', time=2024-09-12T02:52:24.475771+0000, chain.objs.size()=1 2024-09-12T01:10:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.IkXIMsGqA-sV-C8RRaCoJcYD8sfiDGP_0 2024-09-12T01:10:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5442478652378161516', time=2024-09-12T02:52:24.530888+0000, chain.objs.size()=1 2024-09-12T01:10:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pVCnXSrSo8A0uA2y6ymN8F-YVoRCwso_0 2024-09-12T01:10:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8955597024905766706', time=2024-09-12T02:52:24.690046+0000, chain.objs.size()=1 2024-09-12T01:10:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4M6RgSncssCn-ZL5jURXums5lQvd66Q_0 2024-09-12T01:10:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18067409389656114778', time=2024-09-12T02:52:24.722038+0000, chain.objs.size()=1 2024-09-12T01:10:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4MYRFgKwwMHP9U3NGWWMJSagMOHrdup_0 2024-09-12T01:10:59.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15708950850874054223', time=2024-09-12T02:52:24.788799+0000, chain.objs.size()=1 2024-09-12T01:10:59.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ZvA9p1VZNSI1As838yAvB7O3cp6NDRl_0 2024-09-12T01:10:59.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14225375110340896682', time=2024-09-12T02:52:24.963258+0000, chain.objs.size()=1 2024-09-12T01:10:59.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.CG2NDKG4hQ1osjaxm8yYM3SKTaZH3zq_0 2024-09-12T01:10:59.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16566488990195665590', time=2024-09-12T02:52:25.006985+0000, chain.objs.size()=1 2024-09-12T01:10:59.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.6aZhvBUgLaDOu8bDq2t1MQv7fP9dDzY_0 2024-09-12T01:10:59.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15443906042150995754', time=2024-09-12T02:52:25.129909+0000, chain.objs.size()=1 2024-09-12T01:10:59.466 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.465+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._unfJa2vH0NuGh_dkuOIJ7Zz5_dSudb_0 2024-09-12T01:10:59.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.467+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5540978618307064556', time=2024-09-12T02:52:25.146937+0000, chain.objs.size()=1 2024-09-12T01:10:59.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.467+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.eJfuo-BRtDQTMQpm3c2YQW8sLnnIrDp_0 2024-09-12T01:10:59.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.468+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2214467540321873634', time=2024-09-12T02:52:25.605829+0000, chain.objs.size()=1 2024-09-12T01:10:59.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.468+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.mpE1goixvzj3ZbXczj3i_3J_wN2KvG3_0 2024-09-12T01:10:59.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.468+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5764020652499864118', time=2024-09-12T02:52:26.284809+0000, chain.objs.size()=1 2024-09-12T01:10:59.467 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.468+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.dUd4IM88zphsqIqD1GbO8ghVxFA4hLT_0 2024-09-12T01:10:59.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.468+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16491500812717852998', time=2024-09-12T02:52:26.691394+0000, chain.objs.size()=1 2024-09-12T01:10:59.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.468+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.9zOe15em4B1HlTFuXovKtXG0BeF53q0_0 2024-09-12T01:10:59.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.469+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3824039520460758865', time=2024-09-12T02:52:27.056017+0000, chain.objs.size()=1 2024-09-12T01:10:59.468 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.469+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.aor-YI_fFBBq5BaJbV5qc_lMmm6agIu_0 2024-09-12T01:10:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.756928365867541741', time=2024-09-12T02:52:27.250094+0000, chain.objs.size()=1 2024-09-12T01:10:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uxMJmFwxr_mu6T5aP4vLZCH4nd7jkb5_0 2024-09-12T01:10:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17557574764553888560', time=2024-09-12T02:52:27.387133+0000, chain.objs.size()=1 2024-09-12T01:10:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.YXLrgfk6zYd4ZIX7FsFmU9qZGm8vxXh_0 2024-09-12T01:10:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15973888355441960835', time=2024-09-12T02:52:28.572994+0000, chain.objs.size()=1 2024-09-12T01:10:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.aMEd9E0oAqYUtKVv__5EVY0y3YtshuL_0 2024-09-12T01:10:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8687845639756607063', time=2024-09-12T02:52:28.620421+0000, chain.objs.size()=1 2024-09-12T01:10:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.aAq42a-ZmtQyttQxWPiCgVLAqe5Wyns_0 2024-09-12T01:10:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15304630754968323600', time=2024-09-12T02:52:28.740211+0000, chain.objs.size()=1 2024-09-12T01:10:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.MO-INiryKJkhVQDd4cJdn1PM4iHYTb2_0 2024-09-12T01:10:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4485004900124706712', time=2024-09-12T02:52:28.860830+0000, chain.objs.size()=1 2024-09-12T01:10:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Jm6K2E5fhAS5IYXQbqjJEa8JTW2v73g_0 2024-09-12T01:10:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6755723850418361824', time=2024-09-12T02:52:28.977589+0000, chain.objs.size()=1 2024-09-12T01:10:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.foQZlo7lVP4MafGepsyJDk7yfopLVpz_0 2024-09-12T01:10:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15165087113981544113', time=2024-09-12T02:52:29.240890+0000, chain.objs.size()=1 2024-09-12T01:10:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.470+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xHygtJIczyd6qv2SO2YiWwJSgZmZUnE_0 2024-09-12T01:10:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.471+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14346464498243756275', time=2024-09-12T02:52:29.295332+0000, chain.objs.size()=1 2024-09-12T01:10:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.471+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.CAjlemdzyNes8gU26Mnj_TTxsxEP-hz_0 2024-09-12T01:10:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.471+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2460398018746723181', time=2024-09-12T02:52:29.382244+0000, chain.objs.size()=1 2024-09-12T01:10:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.471+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.jS5xlzHxiuNE1NwqxcOqhde6D7gB0mW_0 2024-09-12T01:10:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.473+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16879996480299557875', time=2024-09-12T02:52:30.025465+0000, chain.objs.size()=1 2024-09-12T01:10:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.473+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.I8Gw2CAV-Ukwck7QF3bwPAKORmr4z07_0 2024-09-12T01:10:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.473+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7879687267589332674', time=2024-09-12T02:52:30.804586+0000, chain.objs.size()=1 2024-09-12T01:10:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.473+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.K26LODiB1OcpmTEB2W6MajzabOOrZAg_0 2024-09-12T01:10:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.473+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16574625843642581334', time=2024-09-12T02:52:30.857531+0000, chain.objs.size()=1 2024-09-12T01:10:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.473+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.sEuhRhKTqsLjcirSGtaajeogXIeIhVl_0 2024-09-12T01:10:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.473+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8652357808218515743', time=2024-09-12T02:52:31.147769+0000, chain.objs.size()=1 2024-09-12T01:10:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.473+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.o0c5gKfoWURJlEjwmMSGdkmZHa4UJNt_0 2024-09-12T01:10:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.473+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18029775764927765951', time=2024-09-12T02:52:31.681843+0000, chain.objs.size()=1 2024-09-12T01:10:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.474+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.FaqJ9Dmy6IK2dqYBQAFrv5_22In8G2h_0 2024-09-12T01:10:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.474+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18190710348688124074', time=2024-09-12T02:52:31.682576+0000, chain.objs.size()=1 2024-09-12T01:10:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.474+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.zIJo9pPqnI0uAcXuNf-XUEkEiAe6qf8_0 2024-09-12T01:10:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.474+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4883316641952647896', time=2024-09-12T02:52:31.708440+0000, chain.objs.size()=1 2024-09-12T01:10:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.474+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.W1lizK5Djb9NWCeIfGosrS0xg6dcovW_0 2024-09-12T01:10:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.474+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.358223049484061989', time=2024-09-12T02:52:31.943880+0000, chain.objs.size()=1 2024-09-12T01:10:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.474+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.kFesRfKK8FkAgEK9LjjCwND-MF_XIWs_0 2024-09-12T01:10:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.474+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8497633147223483352', time=2024-09-12T02:52:32.546536+0000, chain.objs.size()=1 2024-09-12T01:10:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.474+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.264__shadow_.Lwe-jVRLbDqBLDU70K-1vAFLUFZoMvB_0 2024-09-12T01:10:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.476+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7710471696594138000', time=2024-09-12T02:52:41.178987+0000, chain.objs.size()=1 2024-09-12T01:10:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.476+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.279__shadow_.nmOT_ISBdEr__eM0RNhmuvmgd66fmyJ_0 2024-09-12T01:10:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.476+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18183670644632728248', time=2024-09-12T02:52:58.854519+0000, chain.objs.size()=1 2024-09-12T01:10:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.476+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.303__shadow_.jHAsCCzzGRBVw-eAMFTjEyCrl9pcFB-_0 2024-09-12T01:10:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.429817796138352728', time=2024-09-12T02:53:01.530932+0000, chain.objs.size()=1 2024-09-12T01:10:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.307__shadow_.ZzxYGjVOWt7TLi84ae0-Dk_-K9N96Q3_0 2024-09-12T01:10:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3424142828808399720', time=2024-09-12T02:53:49.674361+0000, chain.objs.size()=1 2024-09-12T01:10:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ynPw7wWeQrFXxHJI7zsKHccVz9KtPfU_0 2024-09-12T01:10:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1388213929901427791', time=2024-09-12T02:53:50.144790+0000, chain.objs.size()=1 2024-09-12T01:10:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.6LM9JE4pez9Eo2tTWSTjoDGTBcfoJ9a_0 2024-09-12T01:10:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7179267790555402557', time=2024-09-12T02:53:50.893951+0000, chain.objs.size()=1 2024-09-12T01:10:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ARllJfUR1C8-pO63GMIEh4NbUzzc1e1_0 2024-09-12T01:10:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11438494002169863816', time=2024-09-12T02:53:50.894665+0000, chain.objs.size()=1 2024-09-12T01:10:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.CBdt-X8-iZKpkaS9f9rZGU7fSbQkpVR_0 2024-09-12T01:10:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12231782782697095714', time=2024-09-12T02:53:51.287867+0000, chain.objs.size()=1 2024-09-12T01:10:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.2cLDp8GPTAXNmtNRxYAf653nm4Zn-yG_0 2024-09-12T01:10:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11199133391208784590', time=2024-09-12T02:53:51.810816+0000, chain.objs.size()=1 2024-09-12T01:10:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lwPDKHGVgkIDpa1NQQByn3kd0-1Hrbk_0 2024-09-12T01:10:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7601064425538744010', time=2024-09-12T02:53:52.373070+0000, chain.objs.size()=1 2024-09-12T01:10:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.8OZ-ilqOyXbLvMp5hWId8ynA-J3vgFR_0 2024-09-12T01:10:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2460498858925511508', time=2024-09-12T02:53:53.271612+0000, chain.objs.size()=1 2024-09-12T01:10:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.477+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qNn6EQ8mra2YsMy9FCUNLXA9SjSXP73_0 2024-09-12T01:10:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.481+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7343610957902495707', time=2024-09-12T02:53:53.963184+0000, chain.objs.size()=1 2024-09-12T01:10:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.481+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.2O7JXy38emFSBvA2vW9iJg2QmJR1o1t_0 2024-09-12T01:10:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.481+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3216917066732888604', time=2024-09-12T02:53:54.254585+0000, chain.objs.size()=1 2024-09-12T01:10:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.481+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Y4xXOvuvReDdrpZYlad-9C5Q67lTx4W_0 2024-09-12T01:10:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.482+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16894296168269349614', time=2024-09-12T02:53:54.505451+0000, chain.objs.size()=1 2024-09-12T01:10:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.482+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0p4pCTwzfhWFhJl_EHDCXEZAD0gI66X_0 2024-09-12T01:10:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.482+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2203013357024988998', time=2024-09-12T02:53:54.596028+0000, chain.objs.size()=1 2024-09-12T01:10:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.482+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.abxAiY_NbPVvL35OjdEzhpoSU6hffMO_0 2024-09-12T01:10:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17121367190339770897', time=2024-09-12T02:53:55.079934+0000, chain.objs.size()=1 2024-09-12T01:10:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Ucgw0IC8KNSqghvUXCwhkw-Wqf9CwNy_0 2024-09-12T01:10:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17420013283665349339', time=2024-09-12T02:53:56.614875+0000, chain.objs.size()=1 2024-09-12T01:10:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.QUjLmri5OpLKFt1VXEEQaHSIUKSw7J6_0 2024-09-12T01:10:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10525395282297246960', time=2024-09-12T02:53:56.984665+0000, chain.objs.size()=1 2024-09-12T01:10:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.CX1GNLbr3qLF3RYdo1uBEFlySKTerci_0 2024-09-12T01:10:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11748095444502067724', time=2024-09-12T02:53:57.359559+0000, chain.objs.size()=1 2024-09-12T01:10:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.-wmDZvokpEpX0WuI93HcoBZ5v-r3eGV_0 2024-09-12T01:10:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4878330979130655152', time=2024-09-12T02:53:57.988676+0000, chain.objs.size()=1 2024-09-12T01:10:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.T1lje8GiOQcg3xITVU8DZt4USV72pmC_0 2024-09-12T01:10:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4872452284687733299', time=2024-09-12T02:53:58.214565+0000, chain.objs.size()=1 2024-09-12T01:10:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.2ppeEIMilKMRXtDPUDNrW8Cf38UOjDe_0 2024-09-12T01:10:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.483+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18021778606385334663', time=2024-09-12T02:53:58.544731+0000, chain.objs.size()=1 2024-09-12T01:10:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.483+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.iH70qSkVaapYccsRM3NjPQrmjFbZEwU_0 2024-09-12T01:10:59.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.484+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11311042682829613339', time=2024-09-12T02:53:58.650247+0000, chain.objs.size()=1 2024-09-12T01:10:59.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.484+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.F2z-O8px542NvNiXOJBxg6tm7IfS_N__0 2024-09-12T01:10:59.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.484+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17694210924004687364', time=2024-09-12T02:53:58.951160+0000, chain.objs.size()=1 2024-09-12T01:10:59.484 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.484+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.jN44zRHdJd1MTwTCdWQJu7MbgHDlE5M_0 2024-09-12T01:10:59.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.485+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15431821563176121100', time=2024-09-12T02:53:59.482618+0000, chain.objs.size()=1 2024-09-12T01:10:59.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.485+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Hdp5aW51jCW0voEpGU_AL0_rte8xVtp_0 2024-09-12T01:10:59.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.485+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11209760488328650841', time=2024-09-12T02:54:36.635636+0000, chain.objs.size()=1 2024-09-12T01:10:59.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.485+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.n-jaRhTjT16r-BjvU3hMP3WVK4adWjU_0 2024-09-12T01:10:59.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.486+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12905078171505227870', time=2024-09-12T02:54:37.024714+0000, chain.objs.size()=1 2024-09-12T01:10:59.485 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.486+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.yI-19HuxZaHsyqMpjR2TcJecZERt1yn_0 2024-09-12T01:10:59.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8772937489036339433', time=2024-09-12T02:54:37.395406+0000, chain.objs.size()=1 2024-09-12T01:10:59.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.zhO2pKu0_s33y2AU62uwKsxtFBNpEnu_0 2024-09-12T01:10:59.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7659484948408218927', time=2024-09-12T02:54:37.609225+0000, chain.objs.size()=1 2024-09-12T01:10:59.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.iv2s6KxhAkTCBNKTemKM6bxrQ4Taxbs_0 2024-09-12T01:10:59.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9929448642120024404', time=2024-09-12T02:54:38.867605+0000, chain.objs.size()=1 2024-09-12T01:10:59.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.PXzJNP0zpAvjWgwjs6HcL-ex5FCAtet_0 2024-09-12T01:10:59.488 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7560671649278203663', time=2024-09-12T02:54:39.510193+0000, chain.objs.size()=1 2024-09-12T01:10:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.FB-T8sNSJvpsHRMZDGk7pN60SebYB66_0 2024-09-12T01:10:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13018789001256195961', time=2024-09-12T02:54:40.377412+0000, chain.objs.size()=1 2024-09-12T01:10:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Td-YQPKofx4nOf-pQORAIUBJqkVdbQO_0 2024-09-12T01:10:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1814365195436116591', time=2024-09-12T02:54:40.902801+0000, chain.objs.size()=1 2024-09-12T01:10:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.m-XOX1qUtdR0Rhfu1KQ7l1ZVvkJHaQY_0 2024-09-12T01:10:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4621609295896322000', time=2024-09-12T02:54:41.011149+0000, chain.objs.size()=1 2024-09-12T01:10:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.f-_vHGsCxh7D9qUg0Kq9JegHWhqcCih_0 2024-09-12T01:10:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16701099204161487911', time=2024-09-12T02:54:41.192021+0000, chain.objs.size()=1 2024-09-12T01:10:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.WiG2VMpPCEXoivFcT3M8ZULZxoyJMvO_0 2024-09-12T01:10:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17041014919657604742', time=2024-09-12T02:54:41.594482+0000, chain.objs.size()=1 2024-09-12T01:10:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.-I1dROndWvjZDGJGnitGJRoenuxepl5_0 2024-09-12T01:10:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4233534173328328112', time=2024-09-12T02:54:42.435940+0000, chain.objs.size()=1 2024-09-12T01:10:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dswVv6T1gAWlQ29fWn7qg3UwrFU7Pbe_0 2024-09-12T01:10:59.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9661327551882861287', time=2024-09-12T02:54:43.991175+0000, chain.objs.size()=1 2024-09-12T01:10:59.490 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.489+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.bIiyNqq0lEmxsOADLVMrTBfNK7BKJmE_0 2024-09-12T01:10:59.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.492+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14624732410009441299', time=2024-09-12T02:54:44.025969+0000, chain.objs.size()=1 2024-09-12T01:10:59.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.492+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.xgifsvTZdp6YYY9cSblaYZO63hnCXD3_0 2024-09-12T01:10:59.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.492+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15170823349686915305', time=2024-09-12T02:54:44.047034+0000, chain.objs.size()=1 2024-09-12T01:10:59.491 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.492+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.LktSg38mBmkSE99wJjmeBAt4-lVYI0g_0 2024-09-12T01:10:59.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.493+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8454397054592980703', time=2024-09-12T02:54:44.091312+0000, chain.objs.size()=1 2024-09-12T01:10:59.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.493+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.oh0whxbbgAYaQTv6C-tPhzjoFWukh1Q_0 2024-09-12T01:10:59.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.493+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13119293991720662358', time=2024-09-12T02:54:44.114002+0000, chain.objs.size()=1 2024-09-12T01:10:59.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.493+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.0WK9qwTN6-Vei2KPDNFc-yqksjI4htz_0 2024-09-12T01:10:59.492 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.493+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3010659198144131789', time=2024-09-12T02:54:44.485423+0000, chain.objs.size()=1 2024-09-12T01:10:59.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.493+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.tJMsBDEHTqsG37GZco7S61AmNsekUVJ_0 2024-09-12T01:10:59.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.494+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9536070778288152323', time=2024-09-12T02:54:44.573342+0000, chain.objs.size()=1 2024-09-12T01:10:59.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.494+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.vaAy_SdcOihYk9GdkLBENPZHIr8Ren__0 2024-09-12T01:10:59.493 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.494+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6807938468495875378', time=2024-09-12T02:54:44.630160+0000, chain.objs.size()=1 2024-09-12T01:10:59.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.494+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dhzjBokRjvB0_0lrF2-s6otEikeuG87_0 2024-09-12T01:10:59.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.494+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11031929096122988762', time=2024-09-12T02:54:44.748168+0000, chain.objs.size()=1 2024-09-12T01:10:59.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.494+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.byF_elOvC5SWa8ybw0WMFSsh_lpif4d_0 2024-09-12T01:10:59.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.494+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3473033711042076277', time=2024-09-12T02:54:45.379494+0000, chain.objs.size()=1 2024-09-12T01:10:59.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.494+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.G7N5YRGW72rx8UjKYC9tznuCw3KVG8k_0 2024-09-12T01:10:59.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.494+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16907577730569307735', time=2024-09-12T02:54:45.380165+0000, chain.objs.size()=1 2024-09-12T01:10:59.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.494+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.hJWYHiDKMiPS-EwcEj5duTvwCOD1vZS_0 2024-09-12T01:10:59.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.494+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8438909919132638108', time=2024-09-12T02:54:45.485533+0000, chain.objs.size()=1 2024-09-12T01:10:59.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.494+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.DFzrXHI8djhZlorEo4uU2GrxFinmRsg_0 2024-09-12T01:10:59.494 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.495+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2559679694168072716', time=2024-09-12T02:54:45.533823+0000, chain.objs.size()=1 2024-09-12T01:10:59.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.495+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.YtgFUcGgfyUNmetfL7Qzb2nnGSim4mx_0 2024-09-12T01:10:59.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.495+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12655140880292417474', time=2024-09-12T02:54:45.864804+0000, chain.objs.size()=1 2024-09-12T01:10:59.495 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.495+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.KxzBSjyGx2eVs2T3wFCEzo1akgEJ3Hp_0 2024-09-12T01:10:59.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.497+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9343431432000449759', time=2024-09-12T02:54:46.772401+0000, chain.objs.size()=1 2024-09-12T01:10:59.496 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.497+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.2MrV7iwjDh_VppcK7EyO73z-5nu0cuh_0 2024-09-12T01:10:59.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.498+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12182144628288253776', time=2024-09-12T02:54:51.273665+0000, chain.objs.size()=1 2024-09-12T01:10:59.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.498+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.333__shadow_.w0tbYQfMjhuQhqxzTJgWGOceohpicuH_0 2024-09-12T01:10:59.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.498+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11519779260866404404', time=2024-09-12T02:54:53.503527+0000, chain.objs.size()=1 2024-09-12T01:10:59.497 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.498+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.337__shadow_.BYhQWSKeB_a1czehOsSCU2C5rMaNqqN_0 2024-09-12T01:10:59.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.499+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16027239153731710776', time=2024-09-12T02:55:08.352506+0000, chain.objs.size()=1 2024-09-12T01:10:59.498 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.499+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.370__shadow_.IG8l_L0nuRfB7i1QS0Jz2ocFoENCz5X_0 2024-09-12T01:10:59.500 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.501+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/63399 2024-09-12T01:10:59.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T01:10:59.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14465168571493316200', time=2024-09-12T02:56:02.985599+0000, chain.objs.size()=1 2024-09-12T01:10:59.502 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.462__shadow_.dpRaR_GbhDv4wMVM-xXrMTONdQoyZ0__0 2024-09-12T01:10:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2530399698024866812', time=2024-09-12T02:56:14.318892+0000, chain.objs.size()=1 2024-09-12T01:10:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.484__shadow_.sDLnlh2eA2pL5coyMZ59u98S6FaaZ8i_0 2024-09-12T01:10:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15242852756875411409', time=2024-09-12T02:56:41.241331+0000, chain.objs.size()=6 2024-09-12T01:10:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.1 2024-09-12T01:10:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.2 2024-09-12T01:10:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.3 2024-09-12T01:10:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.4 2024-09-12T01:10:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.5 2024-09-12T01:10:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.6 2024-09-12T01:10:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12365901648559238023', time=2024-09-12T02:59:50.028155+0000, chain.objs.size()=1 2024-09-12T01:10:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.566__shadow_.NcX1gLV6ANwPdm6VrFtG-tiAtt5gdS6_0 2024-09-12T01:10:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4275439253767979143', time=2024-09-12T02:59:53.637490+0000, chain.objs.size()=1 2024-09-12T01:10:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:TuAMPqcF04IyDKgKMaa.VfstqUiWxTl_.itKP_IkX6UXxazhoeSQ8IYbmwp4GNmt_0 2024-09-12T01:10:59.503 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2431933565965617593', time=2024-09-12T02:59:57.859386+0000, chain.objs.size()=1 2024-09-12T01:10:59.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:GFCDWUr8mi5dxlugQ2fGvcyisoqFLy9_.wYHXGstPYuruuDCPpzQoopB7wU7nDL__0 2024-09-12T01:10:59.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6995888884984195732', time=2024-09-12T03:00:11.065836+0000, chain.objs.size()=1 2024-09-12T01:10:59.504 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.503+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.575__shadow:UVq5ltmjg-UsyaCS8Pd3b1WeoEXTmXD_.aVUBqtUZtTRRnhAdpN-IsfmEjCHUXBp_0 2024-09-12T01:10:59.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.506+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7605189703041694151', time=2024-09-12T03:00:24.211138+0000, chain.objs.size()=1 2024-09-12T01:10:59.505 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.506+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:TMIn0sragdnHaoMaRBspGtAVxzweEye_.7OWiI_PAMMgn0hwDRMtK8UZGNBChnFz_0 2024-09-12T01:10:59.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.507+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3526865392665781955', time=2024-09-12T03:00:39.088244+0000, chain.objs.size()=1 2024-09-12T01:10:59.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.507+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:v6wEim4zqVAOBuTsKkoc5cf.IhPqVp3_.02kMVywyAPAfYb7RA0SKgc_FOFANfva_0 2024-09-12T01:10:59.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.507+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6361798365380956125', time=2024-09-12T03:00:52.532371+0000, chain.objs.size()=1 2024-09-12T01:10:59.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.507+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.580__shadow:CgYGLT0k9Oz0bHRVzrbb3Os9Gz.BOtK_.D2lLVrCR0nYSct78wTSCQzzgMDDKWgK_0 2024-09-12T01:10:59.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.507+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4390542411142732908', time=2024-09-12T03:00:54.551458+0000, chain.objs.size()=1 2024-09-12T01:10:59.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.507+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.581__shadow:vhn4Imu.J.ZHMkQvM3lrOfQJ10EtQ8h_.ZAG0In-Pi5LY8nVo2YJpTml6dtN5_-A_0 2024-09-12T01:10:59.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.507+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15440841679264405256', time=2024-09-12T03:06:24.352891+0000, chain.objs.size()=1 2024-09-12T01:10:59.506 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.507+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.720__shadow_.M5rLtcFb_y88v4fg8usc6bDC3aEXNvg_0 2024-09-12T01:10:59.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-12T01:10:59.509 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.510+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.511 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.512+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:10:59.512 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.513+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.513 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.514+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47978' 2024-09-12T01:10:59.514 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14319710463001051980', time=2024-09-12T02:49:33.299563+0000, chain.objs.size()=1 2024-09-12T01:10:59.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.167__shadow_.eP7uiHUbw80Nwj5fqAFVKR4daz3feHE_0 2024-09-12T01:10:59.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2613145510434584884', time=2024-09-12T02:52:21.223155+0000, chain.objs.size()=1 2024-09-12T01:10:59.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.AQCnVLWUIDB1AWXvh_tDVLnpkekSvo8_0 2024-09-12T01:10:59.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6827554147807357127', time=2024-09-12T02:52:21.474877+0000, chain.objs.size()=1 2024-09-12T01:10:59.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.IIJxCzRpjBJmAWkg68JTIdaWLCmis_r_0 2024-09-12T01:10:59.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10279962225107341703', time=2024-09-12T02:52:21.919993+0000, chain.objs.size()=1 2024-09-12T01:10:59.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.LafE3BzYEW9otU8gsTX9VpWmfpG1zst_0 2024-09-12T01:10:59.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14124441096530897239', time=2024-09-12T02:52:21.956260+0000, chain.objs.size()=1 2024-09-12T01:10:59.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.MiOUKWej98hLmZLASXxFdWIKzCXpXoP_0 2024-09-12T01:10:59.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9475194869973079995', time=2024-09-12T02:52:22.204360+0000, chain.objs.size()=1 2024-09-12T01:10:59.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.p6VmcfCQRPIoW8dC1J1nstGAhv_YsVy_0 2024-09-12T01:10:59.515 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11111796740377892795', time=2024-09-12T02:52:22.995636+0000, chain.objs.size()=1 2024-09-12T01:10:59.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.FdflqP98fZZdgpewcT0rbhnd19epozq_0 2024-09-12T01:10:59.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3172008075544415831', time=2024-09-12T02:52:23.132849+0000, chain.objs.size()=1 2024-09-12T01:10:59.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.N5rWz_FJ5VJfyajs_gkdYw8zcPTHlSG_0 2024-09-12T01:10:59.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5812990674420251437', time=2024-09-12T02:52:23.183728+0000, chain.objs.size()=1 2024-09-12T01:10:59.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.GTDdo-r2CKelMxOXFajS8wEWsQrlbxN_0 2024-09-12T01:10:59.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.650291640981742889', time=2024-09-12T02:52:23.451473+0000, chain.objs.size()=1 2024-09-12T01:10:59.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.y5MRSsYkK2XPENudY1cfTcju0PBqHdK_0 2024-09-12T01:10:59.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13235718070181622288', time=2024-09-12T02:52:23.547915+0000, chain.objs.size()=1 2024-09-12T01:10:59.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.GP5xb9lDpcBeC5Cf17CdVMK2Vk4_OPA_0 2024-09-12T01:10:59.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5805238556417009714', time=2024-09-12T02:52:23.678435+0000, chain.objs.size()=1 2024-09-12T01:10:59.516 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.515+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.iAIouCH5-hhpQhXmFy1ZDZWBSySTXQX_0 2024-09-12T01:10:59.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14308359617425965704', time=2024-09-12T02:52:24.514823+0000, chain.objs.size()=1 2024-09-12T01:10:59.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.idxrj2_8dlbm8psprNDYK4l2J8srdWk_0 2024-09-12T01:10:59.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1917691743795938688', time=2024-09-12T02:52:24.802401+0000, chain.objs.size()=1 2024-09-12T01:10:59.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ZD6naFUpyQKoKY_626XAipz7O2lE2Jr_0 2024-09-12T01:10:59.517 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10681129753840358953', time=2024-09-12T02:52:25.107312+0000, chain.objs.size()=1 2024-09-12T01:10:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.WplHde_qFBFNh1XUkKTYBB_hnZfbLoI_0 2024-09-12T01:10:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8945300093095563293', time=2024-09-12T02:52:25.827580+0000, chain.objs.size()=1 2024-09-12T01:10:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.oNL6jb8E8JchNn0aHCmO6wu6jhXY7Wy_0 2024-09-12T01:10:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18401964151593557138', time=2024-09-12T02:52:26.442585+0000, chain.objs.size()=1 2024-09-12T01:10:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.w-YPpFlIEtKQmuXiqLagQk5kDkOJe-2_0 2024-09-12T01:10:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10075820222142529387', time=2024-09-12T02:52:27.050394+0000, chain.objs.size()=1 2024-09-12T01:10:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.rEj_eBQXP5CxXbVG_ETSvDbcEgXXI3t_0 2024-09-12T01:10:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18003980988072460832', time=2024-09-12T02:52:27.243732+0000, chain.objs.size()=1 2024-09-12T01:10:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.aClqBi8vHRi0lQbhejX2Rum8OcPOZKk_0 2024-09-12T01:10:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6129989968048416599', time=2024-09-12T02:52:27.324048+0000, chain.objs.size()=1 2024-09-12T01:10:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.cwUkWC5Pu4NMuv5YqgHExqCjTrYojT1_0 2024-09-12T01:10:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3765636184037409307', time=2024-09-12T02:52:27.414997+0000, chain.objs.size()=1 2024-09-12T01:10:59.518 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.gppEc-4qdIB-7zmKPbyXneCl6IgXHpS_0 2024-09-12T01:10:59.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9680407137771224316', time=2024-09-12T02:52:27.602318+0000, chain.objs.size()=1 2024-09-12T01:10:59.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1JCrVcZiETLme1Aubi2vY_v5rVlGwed_0 2024-09-12T01:10:59.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14923802971832075168', time=2024-09-12T02:52:27.638054+0000, chain.objs.size()=1 2024-09-12T01:10:59.519 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.518+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uKH0dPxC51WO4xsCSdgLZkE91AwdHiv_0 2024-09-12T01:10:59.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.522+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17848116289954361660', time=2024-09-12T02:52:28.632255+0000, chain.objs.size()=1 2024-09-12T01:10:59.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.522+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.RfE39OnLVZix8uQDMlUA3ARx_6AqHdQ_0 2024-09-12T01:10:59.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.522+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6054933727691229819', time=2024-09-12T02:52:29.166734+0000, chain.objs.size()=1 2024-09-12T01:10:59.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.522+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.RhjUP9JwfOd4ZEctJ2HavMxy6fl2_Mv_0 2024-09-12T01:10:59.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.522+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12389502079386526952', time=2024-09-12T02:52:29.264353+0000, chain.objs.size()=1 2024-09-12T01:10:59.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.522+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.FZlHwZI9Y4AsPy1ItzKARt-pAZ-bUCe_0 2024-09-12T01:10:59.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.522+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4678037642725427053', time=2024-09-12T02:52:29.869669+0000, chain.objs.size()=1 2024-09-12T01:10:59.521 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.522+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.YaT8_Sh9Lm1IVrxNU4P09Lvruv61CxC_0 2024-09-12T01:10:59.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7717299212572274255', time=2024-09-12T02:52:29.901335+0000, chain.objs.size()=1 2024-09-12T01:10:59.522 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KxYk1TGEx5yTRwAhcfEgNB8HwW8SP20_0 2024-09-12T01:10:59.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7474413073739791434', time=2024-09-12T02:52:30.518282+0000, chain.objs.size()=1 2024-09-12T01:10:59.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.mMBOw1ZiGRMkd2DUuR1Wi5h4NQsbs2j_0 2024-09-12T01:10:59.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5863339082391466748', time=2024-09-12T02:52:31.140228+0000, chain.objs.size()=1 2024-09-12T01:10:59.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wnW6qq3bPl87tyLey5Yz0cg0StGMgWv_0 2024-09-12T01:10:59.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4996021009108742612', time=2024-09-12T02:52:31.459885+0000, chain.objs.size()=1 2024-09-12T01:10:59.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wLHhxMYWEZMhoqpFQQf6IQcCFaQUTKK_0 2024-09-12T01:10:59.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13111709071660206662', time=2024-09-12T02:52:31.473782+0000, chain.objs.size()=1 2024-09-12T01:10:59.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.YWKHKpboxak9SSneRXJ8M_d_gnKlglE_0 2024-09-12T01:10:59.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2998089755584423892', time=2024-09-12T02:52:31.590748+0000, chain.objs.size()=1 2024-09-12T01:10:59.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.MJH9JwNTqStP1pzTnYGmu__htrDOS0k_0 2024-09-12T01:10:59.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.523+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13413522296506553917', time=2024-09-12T02:52:31.886984+0000, chain.objs.size()=1 2024-09-12T01:10:59.523 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.523+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.a3IQu2sLI1H4rtLvMJjr4hQbr2ooJHL_0 2024-09-12T01:10:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.526+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14944045772815894207', time=2024-09-12T02:52:39.980102+0000, chain.objs.size()=1 2024-09-12T01:10:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.526+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.277__shadow_.X9qikM8ZAf-rhj9g2MmY8Ym5dl0e7Mv_0 2024-09-12T01:10:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.526+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13763551579486694756', time=2024-09-12T02:52:51.088523+0000, chain.objs.size()=1 2024-09-12T01:10:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.526+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.6vTRRTIp1oH4wpYHvyYK9SsgBm8nDQQ_0 2024-09-12T01:10:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.526+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11930451815585010922', time=2024-09-12T02:53:49.549999+0000, chain.objs.size()=1 2024-09-12T01:10:59.525 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.526+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.6Ypn6UMIsLeSnrJOYa9ewz8CkHwgGun_0 2024-09-12T01:10:59.526 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.527+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3626786578689565331', time=2024-09-12T02:53:50.033019+0000, chain.objs.size()=1 2024-09-12T01:10:59.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.527+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.zNBcbmJ7brHmBESF1Th1wXqclWoiV0n_0 2024-09-12T01:10:59.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.527+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11518650961980813721', time=2024-09-12T02:53:50.051141+0000, chain.objs.size()=1 2024-09-12T01:10:59.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.527+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.E00VZRnrnfl5j4BhbvkudP-pdWf5ED8_0 2024-09-12T01:10:59.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.528+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13165694211518800073', time=2024-09-12T02:53:50.331574+0000, chain.objs.size()=1 2024-09-12T01:10:59.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.528+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.n3R8cQe5KjvBYS7M2LZabW3qMSdNfCv_0 2024-09-12T01:10:59.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.528+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18077080591374274445', time=2024-09-12T02:53:51.032148+0000, chain.objs.size()=1 2024-09-12T01:10:59.527 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.528+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.QirV6ONZ4-3emxBoDN-l53kaOAhWy7Z_0 2024-09-12T01:10:59.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.529+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2551041848192959343', time=2024-09-12T02:53:51.189972+0000, chain.objs.size()=1 2024-09-12T01:10:59.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.529+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lrg8WRgOmqSWQ8GTMeKCEcLnIBaRMeu_0 2024-09-12T01:10:59.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.529+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11360489299525551754', time=2024-09-12T02:53:51.692354+0000, chain.objs.size()=1 2024-09-12T01:10:59.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.529+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.WH2oow5ultrJmZ7iCx9De-7rpL4tC3T_0 2024-09-12T01:10:59.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.529+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2621835093990628739', time=2024-09-12T02:53:51.851180+0000, chain.objs.size()=1 2024-09-12T01:10:59.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.529+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Q8NtqfKPr06PWhp7Z6sTchmm2J6KUi0_0 2024-09-12T01:10:59.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.529+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15166363122243276236', time=2024-09-12T02:53:52.284072+0000, chain.objs.size()=1 2024-09-12T01:10:59.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.529+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.YkqSbrZjDfUkI7YfH6EIgQoKsZFcp9Z_0 2024-09-12T01:10:59.528 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.529+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3736096125589328297', time=2024-09-12T02:53:52.964819+0000, chain.objs.size()=1 2024-09-12T01:10:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.529+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.teaw19bMrUz5bLrRdgr9zow954opRmx_0 2024-09-12T01:10:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.529+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11099633869046465023', time=2024-09-12T02:53:52.965550+0000, chain.objs.size()=1 2024-09-12T01:10:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.529+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.pdggatFANXLbLESLf9nCHcLjt0VSE5b_0 2024-09-12T01:10:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.529+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13833100136169221775', time=2024-09-12T02:53:53.118301+0000, chain.objs.size()=1 2024-09-12T01:10:59.529 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.529+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ziiVsHMbfzU2iysvgSLucUbMQDeieIk_0 2024-09-12T01:10:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.531+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8117691214466649197', time=2024-09-12T02:53:53.232157+0000, chain.objs.size()=1 2024-09-12T01:10:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.531+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.wpiOyerCdywpO9I5j8tvGRy4BVFOfNz_0 2024-09-12T01:10:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.531+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6805282128547871233', time=2024-09-12T02:53:53.696786+0000, chain.objs.size()=1 2024-09-12T01:10:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.531+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.fggmDY1aHNb3F32YvXBBmq-orSOmR_s_0 2024-09-12T01:10:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.531+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16889238209844589819', time=2024-09-12T02:53:54.023987+0000, chain.objs.size()=1 2024-09-12T01:10:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.531+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.JpznUcFn5y0kgQv_lEFqOqrR4JUq9EL_0 2024-09-12T01:10:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.532+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8417970086746734817', time=2024-09-12T02:53:54.100552+0000, chain.objs.size()=1 2024-09-12T01:10:59.531 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.532+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.igjoDXjfGCrBEGXnl7ymtYelWHH-OqK_0 2024-09-12T01:10:59.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.533+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15398039489100464869', time=2024-09-12T02:53:54.251197+0000, chain.objs.size()=1 2024-09-12T01:10:59.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.533+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.xux3JaazV4ISN4-osZOMVozSei-YZOl_0 2024-09-12T01:10:59.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.533+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.195461574203216406', time=2024-09-12T02:53:54.334114+0000, chain.objs.size()=1 2024-09-12T01:10:59.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.533+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.WY8roGz363Iwyq0S27_JnTiFA4peYh__0 2024-09-12T01:10:59.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.533+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17055958679520809300', time=2024-09-12T02:53:54.477656+0000, chain.objs.size()=1 2024-09-12T01:10:59.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.533+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.AYwBTkFL2zl_NRJ92x0etfk7S15OZtG_0 2024-09-12T01:10:59.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.533+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6513356281405301243', time=2024-09-12T02:53:55.070134+0000, chain.objs.size()=1 2024-09-12T01:10:59.532 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.533+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.9BfcagWSqQD8rg_ybE6ic-JjeYSuBBQ_0 2024-09-12T01:10:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.534+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8605396848134560227', time=2024-09-12T02:53:55.188633+0000, chain.objs.size()=1 2024-09-12T01:10:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.534+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.w0fAGafK-kCiDqFVPxL9JrGEjX6QRa-_0 2024-09-12T01:10:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.534+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2596967214838396539', time=2024-09-12T02:53:55.213486+0000, chain.objs.size()=1 2024-09-12T01:10:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.534+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.th4aKCam1xStQASKwGwjLhgOHJo4cLN_0 2024-09-12T01:10:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.534+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4863055786932537292', time=2024-09-12T02:53:55.485239+0000, chain.objs.size()=1 2024-09-12T01:10:59.533 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.534+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.I59_FoiDUOGisQ766SWBtiYAyiYsZIQ_0 2024-09-12T01:10:59.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.536+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8119970955850178932', time=2024-09-12T02:53:55.547906+0000, chain.objs.size()=1 2024-09-12T01:10:59.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.536+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.uGnY1s7Z4qxngkGZ7QX4S0LUxhD_LNO_0 2024-09-12T01:10:59.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.536+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5475850875992345891', time=2024-09-12T02:53:56.373000+0000, chain.objs.size()=1 2024-09-12T01:10:59.535 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.536+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.QKyFKH4-8nMbyK8CA8J7r4QxIgti4ZW_0 2024-09-12T01:10:59.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9663301358204339383', time=2024-09-12T02:53:56.508412+0000, chain.objs.size()=1 2024-09-12T01:10:59.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ims_Hw739kUsaFYB2lT4J4iZAiM2een_0 2024-09-12T01:10:59.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16696480884177000341', time=2024-09-12T02:53:57.396392+0000, chain.objs.size()=1 2024-09-12T01:10:59.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.b4_qNUKRDhekvQWvq4Bon8GAgoptcNb_0 2024-09-12T01:10:59.536 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10816990828837608767', time=2024-09-12T02:53:57.710132+0000, chain.objs.size()=1 2024-09-12T01:10:59.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.FiWMrafthTJXdX0pfrCvnfF8WMA9fR-_0 2024-09-12T01:10:59.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18289142797202784794', time=2024-09-12T02:53:57.759929+0000, chain.objs.size()=1 2024-09-12T01:10:59.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.gJKr1KUGzHn8Ua0DqEwpuuMlkCl_8Uw_0 2024-09-12T01:10:59.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8171217946731011163', time=2024-09-12T02:53:57.909015+0000, chain.objs.size()=1 2024-09-12T01:10:59.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ZQIm6F3g6FSjKs7siObbLPZc3ESKwdp_0 2024-09-12T01:10:59.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12050952668103689535', time=2024-09-12T02:53:58.196415+0000, chain.objs.size()=1 2024-09-12T01:10:59.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.StoUYof-z_UMDscjNlZUiVmJyUZmmLk_0 2024-09-12T01:10:59.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161884195575739229', time=2024-09-12T02:53:58.422014+0000, chain.objs.size()=1 2024-09-12T01:10:59.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.EQHF5Hdd6n1g0Q1vVxjVW7fP-piKyx7_0 2024-09-12T01:10:59.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17054176644989784104', time=2024-09-12T02:54:36.771003+0000, chain.objs.size()=1 2024-09-12T01:10:59.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.qkRI767dK3wVsr9pnMISpo5NcZR5fVt_0 2024-09-12T01:10:59.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10020113525660684972', time=2024-09-12T02:54:36.914514+0000, chain.objs.size()=1 2024-09-12T01:10:59.537 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.537+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.FkkFlFc3xZ2cePIAoHtLR9cD9sNXUwz_0 2024-09-12T01:10:59.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17935702622072938759', time=2024-09-12T02:54:38.254037+0000, chain.objs.size()=1 2024-09-12T01:10:59.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.aHy6qAaS7KO4owb8ypKIE0X2h_rfag7_0 2024-09-12T01:10:59.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10598796800540264196', time=2024-09-12T02:54:38.277561+0000, chain.objs.size()=1 2024-09-12T01:10:59.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.wYavWakGTJ9DfvwRdT_3qsGh185AV3l_0 2024-09-12T01:10:59.540 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13043428699895261487', time=2024-09-12T02:54:38.303570+0000, chain.objs.size()=1 2024-09-12T01:10:59.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.tzTlQC4DOYrSb4ewtdPVJ23hIP_mxC9_0 2024-09-12T01:10:59.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2461092288463224875', time=2024-09-12T02:54:38.325480+0000, chain.objs.size()=1 2024-09-12T01:10:59.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.jJMuLhVKeCUvL0datsylRCQ9322L-Hz_0 2024-09-12T01:10:59.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10265220403301751353', time=2024-09-12T02:54:38.408329+0000, chain.objs.size()=1 2024-09-12T01:10:59.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dOCQcSUB2yrOW3BPKFNzJCHYGhSBkr7_0 2024-09-12T01:10:59.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16509490149133668404', time=2024-09-12T02:54:38.448621+0000, chain.objs.size()=1 2024-09-12T01:10:59.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.uWzMqjM3nMGHROtaA6ygUOldqdsvWXr_0 2024-09-12T01:10:59.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5205991349778354384', time=2024-09-12T02:54:38.769944+0000, chain.objs.size()=1 2024-09-12T01:10:59.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.a9mCXFk_ZAOmuxYwjMoDHlRhSH7c-Vo_0 2024-09-12T01:10:59.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8462452528510213206', time=2024-09-12T02:54:38.776075+0000, chain.objs.size()=1 2024-09-12T01:10:59.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.CbfXBQFs9_iBfUorteHpARECGa-V2En_0 2024-09-12T01:10:59.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.854873756984427543', time=2024-09-12T02:54:38.865687+0000, chain.objs.size()=1 2024-09-12T01:10:59.541 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.3b5i_JKoQovNu2VRKlTfRVN7BeP06AM_0 2024-09-12T01:10:59.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10169439194421518903', time=2024-09-12T02:54:38.866409+0000, chain.objs.size()=1 2024-09-12T01:10:59.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._rr5-KurXho3dtf6Orav6xCkOVlDzVS_0 2024-09-12T01:10:59.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8020937080506117873', time=2024-09-12T02:54:39.710435+0000, chain.objs.size()=1 2024-09-12T01:10:59.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.541+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.rBdBLW5e_jE3sHrZNilj6DDAJnZEf7S_0 2024-09-12T01:10:59.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.543+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5486847048982582887', time=2024-09-12T02:54:39.723213+0000, chain.objs.size()=1 2024-09-12T01:10:59.542 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.543+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.qFo5RkaJuTv6ehQKtZCd1VChRNqta1U_0 2024-09-12T01:10:59.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14192727234334558719', time=2024-09-12T02:54:39.794063+0000, chain.objs.size()=1 2024-09-12T01:10:59.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.hJc3dMSxszP8O3HDV4KSbwqdN_duUXS_0 2024-09-12T01:10:59.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.384485236255497529', time=2024-09-12T02:54:40.454909+0000, chain.objs.size()=1 2024-09-12T01:10:59.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.e1GIVdrlGdrBMDrWAMLkwQdwO8CGOme_0 2024-09-12T01:10:59.544 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13933630299634031851', time=2024-09-12T02:54:40.825757+0000, chain.objs.size()=1 2024-09-12T01:10:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.tQFTN50ab8Hy_xANL1JFCJkaj681xFj_0 2024-09-12T01:10:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15354284440100458440', time=2024-09-12T02:54:41.389165+0000, chain.objs.size()=1 2024-09-12T01:10:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.0JpReEqq0x2VURa2RKxqwH6wbPPnXJw_0 2024-09-12T01:10:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10692654701572170845', time=2024-09-12T02:54:41.728678+0000, chain.objs.size()=1 2024-09-12T01:10:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.aLroH081ZOQnXPu0VhNPulsiDhkTF_N_0 2024-09-12T01:10:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14385361351458658228', time=2024-09-12T02:54:42.249479+0000, chain.objs.size()=1 2024-09-12T01:10:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.WPG0VVOW7HcnRoUTcA_G_0G6Vv1quXY_0 2024-09-12T01:10:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14295016683858061749', time=2024-09-12T02:54:42.356229+0000, chain.objs.size()=1 2024-09-12T01:10:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.zovPeVP4pJzuMTQjL1UzW-6pridfwXV_0 2024-09-12T01:10:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8064902732728066365', time=2024-09-12T02:54:42.507003+0000, chain.objs.size()=1 2024-09-12T01:10:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.cUPgKNkjjmHZ_1QMwATvRC4xvOwZENR_0 2024-09-12T01:10:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8839503285702006307', time=2024-09-12T02:54:42.555060+0000, chain.objs.size()=1 2024-09-12T01:10:59.545 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.y6DBe13xT8NOIY58W9NkY7TEC2Ku_Ae_0 2024-09-12T01:10:59.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4316391462486561414', time=2024-09-12T02:54:42.818224+0000, chain.objs.size()=1 2024-09-12T01:10:59.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.545+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.-Q09DgYrQlh3DutVaQuaamrm0K1hFzm_0 2024-09-12T01:10:59.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.547+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12474181149014169574', time=2024-09-12T02:54:42.851606+0000, chain.objs.size()=1 2024-09-12T01:10:59.546 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.547+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Ac6ox-iC29eu92yzIqrMJNNA-K-5g2d_0 2024-09-12T01:10:59.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.548+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7624275334143849181', time=2024-09-12T02:54:43.420100+0000, chain.objs.size()=1 2024-09-12T01:10:59.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.548+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Bi2j84W6Rs-o71D3K-SycdaYIDCriac_0 2024-09-12T01:10:59.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.548+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15351703720085922590', time=2024-09-12T02:54:43.801574+0000, chain.objs.size()=1 2024-09-12T01:10:59.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.548+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.QLjLRCXwwJxTS08a-59DNA1iZyZt0Ks_0 2024-09-12T01:10:59.547 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.548+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1601189020992555234', time=2024-09-12T02:54:44.524148+0000, chain.objs.size()=1 2024-09-12T01:10:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.548+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.wEt7P_yQNdv5BdtbuDqGn32pKrHuR36_0 2024-09-12T01:10:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.548+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11207479464887333859', time=2024-09-12T02:54:44.745093+0000, chain.objs.size()=1 2024-09-12T01:10:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.548+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.H1q6VfC8Ry3ms7NEUpZ25dd3uQ72lpv_0 2024-09-12T01:10:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.549+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8398079529524752715', time=2024-09-12T02:54:45.441637+0000, chain.objs.size()=1 2024-09-12T01:10:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.549+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.BsPDWSUpMFATaNWGo1I28MJd8w_hpuz_0 2024-09-12T01:10:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.549+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9446837431434548303', time=2024-09-12T02:54:45.537011+0000, chain.objs.size()=1 2024-09-12T01:10:59.548 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.549+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Ih3mJFnocfsQeGrztsrbdPfXpLU9ZFp_0 2024-09-12T01:10:59.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.549+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1888636367610148384', time=2024-09-12T02:54:45.578888+0000, chain.objs.size()=1 2024-09-12T01:10:59.549 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.549+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.iKdTfDMqZ4ZRGI0XQTn8X-4IV_2NkR-_0 2024-09-12T01:10:59.552 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.553+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/47978 2024-09-12T01:10:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T01:10:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16332442736328431641', time=2024-09-12T02:54:45.762861+0000, chain.objs.size()=1 2024-09-12T01:10:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dwL4tiGrHMqecb2DxnWZeC5ukg_SmEm_0 2024-09-12T01:10:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3867069455195257161', time=2024-09-12T02:54:45.800124+0000, chain.objs.size()=1 2024-09-12T01:10:59.555 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.8xZlxPC9sOE-vrR-gyQZrAzRTk1bLzh_0 2024-09-12T01:10:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10199259959096329708', time=2024-09-12T02:54:45.934447+0000, chain.objs.size()=1 2024-09-12T01:10:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.vco87qQFn_KUxrWoiXzJsdTxUlZwsZA_0 2024-09-12T01:10:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.427672097438098347', time=2024-09-12T02:54:46.058082+0000, chain.objs.size()=1 2024-09-12T01:10:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ip_fiScAy6cfXMi1t-7e4bqKNOEnL2c_0 2024-09-12T01:10:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15334432930879213237', time=2024-09-12T02:54:46.296340+0000, chain.objs.size()=1 2024-09-12T01:10:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.wwHEaZ7mUOJj2VOdnxdtwNxawLfVKhX_0 2024-09-12T01:10:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14036747874724772518', time=2024-09-12T02:54:46.458206+0000, chain.objs.size()=1 2024-09-12T01:10:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.IHFjaUxFSt9wRzdLnjzAej9hbPmKHEo_0 2024-09-12T01:10:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15775371150089012635', time=2024-09-12T02:54:46.581507+0000, chain.objs.size()=1 2024-09-12T01:10:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.tWFX17d0f_lCoWjo5_ZLFLaSLw2Yeky_0 2024-09-12T01:10:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5500158240346291049', time=2024-09-12T02:54:46.593776+0000, chain.objs.size()=1 2024-09-12T01:10:59.556 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.EMehWVl5jyNJQ-7Eqwile5J9ptT5HCU_0 2024-09-12T01:10:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11712578439170322399', time=2024-09-12T02:54:46.888081+0000, chain.objs.size()=1 2024-09-12T01:10:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9xz7zZyzMR51gaBhkH8l2kRcmU7KFmi_0 2024-09-12T01:10:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1021926996888359351', time=2024-09-12T02:54:47.033755+0000, chain.objs.size()=1 2024-09-12T01:10:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.tBjijQi3recyje2bvzSesoEfmHPwCsY_0 2024-09-12T01:10:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14762171206344601083', time=2024-09-12T02:54:47.068107+0000, chain.objs.size()=1 2024-09-12T01:10:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.pTjsDOZxLRbxTYfKr0xPCG91Y63W4qt_0 2024-09-12T01:10:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15891405431447730823', time=2024-09-12T02:54:52.909563+0000, chain.objs.size()=1 2024-09-12T01:10:59.557 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.555+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.336__shadow_.cih9PSlNg4MJrgee3rbfYywfIjVJdUC_0 2024-09-12T01:10:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10469888649105104478', time=2024-09-12T02:55:45.433365+0000, chain.objs.size()=1 2024-09-12T01:10:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.435__shadow_.qvgKdmlcZz0PJTJ_iD6skvOCe4XdqnN_0 2024-09-12T01:10:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14927786245867570684', time=2024-09-12T02:56:07.210623+0000, chain.objs.size()=1 2024-09-12T01:10:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.467__shadow_.l2kqj_Meoiy8pFD-ZslfDpFjSNHT3iq_0 2024-09-12T01:10:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13336352376680883792', time=2024-09-12T02:56:15.029507+0000, chain.objs.size()=1 2024-09-12T01:10:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.485__shadow_.fTORSMnTmwpjYHS4UPjgCQaDF_xODqd_0 2024-09-12T01:10:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15096142056466337772', time=2024-09-12T02:56:51.983550+0000, chain.objs.size()=1 2024-09-12T01:10:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.518__shadow_.i9CwX-z-VqL0Gj9C9iff2QUKVs-O6ay_0 2024-09-12T01:10:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7639390501050710840', time=2024-09-12T02:57:15.367216+0000, chain.objs.size()=1 2024-09-12T01:10:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.521__shadow:9dH0aHhyP-3AM8wx7ZFNocdp5xPBApW_.2UcLeQUGXm2ckseCNMN7mgTY_LF_KR9_0 2024-09-12T01:10:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~8ZTzDla92SW2fhBfstjk28C2kxRIuyS', time=2024-09-12T02:58:03.567089+0000, chain.objs.size()=1 2024-09-12T01:10:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~8ZTzDla92SW2fhBfstjk28C2kxRIuyS.1 2024-09-12T01:10:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~8ZTzDla92SW2fhBfstjk28C2kxRIuyS', time=2024-09-12T02:58:03.570847+0000, chain.objs.size()=1 2024-09-12T01:10:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~8ZTzDla92SW2fhBfstjk28C2kxRIuyS.2 2024-09-12T01:10:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~8ZTzDla92SW2fhBfstjk28C2kxRIuyS', time=2024-09-12T02:58:03.574419+0000, chain.objs.size()=1 2024-09-12T01:10:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~8ZTzDla92SW2fhBfstjk28C2kxRIuyS.3 2024-09-12T01:10:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~8ZTzDla92SW2fhBfstjk28C2kxRIuyS', time=2024-09-12T02:58:03.578112+0000, chain.objs.size()=1 2024-09-12T01:10:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~8ZTzDla92SW2fhBfstjk28C2kxRIuyS.4 2024-09-12T01:10:59.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~8ZTzDla92SW2fhBfstjk28C2kxRIuyS', time=2024-09-12T02:58:03.581526+0000, chain.objs.size()=1 2024-09-12T01:10:59.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~8ZTzDla92SW2fhBfstjk28C2kxRIuyS.5 2024-09-12T01:10:59.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~8ZTzDla92SW2fhBfstjk28C2kxRIuyS', time=2024-09-12T02:58:03.585150+0000, chain.objs.size()=1 2024-09-12T01:10:59.560 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.559+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~8ZTzDla92SW2fhBfstjk28C2kxRIuyS.6 2024-09-12T01:10:59.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.562+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9151265751297680398', time=2024-09-12T02:58:13.793101+0000, chain.objs.size()=3 2024-09-12T01:10:59.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.562+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.524__multipart_mymultipart.2~99-5HumObxOCM9trgsEP0Glr-GcvtLl.1 2024-09-12T01:10:59.561 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.562+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.524__multipart_mymultipart.2~99-5HumObxOCM9trgsEP0Glr-GcvtLl.2 2024-09-12T01:10:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.562+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.524__multipart_mymultipart.2~99-5HumObxOCM9trgsEP0Glr-GcvtLl.3 2024-09-12T01:10:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.562+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4834846972605356824', time=2024-09-12T02:59:30.610972+0000, chain.objs.size()=1 2024-09-12T01:10:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.562+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.556__shadow_.slJFSl1VIVr6r2X110o0LuKK5m_jII0_0 2024-09-12T01:10:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.563+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11792084650508967914', time=2024-09-12T02:59:52.522798+0000, chain.objs.size()=1 2024-09-12T01:10:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.563+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:0.eMtBikfIAca6-24lSE3Cp2MLRWhFO_.QOrzM2fxrxrDtPXse_i6A9IOBZJPR-d_0 2024-09-12T01:10:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.563+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2453665858231218291', time=2024-09-12T02:59:59.650354+0000, chain.objs.size()=1 2024-09-12T01:10:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.563+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:OQY.PCE1oB.eIiPlLCSvArAId6qnS18_.hqJBy2jW9V6e12SC0YFFOVsSd5eNffF_0 2024-09-12T01:10:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.564+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8344986897296977881', time=2024-09-12T03:00:02.530001+0000, chain.objs.size()=1 2024-09-12T01:10:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:i6WJSgkGMW3Xu2Pb5SCsudON5.bGzS._.G30XiHEvtexPjflmTZELNixM14GFBjX_0 2024-09-12T01:10:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.564+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6578230695976565410', time=2024-09-12T03:00:03.540927+0000, chain.objs.size()=1 2024-09-12T01:10:59.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.571__shadow:9uIdW0e3LrDDE1IvSnxb7zCcApYB94-_._N7NBrc_HKT8MgrV-ADqHujW4s3IkHp_0 2024-09-12T01:10:59.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.564+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17137845049364166830', time=2024-09-12T03:00:28.557645+0000, chain.objs.size()=1 2024-09-12T01:10:59.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:b0Wr5edeZWgBW21wIQw02I3mCA0XLgk_.zi7G29f6TkGVUdtf_ItWzK18HteFWwx_0 2024-09-12T01:10:59.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.564+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7253800431647106171', time=2024-09-12T03:05:12.108826+0000, chain.objs.size()=2 2024-09-12T01:10:59.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.651__shadow_.4_T37heL3x3Xt4FLpJ39fykanCQVzuH_0 2024-09-12T01:10:59.564 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.564+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.651__shadow_.4_T37heL3x3Xt4FLpJ39fykanCQVzuH_1 2024-09-12T01:10:59.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.566+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.204806113184952078', time=2024-09-12T03:05:39.024992+0000, chain.objs.size()=1 2024-09-12T01:10:59.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.566+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.672__shadow_.dPnbBbrCxgvIyIVDAdE8_NrRj9HHTaq_0 2024-09-12T01:10:59.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.566+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1617389863195999626', time=2024-09-12T03:05:49.166911+0000, chain.objs.size()=1 2024-09-12T01:10:59.565 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.566+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.693__shadow:W8jhNlcvcOpJsJOxccDPv8IlEUod550_.bWIOciYTiOsCR8mM29Wo6lxs-_3jApH_0 2024-09-12T01:10:59.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.567+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5999032570748365348', time=2024-09-12T03:05:58.939943+0000, chain.objs.size()=1 2024-09-12T01:10:59.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.567+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.709__shadow:PMl8tpe5YWhNjhUiBlFdNUfvYDKxYGl_.tw6T7r5iWFkB8oXQKMqS9ufgTawvPkr_0 2024-09-12T01:10:59.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.567+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~gQVoQsjnn0MqbqTCsxea7rS_PE7Ecco', time=2024-09-12T03:06:47.642117+0000, chain.objs.size()=1 2024-09-12T01:10:59.566 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.567+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.743__multipart_mymultipart.2~gQVoQsjnn0MqbqTCsxea7rS_PE7Ecco.1 2024-09-12T01:10:59.569 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.570+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.571 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.572+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:10:59.572 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.573+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.574+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54978' 2024-09-12T01:10:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='__teeLwURuEBDT6b6QE_D7YEuUyS75Ej', time=2024-09-12T02:49:25.570077+0000, chain.objs.size()=3 2024-09-12T01:10:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_.CqeLG-15ylIe5GyDESAzcxLpKTp57K8_0 2024-09-12T01:10:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_.CqeLG-15ylIe5GyDESAzcxLpKTp57K8_1 2024-09-12T01:10:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_.CqeLG-15ylIe5GyDESAzcxLpKTp57K8_2 2024-09-12T01:10:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13743824917351785161', time=2024-09-12T02:49:29.792100+0000, chain.objs.size()=1 2024-09-12T01:10:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.163__shadow_.KOFB1DaKVwGIbD-L961LMVaWdnrT_v0_0 2024-09-12T01:10:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12487114101123074040', time=2024-09-12T02:51:28.517958+0000, chain.objs.size()=1 2024-09-12T01:10:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.236__shadow_.Yks7RxC9jlITbAa8etmZKFUGMYSJ8Du_0 2024-09-12T01:10:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15122964292028445247', time=2024-09-12T02:51:37.712824+0000, chain.objs.size()=1 2024-09-12T01:10:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.250__shadow_.c9w1mk_XHAy9vtdz0wRzVaNAeqnqjxm_0 2024-09-12T01:10:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15873933284008529572', time=2024-09-12T02:52:21.429482+0000, chain.objs.size()=1 2024-09-12T01:10:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.XzWV-moUBYXnowYECWIukX9O4tOWJdQ_0 2024-09-12T01:10:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2573578559768297011', time=2024-09-12T02:52:21.607584+0000, chain.objs.size()=1 2024-09-12T01:10:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.X03aGnzA45mlWaqwTvsp_BBrfxttOiy_0 2024-09-12T01:10:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6561913246646023571', time=2024-09-12T02:52:21.608793+0000, chain.objs.size()=1 2024-09-12T01:10:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wo0gg-O1-UG5aNJAaBsa0BdlnJ_7fL0_0 2024-09-12T01:10:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18123341058285432279', time=2024-09-12T02:52:21.666066+0000, chain.objs.size()=1 2024-09-12T01:10:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KhyYOoxK_Q4WLgXJtQGTyHJtsJjn0Iy_0 2024-09-12T01:10:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.921348057245777093', time=2024-09-12T02:52:22.249139+0000, chain.objs.size()=1 2024-09-12T01:10:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.UTHbCQXZ5pCRaKhP831bfdXMGhccmff_0 2024-09-12T01:10:59.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5441099516849658621', time=2024-09-12T02:52:23.009391+0000, chain.objs.size()=1 2024-09-12T01:10:59.576 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.575+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uWavVJknEZ7_AEY0-77qfF-628OpNW6_0 2024-09-12T01:10:59.577 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.578+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15220079268342610514', time=2024-09-12T02:52:23.394487+0000, chain.objs.size()=1 2024-09-12T01:10:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.578+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.qE7RUqrRx9PrRiPpb8kxOMxS7rKO2-m_0 2024-09-12T01:10:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8388199988050128447', time=2024-09-12T02:52:23.446661+0000, chain.objs.size()=1 2024-09-12T01:10:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.H_yOzAjvP8s2qGIQMimOCWnAxkBSBEM_0 2024-09-12T01:10:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4364037050009984654', time=2024-09-12T02:52:24.352625+0000, chain.objs.size()=1 2024-09-12T01:10:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wn37UsmGz5Z7FZQYqlm4i3YzYNarsti_0 2024-09-12T01:10:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12756558075261874170', time=2024-09-12T02:52:25.596686+0000, chain.objs.size()=1 2024-09-12T01:10:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ySkSD590lvPnkqdLfCrkGghrD2CqRDl_0 2024-09-12T01:10:59.578 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9278103815376052219', time=2024-09-12T02:52:25.872144+0000, chain.objs.size()=1 2024-09-12T01:10:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.an4h_gGy4NQnokvXCKF3AfoZu1l89n5_0 2024-09-12T01:10:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.752917077688636840', time=2024-09-12T02:52:26.192619+0000, chain.objs.size()=1 2024-09-12T01:10:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._G-4HpESWGu1XG2kQT-IBvVr4mReOIH_0 2024-09-12T01:10:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12563869780996346377', time=2024-09-12T02:52:26.196241+0000, chain.objs.size()=1 2024-09-12T01:10:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.bGqlKip_esjn2TXYI0-e7rU3Vmy0wsn_0 2024-09-12T01:10:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11843795561617677635', time=2024-09-12T02:52:26.330683+0000, chain.objs.size()=1 2024-09-12T01:10:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ZJ3q_s_3--758WG9UFupes-RKnDv5v8_0 2024-09-12T01:10:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13170742529814009545', time=2024-09-12T02:52:26.545374+0000, chain.objs.size()=1 2024-09-12T01:10:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.WZnfAsuj7nD0m35iMVIbOn4t9zvNHNy_0 2024-09-12T01:10:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6011639734153530190', time=2024-09-12T02:52:27.240218+0000, chain.objs.size()=1 2024-09-12T01:10:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.PZZJljuNP6-iSGj5d0Zsgu1l-OE8Up2_0 2024-09-12T01:10:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8915871472741006165', time=2024-09-12T02:52:27.407962+0000, chain.objs.size()=1 2024-09-12T01:10:59.579 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.579+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.rrbSa6lc5HkD7e-nS1t0J4IEdkkmgu8_0 2024-09-12T01:10:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.582+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6705710564187854875', time=2024-09-12T02:52:27.634209+0000, chain.objs.size()=1 2024-09-12T01:10:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.582+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._gdOb8IF1XV9Z0xRDf_Gq5Dy4yBruCy_0 2024-09-12T01:10:59.581 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.582+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11279093350065661734', time=2024-09-12T02:52:28.014582+0000, chain.objs.size()=1 2024-09-12T01:10:59.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.582+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.BCo6J0P4w96b0tTGaQ_kyRp1OhsGqp2_0 2024-09-12T01:10:59.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.583+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10746397371449600126', time=2024-09-12T02:52:28.863667+0000, chain.objs.size()=1 2024-09-12T01:10:59.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.583+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.7E06KcRCeePQghtZ0Rs7wYCGvJA8dCT_0 2024-09-12T01:10:59.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.583+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13383488744601857154', time=2024-09-12T02:52:28.901954+0000, chain.objs.size()=1 2024-09-12T01:10:59.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.583+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.PNDaHqUFI46ckUbdK88KCHnDFBdl6ZX_0 2024-09-12T01:10:59.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.583+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15176208421823177419', time=2024-09-12T02:52:28.949203+0000, chain.objs.size()=1 2024-09-12T01:10:59.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.583+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ujpszi3jCfBMUEBSmvRH3VIHjdb2VAV_0 2024-09-12T01:10:59.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.583+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16812048161497173725', time=2024-09-12T02:52:29.565791+0000, chain.objs.size()=1 2024-09-12T01:10:59.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.583+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.XrM6tcxDSv0_jJnmJpemlO8ow0izAAd_0 2024-09-12T01:10:59.582 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.583+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8602490094601233111', time=2024-09-12T02:52:29.865237+0000, chain.objs.size()=1 2024-09-12T01:10:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.583+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.8Qkew0bOxe7N8JJAkvU94iVMQ5VJuRD_0 2024-09-12T01:10:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.583+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15860806734733770350', time=2024-09-12T02:52:29.882462+0000, chain.objs.size()=1 2024-09-12T01:10:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.583+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.JXw1gg-5_jVAfAvR9YzZpNCqhM6PdEj_0 2024-09-12T01:10:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.583+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18112227451380406625', time=2024-09-12T02:52:30.043567+0000, chain.objs.size()=1 2024-09-12T01:10:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.583+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0V2BqnZ7pwKNKXnkNIdHdh47-sjj1d0_0 2024-09-12T01:10:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.584+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2430897255261947971', time=2024-09-12T02:52:30.531768+0000, chain.objs.size()=1 2024-09-12T01:10:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.584+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.3ZLbXWvwk7gnn2g056bj10CYOFpcyJD_0 2024-09-12T01:10:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.584+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16936408787447779471', time=2024-09-12T02:52:31.463537+0000, chain.objs.size()=1 2024-09-12T01:10:59.583 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.584+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.AfSD1QNMFRJ4057yyD8z9P_QT7QQTcM_0 2024-09-12T01:10:59.584 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.584+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11550466048048930131', time=2024-09-12T02:52:41.171571+0000, chain.objs.size()=1 2024-09-12T01:10:59.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.584+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.279__shadow_.s2EI1uMi1Yf0_lJ3UMQHmkix4KN7HqZ_0 2024-09-12T01:10:59.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.586+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17581521381044219707', time=2024-09-12T02:52:42.393058+0000, chain.objs.size()=1 2024-09-12T01:10:59.585 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.586+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.281__shadow_.mmRULL4Zztde4QFqdgpBlQ4tblTKxhk_0 2024-09-12T01:10:59.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9859225525480153325', time=2024-09-12T02:52:55.677013+0000, chain.objs.size()=1 2024-09-12T01:10:59.587 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.298__shadow_.SVkgkuLLznbxdrGbtoFqNmDWLEWBOnK_0 2024-09-12T01:10:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12090020028559575588', time=2024-09-12T02:53:10.140516+0000, chain.objs.size()=1 2024-09-12T01:10:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.320__shadow:YNeVWZ1T0fiyxVjS5QGyETNrCEdw9Bp_.8h-HL504nSrjgbaPQFtusq62c_yT3ut_0 2024-09-12T01:10:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11769909964560013792', time=2024-09-12T02:53:49.392087+0000, chain.objs.size()=1 2024-09-12T01:10:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.UJyRn1q-uF7QEJkWMzf3zF_jp96AUjV_0 2024-09-12T01:10:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10038099892083390685', time=2024-09-12T02:53:49.441708+0000, chain.objs.size()=1 2024-09-12T01:10:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.3MCwf_-KCjG41rHUzvlMtSUVMyvbYu4_0 2024-09-12T01:10:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7440542965030548115', time=2024-09-12T02:53:49.755008+0000, chain.objs.size()=1 2024-09-12T01:10:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.4IQkwP5ceGB8FnmrffQQmR8mK8o9nKl_0 2024-09-12T01:10:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3394606356686075220', time=2024-09-12T02:53:50.228257+0000, chain.objs.size()=1 2024-09-12T01:10:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.6QVKH3mL15BNzqTpOeRGgMvWFqiyAtP_0 2024-09-12T01:10:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2475626953785100227', time=2024-09-12T02:53:50.228773+0000, chain.objs.size()=1 2024-09-12T01:10:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.WuMKrW0ajFkZiEEVRUrc8WVeWpE6SHI_0 2024-09-12T01:10:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11509972298464590177', time=2024-09-12T02:53:50.397824+0000, chain.objs.size()=1 2024-09-12T01:10:59.588 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.6D_m7ezP0lK2-0fQk9yU6h4MHdaaD8p_0 2024-09-12T01:10:59.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11715377854188507216', time=2024-09-12T02:53:50.404199+0000, chain.objs.size()=1 2024-09-12T01:10:59.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.588+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ncbb6OPG66EBbWTVNh4qVChJT39TaxN_0 2024-09-12T01:10:59.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.589+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16920269179072251921', time=2024-09-12T02:53:50.899238+0000, chain.objs.size()=1 2024-09-12T01:10:59.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.589+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.jW5TTR0pfuA62p785fbad2iEn8ytE8f_0 2024-09-12T01:10:59.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.589+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5261565605612261383', time=2024-09-12T02:53:51.402680+0000, chain.objs.size()=1 2024-09-12T01:10:59.589 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.589+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.4-mt62a47VCFLK4xAz4MwHT3pSdm0dk_0 2024-09-12T01:10:59.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.591+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12218380243106618291', time=2024-09-12T02:53:51.880420+0000, chain.objs.size()=1 2024-09-12T01:10:59.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.591+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Eccm-LQPedZDE0Ktd9DN5eHaYVQeuaj_0 2024-09-12T01:10:59.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.591+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8414526793110194757', time=2024-09-12T02:53:52.294504+0000, chain.objs.size()=1 2024-09-12T01:10:59.590 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.591+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.pDW1hYyEZVMbhT80t7VP4NGwwWWt8SL_0 2024-09-12T01:10:59.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.591+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3646883250857542726', time=2024-09-12T02:53:52.839442+0000, chain.objs.size()=1 2024-09-12T01:10:59.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.591+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.I-DATe5reE3RZED1VyeaZUvdueP5dp2_0 2024-09-12T01:10:59.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.591+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11842290685642650684', time=2024-09-12T02:53:52.852062+0000, chain.objs.size()=1 2024-09-12T01:10:59.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.591+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.n4cH5C-gAhdER1HU3ut9grSPzgKv6bt_0 2024-09-12T01:10:59.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.592+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11705446553657964742', time=2024-09-12T02:53:52.960568+0000, chain.objs.size()=1 2024-09-12T01:10:59.591 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.592+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.CIljezJ8h6YEyP3qO29kkXrmr3oM8XZ_0 2024-09-12T01:10:59.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.592+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11137892072806614788', time=2024-09-12T02:53:53.033016+0000, chain.objs.size()=1 2024-09-12T01:10:59.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.592+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.9ktnMc_b5lPc3iOxXAz7qd6VDLlHxdE_0 2024-09-12T01:10:59.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.592+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17699893712718784292', time=2024-09-12T02:53:53.149520+0000, chain.objs.size()=1 2024-09-12T01:10:59.592 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.592+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.drPI7Yim2xx7Sv-qb11MVAwkKePBREu_0 2024-09-12T01:10:59.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.594+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.577821759975298343', time=2024-09-12T02:53:54.488138+0000, chain.objs.size()=1 2024-09-12T01:10:59.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.594+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.eE5VfUkLwYUJVpdbgAq2E1Q7_gUXlNA_0 2024-09-12T01:10:59.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.594+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5323665297125549327', time=2024-09-12T02:53:55.070113+0000, chain.objs.size()=1 2024-09-12T01:10:59.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.594+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.c3UxggG2fYqRiS5kL5VXzVq7qamlocA_0 2024-09-12T01:10:59.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.594+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12764620917253160916', time=2024-09-12T02:53:55.158069+0000, chain.objs.size()=1 2024-09-12T01:10:59.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.594+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.f8TH-M8I4cYg4h9smJ2bpyGpCGS3Esn_0 2024-09-12T01:10:59.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.594+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11605106411770788790', time=2024-09-12T02:53:55.664209+0000, chain.objs.size()=1 2024-09-12T01:10:59.593 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.594+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.1pKE6kjcPNitnBts25jEw1kzN-5vKoK_0 2024-09-12T01:10:59.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.595+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5965978269543761258', time=2024-09-12T02:53:55.731030+0000, chain.objs.size()=1 2024-09-12T01:10:59.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.595+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.AwlMh0OfaP5wakmjxP5aLYIj4V-L9_9_0 2024-09-12T01:10:59.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.596+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3401196638289151759', time=2024-09-12T02:53:55.812557+0000, chain.objs.size()=1 2024-09-12T01:10:59.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.596+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.PZC04gqXQJW5QJpbZgcB8PWDZdb-XHk_0 2024-09-12T01:10:59.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.596+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7604292732904934240', time=2024-09-12T02:53:56.665069+0000, chain.objs.size()=1 2024-09-12T01:10:59.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.596+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.-iY9xMhcU3FW3X8APXnHe3szcK0Tw2u_0 2024-09-12T01:10:59.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.596+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12811832557212512381', time=2024-09-12T02:53:56.965990+0000, chain.objs.size()=1 2024-09-12T01:10:59.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.596+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.aDOOzldVIgXZD18ksiTkXsCnrPnGKYJ_0 2024-09-12T01:10:59.595 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.596+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13989492857403754100', time=2024-09-12T02:53:57.386476+0000, chain.objs.size()=1 2024-09-12T01:10:59.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.596+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_._-9TkmDQr8hg33f4_W4lrfZWUhHau-I_0 2024-09-12T01:10:59.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.596+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3691753591332879211', time=2024-09-12T02:53:58.171735+0000, chain.objs.size()=1 2024-09-12T01:10:59.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.596+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.gFUasvWAFsbSx6pQcOIgGCNdMiAN8dZ_0 2024-09-12T01:10:59.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.596+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3830165085113273045', time=2024-09-12T02:53:59.237992+0000, chain.objs.size()=1 2024-09-12T01:10:59.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.596+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.10EpmE_6vyu-JL2NsvwoI3jR6b3P1Ys_0 2024-09-12T01:10:59.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.596+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16327881896341069069', time=2024-09-12T02:53:59.248069+0000, chain.objs.size()=1 2024-09-12T01:10:59.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.596+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0nnaKkbST4K74w7GBhCKzGq6pn5uO_A_0 2024-09-12T01:10:59.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.597+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14155286994169519801', time=2024-09-12T02:53:59.341039+0000, chain.objs.size()=1 2024-09-12T01:10:59.596 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.597+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.KaARn9S7TRaAcPbWvqyomHqNcuQOe3h_0 2024-09-12T01:10:59.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.598+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1539739592616469302', time=2024-09-12T02:54:37.324564+0000, chain.objs.size()=1 2024-09-12T01:10:59.597 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.598+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9sMdhLSFkAVRFVl6Y72XDItcKY7PmhP_0 2024-09-12T01:10:59.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.600+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17624860317471416526', time=2024-09-12T02:54:37.507620+0000, chain.objs.size()=1 2024-09-12T01:10:59.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.600+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Bm8y-9MfhkucwOHtxuMJ8QBMzoOhfpX_0 2024-09-12T01:10:59.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.600+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2092720074527646756', time=2024-09-12T02:54:38.077627+0000, chain.objs.size()=1 2024-09-12T01:10:59.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.600+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.1xN1boDvK2LfqzhLsnGPAK5OyRk25E2_0 2024-09-12T01:10:59.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.600+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16493636562048508630', time=2024-09-12T02:54:38.115805+0000, chain.objs.size()=1 2024-09-12T01:10:59.599 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.600+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.-rTGYMnAGwGGNOLpcj4OnToDOLgjx0x_0 2024-09-12T01:10:59.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.600+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8320633421813305907', time=2024-09-12T02:54:38.142108+0000, chain.objs.size()=1 2024-09-12T01:10:59.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.600+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.4AC2QQE-YfrULLjnKv-BnqSORYxgLpU_0 2024-09-12T01:10:59.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.600+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.660652338522897231', time=2024-09-12T02:54:38.865754+0000, chain.objs.size()=1 2024-09-12T01:10:59.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.600+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.PbY6EyFOuQt0eJVj9oc9l27ImomuA9K_0 2024-09-12T01:10:59.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.600+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8220956958498645052', time=2024-09-12T02:54:39.044404+0000, chain.objs.size()=1 2024-09-12T01:10:59.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.600+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.XFYf2d0o79VA-Cb5CsKOFZqtLqJJqrR_0 2024-09-12T01:10:59.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.600+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12024210321705950919', time=2024-09-12T02:54:39.093826+0000, chain.objs.size()=1 2024-09-12T01:10:59.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.600+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Wduko5GZ54DROBWsc8ebeswXcNP92Kq_0 2024-09-12T01:10:59.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.601+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3376966472281491045', time=2024-09-12T02:54:39.498543+0000, chain.objs.size()=1 2024-09-12T01:10:59.600 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.601+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.aYv3iFbLUmoov3BqHnCzv9rwEHE1Tpm_0 2024-09-12T01:10:59.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.601+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10399044393729174973', time=2024-09-12T02:54:39.665661+0000, chain.objs.size()=1 2024-09-12T01:10:59.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.601+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ymFbG4918Oz0x0u4jOqsWDw_0fhQbkl_0 2024-09-12T01:10:59.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.601+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9614722750454051721', time=2024-09-12T02:54:39.666656+0000, chain.objs.size()=1 2024-09-12T01:10:59.601 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.601+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.BAZ5B42La1HE-ZxfuZXJhFgm_vmKJz5_0 2024-09-12T01:10:59.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.603+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4365553339949919300', time=2024-09-12T02:54:40.199384+0000, chain.objs.size()=1 2024-09-12T01:10:59.602 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.603+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.WCjq6AwcOL28ZOf_Ff1OlRBiE9W4YbP_0 2024-09-12T01:10:59.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.604+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1232812342403535328', time=2024-09-12T02:54:40.261527+0000, chain.objs.size()=1 2024-09-12T01:10:59.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.604+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9M9LchYABLRtZOz95WBUOq2Ol5RUo8L_0 2024-09-12T01:10:59.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.604+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3972843670884048587', time=2024-09-12T02:54:40.278727+0000, chain.objs.size()=1 2024-09-12T01:10:59.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.604+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ghAuXlNaQX4TjYeT7-O97LkzWPEi-0F_0 2024-09-12T01:10:59.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.604+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12704312211052786272', time=2024-09-12T02:54:40.349731+0000, chain.objs.size()=1 2024-09-12T01:10:59.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.604+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.2zUMGPgpAtLTAcVuikI3MPz3Dw_Oc3Y_0 2024-09-12T01:10:59.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.604+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5797093162360809195', time=2024-09-12T02:54:41.067899+0000, chain.objs.size()=1 2024-09-12T01:10:59.603 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.604+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.pFsgTHTLIcF7MRgTSwjRFr45KMKb7MZ_0 2024-09-12T01:10:59.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.604+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.304584696588654442', time=2024-09-12T02:54:41.269008+0000, chain.objs.size()=1 2024-09-12T01:10:59.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.604+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.YC5l6THnNCrsfOYwaMEq7125SSnUFOj_0 2024-09-12T01:10:59.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.605+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2623506326088264141', time=2024-09-12T02:54:41.579926+0000, chain.objs.size()=1 2024-09-12T01:10:59.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.605+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.QR73Vbb4lgzyGFgVFcTB8pqaQTnUu3W_0 2024-09-12T01:10:59.604 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.605+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2146203873962952346', time=2024-09-12T02:54:42.365733+0000, chain.objs.size()=1 2024-09-12T01:10:59.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.605+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.BmgpwzPaxWToA22jTHaRLiUq7OCV3On_0 2024-09-12T01:10:59.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.605+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18161352499210995561', time=2024-09-12T02:54:42.851616+0000, chain.objs.size()=1 2024-09-12T01:10:59.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.605+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.7tz2Sc3XZgcKLAmjpVhgtDWi6Q7Z0hO_0 2024-09-12T01:10:59.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.605+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4248560989919052898', time=2024-09-12T02:54:42.958697+0000, chain.objs.size()=1 2024-09-12T01:10:59.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.605+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ziPNzt0NmkDYBT740jObYRQAhdzTayb_0 2024-09-12T01:10:59.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.605+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16780590904839555699', time=2024-09-12T02:54:42.989501+0000, chain.objs.size()=1 2024-09-12T01:10:59.605 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.605+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.bXe2c5XAVEwbKFm_mQjCGJgGJBizzhb_0 2024-09-12T01:10:59.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.607+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9892005822806924627', time=2024-09-12T02:54:43.398309+0000, chain.objs.size()=1 2024-09-12T01:10:59.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.607+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.sim5ABsVgxb1tFhbAvZRw0SewLh5BXN_0 2024-09-12T01:10:59.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.607+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13775180223572880659', time=2024-09-12T02:54:43.413350+0000, chain.objs.size()=1 2024-09-12T01:10:59.606 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.607+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.RMvVbOlPtQSa7x4E5uAC67_IA0IjFuV_0 2024-09-12T01:10:59.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.609+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3380072494529369290', time=2024-09-12T02:54:44.090563+0000, chain.objs.size()=1 2024-09-12T01:10:59.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.609+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ipPU1JU2wZajAI_L4G-NzHUNUuaemZq_0 2024-09-12T01:10:59.608 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.609+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13060169498875139546', time=2024-09-12T02:54:45.081597+0000, chain.objs.size()=1 2024-09-12T01:10:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.609+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.2yTwpYNIu9wmdlDMez7wX_Mf5k5iw4F_0 2024-09-12T01:10:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.609+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13716704222176702940', time=2024-09-12T02:54:45.279321+0000, chain.objs.size()=1 2024-09-12T01:10:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.609+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.CMXG5Piixvsu_0d-FUoI7z98fH9FMCw_0 2024-09-12T01:10:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.609+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.297305200485142571', time=2024-09-12T02:54:45.855517+0000, chain.objs.size()=1 2024-09-12T01:10:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.609+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dAB18PBemB0htoN7FmSsDihuRlavK8U_0 2024-09-12T01:10:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.609+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7619267225647104875', time=2024-09-12T02:54:46.908894+0000, chain.objs.size()=1 2024-09-12T01:10:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.609+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.-FMWYlV6YVvBSHuwELCIXaX86PCybvJ_0 2024-09-12T01:10:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.609+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14840195038922965275', time=2024-09-12T02:54:47.091779+0000, chain.objs.size()=1 2024-09-12T01:10:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.609+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.UfVkxKPmkcNE8QyISTM0nMQth0WneC3_0 2024-09-12T01:10:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.609+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5369368899989207025', time=2024-09-12T02:55:44.993535+0000, chain.objs.size()=1 2024-09-12T01:10:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.609+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.434__shadow_.criiRoM66Jg0KZDiGaZmgpD1BQlxqN3_0 2024-09-12T01:10:59.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.610+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16483493094915694309', time=2024-09-12T02:56:02.989889+0000, chain.objs.size()=1 2024-09-12T01:10:59.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.610+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.462__shadow_.lbgbSTIQfi5inBYsH0HGc3Zjm0mSPvl_0 2024-09-12T01:10:59.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.610+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4446175714649078789', time=2024-09-12T02:56:22.608657+0000, chain.objs.size()=1 2024-09-12T01:10:59.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.610+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.492__shadow_.pPx5vox7aTyYSBIcISquH_YZZsmvWbG_0 2024-09-12T01:10:59.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.610+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12702132358505327379', time=2024-09-12T02:56:27.160258+0000, chain.objs.size()=1 2024-09-12T01:10:59.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.610+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.501__shadow_.RCqGTrvQ-VeD5NjASoASa7-v4eTzo0O_0 2024-09-12T01:10:59.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.610+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10112714511857387121', time=2024-09-12T02:56:44.264979+0000, chain.objs.size()=1 2024-09-12T01:10:59.610 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.610+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.514__multipart_mymultipart.2~SIAAi75hKocDEZxF52PGpEkJ2WR5rt-.1 2024-09-12T01:10:59.614 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.615+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/54978 2024-09-12T01:10:59.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T01:10:59.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10033556818367275782', time=2024-09-12T02:56:51.594146+0000, chain.objs.size()=1 2024-09-12T01:10:59.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.519__multipart_mymultipart.2~huIHeQNnv4eLXag2WetYaib1tEMbp2t.1 2024-09-12T01:10:59.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18114667278185222051', time=2024-09-12T02:57:51.562003+0000, chain.objs.size()=6 2024-09-12T01:10:59.616 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~ajQLRbV1uAG1gctGBazQtjdYp7WHBxt.1 2024-09-12T01:10:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~ajQLRbV1uAG1gctGBazQtjdYp7WHBxt.2 2024-09-12T01:10:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.X5Ua1B0zZTcGK12SlwRSccolywinodDz.3 2024-09-12T01:10:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~ajQLRbV1uAG1gctGBazQtjdYp7WHBxt.4 2024-09-12T01:10:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~ajQLRbV1uAG1gctGBazQtjdYp7WHBxt.5 2024-09-12T01:10:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~ajQLRbV1uAG1gctGBazQtjdYp7WHBxt.6 2024-09-12T01:10:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~cuo6upwDl4wGhiS7zzwgigAkVrdFU-F', time=2024-09-12T02:58:39.272375+0000, chain.objs.size()=1 2024-09-12T01:10:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.532__multipart_mymultipart.2~cuo6upwDl4wGhiS7zzwgigAkVrdFU-F.1 2024-09-12T01:10:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~J1gigiRWwKw8I4rYMMscEUy4LbgnUIz', time=2024-09-12T02:58:41.429932+0000, chain.objs.size()=1 2024-09-12T01:10:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.535__multipart_mymultipart.2~J1gigiRWwKw8I4rYMMscEUy4LbgnUIz.1 2024-09-12T01:10:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10100894963570914524', time=2024-09-12T02:59:25.689365+0000, chain.objs.size()=1 2024-09-12T01:10:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.554__shadow_.Wco-aAr_5D6mSsnHbtjlSQVLyIFa41H_0 2024-09-12T01:10:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6191894915630607885', time=2024-09-12T02:59:31.762907+0000, chain.objs.size()=1 2024-09-12T01:10:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.557__shadow_.FU0prjxsimsteXyAfDqWH8lYrFgNDXy_0 2024-09-12T01:10:59.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6730233400147269047', time=2024-09-12T02:59:54.738880+0000, chain.objs.size()=1 2024-09-12T01:10:59.618 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.617+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:j9eDHUgzd7gY-b5O2SWEtSXBwWIOxVy_.FZc62PYIU0CU_LebhAcH-kIJAPHvSf__0 2024-09-12T01:10:59.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.620+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11535009639025069060', time=2024-09-12T03:00:03.785377+0000, chain.objs.size()=1 2024-09-12T01:10:59.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.620+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.571__shadow:KpWz4SnZotcRwD6KrIyEkVx0oIF5OUg_.9iLE1Yh5_HAhp9T50cCcUha5JYu4Y4r_0 2024-09-12T01:10:59.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.620+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13213303824114634657', time=2024-09-12T03:00:11.917408+0000, chain.objs.size()=1 2024-09-12T01:10:59.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.620+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.576__shadow_.9JnixzWSfcwU7SLaKvLCQxwB1Mjh3B8_0 2024-09-12T01:10:59.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.620+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1067940125434826104', time=2024-09-12T03:00:21.995785+0000, chain.objs.size()=1 2024-09-12T01:10:59.619 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.620+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:z7ARXovb0OXF606nFgkmkNiVvL44ukX_.9D_jYo9c7woUfULVgEpLLkbZd02TBx__0 2024-09-12T01:10:59.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.620+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15374767958705071961', time=2024-09-12T03:00:27.441847+0000, chain.objs.size()=1 2024-09-12T01:10:59.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.620+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:bZDE9FvdjsSpGftSkmFlkO8lHNMzV2x_.Q0N31kMMJ4NaxT_hKYus86-bjy0vRQk_0 2024-09-12T01:10:59.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.620+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10015627450901610401', time=2024-09-12T03:00:52.423781+0000, chain.objs.size()=1 2024-09-12T01:10:59.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.620+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.580__shadow:a9KIVHBmLjV1uP-m6HgHcif6zJSI54T_.9NizzuhYK7979LRAt4ceGLYSYyeX3W4_0 2024-09-12T01:10:59.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.620+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7936953584127751916', time=2024-09-12T03:03:14.540208+0000, chain.objs.size()=1 2024-09-12T01:10:59.620 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.620+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.618__shadow_.63OBBmiylq7sgVLp2LLX3hBMwkxSv9Q_0 2024-09-12T01:10:59.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.622+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~lUAutgXDmfU9NdZw0zGXbq2-BmmKvJv', time=2024-09-12T03:04:43.086159+0000, chain.objs.size()=12 2024-09-12T01:10:59.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.622+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.625__multipart_multipart_enc.2~lUAutgXDmfU9NdZw0zGXbq2-BmmKvJv.1 2024-09-12T01:10:59.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.622+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.625__shadow_multipart_enc.2~lUAutgXDmfU9NdZw0zGXbq2-BmmKvJv.1_1 2024-09-12T01:10:59.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.622+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.625__multipart_multipart_enc.2~lUAutgXDmfU9NdZw0zGXbq2-BmmKvJv.2 2024-09-12T01:10:59.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.622+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.625__shadow_multipart_enc.2~lUAutgXDmfU9NdZw0zGXbq2-BmmKvJv.2_1 2024-09-12T01:10:59.621 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.622+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.625__multipart_multipart_enc.2~lUAutgXDmfU9NdZw0zGXbq2-BmmKvJv.3 2024-09-12T01:10:59.622 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.623+0000 7ff8edb6a640 0 -- 172.21.15.133:0/840329185 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff8e0069020 msgr2=0x7ff8e00a3b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:59.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.624+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.625__shadow_multipart_enc.2~lUAutgXDmfU9NdZw0zGXbq2-BmmKvJv.3_1 2024-09-12T01:10:59.623 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.624+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.625__multipart_multipart_enc.2~lUAutgXDmfU9NdZw0zGXbq2-BmmKvJv.4 2024-09-12T01:10:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.624+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.625__shadow_multipart_enc.2~lUAutgXDmfU9NdZw0zGXbq2-BmmKvJv.4_1 2024-09-12T01:10:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.624+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.625__multipart_multipart_enc.2~lUAutgXDmfU9NdZw0zGXbq2-BmmKvJv.5 2024-09-12T01:10:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.624+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.625__shadow_multipart_enc.2~lUAutgXDmfU9NdZw0zGXbq2-BmmKvJv.5_1 2024-09-12T01:10:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.625+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.625__multipart_multipart_enc.2~lUAutgXDmfU9NdZw0zGXbq2-BmmKvJv.6 2024-09-12T01:10:59.624 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.625+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.625__shadow_multipart_enc.2~lUAutgXDmfU9NdZw0zGXbq2-BmmKvJv.6_1 2024-09-12T01:10:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.627+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14010491572104578198', time=2024-09-12T03:05:39.202717+0000, chain.objs.size()=1 2024-09-12T01:10:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.627+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.673__shadow_.SCNxqQAvt-kI87G9CN408eLP40x_fgv_0 2024-09-12T01:10:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.627+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2837864074608637399', time=2024-09-12T03:05:51.343477+0000, chain.objs.size()=1 2024-09-12T01:10:59.627 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.627+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.697__shadow:LsPUyVrjVsrFoZOOg6W6WrEFFK8PcMe_.KnIkgKims1J1RPXDxzmPbDbNJU7X8oj_0 2024-09-12T01:10:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.631+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.632 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.633+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:10:59.633 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.634+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.634 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.635+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.635+0000 7ff8edb6a640 0 -- 172.21.15.133:0/840329185 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff8f006f040 msgr2=0x7ff7c00912a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:59.635 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51998' 2024-09-12T01:10:59.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5733116269833904554', time=2024-09-12T02:49:04.793830+0000, chain.objs.size()=1 2024-09-12T01:10:59.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.152__shadow_.6i00v_AlKTqkk3oxGuxVUd0-89pckxC_0 2024-09-12T01:10:59.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='_QH6ofeDkgCkqYtf7GgswwVyfLnfwJ0f', time=2024-09-12T02:49:18.320439+0000, chain.objs.size()=1 2024-09-12T01:10:59.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.IV_pbpQAyXCsi3BU4EVqEsVdcxBKlO3_0 2024-09-12T01:10:59.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='_o7k-qQGN6hx9M5nGKmuHAjCEiQLHZkJ', time=2024-09-12T02:49:27.831533+0000, chain.objs.size()=3 2024-09-12T01:10:59.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_.WVpcIwuC8B1j4VVEsaDlnmk_s3p9aGO_0 2024-09-12T01:10:59.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_.WVpcIwuC8B1j4VVEsaDlnmk_s3p9aGO_1 2024-09-12T01:10:59.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_.WVpcIwuC8B1j4VVEsaDlnmk_s3p9aGO_2 2024-09-12T01:10:59.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='_cgzkgwYvLK9dt6Y2NCnoqUthDsTGGds', time=2024-09-12T02:49:29.923278+0000, chain.objs.size()=1 2024-09-12T01:10:59.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.164__shadow_.VpiJ0OuxeYcrbtOMDoXJSjrFwsiS4Yy_0 2024-09-12T01:10:59.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14425060641840379032', time=2024-09-12T02:51:25.374061+0000, chain.objs.size()=1 2024-09-12T01:10:59.636 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.231__shadow_.AAnGkdC09yIk5osrR_HKlyjJrupEljg_0 2024-09-12T01:10:59.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4730697474154372014', time=2024-09-12T02:51:27.883687+0000, chain.objs.size()=1 2024-09-12T01:10:59.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.235__shadow_.fm4IeEWnxq8fkM1H_Y2PUZTgV81jloT_0 2024-09-12T01:10:59.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5539215015772444265', time=2024-09-12T02:51:29.112550+0000, chain.objs.size()=1 2024-09-12T01:10:59.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.237__shadow_.7PCI90H6-CwXmodCm59f8R3hX2CEti__0 2024-09-12T01:10:59.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2880962162417512103', time=2024-09-12T02:51:35.873936+0000, chain.objs.size()=1 2024-09-12T01:10:59.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.247__shadow_.MJGW6W3cmM5F04hlSOWHCkFfYM_RSDM_0 2024-09-12T01:10:59.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16243053736494476922', time=2024-09-12T02:52:21.127080+0000, chain.objs.size()=1 2024-09-12T01:10:59.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._d2g73p-7qbkeMjve69hcWI8ox5-OZE_0 2024-09-12T01:10:59.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1771195963084734450', time=2024-09-12T02:52:21.439250+0000, chain.objs.size()=1 2024-09-12T01:10:59.637 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.636+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.A0OrJbonHQyA4EdK4OGOGSRr4pJ8prS_0 2024-09-12T01:10:59.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.638+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11169256286859589330', time=2024-09-12T02:52:21.734695+0000, chain.objs.size()=1 2024-09-12T01:10:59.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.638+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.nlvLHA6ggLOF-W3c_Oyo6TsPrFQhWR-_0 2024-09-12T01:10:59.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.638+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11434469390898165309', time=2024-09-12T02:52:21.858209+0000, chain.objs.size()=1 2024-09-12T01:10:59.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.638+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Dckca73ZPu0c2vxoQJqtlEPn4sswuNx_0 2024-09-12T01:10:59.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.638+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7378629661524077400', time=2024-09-12T02:52:21.883637+0000, chain.objs.size()=1 2024-09-12T01:10:59.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.638+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.fVpgZR6bXbcetVG4qBdyd-SRlJYXtgg_0 2024-09-12T01:10:59.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.638+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1596239500603186480', time=2024-09-12T02:52:22.170877+0000, chain.objs.size()=1 2024-09-12T01:10:59.638 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.638+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.qtIzPFTqwYUG5V2Drl0puAQkvzNjCMY_0 2024-09-12T01:10:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.639+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4366923112376447115', time=2024-09-12T02:52:22.888604+0000, chain.objs.size()=1 2024-09-12T01:10:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.639+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.7mtB57WSjfykN_gfSEKjSOwwu_bGj40_0 2024-09-12T01:10:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.639+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11831643447116035746', time=2024-09-12T02:52:24.185760+0000, chain.objs.size()=1 2024-09-12T01:10:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.639+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._Lx2qWAWOXVmGf7S7QOCkddDplVINJp_0 2024-09-12T01:10:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.639+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16555251444596995947', time=2024-09-12T02:52:24.341058+0000, chain.objs.size()=1 2024-09-12T01:10:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.639+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.704lvc3zQY0YNvmTSx5syO2US2kzAJf_0 2024-09-12T01:10:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.639+0000 7ff8edb6a640 0 -- 172.21.15.133:0/840329185 >> [v2:172.21.15.133:6808/2746645038,v1:172.21.15.133:6809/2746645038] conn(0x7ff7c0091fa0 msgr2=0x7ff7c00990f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:10:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.640+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11582678683695940419', time=2024-09-12T02:52:24.432039+0000, chain.objs.size()=1 2024-09-12T01:10:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.640+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.quh_wY4qKvf2wqDpskcsS2QVds2NLTm_0 2024-09-12T01:10:59.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.640+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17513436433968014791', time=2024-09-12T02:52:25.034533+0000, chain.objs.size()=1 2024-09-12T01:10:59.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.640+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wSgMICHKEmqM_10cpMUWPHg13AbDxZr_0 2024-09-12T01:10:59.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.641+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11600971178455738541', time=2024-09-12T02:52:25.147462+0000, chain.objs.size()=1 2024-09-12T01:10:59.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.641+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.comDd-Wyc9ue72xcQvj19IVMdh1cYOe_0 2024-09-12T01:10:59.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.641+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16786762529081802629', time=2024-09-12T02:52:25.745011+0000, chain.objs.size()=1 2024-09-12T01:10:59.640 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.641+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1tKrpeppZhsEp0Mogr5IMa_m5AsibNZ_0 2024-09-12T01:10:59.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.643+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15119734215121881745', time=2024-09-12T02:52:25.877583+0000, chain.objs.size()=1 2024-09-12T01:10:59.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.643+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.s8dj1lgrphuZor19ub2ssHXLqR63KeA_0 2024-09-12T01:10:59.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.643+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16073876844129958037', time=2024-09-12T02:52:26.052948+0000, chain.objs.size()=1 2024-09-12T01:10:59.642 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.643+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.EwurZQow1WaD59aIxG0iyeZJjLAwIAv_0 2024-09-12T01:10:59.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.644+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12322049266248699822', time=2024-09-12T02:52:26.066093+0000, chain.objs.size()=1 2024-09-12T01:10:59.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.644+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wSvlZMbnV5yRU199UaQvA0tkB2W0KUW_0 2024-09-12T01:10:59.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.644+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12372451872836364753', time=2024-09-12T02:52:26.091689+0000, chain.objs.size()=1 2024-09-12T01:10:59.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.644+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.buZCb3U_he9wvMOgjTc2pV7W22v2uWF_0 2024-09-12T01:10:59.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.644+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5474637237586253441', time=2024-09-12T02:52:26.158028+0000, chain.objs.size()=1 2024-09-12T01:10:59.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.644+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vE_GozbSuQxpfm09Su4BdyNQVvbBbWu_0 2024-09-12T01:10:59.643 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.644+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13548420423710626301', time=2024-09-12T02:52:26.484365+0000, chain.objs.size()=1 2024-09-12T01:10:59.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.644+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.9QNV7xW6EKcYQe5HZKiC6gh2UFfrKL4_0 2024-09-12T01:10:59.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.645+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10472722084825482527', time=2024-09-12T02:52:26.491486+0000, chain.objs.size()=1 2024-09-12T01:10:59.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.645+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4852IsOayPTkkmc2JLBzlKyxzNd1eYy_0 2024-09-12T01:10:59.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.645+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9885460604353353840', time=2024-09-12T02:52:26.510789+0000, chain.objs.size()=1 2024-09-12T01:10:59.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.645+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.u81Yl9GoCeFM_h2PEg57YuB90ElhmLY_0 2024-09-12T01:10:59.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.645+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2958903095035872330', time=2024-09-12T02:52:27.227573+0000, chain.objs.size()=1 2024-09-12T01:10:59.644 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.645+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.efe9u-9JbrdF0gnO1KoXU_dQFtVwPJU_0 2024-09-12T01:10:59.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.646+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12793137255792728243', time=2024-09-12T02:52:27.236398+0000, chain.objs.size()=1 2024-09-12T01:10:59.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.646+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pxqgLA4ju2UBOoalYbpvqvTMR2RTAxY_0 2024-09-12T01:10:59.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.646+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8397195150183148743', time=2024-09-12T02:52:27.334878+0000, chain.objs.size()=1 2024-09-12T01:10:59.645 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.646+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.DzotRvBpDy2doxDGIevubwGrPJU3NH-_0 2024-09-12T01:10:59.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5132885705557766482', time=2024-09-12T02:52:27.583094+0000, chain.objs.size()=1 2024-09-12T01:10:59.647 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.hkhlLt2Ab8U0XWUGqIL1bpxgD51zB0__0 2024-09-12T01:10:59.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11528588144515113768', time=2024-09-12T02:52:27.603901+0000, chain.objs.size()=1 2024-09-12T01:10:59.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xTnC4FiexwS2SWk4_w4JPw7k5Dui6Cu_0 2024-09-12T01:10:59.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15642712700500018818', time=2024-09-12T02:52:27.803105+0000, chain.objs.size()=1 2024-09-12T01:10:59.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.96w5jATHpN5ITk_p2oLaSKDtPgHLnDq_0 2024-09-12T01:10:59.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15197184970024325651', time=2024-09-12T02:52:27.827955+0000, chain.objs.size()=1 2024-09-12T01:10:59.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uHOkNf7ODvpJ6cQESwAehkGK2xv8-Sh_0 2024-09-12T01:10:59.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8248019370511432853', time=2024-09-12T02:52:27.938133+0000, chain.objs.size()=1 2024-09-12T01:10:59.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.iP2JZEb-PHEeIJZtQFLZXgVX6vY2-X7_0 2024-09-12T01:10:59.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6344944159049638783', time=2024-09-12T02:52:27.939506+0000, chain.objs.size()=1 2024-09-12T01:10:59.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Rw7DL5wSHpVAlpqP8xdx7eDTXNq7nx8_0 2024-09-12T01:10:59.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8116205339575630390', time=2024-09-12T02:52:28.011104+0000, chain.objs.size()=1 2024-09-12T01:10:59.648 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.9TJaaw0gFAvmNoas8_SVTfo63p1T9Lp_0 2024-09-12T01:10:59.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2634302399281274697', time=2024-09-12T02:52:28.611367+0000, chain.objs.size()=1 2024-09-12T01:10:59.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._r9Vt2wLwjPsyQ2X6ZAHi1Vhv8JuptJ_0 2024-09-12T01:10:59.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4908924184685957304', time=2024-09-12T02:52:28.720782+0000, chain.objs.size()=1 2024-09-12T01:10:59.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.648+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.2ttjpJWp_vimAUjVJQlPcBbWBpDWhdo_0 2024-09-12T01:10:59.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.649+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11122349871139639561', time=2024-09-12T02:52:28.951007+0000, chain.objs.size()=1 2024-09-12T01:10:59.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.649+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KRT-pRzfVm82q2g0NPqkqdbJM2uQv72_0 2024-09-12T01:10:59.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.649+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3780422040339788422', time=2024-09-12T02:52:29.308929+0000, chain.objs.size()=1 2024-09-12T01:10:59.649 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.649+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5yDLQ_YSp3CrZhZTsQLR4oWJpbH9A2X_0 2024-09-12T01:10:59.650 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.651+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4706530530560047620', time=2024-09-12T02:52:29.388742+0000, chain.objs.size()=1 2024-09-12T01:10:59.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.651+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4yKDCy0KuyTcu_284xJkXH-sX6oISYZ_0 2024-09-12T01:10:59.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.651+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7846321769946567095', time=2024-09-12T02:52:29.886036+0000, chain.objs.size()=1 2024-09-12T01:10:59.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.651+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.a4zNqBwR_s11gGgexBbyXYs3GSUd5BJ_0 2024-09-12T01:10:59.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.651+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16821213691283631870', time=2024-09-12T02:52:30.113320+0000, chain.objs.size()=1 2024-09-12T01:10:59.651 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.651+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.kq98LtSFObMJWnOf4rMx08OIbM0OW_I_0 2024-09-12T01:10:59.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.652+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17545096176295862540', time=2024-09-12T02:52:30.657678+0000, chain.objs.size()=1 2024-09-12T01:10:59.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.PRaY5P1JjpDH0e9SDn6yTS097LwYKcW_0 2024-09-12T01:10:59.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.653+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1170949754267779467', time=2024-09-12T02:52:31.314094+0000, chain.objs.size()=1 2024-09-12T01:10:59.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.XIKJDD3DP3l7Ps0ApZZB5SRnGwRPqe8_0 2024-09-12T01:10:59.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.653+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.123523820186553889', time=2024-09-12T02:52:31.732778+0000, chain.objs.size()=1 2024-09-12T01:10:59.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vRb3RuvRk3703hDWFC5I9RlZZMJ_di9_0 2024-09-12T01:10:59.652 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.653+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3614645216722691613', time=2024-09-12T02:52:31.960925+0000, chain.objs.size()=1 2024-09-12T01:10:59.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.IuTOgRkxIprj3lUTXsxd8_2lUdMv9Pb_0 2024-09-12T01:10:59.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.653+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12359076857759176625', time=2024-09-12T02:52:32.544436+0000, chain.objs.size()=1 2024-09-12T01:10:59.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.653+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.264__shadow_.S2bljbZrxVcHvGBsZLaS6l1Pf0-TBzr_0 2024-09-12T01:10:59.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.654+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3596054573737484430', time=2024-09-12T02:52:34.807796+0000, chain.objs.size()=1 2024-09-12T01:10:59.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.654+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.268__shadow_.amZYzf5rKln5ZXMeu_gHyv-FHYylbM9_0 2024-09-12T01:10:59.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.654+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16437576369812063179', time=2024-09-12T02:52:35.372116+0000, chain.objs.size()=1 2024-09-12T01:10:59.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.654+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.269__shadow_.1PRr3ayL_u_GZozgh5-THz1N9xH2gbU_0 2024-09-12T01:10:59.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.654+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11291681168786745952', time=2024-09-12T02:52:35.376351+0000, chain.objs.size()=1 2024-09-12T01:10:59.653 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.654+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.269__shadow_.l3jSTEcR0ZIwNDuTbOkBd0kX32GjwKn_0 2024-09-12T01:10:59.655 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11558820872791842181', time=2024-09-12T02:52:45.474326+0000, chain.objs.size()=1 2024-09-12T01:10:59.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.286__shadow_.W0uW9xYx_8d5IYSwVqGfST2Vwf7I-Cy_0 2024-09-12T01:10:59.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15322448439525430263', time=2024-09-12T02:52:47.984862+0000, chain.objs.size()=1 2024-09-12T01:10:59.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.290__shadow_.gEbOzr-ziGXuiTw0BVj2d6wZ462mTIQ_0 2024-09-12T01:10:59.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1709711609908764573', time=2024-09-12T02:52:51.126473+0000, chain.objs.size()=1 2024-09-12T01:10:59.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.zIV29vVsyZhpMbgK7KF_93EJ1jmlfCF_0 2024-09-12T01:10:59.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10426339244748510941', time=2024-09-12T02:52:51.127187+0000, chain.objs.size()=1 2024-09-12T01:10:59.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.TiFYkJlFEH9zGLv5G11AWucwkAI55Xg_0 2024-09-12T01:10:59.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15430666338929867509', time=2024-09-12T02:52:51.204523+0000, chain.objs.size()=1 2024-09-12T01:10:59.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.mZj_TbZCUzwIjVV94mwg7lbQZDvIJmA_0 2024-09-12T01:10:59.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15544570761551672644', time=2024-09-12T02:52:51.205273+0000, chain.objs.size()=1 2024-09-12T01:10:59.656 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.-l8XdHK6PW4fldeEQPJB_oWr7R7oTTx_0 2024-09-12T01:10:59.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2226485455372707100', time=2024-09-12T02:52:53.275179+0000, chain.objs.size()=1 2024-09-12T01:10:59.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.NvkEtbqhCW_UBJn4Vj7kwBAFlsiIl3r_0 2024-09-12T01:10:59.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.833743821415923333', time=2024-09-12T02:52:58.251402+0000, chain.objs.size()=1 2024-09-12T01:10:59.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.656+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.302__shadow_.6GHxfo8pC12vTmIuvXAvPcoVHC9xalW_0 2024-09-12T01:10:59.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.658+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10041179626778223757', time=2024-09-12T02:53:49.429924+0000, chain.objs.size()=1 2024-09-12T01:10:59.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.658+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.3_BybURIY4YgGeyvMdsGVtAXiRlWj09_0 2024-09-12T01:10:59.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.658+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16260867974313356520', time=2024-09-12T02:53:49.484295+0000, chain.objs.size()=1 2024-09-12T01:10:59.657 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.658+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Mw06mmxoJNbb0Vb2kzkSwKYvg0PEoel_0 2024-09-12T01:10:59.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.658+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12039262384312001173', time=2024-09-12T02:53:49.844306+0000, chain.objs.size()=1 2024-09-12T01:10:59.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.658+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.7N9ms_AaSbzDH6u4muXkjwcsslkrLlW_0 2024-09-12T01:10:59.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.659+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5618901840489188892', time=2024-09-12T02:53:50.877647+0000, chain.objs.size()=1 2024-09-12T01:10:59.658 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.659+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ecu2AGijjR3PVAGwAT3hSYhpismyTI7_0 2024-09-12T01:10:59.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.660+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12132009452079518194', time=2024-09-12T02:53:51.288236+0000, chain.objs.size()=1 2024-09-12T01:10:59.659 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.660+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lzQSVQC9Xp2IXwduFdGqjx0bRZHKZNb_0 2024-09-12T01:10:59.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.661+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.300036181106391637', time=2024-09-12T02:53:51.535518+0000, chain.objs.size()=1 2024-09-12T01:10:59.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.661+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.HE7V5xkLw7yAyP_1SGZUu80sWtUeuCl_0 2024-09-12T01:10:59.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.662+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15984637013972486410', time=2024-09-12T02:53:52.301874+0000, chain.objs.size()=1 2024-09-12T01:10:59.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.662+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.7digb9e3OeIxBV3vJ4IFDvkF3Fy5n-C_0 2024-09-12T01:10:59.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.662+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17905318237314202680', time=2024-09-12T02:53:52.391234+0000, chain.objs.size()=1 2024-09-12T01:10:59.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.662+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.IA4xQxQY8i22DzKi-22JAuJeeBkT6NJ_0 2024-09-12T01:10:59.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.662+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11387252476677701276', time=2024-09-12T02:53:52.642944+0000, chain.objs.size()=1 2024-09-12T01:10:59.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.662+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ES-cQ6qgG5V4ZpS4hJuQyWqwwmI2ZF__0 2024-09-12T01:10:59.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.662+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8971164113955474944', time=2024-09-12T02:53:52.961210+0000, chain.objs.size()=1 2024-09-12T01:10:59.661 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.662+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.POYVZsb_fJVYtBK5rwp8pVcesPp_KBd_0 2024-09-12T01:10:59.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.662+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11453604008633136916', time=2024-09-12T02:53:53.110500+0000, chain.objs.size()=1 2024-09-12T01:10:59.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.662+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.DxzJgV1BlkyDIWX3CqR6sT-FU1Oi4Gy_0 2024-09-12T01:10:59.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.662+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16776886683455457974', time=2024-09-12T02:53:53.112504+0000, chain.objs.size()=1 2024-09-12T01:10:59.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.662+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.3g7hWlSMqTx1g0e9se-ZbArwpmiMTba_0 2024-09-12T01:10:59.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.662+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11869621698422114719', time=2024-09-12T02:53:53.291507+0000, chain.objs.size()=1 2024-09-12T01:10:59.662 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.662+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.iXNrIbKJG9xCu9XA0pceaRdcLHCCIZV_0 2024-09-12T01:10:59.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.664+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11085420482677394801', time=2024-09-12T02:53:53.854205+0000, chain.objs.size()=1 2024-09-12T01:10:59.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.664+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.iAFVm_rC98OIypxQbJHws6a2JLagSON_0 2024-09-12T01:10:59.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.664+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.437098273649554814', time=2024-09-12T02:53:54.169821+0000, chain.objs.size()=1 2024-09-12T01:10:59.663 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.664+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.RO-RJjRrT_ZhdCEPBs4wtNEfXY9oXSY_0 2024-09-12T01:10:59.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8488288402081704192', time=2024-09-12T02:53:54.215717+0000, chain.objs.size()=1 2024-09-12T01:10:59.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.iYHEkEdMkkotY96h0ZQTU_YmorU7F0u_0 2024-09-12T01:10:59.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12539061260904135550', time=2024-09-12T02:53:55.531172+0000, chain.objs.size()=1 2024-09-12T01:10:59.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.KF8xZkTx13a89HdHWx6wyiGpoSGx0mT_0 2024-09-12T01:10:59.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5623354809381280015', time=2024-09-12T02:53:55.701989+0000, chain.objs.size()=1 2024-09-12T01:10:59.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.fqTQZgUC28ReJKueEEVWBxg2kBBN2q-_0 2024-09-12T01:10:59.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.237114916049748159', time=2024-09-12T02:53:55.779286+0000, chain.objs.size()=1 2024-09-12T01:10:59.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Qx92hEbcOKjsv-eJAu7KpHi7Vr5rq4M_0 2024-09-12T01:10:59.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3672149409738806018', time=2024-09-12T02:53:56.030045+0000, chain.objs.size()=1 2024-09-12T01:10:59.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lCPdUw9vTmfM8aRx_Ibx_KtCXC9dftw_0 2024-09-12T01:10:59.666 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.374003312313771337', time=2024-09-12T02:53:56.036301+0000, chain.objs.size()=1 2024-09-12T01:10:59.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.9zLTqp_weoYI1kpK-P20bZ80qCcI-fE_0 2024-09-12T01:10:59.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14395732745699568963', time=2024-09-12T02:53:57.732293+0000, chain.objs.size()=1 2024-09-12T01:10:59.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Pk8pqO15q9hLh-AsE06qk-XdS1ImjiS_0 2024-09-12T01:10:59.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16484351062149226834', time=2024-09-12T02:53:58.107187+0000, chain.objs.size()=1 2024-09-12T01:10:59.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.666+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.WeE2uTQePqrzDraBbLVdxaakpeGi3a3_0 2024-09-12T01:10:59.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.667+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11083556731459132049', time=2024-09-12T02:53:58.270599+0000, chain.objs.size()=1 2024-09-12T01:10:59.667 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.667+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Hq04utuI7sQ8yBiGKLOSJT_ulCWmrLp_0 2024-09-12T01:10:59.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.669+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5324597335944723534', time=2024-09-12T02:53:58.496721+0000, chain.objs.size()=1 2024-09-12T01:10:59.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.669+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.P9g8sacsKe5_uJaX3wpgrJIM7aKQcQu_0 2024-09-12T01:10:59.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.669+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11422296632474651925', time=2024-09-12T02:53:58.665581+0000, chain.objs.size()=1 2024-09-12T01:10:59.668 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.669+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.QpOUrC91Bwi3316BL_Ziuaq-cFTHhdi_0 2024-09-12T01:10:59.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.671+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6972803753333122318', time=2024-09-12T02:53:58.667105+0000, chain.objs.size()=1 2024-09-12T01:10:59.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.671+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Nn7MtuQ19dssJ2cjAIkV-ZIpK-0ZYyH_0 2024-09-12T01:10:59.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.671+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17354509086668686615', time=2024-09-12T02:53:59.212194+0000, chain.objs.size()=1 2024-09-12T01:10:59.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.671+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ImvlGPZAqbIWKcmM0P8wGAg-zjTooDi_0 2024-09-12T01:10:59.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.671+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4833741536009605585', time=2024-09-12T02:54:36.786236+0000, chain.objs.size()=1 2024-09-12T01:10:59.670 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.671+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.IH7nI67egctqVcSqIMjdgsfGROCaCVz_0 2024-09-12T01:10:59.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17045779100020377331', time=2024-09-12T02:54:37.079644+0000, chain.objs.size()=1 2024-09-12T01:10:59.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.oSwZ8qWgjrnpFUrtj8iQHnrxxndIqcc_0 2024-09-12T01:10:59.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6404352139134978025', time=2024-09-12T02:54:37.615550+0000, chain.objs.size()=1 2024-09-12T01:10:59.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.de2Q9hlhgs0TmqlUojoHVH3gq781830_0 2024-09-12T01:10:59.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2965988371198398075', time=2024-09-12T02:54:38.291293+0000, chain.objs.size()=1 2024-09-12T01:10:59.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.5UaShoXqqyB4b0Tf8KwB9rv6TekXUk5_0 2024-09-12T01:10:59.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.942705700877331511', time=2024-09-12T02:54:38.465506+0000, chain.objs.size()=1 2024-09-12T01:10:59.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._-K6mRdz1l1i4FBdflj-bhOZ1N7EOOl_0 2024-09-12T01:10:59.672 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7079618634856518856', time=2024-09-12T02:54:38.573757+0000, chain.objs.size()=1 2024-09-12T01:10:59.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.35yduIcf31YWrWM6FrXoL6cN_ZbwrsW_0 2024-09-12T01:10:59.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11998639967238002918', time=2024-09-12T02:54:38.675294+0000, chain.objs.size()=1 2024-09-12T01:10:59.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.a-wl4n7MYxn645rDlGmlgsU6Id1LAiT_0 2024-09-12T01:10:59.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2433503259946817443', time=2024-09-12T02:54:38.941370+0000, chain.objs.size()=1 2024-09-12T01:10:59.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.3hYXscGRDo6tOmsMTnJrxP0PJx34Olz_0 2024-09-12T01:10:59.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4326707788373355870', time=2024-09-12T02:54:38.961739+0000, chain.objs.size()=1 2024-09-12T01:10:59.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.672+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.vpMEnCgydzLEKC1yqk_4VxwWYmt87w5_0 2024-09-12T01:10:59.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.674+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5873096087490242836', time=2024-09-12T02:54:39.526585+0000, chain.objs.size()=1 2024-09-12T01:10:59.673 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.674+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.U6QQe8dYuMxPmeyDd03abQk9d06bYdV_0 2024-09-12T01:10:59.676 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.677+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/51998 2024-09-12T01:10:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=43, truncated=0, next_marker='' 2024-09-12T01:10:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6432931749480392091', time=2024-09-12T02:54:39.527392+0000, chain.objs.size()=1 2024-09-12T01:10:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6_UNdK16K5bZfZgKDMjVc6LcdN15xTS_0 2024-09-12T01:10:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9825995404118461219', time=2024-09-12T02:54:39.608277+0000, chain.objs.size()=1 2024-09-12T01:10:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.z1cU_vIzfI9UcZvn1tmJ1pBZQh2Q3lF_0 2024-09-12T01:10:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6156156863782234364', time=2024-09-12T02:54:39.689201+0000, chain.objs.size()=1 2024-09-12T01:10:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.StQEktk-KK8IcmfQ6O028I29AmVPx9y_0 2024-09-12T01:10:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10459416406095420410', time=2024-09-12T02:54:40.245651+0000, chain.objs.size()=1 2024-09-12T01:10:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.glcxdkJ-IY-mE8r3Xk-SE1FJY-ZRBFe_0 2024-09-12T01:10:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9765388912620237265', time=2024-09-12T02:54:40.364514+0000, chain.objs.size()=1 2024-09-12T01:10:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.j93JfjumPxER3kstFGF9ovDs3VK3lcH_0 2024-09-12T01:10:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13177212276511660100', time=2024-09-12T02:54:40.436261+0000, chain.objs.size()=1 2024-09-12T01:10:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.KL-Jtmp-ZSYt52mdGOeoLlZIzlGvGOC_0 2024-09-12T01:10:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18063093463505431850', time=2024-09-12T02:54:40.931695+0000, chain.objs.size()=1 2024-09-12T01:10:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.2z5SNZyQIdOmvRFeWe6B_lU9rKAmQG0_0 2024-09-12T01:10:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16632112251059943993', time=2024-09-12T02:54:42.207593+0000, chain.objs.size()=1 2024-09-12T01:10:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.JC8ZYSqZoQ8NsgGaXIU9OMyKvj7qFTg_0 2024-09-12T01:10:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9972165875018526852', time=2024-09-12T02:54:42.645205+0000, chain.objs.size()=1 2024-09-12T01:10:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.bDCHl_paXkGliz_GJWYe5sOUi-EaaeB_0 2024-09-12T01:10:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14736389950152148052', time=2024-09-12T02:54:42.836784+0000, chain.objs.size()=1 2024-09-12T01:10:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.wySTwpP0WatyFu3aepLo4I8DN6c1Amo_0 2024-09-12T01:10:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12852445761509567266', time=2024-09-12T02:54:42.886559+0000, chain.objs.size()=1 2024-09-12T01:10:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.5Sog-Sw1A4znQ3_L2EJmo3vGCFl8k_W_0 2024-09-12T01:10:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3390986620117298968', time=2024-09-12T02:54:43.024299+0000, chain.objs.size()=1 2024-09-12T01:10:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.680+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.a4NVoKpfY6OsgaRjdauM4eMghm0QTDb_0 2024-09-12T01:10:59.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.682+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9967570080166307605', time=2024-09-12T02:54:43.385145+0000, chain.objs.size()=1 2024-09-12T01:10:59.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.682+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.rlMl9AVopiVaf-YXkEiW70032ROLU0J_0 2024-09-12T01:10:59.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.682+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11489878070152128296', time=2024-09-12T02:54:44.185807+0000, chain.objs.size()=1 2024-09-12T01:10:59.683 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.682+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.mTnLALGUoSPj97W-FROp-mUcUOstSxi_0 2024-09-12T01:10:59.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.683+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14825215585454731404', time=2024-09-12T02:54:44.268743+0000, chain.objs.size()=1 2024-09-12T01:10:59.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.683+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.TGmowJcdVKchlKATkKYC_Eguaj_2Hhv_0 2024-09-12T01:10:59.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.683+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9906662013031951602', time=2024-09-12T02:54:44.667783+0000, chain.objs.size()=1 2024-09-12T01:10:59.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.683+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dTyNTleVi4wWcPqPbkHuxOAno3KoZ1r_0 2024-09-12T01:10:59.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.683+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7701308009363051723', time=2024-09-12T02:54:44.772510+0000, chain.objs.size()=1 2024-09-12T01:10:59.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.683+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.pC6XT1i7dOhvXdjf-FJYK4KbDFjgso1_0 2024-09-12T01:10:59.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.683+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18154139582064044855', time=2024-09-12T02:54:44.795882+0000, chain.objs.size()=1 2024-09-12T01:10:59.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.683+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.IQTH0Z2c7HI7bGUJMOcQHD-w1BTZvib_0 2024-09-12T01:10:59.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.684+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17832133137724354231', time=2024-09-12T02:54:45.284067+0000, chain.objs.size()=1 2024-09-12T01:10:59.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.684+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.v1uiiSqwPBNOxjM0OiyTPEtHY7t5KIK_0 2024-09-12T01:10:59.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.684+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16398211599870940703', time=2024-09-12T02:54:45.762143+0000, chain.objs.size()=1 2024-09-12T01:10:59.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.684+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.mtB13ZgHiXp-EhB9YTIcXJbO6X7k24a_0 2024-09-12T01:10:59.684 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.684+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.542753461978255068', time=2024-09-12T02:54:46.049072+0000, chain.objs.size()=1 2024-09-12T01:10:59.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.684+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Dzf_WXdJplLiDjNcf6f_37Vxy2NMSlp_0 2024-09-12T01:10:59.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.684+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.423434956636551436', time=2024-09-12T02:54:46.811570+0000, chain.objs.size()=1 2024-09-12T01:10:59.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.684+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.3Rm6TQxiX52r_DnAW4Xgbz0--rVgaD__0 2024-09-12T01:10:59.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.684+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15982334702359178839', time=2024-09-12T02:54:46.855841+0000, chain.objs.size()=1 2024-09-12T01:10:59.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.684+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.juz80ZaE3Umhcbvi3Gc0hdlzCBHjqkq_0 2024-09-12T01:10:59.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.685+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5066939112730266687', time=2024-09-12T02:54:47.092465+0000, chain.objs.size()=1 2024-09-12T01:10:59.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.685+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.AftFBtaDU7Tk0gf5xhFXK-a87mWSImX_0 2024-09-12T01:10:59.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.685+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6308485998759313072', time=2024-09-12T02:54:54.037246+0000, chain.objs.size()=1 2024-09-12T01:10:59.685 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.685+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.338__shadow_.7fXaqygDUg_gp5rqjdTeJS4uCE71sue_0 2024-09-12T01:10:59.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.686+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7476352532939024248', time=2024-09-12T02:55:18.226713+0000, chain.objs.size()=1 2024-09-12T01:10:59.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.686+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.385__shadow_.nLBbj-PfoUO59Yx4irzKZ5Lfz9LxAvY_0 2024-09-12T01:10:59.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.687+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9438909080954131588', time=2024-09-12T02:55:43.931341+0000, chain.objs.size()=1 2024-09-12T01:10:59.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.687+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.432__shadow_.dv3lTJuVWvI1lWqkw1ZzYoYPU4ybifc_0 2024-09-12T01:10:59.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.687+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16992348784083853706', time=2024-09-12T02:55:50.344532+0000, chain.objs.size()=1 2024-09-12T01:10:59.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.687+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.443__shadow_.WaT13cNVvKPqonXiEhGZ1mhKBUdgZbo_0 2024-09-12T01:10:59.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.687+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.649019068720735566', time=2024-09-12T02:56:00.493857+0000, chain.objs.size()=1 2024-09-12T01:10:59.686 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.687+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.459__shadow_.JQu0MxSLoF-k-vVI-XAkzKyauvLVsgn_0 2024-09-12T01:10:59.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.689+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3150662307590366503', time=2024-09-12T02:56:06.933544+0000, chain.objs.size()=1 2024-09-12T01:10:59.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.689+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.467__shadow_.Df_2O0gUxkirIAEnZU3HzxfRYOC4dBb_0 2024-09-12T01:10:59.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.689+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.609933486723505808', time=2024-09-12T02:57:15.562939+0000, chain.objs.size()=6 2024-09-12T01:10:59.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.689+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.522__multipart_mymultipart.2~HgXFvJyctGYDvJEgMKLqk4Xw_XLguam.1 2024-09-12T01:10:59.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.689+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.522__shadow_mymultipart.2~HgXFvJyctGYDvJEgMKLqk4Xw_XLguam.1_1 2024-09-12T01:10:59.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.689+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.522__multipart_mymultipart.2~HgXFvJyctGYDvJEgMKLqk4Xw_XLguam.2 2024-09-12T01:10:59.688 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.689+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.522__shadow_mymultipart.2~HgXFvJyctGYDvJEgMKLqk4Xw_XLguam.2_1 2024-09-12T01:10:59.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.689+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.522__multipart_mymultipart.2~HgXFvJyctGYDvJEgMKLqk4Xw_XLguam.3 2024-09-12T01:10:59.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.689+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.522__shadow_mymultipart.2~HgXFvJyctGYDvJEgMKLqk4Xw_XLguam.3_1 2024-09-12T01:10:59.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.689+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7592681691879961578', time=2024-09-12T02:59:53.876099+0000, chain.objs.size()=1 2024-09-12T01:10:59.689 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.689+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:rc0KO4R5t1wZ5xQykJStd4QWiamPZSn_.faxFnemj7WXNXgpmk4uxODAHEjsk1vk_0 2024-09-12T01:10:59.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.691+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3473635700516595302', time=2024-09-12T03:00:10.522181+0000, chain.objs.size()=1 2024-09-12T01:10:59.690 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.691+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.575__shadow:LwdUuHsC7mW5fjtRPBuaMpODhQCBSBM_.GTYHXgIve19MQpYun6dUR07wqwFCf-J_0 2024-09-12T01:10:59.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.692+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2317202982739472510', time=2024-09-12T03:00:36.643011+0000, chain.objs.size()=1 2024-09-12T01:10:59.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.692+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:xGviMUhYQkRlIzR0dmuPRhHLQUlYCo9_.9A7tYSxEfz3zwLF1O2BjZrpz0czYtlZ_0 2024-09-12T01:10:59.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.692+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5027204446573583614', time=2024-09-12T03:00:56.234086+0000, chain.objs.size()=1 2024-09-12T01:10:59.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.692+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.584__shadow:Tp2VFA3aXso8lX9Biq3PeX..7ylOOe3_.gHHz4vC0FaZw-BAzJ8d3OOXhEHSCuaF_0 2024-09-12T01:10:59.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.692+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7947098597460892397', time=2024-09-12T03:00:58.211357+0000, chain.objs.size()=1 2024-09-12T01:10:59.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.692+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.586__shadow:2Cdv22xpgRdaWptoXFV4tAnPPOmb.d3_.olUpCD_AqpPplPYWcurl8ykNMB1srhw_0 2024-09-12T01:10:59.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.692+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5567145037295798561', time=2024-09-12T03:01:10.543337+0000, chain.objs.size()=1 2024-09-12T01:10:59.691 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.692+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.608__shadow_.j1kpx2O04Bh1lMIYAL2erlOcPFbe2tN_0 2024-09-12T01:10:59.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.693+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12984460431265226678', time=2024-09-12T03:04:16.608324+0000, chain.objs.size()=1 2024-09-12T01:10:59.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.693+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.620__shadow_.RQOutOMP6xpMnimYSi2usWFTKSQk9Cy_0 2024-09-12T01:10:59.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.693+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17373896544664526695', time=2024-09-12T03:04:57.910813+0000, chain.objs.size()=1 2024-09-12T01:10:59.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.693+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.641__shadow_.R9WojKWY4E3unnWvpRPnsnoFkvrX2hk_0 2024-09-12T01:10:59.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.693+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15439031244039889135', time=2024-09-12T03:05:13.201328+0000, chain.objs.size()=1 2024-09-12T01:10:59.692 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.693+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.653__shadow_.IzZ_egMyd7XeUMHb3oTflmr8PW4-7uu_0 2024-09-12T01:10:59.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.694+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17646268865453708856', time=2024-09-12T03:05:16.590805+0000, chain.objs.size()=1 2024-09-12T01:10:59.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.694+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.656__shadow_.bMwUysw_s03PZU6Nkm-fGBCXKl5vWW8_0 2024-09-12T01:10:59.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.694+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14809767796497688675', time=2024-09-12T03:05:37.672141+0000, chain.objs.size()=1 2024-09-12T01:10:59.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.694+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.669__shadow_.BmfgrIXSeuDFAwMEorijv0a__l2jxiP_0 2024-09-12T01:10:59.693 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.694+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4595590846131301053', time=2024-09-12T03:05:51.528842+0000, chain.objs.size()=1 2024-09-12T01:10:59.694 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.694+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.697__shadow:FQgZFgOjOdkvk7DuHQ7YuzZZPDRZttE_.ctHR9iKqW9I52dq8SuYqtpp0IOCLWZ2_0 2024-09-12T01:10:59.697 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.698+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.699 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.700+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:10:59.700 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.702+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.701 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.702+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50848' 2024-09-12T01:10:59.702 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15356291077408878806', time=2024-09-12T02:49:03.976467+0000, chain.objs.size()=1 2024-09-12T01:10:59.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.149__shadow_.wee09rKW4G3J9hToUAqAOfr2WFbxTOs_0 2024-09-12T01:10:59.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13054354937385746085', time=2024-09-12T02:51:27.884402+0000, chain.objs.size()=1 2024-09-12T01:10:59.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.235__shadow_.434opB2tRLUtxYM3fj0CxusdsLoZMqZ_0 2024-09-12T01:10:59.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10271450473916327131', time=2024-09-12T02:51:35.278712+0000, chain.objs.size()=1 2024-09-12T01:10:59.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.246__shadow_.p43Vf4D-hCq4hGfXLNlbs8DyeyJOANH_0 2024-09-12T01:10:59.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13505248092516090481', time=2024-09-12T02:51:39.539712+0000, chain.objs.size()=1 2024-09-12T01:10:59.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.253__shadow_.vk7riNodOJwlXP2EheSB2e4l-1iRJ61_0 2024-09-12T01:10:59.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12999156773306206588', time=2024-09-12T02:51:44.878934+0000, chain.objs.size()=1 2024-09-12T01:10:59.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.262__shadow_.RmZOp-YksqdH1iXmgEhvx4Fm7NjYh1O_0 2024-09-12T01:10:59.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5559147451400760320', time=2024-09-12T02:52:21.713677+0000, chain.objs.size()=1 2024-09-12T01:10:59.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ZxHqpijOaImvNOvh_GF2inUDm7YR3SA_0 2024-09-12T01:10:59.703 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.394327263044708340', time=2024-09-12T02:52:22.039319+0000, chain.objs.size()=1 2024-09-12T01:10:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Id3FibxfpJrz6fNIGHFFE4OzfRltEB9_0 2024-09-12T01:10:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2237453620662036070', time=2024-09-12T02:52:22.242912+0000, chain.objs.size()=1 2024-09-12T01:10:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.BJ4jFlkoUWAdQj9Htc0RlgDEevLi6Y__0 2024-09-12T01:10:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15013287939166273551', time=2024-09-12T02:52:23.017929+0000, chain.objs.size()=1 2024-09-12T01:10:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Hygf6tkOI6yBAVIrcpQR3vawq8nQHFn_0 2024-09-12T01:10:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15721904416839807036', time=2024-09-12T02:52:23.183210+0000, chain.objs.size()=1 2024-09-12T01:10:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pChw60lqv_bPBiXmHhN1dfK5JwIV6iI_0 2024-09-12T01:10:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9575745900699775065', time=2024-09-12T02:52:23.447604+0000, chain.objs.size()=1 2024-09-12T01:10:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.iobhjQPUTEtcQk9HszkYgK-z_k5vefO_0 2024-09-12T01:10:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15093513361291681902', time=2024-09-12T02:52:23.738200+0000, chain.objs.size()=1 2024-09-12T01:10:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.703+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0wjyib4YV65CZLThnZNlN97jtM-WAPA_0 2024-09-12T01:10:59.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.706+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.130646385546945526', time=2024-09-12T02:52:24.238808+0000, chain.objs.size()=1 2024-09-12T01:10:59.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.706+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Db1RiWw1HlkdQ-4gThlyIo4CCzxk0yC_0 2024-09-12T01:10:59.705 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.706+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11993306886087691128', time=2024-09-12T02:52:24.588946+0000, chain.objs.size()=1 2024-09-12T01:10:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.706+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.g7rWMibYQWJADEH3gQTO8oK4jdpFNCp_0 2024-09-12T01:10:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.706+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10506902457957673927', time=2024-09-12T02:52:25.029626+0000, chain.objs.size()=1 2024-09-12T01:10:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.706+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.gNCkY0jj9IsmeJHOZ9OBfxvglR6pA9P_0 2024-09-12T01:10:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.706+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17918244132736618588', time=2024-09-12T02:52:25.162618+0000, chain.objs.size()=1 2024-09-12T01:10:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.706+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Z36JNZZpOtOraE1FPPGRpdvtBYlt873_0 2024-09-12T01:10:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.706+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12405500027894672357', time=2024-09-12T02:52:25.745685+0000, chain.objs.size()=1 2024-09-12T01:10:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.706+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0CgGvSpjzhlRti59kQbHnsNopB1ugjA_0 2024-09-12T01:10:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.706+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11971329040030275792', time=2024-09-12T02:52:26.313470+0000, chain.objs.size()=1 2024-09-12T01:10:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.706+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Kmagv2MV--Z_Z2zjTGzd3_VJB5jbTaE_0 2024-09-12T01:10:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.706+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7701381713726115942', time=2024-09-12T02:52:27.223563+0000, chain.objs.size()=1 2024-09-12T01:10:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.706+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.aTuRbKF04jyXlkxhghL4KPkiZ-XxN8L_0 2024-09-12T01:10:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.708+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16107050887812320954', time=2024-09-12T02:52:27.436805+0000, chain.objs.size()=1 2024-09-12T01:10:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.708+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.VpVZuwBR1JHslSi1m7v_cjwOpSiHQ8N_0 2024-09-12T01:10:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.708+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5469315830248420965', time=2024-09-12T02:52:28.592511+0000, chain.objs.size()=1 2024-09-12T01:10:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.708+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.TKVf2l9EprdeWnIU_RCmMwVOAytB6OZ_0 2024-09-12T01:10:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.708+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.385597772487746386', time=2024-09-12T02:52:28.706214+0000, chain.objs.size()=1 2024-09-12T01:10:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.708+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.PcI2fDmv-v1UGOJsLTbpOt0hiH9at7I_0 2024-09-12T01:10:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.708+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17339114678130404107', time=2024-09-12T02:52:29.179271+0000, chain.objs.size()=1 2024-09-12T01:10:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.708+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.-a5pAfNlFXhPy7qSnAR7U1gljHr4p1b_0 2024-09-12T01:10:59.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.711+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5193538574475773424', time=2024-09-12T02:52:29.280447+0000, chain.objs.size()=1 2024-09-12T01:10:59.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.711+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.CSYYVjXESybw3P307dt5mSvziYyWCBi_0 2024-09-12T01:10:59.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.711+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6175665030631037121', time=2024-09-12T02:52:29.564357+0000, chain.objs.size()=1 2024-09-12T01:10:59.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.711+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.n0WJQfwhusXIFHF5Kf3MVRu2561wife_0 2024-09-12T01:10:59.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.711+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7719287319099268878', time=2024-09-12T02:52:30.305930+0000, chain.objs.size()=1 2024-09-12T01:10:59.710 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.711+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.eGYhA2frfcdpo6Jtq9z-53OocE0p9N8_0 2024-09-12T01:10:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.98370959134189971', time=2024-09-12T02:52:30.458523+0000, chain.objs.size()=1 2024-09-12T01:10:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wDe19xP-hQvq0H_sJYtdA11vmR56s7x_0 2024-09-12T01:10:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15836335389392717759', time=2024-09-12T02:52:30.797377+0000, chain.objs.size()=1 2024-09-12T01:10:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.w-KbAaP-Hp4XXV10iqiUaMAuhfmWMvp_0 2024-09-12T01:10:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2741128366201992815', time=2024-09-12T02:52:30.839297+0000, chain.objs.size()=1 2024-09-12T01:10:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ixVmbpSxu1k82RpA1_xAn2MRiQxqCcn_0 2024-09-12T01:10:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16029694633667328119', time=2024-09-12T02:52:31.157269+0000, chain.objs.size()=1 2024-09-12T01:10:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.RdGDBUAgVfirEnbzIAWR2K63raUn3Oj_0 2024-09-12T01:10:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11677155983988538564', time=2024-09-12T02:52:31.277909+0000, chain.objs.size()=1 2024-09-12T01:10:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.BXmuKyoZtzXNZ6p4fItfjwFaDbAfZnG_0 2024-09-12T01:10:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3187698220665098681', time=2024-09-12T02:52:31.429487+0000, chain.objs.size()=1 2024-09-12T01:10:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.woQ5mzQ8ZE3KUPA3EIygnu7ex-oBqkK_0 2024-09-12T01:10:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3425463296772010302', time=2024-09-12T02:52:31.795896+0000, chain.objs.size()=1 2024-09-12T01:10:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.y05-wvwqUBFdzwGwofTwtxreRBXjlAF_0 2024-09-12T01:10:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14427881007872983317', time=2024-09-12T02:52:31.928141+0000, chain.objs.size()=1 2024-09-12T01:10:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.713+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.eNabdjejlWV9Mg3lERmNumiRv9zGQzC_0 2024-09-12T01:10:59.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.715+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12090017535311549655', time=2024-09-12T02:52:31.949559+0000, chain.objs.size()=1 2024-09-12T01:10:59.714 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.715+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wlIuupZpsttHF6VPPrancg2FJjdxMTw_0 2024-09-12T01:10:59.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.716+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8064579619809874373', time=2024-09-12T02:52:41.779741+0000, chain.objs.size()=1 2024-09-12T01:10:59.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.716+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.280__shadow_.M8ymnjxID_ldeN8KpXaG5qH6yYfV6Zr_0 2024-09-12T01:10:59.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.716+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15622241897245604316', time=2024-09-12T02:52:51.110451+0000, chain.objs.size()=1 2024-09-12T01:10:59.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.716+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.maXCg97Nf3IL6G1EUvTgz8toHbptgAt_0 2024-09-12T01:10:59.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.716+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10317529249404141641', time=2024-09-12T02:52:53.197438+0000, chain.objs.size()=1 2024-09-12T01:10:59.715 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.716+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.p5qzzaFFoBVmq5cfsOY26ZEJUBOYAoF_0 2024-09-12T01:10:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.717+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2660064549162197387', time=2024-09-12T02:52:53.875709+0000, chain.objs.size()=1 2024-09-12T01:10:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.717+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.295__shadow_.OH059uOlAf565RU7mNTz-55iHkdu67H_0 2024-09-12T01:10:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.717+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18115202647900688110', time=2024-09-12T02:53:50.165358+0000, chain.objs.size()=1 2024-09-12T01:10:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.717+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.OdWzzY5GRhjJpukB_3dVWXJTZbPeN0g_0 2024-09-12T01:10:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.717+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9206909886796328017', time=2024-09-12T02:53:50.229848+0000, chain.objs.size()=1 2024-09-12T01:10:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.717+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qTd3SWYnMLDXwNdv6sBOX46WqfHQDem_0 2024-09-12T01:10:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.717+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3047524043480261634', time=2024-09-12T02:53:50.976394+0000, chain.objs.size()=1 2024-09-12T01:10:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.717+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0NcmiWedMsMpxRNIVnRu3DMzxALnydS_0 2024-09-12T01:10:59.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.718+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2960869533283296183', time=2024-09-12T02:53:51.310482+0000, chain.objs.size()=1 2024-09-12T01:10:59.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.718+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.QQGOSGaPWNlDpAiC3WDJRc_QitiIh-R_0 2024-09-12T01:10:59.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.718+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17794508803082948276', time=2024-09-12T02:53:51.459865+0000, chain.objs.size()=1 2024-09-12T01:10:59.717 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.718+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Z2mE9xlWI82prhupyATCDq4QqFxgCZ4_0 2024-09-12T01:10:59.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.718+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11627984320365616357', time=2024-09-12T02:53:51.586632+0000, chain.objs.size()=1 2024-09-12T01:10:59.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.718+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lBFpOHgAZBjRLJ2xBdEoAJhzJbWH1-6_0 2024-09-12T01:10:59.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.718+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3327822573691925675', time=2024-09-12T02:53:52.617570+0000, chain.objs.size()=1 2024-09-12T01:10:59.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.718+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hDGRrRg1ohBmzZQQ3B2eHw12a2XlYie_0 2024-09-12T01:10:59.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.719+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6335086872122208954', time=2024-09-12T02:53:52.733080+0000, chain.objs.size()=1 2024-09-12T01:10:59.718 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.719+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.fPXD2vgydToWjp60zjDeA-1T1voJjTz_0 2024-09-12T01:10:59.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.719+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4766968739627756782', time=2024-09-12T02:53:53.205645+0000, chain.objs.size()=1 2024-09-12T01:10:59.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.719+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.vjGEeygKTEwvq0mxjZCvts34YL1krv9_0 2024-09-12T01:10:59.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.719+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5248454267083210760', time=2024-09-12T02:53:53.265056+0000, chain.objs.size()=1 2024-09-12T01:10:59.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.719+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.J1MFBHTjx1Sxc-SzQ3jn31bzDm3N0ue_0 2024-09-12T01:10:59.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.720+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4585990965050685969', time=2024-09-12T02:53:53.768107+0000, chain.objs.size()=1 2024-09-12T01:10:59.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.720+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Lox4SE0QZvDiEqoNswKLdyH11eqhrjX_0 2024-09-12T01:10:59.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.720+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7828801479842210490', time=2024-09-12T02:53:54.165157+0000, chain.objs.size()=1 2024-09-12T01:10:59.719 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.720+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.t5E1s0Jw34DysnNB8aswbVnp_ppe7BQ_0 2024-09-12T01:10:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.720+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3169135971930881064', time=2024-09-12T02:53:54.227940+0000, chain.objs.size()=1 2024-09-12T01:10:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.720+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.8iF-QwY4RcSJ4vwlweI0p2mxf_YW0KA_0 2024-09-12T01:10:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.722+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4031064169118812919', time=2024-09-12T02:53:54.495587+0000, chain.objs.size()=1 2024-09-12T01:10:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.722+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.N4y0DB-qX2j0JLqxp9dmoPzp8ztkSYb_0 2024-09-12T01:10:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.722+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16645025104712108832', time=2024-09-12T02:53:54.692320+0000, chain.objs.size()=1 2024-09-12T01:10:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.722+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_._JY5iPvR5qyZbgu6F0GetpBGDew1PQZ_0 2024-09-12T01:10:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.722+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6451426895267938011', time=2024-09-12T02:53:55.618643+0000, chain.objs.size()=1 2024-09-12T01:10:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.722+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ncIfIWci8RNekYVUmlk63UQG0FjEcGq_0 2024-09-12T01:10:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.722+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2549639032176944411', time=2024-09-12T02:53:55.896197+0000, chain.objs.size()=1 2024-09-12T01:10:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.722+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tQu3zK-K0RkhhX8yxAMXFr9InZwaIdq_0 2024-09-12T01:10:59.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.722+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18368438267879459254', time=2024-09-12T02:53:55.897524+0000, chain.objs.size()=1 2024-09-12T01:10:59.722 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.722+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.aF57GHYHsVDmi0kj9b5Ar1lVza6GkAi_0 2024-09-12T01:10:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.724+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10013878193669999344', time=2024-09-12T02:53:55.981952+0000, chain.objs.size()=1 2024-09-12T01:10:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.724+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.wnOJSYX9Aq3ym_m2HHHZeDHpjj3zfpr_0 2024-09-12T01:10:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.724+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10448612391445734660', time=2024-09-12T02:53:56.392234+0000, chain.objs.size()=1 2024-09-12T01:10:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.724+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.gurqemxUc-aSSC0w31pxUx4sb3vbN27_0 2024-09-12T01:10:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.724+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14256857924401405861', time=2024-09-12T02:53:56.523956+0000, chain.objs.size()=1 2024-09-12T01:10:59.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.724+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.QWDS-u384HCYBJawfco61sUUY7Aukv8_0 2024-09-12T01:10:59.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.724+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15603241302866403986', time=2024-09-12T02:53:56.654147+0000, chain.objs.size()=1 2024-09-12T01:10:59.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.724+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.E_xLgkb1yLJA2RL-uGEf_wNp6x_fp4G_0 2024-09-12T01:10:59.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.724+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13994751035885748897', time=2024-09-12T02:53:56.729024+0000, chain.objs.size()=1 2024-09-12T01:10:59.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.724+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.EPixSD1B4UAwr0T1ELrb4xZBOz0oZoO_0 2024-09-12T01:10:59.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.724+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11151645320696105253', time=2024-09-12T02:53:57.267507+0000, chain.objs.size()=1 2024-09-12T01:10:59.724 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.724+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bsFz-LDzWuSFoljh_vcJbAFoqiteQOu_0 2024-09-12T01:10:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.725+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4391211761263961184', time=2024-09-12T02:53:57.268118+0000, chain.objs.size()=1 2024-09-12T01:10:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.725+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.maANCZYND3oTCO5YCqZJThhIxOV1DY7_0 2024-09-12T01:10:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.726+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5050476176686518651', time=2024-09-12T02:53:57.886557+0000, chain.objs.size()=1 2024-09-12T01:10:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.726+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.D9XKKpz-Tn8kFIpgvPVT11TOiglpbqO_0 2024-09-12T01:10:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.726+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.855591608403403630', time=2024-09-12T02:53:58.564175+0000, chain.objs.size()=1 2024-09-12T01:10:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.726+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Y-i87VgkrWHfgmVFj8US4Y4KxIv6Pdg_0 2024-09-12T01:10:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.726+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4198565613842323969', time=2024-09-12T02:53:59.213600+0000, chain.objs.size()=1 2024-09-12T01:10:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.726+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.F4jswvVYA6-PLLIBP28k3dB-qxUeWvL_0 2024-09-12T01:10:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.726+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5375458116049053727', time=2024-09-12T02:54:37.256938+0000, chain.objs.size()=1 2024-09-12T01:10:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.726+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.i9KpbmWCZDf1gs43vEY4RYKK5dpWGp2_0 2024-09-12T01:10:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.729+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12866659768506285211', time=2024-09-12T02:54:37.257640+0000, chain.objs.size()=1 2024-09-12T01:10:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.729+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.R3a3NTh0mbH_n20EgttLcUkgHse4qhg_0 2024-09-12T01:10:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.729+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3599343122786382216', time=2024-09-12T02:54:38.166260+0000, chain.objs.size()=1 2024-09-12T01:10:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.729+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.i7EaaonshTsVPmPHtxyfoNB9NnPifWG_0 2024-09-12T01:10:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.729+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3423780444549423717', time=2024-09-12T02:54:38.208312+0000, chain.objs.size()=1 2024-09-12T01:10:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.729+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.kfgNRtbx1bi-v0TqpgI7fo7W30KxoLL_0 2024-09-12T01:10:59.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.729+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15303053493195527378', time=2024-09-12T02:54:38.527078+0000, chain.objs.size()=1 2024-09-12T01:10:59.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.729+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.SFpdrhfG-9Y3HIxFoM_ICBxcOvZcTwk_0 2024-09-12T01:10:59.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.729+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2599300392475698273', time=2024-09-12T02:54:38.675193+0000, chain.objs.size()=1 2024-09-12T01:10:59.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.729+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.vOK_XT_V5M4jBB9sZtzTU8dAXA7uKFi_0 2024-09-12T01:10:59.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.729+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1914216901230243605', time=2024-09-12T02:54:39.093459+0000, chain.objs.size()=1 2024-09-12T01:10:59.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.729+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.NjuYJvDnqcVxooaHGVNeb6iUiEr5dzw_0 2024-09-12T01:10:59.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.729+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13063809948085801789', time=2024-09-12T02:54:39.503313+0000, chain.objs.size()=1 2024-09-12T01:10:59.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.729+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.NPMjRsz5h8xDQ-tc-0TkN231uiRkRI-_0 2024-09-12T01:10:59.729 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.729+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10537021931355512026', time=2024-09-12T02:54:39.621720+0000, chain.objs.size()=1 2024-09-12T01:10:59.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.730+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.LVv9JYuMiU0WNDwQduNKveDy5PGq9oG_0 2024-09-12T01:10:59.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.730+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14833081112956896057', time=2024-09-12T02:54:39.752354+0000, chain.objs.size()=1 2024-09-12T01:10:59.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.730+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.J8Xnd0JEf3HZxrHqDZodKodv2iXPk4C_0 2024-09-12T01:10:59.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.731+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6451917700054003414', time=2024-09-12T02:54:39.804849+0000, chain.objs.size()=1 2024-09-12T01:10:59.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.731+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.KYFg0o6wDyxnuDelXiwgWaKkTQn6q7A_0 2024-09-12T01:10:59.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.731+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16061628770718057490', time=2024-09-12T02:54:39.975618+0000, chain.objs.size()=1 2024-09-12T01:10:59.730 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.731+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.or6abyacW9gKq-bQmE5k7d5UZe3m2tU_0 2024-09-12T01:10:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.733+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12152032497194464484', time=2024-09-12T02:54:40.375396+0000, chain.objs.size()=1 2024-09-12T01:10:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.734+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.NPcyn1EhIk99LNujzy_mF3HaMvmSZKa_0 2024-09-12T01:10:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.734+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10345367037930540040', time=2024-09-12T02:54:40.856570+0000, chain.objs.size()=1 2024-09-12T01:10:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.734+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.FgZQtXaWzpTdwfrhaZojCsa9N_kJzNa_0 2024-09-12T01:10:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.734+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5561875895823974393', time=2024-09-12T02:54:41.303368+0000, chain.objs.size()=1 2024-09-12T01:10:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.734+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.2R2aWEVrfqmXVbs_uhtOzmG-6YBfyAs_0 2024-09-12T01:10:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.734+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13878941750297008778', time=2024-09-12T02:54:41.623587+0000, chain.objs.size()=1 2024-09-12T01:10:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.734+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.jBW9lhH3Cha_BZN9l736RZ5O3BtC54I_0 2024-09-12T01:10:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.734+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15408675640082224162', time=2024-09-12T02:54:41.809703+0000, chain.objs.size()=1 2024-09-12T01:10:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.734+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.f0vrWqTOOwiaGNj6GMjwlMvnRKW9Q3v_0 2024-09-12T01:10:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.734+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1050495511098932766', time=2024-09-12T02:54:41.832761+0000, chain.objs.size()=1 2024-09-12T01:10:59.733 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.734+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ntp9Cu62CTLklkQoHqn7b-TN0CKFlA1_0 2024-09-12T01:10:59.736 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10012000857363887720', time=2024-09-12T02:54:41.844936+0000, chain.objs.size()=1 2024-09-12T01:10:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.B-2xWW4GWs6_5Y3GhvXDAlBP9kVznEr_0 2024-09-12T01:10:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.854033530252137251', time=2024-09-12T02:54:42.223012+0000, chain.objs.size()=1 2024-09-12T01:10:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.bmPIny2jDeg3HT9aoSCYIfpkry4mF9S_0 2024-09-12T01:10:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14761823182421171097', time=2024-09-12T02:54:42.537400+0000, chain.objs.size()=1 2024-09-12T01:10:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.KimfpUSsuINzsmfhpmtm3s0bqnK-Hb5_0 2024-09-12T01:10:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1043060484422612823', time=2024-09-12T02:54:42.569299+0000, chain.objs.size()=1 2024-09-12T01:10:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.QpQ-5lqcXfiaGDgkJWkw51uTes7oGq7_0 2024-09-12T01:10:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14631065635808276932', time=2024-09-12T02:54:43.922090+0000, chain.objs.size()=1 2024-09-12T01:10:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.lG5_fy3pKm7BrH3zSmbTKJEAngF-vr9_0 2024-09-12T01:10:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16721996681395939877', time=2024-09-12T02:54:44.653103+0000, chain.objs.size()=1 2024-09-12T01:10:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.s_WlEcFX4PJYVzTcGaNbutRdMu2TKqH_0 2024-09-12T01:10:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4470780202870733733', time=2024-09-12T02:54:45.421820+0000, chain.objs.size()=1 2024-09-12T01:10:59.737 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.3i_djiui5SC7sF3LjeKIgcusvec6x3c_0 2024-09-12T01:10:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6635562339478781718', time=2024-09-12T02:54:45.493121+0000, chain.objs.size()=1 2024-09-12T01:10:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.1SSjwlpsEV7e1DY5L9Pexmbs0r3OaaJ_0 2024-09-12T01:10:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.148504440965068136', time=2024-09-12T02:54:45.493831+0000, chain.objs.size()=1 2024-09-12T01:10:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.S43CAacy8S8NkT5OF_neC1Ohx5RcrEV_0 2024-09-12T01:10:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1760594174257706804', time=2024-09-12T02:54:46.035101+0000, chain.objs.size()=1 2024-09-12T01:10:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.cYcF9GjvhNpryhanP_EFonUfr-5emLn_0 2024-09-12T01:10:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18297276682804074492', time=2024-09-12T02:54:46.035646+0000, chain.objs.size()=1 2024-09-12T01:10:59.738 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.737+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.rCICeurKJ4iGuMNPx7T84xcAHkeCKb4_0 2024-09-12T01:10:59.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.740+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2386412077582892460', time=2024-09-12T02:54:46.549256+0000, chain.objs.size()=1 2024-09-12T01:10:59.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.740+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.EFHe8nL-xlNyYBPLZYpbEQwHN6eyzJJ_0 2024-09-12T01:10:59.739 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.740+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12295510528663927848', time=2024-09-12T02:56:02.162193+0000, chain.objs.size()=1 2024-09-12T01:10:59.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.740+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.461__shadow_.PtCj0CxXYnD7oCA4HxEcXiVrjwcXe0f_0 2024-09-12T01:10:59.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.740+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12540596547633094240', time=2024-09-12T02:56:26.016797+0000, chain.objs.size()=1 2024-09-12T01:10:59.740 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.740+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.499__shadow_.SIRGQt-jH5fqFRPU4gtJ8GZ1yPzJqQN_0 2024-09-12T01:10:59.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.742+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9755430078986386878', time=2024-09-12T02:56:29.685179+0000, chain.objs.size()=1 2024-09-12T01:10:59.741 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.742+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.504__shadow:IjSk329PwyZ.TikPwkNaT-eseYUSzXd_.b_0nQhQp9blBOoB3SP2J2YjUhbBu0Hw_0 2024-09-12T01:10:59.743 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.744+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/50848 2024-09-12T01:10:59.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T01:10:59.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16862451777410051566', time=2024-09-12T02:56:45.748395+0000, chain.objs.size()=1 2024-09-12T01:10:59.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.516__shadow_.1msXSBDef-657hXwUlM3RqrmLWZBHFE_0 2024-09-12T01:10:59.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7427797408106190141', time=2024-09-12T02:56:45.925347+0000, chain.objs.size()=1 2024-09-12T01:10:59.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.517__multipart_mymultipartcopy.2~5vIjTlmKZGvEYm0rp5N7WoHFYgB_Rcp.1 2024-09-12T01:10:59.746 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4015738590117566320', time=2024-09-12T02:58:25.800034+0000, chain.objs.size()=3 2024-09-12T01:10:59.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.526__multipart_mymultipart.2~mlILA9q-zU5y76PpgTNwKErSdGv2S59.1 2024-09-12T01:10:59.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.526__multipart_mymultipart.2~mlILA9q-zU5y76PpgTNwKErSdGv2S59.2 2024-09-12T01:10:59.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.526__multipart_mymultipart.2~mlILA9q-zU5y76PpgTNwKErSdGv2S59.3 2024-09-12T01:10:59.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15845391555571106426', time=2024-09-12T03:00:10.825009+0000, chain.objs.size()=1 2024-09-12T01:10:59.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.575__shadow:czMoiuNSaZ-GhIjHPCmY2ng0tFD.CjU_.LpEQAdioqIdTq4rMtb1HiyRHAofIH8e_0 2024-09-12T01:10:59.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11541612582290816487', time=2024-09-12T03:00:20.941163+0000, chain.objs.size()=1 2024-09-12T01:10:59.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:sjviafLA2sVtF6NjSl19uQ8oQJzMIue_.ALrRTpiL9ccZEWgL5IetYWUhKYR0bZe_0 2024-09-12T01:10:59.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.679548953077663754', time=2024-09-12T03:00:52.428346+0000, chain.objs.size()=1 2024-09-12T01:10:59.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.580__shadow:z1ACe4jqbkCB92iAkx.2rlCQ2cgGXxU_.nHpkQoF1q97BBB-TvrWyqU-YTVmdMLL_0 2024-09-12T01:10:59.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7311863032763546419', time=2024-09-12T03:01:00.355690+0000, chain.objs.size()=1 2024-09-12T01:10:59.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.746+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.588__shadow:af0.yNKotZsKKKYh-dpc75WI8kp8F3F_.UvA-H3AYF9N_g0z8DQxxOW4dVLVVTpn_0 2024-09-12T01:10:59.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.747+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14983191409663292110', time=2024-09-12T03:01:10.010816+0000, chain.objs.size()=1 2024-09-12T01:10:59.747 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.747+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.607__shadow_.04WWH3lbHCOY7oj-bwv2R96h0hNfSmq_0 2024-09-12T01:10:59.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.747+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4908593738053735123', time=2024-09-12T03:04:52.324393+0000, chain.objs.size()=1 2024-09-12T01:10:59.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.747+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.631__shadow_.yz87C4xnMCDiE0c1CwSi1k_BM4WPzWq_0 2024-09-12T01:10:59.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.747+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1817931845793694683', time=2024-09-12T03:06:23.707857+0000, chain.objs.size()=1 2024-09-12T01:10:59.748 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.747+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.719__shadow_.EuZkCk1aoKW4NLgqyakZI-HnfH65gPR_0 2024-09-12T01:10:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.751+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.752 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.753+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:10:59.753 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.754+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.755+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46776' 2024-09-12T01:10:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8639855013335383507', time=2024-09-12T02:51:30.775224+0000, chain.objs.size()=1 2024-09-12T01:10:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.239__shadow_.HogAZtDZpjhOTB9wAq8yWJ_S-o0dRbl_0 2024-09-12T01:10:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15662007133071235844', time=2024-09-12T02:51:30.783890+0000, chain.objs.size()=1 2024-09-12T01:10:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.239__shadow_.WkOq4OoRt-NyBGYQAT7mjQAkLIx9OXf_0 2024-09-12T01:10:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11378599018374277787', time=2024-09-12T02:51:34.654536+0000, chain.objs.size()=1 2024-09-12T01:10:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.245__shadow_.zfqHGSUXGD2dPL0BepEL0hmQB4MYcsR_0 2024-09-12T01:10:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1692178806319285143', time=2024-09-12T02:51:37.716377+0000, chain.objs.size()=1 2024-09-12T01:10:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.250__shadow_.hQgEUli5b2o8eyyBtDXVJL_JmBICluB_0 2024-09-12T01:10:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3322366769333226294', time=2024-09-12T02:51:40.136855+0000, chain.objs.size()=1 2024-09-12T01:10:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.254__shadow_.R-2UU4mzIYJT6C__auzwiUrutFxV5Mv_0 2024-09-12T01:10:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16231466552052036637', time=2024-09-12T02:51:44.884224+0000, chain.objs.size()=1 2024-09-12T01:10:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.262__shadow_.QivksNwHZVwQ_TG1wDu6gK38w2U1Ie1_0 2024-09-12T01:10:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5875539878580894500', time=2024-09-12T02:52:21.123963+0000, chain.objs.size()=1 2024-09-12T01:10:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.DpgFKYFCqN3wWx5xbK3mmTkDesChNkU_0 2024-09-12T01:10:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11236749419318421535', time=2024-09-12T02:52:21.124607+0000, chain.objs.size()=1 2024-09-12T01:10:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.aweSFgyV59MtoiVWVpoTlvyEVspm7ws_0 2024-09-12T01:10:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11519869419377922703', time=2024-09-12T02:52:21.219321+0000, chain.objs.size()=1 2024-09-12T01:10:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pbAQbbYuVweK0F9ztRZLXE0Nlvhh9FK_0 2024-09-12T01:10:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7549495586617503410', time=2024-09-12T02:52:21.303075+0000, chain.objs.size()=1 2024-09-12T01:10:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Gw4opokzMJIInDe1lk_L9K559O5cgKY_0 2024-09-12T01:10:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8192883855462608725', time=2024-09-12T02:52:21.807459+0000, chain.objs.size()=1 2024-09-12T01:10:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.qf9A8BIuFlHdpC2XTBXmtVIsxOuCLTa_0 2024-09-12T01:10:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5629390572007351094', time=2024-09-12T02:52:22.054751+0000, chain.objs.size()=1 2024-09-12T01:10:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.756+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.p66IYx_yMyzy_TR0cQI4EbHjkYJqfQA_0 2024-09-12T01:10:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.758+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11609214165670042451', time=2024-09-12T02:52:22.725370+0000, chain.objs.size()=1 2024-09-12T01:10:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.758+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.lnN-mZ_nW5sA6oOyZkMJ1J2S8her-22_0 2024-09-12T01:10:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.758+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14435689736135649767', time=2024-09-12T02:52:22.757600+0000, chain.objs.size()=1 2024-09-12T01:10:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.758+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.d2lZ9j2MCHzKwzpEoHu2ZVP6iSpUhPq_0 2024-09-12T01:10:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.758+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9355097869947124815', time=2024-09-12T02:52:22.890704+0000, chain.objs.size()=1 2024-09-12T01:10:59.758 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.758+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.s5g0po96r7F7J7UPH84QwqfCRj7sF_v_0 2024-09-12T01:10:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.758+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11889861664705318992', time=2024-09-12T02:52:23.020629+0000, chain.objs.size()=1 2024-09-12T01:10:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.758+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.eyYQPyx_TBSLbh_VrHIseo3FAdZEMb9_0 2024-09-12T01:10:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.760+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14862632729252398307', time=2024-09-12T02:52:23.187461+0000, chain.objs.size()=1 2024-09-12T01:10:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.760+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.w6FhJR9-8zmrIWpfHXQmUbND4iQqcJ9_0 2024-09-12T01:10:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.760+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12441990834486884574', time=2024-09-12T02:52:23.193639+0000, chain.objs.size()=1 2024-09-12T01:10:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.760+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.MXwg9uFFLpTfq-W7cNQwLYJ2jiQ9ISl_0 2024-09-12T01:10:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.760+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10052215303039293688', time=2024-09-12T02:52:23.563339+0000, chain.objs.size()=1 2024-09-12T01:10:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.760+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.qW6e78pYmKPhHO1LV6hbCfI0sWX6y38_0 2024-09-12T01:10:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.761+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1724307837626142882', time=2024-09-12T02:52:23.629848+0000, chain.objs.size()=1 2024-09-12T01:10:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.761+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4v--zb7dS_byJqly8r1IOtLZ-WjRQOZ_0 2024-09-12T01:10:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.761+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14256880054393574026', time=2024-09-12T02:52:24.854033+0000, chain.objs.size()=1 2024-09-12T01:10:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.761+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.SkNZ1eI5kf5akQVdOsL1NPyfRJt7SWq_0 2024-09-12T01:10:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.761+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13935716424524202753', time=2024-09-12T02:52:24.945795+0000, chain.objs.size()=1 2024-09-12T01:10:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.761+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ByWBh8DEMBfFkAXEtPEN9DnXjkvMxeT_0 2024-09-12T01:10:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.761+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9865050553886754708', time=2024-09-12T02:52:25.161073+0000, chain.objs.size()=1 2024-09-12T01:10:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.761+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.lloH0Z30EH5I0NGoFcq0ruAf2HbFs_t_0 2024-09-12T01:10:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.761+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3148452085091501284', time=2024-09-12T02:52:25.688923+0000, chain.objs.size()=1 2024-09-12T01:10:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.761+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.UZstBEC74WGJ4-2HSTOITxr2s3fHQn-_0 2024-09-12T01:10:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.762+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14957006507138159134', time=2024-09-12T02:52:25.749938+0000, chain.objs.size()=1 2024-09-12T01:10:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.762+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uHK0u9L-g1MzsTQ2NKA4uiBwbJ9PK7I_0 2024-09-12T01:10:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.762+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10573059379127057801', time=2024-09-12T02:52:26.511202+0000, chain.objs.size()=1 2024-09-12T01:10:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.762+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.bS12bFjJ60UnC34tszTELNsywzM4NVj_0 2024-09-12T01:10:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.762+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10166866409421156888', time=2024-09-12T02:52:27.099315+0000, chain.objs.size()=1 2024-09-12T01:10:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.762+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5CQKA2TE3ESpBl0j6wHPQzh-gnKMBNg_0 2024-09-12T01:10:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.763+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14412693068618270847', time=2024-09-12T02:52:27.574027+0000, chain.objs.size()=1 2024-09-12T01:10:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.763+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5aI-7Fu6KNyBgz2IBjX8qHObKBWkpAH_0 2024-09-12T01:10:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.763+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4254743740361146821', time=2024-09-12T02:52:28.427549+0000, chain.objs.size()=1 2024-09-12T01:10:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.763+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Yln2sJ4kOfl6qwfEige5UD9vCiKNpLs_0 2024-09-12T01:10:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.763+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16291596543264712621', time=2024-09-12T02:52:28.453297+0000, chain.objs.size()=1 2024-09-12T01:10:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.763+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.WIMM1pIM-S1JZtWuhOBWVG-Em4qf8o1_0 2024-09-12T01:10:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.764+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14942113157700605104', time=2024-09-12T02:52:28.585439+0000, chain.objs.size()=1 2024-09-12T01:10:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.764+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.zbPJPtI2V_cgeTdCNYE1LRR8QdGbo3G_0 2024-09-12T01:10:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.764+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6327505783202578216', time=2024-09-12T02:52:28.905393+0000, chain.objs.size()=1 2024-09-12T01:10:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.764+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.TmoAVyj5TAJuh14-7Y3wa4TVUaA8Par_0 2024-09-12T01:10:59.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.765+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11970149497488892429', time=2024-09-12T02:52:28.905895+0000, chain.objs.size()=1 2024-09-12T01:10:59.764 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.765+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.223VVdMuxmv3wk9KXJDnmae4V8G-ijN_0 2024-09-12T01:10:59.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.766+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4374169496170474179', time=2024-09-12T02:52:31.118020+0000, chain.objs.size()=1 2024-09-12T01:10:59.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.766+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.d_hJ48aJLXAIB1-buLzHFnr7B2kP-P8_0 2024-09-12T01:10:59.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.766+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9840737788569153449', time=2024-09-12T02:52:31.428497+0000, chain.objs.size()=1 2024-09-12T01:10:59.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.766+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.jaohtKy1rqz3RW-n64pYfrBUQTKl0JA_0 2024-09-12T01:10:59.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.766+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17139267622384332556', time=2024-09-12T02:52:31.608128+0000, chain.objs.size()=1 2024-09-12T01:10:59.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.766+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.tsHIiaQAyfzstjLrpmZgEZM9pbeTXPQ_0 2024-09-12T01:10:59.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.766+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9823070575073804396', time=2024-09-12T02:52:31.856810+0000, chain.objs.size()=1 2024-09-12T01:10:59.765 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.766+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.oNWBEXYv6nF7uAN9djAFWUfkTfrN67R_0 2024-09-12T01:10:59.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.766+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13416696955016427301', time=2024-09-12T02:52:41.779099+0000, chain.objs.size()=1 2024-09-12T01:10:59.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.766+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.280__shadow_.N_QnAnAoHpQfEGTcWKcZS2vD_1eSUfp_0 2024-09-12T01:10:59.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.766+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3897492875069727421', time=2024-09-12T02:52:42.393047+0000, chain.objs.size()=1 2024-09-12T01:10:59.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.766+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.281__shadow_.OmZ9FR4zpnBZeg8iwWhVIso50lnq0-n_0 2024-09-12T01:10:59.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.767+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10506137559098773516', time=2024-09-12T02:52:45.483272+0000, chain.objs.size()=1 2024-09-12T01:10:59.766 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.767+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.286__shadow_.FdWV05l_6PthxeeFbQHVe7pL7Nn9YZg_0 2024-09-12T01:10:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.769+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4747313812597996005', time=2024-09-12T02:52:51.130120+0000, chain.objs.size()=1 2024-09-12T01:10:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.769+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.zNolwM45BTw7eTPXrVz6HHUQlMXk11L_0 2024-09-12T01:10:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.769+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14489935135869159960', time=2024-09-12T02:52:53.240790+0000, chain.objs.size()=1 2024-09-12T01:10:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.769+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.N3GzrZ6JJTl9AAbvirKTG_dl2-wUd7r_0 2024-09-12T01:10:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.769+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15249474020467523379', time=2024-09-12T02:52:56.386080+0000, chain.objs.size()=1 2024-09-12T01:10:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.769+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.299__shadow_.kYvLNb0OzQtFgKx1r-VcSUO7rV6We1u_0 2024-09-12T01:10:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.769+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15287374171477110842', time=2024-09-12T02:53:10.072851+0000, chain.objs.size()=1 2024-09-12T01:10:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.769+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.320__shadow:qY5KClnLXEFkiTY49kySbQgh2Mas3Lw_.vMc-ZD1dtoUwUFRVZsmBXHOzGdtqd4m_0 2024-09-12T01:10:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.769+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.605152291714660906', time=2024-09-12T02:53:10.084588+0000, chain.objs.size()=1 2024-09-12T01:10:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.769+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.320__shadow:OYCVMznFTSm5HHAmUFKqkrNZmFM9Hcs_.mxTWxMORtK2-TflCJRZ8p0Xqs9kIM35_0 2024-09-12T01:10:59.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.771+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15433289746958408093', time=2024-09-12T02:53:11.272378+0000, chain.objs.size()=1 2024-09-12T01:10:59.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.771+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.322__shadow_.AdSkHhpG3KUPIooGlEQwpUCwpE7lAts_0 2024-09-12T01:10:59.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.771+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7895178741000590329', time=2024-09-12T02:53:49.558407+0000, chain.objs.size()=1 2024-09-12T01:10:59.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.771+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Bmu5-O8cCXFBOAGJsIBx4FJazkB5AYs_0 2024-09-12T01:10:59.770 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.771+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9003539815754382881', time=2024-09-12T02:53:50.162409+0000, chain.objs.size()=1 2024-09-12T01:10:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.771+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qyPHX9X67nWNRf-HJ5dcmpuef04AwyT_0 2024-09-12T01:10:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.771+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8614232128858854673', time=2024-09-12T02:53:50.380114+0000, chain.objs.size()=1 2024-09-12T01:10:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.771+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.DN2mwdLXV24yo4GOsr8dMQbpJuxwGQm_0 2024-09-12T01:10:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.771+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17020166626626027835', time=2024-09-12T02:53:51.118985+0000, chain.objs.size()=1 2024-09-12T01:10:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.771+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.TKpjkUAd9iycdZAAkrzwkzCnB8AD8rD_0 2024-09-12T01:10:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.771+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18264728888908848141', time=2024-09-12T02:53:51.463502+0000, chain.objs.size()=1 2024-09-12T01:10:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.771+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.p-K3tVc6aba-aVZ3L53w0g_XwT_5MjD_0 2024-09-12T01:10:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.771+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5702941575609434819', time=2024-09-12T02:53:51.624334+0000, chain.objs.size()=1 2024-09-12T01:10:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.771+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dmtY5oH7ceaJOzV4ZdrtBus9d_OUOI__0 2024-09-12T01:10:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.772+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16757743391966139894', time=2024-09-12T02:53:51.883535+0000, chain.objs.size()=1 2024-09-12T01:10:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.772+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tPggTl-2zqh6uRiR9a30gb-Q9fNfpzY_0 2024-09-12T01:10:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.772+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16720996145902316782', time=2024-09-12T02:53:51.897844+0000, chain.objs.size()=1 2024-09-12T01:10:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.772+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bzVFF9GyQTW76M0lFeAG7UJRVKv61DN_0 2024-09-12T01:10:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.772+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16800174790406847589', time=2024-09-12T02:53:52.700904+0000, chain.objs.size()=1 2024-09-12T01:10:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.772+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0Ow4vXt2fcJZ2G9gmj19kYMTv9FUc7S_0 2024-09-12T01:10:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.772+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1501922180504335023', time=2024-09-12T02:53:52.760765+0000, chain.objs.size()=1 2024-09-12T01:10:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.772+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.BQ14qn8qyOarViokpvNM4_C7dJJjANG_0 2024-09-12T01:10:59.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8edb6a640 0 -- 172.21.15.133:0/840329185 >> [v2:172.21.15.133:6800/3885452980,v1:172.21.15.133:6801/3885452980] conn(0x7ff7c00923b0 msgr2=0x7ff7c008e810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:10:59.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17221942601639108876', time=2024-09-12T02:53:52.920445+0000, chain.objs.size()=1 2024-09-12T01:10:59.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bgEdpbt-XQp2V1kDA8OBMf0gGfBSzbr_0 2024-09-12T01:10:59.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12608446326229675226', time=2024-09-12T02:53:53.291903+0000, chain.objs.size()=1 2024-09-12T01:10:59.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cxyVudIQzMQDXxOuCFH9S5A2yA9OrbB_0 2024-09-12T01:10:59.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11236323335901025452', time=2024-09-12T02:53:53.732840+0000, chain.objs.size()=1 2024-09-12T01:10:59.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dD3BM4bDREcoFIrBIHiOgbWr-vlPv2K_0 2024-09-12T01:10:59.775 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5759710273342851289', time=2024-09-12T02:53:54.268152+0000, chain.objs.size()=1 2024-09-12T01:10:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.7R7v5bdKz3ZsFfyQgtl-PyE4vW4-Ob5_0 2024-09-12T01:10:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6526013569618539558', time=2024-09-12T02:53:55.109189+0000, chain.objs.size()=1 2024-09-12T01:10:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Fq1l38RUIFMjO7TqskozoEQmB1abk6V_0 2024-09-12T01:10:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.439936060205850641', time=2024-09-12T02:53:55.407518+0000, chain.objs.size()=1 2024-09-12T01:10:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.JVbWp0S9rDLtwWeyos89e3b129ts-1z_0 2024-09-12T01:10:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12091044420635731060', time=2024-09-12T02:53:56.626965+0000, chain.objs.size()=1 2024-09-12T01:10:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.rYhNYi0NeNso8s5vUQz6sDOyc_2BGIO_0 2024-09-12T01:10:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2825774877575267504', time=2024-09-12T02:53:56.792109+0000, chain.objs.size()=1 2024-09-12T01:10:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.c7wxJb8WcyBunUUpDqCRc8gybnVckEO_0 2024-09-12T01:10:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9106977763552720706', time=2024-09-12T02:53:56.950842+0000, chain.objs.size()=1 2024-09-12T01:10:59.776 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.776+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.wqkvE4ZoUhh1jCDDb6eOFd6KRkABtRH_0 2024-09-12T01:10:59.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.777+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8935732420226742303', time=2024-09-12T02:53:57.731971+0000, chain.objs.size()=1 2024-09-12T01:10:59.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.777+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nG-7vVqnGdNStA_6Xt6GHby-8iXbw6e_0 2024-09-12T01:10:59.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.777+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11440807678355568663', time=2024-09-12T02:53:57.884401+0000, chain.objs.size()=1 2024-09-12T01:10:59.777 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.777+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.16CDdDMZ71ZG_1jmfuxnty2dp01tXyH_0 2024-09-12T01:10:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15021583050511589483', time=2024-09-12T02:53:58.331743+0000, chain.objs.size()=1 2024-09-12T01:10:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.sOzY0cBavBXGym4EFLBjBsi7KvLmEtP_0 2024-09-12T01:10:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3491878708275937686', time=2024-09-12T02:53:58.332472+0000, chain.objs.size()=1 2024-09-12T01:10:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.__5nNPFku4xHlcIV5yKoXZdIp5H_LMT_0 2024-09-12T01:10:59.779 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3002760863277546655', time=2024-09-12T02:53:58.333122+0000, chain.objs.size()=1 2024-09-12T01:10:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.VMYYHkAsfP10oyQCnrz5lDzs8wNDkff_0 2024-09-12T01:10:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7443584231549766598', time=2024-09-12T02:53:58.692099+0000, chain.objs.size()=1 2024-09-12T01:10:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.X96cGsCiL1dHlPjsZu19KlzdEsFdrOT_0 2024-09-12T01:10:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16243341237412640009', time=2024-09-12T02:53:58.692743+0000, chain.objs.size()=1 2024-09-12T01:10:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_._w5xmflQMEmGK1KbuZv6R1b0_gGahSk_0 2024-09-12T01:10:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5138736254859751317', time=2024-09-12T02:53:59.095799+0000, chain.objs.size()=1 2024-09-12T01:10:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.WJAq541aSushYkJratdTOCUDKCd5PVt_0 2024-09-12T01:10:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4459312312078457598', time=2024-09-12T02:53:59.208523+0000, chain.objs.size()=1 2024-09-12T01:10:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.AoaA7-XAJR8-mdZSTZ52Fe685gyIx8j_0 2024-09-12T01:10:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15349104082739879457', time=2024-09-12T02:53:59.269078+0000, chain.objs.size()=1 2024-09-12T01:10:59.780 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.780+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.XGmjFkpEApEVWRqs63MX1On4Xpm8WDw_0 2024-09-12T01:10:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.781+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9058588981957492332', time=2024-09-12T02:53:59.721959+0000, chain.objs.size()=1 2024-09-12T01:10:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.781+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.w1X6fW2EnSXytFHfyyIT2V7-7XmBHIn_0 2024-09-12T01:10:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.781+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2406008201755249191', time=2024-09-12T02:54:36.681086+0000, chain.objs.size()=1 2024-09-12T01:10:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.781+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.RUZ9XCuls9FZwqqkpH-Q8uFbDZBXLby_0 2024-09-12T01:10:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.781+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14004783082105059766', time=2024-09-12T02:54:36.785508+0000, chain.objs.size()=1 2024-09-12T01:10:59.781 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.781+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.MelJzfF7xZLBNhh6OzomsRC8gEo4INn_0 2024-09-12T01:10:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.125089418884389868', time=2024-09-12T02:54:36.991372+0000, chain.objs.size()=1 2024-09-12T01:10:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.D88-o2PT9SgyPxZCVxLK6V6SdJHGICw_0 2024-09-12T01:10:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16523093140711463365', time=2024-09-12T02:54:37.094089+0000, chain.objs.size()=1 2024-09-12T01:10:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.HawXxkkuv2JM53sVBE1ROBVpbGpg2Ql_0 2024-09-12T01:10:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1908068822182963367', time=2024-09-12T02:54:37.095313+0000, chain.objs.size()=1 2024-09-12T01:10:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.UjAiDVj-nihMnyKGnxi_ZTppgYK7dDl_0 2024-09-12T01:10:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13687882328682664155', time=2024-09-12T02:54:37.195002+0000, chain.objs.size()=1 2024-09-12T01:10:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.aAM3P9pAlP0HbLjiA_o3PQt1TgemHc1_0 2024-09-12T01:10:59.783 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10719192015364159286', time=2024-09-12T02:54:37.248310+0000, chain.objs.size()=1 2024-09-12T01:10:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.EcTzq9AdkGWxfOgfpmxmQrflbopiC0W_0 2024-09-12T01:10:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5367642812140000191', time=2024-09-12T02:54:37.365148+0000, chain.objs.size()=1 2024-09-12T01:10:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9K7PQvum-lZqtMwgMYlqKL6eb_gyXi__0 2024-09-12T01:10:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14821236385227612035', time=2024-09-12T02:54:38.675786+0000, chain.objs.size()=1 2024-09-12T01:10:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.awj2PqD7P57wWTKgpcw054XTOdngwur_0 2024-09-12T01:10:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11825496132578933582', time=2024-09-12T02:54:40.321934+0000, chain.objs.size()=1 2024-09-12T01:10:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.5wv7QSUuIw_Tkd_v9AJIGhVkgnkM7DR_0 2024-09-12T01:10:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1029129434233099417', time=2024-09-12T02:54:40.424201+0000, chain.objs.size()=1 2024-09-12T01:10:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.784+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.eYWo34qIy4MVXLg_OI363udha3JRPU3_0 2024-09-12T01:10:59.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.786+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11064214637262861141', time=2024-09-12T02:54:40.847106+0000, chain.objs.size()=1 2024-09-12T01:10:59.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.786+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.GZ21Lv8nLurt_ERcB_KyjC0QIucCjci_0 2024-09-12T01:10:59.785 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.786+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17510723387123048728', time=2024-09-12T02:54:40.943405+0000, chain.objs.size()=1 2024-09-12T01:10:59.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.786+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.-vadzmUoexxeHqL9se6lOh4lovO0E46_0 2024-09-12T01:10:59.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.787+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13047047373451330310', time=2024-09-12T02:54:41.349406+0000, chain.objs.size()=1 2024-09-12T01:10:59.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.787+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.afxZrXafufc-DtI4kzxk_ojli4UeZeJ_0 2024-09-12T01:10:59.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.787+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8291572550173839570', time=2024-09-12T02:54:41.406348+0000, chain.objs.size()=1 2024-09-12T01:10:59.786 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.787+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.oWbXZjVkcsaWPIH2tFU6ZAoqwm0ItFG_0 2024-09-12T01:10:59.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.788+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1410619759914140115', time=2024-09-12T02:54:41.472387+0000, chain.objs.size()=1 2024-09-12T01:10:59.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.788+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.uXW6R94yxtObIt_cLz33PFJrmzQJXrF_0 2024-09-12T01:10:59.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.788+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15903704477930383778', time=2024-09-12T02:54:41.525127+0000, chain.objs.size()=1 2024-09-12T01:10:59.787 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.788+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.i2-u0yEDqetF9PH191nQHLVJZeAGzzg_0 2024-09-12T01:10:59.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.789+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6908259985111622461', time=2024-09-12T02:54:41.609349+0000, chain.objs.size()=1 2024-09-12T01:10:59.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.789+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.1VXoQ0d3Y-rlilDWP3WeNsj0GiNwt7D_0 2024-09-12T01:10:59.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.789+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9110447516542358985', time=2024-09-12T02:54:41.783407+0000, chain.objs.size()=1 2024-09-12T01:10:59.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.789+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.iWBFkr1YtLZ9oC9GvSZSREE9btrnJs4_0 2024-09-12T01:10:59.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.789+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17728825506696005805', time=2024-09-12T02:54:41.784882+0000, chain.objs.size()=1 2024-09-12T01:10:59.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.789+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.kk0Ak3oiGkFjexuANd44Le3FqLvKpCz_0 2024-09-12T01:10:59.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.789+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3828706618770535877', time=2024-09-12T02:54:42.311865+0000, chain.objs.size()=1 2024-09-12T01:10:59.788 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.789+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.P_r4NQ-Y3aeISGEytHCMQdDjEnle6es_0 2024-09-12T01:10:59.789 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.790+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13307486068582476061', time=2024-09-12T02:54:42.338899+0000, chain.objs.size()=1 2024-09-12T01:10:59.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.790+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Ueib9HwNUY1mCkcTBwpmICYan319Qku_0 2024-09-12T01:10:59.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.790+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8677177387938059520', time=2024-09-12T02:54:42.559575+0000, chain.objs.size()=1 2024-09-12T01:10:59.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.790+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ofN886n_eeWdQ3k8G1pGkrsaljqFKvU_0 2024-09-12T01:10:59.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.791+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12275326835482577181', time=2024-09-12T02:54:42.623119+0000, chain.objs.size()=1 2024-09-12T01:10:59.790 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.791+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Kb2UjWERKlr6gNflbMx02xqmuxXxfzn_0 2024-09-12T01:10:59.793 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.794+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/46776 2024-09-12T01:10:59.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T01:10:59.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18153555528513309286', time=2024-09-12T02:54:43.826977+0000, chain.objs.size()=1 2024-09-12T01:10:59.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.skyObk3X3hpyLrux7quYnENCxfP8VsG_0 2024-09-12T01:10:59.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4465083412453683245', time=2024-09-12T02:54:44.420249+0000, chain.objs.size()=1 2024-09-12T01:10:59.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.edhRR3gAdZDtozKEIMkoMaQhf0xnJCH_0 2024-09-12T01:10:59.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11188620087990439162', time=2024-09-12T02:54:44.464906+0000, chain.objs.size()=1 2024-09-12T01:10:59.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.kiqPhvX3Qly9PlOFy1SSGotm4RhL84d_0 2024-09-12T01:10:59.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2677436131302668295', time=2024-09-12T02:54:44.526720+0000, chain.objs.size()=1 2024-09-12T01:10:59.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.O1UDnbpR2kaRimR5jxPJuLlusw3W1we_0 2024-09-12T01:10:59.796 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16891670138142739111', time=2024-09-12T02:54:44.679508+0000, chain.objs.size()=1 2024-09-12T01:10:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.arKdMk0r6lgBCwvehlMQlRXtZjOIvAl_0 2024-09-12T01:10:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17186635712046702783', time=2024-09-12T02:54:45.108974+0000, chain.objs.size()=1 2024-09-12T01:10:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fUA9u9S7lhWiCctkQ4UO2ZilzKM1rda_0 2024-09-12T01:10:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10437502368718965063', time=2024-09-12T02:54:45.143221+0000, chain.objs.size()=1 2024-09-12T01:10:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dYnsLyuMPJSpnxXajmGFH1v5ABo34p9_0 2024-09-12T01:10:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4975932022844886504', time=2024-09-12T02:54:45.548028+0000, chain.objs.size()=1 2024-09-12T01:10:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fhiS3H-Qwe8pFvOeGl0t9Kr2Jjq4PRf_0 2024-09-12T01:10:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13131267298892086108', time=2024-09-12T02:54:46.308148+0000, chain.objs.size()=1 2024-09-12T01:10:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.hbTMczf4ZMdKk1gnm7CFo-p1M0nBQPD_0 2024-09-12T01:10:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6841900851004566395', time=2024-09-12T02:54:46.424632+0000, chain.objs.size()=1 2024-09-12T01:10:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.t_Rz3XiMJWHmi6EjfcAEU2JsGoXwT6w_0 2024-09-12T01:10:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11130352658280758162', time=2024-09-12T02:54:46.680992+0000, chain.objs.size()=1 2024-09-12T01:10:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fc1qzZ4MCZQDV2509u0WnTpsG0FMlou_0 2024-09-12T01:10:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16504828335822506225', time=2024-09-12T02:54:47.073794+0000, chain.objs.size()=1 2024-09-12T01:10:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.796+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.bX09z6lvw3v21P3JCGIEBwhLDdy5Pny_0 2024-09-12T01:10:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.799+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14745902017791739513', time=2024-09-12T02:55:09.949625+0000, chain.objs.size()=1 2024-09-12T01:10:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.799+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.373__shadow_.y6S3VpXoek2zw8tnieVd6ZmrfaQIPFC_0 2024-09-12T01:10:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.799+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8644027686173331358', time=2024-09-12T02:55:58.859719+0000, chain.objs.size()=1 2024-09-12T01:10:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.799+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.457__shadow_.jiH-hQePbdBZsVpsbqbBC8iYCCuelfW_0 2024-09-12T01:10:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.799+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10760198420551673918', time=2024-09-12T02:56:14.335315+0000, chain.objs.size()=1 2024-09-12T01:10:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.799+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.484__shadow_.DsOSuInmvRKEVDmB5PrWE88qefPSlGy_0 2024-09-12T01:10:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.799+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3268641659567001194', time=2024-09-12T02:57:12.072958+0000, chain.objs.size()=6 2024-09-12T01:10:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.799+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.522__multipart_mymultipart.2~DdLnbVh1y2aNONSa_17c6SR3arFIoc5.1 2024-09-12T01:10:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.799+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.522__shadow_mymultipart.2~DdLnbVh1y2aNONSa_17c6SR3arFIoc5.1_1 2024-09-12T01:10:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.799+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.522__multipart_mymultipart.2~DdLnbVh1y2aNONSa_17c6SR3arFIoc5.2 2024-09-12T01:10:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.801+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.522__shadow_mymultipart.2~DdLnbVh1y2aNONSa_17c6SR3arFIoc5.2_1 2024-09-12T01:10:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.801+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.522__multipart_mymultipart.2~DdLnbVh1y2aNONSa_17c6SR3arFIoc5.3 2024-09-12T01:10:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.801+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.522__shadow_mymultipart.2~DdLnbVh1y2aNONSa_17c6SR3arFIoc5.3_1 2024-09-12T01:10:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.801+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5444226681239513457', time=2024-09-12T02:57:15.385538+0000, chain.objs.size()=1 2024-09-12T01:10:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.801+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.521__shadow:IJGsTqUAMwnpGOl4BovxpTeIm76R3q5_.hA8muSy33uizJzbbb-YIPN_2m-B7t-F_0 2024-09-12T01:10:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.801+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5109508039247484955', time=2024-09-12T03:00:05.444572+0000, chain.objs.size()=1 2024-09-12T01:10:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.801+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.573__shadow_.GF-f8sWmLorb8DfC8o3NOzmvf8tqQTN_0 2024-09-12T01:10:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.803+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3113684306160350376', time=2024-09-12T03:01:00.537278+0000, chain.objs.size()=1 2024-09-12T01:10:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.803+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.588__shadow:NZFgIcAsMT1oEX2iAvcK-XXD9KPn08d_.7CiKm9nzeoecczptSQDIthkfVHxowB5_0 2024-09-12T01:10:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.803+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16465083234961122025', time=2024-09-12T03:04:56.328164+0000, chain.objs.size()=1 2024-09-12T01:10:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.803+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.638__shadow_.sKGUp3jAsBI2VzQBvmr38r8Y7qukfzG_0 2024-09-12T01:10:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.803+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2341554360115218709', time=2024-09-12T03:05:37.498715+0000, chain.objs.size()=1 2024-09-12T01:10:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.803+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.669__shadow_.BmfgrIXSeuDFAwMEorijv0a__l2jxiP_0 2024-09-12T01:10:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.803+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.634899283306392996', time=2024-09-12T03:05:54.447164+0000, chain.objs.size()=1 2024-09-12T01:10:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.803+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.702__shadow:Wm.LOUgwO1igCAwDzpBPDa7lRyGhZkl_.d2LkS4USopXBKTFNjttCtnZpvVCUfhz_0 2024-09-12T01:10:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.803+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10824678481024735077', time=2024-09-12T03:06:02.364503+0000, chain.objs.size()=1 2024-09-12T01:10:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.803+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.715__shadow:YxIWzVbxxiXcLahUdLG2wDVRT1mCRyq_.bgsZKVamR_X4wG5USEMrzYOM1TbVaoT_0 2024-09-12T01:10:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.804+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9599708088715890915', time=2024-09-12T03:06:13.385131+0000, chain.objs.size()=1 2024-09-12T01:10:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.804+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.717__shadow:9nJtkg47Dm7AmG-APg5S5whVNQWE5XL_.YM_0b4Bv7a1lXkgITna5W2rc-F26RPV_0 2024-09-12T01:10:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.805+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17682232187952118430', time=2024-09-12T03:06:24.356761+0000, chain.objs.size()=1 2024-09-12T01:10:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.805+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.720__shadow_.M5rLtcFb_y88v4fg8usc6bDC3aEXNvg_0 2024-09-12T01:10:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.809+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.811+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:10:59.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.812+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.811 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.812+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49371' 2024-09-12T01:10:59.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15350840822191349977', time=2024-09-12T02:49:09.659043+0000, chain.objs.size()=1 2024-09-12T01:10:59.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.158__shadow:R4VDW91o.vwCjx6PgYriCw3TsFtLcqK_.Tqbbo_0_5-KfqSL7fb9D6Kxtc-QNJ0X_0 2024-09-12T01:10:59.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='_jVsAOQhqKkaJh9jXL8V_nu5d-EM4n0b', time=2024-09-12T02:49:21.545087+0000, chain.objs.size()=3 2024-09-12T01:10:59.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.NhK4s0ZuXvIlCpG2mKhdipjZhvvTOiF_0 2024-09-12T01:10:59.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.NhK4s0ZuXvIlCpG2mKhdipjZhvvTOiF_1 2024-09-12T01:10:59.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.NhK4s0ZuXvIlCpG2mKhdipjZhvvTOiF_2 2024-09-12T01:10:59.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='__H_RC8Im9APh7U26lF03dIFN5SRkNlb', time=2024-09-12T02:49:32.637388+0000, chain.objs.size()=1 2024-09-12T01:10:59.813 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.166__shadow_.F3aHLPEAfUjdauVz_kyuRUBdfPlUqAI_0 2024-09-12T01:10:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6229668035545899039', time=2024-09-12T02:51:28.512153+0000, chain.objs.size()=1 2024-09-12T01:10:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.236__shadow_.ov2y6nta9Mh1PNxwM81sEzkvJdSd6t-_0 2024-09-12T01:10:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10159059689071413993', time=2024-09-12T02:51:32.979072+0000, chain.objs.size()=1 2024-09-12T01:10:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.243__shadow_.7a30NVvBO6YYVLtSepKKwtn8dCxejQB_0 2024-09-12T01:10:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16961651345299064293', time=2024-09-12T02:52:21.559940+0000, chain.objs.size()=1 2024-09-12T01:10:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.8JY9Otx79SO6hO1v6ISY6bQDVPe_aWt_0 2024-09-12T01:10:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12858425725631368046', time=2024-09-12T02:52:21.646040+0000, chain.objs.size()=1 2024-09-12T01:10:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.tlALFb2h7lhKloycveZz-yE718V0LM2_0 2024-09-12T01:10:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3521305144622550919', time=2024-09-12T02:52:21.646809+0000, chain.objs.size()=1 2024-09-12T01:10:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.R4MjrARaggMoSVIlMMZC_nZEqZvgPVp_0 2024-09-12T01:10:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.589306762051183982', time=2024-09-12T02:52:22.016677+0000, chain.objs.size()=1 2024-09-12T01:10:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.aNhYpYDo0rO98-KTxofbI_1gDDfjy8o_0 2024-09-12T01:10:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3706264756557297384', time=2024-09-12T02:52:22.169833+0000, chain.objs.size()=1 2024-09-12T01:10:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.813+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.MwINw-oQn_qbsd4atNWvkPyxgbsomLX_0 2024-09-12T01:10:59.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.816+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5613560579509668431', time=2024-09-12T02:52:22.766771+0000, chain.objs.size()=1 2024-09-12T01:10:59.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.816+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Kyzr8V3F04043m-aOIPE6D8bnIsXR7n_0 2024-09-12T01:10:59.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.816+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12173305321000609955', time=2024-09-12T02:52:23.314955+0000, chain.objs.size()=1 2024-09-12T01:10:59.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.816+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.JGvr-hVN49BTHF3YgyyFXCAUsZdwhis_0 2024-09-12T01:10:59.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.816+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17568237151548698960', time=2024-09-12T02:52:24.180927+0000, chain.objs.size()=1 2024-09-12T01:10:59.815 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.816+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.FmkkrHAFg8YRukhfrCN3HDXt5YxlRKV_0 2024-09-12T01:10:59.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.816+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6432147078584820909', time=2024-09-12T02:52:24.181712+0000, chain.objs.size()=1 2024-09-12T01:10:59.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.816+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.qOKhkqc2nF1kZdEJ8yKVZvyKcLE5Hpa_0 2024-09-12T01:10:59.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.816+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10749762644247182243', time=2024-09-12T02:52:24.344450+0000, chain.objs.size()=1 2024-09-12T01:10:59.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.816+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.bAiUOwKCpwv6hwyrE0Yp2AH0Mv5myLC_0 2024-09-12T01:10:59.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.816+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5810774423887614647', time=2024-09-12T02:52:24.673505+0000, chain.objs.size()=1 2024-09-12T01:10:59.816 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.816+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.QQttKxfyJAYGn1zqszK-FA9fbS5PiIm_0 2024-09-12T01:10:59.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.818+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6015967007696589964', time=2024-09-12T02:52:24.803015+0000, chain.objs.size()=1 2024-09-12T01:10:59.817 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.818+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.8rfuzR9IxH0TGMMEJ7dZyIo0LPVXNcj_0 2024-09-12T01:10:59.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.818+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8014179061937658410', time=2024-09-12T02:52:24.942486+0000, chain.objs.size()=1 2024-09-12T01:10:59.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.818+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.VMvHwGWjlTnYMOH9JJHAXeeLgyEr-nl_0 2024-09-12T01:10:59.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.818+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8560547381363643708', time=2024-09-12T02:52:25.169205+0000, chain.objs.size()=1 2024-09-12T01:10:59.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.818+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.R3r2asH9Ixop-Bq4mgB0hZ-VIjBAPLM_0 2024-09-12T01:10:59.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.818+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3092480601803785163', time=2024-09-12T02:52:25.604286+0000, chain.objs.size()=1 2024-09-12T01:10:59.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.818+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.GCcS8sTWr3GXc1cf8cH2lN6nSbVlKXL_0 2024-09-12T01:10:59.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.818+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9259350454134020773', time=2024-09-12T02:52:25.748802+0000, chain.objs.size()=1 2024-09-12T01:10:59.818 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.818+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.y3ClIT6LmF9aK7Vrs0rPG08_w0M-JAn_0 2024-09-12T01:10:59.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.821+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14973054082234272916', time=2024-09-12T02:52:26.345936+0000, chain.objs.size()=1 2024-09-12T01:10:59.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.821+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.idy99_Oh2KMWvUD3X0-SL33UifItjb__0 2024-09-12T01:10:59.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.821+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5006320054059391777', time=2024-09-12T02:52:26.403049+0000, chain.objs.size()=1 2024-09-12T01:10:59.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.821+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Tf4UWu7XqrPbariOsT6DN0aOxZqgKlp_0 2024-09-12T01:10:59.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.821+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5473737492878908254', time=2024-09-12T02:52:26.429663+0000, chain.objs.size()=1 2024-09-12T01:10:59.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.821+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.jzPXln3nN-KVeFYWcSPIR_M5jLcdzUV_0 2024-09-12T01:10:59.820 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.821+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13790459934111968437', time=2024-09-12T02:52:27.370075+0000, chain.objs.size()=1 2024-09-12T01:10:59.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.821+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.i8tYUO3JjgZgrhoF8bFDWkziI-pjZFy_0 2024-09-12T01:10:59.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.821+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6384045361965163663', time=2024-09-12T02:52:27.637017+0000, chain.objs.size()=1 2024-09-12T01:10:59.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.821+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.NkebBXAuc9LvnfjvZsIP7p4OYgx4OVH_0 2024-09-12T01:10:59.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.821+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5860178240899524772', time=2024-09-12T02:52:27.869117+0000, chain.objs.size()=1 2024-09-12T01:10:59.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.821+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.yZ-1nnS1RkU6DZku3TsUJfcqGeMcrhD_0 2024-09-12T01:10:59.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.822+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2111294690716973200', time=2024-09-12T02:52:27.935643+0000, chain.objs.size()=1 2024-09-12T01:10:59.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.822+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.cU8hPZ8FgpjazFi5uJiAQrDyGuTnoGX_0 2024-09-12T01:10:59.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.822+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1122058796871587055', time=2024-09-12T02:52:29.179712+0000, chain.objs.size()=1 2024-09-12T01:10:59.821 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.822+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ihOaOOopNz3rMjY2Y7juLMOqyPcR5G8_0 2024-09-12T01:10:59.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.822+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3663211158515307481', time=2024-09-12T02:52:29.880546+0000, chain.objs.size()=1 2024-09-12T01:10:59.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.822+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.So2_iA_8ArXCN-Q1jeUcZYTV8-1_4op_0 2024-09-12T01:10:59.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.822+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8514604948532089715', time=2024-09-12T02:52:30.194417+0000, chain.objs.size()=1 2024-09-12T01:10:59.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.822+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.9N0yR80JiLEKAWySiLHgyootnBNy-Oy_0 2024-09-12T01:10:59.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.823+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7562126967385276733', time=2024-09-12T02:52:31.429016+0000, chain.objs.size()=1 2024-09-12T01:10:59.822 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.823+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.P7f6KtHiwDQeGwc5T-xdIcdcX6Za6EJ_0 2024-09-12T01:10:59.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.825+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12656933635145704046', time=2024-09-12T02:52:31.740668+0000, chain.objs.size()=1 2024-09-12T01:10:59.824 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.825+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.dAkmP0X9V7H5eYnq25uEluxhulDBYN__0 2024-09-12T01:10:59.825 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7941712116564333115', time=2024-09-12T02:52:31.963313+0000, chain.objs.size()=1 2024-09-12T01:10:59.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._E6ZH7ywgujTNyztMivcC5RvoAH4L5D_0 2024-09-12T01:10:59.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.172171652613944006', time=2024-09-12T02:52:33.102452+0000, chain.objs.size()=1 2024-09-12T01:10:59.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.265__shadow_.m0xkrDNAh4kal5ythobygWzaEMAuQFh_0 2024-09-12T01:10:59.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6690970756737689439', time=2024-09-12T02:52:34.225696+0000, chain.objs.size()=1 2024-09-12T01:10:59.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.267__shadow_.kIPl1qJAI5-dZ6AYgypwLnacA0o4rXG_0 2024-09-12T01:10:59.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4360648474684987034', time=2024-09-12T02:52:39.373237+0000, chain.objs.size()=1 2024-09-12T01:10:59.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.276__shadow_.xzkVVxhHPoegyrmBot70hs0OVDlxeRK_0 2024-09-12T01:10:59.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12411546162947931426', time=2024-09-12T02:52:39.980791+0000, chain.objs.size()=1 2024-09-12T01:10:59.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.277__shadow_.m8R1Ga8RIWrr-_xMYoZwvQHYsSsW3zA_0 2024-09-12T01:10:59.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7336328412348340576', time=2024-09-12T02:52:46.140111+0000, chain.objs.size()=1 2024-09-12T01:10:59.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.287__shadow_.AN9UTLk-0c7pp3CifdRCUiNJLiagmow_0 2024-09-12T01:10:59.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11033443272922477656', time=2024-09-12T02:52:51.111272+0000, chain.objs.size()=1 2024-09-12T01:10:59.826 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.cvkVjnqBojhftavg0P_5r7AIm8ZK_id_0 2024-09-12T01:10:59.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9704125064790815040', time=2024-09-12T02:52:55.077935+0000, chain.objs.size()=1 2024-09-12T01:10:59.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.297__shadow_.Hy2MbhBXOuvtNyPV3wU-JIb4EkHESMn_0 2024-09-12T01:10:59.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.448353959184550948', time=2024-09-12T02:53:51.117332+0000, chain.objs.size()=1 2024-09-12T01:10:59.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Du7LxMI26qbglAxyDkEm2HducSiauat_0 2024-09-12T01:10:59.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.330022226006067134', time=2024-09-12T02:53:51.420703+0000, chain.objs.size()=1 2024-09-12T01:10:59.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.826+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5t3OlOv_-Zgw15tutV0cVPMaU6X5hJ4_0 2024-09-12T01:10:59.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.828+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12787335940086128886', time=2024-09-12T02:53:51.747910+0000, chain.objs.size()=1 2024-09-12T01:10:59.827 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.828+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.KYZvOV_cGMkHFZk-HLTbOfoRtZS2A5c_0 2024-09-12T01:10:59.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9359059035465439890', time=2024-09-12T02:53:51.755270+0000, chain.objs.size()=1 2024-09-12T01:10:59.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.e3deE0UKGncYUpbzAJjWRO1EtCtcXGY_0 2024-09-12T01:10:59.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2173523934490106081', time=2024-09-12T02:53:52.417541+0000, chain.objs.size()=1 2024-09-12T01:10:59.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.WRqwfGZp4nPcEitQXLdRFk6Xx-nWL-C_0 2024-09-12T01:10:59.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17662502246584017104', time=2024-09-12T02:53:52.858668+0000, chain.objs.size()=1 2024-09-12T01:10:59.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.2chYROiJapQJZlbJFJFp4d4aTECnClm_0 2024-09-12T01:10:59.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8397076606010625884', time=2024-09-12T02:53:52.930131+0000, chain.objs.size()=1 2024-09-12T01:10:59.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.I_3NfuWxGgDueE_43UmXWaWmPQQ23ub_0 2024-09-12T01:10:59.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11900268814828772177', time=2024-09-12T02:53:52.961528+0000, chain.objs.size()=1 2024-09-12T01:10:59.829 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.wEN3ROx3uI9N64vYyFJJLkO-QcTHsY__0 2024-09-12T01:10:59.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17202052226954648473', time=2024-09-12T02:53:53.127136+0000, chain.objs.size()=1 2024-09-12T01:10:59.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ikrQGJgd0NQIURYXfMonuu2ij7XokeD_0 2024-09-12T01:10:59.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14511325842417688766', time=2024-09-12T02:53:53.201253+0000, chain.objs.size()=1 2024-09-12T01:10:59.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.njTsy2gD_pfSkgP373eeoKvPdpgUDly_0 2024-09-12T01:10:59.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12997420044592255139', time=2024-09-12T02:53:53.220585+0000, chain.objs.size()=1 2024-09-12T01:10:59.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.rDNtkzy3IQi83HuMotlb363yYaOzFsg_0 2024-09-12T01:10:59.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7866594030341600388', time=2024-09-12T02:53:53.233337+0000, chain.objs.size()=1 2024-09-12T01:10:59.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.HJwJ4Ic78Nbr7rW2MT_RpnT7fqkwY1m_0 2024-09-12T01:10:59.830 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10808872738102167690', time=2024-09-12T02:53:54.595329+0000, chain.objs.size()=1 2024-09-12T01:10:59.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.830+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.FbcZ2IS2CQ8oW4nfj4hLUS8Ia0IS1ER_0 2024-09-12T01:10:59.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.831+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7363792458485867055', time=2024-09-12T02:53:54.627654+0000, chain.objs.size()=1 2024-09-12T01:10:59.831 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.831+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.8A2jlRscJ25kSbHkHxiq0rzrqL64fE2_0 2024-09-12T01:10:59.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.833+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3962031607402664993', time=2024-09-12T02:53:57.215476+0000, chain.objs.size()=1 2024-09-12T01:10:59.832 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.833+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bdTRj7u9KLlR-ph7ilypuiS9i6zTn7-_0 2024-09-12T01:10:59.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.834+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18227343910372966272', time=2024-09-12T02:53:57.272101+0000, chain.objs.size()=1 2024-09-12T01:10:59.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.834+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.LiZWVk0QL_Mc0IFKrryfA_wfEePiMpV_0 2024-09-12T01:10:59.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8537699325172613294', time=2024-09-12T02:53:57.339829+0000, chain.objs.size()=1 2024-09-12T01:10:59.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.x37HHmpDQW2ANHok2krrVZTlEhrsZJH_0 2024-09-12T01:10:59.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15813340089833110594', time=2024-09-12T02:53:57.409256+0000, chain.objs.size()=1 2024-09-12T01:10:59.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lzJZ1i1ARlNlsk0ZYb8aIbCCdGhEsRu_0 2024-09-12T01:10:59.834 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7414978189768777008', time=2024-09-12T02:53:57.711702+0000, chain.objs.size()=1 2024-09-12T01:10:59.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.66Rttv0nkrLzMaMsuLJcbnAGVeFUGj6_0 2024-09-12T01:10:59.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10989015830793101050', time=2024-09-12T02:53:57.823488+0000, chain.objs.size()=1 2024-09-12T01:10:59.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.HafzGCqmQ1ivlMXu3tjEvvRGc8SRH0r_0 2024-09-12T01:10:59.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.426732456467337326', time=2024-09-12T02:53:58.024210+0000, chain.objs.size()=1 2024-09-12T01:10:59.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nrP26Je_ARWk9WK06CDsiWTg7l_DrVZ_0 2024-09-12T01:10:59.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4180557186147464587', time=2024-09-12T02:53:58.218298+0000, chain.objs.size()=1 2024-09-12T01:10:59.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.TBs7aJ70lwizm4Gytwk_tWARctKEfz7_0 2024-09-12T01:10:59.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1562749254659106131', time=2024-09-12T02:53:58.541028+0000, chain.objs.size()=1 2024-09-12T01:10:59.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.UpR5Kr1jRk9zMshpDTLP6HvBEQFD4mB_0 2024-09-12T01:10:59.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12180563754419678802', time=2024-09-12T02:53:58.624608+0000, chain.objs.size()=1 2024-09-12T01:10:59.835 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.835+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Mc_dwfdHU025xkqCGn17Wdw8U4MCYtq_0 2024-09-12T01:10:59.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.836+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4358044188000463156', time=2024-09-12T02:53:58.950242+0000, chain.objs.size()=1 2024-09-12T01:10:59.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.836+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.MtAKCvnU-g1fDUKl2Mt61hP7TEKcvH__0 2024-09-12T01:10:59.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.836+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8253700482027675988', time=2024-09-12T02:53:59.602503+0000, chain.objs.size()=1 2024-09-12T01:10:59.836 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.836+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.znGxfreHX9cO_s9ufl6RDDi37rIi39c_0 2024-09-12T01:10:59.838 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15477908922223246251', time=2024-09-12T02:53:59.639409+0000, chain.objs.size()=1 2024-09-12T01:10:59.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5cEkRK36yoYQhKe91JT5_zXZ2pO88nI_0 2024-09-12T01:10:59.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17068632778367593699', time=2024-09-12T02:53:59.695660+0000, chain.objs.size()=1 2024-09-12T01:10:59.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.7SH4atxbuk3mDcjAGRzvdWfPlq4ZEHc_0 2024-09-12T01:10:59.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9245419197784463879', time=2024-09-12T02:54:36.610161+0000, chain.objs.size()=1 2024-09-12T01:10:59.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9C5r8ecD1Wpl_39nXlm6Ml_DoB7KKR-_0 2024-09-12T01:10:59.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12381052292173583242', time=2024-09-12T02:54:36.923178+0000, chain.objs.size()=1 2024-09-12T01:10:59.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.7o4cogoX7lWjkaLHo0jvDOkmSeDGQsh_0 2024-09-12T01:10:59.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7348649313943103712', time=2024-09-12T02:54:36.985050+0000, chain.objs.size()=1 2024-09-12T01:10:59.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.IATuXyLqT6Wad6JT6znOTap6lIzD83x_0 2024-09-12T01:10:59.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16653019389898934006', time=2024-09-12T02:54:37.111083+0000, chain.objs.size()=1 2024-09-12T01:10:59.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6OI5PzSNvYv10qyKEcO25aHwwq7amio_0 2024-09-12T01:10:59.839 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18051293949250685290', time=2024-09-12T02:54:37.585446+0000, chain.objs.size()=1 2024-09-12T01:10:59.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.V3dh5hvjC_txuvt1TVe1cU-4KH94iCQ_0 2024-09-12T01:10:59.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13707209867120864629', time=2024-09-12T02:54:38.315665+0000, chain.objs.size()=1 2024-09-12T01:10:59.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.oZNf0US0Us357eixd1kgHCEfKiGO_Vl_0 2024-09-12T01:10:59.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3400043638853367476', time=2024-09-12T02:54:38.361700+0000, chain.objs.size()=1 2024-09-12T01:10:59.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.I4zpeENNWfxAUifzR_roCZD2FJ6YqXM_0 2024-09-12T01:10:59.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7684200621318327493', time=2024-09-12T02:54:38.646595+0000, chain.objs.size()=1 2024-09-12T01:10:59.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.5eYAOTaonWP-w_z4dtBpInCU4RHT7Wx_0 2024-09-12T01:10:59.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9343711384454520551', time=2024-09-12T02:54:38.839992+0000, chain.objs.size()=1 2024-09-12T01:10:59.840 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.839+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.SplYqdfmPRGtLPWn-rC2EYcuhJfjHiP_0 2024-09-12T01:10:59.841 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.843+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13897945278161844712', time=2024-09-12T02:54:39.805698+0000, chain.objs.size()=1 2024-09-12T01:10:59.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.843+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.CfsRF1hu_U1lFWFpPjPTUO2-9lFad9d_0 2024-09-12T01:10:59.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.843+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2687649752980281220', time=2024-09-12T02:54:40.063043+0000, chain.objs.size()=1 2024-09-12T01:10:59.842 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.843+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.S6TWbVchRLaYSIyUXXE9eaPhXpdNeXJ_0 2024-09-12T01:10:59.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.844+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5631766059698594640', time=2024-09-12T02:54:40.968608+0000, chain.objs.size()=1 2024-09-12T01:10:59.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.844+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.tZ1ZCrF6Ba8-xFagnrISiAgYqCig7GM_0 2024-09-12T01:10:59.843 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.844+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4145014720050365300', time=2024-09-12T02:54:41.178070+0000, chain.objs.size()=1 2024-09-12T01:10:59.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.844+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ZFcpDQ5esphOKREwWiNuOgi22W5wGGL_0 2024-09-12T01:10:59.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.844+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16978194402437213306', time=2024-09-12T02:54:41.311581+0000, chain.objs.size()=1 2024-09-12T01:10:59.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.844+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6zboqBLZR39MTxWZUk-Bf44YQ4M8auA_0 2024-09-12T01:10:59.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.844+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10651115750632285849', time=2024-09-12T02:54:41.333515+0000, chain.objs.size()=1 2024-09-12T01:10:59.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.844+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.OWwc6ecgyM1_kwn0m_Plttm69-iUt2y_0 2024-09-12T01:10:59.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.844+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7183855796423495579', time=2024-09-12T02:54:41.334219+0000, chain.objs.size()=1 2024-09-12T01:10:59.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.844+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.CXg3QGB3vw4x9ZjVsQngjtcuPYbXRCx_0 2024-09-12T01:10:59.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.844+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9899058852102648124', time=2024-09-12T02:54:41.594227+0000, chain.objs.size()=1 2024-09-12T01:10:59.844 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.844+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.KYRcNj0jBKGPDm7l4UONMIcBEL9N4Xz_0 2024-09-12T01:10:59.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.845+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4386932819366079822', time=2024-09-12T02:54:41.650341+0000, chain.objs.size()=1 2024-09-12T01:10:59.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.845+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.tSOp-5wCdlKujkueP6hSfM7W26Yo3Ak_0 2024-09-12T01:10:59.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.845+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10852585094793151673', time=2024-09-12T02:54:42.849902+0000, chain.objs.size()=1 2024-09-12T01:10:59.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.845+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.BL4zIe0y4na3sIaky8vYpMfIauef0Y1_0 2024-09-12T01:10:59.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.845+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13228055777827345455', time=2024-09-12T02:54:43.452402+0000, chain.objs.size()=1 2024-09-12T01:10:59.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.845+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fGgAhZ1w9KzfzhfAf_JE3U3P1f4leqI_0 2024-09-12T01:10:59.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.846+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8111883228623642822', time=2024-09-12T02:54:43.487513+0000, chain.objs.size()=1 2024-09-12T01:10:59.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.846+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.FXrO0wnpcYFgFu2IegqnFqH1ivf66--_0 2024-09-12T01:10:59.845 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.846+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15226184524083340673', time=2024-09-12T02:54:43.833825+0000, chain.objs.size()=1 2024-09-12T01:10:59.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.846+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.pMHDheH-iYSJy2TneRrFytyFMBEYG9p_0 2024-09-12T01:10:59.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.847+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13354218485225705152', time=2024-09-12T02:54:43.939372+0000, chain.objs.size()=1 2024-09-12T01:10:59.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.847+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.XYm_oj5g9VVrIMzbL-mti1YmYJfyxP7_0 2024-09-12T01:10:59.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.847+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.521955948742389799', time=2024-09-12T02:54:44.047077+0000, chain.objs.size()=1 2024-09-12T01:10:59.846 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.847+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.YpyN5ZcbTAWeUVElACyYBL77K3E8p0p_0 2024-09-12T01:10:59.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.850+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18392273070463704050', time=2024-09-12T02:54:44.628147+0000, chain.objs.size()=1 2024-09-12T01:10:59.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.850+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.AqIY5f7y4JD471Peml0IaCmCpQojNK__0 2024-09-12T01:10:59.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.850+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6240586262859693947', time=2024-09-12T02:54:45.290473+0000, chain.objs.size()=1 2024-09-12T01:10:59.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.850+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.UzpVPsUYg0iWUjV0JhAf-YtT311-GGn_0 2024-09-12T01:10:59.849 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.850+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9683173457659927950', time=2024-09-12T02:54:45.291159+0000, chain.objs.size()=1 2024-09-12T01:10:59.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.850+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.h0-ViHF8rcQhxtf9gcoXukLWVW1DXYZ_0 2024-09-12T01:10:59.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.850+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10071145487321141507', time=2024-09-12T02:54:45.672320+0000, chain.objs.size()=1 2024-09-12T01:10:59.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.850+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.UU_0mL4C31YBYhnzkyUOFpLerGxiChL_0 2024-09-12T01:10:59.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.850+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11306472754620333671', time=2024-09-12T02:54:45.991204+0000, chain.objs.size()=1 2024-09-12T01:10:59.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.850+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.U7KlhnUy3JQJQfOHQ1hjQfAU9ogBIug_0 2024-09-12T01:10:59.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.850+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10555188664193764756', time=2024-09-12T02:54:46.308544+0000, chain.objs.size()=1 2024-09-12T01:10:59.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.850+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.1dlGVY9lgQ0giXKvPoO-BZH3i_OCHoT_0 2024-09-12T01:10:59.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.850+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.884610704716540952', time=2024-09-12T02:54:46.855129+0000, chain.objs.size()=1 2024-09-12T01:10:59.850 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.850+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.HpXRbt8cKyH0uQHvhoUifFwE967aiU-_0 2024-09-12T01:10:59.853 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.854+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/49371 2024-09-12T01:10:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.856+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T01:10:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.856+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14148375794393714236', time=2024-09-12T02:54:46.981114+0000, chain.objs.size()=1 2024-09-12T01:10:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.856+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.J-VC1_kjUWIzQy98R2WTiUpMIXOeS4z_0 2024-09-12T01:10:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.856+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6122792068372133722', time=2024-09-12T02:55:21.255700+0000, chain.objs.size()=1 2024-09-12T01:10:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.391__shadow_.H9TeugTq7ZZLUXZ4ga9AeVim9_tU9Wv_0 2024-09-12T01:10:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11107491130819386079', time=2024-09-12T02:55:55.643390+0000, chain.objs.size()=1 2024-09-12T01:10:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.452__shadow_.S1XL6anYUhl0Z5rxV4v_DU2v3KlnYPV_0 2024-09-12T01:10:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12243990579738000246', time=2024-09-12T02:55:58.050039+0000, chain.objs.size()=1 2024-09-12T01:10:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.456__shadow_.09OrV824MlZYAbx-0lqhPLqYTXJ4KN2_0 2024-09-12T01:10:59.856 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15879226726595463082', time=2024-09-12T02:56:07.207662+0000, chain.objs.size()=1 2024-09-12T01:10:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.467__shadow_.Jnzg6ahdife76TSG7DbmeMEtY1fUaf-_0 2024-09-12T01:10:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11519126339123624772', time=2024-09-12T02:56:07.208375+0000, chain.objs.size()=1 2024-09-12T01:10:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.467__shadow_.r30yV4P5I28FfA14DFjfikdsK0po8sc_0 2024-09-12T01:10:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~bfNbWifSqYqd1qC585rCUg1TSlihMkW', time=2024-09-12T02:57:20.354431+0000, chain.objs.size()=1 2024-09-12T01:10:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~bfNbWifSqYqd1qC585rCUg1TSlihMkW.1 2024-09-12T01:10:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16337584756510923668', time=2024-09-12T02:59:24.368241+0000, chain.objs.size()=1 2024-09-12T01:10:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.553__shadow_.8_mDG4zD3jqrnBpk5Jds0mdnestnaez_0 2024-09-12T01:10:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6092006350138705579', time=2024-09-12T02:59:24.708191+0000, chain.objs.size()=2 2024-09-12T01:10:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.553__shadow_.wMcy18tpyxUW_GjW1bncpV_XYANoAfh_0 2024-09-12T01:10:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.553__shadow_.wMcy18tpyxUW_GjW1bncpV_XYANoAfh_1 2024-09-12T01:10:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11110747095843910496', time=2024-09-12T02:59:56.081931+0000, chain.objs.size()=1 2024-09-12T01:10:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:OtEqoqfFj0POjAdCbx1lEofyXM4Q907_.nrlvJBK6ki-fgOIWiwLJ3-Sa_2wJmcL_0 2024-09-12T01:10:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11543946223788232875', time=2024-09-12T03:00:16.761945+0000, chain.objs.size()=1 2024-09-12T01:10:59.857 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.857+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.577__shadow:s5XbXGUZDgw4ywlYNAhZeSjXlNcy1-9_.mEEll_k0d835bRuNRh4u6aG7ydZwR-1_0 2024-09-12T01:10:59.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8658298438722019375', time=2024-09-12T03:00:17.430199+0000, chain.objs.size()=1 2024-09-12T01:10:59.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.577__shadow:WideBoyUOlTIIO3qgRdc.FrwDl36UT3_.8z9JZRqWyO_6hytrW2zqbkaeaww5RdN_0 2024-09-12T01:10:59.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13184397490902767106', time=2024-09-12T03:00:24.968764+0000, chain.objs.size()=1 2024-09-12T01:10:59.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:Q2ZLqRXf3c0q3kB-sbGATITLabbhM1A_.fXYjyj9RF1ym__NRKtGeM7F66VjyCz1_0 2024-09-12T01:10:59.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12904784479343258784', time=2024-09-12T03:00:33.939779+0000, chain.objs.size()=1 2024-09-12T01:10:59.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:Zwt7w-zIDhhKdxGEWffikZFyrJv73nk_.GsFkZ6v2T7RXfKUCt_-28DULmzrZ6mK_0 2024-09-12T01:10:59.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2578414354976159438', time=2024-09-12T03:00:54.568533+0000, chain.objs.size()=1 2024-09-12T01:10:59.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.581__shadow:-gmMr83rYz.t5LsfNxRueg9nfitRab6_.Vuw0fDRA9HpUoJBk4KYKe2gClDrO1k5_0 2024-09-12T01:10:59.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11037767926527959', time=2024-09-12T03:01:08.913269+0000, chain.objs.size()=1 2024-09-12T01:10:59.860 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.605__shadow_.k5do45XxglnEjijhYWi1tS_ZZlNh8_W_0 2024-09-12T01:10:59.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14989599888173001769', time=2024-09-12T03:04:50.453628+0000, chain.objs.size()=1 2024-09-12T01:10:59.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.628__shadow_.IRv3iZrZiOe3wd_QnDu13HQxEac_YnM_0 2024-09-12T01:10:59.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2345229542998207774', time=2024-09-12T03:04:54.618971+0000, chain.objs.size()=1 2024-09-12T01:10:59.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.635__shadow_.F_JbL3Ofd49zpEuWCFl912RPzNqVwWK_0 2024-09-12T01:10:59.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11464072620219571767', time=2024-09-12T03:05:36.475206+0000, chain.objs.size()=1 2024-09-12T01:10:59.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.667__shadow_.6FZyUDzvQxoUxYE19jSSvhRlvan7yyN_0 2024-09-12T01:10:59.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1203116044707496756', time=2024-09-12T03:05:55.147408+0000, chain.objs.size()=1 2024-09-12T01:10:59.861 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.861+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.703__multipart_file1.2~MCdojqFDP0ZneJlaPw9zyEkY3oPwEL0.1 2024-09-12T01:10:59.865 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.866+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.867 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.868+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:10:59.868 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.869+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.869 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.870+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47149' 2024-09-12T01:10:59.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16491395222268062635', time=2024-09-12T02:51:41.951774+0000, chain.objs.size()=1 2024-09-12T01:10:59.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.257__shadow_.eRGXzLPI62eXZ_PrL96mSoheOZgww9a_0 2024-09-12T01:10:59.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11360936885865000532', time=2024-09-12T02:52:21.996821+0000, chain.objs.size()=1 2024-09-12T01:10:59.870 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.RPJyd80Hha9uXnO9B4v8mzaU2oT5qVr_0 2024-09-12T01:10:59.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1087930708932908040', time=2024-09-12T02:52:22.995786+0000, chain.objs.size()=1 2024-09-12T01:10:59.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.r3tqaENgQmSYlzEqXxN0iOsi1zqgX4O_0 2024-09-12T01:10:59.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2931969700555316669', time=2024-09-12T02:52:23.274155+0000, chain.objs.size()=1 2024-09-12T01:10:59.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4NJip0sXAUrmomv0yxZaKtt4G2eZXq9_0 2024-09-12T01:10:59.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17662879068488538626', time=2024-09-12T02:52:23.292471+0000, chain.objs.size()=1 2024-09-12T01:10:59.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1rZ62brdrKIdaoeBLqXdALq7rRfnt2j_0 2024-09-12T01:10:59.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.547291824078359283', time=2024-09-12T02:52:23.467880+0000, chain.objs.size()=1 2024-09-12T01:10:59.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ew8F2OyeVEytMCaxvOlL1rxofxhZZ7k_0 2024-09-12T01:10:59.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1985264913596671009', time=2024-09-12T02:52:23.560344+0000, chain.objs.size()=1 2024-09-12T01:10:59.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ZCjkz9IT_A0d-r5eydAM0Etx0IbL-yP_0 2024-09-12T01:10:59.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9608698401792888337', time=2024-09-12T02:52:24.489928+0000, chain.objs.size()=1 2024-09-12T01:10:59.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.UrJWgtVFvXkoEYEvMxXObS22THZnXSP_0 2024-09-12T01:10:59.871 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8589392981115183160', time=2024-09-12T02:52:24.599027+0000, chain.objs.size()=1 2024-09-12T01:10:59.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.F_FuTdeNUZoHeZ826ACANeASsU419ay_0 2024-09-12T01:10:59.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4137088151995324575', time=2024-09-12T02:52:25.823895+0000, chain.objs.size()=1 2024-09-12T01:10:59.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.M4RX9GrE2yCk0nSPq1W5A6grx_tAL_G_0 2024-09-12T01:10:59.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15063432454854479230', time=2024-09-12T02:52:25.940755+0000, chain.objs.size()=1 2024-09-12T01:10:59.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5i25vmXFYdTry4u9DzdVKFL_RuiEdsb_0 2024-09-12T01:10:59.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14328700720243037624', time=2024-09-12T02:52:26.409701+0000, chain.objs.size()=1 2024-09-12T01:10:59.872 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.871+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Iz5QMKRJDeZZdo8QkrSqoFSoR_5_Ra__0 2024-09-12T01:10:59.873 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.874+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16135052223530718474', time=2024-09-12T02:52:27.416370+0000, chain.objs.size()=1 2024-09-12T01:10:59.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.874+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KW8KPF6yMNTFx-S9OqS7BHF-A6lonTp_0 2024-09-12T01:10:59.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.874+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4679528970120112833', time=2024-09-12T02:52:27.428951+0000, chain.objs.size()=1 2024-09-12T01:10:59.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.874+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wH5-a6kWzWUY87jguXTnzd04_TYBbIX_0 2024-09-12T01:10:59.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.874+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.902492569472202779', time=2024-09-12T02:52:28.448708+0000, chain.objs.size()=1 2024-09-12T01:10:59.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.874+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.6IC9LpJ46GFS0AJVjQU0SpyB4cAqWz4_0 2024-09-12T01:10:59.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.874+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9545693532396092310', time=2024-09-12T02:52:28.565793+0000, chain.objs.size()=1 2024-09-12T01:10:59.874 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.874+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.zU_h7zxwVQlTxTRcJ9jx1pBdKkFdtOt_0 2024-09-12T01:10:59.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.876+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12230620213999292863', time=2024-09-12T02:52:28.843757+0000, chain.objs.size()=1 2024-09-12T01:10:59.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.876+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.OTAS9I1OHQZsjW56NdKNKtQieEnklSf_0 2024-09-12T01:10:59.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.876+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11630818462613626637', time=2024-09-12T02:52:29.142266+0000, chain.objs.size()=1 2024-09-12T01:10:59.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.876+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.BSYK8aGKPpUhoc7VFd-MQp0u5CayEAi_0 2024-09-12T01:10:59.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.876+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16344577769611470368', time=2024-09-12T02:52:29.436381+0000, chain.objs.size()=1 2024-09-12T01:10:59.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.876+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.sQvvpoYnylV6Kow4OWbM3sje1qdsTuj_0 2024-09-12T01:10:59.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.876+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10984092604399278828', time=2024-09-12T02:52:29.551277+0000, chain.objs.size()=1 2024-09-12T01:10:59.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.876+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.7Dhk7legWbpz3y7Pme6dSd22bzCoaTs_0 2024-09-12T01:10:59.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.876+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6380239939622201507', time=2024-09-12T02:52:31.768986+0000, chain.objs.size()=1 2024-09-12T01:10:59.875 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.876+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.LkojI9bFBvucqBwbm0W-OaicoV5Byv5_0 2024-09-12T01:10:59.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.876+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2689568572552660251', time=2024-09-12T02:52:31.886085+0000, chain.objs.size()=1 2024-09-12T01:10:59.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.876+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4HSVKno1Op6utk3_KmrJvsXY2BSr-MB_0 2024-09-12T01:10:59.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.876+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16342649737262147967', time=2024-09-12T02:52:44.814501+0000, chain.objs.size()=1 2024-09-12T01:10:59.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.876+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.285__shadow_.XiGZAagm1hbZj1YIyMUbsng46nAbptS_0 2024-09-12T01:10:59.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.877+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2952661279741319095', time=2024-09-12T02:52:53.173768+0000, chain.objs.size()=1 2024-09-12T01:10:59.876 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.877+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.KQQvUmm_87ls1RFk0R-VbkMi0zFH06Q_0 2024-09-12T01:10:59.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.878+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13958693092369879690', time=2024-09-12T02:52:53.881677+0000, chain.objs.size()=1 2024-09-12T01:10:59.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.878+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.295__shadow_.ESTd5cpEyF1Dhe0lEzoor61bTGfJeyd_0 2024-09-12T01:10:59.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.878+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10559325810931718628', time=2024-09-12T02:52:56.377326+0000, chain.objs.size()=1 2024-09-12T01:10:59.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.878+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.299__shadow_.FeLl702mM24U7yPqQB7EAXHkdWkpobx_0 2024-09-12T01:10:59.877 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.878+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10212609129005565981', time=2024-09-12T02:52:57.051072+0000, chain.objs.size()=1 2024-09-12T01:10:59.878 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.878+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.300__shadow_.tpMGqoj1tjj7zpnaElFDAe4SAwtJAtb_0 2024-09-12T01:10:59.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.880+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14973541944944717709', time=2024-09-12T02:53:00.054892+0000, chain.objs.size()=1 2024-09-12T01:10:59.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.880+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.305__shadow_.xSRQl2s-Qx1A5-WCJ9BS6Sq3NDWJmSU_0 2024-09-12T01:10:59.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.880+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10425948391076029517', time=2024-09-12T02:53:00.055644+0000, chain.objs.size()=1 2024-09-12T01:10:59.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.880+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.305__shadow_.S5PXbtv7CU7Ztzi4EZwR3mV5A412o4G_0 2024-09-12T01:10:59.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.880+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10846405975774340579', time=2024-09-12T02:53:49.782721+0000, chain.objs.size()=1 2024-09-12T01:10:59.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.880+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tXAVIVebxSqh7ivzvg-9GIizBLQ_DKK_0 2024-09-12T01:10:59.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.880+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6182030219826632012', time=2024-09-12T02:53:49.871918+0000, chain.objs.size()=1 2024-09-12T01:10:59.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.880+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.1A2kS9upR5EMoOvd3jW5pk1QXK6zRc8_0 2024-09-12T01:10:59.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.880+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12291219386815972993', time=2024-09-12T02:53:49.911604+0000, chain.objs.size()=1 2024-09-12T01:10:59.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.880+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.wCKrAfLca1QN3Leya8vdhjwQyp9EVeU_0 2024-09-12T01:10:59.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.880+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17774146695563962369', time=2024-09-12T02:53:49.944712+0000, chain.objs.size()=1 2024-09-12T01:10:59.880 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.880+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.kNBgYz7DQDtSuj3rKTSrqFGwx_ffSn1_0 2024-09-12T01:10:59.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.880+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2128080391783823036', time=2024-09-12T02:53:50.364229+0000, chain.objs.size()=1 2024-09-12T01:10:59.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.880+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.USDSVCIa33stlugVp0grY67huH7g99W_0 2024-09-12T01:10:59.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.881+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1007590417008285525', time=2024-09-12T02:53:51.032156+0000, chain.objs.size()=1 2024-09-12T01:10:59.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.881+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.YfdoUyYGBj0Q6Yq3MQ3v5uoZT8Gj0uA_0 2024-09-12T01:10:59.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.881+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15269259534852347439', time=2024-09-12T02:53:51.189947+0000, chain.objs.size()=1 2024-09-12T01:10:59.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.881+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0AIaVJg8PhjCnFMzCuRqyYye6nOjzFe_0 2024-09-12T01:10:59.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.881+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11306293410415002282', time=2024-09-12T02:53:51.419930+0000, chain.objs.size()=1 2024-09-12T01:10:59.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.881+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.F2LDmabHjd1Q3grZXcMDeucLkw7PJ6U_0 2024-09-12T01:10:59.881 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.881+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4115050785815353891', time=2024-09-12T02:53:51.563324+0000, chain.objs.size()=1 2024-09-12T01:10:59.882 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.881+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.yGAEM2YE4PrqZwHS7RCMlOA2tCdRZNX_0 2024-09-12T01:10:59.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.884+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2273446709664224677', time=2024-09-12T02:53:51.583789+0000, chain.objs.size()=1 2024-09-12T01:10:59.883 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.884+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Vvl7TNAM0dGgs7ayOTWTYr2TBfG7hc8_0 2024-09-12T01:10:59.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12402296500536209294', time=2024-09-12T02:53:52.679476+0000, chain.objs.size()=1 2024-09-12T01:10:59.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0RjkNSzkF0ysDFdw6XtbdXNM_5C25tA_0 2024-09-12T01:10:59.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7018618989712828315', time=2024-09-12T02:53:52.695161+0000, chain.objs.size()=1 2024-09-12T01:10:59.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.FoNNxWb36ePLnV20U9gXKO3-BfUSMfN_0 2024-09-12T01:10:59.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16235167822770528746', time=2024-09-12T02:53:52.961870+0000, chain.objs.size()=1 2024-09-12T01:10:59.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.YLPN0LPLM1Rtc8VSMd4EnmSw_IgFA7C_0 2024-09-12T01:10:59.884 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15632732647414192338', time=2024-09-12T02:53:53.057990+0000, chain.objs.size()=1 2024-09-12T01:10:59.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.SgFhvtAEjvNYdnb6eNCRqnGP7FleXOX_0 2024-09-12T01:10:59.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3061941633519940785', time=2024-09-12T02:53:53.087295+0000, chain.objs.size()=1 2024-09-12T01:10:59.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.1aNEadnKKcAljLIVgxg_xzZS9WfN8zE_0 2024-09-12T01:10:59.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4526690289120498584', time=2024-09-12T02:53:53.696745+0000, chain.objs.size()=1 2024-09-12T01:10:59.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.9ui_US8BeBhI8jCB8-EcSJj5-XYncqG_0 2024-09-12T01:10:59.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3678861688695133840', time=2024-09-12T02:53:53.727913+0000, chain.objs.size()=1 2024-09-12T01:10:59.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.p2Tcp9JrcG1arFJAT18kMnkLShn2RIN_0 2024-09-12T01:10:59.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11794693232194397792', time=2024-09-12T02:53:54.319339+0000, chain.objs.size()=1 2024-09-12T01:10:59.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.CuIHG90N4pSAG2pYmIL9uB-cXklvCIv_0 2024-09-12T01:10:59.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9700452420253361421', time=2024-09-12T02:53:55.467502+0000, chain.objs.size()=1 2024-09-12T01:10:59.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tVl-59CncrO5gE9RtAdKLxN5VDQx8Zc_0 2024-09-12T01:10:59.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4520561391547264542', time=2024-09-12T02:53:55.956885+0000, chain.objs.size()=1 2024-09-12T01:10:59.885 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.885+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.BfJ3lfundXrqj1tq8JpmxusrMTbmwLs_0 2024-09-12T01:10:59.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.888+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5800825634113366135', time=2024-09-12T02:53:56.372826+0000, chain.objs.size()=1 2024-09-12T01:10:59.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.888+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.AC6SHq2dHz5mvK9zN1Vfob-PfX6azcl_0 2024-09-12T01:10:59.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.888+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12764153043476949453', time=2024-09-12T02:53:56.618719+0000, chain.objs.size()=1 2024-09-12T01:10:59.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.888+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.HHji9v5JpxdHskbvf8fa7R6mSJX4nnF_0 2024-09-12T01:10:59.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.888+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8754521212350430391', time=2024-09-12T02:53:57.107762+0000, chain.objs.size()=1 2024-09-12T01:10:59.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.888+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.6GwfnX4sRAfjDfZ55LPV1oIwvTniPG-_0 2024-09-12T01:10:59.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.888+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16240741149091518552', time=2024-09-12T02:53:57.185747+0000, chain.objs.size()=1 2024-09-12T01:10:59.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.888+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.PU_oH4S08wJ-n0ApotViykt5p8K24wL_0 2024-09-12T01:10:59.887 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.888+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.868960803754347322', time=2024-09-12T02:53:57.265188+0000, chain.objs.size()=1 2024-09-12T01:10:59.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.888+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.pTd3xwFQ1hdbGPQBnyNBrztFEEP4LS1_0 2024-09-12T01:10:59.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.889+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10904343006096792558', time=2024-09-12T02:53:57.369392+0000, chain.objs.size()=1 2024-09-12T01:10:59.888 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.889+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.MR_db1CcMlV0geo4-mHsXNw9aH6kA66_0 2024-09-12T01:10:59.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.891+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17821432389928951892', time=2024-09-12T02:53:57.409153+0000, chain.objs.size()=1 2024-09-12T01:10:59.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.891+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.wxC_V3td9w7aSUETM7J0ZaHCTVnClLx_0 2024-09-12T01:10:59.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.891+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15536617938156093541', time=2024-09-12T02:53:57.694554+0000, chain.objs.size()=1 2024-09-12T01:10:59.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.891+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.IGBMFK9F1Hok5nL1WOT85AkAMDrkICC_0 2024-09-12T01:10:59.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.891+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.24321817032010654', time=2024-09-12T02:53:57.778110+0000, chain.objs.size()=1 2024-09-12T01:10:59.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.891+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.-OPn0mBT4BcCRK8-LkkUlFvAQQ5J09L_0 2024-09-12T01:10:59.890 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.891+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17782036610081271290', time=2024-09-12T02:53:57.974045+0000, chain.objs.size()=1 2024-09-12T01:10:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.891+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.vHagaotLdY-OfP3v7TAurt1MqFfOT2Y_0 2024-09-12T01:10:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.891+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1582347934357001932', time=2024-09-12T02:53:58.502968+0000, chain.objs.size()=1 2024-09-12T01:10:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.891+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hNfYMEJ3NXiikxxnrs_jqyUYMVz_AED_0 2024-09-12T01:10:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.891+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14381604239285886760', time=2024-09-12T02:53:59.093763+0000, chain.objs.size()=1 2024-09-12T01:10:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.891+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Dd66jNPUgGAMn1zmFTKAHjoFmJEMfu9_0 2024-09-12T01:10:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.891+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8195131667809403256', time=2024-09-12T02:53:59.157791+0000, chain.objs.size()=1 2024-09-12T01:10:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.891+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.q1cTasve3mft9mkIAft-9WxEFCR6F0K_0 2024-09-12T01:10:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.892+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10582206691667189953', time=2024-09-12T02:53:59.207966+0000, chain.objs.size()=1 2024-09-12T01:10:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.892+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.S70-13Ojg_rY-9UoeXcOMfQ6YPWSe6-_0 2024-09-12T01:10:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.892+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16642200849556184164', time=2024-09-12T02:53:59.343267+0000, chain.objs.size()=1 2024-09-12T01:10:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.892+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Tf2I3XuYlgOUV5_LSoBCNul4Q7y7eVQ_0 2024-09-12T01:10:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.892+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12993292241628772270', time=2024-09-12T02:53:59.540046+0000, chain.objs.size()=1 2024-09-12T01:10:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.892+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.FLxnnGHObXm_WBhGcK7bJSaYPxtrcw2_0 2024-09-12T01:10:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.892+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12256428936722539764', time=2024-09-12T02:53:59.734429+0000, chain.objs.size()=1 2024-09-12T01:10:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.892+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.iQuOyuKSC9G2reCH1ye79_gw1YAMa1s_0 2024-09-12T01:10:59.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.895+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4661187473694978157', time=2024-09-12T02:54:36.828397+0000, chain.objs.size()=1 2024-09-12T01:10:59.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.895+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fOuAXLQCwC-1K9hKcoYqrEdIGV4CsGY_0 2024-09-12T01:10:59.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.895+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10890055266819521311', time=2024-09-12T02:54:37.059656+0000, chain.objs.size()=1 2024-09-12T01:10:59.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.895+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.PBVxamrRKB6eagGicMFEBWU_V6VEU0T_0 2024-09-12T01:10:59.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.895+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3644423039978427424', time=2024-09-12T02:54:37.323824+0000, chain.objs.size()=1 2024-09-12T01:10:59.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.895+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.4PpZujS3dj588JK-OzjC9I2HfNf-xNf_0 2024-09-12T01:10:59.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.895+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13569163113407410127', time=2024-09-12T02:54:38.727710+0000, chain.objs.size()=1 2024-09-12T01:10:59.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.895+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.65zTOba5c68-uI2yWGeWcIu3tL-FDnX_0 2024-09-12T01:10:59.894 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.895+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12334116515827440057', time=2024-09-12T02:54:38.769950+0000, chain.objs.size()=1 2024-09-12T01:10:59.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.895+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.D7-i0vLHglAqtwWqrBbAFm4EBxsuIC3_0 2024-09-12T01:10:59.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.895+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16829318652201320111', time=2024-09-12T02:54:39.499160+0000, chain.objs.size()=1 2024-09-12T01:10:59.895 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.895+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.wBXh-e_qWYPTkCwlv4rsbS2ugGF8Pqr_0 2024-09-12T01:10:59.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.897+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16896474126721408961', time=2024-09-12T02:54:40.326004+0000, chain.objs.size()=1 2024-09-12T01:10:59.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.897+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.a5vcClwChzrGciY8N4JqF-SvtzZQdSg_0 2024-09-12T01:10:59.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.897+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5087968087859957202', time=2024-09-12T02:54:40.970595+0000, chain.objs.size()=1 2024-09-12T01:10:59.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.897+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.CMzQZ-zeLFY2-efrXV-8UF3LLcFKTNM_0 2024-09-12T01:10:59.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.897+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16431485944709461438', time=2024-09-12T02:54:41.153315+0000, chain.objs.size()=1 2024-09-12T01:10:59.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.897+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.K6a7NfepXIA4HEi7pGNeTSIdC9oUiKd_0 2024-09-12T01:10:59.896 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.897+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8357554164438726889', time=2024-09-12T02:54:41.331267+0000, chain.objs.size()=1 2024-09-12T01:10:59.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.897+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.t9FFDd49eESD_vNDqd6ONi3yW5vfe-k_0 2024-09-12T01:10:59.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.897+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15140147978616780920', time=2024-09-12T02:54:41.719273+0000, chain.objs.size()=1 2024-09-12T01:10:59.897 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.897+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.YYVcZ1rSGVDGd6ADO1s-fMn-ECvg8H3_0 2024-09-12T01:10:59.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.899+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10107268607475776070', time=2024-09-12T02:54:41.788981+0000, chain.objs.size()=1 2024-09-12T01:10:59.898 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.899+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fHR_1cUbcquh-5DlAGzfm1fe8kU3owf_0 2024-09-12T01:10:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.900+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2521578876421139221', time=2024-09-12T02:54:41.830024+0000, chain.objs.size()=1 2024-09-12T01:10:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.900+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.HqWkxe3TztQ_6LUMKnBaRlFhYi-iCPK_0 2024-09-12T01:10:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.901+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2005687475400909319', time=2024-09-12T02:54:42.229054+0000, chain.objs.size()=1 2024-09-12T01:10:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.901+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ziBqEkbtmm7S5Q2c2cMKMju50iDESiK_0 2024-09-12T01:10:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.901+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2942372244290298169', time=2024-09-12T02:54:42.401015+0000, chain.objs.size()=1 2024-09-12T01:10:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.901+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.06yKpdsfPuq6ZyuLbKW1iG3J0z3DVW5_0 2024-09-12T01:10:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.901+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11795866353709426685', time=2024-09-12T02:54:42.401665+0000, chain.objs.size()=1 2024-09-12T01:10:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.901+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6ZP7-qfgbl60K4phrOEifstIY0c3OjR_0 2024-09-12T01:10:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.901+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17582983622692770055', time=2024-09-12T02:54:42.507047+0000, chain.objs.size()=1 2024-09-12T01:10:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.901+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.hy7Idzh8jqZJK05WYouQUSjQfuNiueI_0 2024-09-12T01:10:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.901+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9927497382405802355', time=2024-09-12T02:54:42.665562+0000, chain.objs.size()=1 2024-09-12T01:10:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.901+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.db3ey8ehxEql_qmDD5zOtxfzCAWcq13_0 2024-09-12T01:10:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.901+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5622186045144670259', time=2024-09-12T02:54:42.666177+0000, chain.objs.size()=1 2024-09-12T01:10:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.901+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.PlGzzk40u5buPWqkUDvJ72FRDqHBEj1_0 2024-09-12T01:10:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.902+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7909517453348613984', time=2024-09-12T02:54:42.925432+0000, chain.objs.size()=1 2024-09-12T01:10:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.902+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.EJ8n1BsSbZWm67pK5q30Uy_h3bhQxDA_0 2024-09-12T01:10:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.902+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3028151272240019621', time=2024-09-12T02:54:42.969758+0000, chain.objs.size()=1 2024-09-12T01:10:59.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.902+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.7lP6RCzaaCbqw63AJldHlSINe15XgRF_0 2024-09-12T01:10:59.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.902+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15121186382845807070', time=2024-09-12T02:54:44.435511+0000, chain.objs.size()=1 2024-09-12T01:10:59.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.902+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.LC7dJXCQ7DsdnbAufyW_cDTQkbFMz1i_0 2024-09-12T01:10:59.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.902+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161388084316071269', time=2024-09-12T02:54:44.704656+0000, chain.objs.size()=1 2024-09-12T01:10:59.902 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.902+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.TSKmLl4GJr3Te4kwSokGBU1y9ofGYDx_0 2024-09-12T01:10:59.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.904+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10916334904179621123', time=2024-09-12T02:54:45.411125+0000, chain.objs.size()=1 2024-09-12T01:10:59.903 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.904+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.exmtL4USGLGflwshCNDvEGFBSOAU8v5_0 2024-09-12T01:10:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.905+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8608534535276634763', time=2024-09-12T02:54:45.537528+0000, chain.objs.size()=1 2024-09-12T01:10:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.905+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ONBkN0KLNWgL4cCxeWgbX32QhM0ldLN_0 2024-09-12T01:10:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.905+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18266750923795516517', time=2024-09-12T02:54:46.420315+0000, chain.objs.size()=1 2024-09-12T01:10:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.905+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.uuscrU6M4w9QOSkLf9ld6iPNiqQuAGc_0 2024-09-12T01:10:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.905+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3591260326220886194', time=2024-09-12T02:54:46.662139+0000, chain.objs.size()=1 2024-09-12T01:10:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.905+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nuR3bVvghI0gY9LM2qg--KTVpMNeuVK_0 2024-09-12T01:10:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.905+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12234892655413302994', time=2024-09-12T02:54:46.982586+0000, chain.objs.size()=1 2024-09-12T01:10:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.905+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.KbW-qFo29Zlzt14TJdPaznMXZEJdCku_0 2024-09-12T01:10:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.905+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3655591603567545801', time=2024-09-12T02:54:47.009638+0000, chain.objs.size()=1 2024-09-12T01:10:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.905+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.jGJO52rDwpB8ueTziNSPRqco5Ew2nm7_0 2024-09-12T01:10:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.905+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6030022161937299046', time=2024-09-12T02:54:47.022094+0000, chain.objs.size()=1 2024-09-12T01:10:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.905+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.eqbahBVpIy6LatQcQhUtIIiexc64AWu_0 2024-09-12T01:10:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.906+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.233986884069710311', time=2024-09-12T02:54:54.890045+0000, chain.objs.size()=1 2024-09-12T01:10:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.906+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.340__shadow_.yDc8dt7hPMaktyTTSittKXqXdk-w5uf_0 2024-09-12T01:10:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.906+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8771891173128059284', time=2024-09-12T02:55:46.027478+0000, chain.objs.size()=1 2024-09-12T01:10:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.906+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.436__shadow_.uK6qiDEwEEdurysNfO9Kqjs1FAQyct-_0 2024-09-12T01:10:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.906+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13077749581834625836', time=2024-09-12T02:56:05.478708+0000, chain.objs.size()=1 2024-09-12T01:10:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.906+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.465__shadow_.s-CMbsXwfmmVmiA-A4oRJG4ndkWtsDP_0 2024-09-12T01:10:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.906+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2282006433867858816', time=2024-09-12T02:56:15.029531+0000, chain.objs.size()=1 2024-09-12T01:10:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.906+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.485__shadow_.OCIENpy0OHTVH05DwlqbRxaUe4pvkQL_0 2024-09-12T01:10:59.910 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.911+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/47149 2024-09-12T01:10:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T01:10:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14463585876544357082', time=2024-09-12T02:56:24.847226+0000, chain.objs.size()=1 2024-09-12T01:10:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.497__shadow_.irI35RwRYGYN6_ZirVqbD-VICrbMxci_0 2024-09-12T01:10:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4282024617595018312', time=2024-09-12T02:58:21.667782+0000, chain.objs.size()=2 2024-09-12T01:10:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.526__multipart_mymultipart.2~LXncAbRheJH9371WGHqCG81Sy76rBSU.1 2024-09-12T01:10:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.526__multipart_mymultipart.2~LXncAbRheJH9371WGHqCG81Sy76rBSU.2 2024-09-12T01:10:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~6XGYdboVkjw6nFu4JJIDECyuGKgAdaC', time=2024-09-12T02:58:27.540096+0000, chain.objs.size()=10 2024-09-12T01:10:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.527__multipart_mymultipart.2~6XGYdboVkjw6nFu4JJIDECyuGKgAdaC.1 2024-09-12T01:10:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.527__multipart_mymultipart.2~6XGYdboVkjw6nFu4JJIDECyuGKgAdaC.2 2024-09-12T01:10:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.527__multipart_mymultipart.2~6XGYdboVkjw6nFu4JJIDECyuGKgAdaC.3 2024-09-12T01:10:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.527__multipart_mymultipart.2~6XGYdboVkjw6nFu4JJIDECyuGKgAdaC.4 2024-09-12T01:10:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.527__multipart_mymultipart.2~6XGYdboVkjw6nFu4JJIDECyuGKgAdaC.5 2024-09-12T01:10:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.527__multipart_mymultipart.2~6XGYdboVkjw6nFu4JJIDECyuGKgAdaC.6 2024-09-12T01:10:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.527__multipart_mymultipart.2~6XGYdboVkjw6nFu4JJIDECyuGKgAdaC.7 2024-09-12T01:10:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.527__multipart_mymultipart.2~6XGYdboVkjw6nFu4JJIDECyuGKgAdaC.8 2024-09-12T01:10:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.913+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.527__multipart_mymultipart.2~6XGYdboVkjw6nFu4JJIDECyuGKgAdaC.9 2024-09-12T01:10:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.916+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.527__multipart_mymultipart.2~6XGYdboVkjw6nFu4JJIDECyuGKgAdaC.10 2024-09-12T01:10:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.916+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~0TgKKbIBTTz3dhTMO4UInhm7WP9BCAt', time=2024-09-12T02:59:42.514571+0000, chain.objs.size()=1 2024-09-12T01:10:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.916+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.562__multipart_mymultipart.2~0TgKKbIBTTz3dhTMO4UInhm7WP9BCAt.1 2024-09-12T01:10:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.916+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1088306233747155950', time=2024-09-12T03:00:00.750127+0000, chain.objs.size()=1 2024-09-12T01:10:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.916+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:XOj6ZPRmwkO8hnoIs8xkf0wvBBv6O2X_.CvuXN1gvICgNOV73Cb_sqoY-DpqL011_0 2024-09-12T01:10:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.917+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9449820071191399886', time=2024-09-12T03:00:12.029989+0000, chain.objs.size()=1 2024-09-12T01:10:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.917+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.576__shadow_.9JnixzWSfcwU7SLaKvLCQxwB1Mjh3B8_0 2024-09-12T01:10:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.917+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11595535030168685469', time=2024-09-12T03:00:13.948055+0000, chain.objs.size()=1 2024-09-12T01:10:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.917+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.577__shadow:WDlTH3vQ5S87CORAw3.UfDbHwraTeOn_.d-zrQCXFp0XlZxBXqAgZJLYmEzN5gzO_0 2024-09-12T01:10:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.917+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.70199951552484568', time=2024-09-12T03:00:14.638905+0000, chain.objs.size()=1 2024-09-12T01:10:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.917+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.577__shadow:-pkUGdBygUdfrf0PYas4Bw-QSKzWB8j_.3vvx0DccufCVN1Q-cwbaSN-vpeWdbZ4_0 2024-09-12T01:10:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.918+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2786019765066771418', time=2024-09-12T03:01:39.502671+0000, chain.objs.size()=12 2024-09-12T01:10:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.918+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.614__multipart_multipart_enc.2~nVuv_U8hU8hq-SULIhozUMONPEgGVSb.1 2024-09-12T01:10:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.918+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.614__shadow_multipart_enc.2~nVuv_U8hU8hq-SULIhozUMONPEgGVSb.1_1 2024-09-12T01:10:59.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.918+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.614__multipart_multipart_enc.2~nVuv_U8hU8hq-SULIhozUMONPEgGVSb.2 2024-09-12T01:10:59.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.918+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.614__shadow_multipart_enc.2~nVuv_U8hU8hq-SULIhozUMONPEgGVSb.2_1 2024-09-12T01:10:59.918 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.918+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.614__multipart_multipart_enc.2~nVuv_U8hU8hq-SULIhozUMONPEgGVSb.3 2024-09-12T01:10:59.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.920+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.614__shadow_multipart_enc.2~nVuv_U8hU8hq-SULIhozUMONPEgGVSb.3_1 2024-09-12T01:10:59.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.920+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.614__multipart_multipart_enc.2~nVuv_U8hU8hq-SULIhozUMONPEgGVSb.4 2024-09-12T01:10:59.919 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.920+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.614__shadow_multipart_enc.2~nVuv_U8hU8hq-SULIhozUMONPEgGVSb.4_1 2024-09-12T01:10:59.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.920+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.614__multipart_multipart_enc.2~nVuv_U8hU8hq-SULIhozUMONPEgGVSb.5 2024-09-12T01:10:59.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.920+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.614__shadow_multipart_enc.2~nVuv_U8hU8hq-SULIhozUMONPEgGVSb.5_1 2024-09-12T01:10:59.920 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.920+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.614__multipart_multipart_enc.2~nVuv_U8hU8hq-SULIhozUMONPEgGVSb.6 2024-09-12T01:10:59.921 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.922+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.614__shadow_multipart_enc.2~nVuv_U8hU8hq-SULIhozUMONPEgGVSb.6_1 2024-09-12T01:10:59.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.923+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4640160643918223383', time=2024-09-12T03:05:04.300937+0000, chain.objs.size()=1 2024-09-12T01:10:59.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.923+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.646__shadow_.UM-wsOOjYuH9C16kgmkdnUEU5fhd3rV_0 2024-09-12T01:10:59.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.923+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16614408403354367213', time=2024-09-12T03:05:10.564436+0000, chain.objs.size()=2 2024-09-12T01:10:59.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.923+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.650__shadow_.1SRS_Qf5g-SlbhB05TxlVit32M64t4__0 2024-09-12T01:10:59.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.923+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.650__shadow_.1SRS_Qf5g-SlbhB05TxlVit32M64t4__1 2024-09-12T01:10:59.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.923+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10971495334528700957', time=2024-09-12T03:05:35.475291+0000, chain.objs.size()=1 2024-09-12T01:10:59.922 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.923+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.666__shadow_.XqfKkXklh3VNHZzNcPYX3PKcnsQX1jw_0 2024-09-12T01:10:59.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.924+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5973544813442840633', time=2024-09-12T03:05:52.047877+0000, chain.objs.size()=1 2024-09-12T01:10:59.923 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.924+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.698__shadow:nyWh8kG-tpkTjURgNmCSl8IV1ZWXiZ4_.JirwmnZyjsEJYoLYkYmJZA9HFdpKkfH_0 2024-09-12T01:10:59.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.925+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12639323268134846356', time=2024-09-12T03:06:00.796571+0000, chain.objs.size()=1 2024-09-12T01:10:59.924 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.925+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.712__multipart_file1.2~qlaWVKoZODWf5itqJt-HqaM8oWR9-Yy.1 2024-09-12T01:10:59.927 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.928+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.929 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.930+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:10:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.932+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.932+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48366' 2024-09-12T01:10:59.932 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='_DiGG_YhXET5UxqutesJcH7mzZgC4U4S', time=2024-09-12T02:49:21.939984+0000, chain.objs.size()=1 2024-09-12T01:10:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.161__shadow_.omnoTbZaFTB-oJJp_Ldbcp45sEGeIyg_0 2024-09-12T01:10:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16627344353373904067', time=2024-09-12T02:49:33.003615+0000, chain.objs.size()=1 2024-09-12T01:10:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.167__shadow_.O2eFKWMHwdrJMZM7jraX4DSqpdaA2vb_0 2024-09-12T01:10:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5220749073824799199', time=2024-09-12T02:51:25.999512+0000, chain.objs.size()=1 2024-09-12T01:10:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.232__shadow_.0YxohaFgusycuc3UqfPZxIzn_LN6KPZ_0 2024-09-12T01:10:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5992864812006933818', time=2024-09-12T02:51:34.655791+0000, chain.objs.size()=1 2024-09-12T01:10:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.245__shadow_.nVFzbkcNo9iSm_f8xUZ3Xpj05RDPrR8_0 2024-09-12T01:10:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5260795172644693591', time=2024-09-12T02:51:37.107429+0000, chain.objs.size()=1 2024-09-12T01:10:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.249__shadow_.-N6HCllTAaOsVsmkD5G0fOweePsK0Ov_0 2024-09-12T01:10:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7897744145041895383', time=2024-09-12T02:51:40.721502+0000, chain.objs.size()=1 2024-09-12T01:10:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.255__shadow_.z5Lzdz-Gs8vKemf08ZvWjb9F1_Tl9fq_0 2024-09-12T01:10:59.933 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18226771818399753913', time=2024-09-12T02:51:44.886712+0000, chain.objs.size()=1 2024-09-12T01:10:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.262__shadow_.rOlTjNKwoLO0wrnTIY0xcS1lnO3oDeV_0 2024-09-12T01:10:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1911575821420458478', time=2024-09-12T02:52:21.126525+0000, chain.objs.size()=1 2024-09-12T01:10:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.BQUKIt9sjXJA-bJs3E5vbOB5Rd0djbz_0 2024-09-12T01:10:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13062412073468346016', time=2024-09-12T02:52:21.226497+0000, chain.objs.size()=1 2024-09-12T01:10:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.b_9wxfWS9GLTX5U6wjHHHcDYXpwRMCQ_0 2024-09-12T01:10:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1629607553771491129', time=2024-09-12T02:52:21.314813+0000, chain.objs.size()=1 2024-09-12T01:10:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.SnwFFRPle3YvQ74pI-HIR4zEPi1m66m_0 2024-09-12T01:10:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8500582998943401725', time=2024-09-12T02:52:21.858786+0000, chain.objs.size()=1 2024-09-12T01:10:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.OMh5fZ4KVnIyWDCEpQoZxbu1G6-pIZp_0 2024-09-12T01:10:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10044158688799320642', time=2024-09-12T02:52:23.135584+0000, chain.objs.size()=1 2024-09-12T01:10:59.934 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.933+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.CiRPUkg5DeJJ9ajkdSTBZi9i4pXc-j5_0 2024-09-12T01:10:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.935+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8577669469048968723', time=2024-09-12T02:52:23.537616+0000, chain.objs.size()=1 2024-09-12T01:10:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.935+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.1-ZvWzSKJRG6-vP1fOfbbsgbPsGNdut_0 2024-09-12T01:10:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.935+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.618526903061763870', time=2024-09-12T02:52:23.551646+0000, chain.objs.size()=1 2024-09-12T01:10:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.935+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uIgi586tvyXLAeHWV4GB64XDN5rsM0P_0 2024-09-12T01:10:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.936+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1842084652392536978', time=2024-09-12T02:52:24.217108+0000, chain.objs.size()=1 2024-09-12T01:10:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.936+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.BlZLlGUrtTqDaeEVayG4iJberIDVvzi_0 2024-09-12T01:10:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.936+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2415808968618256513', time=2024-09-12T02:52:24.288448+0000, chain.objs.size()=1 2024-09-12T01:10:59.935 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.936+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.O1tUbhZzhDqH_PUT5nMVNxLUMAItQkA_0 2024-09-12T01:10:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10876950978534457887', time=2024-09-12T02:52:24.830981+0000, chain.objs.size()=1 2024-09-12T01:10:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Sx5bX74zoAwM3XZI4zZ9jmF4aHKctjc_0 2024-09-12T01:10:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.743558723836487019', time=2024-09-12T02:52:24.848299+0000, chain.objs.size()=1 2024-09-12T01:10:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.gc7cdTAwDAqDW-38hW2wbeMRvgMMLVT_0 2024-09-12T01:10:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17835314631728152708', time=2024-09-12T02:52:24.978448+0000, chain.objs.size()=1 2024-09-12T01:10:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.21nsemAqiukG9vj_5LF12Bnjd6CI88q_0 2024-09-12T01:10:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15564931516145373161', time=2024-09-12T02:52:25.596107+0000, chain.objs.size()=1 2024-09-12T01:10:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.axOrpRdjb-Grt0IFUzY0uvDiVy_6nWD_0 2024-09-12T01:10:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12529069250535786766', time=2024-09-12T02:52:25.824135+0000, chain.objs.size()=1 2024-09-12T01:10:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.9h4f65jSX4dt7aeFwSOEnxYCL-f_sYE_0 2024-09-12T01:10:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14106290285261003051', time=2024-09-12T02:52:25.888749+0000, chain.objs.size()=1 2024-09-12T01:10:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.B3sM1JTKSB_zeskgTMe--IArBWj5sWF_0 2024-09-12T01:10:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.937+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5302443757777721949', time=2024-09-12T02:52:26.344192+0000, chain.objs.size()=1 2024-09-12T01:10:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.937+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.6YPmCUdqeSjefVRB-D_roYLa1YX29SL_0 2024-09-12T01:10:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.938+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12341144958390477157', time=2024-09-12T02:52:26.510191+0000, chain.objs.size()=1 2024-09-12T01:10:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.938+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4lEruFEZiAx1kHGEheQDiwl_TK31IIx_0 2024-09-12T01:10:59.937 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.938+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9995384420135242891', time=2024-09-12T02:52:27.236986+0000, chain.objs.size()=1 2024-09-12T01:10:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.938+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.fgNGozbZsdCFwUOeDnqTSUZniW_lL1E_0 2024-09-12T01:10:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.939+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12882320097730678609', time=2024-09-12T02:52:27.330361+0000, chain.objs.size()=1 2024-09-12T01:10:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.939+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.qxcdgoBXrY3xV3GzKen7Mbstd7xg3BP_0 2024-09-12T01:10:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.939+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9151876747389099305', time=2024-09-12T02:52:27.738203+0000, chain.objs.size()=1 2024-09-12T01:10:59.938 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.939+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wOFVSLdF5XlHZnkLir-c67en4ACDOid_0 2024-09-12T01:10:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.940+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6533813637011895865', time=2024-09-12T02:52:27.915420+0000, chain.objs.size()=1 2024-09-12T01:10:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.940+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.3k1n8Run0n8LpVd804rHAQ14Jkit4uc_0 2024-09-12T01:10:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.940+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1620915601522447615', time=2024-09-12T02:52:27.938785+0000, chain.objs.size()=1 2024-09-12T01:10:59.939 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.940+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.-TgDLSeQ5v3GLlx_UyKCsGGebsI7NsU_0 2024-09-12T01:10:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16444732498457034753', time=2024-09-12T02:52:28.789130+0000, chain.objs.size()=1 2024-09-12T01:10:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.OWB-QrlLqH6nebo34l9wJoxral7ma7k_0 2024-09-12T01:10:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2677450356345668967', time=2024-09-12T02:52:29.294580+0000, chain.objs.size()=1 2024-09-12T01:10:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Xc6B3aM1sZuJP6eFLvNZDVANVrM2ArI_0 2024-09-12T01:10:59.941 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6121509224616442894', time=2024-09-12T02:52:29.528736+0000, chain.objs.size()=1 2024-09-12T01:10:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.IOxQ_IhhXNfNlgD63Gx1RYb2P29AK3W_0 2024-09-12T01:10:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7439051465835842901', time=2024-09-12T02:52:29.886691+0000, chain.objs.size()=1 2024-09-12T01:10:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.7CQwP9u_9EQS4aROeKe0Astcz7Cf2Nh_0 2024-09-12T01:10:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8875225916349626835', time=2024-09-12T02:52:29.976392+0000, chain.objs.size()=1 2024-09-12T01:10:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.BOU62M2p64GWUVCnfW-aNIxe_lteoi4_0 2024-09-12T01:10:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18379693517471863429', time=2024-09-12T02:52:29.987926+0000, chain.objs.size()=1 2024-09-12T01:10:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.X0XGX7MWXOU2WFwwg2asIV3aCcc9vvu_0 2024-09-12T01:10:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9374107657775764438', time=2024-09-12T02:52:30.395445+0000, chain.objs.size()=1 2024-09-12T01:10:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.R-IHlSEfQmdr1pqyavpJ1EQ9yhulbm6_0 2024-09-12T01:10:59.942 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5230317212701218490', time=2024-09-12T02:52:30.802070+0000, chain.objs.size()=1 2024-09-12T01:10:59.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.942+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.OVLUQRa0hVEGQmfAExJlGMWHcoam8M2_0 2024-09-12T01:10:59.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.944+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7498094418089148497', time=2024-09-12T02:52:31.466324+0000, chain.objs.size()=1 2024-09-12T01:10:59.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.944+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._6hi11iIZ6CMGcX-nXyxhu5jQpdOB9S_0 2024-09-12T01:10:59.943 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.945+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8039424437309537568', time=2024-09-12T02:52:37.618846+0000, chain.objs.size()=1 2024-09-12T01:10:59.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.945+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.273__shadow_.U38igdctyrXfU30e-10qDFXnf0SkIHO_0 2024-09-12T01:10:59.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.945+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.283200342346465610', time=2024-09-12T02:52:38.174950+0000, chain.objs.size()=1 2024-09-12T01:10:59.944 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.945+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.274__shadow_.9ixqrypSgM1QYIpA8gNTJtkPzRgLsD2_0 2024-09-12T01:10:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16777083785342052026', time=2024-09-12T02:52:51.206035+0000, chain.objs.size()=1 2024-09-12T01:10:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.Kl4_zzSn754eAvuk9G4__aaPJiV87LF_0 2024-09-12T01:10:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5786244758876743129', time=2024-09-12T02:52:53.142800+0000, chain.objs.size()=1 2024-09-12T01:10:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.qtoHrMXboup5lXpkSg9wL5N4Ff2B6_i_0 2024-09-12T01:10:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8885347053772730862', time=2024-09-12T02:52:53.242593+0000, chain.objs.size()=1 2024-09-12T01:10:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.uPZogsOsel7oB4BJdOa8sutChF6SonB_0 2024-09-12T01:10:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15303050364287367357', time=2024-09-12T02:52:58.860988+0000, chain.objs.size()=1 2024-09-12T01:10:59.945 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.303__shadow_.TWmCc2YLSW5po8jTqp8_kWgnuutamSo_0 2024-09-12T01:10:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15432678669261971972', time=2024-09-12T02:53:49.556007+0000, chain.objs.size()=1 2024-09-12T01:10:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.fx0GQp_noy2V8SJeblwhqtObWRu-Rmz_0 2024-09-12T01:10:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3693093249360554607', time=2024-09-12T02:53:49.938221+0000, chain.objs.size()=1 2024-09-12T01:10:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0jc_Gn4MNdgskV64RBQ7ftFlfO30ezz_0 2024-09-12T01:10:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4843445053314581996', time=2024-09-12T02:53:50.076231+0000, chain.objs.size()=1 2024-09-12T01:10:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5JRhIQ9vIRyQbUZSb1CBDX5epC3-ddx_0 2024-09-12T01:10:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6547762193625085321', time=2024-09-12T02:53:50.878456+0000, chain.objs.size()=1 2024-09-12T01:10:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.oYYlzTTdeGiRaX4FuBuqPTtxmJzSdYJ_0 2024-09-12T01:10:59.946 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4668618136650377604', time=2024-09-12T02:53:51.084457+0000, chain.objs.size()=1 2024-09-12T01:10:59.947 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.946+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.AgriTVElnr5xUwqC2U0Ql80nXWzic0Z_0 2024-09-12T01:10:59.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.949+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16976311542759936566', time=2024-09-12T02:53:51.700615+0000, chain.objs.size()=1 2024-09-12T01:10:59.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.949+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.zPEpcMYjfPcw1NzcF1iwdDzcr6I6ndM_0 2024-09-12T01:10:59.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.949+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3322718141209862507', time=2024-09-12T02:53:51.890026+0000, chain.objs.size()=1 2024-09-12T01:10:59.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.949+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.faJh84d99KNdOEDCepWe9L4Q64_GMj9_0 2024-09-12T01:10:59.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.949+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5324161661790287547', time=2024-09-12T02:53:53.035831+0000, chain.objs.size()=1 2024-09-12T01:10:59.948 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.949+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.sDnWl6fnbrkdb8AUpfQVU12V0aCSzoY_0 2024-09-12T01:10:59.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.949+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17502804996749733027', time=2024-09-12T02:53:53.170721+0000, chain.objs.size()=1 2024-09-12T01:10:59.949 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.949+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.JYvRZ1bdg02aQ7yynMOmlD9ROgxj-4J_0 2024-09-12T01:10:59.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.951+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7184053211845138963', time=2024-09-12T02:53:53.919445+0000, chain.objs.size()=1 2024-09-12T01:10:59.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.951+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.xbkNOm2NcNwmg41PVeMpKKIz7_q28-g_0 2024-09-12T01:10:59.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.951+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4877195634296094982', time=2024-09-12T02:53:53.963492+0000, chain.objs.size()=1 2024-09-12T01:10:59.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.951+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.mol5ooTD-RZsC0owgkYBRl3K_V2XEGR_0 2024-09-12T01:10:59.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.951+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4515288313707126831', time=2024-09-12T02:53:54.030630+0000, chain.objs.size()=1 2024-09-12T01:10:59.950 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.951+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.EPm6Ywcgsn5ZE6iE84Aihqr2LL4FAMy_0 2024-09-12T01:10:59.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.951+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10082210111888317878', time=2024-09-12T02:53:54.109053+0000, chain.objs.size()=1 2024-09-12T01:10:59.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.951+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.A4Ch4_IMTU-o6lwkOemKX6_Cl5aKgPq_0 2024-09-12T01:10:59.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.951+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4833275610016288187', time=2024-09-12T02:53:54.571591+0000, chain.objs.size()=1 2024-09-12T01:10:59.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.951+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0MDgXqGaI_75IVipIw1V2edpCZfDnZJ_0 2024-09-12T01:10:59.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.951+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17709663044470143794', time=2024-09-12T02:53:54.595919+0000, chain.objs.size()=1 2024-09-12T01:10:59.951 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.951+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.TQz2bJviz6VNXZP2KUG0zcTmeZZ2-Bx_0 2024-09-12T01:10:59.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.951+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14587888966662826052', time=2024-09-12T02:53:55.426349+0000, chain.objs.size()=1 2024-09-12T01:10:59.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.951+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5r-ZMdpZ9fdavKZ173v-ZCj-bOVK5Lq_0 2024-09-12T01:10:59.952 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.952+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14341868561656507130', time=2024-09-12T02:53:55.427041+0000, chain.objs.size()=1 2024-09-12T01:10:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.952+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0W7NxH8zk6arTBlkJuleEy-3Eqc_oIg_0 2024-09-12T01:10:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.952+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13564890059955787697', time=2024-09-12T02:53:55.778161+0000, chain.objs.size()=1 2024-09-12T01:10:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.952+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.D7a_1BvAjvBJvtKjzmCjSmk1z2Ls9Su_0 2024-09-12T01:10:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.952+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9290552650015301924', time=2024-09-12T02:53:55.930041+0000, chain.objs.size()=1 2024-09-12T01:10:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.952+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.vtTfR9EGavsOo7eGfyJd-rP_l96JPLS_0 2024-09-12T01:10:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.953+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10096636910409939493', time=2024-09-12T02:53:56.355783+0000, chain.objs.size()=1 2024-09-12T01:10:59.953 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.953+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.dF5kJhcnVwrd-5CRyzOq-DmxH8Qam4X_0 2024-09-12T01:10:59.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12014495315273550958', time=2024-09-12T02:53:56.491994+0000, chain.objs.size()=1 2024-09-12T01:10:59.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.eJgxniDr65uEkNyIhvpfZyYoINswNGm_0 2024-09-12T01:10:59.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11754536002373544297', time=2024-09-12T02:53:56.525875+0000, chain.objs.size()=1 2024-09-12T01:10:59.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Ok0uyP47DOj9gsiPL-gI-Coi0Lv_9Cp_0 2024-09-12T01:10:59.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10077167261129261744', time=2024-09-12T02:53:56.628030+0000, chain.objs.size()=1 2024-09-12T01:10:59.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.PvT4xCNsYaJuoPdWer7lybQy28mokjw_0 2024-09-12T01:10:59.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9127070213734824309', time=2024-09-12T02:53:56.776662+0000, chain.objs.size()=1 2024-09-12T01:10:59.955 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hstmXtc6FKb5j6POnwjRKUd_6zMxeCr_0 2024-09-12T01:10:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1890903011388415272', time=2024-09-12T02:53:56.794817+0000, chain.objs.size()=1 2024-09-12T01:10:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.FQm1XsGQd986Oa_56tjoXbkhXkg0wDw_0 2024-09-12T01:10:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3752126913674400978', time=2024-09-12T02:53:56.990732+0000, chain.objs.size()=1 2024-09-12T01:10:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.1UVBrnmitB9WXnFzBtrpMKCr6sHzJjI_0 2024-09-12T01:10:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10905793174497779334', time=2024-09-12T02:53:57.819145+0000, chain.objs.size()=1 2024-09-12T01:10:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.9mMFnj5AXY_8T2Hb5QtbgIAE_oTbhzx_0 2024-09-12T01:10:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11160020905325879648', time=2024-09-12T02:53:58.059557+0000, chain.objs.size()=1 2024-09-12T01:10:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.vRqI_qT4Mn5SoDqnAJhGWoYrHtgHNp-_0 2024-09-12T01:10:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6521617290443406729', time=2024-09-12T02:53:58.166281+0000, chain.objs.size()=1 2024-09-12T01:10:59.956 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.956+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nK9JXROyef-vvM-CMxQbKp-7TSvYLDZ_0 2024-09-12T01:10:59.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.958+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16071473896350421980', time=2024-09-12T02:53:58.215386+0000, chain.objs.size()=1 2024-09-12T01:10:59.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.958+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tKr78LAKgO8Wed6ELD-CFXpKHzjiqfv_0 2024-09-12T01:10:59.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.958+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16564024310368107595', time=2024-09-12T02:53:58.216832+0000, chain.objs.size()=1 2024-09-12T01:10:59.957 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.958+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.esI2BnbSasFBcg-xsFouV2rbJQOF0k0_0 2024-09-12T01:10:59.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.959+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3563248119855195588', time=2024-09-12T02:53:58.542875+0000, chain.objs.size()=1 2024-09-12T01:10:59.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.959+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0LdCS6gxUgTY8cZQLbskflNBKqe4fe6_0 2024-09-12T01:10:59.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.959+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11232051388412119511', time=2024-09-12T02:53:59.210833+0000, chain.objs.size()=1 2024-09-12T01:10:59.958 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.959+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.LA4a9wL4GmYd_15uFEft9rmq6JxvZVZ_0 2024-09-12T01:10:59.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.959+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.164618081765101204', time=2024-09-12T02:53:59.242030+0000, chain.objs.size()=1 2024-09-12T01:10:59.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.959+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.uMqNl_C1u-fdmfkXsYlaFhd4ujH2KCR_0 2024-09-12T01:10:59.959 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.959+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6270218754022272983', time=2024-09-12T02:53:59.347057+0000, chain.objs.size()=1 2024-09-12T01:10:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.959+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.3giTd7fvE7qUrNGogVibms_1G7q2M9f_0 2024-09-12T01:10:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.959+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6561580961753413622', time=2024-09-12T02:53:59.381497+0000, chain.objs.size()=1 2024-09-12T01:10:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.959+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ekTLuD5cDVvQehDdKeYqjW92GFLl2H8_0 2024-09-12T01:10:59.960 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.960+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16621992608297155254', time=2024-09-12T02:53:59.521901+0000, chain.objs.size()=1 2024-09-12T01:10:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.960+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.AFVBIxvqj3jb1Q7Vt_5Pf2yOs9YFd75_0 2024-09-12T01:10:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.960+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4722574564427914405', time=2024-09-12T02:54:36.747282+0000, chain.objs.size()=1 2024-09-12T01:10:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.960+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dDqAE5QXrqlq2GtAZAQIqVlyyXad3os_0 2024-09-12T01:10:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.960+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10652154331243934292', time=2024-09-12T02:54:36.844687+0000, chain.objs.size()=1 2024-09-12T01:10:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.960+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ZVOb8meNlgjZPLdy4B0bgMBTIfpqKo9_0 2024-09-12T01:10:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.960+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2848143143510055952', time=2024-09-12T02:54:37.223305+0000, chain.objs.size()=1 2024-09-12T01:10:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.960+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.oBbTFOQpQ34P6XXeUUKo3wuQPoDO5T1_0 2024-09-12T01:10:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.963+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2413042006626917432', time=2024-09-12T02:54:37.511051+0000, chain.objs.size()=1 2024-09-12T01:10:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.963+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.XA4lSlUpYMpbYOmpq0zzoePanBhuhlG_0 2024-09-12T01:10:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.963+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16087583158397048187', time=2024-09-12T02:54:37.591075+0000, chain.objs.size()=1 2024-09-12T01:10:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.963+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.xMGObvSqVle-plAqtnHAqK760RFtham_0 2024-09-12T01:10:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.963+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3537793943014254434', time=2024-09-12T02:54:38.872112+0000, chain.objs.size()=1 2024-09-12T01:10:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.963+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.y27Wmssephfqc3hK9Hki1A7TPN7LNao_0 2024-09-12T01:10:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.963+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10599525318593990334', time=2024-09-12T02:54:39.005532+0000, chain.objs.size()=1 2024-09-12T01:10:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.963+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.uJp1bmLTUMVgg2oSE_IAgdRRUlCWouX_0 2024-09-12T01:10:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.963+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17271742958904683163', time=2024-09-12T02:54:39.638223+0000, chain.objs.size()=1 2024-09-12T01:10:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.963+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.cw4f7Y3mWCLvi6iqubIgvMi0upB214q_0 2024-09-12T01:10:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.964+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10699736760779017996', time=2024-09-12T02:54:39.810039+0000, chain.objs.size()=1 2024-09-12T01:10:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.964+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.kCFu3pLRqu0Fycd--DVFLfssNYP9ku8_0 2024-09-12T01:10:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.964+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3523723217247760649', time=2024-09-12T02:54:40.257141+0000, chain.objs.size()=1 2024-09-12T01:10:59.963 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.964+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.afk1PCe4qiHHGdjQFPFz3xcho-yFi5k_0 2024-09-12T01:10:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.964+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4862798668850783249', time=2024-09-12T02:54:40.363210+0000, chain.objs.size()=1 2024-09-12T01:10:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.964+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.kbI3Z78GKY4bXJJXaEbhAVreWiO4fvE_0 2024-09-12T01:10:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.964+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11881877571555643756', time=2024-09-12T02:54:41.093538+0000, chain.objs.size()=1 2024-09-12T01:10:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.964+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9QX7i6WibGm3PntGKfJi7XrTRbXCAyn_0 2024-09-12T01:10:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.964+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1294136816318263002', time=2024-09-12T02:54:41.160310+0000, chain.objs.size()=1 2024-09-12T01:10:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.964+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.IxdWdG4nOoRgz9qpX0kzTN5-rrwXMRr_0 2024-09-12T01:10:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.966+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5407910449254126516', time=2024-09-12T02:54:41.525368+0000, chain.objs.size()=1 2024-09-12T01:10:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.966+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.AEgdsI5XOZMUQrK_fM5XN0R7h4dGbaX_0 2024-09-12T01:10:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.966+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14961313220511898692', time=2024-09-12T02:54:41.821435+0000, chain.objs.size()=1 2024-09-12T01:10:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.966+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.5U0G-IF1CmrTfpnHWH14P1zL8F_T6j3_0 2024-09-12T01:10:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.966+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15149896683626289357', time=2024-09-12T02:54:42.206939+0000, chain.objs.size()=1 2024-09-12T01:10:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.966+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.5hFwryvQchXXQ3mJZmdtUIglUFKsXcJ_0 2024-09-12T01:10:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.967+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6993072193324849724', time=2024-09-12T02:54:42.373568+0000, chain.objs.size()=1 2024-09-12T01:10:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.967+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.8ivLINBV5VHANiaYNuPplDiWwQd9TW7_0 2024-09-12T01:10:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.967+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15301588434026382694', time=2024-09-12T02:54:42.532450+0000, chain.objs.size()=1 2024-09-12T01:10:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.967+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dL6HoOBAV_3Gax5Gh851Un35IbbxeAp_0 2024-09-12T01:10:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.967+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4885009933174953320', time=2024-09-12T02:54:43.495737+0000, chain.objs.size()=1 2024-09-12T01:10:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.967+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.OwhE2mt7S-A5PMIlqTrMTdJdsfS9dgg_0 2024-09-12T01:10:59.970 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.971+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/48366 2024-09-12T01:10:59.972 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T01:10:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15241640787077187746', time=2024-09-12T02:54:44.026183+0000, chain.objs.size()=1 2024-09-12T01:10:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.YACMWGbFY36tF91VzWt96DaUB8GBUhF_0 2024-09-12T01:10:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8793758777249719865', time=2024-09-12T02:54:44.096837+0000, chain.objs.size()=1 2024-09-12T01:10:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.nbRtDK5QaB74unBloZ7AzTKH17Tbo-O_0 2024-09-12T01:10:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7006173346259251768', time=2024-09-12T02:54:44.097610+0000, chain.objs.size()=1 2024-09-12T01:10:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._FJDw0pzaRwyxURxJ7byO9sMaKJbypI_0 2024-09-12T01:10:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1955004529809092056', time=2024-09-12T02:54:44.185151+0000, chain.objs.size()=1 2024-09-12T01:10:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.S-Htp_t4r6obfPX8ANelFwimRjxxSqz_0 2024-09-12T01:10:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15018548722566334643', time=2024-09-12T02:54:44.363447+0000, chain.objs.size()=1 2024-09-12T01:10:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.D7_Y6AV6nWIiO_1U7gslhzBOhZyo_jt_0 2024-09-12T01:10:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6628834978626789283', time=2024-09-12T02:54:44.465663+0000, chain.objs.size()=1 2024-09-12T01:10:59.973 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Vh23aIOsVo5DzOUFA2gDmhyQPPnflAj_0 2024-09-12T01:10:59.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6087627476454744315', time=2024-09-12T02:54:44.668520+0000, chain.objs.size()=1 2024-09-12T01:10:59.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.B4Hf-Qo6zJ-7vfTGJrahgq9tdzbdZFB_0 2024-09-12T01:10:59.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13799066922653072653', time=2024-09-12T02:54:45.181181+0000, chain.objs.size()=1 2024-09-12T01:10:59.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.IcwcfS0WfdAy99NJcKJ4dzxFjnso9Y4_0 2024-09-12T01:10:59.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15264626957612352402', time=2024-09-12T02:54:45.705257+0000, chain.objs.size()=1 2024-09-12T01:10:59.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.rBOOUKKFWFql4m4W5rzbDHNm_ZnnHn5_0 2024-09-12T01:10:59.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15340907236720308705', time=2024-09-12T02:54:45.807790+0000, chain.objs.size()=1 2024-09-12T01:10:59.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.CQ_k2WRZCbFLetjcRQ40Mw_RtKOeLSS_0 2024-09-12T01:10:59.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9388668099545577149', time=2024-09-12T02:54:45.831048+0000, chain.objs.size()=1 2024-09-12T01:10:59.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.UMrdxSvPXIX5esC0U3-pDHTHnVpBwXo_0 2024-09-12T01:10:59.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1023689295890204671', time=2024-09-12T02:54:45.875654+0000, chain.objs.size()=1 2024-09-12T01:10:59.974 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.973+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.VQ_xNJimomEwkEtXHMdBKKpMl27PW8C_0 2024-09-12T01:10:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2242467834502551449', time=2024-09-12T02:54:46.311733+0000, chain.objs.size()=1 2024-09-12T01:10:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.pYDjsy3Nje4m6R_Wqo6iToj6cB7M1ZH_0 2024-09-12T01:10:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9217889702275614512', time=2024-09-12T02:54:46.470000+0000, chain.objs.size()=1 2024-09-12T01:10:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.FMMO0l90G7jRfvGbg4zFB191SXutSzy_0 2024-09-12T01:10:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6645537017370991145', time=2024-09-12T02:54:46.572369+0000, chain.objs.size()=1 2024-09-12T01:10:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.2wMUZgxEgZ3nTl7tKuJtKk54uj74n8j_0 2024-09-12T01:10:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1734187022615691952', time=2024-09-12T02:54:46.810956+0000, chain.objs.size()=1 2024-09-12T01:10:59.976 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ed7qDJP6EDI2mrcddfQTyHwZ0dj00Pa_0 2024-09-12T01:10:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16850196941519224522', time=2024-09-12T02:54:47.091755+0000, chain.objs.size()=1 2024-09-12T01:10:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.lrpucmYIz829W8IyFAr2bsMu91wSvuw_0 2024-09-12T01:10:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9521836668539693845', time=2024-09-12T02:55:21.252028+0000, chain.objs.size()=1 2024-09-12T01:10:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.391__shadow_.0G0LbRR7oKx1h1kgucf5xslNgCjurP1_0 2024-09-12T01:10:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.513453672323373863', time=2024-09-12T02:56:29.846510+0000, chain.objs.size()=1 2024-09-12T01:10:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.504__shadow:IjSk329PwyZ.TikPwkNaT-eseYUSzXd_.b_0nQhQp9blBOoB3SP2J2YjUhbBu0Hw_0 2024-09-12T01:10:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~HN95Az9hblAL1pN12FhYfjIJBQXMGOj', time=2024-09-12T02:57:51.539105+0000, chain.objs.size()=1 2024-09-12T01:10:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~HN95Az9hblAL1pN12FhYfjIJBQXMGOj.2 2024-09-12T01:10:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~HN95Az9hblAL1pN12FhYfjIJBQXMGOj', time=2024-09-12T02:57:51.542859+0000, chain.objs.size()=1 2024-09-12T01:10:59.977 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.977+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~HN95Az9hblAL1pN12FhYfjIJBQXMGOj.3 2024-09-12T01:10:59.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.978+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11841411505399643425', time=2024-09-12T03:00:03.881024+0000, chain.objs.size()=1 2024-09-12T01:10:59.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.978+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.571__shadow:Nf7pQMwUtJpMY-B.dh2KLnYf6gfpSL2_.WR-_s6C-ajuuSMFxGnv_Q0cKZ99K3Cg_0 2024-09-12T01:10:59.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.978+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12820557117108434247', time=2024-09-12T03:00:15.268200+0000, chain.objs.size()=1 2024-09-12T01:10:59.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.978+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.577__shadow:ah9f8TBH77cQViixOWTce0YwhoBTcHj_.YfSVGxVNsDgTxrSqjTZkYuOldx4_VgE_0 2024-09-12T01:10:59.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.979+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8572474903825392692', time=2024-09-12T03:00:16.327283+0000, chain.objs.size()=1 2024-09-12T01:10:59.978 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.979+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.577__shadow:LtpUk9GoA9nJlHsF3FIf-8oG8LmQU.7_.tnkISVbQ8GPEeQ1S3b9ksttZEqUq7c1_0 2024-09-12T01:10:59.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.981+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1350973566193551395', time=2024-09-12T03:00:26.373418+0000, chain.objs.size()=1 2024-09-12T01:10:59.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.981+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:L0CU0nI9O6kmqwDRT0j-joq-SpYRf.C_.QwOg7oc6yiu6kc-w2BiiPfsvGDq6Rjb_0 2024-09-12T01:10:59.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.981+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3832807249410786937', time=2024-09-12T03:00:37.207229+0000, chain.objs.size()=1 2024-09-12T01:10:59.980 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.981+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:9gi6R8rcvGMfEopg5azHM06ValugbtE_.EuN1Rzs1AozG_AphXQPFcrCUn0DiXzl_0 2024-09-12T01:10:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.981+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12193126825345542648', time=2024-09-12T03:00:37.708565+0000, chain.objs.size()=1 2024-09-12T01:10:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.981+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:LgvvRo6Q.EhRPkXnkLpb-5FCUg4hFD2_.Kyecez3jp4yBDZh3i-jpDzoAClx4uAh_0 2024-09-12T01:10:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.981+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13947469142596577990', time=2024-09-12T03:05:15.188375+0000, chain.objs.size()=1 2024-09-12T01:10:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.981+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.655__shadow_.jGn_4Ldu1wZjjQoVaB05sSdI7ypHV9W_0 2024-09-12T01:10:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.982+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15862675554053102182', time=2024-09-12T03:05:36.474694+0000, chain.objs.size()=1 2024-09-12T01:10:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.982+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.667__shadow_.v3v1ZZRrduYwH4PjXz2PWFW6WxTVTYo_0 2024-09-12T01:10:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.982+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16778984759185649821', time=2024-09-12T03:06:00.068586+0000, chain.objs.size()=1 2024-09-12T01:10:59.981 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.982+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.711__shadow:i87H8bSmbqM9FmHdBmD79KP-L2Uo4BA_.OOgciUYRBzBQf04weUZyAq5-E_XajW8_0 2024-09-12T01:10:59.984 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.985+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:10:59.986 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.987+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:10:59.987 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.988+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:10:59.988 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.989+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:10:59.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51451' 2024-09-12T01:10:59.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14303311679238336413', time=2024-09-12T02:49:35.017323+0000, chain.objs.size()=1 2024-09-12T01:10:59.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.172__shadow_.3f3f67o6pAIvfujdt8Ye4d6p_YORAFN_0 2024-09-12T01:10:59.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~ISLS2_iBVeIDG55qgUZgHVjb6yEwDwK', time=2024-09-12T02:50:00.056053+0000, chain.objs.size()=1 2024-09-12T01:10:59.989 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.202__multipart_mymultipart.2~ISLS2_iBVeIDG55qgUZgHVjb6yEwDwK.1 2024-09-12T01:10:59.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14391780876710698119', time=2024-09-12T02:51:27.260130+0000, chain.objs.size()=1 2024-09-12T01:10:59.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.234__shadow_.nLu7_sCFdyxaQPvxpTvw1zw2clx863b_0 2024-09-12T01:10:59.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15671682410745255305', time=2024-09-12T02:51:28.524107+0000, chain.objs.size()=1 2024-09-12T01:10:59.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.236__shadow_.ep1ZUoGPjVjONXoJHpgz-7VdD1iB4j2_0 2024-09-12T01:10:59.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.358695527501261490', time=2024-09-12T02:51:39.530624+0000, chain.objs.size()=1 2024-09-12T01:10:59.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.253__shadow_.GgS2HTWGn0DMA7rPm_6tK6i-eBaLYIE_0 2024-09-12T01:10:59.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12949358896403655516', time=2024-09-12T02:52:21.257185+0000, chain.objs.size()=1 2024-09-12T01:10:59.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.YCkKOsxEqISzo0IfCZuKOu8HTV_gwV__0 2024-09-12T01:10:59.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15318803781213896946', time=2024-09-12T02:52:21.740951+0000, chain.objs.size()=1 2024-09-12T01:10:59.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Gnx-ZsvxICqr3Rymfupjq23E_Yd50t6_0 2024-09-12T01:10:59.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3882380918676042997', time=2024-09-12T02:52:21.884760+0000, chain.objs.size()=1 2024-09-12T01:10:59.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.-48MGGMRimTBq6Up89EBA0pHB2mrUN1_0 2024-09-12T01:10:59.990 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14470159066191328194', time=2024-09-12T02:52:21.917998+0000, chain.objs.size()=1 2024-09-12T01:10:59.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.hMxW1fbxYdOEyN-g6Zww__U77XBcS1I_0 2024-09-12T01:10:59.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8171757349452327956', time=2024-09-12T02:52:21.939051+0000, chain.objs.size()=1 2024-09-12T01:10:59.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.FkJOXpj5q8iBkyDviGYUnrKjmK06jn__0 2024-09-12T01:10:59.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16662738120097136275', time=2024-09-12T02:52:23.263023+0000, chain.objs.size()=1 2024-09-12T01:10:59.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uUFZBzJrMcqCSbYPDJxCJn_aL_EQ9AW_0 2024-09-12T01:10:59.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8160706088780470604', time=2024-09-12T02:52:24.150382+0000, chain.objs.size()=1 2024-09-12T01:10:59.991 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.990+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uV3VrDfgwBtzvFvDTR3XBSqF23_U-PS_0 2024-09-12T01:10:59.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15294932486154454321', time=2024-09-12T02:52:24.152340+0000, chain.objs.size()=1 2024-09-12T01:10:59.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0dfYc1uzUR2o2XqAyjxTYG5rQ5D6ocy_0 2024-09-12T01:10:59.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15343807479032279131', time=2024-09-12T02:52:24.371253+0000, chain.objs.size()=1 2024-09-12T01:10:59.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.wG1tO1eIB7MAYhv-rgnzlkXMXaf8eeu_0 2024-09-12T01:10:59.994 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.712334155295486514', time=2024-09-12T02:52:25.686289+0000, chain.objs.size()=1 2024-09-12T01:10:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4nqkyJbUaERnHDREyZm4kZM8MbBF9q0_0 2024-09-12T01:10:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10895838498424805955', time=2024-09-12T02:52:25.688347+0000, chain.objs.size()=1 2024-09-12T01:10:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4ebvhSKeSRD8tIStyz0DCfu2Iegeh7m_0 2024-09-12T01:10:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1607163025800598939', time=2024-09-12T02:52:26.482289+0000, chain.objs.size()=1 2024-09-12T01:10:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.qb7TAW0l86P9_9t0DST_AxhiqIGUXv1_0 2024-09-12T01:10:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13349214613747371421', time=2024-09-12T02:52:26.690450+0000, chain.objs.size()=1 2024-09-12T01:10:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.4RfVoW9wChUv4e_bKW_3qft7Ibcvv5R_0 2024-09-12T01:10:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7134846090842237273', time=2024-09-12T02:52:27.504535+0000, chain.objs.size()=1 2024-09-12T01:10:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.y8HUCe9QKZn2AYF-0EAe9A1abTbfb8k_0 2024-09-12T01:10:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3114954520465877111', time=2024-09-12T02:52:27.783016+0000, chain.objs.size()=1 2024-09-12T01:10:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.qMDAGGufySQVqgHLp0cWEPjAO6181Re_0 2024-09-12T01:10:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.152679830391089032', time=2024-09-12T02:52:28.509929+0000, chain.objs.size()=1 2024-09-12T01:10:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.g8vvFoXJ4O4_JldubPNH7dPnY9AcD5d_0 2024-09-12T01:10:59.995 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4860355375980236681', time=2024-09-12T02:52:28.706177+0000, chain.objs.size()=1 2024-09-12T01:10:59.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.hXZA8lFR1nYUeR8XqZn1eAKbgKucKPK_0 2024-09-12T01:10:59.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7452446207852175481', time=2024-09-12T02:52:29.210781+0000, chain.objs.size()=1 2024-09-12T01:10:59.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.994+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.6weWj3d2LAF9V63z0B73tljFUdQ2mR3_0 2024-09-12T01:10:59.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.997+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.181793820454260324', time=2024-09-12T02:52:29.220762+0000, chain.objs.size()=1 2024-09-12T01:10:59.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.997+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.qHMWpdasve9vL0_BDTnYyw7vMO_bx5O_0 2024-09-12T01:10:59.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.997+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11242927163936959515', time=2024-09-12T02:52:29.863963+0000, chain.objs.size()=1 2024-09-12T01:10:59.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.997+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.X_IQXZ1Voxn-EXiW5OHkqJ3eF4yk75G_0 2024-09-12T01:10:59.996 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.997+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12863165634944004023', time=2024-09-12T02:52:29.864594+0000, chain.objs.size()=1 2024-09-12T01:10:59.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.997+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.aNEh3xkJmLl_RnwU_k3MF7JQuYyN0nd_0 2024-09-12T01:10:59.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.998+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3449940960059412425', time=2024-09-12T02:52:30.595526+0000, chain.objs.size()=1 2024-09-12T01:10:59.997 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.998+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.O9FluAU9s3RBgzkdO4M4EBHOhRWcruo_0 2024-09-12T01:10:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.998+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6601837934380290349', time=2024-09-12T02:52:30.703835+0000, chain.objs.size()=1 2024-09-12T01:10:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.998+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.29suaH0InsBUaNmhdCNMzJelIfuouGJ_0 2024-09-12T01:10:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.998+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11133168720722471441', time=2024-09-12T02:52:31.157192+0000, chain.objs.size()=1 2024-09-12T01:10:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.998+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.mLJbnpJxHw8DP-fDfFfVXwg9CXUaeX7_0 2024-09-12T01:10:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.998+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8156069167147059148', time=2024-09-12T02:52:31.607608+0000, chain.objs.size()=1 2024-09-12T01:10:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.998+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.tW9PUasJ6sYEpFCJy7wlCbsLHRNMP5h_0 2024-09-12T01:10:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.998+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10765597938923500169', time=2024-09-12T02:52:31.795871+0000, chain.objs.size()=1 2024-09-12T01:10:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.998+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uDnmRnI1jo0q_cz_K7R-G9YYXyDLOIB_0 2024-09-12T01:10:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.998+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15498907228898967473', time=2024-09-12T02:52:31.899764+0000, chain.objs.size()=1 2024-09-12T01:10:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.998+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.eNmsmIPgSCVnbdBSglPKDcbB2nvz1dJ_0 2024-09-12T01:10:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.998+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9247725557436108549', time=2024-09-12T02:52:31.908024+0000, chain.objs.size()=1 2024-09-12T01:10:59.998 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.998+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.AgXhDIWxLhi8DeP5q-JuGvzmkC14ydv_0 2024-09-12T01:10:59.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.999+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14876928364888852041', time=2024-09-12T02:52:35.935089+0000, chain.objs.size()=1 2024-09-12T01:10:59.999 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:10:59.999+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.270__shadow_.IaDMGYjHL5fNjWClsmPr5QrT0FzuOYZ_0 2024-09-12T01:11:00.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.001+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3552008703783631382', time=2024-09-12T02:52:39.368244+0000, chain.objs.size()=1 2024-09-12T01:11:00.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.001+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.276__shadow_.Lc8Av57LScvdF4zkOS9gtD4t-L33FzU_0 2024-09-12T01:11:00.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.001+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17014069518502016358', time=2024-09-12T02:52:39.369010+0000, chain.objs.size()=1 2024-09-12T01:11:00.000 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.001+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.276__shadow_.7z8iegvx7oA_8CWdsfIJ8TfP7KKN5-R_0 2024-09-12T01:11:00.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.001+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9737164507439768017', time=2024-09-12T02:52:47.990471+0000, chain.objs.size()=1 2024-09-12T01:11:00.001 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.001+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.290__shadow_.h4AfVUUbAYu80lIOurKtkUjGOzevfg5_0 2024-09-12T01:11:00.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.002+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11219445777649782188', time=2024-09-12T02:52:51.110468+0000, chain.objs.size()=1 2024-09-12T01:11:00.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.002+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.dKawqq-svraHdQHbO6PrcNCfHXOjGN2_0 2024-09-12T01:11:00.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.102267575083888772', time=2024-09-12T02:52:53.196444+0000, chain.objs.size()=1 2024-09-12T01:11:00.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.wxtoLsn4oKmTs1ndJZH9YDuuMJMl3QZ_0 2024-09-12T01:11:00.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5888854929002916703', time=2024-09-12T02:53:49.402472+0000, chain.objs.size()=1 2024-09-12T01:11:00.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.3P9nOxCapGR0Pi5L6gLn2TF7UdbDNqg_0 2024-09-12T01:11:00.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2675509432551127207', time=2024-09-12T02:53:50.062390+0000, chain.objs.size()=1 2024-09-12T01:11:00.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cxWI8Jo_MocUYPe2JvtWGCbrsHMlyCn_0 2024-09-12T01:11:00.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16554162971107322955', time=2024-09-12T02:53:51.048693+0000, chain.objs.size()=1 2024-09-12T01:11:00.002 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nPE2ZVjcusSA5S4EyXg6jj03d90P40K_0 2024-09-12T01:11:00.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1031216149685911700', time=2024-09-12T02:53:51.260110+0000, chain.objs.size()=1 2024-09-12T01:11:00.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.E-31czGCuGRDGEJ7FpXDnEtYaLU0k-Z_0 2024-09-12T01:11:00.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14867013542129268630', time=2024-09-12T02:53:51.851523+0000, chain.objs.size()=1 2024-09-12T01:11:00.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.BIPEhdsgXwNypQIdZxUhIvoOW0FIG57_0 2024-09-12T01:11:00.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.003+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16834252762127438137', time=2024-09-12T02:53:52.519657+0000, chain.objs.size()=1 2024-09-12T01:11:00.003 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.003+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.6caH2SM8IDlNDjRu6jr_QAR12v4SXC2_0 2024-09-12T01:11:00.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.005+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4428036864956707811', time=2024-09-12T02:53:52.699685+0000, chain.objs.size()=1 2024-09-12T01:11:00.004 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.005+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.yQMTOTWd1eflH0DJRdruhtBPdtT19W9_0 2024-09-12T01:11:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.005+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5063305795368608857', time=2024-09-12T02:53:53.086091+0000, chain.objs.size()=1 2024-09-12T01:11:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.005+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.iQXhbIzG-cm325CzSNITdI-FWFvYKZS_0 2024-09-12T01:11:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.005+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18356425974984811742', time=2024-09-12T02:53:53.086924+0000, chain.objs.size()=1 2024-09-12T01:11:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.005+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.gUL1jFnXTn9Sk0Fft3N4nd3zHmDjZvu_0 2024-09-12T01:11:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.005+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7436794112144518885', time=2024-09-12T02:53:53.112471+0000, chain.objs.size()=1 2024-09-12T01:11:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.005+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.esjOgHF4o7ZrxlSM7LgASYItH3girxZ_0 2024-09-12T01:11:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.006+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6356979522541652874', time=2024-09-12T02:53:53.730080+0000, chain.objs.size()=1 2024-09-12T01:11:00.005 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.006+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.RXp0BxlJlSU6aa7MsfGGgzYRLYCpdMh_0 2024-09-12T01:11:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.007+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10208370152091114949', time=2024-09-12T02:53:53.844733+0000, chain.objs.size()=1 2024-09-12T01:11:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.007+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.DxpSZTZk1BD6eb7boG67RyDAtPrbCjE_0 2024-09-12T01:11:00.006 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.007+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16476883814376093273', time=2024-09-12T02:53:53.845420+0000, chain.objs.size()=1 2024-09-12T01:11:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.007+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lfIh4zKivvt7_2w1rGLDDN_wNKLPskc_0 2024-09-12T01:11:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.007+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14222122604939602048', time=2024-09-12T02:53:54.268694+0000, chain.objs.size()=1 2024-09-12T01:11:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.007+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hk5iMDcmb0Nxb01QxXfS8zzcAGkLyts_0 2024-09-12T01:11:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.007+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17669393607750621049', time=2024-09-12T02:53:54.495465+0000, chain.objs.size()=1 2024-09-12T01:11:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.007+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.tpCx1aHQiwt3xr0ABRfTE0DImOd6FWb_0 2024-09-12T01:11:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.007+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2042698889790473673', time=2024-09-12T02:53:54.496093+0000, chain.objs.size()=1 2024-09-12T01:11:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.007+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.98izukuJWTjOi3yf-BdFOCFrU3WqJCL_0 2024-09-12T01:11:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.007+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3664799344622924920', time=2024-09-12T02:53:54.692349+0000, chain.objs.size()=1 2024-09-12T01:11:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.007+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.JxRN9IqQAyLfDtybdkT0dbRUk-6rJMT_0 2024-09-12T01:11:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.007+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4928488055549010428', time=2024-09-12T02:53:55.182152+0000, chain.objs.size()=1 2024-09-12T01:11:00.007 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.007+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5d1dPeeeDiZIlgcvFG34fIx5z74IGsj_0 2024-09-12T01:11:00.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.008+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9293890009601995947', time=2024-09-12T02:53:56.042245+0000, chain.objs.size()=1 2024-09-12T01:11:00.008 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.008+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.91H0Rxat1ExyBii6t50WLuYvE-bznZw_0 2024-09-12T01:11:00.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.010+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5352985861699812854', time=2024-09-12T02:53:58.460567+0000, chain.objs.size()=1 2024-09-12T01:11:00.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.010+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_._MnMGLBEAvjUzxYD2mrLHHkN9t80LRu_0 2024-09-12T01:11:00.009 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.010+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10000373529695462700', time=2024-09-12T02:53:58.666499+0000, chain.objs.size()=1 2024-09-12T01:11:00.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.010+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.qwSnzsHIK8d9REsnkusCu8ENv4jjMB-_0 2024-09-12T01:11:00.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.010+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7125095317789775791', time=2024-09-12T02:53:58.963843+0000, chain.objs.size()=1 2024-09-12T01:11:00.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.010+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Ca-j50CdufAl3-1Ny5PxrmiLkF9q2Kc_0 2024-09-12T01:11:00.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.011+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11315800231710970258', time=2024-09-12T02:53:59.467475+0000, chain.objs.size()=1 2024-09-12T01:11:00.010 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.011+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.8FzHY3n-UUPzBpnGmBq2AnaTuUpUVf8_0 2024-09-12T01:11:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.012+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16789401409851107078', time=2024-09-12T02:53:59.652465+0000, chain.objs.size()=1 2024-09-12T01:11:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.012+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.IAzoC8eo_TMO00fElISAUGSrKkXNxVS_0 2024-09-12T01:11:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.012+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7776515515357163723', time=2024-09-12T02:54:36.683789+0000, chain.objs.size()=1 2024-09-12T01:11:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.012+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.AFbsVVScp_hLUuyG2KfiLMDY7BLqZMb_0 2024-09-12T01:11:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.012+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7786815646943025300', time=2024-09-12T02:54:36.752394+0000, chain.objs.size()=1 2024-09-12T01:11:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.012+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Z0jSRPnqIDqZqB3biRb8UbtaVizuQJx_0 2024-09-12T01:11:00.011 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.012+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13526985420670253464', time=2024-09-12T02:54:36.898723+0000, chain.objs.size()=1 2024-09-12T01:11:00.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.012+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.mf2YLJo2ofHIfNUoOTc-7LO-wRStMJq_0 2024-09-12T01:11:00.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.012+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7889906760533184101', time=2024-09-12T02:54:36.899485+0000, chain.objs.size()=1 2024-09-12T01:11:00.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.012+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.c7eYV_k2zjlxEH6rYAi5H7S3aewqFdk_0 2024-09-12T01:11:00.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.012+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8530304068057182458', time=2024-09-12T02:54:37.186865+0000, chain.objs.size()=1 2024-09-12T01:11:00.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.012+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.P441M7YoDQnGvw4ubFa9uB6J7FQh63V_0 2024-09-12T01:11:00.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.012+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3267355530135617276', time=2024-09-12T02:54:37.283085+0000, chain.objs.size()=1 2024-09-12T01:11:00.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.012+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.fbUnVHXDf6NPxd7w0PLHJr84BfqMA_X_0 2024-09-12T01:11:00.012 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.013+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12291137788241260352', time=2024-09-12T02:54:37.518705+0000, chain.objs.size()=1 2024-09-12T01:11:00.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.013+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.TBktax8h7OQ6BVFGO2ifPIVJqdo1qW9_0 2024-09-12T01:11:00.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.013+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13626545377790321357', time=2024-09-12T02:54:37.519416+0000, chain.objs.size()=1 2024-09-12T01:11:00.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.013+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9pIL_15Qm-N4pg49s2_doF7kYJrkIZg_0 2024-09-12T01:11:00.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.014+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1440805754286010342', time=2024-09-12T02:54:38.424644+0000, chain.objs.size()=1 2024-09-12T01:11:00.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.014+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.rHXQZUv_6Sv7oFyduRfx5aPDRZkX7gm_0 2024-09-12T01:11:00.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.014+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6028284138280557632', time=2024-09-12T02:54:38.572408+0000, chain.objs.size()=1 2024-09-12T01:11:00.013 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.014+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.q0dPw4N_NSevC2YxBrLFkuo1tvwJbA-_0 2024-09-12T01:11:00.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.016+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1947467861936331623', time=2024-09-12T02:54:38.942338+0000, chain.objs.size()=1 2024-09-12T01:11:00.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.016+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Le815RdNexQmu66uR4oWjzKbBVVYVST_0 2024-09-12T01:11:00.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.016+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5461127531280653153', time=2024-09-12T02:54:39.025090+0000, chain.objs.size()=1 2024-09-12T01:11:00.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.016+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.yjbgDBojxk0jIj-3PFmTpaPfkIxgWod_0 2024-09-12T01:11:00.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.016+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12841417141934985893', time=2024-09-12T02:54:40.241860+0000, chain.objs.size()=1 2024-09-12T01:11:00.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.016+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.bpOtd5qq87BmxIKZKO2QPNCtl_UQAU__0 2024-09-12T01:11:00.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.016+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6558517764959569103', time=2024-09-12T02:54:41.064168+0000, chain.objs.size()=1 2024-09-12T01:11:00.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.016+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.z1lctG0XmRLmmrGMN38YNYpwka2bfRn_0 2024-09-12T01:11:00.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.017+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10026009410844749896', time=2024-09-12T02:54:41.508058+0000, chain.objs.size()=1 2024-09-12T01:11:00.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.017+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.tevn7sVNwR8FjPolvIe5Ff_b6NUJ0q__0 2024-09-12T01:11:00.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.017+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1216967970242819377', time=2024-09-12T02:54:41.608570+0000, chain.objs.size()=1 2024-09-12T01:11:00.016 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.017+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.To_a6K6dxCt9Am9YyJOKbiohysYchwW_0 2024-09-12T01:11:00.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.017+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11242971286481266853', time=2024-09-12T02:54:41.717457+0000, chain.objs.size()=1 2024-09-12T01:11:00.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.017+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.InDna7GjTKquZqtNbxOcoF0pOLr784c_0 2024-09-12T01:11:00.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.017+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3503392360155366798', time=2024-09-12T02:54:42.837504+0000, chain.objs.size()=1 2024-09-12T01:11:00.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.017+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.wSliDG5Ut1RYUWoikGUUI7W1Ks2P0SE_0 2024-09-12T01:11:00.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.017+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7872799243638415885', time=2024-09-12T02:54:43.433347+0000, chain.objs.size()=1 2024-09-12T01:11:00.017 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.017+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Jn1XD4V5GosiJBWFCw0leDADbPjvXUG_0 2024-09-12T01:11:00.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.019+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1705093923436927444', time=2024-09-12T02:54:43.434095+0000, chain.objs.size()=1 2024-09-12T01:11:00.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.019+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.tTKNLvSRXqkrSf3V_B869Mw7zrNNeIZ_0 2024-09-12T01:11:00.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.019+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12262227795688620889', time=2024-09-12T02:54:43.465063+0000, chain.objs.size()=1 2024-09-12T01:11:00.018 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.019+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.oVguyESbZZ70SVQ9zrUkituAGOraW4s_0 2024-09-12T01:11:00.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11971921260525234120', time=2024-09-12T02:54:44.222476+0000, chain.objs.size()=1 2024-09-12T01:11:00.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9XsCp6bYWZtYd_UpOLe9dHKTSXuEkJa_0 2024-09-12T01:11:00.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7966809724577524990', time=2024-09-12T02:54:44.352811+0000, chain.objs.size()=1 2024-09-12T01:11:00.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.e_TgO3xHeqKf6vpx0XOXQp__pSlhfp6_0 2024-09-12T01:11:00.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15797089558764184688', time=2024-09-12T02:54:44.653147+0000, chain.objs.size()=1 2024-09-12T01:11:00.020 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.IutJsI1KDmQsyxnbRnv_wz2bZix2Rax_0 2024-09-12T01:11:00.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18076866028161513856', time=2024-09-12T02:54:45.124933+0000, chain.objs.size()=1 2024-09-12T01:11:00.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.XvI8zyYBeEQ2FNKOQ0ytgl5tmM7DYlt_0 2024-09-12T01:11:00.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9185992577395175790', time=2024-09-12T02:54:45.255269+0000, chain.objs.size()=1 2024-09-12T01:11:00.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ozgSSZ95prlwO2EhNS6E7fPHnMiqo7d_0 2024-09-12T01:11:00.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8800773147242271650', time=2024-09-12T02:54:45.420865+0000, chain.objs.size()=1 2024-09-12T01:11:00.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.HcIKP9r_gfzdcz3RpI37QFy-op2N1In_0 2024-09-12T01:11:00.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3092856865358172099', time=2024-09-12T02:54:45.706065+0000, chain.objs.size()=1 2024-09-12T01:11:00.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.p2O5aVyaMaQjOVMp1m2LzLCcbGhFbYJ_0 2024-09-12T01:11:00.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4276982864208693661', time=2024-09-12T02:54:46.502365+0000, chain.objs.size()=1 2024-09-12T01:11:00.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.isqDl5BFadjl0tdO-duCJvdv6s0vDfB_0 2024-09-12T01:11:00.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14172086920279370309', time=2024-09-12T02:54:46.668965+0000, chain.objs.size()=1 2024-09-12T01:11:00.021 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.021+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.IABCZznAAG7BBFmwo1C1UnHf90-S-Av_0 2024-09-12T01:11:00.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.023+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9570908462654049287', time=2024-09-12T02:54:46.863396+0000, chain.objs.size()=1 2024-09-12T01:11:00.022 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.023+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.gVzDDzqHQ6o-Fa-4lmGeleTSI_aO9fQ_0 2024-09-12T01:11:00.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.023+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17656709838709296791', time=2024-09-12T02:54:46.982057+0000, chain.objs.size()=1 2024-09-12T01:11:00.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.023+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dOvrj4jFWFh4dmxhQ523q3ULNS0I0VD_0 2024-09-12T01:11:00.023 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.024+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17109064553236360526', time=2024-09-12T02:54:47.025237+0000, chain.objs.size()=1 2024-09-12T01:11:00.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.024+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ZuB2UH1sM1V1gWm8XWiNQOybRMthNO-_0 2024-09-12T01:11:00.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.024+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1431538609073117143', time=2024-09-12T02:54:51.812015+0000, chain.objs.size()=1 2024-09-12T01:11:00.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.024+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.334__shadow_.0XC92osf9yrHUQ6HQWDLOSuGH5Iju-N_0 2024-09-12T01:11:00.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.024+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6389484521047851841', time=2024-09-12T02:55:14.875468+0000, chain.objs.size()=1 2024-09-12T01:11:00.024 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.024+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.380__shadow_.mjncwZRobgSOk_deVV_dOduc4dWgIsH_0 2024-09-12T01:11:00.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.026+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.914439934838137483', time=2024-09-12T02:56:14.351890+0000, chain.objs.size()=1 2024-09-12T01:11:00.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.026+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.484__shadow_.1nnMAQMImYxCOylNgVLGjYOqiz46H5M_0 2024-09-12T01:11:00.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.026+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16593218159530624598', time=2024-09-12T02:56:24.649507+0000, chain.objs.size()=1 2024-09-12T01:11:00.025 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.026+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.497__shadow_.irI35RwRYGYN6_ZirVqbD-VICrbMxci_0 2024-09-12T01:11:00.027 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.028+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/51451 2024-09-12T01:11:00.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T01:11:00.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2099714363243479344', time=2024-09-12T02:58:18.933342+0000, chain.objs.size()=1 2024-09-12T01:11:00.030 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.526__multipart_mymultipart.2~sOM7NX925EfBpN3o2rDx0wzs5Q-Go6m.1 2024-09-12T01:11:00.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8456417837486868174', time=2024-09-12T02:58:59.809481+0000, chain.objs.size()=4 2024-09-12T01:11:00.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.536__multipart_mymultipart.2~6hH7Xbg__Ajz8rxMAg1Iu1SiicBFaL7.1 2024-09-12T01:11:00.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.536__multipart_mymultipart.2~6hH7Xbg__Ajz8rxMAg1Iu1SiicBFaL7.2 2024-09-12T01:11:00.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.536__multipart_mymultipart.rJ9bTWC8Bh-LAjrqShreRquAnYQoHCaT.3 2024-09-12T01:11:00.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.536__multipart_mymultipart.2~6hH7Xbg__Ajz8rxMAg1Iu1SiicBFaL7.4 2024-09-12T01:11:00.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.946107139730059407', time=2024-09-12T02:59:50.558128+0000, chain.objs.size()=1 2024-09-12T01:11:00.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.567__shadow_.MZlbiSkrA41WlvdHBPiIjvqbnmFUC0T_0 2024-09-12T01:11:00.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7225628650965237688', time=2024-09-12T03:00:00.082124+0000, chain.objs.size()=1 2024-09-12T01:11:00.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:4JbQXjMRq8MYLzAbaHUB57l9MhlnqWQ_.NVWbZnMUGW6ha2p-nMBZAWdxHp9eTjL_0 2024-09-12T01:11:00.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5836884093029360868', time=2024-09-12T03:00:01.422812+0000, chain.objs.size()=1 2024-09-12T01:11:00.031 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:G99wP1bIfh6WZ1EeDpL-Zd.quYz-bzs_.lWfzCDB14ZKABu2QWdRBY2Ral2ndj9c_0 2024-09-12T01:11:00.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10601010439712350138', time=2024-09-12T03:00:08.006503+0000, chain.objs.size()=1 2024-09-12T01:11:00.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.575__shadow:opG2PD4lYWZoCIHOx9UFXITfetPnx99_._tkO7-kKNb4ogZVjs4HTnamA3Q0vIi-_0 2024-09-12T01:11:00.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13595045128173634271', time=2024-09-12T03:00:08.633356+0000, chain.objs.size()=1 2024-09-12T01:11:00.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.575__shadow:tv5fBObFPeM84jRKMkSG2wNUBm4YTjK_.uKWuObzePkOWabiaMZsc4fDou6W2IKY_0 2024-09-12T01:11:00.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17757716294152077283', time=2024-09-12T03:00:18.856110+0000, chain.objs.size()=1 2024-09-12T01:11:00.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:2MWdzMffdO-PaT2pbAYsQgcei7VGruq_.p7TxL_kPp82oEjH3ERhYTcbLaGlOY1w_0 2024-09-12T01:11:00.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4523598949333200694', time=2024-09-12T03:00:23.352804+0000, chain.objs.size()=1 2024-09-12T01:11:00.032 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.031+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:zFThq3mGIwh2fGHmCqA5B87MyuBBU9Y_.UowgJVe5Jp5bGpouhu2Go71p1QI6jrF_0 2024-09-12T01:11:00.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.033+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4385302149257000684', time=2024-09-12T03:05:09.054974+0000, chain.objs.size()=2 2024-09-12T01:11:00.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.033+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.649__shadow_.gwVYiegOxGYP-W07UE-Eu_OeScHRlBQ_0 2024-09-12T01:11:00.033 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.034+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.649__shadow_.gwVYiegOxGYP-W07UE-Eu_OeScHRlBQ_1 2024-09-12T01:11:00.035 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.036+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:00.037 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.038+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:11:00.038 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.040+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:00.039 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.040+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49303' 2024-09-12T01:11:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15636494035260365729', time=2024-09-12T02:49:34.697440+0000, chain.objs.size()=1 2024-09-12T01:11:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.171__shadow_.YdpxYub-ZO5RHl-D78uY0WaR_TD2kXc_0 2024-09-12T01:11:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13094720652993078179', time=2024-09-12T02:51:29.943905+0000, chain.objs.size()=1 2024-09-12T01:11:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.238__shadow_.VAxp9eQtBMwg0iVrUdiwCgYuQCwpLCO_0 2024-09-12T01:11:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12279506758282054360', time=2024-09-12T02:51:38.311082+0000, chain.objs.size()=1 2024-09-12T01:11:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.251__shadow_.MbLX2axZUhyHwA2FJXcP0393xEeqGU6_0 2024-09-12T01:11:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11003325575507514188', time=2024-09-12T02:52:21.595828+0000, chain.objs.size()=1 2024-09-12T01:11:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.habj-oW_WvloaGi2VuOeTAaoAldUevy_0 2024-09-12T01:11:00.041 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1504752321959001364', time=2024-09-12T02:52:21.596330+0000, chain.objs.size()=1 2024-09-12T01:11:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.GeyxsA9DCf0xCF2uqasmiKIrr49tdk0_0 2024-09-12T01:11:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16631115664819670771', time=2024-09-12T02:52:22.218676+0000, chain.objs.size()=1 2024-09-12T01:11:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0INloATmuN1L12Thv0U725AxUKbYkLk_0 2024-09-12T01:11:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3226861106236135080', time=2024-09-12T02:52:22.236691+0000, chain.objs.size()=1 2024-09-12T01:11:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.kJKtXAhTB-xw3bcrjkLZ2PgCp--u81G_0 2024-09-12T01:11:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12493094284289921026', time=2024-09-12T02:52:22.764787+0000, chain.objs.size()=1 2024-09-12T01:11:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.7EVHS4BFd5T0I702HdBV0mtPc-xubMw_0 2024-09-12T01:11:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16226177267025980135', time=2024-09-12T02:52:22.765620+0000, chain.objs.size()=1 2024-09-12T01:11:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.M_c1S08bxV40QbE_wROA7-wK0mebx7i_0 2024-09-12T01:11:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1832861520201411208', time=2024-09-12T02:52:23.313678+0000, chain.objs.size()=1 2024-09-12T01:11:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ijpT8Es5Xiv4eWLS2gfhmiz4GrPmo06_0 2024-09-12T01:11:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11046232413368546071', time=2024-09-12T02:52:23.704469+0000, chain.objs.size()=1 2024-09-12T01:11:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Fg6M6GShWMuNoHQKZ-R5ud6UXXoLJej_0 2024-09-12T01:11:00.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6611349527422281697', time=2024-09-12T02:52:24.511536+0000, chain.objs.size()=1 2024-09-12T01:11:00.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.041+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.VCy0x9Rbd-Kpg1U72PydFtSGZvZ7flB_0 2024-09-12T01:11:00.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12483476847393102667', time=2024-09-12T02:52:24.713491+0000, chain.objs.size()=1 2024-09-12T01:11:00.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vISRJzJ4rGzWimkuNM4KfMqKO2JECMk_0 2024-09-12T01:11:00.043 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4378501468444541923', time=2024-09-12T02:52:25.168512+0000, chain.objs.size()=1 2024-09-12T01:11:00.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.WhbN_YuE4k1FTioY2F4D_GVqarMAUuW_0 2024-09-12T01:11:00.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5684984245540354119', time=2024-09-12T02:52:25.597134+0000, chain.objs.size()=1 2024-09-12T01:11:00.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.d_bQp6XzxPE8BpfyojsxXP4wZQbouxl_0 2024-09-12T01:11:00.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11867125695152932460', time=2024-09-12T02:52:25.597850+0000, chain.objs.size()=1 2024-09-12T01:11:00.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0kmMwRT5dm_SYA764m8SeB9S4Y1M7PX_0 2024-09-12T01:11:00.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7842473839979638257', time=2024-09-12T02:52:26.428253+0000, chain.objs.size()=1 2024-09-12T01:11:00.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.IdAqokpdo8PLKdg0Hyqft2BP-cpy1TU_0 2024-09-12T01:11:00.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2160097297797028739', time=2024-09-12T02:52:26.568171+0000, chain.objs.size()=1 2024-09-12T01:11:00.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.kiLkQPI3mVT6BdKq7wLaL93W-S8R0hX_0 2024-09-12T01:11:00.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.044+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5433497083923025516', time=2024-09-12T02:52:27.091956+0000, chain.objs.size()=1 2024-09-12T01:11:00.044 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.044+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.7syiWCd3p1kEeFfySzNMxqBcTcbC9O5_0 2024-09-12T01:11:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.045+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15618771607380852787', time=2024-09-12T02:52:27.436783+0000, chain.objs.size()=1 2024-09-12T01:11:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.045+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.fi_X8uXDxvdB2jxDGibzkfWwHDrcb7p_0 2024-09-12T01:11:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.045+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7490511162341543876', time=2024-09-12T02:52:27.581654+0000, chain.objs.size()=1 2024-09-12T01:11:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.045+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.gsIBCMNkMRt3aTRqlSDCEwx52jzNJkD_0 2024-09-12T01:11:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.045+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11692503304284388141', time=2024-09-12T02:52:28.044468+0000, chain.objs.size()=1 2024-09-12T01:11:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.045+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.PX9xb4eUZKvop7hd1DeKIHtunRhCrL-_0 2024-09-12T01:11:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.045+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2432500503937742752', time=2024-09-12T02:52:28.045167+0000, chain.objs.size()=1 2024-09-12T01:11:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.045+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.hVVXfF95kRN-KgdtpBcrSEc54gACTCh_0 2024-09-12T01:11:00.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.047+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12906650848364573743', time=2024-09-12T02:52:28.063966+0000, chain.objs.size()=1 2024-09-12T01:11:00.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.047+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.6ebckmbG3KS-dzQuR00V8OfXEHaHsF8_0 2024-09-12T01:11:00.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.047+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18201492089463128114', time=2024-09-12T02:52:28.609029+0000, chain.objs.size()=1 2024-09-12T01:11:00.046 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.047+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.RvsjaCkUu7dNx89zaj9jxur621Jloub_0 2024-09-12T01:11:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.047+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18420118491206695605', time=2024-09-12T02:52:28.982735+0000, chain.objs.size()=1 2024-09-12T01:11:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.047+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.TGWf9_o7gjweDNRFpLQ2gOKeJ2ZaVzi_0 2024-09-12T01:11:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.047+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7649294996480598968', time=2024-09-12T02:52:29.433887+0000, chain.objs.size()=1 2024-09-12T01:11:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.047+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Pt_SVLyf2S_buGEN8jMLbTRuT1IbV-q_0 2024-09-12T01:11:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.047+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7181235545220604099', time=2024-09-12T02:52:29.533830+0000, chain.objs.size()=1 2024-09-12T01:11:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.047+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uaWM__4pOvtD64iZJNJ8zunQHtxPMzt_0 2024-09-12T01:11:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.048+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4015409412658095056', time=2024-09-12T02:52:29.882451+0000, chain.objs.size()=1 2024-09-12T01:11:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.048+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.N037e0AJbNa9FDz2w330alU7iyZL4EO_0 2024-09-12T01:11:00.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.048+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17784420700659329554', time=2024-09-12T02:52:30.313608+0000, chain.objs.size()=1 2024-09-12T01:11:00.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.048+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_._vD2-nI4Kx-RhgX2flwQ19EXiqL_Jcx_0 2024-09-12T01:11:00.048 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.049+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.451941758126606990', time=2024-09-12T02:52:30.431479+0000, chain.objs.size()=1 2024-09-12T01:11:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.049+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Yczeu2PqYLjYGs8Pgx-AwOM_byHfe1U_0 2024-09-12T01:11:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.049+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5547311277165780597', time=2024-09-12T02:52:30.630319+0000, chain.objs.size()=1 2024-09-12T01:11:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.049+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.T303p_ws066dZsWRke9sZI2S78Q5VNZ_0 2024-09-12T01:11:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.049+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3067674418192067200', time=2024-09-12T02:52:30.821448+0000, chain.objs.size()=1 2024-09-12T01:11:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.049+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.rp3d0zhKJ-EDIha6c6pBaGa3jysQcSn_0 2024-09-12T01:11:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.049+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4031441439850929118', time=2024-09-12T02:52:31.278866+0000, chain.objs.size()=1 2024-09-12T01:11:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.049+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0A7uFg594KVLVFYfXzwbHuqVNrTfZlW_0 2024-09-12T01:11:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.049+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14446218540012281755', time=2024-09-12T02:52:31.297278+0000, chain.objs.size()=1 2024-09-12T01:11:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.049+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.JG4Gzpwtlg_Dy3sa1zoF5WqnUbruPhl_0 2024-09-12T01:11:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.049+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10024720562677792480', time=2024-09-12T02:52:31.639085+0000, chain.objs.size()=1 2024-09-12T01:11:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.049+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.pB_cc8_egdUjwapZOItD3pZHnwfNqHb_0 2024-09-12T01:11:00.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.050+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13725538283120723276', time=2024-09-12T02:52:31.936872+0000, chain.objs.size()=1 2024-09-12T01:11:00.050 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.050+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.7khi7MWbSce-4La1f5rjFO_gp47rf2n_0 2024-09-12T01:11:00.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.052+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8746783136852667641', time=2024-09-12T02:52:34.225571+0000, chain.objs.size()=1 2024-09-12T01:11:00.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.052+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.267__shadow_.-BD6OKFEB6UU5S2lW4DqCyP73CHEAey_0 2024-09-12T01:11:00.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.052+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5841924332427866154', time=2024-09-12T02:52:38.773261+0000, chain.objs.size()=1 2024-09-12T01:11:00.051 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.052+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.275__shadow_.jzwfbvNJo3VRDBzh2oTz9NuLLyVvAN4_0 2024-09-12T01:11:00.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.052+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4286938624769395805', time=2024-09-12T02:52:45.481440+0000, chain.objs.size()=1 2024-09-12T01:11:00.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.052+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.286__shadow_.VYg9kj_oyCKR1diYC93d6tf-o8RnT-W_0 2024-09-12T01:11:00.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.053+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11234352211807596347', time=2024-09-12T02:52:47.991458+0000, chain.objs.size()=1 2024-09-12T01:11:00.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.053+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.290__shadow_.Q8mxoSGBMfNdhoMtTJrKkBgc2ITjTJa_0 2024-09-12T01:11:00.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.053+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14379821193282165007', time=2024-09-12T02:52:53.202737+0000, chain.objs.size()=1 2024-09-12T01:11:00.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.053+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.2SCfun1KNI07YGFku6PJYPw6Bdc5gwU_0 2024-09-12T01:11:00.052 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.053+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5183886180566581131', time=2024-09-12T02:52:53.268012+0000, chain.objs.size()=1 2024-09-12T01:11:00.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.053+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.dA84iaLJdDdFzPYF7-d2Gse1vnSPeV8_0 2024-09-12T01:11:00.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.054+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11620780087710497583', time=2024-09-12T02:52:54.489876+0000, chain.objs.size()=1 2024-09-12T01:11:00.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.054+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.296__shadow_.6ppxBS52z_t0mHWY6GY10Gl43VE9xPW_0 2024-09-12T01:11:00.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.054+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15175162037194882774', time=2024-09-12T02:52:59.443839+0000, chain.objs.size()=1 2024-09-12T01:11:00.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.054+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.304__shadow_.QSqaJkwe5u4hNhgS01UhqOa6nbRf7da_0 2024-09-12T01:11:00.053 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.054+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1085982715566875004', time=2024-09-12T02:52:59.457422+0000, chain.objs.size()=1 2024-09-12T01:11:00.054 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.054+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.304__shadow_.k3xQDe6iAL8-GVzOHy9rPKUFUU2K5Rn_0 2024-09-12T01:11:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.056+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5139064730086557644', time=2024-09-12T02:53:50.056471+0000, chain.objs.size()=1 2024-09-12T01:11:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.056+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cndc0YvYpSrd4tyzYhFKf01HBcWuTi8_0 2024-09-12T01:11:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.056+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8320003882055458539', time=2024-09-12T02:53:50.071656+0000, chain.objs.size()=1 2024-09-12T01:11:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.056+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.SwTx1zhCOf3Hz3QlVRd4dg34BUCOc9n_0 2024-09-12T01:11:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.057+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13696182559669043233', time=2024-09-12T02:53:50.086402+0000, chain.objs.size()=1 2024-09-12T01:11:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.057+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.YMEfq4cgAKj_PS7UxeogYL3nRpe2jei_0 2024-09-12T01:11:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.057+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4084630887841626551', time=2024-09-12T02:53:51.118043+0000, chain.objs.size()=1 2024-09-12T01:11:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.057+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.esta5HoWsjOXLO-kRH9piNP4zMogk67_0 2024-09-12T01:11:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.057+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1895347688781257362', time=2024-09-12T02:53:51.161397+0000, chain.objs.size()=1 2024-09-12T01:11:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.057+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.SaEMLMvjJFASgWF70Gb5z1uR-SBFwoQ_0 2024-09-12T01:11:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.057+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5234567337290521045', time=2024-09-12T02:53:51.451549+0000, chain.objs.size()=1 2024-09-12T01:11:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.057+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.QgZz2qdaRkiCR6qe2QQfjMCBbqYTgHx_0 2024-09-12T01:11:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.057+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16132741040593039560', time=2024-09-12T02:53:52.597406+0000, chain.objs.size()=1 2024-09-12T01:11:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.057+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.UxpMF-v5JIim84Zs_M1FsEYss8jPQcg_0 2024-09-12T01:11:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.058+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14153914771444975113', time=2024-09-12T02:53:52.722044+0000, chain.objs.size()=1 2024-09-12T01:11:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.058+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nJAQSmoKhE9lW7-l0afZumB0XWFh_5X_0 2024-09-12T01:11:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.058+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18121583659879603899', time=2024-09-12T02:53:52.762566+0000, chain.objs.size()=1 2024-09-12T01:11:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.058+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5Sgltz84KJnS5F3A6JbhedYvneKRvjO_0 2024-09-12T01:11:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.058+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8419222685106045593', time=2024-09-12T02:53:52.846789+0000, chain.objs.size()=1 2024-09-12T01:11:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.058+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.QjiNgUEYipEG9veP5Q6-SsiWTWMxOus_0 2024-09-12T01:11:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.058+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5951555072380416130', time=2024-09-12T02:53:52.849454+0000, chain.objs.size()=1 2024-09-12T01:11:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.058+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.AqsX3IwkqEdGxMm3ZRGE-0eKhcLeZxl_0 2024-09-12T01:11:00.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.058+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9013942035216795978', time=2024-09-12T02:53:52.859274+0000, chain.objs.size()=1 2024-09-12T01:11:00.059 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.058+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.kvLDsIGKuvwp3xP5YbtIzbbQIm7IjKG_0 2024-09-12T01:11:00.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.061+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3402811897934980169', time=2024-09-12T02:53:52.963527+0000, chain.objs.size()=1 2024-09-12T01:11:00.060 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.061+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.S3NzEcuoKSNSuaAZjCcFjMrV9V-Svfl_0 2024-09-12T01:11:00.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3180229961419268563', time=2024-09-12T02:53:53.319464+0000, chain.objs.size()=1 2024-09-12T01:11:00.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.2kci1-EFMzgRR4SlY3O4_si2Vp_Eqnn_0 2024-09-12T01:11:00.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15800947712980770259', time=2024-09-12T02:53:53.772786+0000, chain.objs.size()=1 2024-09-12T01:11:00.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.LY4vmKJ4QqtZ0DXMudxIqsQWKHqPyWa_0 2024-09-12T01:11:00.061 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2548264689869452612', time=2024-09-12T02:53:53.875890+0000, chain.objs.size()=1 2024-09-12T01:11:00.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.IVztS7fJ5eIhRUb-fwDkNVdY4o7eOVc_0 2024-09-12T01:11:00.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12240666523916612558', time=2024-09-12T02:53:54.646506+0000, chain.objs.size()=1 2024-09-12T01:11:00.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0N4f-2agzxwyNXTIqouNMAeEXRwy6sm_0 2024-09-12T01:11:00.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6987592358436081273', time=2024-09-12T02:53:54.705083+0000, chain.objs.size()=1 2024-09-12T01:11:00.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.iZCvXJb-wVJdqPDxBttTbmK72QeQGSm_0 2024-09-12T01:11:00.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13054442679959271565', time=2024-09-12T02:53:55.301710+0000, chain.objs.size()=1 2024-09-12T01:11:00.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.QUUAZoZTY9R003UJGZSWiPKkEKCgBTS_0 2024-09-12T01:11:00.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17719897041632071589', time=2024-09-12T02:53:57.846423+0000, chain.objs.size()=1 2024-09-12T01:11:00.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.6Yw3C9XV8eRkAPySU1rRdIeUkui09sM_0 2024-09-12T01:11:00.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12824848944009033609', time=2024-09-12T02:53:58.053732+0000, chain.objs.size()=1 2024-09-12T01:11:00.062 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.FqCXOCm_x9MKoGDZ-j0QdVvoFsL6s6x_0 2024-09-12T01:11:00.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13521534690855124522', time=2024-09-12T02:53:58.256659+0000, chain.objs.size()=1 2024-09-12T01:11:00.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.rEA0xBkhL4kpuacnbFK-nNhZ8HI0K29_0 2024-09-12T01:11:00.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16872540777488859642', time=2024-09-12T02:53:58.932438+0000, chain.objs.size()=1 2024-09-12T01:11:00.063 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.062+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.TcvQ5N8hCwl2roLlc-kkXFnSUMPNnC5_0 2024-09-12T01:11:00.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.065+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7256762801147165081', time=2024-09-12T02:53:59.483197+0000, chain.objs.size()=1 2024-09-12T01:11:00.064 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.065+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.N6cP1Iw5Det9qFvFyHTkTD4TeFOvUEU_0 2024-09-12T01:11:00.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.066+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5542657742468864733', time=2024-09-12T02:53:59.553567+0000, chain.objs.size()=1 2024-09-12T01:11:00.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.066+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.fEnuWFYHPn_6mDO001MRtMinxOoLATu_0 2024-09-12T01:11:00.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.066+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2303210593494520065', time=2024-09-12T02:53:59.708327+0000, chain.objs.size()=1 2024-09-12T01:11:00.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.066+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.jUbsZjeczNNk-OCci4zrkBnNtiv4W8O_0 2024-09-12T01:11:00.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.066+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.220746826511007321', time=2024-09-12T02:54:36.622250+0000, chain.objs.size()=1 2024-09-12T01:11:00.065 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.066+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Xb_SmieLnAzSAuFNmcHUzSa2QzDvT20_0 2024-09-12T01:11:00.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.067+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3288813522168339478', time=2024-09-12T02:54:37.397520+0000, chain.objs.size()=1 2024-09-12T01:11:00.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.067+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.-_chIhkpGbI90YgReT4t-0Db6XMejVO_0 2024-09-12T01:11:00.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.067+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5187975171754376931', time=2024-09-12T02:54:38.082929+0000, chain.objs.size()=1 2024-09-12T01:11:00.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.067+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.89S37jif9_A_nnHKIZLHbldem0BoU2C_0 2024-09-12T01:11:00.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.067+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6091005445275021374', time=2024-09-12T02:54:38.636803+0000, chain.objs.size()=1 2024-09-12T01:11:00.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.067+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.zMsGJ9S2IBgF8P9DABikbd8JRpk842c_0 2024-09-12T01:11:00.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.067+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13681167895783398780', time=2024-09-12T02:54:38.736259+0000, chain.objs.size()=1 2024-09-12T01:11:00.066 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.067+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.vLOqcuIEvBO-JpNpy771da1zAnMjoRF_0 2024-09-12T01:11:00.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.067+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10213480354906895328', time=2024-09-12T02:54:38.825613+0000, chain.objs.size()=1 2024-09-12T01:11:00.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.067+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.VSWAKmC1G6jVSTz7grK3cfhpw6icDto_0 2024-09-12T01:11:00.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.067+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13273011818603259811', time=2024-09-12T02:54:39.043337+0000, chain.objs.size()=1 2024-09-12T01:11:00.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.067+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.LvzQM4dulEhZislEppB1bXRALaDIZQ3_0 2024-09-12T01:11:00.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.067+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1212919403603550849', time=2024-09-12T02:54:39.783847+0000, chain.objs.size()=1 2024-09-12T01:11:00.067 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.067+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.u1FEp44Q832v54MExp2bbU5xpYt5oQ5_0 2024-09-12T01:11:00.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.069+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17609271594502127960', time=2024-09-12T02:54:39.932607+0000, chain.objs.size()=1 2024-09-12T01:11:00.068 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.069+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.j1W7tAOGNueEgERwjgKhKlj71prALzQ_0 2024-09-12T01:11:00.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.071+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8237524525059480960', time=2024-09-12T02:54:40.166369+0000, chain.objs.size()=1 2024-09-12T01:11:00.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.071+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.JOu2MNuXIzbVZJn9xpcBw0zM1so3JeL_0 2024-09-12T01:11:00.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.071+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.818033223500926111', time=2024-09-12T02:54:40.256853+0000, chain.objs.size()=1 2024-09-12T01:11:00.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.071+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.jmTzyRTEEvxQcbOfClM8_uY1YtMXxoQ_0 2024-09-12T01:11:00.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.071+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16724160101269932414', time=2024-09-12T02:54:40.442527+0000, chain.objs.size()=1 2024-09-12T01:11:00.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.071+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.zv_ruJuH4A3_mICuZ49kxBRcY4mSq1e_0 2024-09-12T01:11:00.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.071+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10745259002934402132', time=2024-09-12T02:54:40.943206+0000, chain.objs.size()=1 2024-09-12T01:11:00.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.071+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.EUhdHJhRcrGfqetrt_r2CHTZivYxnAp_0 2024-09-12T01:11:00.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.071+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14964681972260214669', time=2024-09-12T02:54:41.100424+0000, chain.objs.size()=1 2024-09-12T01:11:00.070 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.071+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.o5znAtwLPfJqKu-O3Ee6alDPyp_HWCV_0 2024-09-12T01:11:00.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.072+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15525929358098257900', time=2024-09-12T02:54:41.756459+0000, chain.objs.size()=1 2024-09-12T01:11:00.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.072+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.j45VH6j8-_gvvJAHWM7I_01D4C0c1WJ_0 2024-09-12T01:11:00.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.072+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4302875771097198615', time=2024-09-12T02:54:42.719077+0000, chain.objs.size()=1 2024-09-12T01:11:00.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.072+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.BaU03kjLdjVUiNNUSduKOH6vByNmDzF_0 2024-09-12T01:11:00.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.072+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1115552302146184764', time=2024-09-12T02:54:43.421673+0000, chain.objs.size()=1 2024-09-12T01:11:00.071 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.072+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6DFiW0Zd9oy7vIcVLUNGAjsRUhZbrYR_0 2024-09-12T01:11:00.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.072+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13561931538776523757', time=2024-09-12T02:54:44.389113+0000, chain.objs.size()=1 2024-09-12T01:11:00.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.072+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.sR-_sPCGQU9SZMzVNjLohnng9QB26ra_0 2024-09-12T01:11:00.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.072+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2742949154526192849', time=2024-09-12T02:54:44.769353+0000, chain.objs.size()=1 2024-09-12T01:11:00.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.072+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.i9KxfJ7sl9KQdZPo1DWSJ7EpeTkiOkQ_0 2024-09-12T01:11:00.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.072+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1581256512349206971', time=2024-09-12T02:54:45.046104+0000, chain.objs.size()=1 2024-09-12T01:11:00.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.072+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.L-yzth-zgHUUOQ8eZbErbGj4KLaRIxS_0 2024-09-12T01:11:00.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.073+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15637985321852526096', time=2024-09-12T02:54:45.371809+0000, chain.objs.size()=1 2024-09-12T01:11:00.072 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.073+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.uqbLZwNio3jvLd0bd8zzkKIm8oEz-8l_0 2024-09-12T01:11:00.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.075+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8054289536378632383', time=2024-09-12T02:54:45.413938+0000, chain.objs.size()=1 2024-09-12T01:11:00.074 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.075+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.lsuAfxOd3AR29cshxmzmzkDh0rG8L35_0 2024-09-12T01:11:00.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.075+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5668053787910452106', time=2024-09-12T02:54:45.897213+0000, chain.objs.size()=1 2024-09-12T01:11:00.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.075+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.RSd176XbwPll4M2kD9hsum1AbBkFiH8_0 2024-09-12T01:11:00.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.075+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2442466905363189511', time=2024-09-12T02:54:46.331234+0000, chain.objs.size()=1 2024-09-12T01:11:00.075 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.075+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.V5DD-gbgVVDfjw_1Cdptu6HVCvLla3S_0 2024-09-12T01:11:00.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.078+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8223793892497261038', time=2024-09-12T02:54:46.723758+0000, chain.objs.size()=1 2024-09-12T01:11:00.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.078+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.7LzNbYQgBuckPRXUgVNyFFJP4OtlHIk_0 2024-09-12T01:11:00.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.078+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4468331573461561460', time=2024-09-12T02:54:49.570261+0000, chain.objs.size()=1 2024-09-12T01:11:00.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.078+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.330__shadow_.05W9Y3EM2WI3HopSWySl7seU0mDXGDd_0 2024-09-12T01:11:00.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.078+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18212860018404301199', time=2024-09-12T02:55:53.513596+0000, chain.objs.size()=1 2024-09-12T01:11:00.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.078+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.448__shadow_.jQc7wLuc-TZx3azBZhkI9Qks3QHGyY-_0 2024-09-12T01:11:00.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.078+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1326509588926553047', time=2024-09-12T02:56:14.333853+0000, chain.objs.size()=1 2024-09-12T01:11:00.077 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.078+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.484__shadow_.ZRVrPE7XvIzTyzNIf6vetzPld6lN3A7_0 2024-09-12T01:11:00.080 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.081+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/49303 2024-09-12T01:11:00.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.084+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T01:11:00.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.084+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12581910906533086331', time=2024-09-12T02:56:14.347884+0000, chain.objs.size()=1 2024-09-12T01:11:00.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.084+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.484__shadow_.LqEMTn3Bmfksb89lgXcFkcN2IOHXcsw_0 2024-09-12T01:11:00.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.084+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.495373850975954496', time=2024-09-12T02:56:15.033847+0000, chain.objs.size()=1 2024-09-12T01:11:00.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.084+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.485__shadow_.fyWR995phB1_uKTRPOWtd7CUoOVwWuo_0 2024-09-12T01:11:00.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9592555426136650483', time=2024-09-12T02:56:25.838833+0000, chain.objs.size()=1 2024-09-12T01:11:00.085 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.498__shadow_._rMoGe-4kW3scvQLHCm6_pVmSG4tL0n_0 2024-09-12T01:11:00.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~iji-T0IOjE1Q2uTfHpq-93C46ztjU9w', time=2024-09-12T02:57:31.823948+0000, chain.objs.size()=1 2024-09-12T01:11:00.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~iji-T0IOjE1Q2uTfHpq-93C46ztjU9w.2 2024-09-12T01:11:00.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13850429642333350667', time=2024-09-12T02:58:20.041100+0000, chain.objs.size()=2 2024-09-12T01:11:00.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.526__multipart_mymultipart.2~L108n_FYvMDxBFPcM2CcqAQXBiahwoH.1 2024-09-12T01:11:00.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.526__multipart_mymultipart.2~L108n_FYvMDxBFPcM2CcqAQXBiahwoH.2 2024-09-12T01:11:00.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~6hH7Xbg__Ajz8rxMAg1Iu1SiicBFaL7', time=2024-09-12T02:58:44.737565+0000, chain.objs.size()=1 2024-09-12T01:11:00.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.536__multipart_mymultipart.2~6hH7Xbg__Ajz8rxMAg1Iu1SiicBFaL7.3 2024-09-12T01:11:00.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8186248055439930398', time=2024-09-12T02:59:37.998348+0000, chain.objs.size()=2 2024-09-12T01:11:00.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.559__shadow_.6XOrTCI1jqT44eTAq443J9kxM_t4ub9_0 2024-09-12T01:11:00.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.559__shadow_.6XOrTCI1jqT44eTAq443J9kxM_t4ub9_1 2024-09-12T01:11:00.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18357085442308972118', time=2024-09-12T03:00:07.495695+0000, chain.objs.size()=1 2024-09-12T01:11:00.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.575__shadow_.vMXF6Mikye1OFItv9AiRbo0NkPUkzQc_0 2024-09-12T01:11:00.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3920095407533949539', time=2024-09-12T03:00:52.483222+0000, chain.objs.size()=1 2024-09-12T01:11:00.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.580__shadow:jGrUL.n4GEV2okXsVJktpZqEidmJNI1_.LvcaB1Qu4RPiJFvf0qQzq7CQ7cG_UUj_0 2024-09-12T01:11:00.086 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17095498638253903416', time=2024-09-12T03:01:00.506857+0000, chain.objs.size()=1 2024-09-12T01:11:00.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.085+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.588__shadow:3SDTgfoM2kDYnfDk9Ocm11KUPSYO2Nx_.LzFbmCmDnEp0TOm1b6yz7tjRxMfIXSG_0 2024-09-12T01:11:00.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.087+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1864224228856585003', time=2024-09-12T03:01:04.937143+0000, chain.objs.size()=1 2024-09-12T01:11:00.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.087+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.597__shadow_.vam4AFqwa4LBkHMjcyVSGfUN7Yg0925_0 2024-09-12T01:11:00.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.088+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3366158401003432772', time=2024-09-12T03:01:09.470457+0000, chain.objs.size()=1 2024-09-12T01:11:00.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.088+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.606__shadow_.yez1NgG07XdfOCq4-YrNYHb6iyhFZrS_0 2024-09-12T01:11:00.087 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.088+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12450162236921071376', time=2024-09-12T03:04:15.908887+0000, chain.objs.size()=1 2024-09-12T01:11:00.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.088+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.619__shadow_.zadUbYPEF3ajLP5fmk6WRoeWxsXpRRB_0 2024-09-12T01:11:00.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.088+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7464668897808721568', time=2024-09-12T03:06:46.574390+0000, chain.objs.size()=1 2024-09-12T01:11:00.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.088+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.742__shadow_.f6b7GGEYTqvMIlF8ldL4xGcY6XuRYOX_0 2024-09-12T01:11:00.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.089+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4840468729356562686', time=2024-09-12T03:06:47.583174+0000, chain.objs.size()=1 2024-09-12T01:11:00.088 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.089+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.743__multipart_mymultipart3.2~RJ-F6q4r2v_fJ8zcWttxI_LyuPvNGFi.1 2024-09-12T01:11:00.090 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.091+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:00.093 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.094+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:11:00.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.095+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:00.094 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.095+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:00.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50358' 2024-09-12T01:11:00.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='_vaJtpU3QgXs8puROmHGVE2KpyOI3pVw', time=2024-09-12T02:49:32.662858+0000, chain.objs.size()=1 2024-09-12T01:11:00.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.166__shadow_.HLkU63nXyuYRoSeq2mm1TvOJsRDq119_0 2024-09-12T01:11:00.095 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.456253211033829513', time=2024-09-12T02:49:42.006144+0000, chain.objs.size()=1 2024-09-12T01:11:00.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.178__shadow_.RPhkGGmvzSKtlMi7IEc_81sGpIB8O9k_0 2024-09-12T01:11:00.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6032731207988904364', time=2024-09-12T02:51:29.949048+0000, chain.objs.size()=1 2024-09-12T01:11:00.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.238__shadow_.hcX26M7HEYf2Q2JP2B2KhheOo1Yb2bH_0 2024-09-12T01:11:00.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2087656863316795729', time=2024-09-12T02:51:35.271750+0000, chain.objs.size()=1 2024-09-12T01:11:00.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.246__shadow_.nGCnOlI_EUcX73pSHYDRhlFbdXCfre0_0 2024-09-12T01:11:00.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16030184218673119412', time=2024-09-12T02:51:35.277064+0000, chain.objs.size()=1 2024-09-12T01:11:00.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.246__shadow_.iuO9ZwCIrr9R1ez2kWlWYS8CCvk1S_W_0 2024-09-12T01:11:00.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2751743999964440952', time=2024-09-12T02:51:36.478354+0000, chain.objs.size()=1 2024-09-12T01:11:00.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.248__shadow_.w3hhSRFsyLwAXIKT2lTE5gEyw4XtcSJ_0 2024-09-12T01:11:00.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15151260702899103585', time=2024-09-12T02:51:36.484910+0000, chain.objs.size()=1 2024-09-12T01:11:00.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.248__shadow_.YsODwrhzJdp0e54O8lUwN41GMReTphe_0 2024-09-12T01:11:00.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10449201420755019830', time=2024-09-12T02:51:38.310319+0000, chain.objs.size()=1 2024-09-12T01:11:00.096 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.251__shadow_.NBZihUmkDX5bFyCxLPzstiEzOySGubo_0 2024-09-12T01:11:00.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11192210955710625735', time=2024-09-12T02:51:40.130780+0000, chain.objs.size()=1 2024-09-12T01:11:00.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.254__shadow_.dJFqXS9A2PWW9DBO-WLDbrFcfXBK9wo_0 2024-09-12T01:11:00.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14377895529625842265', time=2024-09-12T02:52:21.126487+0000, chain.objs.size()=1 2024-09-12T01:11:00.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vUDe15kPbU6I2g1hIokrGkhX12OAeyZ_0 2024-09-12T01:11:00.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8032520266302731478', time=2024-09-12T02:52:21.439250+0000, chain.objs.size()=1 2024-09-12T01:11:00.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.aboG_GRv-1HfwdUUqMHt6MSmBZLcqXD_0 2024-09-12T01:11:00.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10569636325682287266', time=2024-09-12T02:52:21.527073+0000, chain.objs.size()=1 2024-09-12T01:11:00.097 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.096+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5NQdwlywgTwolcfXc4ZETGBHPcUsgoN_0 2024-09-12T01:11:00.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.099+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6432276332342102879', time=2024-09-12T02:52:21.842021+0000, chain.objs.size()=1 2024-09-12T01:11:00.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.099+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.uIzVnIltlbghFetzQ9RUtlL6Oal4_kd_0 2024-09-12T01:11:00.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.099+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4418605564809170486', time=2024-09-12T02:52:22.131940+0000, chain.objs.size()=1 2024-09-12T01:11:00.098 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.099+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KBXlSj0R9XaKHppO069HoEwA4-bfz3S_0 2024-09-12T01:11:00.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.100+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15365522316414197845', time=2024-09-12T02:52:23.177402+0000, chain.objs.size()=1 2024-09-12T01:11:00.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.100+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.A1cOuorgink2w03h2SAfZCVT_LLpkX0_0 2024-09-12T01:11:00.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.100+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4612782117691236723', time=2024-09-12T02:52:24.848339+0000, chain.objs.size()=1 2024-09-12T01:11:00.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.100+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.R50JoU0IKxA3_OK303lSRNPNeCbaYkD_0 2024-09-12T01:11:00.099 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.101+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12094728500613080098', time=2024-09-12T02:52:25.596037+0000, chain.objs.size()=1 2024-09-12T01:11:00.100 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.101+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.KMB5V1kznSOZsQQBhd-qy6DV1oRswLs_0 2024-09-12T01:11:00.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.102+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17365222053741666524', time=2024-09-12T02:52:25.596802+0000, chain.objs.size()=1 2024-09-12T01:11:00.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.102+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Z3OjKRE4Ikytn4Pq11GzgXo9lR2bemU_0 2024-09-12T01:11:00.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.102+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15185000043863245569', time=2024-09-12T02:52:25.745062+0000, chain.objs.size()=1 2024-09-12T01:11:00.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.102+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.q2VehmvFjBQ4mMx-nhcwxSYZqtJFSJ0_0 2024-09-12T01:11:00.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.102+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10948791442190597692', time=2024-09-12T02:52:26.344198+0000, chain.objs.size()=1 2024-09-12T01:11:00.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.102+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.CsrqfNnDJ33yet3KuzXTjS7f4rBAfVD_0 2024-09-12T01:11:00.101 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.102+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11199560294971370525', time=2024-09-12T02:52:27.111195+0000, chain.objs.size()=1 2024-09-12T01:11:00.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.102+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.sPSwCA3wwm8eZCF9_szqNt0x-5DXv_L_0 2024-09-12T01:11:00.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.102+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4696628491870677724', time=2024-09-12T02:52:27.236497+0000, chain.objs.size()=1 2024-09-12T01:11:00.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.102+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.UBdsMADGG-9NmmGFh94rAPlTG7_5jBE_0 2024-09-12T01:11:00.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.102+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6324160157886640596', time=2024-09-12T02:52:27.388680+0000, chain.objs.size()=1 2024-09-12T01:11:00.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.102+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.o7LrbWNL-PSYIE08DFo9Zy7T9gV9lRW_0 2024-09-12T01:11:00.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.102+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14623547346244393273', time=2024-09-12T02:52:27.766446+0000, chain.objs.size()=1 2024-09-12T01:11:00.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.102+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.cscPGK9HGWwC1RE3KGecrG0GDxtKCEL_0 2024-09-12T01:11:00.102 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.103+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7319774871112980017', time=2024-09-12T02:52:28.789048+0000, chain.objs.size()=1 2024-09-12T01:11:00.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.103+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.LyCj3ftFMO9n9AQYu7C4oyLUVqRAB_b_0 2024-09-12T01:11:00.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.104+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13244824305333072650', time=2024-09-12T02:52:30.277731+0000, chain.objs.size()=1 2024-09-12T01:11:00.103 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.104+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.-2MKNqAaZwloT6GX9lhdsbx6fF-auzL_0 2024-09-12T01:11:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.104+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4537431719164482555', time=2024-09-12T02:52:30.544069+0000, chain.objs.size()=1 2024-09-12T01:11:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.104+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.eZS-JjSVe1yYdrTPABSy3Pr7BxjNmK4_0 2024-09-12T01:11:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.105+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5522964085268434101', time=2024-09-12T02:52:31.141944+0000, chain.objs.size()=1 2024-09-12T01:11:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.105+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.3P6ddgqjTn_3DqoPJ-h-U0lJbF-eYPI_0 2024-09-12T01:11:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.105+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18158002044166539144', time=2024-09-12T02:52:31.314030+0000, chain.objs.size()=1 2024-09-12T01:11:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.105+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.c6xc42zBXRnPUVnvmJLFO3darL0q5VL_0 2024-09-12T01:11:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.106+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11652976342224035581', time=2024-09-12T02:52:31.466300+0000, chain.objs.size()=1 2024-09-12T01:11:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.106+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.FHOegRnFMFlk2MtJl-et93Uz0aW0fRr_0 2024-09-12T01:11:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.106+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3244531373477128299', time=2024-09-12T02:52:31.552969+0000, chain.objs.size()=1 2024-09-12T01:11:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.106+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Gox8D9oKs4598yF9PVruUjPuheWL1r__0 2024-09-12T01:11:00.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.108+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.805737400416453109', time=2024-09-12T02:52:31.794668+0000, chain.objs.size()=1 2024-09-12T01:11:00.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.108+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.s-SRNWKMReI_dTvQTDr1_CSZPyTo2yY_0 2024-09-12T01:11:00.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.108+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5529795554794887523', time=2024-09-12T02:52:34.812143+0000, chain.objs.size()=1 2024-09-12T01:11:00.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.108+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.268__shadow_.eW1htdjU7UyqCQEOixj_Yjc7QXUbkOb_0 2024-09-12T01:11:00.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.108+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17774807142148329313', time=2024-09-12T02:52:43.025809+0000, chain.objs.size()=1 2024-09-12T01:11:00.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.108+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.282__shadow_.Fhz3zl-ia058xG6FwCWomc9UuysuQFs_0 2024-09-12T01:11:00.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.108+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14721362407706286958', time=2024-09-12T02:52:47.393178+0000, chain.objs.size()=1 2024-09-12T01:11:00.107 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.108+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.289__shadow_.scRoEkKbNmGgtMTeJv3dSdebD1wMHLC_0 2024-09-12T01:11:00.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.108+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16729886101988144608', time=2024-09-12T02:52:51.126519+0000, chain.objs.size()=1 2024-09-12T01:11:00.108 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.108+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.vrIAwJlcyaYtOMezhL67lD5wJDJoufN_0 2024-09-12T01:11:00.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.111+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14061644180340484273', time=2024-09-12T02:52:53.274637+0000, chain.objs.size()=1 2024-09-12T01:11:00.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.111+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.PhyUJkj58tiz-_PG5BQF3UdB4W2iBzA_0 2024-09-12T01:11:00.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.111+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17492077138908612016', time=2024-09-12T02:52:53.275207+0000, chain.objs.size()=1 2024-09-12T01:11:00.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.111+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.294__shadow_.wlEaLgE64e6xPk1vIUy9Lrz8IRFDjWn_0 2024-09-12T01:11:00.110 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.111+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13674717704224873243', time=2024-09-12T02:52:54.486981+0000, chain.objs.size()=1 2024-09-12T01:11:00.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.111+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.296__shadow_.nZpNNRxmQaBQMX97mnEcm8PKcyrRo19_0 2024-09-12T01:11:00.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.111+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7567254176257144419', time=2024-09-12T02:52:57.668300+0000, chain.objs.size()=1 2024-09-12T01:11:00.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.111+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.301__shadow_.cknXk-BHLYfZ4z8sdOUfmRDMgvI_5Me_0 2024-09-12T01:11:00.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.112+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18440673590296408522', time=2024-09-12T02:53:49.844345+0000, chain.objs.size()=1 2024-09-12T01:11:00.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.112+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.0R9MTA_PTOQWQeO78y7M8-IinjjCHuR_0 2024-09-12T01:11:00.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.112+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.62038891480479414', time=2024-09-12T02:53:51.013729+0000, chain.objs.size()=1 2024-09-12T01:11:00.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.112+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_._OvTPbkTvszrz-xHcDRC8SfKEI9AI3L_0 2024-09-12T01:11:00.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.112+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13681192699413630930', time=2024-09-12T02:53:51.090212+0000, chain.objs.size()=1 2024-09-12T01:11:00.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.112+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.vCBOd_ci9Ot8zhaUK78QnDTlCLkE47t_0 2024-09-12T01:11:00.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.112+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16808444576279304486', time=2024-09-12T02:53:51.671269+0000, chain.objs.size()=1 2024-09-12T01:11:00.111 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.112+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.1fJJuvHrSdZmb6U9B8C1Zug2J8CUGy__0 2024-09-12T01:11:00.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.114+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9589720068403383805', time=2024-09-12T02:53:51.814261+0000, chain.objs.size()=1 2024-09-12T01:11:00.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.114+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.UQCWeHAl9Chlz3S_To2ZIiCZ6NyNy3b_0 2024-09-12T01:11:00.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.114+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18226665255132258341', time=2024-09-12T02:53:52.391262+0000, chain.objs.size()=1 2024-09-12T01:11:00.113 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.114+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cA6HYrEkVsfsedu5OtXWDPa3Ty8_uct_0 2024-09-12T01:11:00.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.114+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17658431275072539233', time=2024-09-12T02:53:53.307480+0000, chain.objs.size()=1 2024-09-12T01:11:00.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.114+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.GVOejCHXXqVJ4dkadRz9GiN5kJhu3Ma_0 2024-09-12T01:11:00.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.114+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16681677130605845924', time=2024-09-12T02:53:53.764954+0000, chain.objs.size()=1 2024-09-12T01:11:00.114 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.114+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.3JuIlcjUlrQYxpAp-t8LyyEpVSiE_Bh_0 2024-09-12T01:11:00.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14450829305090175671', time=2024-09-12T02:53:53.999511+0000, chain.objs.size()=1 2024-09-12T01:11:00.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.-ZdoYdmMQRC3bfiRQnntxJWwPkvV8sM_0 2024-09-12T01:11:00.116 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17882854186416692267', time=2024-09-12T02:53:54.169724+0000, chain.objs.size()=1 2024-09-12T01:11:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.aaNTKEicwb3imr1-rycpAGlWYYDXHxz_0 2024-09-12T01:11:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8342564168890769241', time=2024-09-12T02:53:54.306071+0000, chain.objs.size()=1 2024-09-12T01:11:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.OPkekhzLHUbzwCSdTJhoDayqyP19IiU_0 2024-09-12T01:11:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.933606017749763252', time=2024-09-12T02:53:55.048100+0000, chain.objs.size()=1 2024-09-12T01:11:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bQac4gphb6FItDkQ2KmwMkoQ-ByBg-Z_0 2024-09-12T01:11:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3548514501501335698', time=2024-09-12T02:53:55.187540+0000, chain.objs.size()=1 2024-09-12T01:11:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.scKGQ2WKIVH3ChoMcg7TvJm-ek9-_Zn_0 2024-09-12T01:11:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12804659654441502424', time=2024-09-12T02:53:55.267662+0000, chain.objs.size()=1 2024-09-12T01:11:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.IAB6_OHQYr88dNnqROAXJM1YHPIw6Hd_0 2024-09-12T01:11:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5253389212387005003', time=2024-09-12T02:53:55.308569+0000, chain.objs.size()=1 2024-09-12T01:11:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.bgpIOoijka9tRXSkUt7KFvZZtIZfrKr_0 2024-09-12T01:11:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2934289941649889531', time=2024-09-12T02:53:55.531161+0000, chain.objs.size()=1 2024-09-12T01:11:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.B3KnLWD-vYtqZFls4kJWOvi30hHbJ9J_0 2024-09-12T01:11:00.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3722535826320555782', time=2024-09-12T02:53:56.355760+0000, chain.objs.size()=1 2024-09-12T01:11:00.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5NHHse7BHXmEDoHKTSAD4DeaZ0Y_B8j_0 2024-09-12T01:11:00.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7887114732916557604', time=2024-09-12T02:53:56.563730+0000, chain.objs.size()=1 2024-09-12T01:11:00.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.117+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.V-fRgk28dB1KkdgKPPd4GWLspdtUXly_0 2024-09-12T01:11:00.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.118+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8918478368638563632', time=2024-09-12T02:53:56.692381+0000, chain.objs.size()=1 2024-09-12T01:11:00.118 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.118+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hMDDFY0WKjMoLvpL-EE0ZZuYvqlSLVq_0 2024-09-12T01:11:00.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.121+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4858886706862830504', time=2024-09-12T02:53:56.776684+0000, chain.objs.size()=1 2024-09-12T01:11:00.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.121+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.AZb-YmEyx_UX1KCLBt4gCunZ6yP3phA_0 2024-09-12T01:11:00.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.121+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16318243340924795908', time=2024-09-12T02:53:56.839366+0000, chain.objs.size()=1 2024-09-12T01:11:00.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.121+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.7KiyzKrOCbcFpupxjjJQE3fye5BH-wl_0 2024-09-12T01:11:00.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.121+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11214077002894441085', time=2024-09-12T02:53:56.938359+0000, chain.objs.size()=1 2024-09-12T01:11:00.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.121+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.TKjNOD1sJ9Z8i0sTLk3epROX5KhRofY_0 2024-09-12T01:11:00.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.121+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18076533197803772039', time=2024-09-12T02:53:57.093657+0000, chain.objs.size()=1 2024-09-12T01:11:00.120 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.121+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.VykBmvfWUl_S_noaYE6VqH98Yi7w7Ed_0 2024-09-12T01:11:00.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.121+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13943158671097045682', time=2024-09-12T02:53:57.275631+0000, chain.objs.size()=1 2024-09-12T01:11:00.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.121+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.oc9MFd_HIlcg8FcPbHbCGpCjQkTceVZ_0 2024-09-12T01:11:00.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.121+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9816942897280844464', time=2024-09-12T02:53:57.358650+0000, chain.objs.size()=1 2024-09-12T01:11:00.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.121+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ZwTJvzHMcUAnin1Mg-A2MpzrudoKPeL_0 2024-09-12T01:11:00.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.121+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6704435000458699717', time=2024-09-12T02:53:57.819162+0000, chain.objs.size()=1 2024-09-12T01:11:00.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.122+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hfjm4-f0AjKIs2CwrUq6NYEZQ8d5k3f_0 2024-09-12T01:11:00.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.122+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4661232536844483909', time=2024-09-12T02:53:57.898017+0000, chain.objs.size()=1 2024-09-12T01:11:00.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.122+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.PLhZeoFWmEyoxk91NB_kM1Gn6k1wr3A_0 2024-09-12T01:11:00.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.122+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17330750116620438155', time=2024-09-12T02:53:58.025575+0000, chain.objs.size()=1 2024-09-12T01:11:00.121 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.122+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Sd11BqkQwPxuKk__JTtSctB_3gRKyqo_0 2024-09-12T01:11:00.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.122+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.905379424266332397', time=2024-09-12T02:53:58.323660+0000, chain.objs.size()=1 2024-09-12T01:11:00.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.122+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Z8NZEGNg7nLLYOzsBDNmGuxMkShrMHw_0 2024-09-12T01:11:00.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.122+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14725191126134163258', time=2024-09-12T02:53:58.376227+0000, chain.objs.size()=1 2024-09-12T01:11:00.122 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.122+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Xd2ZE6o1cDonZ6rh2N8W5u1yqeUshuJ_0 2024-09-12T01:11:00.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.124+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5843442228698156450', time=2024-09-12T02:53:58.429089+0000, chain.objs.size()=1 2024-09-12T01:11:00.123 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.124+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ZErqHyNWd0K9_JM2ezS8hnAIni57h7C_0 2024-09-12T01:11:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.125+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2033621991642711744', time=2024-09-12T02:53:58.948340+0000, chain.objs.size()=1 2024-09-12T01:11:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.125+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Hg-W_kyFh7S6xAQwLR0bAFNThKxEbr4_0 2024-09-12T01:11:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.125+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1988541924125634826', time=2024-09-12T02:53:59.073021+0000, chain.objs.size()=1 2024-09-12T01:11:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.125+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.RZAjt-Qog876vwDJheMPZ7FxKhY7aeD_0 2024-09-12T01:11:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.125+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10323211022350524300', time=2024-09-12T02:53:59.645943+0000, chain.objs.size()=1 2024-09-12T01:11:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.125+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.HSzM-247TdO-x005bKa7StYNhEHiTaf_0 2024-09-12T01:11:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.125+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13436949368212273968', time=2024-09-12T02:54:36.747259+0000, chain.objs.size()=1 2024-09-12T01:11:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.125+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.dm2zabOAC0YRIdRvwj0mBaYK6Cf8fLr_0 2024-09-12T01:11:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.125+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14541557610761714688', time=2024-09-12T02:54:36.923564+0000, chain.objs.size()=1 2024-09-12T01:11:00.124 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.125+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.VdeJtfjnhGZ_NYl99N_xdow8L5oIQPR_0 2024-09-12T01:11:00.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.126+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9344133482111092672', time=2024-09-12T02:54:37.159429+0000, chain.objs.size()=1 2024-09-12T01:11:00.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.126+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.cp5Gyz5-DPRfjBpgahy4nanSYa9y7tS_0 2024-09-12T01:11:00.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.126+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10682994445663820119', time=2024-09-12T02:54:38.152552+0000, chain.objs.size()=1 2024-09-12T01:11:00.125 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.126+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ChbvhIYDYcRljNtAIJ7jNEaRcGa2eUw_0 2024-09-12T01:11:00.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.127+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12854033462282082327', time=2024-09-12T02:54:38.516615+0000, chain.objs.size()=1 2024-09-12T01:11:00.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.127+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.FloGsNz4KsjILMwRGH5xDEOuCjj6iHJ_0 2024-09-12T01:11:00.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.127+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18240256484850072221', time=2024-09-12T02:54:38.674403+0000, chain.objs.size()=1 2024-09-12T01:11:00.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.127+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.BD9E3x3J9dfQrrLGwm6ZxMF6rC43hvC_0 2024-09-12T01:11:00.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.127+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3327803531805392118', time=2024-09-12T02:54:38.788578+0000, chain.objs.size()=1 2024-09-12T01:11:00.126 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.127+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.1nLEE8P34GiQsIys317vSfNY8B4wh28_0 2024-09-12T01:11:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.129+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2256899082645111680', time=2024-09-12T02:54:38.789330+0000, chain.objs.size()=1 2024-09-12T01:11:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.129+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.iraMN_8PUqw8uGIU-VfZ-PAFwN9Kvlj_0 2024-09-12T01:11:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.129+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.619088796555324932', time=2024-09-12T02:54:39.526564+0000, chain.objs.size()=1 2024-09-12T01:11:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.129+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.OyEcLoVOd04tG8j2WZVlWaDAUX5-CU1_0 2024-09-12T01:11:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.129+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17000187482862859030', time=2024-09-12T02:54:39.934591+0000, chain.objs.size()=1 2024-09-12T01:11:00.128 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.129+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.j_Q6mkmilMUqngphevs5R75wiet3tnF_0 2024-09-12T01:11:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.129+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12301304152023904559', time=2024-09-12T02:54:41.208221+0000, chain.objs.size()=1 2024-09-12T01:11:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.129+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.8Fnfi449yyGWkd1DsJRaCueaBa7MMZ5_0 2024-09-12T01:11:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.129+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17981912835325979134', time=2024-09-12T02:54:41.209131+0000, chain.objs.size()=1 2024-09-12T01:11:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.129+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.is9tWIU1uVpgAF780KBViT1HIlfCr2Z_0 2024-09-12T01:11:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.129+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10576255862684035024', time=2024-09-12T02:54:41.209807+0000, chain.objs.size()=1 2024-09-12T01:11:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.129+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.vDAjDliW7YtCzj8RJTg2Ojbn8YBW1E8_0 2024-09-12T01:11:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.129+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7170362125503761036', time=2024-09-12T02:54:41.846131+0000, chain.objs.size()=1 2024-09-12T01:11:00.129 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.129+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.J5tKrJma8_jVFpGhJoOVdHzCX05Z_pD_0 2024-09-12T01:11:00.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.130+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18436822617321337783', time=2024-09-12T02:54:42.248946+0000, chain.objs.size()=1 2024-09-12T01:11:00.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.130+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.4xuzUb-gNnS9ZvucmoyzgUDtjmPPedO_0 2024-09-12T01:11:00.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.131+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6488057845592229361', time=2024-09-12T02:54:42.373631+0000, chain.objs.size()=1 2024-09-12T01:11:00.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.131+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.NtX-VXt37u1lmx50k-TqpkR4Wy_R1tJ_0 2024-09-12T01:11:00.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.131+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13622600198265361608', time=2024-09-12T02:54:42.645205+0000, chain.objs.size()=1 2024-09-12T01:11:00.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.131+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.K2XID8hgb-6Tw1ZOkBzctreQZ6fRwON_0 2024-09-12T01:11:00.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.131+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15897924465428261375', time=2024-09-12T02:54:42.836791+0000, chain.objs.size()=1 2024-09-12T01:11:00.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.131+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9NqmM29W4Vox1hqRAEVYOeZs2u5cWDg_0 2024-09-12T01:11:00.130 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.132+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5066171334073258803', time=2024-09-12T02:54:42.960611+0000, chain.objs.size()=1 2024-09-12T01:11:00.131 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.132+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.J_40-iXR3723TVD2zsqinT28PnDZN_J_0 2024-09-12T01:11:00.132 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.133+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6663846606234378341', time=2024-09-12T02:54:43.432131+0000, chain.objs.size()=1 2024-09-12T01:11:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.133+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.xDFz5DyxgNabznch73mQduR9U-GJdi-_0 2024-09-12T01:11:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.133+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16359336335478092759', time=2024-09-12T02:54:43.825066+0000, chain.objs.size()=1 2024-09-12T01:11:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.133+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.3rxXL2U2tCCKL9QkC2d4ae0-vGBFYpk_0 2024-09-12T01:11:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.133+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6345489770194765199', time=2024-09-12T02:54:45.127325+0000, chain.objs.size()=1 2024-09-12T01:11:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.133+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.tTOqTT4fvFDwjnys7FREVePsSy1Gp7i_0 2024-09-12T01:11:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.133+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6618743762327496905', time=2024-09-12T02:54:45.248845+0000, chain.objs.size()=1 2024-09-12T01:11:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.133+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.jRJS4MS7-yCSZ0dY5neB2FUKGoRysSd_0 2024-09-12T01:11:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.133+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17161165914287466507', time=2024-09-12T02:54:45.966009+0000, chain.objs.size()=1 2024-09-12T01:11:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.133+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.PX6J1S4riYjM2fiLQjSgIo8b58wvgl3_0 2024-09-12T01:11:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.133+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9421744912997413232', time=2024-09-12T02:54:45.966772+0000, chain.objs.size()=1 2024-09-12T01:11:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.133+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.GO8XrVShizGqxFlkPKqW-P14WLuoo2u_0 2024-09-12T01:11:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.135+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18252795718520907767', time=2024-09-12T02:56:01.308188+0000, chain.objs.size()=1 2024-09-12T01:11:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.135+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.460__shadow_.PKo39ouzAlXwQiYXu9K_kC0uMazZlIk_0 2024-09-12T01:11:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.138+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/50358 2024-09-12T01:11:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T01:11:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3747985085385459566', time=2024-09-12T02:56:14.298468+0000, chain.objs.size()=1 2024-09-12T01:11:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.484__shadow_.DJITXG4C28Hzx19rI-nZpRmkiTbOeq6_0 2024-09-12T01:11:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6507895640875581706', time=2024-09-12T02:56:26.011732+0000, chain.objs.size()=1 2024-09-12T01:11:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.499__shadow_.SIRGQt-jH5fqFRPU4gtJ8GZ1yPzJqQN_0 2024-09-12T01:11:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1159649828075951080', time=2024-09-12T02:56:40.889523+0000, chain.objs.size()=6 2024-09-12T01:11:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.1 2024-09-12T01:11:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.2 2024-09-12T01:11:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.3 2024-09-12T01:11:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.4 2024-09-12T01:11:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.5 2024-09-12T01:11:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.508__multipart_srcmultipart.2~Pd1oErEWwl2fbM6hYqH3aok9qQUgPA-.6 2024-09-12T01:11:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4614328028104936404', time=2024-09-12T02:58:03.603939+0000, chain.objs.size()=6 2024-09-12T01:11:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~HN95Az9hblAL1pN12FhYfjIJBQXMGOj.1 2024-09-12T01:11:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.VBJTEzrG3q03nHwNh3BwVIwOBpW8h1n2.2 2024-09-12T01:11:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.VeToMltvI8vAUmprk3iRDomhelAhsI9r.3 2024-09-12T01:11:00.141 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.141+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~HN95Az9hblAL1pN12FhYfjIJBQXMGOj.4 2024-09-12T01:11:00.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.144+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~HN95Az9hblAL1pN12FhYfjIJBQXMGOj.5 2024-09-12T01:11:00.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.144+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.523__multipart_mymultipart.2~HN95Az9hblAL1pN12FhYfjIJBQXMGOj.6 2024-09-12T01:11:00.143 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.144+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12142554360062030423', time=2024-09-12T02:58:34.327640+0000, chain.objs.size()=2 2024-09-12T01:11:00.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.144+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.529__multipart_mymultipart.2~LU1seY2yiCH5jZqg37_HrM-WM2w2HHk.1 2024-09-12T01:11:00.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.144+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.529__multipart_mymultipart.2~LU1seY2yiCH5jZqg37_HrM-WM2w2HHk.2 2024-09-12T01:11:00.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.144+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17942610658580560249', time=2024-09-12T02:59:30.909351+0000, chain.objs.size()=1 2024-09-12T01:11:00.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.144+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.556__shadow_.5RABNx4TRymGz2b6BaIGYRxXYJh1sj5_0 2024-09-12T01:11:00.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.144+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16095849890523860918', time=2024-09-12T02:59:34.797653+0000, chain.objs.size()=1 2024-09-12T01:11:00.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.144+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.558__shadow_.JJjTQQpaIgMFG9DOTlnFM_Qac4aJe4o_0 2024-09-12T01:11:00.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.144+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7232204016030167689', time=2024-09-12T02:59:41.128126+0000, chain.objs.size()=1 2024-09-12T01:11:00.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.144+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.560__shadow_.qPp9jzFkGQirZNVm4HS6VlZUVqFbBPD_0 2024-09-12T01:11:00.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.144+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14608657063437486127', time=2024-09-12T02:59:55.106644+0000, chain.objs.size()=1 2024-09-12T01:11:00.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.144+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.570__shadow:tWj09zWOSk6P7.QklJS71GDU0JWoOda_.DBO97HiViBvCOuaqbFGb-vbPC9L3DSZ_0 2024-09-12T01:11:00.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.144+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9618444151841773446', time=2024-09-12T03:00:03.928642+0000, chain.objs.size()=1 2024-09-12T01:11:00.144 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.144+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.571__shadow:8cQ9Ed7HGQBanxmeCY4nKWUnRYE9NJ3_.r0krQDARS1y7hQrh0t0Dgn7FuwXPNOh_0 2024-09-12T01:11:00.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.146+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4329604940432157623', time=2024-09-12T03:00:26.940778+0000, chain.objs.size()=1 2024-09-12T01:11:00.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.146+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:-0m3dcKLyvBHfYqhO.3WqXam3SunLHj_.8W7yKS94Pu4fptXGXb8zm4awsML3jwb_0 2024-09-12T01:11:00.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.146+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4011041602896467648', time=2024-09-12T03:00:33.028012+0000, chain.objs.size()=1 2024-09-12T01:11:00.145 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.146+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:R6cADPRLokUe-kTTNDk69Y6iLIhx1qa_.M5Du5MlcZQlVvGlOwD7WEg0t0oRLXnR_0 2024-09-12T01:11:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.147+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12880001003401347649', time=2024-09-12T03:01:00.462574+0000, chain.objs.size()=1 2024-09-12T01:11:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.147+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.588__shadow:NgJtTHZbi5jTKKCbSiomozRpWH4YsKm_.KUh6Ju9OeGQe0MBR0vNZRpj9nZtHdlI_0 2024-09-12T01:11:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.147+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17408677354628409601', time=2024-09-12T03:01:04.936466+0000, chain.objs.size()=1 2024-09-12T01:11:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.147+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.597__shadow_.PhoR6-_wEHQMb7_a3wHmayuz7IrTM25_0 2024-09-12T01:11:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.148+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11546322250502073318', time=2024-09-12T03:05:02.890481+0000, chain.objs.size()=1 2024-09-12T01:11:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.148+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.645__shadow_.dcSJZRFMDreCKoQA3VMqpEh2NypptKc_0 2024-09-12T01:11:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.148+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5259184719104878995', time=2024-09-12T03:05:36.642577+0000, chain.objs.size()=1 2024-09-12T01:11:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.148+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.667__shadow_.6FZyUDzvQxoUxYE19jSSvhRlvan7yyN_0 2024-09-12T01:11:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.148+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2111197756841525686', time=2024-09-12T03:05:50.191265+0000, chain.objs.size()=1 2024-09-12T01:11:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.148+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.695__shadow:En6vHnzx4UH4zenWWOBphW.PjB0.2Xh_.va6gONdJJrcH1hgGf5UvkyXp4tUT65D_0 2024-09-12T01:11:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.149+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13284409623570751838', time=2024-09-12T03:05:56.418401+0000, chain.objs.size()=1 2024-09-12T01:11:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.149+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.705__shadow:P5bSHdXZ0BpKTNk3mNrXln50vp-ocLs_.dykm5w-pLL8zo2VR8J3YlMhPPnZIoEY_0 2024-09-12T01:11:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.149+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3976798550668554537', time=2024-09-12T03:05:58.235393+0000, chain.objs.size()=1 2024-09-12T01:11:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.149+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.708__shadow:kwKqL0m8-7YDypbVD0D3GWSaP.p1ALi_.qy2y_DDRKRepQcBnBv-cgxiUCyDhMsT_0 2024-09-12T01:11:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.149+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12856292413713726569', time=2024-09-12T03:05:59.450775+0000, chain.objs.size()=1 2024-09-12T01:11:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.149+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.710__shadow_.y8R3DURDUO3o0U8cVERGxry85n1ug6n_0 2024-09-12T01:11:00.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.149+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='2~yj9EQSAEaIMA-7z4dSgWeSA6boB1lgb', time=2024-09-12T03:06:47.656379+0000, chain.objs.size()=1 2024-09-12T01:11:00.149 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.149+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.743__multipart_mymultipart2.2~yj9EQSAEaIMA-7z4dSgWeSA6boB1lgb.1 2024-09-12T01:11:00.152 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.153+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:00.154 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.156+0000 7ff8fac0e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:11:00.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.157+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:11:00.156 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.157+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:11:00.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48112' 2024-09-12T01:11:00.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='_ckvIw5GJ2vt6Dpkk0lTAOrxv5VTxBgj', time=2024-09-12T02:49:28.204605+0000, chain.objs.size()=3 2024-09-12T01:11:00.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_.uGnKP5xKlWa5dDI5troI6_c02i_SkdD_0 2024-09-12T01:11:00.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_.uGnKP5xKlWa5dDI5troI6_c02i_SkdD_1 2024-09-12T01:11:00.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.162__shadow_.uGnKP5xKlWa5dDI5troI6_c02i_SkdD_2 2024-09-12T01:11:00.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14961126847537567828', time=2024-09-12T02:49:42.507911+0000, chain.objs.size()=1 2024-09-12T01:11:00.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.179__shadow_._74FKNUFhHibGK9NrH6IuS8JAhP_ZpJ_0 2024-09-12T01:11:00.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13845967026869207862', time=2024-09-12T02:49:58.213970+0000, chain.objs.size()=1 2024-09-12T01:11:00.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.200__shadow_.r3p2_S1miNawPUsnC0sAMNo7E1xC6Uh_0 2024-09-12T01:11:00.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2024858701576120023', time=2024-09-12T02:51:29.947338+0000, chain.objs.size()=1 2024-09-12T01:11:00.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.238__shadow_.b3s20jNlQ_fKU9jCMMNREd-q6kZiQEq_0 2024-09-12T01:11:00.158 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5832345052319096699', time=2024-09-12T02:51:35.277618+0000, chain.objs.size()=1 2024-09-12T01:11:00.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.246__shadow_.1diwgnnji2E7UZRoHuqFNgAsscn8Ons_0 2024-09-12T01:11:00.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5997249103834538001', time=2024-09-12T02:52:21.608307+0000, chain.objs.size()=1 2024-09-12T01:11:00.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Vm6YNUl8kT-JFZ67_JCCmfmJQO6VoJK_0 2024-09-12T01:11:00.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17723388254593719891', time=2024-09-12T02:52:21.675288+0000, chain.objs.size()=1 2024-09-12T01:11:00.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.kcntxaN7d4r-4kbmikNLEcfuoHvO5Nz_0 2024-09-12T01:11:00.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1747031888550998458', time=2024-09-12T02:52:21.767901+0000, chain.objs.size()=1 2024-09-12T01:11:00.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.Bg63btvHMGyt-uFrM-lSwsMSSebDizn_0 2024-09-12T01:11:00.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15003278725171795784', time=2024-09-12T02:52:22.058045+0000, chain.objs.size()=1 2024-09-12T01:11:00.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.YCuYXXqiS00Wz5s2kcZVd5Uc5JgUz7P_0 2024-09-12T01:11:00.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6447241592979826067', time=2024-09-12T02:52:22.164787+0000, chain.objs.size()=1 2024-09-12T01:11:00.159 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.158+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.urygJiUpl5ehRwYUeoPUHhWCF9hDLTA_0 2024-09-12T01:11:00.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.161+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17464188637159032828', time=2024-09-12T02:52:22.885881+0000, chain.objs.size()=1 2024-09-12T01:11:00.160 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.161+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.j55iOm3eaT54dxKEWQdSTEKCXcBHbpn_0 2024-09-12T01:11:00.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15530875985804516463', time=2024-09-12T02:52:23.026752+0000, chain.objs.size()=1 2024-09-12T01:11:00.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.JrMrrXRo6r8E84Nkgn34lWtSIYWsuAT_0 2024-09-12T01:11:00.162 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3091794771764063759', time=2024-09-12T02:52:23.105004+0000, chain.objs.size()=1 2024-09-12T01:11:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.YctpmRvB_U5CBJqsoPxSkpvSDU7ylA3_0 2024-09-12T01:11:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7033302227706060825', time=2024-09-12T02:52:23.185027+0000, chain.objs.size()=1 2024-09-12T01:11:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.QkA-tCuBd_Z4d7DU2OG6Yww8sCqZOUS_0 2024-09-12T01:11:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15283642689722262735', time=2024-09-12T02:52:23.389488+0000, chain.objs.size()=1 2024-09-12T01:11:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.IrXgjl2jRY0Mt2TchNpfHt3-H5CcVB8_0 2024-09-12T01:11:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11296410559642179941', time=2024-09-12T02:52:23.446158+0000, chain.objs.size()=1 2024-09-12T01:11:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.MRS7x5_7nvNcRXoLMFoSMihubmAat-E_0 2024-09-12T01:11:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16156374491387293817', time=2024-09-12T02:52:24.511484+0000, chain.objs.size()=1 2024-09-12T01:11:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.GfbmLugTdbNbOHIGp-S5dNeCCsJYSM0_0 2024-09-12T01:11:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5413459624785038690', time=2024-09-12T02:52:25.595554+0000, chain.objs.size()=1 2024-09-12T01:11:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.zVczDZYZpIryY6GNgkDIJSXa4Ep9IVR_0 2024-09-12T01:11:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11443401601202889557', time=2024-09-12T02:52:25.934602+0000, chain.objs.size()=1 2024-09-12T01:11:00.163 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.mNN_Vf6rPeL8jL9DS73z30aoPYlcqfU_0 2024-09-12T01:11:00.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13303632471361851756', time=2024-09-12T02:52:27.405717+0000, chain.objs.size()=1 2024-09-12T01:11:00.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.5JBcNZf1rc-4njMeBaco3cWDMdWVrst_0 2024-09-12T01:11:00.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9449409655937292085', time=2024-09-12T02:52:27.436789+0000, chain.objs.size()=1 2024-09-12T01:11:00.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.0LD5cJox_cko-r-S-IwMr6D1SRZ3PgJ_0 2024-09-12T01:11:00.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3108205637364327904', time=2024-09-12T02:52:27.714375+0000, chain.objs.size()=1 2024-09-12T01:11:00.164 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.163+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.N-miWakEMfgXhxrex5u7xyy6ESAxQGy_0 2024-09-12T01:11:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10427787693001634864', time=2024-09-12T02:52:28.424803+0000, chain.objs.size()=1 2024-09-12T01:11:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ba3k8GxQRh_KcIzLbT25R1wYjfLXs4b_0 2024-09-12T01:11:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.166+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17848965398748525560', time=2024-09-12T02:52:29.357455+0000, chain.objs.size()=1 2024-09-12T01:11:00.165 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.166+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.vbHmzL35Vr_1uA9ayrwjOb7nmayu4X3_0 2024-09-12T01:11:00.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2928142440280247956', time=2024-09-12T02:52:30.005072+0000, chain.objs.size()=1 2024-09-12T01:11:00.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.W0BepepnNN3apMLRL8RIJsidsC4vkZM_0 2024-09-12T01:11:00.167 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14530893578781557290', time=2024-09-12T02:52:30.149311+0000, chain.objs.size()=1 2024-09-12T01:11:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.xGSLBoqwP63CDtWuPcJRfCHGRHUXjj0_0 2024-09-12T01:11:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13072863189368573470', time=2024-09-12T02:52:30.251379+0000, chain.objs.size()=1 2024-09-12T01:11:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ic2m-3mR_bi3j9DXcYdGSdf_z1oCPDe_0 2024-09-12T01:11:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15346618114740330873', time=2024-09-12T02:52:30.399960+0000, chain.objs.size()=1 2024-09-12T01:11:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.X9-ghs3dChf3SdJVYJKW8ceKOM9ecfN_0 2024-09-12T01:11:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8340532476694580530', time=2024-09-12T02:52:30.422745+0000, chain.objs.size()=1 2024-09-12T01:11:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.9AZD-8nCboWItxUUXlBSbReils0yMFs_0 2024-09-12T01:11:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6369740386849256638', time=2024-09-12T02:52:31.125438+0000, chain.objs.size()=1 2024-09-12T01:11:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.-DWRdV5HsoNGuMzPcO1XGIhrhduGTlh_0 2024-09-12T01:11:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12709300287665288188', time=2024-09-12T02:52:31.451104+0000, chain.objs.size()=1 2024-09-12T01:11:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.gS_Wf0U8Kx6mVURMIZi1FE_LQibs7XW_0 2024-09-12T01:11:00.168 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8219908286782367962', time=2024-09-12T02:52:31.590819+0000, chain.objs.size()=1 2024-09-12T01:11:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.263__shadow_.ULfxkIRG987iDwy3P09vZ-l-Wst331p_0 2024-09-12T01:11:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17309627662943512197', time=2024-09-12T02:52:33.661559+0000, chain.objs.size()=1 2024-09-12T01:11:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.168+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.266__shadow_.Gj__OSJBAt-TcNyHVmY84JrJD1N0Yfq_0 2024-09-12T01:11:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.169+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12294329716949759956', time=2024-09-12T02:52:37.623296+0000, chain.objs.size()=1 2024-09-12T01:11:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.169+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.273__shadow_.oNdTjyMkRYLRKr5sHyugXal9H57i2U4_0 2024-09-12T01:11:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.169+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6466868254608641264', time=2024-09-12T02:52:51.091757+0000, chain.objs.size()=1 2024-09-12T01:11:00.169 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.169+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.lv3VrPTtAeSn0G2jPJzL5QLoqTqnUPY_0 2024-09-12T01:11:00.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.171+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8532422167081598077', time=2024-09-12T02:52:51.203296+0000, chain.objs.size()=1 2024-09-12T01:11:00.170 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.171+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.293__shadow_.RUeS8nua4BULEXo5xPdaBxBxjuCfqJR_0 2024-09-12T01:11:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.172+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15527912546849215153', time=2024-09-12T02:52:57.046796+0000, chain.objs.size()=1 2024-09-12T01:11:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.172+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.300__shadow_.QOMW3op8WDBE1bmo3sr_33dsVK9wuzG_0 2024-09-12T01:11:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.172+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5529315856881181842', time=2024-09-12T02:52:57.660724+0000, chain.objs.size()=1 2024-09-12T01:11:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.172+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.301__shadow_.eSYWapG4kMKUmn99CFBXHrR2FAPeBZr_0 2024-09-12T01:11:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.172+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17345481035566228624', time=2024-09-12T02:52:58.264774+0000, chain.objs.size()=1 2024-09-12T01:11:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.172+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.302__shadow_.rwEIGEO8nThPFqvsd5W116fEfc4hBT8_0 2024-09-12T01:11:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.172+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8213268827418917723', time=2024-09-12T02:53:49.726437+0000, chain.objs.size()=1 2024-09-12T01:11:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.172+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.nh9-NhibVCHC08HXxgyyd-0mDapSJU-_0 2024-09-12T01:11:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.172+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11580388297152648357', time=2024-09-12T02:53:49.821089+0000, chain.objs.size()=1 2024-09-12T01:11:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.172+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.V3wTelBVNKMbHuKolzHES61nUOidHG0_0 2024-09-12T01:11:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.172+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.16058932392771607613', time=2024-09-12T02:53:49.911863+0000, chain.objs.size()=1 2024-09-12T01:11:00.172 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.172+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.IAFiYV_iomibvxPO7K_BDznfyUNEHho_0 2024-09-12T01:11:00.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.173+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15965952493004959526', time=2024-09-12T02:53:51.045424+0000, chain.objs.size()=1 2024-09-12T01:11:00.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.173+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.cVM3CZiJ4JISGh8nv-tAASyPQqIsYNr_0 2024-09-12T01:11:00.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.173+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2235943678733423686', time=2024-09-12T02:53:51.228230+0000, chain.objs.size()=1 2024-09-12T01:11:00.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.173+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.wr_sy5CUTYcQaVAXnb2bsHX_pcK3vjY_0 2024-09-12T01:11:00.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.173+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17797873749460478343', time=2024-09-12T02:53:51.361677+0000, chain.objs.size()=1 2024-09-12T01:11:00.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.173+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.o_CabKrjentITR0cm9rffgyW1TdAOnl_0 2024-09-12T01:11:00.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.173+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13303646385017286743', time=2024-09-12T02:53:51.381181+0000, chain.objs.size()=1 2024-09-12T01:11:00.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.173+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.3zpNMoHt6_iBvDshcYrLJ0nvRAh9eBK_0 2024-09-12T01:11:00.173 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.174+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14630692932809641070', time=2024-09-12T02:53:51.739859+0000, chain.objs.size()=1 2024-09-12T01:11:00.174 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.174+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_._mqQmbqhBAsV_BQlEpBJLmcKzF7FnbT_0 2024-09-12T01:11:00.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12999937991021049346', time=2024-09-12T02:53:52.427083+0000, chain.objs.size()=1 2024-09-12T01:11:00.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5LVEbDeBbPgu5IQLU4smS2lZ0-e1JHR_0 2024-09-12T01:11:00.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2416262529303948731', time=2024-09-12T02:53:52.463555+0000, chain.objs.size()=1 2024-09-12T01:11:00.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.FAvElPiRqi5YFotk92_c_CV3xBaub-H_0 2024-09-12T01:11:00.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8711434925056544922', time=2024-09-12T02:53:52.494095+0000, chain.objs.size()=1 2024-09-12T01:11:00.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.VtsGDQ_cwDQwiXkwleX1mR1UwnSZT2A_0 2024-09-12T01:11:00.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8133484652211620894', time=2024-09-12T02:53:53.312244+0000, chain.objs.size()=1 2024-09-12T01:11:00.176 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.t1sK0xdE93118SyGiHBpsG8s5IskqHF_0 2024-09-12T01:11:00.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3025276958848535523', time=2024-09-12T02:53:54.367930+0000, chain.objs.size()=1 2024-09-12T01:11:00.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ibaYwr8tflzWUEFyqTKGtOcLoOTaTLr_0 2024-09-12T01:11:00.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7023044571531659135', time=2024-09-12T02:53:55.080655+0000, chain.objs.size()=1 2024-09-12T01:11:00.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.zLj3R24nPtyvscU6JCIZVPTOfmls6KE_0 2024-09-12T01:11:00.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9853961119246844828', time=2024-09-12T02:53:55.649312+0000, chain.objs.size()=1 2024-09-12T01:11:00.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.npODikPiOUmVJOTlaXCjdUMCiZTIsX8_0 2024-09-12T01:11:00.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1400891340193910716', time=2024-09-12T02:53:55.816731+0000, chain.objs.size()=1 2024-09-12T01:11:00.177 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.177+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.EhmCRGhnJRnichSPwh5c7rtQH-0Yosx_0 2024-09-12T01:11:00.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.178+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2730880036622058504', time=2024-09-12T02:53:55.904697+0000, chain.objs.size()=1 2024-09-12T01:11:00.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.178+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.JqE-V4gF5I9E0grj2cxntEzQ5tmu242_0 2024-09-12T01:11:00.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.178+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10748786568783735624', time=2024-09-12T02:53:56.345549+0000, chain.objs.size()=1 2024-09-12T01:11:00.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.178+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.RsRS-OBnB18v1aBEKseR71MUX2NCja3_0 2024-09-12T01:11:00.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.178+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6688009521117869713', time=2024-09-12T02:53:56.381600+0000, chain.objs.size()=1 2024-09-12T01:11:00.178 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.178+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_._gMJwKjn_oUL-ARe4kgYklGWFSdFuAD_0 2024-09-12T01:11:00.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15321338098038644372', time=2024-09-12T02:53:56.508363+0000, chain.objs.size()=1 2024-09-12T01:11:00.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.pI8NZU5lp288it4007Fz6kokjJ6Gxyb_0 2024-09-12T01:11:00.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4520957513038357175', time=2024-09-12T02:53:56.616486+0000, chain.objs.size()=1 2024-09-12T01:11:00.180 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.v0htpKgJp4VpGkY_Jo0Z4q8HoTMMM8g_0 2024-09-12T01:11:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9874964045196040453', time=2024-09-12T02:53:56.879289+0000, chain.objs.size()=1 2024-09-12T01:11:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.hCt-XumMR8fjC4HTFfu1YuuDqSqjMCr_0 2024-09-12T01:11:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7139909312790590565', time=2024-09-12T02:53:57.049829+0000, chain.objs.size()=1 2024-09-12T01:11:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.c1cFI9twsje4GYVqbyKEDJuyDcU_9zn_0 2024-09-12T01:11:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18114581408232108393', time=2024-09-12T02:53:57.209783+0000, chain.objs.size()=1 2024-09-12T01:11:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lXu_Ja0mMKJFGEzotP3NBL5qWoqFVqR_0 2024-09-12T01:11:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13978559095071682190', time=2024-09-12T02:53:57.745393+0000, chain.objs.size()=1 2024-09-12T01:11:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.2oJUw5S9CDo2B7Eh9P8Okbpn2TiPoSJ_0 2024-09-12T01:11:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14368153385230200937', time=2024-09-12T02:53:58.056974+0000, chain.objs.size()=1 2024-09-12T01:11:00.181 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.lk0VvPhURzYJmZ-6UCFgLFGfZr7F9_J_0 2024-09-12T01:11:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15800490183714224091', time=2024-09-12T02:53:58.216249+0000, chain.objs.size()=1 2024-09-12T01:11:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.yenjX7sCzYX6ZJu6Hg82rIyBeK7y8SM_0 2024-09-12T01:11:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6052899752702059569', time=2024-09-12T02:53:58.216787+0000, chain.objs.size()=1 2024-09-12T01:11:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.Vqxq09Si6cq8bLRvcoKBA-M4VWvWzX2_0 2024-09-12T01:11:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17806598528401446415', time=2024-09-12T02:53:58.365919+0000, chain.objs.size()=1 2024-09-12T01:11:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.I1zmZ2SRamFbJzR4tcd6qlK_v8wY-fr_0 2024-09-12T01:11:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17590809432174039667', time=2024-09-12T02:53:58.440314+0000, chain.objs.size()=1 2024-09-12T01:11:00.182 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.181+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.A2qwPdAPS8_2BHs38EF1Z4Px83x8mdp_0 2024-09-12T01:11:00.184 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6933822185520350421', time=2024-09-12T02:53:58.440899+0000, chain.objs.size()=1 2024-09-12T01:11:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.5CqLgQTitNyCwDhBaXYdeQ_iBjigCvU_0 2024-09-12T01:11:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8501821690089778873', time=2024-09-12T02:53:58.508142+0000, chain.objs.size()=1 2024-09-12T01:11:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.ijEc0ZBOEIIkWM7K3aogtl2Kg0Lz0bM_0 2024-09-12T01:11:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14423050319421181318', time=2024-09-12T02:53:59.379078+0000, chain.objs.size()=1 2024-09-12T01:11:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.oH_DgTLonhteyEzmqiKg2UoaanpHatF_0 2024-09-12T01:11:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10995257502205123934', time=2024-09-12T02:53:59.510106+0000, chain.objs.size()=1 2024-09-12T01:11:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.BPxTSu196vdb1_vzqkpAldx7oUj42y6_0 2024-09-12T01:11:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.11745833933249866700', time=2024-09-12T02:53:59.573014+0000, chain.objs.size()=1 2024-09-12T01:11:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.7GQ2MFlfxc-aXwS75rX1vkpKn1aJXjI_0 2024-09-12T01:11:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.6410718795073365509', time=2024-09-12T02:53:59.638887+0000, chain.objs.size()=1 2024-09-12T01:11:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.324__shadow_.yKqyofhFPDqwvCCIiZ12XRHU9cuvtje_0 2024-09-12T01:11:00.185 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2571082897951703585', time=2024-09-12T02:54:36.737925+0000, chain.objs.size()=1 2024-09-12T01:11:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.ZFzmWmVL5FVig2sNX1DN6J2dIAT3cN0_0 2024-09-12T01:11:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3044360154685160045', time=2024-09-12T02:54:36.939044+0000, chain.objs.size()=1 2024-09-12T01:11:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.tLaMIHIejfXFR0uaEaTTH7ZCbdfIlLl_0 2024-09-12T01:11:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18398058571976967515', time=2024-09-12T02:54:36.986742+0000, chain.objs.size()=1 2024-09-12T01:11:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.xhUSVvy2Tzu_kA3AaE6wlc6EzavVbVJ_0 2024-09-12T01:11:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14228678975363025264', time=2024-09-12T02:54:37.625003+0000, chain.objs.size()=1 2024-09-12T01:11:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.OhN766Z4-d55HGdaTVlHE3HXbqknmLa_0 2024-09-12T01:11:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1356000452434239927', time=2024-09-12T02:54:39.000854+0000, chain.objs.size()=1 2024-09-12T01:11:00.186 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.185+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._kwjEOAh11bz4l-bh1Hdc2zv3daX9o7_0 2024-09-12T01:11:00.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.190+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9172267635709156318', time=2024-09-12T02:54:39.487984+0000, chain.objs.size()=1 2024-09-12T01:11:00.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.190+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.9AghkBNdU8vbM7-qKCOpDMB9kq1cnXa_0 2024-09-12T01:11:00.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.190+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9326404495765196268', time=2024-09-12T02:54:39.661896+0000, chain.objs.size()=1 2024-09-12T01:11:00.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.190+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.xlpGHbsRyoDEscAqCZAB9VqylWuImTy_0 2024-09-12T01:11:00.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.190+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18123774447499369468', time=2024-09-12T02:54:39.851151+0000, chain.objs.size()=1 2024-09-12T01:11:00.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.190+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.qFoSidG2tCYkXoCrZosRrNocFBLnOds_0 2024-09-12T01:11:00.189 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.190+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5025516470414916171', time=2024-09-12T02:54:40.036870+0000, chain.objs.size()=1 2024-09-12T01:11:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.190+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.O5wnoTyzFk0zUyuxJSWCCeEzMq-PcJ3_0 2024-09-12T01:11:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.190+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7639099003634204720', time=2024-09-12T02:54:40.152880+0000, chain.objs.size()=1 2024-09-12T01:11:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.190+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.H-DaZ1T5TJSnXCtNLBwN6I-c9yOJnwn_0 2024-09-12T01:11:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.190+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13009871149139483665', time=2024-09-12T02:54:40.166372+0000, chain.objs.size()=1 2024-09-12T01:11:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.190+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.bj6vC8a0ZQHnv21vqbpeXs14DErUzPy_0 2024-09-12T01:11:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.190+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8100780007030807876', time=2024-09-12T02:54:40.460393+0000, chain.objs.size()=1 2024-09-12T01:11:00.190 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.190+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_._vjino0Vv2OFG0F0MlsnvezOQOBcueV_0 2024-09-12T01:11:00.191 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.192+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13610123884210315315', time=2024-09-12T02:54:42.192842+0000, chain.objs.size()=1 2024-09-12T01:11:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.192+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.xO5qMpp-usELUxokBW8WLvmnd8W-XvM_0 2024-09-12T01:11:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.192+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4647681469680158841', time=2024-09-12T02:54:42.214000+0000, chain.objs.size()=1 2024-09-12T01:11:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.192+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.m42KUpYHSwh3xNwbDC-_4R7bB-wiVF6_0 2024-09-12T01:11:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.192+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5944518475758158989', time=2024-09-12T02:54:42.487850+0000, chain.objs.size()=1 2024-09-12T01:11:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.192+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.7GIrEu1HjPtEi6ICTH-wwxi4N7uou-0_0 2024-09-12T01:11:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.192+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.5977844845942654102', time=2024-09-12T02:54:42.785405+0000, chain.objs.size()=1 2024-09-12T01:11:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.192+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.0PO4UL3qqc6N1vVTGJil-8mn50Q2y4b_0 2024-09-12T01:11:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.192+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.1718196923221702262', time=2024-09-12T02:54:43.475801+0000, chain.objs.size()=1 2024-09-12T01:11:00.192 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.192+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.tknHijUx2ZWSJ3JfESTThJ087ooDf3__0 2024-09-12T01:11:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.193+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2409742000663102891', time=2024-09-12T02:54:43.803775+0000, chain.objs.size()=1 2024-09-12T01:11:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.193+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.iOCwToHvE6jl-Mf0dd9nlfTS8Pk3KD7_0 2024-09-12T01:11:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.193+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.10875099221106225140', time=2024-09-12T02:54:43.828628+0000, chain.objs.size()=1 2024-09-12T01:11:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.193+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Gm0ntTJ7-9GhPxl846Fa263XSakt4A0_0 2024-09-12T01:11:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.194+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9844215833058040761', time=2024-09-12T02:54:43.896792+0000, chain.objs.size()=1 2024-09-12T01:11:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.194+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.zYLVlCgeu4H10O6tGVUV5DfZzR5o2Dd_0 2024-09-12T01:11:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.194+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8958848866729404557', time=2024-09-12T02:54:44.448605+0000, chain.objs.size()=1 2024-09-12T01:11:00.193 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.194+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.YWzHRAdGiF8EqZTpFQFnT6hxrRFVxhE_0 2024-09-12T01:11:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.194+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2190931135073090447', time=2024-09-12T02:54:44.740352+0000, chain.objs.size()=1 2024-09-12T01:11:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.194+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.tjtUT3R5oWuOYNjR-3oygTjVq_9kGxn_0 2024-09-12T01:11:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.194+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18214417510287943909', time=2024-09-12T02:54:45.194133+0000, chain.objs.size()=1 2024-09-12T01:11:00.194 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.194+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.6OVlPCm2lLK-GyTxEbkbURTGBcl10hc_0 2024-09-12T01:11:00.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.196+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3579486794574120481', time=2024-09-12T02:54:45.580305+0000, chain.objs.size()=1 2024-09-12T01:11:00.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.197+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Cn8KS0JTJmN3Khs3FzLBQoSlM-D0iJN_0 2024-09-12T01:11:00.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.197+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3711974773429637899', time=2024-09-12T02:54:46.331117+0000, chain.objs.size()=1 2024-09-12T01:11:00.196 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.197+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.yAvjpNCI_wuBKveiJyAWZkgjl273sKP_0 2024-09-12T01:11:00.198 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.199+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 0/48112 2024-09-12T01:11:00.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T01:11:00.201 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4906265819645025980', time=2024-09-12T02:54:46.669287+0000, chain.objs.size()=1 2024-09-12T01:11:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.Nm4zhEI62fEosd7o4Tp_lvG0UdWAeZa_0 2024-09-12T01:11:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17983124921089244065', time=2024-09-12T02:54:46.671642+0000, chain.objs.size()=1 2024-09-12T01:11:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.oEjhnuVT0u-0hIp6KwU7WTHXS-9o1-A_0 2024-09-12T01:11:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3864297886815446395', time=2024-09-12T02:54:46.755822+0000, chain.objs.size()=1 2024-09-12T01:11:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.325__shadow_.BQatCMNa1khIEG7q7u8HkK-i7Byxytt_0 2024-09-12T01:11:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2392383660010408375', time=2024-09-12T02:55:21.249732+0000, chain.objs.size()=1 2024-09-12T01:11:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.391__shadow_.Tg1PFnrxrrDErSY9C9fbf3TRdjIEflI_0 2024-09-12T01:11:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15088391033688343885', time=2024-09-12T02:55:31.566894+0000, chain.objs.size()=1 2024-09-12T01:11:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.408__shadow_.HaV2yscJ2gZdWg-vVlqU7TLhEOoGamn_0 2024-09-12T01:11:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15795484759593062841', time=2024-09-12T02:55:49.705196+0000, chain.objs.size()=1 2024-09-12T01:11:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.442__shadow_.YUeiaYpujLKHTczqwQxBGmy1OXSwvXw_0 2024-09-12T01:11:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7593137290543583693', time=2024-09-12T02:55:57.188744+0000, chain.objs.size()=1 2024-09-12T01:11:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.455__shadow_.N0ociftiGsMba-RW-h91Kyozs9A89bx_0 2024-09-12T01:11:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8908423492341953726', time=2024-09-12T02:56:03.807335+0000, chain.objs.size()=1 2024-09-12T01:11:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.463__shadow_.J1m63iyc2VlgUBVOjU2h0z42tS3YpQk_0 2024-09-12T01:11:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.4822697102241688320', time=2024-09-12T02:56:05.978482+0000, chain.objs.size()=1 2024-09-12T01:11:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.466__shadow_.9DEieR0QuQqCS6NirXxyAFiz25Fv-Bi_0 2024-09-12T01:11:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.15734716161875643729', time=2024-09-12T02:56:06.323093+0000, chain.objs.size()=1 2024-09-12T01:11:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.466__shadow_.wa57upZFu5RYBWT5vKLH2m7CN0ZmgP5_0 2024-09-12T01:11:00.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7215344902660315242', time=2024-09-12T02:56:14.347904+0000, chain.objs.size()=1 2024-09-12T01:11:00.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.484__shadow_.N9OHm7XhXjYRMqtgi9sAmD2XTsstyvO_0 2024-09-12T01:11:00.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.18388849643353854693', time=2024-09-12T02:59:48.964024+0000, chain.objs.size()=3 2024-09-12T01:11:00.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.201+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.564__shadow_.s4N8YjCK_3GqDmvOwdSHZJW7cqSm27s_0 2024-09-12T01:11:00.204 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.564__shadow_.s4N8YjCK_3GqDmvOwdSHZJW7cqSm27s_1 2024-09-12T01:11:00.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.564__shadow_.s4N8YjCK_3GqDmvOwdSHZJW7cqSm27s_2 2024-09-12T01:11:00.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13217092437971534376', time=2024-09-12T03:00:06.217477+0000, chain.objs.size()=1 2024-09-12T01:11:00.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.574__shadow_.D84u7vjwW8w2PYORcdB0TSJLlLNjm6l_0 2024-09-12T01:11:00.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.9698013884096318248', time=2024-09-12T03:00:29.455068+0000, chain.objs.size()=1 2024-09-12T01:11:00.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:89ud0XXa2DVe.4sHHwhfCgdHLy6gmDO_.jgY-k4Ur2ELoS7LH7_O5XRrfQhD04mu_0 2024-09-12T01:11:00.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.204+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.2046657879890829859', time=2024-09-12T03:00:33.699612+0000, chain.objs.size()=1 2024-09-12T01:11:00.205 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.204+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.578__shadow:mQ-4JOENL519HzRYAQfJtax-RQQXsBJ_.lMWkSZBC3gxZFvPYEThnQVtuxj7vAFZ_0 2024-09-12T01:11:00.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.206+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.3413997461137684494', time=2024-09-12T03:00:52.673427+0000, chain.objs.size()=1 2024-09-12T01:11:00.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.206+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.580__shadow:O99.aHxqzZUoa1WsEFtK51TCtsC-ZdJ_.I2eAM8lWW8m5QNeLBy-sPmWCTtXDmck_0 2024-09-12T01:11:00.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.206+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.12430701476144768594', time=2024-09-12T03:04:36.671149+0000, chain.objs.size()=12 2024-09-12T01:11:00.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.206+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.624__multipart_multipart_enc.2~PXmoTMolxvWurvOLB20cHBHxCcmz4Br.1 2024-09-12T01:11:00.206 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.206+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.624__shadow_multipart_enc.2~PXmoTMolxvWurvOLB20cHBHxCcmz4Br.1_1 2024-09-12T01:11:00.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.206+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.624__multipart_multipart_enc.2~PXmoTMolxvWurvOLB20cHBHxCcmz4Br.2 2024-09-12T01:11:00.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.206+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.624__shadow_multipart_enc.2~PXmoTMolxvWurvOLB20cHBHxCcmz4Br.2_1 2024-09-12T01:11:00.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.206+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.624__multipart_multipart_enc.2~PXmoTMolxvWurvOLB20cHBHxCcmz4Br.3 2024-09-12T01:11:00.207 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.207+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.624__shadow_multipart_enc.2~PXmoTMolxvWurvOLB20cHBHxCcmz4Br.3_1 2024-09-12T01:11:00.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.209+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.624__multipart_multipart_enc.2~PXmoTMolxvWurvOLB20cHBHxCcmz4Br.4 2024-09-12T01:11:00.208 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.209+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.624__shadow_multipart_enc.2~PXmoTMolxvWurvOLB20cHBHxCcmz4Br.4_1 2024-09-12T01:11:00.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.209+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.624__multipart_multipart_enc.2~PXmoTMolxvWurvOLB20cHBHxCcmz4Br.5 2024-09-12T01:11:00.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.209+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.624__shadow_multipart_enc.2~PXmoTMolxvWurvOLB20cHBHxCcmz4Br.5_1 2024-09-12T01:11:00.209 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.210+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.624__multipart_multipart_enc.2~PXmoTMolxvWurvOLB20cHBHxCcmz4Br.6 2024-09-12T01:11:00.210 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.211+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.624__shadow_multipart_enc.2~PXmoTMolxvWurvOLB20cHBHxCcmz4Br.6_1 2024-09-12T01:11:00.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.211+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17381932433377627838', time=2024-09-12T03:05:05.731983+0000, chain.objs.size()=2 2024-09-12T01:11:00.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.211+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.647__shadow_.8to5RPyph7lIIEsPRPpVOtbmmCUAH5y_0 2024-09-12T01:11:00.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.211+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.647__shadow_.8to5RPyph7lIIEsPRPpVOtbmmCUAH5y_1 2024-09-12T01:11:00.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.211+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.14376984751061169564', time=2024-09-12T03:05:32.495012+0000, chain.objs.size()=6 2024-09-12T01:11:00.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.211+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.661__multipart_bar.2~0GHKz9Hu5flHDBOl-B2fzjgSmuDXr_W.1 2024-09-12T01:11:00.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.211+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.661__multipart_bar.2~0GHKz9Hu5flHDBOl-B2fzjgSmuDXr_W.2 2024-09-12T01:11:00.211 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.211+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.661__multipart_bar.2~0GHKz9Hu5flHDBOl-B2fzjgSmuDXr_W.3 2024-09-12T01:11:00.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.212+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.661__multipart_bar.2~0GHKz9Hu5flHDBOl-B2fzjgSmuDXr_W.4 2024-09-12T01:11:00.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.661__multipart_bar.2~0GHKz9Hu5flHDBOl-B2fzjgSmuDXr_W.5 2024-09-12T01:11:00.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.661__multipart_bar.2~0GHKz9Hu5flHDBOl-B2fzjgSmuDXr_W.6 2024-09-12T01:11:00.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.213+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.8553576088082661844', time=2024-09-12T03:05:32.656379+0000, chain.objs.size()=6 2024-09-12T01:11:00.212 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.213+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.662__multipart_baz.2~VOZDPlIZfP8BPQduFDg7RCpp_k7ZQ0Q.1 2024-09-12T01:11:00.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.214+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.662__multipart_baz.2~VOZDPlIZfP8BPQduFDg7RCpp_k7ZQ0Q.2 2024-09-12T01:11:00.213 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.214+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.662__multipart_baz.2~VOZDPlIZfP8BPQduFDg7RCpp_k7ZQ0Q.3 2024-09-12T01:11:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.662__multipart_baz.2~VOZDPlIZfP8BPQduFDg7RCpp_k7ZQ0Q.4 2024-09-12T01:11:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.662__multipart_baz.2~VOZDPlIZfP8BPQduFDg7RCpp_k7ZQ0Q.5 2024-09-12T01:11:00.216 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.662__multipart_baz.2~VOZDPlIZfP8BPQduFDg7RCpp_k7ZQ0Q.6 2024-09-12T01:11:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.217+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.17826270747104854748', time=2024-09-12T03:05:34.619791+0000, chain.objs.size()=1 2024-09-12T01:11:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.665__shadow_.UGzGHYX25jVpontuio1oypFOP3iYjAN_0 2024-09-12T01:11:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.217+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.13201918667924810800', time=2024-09-12T03:06:01.221684+0000, chain.objs.size()=1 2024-09-12T01:11:00.217 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.713__shadow:SHpRIuqOQveElWMvXcf6heY5WLPDlTE_.gb08Q2jOUHK1ZMUd0D6VuRihtT0LId1_0 2024-09-12T01:11:00.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.217+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7423101028627736474', time=2024-09-12T03:06:44.561132+0000, chain.objs.size()=1 2024-09-12T01:11:00.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.740__shadow_.K6O7sGsCmakYQRurmqIDBASml7-ip80_0 2024-09-12T01:11:00.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.217+0000 7ff8fac0e800 20 garbage collection: RGWGC::process iterating over entry tag='dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.7844161128938160740', time=2024-09-12T03:06:50.912073+0000, chain.objs.size()=3 2024-09-12T01:11:00.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.744__multipart_mymultipart3.2~nKFyJRoVaZhRumhAJMFCCRiJdboShIw.1 2024-09-12T01:11:00.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.217+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.744__multipart_mymultipart3.2~nKFyJRoVaZhRumhAJMFCCRiJdboShIw.2 2024-09-12T01:11:00.218 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.219+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dc288c8f-59ac-48eb-bf10-42b042d6f57a.4570.744__multipart_mymultipart3.2~nKFyJRoVaZhRumhAJMFCCRiJdboShIw.3 2024-09-12T01:11:00.221 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.222+0000 7ff8fac0e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:11:00.224 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.225+0000 7ff7acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:11:00.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.227+0000 7ff8fac0e800 20 remove_watcher() i=0 2024-09-12T01:11:00.226 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.227+0000 7ff8fac0e800 2 removed watcher, disabling cache 2024-09-12T01:11:00.227 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.228+0000 7ff8fac0e800 20 remove_watcher() i=1 2024-09-12T01:11:00.228 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.229+0000 7ff8fac0e800 20 remove_watcher() i=2 2024-09-12T01:11:00.229 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.230+0000 7ff8fac0e800 20 remove_watcher() i=3 2024-09-12T01:11:00.230 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.231+0000 7ff8fac0e800 20 remove_watcher() i=4 2024-09-12T01:11:00.231 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.232+0000 7ff8fac0e800 20 remove_watcher() i=5 2024-09-12T01:11:00.232 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.233+0000 7ff8fac0e800 20 remove_watcher() i=6 2024-09-12T01:11:00.233 INFO:teuthology.orchestra.run.smithi133.stderr:2024-09-12T01:11:00.234+0000 7ff8fac0e800 20 remove_watcher() i=7 2024-09-12T01:11:00.245 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T01:11:00.257 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T01:11:00.363 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:11:00.364 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:11:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:11:00.698 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-09-12T01:11:00.701 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":2019,"stamp":"2024-09-12T01:10:59.331137+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":693215742,"num_objects":4875,"num_object_clones":0,"num_object_copies":14217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4875,"num_whiteouts":0,"num_read":176769,"num_read_kb":2197142,"num_write":139555,"num_write_kb":2394927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14283,"ondisk_log_size":14283,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2523908,"kb_used_data":1159812,"kb_used_omap":12,"kb_used_meta":1363955,"kb_avail":752450812,"statfs":{"total":773094113280,"available":770509631488,"internally_reserved":0,"allocated":1187647488,"data_stored":1171429680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1396690482},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-215,"num_objects":-15,"num_object_clones":0,"num_object_copies":-45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005544"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.023141+0000","last_change":"2024-09-12T00:46:54.886343+0000","last_active":"2024-09-12T01:06:55.023141+0000","last_peered":"2024-09-12T01:06:55.023141+0000","last_clean":"2024-09-12T01:06:55.023141+0000","last_became_active":"2024-09-12T00:46:54.885628+0000","last_became_peered":"2024-09-12T00:46:54.885628+0000","last_unstale":"2024-09-12T01:06:55.023141+0000","last_undegraded":"2024-09-12T01:06:55.023141+0000","last_fullsized":"2024-09-12T01:06:55.023141+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:28.705045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'4","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.235372+0000","last_change":"2024-09-12T00:30:17.763692+0000","last_active":"2024-09-12T01:07:50.235372+0000","last_peered":"2024-09-12T01:07:50.235372+0000","last_clean":"2024-09-12T01:07:50.235372+0000","last_became_active":"2024-09-12T00:30:17.763402+0000","last_became_peered":"2024-09-12T00:30:17.763402+0000","last_unstale":"2024-09-12T01:07:50.235372+0000","last_undegraded":"2024-09-12T01:07:50.235372+0000","last_fullsized":"2024-09-12T01:07:50.235372+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:07.859938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044542+0000","last_change":"2024-09-12T00:30:14.745260+0000","last_active":"2024-09-12T01:07:45.044542+0000","last_peered":"2024-09-12T01:07:45.044542+0000","last_clean":"2024-09-12T01:07:45.044542+0000","last_became_active":"2024-09-12T00:30:14.744833+0000","last_became_peered":"2024-09-12T00:30:14.744833+0000","last_unstale":"2024-09-12T01:07:45.044542+0000","last_undegraded":"2024-09-12T01:07:45.044542+0000","last_fullsized":"2024-09-12T01:07:45.044542+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:11.503961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'41","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.040605+0000","last_change":"2024-09-12T00:27:42.840206+0000","last_active":"2024-09-12T01:07:20.040605+0000","last_peered":"2024-09-12T01:07:20.040605+0000","last_clean":"2024-09-12T01:07:20.040605+0000","last_became_active":"2024-09-12T00:27:42.839605+0000","last_became_peered":"2024-09-12T00:27:42.839605+0000","last_unstale":"2024-09-12T01:07:20.040605+0000","last_undegraded":"2024-09-12T01:07:20.040605+0000","last_fullsized":"2024-09-12T01:07:20.040605+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:10.785209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":144,"num_write":69,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.153651+0000","last_change":"2024-09-12T00:46:54.885981+0000","last_active":"2024-09-12T01:06:55.153651+0000","last_peered":"2024-09-12T01:06:55.153651+0000","last_clean":"2024-09-12T01:06:55.153651+0000","last_became_active":"2024-09-12T00:46:54.885702+0000","last_became_peered":"2024-09-12T00:46:54.885702+0000","last_unstale":"2024-09-12T01:06:55.153651+0000","last_undegraded":"2024-09-12T01:06:55.153651+0000","last_fullsized":"2024-09-12T01:06:55.153651+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:37.616069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135467+0000","last_change":"2024-09-12T00:30:17.762666+0000","last_active":"2024-09-12T01:07:50.135467+0000","last_peered":"2024-09-12T01:07:50.135467+0000","last_clean":"2024-09-12T01:07:50.135467+0000","last_became_active":"2024-09-12T00:30:17.762369+0000","last_became_peered":"2024-09-12T00:30:17.762369+0000","last_unstale":"2024-09-12T01:07:50.135467+0000","last_undegraded":"2024-09-12T01:07:50.135467+0000","last_fullsized":"2024-09-12T01:07:50.135467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:33.357062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042925+0000","last_change":"2024-09-12T00:30:14.747881+0000","last_active":"2024-09-12T01:07:48.042925+0000","last_peered":"2024-09-12T01:07:48.042925+0000","last_clean":"2024-09-12T01:07:48.042925+0000","last_became_active":"2024-09-12T00:30:14.747614+0000","last_became_peered":"2024-09-12T00:30:14.747614+0000","last_unstale":"2024-09-12T01:07:48.042925+0000","last_undegraded":"2024-09-12T01:07:48.042925+0000","last_fullsized":"2024-09-12T01:07:48.042925+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:33.210330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'21","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045493+0000","last_change":"2024-09-12T00:27:42.846591+0000","last_active":"2024-09-12T01:07:50.045493+0000","last_peered":"2024-09-12T01:07:50.045493+0000","last_clean":"2024-09-12T01:07:50.045493+0000","last_became_active":"2024-09-12T00:27:42.846264+0000","last_became_peered":"2024-09-12T00:27:42.846264+0000","last_unstale":"2024-09-12T01:07:50.045493+0000","last_undegraded":"2024-09-12T01:07:50.045493+0000","last_fullsized":"2024-09-12T01:07:50.045493+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:13.645447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:15.224938+0000","last_change":"2024-09-12T00:46:54.890699+0000","last_active":"2024-09-12T01:06:15.224938+0000","last_peered":"2024-09-12T01:06:15.224938+0000","last_clean":"2024-09-12T01:06:15.224938+0000","last_became_active":"2024-09-12T00:46:54.890430+0000","last_became_peered":"2024-09-12T00:46:54.890430+0000","last_unstale":"2024-09-12T01:06:15.224938+0000","last_undegraded":"2024-09-12T01:06:15.224938+0000","last_fullsized":"2024-09-12T01:06:15.224938+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:21.161335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042970+0000","last_change":"2024-09-12T00:30:17.767409+0000","last_active":"2024-09-12T01:07:48.042970+0000","last_peered":"2024-09-12T01:07:48.042970+0000","last_clean":"2024-09-12T01:07:48.042970+0000","last_became_active":"2024-09-12T00:30:17.767116+0000","last_became_peered":"2024-09-12T00:30:17.767116+0000","last_unstale":"2024-09-12T01:07:48.042970+0000","last_undegraded":"2024-09-12T01:07:48.042970+0000","last_fullsized":"2024-09-12T01:07:48.042970+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:25.469472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"263'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.049608+0000","last_change":"2024-09-12T00:30:14.742702+0000","last_active":"2024-09-12T01:08:20.049608+0000","last_peered":"2024-09-12T01:08:20.049608+0000","last_clean":"2024-09-12T01:08:20.049608+0000","last_became_active":"2024-09-12T00:30:14.742434+0000","last_became_peered":"2024-09-12T00:30:14.742434+0000","last_unstale":"2024-09-12T01:08:20.049608+0000","last_undegraded":"2024-09-12T01:08:20.049608+0000","last_fullsized":"2024-09-12T01:08:20.049608+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:37.658561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099035,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6194,"num_write":4,"num_write_kb":5170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'36","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160719+0000","last_change":"2024-09-12T00:27:42.842436+0000","last_active":"2024-09-12T01:07:45.160719+0000","last_peered":"2024-09-12T01:07:45.160719+0000","last_clean":"2024-09-12T01:07:45.160719+0000","last_became_active":"2024-09-12T00:27:42.842172+0000","last_became_peered":"2024-09-12T00:27:42.842172+0000","last_unstale":"2024-09-12T01:07:45.160719+0000","last_undegraded":"2024-09-12T01:07:45.160719+0000","last_fullsized":"2024-09-12T01:07:45.160719+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:30.357785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:23.030019+0000","last_change":"2024-09-12T00:46:54.883267+0000","last_active":"2024-09-12T01:06:23.030019+0000","last_peered":"2024-09-12T01:06:23.030019+0000","last_clean":"2024-09-12T01:06:23.030019+0000","last_became_active":"2024-09-12T00:46:54.882951+0000","last_became_peered":"2024-09-12T00:46:54.882951+0000","last_unstale":"2024-09-12T01:06:23.030019+0000","last_undegraded":"2024-09-12T01:06:23.030019+0000","last_fullsized":"2024-09-12T01:06:23.030019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:55.035382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'1","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.049034+0000","last_change":"2024-09-12T00:30:17.766601+0000","last_active":"2024-09-12T01:08:28.049034+0000","last_peered":"2024-09-12T01:08:28.049034+0000","last_clean":"2024-09-12T01:08:28.049034+0000","last_became_active":"2024-09-12T00:30:17.764967+0000","last_became_peered":"2024-09-12T00:30:17.764967+0000","last_unstale":"2024-09-12T01:08:28.049034+0000","last_undegraded":"2024-09-12T01:08:28.049034+0000","last_fullsized":"2024-09-12T01:08:28.049034+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:56.749587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.234899+0000","last_change":"2024-09-12T00:30:14.747887+0000","last_active":"2024-09-12T01:07:45.234899+0000","last_peered":"2024-09-12T01:07:45.234899+0000","last_clean":"2024-09-12T01:07:45.234899+0000","last_became_active":"2024-09-12T00:30:14.747423+0000","last_became_peered":"2024-09-12T00:30:14.747423+0000","last_unstale":"2024-09-12T01:07:45.234899+0000","last_undegraded":"2024-09-12T01:07:45.234899+0000","last_fullsized":"2024-09-12T01:07:45.234899+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:10.117387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'27","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160694+0000","last_change":"2024-09-12T00:27:42.837430+0000","last_active":"2024-09-12T01:07:45.160694+0000","last_peered":"2024-09-12T01:07:45.160694+0000","last_clean":"2024-09-12T01:07:45.160694+0000","last_became_active":"2024-09-12T00:27:42.837170+0000","last_became_peered":"2024-09-12T00:27:42.837170+0000","last_unstale":"2024-09-12T01:07:45.160694+0000","last_undegraded":"2024-09-12T01:07:45.160694+0000","last_fullsized":"2024-09-12T01:07:45.160694+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:50.502592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":97,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.037066+0000","last_change":"2024-09-12T00:46:54.885456+0000","last_active":"2024-09-12T01:07:00.037066+0000","last_peered":"2024-09-12T01:07:00.037066+0000","last_clean":"2024-09-12T01:07:00.037066+0000","last_became_active":"2024-09-12T00:46:54.885170+0000","last_became_peered":"2024-09-12T00:46:54.885170+0000","last_unstale":"2024-09-12T01:07:00.037066+0000","last_undegraded":"2024-09-12T01:07:00.037066+0000","last_fullsized":"2024-09-12T01:07:00.037066+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:22.660312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.022559+0000","last_change":"2024-09-12T00:30:17.765475+0000","last_active":"2024-09-12T01:06:50.022559+0000","last_peered":"2024-09-12T01:06:50.022559+0000","last_clean":"2024-09-12T01:06:50.022559+0000","last_became_active":"2024-09-12T00:30:17.765167+0000","last_became_peered":"2024-09-12T00:30:17.765167+0000","last_unstale":"2024-09-12T01:06:50.022559+0000","last_undegraded":"2024-09-12T01:06:50.022559+0000","last_fullsized":"2024-09-12T01:06:50.022559+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:48.717488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4778667,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":6715,"num_write":4,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:33.031572+0000","last_change":"2024-09-12T00:30:14.742908+0000","last_active":"2024-09-12T01:06:33.031572+0000","last_peered":"2024-09-12T01:06:33.031572+0000","last_clean":"2024-09-12T01:06:33.031572+0000","last_became_active":"2024-09-12T00:30:14.742625+0000","last_became_peered":"2024-09-12T00:30:14.742625+0000","last_unstale":"2024-09-12T01:06:33.031572+0000","last_undegraded":"2024-09-12T01:06:33.031572+0000","last_fullsized":"2024-09-12T01:06:33.031572+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:00.744053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160647+0000","last_change":"2024-09-12T00:27:42.845668+0000","last_active":"2024-09-12T01:07:45.160647+0000","last_peered":"2024-09-12T01:07:45.160647+0000","last_clean":"2024-09-12T01:07:45.160647+0000","last_became_active":"2024-09-12T00:27:42.845406+0000","last_became_peered":"2024-09-12T00:27:42.845406+0000","last_unstale":"2024-09-12T01:07:45.160647+0000","last_undegraded":"2024-09-12T01:07:45.160647+0000","last_fullsized":"2024-09-12T01:07:45.160647+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:58.406118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":45,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044551+0000","last_change":"2024-09-12T00:46:54.877914+0000","last_active":"2024-09-12T01:07:45.044551+0000","last_peered":"2024-09-12T01:07:45.044551+0000","last_clean":"2024-09-12T01:07:45.044551+0000","last_became_active":"2024-09-12T00:46:54.876219+0000","last_became_peered":"2024-09-12T00:46:54.876219+0000","last_unstale":"2024-09-12T01:07:45.044551+0000","last_undegraded":"2024-09-12T01:07:45.044551+0000","last_fullsized":"2024-09-12T01:07:45.044551+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:46.030061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.033467+0000","last_change":"2024-09-12T00:30:17.763491+0000","last_active":"2024-09-12T01:06:35.033467+0000","last_peered":"2024-09-12T01:06:35.033467+0000","last_clean":"2024-09-12T01:06:35.033467+0000","last_became_active":"2024-09-12T00:30:17.762792+0000","last_became_peered":"2024-09-12T00:30:17.762792+0000","last_unstale":"2024-09-12T01:06:35.033467+0000","last_undegraded":"2024-09-12T01:06:35.033467+0000","last_fullsized":"2024-09-12T01:06:35.033467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:45.751971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.034091+0000","last_change":"2024-09-12T00:30:14.745747+0000","last_active":"2024-09-12T01:06:40.034091+0000","last_peered":"2024-09-12T01:06:40.034091+0000","last_clean":"2024-09-12T01:06:40.034091+0000","last_became_active":"2024-09-12T00:30:14.745328+0000","last_became_peered":"2024-09-12T00:30:14.745328+0000","last_unstale":"2024-09-12T01:06:40.034091+0000","last_undegraded":"2024-09-12T01:06:40.034091+0000","last_fullsized":"2024-09-12T01:06:40.034091+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:22.444900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'29","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.134777+0000","last_change":"2024-09-12T00:27:42.844015+0000","last_active":"2024-09-12T01:07:45.134777+0000","last_peered":"2024-09-12T01:07:45.134777+0000","last_clean":"2024-09-12T01:07:45.134777+0000","last_became_active":"2024-09-12T00:27:42.843745+0000","last_became_peered":"2024-09-12T00:27:42.843745+0000","last_unstale":"2024-09-12T01:07:45.134777+0000","last_undegraded":"2024-09-12T01:07:45.134777+0000","last_fullsized":"2024-09-12T01:07:45.134777+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:02.518882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":101,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.129245+0000","last_change":"2024-09-12T00:46:54.889308+0000","last_active":"2024-09-12T01:06:55.129245+0000","last_peered":"2024-09-12T01:06:55.129245+0000","last_clean":"2024-09-12T01:06:55.129245+0000","last_became_active":"2024-09-12T00:46:54.889006+0000","last_became_peered":"2024-09-12T00:46:54.889006+0000","last_unstale":"2024-09-12T01:06:55.129245+0000","last_undegraded":"2024-09-12T01:06:55.129245+0000","last_fullsized":"2024-09-12T01:06:55.129245+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:09.749976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'10","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135456+0000","last_change":"2024-09-12T00:30:17.759472+0000","last_active":"2024-09-12T01:07:50.135456+0000","last_peered":"2024-09-12T01:07:50.135456+0000","last_clean":"2024-09-12T01:07:50.135456+0000","last_became_active":"2024-09-12T00:30:17.759198+0000","last_became_peered":"2024-09-12T00:30:17.759198+0000","last_unstale":"2024-09-12T01:07:50.135456+0000","last_undegraded":"2024-09-12T01:07:50.135456+0000","last_fullsized":"2024-09-12T01:07:50.135456+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:30.456850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":9336,"num_write":15,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.028479+0000","last_change":"2024-09-12T00:30:14.750283+0000","last_active":"2024-09-12T01:07:45.028479+0000","last_peered":"2024-09-12T01:07:45.028479+0000","last_clean":"2024-09-12T01:07:45.028479+0000","last_became_active":"2024-09-12T00:30:14.750004+0000","last_became_peered":"2024-09-12T00:30:14.750004+0000","last_unstale":"2024-09-12T01:07:45.028479+0000","last_undegraded":"2024-09-12T01:07:45.028479+0000","last_fullsized":"2024-09-12T01:07:45.028479+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:54.714545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'18","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.031378+0000","last_change":"2024-09-12T00:27:42.835796+0000","last_active":"2024-09-12T01:06:30.031378+0000","last_peered":"2024-09-12T01:06:30.031378+0000","last_clean":"2024-09-12T01:06:30.031378+0000","last_became_active":"2024-09-12T00:27:42.835530+0000","last_became_peered":"2024-09-12T00:27:42.835530+0000","last_unstale":"2024-09-12T01:06:30.031378+0000","last_undegraded":"2024-09-12T01:06:30.031378+0000","last_fullsized":"2024-09-12T01:06:30.031378+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:37.899819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.023205+0000","last_change":"2024-09-12T00:46:54.883214+0000","last_active":"2024-09-12T01:06:55.023205+0000","last_peered":"2024-09-12T01:06:55.023205+0000","last_clean":"2024-09-12T01:06:55.023205+0000","last_became_active":"2024-09-12T00:46:54.882946+0000","last_became_peered":"2024-09-12T00:46:54.882946+0000","last_unstale":"2024-09-12T01:06:55.023205+0000","last_undegraded":"2024-09-12T01:06:55.023205+0000","last_fullsized":"2024-09-12T01:06:55.023205+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:01.444701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045398+0000","last_change":"2024-09-12T00:30:17.766684+0000","last_active":"2024-09-12T01:07:50.045398+0000","last_peered":"2024-09-12T01:07:50.045398+0000","last_clean":"2024-09-12T01:07:50.045398+0000","last_became_active":"2024-09-12T00:30:17.763733+0000","last_became_peered":"2024-09-12T00:30:17.763733+0000","last_unstale":"2024-09-12T01:07:50.045398+0000","last_undegraded":"2024-09-12T01:07:50.045398+0000","last_fullsized":"2024-09-12T01:07:50.045398+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:45.175363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'4","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160664+0000","last_change":"2024-09-12T00:30:14.748751+0000","last_active":"2024-09-12T01:07:45.160664+0000","last_peered":"2024-09-12T01:07:45.160664+0000","last_clean":"2024-09-12T01:07:45.160664+0000","last_became_active":"2024-09-12T00:30:14.748462+0000","last_became_peered":"2024-09-12T00:30:14.748462+0000","last_unstale":"2024-09-12T01:07:45.160664+0000","last_undegraded":"2024-09-12T01:07:45.160664+0000","last_fullsized":"2024-09-12T01:07:45.160664+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:23.544212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'17","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.148879+0000","last_change":"2024-09-12T00:27:42.839309+0000","last_active":"2024-09-12T01:06:25.148879+0000","last_peered":"2024-09-12T01:06:25.148879+0000","last_clean":"2024-09-12T01:06:25.148879+0000","last_became_active":"2024-09-12T00:27:42.838896+0000","last_became_peered":"2024-09-12T00:27:42.838896+0000","last_unstale":"2024-09-12T01:06:25.148879+0000","last_undegraded":"2024-09-12T01:06:25.148879+0000","last_fullsized":"2024-09-12T01:06:25.148879+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:33.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.044373+0000","last_change":"2024-09-12T00:46:54.885744+0000","last_active":"2024-09-12T01:07:58.044373+0000","last_peered":"2024-09-12T01:07:58.044373+0000","last_clean":"2024-09-12T01:07:58.044373+0000","last_became_active":"2024-09-12T00:46:54.885457+0000","last_became_peered":"2024-09-12T00:46:54.885457+0000","last_unstale":"2024-09-12T01:07:58.044373+0000","last_undegraded":"2024-09-12T01:07:58.044373+0000","last_fullsized":"2024-09-12T01:07:58.044373+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:36.235325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.032424+0000","last_change":"2024-09-12T00:30:17.765481+0000","last_active":"2024-09-12T01:06:35.032424+0000","last_peered":"2024-09-12T01:06:35.032424+0000","last_clean":"2024-09-12T01:06:35.032424+0000","last_became_active":"2024-09-12T00:30:17.765149+0000","last_became_peered":"2024-09-12T00:30:17.765149+0000","last_unstale":"2024-09-12T01:06:35.032424+0000","last_undegraded":"2024-09-12T01:06:35.032424+0000","last_fullsized":"2024-09-12T01:06:35.032424+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:20.242797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041690+0000","last_change":"2024-09-12T00:30:14.740879+0000","last_active":"2024-09-12T01:07:45.041690+0000","last_peered":"2024-09-12T01:07:45.041690+0000","last_clean":"2024-09-12T01:07:45.041690+0000","last_became_active":"2024-09-12T00:30:14.740516+0000","last_became_peered":"2024-09-12T00:30:14.740516+0000","last_unstale":"2024-09-12T01:07:45.041690+0000","last_undegraded":"2024-09-12T01:07:45.041690+0000","last_fullsized":"2024-09-12T01:07:45.041690+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:43.135121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'20","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030659+0000","last_change":"2024-09-12T00:27:42.841806+0000","last_active":"2024-09-12T01:06:25.030659+0000","last_peered":"2024-09-12T01:06:25.030659+0000","last_clean":"2024-09-12T01:06:25.030659+0000","last_became_active":"2024-09-12T00:27:42.840919+0000","last_became_peered":"2024-09-12T00:27:42.840919+0000","last_unstale":"2024-09-12T01:06:25.030659+0000","last_undegraded":"2024-09-12T01:06:25.030659+0000","last_fullsized":"2024-09-12T01:06:25.030659+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:51.676258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":83,"num_write":31,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.162301+0000","last_change":"2024-09-12T00:46:54.887403+0000","last_active":"2024-09-12T01:07:55.162301+0000","last_peered":"2024-09-12T01:07:55.162301+0000","last_clean":"2024-09-12T01:07:55.162301+0000","last_became_active":"2024-09-12T00:46:54.887134+0000","last_became_peered":"2024-09-12T00:46:54.887134+0000","last_unstale":"2024-09-12T01:07:55.162301+0000","last_undegraded":"2024-09-12T01:07:55.162301+0000","last_fullsized":"2024-09-12T01:07:55.162301+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:13.379263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'6","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042898+0000","last_change":"2024-09-12T00:30:17.766525+0000","last_active":"2024-09-12T01:07:48.042898+0000","last_peered":"2024-09-12T01:07:48.042898+0000","last_clean":"2024-09-12T01:07:48.042898+0000","last_became_active":"2024-09-12T00:30:17.766203+0000","last_became_peered":"2024-09-12T00:30:17.766203+0000","last_unstale":"2024-09-12T01:07:48.042898+0000","last_undegraded":"2024-09-12T01:07:48.042898+0000","last_fullsized":"2024-09-12T01:07:48.042898+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:51.225523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8439067,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":13412,"num_write":11,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.020488+0000","last_change":"2024-09-12T00:30:14.746410+0000","last_active":"2024-09-12T01:06:30.020488+0000","last_peered":"2024-09-12T01:06:30.020488+0000","last_clean":"2024-09-12T01:06:30.020488+0000","last_became_active":"2024-09-12T00:30:14.746119+0000","last_became_peered":"2024-09-12T00:30:14.746119+0000","last_unstale":"2024-09-12T01:06:30.020488+0000","last_undegraded":"2024-09-12T01:06:30.020488+0000","last_fullsized":"2024-09-12T01:06:30.020488+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:15.863696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'39","reported_seq":151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030634+0000","last_change":"2024-09-12T00:27:42.846588+0000","last_active":"2024-09-12T01:06:25.030634+0000","last_peered":"2024-09-12T01:06:25.030634+0000","last_clean":"2024-09-12T01:06:25.030634+0000","last_became_active":"2024-09-12T00:27:42.846198+0000","last_became_peered":"2024-09-12T00:27:42.846198+0000","last_unstale":"2024-09-12T01:06:25.030634+0000","last_undegraded":"2024-09-12T01:06:25.030634+0000","last_fullsized":"2024-09-12T01:06:25.030634+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:39.702227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":138,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.135933+0000","last_change":"2024-09-12T00:46:54.886148+0000","last_active":"2024-09-12T01:07:55.135933+0000","last_peered":"2024-09-12T01:07:55.135933+0000","last_clean":"2024-09-12T01:07:55.135933+0000","last_became_active":"2024-09-12T00:46:54.885879+0000","last_became_peered":"2024-09-12T00:46:54.885879+0000","last_unstale":"2024-09-12T01:07:55.135933+0000","last_undegraded":"2024-09-12T01:07:55.135933+0000","last_fullsized":"2024-09-12T01:07:55.135933+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:12.855547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"260'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.032478+0000","last_change":"2024-09-12T00:30:17.769299+0000","last_active":"2024-09-12T01:06:35.032478+0000","last_peered":"2024-09-12T01:06:35.032478+0000","last_clean":"2024-09-12T01:06:35.032478+0000","last_became_active":"2024-09-12T00:30:17.769051+0000","last_became_peered":"2024-09-12T00:30:17.769051+0000","last_unstale":"2024-09-12T01:06:35.032478+0000","last_undegraded":"2024-09-12T01:06:35.032478+0000","last_fullsized":"2024-09-12T01:06:35.032478+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:02.321672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.031472+0000","last_change":"2024-09-12T00:30:14.743361+0000","last_active":"2024-09-12T01:06:30.031472+0000","last_peered":"2024-09-12T01:06:30.031472+0000","last_clean":"2024-09-12T01:06:30.031472+0000","last_became_active":"2024-09-12T00:30:14.743083+0000","last_became_peered":"2024-09-12T00:30:14.743083+0000","last_unstale":"2024-09-12T01:06:30.031472+0000","last_undegraded":"2024-09-12T01:06:30.031472+0000","last_fullsized":"2024-09-12T01:06:30.031472+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:54.700301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030625+0000","last_change":"2024-09-12T00:27:42.839353+0000","last_active":"2024-09-12T01:06:25.030625+0000","last_peered":"2024-09-12T01:06:25.030625+0000","last_clean":"2024-09-12T01:06:25.030625+0000","last_became_active":"2024-09-12T00:27:42.839063+0000","last_became_peered":"2024-09-12T00:27:42.839063+0000","last_unstale":"2024-09-12T01:06:25.030625+0000","last_undegraded":"2024-09-12T01:06:25.030625+0000","last_fullsized":"2024-09-12T01:06:25.030625+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:50.341652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":119,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.029600+0000","last_change":"2024-09-12T00:46:54.887703+0000","last_active":"2024-09-12T01:07:55.029600+0000","last_peered":"2024-09-12T01:07:55.029600+0000","last_clean":"2024-09-12T01:07:55.029600+0000","last_became_active":"2024-09-12T00:46:54.887450+0000","last_became_peered":"2024-09-12T00:46:54.887450+0000","last_unstale":"2024-09-12T01:07:55.029600+0000","last_undegraded":"2024-09-12T01:07:55.029600+0000","last_fullsized":"2024-09-12T01:07:55.029600+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:53.371335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.021027+0000","last_change":"2024-09-12T00:30:17.756613+0000","last_active":"2024-09-12T01:06:35.021027+0000","last_peered":"2024-09-12T01:06:35.021027+0000","last_clean":"2024-09-12T01:06:35.021027+0000","last_became_active":"2024-09-12T00:30:17.756342+0000","last_became_peered":"2024-09-12T00:30:17.756342+0000","last_unstale":"2024-09-12T01:06:35.021027+0000","last_undegraded":"2024-09-12T01:06:35.021027+0000","last_fullsized":"2024-09-12T01:06:35.021027+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:08.103127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:33.031702+0000","last_change":"2024-09-12T00:30:14.748689+0000","last_active":"2024-09-12T01:06:33.031702+0000","last_peered":"2024-09-12T01:06:33.031702+0000","last_clean":"2024-09-12T01:06:33.031702+0000","last_became_active":"2024-09-12T00:30:14.748446+0000","last_became_peered":"2024-09-12T00:30:14.748446+0000","last_unstale":"2024-09-12T01:06:33.031702+0000","last_undegraded":"2024-09-12T01:06:33.031702+0000","last_fullsized":"2024-09-12T01:06:33.031702+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:32.811168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'23","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.040482+0000","last_change":"2024-09-12T00:27:42.845645+0000","last_active":"2024-09-12T01:07:35.040482+0000","last_peered":"2024-09-12T01:07:35.040482+0000","last_clean":"2024-09-12T01:07:35.040482+0000","last_became_active":"2024-09-12T00:27:42.845379+0000","last_became_peered":"2024-09-12T00:27:42.845379+0000","last_unstale":"2024-09-12T01:07:35.040482+0000","last_undegraded":"2024-09-12T01:07:35.040482+0000","last_fullsized":"2024-09-12T01:07:35.040482+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:35.854841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:18.029467+0000","last_change":"2024-09-12T00:46:54.884019+0000","last_active":"2024-09-12T01:06:18.029467+0000","last_peered":"2024-09-12T01:06:18.029467+0000","last_clean":"2024-09-12T01:06:18.029467+0000","last_became_active":"2024-09-12T00:46:54.883713+0000","last_became_peered":"2024-09-12T00:46:54.883713+0000","last_unstale":"2024-09-12T01:06:18.029467+0000","last_undegraded":"2024-09-12T01:06:18.029467+0000","last_fullsized":"2024-09-12T01:06:18.029467+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:41.973083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.041273+0000","last_change":"2024-09-12T00:30:17.764514+0000","last_active":"2024-09-12T01:07:38.041273+0000","last_peered":"2024-09-12T01:07:38.041273+0000","last_clean":"2024-09-12T01:07:38.041273+0000","last_became_active":"2024-09-12T00:30:17.764165+0000","last_became_peered":"2024-09-12T00:30:17.764165+0000","last_unstale":"2024-09-12T01:07:38.041273+0000","last_undegraded":"2024-09-12T01:07:38.041273+0000","last_fullsized":"2024-09-12T01:07:38.041273+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:16.348051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.233654+0000","last_change":"2024-09-12T00:30:14.747500+0000","last_active":"2024-09-12T01:07:35.233654+0000","last_peered":"2024-09-12T01:07:35.233654+0000","last_clean":"2024-09-12T01:07:35.233654+0000","last_became_active":"2024-09-12T00:30:14.747184+0000","last_became_peered":"2024-09-12T00:30:14.747184+0000","last_unstale":"2024-09-12T01:07:35.233654+0000","last_undegraded":"2024-09-12T01:07:35.233654+0000","last_fullsized":"2024-09-12T01:07:35.233654+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:20.436960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48429,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4144,"num_write":3,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'76","reported_seq":299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.039285+0000","last_change":"2024-09-12T00:27:42.846397+0000","last_active":"2024-09-12T01:07:25.039285+0000","last_peered":"2024-09-12T01:07:25.039285+0000","last_clean":"2024-09-12T01:07:25.039285+0000","last_became_active":"2024-09-12T00:27:42.846108+0000","last_became_peered":"2024-09-12T00:27:42.846108+0000","last_unstale":"2024-09-12T01:07:25.039285+0000","last_undegraded":"2024-09-12T01:07:25.039285+0000","last_fullsized":"2024-09-12T01:07:25.039285+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:11.395534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":337,"num_write":98,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:15.147442+0000","last_change":"2024-09-12T00:46:54.889757+0000","last_active":"2024-09-12T01:06:15.147442+0000","last_peered":"2024-09-12T01:06:15.147442+0000","last_clean":"2024-09-12T01:06:15.147442+0000","last_became_active":"2024-09-12T00:46:54.889496+0000","last_became_peered":"2024-09-12T00:46:54.889496+0000","last_unstale":"2024-09-12T01:06:15.147442+0000","last_undegraded":"2024-09-12T01:06:15.147442+0000","last_fullsized":"2024-09-12T01:06:15.147442+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:28.265877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.041215+0000","last_change":"2024-09-12T00:30:17.767918+0000","last_active":"2024-09-12T01:07:38.041215+0000","last_peered":"2024-09-12T01:07:38.041215+0000","last_clean":"2024-09-12T01:07:38.041215+0000","last_became_active":"2024-09-12T00:30:17.767526+0000","last_became_peered":"2024-09-12T00:30:17.767526+0000","last_unstale":"2024-09-12T01:07:38.041215+0000","last_undegraded":"2024-09-12T01:07:38.041215+0000","last_fullsized":"2024-09-12T01:07:38.041215+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:28.500175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.041253+0000","last_change":"2024-09-12T00:30:14.749360+0000","last_active":"2024-09-12T01:07:38.041253+0000","last_peered":"2024-09-12T01:07:38.041253+0000","last_clean":"2024-09-12T01:07:38.041253+0000","last_became_active":"2024-09-12T00:30:14.749104+0000","last_became_peered":"2024-09-12T00:30:14.749104+0000","last_unstale":"2024-09-12T01:07:38.041253+0000","last_undegraded":"2024-09-12T01:07:38.041253+0000","last_fullsized":"2024-09-12T01:07:38.041253+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:33.044875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'28","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.041394+0000","last_change":"2024-09-12T00:27:42.841054+0000","last_active":"2024-09-12T01:07:25.041394+0000","last_peered":"2024-09-12T01:07:25.041394+0000","last_clean":"2024-09-12T01:07:25.041394+0000","last_became_active":"2024-09-12T00:27:42.840749+0000","last_became_peered":"2024-09-12T00:27:42.840749+0000","last_unstale":"2024-09-12T01:07:25.041394+0000","last_undegraded":"2024-09-12T01:07:25.041394+0000","last_fullsized":"2024-09-12T01:07:25.041394+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:58.932432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":101,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.046768+0000","last_change":"2024-09-12T00:46:54.876242+0000","last_active":"2024-09-12T01:08:00.046768+0000","last_peered":"2024-09-12T01:08:00.046768+0000","last_clean":"2024-09-12T01:08:00.046768+0000","last_became_active":"2024-09-12T00:46:54.875939+0000","last_became_peered":"2024-09-12T00:46:54.875939+0000","last_unstale":"2024-09-12T01:08:00.046768+0000","last_undegraded":"2024-09-12T01:08:00.046768+0000","last_fullsized":"2024-09-12T01:08:00.046768+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:39.634295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043775+0000","last_change":"2024-09-12T00:30:17.761490+0000","last_active":"2024-09-12T01:07:40.043775+0000","last_peered":"2024-09-12T01:07:40.043775+0000","last_clean":"2024-09-12T01:07:40.043775+0000","last_became_active":"2024-09-12T00:30:17.761182+0000","last_became_peered":"2024-09-12T00:30:17.761182+0000","last_unstale":"2024-09-12T01:07:40.043775+0000","last_undegraded":"2024-09-12T01:07:40.043775+0000","last_fullsized":"2024-09-12T01:07:40.043775+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:42.070821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.233715+0000","last_change":"2024-09-12T00:30:14.748190+0000","last_active":"2024-09-12T01:07:35.233715+0000","last_peered":"2024-09-12T01:07:35.233715+0000","last_clean":"2024-09-12T01:07:35.233715+0000","last_became_active":"2024-09-12T00:30:14.747887+0000","last_became_peered":"2024-09-12T00:30:14.747887+0000","last_unstale":"2024-09-12T01:07:35.233715+0000","last_undegraded":"2024-09-12T01:07:35.233715+0000","last_fullsized":"2024-09-12T01:07:35.233715+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:51.879862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'76","reported_seq":312,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.132545+0000","last_change":"2024-09-12T00:27:42.839562+0000","last_active":"2024-09-12T01:07:25.132545+0000","last_peered":"2024-09-12T01:07:25.132545+0000","last_clean":"2024-09-12T01:07:25.132545+0000","last_became_active":"2024-09-12T00:27:42.839295+0000","last_became_peered":"2024-09-12T00:27:42.839295+0000","last_unstale":"2024-09-12T01:07:25.132545+0000","last_undegraded":"2024-09-12T01:07:25.132545+0000","last_fullsized":"2024-09-12T01:07:25.132545+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:56.924650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":349,"num_write":102,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:15.147394+0000","last_change":"2024-09-12T00:46:54.881248+0000","last_active":"2024-09-12T01:06:15.147394+0000","last_peered":"2024-09-12T01:06:15.147394+0000","last_clean":"2024-09-12T01:06:15.147394+0000","last_became_active":"2024-09-12T00:46:54.880982+0000","last_became_peered":"2024-09-12T00:46:54.880982+0000","last_unstale":"2024-09-12T01:06:15.147394+0000","last_undegraded":"2024-09-12T01:06:15.147394+0000","last_fullsized":"2024-09-12T01:06:15.147394+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:32.451032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"263'1","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.041046+0000","last_change":"2024-09-12T00:30:17.766356+0000","last_active":"2024-09-12T01:07:40.041046+0000","last_peered":"2024-09-12T01:07:40.041046+0000","last_clean":"2024-09-12T01:07:40.041046+0000","last_became_active":"2024-09-12T00:30:17.765384+0000","last_became_peered":"2024-09-12T00:30:17.765384+0000","last_unstale":"2024-09-12T01:07:40.041046+0000","last_undegraded":"2024-09-12T01:07:40.041046+0000","last_fullsized":"2024-09-12T01:07:40.041046+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:48.714095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.233741+0000","last_change":"2024-09-12T00:30:14.750712+0000","last_active":"2024-09-12T01:07:35.233741+0000","last_peered":"2024-09-12T01:07:35.233741+0000","last_clean":"2024-09-12T01:07:35.233741+0000","last_became_active":"2024-09-12T00:30:14.750407+0000","last_became_peered":"2024-09-12T00:30:14.750407+0000","last_unstale":"2024-09-12T01:07:35.233741+0000","last_undegraded":"2024-09-12T01:07:35.233741+0000","last_fullsized":"2024-09-12T01:07:35.233741+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:38.391719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4778667,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5691,"num_write":4,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'35","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.041332+0000","last_change":"2024-09-12T00:27:42.840411+0000","last_active":"2024-09-12T01:07:25.041332+0000","last_peered":"2024-09-12T01:07:25.041332+0000","last_clean":"2024-09-12T01:07:25.041332+0000","last_became_active":"2024-09-12T00:27:42.840137+0000","last_became_peered":"2024-09-12T00:27:42.840137+0000","last_unstale":"2024-09-12T01:07:25.041332+0000","last_undegraded":"2024-09-12T01:07:25.041332+0000","last_fullsized":"2024-09-12T01:07:25.041332+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:08.491063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":59,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:43.051166+0000","last_change":"2024-09-12T00:46:54.888517+0000","last_active":"2024-09-12T01:08:43.051166+0000","last_peered":"2024-09-12T01:08:43.051166+0000","last_clean":"2024-09-12T01:08:43.051166+0000","last_became_active":"2024-09-12T00:46:54.888207+0000","last_became_peered":"2024-09-12T00:46:54.888207+0000","last_unstale":"2024-09-12T01:08:43.051166+0000","last_undegraded":"2024-09-12T01:08:43.051166+0000","last_fullsized":"2024-09-12T01:08:43.051166+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:38.971555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052311+0000","last_change":"2024-09-12T00:30:17.763396+0000","last_active":"2024-09-12T01:08:35.052311+0000","last_peered":"2024-09-12T01:08:35.052311+0000","last_clean":"2024-09-12T01:08:35.052311+0000","last_became_active":"2024-09-12T00:30:17.763106+0000","last_became_peered":"2024-09-12T00:30:17.763106+0000","last_unstale":"2024-09-12T01:08:35.052311+0000","last_undegraded":"2024-09-12T01:08:35.052311+0000","last_fullsized":"2024-09-12T01:08:35.052311+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:48.609847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":9,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.139974+0000","last_change":"2024-09-12T00:30:14.746340+0000","last_active":"2024-09-12T01:08:30.139974+0000","last_peered":"2024-09-12T01:08:30.139974+0000","last_clean":"2024-09-12T01:08:30.139974+0000","last_became_active":"2024-09-12T00:30:14.746069+0000","last_became_peered":"2024-09-12T00:30:14.746069+0000","last_unstale":"2024-09-12T01:08:30.139974+0000","last_undegraded":"2024-09-12T01:08:30.139974+0000","last_fullsized":"2024-09-12T01:08:30.139974+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:13.259839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'41","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.049662+0000","last_change":"2024-09-12T00:27:42.841822+0000","last_active":"2024-09-12T01:08:20.049662+0000","last_peered":"2024-09-12T01:08:20.049662+0000","last_clean":"2024-09-12T01:08:20.049662+0000","last_became_active":"2024-09-12T00:27:42.841530+0000","last_became_peered":"2024-09-12T00:27:42.841530+0000","last_unstale":"2024-09-12T01:08:20.049662+0000","last_undegraded":"2024-09-12T01:08:20.049662+0000","last_fullsized":"2024-09-12T01:08:20.049662+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:31.785686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.231129+0000","last_change":"2024-09-12T00:46:54.886162+0000","last_active":"2024-09-12T01:07:10.231129+0000","last_peered":"2024-09-12T01:07:10.231129+0000","last_clean":"2024-09-12T01:07:10.231129+0000","last_became_active":"2024-09-12T00:46:54.885842+0000","last_became_peered":"2024-09-12T00:46:54.885842+0000","last_unstale":"2024-09-12T01:07:10.231129+0000","last_undegraded":"2024-09-12T01:07:10.231129+0000","last_fullsized":"2024-09-12T01:07:10.231129+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:09.698110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'6","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052277+0000","last_change":"2024-09-12T00:30:17.765752+0000","last_active":"2024-09-12T01:08:35.052277+0000","last_peered":"2024-09-12T01:08:35.052277+0000","last_clean":"2024-09-12T01:08:35.052277+0000","last_became_active":"2024-09-12T00:30:17.765404+0000","last_became_peered":"2024-09-12T00:30:17.765404+0000","last_unstale":"2024-09-12T01:08:35.052277+0000","last_undegraded":"2024-09-12T01:08:35.052277+0000","last_fullsized":"2024-09-12T01:08:35.052277+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:56.259889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.167293+0000","last_change":"2024-09-12T00:30:14.743435+0000","last_active":"2024-09-12T01:08:30.167293+0000","last_peered":"2024-09-12T01:08:30.167293+0000","last_clean":"2024-09-12T01:08:30.167293+0000","last_became_active":"2024-09-12T00:30:14.743148+0000","last_became_peered":"2024-09-12T00:30:14.743148+0000","last_unstale":"2024-09-12T01:08:30.167293+0000","last_undegraded":"2024-09-12T01:08:30.167293+0000","last_fullsized":"2024-09-12T01:08:30.167293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:22.367871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'37","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045203+0000","last_change":"2024-09-12T00:27:42.846410+0000","last_active":"2024-09-12T01:08:15.045203+0000","last_peered":"2024-09-12T01:08:15.045203+0000","last_clean":"2024-09-12T01:08:15.045203+0000","last_became_active":"2024-09-12T00:27:42.846090+0000","last_became_peered":"2024-09-12T00:27:42.846090+0000","last_unstale":"2024-09-12T01:08:15.045203+0000","last_undegraded":"2024-09-12T01:08:15.045203+0000","last_fullsized":"2024-09-12T01:08:15.045203+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:24.133207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":132,"num_write":69,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.047409+0000","last_change":"2024-09-12T00:46:54.883396+0000","last_active":"2024-09-12T01:08:35.047409+0000","last_peered":"2024-09-12T01:08:35.047409+0000","last_clean":"2024-09-12T01:08:35.047409+0000","last_became_active":"2024-09-12T00:46:54.883024+0000","last_became_peered":"2024-09-12T00:46:54.883024+0000","last_unstale":"2024-09-12T01:08:35.047409+0000","last_undegraded":"2024-09-12T01:08:35.047409+0000","last_fullsized":"2024-09-12T01:08:35.047409+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:27.222440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'1","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.053193+0000","last_change":"2024-09-12T00:30:17.769409+0000","last_active":"2024-09-12T01:08:40.053193+0000","last_peered":"2024-09-12T01:08:40.053193+0000","last_clean":"2024-09-12T01:08:40.053193+0000","last_became_active":"2024-09-12T00:30:17.769226+0000","last_became_peered":"2024-09-12T00:30:17.769226+0000","last_unstale":"2024-09-12T01:08:40.053193+0000","last_undegraded":"2024-09-12T01:08:40.053193+0000","last_fullsized":"2024-09-12T01:08:40.053193+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:53.397913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.051372+0000","last_change":"2024-09-12T00:30:14.741263+0000","last_active":"2024-09-12T01:08:30.051372+0000","last_peered":"2024-09-12T01:08:30.051372+0000","last_clean":"2024-09-12T01:08:30.051372+0000","last_became_active":"2024-09-12T00:30:14.740963+0000","last_became_peered":"2024-09-12T00:30:14.740963+0000","last_unstale":"2024-09-12T01:08:30.051372+0000","last_undegraded":"2024-09-12T01:08:30.051372+0000","last_fullsized":"2024-09-12T01:08:30.051372+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:55.514008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.238012+0000","last_change":"2024-09-12T00:27:42.835227+0000","last_active":"2024-09-12T01:08:15.238012+0000","last_peered":"2024-09-12T01:08:15.238012+0000","last_clean":"2024-09-12T01:08:15.238012+0000","last_became_active":"2024-09-12T00:27:42.834942+0000","last_became_peered":"2024-09-12T00:27:42.834942+0000","last_unstale":"2024-09-12T01:08:15.238012+0000","last_undegraded":"2024-09-12T01:08:15.238012+0000","last_fullsized":"2024-09-12T01:08:15.238012+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:10.179555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":105,"num_write":60,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.240177+0000","last_change":"2024-09-12T00:46:54.888100+0000","last_active":"2024-09-12T01:08:35.240177+0000","last_peered":"2024-09-12T01:08:35.240177+0000","last_clean":"2024-09-12T01:08:35.240177+0000","last_became_active":"2024-09-12T00:46:54.887303+0000","last_became_peered":"2024-09-12T00:46:54.887303+0000","last_unstale":"2024-09-12T01:08:35.240177+0000","last_undegraded":"2024-09-12T01:08:35.240177+0000","last_fullsized":"2024-09-12T01:08:35.240177+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:37.539140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"263'1","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.049760+0000","last_change":"2024-09-12T00:30:17.768358+0000","last_active":"2024-09-12T01:08:33.049760+0000","last_peered":"2024-09-12T01:08:33.049760+0000","last_clean":"2024-09-12T01:08:33.049760+0000","last_became_active":"2024-09-12T00:30:17.768072+0000","last_became_peered":"2024-09-12T00:30:17.768072+0000","last_unstale":"2024-09-12T01:08:33.049760+0000","last_undegraded":"2024-09-12T01:08:33.049760+0000","last_fullsized":"2024-09-12T01:08:33.049760+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:13.328589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'1","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052381+0000","last_change":"2024-09-12T00:30:14.744984+0000","last_active":"2024-09-12T01:08:35.052381+0000","last_peered":"2024-09-12T01:08:35.052381+0000","last_clean":"2024-09-12T01:08:35.052381+0000","last_became_active":"2024-09-12T00:30:14.744485+0000","last_became_peered":"2024-09-12T00:30:14.744485+0000","last_unstale":"2024-09-12T01:08:35.052381+0000","last_undegraded":"2024-09-12T01:08:35.052381+0000","last_fullsized":"2024-09-12T01:08:35.052381+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:02.930319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'50","reported_seq":195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165137+0000","last_change":"2024-09-12T00:27:42.839068+0000","last_active":"2024-09-12T01:08:15.165137+0000","last_peered":"2024-09-12T01:08:15.165137+0000","last_clean":"2024-09-12T01:08:15.165137+0000","last_became_active":"2024-09-12T00:27:42.838771+0000","last_became_peered":"2024-09-12T00:27:42.838771+0000","last_unstale":"2024-09-12T01:08:15.165137+0000","last_undegraded":"2024-09-12T01:08:15.165137+0000","last_fullsized":"2024-09-12T01:08:15.165137+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:39.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":194,"num_write":94,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.037715+0000","last_change":"2024-09-12T00:46:54.884379+0000","last_active":"2024-09-12T01:07:13.037715+0000","last_peered":"2024-09-12T01:07:13.037715+0000","last_clean":"2024-09-12T01:07:13.037715+0000","last_became_active":"2024-09-12T00:46:54.883927+0000","last_became_peered":"2024-09-12T00:46:54.883927+0000","last_unstale":"2024-09-12T01:07:13.037715+0000","last_undegraded":"2024-09-12T01:07:13.037715+0000","last_fullsized":"2024-09-12T01:07:13.037715+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:13.845718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'1","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.037600+0000","last_change":"2024-09-12T00:30:17.761674+0000","last_active":"2024-09-12T01:07:10.037600+0000","last_peered":"2024-09-12T01:07:10.037600+0000","last_clean":"2024-09-12T01:07:10.037600+0000","last_became_active":"2024-09-12T00:30:17.761176+0000","last_became_peered":"2024-09-12T00:30:17.761176+0000","last_unstale":"2024-09-12T01:07:10.037600+0000","last_undegraded":"2024-09-12T01:07:10.037600+0000","last_fullsized":"2024-09-12T01:07:10.037600+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.925976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48429,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'1","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:05.037838+0000","last_change":"2024-09-12T00:30:14.744748+0000","last_active":"2024-09-12T01:07:05.037838+0000","last_peered":"2024-09-12T01:07:05.037838+0000","last_clean":"2024-09-12T01:07:05.037838+0000","last_became_active":"2024-09-12T00:30:14.743730+0000","last_became_peered":"2024-09-12T00:30:14.743730+0000","last_unstale":"2024-09-12T01:07:05.037838+0000","last_undegraded":"2024-09-12T01:07:05.037838+0000","last_fullsized":"2024-09-12T01:07:05.037838+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:40.137757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'40","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165081+0000","last_change":"2024-09-12T00:27:42.842498+0000","last_active":"2024-09-12T01:08:15.165081+0000","last_peered":"2024-09-12T01:08:15.165081+0000","last_clean":"2024-09-12T01:08:15.165081+0000","last_became_active":"2024-09-12T00:27:42.842267+0000","last_became_peered":"2024-09-12T00:27:42.842267+0000","last_unstale":"2024-09-12T01:08:15.165081+0000","last_undegraded":"2024-09-12T01:08:15.165081+0000","last_fullsized":"2024-09-12T01:08:15.165081+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:13.278076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":155,"num_write":62,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:15.131566+0000","last_change":"2024-09-12T00:46:54.889599+0000","last_active":"2024-09-12T01:07:15.131566+0000","last_peered":"2024-09-12T01:07:15.131566+0000","last_clean":"2024-09-12T01:07:15.131566+0000","last_became_active":"2024-09-12T00:46:54.889349+0000","last_became_peered":"2024-09-12T00:46:54.889349+0000","last_unstale":"2024-09-12T01:07:15.131566+0000","last_undegraded":"2024-09-12T01:07:15.131566+0000","last_fullsized":"2024-09-12T01:07:15.131566+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:02.442642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.130933+0000","last_change":"2024-09-12T00:30:17.760081+0000","last_active":"2024-09-12T01:07:10.130933+0000","last_peered":"2024-09-12T01:07:10.130933+0000","last_clean":"2024-09-12T01:07:10.130933+0000","last_became_active":"2024-09-12T00:30:17.759769+0000","last_became_peered":"2024-09-12T00:30:17.759769+0000","last_unstale":"2024-09-12T01:07:10.130933+0000","last_undegraded":"2024-09-12T01:07:10.130933+0000","last_fullsized":"2024-09-12T01:07:10.130933+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:22.158179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.036968+0000","last_change":"2024-09-12T00:30:14.748668+0000","last_active":"2024-09-12T01:07:08.036968+0000","last_peered":"2024-09-12T01:07:08.036968+0000","last_clean":"2024-09-12T01:07:08.036968+0000","last_became_active":"2024-09-12T00:30:14.748409+0000","last_became_peered":"2024-09-12T00:30:14.748409+0000","last_unstale":"2024-09-12T01:07:08.036968+0000","last_undegraded":"2024-09-12T01:07:08.036968+0000","last_fullsized":"2024-09-12T01:07:08.036968+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:15.762806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'24","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.128541+0000","last_change":"2024-09-12T00:27:42.844619+0000","last_active":"2024-09-12T01:06:50.128541+0000","last_peered":"2024-09-12T01:06:50.128541+0000","last_clean":"2024-09-12T01:06:50.128541+0000","last_became_active":"2024-09-12T00:27:42.844338+0000","last_became_peered":"2024-09-12T00:27:42.844338+0000","last_unstale":"2024-09-12T01:06:50.128541+0000","last_undegraded":"2024-09-12T01:06:50.128541+0000","last_fullsized":"2024-09-12T01:06:50.128541+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:10.822999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":85,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.024797+0000","last_change":"2024-09-12T00:46:54.890993+0000","last_active":"2024-09-12T01:07:10.024797+0000","last_peered":"2024-09-12T01:07:10.024797+0000","last_clean":"2024-09-12T01:07:10.024797+0000","last_became_active":"2024-09-12T00:46:54.890636+0000","last_became_peered":"2024-09-12T00:46:54.890636+0000","last_unstale":"2024-09-12T01:07:10.024797+0000","last_undegraded":"2024-09-12T01:07:10.024797+0000","last_fullsized":"2024-09-12T01:07:10.024797+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:05.237293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.169493+0000","last_change":"2024-09-12T00:30:17.762552+0000","last_active":"2024-09-12T01:08:35.169493+0000","last_peered":"2024-09-12T01:08:35.169493+0000","last_clean":"2024-09-12T01:08:35.169493+0000","last_became_active":"2024-09-12T00:30:17.762239+0000","last_became_peered":"2024-09-12T00:30:17.762239+0000","last_unstale":"2024-09-12T01:08:35.169493+0000","last_undegraded":"2024-09-12T01:08:35.169493+0000","last_fullsized":"2024-09-12T01:08:35.169493+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:41.552516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'8","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.038702+0000","last_change":"2024-09-12T00:30:14.751029+0000","last_active":"2024-09-12T01:07:10.038702+0000","last_peered":"2024-09-12T01:07:10.038702+0000","last_clean":"2024-09-12T01:07:10.038702+0000","last_became_active":"2024-09-12T00:30:14.750745+0000","last_became_peered":"2024-09-12T00:30:14.750745+0000","last_unstale":"2024-09-12T01:07:10.038702+0000","last_undegraded":"2024-09-12T01:07:10.038702+0000","last_fullsized":"2024-09-12T01:07:10.038702+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:09.884275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5827243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":12861,"num_write":13,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:43.033206+0000","last_change":"2024-09-12T00:27:42.837910+0000","last_active":"2024-09-12T01:06:43.033206+0000","last_peered":"2024-09-12T01:06:43.033206+0000","last_clean":"2024-09-12T01:06:43.033206+0000","last_became_active":"2024-09-12T00:27:42.837690+0000","last_became_peered":"2024-09-12T00:27:42.837690+0000","last_unstale":"2024-09-12T01:06:43.033206+0000","last_undegraded":"2024-09-12T01:06:43.033206+0000","last_fullsized":"2024-09-12T01:06:43.033206+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:00.171095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.038780+0000","last_change":"2024-09-12T00:46:54.885537+0000","last_active":"2024-09-12T01:07:10.038780+0000","last_peered":"2024-09-12T01:07:10.038780+0000","last_clean":"2024-09-12T01:07:10.038780+0000","last_became_active":"2024-09-12T00:46:54.885262+0000","last_became_peered":"2024-09-12T00:46:54.885262+0000","last_unstale":"2024-09-12T01:07:10.038780+0000","last_undegraded":"2024-09-12T01:07:10.038780+0000","last_fullsized":"2024-09-12T01:07:10.038780+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:34.916083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'7","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.026327+0000","last_change":"2024-09-12T00:30:17.761394+0000","last_active":"2024-09-12T01:07:25.026327+0000","last_peered":"2024-09-12T01:07:25.026327+0000","last_clean":"2024-09-12T01:07:25.026327+0000","last_became_active":"2024-09-12T00:30:17.761071+0000","last_became_peered":"2024-09-12T00:30:17.761071+0000","last_unstale":"2024-09-12T01:07:25.026327+0000","last_undegraded":"2024-09-12T01:07:25.026327+0000","last_fullsized":"2024-09-12T01:07:25.026327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:56.989395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.046932+0000","last_change":"2024-09-12T00:30:14.750202+0000","last_active":"2024-09-12T01:08:30.046932+0000","last_peered":"2024-09-12T01:08:30.046932+0000","last_clean":"2024-09-12T01:08:30.046932+0000","last_became_active":"2024-09-12T00:30:14.749906+0000","last_became_peered":"2024-09-12T00:30:14.749906+0000","last_unstale":"2024-09-12T01:08:30.046932+0000","last_undegraded":"2024-09-12T01:08:30.046932+0000","last_fullsized":"2024-09-12T01:08:30.046932+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:25.050487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'11","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.022023+0000","last_change":"2024-09-12T00:27:42.837136+0000","last_active":"2024-09-12T01:06:45.022023+0000","last_peered":"2024-09-12T01:06:45.022023+0000","last_clean":"2024-09-12T01:06:45.022023+0000","last_became_active":"2024-09-12T00:27:42.836870+0000","last_became_peered":"2024-09-12T00:27:42.836870+0000","last_unstale":"2024-09-12T01:06:45.022023+0000","last_undegraded":"2024-09-12T01:06:45.022023+0000","last_fullsized":"2024-09-12T01:06:45.022023+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:28.106493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.028516+0000","last_change":"2024-09-12T00:46:54.891625+0000","last_active":"2024-09-12T01:07:45.028516+0000","last_peered":"2024-09-12T01:07:45.028516+0000","last_clean":"2024-09-12T01:07:45.028516+0000","last_became_active":"2024-09-12T00:46:54.891359+0000","last_became_peered":"2024-09-12T00:46:54.891359+0000","last_unstale":"2024-09-12T01:07:45.028516+0000","last_undegraded":"2024-09-12T01:07:45.028516+0000","last_fullsized":"2024-09-12T01:07:45.028516+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:36.674826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.044429+0000","last_change":"2024-09-12T00:30:17.767137+0000","last_active":"2024-09-12T01:07:58.044429+0000","last_peered":"2024-09-12T01:07:58.044429+0000","last_clean":"2024-09-12T01:07:58.044429+0000","last_became_active":"2024-09-12T00:30:17.766810+0000","last_became_peered":"2024-09-12T00:30:17.766810+0000","last_unstale":"2024-09-12T01:07:58.044429+0000","last_undegraded":"2024-09-12T01:07:58.044429+0000","last_fullsized":"2024-09-12T01:07:58.044429+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:50.589394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041701+0000","last_change":"2024-09-12T00:30:14.744674+0000","last_active":"2024-09-12T01:07:45.041701+0000","last_peered":"2024-09-12T01:07:45.041701+0000","last_clean":"2024-09-12T01:07:45.041701+0000","last_became_active":"2024-09-12T00:30:14.744334+0000","last_became_peered":"2024-09-12T00:30:14.744334+0000","last_unstale":"2024-09-12T01:07:45.041701+0000","last_undegraded":"2024-09-12T01:07:45.041701+0000","last_fullsized":"2024-09-12T01:07:45.041701+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:58.360546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.034356+0000","last_change":"2024-09-12T00:27:42.836761+0000","last_active":"2024-09-12T01:06:45.034356+0000","last_peered":"2024-09-12T01:06:45.034356+0000","last_clean":"2024-09-12T01:06:45.034356+0000","last_became_active":"2024-09-12T00:27:42.836468+0000","last_became_peered":"2024-09-12T00:27:42.836468+0000","last_unstale":"2024-09-12T01:06:45.034356+0000","last_undegraded":"2024-09-12T01:06:45.034356+0000","last_fullsized":"2024-09-12T01:06:45.034356+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:01.432222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":155,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.028541+0000","last_change":"2024-09-12T00:46:54.888800+0000","last_active":"2024-09-12T01:07:45.028541+0000","last_peered":"2024-09-12T01:07:45.028541+0000","last_clean":"2024-09-12T01:07:45.028541+0000","last_became_active":"2024-09-12T00:46:54.888533+0000","last_became_peered":"2024-09-12T00:46:54.888533+0000","last_unstale":"2024-09-12T01:07:45.028541+0000","last_undegraded":"2024-09-12T01:07:45.028541+0000","last_fullsized":"2024-09-12T01:07:45.028541+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:16.016312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'3","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042911+0000","last_change":"2024-09-12T00:30:17.766100+0000","last_active":"2024-09-12T01:07:48.042911+0000","last_peered":"2024-09-12T01:07:48.042911+0000","last_clean":"2024-09-12T01:07:48.042911+0000","last_became_active":"2024-09-12T00:30:17.764747+0000","last_became_peered":"2024-09-12T00:30:17.764747+0000","last_unstale":"2024-09-12T01:07:48.042911+0000","last_undegraded":"2024-09-12T01:07:48.042911+0000","last_fullsized":"2024-09-12T01:07:48.042911+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:28.017911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045464+0000","last_change":"2024-09-12T00:30:14.750085+0000","last_active":"2024-09-12T01:07:50.045464+0000","last_peered":"2024-09-12T01:07:50.045464+0000","last_clean":"2024-09-12T01:07:50.045464+0000","last_became_active":"2024-09-12T00:30:14.749668+0000","last_became_peered":"2024-09-12T00:30:14.749668+0000","last_unstale":"2024-09-12T01:07:50.045464+0000","last_undegraded":"2024-09-12T01:07:50.045464+0000","last_fullsized":"2024-09-12T01:07:50.045464+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:46.909054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'44","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.034744+0000","last_change":"2024-09-12T00:27:42.846229+0000","last_active":"2024-09-12T01:06:45.034744+0000","last_peered":"2024-09-12T01:06:45.034744+0000","last_clean":"2024-09-12T01:06:45.034744+0000","last_became_active":"2024-09-12T00:27:42.845963+0000","last_became_peered":"2024-09-12T00:27:42.845963+0000","last_unstale":"2024-09-12T01:06:45.034744+0000","last_undegraded":"2024-09-12T01:06:45.034744+0000","last_fullsized":"2024-09-12T01:06:45.034744+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:39.746358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":173,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:03.036079+0000","last_change":"2024-09-12T00:46:54.885230+0000","last_active":"2024-09-12T01:07:03.036079+0000","last_peered":"2024-09-12T01:07:03.036079+0000","last_clean":"2024-09-12T01:07:03.036079+0000","last_became_active":"2024-09-12T00:46:54.884950+0000","last_became_peered":"2024-09-12T00:46:54.884950+0000","last_unstale":"2024-09-12T01:07:03.036079+0000","last_undegraded":"2024-09-12T01:07:03.036079+0000","last_fullsized":"2024-09-12T01:07:03.036079+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:05.858636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"263'1","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.024836+0000","last_change":"2024-09-12T00:30:17.762675+0000","last_active":"2024-09-12T01:07:10.024836+0000","last_peered":"2024-09-12T01:07:10.024836+0000","last_clean":"2024-09-12T01:07:10.024836+0000","last_became_active":"2024-09-12T00:30:17.762415+0000","last_became_peered":"2024-09-12T00:30:17.762415+0000","last_unstale":"2024-09-12T01:07:10.024836+0000","last_undegraded":"2024-09-12T01:07:10.024836+0000","last_fullsized":"2024-09-12T01:07:10.024836+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:08.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:05.130460+0000","last_change":"2024-09-12T00:30:14.748878+0000","last_active":"2024-09-12T01:07:05.130460+0000","last_peered":"2024-09-12T01:07:05.130460+0000","last_clean":"2024-09-12T01:07:05.130460+0000","last_became_active":"2024-09-12T00:30:14.748581+0000","last_became_peered":"2024-09-12T00:30:14.748581+0000","last_unstale":"2024-09-12T01:07:05.130460+0000","last_undegraded":"2024-09-12T01:07:05.130460+0000","last_fullsized":"2024-09-12T01:07:05.130460+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:51.379006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":7170,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.132599+0000","last_change":"2024-09-12T00:27:42.844241+0000","last_active":"2024-09-12T01:07:25.132599+0000","last_peered":"2024-09-12T01:07:25.132599+0000","last_clean":"2024-09-12T01:07:25.132599+0000","last_became_active":"2024-09-12T00:27:42.843968+0000","last_became_peered":"2024-09-12T00:27:42.843968+0000","last_unstale":"2024-09-12T01:07:25.132599+0000","last_undegraded":"2024-09-12T01:07:25.132599+0000","last_fullsized":"2024-09-12T01:07:25.132599+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:47.646443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":171,"num_write":76,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041617+0000","last_change":"2024-09-12T00:46:54.881183+0000","last_active":"2024-09-12T01:07:45.041617+0000","last_peered":"2024-09-12T01:07:45.041617+0000","last_clean":"2024-09-12T01:07:45.041617+0000","last_became_active":"2024-09-12T00:46:54.880874+0000","last_became_peered":"2024-09-12T00:46:54.880874+0000","last_unstale":"2024-09-12T01:07:45.041617+0000","last_undegraded":"2024-09-12T01:07:45.041617+0000","last_fullsized":"2024-09-12T01:07:45.041617+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:52.663395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.037704+0000","last_change":"2024-09-12T00:30:17.764321+0000","last_active":"2024-09-12T01:07:10.037704+0000","last_peered":"2024-09-12T01:07:10.037704+0000","last_clean":"2024-09-12T01:07:10.037704+0000","last_became_active":"2024-09-12T00:30:17.762807+0000","last_became_peered":"2024-09-12T00:30:17.762807+0000","last_unstale":"2024-09-12T01:07:10.037704+0000","last_undegraded":"2024-09-12T01:07:10.037704+0000","last_fullsized":"2024-09-12T01:07:10.037704+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:22.911043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:05.037172+0000","last_change":"2024-09-12T00:30:14.750078+0000","last_active":"2024-09-12T01:07:05.037172+0000","last_peered":"2024-09-12T01:07:05.037172+0000","last_clean":"2024-09-12T01:07:05.037172+0000","last_became_active":"2024-09-12T00:30:14.749608+0000","last_became_peered":"2024-09-12T00:30:14.749608+0000","last_unstale":"2024-09-12T01:07:05.037172+0000","last_undegraded":"2024-09-12T01:07:05.037172+0000","last_fullsized":"2024-09-12T01:07:05.037172+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:51.387598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'41","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.040525+0000","last_change":"2024-09-12T00:27:42.846138+0000","last_active":"2024-09-12T01:07:20.040525+0000","last_peered":"2024-09-12T01:07:20.040525+0000","last_clean":"2024-09-12T01:07:20.040525+0000","last_became_active":"2024-09-12T00:27:42.845889+0000","last_became_peered":"2024-09-12T00:27:42.845889+0000","last_unstale":"2024-09-12T01:07:20.040525+0000","last_undegraded":"2024-09-12T01:07:20.040525+0000","last_fullsized":"2024-09-12T01:07:20.040525+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:08.298324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":162,"num_write":61,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052331+0000","last_change":"2024-09-12T00:46:54.887517+0000","last_active":"2024-09-12T01:08:35.052331+0000","last_peered":"2024-09-12T01:08:35.052331+0000","last_clean":"2024-09-12T01:08:35.052331+0000","last_became_active":"2024-09-12T00:46:54.887206+0000","last_became_peered":"2024-09-12T00:46:54.887206+0000","last_unstale":"2024-09-12T01:08:35.052331+0000","last_undegraded":"2024-09-12T01:08:35.052331+0000","last_fullsized":"2024-09-12T01:08:35.052331+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:31.785829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045384+0000","last_change":"2024-09-12T00:30:17.768384+0000","last_active":"2024-09-12T01:07:50.045384+0000","last_peered":"2024-09-12T01:07:50.045384+0000","last_clean":"2024-09-12T01:07:50.045384+0000","last_became_active":"2024-09-12T00:30:17.767990+0000","last_became_peered":"2024-09-12T00:30:17.767990+0000","last_unstale":"2024-09-12T01:07:50.045384+0000","last_undegraded":"2024-09-12T01:07:50.045384+0000","last_fullsized":"2024-09-12T01:07:50.045384+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:34.324472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"263'1","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.138616+0000","last_change":"2024-09-12T00:30:14.745501+0000","last_active":"2024-09-12T01:08:20.138616+0000","last_peered":"2024-09-12T01:08:20.138616+0000","last_clean":"2024-09-12T01:08:20.138616+0000","last_became_active":"2024-09-12T00:30:14.745195+0000","last_became_peered":"2024-09-12T00:30:14.745195+0000","last_unstale":"2024-09-12T01:08:20.138616+0000","last_undegraded":"2024-09-12T01:08:20.138616+0000","last_fullsized":"2024-09-12T01:08:20.138616+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:05.190444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'32","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.132064+0000","last_change":"2024-09-12T00:27:42.844201+0000","last_active":"2024-09-12T01:07:20.132064+0000","last_peered":"2024-09-12T01:07:20.132064+0000","last_clean":"2024-09-12T01:07:20.132064+0000","last_became_active":"2024-09-12T00:27:42.843841+0000","last_became_peered":"2024-09-12T00:27:42.843841+0000","last_unstale":"2024-09-12T01:07:20.132064+0000","last_undegraded":"2024-09-12T01:07:20.132064+0000","last_fullsized":"2024-09-12T01:07:20.132064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:33.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":99,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052355+0000","last_change":"2024-09-12T00:46:54.884403+0000","last_active":"2024-09-12T01:08:35.052355+0000","last_peered":"2024-09-12T01:08:35.052355+0000","last_clean":"2024-09-12T01:08:35.052355+0000","last_became_active":"2024-09-12T00:46:54.884110+0000","last_became_peered":"2024-09-12T00:46:54.884110+0000","last_unstale":"2024-09-12T01:08:35.052355+0000","last_undegraded":"2024-09-12T01:08:35.052355+0000","last_fullsized":"2024-09-12T01:08:35.052355+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:54.447390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.046869+0000","last_change":"2024-09-12T00:30:17.763239+0000","last_active":"2024-09-12T01:08:30.046869+0000","last_peered":"2024-09-12T01:08:30.046869+0000","last_clean":"2024-09-12T01:08:30.046869+0000","last_became_active":"2024-09-12T00:30:17.762850+0000","last_became_peered":"2024-09-12T00:30:17.762850+0000","last_unstale":"2024-09-12T01:08:30.046869+0000","last_undegraded":"2024-09-12T01:08:30.046869+0000","last_fullsized":"2024-09-12T01:08:30.046869+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:27.977927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'7","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041634+0000","last_change":"2024-09-12T00:30:14.736582+0000","last_active":"2024-09-12T01:07:45.041634+0000","last_peered":"2024-09-12T01:07:45.041634+0000","last_clean":"2024-09-12T01:07:45.041634+0000","last_became_active":"2024-09-12T00:30:14.736286+0000","last_became_peered":"2024-09-12T00:30:14.736286+0000","last_unstale":"2024-09-12T01:07:45.041634+0000","last_undegraded":"2024-09-12T01:07:45.041634+0000","last_fullsized":"2024-09-12T01:07:45.041634+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:21.074121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":14336,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'42","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.038717+0000","last_change":"2024-09-12T00:27:42.842160+0000","last_active":"2024-09-12T01:07:20.038717+0000","last_peered":"2024-09-12T01:07:20.038717+0000","last_clean":"2024-09-12T01:07:20.038717+0000","last_became_active":"2024-09-12T00:27:42.841880+0000","last_became_peered":"2024-09-12T00:27:42.841880+0000","last_unstale":"2024-09-12T01:07:20.038717+0000","last_undegraded":"2024-09-12T01:07:20.038717+0000","last_fullsized":"2024-09-12T01:07:20.038717+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:58.218462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":149,"num_write":77,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042872+0000","last_change":"2024-09-12T00:46:54.887508+0000","last_active":"2024-09-12T01:07:48.042872+0000","last_peered":"2024-09-12T01:07:48.042872+0000","last_clean":"2024-09-12T01:07:48.042872+0000","last_became_active":"2024-09-12T00:46:54.887241+0000","last_became_peered":"2024-09-12T00:46:54.887241+0000","last_unstale":"2024-09-12T01:07:48.042872+0000","last_undegraded":"2024-09-12T01:07:48.042872+0000","last_fullsized":"2024-09-12T01:07:48.042872+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:05.592034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135434+0000","last_change":"2024-09-12T00:30:17.763748+0000","last_active":"2024-09-12T01:07:50.135434+0000","last_peered":"2024-09-12T01:07:50.135434+0000","last_clean":"2024-09-12T01:07:50.135434+0000","last_became_active":"2024-09-12T00:30:17.763434+0000","last_became_peered":"2024-09-12T00:30:17.763434+0000","last_unstale":"2024-09-12T01:07:50.135434+0000","last_undegraded":"2024-09-12T01:07:50.135434+0000","last_fullsized":"2024-09-12T01:07:50.135434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:35.178500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160616+0000","last_change":"2024-09-12T00:30:14.745243+0000","last_active":"2024-09-12T01:07:45.160616+0000","last_peered":"2024-09-12T01:07:45.160616+0000","last_clean":"2024-09-12T01:07:45.160616+0000","last_became_active":"2024-09-12T00:30:14.744954+0000","last_became_peered":"2024-09-12T00:30:14.744954+0000","last_unstale":"2024-09-12T01:07:45.160616+0000","last_undegraded":"2024-09-12T01:07:45.160616+0000","last_fullsized":"2024-09-12T01:07:45.160616+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:54.776721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'51","reported_seq":181,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.038684+0000","last_change":"2024-09-12T00:27:42.843112+0000","last_active":"2024-09-12T01:07:20.038684+0000","last_peered":"2024-09-12T01:07:20.038684+0000","last_clean":"2024-09-12T01:07:20.038684+0000","last_became_active":"2024-09-12T00:27:42.842779+0000","last_became_peered":"2024-09-12T00:27:42.842779+0000","last_unstale":"2024-09-12T01:07:20.038684+0000","last_undegraded":"2024-09-12T01:07:20.038684+0000","last_fullsized":"2024-09-12T01:07:20.038684+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:44.649308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":161,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.042278+0000","last_change":"2024-09-12T00:46:54.882461+0000","last_active":"2024-09-12T01:07:50.042278+0000","last_peered":"2024-09-12T01:07:50.042278+0000","last_clean":"2024-09-12T01:07:50.042278+0000","last_became_active":"2024-09-12T00:46:54.882192+0000","last_became_peered":"2024-09-12T00:46:54.882192+0000","last_unstale":"2024-09-12T01:07:50.042278+0000","last_undegraded":"2024-09-12T01:07:50.042278+0000","last_fullsized":"2024-09-12T01:07:50.042278+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:45.883428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'4","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135413+0000","last_change":"2024-09-12T00:30:17.758495+0000","last_active":"2024-09-12T01:07:50.135413+0000","last_peered":"2024-09-12T01:07:50.135413+0000","last_clean":"2024-09-12T01:07:50.135413+0000","last_became_active":"2024-09-12T00:30:17.756710+0000","last_became_peered":"2024-09-12T00:30:17.756710+0000","last_unstale":"2024-09-12T01:07:50.135413+0000","last_undegraded":"2024-09-12T01:07:50.135413+0000","last_fullsized":"2024-09-12T01:07:50.135413+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:26.589681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.234862+0000","last_change":"2024-09-12T00:30:14.749818+0000","last_active":"2024-09-12T01:07:45.234862+0000","last_peered":"2024-09-12T01:07:45.234862+0000","last_clean":"2024-09-12T01:07:45.234862+0000","last_became_active":"2024-09-12T00:30:14.749353+0000","last_became_peered":"2024-09-12T00:30:14.749353+0000","last_unstale":"2024-09-12T01:07:45.234862+0000","last_undegraded":"2024-09-12T01:07:45.234862+0000","last_fullsized":"2024-09-12T01:07:45.234862+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.846302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'16","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135384+0000","last_change":"2024-09-12T00:27:42.846318+0000","last_active":"2024-09-12T01:07:50.135384+0000","last_peered":"2024-09-12T01:07:50.135384+0000","last_clean":"2024-09-12T01:07:50.135384+0000","last_became_active":"2024-09-12T00:27:42.846065+0000","last_became_peered":"2024-09-12T00:27:42.846065+0000","last_unstale":"2024-09-12T01:07:50.135384+0000","last_undegraded":"2024-09-12T01:07:50.135384+0000","last_fullsized":"2024-09-12T01:07:50.135384+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:12.594329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":60,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'298","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:41.152759+0000","last_change":"2024-09-12T00:12:36.042181+0000","last_active":"2024-09-12T01:08:41.152759+0000","last_peered":"2024-09-12T01:08:41.152759+0000","last_clean":"2024-09-12T01:08:41.152759+0000","last_became_active":"2024-09-12T00:12:36.041803+0000","last_became_peered":"2024-09-12T00:12:36.041803+0000","last_unstale":"2024-09-12T01:08:41.152759+0000","last_undegraded":"2024-09-12T01:08:41.152759+0000","last_fullsized":"2024-09-12T01:08:41.152759+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:47.399756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14292667,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":527,"num_read_kb":31202,"num_write":1099,"num_write_kb":36538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'78","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.234258+0000","last_change":"2024-09-12T00:12:38.036843+0000","last_active":"2024-09-12T01:07:40.234258+0000","last_peered":"2024-09-12T01:07:40.234258+0000","last_clean":"2024-09-12T01:07:40.234258+0000","last_became_active":"2024-09-12T00:12:38.035848+0000","last_became_peered":"2024-09-12T00:12:38.035848+0000","last_unstale":"2024-09-12T01:07:40.234258+0000","last_undegraded":"2024-09-12T01:07:40.234258+0000","last_fullsized":"2024-09-12T01:07:40.234258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:27.637600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":321,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'397","reported_seq":1170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.951540+0000","last_change":"2024-09-12T00:12:36.045798+0000","last_active":"2024-09-12T01:10:57.951540+0000","last_peered":"2024-09-12T01:10:57.951540+0000","last_clean":"2024-09-12T01:10:57.951540+0000","last_became_active":"2024-09-12T00:12:36.045325+0000","last_became_peered":"2024-09-12T00:12:36.045325+0000","last_unstale":"2024-09-12T01:10:57.951540+0000","last_undegraded":"2024-09-12T01:10:57.951540+0000","last_fullsized":"2024-09-12T01:10:57.951540+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:52.983449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12805006,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":973,"num_read_kb":48846,"num_write":1357,"num_write_kb":45958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'64","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.041016+0000","last_change":"2024-09-12T00:12:38.041199+0000","last_active":"2024-09-12T01:07:40.041016+0000","last_peered":"2024-09-12T01:07:40.041016+0000","last_clean":"2024-09-12T01:07:40.041016+0000","last_became_active":"2024-09-12T00:12:38.040122+0000","last_became_peered":"2024-09-12T00:12:38.040122+0000","last_unstale":"2024-09-12T01:07:40.041016+0000","last_undegraded":"2024-09-12T01:07:40.041016+0000","last_fullsized":"2024-09-12T01:07:40.041016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:46.078316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":259,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'270","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.932852+0000","last_change":"2024-09-12T00:12:36.040486+0000","last_active":"2024-09-12T01:10:57.932852+0000","last_peered":"2024-09-12T01:10:57.932852+0000","last_clean":"2024-09-12T01:10:57.932852+0000","last_became_active":"2024-09-12T00:12:36.039741+0000","last_became_peered":"2024-09-12T00:12:36.039741+0000","last_unstale":"2024-09-12T01:10:57.932852+0000","last_undegraded":"2024-09-12T01:10:57.932852+0000","last_fullsized":"2024-09-12T01:10:57.932852+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:20.639041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6701801,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":417,"num_read_kb":26393,"num_write":954,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'307","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.041068+0000","last_change":"2024-09-12T00:12:38.042224+0000","last_active":"2024-09-12T01:07:40.041068+0000","last_peered":"2024-09-12T01:07:40.041068+0000","last_clean":"2024-09-12T01:07:40.041068+0000","last_became_active":"2024-09-12T00:12:38.041795+0000","last_became_peered":"2024-09-12T00:12:38.041795+0000","last_unstale":"2024-09-12T01:07:40.041068+0000","last_undegraded":"2024-09-12T01:07:40.041068+0000","last_fullsized":"2024-09-12T01:07:40.041068+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:58.089809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1291,"num_read_kb":1053,"num_write":447,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'333","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.142268+0000","last_change":"2024-09-12T00:12:36.037299+0000","last_active":"2024-09-12T01:08:50.142268+0000","last_peered":"2024-09-12T01:08:50.142268+0000","last_clean":"2024-09-12T01:08:50.142268+0000","last_became_active":"2024-09-12T00:12:36.036970+0000","last_became_peered":"2024-09-12T00:12:36.036970+0000","last_unstale":"2024-09-12T01:08:50.142268+0000","last_undegraded":"2024-09-12T01:08:50.142268+0000","last_fullsized":"2024-09-12T01:08:50.142268+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:48.587739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15753149,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":493,"num_read_kb":29211,"num_write":1180,"num_write_kb":52081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'61","reported_seq":601,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043790+0000","last_change":"2024-09-12T00:12:38.039591+0000","last_active":"2024-09-12T01:07:40.043790+0000","last_peered":"2024-09-12T01:07:40.043790+0000","last_clean":"2024-09-12T01:07:40.043790+0000","last_became_active":"2024-09-12T00:12:38.039292+0000","last_became_peered":"2024-09-12T00:12:38.039292+0000","last_unstale":"2024-09-12T01:07:40.043790+0000","last_undegraded":"2024-09-12T01:07:40.043790+0000","last_fullsized":"2024-09-12T01:07:40.043790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:31.375488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":95,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'270","reported_seq":897,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.244373+0000","last_change":"2024-09-12T00:12:36.046560+0000","last_active":"2024-09-12T01:08:20.244373+0000","last_peered":"2024-09-12T01:08:20.244373+0000","last_clean":"2024-09-12T01:08:20.244373+0000","last_became_active":"2024-09-12T00:12:36.044021+0000","last_became_peered":"2024-09-12T00:12:36.044021+0000","last_unstale":"2024-09-12T01:08:20.244373+0000","last_undegraded":"2024-09-12T01:08:20.244373+0000","last_fullsized":"2024-09-12T01:08:20.244373+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:49.437691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11192773,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":385,"num_read_kb":19077,"num_write":935,"num_write_kb":26981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'446","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.036112+0000","last_change":"2024-09-12T00:12:38.037277+0000","last_active":"2024-09-12T01:08:55.036112+0000","last_peered":"2024-09-12T01:08:55.036112+0000","last_clean":"2024-09-12T01:08:55.036112+0000","last_became_active":"2024-09-12T00:12:38.037000+0000","last_became_peered":"2024-09-12T00:12:38.037000+0000","last_unstale":"2024-09-12T01:08:55.036112+0000","last_undegraded":"2024-09-12T01:08:55.036112+0000","last_fullsized":"2024-09-12T01:08:55.036112+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:52.457342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1930,"num_read_kb":1543,"num_write":735,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'306","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:06.341859+0000","last_change":"2024-09-12T00:12:36.038559+0000","last_active":"2024-09-12T01:09:06.341859+0000","last_peered":"2024-09-12T01:09:06.341859+0000","last_clean":"2024-09-12T01:09:06.341859+0000","last_became_active":"2024-09-12T00:12:36.038235+0000","last_became_peered":"2024-09-12T00:12:36.038235+0000","last_unstale":"2024-09-12T01:09:06.341859+0000","last_undegraded":"2024-09-12T01:09:06.341859+0000","last_fullsized":"2024-09-12T01:09:06.341859+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:13.516943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7738630,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":566,"num_read_kb":9962,"num_write":1185,"num_write_kb":25658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'300","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.022656+0000","last_change":"2024-09-12T00:12:38.045583+0000","last_active":"2024-09-12T01:06:50.022656+0000","last_peered":"2024-09-12T01:06:50.022656+0000","last_clean":"2024-09-12T01:06:50.022656+0000","last_became_active":"2024-09-12T00:12:38.045308+0000","last_became_peered":"2024-09-12T00:12:38.045308+0000","last_unstale":"2024-09-12T01:06:50.022656+0000","last_undegraded":"2024-09-12T01:06:50.022656+0000","last_fullsized":"2024-09-12T01:06:50.022656+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:38.191795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1317,"num_read_kb":1075,"num_write":482,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'267","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.268303+0000","last_change":"2024-09-12T00:12:36.042085+0000","last_active":"2024-09-12T01:07:43.268303+0000","last_peered":"2024-09-12T01:07:43.268303+0000","last_clean":"2024-09-12T01:07:43.268303+0000","last_became_active":"2024-09-12T00:12:36.041698+0000","last_became_peered":"2024-09-12T00:12:36.041698+0000","last_unstale":"2024-09-12T01:07:43.268303+0000","last_undegraded":"2024-09-12T01:07:43.268303+0000","last_fullsized":"2024-09-12T01:07:43.268303+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:23.633785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15016627,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":419,"num_read_kb":30384,"num_write":963,"num_write_kb":31492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'492","reported_seq":1252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:14.754868+0000","last_change":"2024-09-12T00:12:38.038282+0000","last_active":"2024-09-12T01:07:14.754868+0000","last_peered":"2024-09-12T01:07:14.754868+0000","last_clean":"2024-09-12T01:07:14.754868+0000","last_became_active":"2024-09-12T00:12:38.038023+0000","last_became_peered":"2024-09-12T00:12:38.038023+0000","last_unstale":"2024-09-12T01:07:14.754868+0000","last_undegraded":"2024-09-12T01:07:14.754868+0000","last_fullsized":"2024-09-12T01:07:14.754868+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:15.550968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2347,"num_read_kb":2031,"num_write":873,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'243","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.064417+0000","last_change":"2024-09-12T00:12:36.050337+0000","last_active":"2024-09-12T01:10:08.064417+0000","last_peered":"2024-09-12T01:10:08.064417+0000","last_clean":"2024-09-12T01:10:08.064417+0000","last_became_active":"2024-09-12T00:12:36.050008+0000","last_became_peered":"2024-09-12T00:12:36.050008+0000","last_unstale":"2024-09-12T01:10:08.064417+0000","last_undegraded":"2024-09-12T01:10:08.064417+0000","last_fullsized":"2024-09-12T01:10:08.064417+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:38.881671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8398716,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":456,"num_read_kb":30850,"num_write":995,"num_write_kb":20572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'204","reported_seq":830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.053105+0000","last_change":"2024-09-12T00:12:38.043322+0000","last_active":"2024-09-12T01:08:53.053105+0000","last_peered":"2024-09-12T01:08:53.053105+0000","last_clean":"2024-09-12T01:08:53.053105+0000","last_became_active":"2024-09-12T00:12:38.043059+0000","last_became_peered":"2024-09-12T00:12:38.043059+0000","last_unstale":"2024-09-12T01:08:53.053105+0000","last_undegraded":"2024-09-12T01:08:53.053105+0000","last_fullsized":"2024-09-12T01:08:53.053105+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:02.061980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":751,"num_write":306,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'111","reported_seq":699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:20.031721+0000","last_change":"2024-09-12T00:12:38.040965+0000","last_active":"2024-09-12T01:06:20.031721+0000","last_peered":"2024-09-12T01:06:20.031721+0000","last_clean":"2024-09-12T01:06:20.031721+0000","last_became_active":"2024-09-12T00:12:38.040613+0000","last_became_peered":"2024-09-12T00:12:38.040613+0000","last_unstale":"2024-09-12T01:06:20.031721+0000","last_undegraded":"2024-09-12T01:06:20.031721+0000","last_fullsized":"2024-09-12T01:06:20.031721+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:25.644646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":420,"num_write":176,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'297","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.238577+0000","last_change":"2024-09-12T00:12:36.037211+0000","last_active":"2024-09-12T01:08:20.238577+0000","last_peered":"2024-09-12T01:08:20.238577+0000","last_clean":"2024-09-12T01:08:20.238577+0000","last_became_active":"2024-09-12T00:12:36.036905+0000","last_became_peered":"2024-09-12T00:12:36.036905+0000","last_unstale":"2024-09-12T01:08:20.238577+0000","last_undegraded":"2024-09-12T01:08:20.238577+0000","last_fullsized":"2024-09-12T01:08:20.238577+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:21.711720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11669514,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":512,"num_read_kb":41745,"num_write":1072,"num_write_kb":45582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'78","reported_seq":658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:51.954553+0000","last_change":"2024-09-12T00:12:38.038756+0000","last_active":"2024-09-12T01:06:51.954553+0000","last_peered":"2024-09-12T01:06:51.954553+0000","last_clean":"2024-09-12T01:06:51.954553+0000","last_became_active":"2024-09-12T00:12:38.038478+0000","last_became_peered":"2024-09-12T00:12:38.038478+0000","last_unstale":"2024-09-12T01:06:51.954553+0000","last_undegraded":"2024-09-12T01:06:51.954553+0000","last_fullsized":"2024-09-12T01:06:51.954553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:35.041048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":318,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'307","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.031888+0000","last_change":"2024-09-12T00:12:36.033187+0000","last_active":"2024-09-12T01:08:15.031888+0000","last_peered":"2024-09-12T01:08:15.031888+0000","last_clean":"2024-09-12T01:08:15.031888+0000","last_became_active":"2024-09-12T00:12:36.032821+0000","last_became_peered":"2024-09-12T00:12:36.032821+0000","last_unstale":"2024-09-12T01:08:15.031888+0000","last_undegraded":"2024-09-12T01:08:15.031888+0000","last_fullsized":"2024-09-12T01:08:15.031888+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:19.055738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8342209,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":444,"num_read_kb":42765,"num_write":969,"num_write_kb":38443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'199","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.226253+0000","last_change":"2024-09-12T00:12:38.044432+0000","last_active":"2024-09-12T01:06:25.226253+0000","last_peered":"2024-09-12T01:06:25.226253+0000","last_clean":"2024-09-12T01:06:25.226253+0000","last_became_active":"2024-09-12T00:12:38.044169+0000","last_became_peered":"2024-09-12T00:12:38.044169+0000","last_unstale":"2024-09-12T01:06:25.226253+0000","last_undegraded":"2024-09-12T01:06:25.226253+0000","last_fullsized":"2024-09-12T01:06:25.226253+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:46.038643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":679,"num_write":307,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'278","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.031865+0000","last_change":"2024-09-12T00:12:36.037534+0000","last_active":"2024-09-12T01:08:15.031865+0000","last_peered":"2024-09-12T01:08:15.031865+0000","last_clean":"2024-09-12T01:08:15.031865+0000","last_became_active":"2024-09-12T00:12:36.037200+0000","last_became_peered":"2024-09-12T00:12:36.037200+0000","last_unstale":"2024-09-12T01:08:15.031865+0000","last_undegraded":"2024-09-12T01:08:15.031865+0000","last_fullsized":"2024-09-12T01:08:15.031865+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:52.993855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549747,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":450,"num_read_kb":1481,"num_write":1017,"num_write_kb":18199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'162","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165122+0000","last_change":"2024-09-12T00:12:38.045098+0000","last_active":"2024-09-12T01:08:15.165122+0000","last_peered":"2024-09-12T01:08:15.165122+0000","last_clean":"2024-09-12T01:08:15.165122+0000","last_became_active":"2024-09-12T00:12:38.044089+0000","last_became_peered":"2024-09-12T00:12:38.044089+0000","last_unstale":"2024-09-12T01:08:15.165122+0000","last_undegraded":"2024-09-12T01:08:15.165122+0000","last_fullsized":"2024-09-12T01:08:15.165122+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:41.312963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":583,"num_write":265,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'287","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.693314+0000","last_change":"2024-09-12T00:12:36.029615+0000","last_active":"2024-09-12T01:08:30.693314+0000","last_peered":"2024-09-12T01:08:30.693314+0000","last_clean":"2024-09-12T01:08:30.693314+0000","last_became_active":"2024-09-12T00:12:36.029286+0000","last_became_peered":"2024-09-12T00:12:36.029286+0000","last_unstale":"2024-09-12T01:08:30.693314+0000","last_undegraded":"2024-09-12T01:08:30.693314+0000","last_fullsized":"2024-09-12T01:08:30.693314+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:36.388912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12243728,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":404,"num_read_kb":28442,"num_write":984,"num_write_kb":34038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'237","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.046795+0000","last_change":"2024-09-12T00:12:38.042662+0000","last_active":"2024-09-12T01:08:13.046795+0000","last_peered":"2024-09-12T01:08:13.046795+0000","last_clean":"2024-09-12T01:08:13.046795+0000","last_became_active":"2024-09-12T00:12:38.042387+0000","last_became_peered":"2024-09-12T00:12:38.042387+0000","last_unstale":"2024-09-12T01:08:13.046795+0000","last_undegraded":"2024-09-12T01:08:13.046795+0000","last_fullsized":"2024-09-12T01:08:13.046795+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:52.954165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1130,"num_read_kb":955,"num_write":386,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'279","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165105+0000","last_change":"2024-09-12T00:12:36.035258+0000","last_active":"2024-09-12T01:08:15.165105+0000","last_peered":"2024-09-12T01:08:15.165105+0000","last_clean":"2024-09-12T01:08:15.165105+0000","last_became_active":"2024-09-12T00:12:36.034811+0000","last_became_peered":"2024-09-12T00:12:36.034811+0000","last_unstale":"2024-09-12T01:08:15.165105+0000","last_undegraded":"2024-09-12T01:08:15.165105+0000","last_fullsized":"2024-09-12T01:08:15.165105+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:17.351084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5398523,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":531,"num_read_kb":22751,"num_write":1047,"num_write_kb":14938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'112","reported_seq":703,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:39.935379+0000","last_change":"2024-09-12T00:12:38.036179+0000","last_active":"2024-09-12T01:08:39.935379+0000","last_peered":"2024-09-12T01:08:39.935379+0000","last_clean":"2024-09-12T01:08:39.935379+0000","last_became_active":"2024-09-12T00:12:38.035835+0000","last_became_peered":"2024-09-12T00:12:38.035835+0000","last_unstale":"2024-09-12T01:08:39.935379+0000","last_undegraded":"2024-09-12T01:08:39.935379+0000","last_fullsized":"2024-09-12T01:08:39.935379+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:40.642378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":399,"num_write":174,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'257","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:43.243938+0000","last_change":"2024-09-12T00:12:36.036412+0000","last_active":"2024-09-12T01:08:43.243938+0000","last_peered":"2024-09-12T01:08:43.243938+0000","last_clean":"2024-09-12T01:08:43.243938+0000","last_became_active":"2024-09-12T00:12:36.036060+0000","last_became_peered":"2024-09-12T00:12:36.036060+0000","last_unstale":"2024-09-12T01:08:43.243938+0000","last_undegraded":"2024-09-12T01:08:43.243938+0000","last_fullsized":"2024-09-12T01:08:43.243938+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:28.300988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10255709,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":476,"num_read_kb":15680,"num_write":943,"num_write_kb":17630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'129","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.436476+0000","last_change":"2024-09-12T00:12:46.059495+0000","last_active":"2024-09-12T01:09:23.436476+0000","last_peered":"2024-09-12T01:09:23.436476+0000","last_clean":"2024-09-12T01:09:23.436476+0000","last_became_active":"2024-09-12T00:12:46.059203+0000","last_became_peered":"2024-09-12T00:12:46.059203+0000","last_unstale":"2024-09-12T01:09:23.436476+0000","last_undegraded":"2024-09-12T01:09:23.436476+0000","last_fullsized":"2024-09-12T01:09:23.436476+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:04.594775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":135,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'77","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.040701+0000","last_change":"2024-09-12T00:12:38.043406+0000","last_active":"2024-09-12T01:07:35.040701+0000","last_peered":"2024-09-12T01:07:35.040701+0000","last_clean":"2024-09-12T01:07:35.040701+0000","last_became_active":"2024-09-12T00:12:38.041964+0000","last_became_peered":"2024-09-12T00:12:38.041964+0000","last_unstale":"2024-09-12T01:07:35.040701+0000","last_undegraded":"2024-09-12T01:07:35.040701+0000","last_fullsized":"2024-09-12T01:07:35.040701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:09.254764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":305,"num_read_kb":247,"num_write":113,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'290","reported_seq":1137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.006437+0000","last_change":"2024-09-12T00:12:36.034053+0000","last_active":"2024-09-12T01:08:33.006437+0000","last_peered":"2024-09-12T01:08:33.006437+0000","last_clean":"2024-09-12T01:08:33.006437+0000","last_became_active":"2024-09-12T00:12:36.033666+0000","last_became_peered":"2024-09-12T00:12:36.033666+0000","last_unstale":"2024-09-12T01:08:33.006437+0000","last_undegraded":"2024-09-12T01:08:33.006437+0000","last_fullsized":"2024-09-12T01:08:33.006437+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:42.337722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7265591,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":895,"num_read_kb":16942,"num_write":1122,"num_write_kb":38560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045191+0000","last_change":"2024-09-12T00:12:40.043098+0000","last_active":"2024-09-12T01:08:15.045191+0000","last_peered":"2024-09-12T01:08:15.045191+0000","last_clean":"2024-09-12T01:08:15.045191+0000","last_became_active":"2024-09-12T00:12:40.042778+0000","last_became_peered":"2024-09-12T00:12:40.042778+0000","last_unstale":"2024-09-12T01:08:15.045191+0000","last_undegraded":"2024-09-12T01:08:15.045191+0000","last_fullsized":"2024-09-12T01:08:15.045191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:24.903477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'340","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.986353+0000","last_change":"2024-09-12T00:12:42.041284+0000","last_active":"2024-09-12T01:10:32.986353+0000","last_peered":"2024-09-12T01:10:32.986353+0000","last_clean":"2024-09-12T01:10:32.986353+0000","last_became_active":"2024-09-12T00:12:42.040764+0000","last_became_peered":"2024-09-12T00:12:42.040764+0000","last_unstale":"2024-09-12T01:10:32.986353+0000","last_undegraded":"2024-09-12T01:10:32.986353+0000","last_fullsized":"2024-09-12T01:10:32.986353+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:17.910880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56754,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":548,"num_read_kb":1023,"num_write":436,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.238599+0000","last_change":"2024-09-12T00:12:44.055832+0000","last_active":"2024-09-12T01:08:20.238599+0000","last_peered":"2024-09-12T01:08:20.238599+0000","last_clean":"2024-09-12T01:08:20.238599+0000","last_became_active":"2024-09-12T00:12:44.055504+0000","last_became_peered":"2024-09-12T00:12:44.055504+0000","last_unstale":"2024-09-12T01:08:20.238599+0000","last_undegraded":"2024-09-12T01:08:20.238599+0000","last_fullsized":"2024-09-12T01:08:20.238599+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:45.759712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'168","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.825669+0000","last_change":"2024-09-12T00:12:46.065977+0000","last_active":"2024-09-12T01:08:55.825669+0000","last_peered":"2024-09-12T01:08:55.825669+0000","last_clean":"2024-09-12T01:08:55.825669+0000","last_became_active":"2024-09-12T00:12:46.065664+0000","last_became_peered":"2024-09-12T00:12:46.065664+0000","last_unstale":"2024-09-12T01:08:55.825669+0000","last_undegraded":"2024-09-12T01:08:55.825669+0000","last_fullsized":"2024-09-12T01:08:55.825669+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:46.395099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":198,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'177","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045160+0000","last_change":"2024-09-12T00:12:38.042600+0000","last_active":"2024-09-12T01:08:15.045160+0000","last_peered":"2024-09-12T01:08:15.045160+0000","last_clean":"2024-09-12T01:08:15.045160+0000","last_became_active":"2024-09-12T00:12:38.041187+0000","last_became_peered":"2024-09-12T00:12:38.041187+0000","last_unstale":"2024-09-12T01:08:15.045160+0000","last_undegraded":"2024-09-12T01:08:15.045160+0000","last_fullsized":"2024-09-12T01:08:15.045160+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:30.414258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":787,"num_read_kb":651,"num_write":272,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'302","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:27.263244+0000","last_change":"2024-09-12T00:12:36.034110+0000","last_active":"2024-09-12T01:10:27.263244+0000","last_peered":"2024-09-12T01:10:27.263244+0000","last_clean":"2024-09-12T01:10:27.263244+0000","last_became_active":"2024-09-12T00:12:36.033751+0000","last_became_peered":"2024-09-12T00:12:36.033751+0000","last_unstale":"2024-09-12T01:10:27.263244+0000","last_undegraded":"2024-09-12T01:10:27.263244+0000","last_fullsized":"2024-09-12T01:10:27.263244+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:13.850294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5847460,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":527,"num_read_kb":6771,"num_write":991,"num_write_kb":22452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.031479+0000","last_change":"2024-09-12T00:12:40.032783+0000","last_active":"2024-09-12T01:06:30.031479+0000","last_peered":"2024-09-12T01:06:30.031479+0000","last_clean":"2024-09-12T01:06:30.031479+0000","last_became_active":"2024-09-12T00:12:40.032489+0000","last_became_peered":"2024-09-12T00:12:40.032489+0000","last_unstale":"2024-09-12T01:06:30.031479+0000","last_undegraded":"2024-09-12T01:06:30.031479+0000","last_fullsized":"2024-09-12T01:06:30.031479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:22.084698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'93","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.815511+0000","last_change":"2024-09-12T00:12:42.046654+0000","last_active":"2024-09-12T01:10:31.815511+0000","last_peered":"2024-09-12T01:10:31.815511+0000","last_clean":"2024-09-12T01:10:31.815511+0000","last_became_active":"2024-09-12T00:12:42.046316+0000","last_became_peered":"2024-09-12T00:12:42.046316+0000","last_unstale":"2024-09-12T01:10:31.815511+0000","last_undegraded":"2024-09-12T01:10:31.815511+0000","last_fullsized":"2024-09-12T01:10:31.815511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:43.446982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":105,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.238553+0000","last_change":"2024-09-12T00:12:44.057706+0000","last_active":"2024-09-12T01:08:20.238553+0000","last_peered":"2024-09-12T01:08:20.238553+0000","last_clean":"2024-09-12T01:08:20.238553+0000","last_became_active":"2024-09-12T00:12:44.057398+0000","last_became_peered":"2024-09-12T00:12:44.057398+0000","last_unstale":"2024-09-12T01:08:20.238553+0000","last_undegraded":"2024-09-12T01:08:20.238553+0000","last_fullsized":"2024-09-12T01:08:20.238553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:05.128485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'136","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:39.937608+0000","last_change":"2024-09-12T00:12:46.061250+0000","last_active":"2024-09-12T01:08:39.937608+0000","last_peered":"2024-09-12T01:08:39.937608+0000","last_clean":"2024-09-12T01:08:39.937608+0000","last_became_active":"2024-09-12T00:12:46.060932+0000","last_became_peered":"2024-09-12T00:12:46.060932+0000","last_unstale":"2024-09-12T01:08:39.937608+0000","last_undegraded":"2024-09-12T01:08:39.937608+0000","last_fullsized":"2024-09-12T01:08:39.937608+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:30.826242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'190","reported_seq":814,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.046842+0000","last_change":"2024-09-12T00:12:38.038566+0000","last_active":"2024-09-12T01:08:13.046842+0000","last_peered":"2024-09-12T01:08:13.046842+0000","last_clean":"2024-09-12T01:08:13.046842+0000","last_became_active":"2024-09-12T00:12:38.038234+0000","last_became_peered":"2024-09-12T00:12:38.038234+0000","last_unstale":"2024-09-12T01:08:13.046842+0000","last_undegraded":"2024-09-12T01:08:13.046842+0000","last_fullsized":"2024-09-12T01:08:13.046842+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:49.369461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":891,"num_read_kb":755,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'283","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:43.235432+0000","last_change":"2024-09-12T00:13:07.150014+0000","last_active":"2024-09-12T01:08:43.235432+0000","last_peered":"2024-09-12T01:08:43.235432+0000","last_clean":"2024-09-12T01:08:43.235432+0000","last_became_active":"2024-09-12T00:13:07.149671+0000","last_became_peered":"2024-09-12T00:13:07.149671+0000","last_unstale":"2024-09-12T01:08:43.235432+0000","last_undegraded":"2024-09-12T01:08:43.235432+0000","last_fullsized":"2024-09-12T01:08:43.235432+0000","mapping_epoch":40,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:56.523641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1073886,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":528,"num_read_kb":33322,"num_write":936,"num_write_kb":23312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.049001+0000","last_change":"2024-09-12T00:12:40.037054+0000","last_active":"2024-09-12T01:08:15.049001+0000","last_peered":"2024-09-12T01:08:15.049001+0000","last_clean":"2024-09-12T01:08:15.049001+0000","last_became_active":"2024-09-12T00:12:40.036714+0000","last_became_peered":"2024-09-12T00:12:40.036714+0000","last_unstale":"2024-09-12T01:08:15.049001+0000","last_undegraded":"2024-09-12T01:08:15.049001+0000","last_fullsized":"2024-09-12T01:08:15.049001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:41.522842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'128","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.032412+0000","last_change":"2024-09-12T00:12:42.038292+0000","last_active":"2024-09-12T01:06:35.032412+0000","last_peered":"2024-09-12T01:06:35.032412+0000","last_clean":"2024-09-12T01:06:35.032412+0000","last_became_active":"2024-09-12T00:12:42.037971+0000","last_became_peered":"2024-09-12T00:12:42.037971+0000","last_unstale":"2024-09-12T01:06:35.032412+0000","last_undegraded":"2024-09-12T01:06:35.032412+0000","last_fullsized":"2024-09-12T01:06:35.032412+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:23.076188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":156,"num_read_kb":149,"num_write":106,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'770","reported_seq":2777,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:36.416192+0000","last_change":"2024-09-12T00:12:44.059925+0000","last_active":"2024-09-12T01:10:36.416192+0000","last_peered":"2024-09-12T01:10:36.416192+0000","last_clean":"2024-09-12T01:10:36.416192+0000","last_became_active":"2024-09-12T00:12:44.059258+0000","last_became_peered":"2024-09-12T00:12:44.059258+0000","last_unstale":"2024-09-12T01:10:36.416192+0000","last_undegraded":"2024-09-12T01:10:36.416192+0000","last_fullsized":"2024-09-12T01:10:36.416192+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:23.120624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'196","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.494669+0000","last_change":"2024-09-12T00:12:46.059926+0000","last_active":"2024-09-12T01:09:23.494669+0000","last_peered":"2024-09-12T01:09:23.494669+0000","last_clean":"2024-09-12T01:09:23.494669+0000","last_became_active":"2024-09-12T00:12:46.059591+0000","last_became_peered":"2024-09-12T00:12:46.059591+0000","last_unstale":"2024-09-12T01:09:23.494669+0000","last_undegraded":"2024-09-12T01:09:23.494669+0000","last_fullsized":"2024-09-12T01:09:23.494669+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:40.868229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":585,"num_read_kb":583,"num_write":433,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'4340","reported_seq":5003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.046880+0000","last_change":"2024-09-12T00:12:38.036026+0000","last_active":"2024-09-12T01:08:13.046880+0000","last_peered":"2024-09-12T01:08:13.046880+0000","last_clean":"2024-09-12T01:08:13.046880+0000","last_became_active":"2024-09-12T00:12:38.035743+0000","last_became_peered":"2024-09-12T00:12:38.035743+0000","last_unstale":"2024-09-12T01:08:13.046880+0000","last_undegraded":"2024-09-12T01:08:13.046880+0000","last_fullsized":"2024-09-12T01:08:13.046880+0000","mapping_epoch":29,"log_start":"263'4300","ondisk_log_start":"263'4300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:55.482084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17417,"num_read_kb":14583,"num_write":6500,"num_write_kb":3272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'292","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.186718+0000","last_change":"2024-09-12T00:12:36.038350+0000","last_active":"2024-09-12T01:07:50.186718+0000","last_peered":"2024-09-12T01:07:50.186718+0000","last_clean":"2024-09-12T01:07:50.186718+0000","last_became_active":"2024-09-12T00:12:36.038014+0000","last_became_peered":"2024-09-12T00:12:36.038014+0000","last_unstale":"2024-09-12T01:07:50.186718+0000","last_undegraded":"2024-09-12T01:07:50.186718+0000","last_fullsized":"2024-09-12T01:07:50.186718+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:25.617148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11217581,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":490,"num_read_kb":22310,"num_write":989,"num_write_kb":43311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045229+0000","last_change":"2024-09-12T00:12:40.041340+0000","last_active":"2024-09-12T01:08:15.045229+0000","last_peered":"2024-09-12T01:08:15.045229+0000","last_clean":"2024-09-12T01:08:15.045229+0000","last_became_active":"2024-09-12T00:12:40.040992+0000","last_became_peered":"2024-09-12T00:12:40.040992+0000","last_unstale":"2024-09-12T01:08:15.045229+0000","last_undegraded":"2024-09-12T01:08:15.045229+0000","last_fullsized":"2024-09-12T01:08:15.045229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:18.861321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'279","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.980782+0000","last_change":"2024-09-12T00:12:42.041347+0000","last_active":"2024-09-12T01:10:32.980782+0000","last_peered":"2024-09-12T01:10:32.980782+0000","last_clean":"2024-09-12T01:10:32.980782+0000","last_became_active":"2024-09-12T00:12:42.041042+0000","last_became_peered":"2024-09-12T00:12:42.041042+0000","last_unstale":"2024-09-12T01:10:32.980782+0000","last_undegraded":"2024-09-12T01:10:32.980782+0000","last_fullsized":"2024-09-12T01:10:32.980782+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:46.437978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":965,"num_write":370,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'805","reported_seq":2515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.886558+0000","last_change":"2024-09-12T00:12:44.062745+0000","last_active":"2024-09-12T01:10:57.886558+0000","last_peered":"2024-09-12T01:10:57.886558+0000","last_clean":"2024-09-12T01:10:57.886558+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:10:57.886558+0000","last_undegraded":"2024-09-12T01:10:57.886558+0000","last_fullsized":"2024-09-12T01:10:57.886558+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:30.427552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'191","reported_seq":820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035206+0000","last_change":"2024-09-12T00:12:38.040302+0000","last_active":"2024-09-12T01:06:50.035206+0000","last_peered":"2024-09-12T01:06:50.035206+0000","last_clean":"2024-09-12T01:06:50.035206+0000","last_became_active":"2024-09-12T00:12:38.040030+0000","last_became_peered":"2024-09-12T00:12:38.040030+0000","last_unstale":"2024-09-12T01:06:50.035206+0000","last_undegraded":"2024-09-12T01:06:50.035206+0000","last_fullsized":"2024-09-12T01:06:50.035206+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:17.788252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":682,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'278","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.023239+0000","last_change":"2024-09-12T00:12:36.040947+0000","last_active":"2024-09-12T01:06:55.023239+0000","last_peered":"2024-09-12T01:06:55.023239+0000","last_clean":"2024-09-12T01:06:55.023239+0000","last_became_active":"2024-09-12T00:12:36.040657+0000","last_became_peered":"2024-09-12T00:12:36.040657+0000","last_unstale":"2024-09-12T01:06:55.023239+0000","last_undegraded":"2024-09-12T01:06:55.023239+0000","last_fullsized":"2024-09-12T01:06:55.023239+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:18.229544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9510629,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":388,"num_read_kb":5569,"num_write":1051,"num_write_kb":16904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.229029+0000","last_change":"2024-09-12T00:12:40.036607+0000","last_active":"2024-09-12T01:06:50.229029+0000","last_peered":"2024-09-12T01:06:50.229029+0000","last_clean":"2024-09-12T01:06:50.229029+0000","last_became_active":"2024-09-12T00:12:40.036362+0000","last_became_peered":"2024-09-12T00:12:40.036362+0000","last_unstale":"2024-09-12T01:06:50.229029+0000","last_undegraded":"2024-09-12T01:06:50.229029+0000","last_fullsized":"2024-09-12T01:06:50.229029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:43.641028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'342","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.039063+0000","last_change":"2024-09-12T00:12:42.044696+0000","last_active":"2024-09-12T01:09:20.039063+0000","last_peered":"2024-09-12T01:09:20.039063+0000","last_clean":"2024-09-12T01:09:20.039063+0000","last_became_active":"2024-09-12T00:12:42.044418+0000","last_became_peered":"2024-09-12T00:12:42.044418+0000","last_unstale":"2024-09-12T01:09:20.039063+0000","last_undegraded":"2024-09-12T01:09:20.039063+0000","last_fullsized":"2024-09-12T01:09:20.039063+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:13.793410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56243,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":556,"num_read_kb":1000,"num_write":430,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.152015+0000","last_change":"2024-09-12T00:12:44.057796+0000","last_active":"2024-09-12T01:06:45.152015+0000","last_peered":"2024-09-12T01:06:45.152015+0000","last_clean":"2024-09-12T01:06:45.152015+0000","last_became_active":"2024-09-12T00:12:44.057438+0000","last_became_peered":"2024-09-12T00:12:44.057438+0000","last_unstale":"2024-09-12T01:06:45.152015+0000","last_undegraded":"2024-09-12T01:06:45.152015+0000","last_fullsized":"2024-09-12T01:06:45.152015+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:56.467860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'557","reported_seq":1367,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.003073+0000","last_change":"2024-09-12T00:12:46.060839+0000","last_active":"2024-09-12T01:10:33.003073+0000","last_peered":"2024-09-12T01:10:33.003073+0000","last_clean":"2024-09-12T01:10:33.003073+0000","last_became_active":"2024-09-12T00:12:46.060552+0000","last_became_peered":"2024-09-12T00:12:46.060552+0000","last_unstale":"2024-09-12T01:10:33.003073+0000","last_undegraded":"2024-09-12T01:10:33.003073+0000","last_fullsized":"2024-09-12T01:10:33.003073+0000","mapping_epoch":37,"log_start":"263'500","ondisk_log_start":"263'500","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:49.354363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1290,"num_read_kb":1284,"num_write":1146,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'240","reported_seq":844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.183059+0000","last_change":"2024-09-12T00:12:38.042271+0000","last_active":"2024-09-12T01:08:32.183059+0000","last_peered":"2024-09-12T01:08:32.183059+0000","last_clean":"2024-09-12T01:08:32.183059+0000","last_became_active":"2024-09-12T00:12:38.041916+0000","last_became_peered":"2024-09-12T00:12:38.041916+0000","last_unstale":"2024-09-12T01:08:32.183059+0000","last_undegraded":"2024-09-12T01:08:32.183059+0000","last_fullsized":"2024-09-12T01:08:32.183059+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:14.378653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1071,"num_read_kb":865,"num_write":389,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'266","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.127516+0000","last_change":"2024-09-12T00:12:36.043410+0000","last_active":"2024-09-12T01:06:40.127516+0000","last_peered":"2024-09-12T01:06:40.127516+0000","last_clean":"2024-09-12T01:06:40.127516+0000","last_became_active":"2024-09-12T00:12:36.042838+0000","last_became_peered":"2024-09-12T00:12:36.042838+0000","last_unstale":"2024-09-12T01:06:40.127516+0000","last_undegraded":"2024-09-12T01:06:40.127516+0000","last_fullsized":"2024-09-12T01:06:40.127516+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:50.068914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667686,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":421,"num_read_kb":7238,"num_write":1003,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.152809+0000","last_change":"2024-09-12T00:12:40.042917+0000","last_active":"2024-09-12T01:06:50.152809+0000","last_peered":"2024-09-12T01:06:50.152809+0000","last_clean":"2024-09-12T01:06:50.152809+0000","last_became_active":"2024-09-12T00:12:40.042625+0000","last_became_peered":"2024-09-12T00:12:40.042625+0000","last_unstale":"2024-09-12T01:06:50.152809+0000","last_undegraded":"2024-09-12T01:06:50.152809+0000","last_fullsized":"2024-09-12T01:06:50.152809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:42.496763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'250","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.056461+0000","last_change":"2024-09-12T00:12:42.040576+0000","last_active":"2024-09-12T01:09:00.056461+0000","last_peered":"2024-09-12T01:09:00.056461+0000","last_clean":"2024-09-12T01:09:00.056461+0000","last_became_active":"2024-09-12T00:12:42.040266+0000","last_became_peered":"2024-09-12T00:12:42.040266+0000","last_unstale":"2024-09-12T01:09:00.056461+0000","last_undegraded":"2024-09-12T01:09:00.056461+0000","last_fullsized":"2024-09-12T01:09:00.056461+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:24.483433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52734,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":866,"num_write":342,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:05.037890+0000","last_change":"2024-09-12T00:12:44.062951+0000","last_active":"2024-09-12T01:07:05.037890+0000","last_peered":"2024-09-12T01:07:05.037890+0000","last_clean":"2024-09-12T01:07:05.037890+0000","last_became_active":"2024-09-12T00:12:44.062608+0000","last_became_peered":"2024-09-12T00:12:44.062608+0000","last_unstale":"2024-09-12T01:07:05.037890+0000","last_undegraded":"2024-09-12T01:07:05.037890+0000","last_fullsized":"2024-09-12T01:07:05.037890+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:39.092545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2412","reported_seq":4250,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.887941+0000","last_change":"2024-09-12T00:12:46.062926+0000","last_active":"2024-09-12T01:10:35.887941+0000","last_peered":"2024-09-12T01:10:35.887941+0000","last_clean":"2024-09-12T01:10:35.887941+0000","last_became_active":"2024-09-12T00:12:46.062624+0000","last_became_peered":"2024-09-12T00:12:46.062624+0000","last_unstale":"2024-09-12T01:10:35.887941+0000","last_undegraded":"2024-09-12T01:10:35.887941+0000","last_fullsized":"2024-09-12T01:10:35.887941+0000","mapping_epoch":37,"log_start":"263'2400","ondisk_log_start":"263'2400","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":2400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:26.452821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":6065,"num_write":4891,"num_write_kb":1799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'224","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.300929+0000","last_change":"2024-09-12T00:12:38.042922+0000","last_active":"2024-09-12T01:08:19.300929+0000","last_peered":"2024-09-12T01:08:19.300929+0000","last_clean":"2024-09-12T01:08:19.300929+0000","last_became_active":"2024-09-12T00:12:38.042657+0000","last_became_peered":"2024-09-12T00:12:38.042657+0000","last_unstale":"2024-09-12T01:08:19.300929+0000","last_undegraded":"2024-09-12T01:08:19.300929+0000","last_fullsized":"2024-09-12T01:08:19.300929+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:37.846035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":947,"num_read_kb":771,"num_write":346,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'306","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:04.709086+0000","last_change":"2024-09-12T00:12:36.046609+0000","last_active":"2024-09-12T01:09:04.709086+0000","last_peered":"2024-09-12T01:09:04.709086+0000","last_clean":"2024-09-12T01:09:04.709086+0000","last_became_active":"2024-09-12T00:12:36.046196+0000","last_became_peered":"2024-09-12T00:12:36.046196+0000","last_unstale":"2024-09-12T01:09:04.709086+0000","last_undegraded":"2024-09-12T01:09:04.709086+0000","last_fullsized":"2024-09-12T01:09:04.709086+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:49.734531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23337616,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":474,"num_read_kb":69753,"num_write":1133,"num_write_kb":51465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:43.033241+0000","last_change":"2024-09-12T00:12:40.040357+0000","last_active":"2024-09-12T01:06:43.033241+0000","last_peered":"2024-09-12T01:06:43.033241+0000","last_clean":"2024-09-12T01:06:43.033241+0000","last_became_active":"2024-09-12T00:12:40.039887+0000","last_became_peered":"2024-09-12T00:12:40.039887+0000","last_unstale":"2024-09-12T01:06:43.033241+0000","last_undegraded":"2024-09-12T01:06:43.033241+0000","last_fullsized":"2024-09-12T01:06:43.033241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:20.058438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'325","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:05.051153+0000","last_change":"2024-09-12T00:12:42.051353+0000","last_active":"2024-09-12T01:09:05.051153+0000","last_peered":"2024-09-12T01:09:05.051153+0000","last_clean":"2024-09-12T01:09:05.051153+0000","last_became_active":"2024-09-12T00:12:42.051042+0000","last_became_peered":"2024-09-12T00:12:42.051042+0000","last_unstale":"2024-09-12T01:09:05.051153+0000","last_undegraded":"2024-09-12T01:09:05.051153+0000","last_fullsized":"2024-09-12T01:09:05.051153+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:52.667091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60864,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":519,"num_read_kb":1003,"num_write":418,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'805","reported_seq":2511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.887570+0000","last_change":"2024-09-12T00:12:44.057367+0000","last_active":"2024-09-12T01:10:57.887570+0000","last_peered":"2024-09-12T01:10:57.887570+0000","last_clean":"2024-09-12T01:10:57.887570+0000","last_became_active":"2024-09-12T00:12:44.057064+0000","last_became_peered":"2024-09-12T00:12:44.057064+0000","last_unstale":"2024-09-12T01:10:57.887570+0000","last_undegraded":"2024-09-12T01:10:57.887570+0000","last_fullsized":"2024-09-12T01:10:57.887570+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:28.146163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'102","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.693001+0000","last_change":"2024-09-12T00:12:46.059872+0000","last_active":"2024-09-12T01:10:31.693001+0000","last_peered":"2024-09-12T01:10:31.693001+0000","last_clean":"2024-09-12T01:10:31.693001+0000","last_became_active":"2024-09-12T00:12:46.059567+0000","last_became_peered":"2024-09-12T00:12:46.059567+0000","last_unstale":"2024-09-12T01:10:31.693001+0000","last_undegraded":"2024-09-12T01:10:31.693001+0000","last_fullsized":"2024-09-12T01:10:31.693001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:15.879983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":78,"num_write":230,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'198","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:38.032532+0000","last_change":"2024-09-12T00:12:38.040110+0000","last_active":"2024-09-12T01:06:38.032532+0000","last_peered":"2024-09-12T01:06:38.032532+0000","last_clean":"2024-09-12T01:06:38.032532+0000","last_became_active":"2024-09-12T00:12:38.039788+0000","last_became_peered":"2024-09-12T00:12:38.039788+0000","last_unstale":"2024-09-12T01:06:38.032532+0000","last_undegraded":"2024-09-12T01:06:38.032532+0000","last_fullsized":"2024-09-12T01:06:38.032532+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:03.291708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":765,"num_write":285,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'296","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:47.325600+0000","last_change":"2024-09-12T00:12:36.034612+0000","last_active":"2024-09-12T01:06:47.325600+0000","last_peered":"2024-09-12T01:06:47.325600+0000","last_clean":"2024-09-12T01:06:47.325600+0000","last_became_active":"2024-09-12T00:12:36.034290+0000","last_became_peered":"2024-09-12T00:12:36.034290+0000","last_unstale":"2024-09-12T01:06:47.325600+0000","last_undegraded":"2024-09-12T01:06:47.325600+0000","last_fullsized":"2024-09-12T01:06:47.325600+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:32.222016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11680083,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":463,"num_read_kb":18522,"num_write":1087,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.154250+0000","last_change":"2024-09-12T00:12:40.036885+0000","last_active":"2024-09-12T01:07:00.154250+0000","last_peered":"2024-09-12T01:07:00.154250+0000","last_clean":"2024-09-12T01:07:00.154250+0000","last_became_active":"2024-09-12T00:12:40.036551+0000","last_became_peered":"2024-09-12T00:12:40.036551+0000","last_unstale":"2024-09-12T01:07:00.154250+0000","last_undegraded":"2024-09-12T01:07:00.154250+0000","last_fullsized":"2024-09-12T01:07:00.154250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:09.117904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'505","reported_seq":1139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.972927+0000","last_change":"2024-09-12T00:12:42.041830+0000","last_active":"2024-09-12T01:10:32.972927+0000","last_peered":"2024-09-12T01:10:32.972927+0000","last_clean":"2024-09-12T01:10:32.972927+0000","last_became_active":"2024-09-12T00:12:42.041307+0000","last_became_peered":"2024-09-12T00:12:42.041307+0000","last_unstale":"2024-09-12T01:10:32.972927+0000","last_undegraded":"2024-09-12T01:10:32.972927+0000","last_fullsized":"2024-09-12T01:10:32.972927+0000","mapping_epoch":33,"log_start":"263'400","ondisk_log_start":"263'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:40.915241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121369,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":880,"num_read_kb":1904,"num_write":736,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:58.035239+0000","last_change":"2024-09-12T00:12:44.049673+0000","last_active":"2024-09-12T01:06:58.035239+0000","last_peered":"2024-09-12T01:06:58.035239+0000","last_clean":"2024-09-12T01:06:58.035239+0000","last_became_active":"2024-09-12T00:12:44.049211+0000","last_became_peered":"2024-09-12T00:12:44.049211+0000","last_unstale":"2024-09-12T01:06:58.035239+0000","last_undegraded":"2024-09-12T01:06:58.035239+0000","last_fullsized":"2024-09-12T01:06:58.035239+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:06.344330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'145","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.046019+0000","last_change":"2024-09-12T00:12:46.066668+0000","last_active":"2024-09-12T01:08:12.046019+0000","last_peered":"2024-09-12T01:08:12.046019+0000","last_clean":"2024-09-12T01:08:12.046019+0000","last_became_active":"2024-09-12T00:12:46.066431+0000","last_became_peered":"2024-09-12T00:12:46.066431+0000","last_unstale":"2024-09-12T01:08:12.046019+0000","last_undegraded":"2024-09-12T01:08:12.046019+0000","last_fullsized":"2024-09-12T01:08:12.046019+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:16.649236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":339,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'119","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.021555+0000","last_change":"2024-09-12T00:12:38.037741+0000","last_active":"2024-09-12T01:06:40.021555+0000","last_peered":"2024-09-12T01:06:40.021555+0000","last_clean":"2024-09-12T01:06:40.021555+0000","last_became_active":"2024-09-12T00:12:38.037464+0000","last_became_peered":"2024-09-12T00:12:38.037464+0000","last_unstale":"2024-09-12T01:06:40.021555+0000","last_undegraded":"2024-09-12T01:06:40.021555+0000","last_fullsized":"2024-09-12T01:06:40.021555+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:07.317139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'265","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.046082+0000","last_change":"2024-09-12T00:12:36.045431+0000","last_active":"2024-09-12T01:08:16.046082+0000","last_peered":"2024-09-12T01:08:16.046082+0000","last_clean":"2024-09-12T01:08:16.046082+0000","last_became_active":"2024-09-12T00:12:36.045050+0000","last_became_peered":"2024-09-12T00:12:36.045050+0000","last_unstale":"2024-09-12T01:08:16.046082+0000","last_undegraded":"2024-09-12T01:08:16.046082+0000","last_fullsized":"2024-09-12T01:08:16.046082+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:43.812152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4782027,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":419,"num_read_kb":13364,"num_write":1023,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.033417+0000","last_change":"2024-09-12T00:12:40.038347+0000","last_active":"2024-09-12T01:06:40.033417+0000","last_peered":"2024-09-12T01:06:40.033417+0000","last_clean":"2024-09-12T01:06:40.033417+0000","last_became_active":"2024-09-12T00:12:40.038036+0000","last_became_peered":"2024-09-12T00:12:40.038036+0000","last_unstale":"2024-09-12T01:06:40.033417+0000","last_undegraded":"2024-09-12T01:06:40.033417+0000","last_fullsized":"2024-09-12T01:06:40.033417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:56.716723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'292","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.242940+0000","last_change":"2024-09-12T00:12:42.051976+0000","last_active":"2024-09-12T01:09:00.242940+0000","last_peered":"2024-09-12T01:09:00.242940+0000","last_clean":"2024-09-12T01:09:00.242940+0000","last_became_active":"2024-09-12T00:12:42.051668+0000","last_became_peered":"2024-09-12T00:12:42.051668+0000","last_unstale":"2024-09-12T01:09:00.242940+0000","last_undegraded":"2024-09-12T01:09:00.242940+0000","last_fullsized":"2024-09-12T01:09:00.242940+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:48.021906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55574,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":985,"num_write":454,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.036235+0000","last_change":"2024-09-12T00:12:44.062196+0000","last_active":"2024-09-12T01:06:55.036235+0000","last_peered":"2024-09-12T01:06:55.036235+0000","last_clean":"2024-09-12T01:06:55.036235+0000","last_became_active":"2024-09-12T00:12:44.061848+0000","last_became_peered":"2024-09-12T00:12:44.061848+0000","last_unstale":"2024-09-12T01:06:55.036235+0000","last_undegraded":"2024-09-12T01:06:55.036235+0000","last_fullsized":"2024-09-12T01:06:55.036235+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:41.383111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'90","reported_seq":569,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:21.961327+0000","last_change":"2024-09-12T00:12:46.066391+0000","last_active":"2024-09-12T01:10:21.961327+0000","last_peered":"2024-09-12T01:10:21.961327+0000","last_clean":"2024-09-12T01:10:21.961327+0000","last_became_active":"2024-09-12T00:12:46.066121+0000","last_became_peered":"2024-09-12T00:12:46.066121+0000","last_unstale":"2024-09-12T01:10:21.961327+0000","last_undegraded":"2024-09-12T01:10:21.961327+0000","last_fullsized":"2024-09-12T01:10:21.961327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:35.295982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":71,"num_write":206,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'180","reported_seq":761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.034161+0000","last_change":"2024-09-12T00:12:38.046524+0000","last_active":"2024-09-12T01:06:40.034161+0000","last_peered":"2024-09-12T01:06:40.034161+0000","last_clean":"2024-09-12T01:06:40.034161+0000","last_became_active":"2024-09-12T00:12:38.046276+0000","last_became_peered":"2024-09-12T00:12:38.046276+0000","last_unstale":"2024-09-12T01:06:40.034161+0000","last_undegraded":"2024-09-12T01:06:40.034161+0000","last_fullsized":"2024-09-12T01:06:40.034161+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:51.205849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":618,"num_write":256,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'434","reported_seq":1137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:05.037105+0000","last_change":"2024-09-12T00:12:36.035888+0000","last_active":"2024-09-12T01:07:05.037105+0000","last_peered":"2024-09-12T01:07:05.037105+0000","last_clean":"2024-09-12T01:07:05.037105+0000","last_became_active":"2024-09-12T00:12:36.035311+0000","last_became_peered":"2024-09-12T00:12:36.035311+0000","last_unstale":"2024-09-12T01:07:05.037105+0000","last_undegraded":"2024-09-12T01:07:05.037105+0000","last_fullsized":"2024-09-12T01:07:05.037105+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:22.262395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143354,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":881,"num_read_kb":11265,"num_write":1412,"num_write_kb":28283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:43.033260+0000","last_change":"2024-09-12T00:12:40.035887+0000","last_active":"2024-09-12T01:06:43.033260+0000","last_peered":"2024-09-12T01:06:43.033260+0000","last_clean":"2024-09-12T01:06:43.033260+0000","last_became_active":"2024-09-12T00:12:40.035585+0000","last_became_peered":"2024-09-12T00:12:40.035585+0000","last_unstale":"2024-09-12T01:06:43.033260+0000","last_undegraded":"2024-09-12T01:06:43.033260+0000","last_fullsized":"2024-09-12T01:06:43.033260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:55.033563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'306","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.001454+0000","last_change":"2024-09-12T00:12:42.052616+0000","last_active":"2024-09-12T01:10:33.001454+0000","last_peered":"2024-09-12T01:10:33.001454+0000","last_clean":"2024-09-12T01:10:33.001454+0000","last_became_active":"2024-09-12T00:12:42.052279+0000","last_became_peered":"2024-09-12T00:12:42.052279+0000","last_unstale":"2024-09-12T01:10:33.001454+0000","last_undegraded":"2024-09-12T01:10:33.001454+0000","last_fullsized":"2024-09-12T01:10:33.001454+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:39.576180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60389,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":500,"num_read_kb":993,"num_write":404,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'770","reported_seq":4971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.870432+0000","last_change":"2024-09-12T00:12:44.060751+0000","last_active":"2024-09-12T01:10:35.870432+0000","last_peered":"2024-09-12T01:10:35.870432+0000","last_clean":"2024-09-12T01:10:35.870432+0000","last_became_active":"2024-09-12T00:12:44.060494+0000","last_became_peered":"2024-09-12T00:12:44.060494+0000","last_unstale":"2024-09-12T01:10:35.870432+0000","last_undegraded":"2024-09-12T01:10:35.870432+0000","last_fullsized":"2024-09-12T01:10:35.870432+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:43.956970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'133","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.942636+0000","last_change":"2024-09-12T00:12:46.060540+0000","last_active":"2024-09-12T01:09:20.942636+0000","last_peered":"2024-09-12T01:09:20.942636+0000","last_clean":"2024-09-12T01:09:20.942636+0000","last_became_active":"2024-09-12T00:12:46.060211+0000","last_became_peered":"2024-09-12T00:12:46.060211+0000","last_unstale":"2024-09-12T01:09:20.942636+0000","last_undegraded":"2024-09-12T01:09:20.942636+0000","last_fullsized":"2024-09-12T01:09:20.942636+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:03.614002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":113,"num_write":319,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'256","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.704664+0000","last_change":"2024-09-12T00:12:38.043160+0000","last_active":"2024-09-12T01:08:36.704664+0000","last_peered":"2024-09-12T01:08:36.704664+0000","last_clean":"2024-09-12T01:08:36.704664+0000","last_became_active":"2024-09-12T00:12:38.042601+0000","last_became_peered":"2024-09-12T00:12:38.042601+0000","last_unstale":"2024-09-12T01:08:36.704664+0000","last_undegraded":"2024-09-12T01:08:36.704664+0000","last_fullsized":"2024-09-12T01:08:36.704664+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:58.848548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1116,"num_read_kb":905,"num_write":388,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'303","reported_seq":939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.703071+0000","last_change":"2024-09-12T00:12:36.043748+0000","last_active":"2024-09-12T01:08:30.703071+0000","last_peered":"2024-09-12T01:08:30.703071+0000","last_clean":"2024-09-12T01:08:30.703071+0000","last_became_active":"2024-09-12T00:12:36.043404+0000","last_became_peered":"2024-09-12T00:12:36.043404+0000","last_unstale":"2024-09-12T01:08:30.703071+0000","last_undegraded":"2024-09-12T01:08:30.703071+0000","last_fullsized":"2024-09-12T01:08:30.703071+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:28.818965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7180177,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":450,"num_read_kb":34059,"num_write":1093,"num_write_kb":45928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'2","reported_seq":1454,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.736903+0000","last_change":"2024-09-12T00:12:40.035929+0000","last_active":"2024-09-12T01:10:32.736903+0000","last_peered":"2024-09-12T01:10:32.736903+0000","last_clean":"2024-09-12T01:10:32.736903+0000","last_became_active":"2024-09-12T00:12:40.035633+0000","last_became_peered":"2024-09-12T00:12:40.035633+0000","last_unstale":"2024-09-12T01:10:32.736903+0000","last_undegraded":"2024-09-12T01:10:32.736903+0000","last_fullsized":"2024-09-12T01:10:32.736903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:19.957170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'82","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.152071+0000","last_change":"2024-09-12T00:12:42.051649+0000","last_active":"2024-09-12T01:06:45.152071+0000","last_peered":"2024-09-12T01:06:45.152071+0000","last_clean":"2024-09-12T01:06:45.152071+0000","last_became_active":"2024-09-12T00:12:42.051384+0000","last_became_peered":"2024-09-12T00:12:42.051384+0000","last_unstale":"2024-09-12T01:06:45.152071+0000","last_undegraded":"2024-09-12T01:06:45.152071+0000","last_fullsized":"2024-09-12T01:06:45.152071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:53.378146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'774","reported_seq":4084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.870259+0000","last_change":"2024-09-12T00:12:44.062143+0000","last_active":"2024-09-12T01:10:35.870259+0000","last_peered":"2024-09-12T01:10:35.870259+0000","last_clean":"2024-09-12T01:10:35.870259+0000","last_became_active":"2024-09-12T00:12:44.061837+0000","last_became_peered":"2024-09-12T00:12:44.061837+0000","last_unstale":"2024-09-12T01:10:35.870259+0000","last_undegraded":"2024-09-12T01:10:35.870259+0000","last_fullsized":"2024-09-12T01:10:35.870259+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:55.341365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'132","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.359620+0000","last_change":"2024-09-12T00:12:46.059816+0000","last_active":"2024-09-12T01:09:22.359620+0000","last_peered":"2024-09-12T01:09:22.359620+0000","last_clean":"2024-09-12T01:09:22.359620+0000","last_became_active":"2024-09-12T00:12:46.057978+0000","last_became_peered":"2024-09-12T00:12:46.057978+0000","last_unstale":"2024-09-12T01:09:22.359620+0000","last_undegraded":"2024-09-12T01:09:22.359620+0000","last_fullsized":"2024-09-12T01:09:22.359620+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:40.034637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":126,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'235","reported_seq":844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.646426+0000","last_change":"2024-09-12T00:12:38.037321+0000","last_active":"2024-09-12T01:08:55.646426+0000","last_peered":"2024-09-12T01:08:55.646426+0000","last_clean":"2024-09-12T01:08:55.646426+0000","last_became_active":"2024-09-12T00:12:38.037035+0000","last_became_peered":"2024-09-12T00:12:38.037035+0000","last_unstale":"2024-09-12T01:08:55.646426+0000","last_undegraded":"2024-09-12T01:08:55.646426+0000","last_fullsized":"2024-09-12T01:08:55.646426+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:35.492382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":394,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'250","reported_seq":873,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.679176+0000","last_change":"2024-09-12T00:12:36.029406+0000","last_active":"2024-09-12T01:08:45.679176+0000","last_peered":"2024-09-12T01:08:45.679176+0000","last_clean":"2024-09-12T01:08:45.679176+0000","last_became_active":"2024-09-12T00:12:36.029059+0000","last_became_peered":"2024-09-12T00:12:36.029059+0000","last_unstale":"2024-09-12T01:08:45.679176+0000","last_undegraded":"2024-09-12T01:08:45.679176+0000","last_fullsized":"2024-09-12T01:08:45.679176+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:18.842991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9035013,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":371,"num_read_kb":19038,"num_write":947,"num_write_kb":37710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.034179+0000","last_change":"2024-09-12T00:12:40.042406+0000","last_active":"2024-09-12T01:06:40.034179+0000","last_peered":"2024-09-12T01:06:40.034179+0000","last_clean":"2024-09-12T01:06:40.034179+0000","last_became_active":"2024-09-12T00:12:40.042158+0000","last_became_peered":"2024-09-12T00:12:40.042158+0000","last_unstale":"2024-09-12T01:06:40.034179+0000","last_undegraded":"2024-09-12T01:06:40.034179+0000","last_fullsized":"2024-09-12T01:06:40.034179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:16.795550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'345","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.306952+0000","last_change":"2024-09-12T00:12:42.049042+0000","last_active":"2024-09-12T01:09:23.306952+0000","last_peered":"2024-09-12T01:09:23.306952+0000","last_clean":"2024-09-12T01:09:23.306952+0000","last_became_active":"2024-09-12T00:12:42.048747+0000","last_became_peered":"2024-09-12T00:12:42.048747+0000","last_unstale":"2024-09-12T01:09:23.306952+0000","last_undegraded":"2024-09-12T01:09:23.306952+0000","last_fullsized":"2024-09-12T01:09:23.306952+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:20.408850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56660,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":560,"num_read_kb":1054,"num_write":442,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.128059+0000","last_change":"2024-09-12T00:12:44.050415+0000","last_active":"2024-09-12T01:06:45.128059+0000","last_peered":"2024-09-12T01:06:45.128059+0000","last_clean":"2024-09-12T01:06:45.128059+0000","last_became_active":"2024-09-12T00:12:44.050074+0000","last_became_peered":"2024-09-12T00:12:44.050074+0000","last_unstale":"2024-09-12T01:06:45.128059+0000","last_undegraded":"2024-09-12T01:06:45.128059+0000","last_fullsized":"2024-09-12T01:06:45.128059+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:57.225646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'192","reported_seq":698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.036974+0000","last_change":"2024-09-12T00:12:46.064781+0000","last_active":"2024-09-12T01:07:00.036974+0000","last_peered":"2024-09-12T01:07:00.036974+0000","last_clean":"2024-09-12T01:07:00.036974+0000","last_became_active":"2024-09-12T00:12:46.064517+0000","last_became_peered":"2024-09-12T00:12:46.064517+0000","last_unstale":"2024-09-12T01:07:00.036974+0000","last_undegraded":"2024-09-12T01:07:00.036974+0000","last_fullsized":"2024-09-12T01:07:00.036974+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:13.273953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":229,"num_read_kb":204,"num_write":354,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'287","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:10.051836+0000","last_change":"2024-09-12T00:12:38.042874+0000","last_active":"2024-09-12T01:09:10.051836+0000","last_peered":"2024-09-12T01:09:10.051836+0000","last_clean":"2024-09-12T01:09:10.051836+0000","last_became_active":"2024-09-12T00:12:38.040885+0000","last_became_peered":"2024-09-12T00:12:38.040885+0000","last_unstale":"2024-09-12T01:09:10.051836+0000","last_undegraded":"2024-09-12T01:09:10.051836+0000","last_fullsized":"2024-09-12T01:09:10.051836+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:18.323532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1200,"num_read_kb":970,"num_write":419,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.239059+0000","last_change":"2024-09-12T00:12:17.818843+0000","last_active":"2024-09-12T01:08:25.239059+0000","last_peered":"2024-09-12T01:08:25.239059+0000","last_clean":"2024-09-12T01:08:25.239059+0000","last_became_active":"2024-09-12T00:12:17.817880+0000","last_became_peered":"2024-09-12T00:12:17.817880+0000","last_unstale":"2024-09-12T01:08:25.239059+0000","last_undegraded":"2024-09-12T01:08:25.239059+0000","last_fullsized":"2024-09-12T01:08:25.239059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:16.658840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:16.658840+0000","last_clean_scrub_stamp":"2024-09-12T00:12:16.658840+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:23.769027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.048041+0000","last_change":"2024-09-12T00:12:24.720432+0000","last_active":"2024-09-12T01:08:40.048041+0000","last_peered":"2024-09-12T01:08:40.048041+0000","last_clean":"2024-09-12T01:08:40.048041+0000","last_became_active":"2024-09-12T00:12:22.713297+0000","last_became_peered":"2024-09-12T00:12:22.713297+0000","last_unstale":"2024-09-12T01:08:40.048041+0000","last_undegraded":"2024-09-12T01:08:40.048041+0000","last_fullsized":"2024-09-12T01:08:40.048041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:31.323737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014022310000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'314","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035100+0000","last_change":"2024-09-12T00:12:36.031160+0000","last_active":"2024-09-12T01:06:50.035100+0000","last_peered":"2024-09-12T01:06:50.035100+0000","last_clean":"2024-09-12T01:06:50.035100+0000","last_became_active":"2024-09-12T00:12:36.030408+0000","last_became_peered":"2024-09-12T00:12:36.030408+0000","last_unstale":"2024-09-12T01:06:50.035100+0000","last_undegraded":"2024-09-12T01:06:50.035100+0000","last_fullsized":"2024-09-12T01:06:50.035100+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:33.226277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21257187,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":680,"num_read_kb":42609,"num_write":1091,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"39'3","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.726269+0000","last_change":"2024-09-12T00:12:40.039805+0000","last_active":"2024-09-12T01:10:32.726269+0000","last_peered":"2024-09-12T01:10:32.726269+0000","last_clean":"2024-09-12T01:10:32.726269+0000","last_became_active":"2024-09-12T00:12:40.039529+0000","last_became_peered":"2024-09-12T00:12:40.039529+0000","last_unstale":"2024-09-12T01:10:32.726269+0000","last_undegraded":"2024-09-12T01:10:32.726269+0000","last_fullsized":"2024-09-12T01:10:32.726269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:59.811179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'749","reported_seq":1443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.989481+0000","last_change":"2024-09-12T00:12:42.047000+0000","last_active":"2024-09-12T01:10:32.989481+0000","last_peered":"2024-09-12T01:10:32.989481+0000","last_clean":"2024-09-12T01:10:32.989481+0000","last_became_active":"2024-09-12T00:12:42.046668+0000","last_became_peered":"2024-09-12T00:12:42.046668+0000","last_unstale":"2024-09-12T01:10:32.989481+0000","last_undegraded":"2024-09-12T01:10:32.989481+0000","last_fullsized":"2024-09-12T01:10:32.989481+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:28.052922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180876,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1457,"num_read_kb":2974,"num_write":1430,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:58.035351+0000","last_change":"2024-09-12T00:12:44.054071+0000","last_active":"2024-09-12T01:06:58.035351+0000","last_peered":"2024-09-12T01:06:58.035351+0000","last_clean":"2024-09-12T01:06:58.035351+0000","last_became_active":"2024-09-12T00:12:44.053779+0000","last_became_peered":"2024-09-12T00:12:44.053779+0000","last_unstale":"2024-09-12T01:06:58.035351+0000","last_undegraded":"2024-09-12T01:06:58.035351+0000","last_fullsized":"2024-09-12T01:06:58.035351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:27.975447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'187","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.839569+0000","last_change":"2024-09-12T00:12:46.055892+0000","last_active":"2024-09-12T01:09:21.839569+0000","last_peered":"2024-09-12T01:09:21.839569+0000","last_clean":"2024-09-12T01:09:21.839569+0000","last_became_active":"2024-09-12T00:12:46.055501+0000","last_became_peered":"2024-09-12T00:12:46.055501+0000","last_unstale":"2024-09-12T01:09:21.839569+0000","last_undegraded":"2024-09-12T01:09:21.839569+0000","last_fullsized":"2024-09-12T01:09:21.839569+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:21.728435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":436,"num_write":384,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'149","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.983294+0000","last_change":"2024-09-12T00:12:38.037702+0000","last_active":"2024-09-12T01:06:50.983294+0000","last_peered":"2024-09-12T01:06:50.983294+0000","last_clean":"2024-09-12T01:06:50.983294+0000","last_became_active":"2024-09-12T00:12:38.037392+0000","last_became_peered":"2024-09-12T00:12:38.037392+0000","last_unstale":"2024-09-12T01:06:50.983294+0000","last_undegraded":"2024-09-12T01:06:50.983294+0000","last_fullsized":"2024-09-12T01:06:50.983294+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:11.775556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":647,"num_read_kb":530,"num_write":212,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.047963+0000","last_change":"2024-09-12T00:12:24.720267+0000","last_active":"2024-09-12T01:08:40.047963+0000","last_peered":"2024-09-12T01:08:40.047963+0000","last_clean":"2024-09-12T01:08:40.047963+0000","last_became_active":"2024-09-12T00:12:22.713657+0000","last_became_peered":"2024-09-12T00:12:22.713657+0000","last_unstale":"2024-09-12T01:08:40.047963+0000","last_undegraded":"2024-09-12T01:08:40.047963+0000","last_fullsized":"2024-09-12T01:08:40.047963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:55.127846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012667690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'274","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:01.178847+0000","last_change":"2024-09-12T00:12:36.036400+0000","last_active":"2024-09-12T01:07:01.178847+0000","last_peered":"2024-09-12T01:07:01.178847+0000","last_clean":"2024-09-12T01:07:01.178847+0000","last_became_active":"2024-09-12T00:12:36.036010+0000","last_became_peered":"2024-09-12T00:12:36.036010+0000","last_unstale":"2024-09-12T01:07:01.178847+0000","last_undegraded":"2024-09-12T01:07:01.178847+0000","last_fullsized":"2024-09-12T01:07:01.178847+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:28.310996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9561323,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":463,"num_read_kb":7159,"num_write":1042,"num_write_kb":37525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035353+0000","last_change":"2024-09-12T00:12:40.039924+0000","last_active":"2024-09-12T01:06:50.035353+0000","last_peered":"2024-09-12T01:06:50.035353+0000","last_clean":"2024-09-12T01:06:50.035353+0000","last_became_active":"2024-09-12T00:12:40.039592+0000","last_became_peered":"2024-09-12T00:12:40.039592+0000","last_unstale":"2024-09-12T01:06:50.035353+0000","last_undegraded":"2024-09-12T01:06:50.035353+0000","last_fullsized":"2024-09-12T01:06:50.035353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:03.351155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1291","reported_seq":2905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.870389+0000","last_change":"2024-09-12T00:12:42.049983+0000","last_active":"2024-09-12T01:10:35.870389+0000","last_peered":"2024-09-12T01:10:35.870389+0000","last_clean":"2024-09-12T01:10:35.870389+0000","last_became_active":"2024-09-12T00:12:42.049594+0000","last_became_peered":"2024-09-12T00:12:42.049594+0000","last_unstale":"2024-09-12T01:10:35.870389+0000","last_undegraded":"2024-09-12T01:10:35.870389+0000","last_fullsized":"2024-09-12T01:10:35.870389+0000","mapping_epoch":33,"log_start":"263'1201","ondisk_log_start":"263'1201","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":1201,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:24.166453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181533,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2029,"num_read_kb":3499,"num_write":1142,"num_write_kb":986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.037681+0000","last_change":"2024-09-12T00:12:44.059941+0000","last_active":"2024-09-12T01:07:10.037681+0000","last_peered":"2024-09-12T01:07:10.037681+0000","last_clean":"2024-09-12T01:07:10.037681+0000","last_became_active":"2024-09-12T00:12:44.059188+0000","last_became_peered":"2024-09-12T00:12:44.059188+0000","last_unstale":"2024-09-12T01:07:10.037681+0000","last_undegraded":"2024-09-12T01:07:10.037681+0000","last_fullsized":"2024-09-12T01:07:10.037681+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:21.870093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'151","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.534259+0000","last_change":"2024-09-12T00:12:46.065282+0000","last_active":"2024-09-12T01:09:21.534259+0000","last_peered":"2024-09-12T01:09:21.534259+0000","last_clean":"2024-09-12T01:09:21.534259+0000","last_became_active":"2024-09-12T00:12:46.064993+0000","last_became_peered":"2024-09-12T00:12:46.064993+0000","last_unstale":"2024-09-12T01:09:21.534259+0000","last_undegraded":"2024-09-12T01:09:21.534259+0000","last_fullsized":"2024-09-12T01:09:21.534259+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:44.458446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":277,"num_write":363,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'61","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.153022+0000","last_change":"2024-09-12T00:12:38.039881+0000","last_active":"2024-09-12T01:06:50.153022+0000","last_peered":"2024-09-12T01:06:50.153022+0000","last_clean":"2024-09-12T01:06:50.153022+0000","last_became_active":"2024-09-12T00:12:38.039492+0000","last_became_peered":"2024-09-12T00:12:38.039492+0000","last_unstale":"2024-09-12T01:06:50.153022+0000","last_undegraded":"2024-09-12T01:06:50.153022+0000","last_fullsized":"2024-09-12T01:06:50.153022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:21.545330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":235,"num_write":88,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.053063+0000","last_change":"2024-09-12T00:12:25.140418+0000","last_active":"2024-09-12T01:08:40.053063+0000","last_peered":"2024-09-12T01:08:40.053063+0000","last_clean":"2024-09-12T01:08:40.053063+0000","last_became_active":"2024-09-12T00:12:22.714487+0000","last_became_peered":"2024-09-12T00:12:22.714487+0000","last_unstale":"2024-09-12T01:08:40.053063+0000","last_undegraded":"2024-09-12T01:08:40.053063+0000","last_fullsized":"2024-09-12T01:08:40.053063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:43.265742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038937299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'259","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.052910+0000","last_change":"2024-09-12T00:12:36.042842+0000","last_active":"2024-09-12T01:08:53.052910+0000","last_peered":"2024-09-12T01:08:53.052910+0000","last_clean":"2024-09-12T01:08:53.052910+0000","last_became_active":"2024-09-12T00:12:36.042293+0000","last_became_peered":"2024-09-12T00:12:36.042293+0000","last_unstale":"2024-09-12T01:08:53.052910+0000","last_undegraded":"2024-09-12T01:08:53.052910+0000","last_fullsized":"2024-09-12T01:08:53.052910+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:27.070087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8603516,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":428,"num_read_kb":33497,"num_write":1002,"num_write_kb":40497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"32'1","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035127+0000","last_change":"2024-09-12T00:12:40.038528+0000","last_active":"2024-09-12T01:06:50.035127+0000","last_peered":"2024-09-12T01:06:50.035127+0000","last_clean":"2024-09-12T01:06:50.035127+0000","last_became_active":"2024-09-12T00:12:40.038202+0000","last_became_peered":"2024-09-12T00:12:40.038202+0000","last_unstale":"2024-09-12T01:06:50.035127+0000","last_undegraded":"2024-09-12T01:06:50.035127+0000","last_fullsized":"2024-09-12T01:06:50.035127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:20.002180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'248","reported_seq":1480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:30.102145+0000","last_change":"2024-09-12T00:12:42.044804+0000","last_active":"2024-09-12T01:10:30.102145+0000","last_peered":"2024-09-12T01:10:30.102145+0000","last_clean":"2024-09-12T01:10:30.102145+0000","last_became_active":"2024-09-12T00:12:42.044498+0000","last_became_peered":"2024-09-12T00:12:42.044498+0000","last_unstale":"2024-09-12T01:10:30.102145+0000","last_undegraded":"2024-09-12T01:10:30.102145+0000","last_fullsized":"2024-09-12T01:10:30.102145+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:46.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":187,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.036173+0000","last_change":"2024-09-12T00:12:44.062318+0000","last_active":"2024-09-12T01:06:55.036173+0000","last_peered":"2024-09-12T01:06:55.036173+0000","last_clean":"2024-09-12T01:06:55.036173+0000","last_became_active":"2024-09-12T00:12:44.062039+0000","last_became_peered":"2024-09-12T00:12:44.062039+0000","last_unstale":"2024-09-12T01:06:55.036173+0000","last_undegraded":"2024-09-12T01:06:55.036173+0000","last_fullsized":"2024-09-12T01:06:55.036173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:41.686967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'260","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.751353+0000","last_change":"2024-09-12T00:12:46.053602+0000","last_active":"2024-09-12T01:09:22.751353+0000","last_peered":"2024-09-12T01:09:22.751353+0000","last_clean":"2024-09-12T01:09:22.751353+0000","last_became_active":"2024-09-12T00:12:46.053228+0000","last_became_peered":"2024-09-12T00:12:46.053228+0000","last_unstale":"2024-09-12T01:09:22.751353+0000","last_undegraded":"2024-09-12T01:09:22.751353+0000","last_fullsized":"2024-09-12T01:09:22.751353+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:21.825120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":531,"num_write":580,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'172","reported_seq":751,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.152971+0000","last_change":"2024-09-12T00:12:38.040785+0000","last_active":"2024-09-12T01:06:50.152971+0000","last_peered":"2024-09-12T01:06:50.152971+0000","last_clean":"2024-09-12T01:06:50.152971+0000","last_became_active":"2024-09-12T00:12:38.040477+0000","last_became_peered":"2024-09-12T00:12:38.040477+0000","last_unstale":"2024-09-12T01:06:50.152971+0000","last_undegraded":"2024-09-12T01:06:50.152971+0000","last_fullsized":"2024-09-12T01:06:50.152971+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.489846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":766,"num_read_kb":623,"num_write":281,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.048018+0000","last_change":"2024-09-12T00:12:24.719660+0000","last_active":"2024-09-12T01:08:40.048018+0000","last_peered":"2024-09-12T01:08:40.048018+0000","last_clean":"2024-09-12T01:08:40.048018+0000","last_became_active":"2024-09-12T00:12:22.840587+0000","last_became_peered":"2024-09-12T00:12:22.840587+0000","last_unstale":"2024-09-12T01:08:40.048018+0000","last_undegraded":"2024-09-12T01:08:40.048018+0000","last_fullsized":"2024-09-12T01:08:40.048018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:04.555069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065014999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'301","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.174386+0000","last_change":"2024-09-12T00:12:36.040303+0000","last_active":"2024-09-12T01:07:43.174386+0000","last_peered":"2024-09-12T01:07:43.174386+0000","last_clean":"2024-09-12T01:07:43.174386+0000","last_became_active":"2024-09-12T00:12:36.039564+0000","last_became_peered":"2024-09-12T00:12:36.039564+0000","last_unstale":"2024-09-12T01:07:43.174386+0000","last_undegraded":"2024-09-12T01:07:43.174386+0000","last_fullsized":"2024-09-12T01:07:43.174386+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:41.381139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9770591,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":569,"num_read_kb":35581,"num_write":1119,"num_write_kb":35527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.037023+0000","last_change":"2024-09-12T00:12:40.042792+0000","last_active":"2024-09-12T01:07:00.037023+0000","last_peered":"2024-09-12T01:07:00.037023+0000","last_clean":"2024-09-12T01:07:00.037023+0000","last_became_active":"2024-09-12T00:12:40.042510+0000","last_became_peered":"2024-09-12T00:12:40.042510+0000","last_unstale":"2024-09-12T01:07:00.037023+0000","last_undegraded":"2024-09-12T01:07:00.037023+0000","last_fullsized":"2024-09-12T01:07:00.037023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:33.760779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'131","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.054611+0000","last_change":"2024-09-12T00:12:42.051046+0000","last_active":"2024-09-12T01:09:03.054611+0000","last_peered":"2024-09-12T01:09:03.054611+0000","last_clean":"2024-09-12T01:09:03.054611+0000","last_became_active":"2024-09-12T00:12:42.050143+0000","last_became_peered":"2024-09-12T00:12:42.050143+0000","last_unstale":"2024-09-12T01:09:03.054611+0000","last_undegraded":"2024-09-12T01:09:03.054611+0000","last_fullsized":"2024-09-12T01:09:03.054611+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:15.073604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.035914+0000","last_change":"2024-09-12T00:12:44.059423+0000","last_active":"2024-09-12T01:06:55.035914+0000","last_peered":"2024-09-12T01:06:55.035914+0000","last_clean":"2024-09-12T01:06:55.035914+0000","last_became_active":"2024-09-12T00:12:44.059037+0000","last_became_peered":"2024-09-12T00:12:44.059037+0000","last_unstale":"2024-09-12T01:06:55.035914+0000","last_undegraded":"2024-09-12T01:06:55.035914+0000","last_fullsized":"2024-09-12T01:06:55.035914+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:59.363962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'163","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.572035+0000","last_change":"2024-09-12T00:12:46.069307+0000","last_active":"2024-09-12T01:09:21.572035+0000","last_peered":"2024-09-12T01:09:21.572035+0000","last_clean":"2024-09-12T01:09:21.572035+0000","last_became_active":"2024-09-12T00:12:46.068934+0000","last_became_peered":"2024-09-12T00:12:46.068934+0000","last_unstale":"2024-09-12T01:09:21.572035+0000","last_undegraded":"2024-09-12T01:09:21.572035+0000","last_fullsized":"2024-09-12T01:09:21.572035+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:07.233294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":270,"num_read_kb":259,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'110","reported_seq":685,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.152888+0000","last_change":"2024-09-12T00:12:38.044730+0000","last_active":"2024-09-12T01:06:50.152888+0000","last_peered":"2024-09-12T01:06:50.152888+0000","last_clean":"2024-09-12T01:06:50.152888+0000","last_became_active":"2024-09-12T00:12:38.044464+0000","last_became_peered":"2024-09-12T00:12:38.044464+0000","last_unstale":"2024-09-12T01:06:50.152888+0000","last_undegraded":"2024-09-12T01:06:50.152888+0000","last_fullsized":"2024-09-12T01:06:50.152888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:14.066506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":513,"num_read_kb":428,"num_write":178,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'319","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.729395+0000","last_change":"2024-09-12T00:12:36.037463+0000","last_active":"2024-09-12T01:08:27.729395+0000","last_peered":"2024-09-12T01:08:27.729395+0000","last_clean":"2024-09-12T01:08:27.729395+0000","last_became_active":"2024-09-12T00:12:36.036570+0000","last_became_peered":"2024-09-12T00:12:36.036570+0000","last_unstale":"2024-09-12T01:08:27.729395+0000","last_undegraded":"2024-09-12T01:08:27.729395+0000","last_fullsized":"2024-09-12T01:08:27.729395+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:27.156201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6816504,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":752,"num_read_kb":22341,"num_write":1095,"num_write_kb":30942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:38.050417+0000","last_change":"2024-09-12T00:12:24.788080+0000","last_active":"2024-09-12T01:08:38.050417+0000","last_peered":"2024-09-12T01:08:38.050417+0000","last_clean":"2024-09-12T01:08:38.050417+0000","last_became_active":"2024-09-12T00:12:22.840210+0000","last_became_peered":"2024-09-12T00:12:22.840210+0000","last_unstale":"2024-09-12T01:08:38.050417+0000","last_undegraded":"2024-09-12T01:08:38.050417+0000","last_fullsized":"2024-09-12T01:08:38.050417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.906053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043827699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035136+0000","last_change":"2024-09-12T00:12:40.041037+0000","last_active":"2024-09-12T01:06:50.035136+0000","last_peered":"2024-09-12T01:06:50.035136+0000","last_clean":"2024-09-12T01:06:50.035136+0000","last_became_active":"2024-09-12T00:12:40.040760+0000","last_became_peered":"2024-09-12T00:12:40.040760+0000","last_unstale":"2024-09-12T01:06:50.035136+0000","last_undegraded":"2024-09-12T01:06:50.035136+0000","last_fullsized":"2024-09-12T01:06:50.035136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:43.762744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'616","reported_seq":1278,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.000115+0000","last_change":"2024-09-12T00:12:42.053771+0000","last_active":"2024-09-12T01:10:33.000115+0000","last_peered":"2024-09-12T01:10:33.000115+0000","last_clean":"2024-09-12T01:10:33.000115+0000","last_became_active":"2024-09-12T00:12:42.053472+0000","last_became_peered":"2024-09-12T00:12:42.053472+0000","last_unstale":"2024-09-12T01:10:33.000115+0000","last_undegraded":"2024-09-12T01:10:33.000115+0000","last_fullsized":"2024-09-12T01:10:33.000115+0000","mapping_epoch":33,"log_start":"263'600","ondisk_log_start":"263'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":600,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:10.598317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123401,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1689,"num_read_kb":2758,"num_write":2204,"num_write_kb":2034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.129178+0000","last_change":"2024-09-12T00:12:44.049070+0000","last_active":"2024-09-12T01:06:55.129178+0000","last_peered":"2024-09-12T01:06:55.129178+0000","last_clean":"2024-09-12T01:06:55.129178+0000","last_became_active":"2024-09-12T00:12:44.048703+0000","last_became_peered":"2024-09-12T00:12:44.048703+0000","last_unstale":"2024-09-12T01:06:55.129178+0000","last_undegraded":"2024-09-12T01:06:55.129178+0000","last_fullsized":"2024-09-12T01:06:55.129178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:10.832094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'142","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.054601+0000","last_change":"2024-09-12T00:12:46.064205+0000","last_active":"2024-09-12T01:09:03.054601+0000","last_peered":"2024-09-12T01:09:03.054601+0000","last_clean":"2024-09-12T01:09:03.054601+0000","last_became_active":"2024-09-12T00:12:46.063429+0000","last_became_peered":"2024-09-12T00:12:46.063429+0000","last_unstale":"2024-09-12T01:09:03.054601+0000","last_undegraded":"2024-09-12T01:09:03.054601+0000","last_fullsized":"2024-09-12T01:09:03.054601+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:01.539611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":320,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'177","reported_seq":786,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.831865+0000","last_change":"2024-09-12T00:12:38.041538+0000","last_active":"2024-09-12T01:07:41.831865+0000","last_peered":"2024-09-12T01:07:41.831865+0000","last_clean":"2024-09-12T01:07:41.831865+0000","last_became_active":"2024-09-12T00:12:38.041178+0000","last_became_peered":"2024-09-12T00:12:38.041178+0000","last_unstale":"2024-09-12T01:07:41.831865+0000","last_undegraded":"2024-09-12T01:07:41.831865+0000","last_fullsized":"2024-09-12T01:07:41.831865+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:50.594465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":778,"num_read_kb":646,"num_write":262,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'286","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.276118+0000","last_change":"2024-09-12T00:12:36.036323+0000","last_active":"2024-09-12T01:07:12.276118+0000","last_peered":"2024-09-12T01:07:12.276118+0000","last_clean":"2024-09-12T01:07:12.276118+0000","last_became_active":"2024-09-12T00:12:36.035932+0000","last_became_peered":"2024-09-12T00:12:36.035932+0000","last_unstale":"2024-09-12T01:07:12.276118+0000","last_undegraded":"2024-09-12T01:07:12.276118+0000","last_fullsized":"2024-09-12T01:07:12.276118+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:58.357878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9574875,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":431,"num_read_kb":22294,"num_write":1091,"num_write_kb":32564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035300+0000","last_change":"2024-09-12T00:12:24.719653+0000","last_active":"2024-09-12T01:06:50.035300+0000","last_peered":"2024-09-12T01:06:50.035300+0000","last_clean":"2024-09-12T01:06:50.035300+0000","last_became_active":"2024-09-12T00:12:22.713263+0000","last_became_peered":"2024-09-12T00:12:22.713263+0000","last_unstale":"2024-09-12T01:06:50.035300+0000","last_undegraded":"2024-09-12T01:06:50.035300+0000","last_fullsized":"2024-09-12T01:06:50.035300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:13.032469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065424400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.022587+0000","last_change":"2024-09-12T00:12:40.039181+0000","last_active":"2024-09-12T01:06:50.022587+0000","last_peered":"2024-09-12T01:06:50.022587+0000","last_clean":"2024-09-12T01:06:50.022587+0000","last_became_active":"2024-09-12T00:12:40.038903+0000","last_became_peered":"2024-09-12T00:12:40.038903+0000","last_unstale":"2024-09-12T01:06:50.022587+0000","last_undegraded":"2024-09-12T01:06:50.022587+0000","last_fullsized":"2024-09-12T01:06:50.022587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:00.591959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'172","reported_seq":741,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.153591+0000","last_change":"2024-09-12T00:12:42.050874+0000","last_active":"2024-09-12T01:06:55.153591+0000","last_peered":"2024-09-12T01:06:55.153591+0000","last_clean":"2024-09-12T01:06:55.153591+0000","last_became_active":"2024-09-12T00:12:42.050580+0000","last_became_peered":"2024-09-12T00:12:42.050580+0000","last_unstale":"2024-09-12T01:06:55.153591+0000","last_undegraded":"2024-09-12T01:06:55.153591+0000","last_fullsized":"2024-09-12T01:06:55.153591+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:59.841756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":221,"num_write":156,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'775","reported_seq":2698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:36.413895+0000","last_change":"2024-09-12T00:12:44.050548+0000","last_active":"2024-09-12T01:10:36.413895+0000","last_peered":"2024-09-12T01:10:36.413895+0000","last_clean":"2024-09-12T01:10:36.413895+0000","last_became_active":"2024-09-12T00:12:44.050295+0000","last_became_peered":"2024-09-12T00:12:44.050295+0000","last_unstale":"2024-09-12T01:10:36.413895+0000","last_undegraded":"2024-09-12T01:10:36.413895+0000","last_fullsized":"2024-09-12T01:10:36.413895+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:53.235246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'126","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.059081+0000","last_change":"2024-09-12T00:12:46.064323+0000","last_active":"2024-09-12T01:09:15.059081+0000","last_peered":"2024-09-12T01:09:15.059081+0000","last_clean":"2024-09-12T01:09:15.059081+0000","last_became_active":"2024-09-12T00:12:46.064036+0000","last_became_peered":"2024-09-12T00:12:46.064036+0000","last_unstale":"2024-09-12T01:09:15.059081+0000","last_undegraded":"2024-09-12T01:09:15.059081+0000","last_fullsized":"2024-09-12T01:09:15.059081+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:58.782613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1116,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'65","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.900165+0000","last_change":"2024-09-12T00:12:38.040132+0000","last_active":"2024-09-12T01:10:35.900165+0000","last_peered":"2024-09-12T01:10:35.900165+0000","last_clean":"2024-09-12T01:10:35.900165+0000","last_became_active":"2024-09-12T00:12:38.039759+0000","last_became_peered":"2024-09-12T00:12:38.039759+0000","last_unstale":"2024-09-12T01:10:35.900165+0000","last_undegraded":"2024-09-12T01:10:35.900165+0000","last_fullsized":"2024-09-12T01:10:35.900165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:56.827266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":290,"num_read_kb":242,"num_write":89,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'293","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035264+0000","last_change":"2024-09-12T00:12:36.032820+0000","last_active":"2024-09-12T01:06:50.035264+0000","last_peered":"2024-09-12T01:06:50.035264+0000","last_clean":"2024-09-12T01:06:50.035264+0000","last_became_active":"2024-09-12T00:12:36.032470+0000","last_became_peered":"2024-09-12T00:12:36.032470+0000","last_unstale":"2024-09-12T01:06:50.035264+0000","last_undegraded":"2024-09-12T01:06:50.035264+0000","last_fullsized":"2024-09-12T01:06:50.035264+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:59.424753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4550458,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":443,"num_read_kb":9891,"num_write":1138,"num_write_kb":25017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.054108+0000","last_change":"2024-09-12T00:12:24.719145+0000","last_active":"2024-09-12T01:08:45.054108+0000","last_peered":"2024-09-12T01:08:45.054108+0000","last_clean":"2024-09-12T01:08:45.054108+0000","last_became_active":"2024-09-12T00:12:22.875452+0000","last_became_peered":"2024-09-12T00:12:22.875452+0000","last_unstale":"2024-09-12T01:08:45.054108+0000","last_undegraded":"2024-09-12T01:08:45.054108+0000","last_fullsized":"2024-09-12T01:08:45.054108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:18.582665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040035500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035250+0000","last_change":"2024-09-12T00:12:40.040001+0000","last_active":"2024-09-12T01:06:50.035250+0000","last_peered":"2024-09-12T01:06:50.035250+0000","last_clean":"2024-09-12T01:06:50.035250+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:06:50.035250+0000","last_undegraded":"2024-09-12T01:06:50.035250+0000","last_fullsized":"2024-09-12T01:06:50.035250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:47.045425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'129","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.035838+0000","last_change":"2024-09-12T00:12:42.048645+0000","last_active":"2024-09-12T01:06:55.035838+0000","last_peered":"2024-09-12T01:06:55.035838+0000","last_clean":"2024-09-12T01:06:55.035838+0000","last_became_active":"2024-09-12T00:12:42.048364+0000","last_became_peered":"2024-09-12T00:12:42.048364+0000","last_unstale":"2024-09-12T01:06:55.035838+0000","last_undegraded":"2024-09-12T01:06:55.035838+0000","last_fullsized":"2024-09-12T01:06:55.035838+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:36.782398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'805","reported_seq":2514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.885117+0000","last_change":"2024-09-12T00:12:44.050927+0000","last_active":"2024-09-12T01:10:57.885117+0000","last_peered":"2024-09-12T01:10:57.885117+0000","last_clean":"2024-09-12T01:10:57.885117+0000","last_became_active":"2024-09-12T00:12:44.049336+0000","last_became_peered":"2024-09-12T00:12:44.049336+0000","last_unstale":"2024-09-12T01:10:57.885117+0000","last_undegraded":"2024-09-12T01:10:57.885117+0000","last_fullsized":"2024-09-12T01:10:57.885117+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:05.958866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'271","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:44.898434+0000","last_change":"2024-09-12T00:12:46.064357+0000","last_active":"2024-09-12T01:08:44.898434+0000","last_peered":"2024-09-12T01:08:44.898434+0000","last_clean":"2024-09-12T01:08:44.898434+0000","last_became_active":"2024-09-12T00:12:46.064058+0000","last_became_peered":"2024-09-12T00:12:46.064058+0000","last_unstale":"2024-09-12T01:08:44.898434+0000","last_undegraded":"2024-09-12T01:08:44.898434+0000","last_fullsized":"2024-09-12T01:08:44.898434+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:14.383616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":363,"num_read_kb":352,"num_write":596,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'133","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.128524+0000","last_change":"2024-09-12T00:12:38.045014+0000","last_active":"2024-09-12T01:06:50.128524+0000","last_peered":"2024-09-12T01:06:50.128524+0000","last_clean":"2024-09-12T01:06:50.128524+0000","last_became_active":"2024-09-12T00:12:38.044075+0000","last_became_peered":"2024-09-12T00:12:38.044075+0000","last_unstale":"2024-09-12T01:06:50.128524+0000","last_undegraded":"2024-09-12T01:06:50.128524+0000","last_fullsized":"2024-09-12T01:06:50.128524+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:39.495991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":484,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'327","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.693093+0000","last_change":"2024-09-12T00:12:36.031043+0000","last_active":"2024-09-12T01:07:42.693093+0000","last_peered":"2024-09-12T01:07:42.693093+0000","last_clean":"2024-09-12T01:07:42.693093+0000","last_became_active":"2024-09-12T00:12:36.030644+0000","last_became_peered":"2024-09-12T00:12:36.030644+0000","last_unstale":"2024-09-12T01:07:42.693093+0000","last_undegraded":"2024-09-12T01:07:42.693093+0000","last_fullsized":"2024-09-12T01:07:42.693093+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:31.856368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14276891,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":655,"num_read_kb":123114,"num_write":1162,"num_write_kb":49104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.048638+0000","last_change":"2024-09-12T00:12:24.720016+0000","last_active":"2024-09-12T01:08:45.048638+0000","last_peered":"2024-09-12T01:08:45.048638+0000","last_clean":"2024-09-12T01:08:45.048638+0000","last_became_active":"2024-09-12T00:12:22.875444+0000","last_became_peered":"2024-09-12T00:12:22.875444+0000","last_unstale":"2024-09-12T01:08:45.048638+0000","last_undegraded":"2024-09-12T01:08:45.048638+0000","last_fullsized":"2024-09-12T01:08:45.048638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:01.561555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001017387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'5","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.737689+0000","last_change":"2024-09-12T00:12:40.031664+0000","last_active":"2024-09-12T01:10:32.737689+0000","last_peered":"2024-09-12T01:10:32.737689+0000","last_clean":"2024-09-12T01:10:32.737689+0000","last_became_active":"2024-09-12T00:12:40.031382+0000","last_became_peered":"2024-09-12T00:12:40.031382+0000","last_unstale":"2024-09-12T01:10:32.737689+0000","last_undegraded":"2024-09-12T01:10:32.737689+0000","last_fullsized":"2024-09-12T01:10:32.737689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:43.398397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'715","reported_seq":1425,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.978409+0000","last_change":"2024-09-12T00:12:42.043628+0000","last_active":"2024-09-12T01:10:32.978409+0000","last_peered":"2024-09-12T01:10:32.978409+0000","last_clean":"2024-09-12T01:10:32.978409+0000","last_became_active":"2024-09-12T00:12:42.043328+0000","last_became_peered":"2024-09-12T00:12:42.043328+0000","last_unstale":"2024-09-12T01:10:32.978409+0000","last_undegraded":"2024-09-12T01:10:32.978409+0000","last_fullsized":"2024-09-12T01:10:32.978409+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:41.276102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174167,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1267,"num_read_kb":2700,"num_write":1040,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.036126+0000","last_change":"2024-09-12T00:12:44.062248+0000","last_active":"2024-09-12T01:06:55.036126+0000","last_peered":"2024-09-12T01:06:55.036126+0000","last_clean":"2024-09-12T01:06:55.036126+0000","last_became_active":"2024-09-12T00:12:44.061206+0000","last_became_peered":"2024-09-12T00:12:44.061206+0000","last_unstale":"2024-09-12T01:06:55.036126+0000","last_undegraded":"2024-09-12T01:06:55.036126+0000","last_fullsized":"2024-09-12T01:06:55.036126+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:28.838993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'95","reported_seq":588,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.128446+0000","last_change":"2024-09-12T00:12:46.058756+0000","last_active":"2024-09-12T01:09:23.128446+0000","last_peered":"2024-09-12T01:09:23.128446+0000","last_clean":"2024-09-12T01:09:23.128446+0000","last_became_active":"2024-09-12T00:12:46.058465+0000","last_became_peered":"2024-09-12T00:12:46.058465+0000","last_unstale":"2024-09-12T01:09:23.128446+0000","last_undegraded":"2024-09-12T01:09:23.128446+0000","last_fullsized":"2024-09-12T01:09:23.128446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:59.069997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":101,"num_write":234,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'139","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.693672+0000","last_change":"2024-09-12T00:12:46.063719+0000","last_active":"2024-09-12T01:10:31.693672+0000","last_peered":"2024-09-12T01:10:31.693672+0000","last_clean":"2024-09-12T01:10:31.693672+0000","last_became_active":"2024-09-12T00:12:46.063423+0000","last_became_peered":"2024-09-12T00:12:46.063423+0000","last_unstale":"2024-09-12T01:10:31.693672+0000","last_undegraded":"2024-09-12T01:10:31.693672+0000","last_fullsized":"2024-09-12T01:10:31.693672+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:35.174197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":252,"num_write":335,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'151","reported_seq":719,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:41.704952+0000","last_change":"2024-09-12T00:12:38.041953+0000","last_active":"2024-09-12T01:08:41.704952+0000","last_peered":"2024-09-12T01:08:41.704952+0000","last_clean":"2024-09-12T01:08:41.704952+0000","last_became_active":"2024-09-12T00:12:38.041665+0000","last_became_peered":"2024-09-12T00:12:38.041665+0000","last_unstale":"2024-09-12T01:08:41.704952+0000","last_undegraded":"2024-09-12T01:08:41.704952+0000","last_fullsized":"2024-09-12T01:08:41.704952+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:35.209960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":652,"num_read_kb":531,"num_write":244,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'240","reported_seq":873,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:24.214344+0000","last_change":"2024-09-12T00:13:07.152881+0000","last_active":"2024-09-12T01:10:24.214344+0000","last_peered":"2024-09-12T01:10:24.214344+0000","last_clean":"2024-09-12T01:10:24.214344+0000","last_became_active":"2024-09-12T00:13:07.152470+0000","last_became_peered":"2024-09-12T00:13:07.152470+0000","last_unstale":"2024-09-12T01:10:24.214344+0000","last_undegraded":"2024-09-12T01:10:24.214344+0000","last_fullsized":"2024-09-12T01:10:24.214344+0000","mapping_epoch":40,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:42.910204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11395301,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":377,"num_read_kb":19566,"num_write":854,"num_write_kb":20485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:20.148239+0000","last_change":"2024-09-12T00:12:40.038938+0000","last_active":"2024-09-12T01:06:20.148239+0000","last_peered":"2024-09-12T01:06:20.148239+0000","last_clean":"2024-09-12T01:06:20.148239+0000","last_became_active":"2024-09-12T00:12:40.038618+0000","last_became_peered":"2024-09-12T00:12:40.038618+0000","last_unstale":"2024-09-12T01:06:20.148239+0000","last_undegraded":"2024-09-12T01:06:20.148239+0000","last_fullsized":"2024-09-12T01:06:20.148239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:06.465719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'274","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.170957+0000","last_change":"2024-09-12T00:12:42.050190+0000","last_active":"2024-09-12T01:08:45.170957+0000","last_peered":"2024-09-12T01:08:45.170957+0000","last_clean":"2024-09-12T01:08:45.170957+0000","last_became_active":"2024-09-12T00:12:42.049685+0000","last_became_peered":"2024-09-12T00:12:42.049685+0000","last_unstale":"2024-09-12T01:08:45.170957+0000","last_undegraded":"2024-09-12T01:08:45.170957+0000","last_fullsized":"2024-09-12T01:08:45.170957+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:57.050916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54983,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":448,"num_read_kb":910,"num_write":362,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030516+0000","last_change":"2024-09-12T00:12:44.062762+0000","last_active":"2024-09-12T01:06:25.030516+0000","last_peered":"2024-09-12T01:06:25.030516+0000","last_clean":"2024-09-12T01:06:25.030516+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:06:25.030516+0000","last_undegraded":"2024-09-12T01:06:25.030516+0000","last_fullsized":"2024-09-12T01:06:25.030516+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:30.852996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.283120+0000","last_change":"2024-09-12T00:12:46.064377+0000","last_active":"2024-09-12T01:09:23.283120+0000","last_peered":"2024-09-12T01:09:23.283120+0000","last_clean":"2024-09-12T01:09:23.283120+0000","last_became_active":"2024-09-12T00:12:46.064080+0000","last_became_peered":"2024-09-12T00:12:46.064080+0000","last_unstale":"2024-09-12T01:09:23.283120+0000","last_undegraded":"2024-09-12T01:09:23.283120+0000","last_fullsized":"2024-09-12T01:09:23.283120+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:28.289493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":189,"num_write":302,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'148","reported_seq":739,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:20.029462+0000","last_change":"2024-09-12T00:12:38.045256+0000","last_active":"2024-09-12T01:06:20.029462+0000","last_peered":"2024-09-12T01:06:20.029462+0000","last_clean":"2024-09-12T01:06:20.029462+0000","last_became_active":"2024-09-12T00:12:38.044990+0000","last_became_peered":"2024-09-12T00:12:38.044990+0000","last_unstale":"2024-09-12T01:06:20.029462+0000","last_undegraded":"2024-09-12T01:06:20.029462+0000","last_fullsized":"2024-09-12T01:06:20.029462+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:23.380297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":701,"num_read_kb":570,"num_write":228,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'280","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:22.347456+0000","last_change":"2024-09-12T00:12:36.036464+0000","last_active":"2024-09-12T01:10:22.347456+0000","last_peered":"2024-09-12T01:10:22.347456+0000","last_clean":"2024-09-12T01:10:22.347456+0000","last_became_active":"2024-09-12T00:12:36.034816+0000","last_became_peered":"2024-09-12T00:12:36.034816+0000","last_unstale":"2024-09-12T01:10:22.347456+0000","last_undegraded":"2024-09-12T01:10:22.347456+0000","last_fullsized":"2024-09-12T01:10:22.347456+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:54.535251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28498,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":460,"num_read_kb":1836,"num_write":1098,"num_write_kb":16367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:20.029501+0000","last_change":"2024-09-12T00:12:40.042449+0000","last_active":"2024-09-12T01:06:20.029501+0000","last_peered":"2024-09-12T01:06:20.029501+0000","last_clean":"2024-09-12T01:06:20.029501+0000","last_became_active":"2024-09-12T00:12:40.042104+0000","last_became_peered":"2024-09-12T00:12:40.042104+0000","last_unstale":"2024-09-12T01:06:20.029501+0000","last_undegraded":"2024-09-12T01:06:20.029501+0000","last_fullsized":"2024-09-12T01:06:20.029501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:33.704187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'55","reported_seq":557,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:44.638948+0000","last_change":"2024-09-12T00:12:42.043918+0000","last_active":"2024-09-12T01:06:44.638948+0000","last_peered":"2024-09-12T01:06:44.638948+0000","last_clean":"2024-09-12T01:06:44.638948+0000","last_became_active":"2024-09-12T00:12:42.043599+0000","last_became_peered":"2024-09-12T00:12:42.043599+0000","last_unstale":"2024-09-12T01:06:44.638948+0000","last_undegraded":"2024-09-12T01:06:44.638948+0000","last_fullsized":"2024-09-12T01:06:44.638948+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:06.844583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.125476+0000","last_change":"2024-09-12T00:12:44.054488+0000","last_active":"2024-09-12T01:06:25.125476+0000","last_peered":"2024-09-12T01:06:25.125476+0000","last_clean":"2024-09-12T01:06:25.125476+0000","last_became_active":"2024-09-12T00:12:44.054145+0000","last_became_peered":"2024-09-12T00:12:44.054145+0000","last_unstale":"2024-09-12T01:06:25.125476+0000","last_undegraded":"2024-09-12T01:06:25.125476+0000","last_fullsized":"2024-09-12T01:06:25.125476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:04.106673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'200","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.568625+0000","last_change":"2024-09-12T00:12:46.059839+0000","last_active":"2024-09-12T01:09:22.568625+0000","last_peered":"2024-09-12T01:09:22.568625+0000","last_clean":"2024-09-12T01:09:22.568625+0000","last_became_active":"2024-09-12T00:12:46.059520+0000","last_became_peered":"2024-09-12T00:12:46.059520+0000","last_unstale":"2024-09-12T01:09:22.568625+0000","last_undegraded":"2024-09-12T01:09:22.568625+0000","last_fullsized":"2024-09-12T01:09:22.568625+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:17.663006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":406,"num_read_kb":365,"num_write":468,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'124","reported_seq":722,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.795658+0000","last_change":"2024-09-12T00:12:38.041224+0000","last_active":"2024-09-12T01:10:31.795658+0000","last_peered":"2024-09-12T01:10:31.795658+0000","last_clean":"2024-09-12T01:10:31.795658+0000","last_became_active":"2024-09-12T00:12:38.040948+0000","last_became_peered":"2024-09-12T00:12:38.040948+0000","last_unstale":"2024-09-12T01:10:31.795658+0000","last_undegraded":"2024-09-12T01:10:31.795658+0000","last_fullsized":"2024-09-12T01:10:31.795658+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:21.931055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":483,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'266","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:06.267240+0000","last_change":"2024-09-12T00:12:36.040361+0000","last_active":"2024-09-12T01:09:06.267240+0000","last_peered":"2024-09-12T01:09:06.267240+0000","last_clean":"2024-09-12T01:09:06.267240+0000","last_became_active":"2024-09-12T00:12:36.038823+0000","last_became_peered":"2024-09-12T00:12:36.038823+0000","last_unstale":"2024-09-12T01:09:06.267240+0000","last_undegraded":"2024-09-12T01:09:06.267240+0000","last_fullsized":"2024-09-12T01:09:06.267240+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:53.004387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4700810,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":480,"num_read_kb":31572,"num_write":1017,"num_write_kb":24420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:20.124794+0000","last_change":"2024-09-12T00:12:40.030750+0000","last_active":"2024-09-12T01:06:20.124794+0000","last_peered":"2024-09-12T01:06:20.124794+0000","last_clean":"2024-09-12T01:06:20.124794+0000","last_became_active":"2024-09-12T00:12:40.030447+0000","last_became_peered":"2024-09-12T00:12:40.030447+0000","last_unstale":"2024-09-12T01:06:20.124794+0000","last_undegraded":"2024-09-12T01:06:20.124794+0000","last_fullsized":"2024-09-12T01:06:20.124794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:19.640921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'324","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.054048+0000","last_change":"2024-09-12T00:12:42.051159+0000","last_active":"2024-09-12T01:08:45.054048+0000","last_peered":"2024-09-12T01:08:45.054048+0000","last_clean":"2024-09-12T01:08:45.054048+0000","last_became_active":"2024-09-12T00:12:42.050885+0000","last_became_peered":"2024-09-12T00:12:42.050885+0000","last_unstale":"2024-09-12T01:08:45.054048+0000","last_undegraded":"2024-09-12T01:08:45.054048+0000","last_fullsized":"2024-09-12T01:08:45.054048+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:07.994436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66063,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":533,"num_read_kb":1077,"num_write":432,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.226242+0000","last_change":"2024-09-12T00:12:44.056404+0000","last_active":"2024-09-12T01:06:25.226242+0000","last_peered":"2024-09-12T01:06:25.226242+0000","last_clean":"2024-09-12T01:06:25.226242+0000","last_became_active":"2024-09-12T00:12:44.056032+0000","last_became_peered":"2024-09-12T00:12:44.056032+0000","last_unstale":"2024-09-12T01:06:25.226242+0000","last_undegraded":"2024-09-12T01:06:25.226242+0000","last_fullsized":"2024-09-12T01:06:25.226242+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:26.625201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'121","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.354255+0000","last_change":"2024-09-12T00:12:46.063983+0000","last_active":"2024-09-12T01:08:28.354255+0000","last_peered":"2024-09-12T01:08:28.354255+0000","last_clean":"2024-09-12T01:08:28.354255+0000","last_became_active":"2024-09-12T00:12:46.063700+0000","last_became_peered":"2024-09-12T00:12:46.063700+0000","last_unstale":"2024-09-12T01:08:28.354255+0000","last_undegraded":"2024-09-12T01:08:28.354255+0000","last_fullsized":"2024-09-12T01:08:28.354255+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:48.139495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'4185","reported_seq":4809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:56.751537+0000","last_change":"2024-09-12T00:12:38.042946+0000","last_active":"2024-09-12T01:06:56.751537+0000","last_peered":"2024-09-12T01:06:56.751537+0000","last_clean":"2024-09-12T01:06:56.751537+0000","last_became_active":"2024-09-12T00:12:38.042680+0000","last_became_peered":"2024-09-12T00:12:38.042680+0000","last_unstale":"2024-09-12T01:06:56.751537+0000","last_undegraded":"2024-09-12T01:06:56.751537+0000","last_fullsized":"2024-09-12T01:06:56.751537+0000","mapping_epoch":29,"log_start":"263'4100","ondisk_log_start":"263'4100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":3000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:46.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16870,"num_read_kb":14146,"num_write":6296,"num_write_kb":3134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'308","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:38.068919+0000","last_change":"2024-09-12T00:12:36.034607+0000","last_active":"2024-09-12T01:10:38.068919+0000","last_peered":"2024-09-12T01:10:38.068919+0000","last_clean":"2024-09-12T01:10:38.068919+0000","last_became_active":"2024-09-12T00:12:36.034292+0000","last_became_peered":"2024-09-12T00:12:36.034292+0000","last_unstale":"2024-09-12T01:10:38.068919+0000","last_undegraded":"2024-09-12T01:10:38.068919+0000","last_fullsized":"2024-09-12T01:10:38.068919+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:00.939504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3147581,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":507,"num_read_kb":3622,"num_write":1211,"num_write_kb":13483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:20.031760+0000","last_change":"2024-09-12T00:12:40.038541+0000","last_active":"2024-09-12T01:06:20.031760+0000","last_peered":"2024-09-12T01:06:20.031760+0000","last_clean":"2024-09-12T01:06:20.031760+0000","last_became_active":"2024-09-12T00:12:40.038192+0000","last_became_peered":"2024-09-12T00:12:40.038192+0000","last_unstale":"2024-09-12T01:06:20.031760+0000","last_undegraded":"2024-09-12T01:06:20.031760+0000","last_fullsized":"2024-09-12T01:06:20.031760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:28.217627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'252","reported_seq":812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.035032+0000","last_change":"2024-09-12T00:12:42.046891+0000","last_active":"2024-09-12T01:08:45.035032+0000","last_peered":"2024-09-12T01:08:45.035032+0000","last_clean":"2024-09-12T01:08:45.035032+0000","last_became_active":"2024-09-12T00:12:42.046589+0000","last_became_peered":"2024-09-12T00:12:42.046589+0000","last_unstale":"2024-09-12T01:08:45.035032+0000","last_undegraded":"2024-09-12T01:08:45.035032+0000","last_fullsized":"2024-09-12T01:08:45.035032+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:54.242811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":423,"num_read_kb":898,"num_write":346,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030598+0000","last_change":"2024-09-12T00:12:44.057887+0000","last_active":"2024-09-12T01:06:25.030598+0000","last_peered":"2024-09-12T01:06:25.030598+0000","last_clean":"2024-09-12T01:06:25.030598+0000","last_became_active":"2024-09-12T00:12:44.057606+0000","last_became_peered":"2024-09-12T00:12:44.057606+0000","last_unstale":"2024-09-12T01:06:25.030598+0000","last_undegraded":"2024-09-12T01:06:25.030598+0000","last_fullsized":"2024-09-12T01:06:25.030598+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:25.314359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'180","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035343+0000","last_change":"2024-09-12T00:12:38.047826+0000","last_active":"2024-09-12T01:06:50.035343+0000","last_peered":"2024-09-12T01:06:50.035343+0000","last_clean":"2024-09-12T01:06:50.035343+0000","last_became_active":"2024-09-12T00:12:38.047545+0000","last_became_peered":"2024-09-12T00:12:38.047545+0000","last_unstale":"2024-09-12T01:06:50.035343+0000","last_undegraded":"2024-09-12T01:06:50.035343+0000","last_fullsized":"2024-09-12T01:06:50.035343+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:27.324611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":815,"num_read_kb":702,"num_write":306,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'263","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:38.068757+0000","last_change":"2024-09-12T00:12:36.043322+0000","last_active":"2024-09-12T01:10:38.068757+0000","last_peered":"2024-09-12T01:10:38.068757+0000","last_clean":"2024-09-12T01:10:38.068757+0000","last_became_active":"2024-09-12T00:12:36.042983+0000","last_became_peered":"2024-09-12T00:12:36.042983+0000","last_unstale":"2024-09-12T01:10:38.068757+0000","last_undegraded":"2024-09-12T01:10:38.068757+0000","last_fullsized":"2024-09-12T01:10:38.068757+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:32.011867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4217616,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":408,"num_read_kb":13747,"num_write":994,"num_write_kb":22365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.171772+0000","last_change":"2024-09-12T00:12:40.039966+0000","last_active":"2024-09-12T01:08:50.171772+0000","last_peered":"2024-09-12T01:08:50.171772+0000","last_clean":"2024-09-12T01:08:50.171772+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:08:50.171772+0000","last_undegraded":"2024-09-12T01:08:50.171772+0000","last_fullsized":"2024-09-12T01:08:50.171772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:12.418930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'488","reported_seq":1109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.975100+0000","last_change":"2024-09-12T00:12:42.050774+0000","last_active":"2024-09-12T01:10:32.975100+0000","last_peered":"2024-09-12T01:10:32.975100+0000","last_clean":"2024-09-12T01:10:32.975100+0000","last_became_active":"2024-09-12T00:12:42.050479+0000","last_became_peered":"2024-09-12T00:12:42.050479+0000","last_unstale":"2024-09-12T01:10:32.975100+0000","last_undegraded":"2024-09-12T01:10:32.975100+0000","last_fullsized":"2024-09-12T01:10:32.975100+0000","mapping_epoch":33,"log_start":"263'400","ondisk_log_start":"263'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:54.813408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128116,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":872,"num_read_kb":1889,"num_write":762,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.134850+0000","last_change":"2024-09-12T00:12:44.061802+0000","last_active":"2024-09-12T01:07:45.134850+0000","last_peered":"2024-09-12T01:07:45.134850+0000","last_clean":"2024-09-12T01:07:45.134850+0000","last_became_active":"2024-09-12T00:12:44.061554+0000","last_became_peered":"2024-09-12T00:12:44.061554+0000","last_unstale":"2024-09-12T01:07:45.134850+0000","last_undegraded":"2024-09-12T01:07:45.134850+0000","last_fullsized":"2024-09-12T01:07:45.134850+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:41.354262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'159","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.539630+0000","last_change":"2024-09-12T00:12:46.062051+0000","last_active":"2024-09-12T01:09:22.539630+0000","last_peered":"2024-09-12T01:09:22.539630+0000","last_clean":"2024-09-12T01:09:22.539630+0000","last_became_active":"2024-09-12T00:12:46.061727+0000","last_became_peered":"2024-09-12T00:12:46.061727+0000","last_unstale":"2024-09-12T01:09:22.539630+0000","last_undegraded":"2024-09-12T01:09:22.539630+0000","last_fullsized":"2024-09-12T01:09:22.539630+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.660864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":216,"num_write":366,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'66","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.302716+0000","last_change":"2024-09-12T00:12:38.040768+0000","last_active":"2024-09-12T01:09:23.302716+0000","last_peered":"2024-09-12T01:09:23.302716+0000","last_clean":"2024-09-12T01:09:23.302716+0000","last_became_active":"2024-09-12T00:12:38.040282+0000","last_became_peered":"2024-09-12T00:12:38.040282+0000","last_unstale":"2024-09-12T01:09:23.302716+0000","last_undegraded":"2024-09-12T01:09:23.302716+0000","last_fullsized":"2024-09-12T01:09:23.302716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:50.542495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":276,"num_write":85,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'280","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.148373+0000","last_change":"2024-09-12T00:12:36.032117+0000","last_active":"2024-09-12T01:08:36.148373+0000","last_peered":"2024-09-12T01:08:36.148373+0000","last_clean":"2024-09-12T01:08:36.148373+0000","last_became_active":"2024-09-12T00:12:36.031081+0000","last_became_peered":"2024-09-12T00:12:36.031081+0000","last_unstale":"2024-09-12T01:08:36.148373+0000","last_undegraded":"2024-09-12T01:08:36.148373+0000","last_fullsized":"2024-09-12T01:08:36.148373+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:31.633755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15053181,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":554,"num_read_kb":88549,"num_write":1010,"num_write_kb":46090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.128624+0000","last_change":"2024-09-12T00:12:40.037157+0000","last_active":"2024-09-12T01:06:50.128624+0000","last_peered":"2024-09-12T01:06:50.128624+0000","last_clean":"2024-09-12T01:06:50.128624+0000","last_became_active":"2024-09-12T00:12:40.036842+0000","last_became_peered":"2024-09-12T00:12:40.036842+0000","last_unstale":"2024-09-12T01:06:50.128624+0000","last_undegraded":"2024-09-12T01:06:50.128624+0000","last_fullsized":"2024-09-12T01:06:50.128624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:07.662805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'294","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:15.060093+0000","last_change":"2024-09-12T00:12:42.044141+0000","last_active":"2024-09-12T01:10:15.060093+0000","last_peered":"2024-09-12T01:10:15.060093+0000","last_clean":"2024-09-12T01:10:15.060093+0000","last_became_active":"2024-09-12T00:12:42.043681+0000","last_became_peered":"2024-09-12T00:12:42.043681+0000","last_unstale":"2024-09-12T01:10:15.060093+0000","last_undegraded":"2024-09-12T01:10:15.060093+0000","last_fullsized":"2024-09-12T01:10:15.060093+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:57.312003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61267,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":489,"num_read_kb":964,"num_write":408,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042934+0000","last_change":"2024-09-12T00:12:44.058909+0000","last_active":"2024-09-12T01:07:48.042934+0000","last_peered":"2024-09-12T01:07:48.042934+0000","last_clean":"2024-09-12T01:07:48.042934+0000","last_became_active":"2024-09-12T00:12:44.058542+0000","last_became_peered":"2024-09-12T00:12:44.058542+0000","last_unstale":"2024-09-12T01:07:48.042934+0000","last_undegraded":"2024-09-12T01:07:48.042934+0000","last_fullsized":"2024-09-12T01:07:48.042934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:44.072219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'190","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.032970+0000","last_change":"2024-09-12T00:12:46.063225+0000","last_active":"2024-09-12T01:06:30.032970+0000","last_peered":"2024-09-12T01:06:30.032970+0000","last_clean":"2024-09-12T01:06:30.032970+0000","last_became_active":"2024-09-12T00:12:46.062957+0000","last_became_peered":"2024-09-12T00:12:46.062957+0000","last_unstale":"2024-09-12T01:06:30.032970+0000","last_undegraded":"2024-09-12T01:06:30.032970+0000","last_fullsized":"2024-09-12T01:06:30.032970+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.650377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":323,"num_read_kb":295,"num_write":565,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'204","reported_seq":789,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043832+0000","last_change":"2024-09-12T00:12:38.046033+0000","last_active":"2024-09-12T01:07:40.043832+0000","last_peered":"2024-09-12T01:07:40.043832+0000","last_clean":"2024-09-12T01:07:40.043832+0000","last_became_active":"2024-09-12T00:12:38.045576+0000","last_became_peered":"2024-09-12T00:12:38.045576+0000","last_unstale":"2024-09-12T01:07:40.043832+0000","last_undegraded":"2024-09-12T01:07:40.043832+0000","last_fullsized":"2024-09-12T01:07:40.043832+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:34.974243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":691,"num_write":313,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'299","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.862932+0000","last_change":"2024-09-12T00:12:36.036793+0000","last_active":"2024-09-12T01:08:16.862932+0000","last_peered":"2024-09-12T01:08:16.862932+0000","last_clean":"2024-09-12T01:08:16.862932+0000","last_became_active":"2024-09-12T00:12:36.036446+0000","last_became_peered":"2024-09-12T00:12:36.036446+0000","last_unstale":"2024-09-12T01:08:16.862932+0000","last_undegraded":"2024-09-12T01:08:16.862932+0000","last_fullsized":"2024-09-12T01:08:16.862932+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:19.859949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585124,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":567,"num_read_kb":64541,"num_write":1132,"num_write_kb":11770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134208+0000","last_change":"2024-09-12T00:12:40.030166+0000","last_active":"2024-09-12T01:07:40.134208+0000","last_peered":"2024-09-12T01:07:40.134208+0000","last_clean":"2024-09-12T01:07:40.134208+0000","last_became_active":"2024-09-12T00:12:40.029908+0000","last_became_peered":"2024-09-12T00:12:40.029908+0000","last_unstale":"2024-09-12T01:07:40.134208+0000","last_undegraded":"2024-09-12T01:07:40.134208+0000","last_fullsized":"2024-09-12T01:07:40.134208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:24.945019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'274","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.173460+0000","last_change":"2024-09-12T00:12:42.050883+0000","last_active":"2024-09-12T01:09:00.173460+0000","last_peered":"2024-09-12T01:09:00.173460+0000","last_clean":"2024-09-12T01:09:00.173460+0000","last_became_active":"2024-09-12T00:12:42.050599+0000","last_became_peered":"2024-09-12T00:12:42.050599+0000","last_unstale":"2024-09-12T01:09:00.173460+0000","last_undegraded":"2024-09-12T01:09:00.173460+0000","last_fullsized":"2024-09-12T01:09:00.173460+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:27.986140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52033,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":431,"num_read_kb":854,"num_write":348,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.055691+0000","last_change":"2024-09-12T00:12:44.062691+0000","last_active":"2024-09-12T01:08:55.055691+0000","last_peered":"2024-09-12T01:08:55.055691+0000","last_clean":"2024-09-12T01:08:55.055691+0000","last_became_active":"2024-09-12T00:12:44.062419+0000","last_became_peered":"2024-09-12T00:12:44.062419+0000","last_unstale":"2024-09-12T01:08:55.055691+0000","last_undegraded":"2024-09-12T01:08:55.055691+0000","last_fullsized":"2024-09-12T01:08:55.055691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.349610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'183","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.002642+0000","last_change":"2024-09-12T00:12:46.067271+0000","last_active":"2024-09-12T01:10:33.002642+0000","last_peered":"2024-09-12T01:10:33.002642+0000","last_clean":"2024-09-12T01:10:33.002642+0000","last_became_active":"2024-09-12T00:12:46.066977+0000","last_became_peered":"2024-09-12T00:12:46.066977+0000","last_unstale":"2024-09-12T01:10:33.002642+0000","last_undegraded":"2024-09-12T01:10:33.002642+0000","last_fullsized":"2024-09-12T01:10:33.002642+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:28.610163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":141,"num_write":422,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'58","reported_seq":591,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043831+0000","last_change":"2024-09-12T00:12:38.044154+0000","last_active":"2024-09-12T01:07:40.043831+0000","last_peered":"2024-09-12T01:07:40.043831+0000","last_clean":"2024-09-12T01:07:40.043831+0000","last_became_active":"2024-09-12T00:12:38.043886+0000","last_became_peered":"2024-09-12T00:12:38.043886+0000","last_unstale":"2024-09-12T01:07:40.043831+0000","last_undegraded":"2024-09-12T01:07:40.043831+0000","last_fullsized":"2024-09-12T01:07:40.043831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:23.214032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":197,"num_write":99,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'292","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043756+0000","last_change":"2024-09-12T00:12:36.031024+0000","last_active":"2024-09-12T01:07:40.043756+0000","last_peered":"2024-09-12T01:07:40.043756+0000","last_clean":"2024-09-12T01:07:40.043756+0000","last_became_active":"2024-09-12T00:12:36.030663+0000","last_became_peered":"2024-09-12T00:12:36.030663+0000","last_unstale":"2024-09-12T01:07:40.043756+0000","last_undegraded":"2024-09-12T01:07:40.043756+0000","last_fullsized":"2024-09-12T01:07:40.043756+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:04.337764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5821370,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":420,"num_read_kb":3753,"num_write":1037,"num_write_kb":36132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043857+0000","last_change":"2024-09-12T00:12:40.040334+0000","last_active":"2024-09-12T01:07:40.043857+0000","last_peered":"2024-09-12T01:07:40.043857+0000","last_clean":"2024-09-12T01:07:40.043857+0000","last_became_active":"2024-09-12T00:12:40.040095+0000","last_became_peered":"2024-09-12T00:12:40.040095+0000","last_unstale":"2024-09-12T01:07:40.043857+0000","last_undegraded":"2024-09-12T01:07:40.043857+0000","last_fullsized":"2024-09-12T01:07:40.043857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:14.746788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'104","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.036577+0000","last_change":"2024-09-12T00:12:42.043827+0000","last_active":"2024-09-12T01:07:00.036577+0000","last_peered":"2024-09-12T01:07:00.036577+0000","last_clean":"2024-09-12T01:07:00.036577+0000","last_became_active":"2024-09-12T00:12:42.043492+0000","last_became_peered":"2024-09-12T00:12:42.043492+0000","last_unstale":"2024-09-12T01:07:00.036577+0000","last_undegraded":"2024-09-12T01:07:00.036577+0000","last_fullsized":"2024-09-12T01:07:00.036577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:42.505398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":110,"num_read_kb":100,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'762","reported_seq":2171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.876777+0000","last_change":"2024-09-12T00:12:44.054520+0000","last_active":"2024-09-12T01:10:35.876777+0000","last_peered":"2024-09-12T01:10:35.876777+0000","last_clean":"2024-09-12T01:10:35.876777+0000","last_became_active":"2024-09-12T00:12:44.054237+0000","last_became_peered":"2024-09-12T00:12:44.054237+0000","last_unstale":"2024-09-12T01:10:35.876777+0000","last_undegraded":"2024-09-12T01:10:35.876777+0000","last_fullsized":"2024-09-12T01:10:35.876777+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:52.613881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'121","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.977988+0000","last_change":"2024-09-12T00:12:46.061987+0000","last_active":"2024-09-12T01:08:19.977988+0000","last_peered":"2024-09-12T01:08:19.977988+0000","last_clean":"2024-09-12T01:08:19.977988+0000","last_became_active":"2024-09-12T00:12:46.061673+0000","last_became_peered":"2024-09-12T00:12:46.061673+0000","last_unstale":"2024-09-12T01:08:19.977988+0000","last_undegraded":"2024-09-12T01:08:19.977988+0000","last_fullsized":"2024-09-12T01:08:19.977988+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:08.970829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'432","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134186+0000","last_change":"2024-09-12T00:12:38.029773+0000","last_active":"2024-09-12T01:07:40.134186+0000","last_peered":"2024-09-12T01:07:40.134186+0000","last_clean":"2024-09-12T01:07:40.134186+0000","last_became_active":"2024-09-12T00:12:38.029483+0000","last_became_peered":"2024-09-12T00:12:38.029483+0000","last_unstale":"2024-09-12T01:07:40.134186+0000","last_undegraded":"2024-09-12T01:07:40.134186+0000","last_fullsized":"2024-09-12T01:07:40.134186+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:54.184567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1848,"num_read_kb":1460,"num_write":651,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'281","reported_seq":888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.671067+0000","last_change":"2024-09-12T00:12:36.034572+0000","last_active":"2024-09-12T01:08:45.671067+0000","last_peered":"2024-09-12T01:08:45.671067+0000","last_clean":"2024-09-12T01:08:45.671067+0000","last_became_active":"2024-09-12T00:12:36.034259+0000","last_became_peered":"2024-09-12T00:12:36.034259+0000","last_unstale":"2024-09-12T01:08:45.671067+0000","last_undegraded":"2024-09-12T01:08:45.671067+0000","last_fullsized":"2024-09-12T01:08:45.671067+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:05.093712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12586058,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":373,"num_read_kb":12694,"num_write":997,"num_write_kb":34924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.234299+0000","last_change":"2024-09-12T00:12:40.034568+0000","last_active":"2024-09-12T01:07:40.234299+0000","last_peered":"2024-09-12T01:07:40.234299+0000","last_clean":"2024-09-12T01:07:40.234299+0000","last_became_active":"2024-09-12T00:12:40.034301+0000","last_became_peered":"2024-09-12T00:12:40.034301+0000","last_unstale":"2024-09-12T01:07:40.234299+0000","last_undegraded":"2024-09-12T01:07:40.234299+0000","last_fullsized":"2024-09-12T01:07:40.234299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:22.089148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'362","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.033947+0000","last_change":"2024-09-12T00:12:42.044477+0000","last_active":"2024-09-12T01:08:35.033947+0000","last_peered":"2024-09-12T01:08:35.033947+0000","last_clean":"2024-09-12T01:08:35.033947+0000","last_became_active":"2024-09-12T00:12:42.044154+0000","last_became_peered":"2024-09-12T00:12:42.044154+0000","last_unstale":"2024-09-12T01:08:35.033947+0000","last_undegraded":"2024-09-12T01:08:35.033947+0000","last_fullsized":"2024-09-12T01:08:35.033947+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:59.538243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56321,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":548,"num_read_kb":1028,"num_write":448,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.049637+0000","last_change":"2024-09-12T00:12:44.060009+0000","last_active":"2024-09-12T01:08:20.049637+0000","last_peered":"2024-09-12T01:08:20.049637+0000","last_clean":"2024-09-12T01:08:20.049637+0000","last_became_active":"2024-09-12T00:12:44.059671+0000","last_became_peered":"2024-09-12T00:12:44.059671+0000","last_unstale":"2024-09-12T01:08:20.049637+0000","last_undegraded":"2024-09-12T01:08:20.049637+0000","last_fullsized":"2024-09-12T01:08:20.049637+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:58.980993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'125","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.596906+0000","last_change":"2024-09-12T00:12:46.067043+0000","last_active":"2024-09-12T01:09:20.596906+0000","last_peered":"2024-09-12T01:09:20.596906+0000","last_clean":"2024-09-12T01:09:20.596906+0000","last_became_active":"2024-09-12T00:12:46.066777+0000","last_became_peered":"2024-09-12T00:12:46.066777+0000","last_unstale":"2024-09-12T01:09:20.596906+0000","last_undegraded":"2024-09-12T01:09:20.596906+0000","last_fullsized":"2024-09-12T01:09:20.596906+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:01.876836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":239,"num_read_kb":208,"num_write":345,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'510","reported_seq":1326,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134147+0000","last_change":"2024-09-12T00:12:38.040248+0000","last_active":"2024-09-12T01:07:40.134147+0000","last_peered":"2024-09-12T01:07:40.134147+0000","last_clean":"2024-09-12T01:07:40.134147+0000","last_became_active":"2024-09-12T00:12:38.039996+0000","last_became_peered":"2024-09-12T00:12:38.039996+0000","last_unstale":"2024-09-12T01:07:40.134147+0000","last_undegraded":"2024-09-12T01:07:40.134147+0000","last_fullsized":"2024-09-12T01:07:40.134147+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:17.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2706,"num_read_kb":2334,"num_write":934,"num_write_kb":583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'236","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.041111+0000","last_change":"2024-09-12T00:12:36.030460+0000","last_active":"2024-09-12T01:07:40.041111+0000","last_peered":"2024-09-12T01:07:40.041111+0000","last_clean":"2024-09-12T01:07:40.041111+0000","last_became_active":"2024-09-12T00:12:36.029998+0000","last_became_peered":"2024-09-12T00:12:36.029998+0000","last_unstale":"2024-09-12T01:07:40.041111+0000","last_undegraded":"2024-09-12T01:07:40.041111+0000","last_fullsized":"2024-09-12T01:07:40.041111+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:09.569791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7665422,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":502,"num_read_kb":3980,"num_write":861,"num_write_kb":28798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134195+0000","last_change":"2024-09-12T00:12:40.039109+0000","last_active":"2024-09-12T01:07:40.134195+0000","last_peered":"2024-09-12T01:07:40.134195+0000","last_clean":"2024-09-12T01:07:40.134195+0000","last_became_active":"2024-09-12T00:12:40.038037+0000","last_became_peered":"2024-09-12T00:12:40.038037+0000","last_unstale":"2024-09-12T01:07:40.134195+0000","last_undegraded":"2024-09-12T01:07:40.134195+0000","last_fullsized":"2024-09-12T01:07:40.134195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:11.329535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'279","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.967924+0000","last_change":"2024-09-12T00:12:42.047201+0000","last_active":"2024-09-12T01:10:32.967924+0000","last_peered":"2024-09-12T01:10:32.967924+0000","last_clean":"2024-09-12T01:10:32.967924+0000","last_became_active":"2024-09-12T00:12:42.046917+0000","last_became_peered":"2024-09-12T00:12:42.046917+0000","last_unstale":"2024-09-12T01:10:32.967924+0000","last_undegraded":"2024-09-12T01:10:32.967924+0000","last_fullsized":"2024-09-12T01:10:32.967924+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:26.130504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65113,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":999,"num_write":394,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:10.030149+0000","last_change":"2024-09-12T00:12:44.058423+0000","last_active":"2024-09-12T01:06:10.030149+0000","last_peered":"2024-09-12T01:06:10.030149+0000","last_clean":"2024-09-12T01:06:10.030149+0000","last_became_active":"2024-09-12T00:12:44.058006+0000","last_became_peered":"2024-09-12T00:12:44.058006+0000","last_unstale":"2024-09-12T01:06:10.030149+0000","last_undegraded":"2024-09-12T01:06:10.030149+0000","last_fullsized":"2024-09-12T01:06:10.030149+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:01.738470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'117","reported_seq":622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.048235+0000","last_change":"2024-09-12T00:12:46.065323+0000","last_active":"2024-09-12T01:08:23.048235+0000","last_peered":"2024-09-12T01:08:23.048235+0000","last_clean":"2024-09-12T01:08:23.048235+0000","last_became_active":"2024-09-12T00:12:46.064988+0000","last_became_peered":"2024-09-12T00:12:46.064988+0000","last_unstale":"2024-09-12T01:08:23.048235+0000","last_undegraded":"2024-09-12T01:08:23.048235+0000","last_fullsized":"2024-09-12T01:08:23.048235+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:07.524788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":147,"num_write":261,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'320","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.050462+0000","last_change":"2024-09-12T00:12:38.042896+0000","last_active":"2024-09-12T01:08:25.050462+0000","last_peered":"2024-09-12T01:08:25.050462+0000","last_clean":"2024-09-12T01:08:25.050462+0000","last_became_active":"2024-09-12T00:12:38.042565+0000","last_became_peered":"2024-09-12T00:12:38.042565+0000","last_unstale":"2024-09-12T01:08:25.050462+0000","last_undegraded":"2024-09-12T01:08:25.050462+0000","last_fullsized":"2024-09-12T01:08:25.050462+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:20.595221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1481,"num_read_kb":1253,"num_write":527,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'304","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.953367+0000","last_change":"2024-09-12T00:12:36.042891+0000","last_active":"2024-09-12T01:10:57.953367+0000","last_peered":"2024-09-12T01:10:57.953367+0000","last_clean":"2024-09-12T01:10:57.953367+0000","last_became_active":"2024-09-12T00:12:36.042198+0000","last_became_peered":"2024-09-12T00:12:36.042198+0000","last_unstale":"2024-09-12T01:10:57.953367+0000","last_undegraded":"2024-09-12T01:10:57.953367+0000","last_fullsized":"2024-09-12T01:10:57.953367+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:27.004848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13171441,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":436,"num_read_kb":61057,"num_write":1068,"num_write_kb":53442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.237962+0000","last_change":"2024-09-12T00:12:40.032609+0000","last_active":"2024-09-12T01:08:15.237962+0000","last_peered":"2024-09-12T01:08:15.237962+0000","last_clean":"2024-09-12T01:08:15.237962+0000","last_became_active":"2024-09-12T00:12:40.032284+0000","last_became_peered":"2024-09-12T00:12:40.032284+0000","last_unstale":"2024-09-12T01:08:15.237962+0000","last_undegraded":"2024-09-12T01:08:15.237962+0000","last_fullsized":"2024-09-12T01:08:15.237962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:20.113080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'252","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:15.184391+0000","last_change":"2024-09-12T00:12:42.051390+0000","last_active":"2024-09-12T01:10:15.184391+0000","last_peered":"2024-09-12T01:10:15.184391+0000","last_clean":"2024-09-12T01:10:15.184391+0000","last_became_active":"2024-09-12T00:12:42.051133+0000","last_became_peered":"2024-09-12T00:12:42.051133+0000","last_unstale":"2024-09-12T01:10:15.184391+0000","last_undegraded":"2024-09-12T01:10:15.184391+0000","last_fullsized":"2024-09-12T01:10:15.184391+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:39.225249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63093,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":413,"num_read_kb":906,"num_write":346,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041676+0000","last_change":"2024-09-12T00:12:44.060747+0000","last_active":"2024-09-12T01:07:45.041676+0000","last_peered":"2024-09-12T01:07:45.041676+0000","last_clean":"2024-09-12T01:07:45.041676+0000","last_became_active":"2024-09-12T00:12:44.060464+0000","last_became_peered":"2024-09-12T00:12:44.060464+0000","last_unstale":"2024-09-12T01:07:45.041676+0000","last_undegraded":"2024-09-12T01:07:45.041676+0000","last_fullsized":"2024-09-12T01:07:45.041676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:56.068981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'150","reported_seq":1608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.570464+0000","last_change":"2024-09-12T00:12:46.064822+0000","last_active":"2024-09-12T01:09:20.570464+0000","last_peered":"2024-09-12T01:09:20.570464+0000","last_clean":"2024-09-12T01:09:20.570464+0000","last_became_active":"2024-09-12T00:12:46.064565+0000","last_became_peered":"2024-09-12T00:12:46.064565+0000","last_unstale":"2024-09-12T01:09:20.570464+0000","last_undegraded":"2024-09-12T01:09:20.570464+0000","last_fullsized":"2024-09-12T01:09:20.570464+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:23.873971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1152,"num_read_kb":1150,"num_write":337,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'89","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.137995+0000","last_change":"2024-09-12T00:12:38.038149+0000","last_active":"2024-09-12T01:08:15.137995+0000","last_peered":"2024-09-12T01:08:15.137995+0000","last_clean":"2024-09-12T01:08:15.137995+0000","last_became_active":"2024-09-12T00:12:38.037860+0000","last_became_peered":"2024-09-12T00:12:38.037860+0000","last_unstale":"2024-09-12T01:08:15.137995+0000","last_undegraded":"2024-09-12T01:08:15.137995+0000","last_fullsized":"2024-09-12T01:08:15.137995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:24.535343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":333,"num_write":131,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'255","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.053092+0000","last_change":"2024-09-12T00:12:36.042368+0000","last_active":"2024-09-12T01:08:53.053092+0000","last_peered":"2024-09-12T01:08:53.053092+0000","last_clean":"2024-09-12T01:08:53.053092+0000","last_became_active":"2024-09-12T00:12:36.041860+0000","last_became_peered":"2024-09-12T00:12:36.041860+0000","last_unstale":"2024-09-12T01:08:53.053092+0000","last_undegraded":"2024-09-12T01:08:53.053092+0000","last_fullsized":"2024-09-12T01:08:53.053092+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:01.561434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6163646,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":308,"num_read_kb":7017,"num_write":926,"num_write_kb":36211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"32'1","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.050491+0000","last_change":"2024-09-12T00:12:40.039492+0000","last_active":"2024-09-12T01:08:25.050491+0000","last_peered":"2024-09-12T01:08:25.050491+0000","last_clean":"2024-09-12T01:08:25.050491+0000","last_became_active":"2024-09-12T00:12:40.039196+0000","last_became_peered":"2024-09-12T00:12:40.039196+0000","last_unstale":"2024-09-12T01:08:25.050491+0000","last_undegraded":"2024-09-12T01:08:25.050491+0000","last_fullsized":"2024-09-12T01:08:25.050491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:03.281450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'339","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:15.060054+0000","last_change":"2024-09-12T00:12:42.039343+0000","last_active":"2024-09-12T01:10:15.060054+0000","last_peered":"2024-09-12T01:10:15.060054+0000","last_clean":"2024-09-12T01:10:15.060054+0000","last_became_active":"2024-09-12T00:12:42.039068+0000","last_became_peered":"2024-09-12T00:12:42.039068+0000","last_unstale":"2024-09-12T01:10:15.060054+0000","last_undegraded":"2024-09-12T01:10:15.060054+0000","last_fullsized":"2024-09-12T01:10:15.060054+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:19.273390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57499,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":1035,"num_write":436,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044483+0000","last_change":"2024-09-12T00:12:44.064609+0000","last_active":"2024-09-12T01:07:45.044483+0000","last_peered":"2024-09-12T01:07:45.044483+0000","last_clean":"2024-09-12T01:07:45.044483+0000","last_became_active":"2024-09-12T00:12:44.064105+0000","last_became_peered":"2024-09-12T00:12:44.064105+0000","last_unstale":"2024-09-12T01:07:45.044483+0000","last_undegraded":"2024-09-12T01:07:45.044483+0000","last_fullsized":"2024-09-12T01:07:45.044483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:34.680066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'146","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.794252+0000","last_change":"2024-09-12T00:12:46.054136+0000","last_active":"2024-09-12T01:10:31.794252+0000","last_peered":"2024-09-12T01:10:31.794252+0000","last_clean":"2024-09-12T01:10:31.794252+0000","last_became_active":"2024-09-12T00:12:46.053763+0000","last_became_peered":"2024-09-12T00:12:46.053763+0000","last_unstale":"2024-09-12T01:10:31.794252+0000","last_undegraded":"2024-09-12T01:10:31.794252+0000","last_fullsized":"2024-09-12T01:10:31.794252+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:31.432295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":382,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'137","reported_seq":721,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.975539+0000","last_change":"2024-09-12T00:12:38.044545+0000","last_active":"2024-09-12T01:08:19.975539+0000","last_peered":"2024-09-12T01:08:19.975539+0000","last_clean":"2024-09-12T01:08:19.975539+0000","last_became_active":"2024-09-12T00:12:38.044285+0000","last_became_peered":"2024-09-12T00:12:38.044285+0000","last_unstale":"2024-09-12T01:08:19.975539+0000","last_undegraded":"2024-09-12T01:08:19.975539+0000","last_fullsized":"2024-09-12T01:08:19.975539+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:05.907607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":475,"num_write":234,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'325","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.128500+0000","last_change":"2024-09-12T00:12:36.037087+0000","last_active":"2024-09-12T01:06:50.128500+0000","last_peered":"2024-09-12T01:06:50.128500+0000","last_clean":"2024-09-12T01:06:50.128500+0000","last_became_active":"2024-09-12T00:12:36.036773+0000","last_became_peered":"2024-09-12T00:12:36.036773+0000","last_unstale":"2024-09-12T01:06:50.128500+0000","last_undegraded":"2024-09-12T01:06:50.128500+0000","last_fullsized":"2024-09-12T01:06:50.128500+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:15.783771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9731977,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":534,"num_read_kb":16735,"num_write":1073,"num_write_kb":32233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'47","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.460370+0000","last_change":"2024-09-12T00:12:38.037279+0000","last_active":"2024-09-12T01:08:08.460370+0000","last_peered":"2024-09-12T01:08:08.460370+0000","last_clean":"2024-09-12T01:08:08.460370+0000","last_became_active":"2024-09-12T00:12:38.036978+0000","last_became_peered":"2024-09-12T00:12:38.036978+0000","last_unstale":"2024-09-12T01:08:08.460370+0000","last_undegraded":"2024-09-12T01:08:08.460370+0000","last_fullsized":"2024-09-12T01:08:08.460370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:21.347370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":60,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'271","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.034990+0000","last_change":"2024-09-12T00:12:36.035846+0000","last_active":"2024-09-12T01:06:50.034990+0000","last_peered":"2024-09-12T01:06:50.034990+0000","last_clean":"2024-09-12T01:06:50.034990+0000","last_became_active":"2024-09-12T00:12:36.035112+0000","last_became_peered":"2024-09-12T00:12:36.035112+0000","last_unstale":"2024-09-12T01:06:50.034990+0000","last_undegraded":"2024-09-12T01:06:50.034990+0000","last_fullsized":"2024-09-12T01:06:50.034990+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:21.404926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12606410,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":429,"num_read_kb":34939,"num_write":1037,"num_write_kb":28471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'137","reported_seq":769,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.101896+0000","last_change":"2024-09-12T00:12:38.040495+0000","last_active":"2024-09-12T01:07:43.101896+0000","last_peered":"2024-09-12T01:07:43.101896+0000","last_clean":"2024-09-12T01:07:43.101896+0000","last_became_active":"2024-09-12T00:12:38.040144+0000","last_became_peered":"2024-09-12T00:12:38.040144+0000","last_unstale":"2024-09-12T01:07:43.101896+0000","last_undegraded":"2024-09-12T01:07:43.101896+0000","last_fullsized":"2024-09-12T01:07:43.101896+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.698332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":511,"num_write":216,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'249","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.499023+0000","last_change":"2024-09-12T00:12:36.038607+0000","last_active":"2024-09-12T01:08:09.499023+0000","last_peered":"2024-09-12T01:08:09.499023+0000","last_clean":"2024-09-12T01:08:09.499023+0000","last_became_active":"2024-09-12T00:12:36.035558+0000","last_became_peered":"2024-09-12T00:12:36.035558+0000","last_unstale":"2024-09-12T01:08:09.499023+0000","last_undegraded":"2024-09-12T01:08:09.499023+0000","last_fullsized":"2024-09-12T01:08:09.499023+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:48.869269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438723,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":373,"num_read_kb":7818,"num_write":896,"num_write_kb":22426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'275","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:48.033948+0000","last_change":"2024-09-12T00:12:38.026451+0000","last_active":"2024-09-12T01:06:48.033948+0000","last_peered":"2024-09-12T01:06:48.033948+0000","last_clean":"2024-09-12T01:06:48.033948+0000","last_became_active":"2024-09-12T00:12:38.026109+0000","last_became_peered":"2024-09-12T00:12:38.026109+0000","last_unstale":"2024-09-12T01:06:48.033948+0000","last_undegraded":"2024-09-12T01:06:48.033948+0000","last_fullsized":"2024-09-12T01:06:48.033948+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:18.043515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1270,"num_read_kb":1040,"num_write":446,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'276","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.949069+0000","last_change":"2024-09-12T00:12:36.033841+0000","last_active":"2024-09-12T01:10:57.949069+0000","last_peered":"2024-09-12T01:10:57.949069+0000","last_clean":"2024-09-12T01:10:57.949069+0000","last_became_active":"2024-09-12T00:12:36.033426+0000","last_became_peered":"2024-09-12T00:12:36.033426+0000","last_unstale":"2024-09-12T01:10:57.949069+0000","last_undegraded":"2024-09-12T01:10:57.949069+0000","last_fullsized":"2024-09-12T01:10:57.949069+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:43.664314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8725093,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":380,"num_read_kb":19382,"num_write":896,"num_write_kb":44169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'4265","reported_seq":4908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.043610+0000","last_change":"2024-09-12T00:12:38.028635+0000","last_active":"2024-09-12T01:08:12.043610+0000","last_peered":"2024-09-12T01:08:12.043610+0000","last_clean":"2024-09-12T01:08:12.043610+0000","last_became_active":"2024-09-12T00:12:38.028401+0000","last_became_peered":"2024-09-12T00:12:38.028401+0000","last_unstale":"2024-09-12T01:08:12.043610+0000","last_undegraded":"2024-09-12T01:08:12.043610+0000","last_fullsized":"2024-09-12T01:08:12.043610+0000","mapping_epoch":29,"log_start":"263'4200","ondisk_log_start":"263'4200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":3000,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17227,"num_read_kb":14428,"num_write":6422,"num_write_kb":3205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'260","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.154405+0000","last_change":"2024-09-12T00:12:36.032699+0000","last_active":"2024-09-12T01:08:25.154405+0000","last_peered":"2024-09-12T01:08:25.154405+0000","last_clean":"2024-09-12T01:08:25.154405+0000","last_became_active":"2024-09-12T00:12:36.032341+0000","last_became_peered":"2024-09-12T00:12:36.032341+0000","last_unstale":"2024-09-12T01:08:25.154405+0000","last_undegraded":"2024-09-12T01:08:25.154405+0000","last_fullsized":"2024-09-12T01:08:25.154405+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.087075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13401428,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":444,"num_read_kb":66123,"num_write":991,"num_write_kb":26739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'149","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.022603+0000","last_change":"2024-09-12T00:12:38.043531+0000","last_active":"2024-09-12T01:06:50.022603+0000","last_peered":"2024-09-12T01:06:50.022603+0000","last_clean":"2024-09-12T01:06:50.022603+0000","last_became_active":"2024-09-12T00:12:38.043276+0000","last_became_peered":"2024-09-12T00:12:38.043276+0000","last_unstale":"2024-09-12T01:06:50.022603+0000","last_undegraded":"2024-09-12T01:06:50.022603+0000","last_fullsized":"2024-09-12T01:06:50.022603+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:16.032522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":632,"num_read_kb":523,"num_write":222,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'256","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.152999+0000","last_change":"2024-09-12T00:12:36.030036+0000","last_active":"2024-09-12T01:06:50.152999+0000","last_peered":"2024-09-12T01:06:50.152999+0000","last_clean":"2024-09-12T01:06:50.152999+0000","last_became_active":"2024-09-12T00:12:36.029687+0000","last_became_peered":"2024-09-12T00:12:36.029687+0000","last_unstale":"2024-09-12T01:06:50.152999+0000","last_undegraded":"2024-09-12T01:06:50.152999+0000","last_fullsized":"2024-09-12T01:06:50.152999+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:58.296237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244632,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":389,"num_read_kb":12036,"num_write":986,"num_write_kb":29691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'211","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.152859+0000","last_change":"2024-09-12T00:12:38.047873+0000","last_active":"2024-09-12T01:06:50.152859+0000","last_peered":"2024-09-12T01:06:50.152859+0000","last_clean":"2024-09-12T01:06:50.152859+0000","last_became_active":"2024-09-12T00:12:38.047575+0000","last_became_peered":"2024-09-12T00:12:38.047575+0000","last_unstale":"2024-09-12T01:06:50.152859+0000","last_undegraded":"2024-09-12T01:06:50.152859+0000","last_fullsized":"2024-09-12T01:06:50.152859+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:28.383492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":952,"num_read_kb":776,"num_write":336,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'296","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.128604+0000","last_change":"2024-09-12T00:12:36.044107+0000","last_active":"2024-09-12T01:06:50.128604+0000","last_peered":"2024-09-12T01:06:50.128604+0000","last_clean":"2024-09-12T01:06:50.128604+0000","last_became_active":"2024-09-12T00:12:36.043803+0000","last_became_peered":"2024-09-12T00:12:36.043803+0000","last_unstale":"2024-09-12T01:06:50.128604+0000","last_undegraded":"2024-09-12T01:06:50.128604+0000","last_fullsized":"2024-09-12T01:06:50.128604+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:42.820031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17102710,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":395,"num_read_kb":37298,"num_write":1084,"num_write_kb":54766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'143","reported_seq":729,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.228988+0000","last_change":"2024-09-12T00:12:38.036740+0000","last_active":"2024-09-12T01:06:50.228988+0000","last_peered":"2024-09-12T01:06:50.228988+0000","last_clean":"2024-09-12T01:06:50.228988+0000","last_became_active":"2024-09-12T00:12:38.036463+0000","last_became_peered":"2024-09-12T00:12:38.036463+0000","last_unstale":"2024-09-12T01:06:50.228988+0000","last_undegraded":"2024-09-12T01:06:50.228988+0000","last_fullsized":"2024-09-12T01:06:50.228988+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:20.504629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":509,"num_write":213,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'234","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.143680+0000","last_change":"2024-09-12T00:12:36.042056+0000","last_active":"2024-09-12T01:08:25.143680+0000","last_peered":"2024-09-12T01:08:25.143680+0000","last_clean":"2024-09-12T01:08:25.143680+0000","last_became_active":"2024-09-12T00:12:36.041392+0000","last_became_peered":"2024-09-12T00:12:36.041392+0000","last_unstale":"2024-09-12T01:08:25.143680+0000","last_undegraded":"2024-09-12T01:08:25.143680+0000","last_fullsized":"2024-09-12T01:08:25.143680+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:58.023567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11430218,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":354,"num_read_kb":23602,"num_write":959,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'133","reported_seq":752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.547462+0000","last_change":"2024-09-12T00:12:38.043147+0000","last_active":"2024-09-12T01:09:22.547462+0000","last_peered":"2024-09-12T01:09:22.547462+0000","last_clean":"2024-09-12T01:09:22.547462+0000","last_became_active":"2024-09-12T00:12:38.042584+0000","last_became_peered":"2024-09-12T00:12:38.042584+0000","last_unstale":"2024-09-12T01:09:22.547462+0000","last_undegraded":"2024-09-12T01:09:22.547462+0000","last_fullsized":"2024-09-12T01:09:22.547462+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:40.303117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":632,"num_read_kb":533,"num_write":194,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'324","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.766246+0000","last_change":"2024-09-12T00:12:36.037876+0000","last_active":"2024-09-12T01:08:18.766246+0000","last_peered":"2024-09-12T01:08:18.766246+0000","last_clean":"2024-09-12T01:08:18.766246+0000","last_became_active":"2024-09-12T00:12:36.037461+0000","last_became_peered":"2024-09-12T00:12:36.037461+0000","last_unstale":"2024-09-12T01:08:18.766246+0000","last_undegraded":"2024-09-12T01:08:18.766246+0000","last_fullsized":"2024-09-12T01:08:18.766246+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:05.562845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4509850,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":557,"num_read_kb":9826,"num_write":1192,"num_write_kb":32499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'308","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.226100+0000","last_change":"2024-09-12T00:12:38.037217+0000","last_active":"2024-09-12T01:07:51.226100+0000","last_peered":"2024-09-12T01:07:51.226100+0000","last_clean":"2024-09-12T01:07:51.226100+0000","last_became_active":"2024-09-12T00:12:38.036872+0000","last_became_peered":"2024-09-12T00:12:38.036872+0000","last_unstale":"2024-09-12T01:07:51.226100+0000","last_undegraded":"2024-09-12T01:07:51.226100+0000","last_fullsized":"2024-09-12T01:07:51.226100+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:45.277008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1112,"num_write":459,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'290","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.937493+0000","last_change":"2024-09-12T00:12:36.042921+0000","last_active":"2024-09-12T01:10:57.937493+0000","last_peered":"2024-09-12T01:10:57.937493+0000","last_clean":"2024-09-12T01:10:57.937493+0000","last_became_active":"2024-09-12T00:12:36.042159+0000","last_became_peered":"2024-09-12T00:12:36.042159+0000","last_unstale":"2024-09-12T01:10:57.937493+0000","last_undegraded":"2024-09-12T01:10:57.937493+0000","last_fullsized":"2024-09-12T01:10:57.937493+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:47.107719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1320302,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":462,"num_read_kb":43498,"num_write":1153,"num_write_kb":41544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'313","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.061449+0000","last_change":"2024-09-12T00:12:38.045246+0000","last_active":"2024-09-12T01:08:10.061449+0000","last_peered":"2024-09-12T01:08:10.061449+0000","last_clean":"2024-09-12T01:08:10.061449+0000","last_became_active":"2024-09-12T00:12:38.042966+0000","last_became_peered":"2024-09-12T00:12:38.042966+0000","last_unstale":"2024-09-12T01:08:10.061449+0000","last_undegraded":"2024-09-12T01:08:10.061449+0000","last_fullsized":"2024-09-12T01:08:10.061449+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:43.848333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1467,"num_read_kb":1262,"num_write":468,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'300","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.242369+0000","last_change":"2024-09-12T00:12:36.027754+0000","last_active":"2024-09-12T01:08:55.242369+0000","last_peered":"2024-09-12T01:08:55.242369+0000","last_clean":"2024-09-12T01:08:55.242369+0000","last_became_active":"2024-09-12T00:12:36.027423+0000","last_became_peered":"2024-09-12T00:12:36.027423+0000","last_unstale":"2024-09-12T01:08:55.242369+0000","last_undegraded":"2024-09-12T01:08:55.242369+0000","last_fullsized":"2024-09-12T01:08:55.242369+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:36.409512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20607435,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":452,"num_read_kb":69050,"num_write":1096,"num_write_kb":46135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'156","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.227992+0000","last_change":"2024-09-12T00:12:38.036518+0000","last_active":"2024-09-12T01:06:40.227992+0000","last_peered":"2024-09-12T01:06:40.227992+0000","last_clean":"2024-09-12T01:06:40.227992+0000","last_became_active":"2024-09-12T00:12:38.036235+0000","last_became_peered":"2024-09-12T00:12:38.036235+0000","last_unstale":"2024-09-12T01:06:40.227992+0000","last_undegraded":"2024-09-12T01:06:40.227992+0000","last_fullsized":"2024-09-12T01:06:40.227992+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:14.890009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":550,"num_write":221,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'388","reported_seq":1205,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:41.160785+0000","last_change":"2024-09-12T00:12:36.038795+0000","last_active":"2024-09-12T01:08:41.160785+0000","last_peered":"2024-09-12T01:08:41.160785+0000","last_clean":"2024-09-12T01:08:41.160785+0000","last_became_active":"2024-09-12T00:12:36.038449+0000","last_became_peered":"2024-09-12T00:12:36.038449+0000","last_unstale":"2024-09-12T01:08:41.160785+0000","last_undegraded":"2024-09-12T01:08:41.160785+0000","last_fullsized":"2024-09-12T01:08:41.160785+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:36.774240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19233523,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":1008,"num_read_kb":25378,"num_write":1397,"num_write_kb":31172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'189","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.227982+0000","last_change":"2024-09-12T00:12:38.042951+0000","last_active":"2024-09-12T01:06:40.227982+0000","last_peered":"2024-09-12T01:06:40.227982+0000","last_clean":"2024-09-12T01:06:40.227982+0000","last_became_active":"2024-09-12T00:12:38.042691+0000","last_became_peered":"2024-09-12T00:12:38.042691+0000","last_unstale":"2024-09-12T01:06:40.227982+0000","last_undegraded":"2024-09-12T01:06:40.227982+0000","last_fullsized":"2024-09-12T01:06:40.227982+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:20.069819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":710,"num_write":289,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'293","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:39.320455+0000","last_change":"2024-09-12T00:12:36.025331+0000","last_active":"2024-09-12T01:08:39.320455+0000","last_peered":"2024-09-12T01:08:39.320455+0000","last_clean":"2024-09-12T01:08:39.320455+0000","last_became_active":"2024-09-12T00:12:36.025028+0000","last_became_peered":"2024-09-12T00:12:36.025028+0000","last_unstale":"2024-09-12T01:08:39.320455+0000","last_undegraded":"2024-09-12T01:08:39.320455+0000","last_fullsized":"2024-09-12T01:08:39.320455+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:26.322567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311653,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":467,"num_read_kb":8333,"num_write":1180,"num_write_kb":35038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'132","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.033321+0000","last_change":"2024-09-12T00:12:38.047056+0000","last_active":"2024-09-12T01:06:40.033321+0000","last_peered":"2024-09-12T01:06:40.033321+0000","last_clean":"2024-09-12T01:06:40.033321+0000","last_became_active":"2024-09-12T00:12:38.046753+0000","last_became_peered":"2024-09-12T00:12:38.046753+0000","last_unstale":"2024-09-12T01:06:40.033321+0000","last_undegraded":"2024-09-12T01:06:40.033321+0000","last_fullsized":"2024-09-12T01:06:40.033321+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:58.264361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":645,"num_read_kb":546,"num_write":214,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'307","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.737197+0000","last_change":"2024-09-12T00:12:36.047535+0000","last_active":"2024-09-12T01:08:27.737197+0000","last_peered":"2024-09-12T01:08:27.737197+0000","last_clean":"2024-09-12T01:08:27.737197+0000","last_became_active":"2024-09-12T00:12:36.047221+0000","last_became_peered":"2024-09-12T00:12:36.047221+0000","last_unstale":"2024-09-12T01:08:27.737197+0000","last_undegraded":"2024-09-12T01:08:27.737197+0000","last_fullsized":"2024-09-12T01:08:27.737197+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:45.416216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7981849,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":458,"num_read_kb":28470,"num_write":1084,"num_write_kb":36833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'173","reported_seq":801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:46.645799+0000","last_change":"2024-09-12T00:12:38.048404+0000","last_active":"2024-09-12T01:06:46.645799+0000","last_peered":"2024-09-12T01:06:46.645799+0000","last_clean":"2024-09-12T01:06:46.645799+0000","last_became_active":"2024-09-12T00:12:38.048094+0000","last_became_peered":"2024-09-12T00:12:38.048094+0000","last_unstale":"2024-09-12T01:06:46.645799+0000","last_undegraded":"2024-09-12T01:06:46.645799+0000","last_fullsized":"2024-09-12T01:06:46.645799+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:31.879991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":798,"num_read_kb":664,"num_write":275,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'256","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:47.580084+0000","last_change":"2024-09-12T00:12:36.039699+0000","last_active":"2024-09-12T01:06:47.580084+0000","last_peered":"2024-09-12T01:06:47.580084+0000","last_clean":"2024-09-12T01:06:47.580084+0000","last_became_active":"2024-09-12T00:12:36.039442+0000","last_became_peered":"2024-09-12T00:12:36.039442+0000","last_unstale":"2024-09-12T01:06:47.580084+0000","last_undegraded":"2024-09-12T01:06:47.580084+0000","last_fullsized":"2024-09-12T01:06:47.580084+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:18.334602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3884531,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":385,"num_read_kb":5822,"num_write":947,"num_write_kb":34989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'85","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.229535+0000","last_change":"2024-09-12T00:12:38.042638+0000","last_active":"2024-09-12T01:06:55.229535+0000","last_peered":"2024-09-12T01:06:55.229535+0000","last_clean":"2024-09-12T01:06:55.229535+0000","last_became_active":"2024-09-12T00:12:38.042380+0000","last_became_peered":"2024-09-12T00:12:38.042380+0000","last_unstale":"2024-09-12T01:06:55.229535+0000","last_undegraded":"2024-09-12T01:06:55.229535+0000","last_fullsized":"2024-09-12T01:06:55.229535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:54.486935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":311,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'336","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.237628+0000","last_change":"2024-09-12T00:12:36.036316+0000","last_active":"2024-09-12T01:07:33.237628+0000","last_peered":"2024-09-12T01:07:33.237628+0000","last_clean":"2024-09-12T01:07:33.237628+0000","last_became_active":"2024-09-12T00:12:36.035235+0000","last_became_peered":"2024-09-12T00:12:36.035235+0000","last_unstale":"2024-09-12T01:07:33.237628+0000","last_undegraded":"2024-09-12T01:07:33.237628+0000","last_fullsized":"2024-09-12T01:07:33.237628+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:35.845612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7760319,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":523,"num_read_kb":34997,"num_write":1187,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'281","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.344536+0000","last_change":"2024-09-12T00:13:07.150744+0000","last_active":"2024-09-12T01:07:41.344536+0000","last_peered":"2024-09-12T01:07:41.344536+0000","last_clean":"2024-09-12T01:07:41.344536+0000","last_became_active":"2024-09-12T00:13:07.150278+0000","last_became_peered":"2024-09-12T00:13:07.150278+0000","last_unstale":"2024-09-12T01:07:41.344536+0000","last_undegraded":"2024-09-12T01:07:41.344536+0000","last_fullsized":"2024-09-12T01:07:41.344536+0000","mapping_epoch":40,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:11.722385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3018003,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":467,"num_read_kb":16889,"num_write":1018,"num_write_kb":27724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"263'232","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.050604+0000","last_change":"2024-09-12T00:12:38.048481+0000","last_active":"2024-09-12T01:08:25.050604+0000","last_peered":"2024-09-12T01:08:25.050604+0000","last_clean":"2024-09-12T01:08:25.050604+0000","last_became_active":"2024-09-12T00:12:38.048092+0000","last_became_peered":"2024-09-12T00:12:38.048092+0000","last_unstale":"2024-09-12T01:08:25.050604+0000","last_undegraded":"2024-09-12T01:08:25.050604+0000","last_fullsized":"2024-09-12T01:08:25.050604+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:42.485985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":909,"num_write":384,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'328","reported_seq":1141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.943224+0000","last_change":"2024-09-12T00:12:36.035409+0000","last_active":"2024-09-12T01:10:57.943224+0000","last_peered":"2024-09-12T01:10:57.943224+0000","last_clean":"2024-09-12T01:10:57.943224+0000","last_became_active":"2024-09-12T00:12:36.034396+0000","last_became_peered":"2024-09-12T00:12:36.034396+0000","last_unstale":"2024-09-12T01:10:57.943224+0000","last_undegraded":"2024-09-12T01:10:57.943224+0000","last_fullsized":"2024-09-12T01:10:57.943224+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:08.822878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4973287,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":915,"num_read_kb":9206,"num_write":1404,"num_write_kb":42121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'344","reported_seq":938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.830495+0000","last_change":"2024-09-12T00:12:38.040209+0000","last_active":"2024-09-12T01:08:20.830495+0000","last_peered":"2024-09-12T01:08:20.830495+0000","last_clean":"2024-09-12T01:08:20.830495+0000","last_became_active":"2024-09-12T00:12:38.039941+0000","last_became_peered":"2024-09-12T00:12:38.039941+0000","last_unstale":"2024-09-12T01:08:20.830495+0000","last_undegraded":"2024-09-12T01:08:20.830495+0000","last_fullsized":"2024-09-12T01:08:20.830495+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:03.997031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1443,"num_read_kb":1146,"num_write":558,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5787,"num_read_kb":4069,"num_write":1922,"num_write_kb":820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1093,"ondisk_log_size":1093,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15069,"num_read_kb":14720,"num_write":16734,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1768,"ondisk_log_size":1768,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":666,"ondisk_log_size":666,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1913657,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17811,"num_read_kb":33483,"num_write":15051,"num_write_kb":11721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3301376,"data_stored":2790522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1934,"ondisk_log_size":1934,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2422,"num_read_kb":2887,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":103162,"num_read_kb":86048,"num_write":37373,"num_write_kb":18894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3928,"ondisk_log_size":3928,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":562329238,"num_objects":4467,"num_object_clones":0,"num_object_copies":13401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4467,"num_whiteouts":0,"num_read":32165,"num_read_kb":1714764,"num_write":68012,"num_write_kb":2100462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":893014016,"data_stored":893014016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4601,"ondisk_log_size":4601,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":64182174,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":138,"num_read_kb":170862,"num_write":160,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128376832,"data_stored":128364348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":64182174,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":170241,"num_write":160,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128376832,"data_stored":128364348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510148,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":324492,"kb_used_data":130940,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":94047348,"statfs":{"total":96636764160,"available":96304484352,"internally_reserved":0,"allocated":134082560,"data_stored":132060496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":198179275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510151,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190848,"kb_used_data":105584,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94180992,"statfs":{"total":96636764160,"available":96441335808,"internally_reserved":0,"allocated":108118016,"data_stored":106081500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510148,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335140,"kb_used_data":163796,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94036700,"statfs":{"total":96636764160,"available":96293580800,"internally_reserved":0,"allocated":167727104,"data_stored":165700867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510149,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371556,"kb_used_data":159892,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94000284,"statfs":{"total":96636764160,"available":96256290816,"internally_reserved":0,"allocated":163729408,"data_stored":161718302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510149,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":258888,"kb_used_data":159672,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94112952,"statfs":{"total":96636764160,"available":96371662848,"internally_reserved":0,"allocated":163504128,"data_stored":161512842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510149,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":414976,"kb_used_data":135280,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":93956864,"statfs":{"total":96636764160,"available":96211828736,"internally_reserved":0,"allocated":138526720,"data_stored":136486609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510151,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249120,"kb_used_data":163792,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94122720,"statfs":{"total":96636764160,"available":96381665280,"internally_reserved":0,"allocated":167723008,"data_stored":165670605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575557,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378888,"kb_used_data":140856,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93992952,"statfs":{"total":96636764160,"available":96248782848,"internally_reserved":0,"allocated":144236544,"data_stored":142198459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":144601088,"data_stored":144601088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":108945408,"data_stored":108945408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":125046784,"data_stored":125046784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":126697472,"data_stored":126697472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":133562368,"data_stored":133562368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":88969216,"data_stored":88969216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":74076160,"data_stored":74076160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":91115520,"data_stored":91115520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":458188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":467252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":126536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":267690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":405520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":475136,"data_stored":406325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":346468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":312543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16363520,"data_stored":16361432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11710464,"data_stored":11704945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13680640,"data_stored":13679917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":27901952,"data_stored":27897798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14217216,"data_stored":14215851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7925760,"data_stored":7924395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17362944,"data_stored":17361579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15777069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28950528,"data_stored":28946374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15781888,"data_stored":15779099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10534912,"data_stored":10534189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:11:00.718 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:11:01.049 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:11:01.061 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-09-12T01:11:01.063 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":2019,"stamp":"2024-09-12T01:10:59.331137+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":693215742,"num_objects":4875,"num_object_clones":0,"num_object_copies":14217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4875,"num_whiteouts":0,"num_read":176769,"num_read_kb":2197142,"num_write":139555,"num_write_kb":2394927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14283,"ondisk_log_size":14283,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2523908,"kb_used_data":1159812,"kb_used_omap":12,"kb_used_meta":1363955,"kb_avail":752450812,"statfs":{"total":773094113280,"available":770509631488,"internally_reserved":0,"allocated":1187647488,"data_stored":1171429680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1396690482},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-215,"num_objects":-15,"num_object_clones":0,"num_object_copies":-45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-15,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005544"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.023141+0000","last_change":"2024-09-12T00:46:54.886343+0000","last_active":"2024-09-12T01:06:55.023141+0000","last_peered":"2024-09-12T01:06:55.023141+0000","last_clean":"2024-09-12T01:06:55.023141+0000","last_became_active":"2024-09-12T00:46:54.885628+0000","last_became_peered":"2024-09-12T00:46:54.885628+0000","last_unstale":"2024-09-12T01:06:55.023141+0000","last_undegraded":"2024-09-12T01:06:55.023141+0000","last_fullsized":"2024-09-12T01:06:55.023141+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:28.705045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'4","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.235372+0000","last_change":"2024-09-12T00:30:17.763692+0000","last_active":"2024-09-12T01:07:50.235372+0000","last_peered":"2024-09-12T01:07:50.235372+0000","last_clean":"2024-09-12T01:07:50.235372+0000","last_became_active":"2024-09-12T00:30:17.763402+0000","last_became_peered":"2024-09-12T00:30:17.763402+0000","last_unstale":"2024-09-12T01:07:50.235372+0000","last_undegraded":"2024-09-12T01:07:50.235372+0000","last_fullsized":"2024-09-12T01:07:50.235372+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:07.859938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044542+0000","last_change":"2024-09-12T00:30:14.745260+0000","last_active":"2024-09-12T01:07:45.044542+0000","last_peered":"2024-09-12T01:07:45.044542+0000","last_clean":"2024-09-12T01:07:45.044542+0000","last_became_active":"2024-09-12T00:30:14.744833+0000","last_became_peered":"2024-09-12T00:30:14.744833+0000","last_unstale":"2024-09-12T01:07:45.044542+0000","last_undegraded":"2024-09-12T01:07:45.044542+0000","last_fullsized":"2024-09-12T01:07:45.044542+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:11.503961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'41","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.040605+0000","last_change":"2024-09-12T00:27:42.840206+0000","last_active":"2024-09-12T01:07:20.040605+0000","last_peered":"2024-09-12T01:07:20.040605+0000","last_clean":"2024-09-12T01:07:20.040605+0000","last_became_active":"2024-09-12T00:27:42.839605+0000","last_became_peered":"2024-09-12T00:27:42.839605+0000","last_unstale":"2024-09-12T01:07:20.040605+0000","last_undegraded":"2024-09-12T01:07:20.040605+0000","last_fullsized":"2024-09-12T01:07:20.040605+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:10.785209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":144,"num_write":69,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.153651+0000","last_change":"2024-09-12T00:46:54.885981+0000","last_active":"2024-09-12T01:06:55.153651+0000","last_peered":"2024-09-12T01:06:55.153651+0000","last_clean":"2024-09-12T01:06:55.153651+0000","last_became_active":"2024-09-12T00:46:54.885702+0000","last_became_peered":"2024-09-12T00:46:54.885702+0000","last_unstale":"2024-09-12T01:06:55.153651+0000","last_undegraded":"2024-09-12T01:06:55.153651+0000","last_fullsized":"2024-09-12T01:06:55.153651+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:37.616069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135467+0000","last_change":"2024-09-12T00:30:17.762666+0000","last_active":"2024-09-12T01:07:50.135467+0000","last_peered":"2024-09-12T01:07:50.135467+0000","last_clean":"2024-09-12T01:07:50.135467+0000","last_became_active":"2024-09-12T00:30:17.762369+0000","last_became_peered":"2024-09-12T00:30:17.762369+0000","last_unstale":"2024-09-12T01:07:50.135467+0000","last_undegraded":"2024-09-12T01:07:50.135467+0000","last_fullsized":"2024-09-12T01:07:50.135467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:33.357062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042925+0000","last_change":"2024-09-12T00:30:14.747881+0000","last_active":"2024-09-12T01:07:48.042925+0000","last_peered":"2024-09-12T01:07:48.042925+0000","last_clean":"2024-09-12T01:07:48.042925+0000","last_became_active":"2024-09-12T00:30:14.747614+0000","last_became_peered":"2024-09-12T00:30:14.747614+0000","last_unstale":"2024-09-12T01:07:48.042925+0000","last_undegraded":"2024-09-12T01:07:48.042925+0000","last_fullsized":"2024-09-12T01:07:48.042925+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:33.210330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'21","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045493+0000","last_change":"2024-09-12T00:27:42.846591+0000","last_active":"2024-09-12T01:07:50.045493+0000","last_peered":"2024-09-12T01:07:50.045493+0000","last_clean":"2024-09-12T01:07:50.045493+0000","last_became_active":"2024-09-12T00:27:42.846264+0000","last_became_peered":"2024-09-12T00:27:42.846264+0000","last_unstale":"2024-09-12T01:07:50.045493+0000","last_undegraded":"2024-09-12T01:07:50.045493+0000","last_fullsized":"2024-09-12T01:07:50.045493+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:13.645447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:15.224938+0000","last_change":"2024-09-12T00:46:54.890699+0000","last_active":"2024-09-12T01:06:15.224938+0000","last_peered":"2024-09-12T01:06:15.224938+0000","last_clean":"2024-09-12T01:06:15.224938+0000","last_became_active":"2024-09-12T00:46:54.890430+0000","last_became_peered":"2024-09-12T00:46:54.890430+0000","last_unstale":"2024-09-12T01:06:15.224938+0000","last_undegraded":"2024-09-12T01:06:15.224938+0000","last_fullsized":"2024-09-12T01:06:15.224938+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:21.161335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042970+0000","last_change":"2024-09-12T00:30:17.767409+0000","last_active":"2024-09-12T01:07:48.042970+0000","last_peered":"2024-09-12T01:07:48.042970+0000","last_clean":"2024-09-12T01:07:48.042970+0000","last_became_active":"2024-09-12T00:30:17.767116+0000","last_became_peered":"2024-09-12T00:30:17.767116+0000","last_unstale":"2024-09-12T01:07:48.042970+0000","last_undegraded":"2024-09-12T01:07:48.042970+0000","last_fullsized":"2024-09-12T01:07:48.042970+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:25.469472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"263'4","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.049608+0000","last_change":"2024-09-12T00:30:14.742702+0000","last_active":"2024-09-12T01:08:20.049608+0000","last_peered":"2024-09-12T01:08:20.049608+0000","last_clean":"2024-09-12T01:08:20.049608+0000","last_became_active":"2024-09-12T00:30:14.742434+0000","last_became_peered":"2024-09-12T00:30:14.742434+0000","last_unstale":"2024-09-12T01:08:20.049608+0000","last_undegraded":"2024-09-12T01:08:20.049608+0000","last_fullsized":"2024-09-12T01:08:20.049608+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:37.658561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099035,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6194,"num_write":4,"num_write_kb":5170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'36","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160719+0000","last_change":"2024-09-12T00:27:42.842436+0000","last_active":"2024-09-12T01:07:45.160719+0000","last_peered":"2024-09-12T01:07:45.160719+0000","last_clean":"2024-09-12T01:07:45.160719+0000","last_became_active":"2024-09-12T00:27:42.842172+0000","last_became_peered":"2024-09-12T00:27:42.842172+0000","last_unstale":"2024-09-12T01:07:45.160719+0000","last_undegraded":"2024-09-12T01:07:45.160719+0000","last_fullsized":"2024-09-12T01:07:45.160719+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:30.357785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:23.030019+0000","last_change":"2024-09-12T00:46:54.883267+0000","last_active":"2024-09-12T01:06:23.030019+0000","last_peered":"2024-09-12T01:06:23.030019+0000","last_clean":"2024-09-12T01:06:23.030019+0000","last_became_active":"2024-09-12T00:46:54.882951+0000","last_became_peered":"2024-09-12T00:46:54.882951+0000","last_unstale":"2024-09-12T01:06:23.030019+0000","last_undegraded":"2024-09-12T01:06:23.030019+0000","last_fullsized":"2024-09-12T01:06:23.030019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:55.035382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'1","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.049034+0000","last_change":"2024-09-12T00:30:17.766601+0000","last_active":"2024-09-12T01:08:28.049034+0000","last_peered":"2024-09-12T01:08:28.049034+0000","last_clean":"2024-09-12T01:08:28.049034+0000","last_became_active":"2024-09-12T00:30:17.764967+0000","last_became_peered":"2024-09-12T00:30:17.764967+0000","last_unstale":"2024-09-12T01:08:28.049034+0000","last_undegraded":"2024-09-12T01:08:28.049034+0000","last_fullsized":"2024-09-12T01:08:28.049034+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:56.749587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.234899+0000","last_change":"2024-09-12T00:30:14.747887+0000","last_active":"2024-09-12T01:07:45.234899+0000","last_peered":"2024-09-12T01:07:45.234899+0000","last_clean":"2024-09-12T01:07:45.234899+0000","last_became_active":"2024-09-12T00:30:14.747423+0000","last_became_peered":"2024-09-12T00:30:14.747423+0000","last_unstale":"2024-09-12T01:07:45.234899+0000","last_undegraded":"2024-09-12T01:07:45.234899+0000","last_fullsized":"2024-09-12T01:07:45.234899+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:10.117387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'27","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160694+0000","last_change":"2024-09-12T00:27:42.837430+0000","last_active":"2024-09-12T01:07:45.160694+0000","last_peered":"2024-09-12T01:07:45.160694+0000","last_clean":"2024-09-12T01:07:45.160694+0000","last_became_active":"2024-09-12T00:27:42.837170+0000","last_became_peered":"2024-09-12T00:27:42.837170+0000","last_unstale":"2024-09-12T01:07:45.160694+0000","last_undegraded":"2024-09-12T01:07:45.160694+0000","last_fullsized":"2024-09-12T01:07:45.160694+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:50.502592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":97,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.037066+0000","last_change":"2024-09-12T00:46:54.885456+0000","last_active":"2024-09-12T01:07:00.037066+0000","last_peered":"2024-09-12T01:07:00.037066+0000","last_clean":"2024-09-12T01:07:00.037066+0000","last_became_active":"2024-09-12T00:46:54.885170+0000","last_became_peered":"2024-09-12T00:46:54.885170+0000","last_unstale":"2024-09-12T01:07:00.037066+0000","last_undegraded":"2024-09-12T01:07:00.037066+0000","last_fullsized":"2024-09-12T01:07:00.037066+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:22.660312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.022559+0000","last_change":"2024-09-12T00:30:17.765475+0000","last_active":"2024-09-12T01:06:50.022559+0000","last_peered":"2024-09-12T01:06:50.022559+0000","last_clean":"2024-09-12T01:06:50.022559+0000","last_became_active":"2024-09-12T00:30:17.765167+0000","last_became_peered":"2024-09-12T00:30:17.765167+0000","last_unstale":"2024-09-12T01:06:50.022559+0000","last_undegraded":"2024-09-12T01:06:50.022559+0000","last_fullsized":"2024-09-12T01:06:50.022559+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:48.717488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4778667,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":6715,"num_write":4,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:33.031572+0000","last_change":"2024-09-12T00:30:14.742908+0000","last_active":"2024-09-12T01:06:33.031572+0000","last_peered":"2024-09-12T01:06:33.031572+0000","last_clean":"2024-09-12T01:06:33.031572+0000","last_became_active":"2024-09-12T00:30:14.742625+0000","last_became_peered":"2024-09-12T00:30:14.742625+0000","last_unstale":"2024-09-12T01:06:33.031572+0000","last_undegraded":"2024-09-12T01:06:33.031572+0000","last_fullsized":"2024-09-12T01:06:33.031572+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:00.744053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160647+0000","last_change":"2024-09-12T00:27:42.845668+0000","last_active":"2024-09-12T01:07:45.160647+0000","last_peered":"2024-09-12T01:07:45.160647+0000","last_clean":"2024-09-12T01:07:45.160647+0000","last_became_active":"2024-09-12T00:27:42.845406+0000","last_became_peered":"2024-09-12T00:27:42.845406+0000","last_unstale":"2024-09-12T01:07:45.160647+0000","last_undegraded":"2024-09-12T01:07:45.160647+0000","last_fullsized":"2024-09-12T01:07:45.160647+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:58.406118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":45,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044551+0000","last_change":"2024-09-12T00:46:54.877914+0000","last_active":"2024-09-12T01:07:45.044551+0000","last_peered":"2024-09-12T01:07:45.044551+0000","last_clean":"2024-09-12T01:07:45.044551+0000","last_became_active":"2024-09-12T00:46:54.876219+0000","last_became_peered":"2024-09-12T00:46:54.876219+0000","last_unstale":"2024-09-12T01:07:45.044551+0000","last_undegraded":"2024-09-12T01:07:45.044551+0000","last_fullsized":"2024-09-12T01:07:45.044551+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:46.030061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.033467+0000","last_change":"2024-09-12T00:30:17.763491+0000","last_active":"2024-09-12T01:06:35.033467+0000","last_peered":"2024-09-12T01:06:35.033467+0000","last_clean":"2024-09-12T01:06:35.033467+0000","last_became_active":"2024-09-12T00:30:17.762792+0000","last_became_peered":"2024-09-12T00:30:17.762792+0000","last_unstale":"2024-09-12T01:06:35.033467+0000","last_undegraded":"2024-09-12T01:06:35.033467+0000","last_fullsized":"2024-09-12T01:06:35.033467+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:45.751971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.034091+0000","last_change":"2024-09-12T00:30:14.745747+0000","last_active":"2024-09-12T01:06:40.034091+0000","last_peered":"2024-09-12T01:06:40.034091+0000","last_clean":"2024-09-12T01:06:40.034091+0000","last_became_active":"2024-09-12T00:30:14.745328+0000","last_became_peered":"2024-09-12T00:30:14.745328+0000","last_unstale":"2024-09-12T01:06:40.034091+0000","last_undegraded":"2024-09-12T01:06:40.034091+0000","last_fullsized":"2024-09-12T01:06:40.034091+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:22.444900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'29","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.134777+0000","last_change":"2024-09-12T00:27:42.844015+0000","last_active":"2024-09-12T01:07:45.134777+0000","last_peered":"2024-09-12T01:07:45.134777+0000","last_clean":"2024-09-12T01:07:45.134777+0000","last_became_active":"2024-09-12T00:27:42.843745+0000","last_became_peered":"2024-09-12T00:27:42.843745+0000","last_unstale":"2024-09-12T01:07:45.134777+0000","last_undegraded":"2024-09-12T01:07:45.134777+0000","last_fullsized":"2024-09-12T01:07:45.134777+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:02.518882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":101,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.129245+0000","last_change":"2024-09-12T00:46:54.889308+0000","last_active":"2024-09-12T01:06:55.129245+0000","last_peered":"2024-09-12T01:06:55.129245+0000","last_clean":"2024-09-12T01:06:55.129245+0000","last_became_active":"2024-09-12T00:46:54.889006+0000","last_became_peered":"2024-09-12T00:46:54.889006+0000","last_unstale":"2024-09-12T01:06:55.129245+0000","last_undegraded":"2024-09-12T01:06:55.129245+0000","last_fullsized":"2024-09-12T01:06:55.129245+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:09.749976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'10","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135456+0000","last_change":"2024-09-12T00:30:17.759472+0000","last_active":"2024-09-12T01:07:50.135456+0000","last_peered":"2024-09-12T01:07:50.135456+0000","last_clean":"2024-09-12T01:07:50.135456+0000","last_became_active":"2024-09-12T00:30:17.759198+0000","last_became_peered":"2024-09-12T00:30:17.759198+0000","last_unstale":"2024-09-12T01:07:50.135456+0000","last_undegraded":"2024-09-12T01:07:50.135456+0000","last_fullsized":"2024-09-12T01:07:50.135456+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:30.456850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":9336,"num_write":15,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.028479+0000","last_change":"2024-09-12T00:30:14.750283+0000","last_active":"2024-09-12T01:07:45.028479+0000","last_peered":"2024-09-12T01:07:45.028479+0000","last_clean":"2024-09-12T01:07:45.028479+0000","last_became_active":"2024-09-12T00:30:14.750004+0000","last_became_peered":"2024-09-12T00:30:14.750004+0000","last_unstale":"2024-09-12T01:07:45.028479+0000","last_undegraded":"2024-09-12T01:07:45.028479+0000","last_fullsized":"2024-09-12T01:07:45.028479+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:54.714545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'18","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.031378+0000","last_change":"2024-09-12T00:27:42.835796+0000","last_active":"2024-09-12T01:06:30.031378+0000","last_peered":"2024-09-12T01:06:30.031378+0000","last_clean":"2024-09-12T01:06:30.031378+0000","last_became_active":"2024-09-12T00:27:42.835530+0000","last_became_peered":"2024-09-12T00:27:42.835530+0000","last_unstale":"2024-09-12T01:06:30.031378+0000","last_undegraded":"2024-09-12T01:06:30.031378+0000","last_fullsized":"2024-09-12T01:06:30.031378+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:37.899819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.023205+0000","last_change":"2024-09-12T00:46:54.883214+0000","last_active":"2024-09-12T01:06:55.023205+0000","last_peered":"2024-09-12T01:06:55.023205+0000","last_clean":"2024-09-12T01:06:55.023205+0000","last_became_active":"2024-09-12T00:46:54.882946+0000","last_became_peered":"2024-09-12T00:46:54.882946+0000","last_unstale":"2024-09-12T01:06:55.023205+0000","last_undegraded":"2024-09-12T01:06:55.023205+0000","last_fullsized":"2024-09-12T01:06:55.023205+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:01.444701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045398+0000","last_change":"2024-09-12T00:30:17.766684+0000","last_active":"2024-09-12T01:07:50.045398+0000","last_peered":"2024-09-12T01:07:50.045398+0000","last_clean":"2024-09-12T01:07:50.045398+0000","last_became_active":"2024-09-12T00:30:17.763733+0000","last_became_peered":"2024-09-12T00:30:17.763733+0000","last_unstale":"2024-09-12T01:07:50.045398+0000","last_undegraded":"2024-09-12T01:07:50.045398+0000","last_fullsized":"2024-09-12T01:07:50.045398+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:45.175363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'4","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160664+0000","last_change":"2024-09-12T00:30:14.748751+0000","last_active":"2024-09-12T01:07:45.160664+0000","last_peered":"2024-09-12T01:07:45.160664+0000","last_clean":"2024-09-12T01:07:45.160664+0000","last_became_active":"2024-09-12T00:30:14.748462+0000","last_became_peered":"2024-09-12T00:30:14.748462+0000","last_unstale":"2024-09-12T01:07:45.160664+0000","last_undegraded":"2024-09-12T01:07:45.160664+0000","last_fullsized":"2024-09-12T01:07:45.160664+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:23.544212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'17","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.148879+0000","last_change":"2024-09-12T00:27:42.839309+0000","last_active":"2024-09-12T01:06:25.148879+0000","last_peered":"2024-09-12T01:06:25.148879+0000","last_clean":"2024-09-12T01:06:25.148879+0000","last_became_active":"2024-09-12T00:27:42.838896+0000","last_became_peered":"2024-09-12T00:27:42.838896+0000","last_unstale":"2024-09-12T01:06:25.148879+0000","last_undegraded":"2024-09-12T01:06:25.148879+0000","last_fullsized":"2024-09-12T01:06:25.148879+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:33.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.044373+0000","last_change":"2024-09-12T00:46:54.885744+0000","last_active":"2024-09-12T01:07:58.044373+0000","last_peered":"2024-09-12T01:07:58.044373+0000","last_clean":"2024-09-12T01:07:58.044373+0000","last_became_active":"2024-09-12T00:46:54.885457+0000","last_became_peered":"2024-09-12T00:46:54.885457+0000","last_unstale":"2024-09-12T01:07:58.044373+0000","last_undegraded":"2024-09-12T01:07:58.044373+0000","last_fullsized":"2024-09-12T01:07:58.044373+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:36.235325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.032424+0000","last_change":"2024-09-12T00:30:17.765481+0000","last_active":"2024-09-12T01:06:35.032424+0000","last_peered":"2024-09-12T01:06:35.032424+0000","last_clean":"2024-09-12T01:06:35.032424+0000","last_became_active":"2024-09-12T00:30:17.765149+0000","last_became_peered":"2024-09-12T00:30:17.765149+0000","last_unstale":"2024-09-12T01:06:35.032424+0000","last_undegraded":"2024-09-12T01:06:35.032424+0000","last_fullsized":"2024-09-12T01:06:35.032424+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:20.242797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041690+0000","last_change":"2024-09-12T00:30:14.740879+0000","last_active":"2024-09-12T01:07:45.041690+0000","last_peered":"2024-09-12T01:07:45.041690+0000","last_clean":"2024-09-12T01:07:45.041690+0000","last_became_active":"2024-09-12T00:30:14.740516+0000","last_became_peered":"2024-09-12T00:30:14.740516+0000","last_unstale":"2024-09-12T01:07:45.041690+0000","last_undegraded":"2024-09-12T01:07:45.041690+0000","last_fullsized":"2024-09-12T01:07:45.041690+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:43.135121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'20","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030659+0000","last_change":"2024-09-12T00:27:42.841806+0000","last_active":"2024-09-12T01:06:25.030659+0000","last_peered":"2024-09-12T01:06:25.030659+0000","last_clean":"2024-09-12T01:06:25.030659+0000","last_became_active":"2024-09-12T00:27:42.840919+0000","last_became_peered":"2024-09-12T00:27:42.840919+0000","last_unstale":"2024-09-12T01:06:25.030659+0000","last_undegraded":"2024-09-12T01:06:25.030659+0000","last_fullsized":"2024-09-12T01:06:25.030659+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:51.676258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":83,"num_write":31,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.162301+0000","last_change":"2024-09-12T00:46:54.887403+0000","last_active":"2024-09-12T01:07:55.162301+0000","last_peered":"2024-09-12T01:07:55.162301+0000","last_clean":"2024-09-12T01:07:55.162301+0000","last_became_active":"2024-09-12T00:46:54.887134+0000","last_became_peered":"2024-09-12T00:46:54.887134+0000","last_unstale":"2024-09-12T01:07:55.162301+0000","last_undegraded":"2024-09-12T01:07:55.162301+0000","last_fullsized":"2024-09-12T01:07:55.162301+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:13.379263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'6","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042898+0000","last_change":"2024-09-12T00:30:17.766525+0000","last_active":"2024-09-12T01:07:48.042898+0000","last_peered":"2024-09-12T01:07:48.042898+0000","last_clean":"2024-09-12T01:07:48.042898+0000","last_became_active":"2024-09-12T00:30:17.766203+0000","last_became_peered":"2024-09-12T00:30:17.766203+0000","last_unstale":"2024-09-12T01:07:48.042898+0000","last_undegraded":"2024-09-12T01:07:48.042898+0000","last_fullsized":"2024-09-12T01:07:48.042898+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:51.225523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8439067,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":13412,"num_write":11,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.020488+0000","last_change":"2024-09-12T00:30:14.746410+0000","last_active":"2024-09-12T01:06:30.020488+0000","last_peered":"2024-09-12T01:06:30.020488+0000","last_clean":"2024-09-12T01:06:30.020488+0000","last_became_active":"2024-09-12T00:30:14.746119+0000","last_became_peered":"2024-09-12T00:30:14.746119+0000","last_unstale":"2024-09-12T01:06:30.020488+0000","last_undegraded":"2024-09-12T01:06:30.020488+0000","last_fullsized":"2024-09-12T01:06:30.020488+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:15.863696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'39","reported_seq":151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030634+0000","last_change":"2024-09-12T00:27:42.846588+0000","last_active":"2024-09-12T01:06:25.030634+0000","last_peered":"2024-09-12T01:06:25.030634+0000","last_clean":"2024-09-12T01:06:25.030634+0000","last_became_active":"2024-09-12T00:27:42.846198+0000","last_became_peered":"2024-09-12T00:27:42.846198+0000","last_unstale":"2024-09-12T01:06:25.030634+0000","last_undegraded":"2024-09-12T01:06:25.030634+0000","last_fullsized":"2024-09-12T01:06:25.030634+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:39.702227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":138,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.135933+0000","last_change":"2024-09-12T00:46:54.886148+0000","last_active":"2024-09-12T01:07:55.135933+0000","last_peered":"2024-09-12T01:07:55.135933+0000","last_clean":"2024-09-12T01:07:55.135933+0000","last_became_active":"2024-09-12T00:46:54.885879+0000","last_became_peered":"2024-09-12T00:46:54.885879+0000","last_unstale":"2024-09-12T01:07:55.135933+0000","last_undegraded":"2024-09-12T01:07:55.135933+0000","last_fullsized":"2024-09-12T01:07:55.135933+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:12.855547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"260'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.032478+0000","last_change":"2024-09-12T00:30:17.769299+0000","last_active":"2024-09-12T01:06:35.032478+0000","last_peered":"2024-09-12T01:06:35.032478+0000","last_clean":"2024-09-12T01:06:35.032478+0000","last_became_active":"2024-09-12T00:30:17.769051+0000","last_became_peered":"2024-09-12T00:30:17.769051+0000","last_unstale":"2024-09-12T01:06:35.032478+0000","last_undegraded":"2024-09-12T01:06:35.032478+0000","last_fullsized":"2024-09-12T01:06:35.032478+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:02.321672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.031472+0000","last_change":"2024-09-12T00:30:14.743361+0000","last_active":"2024-09-12T01:06:30.031472+0000","last_peered":"2024-09-12T01:06:30.031472+0000","last_clean":"2024-09-12T01:06:30.031472+0000","last_became_active":"2024-09-12T00:30:14.743083+0000","last_became_peered":"2024-09-12T00:30:14.743083+0000","last_unstale":"2024-09-12T01:06:30.031472+0000","last_undegraded":"2024-09-12T01:06:30.031472+0000","last_fullsized":"2024-09-12T01:06:30.031472+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:54.700301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":6,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030625+0000","last_change":"2024-09-12T00:27:42.839353+0000","last_active":"2024-09-12T01:06:25.030625+0000","last_peered":"2024-09-12T01:06:25.030625+0000","last_clean":"2024-09-12T01:06:25.030625+0000","last_became_active":"2024-09-12T00:27:42.839063+0000","last_became_peered":"2024-09-12T00:27:42.839063+0000","last_unstale":"2024-09-12T01:06:25.030625+0000","last_undegraded":"2024-09-12T01:06:25.030625+0000","last_fullsized":"2024-09-12T01:06:25.030625+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:50.341652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":119,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.029600+0000","last_change":"2024-09-12T00:46:54.887703+0000","last_active":"2024-09-12T01:07:55.029600+0000","last_peered":"2024-09-12T01:07:55.029600+0000","last_clean":"2024-09-12T01:07:55.029600+0000","last_became_active":"2024-09-12T00:46:54.887450+0000","last_became_peered":"2024-09-12T00:46:54.887450+0000","last_unstale":"2024-09-12T01:07:55.029600+0000","last_undegraded":"2024-09-12T01:07:55.029600+0000","last_fullsized":"2024-09-12T01:07:55.029600+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:53.371335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.021027+0000","last_change":"2024-09-12T00:30:17.756613+0000","last_active":"2024-09-12T01:06:35.021027+0000","last_peered":"2024-09-12T01:06:35.021027+0000","last_clean":"2024-09-12T01:06:35.021027+0000","last_became_active":"2024-09-12T00:30:17.756342+0000","last_became_peered":"2024-09-12T00:30:17.756342+0000","last_unstale":"2024-09-12T01:06:35.021027+0000","last_undegraded":"2024-09-12T01:06:35.021027+0000","last_fullsized":"2024-09-12T01:06:35.021027+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:08.103127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:33.031702+0000","last_change":"2024-09-12T00:30:14.748689+0000","last_active":"2024-09-12T01:06:33.031702+0000","last_peered":"2024-09-12T01:06:33.031702+0000","last_clean":"2024-09-12T01:06:33.031702+0000","last_became_active":"2024-09-12T00:30:14.748446+0000","last_became_peered":"2024-09-12T00:30:14.748446+0000","last_unstale":"2024-09-12T01:06:33.031702+0000","last_undegraded":"2024-09-12T01:06:33.031702+0000","last_fullsized":"2024-09-12T01:06:33.031702+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:32.811168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'23","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.040482+0000","last_change":"2024-09-12T00:27:42.845645+0000","last_active":"2024-09-12T01:07:35.040482+0000","last_peered":"2024-09-12T01:07:35.040482+0000","last_clean":"2024-09-12T01:07:35.040482+0000","last_became_active":"2024-09-12T00:27:42.845379+0000","last_became_peered":"2024-09-12T00:27:42.845379+0000","last_unstale":"2024-09-12T01:07:35.040482+0000","last_undegraded":"2024-09-12T01:07:35.040482+0000","last_fullsized":"2024-09-12T01:07:35.040482+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:35.854841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:18.029467+0000","last_change":"2024-09-12T00:46:54.884019+0000","last_active":"2024-09-12T01:06:18.029467+0000","last_peered":"2024-09-12T01:06:18.029467+0000","last_clean":"2024-09-12T01:06:18.029467+0000","last_became_active":"2024-09-12T00:46:54.883713+0000","last_became_peered":"2024-09-12T00:46:54.883713+0000","last_unstale":"2024-09-12T01:06:18.029467+0000","last_undegraded":"2024-09-12T01:06:18.029467+0000","last_fullsized":"2024-09-12T01:06:18.029467+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:41.973083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.041273+0000","last_change":"2024-09-12T00:30:17.764514+0000","last_active":"2024-09-12T01:07:38.041273+0000","last_peered":"2024-09-12T01:07:38.041273+0000","last_clean":"2024-09-12T01:07:38.041273+0000","last_became_active":"2024-09-12T00:30:17.764165+0000","last_became_peered":"2024-09-12T00:30:17.764165+0000","last_unstale":"2024-09-12T01:07:38.041273+0000","last_undegraded":"2024-09-12T01:07:38.041273+0000","last_fullsized":"2024-09-12T01:07:38.041273+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:16.348051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.233654+0000","last_change":"2024-09-12T00:30:14.747500+0000","last_active":"2024-09-12T01:07:35.233654+0000","last_peered":"2024-09-12T01:07:35.233654+0000","last_clean":"2024-09-12T01:07:35.233654+0000","last_became_active":"2024-09-12T00:30:14.747184+0000","last_became_peered":"2024-09-12T00:30:14.747184+0000","last_unstale":"2024-09-12T01:07:35.233654+0000","last_undegraded":"2024-09-12T01:07:35.233654+0000","last_fullsized":"2024-09-12T01:07:35.233654+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:20.436960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48429,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4144,"num_write":3,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'76","reported_seq":299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.039285+0000","last_change":"2024-09-12T00:27:42.846397+0000","last_active":"2024-09-12T01:07:25.039285+0000","last_peered":"2024-09-12T01:07:25.039285+0000","last_clean":"2024-09-12T01:07:25.039285+0000","last_became_active":"2024-09-12T00:27:42.846108+0000","last_became_peered":"2024-09-12T00:27:42.846108+0000","last_unstale":"2024-09-12T01:07:25.039285+0000","last_undegraded":"2024-09-12T01:07:25.039285+0000","last_fullsized":"2024-09-12T01:07:25.039285+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:11.395534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":337,"num_write":98,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:15.147442+0000","last_change":"2024-09-12T00:46:54.889757+0000","last_active":"2024-09-12T01:06:15.147442+0000","last_peered":"2024-09-12T01:06:15.147442+0000","last_clean":"2024-09-12T01:06:15.147442+0000","last_became_active":"2024-09-12T00:46:54.889496+0000","last_became_peered":"2024-09-12T00:46:54.889496+0000","last_unstale":"2024-09-12T01:06:15.147442+0000","last_undegraded":"2024-09-12T01:06:15.147442+0000","last_fullsized":"2024-09-12T01:06:15.147442+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:28.265877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.041215+0000","last_change":"2024-09-12T00:30:17.767918+0000","last_active":"2024-09-12T01:07:38.041215+0000","last_peered":"2024-09-12T01:07:38.041215+0000","last_clean":"2024-09-12T01:07:38.041215+0000","last_became_active":"2024-09-12T00:30:17.767526+0000","last_became_peered":"2024-09-12T00:30:17.767526+0000","last_unstale":"2024-09-12T01:07:38.041215+0000","last_undegraded":"2024-09-12T01:07:38.041215+0000","last_fullsized":"2024-09-12T01:07:38.041215+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:28.500175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.041253+0000","last_change":"2024-09-12T00:30:14.749360+0000","last_active":"2024-09-12T01:07:38.041253+0000","last_peered":"2024-09-12T01:07:38.041253+0000","last_clean":"2024-09-12T01:07:38.041253+0000","last_became_active":"2024-09-12T00:30:14.749104+0000","last_became_peered":"2024-09-12T00:30:14.749104+0000","last_unstale":"2024-09-12T01:07:38.041253+0000","last_undegraded":"2024-09-12T01:07:38.041253+0000","last_fullsized":"2024-09-12T01:07:38.041253+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:33.044875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'28","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.041394+0000","last_change":"2024-09-12T00:27:42.841054+0000","last_active":"2024-09-12T01:07:25.041394+0000","last_peered":"2024-09-12T01:07:25.041394+0000","last_clean":"2024-09-12T01:07:25.041394+0000","last_became_active":"2024-09-12T00:27:42.840749+0000","last_became_peered":"2024-09-12T00:27:42.840749+0000","last_unstale":"2024-09-12T01:07:25.041394+0000","last_undegraded":"2024-09-12T01:07:25.041394+0000","last_fullsized":"2024-09-12T01:07:25.041394+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:58.932432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":101,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.046768+0000","last_change":"2024-09-12T00:46:54.876242+0000","last_active":"2024-09-12T01:08:00.046768+0000","last_peered":"2024-09-12T01:08:00.046768+0000","last_clean":"2024-09-12T01:08:00.046768+0000","last_became_active":"2024-09-12T00:46:54.875939+0000","last_became_peered":"2024-09-12T00:46:54.875939+0000","last_unstale":"2024-09-12T01:08:00.046768+0000","last_undegraded":"2024-09-12T01:08:00.046768+0000","last_fullsized":"2024-09-12T01:08:00.046768+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:39.634295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043775+0000","last_change":"2024-09-12T00:30:17.761490+0000","last_active":"2024-09-12T01:07:40.043775+0000","last_peered":"2024-09-12T01:07:40.043775+0000","last_clean":"2024-09-12T01:07:40.043775+0000","last_became_active":"2024-09-12T00:30:17.761182+0000","last_became_peered":"2024-09-12T00:30:17.761182+0000","last_unstale":"2024-09-12T01:07:40.043775+0000","last_undegraded":"2024-09-12T01:07:40.043775+0000","last_fullsized":"2024-09-12T01:07:40.043775+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:42.070821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.233715+0000","last_change":"2024-09-12T00:30:14.748190+0000","last_active":"2024-09-12T01:07:35.233715+0000","last_peered":"2024-09-12T01:07:35.233715+0000","last_clean":"2024-09-12T01:07:35.233715+0000","last_became_active":"2024-09-12T00:30:14.747887+0000","last_became_peered":"2024-09-12T00:30:14.747887+0000","last_unstale":"2024-09-12T01:07:35.233715+0000","last_undegraded":"2024-09-12T01:07:35.233715+0000","last_fullsized":"2024-09-12T01:07:35.233715+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:51.879862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'76","reported_seq":312,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.132545+0000","last_change":"2024-09-12T00:27:42.839562+0000","last_active":"2024-09-12T01:07:25.132545+0000","last_peered":"2024-09-12T01:07:25.132545+0000","last_clean":"2024-09-12T01:07:25.132545+0000","last_became_active":"2024-09-12T00:27:42.839295+0000","last_became_peered":"2024-09-12T00:27:42.839295+0000","last_unstale":"2024-09-12T01:07:25.132545+0000","last_undegraded":"2024-09-12T01:07:25.132545+0000","last_fullsized":"2024-09-12T01:07:25.132545+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:56.924650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":349,"num_write":102,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:15.147394+0000","last_change":"2024-09-12T00:46:54.881248+0000","last_active":"2024-09-12T01:06:15.147394+0000","last_peered":"2024-09-12T01:06:15.147394+0000","last_clean":"2024-09-12T01:06:15.147394+0000","last_became_active":"2024-09-12T00:46:54.880982+0000","last_became_peered":"2024-09-12T00:46:54.880982+0000","last_unstale":"2024-09-12T01:06:15.147394+0000","last_undegraded":"2024-09-12T01:06:15.147394+0000","last_fullsized":"2024-09-12T01:06:15.147394+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:32.451032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"263'1","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.041046+0000","last_change":"2024-09-12T00:30:17.766356+0000","last_active":"2024-09-12T01:07:40.041046+0000","last_peered":"2024-09-12T01:07:40.041046+0000","last_clean":"2024-09-12T01:07:40.041046+0000","last_became_active":"2024-09-12T00:30:17.765384+0000","last_became_peered":"2024-09-12T00:30:17.765384+0000","last_unstale":"2024-09-12T01:07:40.041046+0000","last_undegraded":"2024-09-12T01:07:40.041046+0000","last_fullsized":"2024-09-12T01:07:40.041046+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:48.714095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.233741+0000","last_change":"2024-09-12T00:30:14.750712+0000","last_active":"2024-09-12T01:07:35.233741+0000","last_peered":"2024-09-12T01:07:35.233741+0000","last_clean":"2024-09-12T01:07:35.233741+0000","last_became_active":"2024-09-12T00:30:14.750407+0000","last_became_peered":"2024-09-12T00:30:14.750407+0000","last_unstale":"2024-09-12T01:07:35.233741+0000","last_undegraded":"2024-09-12T01:07:35.233741+0000","last_fullsized":"2024-09-12T01:07:35.233741+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:38.391719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4778667,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5691,"num_write":4,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'35","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.041332+0000","last_change":"2024-09-12T00:27:42.840411+0000","last_active":"2024-09-12T01:07:25.041332+0000","last_peered":"2024-09-12T01:07:25.041332+0000","last_clean":"2024-09-12T01:07:25.041332+0000","last_became_active":"2024-09-12T00:27:42.840137+0000","last_became_peered":"2024-09-12T00:27:42.840137+0000","last_unstale":"2024-09-12T01:07:25.041332+0000","last_undegraded":"2024-09-12T01:07:25.041332+0000","last_fullsized":"2024-09-12T01:07:25.041332+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:08.491063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":59,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:43.051166+0000","last_change":"2024-09-12T00:46:54.888517+0000","last_active":"2024-09-12T01:08:43.051166+0000","last_peered":"2024-09-12T01:08:43.051166+0000","last_clean":"2024-09-12T01:08:43.051166+0000","last_became_active":"2024-09-12T00:46:54.888207+0000","last_became_peered":"2024-09-12T00:46:54.888207+0000","last_unstale":"2024-09-12T01:08:43.051166+0000","last_undegraded":"2024-09-12T01:08:43.051166+0000","last_fullsized":"2024-09-12T01:08:43.051166+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:38.971555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052311+0000","last_change":"2024-09-12T00:30:17.763396+0000","last_active":"2024-09-12T01:08:35.052311+0000","last_peered":"2024-09-12T01:08:35.052311+0000","last_clean":"2024-09-12T01:08:35.052311+0000","last_became_active":"2024-09-12T00:30:17.763106+0000","last_became_peered":"2024-09-12T00:30:17.763106+0000","last_unstale":"2024-09-12T01:08:35.052311+0000","last_undegraded":"2024-09-12T01:08:35.052311+0000","last_fullsized":"2024-09-12T01:08:35.052311+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:48.609847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":9,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.139974+0000","last_change":"2024-09-12T00:30:14.746340+0000","last_active":"2024-09-12T01:08:30.139974+0000","last_peered":"2024-09-12T01:08:30.139974+0000","last_clean":"2024-09-12T01:08:30.139974+0000","last_became_active":"2024-09-12T00:30:14.746069+0000","last_became_peered":"2024-09-12T00:30:14.746069+0000","last_unstale":"2024-09-12T01:08:30.139974+0000","last_undegraded":"2024-09-12T01:08:30.139974+0000","last_fullsized":"2024-09-12T01:08:30.139974+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:13.259839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'41","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.049662+0000","last_change":"2024-09-12T00:27:42.841822+0000","last_active":"2024-09-12T01:08:20.049662+0000","last_peered":"2024-09-12T01:08:20.049662+0000","last_clean":"2024-09-12T01:08:20.049662+0000","last_became_active":"2024-09-12T00:27:42.841530+0000","last_became_peered":"2024-09-12T00:27:42.841530+0000","last_unstale":"2024-09-12T01:08:20.049662+0000","last_undegraded":"2024-09-12T01:08:20.049662+0000","last_fullsized":"2024-09-12T01:08:20.049662+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:31.785686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.231129+0000","last_change":"2024-09-12T00:46:54.886162+0000","last_active":"2024-09-12T01:07:10.231129+0000","last_peered":"2024-09-12T01:07:10.231129+0000","last_clean":"2024-09-12T01:07:10.231129+0000","last_became_active":"2024-09-12T00:46:54.885842+0000","last_became_peered":"2024-09-12T00:46:54.885842+0000","last_unstale":"2024-09-12T01:07:10.231129+0000","last_undegraded":"2024-09-12T01:07:10.231129+0000","last_fullsized":"2024-09-12T01:07:10.231129+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:09.698110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'6","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052277+0000","last_change":"2024-09-12T00:30:17.765752+0000","last_active":"2024-09-12T01:08:35.052277+0000","last_peered":"2024-09-12T01:08:35.052277+0000","last_clean":"2024-09-12T01:08:35.052277+0000","last_became_active":"2024-09-12T00:30:17.765404+0000","last_became_peered":"2024-09-12T00:30:17.765404+0000","last_unstale":"2024-09-12T01:08:35.052277+0000","last_undegraded":"2024-09-12T01:08:35.052277+0000","last_fullsized":"2024-09-12T01:08:35.052277+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:56.259889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.167293+0000","last_change":"2024-09-12T00:30:14.743435+0000","last_active":"2024-09-12T01:08:30.167293+0000","last_peered":"2024-09-12T01:08:30.167293+0000","last_clean":"2024-09-12T01:08:30.167293+0000","last_became_active":"2024-09-12T00:30:14.743148+0000","last_became_peered":"2024-09-12T00:30:14.743148+0000","last_unstale":"2024-09-12T01:08:30.167293+0000","last_undegraded":"2024-09-12T01:08:30.167293+0000","last_fullsized":"2024-09-12T01:08:30.167293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:22.367871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'37","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045203+0000","last_change":"2024-09-12T00:27:42.846410+0000","last_active":"2024-09-12T01:08:15.045203+0000","last_peered":"2024-09-12T01:08:15.045203+0000","last_clean":"2024-09-12T01:08:15.045203+0000","last_became_active":"2024-09-12T00:27:42.846090+0000","last_became_peered":"2024-09-12T00:27:42.846090+0000","last_unstale":"2024-09-12T01:08:15.045203+0000","last_undegraded":"2024-09-12T01:08:15.045203+0000","last_fullsized":"2024-09-12T01:08:15.045203+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:24.133207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":132,"num_write":69,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.047409+0000","last_change":"2024-09-12T00:46:54.883396+0000","last_active":"2024-09-12T01:08:35.047409+0000","last_peered":"2024-09-12T01:08:35.047409+0000","last_clean":"2024-09-12T01:08:35.047409+0000","last_became_active":"2024-09-12T00:46:54.883024+0000","last_became_peered":"2024-09-12T00:46:54.883024+0000","last_unstale":"2024-09-12T01:08:35.047409+0000","last_undegraded":"2024-09-12T01:08:35.047409+0000","last_fullsized":"2024-09-12T01:08:35.047409+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:27.222440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'1","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.053193+0000","last_change":"2024-09-12T00:30:17.769409+0000","last_active":"2024-09-12T01:08:40.053193+0000","last_peered":"2024-09-12T01:08:40.053193+0000","last_clean":"2024-09-12T01:08:40.053193+0000","last_became_active":"2024-09-12T00:30:17.769226+0000","last_became_peered":"2024-09-12T00:30:17.769226+0000","last_unstale":"2024-09-12T01:08:40.053193+0000","last_undegraded":"2024-09-12T01:08:40.053193+0000","last_fullsized":"2024-09-12T01:08:40.053193+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:53.397913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.051372+0000","last_change":"2024-09-12T00:30:14.741263+0000","last_active":"2024-09-12T01:08:30.051372+0000","last_peered":"2024-09-12T01:08:30.051372+0000","last_clean":"2024-09-12T01:08:30.051372+0000","last_became_active":"2024-09-12T00:30:14.740963+0000","last_became_peered":"2024-09-12T00:30:14.740963+0000","last_unstale":"2024-09-12T01:08:30.051372+0000","last_undegraded":"2024-09-12T01:08:30.051372+0000","last_fullsized":"2024-09-12T01:08:30.051372+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:55.514008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.238012+0000","last_change":"2024-09-12T00:27:42.835227+0000","last_active":"2024-09-12T01:08:15.238012+0000","last_peered":"2024-09-12T01:08:15.238012+0000","last_clean":"2024-09-12T01:08:15.238012+0000","last_became_active":"2024-09-12T00:27:42.834942+0000","last_became_peered":"2024-09-12T00:27:42.834942+0000","last_unstale":"2024-09-12T01:08:15.238012+0000","last_undegraded":"2024-09-12T01:08:15.238012+0000","last_fullsized":"2024-09-12T01:08:15.238012+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:10.179555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":105,"num_write":60,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.240177+0000","last_change":"2024-09-12T00:46:54.888100+0000","last_active":"2024-09-12T01:08:35.240177+0000","last_peered":"2024-09-12T01:08:35.240177+0000","last_clean":"2024-09-12T01:08:35.240177+0000","last_became_active":"2024-09-12T00:46:54.887303+0000","last_became_peered":"2024-09-12T00:46:54.887303+0000","last_unstale":"2024-09-12T01:08:35.240177+0000","last_undegraded":"2024-09-12T01:08:35.240177+0000","last_fullsized":"2024-09-12T01:08:35.240177+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:37.539140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"263'1","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.049760+0000","last_change":"2024-09-12T00:30:17.768358+0000","last_active":"2024-09-12T01:08:33.049760+0000","last_peered":"2024-09-12T01:08:33.049760+0000","last_clean":"2024-09-12T01:08:33.049760+0000","last_became_active":"2024-09-12T00:30:17.768072+0000","last_became_peered":"2024-09-12T00:30:17.768072+0000","last_unstale":"2024-09-12T01:08:33.049760+0000","last_undegraded":"2024-09-12T01:08:33.049760+0000","last_fullsized":"2024-09-12T01:08:33.049760+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:13.328589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'1","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052381+0000","last_change":"2024-09-12T00:30:14.744984+0000","last_active":"2024-09-12T01:08:35.052381+0000","last_peered":"2024-09-12T01:08:35.052381+0000","last_clean":"2024-09-12T01:08:35.052381+0000","last_became_active":"2024-09-12T00:30:14.744485+0000","last_became_peered":"2024-09-12T00:30:14.744485+0000","last_unstale":"2024-09-12T01:08:35.052381+0000","last_undegraded":"2024-09-12T01:08:35.052381+0000","last_fullsized":"2024-09-12T01:08:35.052381+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:02.930319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'50","reported_seq":195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165137+0000","last_change":"2024-09-12T00:27:42.839068+0000","last_active":"2024-09-12T01:08:15.165137+0000","last_peered":"2024-09-12T01:08:15.165137+0000","last_clean":"2024-09-12T01:08:15.165137+0000","last_became_active":"2024-09-12T00:27:42.838771+0000","last_became_peered":"2024-09-12T00:27:42.838771+0000","last_unstale":"2024-09-12T01:08:15.165137+0000","last_undegraded":"2024-09-12T01:08:15.165137+0000","last_fullsized":"2024-09-12T01:08:15.165137+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:39.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":194,"num_write":94,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.037715+0000","last_change":"2024-09-12T00:46:54.884379+0000","last_active":"2024-09-12T01:07:13.037715+0000","last_peered":"2024-09-12T01:07:13.037715+0000","last_clean":"2024-09-12T01:07:13.037715+0000","last_became_active":"2024-09-12T00:46:54.883927+0000","last_became_peered":"2024-09-12T00:46:54.883927+0000","last_unstale":"2024-09-12T01:07:13.037715+0000","last_undegraded":"2024-09-12T01:07:13.037715+0000","last_fullsized":"2024-09-12T01:07:13.037715+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:13.845718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'1","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.037600+0000","last_change":"2024-09-12T00:30:17.761674+0000","last_active":"2024-09-12T01:07:10.037600+0000","last_peered":"2024-09-12T01:07:10.037600+0000","last_clean":"2024-09-12T01:07:10.037600+0000","last_became_active":"2024-09-12T00:30:17.761176+0000","last_became_peered":"2024-09-12T00:30:17.761176+0000","last_unstale":"2024-09-12T01:07:10.037600+0000","last_undegraded":"2024-09-12T01:07:10.037600+0000","last_fullsized":"2024-09-12T01:07:10.037600+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.925976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48429,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'1","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:05.037838+0000","last_change":"2024-09-12T00:30:14.744748+0000","last_active":"2024-09-12T01:07:05.037838+0000","last_peered":"2024-09-12T01:07:05.037838+0000","last_clean":"2024-09-12T01:07:05.037838+0000","last_became_active":"2024-09-12T00:30:14.743730+0000","last_became_peered":"2024-09-12T00:30:14.743730+0000","last_unstale":"2024-09-12T01:07:05.037838+0000","last_undegraded":"2024-09-12T01:07:05.037838+0000","last_fullsized":"2024-09-12T01:07:05.037838+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:40.137757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'40","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165081+0000","last_change":"2024-09-12T00:27:42.842498+0000","last_active":"2024-09-12T01:08:15.165081+0000","last_peered":"2024-09-12T01:08:15.165081+0000","last_clean":"2024-09-12T01:08:15.165081+0000","last_became_active":"2024-09-12T00:27:42.842267+0000","last_became_peered":"2024-09-12T00:27:42.842267+0000","last_unstale":"2024-09-12T01:08:15.165081+0000","last_undegraded":"2024-09-12T01:08:15.165081+0000","last_fullsized":"2024-09-12T01:08:15.165081+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:13.278076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":155,"num_write":62,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:15.131566+0000","last_change":"2024-09-12T00:46:54.889599+0000","last_active":"2024-09-12T01:07:15.131566+0000","last_peered":"2024-09-12T01:07:15.131566+0000","last_clean":"2024-09-12T01:07:15.131566+0000","last_became_active":"2024-09-12T00:46:54.889349+0000","last_became_peered":"2024-09-12T00:46:54.889349+0000","last_unstale":"2024-09-12T01:07:15.131566+0000","last_undegraded":"2024-09-12T01:07:15.131566+0000","last_fullsized":"2024-09-12T01:07:15.131566+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:02.442642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.130933+0000","last_change":"2024-09-12T00:30:17.760081+0000","last_active":"2024-09-12T01:07:10.130933+0000","last_peered":"2024-09-12T01:07:10.130933+0000","last_clean":"2024-09-12T01:07:10.130933+0000","last_became_active":"2024-09-12T00:30:17.759769+0000","last_became_peered":"2024-09-12T00:30:17.759769+0000","last_unstale":"2024-09-12T01:07:10.130933+0000","last_undegraded":"2024-09-12T01:07:10.130933+0000","last_fullsized":"2024-09-12T01:07:10.130933+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:22.158179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.036968+0000","last_change":"2024-09-12T00:30:14.748668+0000","last_active":"2024-09-12T01:07:08.036968+0000","last_peered":"2024-09-12T01:07:08.036968+0000","last_clean":"2024-09-12T01:07:08.036968+0000","last_became_active":"2024-09-12T00:30:14.748409+0000","last_became_peered":"2024-09-12T00:30:14.748409+0000","last_unstale":"2024-09-12T01:07:08.036968+0000","last_undegraded":"2024-09-12T01:07:08.036968+0000","last_fullsized":"2024-09-12T01:07:08.036968+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:15.762806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'24","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.128541+0000","last_change":"2024-09-12T00:27:42.844619+0000","last_active":"2024-09-12T01:06:50.128541+0000","last_peered":"2024-09-12T01:06:50.128541+0000","last_clean":"2024-09-12T01:06:50.128541+0000","last_became_active":"2024-09-12T00:27:42.844338+0000","last_became_peered":"2024-09-12T00:27:42.844338+0000","last_unstale":"2024-09-12T01:06:50.128541+0000","last_undegraded":"2024-09-12T01:06:50.128541+0000","last_fullsized":"2024-09-12T01:06:50.128541+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:10.822999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":85,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.024797+0000","last_change":"2024-09-12T00:46:54.890993+0000","last_active":"2024-09-12T01:07:10.024797+0000","last_peered":"2024-09-12T01:07:10.024797+0000","last_clean":"2024-09-12T01:07:10.024797+0000","last_became_active":"2024-09-12T00:46:54.890636+0000","last_became_peered":"2024-09-12T00:46:54.890636+0000","last_unstale":"2024-09-12T01:07:10.024797+0000","last_undegraded":"2024-09-12T01:07:10.024797+0000","last_fullsized":"2024-09-12T01:07:10.024797+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:05.237293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.169493+0000","last_change":"2024-09-12T00:30:17.762552+0000","last_active":"2024-09-12T01:08:35.169493+0000","last_peered":"2024-09-12T01:08:35.169493+0000","last_clean":"2024-09-12T01:08:35.169493+0000","last_became_active":"2024-09-12T00:30:17.762239+0000","last_became_peered":"2024-09-12T00:30:17.762239+0000","last_unstale":"2024-09-12T01:08:35.169493+0000","last_undegraded":"2024-09-12T01:08:35.169493+0000","last_fullsized":"2024-09-12T01:08:35.169493+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:41.552516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'8","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.038702+0000","last_change":"2024-09-12T00:30:14.751029+0000","last_active":"2024-09-12T01:07:10.038702+0000","last_peered":"2024-09-12T01:07:10.038702+0000","last_clean":"2024-09-12T01:07:10.038702+0000","last_became_active":"2024-09-12T00:30:14.750745+0000","last_became_peered":"2024-09-12T00:30:14.750745+0000","last_unstale":"2024-09-12T01:07:10.038702+0000","last_undegraded":"2024-09-12T01:07:10.038702+0000","last_fullsized":"2024-09-12T01:07:10.038702+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:09.884275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5827243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":12861,"num_write":13,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:43.033206+0000","last_change":"2024-09-12T00:27:42.837910+0000","last_active":"2024-09-12T01:06:43.033206+0000","last_peered":"2024-09-12T01:06:43.033206+0000","last_clean":"2024-09-12T01:06:43.033206+0000","last_became_active":"2024-09-12T00:27:42.837690+0000","last_became_peered":"2024-09-12T00:27:42.837690+0000","last_unstale":"2024-09-12T01:06:43.033206+0000","last_undegraded":"2024-09-12T01:06:43.033206+0000","last_fullsized":"2024-09-12T01:06:43.033206+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:00.171095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.038780+0000","last_change":"2024-09-12T00:46:54.885537+0000","last_active":"2024-09-12T01:07:10.038780+0000","last_peered":"2024-09-12T01:07:10.038780+0000","last_clean":"2024-09-12T01:07:10.038780+0000","last_became_active":"2024-09-12T00:46:54.885262+0000","last_became_peered":"2024-09-12T00:46:54.885262+0000","last_unstale":"2024-09-12T01:07:10.038780+0000","last_undegraded":"2024-09-12T01:07:10.038780+0000","last_fullsized":"2024-09-12T01:07:10.038780+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:34.916083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'7","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.026327+0000","last_change":"2024-09-12T00:30:17.761394+0000","last_active":"2024-09-12T01:07:25.026327+0000","last_peered":"2024-09-12T01:07:25.026327+0000","last_clean":"2024-09-12T01:07:25.026327+0000","last_became_active":"2024-09-12T00:30:17.761071+0000","last_became_peered":"2024-09-12T00:30:17.761071+0000","last_unstale":"2024-09-12T01:07:25.026327+0000","last_undegraded":"2024-09-12T01:07:25.026327+0000","last_fullsized":"2024-09-12T01:07:25.026327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:56.989395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.046932+0000","last_change":"2024-09-12T00:30:14.750202+0000","last_active":"2024-09-12T01:08:30.046932+0000","last_peered":"2024-09-12T01:08:30.046932+0000","last_clean":"2024-09-12T01:08:30.046932+0000","last_became_active":"2024-09-12T00:30:14.749906+0000","last_became_peered":"2024-09-12T00:30:14.749906+0000","last_unstale":"2024-09-12T01:08:30.046932+0000","last_undegraded":"2024-09-12T01:08:30.046932+0000","last_fullsized":"2024-09-12T01:08:30.046932+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:25.050487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'11","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.022023+0000","last_change":"2024-09-12T00:27:42.837136+0000","last_active":"2024-09-12T01:06:45.022023+0000","last_peered":"2024-09-12T01:06:45.022023+0000","last_clean":"2024-09-12T01:06:45.022023+0000","last_became_active":"2024-09-12T00:27:42.836870+0000","last_became_peered":"2024-09-12T00:27:42.836870+0000","last_unstale":"2024-09-12T01:06:45.022023+0000","last_undegraded":"2024-09-12T01:06:45.022023+0000","last_fullsized":"2024-09-12T01:06:45.022023+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:28.106493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.028516+0000","last_change":"2024-09-12T00:46:54.891625+0000","last_active":"2024-09-12T01:07:45.028516+0000","last_peered":"2024-09-12T01:07:45.028516+0000","last_clean":"2024-09-12T01:07:45.028516+0000","last_became_active":"2024-09-12T00:46:54.891359+0000","last_became_peered":"2024-09-12T00:46:54.891359+0000","last_unstale":"2024-09-12T01:07:45.028516+0000","last_undegraded":"2024-09-12T01:07:45.028516+0000","last_fullsized":"2024-09-12T01:07:45.028516+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:36.674826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.044429+0000","last_change":"2024-09-12T00:30:17.767137+0000","last_active":"2024-09-12T01:07:58.044429+0000","last_peered":"2024-09-12T01:07:58.044429+0000","last_clean":"2024-09-12T01:07:58.044429+0000","last_became_active":"2024-09-12T00:30:17.766810+0000","last_became_peered":"2024-09-12T00:30:17.766810+0000","last_unstale":"2024-09-12T01:07:58.044429+0000","last_undegraded":"2024-09-12T01:07:58.044429+0000","last_fullsized":"2024-09-12T01:07:58.044429+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:50.589394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041701+0000","last_change":"2024-09-12T00:30:14.744674+0000","last_active":"2024-09-12T01:07:45.041701+0000","last_peered":"2024-09-12T01:07:45.041701+0000","last_clean":"2024-09-12T01:07:45.041701+0000","last_became_active":"2024-09-12T00:30:14.744334+0000","last_became_peered":"2024-09-12T00:30:14.744334+0000","last_unstale":"2024-09-12T01:07:45.041701+0000","last_undegraded":"2024-09-12T01:07:45.041701+0000","last_fullsized":"2024-09-12T01:07:45.041701+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:58.360546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.034356+0000","last_change":"2024-09-12T00:27:42.836761+0000","last_active":"2024-09-12T01:06:45.034356+0000","last_peered":"2024-09-12T01:06:45.034356+0000","last_clean":"2024-09-12T01:06:45.034356+0000","last_became_active":"2024-09-12T00:27:42.836468+0000","last_became_peered":"2024-09-12T00:27:42.836468+0000","last_unstale":"2024-09-12T01:06:45.034356+0000","last_undegraded":"2024-09-12T01:06:45.034356+0000","last_fullsized":"2024-09-12T01:06:45.034356+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:01.432222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":155,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.028541+0000","last_change":"2024-09-12T00:46:54.888800+0000","last_active":"2024-09-12T01:07:45.028541+0000","last_peered":"2024-09-12T01:07:45.028541+0000","last_clean":"2024-09-12T01:07:45.028541+0000","last_became_active":"2024-09-12T00:46:54.888533+0000","last_became_peered":"2024-09-12T00:46:54.888533+0000","last_unstale":"2024-09-12T01:07:45.028541+0000","last_undegraded":"2024-09-12T01:07:45.028541+0000","last_fullsized":"2024-09-12T01:07:45.028541+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:16.016312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'3","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042911+0000","last_change":"2024-09-12T00:30:17.766100+0000","last_active":"2024-09-12T01:07:48.042911+0000","last_peered":"2024-09-12T01:07:48.042911+0000","last_clean":"2024-09-12T01:07:48.042911+0000","last_became_active":"2024-09-12T00:30:17.764747+0000","last_became_peered":"2024-09-12T00:30:17.764747+0000","last_unstale":"2024-09-12T01:07:48.042911+0000","last_undegraded":"2024-09-12T01:07:48.042911+0000","last_fullsized":"2024-09-12T01:07:48.042911+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:28.017911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045464+0000","last_change":"2024-09-12T00:30:14.750085+0000","last_active":"2024-09-12T01:07:50.045464+0000","last_peered":"2024-09-12T01:07:50.045464+0000","last_clean":"2024-09-12T01:07:50.045464+0000","last_became_active":"2024-09-12T00:30:14.749668+0000","last_became_peered":"2024-09-12T00:30:14.749668+0000","last_unstale":"2024-09-12T01:07:50.045464+0000","last_undegraded":"2024-09-12T01:07:50.045464+0000","last_fullsized":"2024-09-12T01:07:50.045464+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:46.909054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'44","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.034744+0000","last_change":"2024-09-12T00:27:42.846229+0000","last_active":"2024-09-12T01:06:45.034744+0000","last_peered":"2024-09-12T01:06:45.034744+0000","last_clean":"2024-09-12T01:06:45.034744+0000","last_became_active":"2024-09-12T00:27:42.845963+0000","last_became_peered":"2024-09-12T00:27:42.845963+0000","last_unstale":"2024-09-12T01:06:45.034744+0000","last_undegraded":"2024-09-12T01:06:45.034744+0000","last_fullsized":"2024-09-12T01:06:45.034744+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:39.746358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":173,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:03.036079+0000","last_change":"2024-09-12T00:46:54.885230+0000","last_active":"2024-09-12T01:07:03.036079+0000","last_peered":"2024-09-12T01:07:03.036079+0000","last_clean":"2024-09-12T01:07:03.036079+0000","last_became_active":"2024-09-12T00:46:54.884950+0000","last_became_peered":"2024-09-12T00:46:54.884950+0000","last_unstale":"2024-09-12T01:07:03.036079+0000","last_undegraded":"2024-09-12T01:07:03.036079+0000","last_fullsized":"2024-09-12T01:07:03.036079+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:05.858636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"263'1","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.024836+0000","last_change":"2024-09-12T00:30:17.762675+0000","last_active":"2024-09-12T01:07:10.024836+0000","last_peered":"2024-09-12T01:07:10.024836+0000","last_clean":"2024-09-12T01:07:10.024836+0000","last_became_active":"2024-09-12T00:30:17.762415+0000","last_became_peered":"2024-09-12T00:30:17.762415+0000","last_unstale":"2024-09-12T01:07:10.024836+0000","last_undegraded":"2024-09-12T01:07:10.024836+0000","last_fullsized":"2024-09-12T01:07:10.024836+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:08.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:05.130460+0000","last_change":"2024-09-12T00:30:14.748878+0000","last_active":"2024-09-12T01:07:05.130460+0000","last_peered":"2024-09-12T01:07:05.130460+0000","last_clean":"2024-09-12T01:07:05.130460+0000","last_became_active":"2024-09-12T00:30:14.748581+0000","last_became_peered":"2024-09-12T00:30:14.748581+0000","last_unstale":"2024-09-12T01:07:05.130460+0000","last_undegraded":"2024-09-12T01:07:05.130460+0000","last_fullsized":"2024-09-12T01:07:05.130460+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:51.379006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":7170,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.132599+0000","last_change":"2024-09-12T00:27:42.844241+0000","last_active":"2024-09-12T01:07:25.132599+0000","last_peered":"2024-09-12T01:07:25.132599+0000","last_clean":"2024-09-12T01:07:25.132599+0000","last_became_active":"2024-09-12T00:27:42.843968+0000","last_became_peered":"2024-09-12T00:27:42.843968+0000","last_unstale":"2024-09-12T01:07:25.132599+0000","last_undegraded":"2024-09-12T01:07:25.132599+0000","last_fullsized":"2024-09-12T01:07:25.132599+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:47.646443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":171,"num_write":76,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041617+0000","last_change":"2024-09-12T00:46:54.881183+0000","last_active":"2024-09-12T01:07:45.041617+0000","last_peered":"2024-09-12T01:07:45.041617+0000","last_clean":"2024-09-12T01:07:45.041617+0000","last_became_active":"2024-09-12T00:46:54.880874+0000","last_became_peered":"2024-09-12T00:46:54.880874+0000","last_unstale":"2024-09-12T01:07:45.041617+0000","last_undegraded":"2024-09-12T01:07:45.041617+0000","last_fullsized":"2024-09-12T01:07:45.041617+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:52.663395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.037704+0000","last_change":"2024-09-12T00:30:17.764321+0000","last_active":"2024-09-12T01:07:10.037704+0000","last_peered":"2024-09-12T01:07:10.037704+0000","last_clean":"2024-09-12T01:07:10.037704+0000","last_became_active":"2024-09-12T00:30:17.762807+0000","last_became_peered":"2024-09-12T00:30:17.762807+0000","last_unstale":"2024-09-12T01:07:10.037704+0000","last_undegraded":"2024-09-12T01:07:10.037704+0000","last_fullsized":"2024-09-12T01:07:10.037704+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:22.911043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:05.037172+0000","last_change":"2024-09-12T00:30:14.750078+0000","last_active":"2024-09-12T01:07:05.037172+0000","last_peered":"2024-09-12T01:07:05.037172+0000","last_clean":"2024-09-12T01:07:05.037172+0000","last_became_active":"2024-09-12T00:30:14.749608+0000","last_became_peered":"2024-09-12T00:30:14.749608+0000","last_unstale":"2024-09-12T01:07:05.037172+0000","last_undegraded":"2024-09-12T01:07:05.037172+0000","last_fullsized":"2024-09-12T01:07:05.037172+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:51.387598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'41","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.040525+0000","last_change":"2024-09-12T00:27:42.846138+0000","last_active":"2024-09-12T01:07:20.040525+0000","last_peered":"2024-09-12T01:07:20.040525+0000","last_clean":"2024-09-12T01:07:20.040525+0000","last_became_active":"2024-09-12T00:27:42.845889+0000","last_became_peered":"2024-09-12T00:27:42.845889+0000","last_unstale":"2024-09-12T01:07:20.040525+0000","last_undegraded":"2024-09-12T01:07:20.040525+0000","last_fullsized":"2024-09-12T01:07:20.040525+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:08.298324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":162,"num_write":61,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052331+0000","last_change":"2024-09-12T00:46:54.887517+0000","last_active":"2024-09-12T01:08:35.052331+0000","last_peered":"2024-09-12T01:08:35.052331+0000","last_clean":"2024-09-12T01:08:35.052331+0000","last_became_active":"2024-09-12T00:46:54.887206+0000","last_became_peered":"2024-09-12T00:46:54.887206+0000","last_unstale":"2024-09-12T01:08:35.052331+0000","last_undegraded":"2024-09-12T01:08:35.052331+0000","last_fullsized":"2024-09-12T01:08:35.052331+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:31.785829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045384+0000","last_change":"2024-09-12T00:30:17.768384+0000","last_active":"2024-09-12T01:07:50.045384+0000","last_peered":"2024-09-12T01:07:50.045384+0000","last_clean":"2024-09-12T01:07:50.045384+0000","last_became_active":"2024-09-12T00:30:17.767990+0000","last_became_peered":"2024-09-12T00:30:17.767990+0000","last_unstale":"2024-09-12T01:07:50.045384+0000","last_undegraded":"2024-09-12T01:07:50.045384+0000","last_fullsized":"2024-09-12T01:07:50.045384+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:34.324472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"263'1","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.138616+0000","last_change":"2024-09-12T00:30:14.745501+0000","last_active":"2024-09-12T01:08:20.138616+0000","last_peered":"2024-09-12T01:08:20.138616+0000","last_clean":"2024-09-12T01:08:20.138616+0000","last_became_active":"2024-09-12T00:30:14.745195+0000","last_became_peered":"2024-09-12T00:30:14.745195+0000","last_unstale":"2024-09-12T01:08:20.138616+0000","last_undegraded":"2024-09-12T01:08:20.138616+0000","last_fullsized":"2024-09-12T01:08:20.138616+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:05.190444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'32","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.132064+0000","last_change":"2024-09-12T00:27:42.844201+0000","last_active":"2024-09-12T01:07:20.132064+0000","last_peered":"2024-09-12T01:07:20.132064+0000","last_clean":"2024-09-12T01:07:20.132064+0000","last_became_active":"2024-09-12T00:27:42.843841+0000","last_became_peered":"2024-09-12T00:27:42.843841+0000","last_unstale":"2024-09-12T01:07:20.132064+0000","last_undegraded":"2024-09-12T01:07:20.132064+0000","last_fullsized":"2024-09-12T01:07:20.132064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:33.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":99,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052355+0000","last_change":"2024-09-12T00:46:54.884403+0000","last_active":"2024-09-12T01:08:35.052355+0000","last_peered":"2024-09-12T01:08:35.052355+0000","last_clean":"2024-09-12T01:08:35.052355+0000","last_became_active":"2024-09-12T00:46:54.884110+0000","last_became_peered":"2024-09-12T00:46:54.884110+0000","last_unstale":"2024-09-12T01:08:35.052355+0000","last_undegraded":"2024-09-12T01:08:35.052355+0000","last_fullsized":"2024-09-12T01:08:35.052355+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:54.447390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'2","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.046869+0000","last_change":"2024-09-12T00:30:17.763239+0000","last_active":"2024-09-12T01:08:30.046869+0000","last_peered":"2024-09-12T01:08:30.046869+0000","last_clean":"2024-09-12T01:08:30.046869+0000","last_became_active":"2024-09-12T00:30:17.762850+0000","last_became_peered":"2024-09-12T00:30:17.762850+0000","last_unstale":"2024-09-12T01:08:30.046869+0000","last_undegraded":"2024-09-12T01:08:30.046869+0000","last_fullsized":"2024-09-12T01:08:30.046869+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:27.977927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'7","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041634+0000","last_change":"2024-09-12T00:30:14.736582+0000","last_active":"2024-09-12T01:07:45.041634+0000","last_peered":"2024-09-12T01:07:45.041634+0000","last_clean":"2024-09-12T01:07:45.041634+0000","last_became_active":"2024-09-12T00:30:14.736286+0000","last_became_peered":"2024-09-12T00:30:14.736286+0000","last_unstale":"2024-09-12T01:07:45.041634+0000","last_undegraded":"2024-09-12T01:07:45.041634+0000","last_fullsized":"2024-09-12T01:07:45.041634+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:21.074121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":14336,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'42","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.038717+0000","last_change":"2024-09-12T00:27:42.842160+0000","last_active":"2024-09-12T01:07:20.038717+0000","last_peered":"2024-09-12T01:07:20.038717+0000","last_clean":"2024-09-12T01:07:20.038717+0000","last_became_active":"2024-09-12T00:27:42.841880+0000","last_became_peered":"2024-09-12T00:27:42.841880+0000","last_unstale":"2024-09-12T01:07:20.038717+0000","last_undegraded":"2024-09-12T01:07:20.038717+0000","last_fullsized":"2024-09-12T01:07:20.038717+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:58.218462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":149,"num_write":77,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042872+0000","last_change":"2024-09-12T00:46:54.887508+0000","last_active":"2024-09-12T01:07:48.042872+0000","last_peered":"2024-09-12T01:07:48.042872+0000","last_clean":"2024-09-12T01:07:48.042872+0000","last_became_active":"2024-09-12T00:46:54.887241+0000","last_became_peered":"2024-09-12T00:46:54.887241+0000","last_unstale":"2024-09-12T01:07:48.042872+0000","last_undegraded":"2024-09-12T01:07:48.042872+0000","last_fullsized":"2024-09-12T01:07:48.042872+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:05.592034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135434+0000","last_change":"2024-09-12T00:30:17.763748+0000","last_active":"2024-09-12T01:07:50.135434+0000","last_peered":"2024-09-12T01:07:50.135434+0000","last_clean":"2024-09-12T01:07:50.135434+0000","last_became_active":"2024-09-12T00:30:17.763434+0000","last_became_peered":"2024-09-12T00:30:17.763434+0000","last_unstale":"2024-09-12T01:07:50.135434+0000","last_undegraded":"2024-09-12T01:07:50.135434+0000","last_fullsized":"2024-09-12T01:07:50.135434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:35.178500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160616+0000","last_change":"2024-09-12T00:30:14.745243+0000","last_active":"2024-09-12T01:07:45.160616+0000","last_peered":"2024-09-12T01:07:45.160616+0000","last_clean":"2024-09-12T01:07:45.160616+0000","last_became_active":"2024-09-12T00:30:14.744954+0000","last_became_peered":"2024-09-12T00:30:14.744954+0000","last_unstale":"2024-09-12T01:07:45.160616+0000","last_undegraded":"2024-09-12T01:07:45.160616+0000","last_fullsized":"2024-09-12T01:07:45.160616+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:54.776721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'51","reported_seq":181,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.038684+0000","last_change":"2024-09-12T00:27:42.843112+0000","last_active":"2024-09-12T01:07:20.038684+0000","last_peered":"2024-09-12T01:07:20.038684+0000","last_clean":"2024-09-12T01:07:20.038684+0000","last_became_active":"2024-09-12T00:27:42.842779+0000","last_became_peered":"2024-09-12T00:27:42.842779+0000","last_unstale":"2024-09-12T01:07:20.038684+0000","last_undegraded":"2024-09-12T01:07:20.038684+0000","last_fullsized":"2024-09-12T01:07:20.038684+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:44.649308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":161,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.042278+0000","last_change":"2024-09-12T00:46:54.882461+0000","last_active":"2024-09-12T01:07:50.042278+0000","last_peered":"2024-09-12T01:07:50.042278+0000","last_clean":"2024-09-12T01:07:50.042278+0000","last_became_active":"2024-09-12T00:46:54.882192+0000","last_became_peered":"2024-09-12T00:46:54.882192+0000","last_unstale":"2024-09-12T01:07:50.042278+0000","last_undegraded":"2024-09-12T01:07:50.042278+0000","last_fullsized":"2024-09-12T01:07:50.042278+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:45.883428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'4","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135413+0000","last_change":"2024-09-12T00:30:17.758495+0000","last_active":"2024-09-12T01:07:50.135413+0000","last_peered":"2024-09-12T01:07:50.135413+0000","last_clean":"2024-09-12T01:07:50.135413+0000","last_became_active":"2024-09-12T00:30:17.756710+0000","last_became_peered":"2024-09-12T00:30:17.756710+0000","last_unstale":"2024-09-12T01:07:50.135413+0000","last_undegraded":"2024-09-12T01:07:50.135413+0000","last_fullsized":"2024-09-12T01:07:50.135413+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:26.589681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.234862+0000","last_change":"2024-09-12T00:30:14.749818+0000","last_active":"2024-09-12T01:07:45.234862+0000","last_peered":"2024-09-12T01:07:45.234862+0000","last_clean":"2024-09-12T01:07:45.234862+0000","last_became_active":"2024-09-12T00:30:14.749353+0000","last_became_peered":"2024-09-12T00:30:14.749353+0000","last_unstale":"2024-09-12T01:07:45.234862+0000","last_undegraded":"2024-09-12T01:07:45.234862+0000","last_fullsized":"2024-09-12T01:07:45.234862+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.846302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'16","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135384+0000","last_change":"2024-09-12T00:27:42.846318+0000","last_active":"2024-09-12T01:07:50.135384+0000","last_peered":"2024-09-12T01:07:50.135384+0000","last_clean":"2024-09-12T01:07:50.135384+0000","last_became_active":"2024-09-12T00:27:42.846065+0000","last_became_peered":"2024-09-12T00:27:42.846065+0000","last_unstale":"2024-09-12T01:07:50.135384+0000","last_undegraded":"2024-09-12T01:07:50.135384+0000","last_fullsized":"2024-09-12T01:07:50.135384+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:12.594329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":60,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'298","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:41.152759+0000","last_change":"2024-09-12T00:12:36.042181+0000","last_active":"2024-09-12T01:08:41.152759+0000","last_peered":"2024-09-12T01:08:41.152759+0000","last_clean":"2024-09-12T01:08:41.152759+0000","last_became_active":"2024-09-12T00:12:36.041803+0000","last_became_peered":"2024-09-12T00:12:36.041803+0000","last_unstale":"2024-09-12T01:08:41.152759+0000","last_undegraded":"2024-09-12T01:08:41.152759+0000","last_fullsized":"2024-09-12T01:08:41.152759+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:47.399756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14292667,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":527,"num_read_kb":31202,"num_write":1099,"num_write_kb":36538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'78","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.234258+0000","last_change":"2024-09-12T00:12:38.036843+0000","last_active":"2024-09-12T01:07:40.234258+0000","last_peered":"2024-09-12T01:07:40.234258+0000","last_clean":"2024-09-12T01:07:40.234258+0000","last_became_active":"2024-09-12T00:12:38.035848+0000","last_became_peered":"2024-09-12T00:12:38.035848+0000","last_unstale":"2024-09-12T01:07:40.234258+0000","last_undegraded":"2024-09-12T01:07:40.234258+0000","last_fullsized":"2024-09-12T01:07:40.234258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:27.637600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":321,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'397","reported_seq":1170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.951540+0000","last_change":"2024-09-12T00:12:36.045798+0000","last_active":"2024-09-12T01:10:57.951540+0000","last_peered":"2024-09-12T01:10:57.951540+0000","last_clean":"2024-09-12T01:10:57.951540+0000","last_became_active":"2024-09-12T00:12:36.045325+0000","last_became_peered":"2024-09-12T00:12:36.045325+0000","last_unstale":"2024-09-12T01:10:57.951540+0000","last_undegraded":"2024-09-12T01:10:57.951540+0000","last_fullsized":"2024-09-12T01:10:57.951540+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:52.983449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12805006,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":973,"num_read_kb":48846,"num_write":1357,"num_write_kb":45958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'64","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.041016+0000","last_change":"2024-09-12T00:12:38.041199+0000","last_active":"2024-09-12T01:07:40.041016+0000","last_peered":"2024-09-12T01:07:40.041016+0000","last_clean":"2024-09-12T01:07:40.041016+0000","last_became_active":"2024-09-12T00:12:38.040122+0000","last_became_peered":"2024-09-12T00:12:38.040122+0000","last_unstale":"2024-09-12T01:07:40.041016+0000","last_undegraded":"2024-09-12T01:07:40.041016+0000","last_fullsized":"2024-09-12T01:07:40.041016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:46.078316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":259,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'270","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.932852+0000","last_change":"2024-09-12T00:12:36.040486+0000","last_active":"2024-09-12T01:10:57.932852+0000","last_peered":"2024-09-12T01:10:57.932852+0000","last_clean":"2024-09-12T01:10:57.932852+0000","last_became_active":"2024-09-12T00:12:36.039741+0000","last_became_peered":"2024-09-12T00:12:36.039741+0000","last_unstale":"2024-09-12T01:10:57.932852+0000","last_undegraded":"2024-09-12T01:10:57.932852+0000","last_fullsized":"2024-09-12T01:10:57.932852+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:20.639041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6701801,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":417,"num_read_kb":26393,"num_write":954,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'307","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.041068+0000","last_change":"2024-09-12T00:12:38.042224+0000","last_active":"2024-09-12T01:07:40.041068+0000","last_peered":"2024-09-12T01:07:40.041068+0000","last_clean":"2024-09-12T01:07:40.041068+0000","last_became_active":"2024-09-12T00:12:38.041795+0000","last_became_peered":"2024-09-12T00:12:38.041795+0000","last_unstale":"2024-09-12T01:07:40.041068+0000","last_undegraded":"2024-09-12T01:07:40.041068+0000","last_fullsized":"2024-09-12T01:07:40.041068+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:58.089809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1291,"num_read_kb":1053,"num_write":447,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'333","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.142268+0000","last_change":"2024-09-12T00:12:36.037299+0000","last_active":"2024-09-12T01:08:50.142268+0000","last_peered":"2024-09-12T01:08:50.142268+0000","last_clean":"2024-09-12T01:08:50.142268+0000","last_became_active":"2024-09-12T00:12:36.036970+0000","last_became_peered":"2024-09-12T00:12:36.036970+0000","last_unstale":"2024-09-12T01:08:50.142268+0000","last_undegraded":"2024-09-12T01:08:50.142268+0000","last_fullsized":"2024-09-12T01:08:50.142268+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:48.587739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15753149,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":493,"num_read_kb":29211,"num_write":1180,"num_write_kb":52081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'61","reported_seq":601,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043790+0000","last_change":"2024-09-12T00:12:38.039591+0000","last_active":"2024-09-12T01:07:40.043790+0000","last_peered":"2024-09-12T01:07:40.043790+0000","last_clean":"2024-09-12T01:07:40.043790+0000","last_became_active":"2024-09-12T00:12:38.039292+0000","last_became_peered":"2024-09-12T00:12:38.039292+0000","last_unstale":"2024-09-12T01:07:40.043790+0000","last_undegraded":"2024-09-12T01:07:40.043790+0000","last_fullsized":"2024-09-12T01:07:40.043790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:31.375488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":95,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'270","reported_seq":897,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.244373+0000","last_change":"2024-09-12T00:12:36.046560+0000","last_active":"2024-09-12T01:08:20.244373+0000","last_peered":"2024-09-12T01:08:20.244373+0000","last_clean":"2024-09-12T01:08:20.244373+0000","last_became_active":"2024-09-12T00:12:36.044021+0000","last_became_peered":"2024-09-12T00:12:36.044021+0000","last_unstale":"2024-09-12T01:08:20.244373+0000","last_undegraded":"2024-09-12T01:08:20.244373+0000","last_fullsized":"2024-09-12T01:08:20.244373+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:49.437691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11192773,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":385,"num_read_kb":19077,"num_write":935,"num_write_kb":26981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'446","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.036112+0000","last_change":"2024-09-12T00:12:38.037277+0000","last_active":"2024-09-12T01:08:55.036112+0000","last_peered":"2024-09-12T01:08:55.036112+0000","last_clean":"2024-09-12T01:08:55.036112+0000","last_became_active":"2024-09-12T00:12:38.037000+0000","last_became_peered":"2024-09-12T00:12:38.037000+0000","last_unstale":"2024-09-12T01:08:55.036112+0000","last_undegraded":"2024-09-12T01:08:55.036112+0000","last_fullsized":"2024-09-12T01:08:55.036112+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:52.457342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1930,"num_read_kb":1543,"num_write":735,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'306","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:06.341859+0000","last_change":"2024-09-12T00:12:36.038559+0000","last_active":"2024-09-12T01:09:06.341859+0000","last_peered":"2024-09-12T01:09:06.341859+0000","last_clean":"2024-09-12T01:09:06.341859+0000","last_became_active":"2024-09-12T00:12:36.038235+0000","last_became_peered":"2024-09-12T00:12:36.038235+0000","last_unstale":"2024-09-12T01:09:06.341859+0000","last_undegraded":"2024-09-12T01:09:06.341859+0000","last_fullsized":"2024-09-12T01:09:06.341859+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:13.516943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7738630,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":566,"num_read_kb":9962,"num_write":1185,"num_write_kb":25658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'300","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.022656+0000","last_change":"2024-09-12T00:12:38.045583+0000","last_active":"2024-09-12T01:06:50.022656+0000","last_peered":"2024-09-12T01:06:50.022656+0000","last_clean":"2024-09-12T01:06:50.022656+0000","last_became_active":"2024-09-12T00:12:38.045308+0000","last_became_peered":"2024-09-12T00:12:38.045308+0000","last_unstale":"2024-09-12T01:06:50.022656+0000","last_undegraded":"2024-09-12T01:06:50.022656+0000","last_fullsized":"2024-09-12T01:06:50.022656+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:38.191795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1317,"num_read_kb":1075,"num_write":482,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'267","reported_seq":904,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.268303+0000","last_change":"2024-09-12T00:12:36.042085+0000","last_active":"2024-09-12T01:07:43.268303+0000","last_peered":"2024-09-12T01:07:43.268303+0000","last_clean":"2024-09-12T01:07:43.268303+0000","last_became_active":"2024-09-12T00:12:36.041698+0000","last_became_peered":"2024-09-12T00:12:36.041698+0000","last_unstale":"2024-09-12T01:07:43.268303+0000","last_undegraded":"2024-09-12T01:07:43.268303+0000","last_fullsized":"2024-09-12T01:07:43.268303+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:23.633785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15016627,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":419,"num_read_kb":30384,"num_write":963,"num_write_kb":31492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'492","reported_seq":1252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:14.754868+0000","last_change":"2024-09-12T00:12:38.038282+0000","last_active":"2024-09-12T01:07:14.754868+0000","last_peered":"2024-09-12T01:07:14.754868+0000","last_clean":"2024-09-12T01:07:14.754868+0000","last_became_active":"2024-09-12T00:12:38.038023+0000","last_became_peered":"2024-09-12T00:12:38.038023+0000","last_unstale":"2024-09-12T01:07:14.754868+0000","last_undegraded":"2024-09-12T01:07:14.754868+0000","last_fullsized":"2024-09-12T01:07:14.754868+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:15.550968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2347,"num_read_kb":2031,"num_write":873,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'243","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.064417+0000","last_change":"2024-09-12T00:12:36.050337+0000","last_active":"2024-09-12T01:10:08.064417+0000","last_peered":"2024-09-12T01:10:08.064417+0000","last_clean":"2024-09-12T01:10:08.064417+0000","last_became_active":"2024-09-12T00:12:36.050008+0000","last_became_peered":"2024-09-12T00:12:36.050008+0000","last_unstale":"2024-09-12T01:10:08.064417+0000","last_undegraded":"2024-09-12T01:10:08.064417+0000","last_fullsized":"2024-09-12T01:10:08.064417+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:38.881671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8398716,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":456,"num_read_kb":30850,"num_write":995,"num_write_kb":20572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'204","reported_seq":830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.053105+0000","last_change":"2024-09-12T00:12:38.043322+0000","last_active":"2024-09-12T01:08:53.053105+0000","last_peered":"2024-09-12T01:08:53.053105+0000","last_clean":"2024-09-12T01:08:53.053105+0000","last_became_active":"2024-09-12T00:12:38.043059+0000","last_became_peered":"2024-09-12T00:12:38.043059+0000","last_unstale":"2024-09-12T01:08:53.053105+0000","last_undegraded":"2024-09-12T01:08:53.053105+0000","last_fullsized":"2024-09-12T01:08:53.053105+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:02.061980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":751,"num_write":306,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'111","reported_seq":699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:20.031721+0000","last_change":"2024-09-12T00:12:38.040965+0000","last_active":"2024-09-12T01:06:20.031721+0000","last_peered":"2024-09-12T01:06:20.031721+0000","last_clean":"2024-09-12T01:06:20.031721+0000","last_became_active":"2024-09-12T00:12:38.040613+0000","last_became_peered":"2024-09-12T00:12:38.040613+0000","last_unstale":"2024-09-12T01:06:20.031721+0000","last_undegraded":"2024-09-12T01:06:20.031721+0000","last_fullsized":"2024-09-12T01:06:20.031721+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:25.644646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":420,"num_write":176,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'297","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.238577+0000","last_change":"2024-09-12T00:12:36.037211+0000","last_active":"2024-09-12T01:08:20.238577+0000","last_peered":"2024-09-12T01:08:20.238577+0000","last_clean":"2024-09-12T01:08:20.238577+0000","last_became_active":"2024-09-12T00:12:36.036905+0000","last_became_peered":"2024-09-12T00:12:36.036905+0000","last_unstale":"2024-09-12T01:08:20.238577+0000","last_undegraded":"2024-09-12T01:08:20.238577+0000","last_fullsized":"2024-09-12T01:08:20.238577+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:21.711720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11669514,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":512,"num_read_kb":41745,"num_write":1072,"num_write_kb":45582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'78","reported_seq":658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:51.954553+0000","last_change":"2024-09-12T00:12:38.038756+0000","last_active":"2024-09-12T01:06:51.954553+0000","last_peered":"2024-09-12T01:06:51.954553+0000","last_clean":"2024-09-12T01:06:51.954553+0000","last_became_active":"2024-09-12T00:12:38.038478+0000","last_became_peered":"2024-09-12T00:12:38.038478+0000","last_unstale":"2024-09-12T01:06:51.954553+0000","last_undegraded":"2024-09-12T01:06:51.954553+0000","last_fullsized":"2024-09-12T01:06:51.954553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:35.041048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":318,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'307","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.031888+0000","last_change":"2024-09-12T00:12:36.033187+0000","last_active":"2024-09-12T01:08:15.031888+0000","last_peered":"2024-09-12T01:08:15.031888+0000","last_clean":"2024-09-12T01:08:15.031888+0000","last_became_active":"2024-09-12T00:12:36.032821+0000","last_became_peered":"2024-09-12T00:12:36.032821+0000","last_unstale":"2024-09-12T01:08:15.031888+0000","last_undegraded":"2024-09-12T01:08:15.031888+0000","last_fullsized":"2024-09-12T01:08:15.031888+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:19.055738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8342209,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":444,"num_read_kb":42765,"num_write":969,"num_write_kb":38443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'199","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.226253+0000","last_change":"2024-09-12T00:12:38.044432+0000","last_active":"2024-09-12T01:06:25.226253+0000","last_peered":"2024-09-12T01:06:25.226253+0000","last_clean":"2024-09-12T01:06:25.226253+0000","last_became_active":"2024-09-12T00:12:38.044169+0000","last_became_peered":"2024-09-12T00:12:38.044169+0000","last_unstale":"2024-09-12T01:06:25.226253+0000","last_undegraded":"2024-09-12T01:06:25.226253+0000","last_fullsized":"2024-09-12T01:06:25.226253+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:46.038643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":679,"num_write":307,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'278","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.031865+0000","last_change":"2024-09-12T00:12:36.037534+0000","last_active":"2024-09-12T01:08:15.031865+0000","last_peered":"2024-09-12T01:08:15.031865+0000","last_clean":"2024-09-12T01:08:15.031865+0000","last_became_active":"2024-09-12T00:12:36.037200+0000","last_became_peered":"2024-09-12T00:12:36.037200+0000","last_unstale":"2024-09-12T01:08:15.031865+0000","last_undegraded":"2024-09-12T01:08:15.031865+0000","last_fullsized":"2024-09-12T01:08:15.031865+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:52.993855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549747,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":450,"num_read_kb":1481,"num_write":1017,"num_write_kb":18199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'162","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165122+0000","last_change":"2024-09-12T00:12:38.045098+0000","last_active":"2024-09-12T01:08:15.165122+0000","last_peered":"2024-09-12T01:08:15.165122+0000","last_clean":"2024-09-12T01:08:15.165122+0000","last_became_active":"2024-09-12T00:12:38.044089+0000","last_became_peered":"2024-09-12T00:12:38.044089+0000","last_unstale":"2024-09-12T01:08:15.165122+0000","last_undegraded":"2024-09-12T01:08:15.165122+0000","last_fullsized":"2024-09-12T01:08:15.165122+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:41.312963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":583,"num_write":265,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'287","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.693314+0000","last_change":"2024-09-12T00:12:36.029615+0000","last_active":"2024-09-12T01:08:30.693314+0000","last_peered":"2024-09-12T01:08:30.693314+0000","last_clean":"2024-09-12T01:08:30.693314+0000","last_became_active":"2024-09-12T00:12:36.029286+0000","last_became_peered":"2024-09-12T00:12:36.029286+0000","last_unstale":"2024-09-12T01:08:30.693314+0000","last_undegraded":"2024-09-12T01:08:30.693314+0000","last_fullsized":"2024-09-12T01:08:30.693314+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:36.388912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12243728,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":404,"num_read_kb":28442,"num_write":984,"num_write_kb":34038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'237","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.046795+0000","last_change":"2024-09-12T00:12:38.042662+0000","last_active":"2024-09-12T01:08:13.046795+0000","last_peered":"2024-09-12T01:08:13.046795+0000","last_clean":"2024-09-12T01:08:13.046795+0000","last_became_active":"2024-09-12T00:12:38.042387+0000","last_became_peered":"2024-09-12T00:12:38.042387+0000","last_unstale":"2024-09-12T01:08:13.046795+0000","last_undegraded":"2024-09-12T01:08:13.046795+0000","last_fullsized":"2024-09-12T01:08:13.046795+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:52.954165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1130,"num_read_kb":955,"num_write":386,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'279","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165105+0000","last_change":"2024-09-12T00:12:36.035258+0000","last_active":"2024-09-12T01:08:15.165105+0000","last_peered":"2024-09-12T01:08:15.165105+0000","last_clean":"2024-09-12T01:08:15.165105+0000","last_became_active":"2024-09-12T00:12:36.034811+0000","last_became_peered":"2024-09-12T00:12:36.034811+0000","last_unstale":"2024-09-12T01:08:15.165105+0000","last_undegraded":"2024-09-12T01:08:15.165105+0000","last_fullsized":"2024-09-12T01:08:15.165105+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:17.351084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5398523,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":531,"num_read_kb":22751,"num_write":1047,"num_write_kb":14938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'112","reported_seq":703,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:39.935379+0000","last_change":"2024-09-12T00:12:38.036179+0000","last_active":"2024-09-12T01:08:39.935379+0000","last_peered":"2024-09-12T01:08:39.935379+0000","last_clean":"2024-09-12T01:08:39.935379+0000","last_became_active":"2024-09-12T00:12:38.035835+0000","last_became_peered":"2024-09-12T00:12:38.035835+0000","last_unstale":"2024-09-12T01:08:39.935379+0000","last_undegraded":"2024-09-12T01:08:39.935379+0000","last_fullsized":"2024-09-12T01:08:39.935379+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:40.642378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":399,"num_write":174,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'257","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:43.243938+0000","last_change":"2024-09-12T00:12:36.036412+0000","last_active":"2024-09-12T01:08:43.243938+0000","last_peered":"2024-09-12T01:08:43.243938+0000","last_clean":"2024-09-12T01:08:43.243938+0000","last_became_active":"2024-09-12T00:12:36.036060+0000","last_became_peered":"2024-09-12T00:12:36.036060+0000","last_unstale":"2024-09-12T01:08:43.243938+0000","last_undegraded":"2024-09-12T01:08:43.243938+0000","last_fullsized":"2024-09-12T01:08:43.243938+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:28.300988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10255709,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":476,"num_read_kb":15680,"num_write":943,"num_write_kb":17630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'129","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.436476+0000","last_change":"2024-09-12T00:12:46.059495+0000","last_active":"2024-09-12T01:09:23.436476+0000","last_peered":"2024-09-12T01:09:23.436476+0000","last_clean":"2024-09-12T01:09:23.436476+0000","last_became_active":"2024-09-12T00:12:46.059203+0000","last_became_peered":"2024-09-12T00:12:46.059203+0000","last_unstale":"2024-09-12T01:09:23.436476+0000","last_undegraded":"2024-09-12T01:09:23.436476+0000","last_fullsized":"2024-09-12T01:09:23.436476+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:04.594775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":135,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'77","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.040701+0000","last_change":"2024-09-12T00:12:38.043406+0000","last_active":"2024-09-12T01:07:35.040701+0000","last_peered":"2024-09-12T01:07:35.040701+0000","last_clean":"2024-09-12T01:07:35.040701+0000","last_became_active":"2024-09-12T00:12:38.041964+0000","last_became_peered":"2024-09-12T00:12:38.041964+0000","last_unstale":"2024-09-12T01:07:35.040701+0000","last_undegraded":"2024-09-12T01:07:35.040701+0000","last_fullsized":"2024-09-12T01:07:35.040701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:09.254764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":305,"num_read_kb":247,"num_write":113,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'290","reported_seq":1137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.006437+0000","last_change":"2024-09-12T00:12:36.034053+0000","last_active":"2024-09-12T01:08:33.006437+0000","last_peered":"2024-09-12T01:08:33.006437+0000","last_clean":"2024-09-12T01:08:33.006437+0000","last_became_active":"2024-09-12T00:12:36.033666+0000","last_became_peered":"2024-09-12T00:12:36.033666+0000","last_unstale":"2024-09-12T01:08:33.006437+0000","last_undegraded":"2024-09-12T01:08:33.006437+0000","last_fullsized":"2024-09-12T01:08:33.006437+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:42.337722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7265591,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":895,"num_read_kb":16942,"num_write":1122,"num_write_kb":38560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045191+0000","last_change":"2024-09-12T00:12:40.043098+0000","last_active":"2024-09-12T01:08:15.045191+0000","last_peered":"2024-09-12T01:08:15.045191+0000","last_clean":"2024-09-12T01:08:15.045191+0000","last_became_active":"2024-09-12T00:12:40.042778+0000","last_became_peered":"2024-09-12T00:12:40.042778+0000","last_unstale":"2024-09-12T01:08:15.045191+0000","last_undegraded":"2024-09-12T01:08:15.045191+0000","last_fullsized":"2024-09-12T01:08:15.045191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:24.903477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'340","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.986353+0000","last_change":"2024-09-12T00:12:42.041284+0000","last_active":"2024-09-12T01:10:32.986353+0000","last_peered":"2024-09-12T01:10:32.986353+0000","last_clean":"2024-09-12T01:10:32.986353+0000","last_became_active":"2024-09-12T00:12:42.040764+0000","last_became_peered":"2024-09-12T00:12:42.040764+0000","last_unstale":"2024-09-12T01:10:32.986353+0000","last_undegraded":"2024-09-12T01:10:32.986353+0000","last_fullsized":"2024-09-12T01:10:32.986353+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:17.910880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56754,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":548,"num_read_kb":1023,"num_write":436,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.238599+0000","last_change":"2024-09-12T00:12:44.055832+0000","last_active":"2024-09-12T01:08:20.238599+0000","last_peered":"2024-09-12T01:08:20.238599+0000","last_clean":"2024-09-12T01:08:20.238599+0000","last_became_active":"2024-09-12T00:12:44.055504+0000","last_became_peered":"2024-09-12T00:12:44.055504+0000","last_unstale":"2024-09-12T01:08:20.238599+0000","last_undegraded":"2024-09-12T01:08:20.238599+0000","last_fullsized":"2024-09-12T01:08:20.238599+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:45.759712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'168","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.825669+0000","last_change":"2024-09-12T00:12:46.065977+0000","last_active":"2024-09-12T01:08:55.825669+0000","last_peered":"2024-09-12T01:08:55.825669+0000","last_clean":"2024-09-12T01:08:55.825669+0000","last_became_active":"2024-09-12T00:12:46.065664+0000","last_became_peered":"2024-09-12T00:12:46.065664+0000","last_unstale":"2024-09-12T01:08:55.825669+0000","last_undegraded":"2024-09-12T01:08:55.825669+0000","last_fullsized":"2024-09-12T01:08:55.825669+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:46.395099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":198,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'177","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045160+0000","last_change":"2024-09-12T00:12:38.042600+0000","last_active":"2024-09-12T01:08:15.045160+0000","last_peered":"2024-09-12T01:08:15.045160+0000","last_clean":"2024-09-12T01:08:15.045160+0000","last_became_active":"2024-09-12T00:12:38.041187+0000","last_became_peered":"2024-09-12T00:12:38.041187+0000","last_unstale":"2024-09-12T01:08:15.045160+0000","last_undegraded":"2024-09-12T01:08:15.045160+0000","last_fullsized":"2024-09-12T01:08:15.045160+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:30.414258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":787,"num_read_kb":651,"num_write":272,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'302","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:27.263244+0000","last_change":"2024-09-12T00:12:36.034110+0000","last_active":"2024-09-12T01:10:27.263244+0000","last_peered":"2024-09-12T01:10:27.263244+0000","last_clean":"2024-09-12T01:10:27.263244+0000","last_became_active":"2024-09-12T00:12:36.033751+0000","last_became_peered":"2024-09-12T00:12:36.033751+0000","last_unstale":"2024-09-12T01:10:27.263244+0000","last_undegraded":"2024-09-12T01:10:27.263244+0000","last_fullsized":"2024-09-12T01:10:27.263244+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:13.850294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5847460,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":527,"num_read_kb":6771,"num_write":991,"num_write_kb":22452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.031479+0000","last_change":"2024-09-12T00:12:40.032783+0000","last_active":"2024-09-12T01:06:30.031479+0000","last_peered":"2024-09-12T01:06:30.031479+0000","last_clean":"2024-09-12T01:06:30.031479+0000","last_became_active":"2024-09-12T00:12:40.032489+0000","last_became_peered":"2024-09-12T00:12:40.032489+0000","last_unstale":"2024-09-12T01:06:30.031479+0000","last_undegraded":"2024-09-12T01:06:30.031479+0000","last_fullsized":"2024-09-12T01:06:30.031479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:22.084698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'93","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.815511+0000","last_change":"2024-09-12T00:12:42.046654+0000","last_active":"2024-09-12T01:10:31.815511+0000","last_peered":"2024-09-12T01:10:31.815511+0000","last_clean":"2024-09-12T01:10:31.815511+0000","last_became_active":"2024-09-12T00:12:42.046316+0000","last_became_peered":"2024-09-12T00:12:42.046316+0000","last_unstale":"2024-09-12T01:10:31.815511+0000","last_undegraded":"2024-09-12T01:10:31.815511+0000","last_fullsized":"2024-09-12T01:10:31.815511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:43.446982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":105,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.238553+0000","last_change":"2024-09-12T00:12:44.057706+0000","last_active":"2024-09-12T01:08:20.238553+0000","last_peered":"2024-09-12T01:08:20.238553+0000","last_clean":"2024-09-12T01:08:20.238553+0000","last_became_active":"2024-09-12T00:12:44.057398+0000","last_became_peered":"2024-09-12T00:12:44.057398+0000","last_unstale":"2024-09-12T01:08:20.238553+0000","last_undegraded":"2024-09-12T01:08:20.238553+0000","last_fullsized":"2024-09-12T01:08:20.238553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:05.128485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'136","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:39.937608+0000","last_change":"2024-09-12T00:12:46.061250+0000","last_active":"2024-09-12T01:08:39.937608+0000","last_peered":"2024-09-12T01:08:39.937608+0000","last_clean":"2024-09-12T01:08:39.937608+0000","last_became_active":"2024-09-12T00:12:46.060932+0000","last_became_peered":"2024-09-12T00:12:46.060932+0000","last_unstale":"2024-09-12T01:08:39.937608+0000","last_undegraded":"2024-09-12T01:08:39.937608+0000","last_fullsized":"2024-09-12T01:08:39.937608+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:30.826242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'190","reported_seq":814,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.046842+0000","last_change":"2024-09-12T00:12:38.038566+0000","last_active":"2024-09-12T01:08:13.046842+0000","last_peered":"2024-09-12T01:08:13.046842+0000","last_clean":"2024-09-12T01:08:13.046842+0000","last_became_active":"2024-09-12T00:12:38.038234+0000","last_became_peered":"2024-09-12T00:12:38.038234+0000","last_unstale":"2024-09-12T01:08:13.046842+0000","last_undegraded":"2024-09-12T01:08:13.046842+0000","last_fullsized":"2024-09-12T01:08:13.046842+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:49.369461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":891,"num_read_kb":755,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'283","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:43.235432+0000","last_change":"2024-09-12T00:13:07.150014+0000","last_active":"2024-09-12T01:08:43.235432+0000","last_peered":"2024-09-12T01:08:43.235432+0000","last_clean":"2024-09-12T01:08:43.235432+0000","last_became_active":"2024-09-12T00:13:07.149671+0000","last_became_peered":"2024-09-12T00:13:07.149671+0000","last_unstale":"2024-09-12T01:08:43.235432+0000","last_undegraded":"2024-09-12T01:08:43.235432+0000","last_fullsized":"2024-09-12T01:08:43.235432+0000","mapping_epoch":40,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:56.523641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1073886,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":528,"num_read_kb":33322,"num_write":936,"num_write_kb":23312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.049001+0000","last_change":"2024-09-12T00:12:40.037054+0000","last_active":"2024-09-12T01:08:15.049001+0000","last_peered":"2024-09-12T01:08:15.049001+0000","last_clean":"2024-09-12T01:08:15.049001+0000","last_became_active":"2024-09-12T00:12:40.036714+0000","last_became_peered":"2024-09-12T00:12:40.036714+0000","last_unstale":"2024-09-12T01:08:15.049001+0000","last_undegraded":"2024-09-12T01:08:15.049001+0000","last_fullsized":"2024-09-12T01:08:15.049001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:41.522842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'128","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.032412+0000","last_change":"2024-09-12T00:12:42.038292+0000","last_active":"2024-09-12T01:06:35.032412+0000","last_peered":"2024-09-12T01:06:35.032412+0000","last_clean":"2024-09-12T01:06:35.032412+0000","last_became_active":"2024-09-12T00:12:42.037971+0000","last_became_peered":"2024-09-12T00:12:42.037971+0000","last_unstale":"2024-09-12T01:06:35.032412+0000","last_undegraded":"2024-09-12T01:06:35.032412+0000","last_fullsized":"2024-09-12T01:06:35.032412+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:23.076188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":156,"num_read_kb":149,"num_write":106,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'770","reported_seq":2777,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:36.416192+0000","last_change":"2024-09-12T00:12:44.059925+0000","last_active":"2024-09-12T01:10:36.416192+0000","last_peered":"2024-09-12T01:10:36.416192+0000","last_clean":"2024-09-12T01:10:36.416192+0000","last_became_active":"2024-09-12T00:12:44.059258+0000","last_became_peered":"2024-09-12T00:12:44.059258+0000","last_unstale":"2024-09-12T01:10:36.416192+0000","last_undegraded":"2024-09-12T01:10:36.416192+0000","last_fullsized":"2024-09-12T01:10:36.416192+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:23.120624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'196","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.494669+0000","last_change":"2024-09-12T00:12:46.059926+0000","last_active":"2024-09-12T01:09:23.494669+0000","last_peered":"2024-09-12T01:09:23.494669+0000","last_clean":"2024-09-12T01:09:23.494669+0000","last_became_active":"2024-09-12T00:12:46.059591+0000","last_became_peered":"2024-09-12T00:12:46.059591+0000","last_unstale":"2024-09-12T01:09:23.494669+0000","last_undegraded":"2024-09-12T01:09:23.494669+0000","last_fullsized":"2024-09-12T01:09:23.494669+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:40.868229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":585,"num_read_kb":583,"num_write":433,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'4340","reported_seq":5003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.046880+0000","last_change":"2024-09-12T00:12:38.036026+0000","last_active":"2024-09-12T01:08:13.046880+0000","last_peered":"2024-09-12T01:08:13.046880+0000","last_clean":"2024-09-12T01:08:13.046880+0000","last_became_active":"2024-09-12T00:12:38.035743+0000","last_became_peered":"2024-09-12T00:12:38.035743+0000","last_unstale":"2024-09-12T01:08:13.046880+0000","last_undegraded":"2024-09-12T01:08:13.046880+0000","last_fullsized":"2024-09-12T01:08:13.046880+0000","mapping_epoch":29,"log_start":"263'4300","ondisk_log_start":"263'4300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:55.482084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17417,"num_read_kb":14583,"num_write":6500,"num_write_kb":3272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'292","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.186718+0000","last_change":"2024-09-12T00:12:36.038350+0000","last_active":"2024-09-12T01:07:50.186718+0000","last_peered":"2024-09-12T01:07:50.186718+0000","last_clean":"2024-09-12T01:07:50.186718+0000","last_became_active":"2024-09-12T00:12:36.038014+0000","last_became_peered":"2024-09-12T00:12:36.038014+0000","last_unstale":"2024-09-12T01:07:50.186718+0000","last_undegraded":"2024-09-12T01:07:50.186718+0000","last_fullsized":"2024-09-12T01:07:50.186718+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:25.617148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11217581,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":490,"num_read_kb":22310,"num_write":989,"num_write_kb":43311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045229+0000","last_change":"2024-09-12T00:12:40.041340+0000","last_active":"2024-09-12T01:08:15.045229+0000","last_peered":"2024-09-12T01:08:15.045229+0000","last_clean":"2024-09-12T01:08:15.045229+0000","last_became_active":"2024-09-12T00:12:40.040992+0000","last_became_peered":"2024-09-12T00:12:40.040992+0000","last_unstale":"2024-09-12T01:08:15.045229+0000","last_undegraded":"2024-09-12T01:08:15.045229+0000","last_fullsized":"2024-09-12T01:08:15.045229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:18.861321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'279","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.980782+0000","last_change":"2024-09-12T00:12:42.041347+0000","last_active":"2024-09-12T01:10:32.980782+0000","last_peered":"2024-09-12T01:10:32.980782+0000","last_clean":"2024-09-12T01:10:32.980782+0000","last_became_active":"2024-09-12T00:12:42.041042+0000","last_became_peered":"2024-09-12T00:12:42.041042+0000","last_unstale":"2024-09-12T01:10:32.980782+0000","last_undegraded":"2024-09-12T01:10:32.980782+0000","last_fullsized":"2024-09-12T01:10:32.980782+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:46.437978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":450,"num_read_kb":965,"num_write":370,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'805","reported_seq":2515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.886558+0000","last_change":"2024-09-12T00:12:44.062745+0000","last_active":"2024-09-12T01:10:57.886558+0000","last_peered":"2024-09-12T01:10:57.886558+0000","last_clean":"2024-09-12T01:10:57.886558+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:10:57.886558+0000","last_undegraded":"2024-09-12T01:10:57.886558+0000","last_fullsized":"2024-09-12T01:10:57.886558+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:30.427552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'191","reported_seq":820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035206+0000","last_change":"2024-09-12T00:12:38.040302+0000","last_active":"2024-09-12T01:06:50.035206+0000","last_peered":"2024-09-12T01:06:50.035206+0000","last_clean":"2024-09-12T01:06:50.035206+0000","last_became_active":"2024-09-12T00:12:38.040030+0000","last_became_peered":"2024-09-12T00:12:38.040030+0000","last_unstale":"2024-09-12T01:06:50.035206+0000","last_undegraded":"2024-09-12T01:06:50.035206+0000","last_fullsized":"2024-09-12T01:06:50.035206+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:17.788252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":682,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'278","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.023239+0000","last_change":"2024-09-12T00:12:36.040947+0000","last_active":"2024-09-12T01:06:55.023239+0000","last_peered":"2024-09-12T01:06:55.023239+0000","last_clean":"2024-09-12T01:06:55.023239+0000","last_became_active":"2024-09-12T00:12:36.040657+0000","last_became_peered":"2024-09-12T00:12:36.040657+0000","last_unstale":"2024-09-12T01:06:55.023239+0000","last_undegraded":"2024-09-12T01:06:55.023239+0000","last_fullsized":"2024-09-12T01:06:55.023239+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:18.229544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9510629,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":388,"num_read_kb":5569,"num_write":1051,"num_write_kb":16904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.229029+0000","last_change":"2024-09-12T00:12:40.036607+0000","last_active":"2024-09-12T01:06:50.229029+0000","last_peered":"2024-09-12T01:06:50.229029+0000","last_clean":"2024-09-12T01:06:50.229029+0000","last_became_active":"2024-09-12T00:12:40.036362+0000","last_became_peered":"2024-09-12T00:12:40.036362+0000","last_unstale":"2024-09-12T01:06:50.229029+0000","last_undegraded":"2024-09-12T01:06:50.229029+0000","last_fullsized":"2024-09-12T01:06:50.229029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:43.641028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'342","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.039063+0000","last_change":"2024-09-12T00:12:42.044696+0000","last_active":"2024-09-12T01:09:20.039063+0000","last_peered":"2024-09-12T01:09:20.039063+0000","last_clean":"2024-09-12T01:09:20.039063+0000","last_became_active":"2024-09-12T00:12:42.044418+0000","last_became_peered":"2024-09-12T00:12:42.044418+0000","last_unstale":"2024-09-12T01:09:20.039063+0000","last_undegraded":"2024-09-12T01:09:20.039063+0000","last_fullsized":"2024-09-12T01:09:20.039063+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:13.793410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56243,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":556,"num_read_kb":1000,"num_write":430,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.152015+0000","last_change":"2024-09-12T00:12:44.057796+0000","last_active":"2024-09-12T01:06:45.152015+0000","last_peered":"2024-09-12T01:06:45.152015+0000","last_clean":"2024-09-12T01:06:45.152015+0000","last_became_active":"2024-09-12T00:12:44.057438+0000","last_became_peered":"2024-09-12T00:12:44.057438+0000","last_unstale":"2024-09-12T01:06:45.152015+0000","last_undegraded":"2024-09-12T01:06:45.152015+0000","last_fullsized":"2024-09-12T01:06:45.152015+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:56.467860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'557","reported_seq":1367,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.003073+0000","last_change":"2024-09-12T00:12:46.060839+0000","last_active":"2024-09-12T01:10:33.003073+0000","last_peered":"2024-09-12T01:10:33.003073+0000","last_clean":"2024-09-12T01:10:33.003073+0000","last_became_active":"2024-09-12T00:12:46.060552+0000","last_became_peered":"2024-09-12T00:12:46.060552+0000","last_unstale":"2024-09-12T01:10:33.003073+0000","last_undegraded":"2024-09-12T01:10:33.003073+0000","last_fullsized":"2024-09-12T01:10:33.003073+0000","mapping_epoch":37,"log_start":"263'500","ondisk_log_start":"263'500","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:49.354363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1290,"num_read_kb":1284,"num_write":1146,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'240","reported_seq":844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.183059+0000","last_change":"2024-09-12T00:12:38.042271+0000","last_active":"2024-09-12T01:08:32.183059+0000","last_peered":"2024-09-12T01:08:32.183059+0000","last_clean":"2024-09-12T01:08:32.183059+0000","last_became_active":"2024-09-12T00:12:38.041916+0000","last_became_peered":"2024-09-12T00:12:38.041916+0000","last_unstale":"2024-09-12T01:08:32.183059+0000","last_undegraded":"2024-09-12T01:08:32.183059+0000","last_fullsized":"2024-09-12T01:08:32.183059+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:14.378653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1071,"num_read_kb":865,"num_write":389,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'266","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.127516+0000","last_change":"2024-09-12T00:12:36.043410+0000","last_active":"2024-09-12T01:06:40.127516+0000","last_peered":"2024-09-12T01:06:40.127516+0000","last_clean":"2024-09-12T01:06:40.127516+0000","last_became_active":"2024-09-12T00:12:36.042838+0000","last_became_peered":"2024-09-12T00:12:36.042838+0000","last_unstale":"2024-09-12T01:06:40.127516+0000","last_undegraded":"2024-09-12T01:06:40.127516+0000","last_fullsized":"2024-09-12T01:06:40.127516+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:50.068914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667686,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":421,"num_read_kb":7238,"num_write":1003,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.152809+0000","last_change":"2024-09-12T00:12:40.042917+0000","last_active":"2024-09-12T01:06:50.152809+0000","last_peered":"2024-09-12T01:06:50.152809+0000","last_clean":"2024-09-12T01:06:50.152809+0000","last_became_active":"2024-09-12T00:12:40.042625+0000","last_became_peered":"2024-09-12T00:12:40.042625+0000","last_unstale":"2024-09-12T01:06:50.152809+0000","last_undegraded":"2024-09-12T01:06:50.152809+0000","last_fullsized":"2024-09-12T01:06:50.152809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:42.496763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'250","reported_seq":821,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.056461+0000","last_change":"2024-09-12T00:12:42.040576+0000","last_active":"2024-09-12T01:09:00.056461+0000","last_peered":"2024-09-12T01:09:00.056461+0000","last_clean":"2024-09-12T01:09:00.056461+0000","last_became_active":"2024-09-12T00:12:42.040266+0000","last_became_peered":"2024-09-12T00:12:42.040266+0000","last_unstale":"2024-09-12T01:09:00.056461+0000","last_undegraded":"2024-09-12T01:09:00.056461+0000","last_fullsized":"2024-09-12T01:09:00.056461+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:24.483433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52734,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":866,"num_write":342,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:05.037890+0000","last_change":"2024-09-12T00:12:44.062951+0000","last_active":"2024-09-12T01:07:05.037890+0000","last_peered":"2024-09-12T01:07:05.037890+0000","last_clean":"2024-09-12T01:07:05.037890+0000","last_became_active":"2024-09-12T00:12:44.062608+0000","last_became_peered":"2024-09-12T00:12:44.062608+0000","last_unstale":"2024-09-12T01:07:05.037890+0000","last_undegraded":"2024-09-12T01:07:05.037890+0000","last_fullsized":"2024-09-12T01:07:05.037890+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:39.092545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2412","reported_seq":4250,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.887941+0000","last_change":"2024-09-12T00:12:46.062926+0000","last_active":"2024-09-12T01:10:35.887941+0000","last_peered":"2024-09-12T01:10:35.887941+0000","last_clean":"2024-09-12T01:10:35.887941+0000","last_became_active":"2024-09-12T00:12:46.062624+0000","last_became_peered":"2024-09-12T00:12:46.062624+0000","last_unstale":"2024-09-12T01:10:35.887941+0000","last_undegraded":"2024-09-12T01:10:35.887941+0000","last_fullsized":"2024-09-12T01:10:35.887941+0000","mapping_epoch":37,"log_start":"263'2400","ondisk_log_start":"263'2400","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":2400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:26.452821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":6065,"num_write":4891,"num_write_kb":1799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'224","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.300929+0000","last_change":"2024-09-12T00:12:38.042922+0000","last_active":"2024-09-12T01:08:19.300929+0000","last_peered":"2024-09-12T01:08:19.300929+0000","last_clean":"2024-09-12T01:08:19.300929+0000","last_became_active":"2024-09-12T00:12:38.042657+0000","last_became_peered":"2024-09-12T00:12:38.042657+0000","last_unstale":"2024-09-12T01:08:19.300929+0000","last_undegraded":"2024-09-12T01:08:19.300929+0000","last_fullsized":"2024-09-12T01:08:19.300929+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:37.846035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":947,"num_read_kb":771,"num_write":346,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'306","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:04.709086+0000","last_change":"2024-09-12T00:12:36.046609+0000","last_active":"2024-09-12T01:09:04.709086+0000","last_peered":"2024-09-12T01:09:04.709086+0000","last_clean":"2024-09-12T01:09:04.709086+0000","last_became_active":"2024-09-12T00:12:36.046196+0000","last_became_peered":"2024-09-12T00:12:36.046196+0000","last_unstale":"2024-09-12T01:09:04.709086+0000","last_undegraded":"2024-09-12T01:09:04.709086+0000","last_fullsized":"2024-09-12T01:09:04.709086+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:49.734531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23337616,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":474,"num_read_kb":69753,"num_write":1133,"num_write_kb":51465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:43.033241+0000","last_change":"2024-09-12T00:12:40.040357+0000","last_active":"2024-09-12T01:06:43.033241+0000","last_peered":"2024-09-12T01:06:43.033241+0000","last_clean":"2024-09-12T01:06:43.033241+0000","last_became_active":"2024-09-12T00:12:40.039887+0000","last_became_peered":"2024-09-12T00:12:40.039887+0000","last_unstale":"2024-09-12T01:06:43.033241+0000","last_undegraded":"2024-09-12T01:06:43.033241+0000","last_fullsized":"2024-09-12T01:06:43.033241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:20.058438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'325","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:05.051153+0000","last_change":"2024-09-12T00:12:42.051353+0000","last_active":"2024-09-12T01:09:05.051153+0000","last_peered":"2024-09-12T01:09:05.051153+0000","last_clean":"2024-09-12T01:09:05.051153+0000","last_became_active":"2024-09-12T00:12:42.051042+0000","last_became_peered":"2024-09-12T00:12:42.051042+0000","last_unstale":"2024-09-12T01:09:05.051153+0000","last_undegraded":"2024-09-12T01:09:05.051153+0000","last_fullsized":"2024-09-12T01:09:05.051153+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:52.667091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60864,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":519,"num_read_kb":1003,"num_write":418,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'805","reported_seq":2511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.887570+0000","last_change":"2024-09-12T00:12:44.057367+0000","last_active":"2024-09-12T01:10:57.887570+0000","last_peered":"2024-09-12T01:10:57.887570+0000","last_clean":"2024-09-12T01:10:57.887570+0000","last_became_active":"2024-09-12T00:12:44.057064+0000","last_became_peered":"2024-09-12T00:12:44.057064+0000","last_unstale":"2024-09-12T01:10:57.887570+0000","last_undegraded":"2024-09-12T01:10:57.887570+0000","last_fullsized":"2024-09-12T01:10:57.887570+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:28.146163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'102","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.693001+0000","last_change":"2024-09-12T00:12:46.059872+0000","last_active":"2024-09-12T01:10:31.693001+0000","last_peered":"2024-09-12T01:10:31.693001+0000","last_clean":"2024-09-12T01:10:31.693001+0000","last_became_active":"2024-09-12T00:12:46.059567+0000","last_became_peered":"2024-09-12T00:12:46.059567+0000","last_unstale":"2024-09-12T01:10:31.693001+0000","last_undegraded":"2024-09-12T01:10:31.693001+0000","last_fullsized":"2024-09-12T01:10:31.693001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:15.879983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":78,"num_write":230,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'198","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:38.032532+0000","last_change":"2024-09-12T00:12:38.040110+0000","last_active":"2024-09-12T01:06:38.032532+0000","last_peered":"2024-09-12T01:06:38.032532+0000","last_clean":"2024-09-12T01:06:38.032532+0000","last_became_active":"2024-09-12T00:12:38.039788+0000","last_became_peered":"2024-09-12T00:12:38.039788+0000","last_unstale":"2024-09-12T01:06:38.032532+0000","last_undegraded":"2024-09-12T01:06:38.032532+0000","last_fullsized":"2024-09-12T01:06:38.032532+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:03.291708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":765,"num_write":285,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'296","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:47.325600+0000","last_change":"2024-09-12T00:12:36.034612+0000","last_active":"2024-09-12T01:06:47.325600+0000","last_peered":"2024-09-12T01:06:47.325600+0000","last_clean":"2024-09-12T01:06:47.325600+0000","last_became_active":"2024-09-12T00:12:36.034290+0000","last_became_peered":"2024-09-12T00:12:36.034290+0000","last_unstale":"2024-09-12T01:06:47.325600+0000","last_undegraded":"2024-09-12T01:06:47.325600+0000","last_fullsized":"2024-09-12T01:06:47.325600+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:32.222016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11680083,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":463,"num_read_kb":18522,"num_write":1087,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.154250+0000","last_change":"2024-09-12T00:12:40.036885+0000","last_active":"2024-09-12T01:07:00.154250+0000","last_peered":"2024-09-12T01:07:00.154250+0000","last_clean":"2024-09-12T01:07:00.154250+0000","last_became_active":"2024-09-12T00:12:40.036551+0000","last_became_peered":"2024-09-12T00:12:40.036551+0000","last_unstale":"2024-09-12T01:07:00.154250+0000","last_undegraded":"2024-09-12T01:07:00.154250+0000","last_fullsized":"2024-09-12T01:07:00.154250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:09.117904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'505","reported_seq":1139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.972927+0000","last_change":"2024-09-12T00:12:42.041830+0000","last_active":"2024-09-12T01:10:32.972927+0000","last_peered":"2024-09-12T01:10:32.972927+0000","last_clean":"2024-09-12T01:10:32.972927+0000","last_became_active":"2024-09-12T00:12:42.041307+0000","last_became_peered":"2024-09-12T00:12:42.041307+0000","last_unstale":"2024-09-12T01:10:32.972927+0000","last_undegraded":"2024-09-12T01:10:32.972927+0000","last_fullsized":"2024-09-12T01:10:32.972927+0000","mapping_epoch":33,"log_start":"263'400","ondisk_log_start":"263'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:40.915241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121369,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":880,"num_read_kb":1904,"num_write":736,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:58.035239+0000","last_change":"2024-09-12T00:12:44.049673+0000","last_active":"2024-09-12T01:06:58.035239+0000","last_peered":"2024-09-12T01:06:58.035239+0000","last_clean":"2024-09-12T01:06:58.035239+0000","last_became_active":"2024-09-12T00:12:44.049211+0000","last_became_peered":"2024-09-12T00:12:44.049211+0000","last_unstale":"2024-09-12T01:06:58.035239+0000","last_undegraded":"2024-09-12T01:06:58.035239+0000","last_fullsized":"2024-09-12T01:06:58.035239+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:06.344330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'145","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.046019+0000","last_change":"2024-09-12T00:12:46.066668+0000","last_active":"2024-09-12T01:08:12.046019+0000","last_peered":"2024-09-12T01:08:12.046019+0000","last_clean":"2024-09-12T01:08:12.046019+0000","last_became_active":"2024-09-12T00:12:46.066431+0000","last_became_peered":"2024-09-12T00:12:46.066431+0000","last_unstale":"2024-09-12T01:08:12.046019+0000","last_undegraded":"2024-09-12T01:08:12.046019+0000","last_fullsized":"2024-09-12T01:08:12.046019+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:16.649236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":339,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'119","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.021555+0000","last_change":"2024-09-12T00:12:38.037741+0000","last_active":"2024-09-12T01:06:40.021555+0000","last_peered":"2024-09-12T01:06:40.021555+0000","last_clean":"2024-09-12T01:06:40.021555+0000","last_became_active":"2024-09-12T00:12:38.037464+0000","last_became_peered":"2024-09-12T00:12:38.037464+0000","last_unstale":"2024-09-12T01:06:40.021555+0000","last_undegraded":"2024-09-12T01:06:40.021555+0000","last_fullsized":"2024-09-12T01:06:40.021555+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:07.317139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'265","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.046082+0000","last_change":"2024-09-12T00:12:36.045431+0000","last_active":"2024-09-12T01:08:16.046082+0000","last_peered":"2024-09-12T01:08:16.046082+0000","last_clean":"2024-09-12T01:08:16.046082+0000","last_became_active":"2024-09-12T00:12:36.045050+0000","last_became_peered":"2024-09-12T00:12:36.045050+0000","last_unstale":"2024-09-12T01:08:16.046082+0000","last_undegraded":"2024-09-12T01:08:16.046082+0000","last_fullsized":"2024-09-12T01:08:16.046082+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:43.812152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4782027,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":419,"num_read_kb":13364,"num_write":1023,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.033417+0000","last_change":"2024-09-12T00:12:40.038347+0000","last_active":"2024-09-12T01:06:40.033417+0000","last_peered":"2024-09-12T01:06:40.033417+0000","last_clean":"2024-09-12T01:06:40.033417+0000","last_became_active":"2024-09-12T00:12:40.038036+0000","last_became_peered":"2024-09-12T00:12:40.038036+0000","last_unstale":"2024-09-12T01:06:40.033417+0000","last_undegraded":"2024-09-12T01:06:40.033417+0000","last_fullsized":"2024-09-12T01:06:40.033417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:56.716723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'292","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.242940+0000","last_change":"2024-09-12T00:12:42.051976+0000","last_active":"2024-09-12T01:09:00.242940+0000","last_peered":"2024-09-12T01:09:00.242940+0000","last_clean":"2024-09-12T01:09:00.242940+0000","last_became_active":"2024-09-12T00:12:42.051668+0000","last_became_peered":"2024-09-12T00:12:42.051668+0000","last_unstale":"2024-09-12T01:09:00.242940+0000","last_undegraded":"2024-09-12T01:09:00.242940+0000","last_fullsized":"2024-09-12T01:09:00.242940+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:48.021906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55574,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":985,"num_write":454,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.036235+0000","last_change":"2024-09-12T00:12:44.062196+0000","last_active":"2024-09-12T01:06:55.036235+0000","last_peered":"2024-09-12T01:06:55.036235+0000","last_clean":"2024-09-12T01:06:55.036235+0000","last_became_active":"2024-09-12T00:12:44.061848+0000","last_became_peered":"2024-09-12T00:12:44.061848+0000","last_unstale":"2024-09-12T01:06:55.036235+0000","last_undegraded":"2024-09-12T01:06:55.036235+0000","last_fullsized":"2024-09-12T01:06:55.036235+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:41.383111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'90","reported_seq":569,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:21.961327+0000","last_change":"2024-09-12T00:12:46.066391+0000","last_active":"2024-09-12T01:10:21.961327+0000","last_peered":"2024-09-12T01:10:21.961327+0000","last_clean":"2024-09-12T01:10:21.961327+0000","last_became_active":"2024-09-12T00:12:46.066121+0000","last_became_peered":"2024-09-12T00:12:46.066121+0000","last_unstale":"2024-09-12T01:10:21.961327+0000","last_undegraded":"2024-09-12T01:10:21.961327+0000","last_fullsized":"2024-09-12T01:10:21.961327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:35.295982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":71,"num_write":206,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'180","reported_seq":761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.034161+0000","last_change":"2024-09-12T00:12:38.046524+0000","last_active":"2024-09-12T01:06:40.034161+0000","last_peered":"2024-09-12T01:06:40.034161+0000","last_clean":"2024-09-12T01:06:40.034161+0000","last_became_active":"2024-09-12T00:12:38.046276+0000","last_became_peered":"2024-09-12T00:12:38.046276+0000","last_unstale":"2024-09-12T01:06:40.034161+0000","last_undegraded":"2024-09-12T01:06:40.034161+0000","last_fullsized":"2024-09-12T01:06:40.034161+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:51.205849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":618,"num_write":256,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'434","reported_seq":1137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:05.037105+0000","last_change":"2024-09-12T00:12:36.035888+0000","last_active":"2024-09-12T01:07:05.037105+0000","last_peered":"2024-09-12T01:07:05.037105+0000","last_clean":"2024-09-12T01:07:05.037105+0000","last_became_active":"2024-09-12T00:12:36.035311+0000","last_became_peered":"2024-09-12T00:12:36.035311+0000","last_unstale":"2024-09-12T01:07:05.037105+0000","last_undegraded":"2024-09-12T01:07:05.037105+0000","last_fullsized":"2024-09-12T01:07:05.037105+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:22.262395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1143354,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":881,"num_read_kb":11265,"num_write":1412,"num_write_kb":28283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:43.033260+0000","last_change":"2024-09-12T00:12:40.035887+0000","last_active":"2024-09-12T01:06:43.033260+0000","last_peered":"2024-09-12T01:06:43.033260+0000","last_clean":"2024-09-12T01:06:43.033260+0000","last_became_active":"2024-09-12T00:12:40.035585+0000","last_became_peered":"2024-09-12T00:12:40.035585+0000","last_unstale":"2024-09-12T01:06:43.033260+0000","last_undegraded":"2024-09-12T01:06:43.033260+0000","last_fullsized":"2024-09-12T01:06:43.033260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:55.033563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'306","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.001454+0000","last_change":"2024-09-12T00:12:42.052616+0000","last_active":"2024-09-12T01:10:33.001454+0000","last_peered":"2024-09-12T01:10:33.001454+0000","last_clean":"2024-09-12T01:10:33.001454+0000","last_became_active":"2024-09-12T00:12:42.052279+0000","last_became_peered":"2024-09-12T00:12:42.052279+0000","last_unstale":"2024-09-12T01:10:33.001454+0000","last_undegraded":"2024-09-12T01:10:33.001454+0000","last_fullsized":"2024-09-12T01:10:33.001454+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:39.576180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60389,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":500,"num_read_kb":993,"num_write":404,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'770","reported_seq":4971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.870432+0000","last_change":"2024-09-12T00:12:44.060751+0000","last_active":"2024-09-12T01:10:35.870432+0000","last_peered":"2024-09-12T01:10:35.870432+0000","last_clean":"2024-09-12T01:10:35.870432+0000","last_became_active":"2024-09-12T00:12:44.060494+0000","last_became_peered":"2024-09-12T00:12:44.060494+0000","last_unstale":"2024-09-12T01:10:35.870432+0000","last_undegraded":"2024-09-12T01:10:35.870432+0000","last_fullsized":"2024-09-12T01:10:35.870432+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:43.956970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'133","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.942636+0000","last_change":"2024-09-12T00:12:46.060540+0000","last_active":"2024-09-12T01:09:20.942636+0000","last_peered":"2024-09-12T01:09:20.942636+0000","last_clean":"2024-09-12T01:09:20.942636+0000","last_became_active":"2024-09-12T00:12:46.060211+0000","last_became_peered":"2024-09-12T00:12:46.060211+0000","last_unstale":"2024-09-12T01:09:20.942636+0000","last_undegraded":"2024-09-12T01:09:20.942636+0000","last_fullsized":"2024-09-12T01:09:20.942636+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:03.614002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":113,"num_write":319,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'256","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.704664+0000","last_change":"2024-09-12T00:12:38.043160+0000","last_active":"2024-09-12T01:08:36.704664+0000","last_peered":"2024-09-12T01:08:36.704664+0000","last_clean":"2024-09-12T01:08:36.704664+0000","last_became_active":"2024-09-12T00:12:38.042601+0000","last_became_peered":"2024-09-12T00:12:38.042601+0000","last_unstale":"2024-09-12T01:08:36.704664+0000","last_undegraded":"2024-09-12T01:08:36.704664+0000","last_fullsized":"2024-09-12T01:08:36.704664+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:58.848548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1116,"num_read_kb":905,"num_write":388,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'303","reported_seq":939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.703071+0000","last_change":"2024-09-12T00:12:36.043748+0000","last_active":"2024-09-12T01:08:30.703071+0000","last_peered":"2024-09-12T01:08:30.703071+0000","last_clean":"2024-09-12T01:08:30.703071+0000","last_became_active":"2024-09-12T00:12:36.043404+0000","last_became_peered":"2024-09-12T00:12:36.043404+0000","last_unstale":"2024-09-12T01:08:30.703071+0000","last_undegraded":"2024-09-12T01:08:30.703071+0000","last_fullsized":"2024-09-12T01:08:30.703071+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:28.818965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7180177,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":450,"num_read_kb":34059,"num_write":1093,"num_write_kb":45928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'2","reported_seq":1454,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.736903+0000","last_change":"2024-09-12T00:12:40.035929+0000","last_active":"2024-09-12T01:10:32.736903+0000","last_peered":"2024-09-12T01:10:32.736903+0000","last_clean":"2024-09-12T01:10:32.736903+0000","last_became_active":"2024-09-12T00:12:40.035633+0000","last_became_peered":"2024-09-12T00:12:40.035633+0000","last_unstale":"2024-09-12T01:10:32.736903+0000","last_undegraded":"2024-09-12T01:10:32.736903+0000","last_fullsized":"2024-09-12T01:10:32.736903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:19.957170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'82","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.152071+0000","last_change":"2024-09-12T00:12:42.051649+0000","last_active":"2024-09-12T01:06:45.152071+0000","last_peered":"2024-09-12T01:06:45.152071+0000","last_clean":"2024-09-12T01:06:45.152071+0000","last_became_active":"2024-09-12T00:12:42.051384+0000","last_became_peered":"2024-09-12T00:12:42.051384+0000","last_unstale":"2024-09-12T01:06:45.152071+0000","last_undegraded":"2024-09-12T01:06:45.152071+0000","last_fullsized":"2024-09-12T01:06:45.152071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:53.378146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'774","reported_seq":4084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.870259+0000","last_change":"2024-09-12T00:12:44.062143+0000","last_active":"2024-09-12T01:10:35.870259+0000","last_peered":"2024-09-12T01:10:35.870259+0000","last_clean":"2024-09-12T01:10:35.870259+0000","last_became_active":"2024-09-12T00:12:44.061837+0000","last_became_peered":"2024-09-12T00:12:44.061837+0000","last_unstale":"2024-09-12T01:10:35.870259+0000","last_undegraded":"2024-09-12T01:10:35.870259+0000","last_fullsized":"2024-09-12T01:10:35.870259+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:55.341365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'132","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.359620+0000","last_change":"2024-09-12T00:12:46.059816+0000","last_active":"2024-09-12T01:09:22.359620+0000","last_peered":"2024-09-12T01:09:22.359620+0000","last_clean":"2024-09-12T01:09:22.359620+0000","last_became_active":"2024-09-12T00:12:46.057978+0000","last_became_peered":"2024-09-12T00:12:46.057978+0000","last_unstale":"2024-09-12T01:09:22.359620+0000","last_undegraded":"2024-09-12T01:09:22.359620+0000","last_fullsized":"2024-09-12T01:09:22.359620+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:40.034637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":126,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'235","reported_seq":844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.646426+0000","last_change":"2024-09-12T00:12:38.037321+0000","last_active":"2024-09-12T01:08:55.646426+0000","last_peered":"2024-09-12T01:08:55.646426+0000","last_clean":"2024-09-12T01:08:55.646426+0000","last_became_active":"2024-09-12T00:12:38.037035+0000","last_became_peered":"2024-09-12T00:12:38.037035+0000","last_unstale":"2024-09-12T01:08:55.646426+0000","last_undegraded":"2024-09-12T01:08:55.646426+0000","last_fullsized":"2024-09-12T01:08:55.646426+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:35.492382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":394,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'250","reported_seq":873,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.679176+0000","last_change":"2024-09-12T00:12:36.029406+0000","last_active":"2024-09-12T01:08:45.679176+0000","last_peered":"2024-09-12T01:08:45.679176+0000","last_clean":"2024-09-12T01:08:45.679176+0000","last_became_active":"2024-09-12T00:12:36.029059+0000","last_became_peered":"2024-09-12T00:12:36.029059+0000","last_unstale":"2024-09-12T01:08:45.679176+0000","last_undegraded":"2024-09-12T01:08:45.679176+0000","last_fullsized":"2024-09-12T01:08:45.679176+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:18.842991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9035013,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":371,"num_read_kb":19038,"num_write":947,"num_write_kb":37710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.034179+0000","last_change":"2024-09-12T00:12:40.042406+0000","last_active":"2024-09-12T01:06:40.034179+0000","last_peered":"2024-09-12T01:06:40.034179+0000","last_clean":"2024-09-12T01:06:40.034179+0000","last_became_active":"2024-09-12T00:12:40.042158+0000","last_became_peered":"2024-09-12T00:12:40.042158+0000","last_unstale":"2024-09-12T01:06:40.034179+0000","last_undegraded":"2024-09-12T01:06:40.034179+0000","last_fullsized":"2024-09-12T01:06:40.034179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:16.795550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'345","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.306952+0000","last_change":"2024-09-12T00:12:42.049042+0000","last_active":"2024-09-12T01:09:23.306952+0000","last_peered":"2024-09-12T01:09:23.306952+0000","last_clean":"2024-09-12T01:09:23.306952+0000","last_became_active":"2024-09-12T00:12:42.048747+0000","last_became_peered":"2024-09-12T00:12:42.048747+0000","last_unstale":"2024-09-12T01:09:23.306952+0000","last_undegraded":"2024-09-12T01:09:23.306952+0000","last_fullsized":"2024-09-12T01:09:23.306952+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:20.408850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56660,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":560,"num_read_kb":1054,"num_write":442,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.128059+0000","last_change":"2024-09-12T00:12:44.050415+0000","last_active":"2024-09-12T01:06:45.128059+0000","last_peered":"2024-09-12T01:06:45.128059+0000","last_clean":"2024-09-12T01:06:45.128059+0000","last_became_active":"2024-09-12T00:12:44.050074+0000","last_became_peered":"2024-09-12T00:12:44.050074+0000","last_unstale":"2024-09-12T01:06:45.128059+0000","last_undegraded":"2024-09-12T01:06:45.128059+0000","last_fullsized":"2024-09-12T01:06:45.128059+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:57.225646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'192","reported_seq":698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.036974+0000","last_change":"2024-09-12T00:12:46.064781+0000","last_active":"2024-09-12T01:07:00.036974+0000","last_peered":"2024-09-12T01:07:00.036974+0000","last_clean":"2024-09-12T01:07:00.036974+0000","last_became_active":"2024-09-12T00:12:46.064517+0000","last_became_peered":"2024-09-12T00:12:46.064517+0000","last_unstale":"2024-09-12T01:07:00.036974+0000","last_undegraded":"2024-09-12T01:07:00.036974+0000","last_fullsized":"2024-09-12T01:07:00.036974+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:13.273953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":229,"num_read_kb":204,"num_write":354,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'287","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:10.051836+0000","last_change":"2024-09-12T00:12:38.042874+0000","last_active":"2024-09-12T01:09:10.051836+0000","last_peered":"2024-09-12T01:09:10.051836+0000","last_clean":"2024-09-12T01:09:10.051836+0000","last_became_active":"2024-09-12T00:12:38.040885+0000","last_became_peered":"2024-09-12T00:12:38.040885+0000","last_unstale":"2024-09-12T01:09:10.051836+0000","last_undegraded":"2024-09-12T01:09:10.051836+0000","last_fullsized":"2024-09-12T01:09:10.051836+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:18.323532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1200,"num_read_kb":970,"num_write":419,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.239059+0000","last_change":"2024-09-12T00:12:17.818843+0000","last_active":"2024-09-12T01:08:25.239059+0000","last_peered":"2024-09-12T01:08:25.239059+0000","last_clean":"2024-09-12T01:08:25.239059+0000","last_became_active":"2024-09-12T00:12:17.817880+0000","last_became_peered":"2024-09-12T00:12:17.817880+0000","last_unstale":"2024-09-12T01:08:25.239059+0000","last_undegraded":"2024-09-12T01:08:25.239059+0000","last_fullsized":"2024-09-12T01:08:25.239059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:16.658840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:16.658840+0000","last_clean_scrub_stamp":"2024-09-12T00:12:16.658840+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:23.769027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.048041+0000","last_change":"2024-09-12T00:12:24.720432+0000","last_active":"2024-09-12T01:08:40.048041+0000","last_peered":"2024-09-12T01:08:40.048041+0000","last_clean":"2024-09-12T01:08:40.048041+0000","last_became_active":"2024-09-12T00:12:22.713297+0000","last_became_peered":"2024-09-12T00:12:22.713297+0000","last_unstale":"2024-09-12T01:08:40.048041+0000","last_undegraded":"2024-09-12T01:08:40.048041+0000","last_fullsized":"2024-09-12T01:08:40.048041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:31.323737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014022310000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'314","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035100+0000","last_change":"2024-09-12T00:12:36.031160+0000","last_active":"2024-09-12T01:06:50.035100+0000","last_peered":"2024-09-12T01:06:50.035100+0000","last_clean":"2024-09-12T01:06:50.035100+0000","last_became_active":"2024-09-12T00:12:36.030408+0000","last_became_peered":"2024-09-12T00:12:36.030408+0000","last_unstale":"2024-09-12T01:06:50.035100+0000","last_undegraded":"2024-09-12T01:06:50.035100+0000","last_fullsized":"2024-09-12T01:06:50.035100+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:33.226277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21257187,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":680,"num_read_kb":42609,"num_write":1091,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"39'3","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.726269+0000","last_change":"2024-09-12T00:12:40.039805+0000","last_active":"2024-09-12T01:10:32.726269+0000","last_peered":"2024-09-12T01:10:32.726269+0000","last_clean":"2024-09-12T01:10:32.726269+0000","last_became_active":"2024-09-12T00:12:40.039529+0000","last_became_peered":"2024-09-12T00:12:40.039529+0000","last_unstale":"2024-09-12T01:10:32.726269+0000","last_undegraded":"2024-09-12T01:10:32.726269+0000","last_fullsized":"2024-09-12T01:10:32.726269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:59.811179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'749","reported_seq":1443,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.989481+0000","last_change":"2024-09-12T00:12:42.047000+0000","last_active":"2024-09-12T01:10:32.989481+0000","last_peered":"2024-09-12T01:10:32.989481+0000","last_clean":"2024-09-12T01:10:32.989481+0000","last_became_active":"2024-09-12T00:12:42.046668+0000","last_became_peered":"2024-09-12T00:12:42.046668+0000","last_unstale":"2024-09-12T01:10:32.989481+0000","last_undegraded":"2024-09-12T01:10:32.989481+0000","last_fullsized":"2024-09-12T01:10:32.989481+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:28.052922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180876,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1457,"num_read_kb":2974,"num_write":1430,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:58.035351+0000","last_change":"2024-09-12T00:12:44.054071+0000","last_active":"2024-09-12T01:06:58.035351+0000","last_peered":"2024-09-12T01:06:58.035351+0000","last_clean":"2024-09-12T01:06:58.035351+0000","last_became_active":"2024-09-12T00:12:44.053779+0000","last_became_peered":"2024-09-12T00:12:44.053779+0000","last_unstale":"2024-09-12T01:06:58.035351+0000","last_undegraded":"2024-09-12T01:06:58.035351+0000","last_fullsized":"2024-09-12T01:06:58.035351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:27.975447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'187","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.839569+0000","last_change":"2024-09-12T00:12:46.055892+0000","last_active":"2024-09-12T01:09:21.839569+0000","last_peered":"2024-09-12T01:09:21.839569+0000","last_clean":"2024-09-12T01:09:21.839569+0000","last_became_active":"2024-09-12T00:12:46.055501+0000","last_became_peered":"2024-09-12T00:12:46.055501+0000","last_unstale":"2024-09-12T01:09:21.839569+0000","last_undegraded":"2024-09-12T01:09:21.839569+0000","last_fullsized":"2024-09-12T01:09:21.839569+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:21.728435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":436,"num_write":384,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'149","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.983294+0000","last_change":"2024-09-12T00:12:38.037702+0000","last_active":"2024-09-12T01:06:50.983294+0000","last_peered":"2024-09-12T01:06:50.983294+0000","last_clean":"2024-09-12T01:06:50.983294+0000","last_became_active":"2024-09-12T00:12:38.037392+0000","last_became_peered":"2024-09-12T00:12:38.037392+0000","last_unstale":"2024-09-12T01:06:50.983294+0000","last_undegraded":"2024-09-12T01:06:50.983294+0000","last_fullsized":"2024-09-12T01:06:50.983294+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:11.775556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":647,"num_read_kb":530,"num_write":212,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.047963+0000","last_change":"2024-09-12T00:12:24.720267+0000","last_active":"2024-09-12T01:08:40.047963+0000","last_peered":"2024-09-12T01:08:40.047963+0000","last_clean":"2024-09-12T01:08:40.047963+0000","last_became_active":"2024-09-12T00:12:22.713657+0000","last_became_peered":"2024-09-12T00:12:22.713657+0000","last_unstale":"2024-09-12T01:08:40.047963+0000","last_undegraded":"2024-09-12T01:08:40.047963+0000","last_fullsized":"2024-09-12T01:08:40.047963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:55.127846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012667690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'274","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:01.178847+0000","last_change":"2024-09-12T00:12:36.036400+0000","last_active":"2024-09-12T01:07:01.178847+0000","last_peered":"2024-09-12T01:07:01.178847+0000","last_clean":"2024-09-12T01:07:01.178847+0000","last_became_active":"2024-09-12T00:12:36.036010+0000","last_became_peered":"2024-09-12T00:12:36.036010+0000","last_unstale":"2024-09-12T01:07:01.178847+0000","last_undegraded":"2024-09-12T01:07:01.178847+0000","last_fullsized":"2024-09-12T01:07:01.178847+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:28.310996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9561323,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":463,"num_read_kb":7159,"num_write":1042,"num_write_kb":37525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035353+0000","last_change":"2024-09-12T00:12:40.039924+0000","last_active":"2024-09-12T01:06:50.035353+0000","last_peered":"2024-09-12T01:06:50.035353+0000","last_clean":"2024-09-12T01:06:50.035353+0000","last_became_active":"2024-09-12T00:12:40.039592+0000","last_became_peered":"2024-09-12T00:12:40.039592+0000","last_unstale":"2024-09-12T01:06:50.035353+0000","last_undegraded":"2024-09-12T01:06:50.035353+0000","last_fullsized":"2024-09-12T01:06:50.035353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:03.351155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1291","reported_seq":2905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.870389+0000","last_change":"2024-09-12T00:12:42.049983+0000","last_active":"2024-09-12T01:10:35.870389+0000","last_peered":"2024-09-12T01:10:35.870389+0000","last_clean":"2024-09-12T01:10:35.870389+0000","last_became_active":"2024-09-12T00:12:42.049594+0000","last_became_peered":"2024-09-12T00:12:42.049594+0000","last_unstale":"2024-09-12T01:10:35.870389+0000","last_undegraded":"2024-09-12T01:10:35.870389+0000","last_fullsized":"2024-09-12T01:10:35.870389+0000","mapping_epoch":33,"log_start":"263'1201","ondisk_log_start":"263'1201","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":1201,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:24.166453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181533,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2029,"num_read_kb":3499,"num_write":1142,"num_write_kb":986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.037681+0000","last_change":"2024-09-12T00:12:44.059941+0000","last_active":"2024-09-12T01:07:10.037681+0000","last_peered":"2024-09-12T01:07:10.037681+0000","last_clean":"2024-09-12T01:07:10.037681+0000","last_became_active":"2024-09-12T00:12:44.059188+0000","last_became_peered":"2024-09-12T00:12:44.059188+0000","last_unstale":"2024-09-12T01:07:10.037681+0000","last_undegraded":"2024-09-12T01:07:10.037681+0000","last_fullsized":"2024-09-12T01:07:10.037681+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:21.870093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'151","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.534259+0000","last_change":"2024-09-12T00:12:46.065282+0000","last_active":"2024-09-12T01:09:21.534259+0000","last_peered":"2024-09-12T01:09:21.534259+0000","last_clean":"2024-09-12T01:09:21.534259+0000","last_became_active":"2024-09-12T00:12:46.064993+0000","last_became_peered":"2024-09-12T00:12:46.064993+0000","last_unstale":"2024-09-12T01:09:21.534259+0000","last_undegraded":"2024-09-12T01:09:21.534259+0000","last_fullsized":"2024-09-12T01:09:21.534259+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:44.458446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":277,"num_write":363,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'61","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.153022+0000","last_change":"2024-09-12T00:12:38.039881+0000","last_active":"2024-09-12T01:06:50.153022+0000","last_peered":"2024-09-12T01:06:50.153022+0000","last_clean":"2024-09-12T01:06:50.153022+0000","last_became_active":"2024-09-12T00:12:38.039492+0000","last_became_peered":"2024-09-12T00:12:38.039492+0000","last_unstale":"2024-09-12T01:06:50.153022+0000","last_undegraded":"2024-09-12T01:06:50.153022+0000","last_fullsized":"2024-09-12T01:06:50.153022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:21.545330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":235,"num_write":88,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.053063+0000","last_change":"2024-09-12T00:12:25.140418+0000","last_active":"2024-09-12T01:08:40.053063+0000","last_peered":"2024-09-12T01:08:40.053063+0000","last_clean":"2024-09-12T01:08:40.053063+0000","last_became_active":"2024-09-12T00:12:22.714487+0000","last_became_peered":"2024-09-12T00:12:22.714487+0000","last_unstale":"2024-09-12T01:08:40.053063+0000","last_undegraded":"2024-09-12T01:08:40.053063+0000","last_fullsized":"2024-09-12T01:08:40.053063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:43.265742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038937299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'259","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.052910+0000","last_change":"2024-09-12T00:12:36.042842+0000","last_active":"2024-09-12T01:08:53.052910+0000","last_peered":"2024-09-12T01:08:53.052910+0000","last_clean":"2024-09-12T01:08:53.052910+0000","last_became_active":"2024-09-12T00:12:36.042293+0000","last_became_peered":"2024-09-12T00:12:36.042293+0000","last_unstale":"2024-09-12T01:08:53.052910+0000","last_undegraded":"2024-09-12T01:08:53.052910+0000","last_fullsized":"2024-09-12T01:08:53.052910+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:27.070087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8603516,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":428,"num_read_kb":33497,"num_write":1002,"num_write_kb":40497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"32'1","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035127+0000","last_change":"2024-09-12T00:12:40.038528+0000","last_active":"2024-09-12T01:06:50.035127+0000","last_peered":"2024-09-12T01:06:50.035127+0000","last_clean":"2024-09-12T01:06:50.035127+0000","last_became_active":"2024-09-12T00:12:40.038202+0000","last_became_peered":"2024-09-12T00:12:40.038202+0000","last_unstale":"2024-09-12T01:06:50.035127+0000","last_undegraded":"2024-09-12T01:06:50.035127+0000","last_fullsized":"2024-09-12T01:06:50.035127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:20.002180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'248","reported_seq":1480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:30.102145+0000","last_change":"2024-09-12T00:12:42.044804+0000","last_active":"2024-09-12T01:10:30.102145+0000","last_peered":"2024-09-12T01:10:30.102145+0000","last_clean":"2024-09-12T01:10:30.102145+0000","last_became_active":"2024-09-12T00:12:42.044498+0000","last_became_peered":"2024-09-12T00:12:42.044498+0000","last_unstale":"2024-09-12T01:10:30.102145+0000","last_undegraded":"2024-09-12T01:10:30.102145+0000","last_fullsized":"2024-09-12T01:10:30.102145+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:46.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":187,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.036173+0000","last_change":"2024-09-12T00:12:44.062318+0000","last_active":"2024-09-12T01:06:55.036173+0000","last_peered":"2024-09-12T01:06:55.036173+0000","last_clean":"2024-09-12T01:06:55.036173+0000","last_became_active":"2024-09-12T00:12:44.062039+0000","last_became_peered":"2024-09-12T00:12:44.062039+0000","last_unstale":"2024-09-12T01:06:55.036173+0000","last_undegraded":"2024-09-12T01:06:55.036173+0000","last_fullsized":"2024-09-12T01:06:55.036173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:41.686967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'260","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.751353+0000","last_change":"2024-09-12T00:12:46.053602+0000","last_active":"2024-09-12T01:09:22.751353+0000","last_peered":"2024-09-12T01:09:22.751353+0000","last_clean":"2024-09-12T01:09:22.751353+0000","last_became_active":"2024-09-12T00:12:46.053228+0000","last_became_peered":"2024-09-12T00:12:46.053228+0000","last_unstale":"2024-09-12T01:09:22.751353+0000","last_undegraded":"2024-09-12T01:09:22.751353+0000","last_fullsized":"2024-09-12T01:09:22.751353+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:21.825120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":531,"num_write":580,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'172","reported_seq":751,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.152971+0000","last_change":"2024-09-12T00:12:38.040785+0000","last_active":"2024-09-12T01:06:50.152971+0000","last_peered":"2024-09-12T01:06:50.152971+0000","last_clean":"2024-09-12T01:06:50.152971+0000","last_became_active":"2024-09-12T00:12:38.040477+0000","last_became_peered":"2024-09-12T00:12:38.040477+0000","last_unstale":"2024-09-12T01:06:50.152971+0000","last_undegraded":"2024-09-12T01:06:50.152971+0000","last_fullsized":"2024-09-12T01:06:50.152971+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.489846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":766,"num_read_kb":623,"num_write":281,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.048018+0000","last_change":"2024-09-12T00:12:24.719660+0000","last_active":"2024-09-12T01:08:40.048018+0000","last_peered":"2024-09-12T01:08:40.048018+0000","last_clean":"2024-09-12T01:08:40.048018+0000","last_became_active":"2024-09-12T00:12:22.840587+0000","last_became_peered":"2024-09-12T00:12:22.840587+0000","last_unstale":"2024-09-12T01:08:40.048018+0000","last_undegraded":"2024-09-12T01:08:40.048018+0000","last_fullsized":"2024-09-12T01:08:40.048018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:04.555069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065014999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'301","reported_seq":1018,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.174386+0000","last_change":"2024-09-12T00:12:36.040303+0000","last_active":"2024-09-12T01:07:43.174386+0000","last_peered":"2024-09-12T01:07:43.174386+0000","last_clean":"2024-09-12T01:07:43.174386+0000","last_became_active":"2024-09-12T00:12:36.039564+0000","last_became_peered":"2024-09-12T00:12:36.039564+0000","last_unstale":"2024-09-12T01:07:43.174386+0000","last_undegraded":"2024-09-12T01:07:43.174386+0000","last_fullsized":"2024-09-12T01:07:43.174386+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:41.381139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9770591,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":569,"num_read_kb":35581,"num_write":1119,"num_write_kb":35527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.037023+0000","last_change":"2024-09-12T00:12:40.042792+0000","last_active":"2024-09-12T01:07:00.037023+0000","last_peered":"2024-09-12T01:07:00.037023+0000","last_clean":"2024-09-12T01:07:00.037023+0000","last_became_active":"2024-09-12T00:12:40.042510+0000","last_became_peered":"2024-09-12T00:12:40.042510+0000","last_unstale":"2024-09-12T01:07:00.037023+0000","last_undegraded":"2024-09-12T01:07:00.037023+0000","last_fullsized":"2024-09-12T01:07:00.037023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:33.760779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'131","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.054611+0000","last_change":"2024-09-12T00:12:42.051046+0000","last_active":"2024-09-12T01:09:03.054611+0000","last_peered":"2024-09-12T01:09:03.054611+0000","last_clean":"2024-09-12T01:09:03.054611+0000","last_became_active":"2024-09-12T00:12:42.050143+0000","last_became_peered":"2024-09-12T00:12:42.050143+0000","last_unstale":"2024-09-12T01:09:03.054611+0000","last_undegraded":"2024-09-12T01:09:03.054611+0000","last_fullsized":"2024-09-12T01:09:03.054611+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:15.073604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.035914+0000","last_change":"2024-09-12T00:12:44.059423+0000","last_active":"2024-09-12T01:06:55.035914+0000","last_peered":"2024-09-12T01:06:55.035914+0000","last_clean":"2024-09-12T01:06:55.035914+0000","last_became_active":"2024-09-12T00:12:44.059037+0000","last_became_peered":"2024-09-12T00:12:44.059037+0000","last_unstale":"2024-09-12T01:06:55.035914+0000","last_undegraded":"2024-09-12T01:06:55.035914+0000","last_fullsized":"2024-09-12T01:06:55.035914+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:59.363962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'163","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.572035+0000","last_change":"2024-09-12T00:12:46.069307+0000","last_active":"2024-09-12T01:09:21.572035+0000","last_peered":"2024-09-12T01:09:21.572035+0000","last_clean":"2024-09-12T01:09:21.572035+0000","last_became_active":"2024-09-12T00:12:46.068934+0000","last_became_peered":"2024-09-12T00:12:46.068934+0000","last_unstale":"2024-09-12T01:09:21.572035+0000","last_undegraded":"2024-09-12T01:09:21.572035+0000","last_fullsized":"2024-09-12T01:09:21.572035+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:07.233294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":270,"num_read_kb":259,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'110","reported_seq":685,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.152888+0000","last_change":"2024-09-12T00:12:38.044730+0000","last_active":"2024-09-12T01:06:50.152888+0000","last_peered":"2024-09-12T01:06:50.152888+0000","last_clean":"2024-09-12T01:06:50.152888+0000","last_became_active":"2024-09-12T00:12:38.044464+0000","last_became_peered":"2024-09-12T00:12:38.044464+0000","last_unstale":"2024-09-12T01:06:50.152888+0000","last_undegraded":"2024-09-12T01:06:50.152888+0000","last_fullsized":"2024-09-12T01:06:50.152888+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:14.066506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":513,"num_read_kb":428,"num_write":178,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'319","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.729395+0000","last_change":"2024-09-12T00:12:36.037463+0000","last_active":"2024-09-12T01:08:27.729395+0000","last_peered":"2024-09-12T01:08:27.729395+0000","last_clean":"2024-09-12T01:08:27.729395+0000","last_became_active":"2024-09-12T00:12:36.036570+0000","last_became_peered":"2024-09-12T00:12:36.036570+0000","last_unstale":"2024-09-12T01:08:27.729395+0000","last_undegraded":"2024-09-12T01:08:27.729395+0000","last_fullsized":"2024-09-12T01:08:27.729395+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:27.156201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6816504,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":752,"num_read_kb":22341,"num_write":1095,"num_write_kb":30942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:38.050417+0000","last_change":"2024-09-12T00:12:24.788080+0000","last_active":"2024-09-12T01:08:38.050417+0000","last_peered":"2024-09-12T01:08:38.050417+0000","last_clean":"2024-09-12T01:08:38.050417+0000","last_became_active":"2024-09-12T00:12:22.840210+0000","last_became_peered":"2024-09-12T00:12:22.840210+0000","last_unstale":"2024-09-12T01:08:38.050417+0000","last_undegraded":"2024-09-12T01:08:38.050417+0000","last_fullsized":"2024-09-12T01:08:38.050417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.906053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043827699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035136+0000","last_change":"2024-09-12T00:12:40.041037+0000","last_active":"2024-09-12T01:06:50.035136+0000","last_peered":"2024-09-12T01:06:50.035136+0000","last_clean":"2024-09-12T01:06:50.035136+0000","last_became_active":"2024-09-12T00:12:40.040760+0000","last_became_peered":"2024-09-12T00:12:40.040760+0000","last_unstale":"2024-09-12T01:06:50.035136+0000","last_undegraded":"2024-09-12T01:06:50.035136+0000","last_fullsized":"2024-09-12T01:06:50.035136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:43.762744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'616","reported_seq":1278,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.000115+0000","last_change":"2024-09-12T00:12:42.053771+0000","last_active":"2024-09-12T01:10:33.000115+0000","last_peered":"2024-09-12T01:10:33.000115+0000","last_clean":"2024-09-12T01:10:33.000115+0000","last_became_active":"2024-09-12T00:12:42.053472+0000","last_became_peered":"2024-09-12T00:12:42.053472+0000","last_unstale":"2024-09-12T01:10:33.000115+0000","last_undegraded":"2024-09-12T01:10:33.000115+0000","last_fullsized":"2024-09-12T01:10:33.000115+0000","mapping_epoch":33,"log_start":"263'600","ondisk_log_start":"263'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":600,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:10.598317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123401,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1689,"num_read_kb":2758,"num_write":2204,"num_write_kb":2034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.129178+0000","last_change":"2024-09-12T00:12:44.049070+0000","last_active":"2024-09-12T01:06:55.129178+0000","last_peered":"2024-09-12T01:06:55.129178+0000","last_clean":"2024-09-12T01:06:55.129178+0000","last_became_active":"2024-09-12T00:12:44.048703+0000","last_became_peered":"2024-09-12T00:12:44.048703+0000","last_unstale":"2024-09-12T01:06:55.129178+0000","last_undegraded":"2024-09-12T01:06:55.129178+0000","last_fullsized":"2024-09-12T01:06:55.129178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:10.832094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'142","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.054601+0000","last_change":"2024-09-12T00:12:46.064205+0000","last_active":"2024-09-12T01:09:03.054601+0000","last_peered":"2024-09-12T01:09:03.054601+0000","last_clean":"2024-09-12T01:09:03.054601+0000","last_became_active":"2024-09-12T00:12:46.063429+0000","last_became_peered":"2024-09-12T00:12:46.063429+0000","last_unstale":"2024-09-12T01:09:03.054601+0000","last_undegraded":"2024-09-12T01:09:03.054601+0000","last_fullsized":"2024-09-12T01:09:03.054601+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:01.539611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":320,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'177","reported_seq":786,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.831865+0000","last_change":"2024-09-12T00:12:38.041538+0000","last_active":"2024-09-12T01:07:41.831865+0000","last_peered":"2024-09-12T01:07:41.831865+0000","last_clean":"2024-09-12T01:07:41.831865+0000","last_became_active":"2024-09-12T00:12:38.041178+0000","last_became_peered":"2024-09-12T00:12:38.041178+0000","last_unstale":"2024-09-12T01:07:41.831865+0000","last_undegraded":"2024-09-12T01:07:41.831865+0000","last_fullsized":"2024-09-12T01:07:41.831865+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:50.594465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":778,"num_read_kb":646,"num_write":262,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'286","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:12.276118+0000","last_change":"2024-09-12T00:12:36.036323+0000","last_active":"2024-09-12T01:07:12.276118+0000","last_peered":"2024-09-12T01:07:12.276118+0000","last_clean":"2024-09-12T01:07:12.276118+0000","last_became_active":"2024-09-12T00:12:36.035932+0000","last_became_peered":"2024-09-12T00:12:36.035932+0000","last_unstale":"2024-09-12T01:07:12.276118+0000","last_undegraded":"2024-09-12T01:07:12.276118+0000","last_fullsized":"2024-09-12T01:07:12.276118+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:58.357878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9574875,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":431,"num_read_kb":22294,"num_write":1091,"num_write_kb":32564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035300+0000","last_change":"2024-09-12T00:12:24.719653+0000","last_active":"2024-09-12T01:06:50.035300+0000","last_peered":"2024-09-12T01:06:50.035300+0000","last_clean":"2024-09-12T01:06:50.035300+0000","last_became_active":"2024-09-12T00:12:22.713263+0000","last_became_peered":"2024-09-12T00:12:22.713263+0000","last_unstale":"2024-09-12T01:06:50.035300+0000","last_undegraded":"2024-09-12T01:06:50.035300+0000","last_fullsized":"2024-09-12T01:06:50.035300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:13.032469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065424400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.022587+0000","last_change":"2024-09-12T00:12:40.039181+0000","last_active":"2024-09-12T01:06:50.022587+0000","last_peered":"2024-09-12T01:06:50.022587+0000","last_clean":"2024-09-12T01:06:50.022587+0000","last_became_active":"2024-09-12T00:12:40.038903+0000","last_became_peered":"2024-09-12T00:12:40.038903+0000","last_unstale":"2024-09-12T01:06:50.022587+0000","last_undegraded":"2024-09-12T01:06:50.022587+0000","last_fullsized":"2024-09-12T01:06:50.022587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:00.591959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'172","reported_seq":741,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.153591+0000","last_change":"2024-09-12T00:12:42.050874+0000","last_active":"2024-09-12T01:06:55.153591+0000","last_peered":"2024-09-12T01:06:55.153591+0000","last_clean":"2024-09-12T01:06:55.153591+0000","last_became_active":"2024-09-12T00:12:42.050580+0000","last_became_peered":"2024-09-12T00:12:42.050580+0000","last_unstale":"2024-09-12T01:06:55.153591+0000","last_undegraded":"2024-09-12T01:06:55.153591+0000","last_fullsized":"2024-09-12T01:06:55.153591+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:59.841756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":221,"num_write":156,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'775","reported_seq":2698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:36.413895+0000","last_change":"2024-09-12T00:12:44.050548+0000","last_active":"2024-09-12T01:10:36.413895+0000","last_peered":"2024-09-12T01:10:36.413895+0000","last_clean":"2024-09-12T01:10:36.413895+0000","last_became_active":"2024-09-12T00:12:44.050295+0000","last_became_peered":"2024-09-12T00:12:44.050295+0000","last_unstale":"2024-09-12T01:10:36.413895+0000","last_undegraded":"2024-09-12T01:10:36.413895+0000","last_fullsized":"2024-09-12T01:10:36.413895+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:53.235246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'126","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.059081+0000","last_change":"2024-09-12T00:12:46.064323+0000","last_active":"2024-09-12T01:09:15.059081+0000","last_peered":"2024-09-12T01:09:15.059081+0000","last_clean":"2024-09-12T01:09:15.059081+0000","last_became_active":"2024-09-12T00:12:46.064036+0000","last_became_peered":"2024-09-12T00:12:46.064036+0000","last_unstale":"2024-09-12T01:09:15.059081+0000","last_undegraded":"2024-09-12T01:09:15.059081+0000","last_fullsized":"2024-09-12T01:09:15.059081+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:58.782613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1116,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'65","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.900165+0000","last_change":"2024-09-12T00:12:38.040132+0000","last_active":"2024-09-12T01:10:35.900165+0000","last_peered":"2024-09-12T01:10:35.900165+0000","last_clean":"2024-09-12T01:10:35.900165+0000","last_became_active":"2024-09-12T00:12:38.039759+0000","last_became_peered":"2024-09-12T00:12:38.039759+0000","last_unstale":"2024-09-12T01:10:35.900165+0000","last_undegraded":"2024-09-12T01:10:35.900165+0000","last_fullsized":"2024-09-12T01:10:35.900165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:56.827266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":290,"num_read_kb":242,"num_write":89,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'293","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035264+0000","last_change":"2024-09-12T00:12:36.032820+0000","last_active":"2024-09-12T01:06:50.035264+0000","last_peered":"2024-09-12T01:06:50.035264+0000","last_clean":"2024-09-12T01:06:50.035264+0000","last_became_active":"2024-09-12T00:12:36.032470+0000","last_became_peered":"2024-09-12T00:12:36.032470+0000","last_unstale":"2024-09-12T01:06:50.035264+0000","last_undegraded":"2024-09-12T01:06:50.035264+0000","last_fullsized":"2024-09-12T01:06:50.035264+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:59.424753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4550458,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":443,"num_read_kb":9891,"num_write":1138,"num_write_kb":25017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.054108+0000","last_change":"2024-09-12T00:12:24.719145+0000","last_active":"2024-09-12T01:08:45.054108+0000","last_peered":"2024-09-12T01:08:45.054108+0000","last_clean":"2024-09-12T01:08:45.054108+0000","last_became_active":"2024-09-12T00:12:22.875452+0000","last_became_peered":"2024-09-12T00:12:22.875452+0000","last_unstale":"2024-09-12T01:08:45.054108+0000","last_undegraded":"2024-09-12T01:08:45.054108+0000","last_fullsized":"2024-09-12T01:08:45.054108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:18.582665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040035500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035250+0000","last_change":"2024-09-12T00:12:40.040001+0000","last_active":"2024-09-12T01:06:50.035250+0000","last_peered":"2024-09-12T01:06:50.035250+0000","last_clean":"2024-09-12T01:06:50.035250+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:06:50.035250+0000","last_undegraded":"2024-09-12T01:06:50.035250+0000","last_fullsized":"2024-09-12T01:06:50.035250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:47.045425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'129","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.035838+0000","last_change":"2024-09-12T00:12:42.048645+0000","last_active":"2024-09-12T01:06:55.035838+0000","last_peered":"2024-09-12T01:06:55.035838+0000","last_clean":"2024-09-12T01:06:55.035838+0000","last_became_active":"2024-09-12T00:12:42.048364+0000","last_became_peered":"2024-09-12T00:12:42.048364+0000","last_unstale":"2024-09-12T01:06:55.035838+0000","last_undegraded":"2024-09-12T01:06:55.035838+0000","last_fullsized":"2024-09-12T01:06:55.035838+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:36.782398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'805","reported_seq":2514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.885117+0000","last_change":"2024-09-12T00:12:44.050927+0000","last_active":"2024-09-12T01:10:57.885117+0000","last_peered":"2024-09-12T01:10:57.885117+0000","last_clean":"2024-09-12T01:10:57.885117+0000","last_became_active":"2024-09-12T00:12:44.049336+0000","last_became_peered":"2024-09-12T00:12:44.049336+0000","last_unstale":"2024-09-12T01:10:57.885117+0000","last_undegraded":"2024-09-12T01:10:57.885117+0000","last_fullsized":"2024-09-12T01:10:57.885117+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:05.958866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'271","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:44.898434+0000","last_change":"2024-09-12T00:12:46.064357+0000","last_active":"2024-09-12T01:08:44.898434+0000","last_peered":"2024-09-12T01:08:44.898434+0000","last_clean":"2024-09-12T01:08:44.898434+0000","last_became_active":"2024-09-12T00:12:46.064058+0000","last_became_peered":"2024-09-12T00:12:46.064058+0000","last_unstale":"2024-09-12T01:08:44.898434+0000","last_undegraded":"2024-09-12T01:08:44.898434+0000","last_fullsized":"2024-09-12T01:08:44.898434+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:14.383616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":363,"num_read_kb":352,"num_write":596,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'133","reported_seq":716,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.128524+0000","last_change":"2024-09-12T00:12:38.045014+0000","last_active":"2024-09-12T01:06:50.128524+0000","last_peered":"2024-09-12T01:06:50.128524+0000","last_clean":"2024-09-12T01:06:50.128524+0000","last_became_active":"2024-09-12T00:12:38.044075+0000","last_became_peered":"2024-09-12T00:12:38.044075+0000","last_unstale":"2024-09-12T01:06:50.128524+0000","last_undegraded":"2024-09-12T01:06:50.128524+0000","last_fullsized":"2024-09-12T01:06:50.128524+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:39.495991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":484,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'327","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:42.693093+0000","last_change":"2024-09-12T00:12:36.031043+0000","last_active":"2024-09-12T01:07:42.693093+0000","last_peered":"2024-09-12T01:07:42.693093+0000","last_clean":"2024-09-12T01:07:42.693093+0000","last_became_active":"2024-09-12T00:12:36.030644+0000","last_became_peered":"2024-09-12T00:12:36.030644+0000","last_unstale":"2024-09-12T01:07:42.693093+0000","last_undegraded":"2024-09-12T01:07:42.693093+0000","last_fullsized":"2024-09-12T01:07:42.693093+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:31.856368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14276891,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":655,"num_read_kb":123114,"num_write":1162,"num_write_kb":49104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.048638+0000","last_change":"2024-09-12T00:12:24.720016+0000","last_active":"2024-09-12T01:08:45.048638+0000","last_peered":"2024-09-12T01:08:45.048638+0000","last_clean":"2024-09-12T01:08:45.048638+0000","last_became_active":"2024-09-12T00:12:22.875444+0000","last_became_peered":"2024-09-12T00:12:22.875444+0000","last_unstale":"2024-09-12T01:08:45.048638+0000","last_undegraded":"2024-09-12T01:08:45.048638+0000","last_fullsized":"2024-09-12T01:08:45.048638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:01.561555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001017387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'5","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.737689+0000","last_change":"2024-09-12T00:12:40.031664+0000","last_active":"2024-09-12T01:10:32.737689+0000","last_peered":"2024-09-12T01:10:32.737689+0000","last_clean":"2024-09-12T01:10:32.737689+0000","last_became_active":"2024-09-12T00:12:40.031382+0000","last_became_peered":"2024-09-12T00:12:40.031382+0000","last_unstale":"2024-09-12T01:10:32.737689+0000","last_undegraded":"2024-09-12T01:10:32.737689+0000","last_fullsized":"2024-09-12T01:10:32.737689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:43.398397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'715","reported_seq":1425,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.978409+0000","last_change":"2024-09-12T00:12:42.043628+0000","last_active":"2024-09-12T01:10:32.978409+0000","last_peered":"2024-09-12T01:10:32.978409+0000","last_clean":"2024-09-12T01:10:32.978409+0000","last_became_active":"2024-09-12T00:12:42.043328+0000","last_became_peered":"2024-09-12T00:12:42.043328+0000","last_unstale":"2024-09-12T01:10:32.978409+0000","last_undegraded":"2024-09-12T01:10:32.978409+0000","last_fullsized":"2024-09-12T01:10:32.978409+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:41.276102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174167,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1267,"num_read_kb":2700,"num_write":1040,"num_write_kb":867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.036126+0000","last_change":"2024-09-12T00:12:44.062248+0000","last_active":"2024-09-12T01:06:55.036126+0000","last_peered":"2024-09-12T01:06:55.036126+0000","last_clean":"2024-09-12T01:06:55.036126+0000","last_became_active":"2024-09-12T00:12:44.061206+0000","last_became_peered":"2024-09-12T00:12:44.061206+0000","last_unstale":"2024-09-12T01:06:55.036126+0000","last_undegraded":"2024-09-12T01:06:55.036126+0000","last_fullsized":"2024-09-12T01:06:55.036126+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:28.838993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'95","reported_seq":588,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.128446+0000","last_change":"2024-09-12T00:12:46.058756+0000","last_active":"2024-09-12T01:09:23.128446+0000","last_peered":"2024-09-12T01:09:23.128446+0000","last_clean":"2024-09-12T01:09:23.128446+0000","last_became_active":"2024-09-12T00:12:46.058465+0000","last_became_peered":"2024-09-12T00:12:46.058465+0000","last_unstale":"2024-09-12T01:09:23.128446+0000","last_undegraded":"2024-09-12T01:09:23.128446+0000","last_fullsized":"2024-09-12T01:09:23.128446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:59.069997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":101,"num_write":234,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'139","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.693672+0000","last_change":"2024-09-12T00:12:46.063719+0000","last_active":"2024-09-12T01:10:31.693672+0000","last_peered":"2024-09-12T01:10:31.693672+0000","last_clean":"2024-09-12T01:10:31.693672+0000","last_became_active":"2024-09-12T00:12:46.063423+0000","last_became_peered":"2024-09-12T00:12:46.063423+0000","last_unstale":"2024-09-12T01:10:31.693672+0000","last_undegraded":"2024-09-12T01:10:31.693672+0000","last_fullsized":"2024-09-12T01:10:31.693672+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:35.174197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":252,"num_write":335,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'151","reported_seq":719,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:41.704952+0000","last_change":"2024-09-12T00:12:38.041953+0000","last_active":"2024-09-12T01:08:41.704952+0000","last_peered":"2024-09-12T01:08:41.704952+0000","last_clean":"2024-09-12T01:08:41.704952+0000","last_became_active":"2024-09-12T00:12:38.041665+0000","last_became_peered":"2024-09-12T00:12:38.041665+0000","last_unstale":"2024-09-12T01:08:41.704952+0000","last_undegraded":"2024-09-12T01:08:41.704952+0000","last_fullsized":"2024-09-12T01:08:41.704952+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:35.209960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":652,"num_read_kb":531,"num_write":244,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'240","reported_seq":873,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:24.214344+0000","last_change":"2024-09-12T00:13:07.152881+0000","last_active":"2024-09-12T01:10:24.214344+0000","last_peered":"2024-09-12T01:10:24.214344+0000","last_clean":"2024-09-12T01:10:24.214344+0000","last_became_active":"2024-09-12T00:13:07.152470+0000","last_became_peered":"2024-09-12T00:13:07.152470+0000","last_unstale":"2024-09-12T01:10:24.214344+0000","last_undegraded":"2024-09-12T01:10:24.214344+0000","last_fullsized":"2024-09-12T01:10:24.214344+0000","mapping_epoch":40,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:42.910204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11395301,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":377,"num_read_kb":19566,"num_write":854,"num_write_kb":20485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:20.148239+0000","last_change":"2024-09-12T00:12:40.038938+0000","last_active":"2024-09-12T01:06:20.148239+0000","last_peered":"2024-09-12T01:06:20.148239+0000","last_clean":"2024-09-12T01:06:20.148239+0000","last_became_active":"2024-09-12T00:12:40.038618+0000","last_became_peered":"2024-09-12T00:12:40.038618+0000","last_unstale":"2024-09-12T01:06:20.148239+0000","last_undegraded":"2024-09-12T01:06:20.148239+0000","last_fullsized":"2024-09-12T01:06:20.148239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:06.465719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'274","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.170957+0000","last_change":"2024-09-12T00:12:42.050190+0000","last_active":"2024-09-12T01:08:45.170957+0000","last_peered":"2024-09-12T01:08:45.170957+0000","last_clean":"2024-09-12T01:08:45.170957+0000","last_became_active":"2024-09-12T00:12:42.049685+0000","last_became_peered":"2024-09-12T00:12:42.049685+0000","last_unstale":"2024-09-12T01:08:45.170957+0000","last_undegraded":"2024-09-12T01:08:45.170957+0000","last_fullsized":"2024-09-12T01:08:45.170957+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:57.050916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54983,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":448,"num_read_kb":910,"num_write":362,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030516+0000","last_change":"2024-09-12T00:12:44.062762+0000","last_active":"2024-09-12T01:06:25.030516+0000","last_peered":"2024-09-12T01:06:25.030516+0000","last_clean":"2024-09-12T01:06:25.030516+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:06:25.030516+0000","last_undegraded":"2024-09-12T01:06:25.030516+0000","last_fullsized":"2024-09-12T01:06:25.030516+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:30.852996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":639,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.283120+0000","last_change":"2024-09-12T00:12:46.064377+0000","last_active":"2024-09-12T01:09:23.283120+0000","last_peered":"2024-09-12T01:09:23.283120+0000","last_clean":"2024-09-12T01:09:23.283120+0000","last_became_active":"2024-09-12T00:12:46.064080+0000","last_became_peered":"2024-09-12T00:12:46.064080+0000","last_unstale":"2024-09-12T01:09:23.283120+0000","last_undegraded":"2024-09-12T01:09:23.283120+0000","last_fullsized":"2024-09-12T01:09:23.283120+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:28.289493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":189,"num_write":302,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'148","reported_seq":739,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:20.029462+0000","last_change":"2024-09-12T00:12:38.045256+0000","last_active":"2024-09-12T01:06:20.029462+0000","last_peered":"2024-09-12T01:06:20.029462+0000","last_clean":"2024-09-12T01:06:20.029462+0000","last_became_active":"2024-09-12T00:12:38.044990+0000","last_became_peered":"2024-09-12T00:12:38.044990+0000","last_unstale":"2024-09-12T01:06:20.029462+0000","last_undegraded":"2024-09-12T01:06:20.029462+0000","last_fullsized":"2024-09-12T01:06:20.029462+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:23.380297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":701,"num_read_kb":570,"num_write":228,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'280","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:22.347456+0000","last_change":"2024-09-12T00:12:36.036464+0000","last_active":"2024-09-12T01:10:22.347456+0000","last_peered":"2024-09-12T01:10:22.347456+0000","last_clean":"2024-09-12T01:10:22.347456+0000","last_became_active":"2024-09-12T00:12:36.034816+0000","last_became_peered":"2024-09-12T00:12:36.034816+0000","last_unstale":"2024-09-12T01:10:22.347456+0000","last_undegraded":"2024-09-12T01:10:22.347456+0000","last_fullsized":"2024-09-12T01:10:22.347456+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:54.535251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28498,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":460,"num_read_kb":1836,"num_write":1098,"num_write_kb":16367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:20.029501+0000","last_change":"2024-09-12T00:12:40.042449+0000","last_active":"2024-09-12T01:06:20.029501+0000","last_peered":"2024-09-12T01:06:20.029501+0000","last_clean":"2024-09-12T01:06:20.029501+0000","last_became_active":"2024-09-12T00:12:40.042104+0000","last_became_peered":"2024-09-12T00:12:40.042104+0000","last_unstale":"2024-09-12T01:06:20.029501+0000","last_undegraded":"2024-09-12T01:06:20.029501+0000","last_fullsized":"2024-09-12T01:06:20.029501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:33.704187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'55","reported_seq":557,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:44.638948+0000","last_change":"2024-09-12T00:12:42.043918+0000","last_active":"2024-09-12T01:06:44.638948+0000","last_peered":"2024-09-12T01:06:44.638948+0000","last_clean":"2024-09-12T01:06:44.638948+0000","last_became_active":"2024-09-12T00:12:42.043599+0000","last_became_peered":"2024-09-12T00:12:42.043599+0000","last_unstale":"2024-09-12T01:06:44.638948+0000","last_undegraded":"2024-09-12T01:06:44.638948+0000","last_fullsized":"2024-09-12T01:06:44.638948+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:06.844583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.125476+0000","last_change":"2024-09-12T00:12:44.054488+0000","last_active":"2024-09-12T01:06:25.125476+0000","last_peered":"2024-09-12T01:06:25.125476+0000","last_clean":"2024-09-12T01:06:25.125476+0000","last_became_active":"2024-09-12T00:12:44.054145+0000","last_became_peered":"2024-09-12T00:12:44.054145+0000","last_unstale":"2024-09-12T01:06:25.125476+0000","last_undegraded":"2024-09-12T01:06:25.125476+0000","last_fullsized":"2024-09-12T01:06:25.125476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:04.106673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'200","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.568625+0000","last_change":"2024-09-12T00:12:46.059839+0000","last_active":"2024-09-12T01:09:22.568625+0000","last_peered":"2024-09-12T01:09:22.568625+0000","last_clean":"2024-09-12T01:09:22.568625+0000","last_became_active":"2024-09-12T00:12:46.059520+0000","last_became_peered":"2024-09-12T00:12:46.059520+0000","last_unstale":"2024-09-12T01:09:22.568625+0000","last_undegraded":"2024-09-12T01:09:22.568625+0000","last_fullsized":"2024-09-12T01:09:22.568625+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:17.663006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":406,"num_read_kb":365,"num_write":468,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'124","reported_seq":722,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.795658+0000","last_change":"2024-09-12T00:12:38.041224+0000","last_active":"2024-09-12T01:10:31.795658+0000","last_peered":"2024-09-12T01:10:31.795658+0000","last_clean":"2024-09-12T01:10:31.795658+0000","last_became_active":"2024-09-12T00:12:38.040948+0000","last_became_peered":"2024-09-12T00:12:38.040948+0000","last_unstale":"2024-09-12T01:10:31.795658+0000","last_undegraded":"2024-09-12T01:10:31.795658+0000","last_fullsized":"2024-09-12T01:10:31.795658+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:21.931055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":483,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'266","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:06.267240+0000","last_change":"2024-09-12T00:12:36.040361+0000","last_active":"2024-09-12T01:09:06.267240+0000","last_peered":"2024-09-12T01:09:06.267240+0000","last_clean":"2024-09-12T01:09:06.267240+0000","last_became_active":"2024-09-12T00:12:36.038823+0000","last_became_peered":"2024-09-12T00:12:36.038823+0000","last_unstale":"2024-09-12T01:09:06.267240+0000","last_undegraded":"2024-09-12T01:09:06.267240+0000","last_fullsized":"2024-09-12T01:09:06.267240+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:53.004387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4700810,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":480,"num_read_kb":31572,"num_write":1017,"num_write_kb":24420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:20.124794+0000","last_change":"2024-09-12T00:12:40.030750+0000","last_active":"2024-09-12T01:06:20.124794+0000","last_peered":"2024-09-12T01:06:20.124794+0000","last_clean":"2024-09-12T01:06:20.124794+0000","last_became_active":"2024-09-12T00:12:40.030447+0000","last_became_peered":"2024-09-12T00:12:40.030447+0000","last_unstale":"2024-09-12T01:06:20.124794+0000","last_undegraded":"2024-09-12T01:06:20.124794+0000","last_fullsized":"2024-09-12T01:06:20.124794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:19.640921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'324","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.054048+0000","last_change":"2024-09-12T00:12:42.051159+0000","last_active":"2024-09-12T01:08:45.054048+0000","last_peered":"2024-09-12T01:08:45.054048+0000","last_clean":"2024-09-12T01:08:45.054048+0000","last_became_active":"2024-09-12T00:12:42.050885+0000","last_became_peered":"2024-09-12T00:12:42.050885+0000","last_unstale":"2024-09-12T01:08:45.054048+0000","last_undegraded":"2024-09-12T01:08:45.054048+0000","last_fullsized":"2024-09-12T01:08:45.054048+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:07.994436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66063,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":533,"num_read_kb":1077,"num_write":432,"num_write_kb":331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.226242+0000","last_change":"2024-09-12T00:12:44.056404+0000","last_active":"2024-09-12T01:06:25.226242+0000","last_peered":"2024-09-12T01:06:25.226242+0000","last_clean":"2024-09-12T01:06:25.226242+0000","last_became_active":"2024-09-12T00:12:44.056032+0000","last_became_peered":"2024-09-12T00:12:44.056032+0000","last_unstale":"2024-09-12T01:06:25.226242+0000","last_undegraded":"2024-09-12T01:06:25.226242+0000","last_fullsized":"2024-09-12T01:06:25.226242+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:26.625201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'121","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.354255+0000","last_change":"2024-09-12T00:12:46.063983+0000","last_active":"2024-09-12T01:08:28.354255+0000","last_peered":"2024-09-12T01:08:28.354255+0000","last_clean":"2024-09-12T01:08:28.354255+0000","last_became_active":"2024-09-12T00:12:46.063700+0000","last_became_peered":"2024-09-12T00:12:46.063700+0000","last_unstale":"2024-09-12T01:08:28.354255+0000","last_undegraded":"2024-09-12T01:08:28.354255+0000","last_fullsized":"2024-09-12T01:08:28.354255+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:48.139495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'4185","reported_seq":4809,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:56.751537+0000","last_change":"2024-09-12T00:12:38.042946+0000","last_active":"2024-09-12T01:06:56.751537+0000","last_peered":"2024-09-12T01:06:56.751537+0000","last_clean":"2024-09-12T01:06:56.751537+0000","last_became_active":"2024-09-12T00:12:38.042680+0000","last_became_peered":"2024-09-12T00:12:38.042680+0000","last_unstale":"2024-09-12T01:06:56.751537+0000","last_undegraded":"2024-09-12T01:06:56.751537+0000","last_fullsized":"2024-09-12T01:06:56.751537+0000","mapping_epoch":29,"log_start":"263'4100","ondisk_log_start":"263'4100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":3000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:46.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16870,"num_read_kb":14146,"num_write":6296,"num_write_kb":3134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'308","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:38.068919+0000","last_change":"2024-09-12T00:12:36.034607+0000","last_active":"2024-09-12T01:10:38.068919+0000","last_peered":"2024-09-12T01:10:38.068919+0000","last_clean":"2024-09-12T01:10:38.068919+0000","last_became_active":"2024-09-12T00:12:36.034292+0000","last_became_peered":"2024-09-12T00:12:36.034292+0000","last_unstale":"2024-09-12T01:10:38.068919+0000","last_undegraded":"2024-09-12T01:10:38.068919+0000","last_fullsized":"2024-09-12T01:10:38.068919+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:00.939504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3147581,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":507,"num_read_kb":3622,"num_write":1211,"num_write_kb":13483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:20.031760+0000","last_change":"2024-09-12T00:12:40.038541+0000","last_active":"2024-09-12T01:06:20.031760+0000","last_peered":"2024-09-12T01:06:20.031760+0000","last_clean":"2024-09-12T01:06:20.031760+0000","last_became_active":"2024-09-12T00:12:40.038192+0000","last_became_peered":"2024-09-12T00:12:40.038192+0000","last_unstale":"2024-09-12T01:06:20.031760+0000","last_undegraded":"2024-09-12T01:06:20.031760+0000","last_fullsized":"2024-09-12T01:06:20.031760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:28.217627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'252","reported_seq":812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.035032+0000","last_change":"2024-09-12T00:12:42.046891+0000","last_active":"2024-09-12T01:08:45.035032+0000","last_peered":"2024-09-12T01:08:45.035032+0000","last_clean":"2024-09-12T01:08:45.035032+0000","last_became_active":"2024-09-12T00:12:42.046589+0000","last_became_peered":"2024-09-12T00:12:42.046589+0000","last_unstale":"2024-09-12T01:08:45.035032+0000","last_undegraded":"2024-09-12T01:08:45.035032+0000","last_fullsized":"2024-09-12T01:08:45.035032+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:54.242811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59252,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":423,"num_read_kb":898,"num_write":346,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030598+0000","last_change":"2024-09-12T00:12:44.057887+0000","last_active":"2024-09-12T01:06:25.030598+0000","last_peered":"2024-09-12T01:06:25.030598+0000","last_clean":"2024-09-12T01:06:25.030598+0000","last_became_active":"2024-09-12T00:12:44.057606+0000","last_became_peered":"2024-09-12T00:12:44.057606+0000","last_unstale":"2024-09-12T01:06:25.030598+0000","last_undegraded":"2024-09-12T01:06:25.030598+0000","last_fullsized":"2024-09-12T01:06:25.030598+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:25.314359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'180","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035343+0000","last_change":"2024-09-12T00:12:38.047826+0000","last_active":"2024-09-12T01:06:50.035343+0000","last_peered":"2024-09-12T01:06:50.035343+0000","last_clean":"2024-09-12T01:06:50.035343+0000","last_became_active":"2024-09-12T00:12:38.047545+0000","last_became_peered":"2024-09-12T00:12:38.047545+0000","last_unstale":"2024-09-12T01:06:50.035343+0000","last_undegraded":"2024-09-12T01:06:50.035343+0000","last_fullsized":"2024-09-12T01:06:50.035343+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:27.324611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":815,"num_read_kb":702,"num_write":306,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'263","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:38.068757+0000","last_change":"2024-09-12T00:12:36.043322+0000","last_active":"2024-09-12T01:10:38.068757+0000","last_peered":"2024-09-12T01:10:38.068757+0000","last_clean":"2024-09-12T01:10:38.068757+0000","last_became_active":"2024-09-12T00:12:36.042983+0000","last_became_peered":"2024-09-12T00:12:36.042983+0000","last_unstale":"2024-09-12T01:10:38.068757+0000","last_undegraded":"2024-09-12T01:10:38.068757+0000","last_fullsized":"2024-09-12T01:10:38.068757+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:32.011867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4217616,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":408,"num_read_kb":13747,"num_write":994,"num_write_kb":22365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.171772+0000","last_change":"2024-09-12T00:12:40.039966+0000","last_active":"2024-09-12T01:08:50.171772+0000","last_peered":"2024-09-12T01:08:50.171772+0000","last_clean":"2024-09-12T01:08:50.171772+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:08:50.171772+0000","last_undegraded":"2024-09-12T01:08:50.171772+0000","last_fullsized":"2024-09-12T01:08:50.171772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:12.418930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'488","reported_seq":1109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.975100+0000","last_change":"2024-09-12T00:12:42.050774+0000","last_active":"2024-09-12T01:10:32.975100+0000","last_peered":"2024-09-12T01:10:32.975100+0000","last_clean":"2024-09-12T01:10:32.975100+0000","last_became_active":"2024-09-12T00:12:42.050479+0000","last_became_peered":"2024-09-12T00:12:42.050479+0000","last_unstale":"2024-09-12T01:10:32.975100+0000","last_undegraded":"2024-09-12T01:10:32.975100+0000","last_fullsized":"2024-09-12T01:10:32.975100+0000","mapping_epoch":33,"log_start":"263'400","ondisk_log_start":"263'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:54.813408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128116,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":872,"num_read_kb":1889,"num_write":762,"num_write_kb":691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.134850+0000","last_change":"2024-09-12T00:12:44.061802+0000","last_active":"2024-09-12T01:07:45.134850+0000","last_peered":"2024-09-12T01:07:45.134850+0000","last_clean":"2024-09-12T01:07:45.134850+0000","last_became_active":"2024-09-12T00:12:44.061554+0000","last_became_peered":"2024-09-12T00:12:44.061554+0000","last_unstale":"2024-09-12T01:07:45.134850+0000","last_undegraded":"2024-09-12T01:07:45.134850+0000","last_fullsized":"2024-09-12T01:07:45.134850+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:41.354262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'159","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.539630+0000","last_change":"2024-09-12T00:12:46.062051+0000","last_active":"2024-09-12T01:09:22.539630+0000","last_peered":"2024-09-12T01:09:22.539630+0000","last_clean":"2024-09-12T01:09:22.539630+0000","last_became_active":"2024-09-12T00:12:46.061727+0000","last_became_peered":"2024-09-12T00:12:46.061727+0000","last_unstale":"2024-09-12T01:09:22.539630+0000","last_undegraded":"2024-09-12T01:09:22.539630+0000","last_fullsized":"2024-09-12T01:09:22.539630+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.660864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":216,"num_write":366,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'66","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.302716+0000","last_change":"2024-09-12T00:12:38.040768+0000","last_active":"2024-09-12T01:09:23.302716+0000","last_peered":"2024-09-12T01:09:23.302716+0000","last_clean":"2024-09-12T01:09:23.302716+0000","last_became_active":"2024-09-12T00:12:38.040282+0000","last_became_peered":"2024-09-12T00:12:38.040282+0000","last_unstale":"2024-09-12T01:09:23.302716+0000","last_undegraded":"2024-09-12T01:09:23.302716+0000","last_fullsized":"2024-09-12T01:09:23.302716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:50.542495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":276,"num_write":85,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'280","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.148373+0000","last_change":"2024-09-12T00:12:36.032117+0000","last_active":"2024-09-12T01:08:36.148373+0000","last_peered":"2024-09-12T01:08:36.148373+0000","last_clean":"2024-09-12T01:08:36.148373+0000","last_became_active":"2024-09-12T00:12:36.031081+0000","last_became_peered":"2024-09-12T00:12:36.031081+0000","last_unstale":"2024-09-12T01:08:36.148373+0000","last_undegraded":"2024-09-12T01:08:36.148373+0000","last_fullsized":"2024-09-12T01:08:36.148373+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:31.633755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15053181,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":554,"num_read_kb":88549,"num_write":1010,"num_write_kb":46090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.128624+0000","last_change":"2024-09-12T00:12:40.037157+0000","last_active":"2024-09-12T01:06:50.128624+0000","last_peered":"2024-09-12T01:06:50.128624+0000","last_clean":"2024-09-12T01:06:50.128624+0000","last_became_active":"2024-09-12T00:12:40.036842+0000","last_became_peered":"2024-09-12T00:12:40.036842+0000","last_unstale":"2024-09-12T01:06:50.128624+0000","last_undegraded":"2024-09-12T01:06:50.128624+0000","last_fullsized":"2024-09-12T01:06:50.128624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:07.662805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'294","reported_seq":875,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:15.060093+0000","last_change":"2024-09-12T00:12:42.044141+0000","last_active":"2024-09-12T01:10:15.060093+0000","last_peered":"2024-09-12T01:10:15.060093+0000","last_clean":"2024-09-12T01:10:15.060093+0000","last_became_active":"2024-09-12T00:12:42.043681+0000","last_became_peered":"2024-09-12T00:12:42.043681+0000","last_unstale":"2024-09-12T01:10:15.060093+0000","last_undegraded":"2024-09-12T01:10:15.060093+0000","last_fullsized":"2024-09-12T01:10:15.060093+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:57.312003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61267,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":489,"num_read_kb":964,"num_write":408,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042934+0000","last_change":"2024-09-12T00:12:44.058909+0000","last_active":"2024-09-12T01:07:48.042934+0000","last_peered":"2024-09-12T01:07:48.042934+0000","last_clean":"2024-09-12T01:07:48.042934+0000","last_became_active":"2024-09-12T00:12:44.058542+0000","last_became_peered":"2024-09-12T00:12:44.058542+0000","last_unstale":"2024-09-12T01:07:48.042934+0000","last_undegraded":"2024-09-12T01:07:48.042934+0000","last_fullsized":"2024-09-12T01:07:48.042934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:44.072219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'190","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.032970+0000","last_change":"2024-09-12T00:12:46.063225+0000","last_active":"2024-09-12T01:06:30.032970+0000","last_peered":"2024-09-12T01:06:30.032970+0000","last_clean":"2024-09-12T01:06:30.032970+0000","last_became_active":"2024-09-12T00:12:46.062957+0000","last_became_peered":"2024-09-12T00:12:46.062957+0000","last_unstale":"2024-09-12T01:06:30.032970+0000","last_undegraded":"2024-09-12T01:06:30.032970+0000","last_fullsized":"2024-09-12T01:06:30.032970+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.650377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":323,"num_read_kb":295,"num_write":565,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'204","reported_seq":789,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043832+0000","last_change":"2024-09-12T00:12:38.046033+0000","last_active":"2024-09-12T01:07:40.043832+0000","last_peered":"2024-09-12T01:07:40.043832+0000","last_clean":"2024-09-12T01:07:40.043832+0000","last_became_active":"2024-09-12T00:12:38.045576+0000","last_became_peered":"2024-09-12T00:12:38.045576+0000","last_unstale":"2024-09-12T01:07:40.043832+0000","last_undegraded":"2024-09-12T01:07:40.043832+0000","last_fullsized":"2024-09-12T01:07:40.043832+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:34.974243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":691,"num_write":313,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'299","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:16.862932+0000","last_change":"2024-09-12T00:12:36.036793+0000","last_active":"2024-09-12T01:08:16.862932+0000","last_peered":"2024-09-12T01:08:16.862932+0000","last_clean":"2024-09-12T01:08:16.862932+0000","last_became_active":"2024-09-12T00:12:36.036446+0000","last_became_peered":"2024-09-12T00:12:36.036446+0000","last_unstale":"2024-09-12T01:08:16.862932+0000","last_undegraded":"2024-09-12T01:08:16.862932+0000","last_fullsized":"2024-09-12T01:08:16.862932+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:19.859949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585124,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":567,"num_read_kb":64541,"num_write":1132,"num_write_kb":11770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134208+0000","last_change":"2024-09-12T00:12:40.030166+0000","last_active":"2024-09-12T01:07:40.134208+0000","last_peered":"2024-09-12T01:07:40.134208+0000","last_clean":"2024-09-12T01:07:40.134208+0000","last_became_active":"2024-09-12T00:12:40.029908+0000","last_became_peered":"2024-09-12T00:12:40.029908+0000","last_unstale":"2024-09-12T01:07:40.134208+0000","last_undegraded":"2024-09-12T01:07:40.134208+0000","last_fullsized":"2024-09-12T01:07:40.134208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:24.945019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'274","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.173460+0000","last_change":"2024-09-12T00:12:42.050883+0000","last_active":"2024-09-12T01:09:00.173460+0000","last_peered":"2024-09-12T01:09:00.173460+0000","last_clean":"2024-09-12T01:09:00.173460+0000","last_became_active":"2024-09-12T00:12:42.050599+0000","last_became_peered":"2024-09-12T00:12:42.050599+0000","last_unstale":"2024-09-12T01:09:00.173460+0000","last_undegraded":"2024-09-12T01:09:00.173460+0000","last_fullsized":"2024-09-12T01:09:00.173460+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:27.986140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52033,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":431,"num_read_kb":854,"num_write":348,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.055691+0000","last_change":"2024-09-12T00:12:44.062691+0000","last_active":"2024-09-12T01:08:55.055691+0000","last_peered":"2024-09-12T01:08:55.055691+0000","last_clean":"2024-09-12T01:08:55.055691+0000","last_became_active":"2024-09-12T00:12:44.062419+0000","last_became_peered":"2024-09-12T00:12:44.062419+0000","last_unstale":"2024-09-12T01:08:55.055691+0000","last_undegraded":"2024-09-12T01:08:55.055691+0000","last_fullsized":"2024-09-12T01:08:55.055691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.349610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'183","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.002642+0000","last_change":"2024-09-12T00:12:46.067271+0000","last_active":"2024-09-12T01:10:33.002642+0000","last_peered":"2024-09-12T01:10:33.002642+0000","last_clean":"2024-09-12T01:10:33.002642+0000","last_became_active":"2024-09-12T00:12:46.066977+0000","last_became_peered":"2024-09-12T00:12:46.066977+0000","last_unstale":"2024-09-12T01:10:33.002642+0000","last_undegraded":"2024-09-12T01:10:33.002642+0000","last_fullsized":"2024-09-12T01:10:33.002642+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:28.610163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":141,"num_write":422,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'58","reported_seq":591,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043831+0000","last_change":"2024-09-12T00:12:38.044154+0000","last_active":"2024-09-12T01:07:40.043831+0000","last_peered":"2024-09-12T01:07:40.043831+0000","last_clean":"2024-09-12T01:07:40.043831+0000","last_became_active":"2024-09-12T00:12:38.043886+0000","last_became_peered":"2024-09-12T00:12:38.043886+0000","last_unstale":"2024-09-12T01:07:40.043831+0000","last_undegraded":"2024-09-12T01:07:40.043831+0000","last_fullsized":"2024-09-12T01:07:40.043831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:23.214032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":197,"num_write":99,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'292","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043756+0000","last_change":"2024-09-12T00:12:36.031024+0000","last_active":"2024-09-12T01:07:40.043756+0000","last_peered":"2024-09-12T01:07:40.043756+0000","last_clean":"2024-09-12T01:07:40.043756+0000","last_became_active":"2024-09-12T00:12:36.030663+0000","last_became_peered":"2024-09-12T00:12:36.030663+0000","last_unstale":"2024-09-12T01:07:40.043756+0000","last_undegraded":"2024-09-12T01:07:40.043756+0000","last_fullsized":"2024-09-12T01:07:40.043756+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:04.337764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5821370,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":420,"num_read_kb":3753,"num_write":1037,"num_write_kb":36132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043857+0000","last_change":"2024-09-12T00:12:40.040334+0000","last_active":"2024-09-12T01:07:40.043857+0000","last_peered":"2024-09-12T01:07:40.043857+0000","last_clean":"2024-09-12T01:07:40.043857+0000","last_became_active":"2024-09-12T00:12:40.040095+0000","last_became_peered":"2024-09-12T00:12:40.040095+0000","last_unstale":"2024-09-12T01:07:40.043857+0000","last_undegraded":"2024-09-12T01:07:40.043857+0000","last_fullsized":"2024-09-12T01:07:40.043857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:14.746788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'104","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.036577+0000","last_change":"2024-09-12T00:12:42.043827+0000","last_active":"2024-09-12T01:07:00.036577+0000","last_peered":"2024-09-12T01:07:00.036577+0000","last_clean":"2024-09-12T01:07:00.036577+0000","last_became_active":"2024-09-12T00:12:42.043492+0000","last_became_peered":"2024-09-12T00:12:42.043492+0000","last_unstale":"2024-09-12T01:07:00.036577+0000","last_undegraded":"2024-09-12T01:07:00.036577+0000","last_fullsized":"2024-09-12T01:07:00.036577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:42.505398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":110,"num_read_kb":100,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'762","reported_seq":2171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.876777+0000","last_change":"2024-09-12T00:12:44.054520+0000","last_active":"2024-09-12T01:10:35.876777+0000","last_peered":"2024-09-12T01:10:35.876777+0000","last_clean":"2024-09-12T01:10:35.876777+0000","last_became_active":"2024-09-12T00:12:44.054237+0000","last_became_peered":"2024-09-12T00:12:44.054237+0000","last_unstale":"2024-09-12T01:10:35.876777+0000","last_undegraded":"2024-09-12T01:10:35.876777+0000","last_fullsized":"2024-09-12T01:10:35.876777+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:52.613881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'121","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.977988+0000","last_change":"2024-09-12T00:12:46.061987+0000","last_active":"2024-09-12T01:08:19.977988+0000","last_peered":"2024-09-12T01:08:19.977988+0000","last_clean":"2024-09-12T01:08:19.977988+0000","last_became_active":"2024-09-12T00:12:46.061673+0000","last_became_peered":"2024-09-12T00:12:46.061673+0000","last_unstale":"2024-09-12T01:08:19.977988+0000","last_undegraded":"2024-09-12T01:08:19.977988+0000","last_fullsized":"2024-09-12T01:08:19.977988+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:08.970829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'432","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134186+0000","last_change":"2024-09-12T00:12:38.029773+0000","last_active":"2024-09-12T01:07:40.134186+0000","last_peered":"2024-09-12T01:07:40.134186+0000","last_clean":"2024-09-12T01:07:40.134186+0000","last_became_active":"2024-09-12T00:12:38.029483+0000","last_became_peered":"2024-09-12T00:12:38.029483+0000","last_unstale":"2024-09-12T01:07:40.134186+0000","last_undegraded":"2024-09-12T01:07:40.134186+0000","last_fullsized":"2024-09-12T01:07:40.134186+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:54.184567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1848,"num_read_kb":1460,"num_write":651,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'281","reported_seq":888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.671067+0000","last_change":"2024-09-12T00:12:36.034572+0000","last_active":"2024-09-12T01:08:45.671067+0000","last_peered":"2024-09-12T01:08:45.671067+0000","last_clean":"2024-09-12T01:08:45.671067+0000","last_became_active":"2024-09-12T00:12:36.034259+0000","last_became_peered":"2024-09-12T00:12:36.034259+0000","last_unstale":"2024-09-12T01:08:45.671067+0000","last_undegraded":"2024-09-12T01:08:45.671067+0000","last_fullsized":"2024-09-12T01:08:45.671067+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:05.093712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12586058,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":373,"num_read_kb":12694,"num_write":997,"num_write_kb":34924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.234299+0000","last_change":"2024-09-12T00:12:40.034568+0000","last_active":"2024-09-12T01:07:40.234299+0000","last_peered":"2024-09-12T01:07:40.234299+0000","last_clean":"2024-09-12T01:07:40.234299+0000","last_became_active":"2024-09-12T00:12:40.034301+0000","last_became_peered":"2024-09-12T00:12:40.034301+0000","last_unstale":"2024-09-12T01:07:40.234299+0000","last_undegraded":"2024-09-12T01:07:40.234299+0000","last_fullsized":"2024-09-12T01:07:40.234299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:22.089148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'362","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.033947+0000","last_change":"2024-09-12T00:12:42.044477+0000","last_active":"2024-09-12T01:08:35.033947+0000","last_peered":"2024-09-12T01:08:35.033947+0000","last_clean":"2024-09-12T01:08:35.033947+0000","last_became_active":"2024-09-12T00:12:42.044154+0000","last_became_peered":"2024-09-12T00:12:42.044154+0000","last_unstale":"2024-09-12T01:08:35.033947+0000","last_undegraded":"2024-09-12T01:08:35.033947+0000","last_fullsized":"2024-09-12T01:08:35.033947+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:59.538243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56321,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":548,"num_read_kb":1028,"num_write":448,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.049637+0000","last_change":"2024-09-12T00:12:44.060009+0000","last_active":"2024-09-12T01:08:20.049637+0000","last_peered":"2024-09-12T01:08:20.049637+0000","last_clean":"2024-09-12T01:08:20.049637+0000","last_became_active":"2024-09-12T00:12:44.059671+0000","last_became_peered":"2024-09-12T00:12:44.059671+0000","last_unstale":"2024-09-12T01:08:20.049637+0000","last_undegraded":"2024-09-12T01:08:20.049637+0000","last_fullsized":"2024-09-12T01:08:20.049637+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:58.980993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'125","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.596906+0000","last_change":"2024-09-12T00:12:46.067043+0000","last_active":"2024-09-12T01:09:20.596906+0000","last_peered":"2024-09-12T01:09:20.596906+0000","last_clean":"2024-09-12T01:09:20.596906+0000","last_became_active":"2024-09-12T00:12:46.066777+0000","last_became_peered":"2024-09-12T00:12:46.066777+0000","last_unstale":"2024-09-12T01:09:20.596906+0000","last_undegraded":"2024-09-12T01:09:20.596906+0000","last_fullsized":"2024-09-12T01:09:20.596906+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:01.876836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":239,"num_read_kb":208,"num_write":345,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'510","reported_seq":1326,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134147+0000","last_change":"2024-09-12T00:12:38.040248+0000","last_active":"2024-09-12T01:07:40.134147+0000","last_peered":"2024-09-12T01:07:40.134147+0000","last_clean":"2024-09-12T01:07:40.134147+0000","last_became_active":"2024-09-12T00:12:38.039996+0000","last_became_peered":"2024-09-12T00:12:38.039996+0000","last_unstale":"2024-09-12T01:07:40.134147+0000","last_undegraded":"2024-09-12T01:07:40.134147+0000","last_fullsized":"2024-09-12T01:07:40.134147+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:17.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2706,"num_read_kb":2334,"num_write":934,"num_write_kb":583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'236","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.041111+0000","last_change":"2024-09-12T00:12:36.030460+0000","last_active":"2024-09-12T01:07:40.041111+0000","last_peered":"2024-09-12T01:07:40.041111+0000","last_clean":"2024-09-12T01:07:40.041111+0000","last_became_active":"2024-09-12T00:12:36.029998+0000","last_became_peered":"2024-09-12T00:12:36.029998+0000","last_unstale":"2024-09-12T01:07:40.041111+0000","last_undegraded":"2024-09-12T01:07:40.041111+0000","last_fullsized":"2024-09-12T01:07:40.041111+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:09.569791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7665422,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":502,"num_read_kb":3980,"num_write":861,"num_write_kb":28798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134195+0000","last_change":"2024-09-12T00:12:40.039109+0000","last_active":"2024-09-12T01:07:40.134195+0000","last_peered":"2024-09-12T01:07:40.134195+0000","last_clean":"2024-09-12T01:07:40.134195+0000","last_became_active":"2024-09-12T00:12:40.038037+0000","last_became_peered":"2024-09-12T00:12:40.038037+0000","last_unstale":"2024-09-12T01:07:40.134195+0000","last_undegraded":"2024-09-12T01:07:40.134195+0000","last_fullsized":"2024-09-12T01:07:40.134195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:11.329535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'279","reported_seq":849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.967924+0000","last_change":"2024-09-12T00:12:42.047201+0000","last_active":"2024-09-12T01:10:32.967924+0000","last_peered":"2024-09-12T01:10:32.967924+0000","last_clean":"2024-09-12T01:10:32.967924+0000","last_became_active":"2024-09-12T00:12:42.046917+0000","last_became_peered":"2024-09-12T00:12:42.046917+0000","last_unstale":"2024-09-12T01:10:32.967924+0000","last_undegraded":"2024-09-12T01:10:32.967924+0000","last_fullsized":"2024-09-12T01:10:32.967924+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:26.130504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65113,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":999,"num_write":394,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:10.030149+0000","last_change":"2024-09-12T00:12:44.058423+0000","last_active":"2024-09-12T01:06:10.030149+0000","last_peered":"2024-09-12T01:06:10.030149+0000","last_clean":"2024-09-12T01:06:10.030149+0000","last_became_active":"2024-09-12T00:12:44.058006+0000","last_became_peered":"2024-09-12T00:12:44.058006+0000","last_unstale":"2024-09-12T01:06:10.030149+0000","last_undegraded":"2024-09-12T01:06:10.030149+0000","last_fullsized":"2024-09-12T01:06:10.030149+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:01.738470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'117","reported_seq":622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.048235+0000","last_change":"2024-09-12T00:12:46.065323+0000","last_active":"2024-09-12T01:08:23.048235+0000","last_peered":"2024-09-12T01:08:23.048235+0000","last_clean":"2024-09-12T01:08:23.048235+0000","last_became_active":"2024-09-12T00:12:46.064988+0000","last_became_peered":"2024-09-12T00:12:46.064988+0000","last_unstale":"2024-09-12T01:08:23.048235+0000","last_undegraded":"2024-09-12T01:08:23.048235+0000","last_fullsized":"2024-09-12T01:08:23.048235+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:07.524788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":147,"num_write":261,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'320","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.050462+0000","last_change":"2024-09-12T00:12:38.042896+0000","last_active":"2024-09-12T01:08:25.050462+0000","last_peered":"2024-09-12T01:08:25.050462+0000","last_clean":"2024-09-12T01:08:25.050462+0000","last_became_active":"2024-09-12T00:12:38.042565+0000","last_became_peered":"2024-09-12T00:12:38.042565+0000","last_unstale":"2024-09-12T01:08:25.050462+0000","last_undegraded":"2024-09-12T01:08:25.050462+0000","last_fullsized":"2024-09-12T01:08:25.050462+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:20.595221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1481,"num_read_kb":1253,"num_write":527,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'304","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.953367+0000","last_change":"2024-09-12T00:12:36.042891+0000","last_active":"2024-09-12T01:10:57.953367+0000","last_peered":"2024-09-12T01:10:57.953367+0000","last_clean":"2024-09-12T01:10:57.953367+0000","last_became_active":"2024-09-12T00:12:36.042198+0000","last_became_peered":"2024-09-12T00:12:36.042198+0000","last_unstale":"2024-09-12T01:10:57.953367+0000","last_undegraded":"2024-09-12T01:10:57.953367+0000","last_fullsized":"2024-09-12T01:10:57.953367+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:27.004848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13171441,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":436,"num_read_kb":61057,"num_write":1068,"num_write_kb":53442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.237962+0000","last_change":"2024-09-12T00:12:40.032609+0000","last_active":"2024-09-12T01:08:15.237962+0000","last_peered":"2024-09-12T01:08:15.237962+0000","last_clean":"2024-09-12T01:08:15.237962+0000","last_became_active":"2024-09-12T00:12:40.032284+0000","last_became_peered":"2024-09-12T00:12:40.032284+0000","last_unstale":"2024-09-12T01:08:15.237962+0000","last_undegraded":"2024-09-12T01:08:15.237962+0000","last_fullsized":"2024-09-12T01:08:15.237962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:20.113080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'252","reported_seq":805,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:15.184391+0000","last_change":"2024-09-12T00:12:42.051390+0000","last_active":"2024-09-12T01:10:15.184391+0000","last_peered":"2024-09-12T01:10:15.184391+0000","last_clean":"2024-09-12T01:10:15.184391+0000","last_became_active":"2024-09-12T00:12:42.051133+0000","last_became_peered":"2024-09-12T00:12:42.051133+0000","last_unstale":"2024-09-12T01:10:15.184391+0000","last_undegraded":"2024-09-12T01:10:15.184391+0000","last_fullsized":"2024-09-12T01:10:15.184391+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:39.225249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63093,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":413,"num_read_kb":906,"num_write":346,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041676+0000","last_change":"2024-09-12T00:12:44.060747+0000","last_active":"2024-09-12T01:07:45.041676+0000","last_peered":"2024-09-12T01:07:45.041676+0000","last_clean":"2024-09-12T01:07:45.041676+0000","last_became_active":"2024-09-12T00:12:44.060464+0000","last_became_peered":"2024-09-12T00:12:44.060464+0000","last_unstale":"2024-09-12T01:07:45.041676+0000","last_undegraded":"2024-09-12T01:07:45.041676+0000","last_fullsized":"2024-09-12T01:07:45.041676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:56.068981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'150","reported_seq":1608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.570464+0000","last_change":"2024-09-12T00:12:46.064822+0000","last_active":"2024-09-12T01:09:20.570464+0000","last_peered":"2024-09-12T01:09:20.570464+0000","last_clean":"2024-09-12T01:09:20.570464+0000","last_became_active":"2024-09-12T00:12:46.064565+0000","last_became_peered":"2024-09-12T00:12:46.064565+0000","last_unstale":"2024-09-12T01:09:20.570464+0000","last_undegraded":"2024-09-12T01:09:20.570464+0000","last_fullsized":"2024-09-12T01:09:20.570464+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:23.873971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1152,"num_read_kb":1150,"num_write":337,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'89","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.137995+0000","last_change":"2024-09-12T00:12:38.038149+0000","last_active":"2024-09-12T01:08:15.137995+0000","last_peered":"2024-09-12T01:08:15.137995+0000","last_clean":"2024-09-12T01:08:15.137995+0000","last_became_active":"2024-09-12T00:12:38.037860+0000","last_became_peered":"2024-09-12T00:12:38.037860+0000","last_unstale":"2024-09-12T01:08:15.137995+0000","last_undegraded":"2024-09-12T01:08:15.137995+0000","last_fullsized":"2024-09-12T01:08:15.137995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:24.535343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":333,"num_write":131,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'255","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.053092+0000","last_change":"2024-09-12T00:12:36.042368+0000","last_active":"2024-09-12T01:08:53.053092+0000","last_peered":"2024-09-12T01:08:53.053092+0000","last_clean":"2024-09-12T01:08:53.053092+0000","last_became_active":"2024-09-12T00:12:36.041860+0000","last_became_peered":"2024-09-12T00:12:36.041860+0000","last_unstale":"2024-09-12T01:08:53.053092+0000","last_undegraded":"2024-09-12T01:08:53.053092+0000","last_fullsized":"2024-09-12T01:08:53.053092+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:01.561434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6163646,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":308,"num_read_kb":7017,"num_write":926,"num_write_kb":36211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"32'1","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.050491+0000","last_change":"2024-09-12T00:12:40.039492+0000","last_active":"2024-09-12T01:08:25.050491+0000","last_peered":"2024-09-12T01:08:25.050491+0000","last_clean":"2024-09-12T01:08:25.050491+0000","last_became_active":"2024-09-12T00:12:40.039196+0000","last_became_peered":"2024-09-12T00:12:40.039196+0000","last_unstale":"2024-09-12T01:08:25.050491+0000","last_undegraded":"2024-09-12T01:08:25.050491+0000","last_fullsized":"2024-09-12T01:08:25.050491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:03.281450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'339","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:15.060054+0000","last_change":"2024-09-12T00:12:42.039343+0000","last_active":"2024-09-12T01:10:15.060054+0000","last_peered":"2024-09-12T01:10:15.060054+0000","last_clean":"2024-09-12T01:10:15.060054+0000","last_became_active":"2024-09-12T00:12:42.039068+0000","last_became_peered":"2024-09-12T00:12:42.039068+0000","last_unstale":"2024-09-12T01:10:15.060054+0000","last_undegraded":"2024-09-12T01:10:15.060054+0000","last_fullsized":"2024-09-12T01:10:15.060054+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:19.273390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57499,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":531,"num_read_kb":1035,"num_write":436,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044483+0000","last_change":"2024-09-12T00:12:44.064609+0000","last_active":"2024-09-12T01:07:45.044483+0000","last_peered":"2024-09-12T01:07:45.044483+0000","last_clean":"2024-09-12T01:07:45.044483+0000","last_became_active":"2024-09-12T00:12:44.064105+0000","last_became_peered":"2024-09-12T00:12:44.064105+0000","last_unstale":"2024-09-12T01:07:45.044483+0000","last_undegraded":"2024-09-12T01:07:45.044483+0000","last_fullsized":"2024-09-12T01:07:45.044483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:34.680066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'146","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.794252+0000","last_change":"2024-09-12T00:12:46.054136+0000","last_active":"2024-09-12T01:10:31.794252+0000","last_peered":"2024-09-12T01:10:31.794252+0000","last_clean":"2024-09-12T01:10:31.794252+0000","last_became_active":"2024-09-12T00:12:46.053763+0000","last_became_peered":"2024-09-12T00:12:46.053763+0000","last_unstale":"2024-09-12T01:10:31.794252+0000","last_undegraded":"2024-09-12T01:10:31.794252+0000","last_fullsized":"2024-09-12T01:10:31.794252+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:31.432295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":382,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'137","reported_seq":721,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.975539+0000","last_change":"2024-09-12T00:12:38.044545+0000","last_active":"2024-09-12T01:08:19.975539+0000","last_peered":"2024-09-12T01:08:19.975539+0000","last_clean":"2024-09-12T01:08:19.975539+0000","last_became_active":"2024-09-12T00:12:38.044285+0000","last_became_peered":"2024-09-12T00:12:38.044285+0000","last_unstale":"2024-09-12T01:08:19.975539+0000","last_undegraded":"2024-09-12T01:08:19.975539+0000","last_fullsized":"2024-09-12T01:08:19.975539+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:05.907607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":475,"num_write":234,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'325","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.128500+0000","last_change":"2024-09-12T00:12:36.037087+0000","last_active":"2024-09-12T01:06:50.128500+0000","last_peered":"2024-09-12T01:06:50.128500+0000","last_clean":"2024-09-12T01:06:50.128500+0000","last_became_active":"2024-09-12T00:12:36.036773+0000","last_became_peered":"2024-09-12T00:12:36.036773+0000","last_unstale":"2024-09-12T01:06:50.128500+0000","last_undegraded":"2024-09-12T01:06:50.128500+0000","last_fullsized":"2024-09-12T01:06:50.128500+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:15.783771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9731977,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":534,"num_read_kb":16735,"num_write":1073,"num_write_kb":32233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'47","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.460370+0000","last_change":"2024-09-12T00:12:38.037279+0000","last_active":"2024-09-12T01:08:08.460370+0000","last_peered":"2024-09-12T01:08:08.460370+0000","last_clean":"2024-09-12T01:08:08.460370+0000","last_became_active":"2024-09-12T00:12:38.036978+0000","last_became_peered":"2024-09-12T00:12:38.036978+0000","last_unstale":"2024-09-12T01:08:08.460370+0000","last_undegraded":"2024-09-12T01:08:08.460370+0000","last_fullsized":"2024-09-12T01:08:08.460370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:21.347370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":60,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'271","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.034990+0000","last_change":"2024-09-12T00:12:36.035846+0000","last_active":"2024-09-12T01:06:50.034990+0000","last_peered":"2024-09-12T01:06:50.034990+0000","last_clean":"2024-09-12T01:06:50.034990+0000","last_became_active":"2024-09-12T00:12:36.035112+0000","last_became_peered":"2024-09-12T00:12:36.035112+0000","last_unstale":"2024-09-12T01:06:50.034990+0000","last_undegraded":"2024-09-12T01:06:50.034990+0000","last_fullsized":"2024-09-12T01:06:50.034990+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:21.404926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12606410,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":429,"num_read_kb":34939,"num_write":1037,"num_write_kb":28471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'137","reported_seq":769,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.101896+0000","last_change":"2024-09-12T00:12:38.040495+0000","last_active":"2024-09-12T01:07:43.101896+0000","last_peered":"2024-09-12T01:07:43.101896+0000","last_clean":"2024-09-12T01:07:43.101896+0000","last_became_active":"2024-09-12T00:12:38.040144+0000","last_became_peered":"2024-09-12T00:12:38.040144+0000","last_unstale":"2024-09-12T01:07:43.101896+0000","last_undegraded":"2024-09-12T01:07:43.101896+0000","last_fullsized":"2024-09-12T01:07:43.101896+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.698332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":511,"num_write":216,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'249","reported_seq":881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:09.499023+0000","last_change":"2024-09-12T00:12:36.038607+0000","last_active":"2024-09-12T01:08:09.499023+0000","last_peered":"2024-09-12T01:08:09.499023+0000","last_clean":"2024-09-12T01:08:09.499023+0000","last_became_active":"2024-09-12T00:12:36.035558+0000","last_became_peered":"2024-09-12T00:12:36.035558+0000","last_unstale":"2024-09-12T01:08:09.499023+0000","last_undegraded":"2024-09-12T01:08:09.499023+0000","last_fullsized":"2024-09-12T01:08:09.499023+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:48.869269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":438723,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":373,"num_read_kb":7818,"num_write":896,"num_write_kb":22426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'275","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:48.033948+0000","last_change":"2024-09-12T00:12:38.026451+0000","last_active":"2024-09-12T01:06:48.033948+0000","last_peered":"2024-09-12T01:06:48.033948+0000","last_clean":"2024-09-12T01:06:48.033948+0000","last_became_active":"2024-09-12T00:12:38.026109+0000","last_became_peered":"2024-09-12T00:12:38.026109+0000","last_unstale":"2024-09-12T01:06:48.033948+0000","last_undegraded":"2024-09-12T01:06:48.033948+0000","last_fullsized":"2024-09-12T01:06:48.033948+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:18.043515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1270,"num_read_kb":1040,"num_write":446,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'276","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.949069+0000","last_change":"2024-09-12T00:12:36.033841+0000","last_active":"2024-09-12T01:10:57.949069+0000","last_peered":"2024-09-12T01:10:57.949069+0000","last_clean":"2024-09-12T01:10:57.949069+0000","last_became_active":"2024-09-12T00:12:36.033426+0000","last_became_peered":"2024-09-12T00:12:36.033426+0000","last_unstale":"2024-09-12T01:10:57.949069+0000","last_undegraded":"2024-09-12T01:10:57.949069+0000","last_fullsized":"2024-09-12T01:10:57.949069+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:43.664314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8725093,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":380,"num_read_kb":19382,"num_write":896,"num_write_kb":44169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'4265","reported_seq":4908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.043610+0000","last_change":"2024-09-12T00:12:38.028635+0000","last_active":"2024-09-12T01:08:12.043610+0000","last_peered":"2024-09-12T01:08:12.043610+0000","last_clean":"2024-09-12T01:08:12.043610+0000","last_became_active":"2024-09-12T00:12:38.028401+0000","last_became_peered":"2024-09-12T00:12:38.028401+0000","last_unstale":"2024-09-12T01:08:12.043610+0000","last_undegraded":"2024-09-12T01:08:12.043610+0000","last_fullsized":"2024-09-12T01:08:12.043610+0000","mapping_epoch":29,"log_start":"263'4200","ondisk_log_start":"263'4200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":3000,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17227,"num_read_kb":14428,"num_write":6422,"num_write_kb":3205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'260","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.154405+0000","last_change":"2024-09-12T00:12:36.032699+0000","last_active":"2024-09-12T01:08:25.154405+0000","last_peered":"2024-09-12T01:08:25.154405+0000","last_clean":"2024-09-12T01:08:25.154405+0000","last_became_active":"2024-09-12T00:12:36.032341+0000","last_became_peered":"2024-09-12T00:12:36.032341+0000","last_unstale":"2024-09-12T01:08:25.154405+0000","last_undegraded":"2024-09-12T01:08:25.154405+0000","last_fullsized":"2024-09-12T01:08:25.154405+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.087075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13401428,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":444,"num_read_kb":66123,"num_write":991,"num_write_kb":26739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'149","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.022603+0000","last_change":"2024-09-12T00:12:38.043531+0000","last_active":"2024-09-12T01:06:50.022603+0000","last_peered":"2024-09-12T01:06:50.022603+0000","last_clean":"2024-09-12T01:06:50.022603+0000","last_became_active":"2024-09-12T00:12:38.043276+0000","last_became_peered":"2024-09-12T00:12:38.043276+0000","last_unstale":"2024-09-12T01:06:50.022603+0000","last_undegraded":"2024-09-12T01:06:50.022603+0000","last_fullsized":"2024-09-12T01:06:50.022603+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:16.032522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":632,"num_read_kb":523,"num_write":222,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'256","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.152999+0000","last_change":"2024-09-12T00:12:36.030036+0000","last_active":"2024-09-12T01:06:50.152999+0000","last_peered":"2024-09-12T01:06:50.152999+0000","last_clean":"2024-09-12T01:06:50.152999+0000","last_became_active":"2024-09-12T00:12:36.029687+0000","last_became_peered":"2024-09-12T00:12:36.029687+0000","last_unstale":"2024-09-12T01:06:50.152999+0000","last_undegraded":"2024-09-12T01:06:50.152999+0000","last_fullsized":"2024-09-12T01:06:50.152999+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:58.296237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244632,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":389,"num_read_kb":12036,"num_write":986,"num_write_kb":29691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'211","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.152859+0000","last_change":"2024-09-12T00:12:38.047873+0000","last_active":"2024-09-12T01:06:50.152859+0000","last_peered":"2024-09-12T01:06:50.152859+0000","last_clean":"2024-09-12T01:06:50.152859+0000","last_became_active":"2024-09-12T00:12:38.047575+0000","last_became_peered":"2024-09-12T00:12:38.047575+0000","last_unstale":"2024-09-12T01:06:50.152859+0000","last_undegraded":"2024-09-12T01:06:50.152859+0000","last_fullsized":"2024-09-12T01:06:50.152859+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:28.383492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":952,"num_read_kb":776,"num_write":336,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'296","reported_seq":915,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.128604+0000","last_change":"2024-09-12T00:12:36.044107+0000","last_active":"2024-09-12T01:06:50.128604+0000","last_peered":"2024-09-12T01:06:50.128604+0000","last_clean":"2024-09-12T01:06:50.128604+0000","last_became_active":"2024-09-12T00:12:36.043803+0000","last_became_peered":"2024-09-12T00:12:36.043803+0000","last_unstale":"2024-09-12T01:06:50.128604+0000","last_undegraded":"2024-09-12T01:06:50.128604+0000","last_fullsized":"2024-09-12T01:06:50.128604+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:42.820031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17102710,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":395,"num_read_kb":37298,"num_write":1084,"num_write_kb":54766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'143","reported_seq":729,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.228988+0000","last_change":"2024-09-12T00:12:38.036740+0000","last_active":"2024-09-12T01:06:50.228988+0000","last_peered":"2024-09-12T01:06:50.228988+0000","last_clean":"2024-09-12T01:06:50.228988+0000","last_became_active":"2024-09-12T00:12:38.036463+0000","last_became_peered":"2024-09-12T00:12:38.036463+0000","last_unstale":"2024-09-12T01:06:50.228988+0000","last_undegraded":"2024-09-12T01:06:50.228988+0000","last_fullsized":"2024-09-12T01:06:50.228988+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:20.504629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":509,"num_write":213,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'234","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.143680+0000","last_change":"2024-09-12T00:12:36.042056+0000","last_active":"2024-09-12T01:08:25.143680+0000","last_peered":"2024-09-12T01:08:25.143680+0000","last_clean":"2024-09-12T01:08:25.143680+0000","last_became_active":"2024-09-12T00:12:36.041392+0000","last_became_peered":"2024-09-12T00:12:36.041392+0000","last_unstale":"2024-09-12T01:08:25.143680+0000","last_undegraded":"2024-09-12T01:08:25.143680+0000","last_fullsized":"2024-09-12T01:08:25.143680+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:58.023567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11430218,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":354,"num_read_kb":23602,"num_write":959,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'133","reported_seq":752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.547462+0000","last_change":"2024-09-12T00:12:38.043147+0000","last_active":"2024-09-12T01:09:22.547462+0000","last_peered":"2024-09-12T01:09:22.547462+0000","last_clean":"2024-09-12T01:09:22.547462+0000","last_became_active":"2024-09-12T00:12:38.042584+0000","last_became_peered":"2024-09-12T00:12:38.042584+0000","last_unstale":"2024-09-12T01:09:22.547462+0000","last_undegraded":"2024-09-12T01:09:22.547462+0000","last_fullsized":"2024-09-12T01:09:22.547462+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:40.303117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":632,"num_read_kb":533,"num_write":194,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'324","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:18.766246+0000","last_change":"2024-09-12T00:12:36.037876+0000","last_active":"2024-09-12T01:08:18.766246+0000","last_peered":"2024-09-12T01:08:18.766246+0000","last_clean":"2024-09-12T01:08:18.766246+0000","last_became_active":"2024-09-12T00:12:36.037461+0000","last_became_peered":"2024-09-12T00:12:36.037461+0000","last_unstale":"2024-09-12T01:08:18.766246+0000","last_undegraded":"2024-09-12T01:08:18.766246+0000","last_fullsized":"2024-09-12T01:08:18.766246+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:05.562845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4509850,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":557,"num_read_kb":9826,"num_write":1192,"num_write_kb":32499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'308","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:51.226100+0000","last_change":"2024-09-12T00:12:38.037217+0000","last_active":"2024-09-12T01:07:51.226100+0000","last_peered":"2024-09-12T01:07:51.226100+0000","last_clean":"2024-09-12T01:07:51.226100+0000","last_became_active":"2024-09-12T00:12:38.036872+0000","last_became_peered":"2024-09-12T00:12:38.036872+0000","last_unstale":"2024-09-12T01:07:51.226100+0000","last_undegraded":"2024-09-12T01:07:51.226100+0000","last_fullsized":"2024-09-12T01:07:51.226100+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:45.277008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1112,"num_write":459,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'290","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.937493+0000","last_change":"2024-09-12T00:12:36.042921+0000","last_active":"2024-09-12T01:10:57.937493+0000","last_peered":"2024-09-12T01:10:57.937493+0000","last_clean":"2024-09-12T01:10:57.937493+0000","last_became_active":"2024-09-12T00:12:36.042159+0000","last_became_peered":"2024-09-12T00:12:36.042159+0000","last_unstale":"2024-09-12T01:10:57.937493+0000","last_undegraded":"2024-09-12T01:10:57.937493+0000","last_fullsized":"2024-09-12T01:10:57.937493+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:47.107719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1320302,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":462,"num_read_kb":43498,"num_write":1153,"num_write_kb":41544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'313","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.061449+0000","last_change":"2024-09-12T00:12:38.045246+0000","last_active":"2024-09-12T01:08:10.061449+0000","last_peered":"2024-09-12T01:08:10.061449+0000","last_clean":"2024-09-12T01:08:10.061449+0000","last_became_active":"2024-09-12T00:12:38.042966+0000","last_became_peered":"2024-09-12T00:12:38.042966+0000","last_unstale":"2024-09-12T01:08:10.061449+0000","last_undegraded":"2024-09-12T01:08:10.061449+0000","last_fullsized":"2024-09-12T01:08:10.061449+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:43.848333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1467,"num_read_kb":1262,"num_write":468,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'300","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.242369+0000","last_change":"2024-09-12T00:12:36.027754+0000","last_active":"2024-09-12T01:08:55.242369+0000","last_peered":"2024-09-12T01:08:55.242369+0000","last_clean":"2024-09-12T01:08:55.242369+0000","last_became_active":"2024-09-12T00:12:36.027423+0000","last_became_peered":"2024-09-12T00:12:36.027423+0000","last_unstale":"2024-09-12T01:08:55.242369+0000","last_undegraded":"2024-09-12T01:08:55.242369+0000","last_fullsized":"2024-09-12T01:08:55.242369+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:36.409512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20607435,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":452,"num_read_kb":69050,"num_write":1096,"num_write_kb":46135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'156","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.227992+0000","last_change":"2024-09-12T00:12:38.036518+0000","last_active":"2024-09-12T01:06:40.227992+0000","last_peered":"2024-09-12T01:06:40.227992+0000","last_clean":"2024-09-12T01:06:40.227992+0000","last_became_active":"2024-09-12T00:12:38.036235+0000","last_became_peered":"2024-09-12T00:12:38.036235+0000","last_unstale":"2024-09-12T01:06:40.227992+0000","last_undegraded":"2024-09-12T01:06:40.227992+0000","last_fullsized":"2024-09-12T01:06:40.227992+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:14.890009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":550,"num_write":221,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'388","reported_seq":1205,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:41.160785+0000","last_change":"2024-09-12T00:12:36.038795+0000","last_active":"2024-09-12T01:08:41.160785+0000","last_peered":"2024-09-12T01:08:41.160785+0000","last_clean":"2024-09-12T01:08:41.160785+0000","last_became_active":"2024-09-12T00:12:36.038449+0000","last_became_peered":"2024-09-12T00:12:36.038449+0000","last_unstale":"2024-09-12T01:08:41.160785+0000","last_undegraded":"2024-09-12T01:08:41.160785+0000","last_fullsized":"2024-09-12T01:08:41.160785+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:36.774240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19233523,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":1008,"num_read_kb":25378,"num_write":1397,"num_write_kb":31172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'189","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.227982+0000","last_change":"2024-09-12T00:12:38.042951+0000","last_active":"2024-09-12T01:06:40.227982+0000","last_peered":"2024-09-12T01:06:40.227982+0000","last_clean":"2024-09-12T01:06:40.227982+0000","last_became_active":"2024-09-12T00:12:38.042691+0000","last_became_peered":"2024-09-12T00:12:38.042691+0000","last_unstale":"2024-09-12T01:06:40.227982+0000","last_undegraded":"2024-09-12T01:06:40.227982+0000","last_fullsized":"2024-09-12T01:06:40.227982+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:20.069819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":710,"num_write":289,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'293","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:39.320455+0000","last_change":"2024-09-12T00:12:36.025331+0000","last_active":"2024-09-12T01:08:39.320455+0000","last_peered":"2024-09-12T01:08:39.320455+0000","last_clean":"2024-09-12T01:08:39.320455+0000","last_became_active":"2024-09-12T00:12:36.025028+0000","last_became_peered":"2024-09-12T00:12:36.025028+0000","last_unstale":"2024-09-12T01:08:39.320455+0000","last_undegraded":"2024-09-12T01:08:39.320455+0000","last_fullsized":"2024-09-12T01:08:39.320455+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:26.322567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1311653,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":467,"num_read_kb":8333,"num_write":1180,"num_write_kb":35038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'132","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.033321+0000","last_change":"2024-09-12T00:12:38.047056+0000","last_active":"2024-09-12T01:06:40.033321+0000","last_peered":"2024-09-12T01:06:40.033321+0000","last_clean":"2024-09-12T01:06:40.033321+0000","last_became_active":"2024-09-12T00:12:38.046753+0000","last_became_peered":"2024-09-12T00:12:38.046753+0000","last_unstale":"2024-09-12T01:06:40.033321+0000","last_undegraded":"2024-09-12T01:06:40.033321+0000","last_fullsized":"2024-09-12T01:06:40.033321+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:58.264361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":645,"num_read_kb":546,"num_write":214,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'307","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:27.737197+0000","last_change":"2024-09-12T00:12:36.047535+0000","last_active":"2024-09-12T01:08:27.737197+0000","last_peered":"2024-09-12T01:08:27.737197+0000","last_clean":"2024-09-12T01:08:27.737197+0000","last_became_active":"2024-09-12T00:12:36.047221+0000","last_became_peered":"2024-09-12T00:12:36.047221+0000","last_unstale":"2024-09-12T01:08:27.737197+0000","last_undegraded":"2024-09-12T01:08:27.737197+0000","last_fullsized":"2024-09-12T01:08:27.737197+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:45.416216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7981849,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":458,"num_read_kb":28470,"num_write":1084,"num_write_kb":36833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'173","reported_seq":801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:46.645799+0000","last_change":"2024-09-12T00:12:38.048404+0000","last_active":"2024-09-12T01:06:46.645799+0000","last_peered":"2024-09-12T01:06:46.645799+0000","last_clean":"2024-09-12T01:06:46.645799+0000","last_became_active":"2024-09-12T00:12:38.048094+0000","last_became_peered":"2024-09-12T00:12:38.048094+0000","last_unstale":"2024-09-12T01:06:46.645799+0000","last_undegraded":"2024-09-12T01:06:46.645799+0000","last_fullsized":"2024-09-12T01:06:46.645799+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:31.879991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":798,"num_read_kb":664,"num_write":275,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'256","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:47.580084+0000","last_change":"2024-09-12T00:12:36.039699+0000","last_active":"2024-09-12T01:06:47.580084+0000","last_peered":"2024-09-12T01:06:47.580084+0000","last_clean":"2024-09-12T01:06:47.580084+0000","last_became_active":"2024-09-12T00:12:36.039442+0000","last_became_peered":"2024-09-12T00:12:36.039442+0000","last_unstale":"2024-09-12T01:06:47.580084+0000","last_undegraded":"2024-09-12T01:06:47.580084+0000","last_fullsized":"2024-09-12T01:06:47.580084+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:18.334602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3884531,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":385,"num_read_kb":5822,"num_write":947,"num_write_kb":34989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'85","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.229535+0000","last_change":"2024-09-12T00:12:38.042638+0000","last_active":"2024-09-12T01:06:55.229535+0000","last_peered":"2024-09-12T01:06:55.229535+0000","last_clean":"2024-09-12T01:06:55.229535+0000","last_became_active":"2024-09-12T00:12:38.042380+0000","last_became_peered":"2024-09-12T00:12:38.042380+0000","last_unstale":"2024-09-12T01:06:55.229535+0000","last_undegraded":"2024-09-12T01:06:55.229535+0000","last_fullsized":"2024-09-12T01:06:55.229535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:54.486935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":311,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'336","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:33.237628+0000","last_change":"2024-09-12T00:12:36.036316+0000","last_active":"2024-09-12T01:07:33.237628+0000","last_peered":"2024-09-12T01:07:33.237628+0000","last_clean":"2024-09-12T01:07:33.237628+0000","last_became_active":"2024-09-12T00:12:36.035235+0000","last_became_peered":"2024-09-12T00:12:36.035235+0000","last_unstale":"2024-09-12T01:07:33.237628+0000","last_undegraded":"2024-09-12T01:07:33.237628+0000","last_fullsized":"2024-09-12T01:07:33.237628+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:35.845612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7760319,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":523,"num_read_kb":34997,"num_write":1187,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'281","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:41.344536+0000","last_change":"2024-09-12T00:13:07.150744+0000","last_active":"2024-09-12T01:07:41.344536+0000","last_peered":"2024-09-12T01:07:41.344536+0000","last_clean":"2024-09-12T01:07:41.344536+0000","last_became_active":"2024-09-12T00:13:07.150278+0000","last_became_peered":"2024-09-12T00:13:07.150278+0000","last_unstale":"2024-09-12T01:07:41.344536+0000","last_undegraded":"2024-09-12T01:07:41.344536+0000","last_fullsized":"2024-09-12T01:07:41.344536+0000","mapping_epoch":40,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:11.722385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3018003,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":467,"num_read_kb":16889,"num_write":1018,"num_write_kb":27724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"263'232","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.050604+0000","last_change":"2024-09-12T00:12:38.048481+0000","last_active":"2024-09-12T01:08:25.050604+0000","last_peered":"2024-09-12T01:08:25.050604+0000","last_clean":"2024-09-12T01:08:25.050604+0000","last_became_active":"2024-09-12T00:12:38.048092+0000","last_became_peered":"2024-09-12T00:12:38.048092+0000","last_unstale":"2024-09-12T01:08:25.050604+0000","last_undegraded":"2024-09-12T01:08:25.050604+0000","last_fullsized":"2024-09-12T01:08:25.050604+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:42.485985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":909,"num_write":384,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'328","reported_seq":1141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.943224+0000","last_change":"2024-09-12T00:12:36.035409+0000","last_active":"2024-09-12T01:10:57.943224+0000","last_peered":"2024-09-12T01:10:57.943224+0000","last_clean":"2024-09-12T01:10:57.943224+0000","last_became_active":"2024-09-12T00:12:36.034396+0000","last_became_peered":"2024-09-12T00:12:36.034396+0000","last_unstale":"2024-09-12T01:10:57.943224+0000","last_undegraded":"2024-09-12T01:10:57.943224+0000","last_fullsized":"2024-09-12T01:10:57.943224+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:08.822878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4973287,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":915,"num_read_kb":9206,"num_write":1404,"num_write_kb":42121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'344","reported_seq":938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.830495+0000","last_change":"2024-09-12T00:12:38.040209+0000","last_active":"2024-09-12T01:08:20.830495+0000","last_peered":"2024-09-12T01:08:20.830495+0000","last_clean":"2024-09-12T01:08:20.830495+0000","last_became_active":"2024-09-12T00:12:38.039941+0000","last_became_peered":"2024-09-12T00:12:38.039941+0000","last_unstale":"2024-09-12T01:08:20.830495+0000","last_undegraded":"2024-09-12T01:08:20.830495+0000","last_fullsized":"2024-09-12T01:08:20.830495+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:03.997031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1443,"num_read_kb":1146,"num_write":558,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5787,"num_read_kb":4069,"num_write":1922,"num_write_kb":820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1093,"ondisk_log_size":1093,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15069,"num_read_kb":14720,"num_write":16734,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1768,"ondisk_log_size":1768,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":666,"ondisk_log_size":666,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1913657,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":17811,"num_read_kb":33483,"num_write":15051,"num_write_kb":11721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3301376,"data_stored":2790522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1934,"ondisk_log_size":1934,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2422,"num_read_kb":2887,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":103162,"num_read_kb":86048,"num_write":37373,"num_write_kb":18894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3928,"ondisk_log_size":3928,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":562329238,"num_objects":4467,"num_object_clones":0,"num_object_copies":13401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4467,"num_whiteouts":0,"num_read":32165,"num_read_kb":1714764,"num_write":68012,"num_write_kb":2100462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":893014016,"data_stored":893014016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4601,"ondisk_log_size":4601,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":64182174,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":138,"num_read_kb":170862,"num_write":160,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128376832,"data_stored":128364348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":64182174,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136,"num_read_kb":170241,"num_write":160,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128376832,"data_stored":128364348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510148,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":324492,"kb_used_data":130940,"kb_used_omap":1,"kb_used_meta":193534,"kb_avail":94047348,"statfs":{"total":96636764160,"available":96304484352,"internally_reserved":0,"allocated":134082560,"data_stored":132060496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":198179275},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510151,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190848,"kb_used_data":105584,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94180992,"statfs":{"total":96636764160,"available":96441335808,"internally_reserved":0,"allocated":108118016,"data_stored":106081500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510148,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335140,"kb_used_data":163796,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94036700,"statfs":{"total":96636764160,"available":96293580800,"internally_reserved":0,"allocated":167727104,"data_stored":165700867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510149,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371556,"kb_used_data":159892,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94000284,"statfs":{"total":96636764160,"available":96256290816,"internally_reserved":0,"allocated":163729408,"data_stored":161718302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510149,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":258888,"kb_used_data":159672,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94112952,"statfs":{"total":96636764160,"available":96371662848,"internally_reserved":0,"allocated":163504128,"data_stored":161512842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510149,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":414976,"kb_used_data":135280,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":93956864,"statfs":{"total":96636764160,"available":96211828736,"internally_reserved":0,"allocated":138526720,"data_stored":136486609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510151,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249120,"kb_used_data":163792,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94122720,"statfs":{"total":96636764160,"available":96381665280,"internally_reserved":0,"allocated":167723008,"data_stored":165670605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575557,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378888,"kb_used_data":140856,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93992952,"statfs":{"total":96636764160,"available":96248782848,"internally_reserved":0,"allocated":144236544,"data_stored":142198459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":144601088,"data_stored":144601088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":108945408,"data_stored":108945408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":125046784,"data_stored":125046784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":126697472,"data_stored":126697472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":133562368,"data_stored":133562368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":88969216,"data_stored":88969216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":74076160,"data_stored":74076160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":91115520,"data_stored":91115520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":458188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":467252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":126536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":267690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":405520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":475136,"data_stored":406325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":346468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":312543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16363520,"data_stored":16361432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11710464,"data_stored":11704945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13680640,"data_stored":13679917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":27901952,"data_stored":27897798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14217216,"data_stored":14215851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7925760,"data_stored":7924395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17362944,"data_stored":17361579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15777069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28950528,"data_stored":28946374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15781888,"data_stored":15779099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10534912,"data_stored":10534189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:11:01.077 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:11:01.077 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:11:01.423 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:11:01.435 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-09-12T01:11:01.437 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":2020,"stamp":"2024-09-12T01:11:01.331840+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":236706064,"num_objects":1672,"num_object_clones":0,"num_object_copies":4648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1672,"num_whiteouts":0,"num_read":180420,"num_read_kb":2200930,"num_write":142985,"num_write_kb":2394985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13706,"ondisk_log_size":13706,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2107476,"kb_used_data":669284,"kb_used_omap":12,"kb_used_meta":1437491,"kb_avail":752867244,"statfs":{"total":773094113280,"available":770936057856,"internally_reserved":0,"allocated":685346816,"data_stored":669272381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1471991346},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-456509893,"num_objects":-3218,"num_object_clones":0,"num_object_copies":-9614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3218,"num_whiteouts":0,"num_read":3666,"num_read_kb":3788,"num_write":3445,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005474"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.023141+0000","last_change":"2024-09-12T00:46:54.886343+0000","last_active":"2024-09-12T01:06:55.023141+0000","last_peered":"2024-09-12T01:06:55.023141+0000","last_clean":"2024-09-12T01:06:55.023141+0000","last_became_active":"2024-09-12T00:46:54.885628+0000","last_became_peered":"2024-09-12T00:46:54.885628+0000","last_unstale":"2024-09-12T01:06:55.023141+0000","last_undegraded":"2024-09-12T01:06:55.023141+0000","last_fullsized":"2024-09-12T01:06:55.023141+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:28.705045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'4","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.235372+0000","last_change":"2024-09-12T00:30:17.763692+0000","last_active":"2024-09-12T01:07:50.235372+0000","last_peered":"2024-09-12T01:07:50.235372+0000","last_clean":"2024-09-12T01:07:50.235372+0000","last_became_active":"2024-09-12T00:30:17.763402+0000","last_became_peered":"2024-09-12T00:30:17.763402+0000","last_unstale":"2024-09-12T01:07:50.235372+0000","last_undegraded":"2024-09-12T01:07:50.235372+0000","last_fullsized":"2024-09-12T01:07:50.235372+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:07.859938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044542+0000","last_change":"2024-09-12T00:30:14.745260+0000","last_active":"2024-09-12T01:07:45.044542+0000","last_peered":"2024-09-12T01:07:45.044542+0000","last_clean":"2024-09-12T01:07:45.044542+0000","last_became_active":"2024-09-12T00:30:14.744833+0000","last_became_peered":"2024-09-12T00:30:14.744833+0000","last_unstale":"2024-09-12T01:07:45.044542+0000","last_undegraded":"2024-09-12T01:07:45.044542+0000","last_fullsized":"2024-09-12T01:07:45.044542+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:11.503961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'41","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.040605+0000","last_change":"2024-09-12T00:27:42.840206+0000","last_active":"2024-09-12T01:07:20.040605+0000","last_peered":"2024-09-12T01:07:20.040605+0000","last_clean":"2024-09-12T01:07:20.040605+0000","last_became_active":"2024-09-12T00:27:42.839605+0000","last_became_peered":"2024-09-12T00:27:42.839605+0000","last_unstale":"2024-09-12T01:07:20.040605+0000","last_undegraded":"2024-09-12T01:07:20.040605+0000","last_fullsized":"2024-09-12T01:07:20.040605+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:10.785209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":144,"num_write":69,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.153651+0000","last_change":"2024-09-12T00:46:54.885981+0000","last_active":"2024-09-12T01:06:55.153651+0000","last_peered":"2024-09-12T01:06:55.153651+0000","last_clean":"2024-09-12T01:06:55.153651+0000","last_became_active":"2024-09-12T00:46:54.885702+0000","last_became_peered":"2024-09-12T00:46:54.885702+0000","last_unstale":"2024-09-12T01:06:55.153651+0000","last_undegraded":"2024-09-12T01:06:55.153651+0000","last_fullsized":"2024-09-12T01:06:55.153651+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:37.616069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'3","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:20.152789+0000","last_change":"2024-09-12T00:30:17.762666+0000","last_active":"2024-09-12T01:10:20.152789+0000","last_peered":"2024-09-12T01:10:20.152789+0000","last_clean":"2024-09-12T01:10:20.152789+0000","last_became_active":"2024-09-12T00:30:17.762369+0000","last_became_peered":"2024-09-12T00:30:17.762369+0000","last_unstale":"2024-09-12T01:10:20.152789+0000","last_undegraded":"2024-09-12T01:10:20.152789+0000","last_fullsized":"2024-09-12T01:10:20.152789+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:33.357062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042925+0000","last_change":"2024-09-12T00:30:14.747881+0000","last_active":"2024-09-12T01:07:48.042925+0000","last_peered":"2024-09-12T01:07:48.042925+0000","last_clean":"2024-09-12T01:07:48.042925+0000","last_became_active":"2024-09-12T00:30:14.747614+0000","last_became_peered":"2024-09-12T00:30:14.747614+0000","last_unstale":"2024-09-12T01:07:48.042925+0000","last_undegraded":"2024-09-12T01:07:48.042925+0000","last_fullsized":"2024-09-12T01:07:48.042925+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:33.210330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'21","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045493+0000","last_change":"2024-09-12T00:27:42.846591+0000","last_active":"2024-09-12T01:07:50.045493+0000","last_peered":"2024-09-12T01:07:50.045493+0000","last_clean":"2024-09-12T01:07:50.045493+0000","last_became_active":"2024-09-12T00:27:42.846264+0000","last_became_peered":"2024-09-12T00:27:42.846264+0000","last_unstale":"2024-09-12T01:07:50.045493+0000","last_undegraded":"2024-09-12T01:07:50.045493+0000","last_fullsized":"2024-09-12T01:07:50.045493+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:13.645447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:15.224938+0000","last_change":"2024-09-12T00:46:54.890699+0000","last_active":"2024-09-12T01:06:15.224938+0000","last_peered":"2024-09-12T01:06:15.224938+0000","last_clean":"2024-09-12T01:06:15.224938+0000","last_became_active":"2024-09-12T00:46:54.890430+0000","last_became_peered":"2024-09-12T00:46:54.890430+0000","last_unstale":"2024-09-12T01:06:15.224938+0000","last_undegraded":"2024-09-12T01:06:15.224938+0000","last_fullsized":"2024-09-12T01:06:15.224938+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:21.161335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042970+0000","last_change":"2024-09-12T00:30:17.767409+0000","last_active":"2024-09-12T01:07:48.042970+0000","last_peered":"2024-09-12T01:07:48.042970+0000","last_clean":"2024-09-12T01:07:48.042970+0000","last_became_active":"2024-09-12T00:30:17.767116+0000","last_became_peered":"2024-09-12T00:30:17.767116+0000","last_unstale":"2024-09-12T01:07:48.042970+0000","last_undegraded":"2024-09-12T01:07:48.042970+0000","last_fullsized":"2024-09-12T01:07:48.042970+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:25.469472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"263'6","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.240551+0000","last_change":"2024-09-12T00:30:14.742702+0000","last_active":"2024-09-12T01:10:58.240551+0000","last_peered":"2024-09-12T01:10:58.240551+0000","last_clean":"2024-09-12T01:10:58.240551+0000","last_became_active":"2024-09-12T00:30:14.742434+0000","last_became_peered":"2024-09-12T00:30:14.742434+0000","last_unstale":"2024-09-12T01:10:58.240551+0000","last_undegraded":"2024-09-12T01:10:58.240551+0000","last_fullsized":"2024-09-12T01:10:58.240551+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:37.658561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6194,"num_write":6,"num_write_kb":5170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'36","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160719+0000","last_change":"2024-09-12T00:27:42.842436+0000","last_active":"2024-09-12T01:07:45.160719+0000","last_peered":"2024-09-12T01:07:45.160719+0000","last_clean":"2024-09-12T01:07:45.160719+0000","last_became_active":"2024-09-12T00:27:42.842172+0000","last_became_peered":"2024-09-12T00:27:42.842172+0000","last_unstale":"2024-09-12T01:07:45.160719+0000","last_undegraded":"2024-09-12T01:07:45.160719+0000","last_fullsized":"2024-09-12T01:07:45.160719+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:30.357785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:23.030019+0000","last_change":"2024-09-12T00:46:54.883267+0000","last_active":"2024-09-12T01:06:23.030019+0000","last_peered":"2024-09-12T01:06:23.030019+0000","last_clean":"2024-09-12T01:06:23.030019+0000","last_became_active":"2024-09-12T00:46:54.882951+0000","last_became_peered":"2024-09-12T00:46:54.882951+0000","last_unstale":"2024-09-12T01:06:23.030019+0000","last_undegraded":"2024-09-12T01:06:23.030019+0000","last_fullsized":"2024-09-12T01:06:23.030019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:55.035382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'1","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.049034+0000","last_change":"2024-09-12T00:30:17.766601+0000","last_active":"2024-09-12T01:08:28.049034+0000","last_peered":"2024-09-12T01:08:28.049034+0000","last_clean":"2024-09-12T01:08:28.049034+0000","last_became_active":"2024-09-12T00:30:17.764967+0000","last_became_peered":"2024-09-12T00:30:17.764967+0000","last_unstale":"2024-09-12T01:08:28.049034+0000","last_undegraded":"2024-09-12T01:08:28.049034+0000","last_fullsized":"2024-09-12T01:08:28.049034+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:56.749587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:50.248603+0000","last_change":"2024-09-12T00:30:14.747887+0000","last_active":"2024-09-12T01:09:50.248603+0000","last_peered":"2024-09-12T01:09:50.248603+0000","last_clean":"2024-09-12T01:09:50.248603+0000","last_became_active":"2024-09-12T00:30:14.747423+0000","last_became_peered":"2024-09-12T00:30:14.747423+0000","last_unstale":"2024-09-12T01:09:50.248603+0000","last_undegraded":"2024-09-12T01:09:50.248603+0000","last_fullsized":"2024-09-12T01:09:50.248603+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:10.117387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'27","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160694+0000","last_change":"2024-09-12T00:27:42.837430+0000","last_active":"2024-09-12T01:07:45.160694+0000","last_peered":"2024-09-12T01:07:45.160694+0000","last_clean":"2024-09-12T01:07:45.160694+0000","last_became_active":"2024-09-12T00:27:42.837170+0000","last_became_peered":"2024-09-12T00:27:42.837170+0000","last_unstale":"2024-09-12T01:07:45.160694+0000","last_undegraded":"2024-09-12T01:07:45.160694+0000","last_fullsized":"2024-09-12T01:07:45.160694+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:50.502592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":97,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.056429+0000","last_change":"2024-09-12T00:46:54.885456+0000","last_active":"2024-09-12T01:09:00.056429+0000","last_peered":"2024-09-12T01:09:00.056429+0000","last_clean":"2024-09-12T01:09:00.056429+0000","last_became_active":"2024-09-12T00:46:54.885170+0000","last_became_peered":"2024-09-12T00:46:54.885170+0000","last_unstale":"2024-09-12T01:09:00.056429+0000","last_undegraded":"2024-09-12T01:09:00.056429+0000","last_fullsized":"2024-09-12T01:09:00.056429+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:22.660312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.723358+0000","last_change":"2024-09-12T00:30:17.765475+0000","last_active":"2024-09-12T01:10:58.723358+0000","last_peered":"2024-09-12T01:10:58.723358+0000","last_clean":"2024-09-12T01:10:58.723358+0000","last_became_active":"2024-09-12T00:30:17.765167+0000","last_became_peered":"2024-09-12T00:30:17.765167+0000","last_unstale":"2024-09-12T01:10:58.723358+0000","last_undegraded":"2024-09-12T01:10:58.723358+0000","last_fullsized":"2024-09-12T01:10:58.723358+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:48.717488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6715,"num_write":6,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:33.031572+0000","last_change":"2024-09-12T00:30:14.742908+0000","last_active":"2024-09-12T01:06:33.031572+0000","last_peered":"2024-09-12T01:06:33.031572+0000","last_clean":"2024-09-12T01:06:33.031572+0000","last_became_active":"2024-09-12T00:30:14.742625+0000","last_became_peered":"2024-09-12T00:30:14.742625+0000","last_unstale":"2024-09-12T01:06:33.031572+0000","last_undegraded":"2024-09-12T01:06:33.031572+0000","last_fullsized":"2024-09-12T01:06:33.031572+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:00.744053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160647+0000","last_change":"2024-09-12T00:27:42.845668+0000","last_active":"2024-09-12T01:07:45.160647+0000","last_peered":"2024-09-12T01:07:45.160647+0000","last_clean":"2024-09-12T01:07:45.160647+0000","last_became_active":"2024-09-12T00:27:42.845406+0000","last_became_peered":"2024-09-12T00:27:42.845406+0000","last_unstale":"2024-09-12T01:07:45.160647+0000","last_undegraded":"2024-09-12T01:07:45.160647+0000","last_fullsized":"2024-09-12T01:07:45.160647+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:58.406118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":45,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044551+0000","last_change":"2024-09-12T00:46:54.877914+0000","last_active":"2024-09-12T01:07:45.044551+0000","last_peered":"2024-09-12T01:07:45.044551+0000","last_clean":"2024-09-12T01:07:45.044551+0000","last_became_active":"2024-09-12T00:46:54.876219+0000","last_became_peered":"2024-09-12T00:46:54.876219+0000","last_unstale":"2024-09-12T01:07:45.044551+0000","last_undegraded":"2024-09-12T01:07:45.044551+0000","last_fullsized":"2024-09-12T01:07:45.044551+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:46.030061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.723885+0000","last_change":"2024-09-12T00:30:17.763491+0000","last_active":"2024-09-12T01:10:58.723885+0000","last_peered":"2024-09-12T01:10:58.723885+0000","last_clean":"2024-09-12T01:10:58.723885+0000","last_became_active":"2024-09-12T00:30:17.762792+0000","last_became_peered":"2024-09-12T00:30:17.762792+0000","last_unstale":"2024-09-12T01:10:58.723885+0000","last_undegraded":"2024-09-12T01:10:58.723885+0000","last_fullsized":"2024-09-12T01:10:58.723885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:45.751971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.034091+0000","last_change":"2024-09-12T00:30:14.745747+0000","last_active":"2024-09-12T01:06:40.034091+0000","last_peered":"2024-09-12T01:06:40.034091+0000","last_clean":"2024-09-12T01:06:40.034091+0000","last_became_active":"2024-09-12T00:30:14.745328+0000","last_became_peered":"2024-09-12T00:30:14.745328+0000","last_unstale":"2024-09-12T01:06:40.034091+0000","last_undegraded":"2024-09-12T01:06:40.034091+0000","last_fullsized":"2024-09-12T01:06:40.034091+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:22.444900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'29","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.134777+0000","last_change":"2024-09-12T00:27:42.844015+0000","last_active":"2024-09-12T01:07:45.134777+0000","last_peered":"2024-09-12T01:07:45.134777+0000","last_clean":"2024-09-12T01:07:45.134777+0000","last_became_active":"2024-09-12T00:27:42.843745+0000","last_became_peered":"2024-09-12T00:27:42.843745+0000","last_unstale":"2024-09-12T01:07:45.134777+0000","last_undegraded":"2024-09-12T01:07:45.134777+0000","last_fullsized":"2024-09-12T01:07:45.134777+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:02.518882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":101,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.129245+0000","last_change":"2024-09-12T00:46:54.889308+0000","last_active":"2024-09-12T01:06:55.129245+0000","last_peered":"2024-09-12T01:06:55.129245+0000","last_clean":"2024-09-12T01:06:55.129245+0000","last_became_active":"2024-09-12T00:46:54.889006+0000","last_became_peered":"2024-09-12T00:46:54.889006+0000","last_unstale":"2024-09-12T01:06:55.129245+0000","last_undegraded":"2024-09-12T01:06:55.129245+0000","last_fullsized":"2024-09-12T01:06:55.129245+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:09.749976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'11","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:20.152777+0000","last_change":"2024-09-12T00:30:17.759472+0000","last_active":"2024-09-12T01:10:20.152777+0000","last_peered":"2024-09-12T01:10:20.152777+0000","last_clean":"2024-09-12T01:10:20.152777+0000","last_became_active":"2024-09-12T00:30:17.759198+0000","last_became_peered":"2024-09-12T00:30:17.759198+0000","last_unstale":"2024-09-12T01:10:20.152777+0000","last_undegraded":"2024-09-12T01:10:20.152777+0000","last_fullsized":"2024-09-12T01:10:20.152777+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:30.456850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9336,"num_write":16,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.028479+0000","last_change":"2024-09-12T00:30:14.750283+0000","last_active":"2024-09-12T01:07:45.028479+0000","last_peered":"2024-09-12T01:07:45.028479+0000","last_clean":"2024-09-12T01:07:45.028479+0000","last_became_active":"2024-09-12T00:30:14.750004+0000","last_became_peered":"2024-09-12T00:30:14.750004+0000","last_unstale":"2024-09-12T01:07:45.028479+0000","last_undegraded":"2024-09-12T01:07:45.028479+0000","last_fullsized":"2024-09-12T01:07:45.028479+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:54.714545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'18","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.031378+0000","last_change":"2024-09-12T00:27:42.835796+0000","last_active":"2024-09-12T01:06:30.031378+0000","last_peered":"2024-09-12T01:06:30.031378+0000","last_clean":"2024-09-12T01:06:30.031378+0000","last_became_active":"2024-09-12T00:27:42.835530+0000","last_became_peered":"2024-09-12T00:27:42.835530+0000","last_unstale":"2024-09-12T01:06:30.031378+0000","last_undegraded":"2024-09-12T01:06:30.031378+0000","last_fullsized":"2024-09-12T01:06:30.031378+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:37.899819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.023205+0000","last_change":"2024-09-12T00:46:54.883214+0000","last_active":"2024-09-12T01:06:55.023205+0000","last_peered":"2024-09-12T01:06:55.023205+0000","last_clean":"2024-09-12T01:06:55.023205+0000","last_became_active":"2024-09-12T00:46:54.882946+0000","last_became_peered":"2024-09-12T00:46:54.882946+0000","last_unstale":"2024-09-12T01:06:55.023205+0000","last_undegraded":"2024-09-12T01:06:55.023205+0000","last_fullsized":"2024-09-12T01:06:55.023205+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:01.444701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045398+0000","last_change":"2024-09-12T00:30:17.766684+0000","last_active":"2024-09-12T01:07:50.045398+0000","last_peered":"2024-09-12T01:07:50.045398+0000","last_clean":"2024-09-12T01:07:50.045398+0000","last_became_active":"2024-09-12T00:30:17.763733+0000","last_became_peered":"2024-09-12T00:30:17.763733+0000","last_unstale":"2024-09-12T01:07:50.045398+0000","last_undegraded":"2024-09-12T01:07:50.045398+0000","last_fullsized":"2024-09-12T01:07:50.045398+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:45.175363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:15.184368+0000","last_change":"2024-09-12T00:30:14.748751+0000","last_active":"2024-09-12T01:10:15.184368+0000","last_peered":"2024-09-12T01:10:15.184368+0000","last_clean":"2024-09-12T01:10:15.184368+0000","last_became_active":"2024-09-12T00:30:14.748462+0000","last_became_peered":"2024-09-12T00:30:14.748462+0000","last_unstale":"2024-09-12T01:10:15.184368+0000","last_undegraded":"2024-09-12T01:10:15.184368+0000","last_fullsized":"2024-09-12T01:10:15.184368+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:23.544212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'17","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.148879+0000","last_change":"2024-09-12T00:27:42.839309+0000","last_active":"2024-09-12T01:06:25.148879+0000","last_peered":"2024-09-12T01:06:25.148879+0000","last_clean":"2024-09-12T01:06:25.148879+0000","last_became_active":"2024-09-12T00:27:42.838896+0000","last_became_peered":"2024-09-12T00:27:42.838896+0000","last_unstale":"2024-09-12T01:06:25.148879+0000","last_undegraded":"2024-09-12T01:06:25.148879+0000","last_fullsized":"2024-09-12T01:06:25.148879+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:33.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.044373+0000","last_change":"2024-09-12T00:46:54.885744+0000","last_active":"2024-09-12T01:07:58.044373+0000","last_peered":"2024-09-12T01:07:58.044373+0000","last_clean":"2024-09-12T01:07:58.044373+0000","last_became_active":"2024-09-12T00:46:54.885457+0000","last_became_peered":"2024-09-12T00:46:54.885457+0000","last_unstale":"2024-09-12T01:07:58.044373+0000","last_undegraded":"2024-09-12T01:07:58.044373+0000","last_fullsized":"2024-09-12T01:07:58.044373+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:36.235325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.032424+0000","last_change":"2024-09-12T00:30:17.765481+0000","last_active":"2024-09-12T01:06:35.032424+0000","last_peered":"2024-09-12T01:06:35.032424+0000","last_clean":"2024-09-12T01:06:35.032424+0000","last_became_active":"2024-09-12T00:30:17.765149+0000","last_became_peered":"2024-09-12T00:30:17.765149+0000","last_unstale":"2024-09-12T01:06:35.032424+0000","last_undegraded":"2024-09-12T01:06:35.032424+0000","last_fullsized":"2024-09-12T01:06:35.032424+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:20.242797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041690+0000","last_change":"2024-09-12T00:30:14.740879+0000","last_active":"2024-09-12T01:07:45.041690+0000","last_peered":"2024-09-12T01:07:45.041690+0000","last_clean":"2024-09-12T01:07:45.041690+0000","last_became_active":"2024-09-12T00:30:14.740516+0000","last_became_peered":"2024-09-12T00:30:14.740516+0000","last_unstale":"2024-09-12T01:07:45.041690+0000","last_undegraded":"2024-09-12T01:07:45.041690+0000","last_fullsized":"2024-09-12T01:07:45.041690+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:43.135121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'20","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030659+0000","last_change":"2024-09-12T00:27:42.841806+0000","last_active":"2024-09-12T01:06:25.030659+0000","last_peered":"2024-09-12T01:06:25.030659+0000","last_clean":"2024-09-12T01:06:25.030659+0000","last_became_active":"2024-09-12T00:27:42.840919+0000","last_became_peered":"2024-09-12T00:27:42.840919+0000","last_unstale":"2024-09-12T01:06:25.030659+0000","last_undegraded":"2024-09-12T01:06:25.030659+0000","last_fullsized":"2024-09-12T01:06:25.030659+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:51.676258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":83,"num_write":31,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.162301+0000","last_change":"2024-09-12T00:46:54.887403+0000","last_active":"2024-09-12T01:07:55.162301+0000","last_peered":"2024-09-12T01:07:55.162301+0000","last_clean":"2024-09-12T01:07:55.162301+0000","last_became_active":"2024-09-12T00:46:54.887134+0000","last_became_peered":"2024-09-12T00:46:54.887134+0000","last_unstale":"2024-09-12T01:07:55.162301+0000","last_undegraded":"2024-09-12T01:07:55.162301+0000","last_fullsized":"2024-09-12T01:07:55.162301+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:13.379263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'6","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042898+0000","last_change":"2024-09-12T00:30:17.766525+0000","last_active":"2024-09-12T01:07:48.042898+0000","last_peered":"2024-09-12T01:07:48.042898+0000","last_clean":"2024-09-12T01:07:48.042898+0000","last_became_active":"2024-09-12T00:30:17.766203+0000","last_became_peered":"2024-09-12T00:30:17.766203+0000","last_unstale":"2024-09-12T01:07:48.042898+0000","last_undegraded":"2024-09-12T01:07:48.042898+0000","last_fullsized":"2024-09-12T01:07:48.042898+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:51.225523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8439067,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":13412,"num_write":11,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.020488+0000","last_change":"2024-09-12T00:30:14.746410+0000","last_active":"2024-09-12T01:06:30.020488+0000","last_peered":"2024-09-12T01:06:30.020488+0000","last_clean":"2024-09-12T01:06:30.020488+0000","last_became_active":"2024-09-12T00:30:14.746119+0000","last_became_peered":"2024-09-12T00:30:14.746119+0000","last_unstale":"2024-09-12T01:06:30.020488+0000","last_undegraded":"2024-09-12T01:06:30.020488+0000","last_fullsized":"2024-09-12T01:06:30.020488+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:15.863696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'39","reported_seq":151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030634+0000","last_change":"2024-09-12T00:27:42.846588+0000","last_active":"2024-09-12T01:06:25.030634+0000","last_peered":"2024-09-12T01:06:25.030634+0000","last_clean":"2024-09-12T01:06:25.030634+0000","last_became_active":"2024-09-12T00:27:42.846198+0000","last_became_peered":"2024-09-12T00:27:42.846198+0000","last_unstale":"2024-09-12T01:06:25.030634+0000","last_undegraded":"2024-09-12T01:06:25.030634+0000","last_fullsized":"2024-09-12T01:06:25.030634+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:39.702227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":138,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.135933+0000","last_change":"2024-09-12T00:46:54.886148+0000","last_active":"2024-09-12T01:07:55.135933+0000","last_peered":"2024-09-12T01:07:55.135933+0000","last_clean":"2024-09-12T01:07:55.135933+0000","last_became_active":"2024-09-12T00:46:54.885879+0000","last_became_peered":"2024-09-12T00:46:54.885879+0000","last_unstale":"2024-09-12T01:07:55.135933+0000","last_undegraded":"2024-09-12T01:07:55.135933+0000","last_fullsized":"2024-09-12T01:07:55.135933+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:12.855547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"260'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.032478+0000","last_change":"2024-09-12T00:30:17.769299+0000","last_active":"2024-09-12T01:06:35.032478+0000","last_peered":"2024-09-12T01:06:35.032478+0000","last_clean":"2024-09-12T01:06:35.032478+0000","last_became_active":"2024-09-12T00:30:17.769051+0000","last_became_peered":"2024-09-12T00:30:17.769051+0000","last_unstale":"2024-09-12T01:06:35.032478+0000","last_undegraded":"2024-09-12T01:06:35.032478+0000","last_fullsized":"2024-09-12T01:06:35.032478+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:02.321672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'8","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.309265+0000","last_change":"2024-09-12T00:30:14.743361+0000","last_active":"2024-09-12T01:10:58.309265+0000","last_peered":"2024-09-12T01:10:58.309265+0000","last_clean":"2024-09-12T01:10:58.309265+0000","last_became_active":"2024-09-12T00:30:14.743083+0000","last_became_peered":"2024-09-12T00:30:14.743083+0000","last_unstale":"2024-09-12T01:10:58.309265+0000","last_undegraded":"2024-09-12T01:10:58.309265+0000","last_fullsized":"2024-09-12T01:10:58.309265+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:54.700301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030625+0000","last_change":"2024-09-12T00:27:42.839353+0000","last_active":"2024-09-12T01:06:25.030625+0000","last_peered":"2024-09-12T01:06:25.030625+0000","last_clean":"2024-09-12T01:06:25.030625+0000","last_became_active":"2024-09-12T00:27:42.839063+0000","last_became_peered":"2024-09-12T00:27:42.839063+0000","last_unstale":"2024-09-12T01:06:25.030625+0000","last_undegraded":"2024-09-12T01:06:25.030625+0000","last_fullsized":"2024-09-12T01:06:25.030625+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:50.341652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":119,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.029600+0000","last_change":"2024-09-12T00:46:54.887703+0000","last_active":"2024-09-12T01:07:55.029600+0000","last_peered":"2024-09-12T01:07:55.029600+0000","last_clean":"2024-09-12T01:07:55.029600+0000","last_became_active":"2024-09-12T00:46:54.887450+0000","last_became_peered":"2024-09-12T00:46:54.887450+0000","last_unstale":"2024-09-12T01:07:55.029600+0000","last_undegraded":"2024-09-12T01:07:55.029600+0000","last_fullsized":"2024-09-12T01:07:55.029600+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:53.371335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.021027+0000","last_change":"2024-09-12T00:30:17.756613+0000","last_active":"2024-09-12T01:06:35.021027+0000","last_peered":"2024-09-12T01:06:35.021027+0000","last_clean":"2024-09-12T01:06:35.021027+0000","last_became_active":"2024-09-12T00:30:17.756342+0000","last_became_peered":"2024-09-12T00:30:17.756342+0000","last_unstale":"2024-09-12T01:06:35.021027+0000","last_undegraded":"2024-09-12T01:06:35.021027+0000","last_fullsized":"2024-09-12T01:06:35.021027+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:08.103127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:33.031702+0000","last_change":"2024-09-12T00:30:14.748689+0000","last_active":"2024-09-12T01:06:33.031702+0000","last_peered":"2024-09-12T01:06:33.031702+0000","last_clean":"2024-09-12T01:06:33.031702+0000","last_became_active":"2024-09-12T00:30:14.748446+0000","last_became_peered":"2024-09-12T00:30:14.748446+0000","last_unstale":"2024-09-12T01:06:33.031702+0000","last_undegraded":"2024-09-12T01:06:33.031702+0000","last_fullsized":"2024-09-12T01:06:33.031702+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:32.811168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'23","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.040482+0000","last_change":"2024-09-12T00:27:42.845645+0000","last_active":"2024-09-12T01:07:35.040482+0000","last_peered":"2024-09-12T01:07:35.040482+0000","last_clean":"2024-09-12T01:07:35.040482+0000","last_became_active":"2024-09-12T00:27:42.845379+0000","last_became_peered":"2024-09-12T00:27:42.845379+0000","last_unstale":"2024-09-12T01:07:35.040482+0000","last_undegraded":"2024-09-12T01:07:35.040482+0000","last_fullsized":"2024-09-12T01:07:35.040482+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:35.854841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:18.029467+0000","last_change":"2024-09-12T00:46:54.884019+0000","last_active":"2024-09-12T01:06:18.029467+0000","last_peered":"2024-09-12T01:06:18.029467+0000","last_clean":"2024-09-12T01:06:18.029467+0000","last_became_active":"2024-09-12T00:46:54.883713+0000","last_became_peered":"2024-09-12T00:46:54.883713+0000","last_unstale":"2024-09-12T01:06:18.029467+0000","last_undegraded":"2024-09-12T01:06:18.029467+0000","last_fullsized":"2024-09-12T01:06:18.029467+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:41.973083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'6","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.041273+0000","last_change":"2024-09-12T00:30:17.764514+0000","last_active":"2024-09-12T01:07:38.041273+0000","last_peered":"2024-09-12T01:07:38.041273+0000","last_clean":"2024-09-12T01:07:38.041273+0000","last_became_active":"2024-09-12T00:30:17.764165+0000","last_became_peered":"2024-09-12T00:30:17.764165+0000","last_unstale":"2024-09-12T01:07:38.041273+0000","last_undegraded":"2024-09-12T01:07:38.041273+0000","last_fullsized":"2024-09-12T01:07:38.041273+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:16.348051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":11,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:55.249102+0000","last_change":"2024-09-12T00:30:14.747500+0000","last_active":"2024-09-12T01:09:55.249102+0000","last_peered":"2024-09-12T01:09:55.249102+0000","last_clean":"2024-09-12T01:09:55.249102+0000","last_became_active":"2024-09-12T00:30:14.747184+0000","last_became_peered":"2024-09-12T00:30:14.747184+0000","last_unstale":"2024-09-12T01:09:55.249102+0000","last_undegraded":"2024-09-12T01:09:55.249102+0000","last_fullsized":"2024-09-12T01:09:55.249102+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:20.436960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'76","reported_seq":299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.039285+0000","last_change":"2024-09-12T00:27:42.846397+0000","last_active":"2024-09-12T01:07:25.039285+0000","last_peered":"2024-09-12T01:07:25.039285+0000","last_clean":"2024-09-12T01:07:25.039285+0000","last_became_active":"2024-09-12T00:27:42.846108+0000","last_became_peered":"2024-09-12T00:27:42.846108+0000","last_unstale":"2024-09-12T01:07:25.039285+0000","last_undegraded":"2024-09-12T01:07:25.039285+0000","last_fullsized":"2024-09-12T01:07:25.039285+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:11.395534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":337,"num_write":98,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:15.147442+0000","last_change":"2024-09-12T00:46:54.889757+0000","last_active":"2024-09-12T01:06:15.147442+0000","last_peered":"2024-09-12T01:06:15.147442+0000","last_clean":"2024-09-12T01:06:15.147442+0000","last_became_active":"2024-09-12T00:46:54.889496+0000","last_became_peered":"2024-09-12T00:46:54.889496+0000","last_unstale":"2024-09-12T01:06:15.147442+0000","last_undegraded":"2024-09-12T01:06:15.147442+0000","last_fullsized":"2024-09-12T01:06:15.147442+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:28.265877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.041215+0000","last_change":"2024-09-12T00:30:17.767918+0000","last_active":"2024-09-12T01:07:38.041215+0000","last_peered":"2024-09-12T01:07:38.041215+0000","last_clean":"2024-09-12T01:07:38.041215+0000","last_became_active":"2024-09-12T00:30:17.767526+0000","last_became_peered":"2024-09-12T00:30:17.767526+0000","last_unstale":"2024-09-12T01:07:38.041215+0000","last_undegraded":"2024-09-12T01:07:38.041215+0000","last_fullsized":"2024-09-12T01:07:38.041215+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:28.500175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.041253+0000","last_change":"2024-09-12T00:30:14.749360+0000","last_active":"2024-09-12T01:07:38.041253+0000","last_peered":"2024-09-12T01:07:38.041253+0000","last_clean":"2024-09-12T01:07:38.041253+0000","last_became_active":"2024-09-12T00:30:14.749104+0000","last_became_peered":"2024-09-12T00:30:14.749104+0000","last_unstale":"2024-09-12T01:07:38.041253+0000","last_undegraded":"2024-09-12T01:07:38.041253+0000","last_fullsized":"2024-09-12T01:07:38.041253+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:33.044875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'28","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.041394+0000","last_change":"2024-09-12T00:27:42.841054+0000","last_active":"2024-09-12T01:07:25.041394+0000","last_peered":"2024-09-12T01:07:25.041394+0000","last_clean":"2024-09-12T01:07:25.041394+0000","last_became_active":"2024-09-12T00:27:42.840749+0000","last_became_peered":"2024-09-12T00:27:42.840749+0000","last_unstale":"2024-09-12T01:07:25.041394+0000","last_undegraded":"2024-09-12T01:07:25.041394+0000","last_fullsized":"2024-09-12T01:07:25.041394+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:58.932432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":101,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.046768+0000","last_change":"2024-09-12T00:46:54.876242+0000","last_active":"2024-09-12T01:08:00.046768+0000","last_peered":"2024-09-12T01:08:00.046768+0000","last_clean":"2024-09-12T01:08:00.046768+0000","last_became_active":"2024-09-12T00:46:54.875939+0000","last_became_peered":"2024-09-12T00:46:54.875939+0000","last_unstale":"2024-09-12T01:08:00.046768+0000","last_undegraded":"2024-09-12T01:08:00.046768+0000","last_fullsized":"2024-09-12T01:08:00.046768+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:39.634295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043775+0000","last_change":"2024-09-12T00:30:17.761490+0000","last_active":"2024-09-12T01:07:40.043775+0000","last_peered":"2024-09-12T01:07:40.043775+0000","last_clean":"2024-09-12T01:07:40.043775+0000","last_became_active":"2024-09-12T00:30:17.761182+0000","last_became_peered":"2024-09-12T00:30:17.761182+0000","last_unstale":"2024-09-12T01:07:40.043775+0000","last_undegraded":"2024-09-12T01:07:40.043775+0000","last_fullsized":"2024-09-12T01:07:40.043775+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:42.070821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.233715+0000","last_change":"2024-09-12T00:30:14.748190+0000","last_active":"2024-09-12T01:07:35.233715+0000","last_peered":"2024-09-12T01:07:35.233715+0000","last_clean":"2024-09-12T01:07:35.233715+0000","last_became_active":"2024-09-12T00:30:14.747887+0000","last_became_peered":"2024-09-12T00:30:14.747887+0000","last_unstale":"2024-09-12T01:07:35.233715+0000","last_undegraded":"2024-09-12T01:07:35.233715+0000","last_fullsized":"2024-09-12T01:07:35.233715+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:51.879862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'76","reported_seq":312,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.132545+0000","last_change":"2024-09-12T00:27:42.839562+0000","last_active":"2024-09-12T01:07:25.132545+0000","last_peered":"2024-09-12T01:07:25.132545+0000","last_clean":"2024-09-12T01:07:25.132545+0000","last_became_active":"2024-09-12T00:27:42.839295+0000","last_became_peered":"2024-09-12T00:27:42.839295+0000","last_unstale":"2024-09-12T01:07:25.132545+0000","last_undegraded":"2024-09-12T01:07:25.132545+0000","last_fullsized":"2024-09-12T01:07:25.132545+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:56.924650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":349,"num_write":102,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:15.147394+0000","last_change":"2024-09-12T00:46:54.881248+0000","last_active":"2024-09-12T01:06:15.147394+0000","last_peered":"2024-09-12T01:06:15.147394+0000","last_clean":"2024-09-12T01:06:15.147394+0000","last_became_active":"2024-09-12T00:46:54.880982+0000","last_became_peered":"2024-09-12T00:46:54.880982+0000","last_unstale":"2024-09-12T01:06:15.147394+0000","last_undegraded":"2024-09-12T01:06:15.147394+0000","last_fullsized":"2024-09-12T01:06:15.147394+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:32.451032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"263'2","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:00.057885+0000","last_change":"2024-09-12T00:30:17.766356+0000","last_active":"2024-09-12T01:10:00.057885+0000","last_peered":"2024-09-12T01:10:00.057885+0000","last_clean":"2024-09-12T01:10:00.057885+0000","last_became_active":"2024-09-12T00:30:17.765384+0000","last_became_peered":"2024-09-12T00:30:17.765384+0000","last_unstale":"2024-09-12T01:10:00.057885+0000","last_undegraded":"2024-09-12T01:10:00.057885+0000","last_fullsized":"2024-09-12T01:10:00.057885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:48.714095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.936260+0000","last_change":"2024-09-12T00:30:14.750712+0000","last_active":"2024-09-12T01:10:59.936260+0000","last_peered":"2024-09-12T01:10:59.936260+0000","last_clean":"2024-09-12T01:10:59.936260+0000","last_became_active":"2024-09-12T00:30:14.750407+0000","last_became_peered":"2024-09-12T00:30:14.750407+0000","last_unstale":"2024-09-12T01:10:59.936260+0000","last_undegraded":"2024-09-12T01:10:59.936260+0000","last_fullsized":"2024-09-12T01:10:59.936260+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:38.391719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5691,"num_write":6,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'35","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.041332+0000","last_change":"2024-09-12T00:27:42.840411+0000","last_active":"2024-09-12T01:07:25.041332+0000","last_peered":"2024-09-12T01:07:25.041332+0000","last_clean":"2024-09-12T01:07:25.041332+0000","last_became_active":"2024-09-12T00:27:42.840137+0000","last_became_peered":"2024-09-12T00:27:42.840137+0000","last_unstale":"2024-09-12T01:07:25.041332+0000","last_undegraded":"2024-09-12T01:07:25.041332+0000","last_fullsized":"2024-09-12T01:07:25.041332+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:08.491063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":59,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:43.051166+0000","last_change":"2024-09-12T00:46:54.888517+0000","last_active":"2024-09-12T01:08:43.051166+0000","last_peered":"2024-09-12T01:08:43.051166+0000","last_clean":"2024-09-12T01:08:43.051166+0000","last_became_active":"2024-09-12T00:46:54.888207+0000","last_became_peered":"2024-09-12T00:46:54.888207+0000","last_unstale":"2024-09-12T01:08:43.051166+0000","last_undegraded":"2024-09-12T01:08:43.051166+0000","last_fullsized":"2024-09-12T01:08:43.051166+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:38.971555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'7","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.166733+0000","last_change":"2024-09-12T00:30:17.763396+0000","last_active":"2024-09-12T01:10:59.166733+0000","last_peered":"2024-09-12T01:10:59.166733+0000","last_clean":"2024-09-12T01:10:59.166733+0000","last_became_active":"2024-09-12T00:30:17.763106+0000","last_became_peered":"2024-09-12T00:30:17.763106+0000","last_unstale":"2024-09-12T01:10:59.166733+0000","last_undegraded":"2024-09-12T01:10:59.166733+0000","last_fullsized":"2024-09-12T01:10:59.166733+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:48.609847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:45.156114+0000","last_change":"2024-09-12T00:30:14.746340+0000","last_active":"2024-09-12T01:10:45.156114+0000","last_peered":"2024-09-12T01:10:45.156114+0000","last_clean":"2024-09-12T01:10:45.156114+0000","last_became_active":"2024-09-12T00:30:14.746069+0000","last_became_peered":"2024-09-12T00:30:14.746069+0000","last_unstale":"2024-09-12T01:10:45.156114+0000","last_undegraded":"2024-09-12T01:10:45.156114+0000","last_fullsized":"2024-09-12T01:10:45.156114+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:13.259839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'41","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.049662+0000","last_change":"2024-09-12T00:27:42.841822+0000","last_active":"2024-09-12T01:08:20.049662+0000","last_peered":"2024-09-12T01:08:20.049662+0000","last_clean":"2024-09-12T01:08:20.049662+0000","last_became_active":"2024-09-12T00:27:42.841530+0000","last_became_peered":"2024-09-12T00:27:42.841530+0000","last_unstale":"2024-09-12T01:08:20.049662+0000","last_undegraded":"2024-09-12T01:08:20.049662+0000","last_fullsized":"2024-09-12T01:08:20.049662+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:31.785686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.231129+0000","last_change":"2024-09-12T00:46:54.886162+0000","last_active":"2024-09-12T01:07:10.231129+0000","last_peered":"2024-09-12T01:07:10.231129+0000","last_clean":"2024-09-12T01:07:10.231129+0000","last_became_active":"2024-09-12T00:46:54.885842+0000","last_became_peered":"2024-09-12T00:46:54.885842+0000","last_unstale":"2024-09-12T01:07:10.231129+0000","last_undegraded":"2024-09-12T01:07:10.231129+0000","last_fullsized":"2024-09-12T01:07:10.231129+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:09.698110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'6","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052277+0000","last_change":"2024-09-12T00:30:17.765752+0000","last_active":"2024-09-12T01:08:35.052277+0000","last_peered":"2024-09-12T01:08:35.052277+0000","last_clean":"2024-09-12T01:08:35.052277+0000","last_became_active":"2024-09-12T00:30:17.765404+0000","last_became_peered":"2024-09-12T00:30:17.765404+0000","last_unstale":"2024-09-12T01:08:35.052277+0000","last_undegraded":"2024-09-12T01:08:35.052277+0000","last_fullsized":"2024-09-12T01:08:35.052277+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:56.259889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.167293+0000","last_change":"2024-09-12T00:30:14.743435+0000","last_active":"2024-09-12T01:08:30.167293+0000","last_peered":"2024-09-12T01:08:30.167293+0000","last_clean":"2024-09-12T01:08:30.167293+0000","last_became_active":"2024-09-12T00:30:14.743148+0000","last_became_peered":"2024-09-12T00:30:14.743148+0000","last_unstale":"2024-09-12T01:08:30.167293+0000","last_undegraded":"2024-09-12T01:08:30.167293+0000","last_fullsized":"2024-09-12T01:08:30.167293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:22.367871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'37","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045203+0000","last_change":"2024-09-12T00:27:42.846410+0000","last_active":"2024-09-12T01:08:15.045203+0000","last_peered":"2024-09-12T01:08:15.045203+0000","last_clean":"2024-09-12T01:08:15.045203+0000","last_became_active":"2024-09-12T00:27:42.846090+0000","last_became_peered":"2024-09-12T00:27:42.846090+0000","last_unstale":"2024-09-12T01:08:15.045203+0000","last_undegraded":"2024-09-12T01:08:15.045203+0000","last_fullsized":"2024-09-12T01:08:15.045203+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:24.133207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":132,"num_write":69,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.047409+0000","last_change":"2024-09-12T00:46:54.883396+0000","last_active":"2024-09-12T01:08:35.047409+0000","last_peered":"2024-09-12T01:08:35.047409+0000","last_clean":"2024-09-12T01:08:35.047409+0000","last_became_active":"2024-09-12T00:46:54.883024+0000","last_became_peered":"2024-09-12T00:46:54.883024+0000","last_unstale":"2024-09-12T01:08:35.047409+0000","last_undegraded":"2024-09-12T01:08:35.047409+0000","last_fullsized":"2024-09-12T01:08:35.047409+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:27.222440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:55.073588+0000","last_change":"2024-09-12T00:30:17.769409+0000","last_active":"2024-09-12T01:10:55.073588+0000","last_peered":"2024-09-12T01:10:55.073588+0000","last_clean":"2024-09-12T01:10:55.073588+0000","last_became_active":"2024-09-12T00:30:17.769226+0000","last_became_peered":"2024-09-12T00:30:17.769226+0000","last_unstale":"2024-09-12T01:10:55.073588+0000","last_undegraded":"2024-09-12T01:10:55.073588+0000","last_fullsized":"2024-09-12T01:10:55.073588+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:53.397913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.051372+0000","last_change":"2024-09-12T00:30:14.741263+0000","last_active":"2024-09-12T01:08:30.051372+0000","last_peered":"2024-09-12T01:08:30.051372+0000","last_clean":"2024-09-12T01:08:30.051372+0000","last_became_active":"2024-09-12T00:30:14.740963+0000","last_became_peered":"2024-09-12T00:30:14.740963+0000","last_unstale":"2024-09-12T01:08:30.051372+0000","last_undegraded":"2024-09-12T01:08:30.051372+0000","last_fullsized":"2024-09-12T01:08:30.051372+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:55.514008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.238012+0000","last_change":"2024-09-12T00:27:42.835227+0000","last_active":"2024-09-12T01:08:15.238012+0000","last_peered":"2024-09-12T01:08:15.238012+0000","last_clean":"2024-09-12T01:08:15.238012+0000","last_became_active":"2024-09-12T00:27:42.834942+0000","last_became_peered":"2024-09-12T00:27:42.834942+0000","last_unstale":"2024-09-12T01:08:15.238012+0000","last_undegraded":"2024-09-12T01:08:15.238012+0000","last_fullsized":"2024-09-12T01:08:15.238012+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:10.179555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":105,"num_write":60,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.240177+0000","last_change":"2024-09-12T00:46:54.888100+0000","last_active":"2024-09-12T01:08:35.240177+0000","last_peered":"2024-09-12T01:08:35.240177+0000","last_clean":"2024-09-12T01:08:35.240177+0000","last_became_active":"2024-09-12T00:46:54.887303+0000","last_became_peered":"2024-09-12T00:46:54.887303+0000","last_unstale":"2024-09-12T01:08:35.240177+0000","last_undegraded":"2024-09-12T01:08:35.240177+0000","last_fullsized":"2024-09-12T01:08:35.240177+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:37.539140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"263'1","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:33.049760+0000","last_change":"2024-09-12T00:30:17.768358+0000","last_active":"2024-09-12T01:08:33.049760+0000","last_peered":"2024-09-12T01:08:33.049760+0000","last_clean":"2024-09-12T01:08:33.049760+0000","last_became_active":"2024-09-12T00:30:17.768072+0000","last_became_peered":"2024-09-12T00:30:17.768072+0000","last_unstale":"2024-09-12T01:08:33.049760+0000","last_undegraded":"2024-09-12T01:08:33.049760+0000","last_fullsized":"2024-09-12T01:08:33.049760+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:13.328589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.072901+0000","last_change":"2024-09-12T00:30:14.744984+0000","last_active":"2024-09-12T01:10:50.072901+0000","last_peered":"2024-09-12T01:10:50.072901+0000","last_clean":"2024-09-12T01:10:50.072901+0000","last_became_active":"2024-09-12T00:30:14.744485+0000","last_became_peered":"2024-09-12T00:30:14.744485+0000","last_unstale":"2024-09-12T01:10:50.072901+0000","last_undegraded":"2024-09-12T01:10:50.072901+0000","last_fullsized":"2024-09-12T01:10:50.072901+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:02.930319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'50","reported_seq":195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165137+0000","last_change":"2024-09-12T00:27:42.839068+0000","last_active":"2024-09-12T01:08:15.165137+0000","last_peered":"2024-09-12T01:08:15.165137+0000","last_clean":"2024-09-12T01:08:15.165137+0000","last_became_active":"2024-09-12T00:27:42.838771+0000","last_became_peered":"2024-09-12T00:27:42.838771+0000","last_unstale":"2024-09-12T01:08:15.165137+0000","last_undegraded":"2024-09-12T01:08:15.165137+0000","last_fullsized":"2024-09-12T01:08:15.165137+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:39.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":194,"num_write":94,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.037715+0000","last_change":"2024-09-12T00:46:54.884379+0000","last_active":"2024-09-12T01:07:13.037715+0000","last_peered":"2024-09-12T01:07:13.037715+0000","last_clean":"2024-09-12T01:07:13.037715+0000","last_became_active":"2024-09-12T00:46:54.883927+0000","last_became_peered":"2024-09-12T00:46:54.883927+0000","last_unstale":"2024-09-12T01:07:13.037715+0000","last_undegraded":"2024-09-12T01:07:13.037715+0000","last_fullsized":"2024-09-12T01:07:13.037715+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:13.845718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'1","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.037600+0000","last_change":"2024-09-12T00:30:17.761674+0000","last_active":"2024-09-12T01:07:10.037600+0000","last_peered":"2024-09-12T01:07:10.037600+0000","last_clean":"2024-09-12T01:07:10.037600+0000","last_became_active":"2024-09-12T00:30:17.761176+0000","last_became_peered":"2024-09-12T00:30:17.761176+0000","last_unstale":"2024-09-12T01:07:10.037600+0000","last_undegraded":"2024-09-12T01:07:10.037600+0000","last_fullsized":"2024-09-12T01:07:10.037600+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.925976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48429,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.058934+0000","last_change":"2024-09-12T00:30:14.744748+0000","last_active":"2024-09-12T01:09:15.058934+0000","last_peered":"2024-09-12T01:09:15.058934+0000","last_clean":"2024-09-12T01:09:15.058934+0000","last_became_active":"2024-09-12T00:30:14.743730+0000","last_became_peered":"2024-09-12T00:30:14.743730+0000","last_unstale":"2024-09-12T01:09:15.058934+0000","last_undegraded":"2024-09-12T01:09:15.058934+0000","last_fullsized":"2024-09-12T01:09:15.058934+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:40.137757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'40","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165081+0000","last_change":"2024-09-12T00:27:42.842498+0000","last_active":"2024-09-12T01:08:15.165081+0000","last_peered":"2024-09-12T01:08:15.165081+0000","last_clean":"2024-09-12T01:08:15.165081+0000","last_became_active":"2024-09-12T00:27:42.842267+0000","last_became_peered":"2024-09-12T00:27:42.842267+0000","last_unstale":"2024-09-12T01:08:15.165081+0000","last_undegraded":"2024-09-12T01:08:15.165081+0000","last_fullsized":"2024-09-12T01:08:15.165081+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:13.278076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":155,"num_write":62,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:15.131566+0000","last_change":"2024-09-12T00:46:54.889599+0000","last_active":"2024-09-12T01:07:15.131566+0000","last_peered":"2024-09-12T01:07:15.131566+0000","last_clean":"2024-09-12T01:07:15.131566+0000","last_became_active":"2024-09-12T00:46:54.889349+0000","last_became_peered":"2024-09-12T00:46:54.889349+0000","last_unstale":"2024-09-12T01:07:15.131566+0000","last_undegraded":"2024-09-12T01:07:15.131566+0000","last_fullsized":"2024-09-12T01:07:15.131566+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:02.442642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.130933+0000","last_change":"2024-09-12T00:30:17.760081+0000","last_active":"2024-09-12T01:07:10.130933+0000","last_peered":"2024-09-12T01:07:10.130933+0000","last_clean":"2024-09-12T01:07:10.130933+0000","last_became_active":"2024-09-12T00:30:17.759769+0000","last_became_peered":"2024-09-12T00:30:17.759769+0000","last_unstale":"2024-09-12T01:07:10.130933+0000","last_undegraded":"2024-09-12T01:07:10.130933+0000","last_fullsized":"2024-09-12T01:07:10.130933+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:22.158179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.036968+0000","last_change":"2024-09-12T00:30:14.748668+0000","last_active":"2024-09-12T01:07:08.036968+0000","last_peered":"2024-09-12T01:07:08.036968+0000","last_clean":"2024-09-12T01:07:08.036968+0000","last_became_active":"2024-09-12T00:30:14.748409+0000","last_became_peered":"2024-09-12T00:30:14.748409+0000","last_unstale":"2024-09-12T01:07:08.036968+0000","last_undegraded":"2024-09-12T01:07:08.036968+0000","last_fullsized":"2024-09-12T01:07:08.036968+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:15.762806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'24","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.128541+0000","last_change":"2024-09-12T00:27:42.844619+0000","last_active":"2024-09-12T01:06:50.128541+0000","last_peered":"2024-09-12T01:06:50.128541+0000","last_clean":"2024-09-12T01:06:50.128541+0000","last_became_active":"2024-09-12T00:27:42.844338+0000","last_became_peered":"2024-09-12T00:27:42.844338+0000","last_unstale":"2024-09-12T01:06:50.128541+0000","last_undegraded":"2024-09-12T01:06:50.128541+0000","last_fullsized":"2024-09-12T01:06:50.128541+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:10.822999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":85,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.024797+0000","last_change":"2024-09-12T00:46:54.890993+0000","last_active":"2024-09-12T01:07:10.024797+0000","last_peered":"2024-09-12T01:07:10.024797+0000","last_clean":"2024-09-12T01:07:10.024797+0000","last_became_active":"2024-09-12T00:46:54.890636+0000","last_became_peered":"2024-09-12T00:46:54.890636+0000","last_unstale":"2024-09-12T01:07:10.024797+0000","last_undegraded":"2024-09-12T01:07:10.024797+0000","last_fullsized":"2024-09-12T01:07:10.024797+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:05.237293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.169493+0000","last_change":"2024-09-12T00:30:17.762552+0000","last_active":"2024-09-12T01:08:35.169493+0000","last_peered":"2024-09-12T01:08:35.169493+0000","last_clean":"2024-09-12T01:08:35.169493+0000","last_became_active":"2024-09-12T00:30:17.762239+0000","last_became_peered":"2024-09-12T00:30:17.762239+0000","last_unstale":"2024-09-12T01:08:35.169493+0000","last_undegraded":"2024-09-12T01:08:35.169493+0000","last_fullsized":"2024-09-12T01:08:35.169493+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:41.552516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'11","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.552613+0000","last_change":"2024-09-12T00:30:14.751029+0000","last_active":"2024-09-12T01:10:58.552613+0000","last_peered":"2024-09-12T01:10:58.552613+0000","last_clean":"2024-09-12T01:10:58.552613+0000","last_became_active":"2024-09-12T00:30:14.750745+0000","last_became_peered":"2024-09-12T00:30:14.750745+0000","last_unstale":"2024-09-12T01:10:58.552613+0000","last_undegraded":"2024-09-12T01:10:58.552613+0000","last_fullsized":"2024-09-12T01:10:58.552613+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:09.884275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12861,"num_write":16,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":83,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:43.033206+0000","last_change":"2024-09-12T00:27:42.837910+0000","last_active":"2024-09-12T01:06:43.033206+0000","last_peered":"2024-09-12T01:06:43.033206+0000","last_clean":"2024-09-12T01:06:43.033206+0000","last_became_active":"2024-09-12T00:27:42.837690+0000","last_became_peered":"2024-09-12T00:27:42.837690+0000","last_unstale":"2024-09-12T01:06:43.033206+0000","last_undegraded":"2024-09-12T01:06:43.033206+0000","last_fullsized":"2024-09-12T01:06:43.033206+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:00.171095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.038780+0000","last_change":"2024-09-12T00:46:54.885537+0000","last_active":"2024-09-12T01:07:10.038780+0000","last_peered":"2024-09-12T01:07:10.038780+0000","last_clean":"2024-09-12T01:07:10.038780+0000","last_became_active":"2024-09-12T00:46:54.885262+0000","last_became_peered":"2024-09-12T00:46:54.885262+0000","last_unstale":"2024-09-12T01:07:10.038780+0000","last_undegraded":"2024-09-12T01:07:10.038780+0000","last_fullsized":"2024-09-12T01:07:10.038780+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:34.916083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'7","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.026327+0000","last_change":"2024-09-12T00:30:17.761394+0000","last_active":"2024-09-12T01:07:25.026327+0000","last_peered":"2024-09-12T01:07:25.026327+0000","last_clean":"2024-09-12T01:07:25.026327+0000","last_became_active":"2024-09-12T00:30:17.761071+0000","last_became_peered":"2024-09-12T00:30:17.761071+0000","last_unstale":"2024-09-12T01:07:25.026327+0000","last_undegraded":"2024-09-12T01:07:25.026327+0000","last_fullsized":"2024-09-12T01:07:25.026327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:56.989395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.046932+0000","last_change":"2024-09-12T00:30:14.750202+0000","last_active":"2024-09-12T01:08:30.046932+0000","last_peered":"2024-09-12T01:08:30.046932+0000","last_clean":"2024-09-12T01:08:30.046932+0000","last_became_active":"2024-09-12T00:30:14.749906+0000","last_became_peered":"2024-09-12T00:30:14.749906+0000","last_unstale":"2024-09-12T01:08:30.046932+0000","last_undegraded":"2024-09-12T01:08:30.046932+0000","last_fullsized":"2024-09-12T01:08:30.046932+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:25.050487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'11","reported_seq":80,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.022023+0000","last_change":"2024-09-12T00:27:42.837136+0000","last_active":"2024-09-12T01:06:45.022023+0000","last_peered":"2024-09-12T01:06:45.022023+0000","last_clean":"2024-09-12T01:06:45.022023+0000","last_became_active":"2024-09-12T00:27:42.836870+0000","last_became_peered":"2024-09-12T00:27:42.836870+0000","last_unstale":"2024-09-12T01:06:45.022023+0000","last_undegraded":"2024-09-12T01:06:45.022023+0000","last_fullsized":"2024-09-12T01:06:45.022023+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:28.106493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.028516+0000","last_change":"2024-09-12T00:46:54.891625+0000","last_active":"2024-09-12T01:07:45.028516+0000","last_peered":"2024-09-12T01:07:45.028516+0000","last_clean":"2024-09-12T01:07:45.028516+0000","last_became_active":"2024-09-12T00:46:54.891359+0000","last_became_peered":"2024-09-12T00:46:54.891359+0000","last_unstale":"2024-09-12T01:07:45.028516+0000","last_undegraded":"2024-09-12T01:07:45.028516+0000","last_fullsized":"2024-09-12T01:07:45.028516+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:36.674826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.044429+0000","last_change":"2024-09-12T00:30:17.767137+0000","last_active":"2024-09-12T01:07:58.044429+0000","last_peered":"2024-09-12T01:07:58.044429+0000","last_clean":"2024-09-12T01:07:58.044429+0000","last_became_active":"2024-09-12T00:30:17.766810+0000","last_became_peered":"2024-09-12T00:30:17.766810+0000","last_unstale":"2024-09-12T01:07:58.044429+0000","last_undegraded":"2024-09-12T01:07:58.044429+0000","last_fullsized":"2024-09-12T01:07:58.044429+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:50.589394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041701+0000","last_change":"2024-09-12T00:30:14.744674+0000","last_active":"2024-09-12T01:07:45.041701+0000","last_peered":"2024-09-12T01:07:45.041701+0000","last_clean":"2024-09-12T01:07:45.041701+0000","last_became_active":"2024-09-12T00:30:14.744334+0000","last_became_peered":"2024-09-12T00:30:14.744334+0000","last_unstale":"2024-09-12T01:07:45.041701+0000","last_undegraded":"2024-09-12T01:07:45.041701+0000","last_fullsized":"2024-09-12T01:07:45.041701+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:58.360546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":167,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.034356+0000","last_change":"2024-09-12T00:27:42.836761+0000","last_active":"2024-09-12T01:06:45.034356+0000","last_peered":"2024-09-12T01:06:45.034356+0000","last_clean":"2024-09-12T01:06:45.034356+0000","last_became_active":"2024-09-12T00:27:42.836468+0000","last_became_peered":"2024-09-12T00:27:42.836468+0000","last_unstale":"2024-09-12T01:06:45.034356+0000","last_undegraded":"2024-09-12T01:06:45.034356+0000","last_fullsized":"2024-09-12T01:06:45.034356+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:01.432222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":155,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.028541+0000","last_change":"2024-09-12T00:46:54.888800+0000","last_active":"2024-09-12T01:07:45.028541+0000","last_peered":"2024-09-12T01:07:45.028541+0000","last_clean":"2024-09-12T01:07:45.028541+0000","last_became_active":"2024-09-12T00:46:54.888533+0000","last_became_peered":"2024-09-12T00:46:54.888533+0000","last_unstale":"2024-09-12T01:07:45.028541+0000","last_undegraded":"2024-09-12T01:07:45.028541+0000","last_fullsized":"2024-09-12T01:07:45.028541+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:16.016312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'3","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042911+0000","last_change":"2024-09-12T00:30:17.766100+0000","last_active":"2024-09-12T01:07:48.042911+0000","last_peered":"2024-09-12T01:07:48.042911+0000","last_clean":"2024-09-12T01:07:48.042911+0000","last_became_active":"2024-09-12T00:30:17.764747+0000","last_became_peered":"2024-09-12T00:30:17.764747+0000","last_unstale":"2024-09-12T01:07:48.042911+0000","last_undegraded":"2024-09-12T01:07:48.042911+0000","last_fullsized":"2024-09-12T01:07:48.042911+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:28.017911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045464+0000","last_change":"2024-09-12T00:30:14.750085+0000","last_active":"2024-09-12T01:07:50.045464+0000","last_peered":"2024-09-12T01:07:50.045464+0000","last_clean":"2024-09-12T01:07:50.045464+0000","last_became_active":"2024-09-12T00:30:14.749668+0000","last_became_peered":"2024-09-12T00:30:14.749668+0000","last_unstale":"2024-09-12T01:07:50.045464+0000","last_undegraded":"2024-09-12T01:07:50.045464+0000","last_fullsized":"2024-09-12T01:07:50.045464+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:46.909054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'44","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.034744+0000","last_change":"2024-09-12T00:27:42.846229+0000","last_active":"2024-09-12T01:06:45.034744+0000","last_peered":"2024-09-12T01:06:45.034744+0000","last_clean":"2024-09-12T01:06:45.034744+0000","last_became_active":"2024-09-12T00:27:42.845963+0000","last_became_peered":"2024-09-12T00:27:42.845963+0000","last_unstale":"2024-09-12T01:06:45.034744+0000","last_undegraded":"2024-09-12T01:06:45.034744+0000","last_fullsized":"2024-09-12T01:06:45.034744+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:39.746358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":173,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:03.036079+0000","last_change":"2024-09-12T00:46:54.885230+0000","last_active":"2024-09-12T01:07:03.036079+0000","last_peered":"2024-09-12T01:07:03.036079+0000","last_clean":"2024-09-12T01:07:03.036079+0000","last_became_active":"2024-09-12T00:46:54.884950+0000","last_became_peered":"2024-09-12T00:46:54.884950+0000","last_unstale":"2024-09-12T01:07:03.036079+0000","last_undegraded":"2024-09-12T01:07:03.036079+0000","last_fullsized":"2024-09-12T01:07:03.036079+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:05.858636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.039122+0000","last_change":"2024-09-12T00:30:17.762675+0000","last_active":"2024-09-12T01:09:20.039122+0000","last_peered":"2024-09-12T01:09:20.039122+0000","last_clean":"2024-09-12T01:09:20.039122+0000","last_became_active":"2024-09-12T00:30:17.762415+0000","last_became_peered":"2024-09-12T00:30:17.762415+0000","last_unstale":"2024-09-12T01:09:20.039122+0000","last_undegraded":"2024-09-12T01:09:20.039122+0000","last_fullsized":"2024-09-12T01:09:20.039122+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:08.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.145112+0000","last_change":"2024-09-12T00:30:14.748878+0000","last_active":"2024-09-12T01:09:15.145112+0000","last_peered":"2024-09-12T01:09:15.145112+0000","last_clean":"2024-09-12T01:09:15.145112+0000","last_became_active":"2024-09-12T00:30:14.748581+0000","last_became_peered":"2024-09-12T00:30:14.748581+0000","last_unstale":"2024-09-12T01:09:15.145112+0000","last_undegraded":"2024-09-12T01:09:15.145112+0000","last_fullsized":"2024-09-12T01:09:15.145112+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:51.379006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.132599+0000","last_change":"2024-09-12T00:27:42.844241+0000","last_active":"2024-09-12T01:07:25.132599+0000","last_peered":"2024-09-12T01:07:25.132599+0000","last_clean":"2024-09-12T01:07:25.132599+0000","last_became_active":"2024-09-12T00:27:42.843968+0000","last_became_peered":"2024-09-12T00:27:42.843968+0000","last_unstale":"2024-09-12T01:07:25.132599+0000","last_undegraded":"2024-09-12T01:07:25.132599+0000","last_fullsized":"2024-09-12T01:07:25.132599+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:47.646443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":171,"num_write":76,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041617+0000","last_change":"2024-09-12T00:46:54.881183+0000","last_active":"2024-09-12T01:07:45.041617+0000","last_peered":"2024-09-12T01:07:45.041617+0000","last_clean":"2024-09-12T01:07:45.041617+0000","last_became_active":"2024-09-12T00:46:54.880874+0000","last_became_peered":"2024-09-12T00:46:54.880874+0000","last_unstale":"2024-09-12T01:07:45.041617+0000","last_undegraded":"2024-09-12T01:07:45.041617+0000","last_fullsized":"2024-09-12T01:07:45.041617+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:52.663395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.037704+0000","last_change":"2024-09-12T00:30:17.764321+0000","last_active":"2024-09-12T01:07:10.037704+0000","last_peered":"2024-09-12T01:07:10.037704+0000","last_clean":"2024-09-12T01:07:10.037704+0000","last_became_active":"2024-09-12T00:30:17.762807+0000","last_became_peered":"2024-09-12T00:30:17.762807+0000","last_unstale":"2024-09-12T01:07:10.037704+0000","last_undegraded":"2024-09-12T01:07:10.037704+0000","last_fullsized":"2024-09-12T01:07:10.037704+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:22.911043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.052565+0000","last_change":"2024-09-12T00:30:14.750078+0000","last_active":"2024-09-12T01:09:15.052565+0000","last_peered":"2024-09-12T01:09:15.052565+0000","last_clean":"2024-09-12T01:09:15.052565+0000","last_became_active":"2024-09-12T00:30:14.749608+0000","last_became_peered":"2024-09-12T00:30:14.749608+0000","last_unstale":"2024-09-12T01:09:15.052565+0000","last_undegraded":"2024-09-12T01:09:15.052565+0000","last_fullsized":"2024-09-12T01:09:15.052565+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:51.387598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'41","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.040525+0000","last_change":"2024-09-12T00:27:42.846138+0000","last_active":"2024-09-12T01:07:20.040525+0000","last_peered":"2024-09-12T01:07:20.040525+0000","last_clean":"2024-09-12T01:07:20.040525+0000","last_became_active":"2024-09-12T00:27:42.845889+0000","last_became_peered":"2024-09-12T00:27:42.845889+0000","last_unstale":"2024-09-12T01:07:20.040525+0000","last_undegraded":"2024-09-12T01:07:20.040525+0000","last_fullsized":"2024-09-12T01:07:20.040525+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:08.298324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":162,"num_write":61,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052331+0000","last_change":"2024-09-12T00:46:54.887517+0000","last_active":"2024-09-12T01:08:35.052331+0000","last_peered":"2024-09-12T01:08:35.052331+0000","last_clean":"2024-09-12T01:08:35.052331+0000","last_became_active":"2024-09-12T00:46:54.887206+0000","last_became_peered":"2024-09-12T00:46:54.887206+0000","last_unstale":"2024-09-12T01:08:35.052331+0000","last_undegraded":"2024-09-12T01:08:35.052331+0000","last_fullsized":"2024-09-12T01:08:35.052331+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:31.785829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045384+0000","last_change":"2024-09-12T00:30:17.768384+0000","last_active":"2024-09-12T01:07:50.045384+0000","last_peered":"2024-09-12T01:07:50.045384+0000","last_clean":"2024-09-12T01:07:50.045384+0000","last_became_active":"2024-09-12T00:30:17.767990+0000","last_became_peered":"2024-09-12T00:30:17.767990+0000","last_unstale":"2024-09-12T01:07:50.045384+0000","last_undegraded":"2024-09-12T01:07:50.045384+0000","last_fullsized":"2024-09-12T01:07:50.045384+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:34.324472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"263'2","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:20.152715+0000","last_change":"2024-09-12T00:30:14.745501+0000","last_active":"2024-09-12T01:10:20.152715+0000","last_peered":"2024-09-12T01:10:20.152715+0000","last_clean":"2024-09-12T01:10:20.152715+0000","last_became_active":"2024-09-12T00:30:14.745195+0000","last_became_peered":"2024-09-12T00:30:14.745195+0000","last_unstale":"2024-09-12T01:10:20.152715+0000","last_undegraded":"2024-09-12T01:10:20.152715+0000","last_fullsized":"2024-09-12T01:10:20.152715+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:05.190444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'32","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.132064+0000","last_change":"2024-09-12T00:27:42.844201+0000","last_active":"2024-09-12T01:07:20.132064+0000","last_peered":"2024-09-12T01:07:20.132064+0000","last_clean":"2024-09-12T01:07:20.132064+0000","last_became_active":"2024-09-12T00:27:42.843841+0000","last_became_peered":"2024-09-12T00:27:42.843841+0000","last_unstale":"2024-09-12T01:07:20.132064+0000","last_undegraded":"2024-09-12T01:07:20.132064+0000","last_fullsized":"2024-09-12T01:07:20.132064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:33.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":99,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052355+0000","last_change":"2024-09-12T00:46:54.884403+0000","last_active":"2024-09-12T01:08:35.052355+0000","last_peered":"2024-09-12T01:08:35.052355+0000","last_clean":"2024-09-12T01:08:35.052355+0000","last_became_active":"2024-09-12T00:46:54.884110+0000","last_became_peered":"2024-09-12T00:46:54.884110+0000","last_unstale":"2024-09-12T01:08:35.052355+0000","last_undegraded":"2024-09-12T01:08:35.052355+0000","last_fullsized":"2024-09-12T01:08:35.052355+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:54.447390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.724327+0000","last_change":"2024-09-12T00:30:17.763239+0000","last_active":"2024-09-12T01:10:58.724327+0000","last_peered":"2024-09-12T01:10:58.724327+0000","last_clean":"2024-09-12T01:10:58.724327+0000","last_became_active":"2024-09-12T00:30:17.762850+0000","last_became_peered":"2024-09-12T00:30:17.762850+0000","last_unstale":"2024-09-12T01:10:58.724327+0000","last_undegraded":"2024-09-12T01:10:58.724327+0000","last_fullsized":"2024-09-12T01:10:58.724327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:27.977927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'10","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.365202+0000","last_change":"2024-09-12T00:30:14.736582+0000","last_active":"2024-09-12T01:10:58.365202+0000","last_peered":"2024-09-12T01:10:58.365202+0000","last_clean":"2024-09-12T01:10:58.365202+0000","last_became_active":"2024-09-12T00:30:14.736286+0000","last_became_peered":"2024-09-12T00:30:14.736286+0000","last_unstale":"2024-09-12T01:10:58.365202+0000","last_undegraded":"2024-09-12T01:10:58.365202+0000","last_fullsized":"2024-09-12T01:10:58.365202+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:21.074121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":20,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'42","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.038717+0000","last_change":"2024-09-12T00:27:42.842160+0000","last_active":"2024-09-12T01:07:20.038717+0000","last_peered":"2024-09-12T01:07:20.038717+0000","last_clean":"2024-09-12T01:07:20.038717+0000","last_became_active":"2024-09-12T00:27:42.841880+0000","last_became_peered":"2024-09-12T00:27:42.841880+0000","last_unstale":"2024-09-12T01:07:20.038717+0000","last_undegraded":"2024-09-12T01:07:20.038717+0000","last_fullsized":"2024-09-12T01:07:20.038717+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:58.218462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":149,"num_write":77,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042872+0000","last_change":"2024-09-12T00:46:54.887508+0000","last_active":"2024-09-12T01:07:48.042872+0000","last_peered":"2024-09-12T01:07:48.042872+0000","last_clean":"2024-09-12T01:07:48.042872+0000","last_became_active":"2024-09-12T00:46:54.887241+0000","last_became_peered":"2024-09-12T00:46:54.887241+0000","last_unstale":"2024-09-12T01:07:48.042872+0000","last_undegraded":"2024-09-12T01:07:48.042872+0000","last_fullsized":"2024-09-12T01:07:48.042872+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:05.592034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135434+0000","last_change":"2024-09-12T00:30:17.763748+0000","last_active":"2024-09-12T01:07:50.135434+0000","last_peered":"2024-09-12T01:07:50.135434+0000","last_clean":"2024-09-12T01:07:50.135434+0000","last_became_active":"2024-09-12T00:30:17.763434+0000","last_became_peered":"2024-09-12T00:30:17.763434+0000","last_unstale":"2024-09-12T01:07:50.135434+0000","last_undegraded":"2024-09-12T01:07:50.135434+0000","last_fullsized":"2024-09-12T01:07:50.135434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:35.178500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160616+0000","last_change":"2024-09-12T00:30:14.745243+0000","last_active":"2024-09-12T01:07:45.160616+0000","last_peered":"2024-09-12T01:07:45.160616+0000","last_clean":"2024-09-12T01:07:45.160616+0000","last_became_active":"2024-09-12T00:30:14.744954+0000","last_became_peered":"2024-09-12T00:30:14.744954+0000","last_unstale":"2024-09-12T01:07:45.160616+0000","last_undegraded":"2024-09-12T01:07:45.160616+0000","last_fullsized":"2024-09-12T01:07:45.160616+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:54.776721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'51","reported_seq":181,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.038684+0000","last_change":"2024-09-12T00:27:42.843112+0000","last_active":"2024-09-12T01:07:20.038684+0000","last_peered":"2024-09-12T01:07:20.038684+0000","last_clean":"2024-09-12T01:07:20.038684+0000","last_became_active":"2024-09-12T00:27:42.842779+0000","last_became_peered":"2024-09-12T00:27:42.842779+0000","last_unstale":"2024-09-12T01:07:20.038684+0000","last_undegraded":"2024-09-12T01:07:20.038684+0000","last_fullsized":"2024-09-12T01:07:20.038684+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:44.649308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":161,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.042278+0000","last_change":"2024-09-12T00:46:54.882461+0000","last_active":"2024-09-12T01:07:50.042278+0000","last_peered":"2024-09-12T01:07:50.042278+0000","last_clean":"2024-09-12T01:07:50.042278+0000","last_became_active":"2024-09-12T00:46:54.882192+0000","last_became_peered":"2024-09-12T00:46:54.882192+0000","last_unstale":"2024-09-12T01:07:50.042278+0000","last_undegraded":"2024-09-12T01:07:50.042278+0000","last_fullsized":"2024-09-12T01:07:50.042278+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:45.883428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'6","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.604105+0000","last_change":"2024-09-12T00:30:17.758495+0000","last_active":"2024-09-12T01:10:58.604105+0000","last_peered":"2024-09-12T01:10:58.604105+0000","last_clean":"2024-09-12T01:10:58.604105+0000","last_became_active":"2024-09-12T00:30:17.756710+0000","last_became_peered":"2024-09-12T00:30:17.756710+0000","last_unstale":"2024-09-12T01:10:58.604105+0000","last_undegraded":"2024-09-12T01:10:58.604105+0000","last_fullsized":"2024-09-12T01:10:58.604105+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:26.589681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'5","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.239757+0000","last_change":"2024-09-12T00:30:14.749818+0000","last_active":"2024-09-12T01:10:58.239757+0000","last_peered":"2024-09-12T01:10:58.239757+0000","last_clean":"2024-09-12T01:10:58.239757+0000","last_became_active":"2024-09-12T00:30:14.749353+0000","last_became_peered":"2024-09-12T00:30:14.749353+0000","last_unstale":"2024-09-12T01:10:58.239757+0000","last_undegraded":"2024-09-12T01:10:58.239757+0000","last_fullsized":"2024-09-12T01:10:58.239757+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.846302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'16","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135384+0000","last_change":"2024-09-12T00:27:42.846318+0000","last_active":"2024-09-12T01:07:50.135384+0000","last_peered":"2024-09-12T01:07:50.135384+0000","last_clean":"2024-09-12T01:07:50.135384+0000","last_became_active":"2024-09-12T00:27:42.846065+0000","last_became_peered":"2024-09-12T00:27:42.846065+0000","last_unstale":"2024-09-12T01:07:50.135384+0000","last_undegraded":"2024-09-12T01:07:50.135384+0000","last_fullsized":"2024-09-12T01:07:50.135384+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:12.594329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":60,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'365","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.006605+0000","last_change":"2024-09-12T00:12:36.042181+0000","last_active":"2024-09-12T01:11:00.006605+0000","last_peered":"2024-09-12T01:11:00.006605+0000","last_clean":"2024-09-12T01:11:00.006605+0000","last_became_active":"2024-09-12T00:12:36.041803+0000","last_became_peered":"2024-09-12T00:12:36.041803+0000","last_unstale":"2024-09-12T01:11:00.006605+0000","last_undegraded":"2024-09-12T01:11:00.006605+0000","last_fullsized":"2024-09-12T01:11:00.006605+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:47.399756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76046,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":594,"num_read_kb":31202,"num_write":1166,"num_write_kb":36538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'78","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.234258+0000","last_change":"2024-09-12T00:12:38.036843+0000","last_active":"2024-09-12T01:07:40.234258+0000","last_peered":"2024-09-12T01:07:40.234258+0000","last_clean":"2024-09-12T01:07:40.234258+0000","last_became_active":"2024-09-12T00:12:38.035848+0000","last_became_peered":"2024-09-12T00:12:38.035848+0000","last_unstale":"2024-09-12T01:07:40.234258+0000","last_undegraded":"2024-09-12T01:07:40.234258+0000","last_fullsized":"2024-09-12T01:07:40.234258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:27.637600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":321,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'397","reported_seq":1170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.951540+0000","last_change":"2024-09-12T00:12:36.045798+0000","last_active":"2024-09-12T01:10:57.951540+0000","last_peered":"2024-09-12T01:10:57.951540+0000","last_clean":"2024-09-12T01:10:57.951540+0000","last_became_active":"2024-09-12T00:12:36.045325+0000","last_became_peered":"2024-09-12T00:12:36.045325+0000","last_unstale":"2024-09-12T01:10:57.951540+0000","last_undegraded":"2024-09-12T01:10:57.951540+0000","last_fullsized":"2024-09-12T01:10:57.951540+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:52.983449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12805006,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":973,"num_read_kb":48846,"num_write":1357,"num_write_kb":45958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'64","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.041016+0000","last_change":"2024-09-12T00:12:38.041199+0000","last_active":"2024-09-12T01:07:40.041016+0000","last_peered":"2024-09-12T01:07:40.041016+0000","last_clean":"2024-09-12T01:07:40.041016+0000","last_became_active":"2024-09-12T00:12:38.040122+0000","last_became_peered":"2024-09-12T00:12:38.040122+0000","last_unstale":"2024-09-12T01:07:40.041016+0000","last_undegraded":"2024-09-12T01:07:40.041016+0000","last_fullsized":"2024-09-12T01:07:40.041016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:46.078316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":259,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'270","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.932852+0000","last_change":"2024-09-12T00:12:36.040486+0000","last_active":"2024-09-12T01:10:57.932852+0000","last_peered":"2024-09-12T01:10:57.932852+0000","last_clean":"2024-09-12T01:10:57.932852+0000","last_became_active":"2024-09-12T00:12:36.039741+0000","last_became_peered":"2024-09-12T00:12:36.039741+0000","last_unstale":"2024-09-12T01:10:57.932852+0000","last_undegraded":"2024-09-12T01:10:57.932852+0000","last_fullsized":"2024-09-12T01:10:57.932852+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:20.639041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6701801,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":417,"num_read_kb":26393,"num_write":954,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'307","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.041068+0000","last_change":"2024-09-12T00:12:38.042224+0000","last_active":"2024-09-12T01:07:40.041068+0000","last_peered":"2024-09-12T01:07:40.041068+0000","last_clean":"2024-09-12T01:07:40.041068+0000","last_became_active":"2024-09-12T00:12:38.041795+0000","last_became_peered":"2024-09-12T00:12:38.041795+0000","last_unstale":"2024-09-12T01:07:40.041068+0000","last_undegraded":"2024-09-12T01:07:40.041068+0000","last_fullsized":"2024-09-12T01:07:40.041068+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:58.089809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1291,"num_read_kb":1053,"num_write":447,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'401","reported_seq":1049,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.113307+0000","last_change":"2024-09-12T00:12:36.037299+0000","last_active":"2024-09-12T01:11:00.113307+0000","last_peered":"2024-09-12T01:11:00.113307+0000","last_clean":"2024-09-12T01:11:00.113307+0000","last_became_active":"2024-09-12T00:12:36.036970+0000","last_became_peered":"2024-09-12T00:12:36.036970+0000","last_unstale":"2024-09-12T01:11:00.113307+0000","last_undegraded":"2024-09-12T01:11:00.113307+0000","last_fullsized":"2024-09-12T01:11:00.113307+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:48.587739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":561,"num_read_kb":29211,"num_write":1248,"num_write_kb":52081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'61","reported_seq":601,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043790+0000","last_change":"2024-09-12T00:12:38.039591+0000","last_active":"2024-09-12T01:07:40.043790+0000","last_peered":"2024-09-12T01:07:40.043790+0000","last_clean":"2024-09-12T01:07:40.043790+0000","last_became_active":"2024-09-12T00:12:38.039292+0000","last_became_peered":"2024-09-12T00:12:38.039292+0000","last_unstale":"2024-09-12T01:07:40.043790+0000","last_undegraded":"2024-09-12T01:07:40.043790+0000","last_fullsized":"2024-09-12T01:07:40.043790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:31.375488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":95,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'333","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.993462+0000","last_change":"2024-09-12T00:12:36.046560+0000","last_active":"2024-09-12T01:10:59.993462+0000","last_peered":"2024-09-12T01:10:59.993462+0000","last_clean":"2024-09-12T01:10:59.993462+0000","last_became_active":"2024-09-12T00:12:36.044021+0000","last_became_peered":"2024-09-12T00:12:36.044021+0000","last_unstale":"2024-09-12T01:10:59.993462+0000","last_undegraded":"2024-09-12T01:10:59.993462+0000","last_fullsized":"2024-09-12T01:10:59.993462+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:49.437691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1754881,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":448,"num_read_kb":19079,"num_write":998,"num_write_kb":26981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'446","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.036112+0000","last_change":"2024-09-12T00:12:38.037277+0000","last_active":"2024-09-12T01:08:55.036112+0000","last_peered":"2024-09-12T01:08:55.036112+0000","last_clean":"2024-09-12T01:08:55.036112+0000","last_became_active":"2024-09-12T00:12:38.037000+0000","last_became_peered":"2024-09-12T00:12:38.037000+0000","last_unstale":"2024-09-12T01:08:55.036112+0000","last_undegraded":"2024-09-12T01:08:55.036112+0000","last_fullsized":"2024-09-12T01:08:55.036112+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:52.457342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1930,"num_read_kb":1543,"num_write":735,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'367","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.037379+0000","last_change":"2024-09-12T00:12:36.038559+0000","last_active":"2024-09-12T01:11:00.037379+0000","last_peered":"2024-09-12T01:11:00.037379+0000","last_clean":"2024-09-12T01:11:00.037379+0000","last_became_active":"2024-09-12T00:12:36.038235+0000","last_became_peered":"2024-09-12T00:12:36.038235+0000","last_unstale":"2024-09-12T01:11:00.037379+0000","last_undegraded":"2024-09-12T01:11:00.037379+0000","last_fullsized":"2024-09-12T01:11:00.037379+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:13.516943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364679,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":627,"num_read_kb":9962,"num_write":1246,"num_write_kb":25658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'300","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.036158+0000","last_change":"2024-09-12T00:12:38.045583+0000","last_active":"2024-09-12T01:08:55.036158+0000","last_peered":"2024-09-12T01:08:55.036158+0000","last_clean":"2024-09-12T01:08:55.036158+0000","last_became_active":"2024-09-12T00:12:38.045308+0000","last_became_peered":"2024-09-12T00:12:38.045308+0000","last_unstale":"2024-09-12T01:08:55.036158+0000","last_undegraded":"2024-09-12T01:08:55.036158+0000","last_fullsized":"2024-09-12T01:08:55.036158+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:38.191795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1317,"num_read_kb":1075,"num_write":482,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'320","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.903505+0000","last_change":"2024-09-12T00:12:36.042085+0000","last_active":"2024-09-12T01:10:59.903505+0000","last_peered":"2024-09-12T01:10:59.903505+0000","last_clean":"2024-09-12T01:10:59.903505+0000","last_became_active":"2024-09-12T00:12:36.041698+0000","last_became_peered":"2024-09-12T00:12:36.041698+0000","last_unstale":"2024-09-12T01:10:59.903505+0000","last_undegraded":"2024-09-12T01:10:59.903505+0000","last_fullsized":"2024-09-12T01:10:59.903505+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:23.633785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262223,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":472,"num_read_kb":30384,"num_write":1016,"num_write_kb":31492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'492","reported_seq":1253,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.142856+0000","last_change":"2024-09-12T00:12:38.038282+0000","last_active":"2024-09-12T01:08:55.142856+0000","last_peered":"2024-09-12T01:08:55.142856+0000","last_clean":"2024-09-12T01:08:55.142856+0000","last_became_active":"2024-09-12T00:12:38.038023+0000","last_became_peered":"2024-09-12T00:12:38.038023+0000","last_unstale":"2024-09-12T01:08:55.142856+0000","last_undegraded":"2024-09-12T01:08:55.142856+0000","last_fullsized":"2024-09-12T01:08:55.142856+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:15.550968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2347,"num_read_kb":2031,"num_write":873,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'243","reported_seq":880,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:08.064417+0000","last_change":"2024-09-12T00:12:36.050337+0000","last_active":"2024-09-12T01:10:08.064417+0000","last_peered":"2024-09-12T01:10:08.064417+0000","last_clean":"2024-09-12T01:10:08.064417+0000","last_became_active":"2024-09-12T00:12:36.050008+0000","last_became_peered":"2024-09-12T00:12:36.050008+0000","last_unstale":"2024-09-12T01:10:08.064417+0000","last_undegraded":"2024-09-12T01:10:08.064417+0000","last_fullsized":"2024-09-12T01:10:08.064417+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:38.881671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8398716,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":456,"num_read_kb":30850,"num_write":995,"num_write_kb":20572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'204","reported_seq":830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.053105+0000","last_change":"2024-09-12T00:12:38.043322+0000","last_active":"2024-09-12T01:08:53.053105+0000","last_peered":"2024-09-12T01:08:53.053105+0000","last_clean":"2024-09-12T01:08:53.053105+0000","last_became_active":"2024-09-12T00:12:38.043059+0000","last_became_peered":"2024-09-12T00:12:38.043059+0000","last_unstale":"2024-09-12T01:08:53.053105+0000","last_undegraded":"2024-09-12T01:08:53.053105+0000","last_fullsized":"2024-09-12T01:08:53.053105+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:02.061980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":751,"num_write":306,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'111","reported_seq":700,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.047945+0000","last_change":"2024-09-12T00:12:38.040965+0000","last_active":"2024-09-12T01:08:40.047945+0000","last_peered":"2024-09-12T01:08:40.047945+0000","last_clean":"2024-09-12T01:08:40.047945+0000","last_became_active":"2024-09-12T00:12:38.040613+0000","last_became_peered":"2024-09-12T00:12:38.040613+0000","last_unstale":"2024-09-12T01:08:40.047945+0000","last_undegraded":"2024-09-12T01:08:40.047945+0000","last_fullsized":"2024-09-12T01:08:40.047945+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:25.644646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":420,"num_write":176,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'377","reported_seq":1115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.205112+0000","last_change":"2024-09-12T00:12:36.037211+0000","last_active":"2024-09-12T01:11:00.205112+0000","last_peered":"2024-09-12T01:11:00.205112+0000","last_clean":"2024-09-12T01:11:00.205112+0000","last_became_active":"2024-09-12T00:12:36.036905+0000","last_became_peered":"2024-09-12T00:12:36.036905+0000","last_unstale":"2024-09-12T01:11:00.205112+0000","last_undegraded":"2024-09-12T01:11:00.205112+0000","last_fullsized":"2024-09-12T01:11:00.205112+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:21.711720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529645,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":592,"num_read_kb":41745,"num_write":1152,"num_write_kb":45582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'78","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.034481+0000","last_change":"2024-09-12T00:12:38.038756+0000","last_active":"2024-09-12T01:08:40.034481+0000","last_peered":"2024-09-12T01:08:40.034481+0000","last_clean":"2024-09-12T01:08:40.034481+0000","last_became_active":"2024-09-12T00:12:38.038478+0000","last_became_peered":"2024-09-12T00:12:38.038478+0000","last_unstale":"2024-09-12T01:08:40.034481+0000","last_undegraded":"2024-09-12T01:08:40.034481+0000","last_fullsized":"2024-09-12T01:08:40.034481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:35.041048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":318,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'374","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.982189+0000","last_change":"2024-09-12T00:12:36.033187+0000","last_active":"2024-09-12T01:10:59.982189+0000","last_peered":"2024-09-12T01:10:59.982189+0000","last_clean":"2024-09-12T01:10:59.982189+0000","last_became_active":"2024-09-12T00:12:36.032821+0000","last_became_peered":"2024-09-12T00:12:36.032821+0000","last_unstale":"2024-09-12T01:10:59.982189+0000","last_undegraded":"2024-09-12T01:10:59.982189+0000","last_fullsized":"2024-09-12T01:10:59.982189+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:19.055738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3094554,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":511,"num_read_kb":42771,"num_write":1036,"num_write_kb":38443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'199","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.226253+0000","last_change":"2024-09-12T00:12:38.044432+0000","last_active":"2024-09-12T01:06:25.226253+0000","last_peered":"2024-09-12T01:06:25.226253+0000","last_clean":"2024-09-12T01:06:25.226253+0000","last_became_active":"2024-09-12T00:12:38.044169+0000","last_became_peered":"2024-09-12T00:12:38.044169+0000","last_unstale":"2024-09-12T01:06:25.226253+0000","last_undegraded":"2024-09-12T01:06:25.226253+0000","last_fullsized":"2024-09-12T01:06:25.226253+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:46.038643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":679,"num_write":307,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'327","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.045387+0000","last_change":"2024-09-12T00:12:36.037534+0000","last_active":"2024-09-12T01:11:00.045387+0000","last_peered":"2024-09-12T01:11:00.045387+0000","last_clean":"2024-09-12T01:11:00.045387+0000","last_became_active":"2024-09-12T00:12:36.037200+0000","last_became_peered":"2024-09-12T00:12:36.037200+0000","last_unstale":"2024-09-12T01:11:00.045387+0000","last_undegraded":"2024-09-12T01:11:00.045387+0000","last_fullsized":"2024-09-12T01:11:00.045387+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:52.993855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":547142,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":499,"num_read_kb":1481,"num_write":1066,"num_write_kb":18199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'162","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165122+0000","last_change":"2024-09-12T00:12:38.045098+0000","last_active":"2024-09-12T01:08:15.165122+0000","last_peered":"2024-09-12T01:08:15.165122+0000","last_clean":"2024-09-12T01:08:15.165122+0000","last_became_active":"2024-09-12T00:12:38.044089+0000","last_became_peered":"2024-09-12T00:12:38.044089+0000","last_unstale":"2024-09-12T01:08:15.165122+0000","last_undegraded":"2024-09-12T01:08:15.165122+0000","last_fullsized":"2024-09-12T01:08:15.165122+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:41.312963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":583,"num_write":265,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'350","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.044981+0000","last_change":"2024-09-12T00:12:36.029615+0000","last_active":"2024-09-12T01:11:00.044981+0000","last_peered":"2024-09-12T01:11:00.044981+0000","last_clean":"2024-09-12T01:11:00.044981+0000","last_became_active":"2024-09-12T00:12:36.029286+0000","last_became_peered":"2024-09-12T00:12:36.029286+0000","last_unstale":"2024-09-12T01:11:00.044981+0000","last_undegraded":"2024-09-12T01:11:00.044981+0000","last_fullsized":"2024-09-12T01:11:00.044981+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:36.388912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3807091,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":467,"num_read_kb":28445,"num_write":1047,"num_write_kb":34038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'237","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.046795+0000","last_change":"2024-09-12T00:12:38.042662+0000","last_active":"2024-09-12T01:08:13.046795+0000","last_peered":"2024-09-12T01:08:13.046795+0000","last_clean":"2024-09-12T01:08:13.046795+0000","last_became_active":"2024-09-12T00:12:38.042387+0000","last_became_peered":"2024-09-12T00:12:38.042387+0000","last_unstale":"2024-09-12T01:08:13.046795+0000","last_undegraded":"2024-09-12T01:08:13.046795+0000","last_fullsized":"2024-09-12T01:08:13.046795+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:52.954165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1130,"num_read_kb":955,"num_write":386,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'347","reported_seq":1019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.149760+0000","last_change":"2024-09-12T00:12:36.035258+0000","last_active":"2024-09-12T01:11:00.149760+0000","last_peered":"2024-09-12T01:11:00.149760+0000","last_clean":"2024-09-12T01:11:00.149760+0000","last_became_active":"2024-09-12T00:12:36.034811+0000","last_became_peered":"2024-09-12T00:12:36.034811+0000","last_unstale":"2024-09-12T01:11:00.149760+0000","last_undegraded":"2024-09-12T01:11:00.149760+0000","last_fullsized":"2024-09-12T01:11:00.149760+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:17.351084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196380,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":599,"num_read_kb":22753,"num_write":1115,"num_write_kb":14938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'112","reported_seq":703,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:39.935379+0000","last_change":"2024-09-12T00:12:38.036179+0000","last_active":"2024-09-12T01:08:39.935379+0000","last_peered":"2024-09-12T01:08:39.935379+0000","last_clean":"2024-09-12T01:08:39.935379+0000","last_became_active":"2024-09-12T00:12:38.035835+0000","last_became_peered":"2024-09-12T00:12:38.035835+0000","last_unstale":"2024-09-12T01:08:39.935379+0000","last_undegraded":"2024-09-12T01:08:39.935379+0000","last_fullsized":"2024-09-12T01:08:39.935379+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:40.642378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":399,"num_write":174,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'328","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.013802+0000","last_change":"2024-09-12T00:12:36.036412+0000","last_active":"2024-09-12T01:11:00.013802+0000","last_peered":"2024-09-12T01:11:00.013802+0000","last_clean":"2024-09-12T01:11:00.013802+0000","last_became_active":"2024-09-12T00:12:36.036060+0000","last_became_peered":"2024-09-12T00:12:36.036060+0000","last_unstale":"2024-09-12T01:11:00.013802+0000","last_undegraded":"2024-09-12T01:11:00.013802+0000","last_fullsized":"2024-09-12T01:11:00.013802+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:28.300988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568184,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":547,"num_read_kb":15680,"num_write":1014,"num_write_kb":17630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'129","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.436476+0000","last_change":"2024-09-12T00:12:46.059495+0000","last_active":"2024-09-12T01:09:23.436476+0000","last_peered":"2024-09-12T01:09:23.436476+0000","last_clean":"2024-09-12T01:09:23.436476+0000","last_became_active":"2024-09-12T00:12:46.059203+0000","last_became_peered":"2024-09-12T00:12:46.059203+0000","last_unstale":"2024-09-12T01:09:23.436476+0000","last_undegraded":"2024-09-12T01:09:23.436476+0000","last_fullsized":"2024-09-12T01:09:23.436476+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:04.594775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":135,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'77","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.040701+0000","last_change":"2024-09-12T00:12:38.043406+0000","last_active":"2024-09-12T01:07:35.040701+0000","last_peered":"2024-09-12T01:07:35.040701+0000","last_clean":"2024-09-12T01:07:35.040701+0000","last_became_active":"2024-09-12T00:12:38.041964+0000","last_became_peered":"2024-09-12T00:12:38.041964+0000","last_unstale":"2024-09-12T01:07:35.040701+0000","last_undegraded":"2024-09-12T01:07:35.040701+0000","last_fullsized":"2024-09-12T01:07:35.040701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:09.254764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":305,"num_read_kb":247,"num_write":113,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'351","reported_seq":1199,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.058012+0000","last_change":"2024-09-12T00:12:36.034053+0000","last_active":"2024-09-12T01:11:00.058012+0000","last_peered":"2024-09-12T01:11:00.058012+0000","last_clean":"2024-09-12T01:11:00.058012+0000","last_became_active":"2024-09-12T00:12:36.033666+0000","last_became_peered":"2024-09-12T00:12:36.033666+0000","last_unstale":"2024-09-12T01:11:00.058012+0000","last_undegraded":"2024-09-12T01:11:00.058012+0000","last_fullsized":"2024-09-12T01:11:00.058012+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:42.337722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3068587,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":956,"num_read_kb":16942,"num_write":1183,"num_write_kb":38560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045191+0000","last_change":"2024-09-12T00:12:40.043098+0000","last_active":"2024-09-12T01:08:15.045191+0000","last_peered":"2024-09-12T01:08:15.045191+0000","last_clean":"2024-09-12T01:08:15.045191+0000","last_became_active":"2024-09-12T00:12:40.042778+0000","last_became_peered":"2024-09-12T00:12:40.042778+0000","last_unstale":"2024-09-12T01:08:15.045191+0000","last_undegraded":"2024-09-12T01:08:15.045191+0000","last_fullsized":"2024-09-12T01:08:15.045191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:24.903477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'345","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.811165+0000","last_change":"2024-09-12T00:12:42.041284+0000","last_active":"2024-09-12T01:10:59.811165+0000","last_peered":"2024-09-12T01:10:59.811165+0000","last_clean":"2024-09-12T01:10:59.811165+0000","last_became_active":"2024-09-12T00:12:42.040764+0000","last_became_peered":"2024-09-12T00:12:42.040764+0000","last_unstale":"2024-09-12T01:10:59.811165+0000","last_undegraded":"2024-09-12T01:10:59.811165+0000","last_fullsized":"2024-09-12T01:10:59.811165+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:17.910880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46776,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":561,"num_read_kb":1150,"num_write":442,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.238599+0000","last_change":"2024-09-12T00:12:44.055832+0000","last_active":"2024-09-12T01:08:20.238599+0000","last_peered":"2024-09-12T01:08:20.238599+0000","last_clean":"2024-09-12T01:08:20.238599+0000","last_became_active":"2024-09-12T00:12:44.055504+0000","last_became_peered":"2024-09-12T00:12:44.055504+0000","last_unstale":"2024-09-12T01:08:20.238599+0000","last_undegraded":"2024-09-12T01:08:20.238599+0000","last_fullsized":"2024-09-12T01:08:20.238599+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:45.759712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'168","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.825669+0000","last_change":"2024-09-12T00:12:46.065977+0000","last_active":"2024-09-12T01:08:55.825669+0000","last_peered":"2024-09-12T01:08:55.825669+0000","last_clean":"2024-09-12T01:08:55.825669+0000","last_became_active":"2024-09-12T00:12:46.065664+0000","last_became_peered":"2024-09-12T00:12:46.065664+0000","last_unstale":"2024-09-12T01:08:55.825669+0000","last_undegraded":"2024-09-12T01:08:55.825669+0000","last_fullsized":"2024-09-12T01:08:55.825669+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:46.395099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":198,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'177","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045160+0000","last_change":"2024-09-12T00:12:38.042600+0000","last_active":"2024-09-12T01:08:15.045160+0000","last_peered":"2024-09-12T01:08:15.045160+0000","last_clean":"2024-09-12T01:08:15.045160+0000","last_became_active":"2024-09-12T00:12:38.041187+0000","last_became_peered":"2024-09-12T00:12:38.041187+0000","last_unstale":"2024-09-12T01:08:15.045160+0000","last_undegraded":"2024-09-12T01:08:15.045160+0000","last_fullsized":"2024-09-12T01:08:15.045160+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:30.414258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":787,"num_read_kb":651,"num_write":272,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'370","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.118069+0000","last_change":"2024-09-12T00:12:36.034110+0000","last_active":"2024-09-12T01:11:00.118069+0000","last_peered":"2024-09-12T01:11:00.118069+0000","last_clean":"2024-09-12T01:11:00.118069+0000","last_became_active":"2024-09-12T00:12:36.033751+0000","last_became_peered":"2024-09-12T00:12:36.033751+0000","last_unstale":"2024-09-12T01:11:00.118069+0000","last_undegraded":"2024-09-12T01:11:00.118069+0000","last_fullsized":"2024-09-12T01:11:00.118069+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:13.850294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254460,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":6771,"num_write":1059,"num_write_kb":22452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.031479+0000","last_change":"2024-09-12T00:12:40.032783+0000","last_active":"2024-09-12T01:06:30.031479+0000","last_peered":"2024-09-12T01:06:30.031479+0000","last_clean":"2024-09-12T01:06:30.031479+0000","last_became_active":"2024-09-12T00:12:40.032489+0000","last_became_peered":"2024-09-12T00:12:40.032489+0000","last_unstale":"2024-09-12T01:06:30.031479+0000","last_undegraded":"2024-09-12T01:06:30.031479+0000","last_fullsized":"2024-09-12T01:06:30.031479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:22.084698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'93","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.815511+0000","last_change":"2024-09-12T00:12:42.046654+0000","last_active":"2024-09-12T01:10:31.815511+0000","last_peered":"2024-09-12T01:10:31.815511+0000","last_clean":"2024-09-12T01:10:31.815511+0000","last_became_active":"2024-09-12T00:12:42.046316+0000","last_became_peered":"2024-09-12T00:12:42.046316+0000","last_unstale":"2024-09-12T01:10:31.815511+0000","last_undegraded":"2024-09-12T01:10:31.815511+0000","last_fullsized":"2024-09-12T01:10:31.815511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:43.446982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":105,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.238553+0000","last_change":"2024-09-12T00:12:44.057706+0000","last_active":"2024-09-12T01:08:20.238553+0000","last_peered":"2024-09-12T01:08:20.238553+0000","last_clean":"2024-09-12T01:08:20.238553+0000","last_became_active":"2024-09-12T00:12:44.057398+0000","last_became_peered":"2024-09-12T00:12:44.057398+0000","last_unstale":"2024-09-12T01:08:20.238553+0000","last_undegraded":"2024-09-12T01:08:20.238553+0000","last_fullsized":"2024-09-12T01:08:20.238553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:05.128485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'136","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:39.937608+0000","last_change":"2024-09-12T00:12:46.061250+0000","last_active":"2024-09-12T01:08:39.937608+0000","last_peered":"2024-09-12T01:08:39.937608+0000","last_clean":"2024-09-12T01:08:39.937608+0000","last_became_active":"2024-09-12T00:12:46.060932+0000","last_became_peered":"2024-09-12T00:12:46.060932+0000","last_unstale":"2024-09-12T01:08:39.937608+0000","last_undegraded":"2024-09-12T01:08:39.937608+0000","last_fullsized":"2024-09-12T01:08:39.937608+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:30.826242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'190","reported_seq":814,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.046842+0000","last_change":"2024-09-12T00:12:38.038566+0000","last_active":"2024-09-12T01:08:13.046842+0000","last_peered":"2024-09-12T01:08:13.046842+0000","last_clean":"2024-09-12T01:08:13.046842+0000","last_became_active":"2024-09-12T00:12:38.038234+0000","last_became_peered":"2024-09-12T00:12:38.038234+0000","last_unstale":"2024-09-12T01:08:13.046842+0000","last_undegraded":"2024-09-12T01:08:13.046842+0000","last_fullsized":"2024-09-12T01:08:13.046842+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:49.369461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":891,"num_read_kb":755,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'338","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.108608+0000","last_change":"2024-09-12T00:13:07.150014+0000","last_active":"2024-09-12T01:11:00.108608+0000","last_peered":"2024-09-12T01:11:00.108608+0000","last_clean":"2024-09-12T01:11:00.108608+0000","last_became_active":"2024-09-12T00:13:07.149671+0000","last_became_peered":"2024-09-12T00:13:07.149671+0000","last_unstale":"2024-09-12T01:11:00.108608+0000","last_undegraded":"2024-09-12T01:11:00.108608+0000","last_fullsized":"2024-09-12T01:11:00.108608+0000","mapping_epoch":40,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:56.523641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":583,"num_read_kb":33322,"num_write":991,"num_write_kb":23312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.049001+0000","last_change":"2024-09-12T00:12:40.037054+0000","last_active":"2024-09-12T01:08:15.049001+0000","last_peered":"2024-09-12T01:08:15.049001+0000","last_clean":"2024-09-12T01:08:15.049001+0000","last_became_active":"2024-09-12T00:12:40.036714+0000","last_became_peered":"2024-09-12T00:12:40.036714+0000","last_unstale":"2024-09-12T01:08:15.049001+0000","last_undegraded":"2024-09-12T01:08:15.049001+0000","last_fullsized":"2024-09-12T01:08:15.049001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:41.522842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'128","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.032412+0000","last_change":"2024-09-12T00:12:42.038292+0000","last_active":"2024-09-12T01:06:35.032412+0000","last_peered":"2024-09-12T01:06:35.032412+0000","last_clean":"2024-09-12T01:06:35.032412+0000","last_became_active":"2024-09-12T00:12:42.037971+0000","last_became_peered":"2024-09-12T00:12:42.037971+0000","last_unstale":"2024-09-12T01:06:35.032412+0000","last_undegraded":"2024-09-12T01:06:35.032412+0000","last_fullsized":"2024-09-12T01:06:35.032412+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:23.076188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":156,"num_read_kb":149,"num_write":106,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'776","reported_seq":2783,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.645137+0000","last_change":"2024-09-12T00:12:44.059925+0000","last_active":"2024-09-12T01:10:59.645137+0000","last_peered":"2024-09-12T01:10:59.645137+0000","last_clean":"2024-09-12T01:10:59.645137+0000","last_became_active":"2024-09-12T00:12:44.059258+0000","last_became_peered":"2024-09-12T00:12:44.059258+0000","last_unstale":"2024-09-12T01:10:59.645137+0000","last_undegraded":"2024-09-12T01:10:59.645137+0000","last_fullsized":"2024-09-12T01:10:59.645137+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:23.120624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'196","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.494669+0000","last_change":"2024-09-12T00:12:46.059926+0000","last_active":"2024-09-12T01:09:23.494669+0000","last_peered":"2024-09-12T01:09:23.494669+0000","last_clean":"2024-09-12T01:09:23.494669+0000","last_became_active":"2024-09-12T00:12:46.059591+0000","last_became_peered":"2024-09-12T00:12:46.059591+0000","last_unstale":"2024-09-12T01:09:23.494669+0000","last_undegraded":"2024-09-12T01:09:23.494669+0000","last_fullsized":"2024-09-12T01:09:23.494669+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:40.868229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":585,"num_read_kb":583,"num_write":433,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'4340","reported_seq":5003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.046880+0000","last_change":"2024-09-12T00:12:38.036026+0000","last_active":"2024-09-12T01:08:13.046880+0000","last_peered":"2024-09-12T01:08:13.046880+0000","last_clean":"2024-09-12T01:08:13.046880+0000","last_became_active":"2024-09-12T00:12:38.035743+0000","last_became_peered":"2024-09-12T00:12:38.035743+0000","last_unstale":"2024-09-12T01:08:13.046880+0000","last_undegraded":"2024-09-12T01:08:13.046880+0000","last_fullsized":"2024-09-12T01:08:13.046880+0000","mapping_epoch":29,"log_start":"263'4300","ondisk_log_start":"263'4300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:55.482084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17417,"num_read_kb":14583,"num_write":6500,"num_write_kb":3272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'359","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.185288+0000","last_change":"2024-09-12T00:12:36.038350+0000","last_active":"2024-09-12T01:11:00.185288+0000","last_peered":"2024-09-12T01:11:00.185288+0000","last_clean":"2024-09-12T01:11:00.185288+0000","last_became_active":"2024-09-12T00:12:36.038014+0000","last_became_peered":"2024-09-12T00:12:36.038014+0000","last_unstale":"2024-09-12T01:11:00.185288+0000","last_undegraded":"2024-09-12T01:11:00.185288+0000","last_fullsized":"2024-09-12T01:11:00.185288+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:25.617148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924421,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":557,"num_read_kb":22312,"num_write":1056,"num_write_kb":43311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045229+0000","last_change":"2024-09-12T00:12:40.041340+0000","last_active":"2024-09-12T01:08:15.045229+0000","last_peered":"2024-09-12T01:08:15.045229+0000","last_clean":"2024-09-12T01:08:15.045229+0000","last_became_active":"2024-09-12T00:12:40.040992+0000","last_became_peered":"2024-09-12T00:12:40.040992+0000","last_unstale":"2024-09-12T01:08:15.045229+0000","last_undegraded":"2024-09-12T01:08:15.045229+0000","last_fullsized":"2024-09-12T01:08:15.045229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:18.861321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'284","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.512418+0000","last_change":"2024-09-12T00:12:42.041347+0000","last_active":"2024-09-12T01:10:59.512418+0000","last_peered":"2024-09-12T01:10:59.512418+0000","last_clean":"2024-09-12T01:10:59.512418+0000","last_became_active":"2024-09-12T00:12:42.041042+0000","last_became_peered":"2024-09-12T00:12:42.041042+0000","last_unstale":"2024-09-12T01:10:59.512418+0000","last_undegraded":"2024-09-12T01:10:59.512418+0000","last_fullsized":"2024-09-12T01:10:59.512418+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:46.437978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63399,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":1076,"num_write":376,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'805","reported_seq":2515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.886558+0000","last_change":"2024-09-12T00:12:44.062745+0000","last_active":"2024-09-12T01:10:57.886558+0000","last_peered":"2024-09-12T01:10:57.886558+0000","last_clean":"2024-09-12T01:10:57.886558+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:10:57.886558+0000","last_undegraded":"2024-09-12T01:10:57.886558+0000","last_fullsized":"2024-09-12T01:10:57.886558+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:30.427552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'191","reported_seq":820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035206+0000","last_change":"2024-09-12T00:12:38.040302+0000","last_active":"2024-09-12T01:06:50.035206+0000","last_peered":"2024-09-12T01:06:50.035206+0000","last_clean":"2024-09-12T01:06:50.035206+0000","last_became_active":"2024-09-12T00:12:38.040030+0000","last_became_peered":"2024-09-12T00:12:38.040030+0000","last_unstale":"2024-09-12T01:06:50.035206+0000","last_undegraded":"2024-09-12T01:06:50.035206+0000","last_fullsized":"2024-09-12T01:06:50.035206+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:17.788252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":682,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'334","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.016598+0000","last_change":"2024-09-12T00:12:36.040947+0000","last_active":"2024-09-12T01:11:00.016598+0000","last_peered":"2024-09-12T01:11:00.016598+0000","last_clean":"2024-09-12T01:11:00.016598+0000","last_became_active":"2024-09-12T00:12:36.040657+0000","last_became_peered":"2024-09-12T00:12:36.040657+0000","last_unstale":"2024-09-12T01:11:00.016598+0000","last_undegraded":"2024-09-12T01:11:00.016598+0000","last_fullsized":"2024-09-12T01:11:00.016598+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:18.229544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2551,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":444,"num_read_kb":5571,"num_write":1107,"num_write_kb":16904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.229029+0000","last_change":"2024-09-12T00:12:40.036607+0000","last_active":"2024-09-12T01:06:50.229029+0000","last_peered":"2024-09-12T01:06:50.229029+0000","last_clean":"2024-09-12T01:06:50.229029+0000","last_became_active":"2024-09-12T00:12:40.036362+0000","last_became_peered":"2024-09-12T00:12:40.036362+0000","last_unstale":"2024-09-12T01:06:50.229029+0000","last_undegraded":"2024-09-12T01:06:50.229029+0000","last_fullsized":"2024-09-12T01:06:50.229029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:43.641028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'347","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.038825+0000","last_change":"2024-09-12T00:12:42.044696+0000","last_active":"2024-09-12T01:11:00.038825+0000","last_peered":"2024-09-12T01:11:00.038825+0000","last_clean":"2024-09-12T01:11:00.038825+0000","last_became_active":"2024-09-12T00:12:42.044418+0000","last_became_peered":"2024-09-12T00:12:42.044418+0000","last_unstale":"2024-09-12T01:11:00.038825+0000","last_undegraded":"2024-09-12T01:11:00.038825+0000","last_fullsized":"2024-09-12T01:11:00.038825+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:13.793410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51451,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":1107,"num_write":436,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.152015+0000","last_change":"2024-09-12T00:12:44.057796+0000","last_active":"2024-09-12T01:06:45.152015+0000","last_peered":"2024-09-12T01:06:45.152015+0000","last_clean":"2024-09-12T01:06:45.152015+0000","last_became_active":"2024-09-12T00:12:44.057438+0000","last_became_peered":"2024-09-12T00:12:44.057438+0000","last_unstale":"2024-09-12T01:06:45.152015+0000","last_undegraded":"2024-09-12T01:06:45.152015+0000","last_fullsized":"2024-09-12T01:06:45.152015+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:56.467860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'557","reported_seq":1367,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.003073+0000","last_change":"2024-09-12T00:12:46.060839+0000","last_active":"2024-09-12T01:10:33.003073+0000","last_peered":"2024-09-12T01:10:33.003073+0000","last_clean":"2024-09-12T01:10:33.003073+0000","last_became_active":"2024-09-12T00:12:46.060552+0000","last_became_peered":"2024-09-12T00:12:46.060552+0000","last_unstale":"2024-09-12T01:10:33.003073+0000","last_undegraded":"2024-09-12T01:10:33.003073+0000","last_fullsized":"2024-09-12T01:10:33.003073+0000","mapping_epoch":37,"log_start":"263'500","ondisk_log_start":"263'500","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:49.354363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1290,"num_read_kb":1284,"num_write":1146,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'240","reported_seq":844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.183059+0000","last_change":"2024-09-12T00:12:38.042271+0000","last_active":"2024-09-12T01:08:32.183059+0000","last_peered":"2024-09-12T01:08:32.183059+0000","last_clean":"2024-09-12T01:08:32.183059+0000","last_became_active":"2024-09-12T00:12:38.041916+0000","last_became_peered":"2024-09-12T00:12:38.041916+0000","last_unstale":"2024-09-12T01:08:32.183059+0000","last_undegraded":"2024-09-12T01:08:32.183059+0000","last_fullsized":"2024-09-12T01:08:32.183059+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:14.378653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1071,"num_read_kb":865,"num_write":389,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'323","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.090107+0000","last_change":"2024-09-12T00:12:36.043410+0000","last_active":"2024-09-12T01:11:00.090107+0000","last_peered":"2024-09-12T01:11:00.090107+0000","last_clean":"2024-09-12T01:11:00.090107+0000","last_became_active":"2024-09-12T00:12:36.042838+0000","last_became_peered":"2024-09-12T00:12:36.042838+0000","last_unstale":"2024-09-12T01:11:00.090107+0000","last_undegraded":"2024-09-12T01:11:00.090107+0000","last_fullsized":"2024-09-12T01:11:00.090107+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:50.068914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":478,"num_read_kb":7238,"num_write":1060,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.152809+0000","last_change":"2024-09-12T00:12:40.042917+0000","last_active":"2024-09-12T01:06:50.152809+0000","last_peered":"2024-09-12T01:06:50.152809+0000","last_clean":"2024-09-12T01:06:50.152809+0000","last_became_active":"2024-09-12T00:12:40.042625+0000","last_became_peered":"2024-09-12T00:12:40.042625+0000","last_unstale":"2024-09-12T01:06:50.152809+0000","last_undegraded":"2024-09-12T01:06:50.152809+0000","last_fullsized":"2024-09-12T01:06:50.152809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:42.496763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'255","reported_seq":831,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.717963+0000","last_change":"2024-09-12T00:12:42.040576+0000","last_active":"2024-09-12T01:10:58.717963+0000","last_peered":"2024-09-12T01:10:58.717963+0000","last_clean":"2024-09-12T01:10:58.717963+0000","last_became_active":"2024-09-12T00:12:42.040266+0000","last_became_peered":"2024-09-12T00:12:42.040266+0000","last_unstale":"2024-09-12T01:10:58.717963+0000","last_undegraded":"2024-09-12T01:10:58.717963+0000","last_fullsized":"2024-09-12T01:10:58.717963+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:24.483433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":965,"num_write":348,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:05.037890+0000","last_change":"2024-09-12T00:12:44.062951+0000","last_active":"2024-09-12T01:07:05.037890+0000","last_peered":"2024-09-12T01:07:05.037890+0000","last_clean":"2024-09-12T01:07:05.037890+0000","last_became_active":"2024-09-12T00:12:44.062608+0000","last_became_peered":"2024-09-12T00:12:44.062608+0000","last_unstale":"2024-09-12T01:07:05.037890+0000","last_undegraded":"2024-09-12T01:07:05.037890+0000","last_fullsized":"2024-09-12T01:07:05.037890+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:39.092545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2412","reported_seq":4250,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.887941+0000","last_change":"2024-09-12T00:12:46.062926+0000","last_active":"2024-09-12T01:10:35.887941+0000","last_peered":"2024-09-12T01:10:35.887941+0000","last_clean":"2024-09-12T01:10:35.887941+0000","last_became_active":"2024-09-12T00:12:46.062624+0000","last_became_peered":"2024-09-12T00:12:46.062624+0000","last_unstale":"2024-09-12T01:10:35.887941+0000","last_undegraded":"2024-09-12T01:10:35.887941+0000","last_fullsized":"2024-09-12T01:10:35.887941+0000","mapping_epoch":37,"log_start":"263'2400","ondisk_log_start":"263'2400","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":2400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:26.452821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":6065,"num_write":4891,"num_write_kb":1799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'224","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.300929+0000","last_change":"2024-09-12T00:12:38.042922+0000","last_active":"2024-09-12T01:08:19.300929+0000","last_peered":"2024-09-12T01:08:19.300929+0000","last_clean":"2024-09-12T01:08:19.300929+0000","last_became_active":"2024-09-12T00:12:38.042657+0000","last_became_peered":"2024-09-12T00:12:38.042657+0000","last_unstale":"2024-09-12T01:08:19.300929+0000","last_undegraded":"2024-09-12T01:08:19.300929+0000","last_fullsized":"2024-09-12T01:08:19.300929+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:37.846035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":947,"num_read_kb":771,"num_write":346,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'371","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.998449+0000","last_change":"2024-09-12T00:12:36.046609+0000","last_active":"2024-09-12T01:10:59.998449+0000","last_peered":"2024-09-12T01:10:59.998449+0000","last_clean":"2024-09-12T01:10:59.998449+0000","last_became_active":"2024-09-12T00:12:36.046196+0000","last_became_peered":"2024-09-12T00:12:36.046196+0000","last_unstale":"2024-09-12T01:10:59.998449+0000","last_undegraded":"2024-09-12T01:10:59.998449+0000","last_fullsized":"2024-09-12T01:10:59.998449+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:49.734531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9648952,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":539,"num_read_kb":69753,"num_write":1198,"num_write_kb":51465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:43.033241+0000","last_change":"2024-09-12T00:12:40.040357+0000","last_active":"2024-09-12T01:06:43.033241+0000","last_peered":"2024-09-12T01:06:43.033241+0000","last_clean":"2024-09-12T01:06:43.033241+0000","last_became_active":"2024-09-12T00:12:40.039887+0000","last_became_peered":"2024-09-12T00:12:40.039887+0000","last_unstale":"2024-09-12T01:06:43.033241+0000","last_undegraded":"2024-09-12T01:06:43.033241+0000","last_fullsized":"2024-09-12T01:06:43.033241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:20.058438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'326","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:32.992566+0000","last_change":"2024-09-12T00:12:42.051353+0000","last_active":"2024-09-12T01:10:32.992566+0000","last_peered":"2024-09-12T01:10:32.992566+0000","last_clean":"2024-09-12T01:10:32.992566+0000","last_became_active":"2024-09-12T00:12:42.051042+0000","last_became_peered":"2024-09-12T00:12:42.051042+0000","last_unstale":"2024-09-12T01:10:32.992566+0000","last_undegraded":"2024-09-12T01:10:32.992566+0000","last_fullsized":"2024-09-12T01:10:32.992566+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:52.667091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60864,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":519,"num_read_kb":1003,"num_write":418,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'805","reported_seq":2511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.887570+0000","last_change":"2024-09-12T00:12:44.057367+0000","last_active":"2024-09-12T01:10:57.887570+0000","last_peered":"2024-09-12T01:10:57.887570+0000","last_clean":"2024-09-12T01:10:57.887570+0000","last_became_active":"2024-09-12T00:12:44.057064+0000","last_became_peered":"2024-09-12T00:12:44.057064+0000","last_unstale":"2024-09-12T01:10:57.887570+0000","last_undegraded":"2024-09-12T01:10:57.887570+0000","last_fullsized":"2024-09-12T01:10:57.887570+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:28.146163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'102","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.693001+0000","last_change":"2024-09-12T00:12:46.059872+0000","last_active":"2024-09-12T01:10:31.693001+0000","last_peered":"2024-09-12T01:10:31.693001+0000","last_clean":"2024-09-12T01:10:31.693001+0000","last_became_active":"2024-09-12T00:12:46.059567+0000","last_became_peered":"2024-09-12T00:12:46.059567+0000","last_unstale":"2024-09-12T01:10:31.693001+0000","last_undegraded":"2024-09-12T01:10:31.693001+0000","last_fullsized":"2024-09-12T01:10:31.693001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:15.879983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":78,"num_write":230,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'198","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:38.032532+0000","last_change":"2024-09-12T00:12:38.040110+0000","last_active":"2024-09-12T01:06:38.032532+0000","last_peered":"2024-09-12T01:06:38.032532+0000","last_clean":"2024-09-12T01:06:38.032532+0000","last_became_active":"2024-09-12T00:12:38.039788+0000","last_became_peered":"2024-09-12T00:12:38.039788+0000","last_unstale":"2024-09-12T01:06:38.032532+0000","last_undegraded":"2024-09-12T01:06:38.032532+0000","last_fullsized":"2024-09-12T01:06:38.032532+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:03.291708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":765,"num_write":285,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'359","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.027091+0000","last_change":"2024-09-12T00:12:36.034612+0000","last_active":"2024-09-12T01:11:00.027091+0000","last_peered":"2024-09-12T01:11:00.027091+0000","last_clean":"2024-09-12T01:11:00.027091+0000","last_became_active":"2024-09-12T00:12:36.034290+0000","last_became_peered":"2024-09-12T00:12:36.034290+0000","last_unstale":"2024-09-12T01:11:00.027091+0000","last_undegraded":"2024-09-12T01:11:00.027091+0000","last_fullsized":"2024-09-12T01:11:00.027091+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:32.222016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6433451,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":526,"num_read_kb":18534,"num_write":1150,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.154250+0000","last_change":"2024-09-12T00:12:40.036885+0000","last_active":"2024-09-12T01:07:00.154250+0000","last_peered":"2024-09-12T01:07:00.154250+0000","last_clean":"2024-09-12T01:07:00.154250+0000","last_became_active":"2024-09-12T00:12:40.036551+0000","last_became_peered":"2024-09-12T00:12:40.036551+0000","last_unstale":"2024-09-12T01:07:00.154250+0000","last_undegraded":"2024-09-12T01:07:00.154250+0000","last_fullsized":"2024-09-12T01:07:00.154250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:09.117904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'515","reported_seq":1159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.102422+0000","last_change":"2024-09-12T00:12:42.041830+0000","last_active":"2024-09-12T01:10:59.102422+0000","last_peered":"2024-09-12T01:10:59.102422+0000","last_clean":"2024-09-12T01:10:59.102422+0000","last_became_active":"2024-09-12T00:12:42.041307+0000","last_became_peered":"2024-09-12T00:12:42.041307+0000","last_unstale":"2024-09-12T01:10:59.102422+0000","last_undegraded":"2024-09-12T01:10:59.102422+0000","last_fullsized":"2024-09-12T01:10:59.102422+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:40.915241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96065,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":906,"num_read_kb":2178,"num_write":748,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:58.035239+0000","last_change":"2024-09-12T00:12:44.049673+0000","last_active":"2024-09-12T01:06:58.035239+0000","last_peered":"2024-09-12T01:06:58.035239+0000","last_clean":"2024-09-12T01:06:58.035239+0000","last_became_active":"2024-09-12T00:12:44.049211+0000","last_became_peered":"2024-09-12T00:12:44.049211+0000","last_unstale":"2024-09-12T01:06:58.035239+0000","last_undegraded":"2024-09-12T01:06:58.035239+0000","last_fullsized":"2024-09-12T01:06:58.035239+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:06.344330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'145","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.046019+0000","last_change":"2024-09-12T00:12:46.066668+0000","last_active":"2024-09-12T01:08:12.046019+0000","last_peered":"2024-09-12T01:08:12.046019+0000","last_clean":"2024-09-12T01:08:12.046019+0000","last_became_active":"2024-09-12T00:12:46.066431+0000","last_became_peered":"2024-09-12T00:12:46.066431+0000","last_unstale":"2024-09-12T01:08:12.046019+0000","last_undegraded":"2024-09-12T01:08:12.046019+0000","last_fullsized":"2024-09-12T01:08:12.046019+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:16.649236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":339,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'119","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.021555+0000","last_change":"2024-09-12T00:12:38.037741+0000","last_active":"2024-09-12T01:06:40.021555+0000","last_peered":"2024-09-12T01:06:40.021555+0000","last_clean":"2024-09-12T01:06:40.021555+0000","last_became_active":"2024-09-12T00:12:38.037464+0000","last_became_peered":"2024-09-12T00:12:38.037464+0000","last_unstale":"2024-09-12T01:06:40.021555+0000","last_undegraded":"2024-09-12T01:06:40.021555+0000","last_fullsized":"2024-09-12T01:06:40.021555+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:07.317139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'322","reported_seq":939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.054336+0000","last_change":"2024-09-12T00:12:36.045431+0000","last_active":"2024-09-12T01:11:00.054336+0000","last_peered":"2024-09-12T01:11:00.054336+0000","last_clean":"2024-09-12T01:11:00.054336+0000","last_became_active":"2024-09-12T00:12:36.045050+0000","last_became_peered":"2024-09-12T00:12:36.045050+0000","last_unstale":"2024-09-12T01:11:00.054336+0000","last_undegraded":"2024-09-12T01:11:00.054336+0000","last_fullsized":"2024-09-12T01:11:00.054336+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:43.812152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4456681,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":476,"num_read_kb":13364,"num_write":1080,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.033417+0000","last_change":"2024-09-12T00:12:40.038347+0000","last_active":"2024-09-12T01:06:40.033417+0000","last_peered":"2024-09-12T01:06:40.033417+0000","last_clean":"2024-09-12T01:06:40.033417+0000","last_became_active":"2024-09-12T00:12:40.038036+0000","last_became_peered":"2024-09-12T00:12:40.038036+0000","last_unstale":"2024-09-12T01:06:40.033417+0000","last_undegraded":"2024-09-12T01:06:40.033417+0000","last_fullsized":"2024-09-12T01:06:40.033417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:56.716723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'297","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.160844+0000","last_change":"2024-09-12T00:12:42.051976+0000","last_active":"2024-09-12T01:10:59.160844+0000","last_peered":"2024-09-12T01:10:59.160844+0000","last_clean":"2024-09-12T01:10:59.160844+0000","last_became_active":"2024-09-12T00:12:42.051668+0000","last_became_peered":"2024-09-12T00:12:42.051668+0000","last_unstale":"2024-09-12T01:10:59.160844+0000","last_undegraded":"2024-09-12T01:10:59.160844+0000","last_fullsized":"2024-09-12T01:10:59.160844+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:48.021906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":1104,"num_write":460,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.036235+0000","last_change":"2024-09-12T00:12:44.062196+0000","last_active":"2024-09-12T01:06:55.036235+0000","last_peered":"2024-09-12T01:06:55.036235+0000","last_clean":"2024-09-12T01:06:55.036235+0000","last_became_active":"2024-09-12T00:12:44.061848+0000","last_became_peered":"2024-09-12T00:12:44.061848+0000","last_unstale":"2024-09-12T01:06:55.036235+0000","last_undegraded":"2024-09-12T01:06:55.036235+0000","last_fullsized":"2024-09-12T01:06:55.036235+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:41.383111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'90","reported_seq":569,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:21.961327+0000","last_change":"2024-09-12T00:12:46.066391+0000","last_active":"2024-09-12T01:10:21.961327+0000","last_peered":"2024-09-12T01:10:21.961327+0000","last_clean":"2024-09-12T01:10:21.961327+0000","last_became_active":"2024-09-12T00:12:46.066121+0000","last_became_peered":"2024-09-12T00:12:46.066121+0000","last_unstale":"2024-09-12T01:10:21.961327+0000","last_undegraded":"2024-09-12T01:10:21.961327+0000","last_fullsized":"2024-09-12T01:10:21.961327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:35.295982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":71,"num_write":206,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'180","reported_seq":761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.034161+0000","last_change":"2024-09-12T00:12:38.046524+0000","last_active":"2024-09-12T01:06:40.034161+0000","last_peered":"2024-09-12T01:06:40.034161+0000","last_clean":"2024-09-12T01:06:40.034161+0000","last_became_active":"2024-09-12T00:12:38.046276+0000","last_became_peered":"2024-09-12T00:12:38.046276+0000","last_unstale":"2024-09-12T01:06:40.034161+0000","last_undegraded":"2024-09-12T01:06:40.034161+0000","last_fullsized":"2024-09-12T01:06:40.034161+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:51.205849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":618,"num_write":256,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'489","reported_seq":1192,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.055230+0000","last_change":"2024-09-12T00:12:36.035888+0000","last_active":"2024-09-12T01:11:00.055230+0000","last_peered":"2024-09-12T01:11:00.055230+0000","last_clean":"2024-09-12T01:11:00.055230+0000","last_became_active":"2024-09-12T00:12:36.035311+0000","last_became_peered":"2024-09-12T00:12:36.035311+0000","last_unstale":"2024-09-12T01:11:00.055230+0000","last_undegraded":"2024-09-12T01:11:00.055230+0000","last_fullsized":"2024-09-12T01:11:00.055230+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:22.262395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048645,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":936,"num_read_kb":11265,"num_write":1467,"num_write_kb":28283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:43.033260+0000","last_change":"2024-09-12T00:12:40.035887+0000","last_active":"2024-09-12T01:06:43.033260+0000","last_peered":"2024-09-12T01:06:43.033260+0000","last_clean":"2024-09-12T01:06:43.033260+0000","last_became_active":"2024-09-12T00:12:40.035585+0000","last_became_peered":"2024-09-12T00:12:40.035585+0000","last_unstale":"2024-09-12T01:06:43.033260+0000","last_undegraded":"2024-09-12T01:06:43.033260+0000","last_fullsized":"2024-09-12T01:06:43.033260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:55.033563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'306","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.001454+0000","last_change":"2024-09-12T00:12:42.052616+0000","last_active":"2024-09-12T01:10:33.001454+0000","last_peered":"2024-09-12T01:10:33.001454+0000","last_clean":"2024-09-12T01:10:33.001454+0000","last_became_active":"2024-09-12T00:12:42.052279+0000","last_became_peered":"2024-09-12T00:12:42.052279+0000","last_unstale":"2024-09-12T01:10:33.001454+0000","last_undegraded":"2024-09-12T01:10:33.001454+0000","last_fullsized":"2024-09-12T01:10:33.001454+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:39.576180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60389,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":500,"num_read_kb":993,"num_write":404,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'772","reported_seq":4973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.881914+0000","last_change":"2024-09-12T00:12:44.060751+0000","last_active":"2024-09-12T01:10:57.881914+0000","last_peered":"2024-09-12T01:10:57.881914+0000","last_clean":"2024-09-12T01:10:57.881914+0000","last_became_active":"2024-09-12T00:12:44.060494+0000","last_became_peered":"2024-09-12T00:12:44.060494+0000","last_unstale":"2024-09-12T01:10:57.881914+0000","last_undegraded":"2024-09-12T01:10:57.881914+0000","last_fullsized":"2024-09-12T01:10:57.881914+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:43.956970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'133","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.942636+0000","last_change":"2024-09-12T00:12:46.060540+0000","last_active":"2024-09-12T01:09:20.942636+0000","last_peered":"2024-09-12T01:09:20.942636+0000","last_clean":"2024-09-12T01:09:20.942636+0000","last_became_active":"2024-09-12T00:12:46.060211+0000","last_became_peered":"2024-09-12T00:12:46.060211+0000","last_unstale":"2024-09-12T01:09:20.942636+0000","last_undegraded":"2024-09-12T01:09:20.942636+0000","last_fullsized":"2024-09-12T01:09:20.942636+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:03.614002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":113,"num_write":319,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'256","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.704664+0000","last_change":"2024-09-12T00:12:38.043160+0000","last_active":"2024-09-12T01:08:36.704664+0000","last_peered":"2024-09-12T01:08:36.704664+0000","last_clean":"2024-09-12T01:08:36.704664+0000","last_became_active":"2024-09-12T00:12:38.042601+0000","last_became_peered":"2024-09-12T00:12:38.042601+0000","last_unstale":"2024-09-12T01:08:36.704664+0000","last_undegraded":"2024-09-12T01:08:36.704664+0000","last_fullsized":"2024-09-12T01:08:36.704664+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:58.848548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1116,"num_read_kb":905,"num_write":388,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'367","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.029268+0000","last_change":"2024-09-12T00:12:36.043748+0000","last_active":"2024-09-12T01:11:00.029268+0000","last_peered":"2024-09-12T01:11:00.029268+0000","last_clean":"2024-09-12T01:11:00.029268+0000","last_became_active":"2024-09-12T00:12:36.043404+0000","last_became_peered":"2024-09-12T00:12:36.043404+0000","last_unstale":"2024-09-12T01:11:00.029268+0000","last_undegraded":"2024-09-12T01:11:00.029268+0000","last_fullsized":"2024-09-12T01:11:00.029268+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:28.818965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432371,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":514,"num_read_kb":34059,"num_write":1157,"num_write_kb":45928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'2","reported_seq":1458,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.863277+0000","last_change":"2024-09-12T00:12:40.035929+0000","last_active":"2024-09-12T01:10:57.863277+0000","last_peered":"2024-09-12T01:10:57.863277+0000","last_clean":"2024-09-12T01:10:57.863277+0000","last_became_active":"2024-09-12T00:12:40.035633+0000","last_became_peered":"2024-09-12T00:12:40.035633+0000","last_unstale":"2024-09-12T01:10:57.863277+0000","last_undegraded":"2024-09-12T01:10:57.863277+0000","last_fullsized":"2024-09-12T01:10:57.863277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:19.957170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'82","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.152071+0000","last_change":"2024-09-12T00:12:42.051649+0000","last_active":"2024-09-12T01:06:45.152071+0000","last_peered":"2024-09-12T01:06:45.152071+0000","last_clean":"2024-09-12T01:06:45.152071+0000","last_became_active":"2024-09-12T00:12:42.051384+0000","last_became_peered":"2024-09-12T00:12:42.051384+0000","last_unstale":"2024-09-12T01:06:45.152071+0000","last_undegraded":"2024-09-12T01:06:45.152071+0000","last_fullsized":"2024-09-12T01:06:45.152071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:53.378146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'777","reported_seq":4087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.883992+0000","last_change":"2024-09-12T00:12:44.062143+0000","last_active":"2024-09-12T01:10:57.883992+0000","last_peered":"2024-09-12T01:10:57.883992+0000","last_clean":"2024-09-12T01:10:57.883992+0000","last_became_active":"2024-09-12T00:12:44.061837+0000","last_became_peered":"2024-09-12T00:12:44.061837+0000","last_unstale":"2024-09-12T01:10:57.883992+0000","last_undegraded":"2024-09-12T01:10:57.883992+0000","last_fullsized":"2024-09-12T01:10:57.883992+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:55.341365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'132","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.359620+0000","last_change":"2024-09-12T00:12:46.059816+0000","last_active":"2024-09-12T01:09:22.359620+0000","last_peered":"2024-09-12T01:09:22.359620+0000","last_clean":"2024-09-12T01:09:22.359620+0000","last_became_active":"2024-09-12T00:12:46.057978+0000","last_became_peered":"2024-09-12T00:12:46.057978+0000","last_unstale":"2024-09-12T01:09:22.359620+0000","last_undegraded":"2024-09-12T01:09:22.359620+0000","last_fullsized":"2024-09-12T01:09:22.359620+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:40.034637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":126,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'235","reported_seq":844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.646426+0000","last_change":"2024-09-12T00:12:38.037321+0000","last_active":"2024-09-12T01:08:55.646426+0000","last_peered":"2024-09-12T01:08:55.646426+0000","last_clean":"2024-09-12T01:08:55.646426+0000","last_became_active":"2024-09-12T00:12:38.037035+0000","last_became_peered":"2024-09-12T00:12:38.037035+0000","last_unstale":"2024-09-12T01:08:55.646426+0000","last_undegraded":"2024-09-12T01:08:55.646426+0000","last_fullsized":"2024-09-12T01:08:55.646426+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:35.492382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":394,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'293","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.927935+0000","last_change":"2024-09-12T00:12:36.029406+0000","last_active":"2024-09-12T01:10:59.927935+0000","last_peered":"2024-09-12T01:10:59.927935+0000","last_clean":"2024-09-12T01:10:59.927935+0000","last_became_active":"2024-09-12T00:12:36.029059+0000","last_became_peered":"2024-09-12T00:12:36.029059+0000","last_unstale":"2024-09-12T01:10:59.927935+0000","last_undegraded":"2024-09-12T01:10:59.927935+0000","last_fullsized":"2024-09-12T01:10:59.927935+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:18.842991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4838175,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":414,"num_read_kb":19038,"num_write":990,"num_write_kb":37710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.034179+0000","last_change":"2024-09-12T00:12:40.042406+0000","last_active":"2024-09-12T01:06:40.034179+0000","last_peered":"2024-09-12T01:06:40.034179+0000","last_clean":"2024-09-12T01:06:40.034179+0000","last_became_active":"2024-09-12T00:12:40.042158+0000","last_became_peered":"2024-09-12T00:12:40.042158+0000","last_unstale":"2024-09-12T01:06:40.034179+0000","last_undegraded":"2024-09-12T01:06:40.034179+0000","last_fullsized":"2024-09-12T01:06:40.034179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:16.795550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'350","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.868328+0000","last_change":"2024-09-12T00:12:42.049042+0000","last_active":"2024-09-12T01:10:59.868328+0000","last_peered":"2024-09-12T01:10:59.868328+0000","last_clean":"2024-09-12T01:10:59.868328+0000","last_became_active":"2024-09-12T00:12:42.048747+0000","last_became_peered":"2024-09-12T00:12:42.048747+0000","last_unstale":"2024-09-12T01:10:59.868328+0000","last_undegraded":"2024-09-12T01:10:59.868328+0000","last_fullsized":"2024-09-12T01:10:59.868328+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:20.408850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49371,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":1173,"num_write":448,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.128059+0000","last_change":"2024-09-12T00:12:44.050415+0000","last_active":"2024-09-12T01:06:45.128059+0000","last_peered":"2024-09-12T01:06:45.128059+0000","last_clean":"2024-09-12T01:06:45.128059+0000","last_became_active":"2024-09-12T00:12:44.050074+0000","last_became_peered":"2024-09-12T00:12:44.050074+0000","last_unstale":"2024-09-12T01:06:45.128059+0000","last_undegraded":"2024-09-12T01:06:45.128059+0000","last_fullsized":"2024-09-12T01:06:45.128059+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:57.225646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'192","reported_seq":698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.036974+0000","last_change":"2024-09-12T00:12:46.064781+0000","last_active":"2024-09-12T01:07:00.036974+0000","last_peered":"2024-09-12T01:07:00.036974+0000","last_clean":"2024-09-12T01:07:00.036974+0000","last_became_active":"2024-09-12T00:12:46.064517+0000","last_became_peered":"2024-09-12T00:12:46.064517+0000","last_unstale":"2024-09-12T01:07:00.036974+0000","last_undegraded":"2024-09-12T01:07:00.036974+0000","last_fullsized":"2024-09-12T01:07:00.036974+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:13.273953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":229,"num_read_kb":204,"num_write":354,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'287","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:10.051836+0000","last_change":"2024-09-12T00:12:38.042874+0000","last_active":"2024-09-12T01:09:10.051836+0000","last_peered":"2024-09-12T01:09:10.051836+0000","last_clean":"2024-09-12T01:09:10.051836+0000","last_became_active":"2024-09-12T00:12:38.040885+0000","last_became_peered":"2024-09-12T00:12:38.040885+0000","last_unstale":"2024-09-12T01:09:10.051836+0000","last_undegraded":"2024-09-12T01:09:10.051836+0000","last_fullsized":"2024-09-12T01:09:10.051836+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:18.323532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1200,"num_read_kb":970,"num_write":419,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.239059+0000","last_change":"2024-09-12T00:12:17.818843+0000","last_active":"2024-09-12T01:08:25.239059+0000","last_peered":"2024-09-12T01:08:25.239059+0000","last_clean":"2024-09-12T01:08:25.239059+0000","last_became_active":"2024-09-12T00:12:17.817880+0000","last_became_peered":"2024-09-12T00:12:17.817880+0000","last_unstale":"2024-09-12T01:08:25.239059+0000","last_undegraded":"2024-09-12T01:08:25.239059+0000","last_fullsized":"2024-09-12T01:08:25.239059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:16.658840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:16.658840+0000","last_clean_scrub_stamp":"2024-09-12T00:12:16.658840+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:23.769027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.048041+0000","last_change":"2024-09-12T00:12:24.720432+0000","last_active":"2024-09-12T01:08:40.048041+0000","last_peered":"2024-09-12T01:08:40.048041+0000","last_clean":"2024-09-12T01:08:40.048041+0000","last_became_active":"2024-09-12T00:12:22.713297+0000","last_became_peered":"2024-09-12T00:12:22.713297+0000","last_unstale":"2024-09-12T01:08:40.048041+0000","last_undegraded":"2024-09-12T01:08:40.048041+0000","last_fullsized":"2024-09-12T01:08:40.048041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:31.323737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014022310000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'384","reported_seq":1089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.026979+0000","last_change":"2024-09-12T00:12:36.031160+0000","last_active":"2024-09-12T01:11:00.026979+0000","last_peered":"2024-09-12T01:11:00.026979+0000","last_clean":"2024-09-12T01:11:00.026979+0000","last_became_active":"2024-09-12T00:12:36.030408+0000","last_became_peered":"2024-09-12T00:12:36.030408+0000","last_unstale":"2024-09-12T01:11:00.026979+0000","last_undegraded":"2024-09-12T01:11:00.026979+0000","last_fullsized":"2024-09-12T01:11:00.026979+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:33.226277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699455,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":750,"num_read_kb":42611,"num_write":1161,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"39'3","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.876104+0000","last_change":"2024-09-12T00:12:40.039805+0000","last_active":"2024-09-12T01:10:57.876104+0000","last_peered":"2024-09-12T01:10:57.876104+0000","last_clean":"2024-09-12T01:10:57.876104+0000","last_became_active":"2024-09-12T00:12:40.039529+0000","last_became_peered":"2024-09-12T00:12:40.039529+0000","last_unstale":"2024-09-12T01:10:57.876104+0000","last_undegraded":"2024-09-12T01:10:57.876104+0000","last_fullsized":"2024-09-12T01:10:57.876104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:59.811179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'764","reported_seq":1473,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.987650+0000","last_change":"2024-09-12T00:12:42.047000+0000","last_active":"2024-09-12T01:10:59.987650+0000","last_peered":"2024-09-12T01:10:59.987650+0000","last_clean":"2024-09-12T01:10:59.987650+0000","last_became_active":"2024-09-12T00:12:42.046668+0000","last_became_peered":"2024-09-12T00:12:42.046668+0000","last_unstale":"2024-09-12T01:10:59.987650+0000","last_undegraded":"2024-09-12T01:10:59.987650+0000","last_fullsized":"2024-09-12T01:10:59.987650+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:28.052922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143901,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1496,"num_read_kb":3385,"num_write":1448,"num_write_kb":1292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:58.035351+0000","last_change":"2024-09-12T00:12:44.054071+0000","last_active":"2024-09-12T01:06:58.035351+0000","last_peered":"2024-09-12T01:06:58.035351+0000","last_clean":"2024-09-12T01:06:58.035351+0000","last_became_active":"2024-09-12T00:12:44.053779+0000","last_became_peered":"2024-09-12T00:12:44.053779+0000","last_unstale":"2024-09-12T01:06:58.035351+0000","last_undegraded":"2024-09-12T01:06:58.035351+0000","last_fullsized":"2024-09-12T01:06:58.035351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:27.975447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'187","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.839569+0000","last_change":"2024-09-12T00:12:46.055892+0000","last_active":"2024-09-12T01:09:21.839569+0000","last_peered":"2024-09-12T01:09:21.839569+0000","last_clean":"2024-09-12T01:09:21.839569+0000","last_became_active":"2024-09-12T00:12:46.055501+0000","last_became_peered":"2024-09-12T00:12:46.055501+0000","last_unstale":"2024-09-12T01:09:21.839569+0000","last_undegraded":"2024-09-12T01:09:21.839569+0000","last_fullsized":"2024-09-12T01:09:21.839569+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:21.728435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":436,"num_write":384,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'149","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.983294+0000","last_change":"2024-09-12T00:12:38.037702+0000","last_active":"2024-09-12T01:06:50.983294+0000","last_peered":"2024-09-12T01:06:50.983294+0000","last_clean":"2024-09-12T01:06:50.983294+0000","last_became_active":"2024-09-12T00:12:38.037392+0000","last_became_peered":"2024-09-12T00:12:38.037392+0000","last_unstale":"2024-09-12T01:06:50.983294+0000","last_undegraded":"2024-09-12T01:06:50.983294+0000","last_fullsized":"2024-09-12T01:06:50.983294+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:11.775556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":647,"num_read_kb":530,"num_write":212,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.047963+0000","last_change":"2024-09-12T00:12:24.720267+0000","last_active":"2024-09-12T01:08:40.047963+0000","last_peered":"2024-09-12T01:08:40.047963+0000","last_clean":"2024-09-12T01:08:40.047963+0000","last_became_active":"2024-09-12T00:12:22.713657+0000","last_became_peered":"2024-09-12T00:12:22.713657+0000","last_unstale":"2024-09-12T01:08:40.047963+0000","last_undegraded":"2024-09-12T01:08:40.047963+0000","last_fullsized":"2024-09-12T01:08:40.047963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:55.127846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012667690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'333","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.148444+0000","last_change":"2024-09-12T00:12:36.036400+0000","last_active":"2024-09-12T01:11:00.148444+0000","last_peered":"2024-09-12T01:11:00.148444+0000","last_clean":"2024-09-12T01:11:00.148444+0000","last_became_active":"2024-09-12T00:12:36.036010+0000","last_became_peered":"2024-09-12T00:12:36.036010+0000","last_unstale":"2024-09-12T01:11:00.148444+0000","last_undegraded":"2024-09-12T01:11:00.148444+0000","last_fullsized":"2024-09-12T01:11:00.148444+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:28.310996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":522,"num_read_kb":7159,"num_write":1101,"num_write_kb":37525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035353+0000","last_change":"2024-09-12T00:12:40.039924+0000","last_active":"2024-09-12T01:06:50.035353+0000","last_peered":"2024-09-12T01:06:50.035353+0000","last_clean":"2024-09-12T01:06:50.035353+0000","last_became_active":"2024-09-12T00:12:40.039592+0000","last_became_peered":"2024-09-12T00:12:40.039592+0000","last_unstale":"2024-09-12T01:06:50.035353+0000","last_undegraded":"2024-09-12T01:06:50.035353+0000","last_fullsized":"2024-09-12T01:06:50.035353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:03.351155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1307","reported_seq":2937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.930702+0000","last_change":"2024-09-12T00:12:42.049983+0000","last_active":"2024-09-12T01:10:59.930702+0000","last_peered":"2024-09-12T01:10:59.930702+0000","last_clean":"2024-09-12T01:10:59.930702+0000","last_became_active":"2024-09-12T00:12:42.049594+0000","last_became_peered":"2024-09-12T00:12:42.049594+0000","last_unstale":"2024-09-12T01:10:59.930702+0000","last_undegraded":"2024-09-12T01:10:59.930702+0000","last_fullsized":"2024-09-12T01:10:59.930702+0000","mapping_epoch":33,"log_start":"263'1201","ondisk_log_start":"263'1201","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":1201,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:24.166453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146958,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3903,"num_write":1160,"num_write_kb":992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.037681+0000","last_change":"2024-09-12T00:12:44.059941+0000","last_active":"2024-09-12T01:07:10.037681+0000","last_peered":"2024-09-12T01:07:10.037681+0000","last_clean":"2024-09-12T01:07:10.037681+0000","last_became_active":"2024-09-12T00:12:44.059188+0000","last_became_peered":"2024-09-12T00:12:44.059188+0000","last_unstale":"2024-09-12T01:07:10.037681+0000","last_undegraded":"2024-09-12T01:07:10.037681+0000","last_fullsized":"2024-09-12T01:07:10.037681+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:21.870093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'151","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.534259+0000","last_change":"2024-09-12T00:12:46.065282+0000","last_active":"2024-09-12T01:09:21.534259+0000","last_peered":"2024-09-12T01:09:21.534259+0000","last_clean":"2024-09-12T01:09:21.534259+0000","last_became_active":"2024-09-12T00:12:46.064993+0000","last_became_peered":"2024-09-12T00:12:46.064993+0000","last_unstale":"2024-09-12T01:09:21.534259+0000","last_undegraded":"2024-09-12T01:09:21.534259+0000","last_fullsized":"2024-09-12T01:09:21.534259+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:44.458446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":277,"num_write":363,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'61","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.153022+0000","last_change":"2024-09-12T00:12:38.039881+0000","last_active":"2024-09-12T01:06:50.153022+0000","last_peered":"2024-09-12T01:06:50.153022+0000","last_clean":"2024-09-12T01:06:50.153022+0000","last_became_active":"2024-09-12T00:12:38.039492+0000","last_became_peered":"2024-09-12T00:12:38.039492+0000","last_unstale":"2024-09-12T01:06:50.153022+0000","last_undegraded":"2024-09-12T01:06:50.153022+0000","last_fullsized":"2024-09-12T01:06:50.153022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:21.545330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":235,"num_write":88,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.053063+0000","last_change":"2024-09-12T00:12:25.140418+0000","last_active":"2024-09-12T01:08:40.053063+0000","last_peered":"2024-09-12T01:08:40.053063+0000","last_clean":"2024-09-12T01:08:40.053063+0000","last_became_active":"2024-09-12T00:12:22.714487+0000","last_became_peered":"2024-09-12T00:12:22.714487+0000","last_unstale":"2024-09-12T01:08:40.053063+0000","last_undegraded":"2024-09-12T01:08:40.053063+0000","last_fullsized":"2024-09-12T01:08:40.053063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:43.265742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038937299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'259","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.052910+0000","last_change":"2024-09-12T00:12:36.042842+0000","last_active":"2024-09-12T01:08:53.052910+0000","last_peered":"2024-09-12T01:08:53.052910+0000","last_clean":"2024-09-12T01:08:53.052910+0000","last_became_active":"2024-09-12T00:12:36.042293+0000","last_became_peered":"2024-09-12T00:12:36.042293+0000","last_unstale":"2024-09-12T01:08:53.052910+0000","last_undegraded":"2024-09-12T01:08:53.052910+0000","last_fullsized":"2024-09-12T01:08:53.052910+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:27.070087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8603516,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":428,"num_read_kb":33497,"num_write":1002,"num_write_kb":40497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"32'1","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035127+0000","last_change":"2024-09-12T00:12:40.038528+0000","last_active":"2024-09-12T01:06:50.035127+0000","last_peered":"2024-09-12T01:06:50.035127+0000","last_clean":"2024-09-12T01:06:50.035127+0000","last_became_active":"2024-09-12T00:12:40.038202+0000","last_became_peered":"2024-09-12T00:12:40.038202+0000","last_unstale":"2024-09-12T01:06:50.035127+0000","last_undegraded":"2024-09-12T01:06:50.035127+0000","last_fullsized":"2024-09-12T01:06:50.035127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:20.002180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'248","reported_seq":1480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:30.102145+0000","last_change":"2024-09-12T00:12:42.044804+0000","last_active":"2024-09-12T01:10:30.102145+0000","last_peered":"2024-09-12T01:10:30.102145+0000","last_clean":"2024-09-12T01:10:30.102145+0000","last_became_active":"2024-09-12T00:12:42.044498+0000","last_became_peered":"2024-09-12T00:12:42.044498+0000","last_unstale":"2024-09-12T01:10:30.102145+0000","last_undegraded":"2024-09-12T01:10:30.102145+0000","last_fullsized":"2024-09-12T01:10:30.102145+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:46.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":187,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.036173+0000","last_change":"2024-09-12T00:12:44.062318+0000","last_active":"2024-09-12T01:06:55.036173+0000","last_peered":"2024-09-12T01:06:55.036173+0000","last_clean":"2024-09-12T01:06:55.036173+0000","last_became_active":"2024-09-12T00:12:44.062039+0000","last_became_peered":"2024-09-12T00:12:44.062039+0000","last_unstale":"2024-09-12T01:06:55.036173+0000","last_undegraded":"2024-09-12T01:06:55.036173+0000","last_fullsized":"2024-09-12T01:06:55.036173+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:41.686967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'260","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.751353+0000","last_change":"2024-09-12T00:12:46.053602+0000","last_active":"2024-09-12T01:09:22.751353+0000","last_peered":"2024-09-12T01:09:22.751353+0000","last_clean":"2024-09-12T01:09:22.751353+0000","last_became_active":"2024-09-12T00:12:46.053228+0000","last_became_peered":"2024-09-12T00:12:46.053228+0000","last_unstale":"2024-09-12T01:09:22.751353+0000","last_undegraded":"2024-09-12T01:09:22.751353+0000","last_fullsized":"2024-09-12T01:09:22.751353+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:21.825120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":531,"num_write":580,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'172","reported_seq":752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.172609+0000","last_change":"2024-09-12T00:12:38.040785+0000","last_active":"2024-09-12T01:08:55.172609+0000","last_peered":"2024-09-12T01:08:55.172609+0000","last_clean":"2024-09-12T01:08:55.172609+0000","last_became_active":"2024-09-12T00:12:38.040477+0000","last_became_peered":"2024-09-12T00:12:38.040477+0000","last_unstale":"2024-09-12T01:08:55.172609+0000","last_undegraded":"2024-09-12T01:08:55.172609+0000","last_fullsized":"2024-09-12T01:08:55.172609+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.489846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":766,"num_read_kb":623,"num_write":281,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.048018+0000","last_change":"2024-09-12T00:12:24.719660+0000","last_active":"2024-09-12T01:08:40.048018+0000","last_peered":"2024-09-12T01:08:40.048018+0000","last_clean":"2024-09-12T01:08:40.048018+0000","last_became_active":"2024-09-12T00:12:22.840587+0000","last_became_peered":"2024-09-12T00:12:22.840587+0000","last_unstale":"2024-09-12T01:08:40.048018+0000","last_undegraded":"2024-09-12T01:08:40.048018+0000","last_fullsized":"2024-09-12T01:08:40.048018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:04.555069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065014999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'360","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.048747+0000","last_change":"2024-09-12T00:12:36.040303+0000","last_active":"2024-09-12T01:11:00.048747+0000","last_peered":"2024-09-12T01:11:00.048747+0000","last_clean":"2024-09-12T01:11:00.048747+0000","last_became_active":"2024-09-12T00:12:36.039564+0000","last_became_peered":"2024-09-12T00:12:36.039564+0000","last_unstale":"2024-09-12T01:11:00.048747+0000","last_undegraded":"2024-09-12T01:11:00.048747+0000","last_fullsized":"2024-09-12T01:11:00.048747+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:41.381139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568705,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":628,"num_read_kb":35583,"num_write":1178,"num_write_kb":35527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.037023+0000","last_change":"2024-09-12T00:12:40.042792+0000","last_active":"2024-09-12T01:07:00.037023+0000","last_peered":"2024-09-12T01:07:00.037023+0000","last_clean":"2024-09-12T01:07:00.037023+0000","last_became_active":"2024-09-12T00:12:40.042510+0000","last_became_peered":"2024-09-12T00:12:40.042510+0000","last_unstale":"2024-09-12T01:07:00.037023+0000","last_undegraded":"2024-09-12T01:07:00.037023+0000","last_fullsized":"2024-09-12T01:07:00.037023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:33.760779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'131","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.054611+0000","last_change":"2024-09-12T00:12:42.051046+0000","last_active":"2024-09-12T01:09:03.054611+0000","last_peered":"2024-09-12T01:09:03.054611+0000","last_clean":"2024-09-12T01:09:03.054611+0000","last_became_active":"2024-09-12T00:12:42.050143+0000","last_became_peered":"2024-09-12T00:12:42.050143+0000","last_unstale":"2024-09-12T01:09:03.054611+0000","last_undegraded":"2024-09-12T01:09:03.054611+0000","last_fullsized":"2024-09-12T01:09:03.054611+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:15.073604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.035914+0000","last_change":"2024-09-12T00:12:44.059423+0000","last_active":"2024-09-12T01:06:55.035914+0000","last_peered":"2024-09-12T01:06:55.035914+0000","last_clean":"2024-09-12T01:06:55.035914+0000","last_became_active":"2024-09-12T00:12:44.059037+0000","last_became_peered":"2024-09-12T00:12:44.059037+0000","last_unstale":"2024-09-12T01:06:55.035914+0000","last_undegraded":"2024-09-12T01:06:55.035914+0000","last_fullsized":"2024-09-12T01:06:55.035914+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:59.363962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'163","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.572035+0000","last_change":"2024-09-12T00:12:46.069307+0000","last_active":"2024-09-12T01:09:21.572035+0000","last_peered":"2024-09-12T01:09:21.572035+0000","last_clean":"2024-09-12T01:09:21.572035+0000","last_became_active":"2024-09-12T00:12:46.068934+0000","last_became_peered":"2024-09-12T00:12:46.068934+0000","last_unstale":"2024-09-12T01:09:21.572035+0000","last_undegraded":"2024-09-12T01:09:21.572035+0000","last_fullsized":"2024-09-12T01:09:21.572035+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:07.233294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":270,"num_read_kb":259,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'110","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.172540+0000","last_change":"2024-09-12T00:12:38.044730+0000","last_active":"2024-09-12T01:08:55.172540+0000","last_peered":"2024-09-12T01:08:55.172540+0000","last_clean":"2024-09-12T01:08:55.172540+0000","last_became_active":"2024-09-12T00:12:38.044464+0000","last_became_peered":"2024-09-12T00:12:38.044464+0000","last_unstale":"2024-09-12T01:08:55.172540+0000","last_undegraded":"2024-09-12T01:08:55.172540+0000","last_fullsized":"2024-09-12T01:08:55.172540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:14.066506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":513,"num_read_kb":428,"num_write":178,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'368","reported_seq":1133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.120928+0000","last_change":"2024-09-12T00:12:36.037463+0000","last_active":"2024-09-12T01:11:00.120928+0000","last_peered":"2024-09-12T01:11:00.120928+0000","last_clean":"2024-09-12T01:11:00.120928+0000","last_became_active":"2024-09-12T00:12:36.036570+0000","last_became_peered":"2024-09-12T00:12:36.036570+0000","last_unstale":"2024-09-12T01:11:00.120928+0000","last_undegraded":"2024-09-12T01:11:00.120928+0000","last_fullsized":"2024-09-12T01:11:00.120928+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:27.156201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4718703,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":801,"num_read_kb":22341,"num_write":1144,"num_write_kb":30942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:38.050417+0000","last_change":"2024-09-12T00:12:24.788080+0000","last_active":"2024-09-12T01:08:38.050417+0000","last_peered":"2024-09-12T01:08:38.050417+0000","last_clean":"2024-09-12T01:08:38.050417+0000","last_became_active":"2024-09-12T00:12:22.840210+0000","last_became_peered":"2024-09-12T00:12:22.840210+0000","last_unstale":"2024-09-12T01:08:38.050417+0000","last_undegraded":"2024-09-12T01:08:38.050417+0000","last_fullsized":"2024-09-12T01:08:38.050417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.906053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043827699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.055677+0000","last_change":"2024-09-12T00:12:40.041037+0000","last_active":"2024-09-12T01:08:55.055677+0000","last_peered":"2024-09-12T01:08:55.055677+0000","last_clean":"2024-09-12T01:08:55.055677+0000","last_became_active":"2024-09-12T00:12:40.040760+0000","last_became_peered":"2024-09-12T00:12:40.040760+0000","last_unstale":"2024-09-12T01:08:55.055677+0000","last_undegraded":"2024-09-12T01:08:55.055677+0000","last_fullsized":"2024-09-12T01:08:55.055677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:43.762744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'626","reported_seq":1298,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.572713+0000","last_change":"2024-09-12T00:12:42.053771+0000","last_active":"2024-09-12T01:10:59.572713+0000","last_peered":"2024-09-12T01:10:59.572713+0000","last_clean":"2024-09-12T01:10:59.572713+0000","last_became_active":"2024-09-12T00:12:42.053472+0000","last_became_peered":"2024-09-12T00:12:42.053472+0000","last_unstale":"2024-09-12T01:10:59.572713+0000","last_undegraded":"2024-09-12T01:10:59.572713+0000","last_fullsized":"2024-09-12T01:10:59.572713+0000","mapping_epoch":33,"log_start":"263'600","ondisk_log_start":"263'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:10.598317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1715,"num_read_kb":3028,"num_write":2216,"num_write_kb":2038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.129178+0000","last_change":"2024-09-12T00:12:44.049070+0000","last_active":"2024-09-12T01:06:55.129178+0000","last_peered":"2024-09-12T01:06:55.129178+0000","last_clean":"2024-09-12T01:06:55.129178+0000","last_became_active":"2024-09-12T00:12:44.048703+0000","last_became_peered":"2024-09-12T00:12:44.048703+0000","last_unstale":"2024-09-12T01:06:55.129178+0000","last_undegraded":"2024-09-12T01:06:55.129178+0000","last_fullsized":"2024-09-12T01:06:55.129178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:10.832094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'142","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.054601+0000","last_change":"2024-09-12T00:12:46.064205+0000","last_active":"2024-09-12T01:09:03.054601+0000","last_peered":"2024-09-12T01:09:03.054601+0000","last_clean":"2024-09-12T01:09:03.054601+0000","last_became_active":"2024-09-12T00:12:46.063429+0000","last_became_peered":"2024-09-12T00:12:46.063429+0000","last_unstale":"2024-09-12T01:09:03.054601+0000","last_undegraded":"2024-09-12T01:09:03.054601+0000","last_fullsized":"2024-09-12T01:09:03.054601+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:01.539611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":320,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'177","reported_seq":787,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.172570+0000","last_change":"2024-09-12T00:12:38.041538+0000","last_active":"2024-09-12T01:08:55.172570+0000","last_peered":"2024-09-12T01:08:55.172570+0000","last_clean":"2024-09-12T01:08:55.172570+0000","last_became_active":"2024-09-12T00:12:38.041178+0000","last_became_peered":"2024-09-12T00:12:38.041178+0000","last_unstale":"2024-09-12T01:08:55.172570+0000","last_undegraded":"2024-09-12T01:08:55.172570+0000","last_fullsized":"2024-09-12T01:08:55.172570+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:50.594465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":778,"num_read_kb":646,"num_write":262,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'364","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.166909+0000","last_change":"2024-09-12T00:12:36.036323+0000","last_active":"2024-09-12T01:11:00.166909+0000","last_peered":"2024-09-12T01:11:00.166909+0000","last_clean":"2024-09-12T01:11:00.166909+0000","last_became_active":"2024-09-12T00:12:36.035932+0000","last_became_peered":"2024-09-12T00:12:36.035932+0000","last_unstale":"2024-09-12T01:11:00.166909+0000","last_undegraded":"2024-09-12T01:11:00.166909+0000","last_fullsized":"2024-09-12T01:11:00.166909+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:58.357878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":22298,"num_write":1168,"num_write_kb":32564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.049776+0000","last_change":"2024-09-12T00:12:24.719653+0000","last_active":"2024-09-12T01:08:55.049776+0000","last_peered":"2024-09-12T01:08:55.049776+0000","last_clean":"2024-09-12T01:08:55.049776+0000","last_became_active":"2024-09-12T00:12:22.713263+0000","last_became_peered":"2024-09-12T00:12:22.713263+0000","last_unstale":"2024-09-12T01:08:55.049776+0000","last_undegraded":"2024-09-12T01:08:55.049776+0000","last_fullsized":"2024-09-12T01:08:55.049776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:13.032469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065424400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.036052+0000","last_change":"2024-09-12T00:12:40.039181+0000","last_active":"2024-09-12T01:08:55.036052+0000","last_peered":"2024-09-12T01:08:55.036052+0000","last_clean":"2024-09-12T01:08:55.036052+0000","last_became_active":"2024-09-12T00:12:40.038903+0000","last_became_peered":"2024-09-12T00:12:40.038903+0000","last_unstale":"2024-09-12T01:08:55.036052+0000","last_undegraded":"2024-09-12T01:08:55.036052+0000","last_fullsized":"2024-09-12T01:08:55.036052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:00.591959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'172","reported_seq":741,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.153591+0000","last_change":"2024-09-12T00:12:42.050874+0000","last_active":"2024-09-12T01:06:55.153591+0000","last_peered":"2024-09-12T01:06:55.153591+0000","last_clean":"2024-09-12T01:06:55.153591+0000","last_became_active":"2024-09-12T00:12:42.050580+0000","last_became_peered":"2024-09-12T00:12:42.050580+0000","last_unstale":"2024-09-12T01:06:55.153591+0000","last_undegraded":"2024-09-12T01:06:55.153591+0000","last_fullsized":"2024-09-12T01:06:55.153591+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:59.841756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":221,"num_write":156,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'778","reported_seq":2701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.881010+0000","last_change":"2024-09-12T00:12:44.050548+0000","last_active":"2024-09-12T01:10:57.881010+0000","last_peered":"2024-09-12T01:10:57.881010+0000","last_clean":"2024-09-12T01:10:57.881010+0000","last_became_active":"2024-09-12T00:12:44.050295+0000","last_became_peered":"2024-09-12T00:12:44.050295+0000","last_unstale":"2024-09-12T01:10:57.881010+0000","last_undegraded":"2024-09-12T01:10:57.881010+0000","last_fullsized":"2024-09-12T01:10:57.881010+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:53.235246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'126","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.059081+0000","last_change":"2024-09-12T00:12:46.064323+0000","last_active":"2024-09-12T01:09:15.059081+0000","last_peered":"2024-09-12T01:09:15.059081+0000","last_clean":"2024-09-12T01:09:15.059081+0000","last_became_active":"2024-09-12T00:12:46.064036+0000","last_became_peered":"2024-09-12T00:12:46.064036+0000","last_unstale":"2024-09-12T01:09:15.059081+0000","last_undegraded":"2024-09-12T01:09:15.059081+0000","last_fullsized":"2024-09-12T01:09:15.059081+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:58.782613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1116,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'65","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.900165+0000","last_change":"2024-09-12T00:12:38.040132+0000","last_active":"2024-09-12T01:10:35.900165+0000","last_peered":"2024-09-12T01:10:35.900165+0000","last_clean":"2024-09-12T01:10:35.900165+0000","last_became_active":"2024-09-12T00:12:38.039759+0000","last_became_peered":"2024-09-12T00:12:38.039759+0000","last_unstale":"2024-09-12T01:10:35.900165+0000","last_undegraded":"2024-09-12T01:10:35.900165+0000","last_fullsized":"2024-09-12T01:10:35.900165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:56.827266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":290,"num_read_kb":242,"num_write":89,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'351","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.048734+0000","last_change":"2024-09-12T00:12:36.032820+0000","last_active":"2024-09-12T01:11:00.048734+0000","last_peered":"2024-09-12T01:11:00.048734+0000","last_clean":"2024-09-12T01:11:00.048734+0000","last_became_active":"2024-09-12T00:12:36.032470+0000","last_became_peered":"2024-09-12T00:12:36.032470+0000","last_unstale":"2024-09-12T01:11:00.048734+0000","last_undegraded":"2024-09-12T01:11:00.048734+0000","last_fullsized":"2024-09-12T01:11:00.048734+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:59.424753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27280,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":501,"num_read_kb":9896,"num_write":1196,"num_write_kb":25017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.054108+0000","last_change":"2024-09-12T00:12:24.719145+0000","last_active":"2024-09-12T01:08:45.054108+0000","last_peered":"2024-09-12T01:08:45.054108+0000","last_clean":"2024-09-12T01:08:45.054108+0000","last_became_active":"2024-09-12T00:12:22.875452+0000","last_became_peered":"2024-09-12T00:12:22.875452+0000","last_unstale":"2024-09-12T01:08:45.054108+0000","last_undegraded":"2024-09-12T01:08:45.054108+0000","last_fullsized":"2024-09-12T01:08:45.054108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:18.582665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040035500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.049709+0000","last_change":"2024-09-12T00:12:40.040001+0000","last_active":"2024-09-12T01:08:55.049709+0000","last_peered":"2024-09-12T01:08:55.049709+0000","last_clean":"2024-09-12T01:08:55.049709+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:08:55.049709+0000","last_undegraded":"2024-09-12T01:08:55.049709+0000","last_fullsized":"2024-09-12T01:08:55.049709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:47.045425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'129","reported_seq":674,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.035838+0000","last_change":"2024-09-12T00:12:42.048645+0000","last_active":"2024-09-12T01:06:55.035838+0000","last_peered":"2024-09-12T01:06:55.035838+0000","last_clean":"2024-09-12T01:06:55.035838+0000","last_became_active":"2024-09-12T00:12:42.048364+0000","last_became_peered":"2024-09-12T00:12:42.048364+0000","last_unstale":"2024-09-12T01:06:55.035838+0000","last_undegraded":"2024-09-12T01:06:55.035838+0000","last_fullsized":"2024-09-12T01:06:55.035838+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:36.782398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'805","reported_seq":2514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.885117+0000","last_change":"2024-09-12T00:12:44.050927+0000","last_active":"2024-09-12T01:10:57.885117+0000","last_peered":"2024-09-12T01:10:57.885117+0000","last_clean":"2024-09-12T01:10:57.885117+0000","last_became_active":"2024-09-12T00:12:44.049336+0000","last_became_peered":"2024-09-12T00:12:44.049336+0000","last_unstale":"2024-09-12T01:10:57.885117+0000","last_undegraded":"2024-09-12T01:10:57.885117+0000","last_fullsized":"2024-09-12T01:10:57.885117+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:05.958866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'271","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:44.898434+0000","last_change":"2024-09-12T00:12:46.064357+0000","last_active":"2024-09-12T01:08:44.898434+0000","last_peered":"2024-09-12T01:08:44.898434+0000","last_clean":"2024-09-12T01:08:44.898434+0000","last_became_active":"2024-09-12T00:12:46.064058+0000","last_became_peered":"2024-09-12T00:12:46.064058+0000","last_unstale":"2024-09-12T01:08:44.898434+0000","last_undegraded":"2024-09-12T01:08:44.898434+0000","last_fullsized":"2024-09-12T01:08:44.898434+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:14.383616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":363,"num_read_kb":352,"num_write":596,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'133","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.142775+0000","last_change":"2024-09-12T00:12:38.045014+0000","last_active":"2024-09-12T01:08:55.142775+0000","last_peered":"2024-09-12T01:08:55.142775+0000","last_clean":"2024-09-12T01:08:55.142775+0000","last_became_active":"2024-09-12T00:12:38.044075+0000","last_became_peered":"2024-09-12T00:12:38.044075+0000","last_unstale":"2024-09-12T01:08:55.142775+0000","last_undegraded":"2024-09-12T01:08:55.142775+0000","last_fullsized":"2024-09-12T01:08:55.142775+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:39.495991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":484,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'405","reported_seq":1155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.034691+0000","last_change":"2024-09-12T00:12:36.031043+0000","last_active":"2024-09-12T01:11:00.034691+0000","last_peered":"2024-09-12T01:11:00.034691+0000","last_clean":"2024-09-12T01:11:00.034691+0000","last_became_active":"2024-09-12T00:12:36.030644+0000","last_became_peered":"2024-09-12T00:12:36.030644+0000","last_unstale":"2024-09-12T01:11:00.034691+0000","last_undegraded":"2024-09-12T01:11:00.034691+0000","last_fullsized":"2024-09-12T01:11:00.034691+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:31.856368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":618533,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":733,"num_read_kb":123119,"num_write":1240,"num_write_kb":49104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.048638+0000","last_change":"2024-09-12T00:12:24.720016+0000","last_active":"2024-09-12T01:08:45.048638+0000","last_peered":"2024-09-12T01:08:45.048638+0000","last_clean":"2024-09-12T01:08:45.048638+0000","last_became_active":"2024-09-12T00:12:22.875444+0000","last_became_peered":"2024-09-12T00:12:22.875444+0000","last_unstale":"2024-09-12T01:08:45.048638+0000","last_undegraded":"2024-09-12T01:08:45.048638+0000","last_fullsized":"2024-09-12T01:08:45.048638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:01.561555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001017387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'5","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.851756+0000","last_change":"2024-09-12T00:12:40.031664+0000","last_active":"2024-09-12T01:10:57.851756+0000","last_peered":"2024-09-12T01:10:57.851756+0000","last_clean":"2024-09-12T01:10:57.851756+0000","last_became_active":"2024-09-12T00:12:40.031382+0000","last_became_peered":"2024-09-12T00:12:40.031382+0000","last_unstale":"2024-09-12T01:10:57.851756+0000","last_undegraded":"2024-09-12T01:10:57.851756+0000","last_fullsized":"2024-09-12T01:10:57.851756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:43.398397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'730","reported_seq":1455,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.753609+0000","last_change":"2024-09-12T00:12:42.043628+0000","last_active":"2024-09-12T01:10:59.753609+0000","last_peered":"2024-09-12T01:10:59.753609+0000","last_clean":"2024-09-12T01:10:59.753609+0000","last_became_active":"2024-09-12T00:12:42.043328+0000","last_became_peered":"2024-09-12T00:12:42.043328+0000","last_unstale":"2024-09-12T01:10:59.753609+0000","last_undegraded":"2024-09-12T01:10:59.753609+0000","last_fullsized":"2024-09-12T01:10:59.753609+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":700,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:41.276102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147946,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1306,"num_read_kb":3069,"num_write":1058,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.036126+0000","last_change":"2024-09-12T00:12:44.062248+0000","last_active":"2024-09-12T01:06:55.036126+0000","last_peered":"2024-09-12T01:06:55.036126+0000","last_clean":"2024-09-12T01:06:55.036126+0000","last_became_active":"2024-09-12T00:12:44.061206+0000","last_became_peered":"2024-09-12T00:12:44.061206+0000","last_unstale":"2024-09-12T01:06:55.036126+0000","last_undegraded":"2024-09-12T01:06:55.036126+0000","last_fullsized":"2024-09-12T01:06:55.036126+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:28.838993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'95","reported_seq":588,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.128446+0000","last_change":"2024-09-12T00:12:46.058756+0000","last_active":"2024-09-12T01:09:23.128446+0000","last_peered":"2024-09-12T01:09:23.128446+0000","last_clean":"2024-09-12T01:09:23.128446+0000","last_became_active":"2024-09-12T00:12:46.058465+0000","last_became_peered":"2024-09-12T00:12:46.058465+0000","last_unstale":"2024-09-12T01:09:23.128446+0000","last_undegraded":"2024-09-12T01:09:23.128446+0000","last_fullsized":"2024-09-12T01:09:23.128446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:59.069997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":101,"num_write":234,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'139","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.693672+0000","last_change":"2024-09-12T00:12:46.063719+0000","last_active":"2024-09-12T01:10:31.693672+0000","last_peered":"2024-09-12T01:10:31.693672+0000","last_clean":"2024-09-12T01:10:31.693672+0000","last_became_active":"2024-09-12T00:12:46.063423+0000","last_became_peered":"2024-09-12T00:12:46.063423+0000","last_unstale":"2024-09-12T01:10:31.693672+0000","last_undegraded":"2024-09-12T01:10:31.693672+0000","last_fullsized":"2024-09-12T01:10:31.693672+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:35.174197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":252,"num_write":335,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'151","reported_seq":720,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:41.717924+0000","last_change":"2024-09-12T00:12:38.041953+0000","last_active":"2024-09-12T01:08:41.717924+0000","last_peered":"2024-09-12T01:08:41.717924+0000","last_clean":"2024-09-12T01:08:41.717924+0000","last_became_active":"2024-09-12T00:12:38.041665+0000","last_became_peered":"2024-09-12T00:12:38.041665+0000","last_unstale":"2024-09-12T01:08:41.717924+0000","last_undegraded":"2024-09-12T01:08:41.717924+0000","last_fullsized":"2024-09-12T01:08:41.717924+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:35.209960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":652,"num_read_kb":531,"num_write":244,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'297","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.025046+0000","last_change":"2024-09-12T00:13:07.152881+0000","last_active":"2024-09-12T01:11:00.025046+0000","last_peered":"2024-09-12T01:11:00.025046+0000","last_clean":"2024-09-12T01:11:00.025046+0000","last_became_active":"2024-09-12T00:13:07.152470+0000","last_became_peered":"2024-09-12T00:13:07.152470+0000","last_unstale":"2024-09-12T01:11:00.025046+0000","last_undegraded":"2024-09-12T01:11:00.025046+0000","last_fullsized":"2024-09-12T01:11:00.025046+0000","mapping_epoch":40,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:42.910204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5099056,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":434,"num_read_kb":19566,"num_write":911,"num_write_kb":20485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.170293+0000","last_change":"2024-09-12T00:12:40.038938+0000","last_active":"2024-09-12T01:08:40.170293+0000","last_peered":"2024-09-12T01:08:40.170293+0000","last_clean":"2024-09-12T01:08:40.170293+0000","last_became_active":"2024-09-12T00:12:40.038618+0000","last_became_peered":"2024-09-12T00:12:40.038618+0000","last_unstale":"2024-09-12T01:08:40.170293+0000","last_undegraded":"2024-09-12T01:08:40.170293+0000","last_fullsized":"2024-09-12T01:08:40.170293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:06.465719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'279","reported_seq":856,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.094045+0000","last_change":"2024-09-12T00:12:42.050190+0000","last_active":"2024-09-12T01:11:00.094045+0000","last_peered":"2024-09-12T01:11:00.094045+0000","last_clean":"2024-09-12T01:11:00.094045+0000","last_became_active":"2024-09-12T00:12:42.049685+0000","last_became_peered":"2024-09-12T00:12:42.049685+0000","last_unstale":"2024-09-12T01:11:00.094045+0000","last_undegraded":"2024-09-12T01:11:00.094045+0000","last_fullsized":"2024-09-12T01:11:00.094045+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:57.050916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49303,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":1021,"num_write":368,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030516+0000","last_change":"2024-09-12T00:12:44.062762+0000","last_active":"2024-09-12T01:06:25.030516+0000","last_peered":"2024-09-12T01:06:25.030516+0000","last_clean":"2024-09-12T01:06:25.030516+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:06:25.030516+0000","last_undegraded":"2024-09-12T01:06:25.030516+0000","last_fullsized":"2024-09-12T01:06:25.030516+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:30.852996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.431103+0000","last_change":"2024-09-12T00:12:46.064377+0000","last_active":"2024-09-12T01:09:23.431103+0000","last_peered":"2024-09-12T01:09:23.431103+0000","last_clean":"2024-09-12T01:09:23.431103+0000","last_became_active":"2024-09-12T00:12:46.064080+0000","last_became_peered":"2024-09-12T00:12:46.064080+0000","last_unstale":"2024-09-12T01:09:23.431103+0000","last_undegraded":"2024-09-12T01:09:23.431103+0000","last_fullsized":"2024-09-12T01:09:23.431103+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:28.289493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":189,"num_write":302,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'148","reported_seq":740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.053154+0000","last_change":"2024-09-12T00:12:38.045256+0000","last_active":"2024-09-12T01:08:40.053154+0000","last_peered":"2024-09-12T01:08:40.053154+0000","last_clean":"2024-09-12T01:08:40.053154+0000","last_became_active":"2024-09-12T00:12:38.044990+0000","last_became_peered":"2024-09-12T00:12:38.044990+0000","last_unstale":"2024-09-12T01:08:40.053154+0000","last_undegraded":"2024-09-12T01:08:40.053154+0000","last_fullsized":"2024-09-12T01:08:40.053154+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:23.380297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":701,"num_read_kb":570,"num_write":228,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'335","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.920418+0000","last_change":"2024-09-12T00:12:36.036464+0000","last_active":"2024-09-12T01:10:59.920418+0000","last_peered":"2024-09-12T01:10:59.920418+0000","last_clean":"2024-09-12T01:10:59.920418+0000","last_became_active":"2024-09-12T00:12:36.034816+0000","last_became_peered":"2024-09-12T00:12:36.034816+0000","last_unstale":"2024-09-12T01:10:59.920418+0000","last_undegraded":"2024-09-12T01:10:59.920418+0000","last_fullsized":"2024-09-12T01:10:59.920418+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:54.535251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":1836,"num_write":1153,"num_write_kb":16367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.053198+0000","last_change":"2024-09-12T00:12:40.042449+0000","last_active":"2024-09-12T01:08:40.053198+0000","last_peered":"2024-09-12T01:08:40.053198+0000","last_clean":"2024-09-12T01:08:40.053198+0000","last_became_active":"2024-09-12T00:12:40.042104+0000","last_became_peered":"2024-09-12T00:12:40.042104+0000","last_unstale":"2024-09-12T01:08:40.053198+0000","last_undegraded":"2024-09-12T01:08:40.053198+0000","last_fullsized":"2024-09-12T01:08:40.053198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:33.704187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'55","reported_seq":557,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:44.638948+0000","last_change":"2024-09-12T00:12:42.043918+0000","last_active":"2024-09-12T01:06:44.638948+0000","last_peered":"2024-09-12T01:06:44.638948+0000","last_clean":"2024-09-12T01:06:44.638948+0000","last_became_active":"2024-09-12T00:12:42.043599+0000","last_became_peered":"2024-09-12T00:12:42.043599+0000","last_unstale":"2024-09-12T01:06:44.638948+0000","last_undegraded":"2024-09-12T01:06:44.638948+0000","last_fullsized":"2024-09-12T01:06:44.638948+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:06.844583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.125476+0000","last_change":"2024-09-12T00:12:44.054488+0000","last_active":"2024-09-12T01:06:25.125476+0000","last_peered":"2024-09-12T01:06:25.125476+0000","last_clean":"2024-09-12T01:06:25.125476+0000","last_became_active":"2024-09-12T00:12:44.054145+0000","last_became_peered":"2024-09-12T00:12:44.054145+0000","last_unstale":"2024-09-12T01:06:25.125476+0000","last_undegraded":"2024-09-12T01:06:25.125476+0000","last_fullsized":"2024-09-12T01:06:25.125476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:04.106673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'200","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.568625+0000","last_change":"2024-09-12T00:12:46.059839+0000","last_active":"2024-09-12T01:09:22.568625+0000","last_peered":"2024-09-12T01:09:22.568625+0000","last_clean":"2024-09-12T01:09:22.568625+0000","last_became_active":"2024-09-12T00:12:46.059520+0000","last_became_peered":"2024-09-12T00:12:46.059520+0000","last_unstale":"2024-09-12T01:09:22.568625+0000","last_undegraded":"2024-09-12T01:09:22.568625+0000","last_fullsized":"2024-09-12T01:09:22.568625+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:17.663006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":406,"num_read_kb":365,"num_write":468,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'124","reported_seq":723,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.811409+0000","last_change":"2024-09-12T00:12:38.041224+0000","last_active":"2024-09-12T01:10:31.811409+0000","last_peered":"2024-09-12T01:10:31.811409+0000","last_clean":"2024-09-12T01:10:31.811409+0000","last_became_active":"2024-09-12T00:12:38.040948+0000","last_became_peered":"2024-09-12T00:12:38.040948+0000","last_unstale":"2024-09-12T01:10:31.811409+0000","last_undegraded":"2024-09-12T01:10:31.811409+0000","last_fullsized":"2024-09-12T01:10:31.811409+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:21.931055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":483,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'332","reported_seq":997,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.135509+0000","last_change":"2024-09-12T00:12:36.040361+0000","last_active":"2024-09-12T01:11:00.135509+0000","last_peered":"2024-09-12T01:11:00.135509+0000","last_clean":"2024-09-12T01:11:00.135509+0000","last_became_active":"2024-09-12T00:12:36.038823+0000","last_became_peered":"2024-09-12T00:12:36.038823+0000","last_unstale":"2024-09-12T01:11:00.135509+0000","last_undegraded":"2024-09-12T01:11:00.135509+0000","last_fullsized":"2024-09-12T01:11:00.135509+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:53.004387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364595,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":546,"num_read_kb":31576,"num_write":1083,"num_write_kb":24420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.141149+0000","last_change":"2024-09-12T00:12:40.030750+0000","last_active":"2024-09-12T01:08:40.141149+0000","last_peered":"2024-09-12T01:08:40.141149+0000","last_clean":"2024-09-12T01:08:40.141149+0000","last_became_active":"2024-09-12T00:12:40.030447+0000","last_became_peered":"2024-09-12T00:12:40.030447+0000","last_unstale":"2024-09-12T01:08:40.141149+0000","last_undegraded":"2024-09-12T01:08:40.141149+0000","last_fullsized":"2024-09-12T01:08:40.141149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:19.640921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'329","reported_seq":912,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.459108+0000","last_change":"2024-09-12T00:12:42.051159+0000","last_active":"2024-09-12T01:10:59.459108+0000","last_peered":"2024-09-12T01:10:59.459108+0000","last_clean":"2024-09-12T01:10:59.459108+0000","last_became_active":"2024-09-12T00:12:42.050885+0000","last_became_peered":"2024-09-12T00:12:42.050885+0000","last_unstale":"2024-09-12T01:10:59.459108+0000","last_undegraded":"2024-09-12T01:10:59.459108+0000","last_fullsized":"2024-09-12T01:10:59.459108+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:07.994436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52758,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":1216,"num_write":438,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.226242+0000","last_change":"2024-09-12T00:12:44.056404+0000","last_active":"2024-09-12T01:06:25.226242+0000","last_peered":"2024-09-12T01:06:25.226242+0000","last_clean":"2024-09-12T01:06:25.226242+0000","last_became_active":"2024-09-12T00:12:44.056032+0000","last_became_peered":"2024-09-12T00:12:44.056032+0000","last_unstale":"2024-09-12T01:06:25.226242+0000","last_undegraded":"2024-09-12T01:06:25.226242+0000","last_fullsized":"2024-09-12T01:06:25.226242+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:26.625201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'121","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.354255+0000","last_change":"2024-09-12T00:12:46.063983+0000","last_active":"2024-09-12T01:08:28.354255+0000","last_peered":"2024-09-12T01:08:28.354255+0000","last_clean":"2024-09-12T01:08:28.354255+0000","last_became_active":"2024-09-12T00:12:46.063700+0000","last_became_peered":"2024-09-12T00:12:46.063700+0000","last_unstale":"2024-09-12T01:08:28.354255+0000","last_undegraded":"2024-09-12T01:08:28.354255+0000","last_fullsized":"2024-09-12T01:08:28.354255+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:48.139495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'4185","reported_seq":4810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.053015+0000","last_change":"2024-09-12T00:12:38.042946+0000","last_active":"2024-09-12T01:08:40.053015+0000","last_peered":"2024-09-12T01:08:40.053015+0000","last_clean":"2024-09-12T01:08:40.053015+0000","last_became_active":"2024-09-12T00:12:38.042680+0000","last_became_peered":"2024-09-12T00:12:38.042680+0000","last_unstale":"2024-09-12T01:08:40.053015+0000","last_undegraded":"2024-09-12T01:08:40.053015+0000","last_fullsized":"2024-09-12T01:08:40.053015+0000","mapping_epoch":29,"log_start":"263'4100","ondisk_log_start":"263'4100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":3000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:46.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16870,"num_read_kb":14146,"num_write":6296,"num_write_kb":3134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'308","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:38.068919+0000","last_change":"2024-09-12T00:12:36.034607+0000","last_active":"2024-09-12T01:10:38.068919+0000","last_peered":"2024-09-12T01:10:38.068919+0000","last_clean":"2024-09-12T01:10:38.068919+0000","last_became_active":"2024-09-12T00:12:36.034292+0000","last_became_peered":"2024-09-12T00:12:36.034292+0000","last_unstale":"2024-09-12T01:10:38.068919+0000","last_undegraded":"2024-09-12T01:10:38.068919+0000","last_fullsized":"2024-09-12T01:10:38.068919+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:00.939504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3147581,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":507,"num_read_kb":3622,"num_write":1211,"num_write_kb":13483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.047994+0000","last_change":"2024-09-12T00:12:40.038541+0000","last_active":"2024-09-12T01:08:40.047994+0000","last_peered":"2024-09-12T01:08:40.047994+0000","last_clean":"2024-09-12T01:08:40.047994+0000","last_became_active":"2024-09-12T00:12:40.038192+0000","last_became_peered":"2024-09-12T00:12:40.038192+0000","last_unstale":"2024-09-12T01:08:40.047994+0000","last_undegraded":"2024-09-12T01:08:40.047994+0000","last_fullsized":"2024-09-12T01:08:40.047994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:28.217627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'257","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.284251+0000","last_change":"2024-09-12T00:12:42.046891+0000","last_active":"2024-09-12T01:10:59.284251+0000","last_peered":"2024-09-12T01:10:59.284251+0000","last_clean":"2024-09-12T01:10:59.284251+0000","last_became_active":"2024-09-12T00:12:42.046589+0000","last_became_peered":"2024-09-12T00:12:42.046589+0000","last_unstale":"2024-09-12T01:10:59.284251+0000","last_undegraded":"2024-09-12T01:10:59.284251+0000","last_fullsized":"2024-09-12T01:10:59.284251+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:54.242811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53508,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":1009,"num_write":352,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030598+0000","last_change":"2024-09-12T00:12:44.057887+0000","last_active":"2024-09-12T01:06:25.030598+0000","last_peered":"2024-09-12T01:06:25.030598+0000","last_clean":"2024-09-12T01:06:25.030598+0000","last_became_active":"2024-09-12T00:12:44.057606+0000","last_became_peered":"2024-09-12T00:12:44.057606+0000","last_unstale":"2024-09-12T01:06:25.030598+0000","last_undegraded":"2024-09-12T01:06:25.030598+0000","last_fullsized":"2024-09-12T01:06:25.030598+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:25.314359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'180","reported_seq":734,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.049840+0000","last_change":"2024-09-12T00:12:38.047826+0000","last_active":"2024-09-12T01:08:55.049840+0000","last_peered":"2024-09-12T01:08:55.049840+0000","last_clean":"2024-09-12T01:08:55.049840+0000","last_became_active":"2024-09-12T00:12:38.047545+0000","last_became_peered":"2024-09-12T00:12:38.047545+0000","last_unstale":"2024-09-12T01:08:55.049840+0000","last_undegraded":"2024-09-12T01:08:55.049840+0000","last_fullsized":"2024-09-12T01:08:55.049840+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:27.324611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":815,"num_read_kb":702,"num_write":306,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'263","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:38.068757+0000","last_change":"2024-09-12T00:12:36.043322+0000","last_active":"2024-09-12T01:10:38.068757+0000","last_peered":"2024-09-12T01:10:38.068757+0000","last_clean":"2024-09-12T01:10:38.068757+0000","last_became_active":"2024-09-12T00:12:36.042983+0000","last_became_peered":"2024-09-12T00:12:36.042983+0000","last_unstale":"2024-09-12T01:10:38.068757+0000","last_undegraded":"2024-09-12T01:10:38.068757+0000","last_fullsized":"2024-09-12T01:10:38.068757+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:32.011867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4217616,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":408,"num_read_kb":13747,"num_write":994,"num_write_kb":22365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.171772+0000","last_change":"2024-09-12T00:12:40.039966+0000","last_active":"2024-09-12T01:08:50.171772+0000","last_peered":"2024-09-12T01:08:50.171772+0000","last_clean":"2024-09-12T01:08:50.171772+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:08:50.171772+0000","last_undegraded":"2024-09-12T01:08:50.171772+0000","last_fullsized":"2024-09-12T01:08:50.171772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:12.418930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'498","reported_seq":1129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.229789+0000","last_change":"2024-09-12T00:12:42.050774+0000","last_active":"2024-09-12T01:10:59.229789+0000","last_peered":"2024-09-12T01:10:59.229789+0000","last_clean":"2024-09-12T01:10:59.229789+0000","last_became_active":"2024-09-12T00:12:42.050479+0000","last_became_peered":"2024-09-12T00:12:42.050479+0000","last_unstale":"2024-09-12T01:10:59.229789+0000","last_undegraded":"2024-09-12T01:10:59.229789+0000","last_fullsized":"2024-09-12T01:10:59.229789+0000","mapping_epoch":33,"log_start":"263'400","ondisk_log_start":"263'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:54.813408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104580,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":898,"num_read_kb":2161,"num_write":774,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.134850+0000","last_change":"2024-09-12T00:12:44.061802+0000","last_active":"2024-09-12T01:07:45.134850+0000","last_peered":"2024-09-12T01:07:45.134850+0000","last_clean":"2024-09-12T01:07:45.134850+0000","last_became_active":"2024-09-12T00:12:44.061554+0000","last_became_peered":"2024-09-12T00:12:44.061554+0000","last_unstale":"2024-09-12T01:07:45.134850+0000","last_undegraded":"2024-09-12T01:07:45.134850+0000","last_fullsized":"2024-09-12T01:07:45.134850+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:41.354262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'159","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.539630+0000","last_change":"2024-09-12T00:12:46.062051+0000","last_active":"2024-09-12T01:09:22.539630+0000","last_peered":"2024-09-12T01:09:22.539630+0000","last_clean":"2024-09-12T01:09:22.539630+0000","last_became_active":"2024-09-12T00:12:46.061727+0000","last_became_peered":"2024-09-12T00:12:46.061727+0000","last_unstale":"2024-09-12T01:09:22.539630+0000","last_undegraded":"2024-09-12T01:09:22.539630+0000","last_fullsized":"2024-09-12T01:09:22.539630+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.660864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":216,"num_write":366,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'66","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.302716+0000","last_change":"2024-09-12T00:12:38.040768+0000","last_active":"2024-09-12T01:09:23.302716+0000","last_peered":"2024-09-12T01:09:23.302716+0000","last_clean":"2024-09-12T01:09:23.302716+0000","last_became_active":"2024-09-12T00:12:38.040282+0000","last_became_peered":"2024-09-12T00:12:38.040282+0000","last_unstale":"2024-09-12T01:09:23.302716+0000","last_undegraded":"2024-09-12T01:09:23.302716+0000","last_fullsized":"2024-09-12T01:09:23.302716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:50.542495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":276,"num_write":85,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'337","reported_seq":1038,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.011047+0000","last_change":"2024-09-12T00:12:36.032117+0000","last_active":"2024-09-12T01:11:00.011047+0000","last_peered":"2024-09-12T01:11:00.011047+0000","last_clean":"2024-09-12T01:11:00.011047+0000","last_became_active":"2024-09-12T00:12:36.031081+0000","last_became_peered":"2024-09-12T00:12:36.031081+0000","last_unstale":"2024-09-12T01:11:00.011047+0000","last_undegraded":"2024-09-12T01:11:00.011047+0000","last_fullsized":"2024-09-12T01:11:00.011047+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:31.633755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2145051,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":611,"num_read_kb":88556,"num_write":1067,"num_write_kb":46090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.142866+0000","last_change":"2024-09-12T00:12:40.037157+0000","last_active":"2024-09-12T01:08:55.142866+0000","last_peered":"2024-09-12T01:08:55.142866+0000","last_clean":"2024-09-12T01:08:55.142866+0000","last_became_active":"2024-09-12T00:12:40.036842+0000","last_became_peered":"2024-09-12T00:12:40.036842+0000","last_unstale":"2024-09-12T01:08:55.142866+0000","last_undegraded":"2024-09-12T01:08:55.142866+0000","last_fullsized":"2024-09-12T01:08:55.142866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:07.662805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'299","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.334820+0000","last_change":"2024-09-12T00:12:42.044141+0000","last_active":"2024-09-12T01:10:59.334820+0000","last_peered":"2024-09-12T01:10:59.334820+0000","last_clean":"2024-09-12T01:10:59.334820+0000","last_became_active":"2024-09-12T00:12:42.043681+0000","last_became_peered":"2024-09-12T00:12:42.043681+0000","last_unstale":"2024-09-12T01:10:59.334820+0000","last_undegraded":"2024-09-12T01:10:59.334820+0000","last_fullsized":"2024-09-12T01:10:59.334820+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:57.312003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58226,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":1067,"num_write":414,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042934+0000","last_change":"2024-09-12T00:12:44.058909+0000","last_active":"2024-09-12T01:07:48.042934+0000","last_peered":"2024-09-12T01:07:48.042934+0000","last_clean":"2024-09-12T01:07:48.042934+0000","last_became_active":"2024-09-12T00:12:44.058542+0000","last_became_peered":"2024-09-12T00:12:44.058542+0000","last_unstale":"2024-09-12T01:07:48.042934+0000","last_undegraded":"2024-09-12T01:07:48.042934+0000","last_fullsized":"2024-09-12T01:07:48.042934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:44.072219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'190","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.032970+0000","last_change":"2024-09-12T00:12:46.063225+0000","last_active":"2024-09-12T01:06:30.032970+0000","last_peered":"2024-09-12T01:06:30.032970+0000","last_clean":"2024-09-12T01:06:30.032970+0000","last_became_active":"2024-09-12T00:12:46.062957+0000","last_became_peered":"2024-09-12T00:12:46.062957+0000","last_unstale":"2024-09-12T01:06:30.032970+0000","last_undegraded":"2024-09-12T01:06:30.032970+0000","last_fullsized":"2024-09-12T01:06:30.032970+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.650377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":323,"num_read_kb":295,"num_write":565,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'204","reported_seq":789,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043832+0000","last_change":"2024-09-12T00:12:38.046033+0000","last_active":"2024-09-12T01:07:40.043832+0000","last_peered":"2024-09-12T01:07:40.043832+0000","last_clean":"2024-09-12T01:07:40.043832+0000","last_became_active":"2024-09-12T00:12:38.045576+0000","last_became_peered":"2024-09-12T00:12:38.045576+0000","last_unstale":"2024-09-12T01:07:40.043832+0000","last_undegraded":"2024-09-12T01:07:40.043832+0000","last_fullsized":"2024-09-12T01:07:40.043832+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:34.974243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":691,"num_write":313,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'353","reported_seq":1037,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.152808+0000","last_change":"2024-09-12T00:12:36.036793+0000","last_active":"2024-09-12T01:11:00.152808+0000","last_peered":"2024-09-12T01:11:00.152808+0000","last_clean":"2024-09-12T01:11:00.152808+0000","last_became_active":"2024-09-12T00:12:36.036446+0000","last_became_peered":"2024-09-12T00:12:36.036446+0000","last_unstale":"2024-09-12T01:11:00.152808+0000","last_undegraded":"2024-09-12T01:11:00.152808+0000","last_fullsized":"2024-09-12T01:11:00.152808+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:19.859949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434692,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":621,"num_read_kb":64541,"num_write":1186,"num_write_kb":11770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134208+0000","last_change":"2024-09-12T00:12:40.030166+0000","last_active":"2024-09-12T01:07:40.134208+0000","last_peered":"2024-09-12T01:07:40.134208+0000","last_clean":"2024-09-12T01:07:40.134208+0000","last_became_active":"2024-09-12T00:12:40.029908+0000","last_became_peered":"2024-09-12T00:12:40.029908+0000","last_unstale":"2024-09-12T01:07:40.134208+0000","last_undegraded":"2024-09-12T01:07:40.134208+0000","last_fullsized":"2024-09-12T01:07:40.134208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:24.945019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'279","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.234407+0000","last_change":"2024-09-12T00:12:42.050883+0000","last_active":"2024-09-12T01:10:58.234407+0000","last_peered":"2024-09-12T01:10:58.234407+0000","last_clean":"2024-09-12T01:10:58.234407+0000","last_became_active":"2024-09-12T00:12:42.050599+0000","last_became_peered":"2024-09-12T00:12:42.050599+0000","last_unstale":"2024-09-12T01:10:58.234407+0000","last_undegraded":"2024-09-12T01:10:58.234407+0000","last_fullsized":"2024-09-12T01:10:58.234407+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:27.986140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50970,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":947,"num_write":354,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.055691+0000","last_change":"2024-09-12T00:12:44.062691+0000","last_active":"2024-09-12T01:08:55.055691+0000","last_peered":"2024-09-12T01:08:55.055691+0000","last_clean":"2024-09-12T01:08:55.055691+0000","last_became_active":"2024-09-12T00:12:44.062419+0000","last_became_peered":"2024-09-12T00:12:44.062419+0000","last_unstale":"2024-09-12T01:08:55.055691+0000","last_undegraded":"2024-09-12T01:08:55.055691+0000","last_fullsized":"2024-09-12T01:08:55.055691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.349610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'183","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.002642+0000","last_change":"2024-09-12T00:12:46.067271+0000","last_active":"2024-09-12T01:10:33.002642+0000","last_peered":"2024-09-12T01:10:33.002642+0000","last_clean":"2024-09-12T01:10:33.002642+0000","last_became_active":"2024-09-12T00:12:46.066977+0000","last_became_peered":"2024-09-12T00:12:46.066977+0000","last_unstale":"2024-09-12T01:10:33.002642+0000","last_undegraded":"2024-09-12T01:10:33.002642+0000","last_fullsized":"2024-09-12T01:10:33.002642+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:28.610163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":141,"num_write":422,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'58","reported_seq":591,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043831+0000","last_change":"2024-09-12T00:12:38.044154+0000","last_active":"2024-09-12T01:07:40.043831+0000","last_peered":"2024-09-12T01:07:40.043831+0000","last_clean":"2024-09-12T01:07:40.043831+0000","last_became_active":"2024-09-12T00:12:38.043886+0000","last_became_peered":"2024-09-12T00:12:38.043886+0000","last_unstale":"2024-09-12T01:07:40.043831+0000","last_undegraded":"2024-09-12T01:07:40.043831+0000","last_fullsized":"2024-09-12T01:07:40.043831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:23.214032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":197,"num_write":99,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'358","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.994108+0000","last_change":"2024-09-12T00:12:36.031024+0000","last_active":"2024-09-12T01:10:59.994108+0000","last_peered":"2024-09-12T01:10:59.994108+0000","last_clean":"2024-09-12T01:10:59.994108+0000","last_became_active":"2024-09-12T00:12:36.030663+0000","last_became_peered":"2024-09-12T00:12:36.030663+0000","last_unstale":"2024-09-12T01:10:59.994108+0000","last_undegraded":"2024-09-12T01:10:59.994108+0000","last_fullsized":"2024-09-12T01:10:59.994108+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:04.337764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4762923,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":486,"num_read_kb":3753,"num_write":1103,"num_write_kb":36132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043857+0000","last_change":"2024-09-12T00:12:40.040334+0000","last_active":"2024-09-12T01:07:40.043857+0000","last_peered":"2024-09-12T01:07:40.043857+0000","last_clean":"2024-09-12T01:07:40.043857+0000","last_became_active":"2024-09-12T00:12:40.040095+0000","last_became_peered":"2024-09-12T00:12:40.040095+0000","last_unstale":"2024-09-12T01:07:40.043857+0000","last_undegraded":"2024-09-12T01:07:40.043857+0000","last_fullsized":"2024-09-12T01:07:40.043857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:14.746788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'104","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.050614+0000","last_change":"2024-09-12T00:12:42.043827+0000","last_active":"2024-09-12T01:09:00.050614+0000","last_peered":"2024-09-12T01:09:00.050614+0000","last_clean":"2024-09-12T01:09:00.050614+0000","last_became_active":"2024-09-12T00:12:42.043492+0000","last_became_peered":"2024-09-12T00:12:42.043492+0000","last_unstale":"2024-09-12T01:09:00.050614+0000","last_undegraded":"2024-09-12T01:09:00.050614+0000","last_fullsized":"2024-09-12T01:09:00.050614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:42.505398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":110,"num_read_kb":100,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'766","reported_seq":2175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.627821+0000","last_change":"2024-09-12T00:12:44.054520+0000","last_active":"2024-09-12T01:10:59.627821+0000","last_peered":"2024-09-12T01:10:59.627821+0000","last_clean":"2024-09-12T01:10:59.627821+0000","last_became_active":"2024-09-12T00:12:44.054237+0000","last_became_peered":"2024-09-12T00:12:44.054237+0000","last_unstale":"2024-09-12T01:10:59.627821+0000","last_undegraded":"2024-09-12T01:10:59.627821+0000","last_fullsized":"2024-09-12T01:10:59.627821+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:52.613881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'121","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.977988+0000","last_change":"2024-09-12T00:12:46.061987+0000","last_active":"2024-09-12T01:08:19.977988+0000","last_peered":"2024-09-12T01:08:19.977988+0000","last_clean":"2024-09-12T01:08:19.977988+0000","last_became_active":"2024-09-12T00:12:46.061673+0000","last_became_peered":"2024-09-12T00:12:46.061673+0000","last_unstale":"2024-09-12T01:08:19.977988+0000","last_undegraded":"2024-09-12T01:08:19.977988+0000","last_fullsized":"2024-09-12T01:08:19.977988+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:08.970829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'432","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134186+0000","last_change":"2024-09-12T00:12:38.029773+0000","last_active":"2024-09-12T01:07:40.134186+0000","last_peered":"2024-09-12T01:07:40.134186+0000","last_clean":"2024-09-12T01:07:40.134186+0000","last_became_active":"2024-09-12T00:12:38.029483+0000","last_became_peered":"2024-09-12T00:12:38.029483+0000","last_unstale":"2024-09-12T01:07:40.134186+0000","last_undegraded":"2024-09-12T01:07:40.134186+0000","last_fullsized":"2024-09-12T01:07:40.134186+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:54.184567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1848,"num_read_kb":1460,"num_write":651,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'351","reported_seq":958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.190669+0000","last_change":"2024-09-12T00:12:36.034572+0000","last_active":"2024-09-12T01:11:00.190669+0000","last_peered":"2024-09-12T01:11:00.190669+0000","last_clean":"2024-09-12T01:11:00.190669+0000","last_became_active":"2024-09-12T00:12:36.034259+0000","last_became_peered":"2024-09-12T00:12:36.034259+0000","last_unstale":"2024-09-12T01:11:00.190669+0000","last_undegraded":"2024-09-12T01:11:00.190669+0000","last_fullsized":"2024-09-12T01:11:00.190669+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:05.093712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":12694,"num_write":1067,"num_write_kb":34924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.234299+0000","last_change":"2024-09-12T00:12:40.034568+0000","last_active":"2024-09-12T01:07:40.234299+0000","last_peered":"2024-09-12T01:07:40.234299+0000","last_clean":"2024-09-12T01:07:40.234299+0000","last_became_active":"2024-09-12T00:12:40.034301+0000","last_became_peered":"2024-09-12T00:12:40.034301+0000","last_unstale":"2024-09-12T01:07:40.234299+0000","last_undegraded":"2024-09-12T01:07:40.234299+0000","last_fullsized":"2024-09-12T01:07:40.234299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:22.089148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'367","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.597558+0000","last_change":"2024-09-12T00:12:42.044477+0000","last_active":"2024-09-12T01:10:58.597558+0000","last_peered":"2024-09-12T01:10:58.597558+0000","last_clean":"2024-09-12T01:10:58.597558+0000","last_became_active":"2024-09-12T00:12:42.044154+0000","last_became_peered":"2024-09-12T00:12:42.044154+0000","last_unstale":"2024-09-12T01:10:58.597558+0000","last_undegraded":"2024-09-12T01:10:58.597558+0000","last_fullsized":"2024-09-12T01:10:58.597558+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:59.538243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51621,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":561,"num_read_kb":1137,"num_write":454,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.049637+0000","last_change":"2024-09-12T00:12:44.060009+0000","last_active":"2024-09-12T01:08:20.049637+0000","last_peered":"2024-09-12T01:08:20.049637+0000","last_clean":"2024-09-12T01:08:20.049637+0000","last_became_active":"2024-09-12T00:12:44.059671+0000","last_became_peered":"2024-09-12T00:12:44.059671+0000","last_unstale":"2024-09-12T01:08:20.049637+0000","last_undegraded":"2024-09-12T01:08:20.049637+0000","last_fullsized":"2024-09-12T01:08:20.049637+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:58.980993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'125","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.596906+0000","last_change":"2024-09-12T00:12:46.067043+0000","last_active":"2024-09-12T01:09:20.596906+0000","last_peered":"2024-09-12T01:09:20.596906+0000","last_clean":"2024-09-12T01:09:20.596906+0000","last_became_active":"2024-09-12T00:12:46.066777+0000","last_became_peered":"2024-09-12T00:12:46.066777+0000","last_unstale":"2024-09-12T01:09:20.596906+0000","last_undegraded":"2024-09-12T01:09:20.596906+0000","last_fullsized":"2024-09-12T01:09:20.596906+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:01.876836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":239,"num_read_kb":208,"num_write":345,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'510","reported_seq":1326,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134147+0000","last_change":"2024-09-12T00:12:38.040248+0000","last_active":"2024-09-12T01:07:40.134147+0000","last_peered":"2024-09-12T01:07:40.134147+0000","last_clean":"2024-09-12T01:07:40.134147+0000","last_became_active":"2024-09-12T00:12:38.039996+0000","last_became_peered":"2024-09-12T00:12:38.039996+0000","last_unstale":"2024-09-12T01:07:40.134147+0000","last_undegraded":"2024-09-12T01:07:40.134147+0000","last_fullsized":"2024-09-12T01:07:40.134147+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:17.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2706,"num_read_kb":2334,"num_write":934,"num_write_kb":583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'296","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.033599+0000","last_change":"2024-09-12T00:12:36.030460+0000","last_active":"2024-09-12T01:11:00.033599+0000","last_peered":"2024-09-12T01:11:00.033599+0000","last_clean":"2024-09-12T01:11:00.033599+0000","last_became_active":"2024-09-12T00:12:36.029998+0000","last_became_peered":"2024-09-12T00:12:36.029998+0000","last_unstale":"2024-09-12T01:11:00.033599+0000","last_undegraded":"2024-09-12T01:11:00.033599+0000","last_fullsized":"2024-09-12T01:11:00.033599+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:09.569791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":562,"num_read_kb":3980,"num_write":921,"num_write_kb":28798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134195+0000","last_change":"2024-09-12T00:12:40.039109+0000","last_active":"2024-09-12T01:07:40.134195+0000","last_peered":"2024-09-12T01:07:40.134195+0000","last_clean":"2024-09-12T01:07:40.134195+0000","last_became_active":"2024-09-12T00:12:40.038037+0000","last_became_peered":"2024-09-12T00:12:40.038037+0000","last_unstale":"2024-09-12T01:07:40.134195+0000","last_undegraded":"2024-09-12T01:07:40.134195+0000","last_fullsized":"2024-09-12T01:07:40.134195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:11.329535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'284","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.667784+0000","last_change":"2024-09-12T00:12:42.047201+0000","last_active":"2024-09-12T01:10:58.667784+0000","last_peered":"2024-09-12T01:10:58.667784+0000","last_clean":"2024-09-12T01:10:58.667784+0000","last_became_active":"2024-09-12T00:12:42.046917+0000","last_became_peered":"2024-09-12T00:12:42.046917+0000","last_unstale":"2024-09-12T01:10:58.667784+0000","last_undegraded":"2024-09-12T01:10:58.667784+0000","last_fullsized":"2024-09-12T01:10:58.667784+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:26.130504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46808,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1160,"num_write":400,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.047451+0000","last_change":"2024-09-12T00:12:44.058423+0000","last_active":"2024-09-12T01:08:35.047451+0000","last_peered":"2024-09-12T01:08:35.047451+0000","last_clean":"2024-09-12T01:08:35.047451+0000","last_became_active":"2024-09-12T00:12:44.058006+0000","last_became_peered":"2024-09-12T00:12:44.058006+0000","last_unstale":"2024-09-12T01:08:35.047451+0000","last_undegraded":"2024-09-12T01:08:35.047451+0000","last_fullsized":"2024-09-12T01:08:35.047451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:01.738470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'117","reported_seq":622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.048235+0000","last_change":"2024-09-12T00:12:46.065323+0000","last_active":"2024-09-12T01:08:23.048235+0000","last_peered":"2024-09-12T01:08:23.048235+0000","last_clean":"2024-09-12T01:08:23.048235+0000","last_became_active":"2024-09-12T00:12:46.064988+0000","last_became_peered":"2024-09-12T00:12:46.064988+0000","last_unstale":"2024-09-12T01:08:23.048235+0000","last_undegraded":"2024-09-12T01:08:23.048235+0000","last_fullsized":"2024-09-12T01:08:23.048235+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:07.524788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":147,"num_write":261,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'320","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.050462+0000","last_change":"2024-09-12T00:12:38.042896+0000","last_active":"2024-09-12T01:08:25.050462+0000","last_peered":"2024-09-12T01:08:25.050462+0000","last_clean":"2024-09-12T01:08:25.050462+0000","last_became_active":"2024-09-12T00:12:38.042565+0000","last_became_peered":"2024-09-12T00:12:38.042565+0000","last_unstale":"2024-09-12T01:08:25.050462+0000","last_undegraded":"2024-09-12T01:08:25.050462+0000","last_fullsized":"2024-09-12T01:08:25.050462+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:20.595221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1481,"num_read_kb":1253,"num_write":527,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'304","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.953367+0000","last_change":"2024-09-12T00:12:36.042891+0000","last_active":"2024-09-12T01:10:57.953367+0000","last_peered":"2024-09-12T01:10:57.953367+0000","last_clean":"2024-09-12T01:10:57.953367+0000","last_became_active":"2024-09-12T00:12:36.042198+0000","last_became_peered":"2024-09-12T00:12:36.042198+0000","last_unstale":"2024-09-12T01:10:57.953367+0000","last_undegraded":"2024-09-12T01:10:57.953367+0000","last_fullsized":"2024-09-12T01:10:57.953367+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:27.004848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13171441,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":436,"num_read_kb":61057,"num_write":1068,"num_write_kb":53442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.237962+0000","last_change":"2024-09-12T00:12:40.032609+0000","last_active":"2024-09-12T01:08:15.237962+0000","last_peered":"2024-09-12T01:08:15.237962+0000","last_clean":"2024-09-12T01:08:15.237962+0000","last_became_active":"2024-09-12T00:12:40.032284+0000","last_became_peered":"2024-09-12T00:12:40.032284+0000","last_unstale":"2024-09-12T01:08:15.237962+0000","last_undegraded":"2024-09-12T01:08:15.237962+0000","last_fullsized":"2024-09-12T01:08:15.237962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:20.113080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'254","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.158767+0000","last_change":"2024-09-12T00:12:42.051390+0000","last_active":"2024-09-12T01:11:00.158767+0000","last_peered":"2024-09-12T01:11:00.158767+0000","last_clean":"2024-09-12T01:11:00.158767+0000","last_became_active":"2024-09-12T00:12:42.051133+0000","last_became_peered":"2024-09-12T00:12:42.051133+0000","last_unstale":"2024-09-12T01:11:00.158767+0000","last_undegraded":"2024-09-12T01:11:00.158767+0000","last_fullsized":"2024-09-12T01:11:00.158767+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:39.225249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63093,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":419,"num_read_kb":962,"num_write":347,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041676+0000","last_change":"2024-09-12T00:12:44.060747+0000","last_active":"2024-09-12T01:07:45.041676+0000","last_peered":"2024-09-12T01:07:45.041676+0000","last_clean":"2024-09-12T01:07:45.041676+0000","last_became_active":"2024-09-12T00:12:44.060464+0000","last_became_peered":"2024-09-12T00:12:44.060464+0000","last_unstale":"2024-09-12T01:07:45.041676+0000","last_undegraded":"2024-09-12T01:07:45.041676+0000","last_fullsized":"2024-09-12T01:07:45.041676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:56.068981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'150","reported_seq":1608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.570464+0000","last_change":"2024-09-12T00:12:46.064822+0000","last_active":"2024-09-12T01:09:20.570464+0000","last_peered":"2024-09-12T01:09:20.570464+0000","last_clean":"2024-09-12T01:09:20.570464+0000","last_became_active":"2024-09-12T00:12:46.064565+0000","last_became_peered":"2024-09-12T00:12:46.064565+0000","last_unstale":"2024-09-12T01:09:20.570464+0000","last_undegraded":"2024-09-12T01:09:20.570464+0000","last_fullsized":"2024-09-12T01:09:20.570464+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:23.873971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1152,"num_read_kb":1150,"num_write":337,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'89","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.137995+0000","last_change":"2024-09-12T00:12:38.038149+0000","last_active":"2024-09-12T01:08:15.137995+0000","last_peered":"2024-09-12T01:08:15.137995+0000","last_clean":"2024-09-12T01:08:15.137995+0000","last_became_active":"2024-09-12T00:12:38.037860+0000","last_became_peered":"2024-09-12T00:12:38.037860+0000","last_unstale":"2024-09-12T01:08:15.137995+0000","last_undegraded":"2024-09-12T01:08:15.137995+0000","last_fullsized":"2024-09-12T01:08:15.137995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:24.535343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":333,"num_write":131,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'255","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.053092+0000","last_change":"2024-09-12T00:12:36.042368+0000","last_active":"2024-09-12T01:08:53.053092+0000","last_peered":"2024-09-12T01:08:53.053092+0000","last_clean":"2024-09-12T01:08:53.053092+0000","last_became_active":"2024-09-12T00:12:36.041860+0000","last_became_peered":"2024-09-12T00:12:36.041860+0000","last_unstale":"2024-09-12T01:08:53.053092+0000","last_undegraded":"2024-09-12T01:08:53.053092+0000","last_fullsized":"2024-09-12T01:08:53.053092+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:01.561434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6163646,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":308,"num_read_kb":7017,"num_write":926,"num_write_kb":36211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"32'1","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.050491+0000","last_change":"2024-09-12T00:12:40.039492+0000","last_active":"2024-09-12T01:08:25.050491+0000","last_peered":"2024-09-12T01:08:25.050491+0000","last_clean":"2024-09-12T01:08:25.050491+0000","last_became_active":"2024-09-12T00:12:40.039196+0000","last_became_peered":"2024-09-12T00:12:40.039196+0000","last_unstale":"2024-09-12T01:08:25.050491+0000","last_undegraded":"2024-09-12T01:08:25.050491+0000","last_fullsized":"2024-09-12T01:08:25.050491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:03.281450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'344","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.301784+0000","last_change":"2024-09-12T00:12:42.039343+0000","last_active":"2024-09-12T01:10:58.301784+0000","last_peered":"2024-09-12T01:10:58.301784+0000","last_clean":"2024-09-12T01:10:58.301784+0000","last_became_active":"2024-09-12T00:12:42.039068+0000","last_became_peered":"2024-09-12T00:12:42.039068+0000","last_unstale":"2024-09-12T01:10:58.301784+0000","last_undegraded":"2024-09-12T01:10:58.301784+0000","last_fullsized":"2024-09-12T01:10:58.301784+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:19.273390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44473,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":544,"num_read_kb":1176,"num_write":442,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044483+0000","last_change":"2024-09-12T00:12:44.064609+0000","last_active":"2024-09-12T01:07:45.044483+0000","last_peered":"2024-09-12T01:07:45.044483+0000","last_clean":"2024-09-12T01:07:45.044483+0000","last_became_active":"2024-09-12T00:12:44.064105+0000","last_became_peered":"2024-09-12T00:12:44.064105+0000","last_unstale":"2024-09-12T01:07:45.044483+0000","last_undegraded":"2024-09-12T01:07:45.044483+0000","last_fullsized":"2024-09-12T01:07:45.044483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:34.680066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'146","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.794252+0000","last_change":"2024-09-12T00:12:46.054136+0000","last_active":"2024-09-12T01:10:31.794252+0000","last_peered":"2024-09-12T01:10:31.794252+0000","last_clean":"2024-09-12T01:10:31.794252+0000","last_became_active":"2024-09-12T00:12:46.053763+0000","last_became_peered":"2024-09-12T00:12:46.053763+0000","last_unstale":"2024-09-12T01:10:31.794252+0000","last_undegraded":"2024-09-12T01:10:31.794252+0000","last_fullsized":"2024-09-12T01:10:31.794252+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:31.432295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":382,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'137","reported_seq":721,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.975539+0000","last_change":"2024-09-12T00:12:38.044545+0000","last_active":"2024-09-12T01:08:19.975539+0000","last_peered":"2024-09-12T01:08:19.975539+0000","last_clean":"2024-09-12T01:08:19.975539+0000","last_became_active":"2024-09-12T00:12:38.044285+0000","last_became_peered":"2024-09-12T00:12:38.044285+0000","last_unstale":"2024-09-12T01:08:19.975539+0000","last_undegraded":"2024-09-12T01:08:19.975539+0000","last_fullsized":"2024-09-12T01:08:19.975539+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:05.907607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":475,"num_write":234,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'395","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.117988+0000","last_change":"2024-09-12T00:12:36.037087+0000","last_active":"2024-09-12T01:11:00.117988+0000","last_peered":"2024-09-12T01:11:00.117988+0000","last_clean":"2024-09-12T01:11:00.117988+0000","last_became_active":"2024-09-12T00:12:36.036773+0000","last_became_peered":"2024-09-12T00:12:36.036773+0000","last_unstale":"2024-09-12T01:11:00.117988+0000","last_undegraded":"2024-09-12T01:11:00.117988+0000","last_fullsized":"2024-09-12T01:11:00.117988+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:15.783771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262269,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":604,"num_read_kb":16738,"num_write":1143,"num_write_kb":32233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'47","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.460370+0000","last_change":"2024-09-12T00:12:38.037279+0000","last_active":"2024-09-12T01:08:08.460370+0000","last_peered":"2024-09-12T01:08:08.460370+0000","last_clean":"2024-09-12T01:08:08.460370+0000","last_became_active":"2024-09-12T00:12:38.036978+0000","last_became_peered":"2024-09-12T00:12:38.036978+0000","last_unstale":"2024-09-12T01:08:08.460370+0000","last_undegraded":"2024-09-12T01:08:08.460370+0000","last_fullsized":"2024-09-12T01:08:08.460370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:21.347370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":60,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'326","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.053846+0000","last_change":"2024-09-12T00:12:36.035846+0000","last_active":"2024-09-12T01:11:00.053846+0000","last_peered":"2024-09-12T01:11:00.053846+0000","last_clean":"2024-09-12T01:11:00.053846+0000","last_became_active":"2024-09-12T00:12:36.035112+0000","last_became_peered":"2024-09-12T00:12:36.035112+0000","last_unstale":"2024-09-12T01:11:00.053846+0000","last_undegraded":"2024-09-12T01:11:00.053846+0000","last_fullsized":"2024-09-12T01:11:00.053846+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:21.404926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22700,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":484,"num_read_kb":34939,"num_write":1092,"num_write_kb":28471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'137","reported_seq":769,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.101896+0000","last_change":"2024-09-12T00:12:38.040495+0000","last_active":"2024-09-12T01:07:43.101896+0000","last_peered":"2024-09-12T01:07:43.101896+0000","last_clean":"2024-09-12T01:07:43.101896+0000","last_became_active":"2024-09-12T00:12:38.040144+0000","last_became_peered":"2024-09-12T00:12:38.040144+0000","last_unstale":"2024-09-12T01:07:43.101896+0000","last_undegraded":"2024-09-12T01:07:43.101896+0000","last_fullsized":"2024-09-12T01:07:43.101896+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.698332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":511,"num_write":216,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'313","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.066616+0000","last_change":"2024-09-12T00:12:36.038607+0000","last_active":"2024-09-12T01:11:00.066616+0000","last_peered":"2024-09-12T01:11:00.066616+0000","last_clean":"2024-09-12T01:11:00.066616+0000","last_became_active":"2024-09-12T00:12:36.035558+0000","last_became_peered":"2024-09-12T00:12:36.035558+0000","last_unstale":"2024-09-12T01:11:00.066616+0000","last_undegraded":"2024-09-12T01:11:00.066616+0000","last_fullsized":"2024-09-12T01:11:00.066616+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:48.869269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289743,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":437,"num_read_kb":7821,"num_write":960,"num_write_kb":22426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'275","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:48.033948+0000","last_change":"2024-09-12T00:12:38.026451+0000","last_active":"2024-09-12T01:06:48.033948+0000","last_peered":"2024-09-12T01:06:48.033948+0000","last_clean":"2024-09-12T01:06:48.033948+0000","last_became_active":"2024-09-12T00:12:38.026109+0000","last_became_peered":"2024-09-12T00:12:38.026109+0000","last_unstale":"2024-09-12T01:06:48.033948+0000","last_undegraded":"2024-09-12T01:06:48.033948+0000","last_fullsized":"2024-09-12T01:06:48.033948+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:18.043515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1270,"num_read_kb":1040,"num_write":446,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'276","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.949069+0000","last_change":"2024-09-12T00:12:36.033841+0000","last_active":"2024-09-12T01:10:57.949069+0000","last_peered":"2024-09-12T01:10:57.949069+0000","last_clean":"2024-09-12T01:10:57.949069+0000","last_became_active":"2024-09-12T00:12:36.033426+0000","last_became_peered":"2024-09-12T00:12:36.033426+0000","last_unstale":"2024-09-12T01:10:57.949069+0000","last_undegraded":"2024-09-12T01:10:57.949069+0000","last_fullsized":"2024-09-12T01:10:57.949069+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:43.664314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8725093,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":380,"num_read_kb":19382,"num_write":896,"num_write_kb":44169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'4265","reported_seq":4908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.043610+0000","last_change":"2024-09-12T00:12:38.028635+0000","last_active":"2024-09-12T01:08:12.043610+0000","last_peered":"2024-09-12T01:08:12.043610+0000","last_clean":"2024-09-12T01:08:12.043610+0000","last_became_active":"2024-09-12T00:12:38.028401+0000","last_became_peered":"2024-09-12T00:12:38.028401+0000","last_unstale":"2024-09-12T01:08:12.043610+0000","last_undegraded":"2024-09-12T01:08:12.043610+0000","last_fullsized":"2024-09-12T01:08:12.043610+0000","mapping_epoch":29,"log_start":"263'4200","ondisk_log_start":"263'4200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":3000,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17227,"num_read_kb":14428,"num_write":6422,"num_write_kb":3205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'322","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.162654+0000","last_change":"2024-09-12T00:12:36.032699+0000","last_active":"2024-09-12T01:11:00.162654+0000","last_peered":"2024-09-12T01:11:00.162654+0000","last_clean":"2024-09-12T01:11:00.162654+0000","last_became_active":"2024-09-12T00:12:36.032341+0000","last_became_peered":"2024-09-12T00:12:36.032341+0000","last_unstale":"2024-09-12T01:11:00.162654+0000","last_undegraded":"2024-09-12T01:11:00.162654+0000","last_fullsized":"2024-09-12T01:11:00.162654+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.087075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6778169,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":506,"num_read_kb":66123,"num_write":1053,"num_write_kb":26739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'149","reported_seq":729,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.036066+0000","last_change":"2024-09-12T00:12:38.043531+0000","last_active":"2024-09-12T01:08:55.036066+0000","last_peered":"2024-09-12T01:08:55.036066+0000","last_clean":"2024-09-12T01:08:55.036066+0000","last_became_active":"2024-09-12T00:12:38.043276+0000","last_became_peered":"2024-09-12T00:12:38.043276+0000","last_unstale":"2024-09-12T01:08:55.036066+0000","last_undegraded":"2024-09-12T01:08:55.036066+0000","last_fullsized":"2024-09-12T01:08:55.036066+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:16.032522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":632,"num_read_kb":523,"num_write":222,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'309","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.152087+0000","last_change":"2024-09-12T00:12:36.030036+0000","last_active":"2024-09-12T01:11:00.152087+0000","last_peered":"2024-09-12T01:11:00.152087+0000","last_clean":"2024-09-12T01:11:00.152087+0000","last_became_active":"2024-09-12T00:12:36.029687+0000","last_became_peered":"2024-09-12T00:12:36.029687+0000","last_unstale":"2024-09-12T01:11:00.152087+0000","last_undegraded":"2024-09-12T01:11:00.152087+0000","last_fullsized":"2024-09-12T01:11:00.152087+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:58.296237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":442,"num_read_kb":12036,"num_write":1039,"num_write_kb":29691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'211","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.172500+0000","last_change":"2024-09-12T00:12:38.047873+0000","last_active":"2024-09-12T01:08:55.172500+0000","last_peered":"2024-09-12T01:08:55.172500+0000","last_clean":"2024-09-12T01:08:55.172500+0000","last_became_active":"2024-09-12T00:12:38.047575+0000","last_became_peered":"2024-09-12T00:12:38.047575+0000","last_unstale":"2024-09-12T01:08:55.172500+0000","last_undegraded":"2024-09-12T01:08:55.172500+0000","last_fullsized":"2024-09-12T01:08:55.172500+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:28.383492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":952,"num_read_kb":776,"num_write":336,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'363","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.088652+0000","last_change":"2024-09-12T00:12:36.044107+0000","last_active":"2024-09-12T01:11:00.088652+0000","last_peered":"2024-09-12T01:11:00.088652+0000","last_clean":"2024-09-12T01:11:00.088652+0000","last_became_active":"2024-09-12T00:12:36.043803+0000","last_became_peered":"2024-09-12T00:12:36.043803+0000","last_unstale":"2024-09-12T01:11:00.088652+0000","last_undegraded":"2024-09-12T01:11:00.088652+0000","last_fullsized":"2024-09-12T01:11:00.088652+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:42.820031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":462,"num_read_kb":37298,"num_write":1151,"num_write_kb":54766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'143","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.242332+0000","last_change":"2024-09-12T00:12:38.036740+0000","last_active":"2024-09-12T01:08:55.242332+0000","last_peered":"2024-09-12T01:08:55.242332+0000","last_clean":"2024-09-12T01:08:55.242332+0000","last_became_active":"2024-09-12T00:12:38.036463+0000","last_became_peered":"2024-09-12T00:12:38.036463+0000","last_unstale":"2024-09-12T01:08:55.242332+0000","last_undegraded":"2024-09-12T01:08:55.242332+0000","last_fullsized":"2024-09-12T01:08:55.242332+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:20.504629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":509,"num_write":213,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'234","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.143680+0000","last_change":"2024-09-12T00:12:36.042056+0000","last_active":"2024-09-12T01:08:25.143680+0000","last_peered":"2024-09-12T01:08:25.143680+0000","last_clean":"2024-09-12T01:08:25.143680+0000","last_became_active":"2024-09-12T00:12:36.041392+0000","last_became_peered":"2024-09-12T00:12:36.041392+0000","last_unstale":"2024-09-12T01:08:25.143680+0000","last_undegraded":"2024-09-12T01:08:25.143680+0000","last_fullsized":"2024-09-12T01:08:25.143680+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:58.023567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11430218,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":354,"num_read_kb":23602,"num_write":959,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'133","reported_seq":753,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.561904+0000","last_change":"2024-09-12T00:12:38.043147+0000","last_active":"2024-09-12T01:09:22.561904+0000","last_peered":"2024-09-12T01:09:22.561904+0000","last_clean":"2024-09-12T01:09:22.561904+0000","last_became_active":"2024-09-12T00:12:38.042584+0000","last_became_peered":"2024-09-12T00:12:38.042584+0000","last_unstale":"2024-09-12T01:09:22.561904+0000","last_undegraded":"2024-09-12T01:09:22.561904+0000","last_fullsized":"2024-09-12T01:09:22.561904+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:40.303117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":632,"num_read_kb":533,"num_write":194,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'378","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.998278+0000","last_change":"2024-09-12T00:12:36.037876+0000","last_active":"2024-09-12T01:10:59.998278+0000","last_peered":"2024-09-12T01:10:59.998278+0000","last_clean":"2024-09-12T01:10:59.998278+0000","last_became_active":"2024-09-12T00:12:36.037461+0000","last_became_peered":"2024-09-12T00:12:36.037461+0000","last_unstale":"2024-09-12T01:10:59.998278+0000","last_undegraded":"2024-09-12T01:10:59.998278+0000","last_fullsized":"2024-09-12T01:10:59.998278+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:05.562845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262352,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":611,"num_read_kb":9826,"num_write":1246,"num_write_kb":32499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'308","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.034557+0000","last_change":"2024-09-12T00:12:38.037217+0000","last_active":"2024-09-12T01:08:40.034557+0000","last_peered":"2024-09-12T01:08:40.034557+0000","last_clean":"2024-09-12T01:08:40.034557+0000","last_became_active":"2024-09-12T00:12:38.036872+0000","last_became_peered":"2024-09-12T00:12:38.036872+0000","last_unstale":"2024-09-12T01:08:40.034557+0000","last_undegraded":"2024-09-12T01:08:40.034557+0000","last_fullsized":"2024-09-12T01:08:40.034557+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:45.277008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1112,"num_write":459,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'290","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.937493+0000","last_change":"2024-09-12T00:12:36.042921+0000","last_active":"2024-09-12T01:10:57.937493+0000","last_peered":"2024-09-12T01:10:57.937493+0000","last_clean":"2024-09-12T01:10:57.937493+0000","last_became_active":"2024-09-12T00:12:36.042159+0000","last_became_peered":"2024-09-12T00:12:36.042159+0000","last_unstale":"2024-09-12T01:10:57.937493+0000","last_undegraded":"2024-09-12T01:10:57.937493+0000","last_fullsized":"2024-09-12T01:10:57.937493+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:47.107719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1320302,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":462,"num_read_kb":43498,"num_write":1153,"num_write_kb":41544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'313","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.061449+0000","last_change":"2024-09-12T00:12:38.045246+0000","last_active":"2024-09-12T01:08:10.061449+0000","last_peered":"2024-09-12T01:08:10.061449+0000","last_clean":"2024-09-12T01:08:10.061449+0000","last_became_active":"2024-09-12T00:12:38.042966+0000","last_became_peered":"2024-09-12T00:12:38.042966+0000","last_unstale":"2024-09-12T01:08:10.061449+0000","last_undegraded":"2024-09-12T01:08:10.061449+0000","last_fullsized":"2024-09-12T01:08:10.061449+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:43.848333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1467,"num_read_kb":1262,"num_write":468,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'377","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.212240+0000","last_change":"2024-09-12T00:12:36.027754+0000","last_active":"2024-09-12T01:11:00.212240+0000","last_peered":"2024-09-12T01:11:00.212240+0000","last_clean":"2024-09-12T01:11:00.212240+0000","last_became_active":"2024-09-12T00:12:36.027423+0000","last_became_peered":"2024-09-12T00:12:36.027423+0000","last_unstale":"2024-09-12T01:11:00.212240+0000","last_undegraded":"2024-09-12T01:11:00.212240+0000","last_fullsized":"2024-09-12T01:11:00.212240+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:36.409512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730133,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":69052,"num_write":1173,"num_write_kb":46135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'156","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.227992+0000","last_change":"2024-09-12T00:12:38.036518+0000","last_active":"2024-09-12T01:06:40.227992+0000","last_peered":"2024-09-12T01:06:40.227992+0000","last_clean":"2024-09-12T01:06:40.227992+0000","last_became_active":"2024-09-12T00:12:38.036235+0000","last_became_peered":"2024-09-12T00:12:38.036235+0000","last_unstale":"2024-09-12T01:06:40.227992+0000","last_undegraded":"2024-09-12T01:06:40.227992+0000","last_fullsized":"2024-09-12T01:06:40.227992+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:14.890009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":550,"num_write":221,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'457","reported_seq":1274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.017483+0000","last_change":"2024-09-12T00:12:36.038795+0000","last_active":"2024-09-12T01:11:00.017483+0000","last_peered":"2024-09-12T01:11:00.017483+0000","last_clean":"2024-09-12T01:11:00.017483+0000","last_became_active":"2024-09-12T00:12:36.038449+0000","last_became_peered":"2024-09-12T00:12:36.038449+0000","last_unstale":"2024-09-12T01:11:00.017483+0000","last_undegraded":"2024-09-12T01:11:00.017483+0000","last_fullsized":"2024-09-12T01:11:00.017483+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:36.774240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5288434,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":1077,"num_read_kb":25378,"num_write":1466,"num_write_kb":31172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'189","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.227982+0000","last_change":"2024-09-12T00:12:38.042951+0000","last_active":"2024-09-12T01:06:40.227982+0000","last_peered":"2024-09-12T01:06:40.227982+0000","last_clean":"2024-09-12T01:06:40.227982+0000","last_became_active":"2024-09-12T00:12:38.042691+0000","last_became_peered":"2024-09-12T00:12:38.042691+0000","last_unstale":"2024-09-12T01:06:40.227982+0000","last_undegraded":"2024-09-12T01:06:40.227982+0000","last_fullsized":"2024-09-12T01:06:40.227982+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:20.069819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":710,"num_write":289,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'348","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.925814+0000","last_change":"2024-09-12T00:12:36.025331+0000","last_active":"2024-09-12T01:10:59.925814+0000","last_peered":"2024-09-12T01:10:59.925814+0000","last_clean":"2024-09-12T01:10:59.925814+0000","last_became_active":"2024-09-12T00:12:36.025028+0000","last_became_peered":"2024-09-12T00:12:36.025028+0000","last_unstale":"2024-09-12T01:10:59.925814+0000","last_undegraded":"2024-09-12T01:10:59.925814+0000","last_fullsized":"2024-09-12T01:10:59.925814+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:26.322567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262447,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":522,"num_read_kb":8333,"num_write":1235,"num_write_kb":35038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'132","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.033321+0000","last_change":"2024-09-12T00:12:38.047056+0000","last_active":"2024-09-12T01:06:40.033321+0000","last_peered":"2024-09-12T01:06:40.033321+0000","last_clean":"2024-09-12T01:06:40.033321+0000","last_became_active":"2024-09-12T00:12:38.046753+0000","last_became_peered":"2024-09-12T00:12:38.046753+0000","last_unstale":"2024-09-12T01:06:40.033321+0000","last_undegraded":"2024-09-12T01:06:40.033321+0000","last_fullsized":"2024-09-12T01:06:40.033321+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:58.264361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":645,"num_read_kb":546,"num_write":214,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'372","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.017033+0000","last_change":"2024-09-12T00:12:36.047535+0000","last_active":"2024-09-12T01:11:00.017033+0000","last_peered":"2024-09-12T01:11:00.017033+0000","last_clean":"2024-09-12T01:11:00.017033+0000","last_became_active":"2024-09-12T00:12:36.047221+0000","last_became_peered":"2024-09-12T00:12:36.047221+0000","last_unstale":"2024-09-12T01:11:00.017033+0000","last_undegraded":"2024-09-12T01:11:00.017033+0000","last_fullsized":"2024-09-12T01:11:00.017033+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:45.416216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4807155,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":523,"num_read_kb":28472,"num_write":1149,"num_write_kb":36833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'173","reported_seq":801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:46.645799+0000","last_change":"2024-09-12T00:12:38.048404+0000","last_active":"2024-09-12T01:06:46.645799+0000","last_peered":"2024-09-12T01:06:46.645799+0000","last_clean":"2024-09-12T01:06:46.645799+0000","last_became_active":"2024-09-12T00:12:38.048094+0000","last_became_peered":"2024-09-12T00:12:38.048094+0000","last_unstale":"2024-09-12T01:06:46.645799+0000","last_undegraded":"2024-09-12T01:06:46.645799+0000","last_fullsized":"2024-09-12T01:06:46.645799+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:31.879991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":798,"num_read_kb":664,"num_write":275,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'309","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.070079+0000","last_change":"2024-09-12T00:12:36.039699+0000","last_active":"2024-09-12T01:11:00.070079+0000","last_peered":"2024-09-12T01:11:00.070079+0000","last_clean":"2024-09-12T01:11:00.070079+0000","last_became_active":"2024-09-12T00:12:36.039442+0000","last_became_peered":"2024-09-12T00:12:36.039442+0000","last_unstale":"2024-09-12T01:11:00.070079+0000","last_undegraded":"2024-09-12T01:11:00.070079+0000","last_fullsized":"2024-09-12T01:11:00.070079+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:18.334602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1732152,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":5824,"num_write":1000,"num_write_kb":34989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'85","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.229535+0000","last_change":"2024-09-12T00:12:38.042638+0000","last_active":"2024-09-12T01:06:55.229535+0000","last_peered":"2024-09-12T01:06:55.229535+0000","last_clean":"2024-09-12T01:06:55.229535+0000","last_became_active":"2024-09-12T00:12:38.042380+0000","last_became_peered":"2024-09-12T00:12:38.042380+0000","last_unstale":"2024-09-12T01:06:55.229535+0000","last_undegraded":"2024-09-12T01:06:55.229535+0000","last_fullsized":"2024-09-12T01:06:55.229535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:54.486935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":311,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'392","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.067900+0000","last_change":"2024-09-12T00:12:36.036316+0000","last_active":"2024-09-12T01:11:00.067900+0000","last_peered":"2024-09-12T01:11:00.067900+0000","last_clean":"2024-09-12T01:11:00.067900+0000","last_became_active":"2024-09-12T00:12:36.035235+0000","last_became_peered":"2024-09-12T00:12:36.035235+0000","last_unstale":"2024-09-12T01:11:00.067900+0000","last_undegraded":"2024-09-12T01:11:00.067900+0000","last_fullsized":"2024-09-12T01:11:00.067900+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:35.845612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2508627,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":579,"num_read_kb":34997,"num_write":1243,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'340","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.028745+0000","last_change":"2024-09-12T00:13:07.150744+0000","last_active":"2024-09-12T01:11:00.028745+0000","last_peered":"2024-09-12T01:11:00.028745+0000","last_clean":"2024-09-12T01:11:00.028745+0000","last_became_active":"2024-09-12T00:13:07.150278+0000","last_became_peered":"2024-09-12T00:13:07.150278+0000","last_unstale":"2024-09-12T01:11:00.028745+0000","last_undegraded":"2024-09-12T01:11:00.028745+0000","last_fullsized":"2024-09-12T01:11:00.028745+0000","mapping_epoch":40,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:11.722385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550106,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":16889,"num_write":1077,"num_write_kb":27724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"263'232","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.050604+0000","last_change":"2024-09-12T00:12:38.048481+0000","last_active":"2024-09-12T01:08:25.050604+0000","last_peered":"2024-09-12T01:08:25.050604+0000","last_clean":"2024-09-12T01:08:25.050604+0000","last_became_active":"2024-09-12T00:12:38.048092+0000","last_became_peered":"2024-09-12T00:12:38.048092+0000","last_unstale":"2024-09-12T01:08:25.050604+0000","last_undegraded":"2024-09-12T01:08:25.050604+0000","last_fullsized":"2024-09-12T01:08:25.050604+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:42.485985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":909,"num_write":384,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'328","reported_seq":1141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.943224+0000","last_change":"2024-09-12T00:12:36.035409+0000","last_active":"2024-09-12T01:10:57.943224+0000","last_peered":"2024-09-12T01:10:57.943224+0000","last_clean":"2024-09-12T01:10:57.943224+0000","last_became_active":"2024-09-12T00:12:36.034396+0000","last_became_peered":"2024-09-12T00:12:36.034396+0000","last_unstale":"2024-09-12T01:10:57.943224+0000","last_undegraded":"2024-09-12T01:10:57.943224+0000","last_fullsized":"2024-09-12T01:10:57.943224+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:08.822878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4973287,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":915,"num_read_kb":9206,"num_write":1404,"num_write_kb":42121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'344","reported_seq":938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.830495+0000","last_change":"2024-09-12T00:12:38.040209+0000","last_active":"2024-09-12T01:08:20.830495+0000","last_peered":"2024-09-12T01:08:20.830495+0000","last_clean":"2024-09-12T01:08:20.830495+0000","last_became_active":"2024-09-12T00:12:38.039941+0000","last_became_peered":"2024-09-12T00:12:38.039941+0000","last_unstale":"2024-09-12T01:08:20.830495+0000","last_undegraded":"2024-09-12T01:08:20.830495+0000","last_fullsized":"2024-09-12T01:08:20.830495+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:03.997031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1443,"num_read_kb":1146,"num_write":558,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5787,"num_read_kb":4069,"num_write":1922,"num_write_kb":820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1093,"ondisk_log_size":1093,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15069,"num_read_kb":14720,"num_write":16734,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1768,"ondisk_log_size":1768,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":684,"ondisk_log_size":684,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1640234,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":18197,"num_read_kb":37189,"num_write":15226,"num_write_kb":11779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":868352,"data_stored":553837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1983,"ondisk_log_size":1983,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":103162,"num_read_kb":86048,"num_write":37373,"num_write_kb":18894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3928,"ondisk_log_size":3928,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":202901163,"num_objects":1304,"num_object_clones":0,"num_object_copies":3912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1304,"num_whiteouts":0,"num_read":35380,"num_read_kb":1714834,"num_write":71227,"num_write_kb":2100462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":275472384,"data_stored":275472384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3917,"ondisk_log_size":3917,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":20021832,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":155,"num_read_kb":170862,"num_write":177,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":29048832,"data_stored":29043232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":11534336,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":159,"num_read_kb":170241,"num_write":183,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32505856,"data_stored":32505856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510149,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":245832,"kb_used_data":43808,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94126008,"statfs":{"total":96636764160,"available":96385032192,"internally_reserved":0,"allocated":44859392,"data_stored":42868704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":206698955},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510152,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139292,"kb_used_data":49692,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94232548,"statfs":{"total":96636764160,"available":96494129152,"internally_reserved":0,"allocated":50884608,"data_stored":48863407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510149,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253620,"kb_used_data":78020,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94118220,"statfs":{"total":96636764160,"available":96377057280,"internally_reserved":0,"allocated":79892480,"data_stored":77892921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510150,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":336480,"kb_used_data":102608,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94035360,"statfs":{"total":96636764160,"available":96292208640,"internally_reserved":0,"allocated":105070592,"data_stored":103069934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510150,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":215872,"kb_used_data":112496,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94155968,"statfs":{"total":96636764160,"available":96415711232,"internally_reserved":0,"allocated":115195904,"data_stored":113204618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510150,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":328460,"kb_used_data":22312,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94043380,"statfs":{"total":96636764160,"available":96300421120,"internally_reserved":0,"allocated":22847488,"data_stored":20852874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510152,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209032,"kb_used_data":119492,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94162808,"statfs":{"total":96636764160,"available":96422715392,"internally_reserved":0,"allocated":122359808,"data_stored":120321464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575557,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378888,"kb_used_data":140856,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":93992952,"statfs":{"total":96636764160,"available":96248782848,"internally_reserved":0,"allocated":144236544,"data_stored":142198459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243726789},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33087488,"data_stored":33087488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18063360,"data_stored":18063360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28626944,"data_stored":28626944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34299904,"data_stored":34299904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32231424,"data_stored":32231424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":88969216,"data_stored":88969216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17666048,"data_stored":17666048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":22528000,"data_stored":22528000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":49013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":44392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":475136,"data_stored":406325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":49563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":48429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28950528,"data_stored":28946374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":48429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:11:01.451 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:11:01.754 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:11:01.755 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":263,"fsid":"9d5b883a-c64b-4bbd-824a-b1076948973e","created":"2024-09-12T00:12:01.635987+0000","modified":"2024-09-12T00:46:55.878394+0000","last_up_change":"2024-09-12T00:12:14.620358+0000","last_in_change":"2024-09-12T00:12:04.826322+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:12:15.937266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:12:20.783409+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":23,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:12:34.001590+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:12:36.345065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:12:38.186396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:12:40.293418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:12:42.051500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:12:44.128295+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T00:27:41.537815+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"254","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T00:30:13.245850+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T00:30:16.437621+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T00:46:52.872191+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"263","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0128c84-3570-4ca5-8336-c753493c12fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6801","nonce":3885452980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6803","nonce":3885452980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6807","nonce":3885452980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":3885452980},{"type":"v1","addr":"172.21.15.133:6805","nonce":3885452980}]},"public_addr":"172.21.15.133:6801/3885452980","cluster_addr":"172.21.15.133:6803/3885452980","heartbeat_back_addr":"172.21.15.133:6807/3885452980","heartbeat_front_addr":"172.21.15.133:6805/3885452980","state":["exists","up"]},{"osd":1,"uuid":"be51a288-832a-49ba-9506-3eb4fa95b40f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6825","nonce":186004193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6827","nonce":186004193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6831","nonce":186004193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":186004193},{"type":"v1","addr":"172.21.15.133:6829","nonce":186004193}]},"public_addr":"172.21.15.133:6825/186004193","cluster_addr":"172.21.15.133:6827/186004193","heartbeat_back_addr":"172.21.15.133:6831/186004193","heartbeat_front_addr":"172.21.15.133:6829/186004193","state":["exists","up"]},{"osd":2,"uuid":"021f20b3-af9a-4656-befa-1ca354c52361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6817","nonce":1011460824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6819","nonce":1011460824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6823","nonce":1011460824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1011460824},{"type":"v1","addr":"172.21.15.133:6821","nonce":1011460824}]},"public_addr":"172.21.15.133:6817/1011460824","cluster_addr":"172.21.15.133:6819/1011460824","heartbeat_back_addr":"172.21.15.133:6823/1011460824","heartbeat_front_addr":"172.21.15.133:6821/1011460824","state":["exists","up"]},{"osd":3,"uuid":"fce1d083-a186-44ac-85c6-edf8ce90f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6809","nonce":2746645038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6811","nonce":2746645038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6815","nonce":2746645038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":2746645038},{"type":"v1","addr":"172.21.15.133:6813","nonce":2746645038}]},"public_addr":"172.21.15.133:6809/2746645038","cluster_addr":"172.21.15.133:6811/2746645038","heartbeat_back_addr":"172.21.15.133:6815/2746645038","heartbeat_front_addr":"172.21.15.133:6813/2746645038","state":["exists","up"]},{"osd":4,"uuid":"4d167a93-3b84-456b-807b-d9ae224829fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6811","nonce":170425375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6813","nonce":170425375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6817","nonce":170425375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":170425375},{"type":"v1","addr":"172.21.15.160:6815","nonce":170425375}]},"public_addr":"172.21.15.160:6811/170425375","cluster_addr":"172.21.15.160:6813/170425375","heartbeat_back_addr":"172.21.15.160:6817/170425375","heartbeat_front_addr":"172.21.15.160:6815/170425375","state":["exists","up"]},{"osd":5,"uuid":"8f0d9a3f-3b6f-40ae-add4-30b07b28766c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6801","nonce":2429451477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6803","nonce":2429451477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6807","nonce":2429451477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2429451477},{"type":"v1","addr":"172.21.15.160:6805","nonce":2429451477}]},"public_addr":"172.21.15.160:6801/2429451477","cluster_addr":"172.21.15.160:6803/2429451477","heartbeat_back_addr":"172.21.15.160:6807/2429451477","heartbeat_front_addr":"172.21.15.160:6805/2429451477","state":["exists","up"]},{"osd":6,"uuid":"bf07fb18-89f4-43b6-9221-13dfa970fc2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6827","nonce":253795424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6829","nonce":253795424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6833","nonce":253795424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":253795424},{"type":"v1","addr":"172.21.15.160:6831","nonce":253795424}]},"public_addr":"172.21.15.160:6827/253795424","cluster_addr":"172.21.15.160:6829/253795424","heartbeat_back_addr":"172.21.15.160:6833/253795424","heartbeat_front_addr":"172.21.15.160:6831/253795424","state":["exists","up"]},{"osd":7,"uuid":"e33d6d84-dae7-4ab8-b569-5b5c9008d405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6819","nonce":507321805}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6821","nonce":507321805}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6825","nonce":507321805}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":507321805},{"type":"v1","addr":"172.21.15.160:6823","nonce":507321805}]},"public_addr":"172.21.15.160:6819/507321805","cluster_addr":"172.21.15.160:6821/507321805","heartbeat_back_addr":"172.21.15.160:6825/507321805","heartbeat_front_addr":"172.21.15.160:6823/507321805","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.382831+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.172774+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.629093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.412020+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.078833+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:10.828388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.581535+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:12:11.351723+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":3,"to":6}]},{"pgid":"3.14","mappings":[{"from":0,"to":6}]},{"pgid":"3.30","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:11:02.769 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T01:11:02.769 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:02.918 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T01:11:02.919 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:02.919 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T01:11:02.929 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T01:11:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T01:11:03.245 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T01:11:03.245 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:03.381 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T01:11:03.382 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:03.382 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T01:11:03.392 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T01:11:03.692 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T01:11:03.706 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T01:11:03.706 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:03.842 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T01:11:03.842 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:03.842 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T01:11:03.853 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T01:11:04.158 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T01:11:04.172 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T01:11:04.172 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:04.309 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T01:11:04.309 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:04.309 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T01:11:04.320 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T01:11:04.619 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T01:11:04.633 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T01:11:04.633 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:04.771 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T01:11:04.771 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:04.771 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T01:11:04.782 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T01:11:05.081 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T01:11:05.095 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T01:11:05.095 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:05.233 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T01:11:05.234 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:05.234 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T01:11:05.244 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T01:11:05.544 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T01:11:05.558 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T01:11:05.558 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:05.696 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T01:11:05.696 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:05.696 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T01:11:05.707 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T01:11:06.007 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T01:11:06.020 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T01:11:06.020 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:11:06.160 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2024-09-12T01:11:06.160 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:11:06.160 INFO:teuthology.orchestra.run.smithi133.stdout:} 2024-09-12T01:11:06.171 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T01:11:06.474 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T01:11:06.487 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:11:06.811 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:11:06.823 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-09-12T01:11:06.825 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":2022,"stamp":"2024-09-12T01:11:05.333795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88946274,"num_objects":742,"num_object_clones":0,"num_object_copies":1870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":181390,"num_read_kb":2201314,"num_write":143939,"num_write_kb":2394991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13562,"ondisk_log_size":13562,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1636800,"kb_used_data":163144,"kb_used_omap":12,"kb_used_meta":1472179,"kb_avail":753337920,"statfs":{"total":773094113280,"available":771418030080,"internally_reserved":0,"allocated":167059456,"data_stored":151106346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1507511858},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-604269683,"num_objects":-4148,"num_object_clones":0,"num_object_copies":-12392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4148,"num_whiteouts":0,"num_read":4636,"num_read_kb":4172,"num_write":4399,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005321"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.023141+0000","last_change":"2024-09-12T00:46:54.886343+0000","last_active":"2024-09-12T01:06:55.023141+0000","last_peered":"2024-09-12T01:06:55.023141+0000","last_clean":"2024-09-12T01:06:55.023141+0000","last_became_active":"2024-09-12T00:46:54.885628+0000","last_became_peered":"2024-09-12T00:46:54.885628+0000","last_unstale":"2024-09-12T01:06:55.023141+0000","last_undegraded":"2024-09-12T01:06:55.023141+0000","last_fullsized":"2024-09-12T01:06:55.023141+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:28.705045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'4","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.235372+0000","last_change":"2024-09-12T00:30:17.763692+0000","last_active":"2024-09-12T01:07:50.235372+0000","last_peered":"2024-09-12T01:07:50.235372+0000","last_clean":"2024-09-12T01:07:50.235372+0000","last_became_active":"2024-09-12T00:30:17.763402+0000","last_became_peered":"2024-09-12T00:30:17.763402+0000","last_unstale":"2024-09-12T01:07:50.235372+0000","last_undegraded":"2024-09-12T01:07:50.235372+0000","last_fullsized":"2024-09-12T01:07:50.235372+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:07.859938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044542+0000","last_change":"2024-09-12T00:30:14.745260+0000","last_active":"2024-09-12T01:07:45.044542+0000","last_peered":"2024-09-12T01:07:45.044542+0000","last_clean":"2024-09-12T01:07:45.044542+0000","last_became_active":"2024-09-12T00:30:14.744833+0000","last_became_peered":"2024-09-12T00:30:14.744833+0000","last_unstale":"2024-09-12T01:07:45.044542+0000","last_undegraded":"2024-09-12T01:07:45.044542+0000","last_fullsized":"2024-09-12T01:07:45.044542+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:11.503961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'41","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.040605+0000","last_change":"2024-09-12T00:27:42.840206+0000","last_active":"2024-09-12T01:07:20.040605+0000","last_peered":"2024-09-12T01:07:20.040605+0000","last_clean":"2024-09-12T01:07:20.040605+0000","last_became_active":"2024-09-12T00:27:42.839605+0000","last_became_peered":"2024-09-12T00:27:42.839605+0000","last_unstale":"2024-09-12T01:07:20.040605+0000","last_undegraded":"2024-09-12T01:07:20.040605+0000","last_fullsized":"2024-09-12T01:07:20.040605+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:10.785209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":144,"num_write":69,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.153651+0000","last_change":"2024-09-12T00:46:54.885981+0000","last_active":"2024-09-12T01:06:55.153651+0000","last_peered":"2024-09-12T01:06:55.153651+0000","last_clean":"2024-09-12T01:06:55.153651+0000","last_became_active":"2024-09-12T00:46:54.885702+0000","last_became_peered":"2024-09-12T00:46:54.885702+0000","last_unstale":"2024-09-12T01:06:55.153651+0000","last_undegraded":"2024-09-12T01:06:55.153651+0000","last_fullsized":"2024-09-12T01:06:55.153651+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:37.616069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'3","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:20.152789+0000","last_change":"2024-09-12T00:30:17.762666+0000","last_active":"2024-09-12T01:10:20.152789+0000","last_peered":"2024-09-12T01:10:20.152789+0000","last_clean":"2024-09-12T01:10:20.152789+0000","last_became_active":"2024-09-12T00:30:17.762369+0000","last_became_peered":"2024-09-12T00:30:17.762369+0000","last_unstale":"2024-09-12T01:10:20.152789+0000","last_undegraded":"2024-09-12T01:10:20.152789+0000","last_fullsized":"2024-09-12T01:10:20.152789+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:33.357062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042925+0000","last_change":"2024-09-12T00:30:14.747881+0000","last_active":"2024-09-12T01:07:48.042925+0000","last_peered":"2024-09-12T01:07:48.042925+0000","last_clean":"2024-09-12T01:07:48.042925+0000","last_became_active":"2024-09-12T00:30:14.747614+0000","last_became_peered":"2024-09-12T00:30:14.747614+0000","last_unstale":"2024-09-12T01:07:48.042925+0000","last_undegraded":"2024-09-12T01:07:48.042925+0000","last_fullsized":"2024-09-12T01:07:48.042925+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:33.210330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'21","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045493+0000","last_change":"2024-09-12T00:27:42.846591+0000","last_active":"2024-09-12T01:07:50.045493+0000","last_peered":"2024-09-12T01:07:50.045493+0000","last_clean":"2024-09-12T01:07:50.045493+0000","last_became_active":"2024-09-12T00:27:42.846264+0000","last_became_peered":"2024-09-12T00:27:42.846264+0000","last_unstale":"2024-09-12T01:07:50.045493+0000","last_undegraded":"2024-09-12T01:07:50.045493+0000","last_fullsized":"2024-09-12T01:07:50.045493+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:13.645447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:15.224938+0000","last_change":"2024-09-12T00:46:54.890699+0000","last_active":"2024-09-12T01:06:15.224938+0000","last_peered":"2024-09-12T01:06:15.224938+0000","last_clean":"2024-09-12T01:06:15.224938+0000","last_became_active":"2024-09-12T00:46:54.890430+0000","last_became_peered":"2024-09-12T00:46:54.890430+0000","last_unstale":"2024-09-12T01:06:15.224938+0000","last_undegraded":"2024-09-12T01:06:15.224938+0000","last_fullsized":"2024-09-12T01:06:15.224938+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:21.161335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042970+0000","last_change":"2024-09-12T00:30:17.767409+0000","last_active":"2024-09-12T01:07:48.042970+0000","last_peered":"2024-09-12T01:07:48.042970+0000","last_clean":"2024-09-12T01:07:48.042970+0000","last_became_active":"2024-09-12T00:30:17.767116+0000","last_became_peered":"2024-09-12T00:30:17.767116+0000","last_unstale":"2024-09-12T01:07:48.042970+0000","last_undegraded":"2024-09-12T01:07:48.042970+0000","last_fullsized":"2024-09-12T01:07:48.042970+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:25.469472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"263'6","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.240551+0000","last_change":"2024-09-12T00:30:14.742702+0000","last_active":"2024-09-12T01:10:58.240551+0000","last_peered":"2024-09-12T01:10:58.240551+0000","last_clean":"2024-09-12T01:10:58.240551+0000","last_became_active":"2024-09-12T00:30:14.742434+0000","last_became_peered":"2024-09-12T00:30:14.742434+0000","last_unstale":"2024-09-12T01:10:58.240551+0000","last_undegraded":"2024-09-12T01:10:58.240551+0000","last_fullsized":"2024-09-12T01:10:58.240551+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:37.658561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6194,"num_write":6,"num_write_kb":5170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'36","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160719+0000","last_change":"2024-09-12T00:27:42.842436+0000","last_active":"2024-09-12T01:07:45.160719+0000","last_peered":"2024-09-12T01:07:45.160719+0000","last_clean":"2024-09-12T01:07:45.160719+0000","last_became_active":"2024-09-12T00:27:42.842172+0000","last_became_peered":"2024-09-12T00:27:42.842172+0000","last_unstale":"2024-09-12T01:07:45.160719+0000","last_undegraded":"2024-09-12T01:07:45.160719+0000","last_fullsized":"2024-09-12T01:07:45.160719+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:30.357785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:23.030019+0000","last_change":"2024-09-12T00:46:54.883267+0000","last_active":"2024-09-12T01:06:23.030019+0000","last_peered":"2024-09-12T01:06:23.030019+0000","last_clean":"2024-09-12T01:06:23.030019+0000","last_became_active":"2024-09-12T00:46:54.882951+0000","last_became_peered":"2024-09-12T00:46:54.882951+0000","last_unstale":"2024-09-12T01:06:23.030019+0000","last_undegraded":"2024-09-12T01:06:23.030019+0000","last_fullsized":"2024-09-12T01:06:23.030019+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:55.035382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:28.067511+0000","last_change":"2024-09-12T00:30:17.766601+0000","last_active":"2024-09-12T01:10:28.067511+0000","last_peered":"2024-09-12T01:10:28.067511+0000","last_clean":"2024-09-12T01:10:28.067511+0000","last_became_active":"2024-09-12T00:30:17.764967+0000","last_became_peered":"2024-09-12T00:30:17.764967+0000","last_unstale":"2024-09-12T01:10:28.067511+0000","last_undegraded":"2024-09-12T01:10:28.067511+0000","last_fullsized":"2024-09-12T01:10:28.067511+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:56.749587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:50.248603+0000","last_change":"2024-09-12T00:30:14.747887+0000","last_active":"2024-09-12T01:09:50.248603+0000","last_peered":"2024-09-12T01:09:50.248603+0000","last_clean":"2024-09-12T01:09:50.248603+0000","last_became_active":"2024-09-12T00:30:14.747423+0000","last_became_peered":"2024-09-12T00:30:14.747423+0000","last_unstale":"2024-09-12T01:09:50.248603+0000","last_undegraded":"2024-09-12T01:09:50.248603+0000","last_fullsized":"2024-09-12T01:09:50.248603+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:10.117387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'27","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160694+0000","last_change":"2024-09-12T00:27:42.837430+0000","last_active":"2024-09-12T01:07:45.160694+0000","last_peered":"2024-09-12T01:07:45.160694+0000","last_clean":"2024-09-12T01:07:45.160694+0000","last_became_active":"2024-09-12T00:27:42.837170+0000","last_became_peered":"2024-09-12T00:27:42.837170+0000","last_unstale":"2024-09-12T01:07:45.160694+0000","last_undegraded":"2024-09-12T01:07:45.160694+0000","last_fullsized":"2024-09-12T01:07:45.160694+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:50.502592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":97,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.056429+0000","last_change":"2024-09-12T00:46:54.885456+0000","last_active":"2024-09-12T01:09:00.056429+0000","last_peered":"2024-09-12T01:09:00.056429+0000","last_clean":"2024-09-12T01:09:00.056429+0000","last_became_active":"2024-09-12T00:46:54.885170+0000","last_became_peered":"2024-09-12T00:46:54.885170+0000","last_unstale":"2024-09-12T01:09:00.056429+0000","last_undegraded":"2024-09-12T01:09:00.056429+0000","last_fullsized":"2024-09-12T01:09:00.056429+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:22.660312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.723358+0000","last_change":"2024-09-12T00:30:17.765475+0000","last_active":"2024-09-12T01:10:58.723358+0000","last_peered":"2024-09-12T01:10:58.723358+0000","last_clean":"2024-09-12T01:10:58.723358+0000","last_became_active":"2024-09-12T00:30:17.765167+0000","last_became_peered":"2024-09-12T00:30:17.765167+0000","last_unstale":"2024-09-12T01:10:58.723358+0000","last_undegraded":"2024-09-12T01:10:58.723358+0000","last_fullsized":"2024-09-12T01:10:58.723358+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:48.717488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6715,"num_write":6,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:33.031572+0000","last_change":"2024-09-12T00:30:14.742908+0000","last_active":"2024-09-12T01:06:33.031572+0000","last_peered":"2024-09-12T01:06:33.031572+0000","last_clean":"2024-09-12T01:06:33.031572+0000","last_became_active":"2024-09-12T00:30:14.742625+0000","last_became_peered":"2024-09-12T00:30:14.742625+0000","last_unstale":"2024-09-12T01:06:33.031572+0000","last_undegraded":"2024-09-12T01:06:33.031572+0000","last_fullsized":"2024-09-12T01:06:33.031572+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:00.744053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160647+0000","last_change":"2024-09-12T00:27:42.845668+0000","last_active":"2024-09-12T01:07:45.160647+0000","last_peered":"2024-09-12T01:07:45.160647+0000","last_clean":"2024-09-12T01:07:45.160647+0000","last_became_active":"2024-09-12T00:27:42.845406+0000","last_became_peered":"2024-09-12T00:27:42.845406+0000","last_unstale":"2024-09-12T01:07:45.160647+0000","last_undegraded":"2024-09-12T01:07:45.160647+0000","last_fullsized":"2024-09-12T01:07:45.160647+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:58.406118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":45,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044551+0000","last_change":"2024-09-12T00:46:54.877914+0000","last_active":"2024-09-12T01:07:45.044551+0000","last_peered":"2024-09-12T01:07:45.044551+0000","last_clean":"2024-09-12T01:07:45.044551+0000","last_became_active":"2024-09-12T00:46:54.876219+0000","last_became_peered":"2024-09-12T00:46:54.876219+0000","last_unstale":"2024-09-12T01:07:45.044551+0000","last_undegraded":"2024-09-12T01:07:45.044551+0000","last_fullsized":"2024-09-12T01:07:45.044551+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:46.030061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.723885+0000","last_change":"2024-09-12T00:30:17.763491+0000","last_active":"2024-09-12T01:10:58.723885+0000","last_peered":"2024-09-12T01:10:58.723885+0000","last_clean":"2024-09-12T01:10:58.723885+0000","last_became_active":"2024-09-12T00:30:17.762792+0000","last_became_peered":"2024-09-12T00:30:17.762792+0000","last_unstale":"2024-09-12T01:10:58.723885+0000","last_undegraded":"2024-09-12T01:10:58.723885+0000","last_fullsized":"2024-09-12T01:10:58.723885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:45.751971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:05.051194+0000","last_change":"2024-09-12T00:30:14.745747+0000","last_active":"2024-09-12T01:09:05.051194+0000","last_peered":"2024-09-12T01:09:05.051194+0000","last_clean":"2024-09-12T01:09:05.051194+0000","last_became_active":"2024-09-12T00:30:14.745328+0000","last_became_peered":"2024-09-12T00:30:14.745328+0000","last_unstale":"2024-09-12T01:09:05.051194+0000","last_undegraded":"2024-09-12T01:09:05.051194+0000","last_fullsized":"2024-09-12T01:09:05.051194+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:22.444900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'29","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.134777+0000","last_change":"2024-09-12T00:27:42.844015+0000","last_active":"2024-09-12T01:07:45.134777+0000","last_peered":"2024-09-12T01:07:45.134777+0000","last_clean":"2024-09-12T01:07:45.134777+0000","last_became_active":"2024-09-12T00:27:42.843745+0000","last_became_peered":"2024-09-12T00:27:42.843745+0000","last_unstale":"2024-09-12T01:07:45.134777+0000","last_undegraded":"2024-09-12T01:07:45.134777+0000","last_fullsized":"2024-09-12T01:07:45.134777+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:02.518882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":101,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.129245+0000","last_change":"2024-09-12T00:46:54.889308+0000","last_active":"2024-09-12T01:06:55.129245+0000","last_peered":"2024-09-12T01:06:55.129245+0000","last_clean":"2024-09-12T01:06:55.129245+0000","last_became_active":"2024-09-12T00:46:54.889006+0000","last_became_peered":"2024-09-12T00:46:54.889006+0000","last_unstale":"2024-09-12T01:06:55.129245+0000","last_undegraded":"2024-09-12T01:06:55.129245+0000","last_fullsized":"2024-09-12T01:06:55.129245+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:09.749976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'11","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:20.152777+0000","last_change":"2024-09-12T00:30:17.759472+0000","last_active":"2024-09-12T01:10:20.152777+0000","last_peered":"2024-09-12T01:10:20.152777+0000","last_clean":"2024-09-12T01:10:20.152777+0000","last_became_active":"2024-09-12T00:30:17.759198+0000","last_became_peered":"2024-09-12T00:30:17.759198+0000","last_unstale":"2024-09-12T01:10:20.152777+0000","last_undegraded":"2024-09-12T01:10:20.152777+0000","last_fullsized":"2024-09-12T01:10:20.152777+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:30.456850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9336,"num_write":16,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.028479+0000","last_change":"2024-09-12T00:30:14.750283+0000","last_active":"2024-09-12T01:07:45.028479+0000","last_peered":"2024-09-12T01:07:45.028479+0000","last_clean":"2024-09-12T01:07:45.028479+0000","last_became_active":"2024-09-12T00:30:14.750004+0000","last_became_peered":"2024-09-12T00:30:14.750004+0000","last_unstale":"2024-09-12T01:07:45.028479+0000","last_undegraded":"2024-09-12T01:07:45.028479+0000","last_fullsized":"2024-09-12T01:07:45.028479+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:54.714545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'18","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.031378+0000","last_change":"2024-09-12T00:27:42.835796+0000","last_active":"2024-09-12T01:06:30.031378+0000","last_peered":"2024-09-12T01:06:30.031378+0000","last_clean":"2024-09-12T01:06:30.031378+0000","last_became_active":"2024-09-12T00:27:42.835530+0000","last_became_peered":"2024-09-12T00:27:42.835530+0000","last_unstale":"2024-09-12T01:06:30.031378+0000","last_undegraded":"2024-09-12T01:06:30.031378+0000","last_fullsized":"2024-09-12T01:06:30.031378+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:37.899819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.023205+0000","last_change":"2024-09-12T00:46:54.883214+0000","last_active":"2024-09-12T01:06:55.023205+0000","last_peered":"2024-09-12T01:06:55.023205+0000","last_clean":"2024-09-12T01:06:55.023205+0000","last_became_active":"2024-09-12T00:46:54.882946+0000","last_became_peered":"2024-09-12T00:46:54.882946+0000","last_unstale":"2024-09-12T01:06:55.023205+0000","last_undegraded":"2024-09-12T01:06:55.023205+0000","last_fullsized":"2024-09-12T01:06:55.023205+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:01.444701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045398+0000","last_change":"2024-09-12T00:30:17.766684+0000","last_active":"2024-09-12T01:07:50.045398+0000","last_peered":"2024-09-12T01:07:50.045398+0000","last_clean":"2024-09-12T01:07:50.045398+0000","last_became_active":"2024-09-12T00:30:17.763733+0000","last_became_peered":"2024-09-12T00:30:17.763733+0000","last_unstale":"2024-09-12T01:07:50.045398+0000","last_undegraded":"2024-09-12T01:07:50.045398+0000","last_fullsized":"2024-09-12T01:07:50.045398+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:45.175363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:15.184368+0000","last_change":"2024-09-12T00:30:14.748751+0000","last_active":"2024-09-12T01:10:15.184368+0000","last_peered":"2024-09-12T01:10:15.184368+0000","last_clean":"2024-09-12T01:10:15.184368+0000","last_became_active":"2024-09-12T00:30:14.748462+0000","last_became_peered":"2024-09-12T00:30:14.748462+0000","last_unstale":"2024-09-12T01:10:15.184368+0000","last_undegraded":"2024-09-12T01:10:15.184368+0000","last_fullsized":"2024-09-12T01:10:15.184368+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:23.544212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'17","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.148879+0000","last_change":"2024-09-12T00:27:42.839309+0000","last_active":"2024-09-12T01:06:25.148879+0000","last_peered":"2024-09-12T01:06:25.148879+0000","last_clean":"2024-09-12T01:06:25.148879+0000","last_became_active":"2024-09-12T00:27:42.838896+0000","last_became_peered":"2024-09-12T00:27:42.838896+0000","last_unstale":"2024-09-12T01:06:25.148879+0000","last_undegraded":"2024-09-12T01:06:25.148879+0000","last_fullsized":"2024-09-12T01:06:25.148879+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:33.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.044373+0000","last_change":"2024-09-12T00:46:54.885744+0000","last_active":"2024-09-12T01:07:58.044373+0000","last_peered":"2024-09-12T01:07:58.044373+0000","last_clean":"2024-09-12T01:07:58.044373+0000","last_became_active":"2024-09-12T00:46:54.885457+0000","last_became_peered":"2024-09-12T00:46:54.885457+0000","last_unstale":"2024-09-12T01:07:58.044373+0000","last_undegraded":"2024-09-12T01:07:58.044373+0000","last_fullsized":"2024-09-12T01:07:58.044373+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:36.235325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.032424+0000","last_change":"2024-09-12T00:30:17.765481+0000","last_active":"2024-09-12T01:06:35.032424+0000","last_peered":"2024-09-12T01:06:35.032424+0000","last_clean":"2024-09-12T01:06:35.032424+0000","last_became_active":"2024-09-12T00:30:17.765149+0000","last_became_peered":"2024-09-12T00:30:17.765149+0000","last_unstale":"2024-09-12T01:06:35.032424+0000","last_undegraded":"2024-09-12T01:06:35.032424+0000","last_fullsized":"2024-09-12T01:06:35.032424+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:20.242797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041690+0000","last_change":"2024-09-12T00:30:14.740879+0000","last_active":"2024-09-12T01:07:45.041690+0000","last_peered":"2024-09-12T01:07:45.041690+0000","last_clean":"2024-09-12T01:07:45.041690+0000","last_became_active":"2024-09-12T00:30:14.740516+0000","last_became_peered":"2024-09-12T00:30:14.740516+0000","last_unstale":"2024-09-12T01:07:45.041690+0000","last_undegraded":"2024-09-12T01:07:45.041690+0000","last_fullsized":"2024-09-12T01:07:45.041690+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:43.135121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'20","reported_seq":108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030659+0000","last_change":"2024-09-12T00:27:42.841806+0000","last_active":"2024-09-12T01:06:25.030659+0000","last_peered":"2024-09-12T01:06:25.030659+0000","last_clean":"2024-09-12T01:06:25.030659+0000","last_became_active":"2024-09-12T00:27:42.840919+0000","last_became_peered":"2024-09-12T00:27:42.840919+0000","last_unstale":"2024-09-12T01:06:25.030659+0000","last_undegraded":"2024-09-12T01:06:25.030659+0000","last_fullsized":"2024-09-12T01:06:25.030659+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:51.676258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":83,"num_write":31,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.162301+0000","last_change":"2024-09-12T00:46:54.887403+0000","last_active":"2024-09-12T01:07:55.162301+0000","last_peered":"2024-09-12T01:07:55.162301+0000","last_clean":"2024-09-12T01:07:55.162301+0000","last_became_active":"2024-09-12T00:46:54.887134+0000","last_became_peered":"2024-09-12T00:46:54.887134+0000","last_unstale":"2024-09-12T01:07:55.162301+0000","last_undegraded":"2024-09-12T01:07:55.162301+0000","last_fullsized":"2024-09-12T01:07:55.162301+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:13.379263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'9","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.166881+0000","last_change":"2024-09-12T00:30:17.766525+0000","last_active":"2024-09-12T01:10:59.166881+0000","last_peered":"2024-09-12T01:10:59.166881+0000","last_clean":"2024-09-12T01:10:59.166881+0000","last_became_active":"2024-09-12T00:30:17.766203+0000","last_became_peered":"2024-09-12T00:30:17.766203+0000","last_unstale":"2024-09-12T01:10:59.166881+0000","last_undegraded":"2024-09-12T01:10:59.166881+0000","last_fullsized":"2024-09-12T01:10:59.166881+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:51.225523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13412,"num_write":14,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.020488+0000","last_change":"2024-09-12T00:30:14.746410+0000","last_active":"2024-09-12T01:06:30.020488+0000","last_peered":"2024-09-12T01:06:30.020488+0000","last_clean":"2024-09-12T01:06:30.020488+0000","last_became_active":"2024-09-12T00:30:14.746119+0000","last_became_peered":"2024-09-12T00:30:14.746119+0000","last_unstale":"2024-09-12T01:06:30.020488+0000","last_undegraded":"2024-09-12T01:06:30.020488+0000","last_fullsized":"2024-09-12T01:06:30.020488+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:15.863696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'39","reported_seq":151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030634+0000","last_change":"2024-09-12T00:27:42.846588+0000","last_active":"2024-09-12T01:06:25.030634+0000","last_peered":"2024-09-12T01:06:25.030634+0000","last_clean":"2024-09-12T01:06:25.030634+0000","last_became_active":"2024-09-12T00:27:42.846198+0000","last_became_peered":"2024-09-12T00:27:42.846198+0000","last_unstale":"2024-09-12T01:06:25.030634+0000","last_undegraded":"2024-09-12T01:06:25.030634+0000","last_fullsized":"2024-09-12T01:06:25.030634+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:39.702227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":138,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.135933+0000","last_change":"2024-09-12T00:46:54.886148+0000","last_active":"2024-09-12T01:07:55.135933+0000","last_peered":"2024-09-12T01:07:55.135933+0000","last_clean":"2024-09-12T01:07:55.135933+0000","last_became_active":"2024-09-12T00:46:54.885879+0000","last_became_peered":"2024-09-12T00:46:54.885879+0000","last_unstale":"2024-09-12T01:07:55.135933+0000","last_undegraded":"2024-09-12T01:07:55.135933+0000","last_fullsized":"2024-09-12T01:07:55.135933+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:12.855547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"260'5","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.032478+0000","last_change":"2024-09-12T00:30:17.769299+0000","last_active":"2024-09-12T01:06:35.032478+0000","last_peered":"2024-09-12T01:06:35.032478+0000","last_clean":"2024-09-12T01:06:35.032478+0000","last_became_active":"2024-09-12T00:30:17.769051+0000","last_became_peered":"2024-09-12T00:30:17.769051+0000","last_unstale":"2024-09-12T01:06:35.032478+0000","last_undegraded":"2024-09-12T01:06:35.032478+0000","last_fullsized":"2024-09-12T01:06:35.032478+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:02.321672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'8","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.309265+0000","last_change":"2024-09-12T00:30:14.743361+0000","last_active":"2024-09-12T01:10:58.309265+0000","last_peered":"2024-09-12T01:10:58.309265+0000","last_clean":"2024-09-12T01:10:58.309265+0000","last_became_active":"2024-09-12T00:30:14.743083+0000","last_became_peered":"2024-09-12T00:30:14.743083+0000","last_unstale":"2024-09-12T01:10:58.309265+0000","last_undegraded":"2024-09-12T01:10:58.309265+0000","last_fullsized":"2024-09-12T01:10:58.309265+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:54.700301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.030625+0000","last_change":"2024-09-12T00:27:42.839353+0000","last_active":"2024-09-12T01:06:25.030625+0000","last_peered":"2024-09-12T01:06:25.030625+0000","last_clean":"2024-09-12T01:06:25.030625+0000","last_became_active":"2024-09-12T00:27:42.839063+0000","last_became_peered":"2024-09-12T00:27:42.839063+0000","last_unstale":"2024-09-12T01:06:25.030625+0000","last_undegraded":"2024-09-12T01:06:25.030625+0000","last_fullsized":"2024-09-12T01:06:25.030625+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:50.341652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":119,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.029600+0000","last_change":"2024-09-12T00:46:54.887703+0000","last_active":"2024-09-12T01:07:55.029600+0000","last_peered":"2024-09-12T01:07:55.029600+0000","last_clean":"2024-09-12T01:07:55.029600+0000","last_became_active":"2024-09-12T00:46:54.887450+0000","last_became_peered":"2024-09-12T00:46:54.887450+0000","last_unstale":"2024-09-12T01:07:55.029600+0000","last_undegraded":"2024-09-12T01:07:55.029600+0000","last_fullsized":"2024-09-12T01:07:55.029600+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:53.371335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.021027+0000","last_change":"2024-09-12T00:30:17.756613+0000","last_active":"2024-09-12T01:06:35.021027+0000","last_peered":"2024-09-12T01:06:35.021027+0000","last_clean":"2024-09-12T01:06:35.021027+0000","last_became_active":"2024-09-12T00:30:17.756342+0000","last_became_peered":"2024-09-12T00:30:17.756342+0000","last_unstale":"2024-09-12T01:06:35.021027+0000","last_undegraded":"2024-09-12T01:06:35.021027+0000","last_fullsized":"2024-09-12T01:06:35.021027+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:08.103127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.053829+0000","last_change":"2024-09-12T00:30:14.748689+0000","last_active":"2024-09-12T01:08:58.053829+0000","last_peered":"2024-09-12T01:08:58.053829+0000","last_clean":"2024-09-12T01:08:58.053829+0000","last_became_active":"2024-09-12T00:30:14.748446+0000","last_became_peered":"2024-09-12T00:30:14.748446+0000","last_unstale":"2024-09-12T01:08:58.053829+0000","last_undegraded":"2024-09-12T01:08:58.053829+0000","last_fullsized":"2024-09-12T01:08:58.053829+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:32.811168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'23","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.040482+0000","last_change":"2024-09-12T00:27:42.845645+0000","last_active":"2024-09-12T01:07:35.040482+0000","last_peered":"2024-09-12T01:07:35.040482+0000","last_clean":"2024-09-12T01:07:35.040482+0000","last_became_active":"2024-09-12T00:27:42.845379+0000","last_became_peered":"2024-09-12T00:27:42.845379+0000","last_unstale":"2024-09-12T01:07:35.040482+0000","last_undegraded":"2024-09-12T01:07:35.040482+0000","last_fullsized":"2024-09-12T01:07:35.040482+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:35.854841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:18.029467+0000","last_change":"2024-09-12T00:46:54.884019+0000","last_active":"2024-09-12T01:06:18.029467+0000","last_peered":"2024-09-12T01:06:18.029467+0000","last_clean":"2024-09-12T01:06:18.029467+0000","last_became_active":"2024-09-12T00:46:54.883713+0000","last_became_peered":"2024-09-12T00:46:54.883713+0000","last_unstale":"2024-09-12T01:06:18.029467+0000","last_undegraded":"2024-09-12T01:06:18.029467+0000","last_fullsized":"2024-09-12T01:06:18.029467+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:41.973083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'7","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:58.062838+0000","last_change":"2024-09-12T00:30:17.764514+0000","last_active":"2024-09-12T01:09:58.062838+0000","last_peered":"2024-09-12T01:09:58.062838+0000","last_clean":"2024-09-12T01:09:58.062838+0000","last_became_active":"2024-09-12T00:30:17.764165+0000","last_became_peered":"2024-09-12T00:30:17.764165+0000","last_unstale":"2024-09-12T01:09:58.062838+0000","last_undegraded":"2024-09-12T01:09:58.062838+0000","last_fullsized":"2024-09-12T01:09:58.062838+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:16.348051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:55.249102+0000","last_change":"2024-09-12T00:30:14.747500+0000","last_active":"2024-09-12T01:09:55.249102+0000","last_peered":"2024-09-12T01:09:55.249102+0000","last_clean":"2024-09-12T01:09:55.249102+0000","last_became_active":"2024-09-12T00:30:14.747184+0000","last_became_peered":"2024-09-12T00:30:14.747184+0000","last_unstale":"2024-09-12T01:09:55.249102+0000","last_undegraded":"2024-09-12T01:09:55.249102+0000","last_fullsized":"2024-09-12T01:09:55.249102+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:20.436960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'76","reported_seq":299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.039285+0000","last_change":"2024-09-12T00:27:42.846397+0000","last_active":"2024-09-12T01:07:25.039285+0000","last_peered":"2024-09-12T01:07:25.039285+0000","last_clean":"2024-09-12T01:07:25.039285+0000","last_became_active":"2024-09-12T00:27:42.846108+0000","last_became_peered":"2024-09-12T00:27:42.846108+0000","last_unstale":"2024-09-12T01:07:25.039285+0000","last_undegraded":"2024-09-12T01:07:25.039285+0000","last_fullsized":"2024-09-12T01:07:25.039285+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:11.395534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":337,"num_write":98,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.170367+0000","last_change":"2024-09-12T00:46:54.889757+0000","last_active":"2024-09-12T01:08:40.170367+0000","last_peered":"2024-09-12T01:08:40.170367+0000","last_clean":"2024-09-12T01:08:40.170367+0000","last_became_active":"2024-09-12T00:46:54.889496+0000","last_became_peered":"2024-09-12T00:46:54.889496+0000","last_unstale":"2024-09-12T01:08:40.170367+0000","last_undegraded":"2024-09-12T01:08:40.170367+0000","last_fullsized":"2024-09-12T01:08:40.170367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:28.265877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.041215+0000","last_change":"2024-09-12T00:30:17.767918+0000","last_active":"2024-09-12T01:07:38.041215+0000","last_peered":"2024-09-12T01:07:38.041215+0000","last_clean":"2024-09-12T01:07:38.041215+0000","last_became_active":"2024-09-12T00:30:17.767526+0000","last_became_peered":"2024-09-12T00:30:17.767526+0000","last_unstale":"2024-09-12T01:07:38.041215+0000","last_undegraded":"2024-09-12T01:07:38.041215+0000","last_fullsized":"2024-09-12T01:07:38.041215+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:28.500175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:58.062808+0000","last_change":"2024-09-12T00:30:14.749360+0000","last_active":"2024-09-12T01:09:58.062808+0000","last_peered":"2024-09-12T01:09:58.062808+0000","last_clean":"2024-09-12T01:09:58.062808+0000","last_became_active":"2024-09-12T00:30:14.749104+0000","last_became_peered":"2024-09-12T00:30:14.749104+0000","last_unstale":"2024-09-12T01:09:58.062808+0000","last_undegraded":"2024-09-12T01:09:58.062808+0000","last_fullsized":"2024-09-12T01:09:58.062808+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:33.044875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'28","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.041394+0000","last_change":"2024-09-12T00:27:42.841054+0000","last_active":"2024-09-12T01:07:25.041394+0000","last_peered":"2024-09-12T01:07:25.041394+0000","last_clean":"2024-09-12T01:07:25.041394+0000","last_became_active":"2024-09-12T00:27:42.840749+0000","last_became_peered":"2024-09-12T00:27:42.840749+0000","last_unstale":"2024-09-12T01:07:25.041394+0000","last_undegraded":"2024-09-12T01:07:25.041394+0000","last_fullsized":"2024-09-12T01:07:25.041394+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:58.932432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":101,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.046768+0000","last_change":"2024-09-12T00:46:54.876242+0000","last_active":"2024-09-12T01:08:00.046768+0000","last_peered":"2024-09-12T01:08:00.046768+0000","last_clean":"2024-09-12T01:08:00.046768+0000","last_became_active":"2024-09-12T00:46:54.875939+0000","last_became_peered":"2024-09-12T00:46:54.875939+0000","last_unstale":"2024-09-12T01:08:00.046768+0000","last_undegraded":"2024-09-12T01:08:00.046768+0000","last_fullsized":"2024-09-12T01:08:00.046768+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:39.634295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043775+0000","last_change":"2024-09-12T00:30:17.761490+0000","last_active":"2024-09-12T01:07:40.043775+0000","last_peered":"2024-09-12T01:07:40.043775+0000","last_clean":"2024-09-12T01:07:40.043775+0000","last_became_active":"2024-09-12T00:30:17.761182+0000","last_became_peered":"2024-09-12T00:30:17.761182+0000","last_unstale":"2024-09-12T01:07:40.043775+0000","last_undegraded":"2024-09-12T01:07:40.043775+0000","last_fullsized":"2024-09-12T01:07:40.043775+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:42.070821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.233715+0000","last_change":"2024-09-12T00:30:14.748190+0000","last_active":"2024-09-12T01:07:35.233715+0000","last_peered":"2024-09-12T01:07:35.233715+0000","last_clean":"2024-09-12T01:07:35.233715+0000","last_became_active":"2024-09-12T00:30:14.747887+0000","last_became_peered":"2024-09-12T00:30:14.747887+0000","last_unstale":"2024-09-12T01:07:35.233715+0000","last_undegraded":"2024-09-12T01:07:35.233715+0000","last_fullsized":"2024-09-12T01:07:35.233715+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:51.879862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'76","reported_seq":312,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.132545+0000","last_change":"2024-09-12T00:27:42.839562+0000","last_active":"2024-09-12T01:07:25.132545+0000","last_peered":"2024-09-12T01:07:25.132545+0000","last_clean":"2024-09-12T01:07:25.132545+0000","last_became_active":"2024-09-12T00:27:42.839295+0000","last_became_peered":"2024-09-12T00:27:42.839295+0000","last_unstale":"2024-09-12T01:07:25.132545+0000","last_undegraded":"2024-09-12T01:07:25.132545+0000","last_fullsized":"2024-09-12T01:07:25.132545+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:56.924650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":349,"num_write":102,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.170341+0000","last_change":"2024-09-12T00:46:54.881248+0000","last_active":"2024-09-12T01:08:40.170341+0000","last_peered":"2024-09-12T01:08:40.170341+0000","last_clean":"2024-09-12T01:08:40.170341+0000","last_became_active":"2024-09-12T00:46:54.880982+0000","last_became_peered":"2024-09-12T00:46:54.880982+0000","last_unstale":"2024-09-12T01:08:40.170341+0000","last_undegraded":"2024-09-12T01:08:40.170341+0000","last_fullsized":"2024-09-12T01:08:40.170341+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:32.451032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"263'2","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:00.057885+0000","last_change":"2024-09-12T00:30:17.766356+0000","last_active":"2024-09-12T01:10:00.057885+0000","last_peered":"2024-09-12T01:10:00.057885+0000","last_clean":"2024-09-12T01:10:00.057885+0000","last_became_active":"2024-09-12T00:30:17.765384+0000","last_became_peered":"2024-09-12T00:30:17.765384+0000","last_unstale":"2024-09-12T01:10:00.057885+0000","last_undegraded":"2024-09-12T01:10:00.057885+0000","last_fullsized":"2024-09-12T01:10:00.057885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:48.714095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.936260+0000","last_change":"2024-09-12T00:30:14.750712+0000","last_active":"2024-09-12T01:10:59.936260+0000","last_peered":"2024-09-12T01:10:59.936260+0000","last_clean":"2024-09-12T01:10:59.936260+0000","last_became_active":"2024-09-12T00:30:14.750407+0000","last_became_peered":"2024-09-12T00:30:14.750407+0000","last_unstale":"2024-09-12T01:10:59.936260+0000","last_undegraded":"2024-09-12T01:10:59.936260+0000","last_fullsized":"2024-09-12T01:10:59.936260+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:38.391719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5691,"num_write":6,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'35","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.041332+0000","last_change":"2024-09-12T00:27:42.840411+0000","last_active":"2024-09-12T01:07:25.041332+0000","last_peered":"2024-09-12T01:07:25.041332+0000","last_clean":"2024-09-12T01:07:25.041332+0000","last_became_active":"2024-09-12T00:27:42.840137+0000","last_became_peered":"2024-09-12T00:27:42.840137+0000","last_unstale":"2024-09-12T01:07:25.041332+0000","last_undegraded":"2024-09-12T01:07:25.041332+0000","last_fullsized":"2024-09-12T01:07:25.041332+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:08.491063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":59,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:43.051166+0000","last_change":"2024-09-12T00:46:54.888517+0000","last_active":"2024-09-12T01:08:43.051166+0000","last_peered":"2024-09-12T01:08:43.051166+0000","last_clean":"2024-09-12T01:08:43.051166+0000","last_became_active":"2024-09-12T00:46:54.888207+0000","last_became_peered":"2024-09-12T00:46:54.888207+0000","last_unstale":"2024-09-12T01:08:43.051166+0000","last_undegraded":"2024-09-12T01:08:43.051166+0000","last_fullsized":"2024-09-12T01:08:43.051166+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:38.971555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'7","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.166733+0000","last_change":"2024-09-12T00:30:17.763396+0000","last_active":"2024-09-12T01:10:59.166733+0000","last_peered":"2024-09-12T01:10:59.166733+0000","last_clean":"2024-09-12T01:10:59.166733+0000","last_became_active":"2024-09-12T00:30:17.763106+0000","last_became_peered":"2024-09-12T00:30:17.763106+0000","last_unstale":"2024-09-12T01:10:59.166733+0000","last_undegraded":"2024-09-12T01:10:59.166733+0000","last_fullsized":"2024-09-12T01:10:59.166733+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:48.609847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:45.156114+0000","last_change":"2024-09-12T00:30:14.746340+0000","last_active":"2024-09-12T01:10:45.156114+0000","last_peered":"2024-09-12T01:10:45.156114+0000","last_clean":"2024-09-12T01:10:45.156114+0000","last_became_active":"2024-09-12T00:30:14.746069+0000","last_became_peered":"2024-09-12T00:30:14.746069+0000","last_unstale":"2024-09-12T01:10:45.156114+0000","last_undegraded":"2024-09-12T01:10:45.156114+0000","last_fullsized":"2024-09-12T01:10:45.156114+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:13.259839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'41","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.049662+0000","last_change":"2024-09-12T00:27:42.841822+0000","last_active":"2024-09-12T01:08:20.049662+0000","last_peered":"2024-09-12T01:08:20.049662+0000","last_clean":"2024-09-12T01:08:20.049662+0000","last_became_active":"2024-09-12T00:27:42.841530+0000","last_became_peered":"2024-09-12T00:27:42.841530+0000","last_unstale":"2024-09-12T01:08:20.049662+0000","last_undegraded":"2024-09-12T01:08:20.049662+0000","last_fullsized":"2024-09-12T01:08:20.049662+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:31.785686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.231129+0000","last_change":"2024-09-12T00:46:54.886162+0000","last_active":"2024-09-12T01:07:10.231129+0000","last_peered":"2024-09-12T01:07:10.231129+0000","last_clean":"2024-09-12T01:07:10.231129+0000","last_became_active":"2024-09-12T00:46:54.885842+0000","last_became_peered":"2024-09-12T00:46:54.885842+0000","last_unstale":"2024-09-12T01:07:10.231129+0000","last_undegraded":"2024-09-12T01:07:10.231129+0000","last_fullsized":"2024-09-12T01:07:10.231129+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:09.698110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'6","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052277+0000","last_change":"2024-09-12T00:30:17.765752+0000","last_active":"2024-09-12T01:08:35.052277+0000","last_peered":"2024-09-12T01:08:35.052277+0000","last_clean":"2024-09-12T01:08:35.052277+0000","last_became_active":"2024-09-12T00:30:17.765404+0000","last_became_peered":"2024-09-12T00:30:17.765404+0000","last_unstale":"2024-09-12T01:08:35.052277+0000","last_undegraded":"2024-09-12T01:08:35.052277+0000","last_fullsized":"2024-09-12T01:08:35.052277+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:56.259889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.167293+0000","last_change":"2024-09-12T00:30:14.743435+0000","last_active":"2024-09-12T01:08:30.167293+0000","last_peered":"2024-09-12T01:08:30.167293+0000","last_clean":"2024-09-12T01:08:30.167293+0000","last_became_active":"2024-09-12T00:30:14.743148+0000","last_became_peered":"2024-09-12T00:30:14.743148+0000","last_unstale":"2024-09-12T01:08:30.167293+0000","last_undegraded":"2024-09-12T01:08:30.167293+0000","last_fullsized":"2024-09-12T01:08:30.167293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:22.367871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'37","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045203+0000","last_change":"2024-09-12T00:27:42.846410+0000","last_active":"2024-09-12T01:08:15.045203+0000","last_peered":"2024-09-12T01:08:15.045203+0000","last_clean":"2024-09-12T01:08:15.045203+0000","last_became_active":"2024-09-12T00:27:42.846090+0000","last_became_peered":"2024-09-12T00:27:42.846090+0000","last_unstale":"2024-09-12T01:08:15.045203+0000","last_undegraded":"2024-09-12T01:08:15.045203+0000","last_fullsized":"2024-09-12T01:08:15.045203+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:24.133207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":132,"num_write":69,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.047409+0000","last_change":"2024-09-12T00:46:54.883396+0000","last_active":"2024-09-12T01:08:35.047409+0000","last_peered":"2024-09-12T01:08:35.047409+0000","last_clean":"2024-09-12T01:08:35.047409+0000","last_became_active":"2024-09-12T00:46:54.883024+0000","last_became_peered":"2024-09-12T00:46:54.883024+0000","last_unstale":"2024-09-12T01:08:35.047409+0000","last_undegraded":"2024-09-12T01:08:35.047409+0000","last_fullsized":"2024-09-12T01:08:35.047409+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:27.222440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:55.073588+0000","last_change":"2024-09-12T00:30:17.769409+0000","last_active":"2024-09-12T01:10:55.073588+0000","last_peered":"2024-09-12T01:10:55.073588+0000","last_clean":"2024-09-12T01:10:55.073588+0000","last_became_active":"2024-09-12T00:30:17.769226+0000","last_became_peered":"2024-09-12T00:30:17.769226+0000","last_unstale":"2024-09-12T01:10:55.073588+0000","last_undegraded":"2024-09-12T01:10:55.073588+0000","last_fullsized":"2024-09-12T01:10:55.073588+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:53.397913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.051372+0000","last_change":"2024-09-12T00:30:14.741263+0000","last_active":"2024-09-12T01:08:30.051372+0000","last_peered":"2024-09-12T01:08:30.051372+0000","last_clean":"2024-09-12T01:08:30.051372+0000","last_became_active":"2024-09-12T00:30:14.740963+0000","last_became_peered":"2024-09-12T00:30:14.740963+0000","last_unstale":"2024-09-12T01:08:30.051372+0000","last_undegraded":"2024-09-12T01:08:30.051372+0000","last_fullsized":"2024-09-12T01:08:30.051372+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:55.514008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.238012+0000","last_change":"2024-09-12T00:27:42.835227+0000","last_active":"2024-09-12T01:08:15.238012+0000","last_peered":"2024-09-12T01:08:15.238012+0000","last_clean":"2024-09-12T01:08:15.238012+0000","last_became_active":"2024-09-12T00:27:42.834942+0000","last_became_peered":"2024-09-12T00:27:42.834942+0000","last_unstale":"2024-09-12T01:08:15.238012+0000","last_undegraded":"2024-09-12T01:08:15.238012+0000","last_fullsized":"2024-09-12T01:08:15.238012+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:10.179555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":105,"num_write":60,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.240177+0000","last_change":"2024-09-12T00:46:54.888100+0000","last_active":"2024-09-12T01:08:35.240177+0000","last_peered":"2024-09-12T01:08:35.240177+0000","last_clean":"2024-09-12T01:08:35.240177+0000","last_became_active":"2024-09-12T00:46:54.887303+0000","last_became_peered":"2024-09-12T00:46:54.887303+0000","last_unstale":"2024-09-12T01:08:35.240177+0000","last_undegraded":"2024-09-12T01:08:35.240177+0000","last_fullsized":"2024-09-12T01:08:35.240177+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:37.539140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:48.070602+0000","last_change":"2024-09-12T00:30:17.768358+0000","last_active":"2024-09-12T01:10:48.070602+0000","last_peered":"2024-09-12T01:10:48.070602+0000","last_clean":"2024-09-12T01:10:48.070602+0000","last_became_active":"2024-09-12T00:30:17.768072+0000","last_became_peered":"2024-09-12T00:30:17.768072+0000","last_unstale":"2024-09-12T01:10:48.070602+0000","last_undegraded":"2024-09-12T01:10:48.070602+0000","last_fullsized":"2024-09-12T01:10:48.070602+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:13.328589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.072901+0000","last_change":"2024-09-12T00:30:14.744984+0000","last_active":"2024-09-12T01:10:50.072901+0000","last_peered":"2024-09-12T01:10:50.072901+0000","last_clean":"2024-09-12T01:10:50.072901+0000","last_became_active":"2024-09-12T00:30:14.744485+0000","last_became_peered":"2024-09-12T00:30:14.744485+0000","last_unstale":"2024-09-12T01:10:50.072901+0000","last_undegraded":"2024-09-12T01:10:50.072901+0000","last_fullsized":"2024-09-12T01:10:50.072901+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:02.930319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'50","reported_seq":195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165137+0000","last_change":"2024-09-12T00:27:42.839068+0000","last_active":"2024-09-12T01:08:15.165137+0000","last_peered":"2024-09-12T01:08:15.165137+0000","last_clean":"2024-09-12T01:08:15.165137+0000","last_became_active":"2024-09-12T00:27:42.838771+0000","last_became_peered":"2024-09-12T00:27:42.838771+0000","last_unstale":"2024-09-12T01:08:15.165137+0000","last_undegraded":"2024-09-12T01:08:15.165137+0000","last_fullsized":"2024-09-12T01:08:15.165137+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:39.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":194,"num_write":94,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.037715+0000","last_change":"2024-09-12T00:46:54.884379+0000","last_active":"2024-09-12T01:07:13.037715+0000","last_peered":"2024-09-12T01:07:13.037715+0000","last_clean":"2024-09-12T01:07:13.037715+0000","last_became_active":"2024-09-12T00:46:54.883927+0000","last_became_peered":"2024-09-12T00:46:54.883927+0000","last_unstale":"2024-09-12T01:07:13.037715+0000","last_undegraded":"2024-09-12T01:07:13.037715+0000","last_fullsized":"2024-09-12T01:07:13.037715+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:13.845718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'2","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.053093+0000","last_change":"2024-09-12T00:30:17.761674+0000","last_active":"2024-09-12T01:09:20.053093+0000","last_peered":"2024-09-12T01:09:20.053093+0000","last_clean":"2024-09-12T01:09:20.053093+0000","last_became_active":"2024-09-12T00:30:17.761176+0000","last_became_peered":"2024-09-12T00:30:17.761176+0000","last_unstale":"2024-09-12T01:09:20.053093+0000","last_undegraded":"2024-09-12T01:09:20.053093+0000","last_fullsized":"2024-09-12T01:09:20.053093+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.925976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.058934+0000","last_change":"2024-09-12T00:30:14.744748+0000","last_active":"2024-09-12T01:09:15.058934+0000","last_peered":"2024-09-12T01:09:15.058934+0000","last_clean":"2024-09-12T01:09:15.058934+0000","last_became_active":"2024-09-12T00:30:14.743730+0000","last_became_peered":"2024-09-12T00:30:14.743730+0000","last_unstale":"2024-09-12T01:09:15.058934+0000","last_undegraded":"2024-09-12T01:09:15.058934+0000","last_fullsized":"2024-09-12T01:09:15.058934+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:40.137757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'40","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165081+0000","last_change":"2024-09-12T00:27:42.842498+0000","last_active":"2024-09-12T01:08:15.165081+0000","last_peered":"2024-09-12T01:08:15.165081+0000","last_clean":"2024-09-12T01:08:15.165081+0000","last_became_active":"2024-09-12T00:27:42.842267+0000","last_became_peered":"2024-09-12T00:27:42.842267+0000","last_unstale":"2024-09-12T01:08:15.165081+0000","last_undegraded":"2024-09-12T01:08:15.165081+0000","last_fullsized":"2024-09-12T01:08:15.165081+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:13.278076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":155,"num_write":62,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:15.131566+0000","last_change":"2024-09-12T00:46:54.889599+0000","last_active":"2024-09-12T01:07:15.131566+0000","last_peered":"2024-09-12T01:07:15.131566+0000","last_clean":"2024-09-12T01:07:15.131566+0000","last_became_active":"2024-09-12T00:46:54.889349+0000","last_became_peered":"2024-09-12T00:46:54.889349+0000","last_unstale":"2024-09-12T01:07:15.131566+0000","last_undegraded":"2024-09-12T01:07:15.131566+0000","last_fullsized":"2024-09-12T01:07:15.131566+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:02.442642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.130933+0000","last_change":"2024-09-12T00:30:17.760081+0000","last_active":"2024-09-12T01:07:10.130933+0000","last_peered":"2024-09-12T01:07:10.130933+0000","last_clean":"2024-09-12T01:07:10.130933+0000","last_became_active":"2024-09-12T00:30:17.759769+0000","last_became_peered":"2024-09-12T00:30:17.759769+0000","last_unstale":"2024-09-12T01:07:10.130933+0000","last_undegraded":"2024-09-12T01:07:10.130933+0000","last_fullsized":"2024-09-12T01:07:10.130933+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:22.158179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.036968+0000","last_change":"2024-09-12T00:30:14.748668+0000","last_active":"2024-09-12T01:07:08.036968+0000","last_peered":"2024-09-12T01:07:08.036968+0000","last_clean":"2024-09-12T01:07:08.036968+0000","last_became_active":"2024-09-12T00:30:14.748409+0000","last_became_peered":"2024-09-12T00:30:14.748409+0000","last_unstale":"2024-09-12T01:07:08.036968+0000","last_undegraded":"2024-09-12T01:07:08.036968+0000","last_fullsized":"2024-09-12T01:07:08.036968+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:15.762806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'24","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.128541+0000","last_change":"2024-09-12T00:27:42.844619+0000","last_active":"2024-09-12T01:06:50.128541+0000","last_peered":"2024-09-12T01:06:50.128541+0000","last_clean":"2024-09-12T01:06:50.128541+0000","last_became_active":"2024-09-12T00:27:42.844338+0000","last_became_peered":"2024-09-12T00:27:42.844338+0000","last_unstale":"2024-09-12T01:06:50.128541+0000","last_undegraded":"2024-09-12T01:06:50.128541+0000","last_fullsized":"2024-09-12T01:06:50.128541+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:10.822999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":85,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.024797+0000","last_change":"2024-09-12T00:46:54.890993+0000","last_active":"2024-09-12T01:07:10.024797+0000","last_peered":"2024-09-12T01:07:10.024797+0000","last_clean":"2024-09-12T01:07:10.024797+0000","last_became_active":"2024-09-12T00:46:54.890636+0000","last_became_peered":"2024-09-12T00:46:54.890636+0000","last_unstale":"2024-09-12T01:07:10.024797+0000","last_undegraded":"2024-09-12T01:07:10.024797+0000","last_fullsized":"2024-09-12T01:07:10.024797+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:05.237293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.169493+0000","last_change":"2024-09-12T00:30:17.762552+0000","last_active":"2024-09-12T01:08:35.169493+0000","last_peered":"2024-09-12T01:08:35.169493+0000","last_clean":"2024-09-12T01:08:35.169493+0000","last_became_active":"2024-09-12T00:30:17.762239+0000","last_became_peered":"2024-09-12T00:30:17.762239+0000","last_unstale":"2024-09-12T01:08:35.169493+0000","last_undegraded":"2024-09-12T01:08:35.169493+0000","last_fullsized":"2024-09-12T01:08:35.169493+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:41.552516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'11","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.552613+0000","last_change":"2024-09-12T00:30:14.751029+0000","last_active":"2024-09-12T01:10:58.552613+0000","last_peered":"2024-09-12T01:10:58.552613+0000","last_clean":"2024-09-12T01:10:58.552613+0000","last_became_active":"2024-09-12T00:30:14.750745+0000","last_became_peered":"2024-09-12T00:30:14.750745+0000","last_unstale":"2024-09-12T01:10:58.552613+0000","last_undegraded":"2024-09-12T01:10:58.552613+0000","last_fullsized":"2024-09-12T01:10:58.552613+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:09.884275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12861,"num_write":16,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.052980+0000","last_change":"2024-09-12T00:27:42.837910+0000","last_active":"2024-09-12T01:08:53.052980+0000","last_peered":"2024-09-12T01:08:53.052980+0000","last_clean":"2024-09-12T01:08:53.052980+0000","last_became_active":"2024-09-12T00:27:42.837690+0000","last_became_peered":"2024-09-12T00:27:42.837690+0000","last_unstale":"2024-09-12T01:08:53.052980+0000","last_undegraded":"2024-09-12T01:08:53.052980+0000","last_fullsized":"2024-09-12T01:08:53.052980+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:00.171095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.038780+0000","last_change":"2024-09-12T00:46:54.885537+0000","last_active":"2024-09-12T01:07:10.038780+0000","last_peered":"2024-09-12T01:07:10.038780+0000","last_clean":"2024-09-12T01:07:10.038780+0000","last_became_active":"2024-09-12T00:46:54.885262+0000","last_became_peered":"2024-09-12T00:46:54.885262+0000","last_unstale":"2024-09-12T01:07:10.038780+0000","last_undegraded":"2024-09-12T01:07:10.038780+0000","last_fullsized":"2024-09-12T01:07:10.038780+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:34.916083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'7","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.026327+0000","last_change":"2024-09-12T00:30:17.761394+0000","last_active":"2024-09-12T01:07:25.026327+0000","last_peered":"2024-09-12T01:07:25.026327+0000","last_clean":"2024-09-12T01:07:25.026327+0000","last_became_active":"2024-09-12T00:30:17.761071+0000","last_became_peered":"2024-09-12T00:30:17.761071+0000","last_unstale":"2024-09-12T01:07:25.026327+0000","last_undegraded":"2024-09-12T01:07:25.026327+0000","last_fullsized":"2024-09-12T01:07:25.026327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:56.989395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.046932+0000","last_change":"2024-09-12T00:30:14.750202+0000","last_active":"2024-09-12T01:08:30.046932+0000","last_peered":"2024-09-12T01:08:30.046932+0000","last_clean":"2024-09-12T01:08:30.046932+0000","last_became_active":"2024-09-12T00:30:14.749906+0000","last_became_peered":"2024-09-12T00:30:14.749906+0000","last_unstale":"2024-09-12T01:08:30.046932+0000","last_undegraded":"2024-09-12T01:08:30.046932+0000","last_fullsized":"2024-09-12T01:08:30.046932+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:25.050487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'11","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.036018+0000","last_change":"2024-09-12T00:27:42.837136+0000","last_active":"2024-09-12T01:08:55.036018+0000","last_peered":"2024-09-12T01:08:55.036018+0000","last_clean":"2024-09-12T01:08:55.036018+0000","last_became_active":"2024-09-12T00:27:42.836870+0000","last_became_peered":"2024-09-12T00:27:42.836870+0000","last_unstale":"2024-09-12T01:08:55.036018+0000","last_undegraded":"2024-09-12T01:08:55.036018+0000","last_fullsized":"2024-09-12T01:08:55.036018+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.028516+0000","last_change":"2024-09-12T00:46:54.891625+0000","last_active":"2024-09-12T01:07:45.028516+0000","last_peered":"2024-09-12T01:07:45.028516+0000","last_clean":"2024-09-12T01:07:45.028516+0000","last_became_active":"2024-09-12T00:46:54.891359+0000","last_became_peered":"2024-09-12T00:46:54.891359+0000","last_unstale":"2024-09-12T01:07:45.028516+0000","last_undegraded":"2024-09-12T01:07:45.028516+0000","last_fullsized":"2024-09-12T01:07:45.028516+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:36.674826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:03.063577+0000","last_change":"2024-09-12T00:30:17.767137+0000","last_active":"2024-09-12T01:10:03.063577+0000","last_peered":"2024-09-12T01:10:03.063577+0000","last_clean":"2024-09-12T01:10:03.063577+0000","last_became_active":"2024-09-12T00:30:17.766810+0000","last_became_peered":"2024-09-12T00:30:17.766810+0000","last_unstale":"2024-09-12T01:10:03.063577+0000","last_undegraded":"2024-09-12T01:10:03.063577+0000","last_fullsized":"2024-09-12T01:10:03.063577+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:50.589394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041701+0000","last_change":"2024-09-12T00:30:14.744674+0000","last_active":"2024-09-12T01:07:45.041701+0000","last_peered":"2024-09-12T01:07:45.041701+0000","last_clean":"2024-09-12T01:07:45.041701+0000","last_became_active":"2024-09-12T00:30:14.744334+0000","last_became_peered":"2024-09-12T00:30:14.744334+0000","last_unstale":"2024-09-12T01:07:45.041701+0000","last_undegraded":"2024-09-12T01:07:45.041701+0000","last_fullsized":"2024-09-12T01:07:45.041701+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:58.360546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":168,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.055761+0000","last_change":"2024-09-12T00:27:42.836761+0000","last_active":"2024-09-12T01:08:55.055761+0000","last_peered":"2024-09-12T01:08:55.055761+0000","last_clean":"2024-09-12T01:08:55.055761+0000","last_became_active":"2024-09-12T00:27:42.836468+0000","last_became_peered":"2024-09-12T00:27:42.836468+0000","last_unstale":"2024-09-12T01:08:55.055761+0000","last_undegraded":"2024-09-12T01:08:55.055761+0000","last_fullsized":"2024-09-12T01:08:55.055761+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:01.432222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":155,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.028541+0000","last_change":"2024-09-12T00:46:54.888800+0000","last_active":"2024-09-12T01:07:45.028541+0000","last_peered":"2024-09-12T01:07:45.028541+0000","last_clean":"2024-09-12T01:07:45.028541+0000","last_became_active":"2024-09-12T00:46:54.888533+0000","last_became_peered":"2024-09-12T00:46:54.888533+0000","last_unstale":"2024-09-12T01:07:45.028541+0000","last_undegraded":"2024-09-12T01:07:45.028541+0000","last_fullsized":"2024-09-12T01:07:45.028541+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:16.016312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:53.061966+0000","last_change":"2024-09-12T00:30:17.766100+0000","last_active":"2024-09-12T01:09:53.061966+0000","last_peered":"2024-09-12T01:09:53.061966+0000","last_clean":"2024-09-12T01:09:53.061966+0000","last_became_active":"2024-09-12T00:30:17.764747+0000","last_became_peered":"2024-09-12T00:30:17.764747+0000","last_unstale":"2024-09-12T01:09:53.061966+0000","last_undegraded":"2024-09-12T01:09:53.061966+0000","last_fullsized":"2024-09-12T01:09:53.061966+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:28.017911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045464+0000","last_change":"2024-09-12T00:30:14.750085+0000","last_active":"2024-09-12T01:07:50.045464+0000","last_peered":"2024-09-12T01:07:50.045464+0000","last_clean":"2024-09-12T01:07:50.045464+0000","last_became_active":"2024-09-12T00:30:14.749668+0000","last_became_peered":"2024-09-12T00:30:14.749668+0000","last_unstale":"2024-09-12T01:07:50.045464+0000","last_undegraded":"2024-09-12T01:07:50.045464+0000","last_fullsized":"2024-09-12T01:07:50.045464+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:46.909054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'44","reported_seq":170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.049812+0000","last_change":"2024-09-12T00:27:42.846229+0000","last_active":"2024-09-12T01:08:55.049812+0000","last_peered":"2024-09-12T01:08:55.049812+0000","last_clean":"2024-09-12T01:08:55.049812+0000","last_became_active":"2024-09-12T00:27:42.845963+0000","last_became_peered":"2024-09-12T00:27:42.845963+0000","last_unstale":"2024-09-12T01:08:55.049812+0000","last_undegraded":"2024-09-12T01:08:55.049812+0000","last_fullsized":"2024-09-12T01:08:55.049812+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":173,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.054456+0000","last_change":"2024-09-12T00:46:54.885230+0000","last_active":"2024-09-12T01:09:03.054456+0000","last_peered":"2024-09-12T01:09:03.054456+0000","last_clean":"2024-09-12T01:09:03.054456+0000","last_became_active":"2024-09-12T00:46:54.884950+0000","last_became_peered":"2024-09-12T00:46:54.884950+0000","last_unstale":"2024-09-12T01:09:03.054456+0000","last_undegraded":"2024-09-12T01:09:03.054456+0000","last_fullsized":"2024-09-12T01:09:03.054456+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:05.858636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.039122+0000","last_change":"2024-09-12T00:30:17.762675+0000","last_active":"2024-09-12T01:09:20.039122+0000","last_peered":"2024-09-12T01:09:20.039122+0000","last_clean":"2024-09-12T01:09:20.039122+0000","last_became_active":"2024-09-12T00:30:17.762415+0000","last_became_peered":"2024-09-12T00:30:17.762415+0000","last_unstale":"2024-09-12T01:09:20.039122+0000","last_undegraded":"2024-09-12T01:09:20.039122+0000","last_fullsized":"2024-09-12T01:09:20.039122+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:08.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.145112+0000","last_change":"2024-09-12T00:30:14.748878+0000","last_active":"2024-09-12T01:09:15.145112+0000","last_peered":"2024-09-12T01:09:15.145112+0000","last_clean":"2024-09-12T01:09:15.145112+0000","last_became_active":"2024-09-12T00:30:14.748581+0000","last_became_peered":"2024-09-12T00:30:14.748581+0000","last_unstale":"2024-09-12T01:09:15.145112+0000","last_undegraded":"2024-09-12T01:09:15.145112+0000","last_fullsized":"2024-09-12T01:09:15.145112+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:51.379006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.132599+0000","last_change":"2024-09-12T00:27:42.844241+0000","last_active":"2024-09-12T01:07:25.132599+0000","last_peered":"2024-09-12T01:07:25.132599+0000","last_clean":"2024-09-12T01:07:25.132599+0000","last_became_active":"2024-09-12T00:27:42.843968+0000","last_became_peered":"2024-09-12T00:27:42.843968+0000","last_unstale":"2024-09-12T01:07:25.132599+0000","last_undegraded":"2024-09-12T01:07:25.132599+0000","last_fullsized":"2024-09-12T01:07:25.132599+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:47.646443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":171,"num_write":76,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041617+0000","last_change":"2024-09-12T00:46:54.881183+0000","last_active":"2024-09-12T01:07:45.041617+0000","last_peered":"2024-09-12T01:07:45.041617+0000","last_clean":"2024-09-12T01:07:45.041617+0000","last_became_active":"2024-09-12T00:46:54.880874+0000","last_became_peered":"2024-09-12T00:46:54.880874+0000","last_unstale":"2024-09-12T01:07:45.041617+0000","last_undegraded":"2024-09-12T01:07:45.041617+0000","last_fullsized":"2024-09-12T01:07:45.041617+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:52.663395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.037704+0000","last_change":"2024-09-12T00:30:17.764321+0000","last_active":"2024-09-12T01:07:10.037704+0000","last_peered":"2024-09-12T01:07:10.037704+0000","last_clean":"2024-09-12T01:07:10.037704+0000","last_became_active":"2024-09-12T00:30:17.762807+0000","last_became_peered":"2024-09-12T00:30:17.762807+0000","last_unstale":"2024-09-12T01:07:10.037704+0000","last_undegraded":"2024-09-12T01:07:10.037704+0000","last_fullsized":"2024-09-12T01:07:10.037704+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:22.911043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.052565+0000","last_change":"2024-09-12T00:30:14.750078+0000","last_active":"2024-09-12T01:09:15.052565+0000","last_peered":"2024-09-12T01:09:15.052565+0000","last_clean":"2024-09-12T01:09:15.052565+0000","last_became_active":"2024-09-12T00:30:14.749608+0000","last_became_peered":"2024-09-12T00:30:14.749608+0000","last_unstale":"2024-09-12T01:09:15.052565+0000","last_undegraded":"2024-09-12T01:09:15.052565+0000","last_fullsized":"2024-09-12T01:09:15.052565+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:51.387598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'41","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.040525+0000","last_change":"2024-09-12T00:27:42.846138+0000","last_active":"2024-09-12T01:07:20.040525+0000","last_peered":"2024-09-12T01:07:20.040525+0000","last_clean":"2024-09-12T01:07:20.040525+0000","last_became_active":"2024-09-12T00:27:42.845889+0000","last_became_peered":"2024-09-12T00:27:42.845889+0000","last_unstale":"2024-09-12T01:07:20.040525+0000","last_undegraded":"2024-09-12T01:07:20.040525+0000","last_fullsized":"2024-09-12T01:07:20.040525+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:08.298324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":162,"num_write":61,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052331+0000","last_change":"2024-09-12T00:46:54.887517+0000","last_active":"2024-09-12T01:08:35.052331+0000","last_peered":"2024-09-12T01:08:35.052331+0000","last_clean":"2024-09-12T01:08:35.052331+0000","last_became_active":"2024-09-12T00:46:54.887206+0000","last_became_peered":"2024-09-12T00:46:54.887206+0000","last_unstale":"2024-09-12T01:08:35.052331+0000","last_undegraded":"2024-09-12T01:08:35.052331+0000","last_fullsized":"2024-09-12T01:08:35.052331+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:31.785829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045384+0000","last_change":"2024-09-12T00:30:17.768384+0000","last_active":"2024-09-12T01:07:50.045384+0000","last_peered":"2024-09-12T01:07:50.045384+0000","last_clean":"2024-09-12T01:07:50.045384+0000","last_became_active":"2024-09-12T00:30:17.767990+0000","last_became_peered":"2024-09-12T00:30:17.767990+0000","last_unstale":"2024-09-12T01:07:50.045384+0000","last_undegraded":"2024-09-12T01:07:50.045384+0000","last_fullsized":"2024-09-12T01:07:50.045384+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:34.324472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"263'2","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:20.152715+0000","last_change":"2024-09-12T00:30:14.745501+0000","last_active":"2024-09-12T01:10:20.152715+0000","last_peered":"2024-09-12T01:10:20.152715+0000","last_clean":"2024-09-12T01:10:20.152715+0000","last_became_active":"2024-09-12T00:30:14.745195+0000","last_became_peered":"2024-09-12T00:30:14.745195+0000","last_unstale":"2024-09-12T01:10:20.152715+0000","last_undegraded":"2024-09-12T01:10:20.152715+0000","last_fullsized":"2024-09-12T01:10:20.152715+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:05.190444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'32","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.132064+0000","last_change":"2024-09-12T00:27:42.844201+0000","last_active":"2024-09-12T01:07:20.132064+0000","last_peered":"2024-09-12T01:07:20.132064+0000","last_clean":"2024-09-12T01:07:20.132064+0000","last_became_active":"2024-09-12T00:27:42.843841+0000","last_became_peered":"2024-09-12T00:27:42.843841+0000","last_unstale":"2024-09-12T01:07:20.132064+0000","last_undegraded":"2024-09-12T01:07:20.132064+0000","last_fullsized":"2024-09-12T01:07:20.132064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:33.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":99,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052355+0000","last_change":"2024-09-12T00:46:54.884403+0000","last_active":"2024-09-12T01:08:35.052355+0000","last_peered":"2024-09-12T01:08:35.052355+0000","last_clean":"2024-09-12T01:08:35.052355+0000","last_became_active":"2024-09-12T00:46:54.884110+0000","last_became_peered":"2024-09-12T00:46:54.884110+0000","last_unstale":"2024-09-12T01:08:35.052355+0000","last_undegraded":"2024-09-12T01:08:35.052355+0000","last_fullsized":"2024-09-12T01:08:35.052355+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:54.447390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.724327+0000","last_change":"2024-09-12T00:30:17.763239+0000","last_active":"2024-09-12T01:10:58.724327+0000","last_peered":"2024-09-12T01:10:58.724327+0000","last_clean":"2024-09-12T01:10:58.724327+0000","last_became_active":"2024-09-12T00:30:17.762850+0000","last_became_peered":"2024-09-12T00:30:17.762850+0000","last_unstale":"2024-09-12T01:10:58.724327+0000","last_undegraded":"2024-09-12T01:10:58.724327+0000","last_fullsized":"2024-09-12T01:10:58.724327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:27.977927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'10","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.365202+0000","last_change":"2024-09-12T00:30:14.736582+0000","last_active":"2024-09-12T01:10:58.365202+0000","last_peered":"2024-09-12T01:10:58.365202+0000","last_clean":"2024-09-12T01:10:58.365202+0000","last_became_active":"2024-09-12T00:30:14.736286+0000","last_became_peered":"2024-09-12T00:30:14.736286+0000","last_unstale":"2024-09-12T01:10:58.365202+0000","last_undegraded":"2024-09-12T01:10:58.365202+0000","last_fullsized":"2024-09-12T01:10:58.365202+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:21.074121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":20,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'42","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.038717+0000","last_change":"2024-09-12T00:27:42.842160+0000","last_active":"2024-09-12T01:07:20.038717+0000","last_peered":"2024-09-12T01:07:20.038717+0000","last_clean":"2024-09-12T01:07:20.038717+0000","last_became_active":"2024-09-12T00:27:42.841880+0000","last_became_peered":"2024-09-12T00:27:42.841880+0000","last_unstale":"2024-09-12T01:07:20.038717+0000","last_undegraded":"2024-09-12T01:07:20.038717+0000","last_fullsized":"2024-09-12T01:07:20.038717+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:58.218462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":149,"num_write":77,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042872+0000","last_change":"2024-09-12T00:46:54.887508+0000","last_active":"2024-09-12T01:07:48.042872+0000","last_peered":"2024-09-12T01:07:48.042872+0000","last_clean":"2024-09-12T01:07:48.042872+0000","last_became_active":"2024-09-12T00:46:54.887241+0000","last_became_peered":"2024-09-12T00:46:54.887241+0000","last_unstale":"2024-09-12T01:07:48.042872+0000","last_undegraded":"2024-09-12T01:07:48.042872+0000","last_fullsized":"2024-09-12T01:07:48.042872+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:05.592034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135434+0000","last_change":"2024-09-12T00:30:17.763748+0000","last_active":"2024-09-12T01:07:50.135434+0000","last_peered":"2024-09-12T01:07:50.135434+0000","last_clean":"2024-09-12T01:07:50.135434+0000","last_became_active":"2024-09-12T00:30:17.763434+0000","last_became_peered":"2024-09-12T00:30:17.763434+0000","last_unstale":"2024-09-12T01:07:50.135434+0000","last_undegraded":"2024-09-12T01:07:50.135434+0000","last_fullsized":"2024-09-12T01:07:50.135434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:35.178500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160616+0000","last_change":"2024-09-12T00:30:14.745243+0000","last_active":"2024-09-12T01:07:45.160616+0000","last_peered":"2024-09-12T01:07:45.160616+0000","last_clean":"2024-09-12T01:07:45.160616+0000","last_became_active":"2024-09-12T00:30:14.744954+0000","last_became_peered":"2024-09-12T00:30:14.744954+0000","last_unstale":"2024-09-12T01:07:45.160616+0000","last_undegraded":"2024-09-12T01:07:45.160616+0000","last_fullsized":"2024-09-12T01:07:45.160616+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:54.776721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'51","reported_seq":181,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.038684+0000","last_change":"2024-09-12T00:27:42.843112+0000","last_active":"2024-09-12T01:07:20.038684+0000","last_peered":"2024-09-12T01:07:20.038684+0000","last_clean":"2024-09-12T01:07:20.038684+0000","last_became_active":"2024-09-12T00:27:42.842779+0000","last_became_peered":"2024-09-12T00:27:42.842779+0000","last_unstale":"2024-09-12T01:07:20.038684+0000","last_undegraded":"2024-09-12T01:07:20.038684+0000","last_fullsized":"2024-09-12T01:07:20.038684+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:44.649308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":161,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.042278+0000","last_change":"2024-09-12T00:46:54.882461+0000","last_active":"2024-09-12T01:07:50.042278+0000","last_peered":"2024-09-12T01:07:50.042278+0000","last_clean":"2024-09-12T01:07:50.042278+0000","last_became_active":"2024-09-12T00:46:54.882192+0000","last_became_peered":"2024-09-12T00:46:54.882192+0000","last_unstale":"2024-09-12T01:07:50.042278+0000","last_undegraded":"2024-09-12T01:07:50.042278+0000","last_fullsized":"2024-09-12T01:07:50.042278+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:45.883428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'6","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.604105+0000","last_change":"2024-09-12T00:30:17.758495+0000","last_active":"2024-09-12T01:10:58.604105+0000","last_peered":"2024-09-12T01:10:58.604105+0000","last_clean":"2024-09-12T01:10:58.604105+0000","last_became_active":"2024-09-12T00:30:17.756710+0000","last_became_peered":"2024-09-12T00:30:17.756710+0000","last_unstale":"2024-09-12T01:10:58.604105+0000","last_undegraded":"2024-09-12T01:10:58.604105+0000","last_fullsized":"2024-09-12T01:10:58.604105+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:26.589681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'5","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.239757+0000","last_change":"2024-09-12T00:30:14.749818+0000","last_active":"2024-09-12T01:10:58.239757+0000","last_peered":"2024-09-12T01:10:58.239757+0000","last_clean":"2024-09-12T01:10:58.239757+0000","last_became_active":"2024-09-12T00:30:14.749353+0000","last_became_peered":"2024-09-12T00:30:14.749353+0000","last_unstale":"2024-09-12T01:10:58.239757+0000","last_undegraded":"2024-09-12T01:10:58.239757+0000","last_fullsized":"2024-09-12T01:10:58.239757+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.846302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'16","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135384+0000","last_change":"2024-09-12T00:27:42.846318+0000","last_active":"2024-09-12T01:07:50.135384+0000","last_peered":"2024-09-12T01:07:50.135384+0000","last_clean":"2024-09-12T01:07:50.135384+0000","last_became_active":"2024-09-12T00:27:42.846065+0000","last_became_peered":"2024-09-12T00:27:42.846065+0000","last_unstale":"2024-09-12T01:07:50.135384+0000","last_undegraded":"2024-09-12T01:07:50.135384+0000","last_fullsized":"2024-09-12T01:07:50.135384+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:12.594329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":60,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'368","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.091190+0000","last_change":"2024-09-12T00:12:36.042181+0000","last_active":"2024-09-12T01:11:00.091190+0000","last_peered":"2024-09-12T01:11:00.091190+0000","last_clean":"2024-09-12T01:11:00.091190+0000","last_became_active":"2024-09-12T00:12:36.041803+0000","last_became_peered":"2024-09-12T00:12:36.041803+0000","last_unstale":"2024-09-12T01:11:00.091190+0000","last_undegraded":"2024-09-12T01:11:00.091190+0000","last_fullsized":"2024-09-12T01:11:00.091190+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:47.399756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48825,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":31202,"num_write":1169,"num_write_kb":36538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'78","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.234258+0000","last_change":"2024-09-12T00:12:38.036843+0000","last_active":"2024-09-12T01:07:40.234258+0000","last_peered":"2024-09-12T01:07:40.234258+0000","last_clean":"2024-09-12T01:07:40.234258+0000","last_became_active":"2024-09-12T00:12:38.035848+0000","last_became_peered":"2024-09-12T00:12:38.035848+0000","last_unstale":"2024-09-12T01:07:40.234258+0000","last_undegraded":"2024-09-12T01:07:40.234258+0000","last_fullsized":"2024-09-12T01:07:40.234258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:27.637600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":321,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'468","reported_seq":1241,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.210367+0000","last_change":"2024-09-12T00:12:36.045798+0000","last_active":"2024-09-12T01:11:00.210367+0000","last_peered":"2024-09-12T01:11:00.210367+0000","last_clean":"2024-09-12T01:11:00.210367+0000","last_became_active":"2024-09-12T00:12:36.045325+0000","last_became_peered":"2024-09-12T00:12:36.045325+0000","last_unstale":"2024-09-12T01:11:00.210367+0000","last_undegraded":"2024-09-12T01:11:00.210367+0000","last_fullsized":"2024-09-12T01:11:00.210367+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:52.983449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6448752,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1044,"num_read_kb":48846,"num_write":1428,"num_write_kb":45958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'64","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.041016+0000","last_change":"2024-09-12T00:12:38.041199+0000","last_active":"2024-09-12T01:07:40.041016+0000","last_peered":"2024-09-12T01:07:40.041016+0000","last_clean":"2024-09-12T01:07:40.041016+0000","last_became_active":"2024-09-12T00:12:38.040122+0000","last_became_peered":"2024-09-12T00:12:38.040122+0000","last_unstale":"2024-09-12T01:07:40.041016+0000","last_undegraded":"2024-09-12T01:07:40.041016+0000","last_fullsized":"2024-09-12T01:07:40.041016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:46.078316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":259,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'346","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.185329+0000","last_change":"2024-09-12T00:12:36.040486+0000","last_active":"2024-09-12T01:11:00.185329+0000","last_peered":"2024-09-12T01:11:00.185329+0000","last_clean":"2024-09-12T01:11:00.185329+0000","last_became_active":"2024-09-12T00:12:36.039741+0000","last_became_peered":"2024-09-12T00:12:36.039741+0000","last_unstale":"2024-09-12T01:11:00.185329+0000","last_undegraded":"2024-09-12T01:11:00.185329+0000","last_fullsized":"2024-09-12T01:11:00.185329+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:20.639041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262217,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":26393,"num_write":1030,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'307","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.041068+0000","last_change":"2024-09-12T00:12:38.042224+0000","last_active":"2024-09-12T01:07:40.041068+0000","last_peered":"2024-09-12T01:07:40.041068+0000","last_clean":"2024-09-12T01:07:40.041068+0000","last_became_active":"2024-09-12T00:12:38.041795+0000","last_became_peered":"2024-09-12T00:12:38.041795+0000","last_unstale":"2024-09-12T01:07:40.041068+0000","last_undegraded":"2024-09-12T01:07:40.041068+0000","last_fullsized":"2024-09-12T01:07:40.041068+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:58.089809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1291,"num_read_kb":1053,"num_write":447,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'403","reported_seq":1051,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.172231+0000","last_change":"2024-09-12T00:12:36.037299+0000","last_active":"2024-09-12T01:11:00.172231+0000","last_peered":"2024-09-12T01:11:00.172231+0000","last_clean":"2024-09-12T01:11:00.172231+0000","last_became_active":"2024-09-12T00:12:36.036970+0000","last_became_peered":"2024-09-12T00:12:36.036970+0000","last_unstale":"2024-09-12T01:11:00.172231+0000","last_undegraded":"2024-09-12T01:11:00.172231+0000","last_fullsized":"2024-09-12T01:11:00.172231+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:48.587739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":29211,"num_write":1250,"num_write_kb":52081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'61","reported_seq":601,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043790+0000","last_change":"2024-09-12T00:12:38.039591+0000","last_active":"2024-09-12T01:07:40.043790+0000","last_peered":"2024-09-12T01:07:40.043790+0000","last_clean":"2024-09-12T01:07:40.043790+0000","last_became_active":"2024-09-12T00:12:38.039292+0000","last_became_peered":"2024-09-12T00:12:38.039292+0000","last_unstale":"2024-09-12T01:07:40.043790+0000","last_undegraded":"2024-09-12T01:07:40.043790+0000","last_fullsized":"2024-09-12T01:07:40.043790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:31.375488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":95,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'338","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.217776+0000","last_change":"2024-09-12T00:12:36.046560+0000","last_active":"2024-09-12T01:11:00.217776+0000","last_peered":"2024-09-12T01:11:00.217776+0000","last_clean":"2024-09-12T01:11:00.217776+0000","last_became_active":"2024-09-12T00:12:36.044021+0000","last_became_peered":"2024-09-12T00:12:36.044021+0000","last_unstale":"2024-09-12T01:11:00.217776+0000","last_undegraded":"2024-09-12T01:11:00.217776+0000","last_fullsized":"2024-09-12T01:11:00.217776+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:49.437691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730157,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":19079,"num_write":1003,"num_write_kb":26981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'446","reported_seq":1069,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.036112+0000","last_change":"2024-09-12T00:12:38.037277+0000","last_active":"2024-09-12T01:08:55.036112+0000","last_peered":"2024-09-12T01:08:55.036112+0000","last_clean":"2024-09-12T01:08:55.036112+0000","last_became_active":"2024-09-12T00:12:38.037000+0000","last_became_peered":"2024-09-12T00:12:38.037000+0000","last_unstale":"2024-09-12T01:08:55.036112+0000","last_undegraded":"2024-09-12T01:08:55.036112+0000","last_fullsized":"2024-09-12T01:08:55.036112+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:52.457342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1930,"num_read_kb":1543,"num_write":735,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'369","reported_seq":1037,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.193548+0000","last_change":"2024-09-12T00:12:36.038559+0000","last_active":"2024-09-12T01:11:00.193548+0000","last_peered":"2024-09-12T01:11:00.193548+0000","last_clean":"2024-09-12T01:11:00.193548+0000","last_became_active":"2024-09-12T00:12:36.038235+0000","last_became_peered":"2024-09-12T00:12:36.038235+0000","last_unstale":"2024-09-12T01:11:00.193548+0000","last_undegraded":"2024-09-12T01:11:00.193548+0000","last_fullsized":"2024-09-12T01:11:00.193548+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:13.516943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342021,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":629,"num_read_kb":9962,"num_write":1248,"num_write_kb":25658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'300","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.036158+0000","last_change":"2024-09-12T00:12:38.045583+0000","last_active":"2024-09-12T01:08:55.036158+0000","last_peered":"2024-09-12T01:08:55.036158+0000","last_clean":"2024-09-12T01:08:55.036158+0000","last_became_active":"2024-09-12T00:12:38.045308+0000","last_became_peered":"2024-09-12T00:12:38.045308+0000","last_unstale":"2024-09-12T01:08:55.036158+0000","last_undegraded":"2024-09-12T01:08:55.036158+0000","last_fullsized":"2024-09-12T01:08:55.036158+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:38.191795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1317,"num_read_kb":1075,"num_write":482,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'325","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.167304+0000","last_change":"2024-09-12T00:12:36.042085+0000","last_active":"2024-09-12T01:11:00.167304+0000","last_peered":"2024-09-12T01:11:00.167304+0000","last_clean":"2024-09-12T01:11:00.167304+0000","last_became_active":"2024-09-12T00:12:36.041698+0000","last_became_peered":"2024-09-12T00:12:36.041698+0000","last_unstale":"2024-09-12T01:11:00.167304+0000","last_undegraded":"2024-09-12T01:11:00.167304+0000","last_fullsized":"2024-09-12T01:11:00.167304+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:23.633785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":30384,"num_write":1021,"num_write_kb":31492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'492","reported_seq":1253,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.142856+0000","last_change":"2024-09-12T00:12:38.038282+0000","last_active":"2024-09-12T01:08:55.142856+0000","last_peered":"2024-09-12T01:08:55.142856+0000","last_clean":"2024-09-12T01:08:55.142856+0000","last_became_active":"2024-09-12T00:12:38.038023+0000","last_became_peered":"2024-09-12T00:12:38.038023+0000","last_unstale":"2024-09-12T01:08:55.142856+0000","last_undegraded":"2024-09-12T01:08:55.142856+0000","last_fullsized":"2024-09-12T01:08:55.142856+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:15.550968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2347,"num_read_kb":2031,"num_write":873,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'296","reported_seq":933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.021492+0000","last_change":"2024-09-12T00:12:36.050337+0000","last_active":"2024-09-12T01:11:00.021492+0000","last_peered":"2024-09-12T01:11:00.021492+0000","last_clean":"2024-09-12T01:11:00.021492+0000","last_became_active":"2024-09-12T00:12:36.050008+0000","last_became_peered":"2024-09-12T00:12:36.050008+0000","last_unstale":"2024-09-12T01:11:00.021492+0000","last_undegraded":"2024-09-12T01:11:00.021492+0000","last_fullsized":"2024-09-12T01:11:00.021492+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:38.881671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":30850,"num_write":1048,"num_write_kb":20572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'204","reported_seq":830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.053105+0000","last_change":"2024-09-12T00:12:38.043322+0000","last_active":"2024-09-12T01:08:53.053105+0000","last_peered":"2024-09-12T01:08:53.053105+0000","last_clean":"2024-09-12T01:08:53.053105+0000","last_became_active":"2024-09-12T00:12:38.043059+0000","last_became_peered":"2024-09-12T00:12:38.043059+0000","last_unstale":"2024-09-12T01:08:53.053105+0000","last_undegraded":"2024-09-12T01:08:53.053105+0000","last_fullsized":"2024-09-12T01:08:53.053105+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:02.061980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":751,"num_write":306,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'111","reported_seq":700,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.047945+0000","last_change":"2024-09-12T00:12:38.040965+0000","last_active":"2024-09-12T01:08:40.047945+0000","last_peered":"2024-09-12T01:08:40.047945+0000","last_clean":"2024-09-12T01:08:40.047945+0000","last_became_active":"2024-09-12T00:12:38.040613+0000","last_became_peered":"2024-09-12T00:12:38.040613+0000","last_unstale":"2024-09-12T01:08:40.047945+0000","last_undegraded":"2024-09-12T01:08:40.047945+0000","last_fullsized":"2024-09-12T01:08:40.047945+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:25.644646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":420,"num_write":176,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'377","reported_seq":1115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.205112+0000","last_change":"2024-09-12T00:12:36.037211+0000","last_active":"2024-09-12T01:11:00.205112+0000","last_peered":"2024-09-12T01:11:00.205112+0000","last_clean":"2024-09-12T01:11:00.205112+0000","last_became_active":"2024-09-12T00:12:36.036905+0000","last_became_peered":"2024-09-12T00:12:36.036905+0000","last_unstale":"2024-09-12T01:11:00.205112+0000","last_undegraded":"2024-09-12T01:11:00.205112+0000","last_fullsized":"2024-09-12T01:11:00.205112+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:21.711720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529645,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":592,"num_read_kb":41745,"num_write":1152,"num_write_kb":45582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'78","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.034481+0000","last_change":"2024-09-12T00:12:38.038756+0000","last_active":"2024-09-12T01:08:40.034481+0000","last_peered":"2024-09-12T01:08:40.034481+0000","last_clean":"2024-09-12T01:08:40.034481+0000","last_became_active":"2024-09-12T00:12:38.038478+0000","last_became_peered":"2024-09-12T00:12:38.038478+0000","last_unstale":"2024-09-12T01:08:40.034481+0000","last_undegraded":"2024-09-12T01:08:40.034481+0000","last_fullsized":"2024-09-12T01:08:40.034481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:35.041048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":318,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'378","reported_seq":1015,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.177199+0000","last_change":"2024-09-12T00:12:36.033187+0000","last_active":"2024-09-12T01:11:00.177199+0000","last_peered":"2024-09-12T01:11:00.177199+0000","last_clean":"2024-09-12T01:11:00.177199+0000","last_became_active":"2024-09-12T00:12:36.032821+0000","last_became_peered":"2024-09-12T00:12:36.032821+0000","last_unstale":"2024-09-12T01:11:00.177199+0000","last_undegraded":"2024-09-12T01:11:00.177199+0000","last_fullsized":"2024-09-12T01:11:00.177199+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:19.055738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3061552,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":42771,"num_write":1040,"num_write_kb":38443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'199","reported_seq":788,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.226253+0000","last_change":"2024-09-12T00:12:38.044432+0000","last_active":"2024-09-12T01:06:25.226253+0000","last_peered":"2024-09-12T01:06:25.226253+0000","last_clean":"2024-09-12T01:06:25.226253+0000","last_became_active":"2024-09-12T00:12:38.044169+0000","last_became_peered":"2024-09-12T00:12:38.044169+0000","last_unstale":"2024-09-12T01:06:25.226253+0000","last_undegraded":"2024-09-12T01:06:25.226253+0000","last_fullsized":"2024-09-12T01:06:25.226253+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:46.038643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":679,"num_write":307,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'331","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.177812+0000","last_change":"2024-09-12T00:12:36.037534+0000","last_active":"2024-09-12T01:11:00.177812+0000","last_peered":"2024-09-12T01:11:00.177812+0000","last_clean":"2024-09-12T01:11:00.177812+0000","last_became_active":"2024-09-12T00:12:36.037200+0000","last_became_peered":"2024-09-12T00:12:36.037200+0000","last_unstale":"2024-09-12T01:11:00.177812+0000","last_undegraded":"2024-09-12T01:11:00.177812+0000","last_fullsized":"2024-09-12T01:11:00.177812+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:52.993855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524447,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":1481,"num_write":1070,"num_write_kb":18199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'162","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165122+0000","last_change":"2024-09-12T00:12:38.045098+0000","last_active":"2024-09-12T01:08:15.165122+0000","last_peered":"2024-09-12T01:08:15.165122+0000","last_clean":"2024-09-12T01:08:15.165122+0000","last_became_active":"2024-09-12T00:12:38.044089+0000","last_became_peered":"2024-09-12T00:12:38.044089+0000","last_unstale":"2024-09-12T01:08:15.165122+0000","last_undegraded":"2024-09-12T01:08:15.165122+0000","last_fullsized":"2024-09-12T01:08:15.165122+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:41.312963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":583,"num_write":265,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'360","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.177654+0000","last_change":"2024-09-12T00:12:36.029615+0000","last_active":"2024-09-12T01:11:00.177654+0000","last_peered":"2024-09-12T01:11:00.177654+0000","last_clean":"2024-09-12T01:11:00.177654+0000","last_became_active":"2024-09-12T00:12:36.029286+0000","last_became_peered":"2024-09-12T00:12:36.029286+0000","last_unstale":"2024-09-12T01:11:00.177654+0000","last_undegraded":"2024-09-12T01:11:00.177654+0000","last_fullsized":"2024-09-12T01:11:00.177654+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:36.388912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661265,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":28445,"num_write":1057,"num_write_kb":34038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'237","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.046795+0000","last_change":"2024-09-12T00:12:38.042662+0000","last_active":"2024-09-12T01:08:13.046795+0000","last_peered":"2024-09-12T01:08:13.046795+0000","last_clean":"2024-09-12T01:08:13.046795+0000","last_became_active":"2024-09-12T00:12:38.042387+0000","last_became_peered":"2024-09-12T00:12:38.042387+0000","last_unstale":"2024-09-12T01:08:13.046795+0000","last_undegraded":"2024-09-12T01:08:13.046795+0000","last_fullsized":"2024-09-12T01:08:13.046795+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:52.954165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1130,"num_read_kb":955,"num_write":386,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'350","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.209381+0000","last_change":"2024-09-12T00:12:36.035258+0000","last_active":"2024-09-12T01:11:00.209381+0000","last_peered":"2024-09-12T01:11:00.209381+0000","last_clean":"2024-09-12T01:11:00.209381+0000","last_became_active":"2024-09-12T00:12:36.034811+0000","last_became_peered":"2024-09-12T00:12:36.034811+0000","last_unstale":"2024-09-12T01:11:00.209381+0000","last_undegraded":"2024-09-12T01:11:00.209381+0000","last_fullsized":"2024-09-12T01:11:00.209381+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:17.351084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":602,"num_read_kb":22753,"num_write":1118,"num_write_kb":14938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'112","reported_seq":703,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:39.935379+0000","last_change":"2024-09-12T00:12:38.036179+0000","last_active":"2024-09-12T01:08:39.935379+0000","last_peered":"2024-09-12T01:08:39.935379+0000","last_clean":"2024-09-12T01:08:39.935379+0000","last_became_active":"2024-09-12T00:12:38.035835+0000","last_became_peered":"2024-09-12T00:12:38.035835+0000","last_unstale":"2024-09-12T01:08:39.935379+0000","last_undegraded":"2024-09-12T01:08:39.935379+0000","last_fullsized":"2024-09-12T01:08:39.935379+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:40.642378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":399,"num_write":174,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'328","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.013802+0000","last_change":"2024-09-12T00:12:36.036412+0000","last_active":"2024-09-12T01:11:00.013802+0000","last_peered":"2024-09-12T01:11:00.013802+0000","last_clean":"2024-09-12T01:11:00.013802+0000","last_became_active":"2024-09-12T00:12:36.036060+0000","last_became_peered":"2024-09-12T00:12:36.036060+0000","last_unstale":"2024-09-12T01:11:00.013802+0000","last_undegraded":"2024-09-12T01:11:00.013802+0000","last_fullsized":"2024-09-12T01:11:00.013802+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:28.300988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568184,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":547,"num_read_kb":15680,"num_write":1014,"num_write_kb":17630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'129","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.436476+0000","last_change":"2024-09-12T00:12:46.059495+0000","last_active":"2024-09-12T01:09:23.436476+0000","last_peered":"2024-09-12T01:09:23.436476+0000","last_clean":"2024-09-12T01:09:23.436476+0000","last_became_active":"2024-09-12T00:12:46.059203+0000","last_became_peered":"2024-09-12T00:12:46.059203+0000","last_unstale":"2024-09-12T01:09:23.436476+0000","last_undegraded":"2024-09-12T01:09:23.436476+0000","last_fullsized":"2024-09-12T01:09:23.436476+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:04.594775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":135,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'77","reported_seq":606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.040701+0000","last_change":"2024-09-12T00:12:38.043406+0000","last_active":"2024-09-12T01:07:35.040701+0000","last_peered":"2024-09-12T01:07:35.040701+0000","last_clean":"2024-09-12T01:07:35.040701+0000","last_became_active":"2024-09-12T00:12:38.041964+0000","last_became_peered":"2024-09-12T00:12:38.041964+0000","last_unstale":"2024-09-12T01:07:35.040701+0000","last_undegraded":"2024-09-12T01:07:35.040701+0000","last_fullsized":"2024-09-12T01:07:35.040701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:09.254764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":305,"num_read_kb":247,"num_write":113,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'357","reported_seq":1205,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.217970+0000","last_change":"2024-09-12T00:12:36.034053+0000","last_active":"2024-09-12T01:11:00.217970+0000","last_peered":"2024-09-12T01:11:00.217970+0000","last_clean":"2024-09-12T01:11:00.217970+0000","last_became_active":"2024-09-12T00:12:36.033666+0000","last_became_peered":"2024-09-12T00:12:36.033666+0000","last_unstale":"2024-09-12T01:11:00.217970+0000","last_undegraded":"2024-09-12T01:11:00.217970+0000","last_fullsized":"2024-09-12T01:11:00.217970+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:42.337722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2017915,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":962,"num_read_kb":16942,"num_write":1189,"num_write_kb":38560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045191+0000","last_change":"2024-09-12T00:12:40.043098+0000","last_active":"2024-09-12T01:08:15.045191+0000","last_peered":"2024-09-12T01:08:15.045191+0000","last_clean":"2024-09-12T01:08:15.045191+0000","last_became_active":"2024-09-12T00:12:40.042778+0000","last_became_peered":"2024-09-12T00:12:40.042778+0000","last_unstale":"2024-09-12T01:08:15.045191+0000","last_undegraded":"2024-09-12T01:08:15.045191+0000","last_fullsized":"2024-09-12T01:08:15.045191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:24.903477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'345","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.811165+0000","last_change":"2024-09-12T00:12:42.041284+0000","last_active":"2024-09-12T01:10:59.811165+0000","last_peered":"2024-09-12T01:10:59.811165+0000","last_clean":"2024-09-12T01:10:59.811165+0000","last_became_active":"2024-09-12T00:12:42.040764+0000","last_became_peered":"2024-09-12T00:12:42.040764+0000","last_unstale":"2024-09-12T01:10:59.811165+0000","last_undegraded":"2024-09-12T01:10:59.811165+0000","last_fullsized":"2024-09-12T01:10:59.811165+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:17.910880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46776,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":561,"num_read_kb":1150,"num_write":442,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.238599+0000","last_change":"2024-09-12T00:12:44.055832+0000","last_active":"2024-09-12T01:08:20.238599+0000","last_peered":"2024-09-12T01:08:20.238599+0000","last_clean":"2024-09-12T01:08:20.238599+0000","last_became_active":"2024-09-12T00:12:44.055504+0000","last_became_peered":"2024-09-12T00:12:44.055504+0000","last_unstale":"2024-09-12T01:08:20.238599+0000","last_undegraded":"2024-09-12T01:08:20.238599+0000","last_fullsized":"2024-09-12T01:08:20.238599+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:45.759712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'168","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.825669+0000","last_change":"2024-09-12T00:12:46.065977+0000","last_active":"2024-09-12T01:08:55.825669+0000","last_peered":"2024-09-12T01:08:55.825669+0000","last_clean":"2024-09-12T01:08:55.825669+0000","last_became_active":"2024-09-12T00:12:46.065664+0000","last_became_peered":"2024-09-12T00:12:46.065664+0000","last_unstale":"2024-09-12T01:08:55.825669+0000","last_undegraded":"2024-09-12T01:08:55.825669+0000","last_fullsized":"2024-09-12T01:08:55.825669+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:46.395099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":198,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'177","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045160+0000","last_change":"2024-09-12T00:12:38.042600+0000","last_active":"2024-09-12T01:08:15.045160+0000","last_peered":"2024-09-12T01:08:15.045160+0000","last_clean":"2024-09-12T01:08:15.045160+0000","last_became_active":"2024-09-12T00:12:38.041187+0000","last_became_peered":"2024-09-12T00:12:38.041187+0000","last_unstale":"2024-09-12T01:08:15.045160+0000","last_undegraded":"2024-09-12T01:08:15.045160+0000","last_fullsized":"2024-09-12T01:08:15.045160+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:30.414258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":787,"num_read_kb":651,"num_write":272,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'370","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.118069+0000","last_change":"2024-09-12T00:12:36.034110+0000","last_active":"2024-09-12T01:11:00.118069+0000","last_peered":"2024-09-12T01:11:00.118069+0000","last_clean":"2024-09-12T01:11:00.118069+0000","last_became_active":"2024-09-12T00:12:36.033751+0000","last_became_peered":"2024-09-12T00:12:36.033751+0000","last_unstale":"2024-09-12T01:11:00.118069+0000","last_undegraded":"2024-09-12T01:11:00.118069+0000","last_fullsized":"2024-09-12T01:11:00.118069+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:13.850294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254460,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":6771,"num_write":1059,"num_write_kb":22452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.031479+0000","last_change":"2024-09-12T00:12:40.032783+0000","last_active":"2024-09-12T01:06:30.031479+0000","last_peered":"2024-09-12T01:06:30.031479+0000","last_clean":"2024-09-12T01:06:30.031479+0000","last_became_active":"2024-09-12T00:12:40.032489+0000","last_became_peered":"2024-09-12T00:12:40.032489+0000","last_unstale":"2024-09-12T01:06:30.031479+0000","last_undegraded":"2024-09-12T01:06:30.031479+0000","last_fullsized":"2024-09-12T01:06:30.031479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:22.084698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'93","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.815511+0000","last_change":"2024-09-12T00:12:42.046654+0000","last_active":"2024-09-12T01:10:31.815511+0000","last_peered":"2024-09-12T01:10:31.815511+0000","last_clean":"2024-09-12T01:10:31.815511+0000","last_became_active":"2024-09-12T00:12:42.046316+0000","last_became_peered":"2024-09-12T00:12:42.046316+0000","last_unstale":"2024-09-12T01:10:31.815511+0000","last_undegraded":"2024-09-12T01:10:31.815511+0000","last_fullsized":"2024-09-12T01:10:31.815511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:43.446982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":105,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.238553+0000","last_change":"2024-09-12T00:12:44.057706+0000","last_active":"2024-09-12T01:08:20.238553+0000","last_peered":"2024-09-12T01:08:20.238553+0000","last_clean":"2024-09-12T01:08:20.238553+0000","last_became_active":"2024-09-12T00:12:44.057398+0000","last_became_peered":"2024-09-12T00:12:44.057398+0000","last_unstale":"2024-09-12T01:08:20.238553+0000","last_undegraded":"2024-09-12T01:08:20.238553+0000","last_fullsized":"2024-09-12T01:08:20.238553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:05.128485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'136","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:39.937608+0000","last_change":"2024-09-12T00:12:46.061250+0000","last_active":"2024-09-12T01:08:39.937608+0000","last_peered":"2024-09-12T01:08:39.937608+0000","last_clean":"2024-09-12T01:08:39.937608+0000","last_became_active":"2024-09-12T00:12:46.060932+0000","last_became_peered":"2024-09-12T00:12:46.060932+0000","last_unstale":"2024-09-12T01:08:39.937608+0000","last_undegraded":"2024-09-12T01:08:39.937608+0000","last_fullsized":"2024-09-12T01:08:39.937608+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:30.826242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'190","reported_seq":814,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.046842+0000","last_change":"2024-09-12T00:12:38.038566+0000","last_active":"2024-09-12T01:08:13.046842+0000","last_peered":"2024-09-12T01:08:13.046842+0000","last_clean":"2024-09-12T01:08:13.046842+0000","last_became_active":"2024-09-12T00:12:38.038234+0000","last_became_peered":"2024-09-12T00:12:38.038234+0000","last_unstale":"2024-09-12T01:08:13.046842+0000","last_undegraded":"2024-09-12T01:08:13.046842+0000","last_fullsized":"2024-09-12T01:08:13.046842+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:49.369461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":891,"num_read_kb":755,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'339","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.139535+0000","last_change":"2024-09-12T00:13:07.150014+0000","last_active":"2024-09-12T01:11:00.139535+0000","last_peered":"2024-09-12T01:11:00.139535+0000","last_clean":"2024-09-12T01:11:00.139535+0000","last_became_active":"2024-09-12T00:13:07.149671+0000","last_became_peered":"2024-09-12T00:13:07.149671+0000","last_unstale":"2024-09-12T01:11:00.139535+0000","last_undegraded":"2024-09-12T01:11:00.139535+0000","last_fullsized":"2024-09-12T01:11:00.139535+0000","mapping_epoch":40,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:56.523641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":33322,"num_write":992,"num_write_kb":23312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.049001+0000","last_change":"2024-09-12T00:12:40.037054+0000","last_active":"2024-09-12T01:08:15.049001+0000","last_peered":"2024-09-12T01:08:15.049001+0000","last_clean":"2024-09-12T01:08:15.049001+0000","last_became_active":"2024-09-12T00:12:40.036714+0000","last_became_peered":"2024-09-12T00:12:40.036714+0000","last_unstale":"2024-09-12T01:08:15.049001+0000","last_undegraded":"2024-09-12T01:08:15.049001+0000","last_fullsized":"2024-09-12T01:08:15.049001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:41.522842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'128","reported_seq":676,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:35.032412+0000","last_change":"2024-09-12T00:12:42.038292+0000","last_active":"2024-09-12T01:06:35.032412+0000","last_peered":"2024-09-12T01:06:35.032412+0000","last_clean":"2024-09-12T01:06:35.032412+0000","last_became_active":"2024-09-12T00:12:42.037971+0000","last_became_peered":"2024-09-12T00:12:42.037971+0000","last_unstale":"2024-09-12T01:06:35.032412+0000","last_undegraded":"2024-09-12T01:06:35.032412+0000","last_fullsized":"2024-09-12T01:06:35.032412+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:23.076188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":156,"num_read_kb":149,"num_write":106,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'778","reported_seq":2785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.144095+0000","last_change":"2024-09-12T00:12:44.059925+0000","last_active":"2024-09-12T01:11:00.144095+0000","last_peered":"2024-09-12T01:11:00.144095+0000","last_clean":"2024-09-12T01:11:00.144095+0000","last_became_active":"2024-09-12T00:12:44.059258+0000","last_became_peered":"2024-09-12T00:12:44.059258+0000","last_unstale":"2024-09-12T01:11:00.144095+0000","last_undegraded":"2024-09-12T01:11:00.144095+0000","last_fullsized":"2024-09-12T01:11:00.144095+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:23.120624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'196","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.494669+0000","last_change":"2024-09-12T00:12:46.059926+0000","last_active":"2024-09-12T01:09:23.494669+0000","last_peered":"2024-09-12T01:09:23.494669+0000","last_clean":"2024-09-12T01:09:23.494669+0000","last_became_active":"2024-09-12T00:12:46.059591+0000","last_became_peered":"2024-09-12T00:12:46.059591+0000","last_unstale":"2024-09-12T01:09:23.494669+0000","last_undegraded":"2024-09-12T01:09:23.494669+0000","last_fullsized":"2024-09-12T01:09:23.494669+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:40.868229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":585,"num_read_kb":583,"num_write":433,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'4340","reported_seq":5003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.046880+0000","last_change":"2024-09-12T00:12:38.036026+0000","last_active":"2024-09-12T01:08:13.046880+0000","last_peered":"2024-09-12T01:08:13.046880+0000","last_clean":"2024-09-12T01:08:13.046880+0000","last_became_active":"2024-09-12T00:12:38.035743+0000","last_became_peered":"2024-09-12T00:12:38.035743+0000","last_unstale":"2024-09-12T01:08:13.046880+0000","last_undegraded":"2024-09-12T01:08:13.046880+0000","last_fullsized":"2024-09-12T01:08:13.046880+0000","mapping_epoch":29,"log_start":"263'4300","ondisk_log_start":"263'4300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:55.482084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17417,"num_read_kb":14583,"num_write":6500,"num_write_kb":3272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'359","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.185288+0000","last_change":"2024-09-12T00:12:36.038350+0000","last_active":"2024-09-12T01:11:00.185288+0000","last_peered":"2024-09-12T01:11:00.185288+0000","last_clean":"2024-09-12T01:11:00.185288+0000","last_became_active":"2024-09-12T00:12:36.038014+0000","last_became_peered":"2024-09-12T00:12:36.038014+0000","last_unstale":"2024-09-12T01:11:00.185288+0000","last_undegraded":"2024-09-12T01:11:00.185288+0000","last_fullsized":"2024-09-12T01:11:00.185288+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:25.617148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924421,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":557,"num_read_kb":22312,"num_write":1056,"num_write_kb":43311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045229+0000","last_change":"2024-09-12T00:12:40.041340+0000","last_active":"2024-09-12T01:08:15.045229+0000","last_peered":"2024-09-12T01:08:15.045229+0000","last_clean":"2024-09-12T01:08:15.045229+0000","last_became_active":"2024-09-12T00:12:40.040992+0000","last_became_peered":"2024-09-12T00:12:40.040992+0000","last_unstale":"2024-09-12T01:08:15.045229+0000","last_undegraded":"2024-09-12T01:08:15.045229+0000","last_fullsized":"2024-09-12T01:08:15.045229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:18.861321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'284","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.512418+0000","last_change":"2024-09-12T00:12:42.041347+0000","last_active":"2024-09-12T01:10:59.512418+0000","last_peered":"2024-09-12T01:10:59.512418+0000","last_clean":"2024-09-12T01:10:59.512418+0000","last_became_active":"2024-09-12T00:12:42.041042+0000","last_became_peered":"2024-09-12T00:12:42.041042+0000","last_unstale":"2024-09-12T01:10:59.512418+0000","last_undegraded":"2024-09-12T01:10:59.512418+0000","last_fullsized":"2024-09-12T01:10:59.512418+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:46.437978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63399,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":1076,"num_write":376,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'806","reported_seq":2516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.958963+0000","last_change":"2024-09-12T00:12:44.062745+0000","last_active":"2024-09-12T01:10:57.958963+0000","last_peered":"2024-09-12T01:10:57.958963+0000","last_clean":"2024-09-12T01:10:57.958963+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:10:57.958963+0000","last_undegraded":"2024-09-12T01:10:57.958963+0000","last_fullsized":"2024-09-12T01:10:57.958963+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:30.427552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'191","reported_seq":820,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035206+0000","last_change":"2024-09-12T00:12:38.040302+0000","last_active":"2024-09-12T01:06:50.035206+0000","last_peered":"2024-09-12T01:06:50.035206+0000","last_clean":"2024-09-12T01:06:50.035206+0000","last_became_active":"2024-09-12T00:12:38.040030+0000","last_became_peered":"2024-09-12T00:12:38.040030+0000","last_unstale":"2024-09-12T01:06:50.035206+0000","last_undegraded":"2024-09-12T01:06:50.035206+0000","last_fullsized":"2024-09-12T01:06:50.035206+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:17.788252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":682,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'345","reported_seq":947,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.210061+0000","last_change":"2024-09-12T00:12:36.040947+0000","last_active":"2024-09-12T01:11:00.210061+0000","last_peered":"2024-09-12T01:11:00.210061+0000","last_clean":"2024-09-12T01:11:00.210061+0000","last_became_active":"2024-09-12T00:12:36.040657+0000","last_became_peered":"2024-09-12T00:12:36.040657+0000","last_unstale":"2024-09-12T01:11:00.210061+0000","last_undegraded":"2024-09-12T01:11:00.210061+0000","last_fullsized":"2024-09-12T01:11:00.210061+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:18.229544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":455,"num_read_kb":5571,"num_write":1118,"num_write_kb":16904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.229029+0000","last_change":"2024-09-12T00:12:40.036607+0000","last_active":"2024-09-12T01:06:50.229029+0000","last_peered":"2024-09-12T01:06:50.229029+0000","last_clean":"2024-09-12T01:06:50.229029+0000","last_became_active":"2024-09-12T00:12:40.036362+0000","last_became_peered":"2024-09-12T00:12:40.036362+0000","last_unstale":"2024-09-12T01:06:50.229029+0000","last_undegraded":"2024-09-12T01:06:50.229029+0000","last_fullsized":"2024-09-12T01:06:50.229029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:43.641028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'347","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.038825+0000","last_change":"2024-09-12T00:12:42.044696+0000","last_active":"2024-09-12T01:11:00.038825+0000","last_peered":"2024-09-12T01:11:00.038825+0000","last_clean":"2024-09-12T01:11:00.038825+0000","last_became_active":"2024-09-12T00:12:42.044418+0000","last_became_peered":"2024-09-12T00:12:42.044418+0000","last_unstale":"2024-09-12T01:11:00.038825+0000","last_undegraded":"2024-09-12T01:11:00.038825+0000","last_fullsized":"2024-09-12T01:11:00.038825+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:13.793410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51451,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":1107,"num_write":436,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.152015+0000","last_change":"2024-09-12T00:12:44.057796+0000","last_active":"2024-09-12T01:06:45.152015+0000","last_peered":"2024-09-12T01:06:45.152015+0000","last_clean":"2024-09-12T01:06:45.152015+0000","last_became_active":"2024-09-12T00:12:44.057438+0000","last_became_peered":"2024-09-12T00:12:44.057438+0000","last_unstale":"2024-09-12T01:06:45.152015+0000","last_undegraded":"2024-09-12T01:06:45.152015+0000","last_fullsized":"2024-09-12T01:06:45.152015+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:56.467860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'557","reported_seq":1367,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.003073+0000","last_change":"2024-09-12T00:12:46.060839+0000","last_active":"2024-09-12T01:10:33.003073+0000","last_peered":"2024-09-12T01:10:33.003073+0000","last_clean":"2024-09-12T01:10:33.003073+0000","last_became_active":"2024-09-12T00:12:46.060552+0000","last_became_peered":"2024-09-12T00:12:46.060552+0000","last_unstale":"2024-09-12T01:10:33.003073+0000","last_undegraded":"2024-09-12T01:10:33.003073+0000","last_fullsized":"2024-09-12T01:10:33.003073+0000","mapping_epoch":37,"log_start":"263'500","ondisk_log_start":"263'500","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:49.354363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1290,"num_read_kb":1284,"num_write":1146,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'240","reported_seq":844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:32.183059+0000","last_change":"2024-09-12T00:12:38.042271+0000","last_active":"2024-09-12T01:08:32.183059+0000","last_peered":"2024-09-12T01:08:32.183059+0000","last_clean":"2024-09-12T01:08:32.183059+0000","last_became_active":"2024-09-12T00:12:38.041916+0000","last_became_peered":"2024-09-12T00:12:38.041916+0000","last_unstale":"2024-09-12T01:08:32.183059+0000","last_undegraded":"2024-09-12T01:08:32.183059+0000","last_fullsized":"2024-09-12T01:08:32.183059+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:14.378653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1071,"num_read_kb":865,"num_write":389,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'325","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.197811+0000","last_change":"2024-09-12T00:12:36.043410+0000","last_active":"2024-09-12T01:11:00.197811+0000","last_peered":"2024-09-12T01:11:00.197811+0000","last_clean":"2024-09-12T01:11:00.197811+0000","last_became_active":"2024-09-12T00:12:36.042838+0000","last_became_peered":"2024-09-12T00:12:36.042838+0000","last_unstale":"2024-09-12T01:11:00.197811+0000","last_undegraded":"2024-09-12T01:11:00.197811+0000","last_fullsized":"2024-09-12T01:11:00.197811+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:50.068914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":480,"num_read_kb":7238,"num_write":1062,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.152809+0000","last_change":"2024-09-12T00:12:40.042917+0000","last_active":"2024-09-12T01:06:50.152809+0000","last_peered":"2024-09-12T01:06:50.152809+0000","last_clean":"2024-09-12T01:06:50.152809+0000","last_became_active":"2024-09-12T00:12:40.042625+0000","last_became_peered":"2024-09-12T00:12:40.042625+0000","last_unstale":"2024-09-12T01:06:50.152809+0000","last_undegraded":"2024-09-12T01:06:50.152809+0000","last_fullsized":"2024-09-12T01:06:50.152809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:42.496763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'255","reported_seq":831,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.717963+0000","last_change":"2024-09-12T00:12:42.040576+0000","last_active":"2024-09-12T01:10:58.717963+0000","last_peered":"2024-09-12T01:10:58.717963+0000","last_clean":"2024-09-12T01:10:58.717963+0000","last_became_active":"2024-09-12T00:12:42.040266+0000","last_became_peered":"2024-09-12T00:12:42.040266+0000","last_unstale":"2024-09-12T01:10:58.717963+0000","last_undegraded":"2024-09-12T01:10:58.717963+0000","last_fullsized":"2024-09-12T01:10:58.717963+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:24.483433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":965,"num_write":348,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:05.037890+0000","last_change":"2024-09-12T00:12:44.062951+0000","last_active":"2024-09-12T01:07:05.037890+0000","last_peered":"2024-09-12T01:07:05.037890+0000","last_clean":"2024-09-12T01:07:05.037890+0000","last_became_active":"2024-09-12T00:12:44.062608+0000","last_became_peered":"2024-09-12T00:12:44.062608+0000","last_unstale":"2024-09-12T01:07:05.037890+0000","last_undegraded":"2024-09-12T01:07:05.037890+0000","last_fullsized":"2024-09-12T01:07:05.037890+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:39.092545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2412","reported_seq":4250,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.887941+0000","last_change":"2024-09-12T00:12:46.062926+0000","last_active":"2024-09-12T01:10:35.887941+0000","last_peered":"2024-09-12T01:10:35.887941+0000","last_clean":"2024-09-12T01:10:35.887941+0000","last_became_active":"2024-09-12T00:12:46.062624+0000","last_became_peered":"2024-09-12T00:12:46.062624+0000","last_unstale":"2024-09-12T01:10:35.887941+0000","last_undegraded":"2024-09-12T01:10:35.887941+0000","last_fullsized":"2024-09-12T01:10:35.887941+0000","mapping_epoch":37,"log_start":"263'2400","ondisk_log_start":"263'2400","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":2400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:26.452821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":6065,"num_write":4891,"num_write_kb":1799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'224","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.300929+0000","last_change":"2024-09-12T00:12:38.042922+0000","last_active":"2024-09-12T01:08:19.300929+0000","last_peered":"2024-09-12T01:08:19.300929+0000","last_clean":"2024-09-12T01:08:19.300929+0000","last_became_active":"2024-09-12T00:12:38.042657+0000","last_became_peered":"2024-09-12T00:12:38.042657+0000","last_unstale":"2024-09-12T01:08:19.300929+0000","last_undegraded":"2024-09-12T01:08:19.300929+0000","last_fullsized":"2024-09-12T01:08:19.300929+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:37.846035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":947,"num_read_kb":771,"num_write":346,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'377","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.190771+0000","last_change":"2024-09-12T00:12:36.046609+0000","last_active":"2024-09-12T01:11:00.190771+0000","last_peered":"2024-09-12T01:11:00.190771+0000","last_clean":"2024-09-12T01:11:00.190771+0000","last_became_active":"2024-09-12T00:12:36.046196+0000","last_became_peered":"2024-09-12T00:12:36.046196+0000","last_unstale":"2024-09-12T01:11:00.190771+0000","last_undegraded":"2024-09-12T01:11:00.190771+0000","last_fullsized":"2024-09-12T01:11:00.190771+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:49.734531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9646835,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":545,"num_read_kb":69753,"num_write":1204,"num_write_kb":51465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:43.033241+0000","last_change":"2024-09-12T00:12:40.040357+0000","last_active":"2024-09-12T01:06:43.033241+0000","last_peered":"2024-09-12T01:06:43.033241+0000","last_clean":"2024-09-12T01:06:43.033241+0000","last_became_active":"2024-09-12T00:12:40.039887+0000","last_became_peered":"2024-09-12T00:12:40.039887+0000","last_unstale":"2024-09-12T01:06:43.033241+0000","last_undegraded":"2024-09-12T01:06:43.033241+0000","last_fullsized":"2024-09-12T01:06:43.033241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:20.058438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'330","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.156003+0000","last_change":"2024-09-12T00:12:42.051353+0000","last_active":"2024-09-12T01:11:00.156003+0000","last_peered":"2024-09-12T01:11:00.156003+0000","last_clean":"2024-09-12T01:11:00.156003+0000","last_became_active":"2024-09-12T00:12:42.051042+0000","last_became_peered":"2024-09-12T00:12:42.051042+0000","last_unstale":"2024-09-12T01:11:00.156003+0000","last_undegraded":"2024-09-12T01:11:00.156003+0000","last_fullsized":"2024-09-12T01:11:00.156003+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:52.667091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50358,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":532,"num_read_kb":1132,"num_write":424,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'806","reported_seq":2512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.960453+0000","last_change":"2024-09-12T00:12:44.057367+0000","last_active":"2024-09-12T01:10:57.960453+0000","last_peered":"2024-09-12T01:10:57.960453+0000","last_clean":"2024-09-12T01:10:57.960453+0000","last_became_active":"2024-09-12T00:12:44.057064+0000","last_became_peered":"2024-09-12T00:12:44.057064+0000","last_unstale":"2024-09-12T01:10:57.960453+0000","last_undegraded":"2024-09-12T01:10:57.960453+0000","last_fullsized":"2024-09-12T01:10:57.960453+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:28.146163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'102","reported_seq":586,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.693001+0000","last_change":"2024-09-12T00:12:46.059872+0000","last_active":"2024-09-12T01:10:31.693001+0000","last_peered":"2024-09-12T01:10:31.693001+0000","last_clean":"2024-09-12T01:10:31.693001+0000","last_became_active":"2024-09-12T00:12:46.059567+0000","last_became_peered":"2024-09-12T00:12:46.059567+0000","last_unstale":"2024-09-12T01:10:31.693001+0000","last_undegraded":"2024-09-12T01:10:31.693001+0000","last_fullsized":"2024-09-12T01:10:31.693001+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:15.879983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":78,"num_write":230,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'198","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:38.032532+0000","last_change":"2024-09-12T00:12:38.040110+0000","last_active":"2024-09-12T01:06:38.032532+0000","last_peered":"2024-09-12T01:06:38.032532+0000","last_clean":"2024-09-12T01:06:38.032532+0000","last_became_active":"2024-09-12T00:12:38.039788+0000","last_became_peered":"2024-09-12T00:12:38.039788+0000","last_unstale":"2024-09-12T01:06:38.032532+0000","last_undegraded":"2024-09-12T01:06:38.032532+0000","last_fullsized":"2024-09-12T01:06:38.032532+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:03.291708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":765,"num_write":285,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'369","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:04.101465+0000","last_change":"2024-09-12T01:11:04.101465+0000","last_active":"2024-09-12T01:11:04.101465+0000","last_peered":"2024-09-12T01:11:04.101465+0000","last_clean":"2024-09-12T01:11:04.101465+0000","last_became_active":"2024-09-12T00:12:36.034290+0000","last_became_peered":"2024-09-12T00:12:36.034290+0000","last_unstale":"2024-09-12T01:11:04.101465+0000","last_undegraded":"2024-09-12T01:11:04.101465+0000","last_fullsized":"2024-09-12T01:11:04.101465+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-12T01:11:04.101384+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-12T01:11:04.101384+0000","last_clean_scrub_stamp":"2024-09-12T01:11:04.101384+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:59.360381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":18536,"num_write":1160,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.154250+0000","last_change":"2024-09-12T00:12:40.036885+0000","last_active":"2024-09-12T01:07:00.154250+0000","last_peered":"2024-09-12T01:07:00.154250+0000","last_clean":"2024-09-12T01:07:00.154250+0000","last_became_active":"2024-09-12T00:12:40.036551+0000","last_became_peered":"2024-09-12T00:12:40.036551+0000","last_unstale":"2024-09-12T01:07:00.154250+0000","last_undegraded":"2024-09-12T01:07:00.154250+0000","last_fullsized":"2024-09-12T01:07:00.154250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:09.117904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'515","reported_seq":1159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.102422+0000","last_change":"2024-09-12T00:12:42.041830+0000","last_active":"2024-09-12T01:10:59.102422+0000","last_peered":"2024-09-12T01:10:59.102422+0000","last_clean":"2024-09-12T01:10:59.102422+0000","last_became_active":"2024-09-12T00:12:42.041307+0000","last_became_peered":"2024-09-12T00:12:42.041307+0000","last_unstale":"2024-09-12T01:10:59.102422+0000","last_undegraded":"2024-09-12T01:10:59.102422+0000","last_fullsized":"2024-09-12T01:10:59.102422+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:40.915241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96065,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":906,"num_read_kb":2178,"num_write":748,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:58.035239+0000","last_change":"2024-09-12T00:12:44.049673+0000","last_active":"2024-09-12T01:06:58.035239+0000","last_peered":"2024-09-12T01:06:58.035239+0000","last_clean":"2024-09-12T01:06:58.035239+0000","last_became_active":"2024-09-12T00:12:44.049211+0000","last_became_peered":"2024-09-12T00:12:44.049211+0000","last_unstale":"2024-09-12T01:06:58.035239+0000","last_undegraded":"2024-09-12T01:06:58.035239+0000","last_fullsized":"2024-09-12T01:06:58.035239+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:06.344330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'145","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.046019+0000","last_change":"2024-09-12T00:12:46.066668+0000","last_active":"2024-09-12T01:08:12.046019+0000","last_peered":"2024-09-12T01:08:12.046019+0000","last_clean":"2024-09-12T01:08:12.046019+0000","last_became_active":"2024-09-12T00:12:46.066431+0000","last_became_peered":"2024-09-12T00:12:46.066431+0000","last_unstale":"2024-09-12T01:08:12.046019+0000","last_undegraded":"2024-09-12T01:08:12.046019+0000","last_fullsized":"2024-09-12T01:08:12.046019+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:16.649236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":339,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'119","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.021555+0000","last_change":"2024-09-12T00:12:38.037741+0000","last_active":"2024-09-12T01:06:40.021555+0000","last_peered":"2024-09-12T01:06:40.021555+0000","last_clean":"2024-09-12T01:06:40.021555+0000","last_became_active":"2024-09-12T00:12:38.037464+0000","last_became_peered":"2024-09-12T00:12:38.037464+0000","last_unstale":"2024-09-12T01:06:40.021555+0000","last_undegraded":"2024-09-12T01:06:40.021555+0000","last_fullsized":"2024-09-12T01:06:40.021555+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:07.317139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'335","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.205222+0000","last_change":"2024-09-12T00:12:36.045431+0000","last_active":"2024-09-12T01:11:00.205222+0000","last_peered":"2024-09-12T01:11:00.205222+0000","last_clean":"2024-09-12T01:11:00.205222+0000","last_became_active":"2024-09-12T00:12:36.045050+0000","last_became_peered":"2024-09-12T00:12:36.045050+0000","last_unstale":"2024-09-12T01:11:00.205222+0000","last_undegraded":"2024-09-12T01:11:00.205222+0000","last_fullsized":"2024-09-12T01:11:00.205222+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:43.812152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":13364,"num_write":1093,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.033417+0000","last_change":"2024-09-12T00:12:40.038347+0000","last_active":"2024-09-12T01:06:40.033417+0000","last_peered":"2024-09-12T01:06:40.033417+0000","last_clean":"2024-09-12T01:06:40.033417+0000","last_became_active":"2024-09-12T00:12:40.038036+0000","last_became_peered":"2024-09-12T00:12:40.038036+0000","last_unstale":"2024-09-12T01:06:40.033417+0000","last_undegraded":"2024-09-12T01:06:40.033417+0000","last_fullsized":"2024-09-12T01:06:40.033417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:56.716723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'297","reported_seq":876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.160844+0000","last_change":"2024-09-12T00:12:42.051976+0000","last_active":"2024-09-12T01:10:59.160844+0000","last_peered":"2024-09-12T01:10:59.160844+0000","last_clean":"2024-09-12T01:10:59.160844+0000","last_became_active":"2024-09-12T00:12:42.051668+0000","last_became_peered":"2024-09-12T00:12:42.051668+0000","last_unstale":"2024-09-12T01:10:59.160844+0000","last_undegraded":"2024-09-12T01:10:59.160844+0000","last_fullsized":"2024-09-12T01:10:59.160844+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:48.021906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":1104,"num_write":460,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.036235+0000","last_change":"2024-09-12T00:12:44.062196+0000","last_active":"2024-09-12T01:06:55.036235+0000","last_peered":"2024-09-12T01:06:55.036235+0000","last_clean":"2024-09-12T01:06:55.036235+0000","last_became_active":"2024-09-12T00:12:44.061848+0000","last_became_peered":"2024-09-12T00:12:44.061848+0000","last_unstale":"2024-09-12T01:06:55.036235+0000","last_undegraded":"2024-09-12T01:06:55.036235+0000","last_fullsized":"2024-09-12T01:06:55.036235+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:41.383111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'90","reported_seq":570,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.004115+0000","last_change":"2024-09-12T00:12:46.066391+0000","last_active":"2024-09-12T01:10:33.004115+0000","last_peered":"2024-09-12T01:10:33.004115+0000","last_clean":"2024-09-12T01:10:33.004115+0000","last_became_active":"2024-09-12T00:12:46.066121+0000","last_became_peered":"2024-09-12T00:12:46.066121+0000","last_unstale":"2024-09-12T01:10:33.004115+0000","last_undegraded":"2024-09-12T01:10:33.004115+0000","last_fullsized":"2024-09-12T01:10:33.004115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:35.295982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":71,"num_write":206,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'180","reported_seq":761,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.034161+0000","last_change":"2024-09-12T00:12:38.046524+0000","last_active":"2024-09-12T01:06:40.034161+0000","last_peered":"2024-09-12T01:06:40.034161+0000","last_clean":"2024-09-12T01:06:40.034161+0000","last_became_active":"2024-09-12T00:12:38.046276+0000","last_became_peered":"2024-09-12T00:12:38.046276+0000","last_unstale":"2024-09-12T01:06:40.034161+0000","last_undegraded":"2024-09-12T01:06:40.034161+0000","last_fullsized":"2024-09-12T01:06:40.034161+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:51.205849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":618,"num_write":256,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'495","reported_seq":1198,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.153465+0000","last_change":"2024-09-12T00:12:36.035888+0000","last_active":"2024-09-12T01:11:00.153465+0000","last_peered":"2024-09-12T01:11:00.153465+0000","last_clean":"2024-09-12T01:11:00.153465+0000","last_became_active":"2024-09-12T00:12:36.035311+0000","last_became_peered":"2024-09-12T00:12:36.035311+0000","last_unstale":"2024-09-12T01:11:00.153465+0000","last_undegraded":"2024-09-12T01:11:00.153465+0000","last_fullsized":"2024-09-12T01:11:00.153465+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:22.262395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":942,"num_read_kb":11265,"num_write":1473,"num_write_kb":28283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:43.033260+0000","last_change":"2024-09-12T00:12:40.035887+0000","last_active":"2024-09-12T01:06:43.033260+0000","last_peered":"2024-09-12T01:06:43.033260+0000","last_clean":"2024-09-12T01:06:43.033260+0000","last_became_active":"2024-09-12T00:12:40.035585+0000","last_became_peered":"2024-09-12T00:12:40.035585+0000","last_unstale":"2024-09-12T01:06:43.033260+0000","last_undegraded":"2024-09-12T01:06:43.033260+0000","last_fullsized":"2024-09-12T01:06:43.033260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:55.033563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'310","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.545252+0000","last_change":"2024-09-12T00:12:42.052616+0000","last_active":"2024-09-12T01:10:58.545252+0000","last_peered":"2024-09-12T01:10:58.545252+0000","last_clean":"2024-09-12T01:10:58.545252+0000","last_became_active":"2024-09-12T00:12:42.052279+0000","last_became_peered":"2024-09-12T00:12:42.052279+0000","last_unstale":"2024-09-12T01:10:58.545252+0000","last_undegraded":"2024-09-12T01:10:58.545252+0000","last_fullsized":"2024-09-12T01:10:58.545252+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:39.576180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":1142,"num_write":410,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'773","reported_seq":4974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.882956+0000","last_change":"2024-09-12T00:12:44.060751+0000","last_active":"2024-09-12T01:10:57.882956+0000","last_peered":"2024-09-12T01:10:57.882956+0000","last_clean":"2024-09-12T01:10:57.882956+0000","last_became_active":"2024-09-12T00:12:44.060494+0000","last_became_peered":"2024-09-12T00:12:44.060494+0000","last_unstale":"2024-09-12T01:10:57.882956+0000","last_undegraded":"2024-09-12T01:10:57.882956+0000","last_fullsized":"2024-09-12T01:10:57.882956+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:43.956970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'133","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.942636+0000","last_change":"2024-09-12T00:12:46.060540+0000","last_active":"2024-09-12T01:09:20.942636+0000","last_peered":"2024-09-12T01:09:20.942636+0000","last_clean":"2024-09-12T01:09:20.942636+0000","last_became_active":"2024-09-12T00:12:46.060211+0000","last_became_peered":"2024-09-12T00:12:46.060211+0000","last_unstale":"2024-09-12T01:09:20.942636+0000","last_undegraded":"2024-09-12T01:09:20.942636+0000","last_fullsized":"2024-09-12T01:09:20.942636+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:03.614002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":113,"num_write":319,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'256","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:36.704664+0000","last_change":"2024-09-12T00:12:38.043160+0000","last_active":"2024-09-12T01:08:36.704664+0000","last_peered":"2024-09-12T01:08:36.704664+0000","last_clean":"2024-09-12T01:08:36.704664+0000","last_became_active":"2024-09-12T00:12:38.042601+0000","last_became_peered":"2024-09-12T00:12:38.042601+0000","last_unstale":"2024-09-12T01:08:36.704664+0000","last_undegraded":"2024-09-12T01:08:36.704664+0000","last_fullsized":"2024-09-12T01:08:36.704664+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:58.848548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1116,"num_read_kb":905,"num_write":388,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'367","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.029268+0000","last_change":"2024-09-12T00:12:36.043748+0000","last_active":"2024-09-12T01:11:00.029268+0000","last_peered":"2024-09-12T01:11:00.029268+0000","last_clean":"2024-09-12T01:11:00.029268+0000","last_became_active":"2024-09-12T00:12:36.043404+0000","last_became_peered":"2024-09-12T00:12:36.043404+0000","last_unstale":"2024-09-12T01:11:00.029268+0000","last_undegraded":"2024-09-12T01:11:00.029268+0000","last_fullsized":"2024-09-12T01:11:00.029268+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:28.818965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432371,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":514,"num_read_kb":34059,"num_write":1157,"num_write_kb":45928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'2","reported_seq":1458,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.863277+0000","last_change":"2024-09-12T00:12:40.035929+0000","last_active":"2024-09-12T01:10:57.863277+0000","last_peered":"2024-09-12T01:10:57.863277+0000","last_clean":"2024-09-12T01:10:57.863277+0000","last_became_active":"2024-09-12T00:12:40.035633+0000","last_became_peered":"2024-09-12T00:12:40.035633+0000","last_unstale":"2024-09-12T01:10:57.863277+0000","last_undegraded":"2024-09-12T01:10:57.863277+0000","last_fullsized":"2024-09-12T01:10:57.863277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:19.957170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'82","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.152071+0000","last_change":"2024-09-12T00:12:42.051649+0000","last_active":"2024-09-12T01:06:45.152071+0000","last_peered":"2024-09-12T01:06:45.152071+0000","last_clean":"2024-09-12T01:06:45.152071+0000","last_became_active":"2024-09-12T00:12:42.051384+0000","last_became_peered":"2024-09-12T00:12:42.051384+0000","last_unstale":"2024-09-12T01:06:45.152071+0000","last_undegraded":"2024-09-12T01:06:45.152071+0000","last_fullsized":"2024-09-12T01:06:45.152071+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:53.378146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'777","reported_seq":4087,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.883992+0000","last_change":"2024-09-12T00:12:44.062143+0000","last_active":"2024-09-12T01:10:57.883992+0000","last_peered":"2024-09-12T01:10:57.883992+0000","last_clean":"2024-09-12T01:10:57.883992+0000","last_became_active":"2024-09-12T00:12:44.061837+0000","last_became_peered":"2024-09-12T00:12:44.061837+0000","last_unstale":"2024-09-12T01:10:57.883992+0000","last_undegraded":"2024-09-12T01:10:57.883992+0000","last_fullsized":"2024-09-12T01:10:57.883992+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:55.341365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'132","reported_seq":628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.359620+0000","last_change":"2024-09-12T00:12:46.059816+0000","last_active":"2024-09-12T01:09:22.359620+0000","last_peered":"2024-09-12T01:09:22.359620+0000","last_clean":"2024-09-12T01:09:22.359620+0000","last_became_active":"2024-09-12T00:12:46.057978+0000","last_became_peered":"2024-09-12T00:12:46.057978+0000","last_unstale":"2024-09-12T01:09:22.359620+0000","last_undegraded":"2024-09-12T01:09:22.359620+0000","last_fullsized":"2024-09-12T01:09:22.359620+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:40.034637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":126,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'235","reported_seq":844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.646426+0000","last_change":"2024-09-12T00:12:38.037321+0000","last_active":"2024-09-12T01:08:55.646426+0000","last_peered":"2024-09-12T01:08:55.646426+0000","last_clean":"2024-09-12T01:08:55.646426+0000","last_became_active":"2024-09-12T00:12:38.037035+0000","last_became_peered":"2024-09-12T00:12:38.037035+0000","last_unstale":"2024-09-12T01:08:55.646426+0000","last_undegraded":"2024-09-12T01:08:55.646426+0000","last_fullsized":"2024-09-12T01:08:55.646426+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:35.492382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":394,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'298","reported_seq":921,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.205567+0000","last_change":"2024-09-12T00:12:36.029406+0000","last_active":"2024-09-12T01:11:00.205567+0000","last_peered":"2024-09-12T01:11:00.205567+0000","last_clean":"2024-09-12T01:11:00.205567+0000","last_became_active":"2024-09-12T00:12:36.029059+0000","last_became_peered":"2024-09-12T00:12:36.029059+0000","last_unstale":"2024-09-12T01:11:00.205567+0000","last_undegraded":"2024-09-12T01:11:00.205567+0000","last_fullsized":"2024-09-12T01:11:00.205567+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:18.842991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4837920,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":419,"num_read_kb":19038,"num_write":995,"num_write_kb":37710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.034179+0000","last_change":"2024-09-12T00:12:40.042406+0000","last_active":"2024-09-12T01:06:40.034179+0000","last_peered":"2024-09-12T01:06:40.034179+0000","last_clean":"2024-09-12T01:06:40.034179+0000","last_became_active":"2024-09-12T00:12:40.042158+0000","last_became_peered":"2024-09-12T00:12:40.042158+0000","last_unstale":"2024-09-12T01:06:40.034179+0000","last_undegraded":"2024-09-12T01:06:40.034179+0000","last_fullsized":"2024-09-12T01:06:40.034179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:16.795550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'350","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.868328+0000","last_change":"2024-09-12T00:12:42.049042+0000","last_active":"2024-09-12T01:10:59.868328+0000","last_peered":"2024-09-12T01:10:59.868328+0000","last_clean":"2024-09-12T01:10:59.868328+0000","last_became_active":"2024-09-12T00:12:42.048747+0000","last_became_peered":"2024-09-12T00:12:42.048747+0000","last_unstale":"2024-09-12T01:10:59.868328+0000","last_undegraded":"2024-09-12T01:10:59.868328+0000","last_fullsized":"2024-09-12T01:10:59.868328+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:20.408850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49371,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":1173,"num_write":448,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:45.128059+0000","last_change":"2024-09-12T00:12:44.050415+0000","last_active":"2024-09-12T01:06:45.128059+0000","last_peered":"2024-09-12T01:06:45.128059+0000","last_clean":"2024-09-12T01:06:45.128059+0000","last_became_active":"2024-09-12T00:12:44.050074+0000","last_became_peered":"2024-09-12T00:12:44.050074+0000","last_unstale":"2024-09-12T01:06:45.128059+0000","last_undegraded":"2024-09-12T01:06:45.128059+0000","last_fullsized":"2024-09-12T01:06:45.128059+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:57.225646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'192","reported_seq":698,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.036974+0000","last_change":"2024-09-12T00:12:46.064781+0000","last_active":"2024-09-12T01:07:00.036974+0000","last_peered":"2024-09-12T01:07:00.036974+0000","last_clean":"2024-09-12T01:07:00.036974+0000","last_became_active":"2024-09-12T00:12:46.064517+0000","last_became_peered":"2024-09-12T00:12:46.064517+0000","last_unstale":"2024-09-12T01:07:00.036974+0000","last_undegraded":"2024-09-12T01:07:00.036974+0000","last_fullsized":"2024-09-12T01:07:00.036974+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:13.273953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":229,"num_read_kb":204,"num_write":354,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'287","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:10.051836+0000","last_change":"2024-09-12T00:12:38.042874+0000","last_active":"2024-09-12T01:09:10.051836+0000","last_peered":"2024-09-12T01:09:10.051836+0000","last_clean":"2024-09-12T01:09:10.051836+0000","last_became_active":"2024-09-12T00:12:38.040885+0000","last_became_peered":"2024-09-12T00:12:38.040885+0000","last_unstale":"2024-09-12T01:09:10.051836+0000","last_undegraded":"2024-09-12T01:09:10.051836+0000","last_fullsized":"2024-09-12T01:09:10.051836+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:18.323532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1200,"num_read_kb":970,"num_write":419,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.239059+0000","last_change":"2024-09-12T00:12:17.818843+0000","last_active":"2024-09-12T01:08:25.239059+0000","last_peered":"2024-09-12T01:08:25.239059+0000","last_clean":"2024-09-12T01:08:25.239059+0000","last_became_active":"2024-09-12T00:12:17.817880+0000","last_became_peered":"2024-09-12T00:12:17.817880+0000","last_unstale":"2024-09-12T01:08:25.239059+0000","last_undegraded":"2024-09-12T01:08:25.239059+0000","last_fullsized":"2024-09-12T01:08:25.239059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:16.658840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:16.658840+0000","last_clean_scrub_stamp":"2024-09-12T00:12:16.658840+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:23.769027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"21'1","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.048041+0000","last_change":"2024-09-12T00:12:24.720432+0000","last_active":"2024-09-12T01:08:40.048041+0000","last_peered":"2024-09-12T01:08:40.048041+0000","last_clean":"2024-09-12T01:08:40.048041+0000","last_became_active":"2024-09-12T00:12:22.713297+0000","last_became_peered":"2024-09-12T00:12:22.713297+0000","last_unstale":"2024-09-12T01:08:40.048041+0000","last_undegraded":"2024-09-12T01:08:40.048041+0000","last_fullsized":"2024-09-12T01:08:40.048041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:31.323737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014022310000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'392","reported_seq":1097,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.215169+0000","last_change":"2024-09-12T00:12:36.031160+0000","last_active":"2024-09-12T01:11:00.215169+0000","last_peered":"2024-09-12T01:11:00.215169+0000","last_clean":"2024-09-12T01:11:00.215169+0000","last_became_active":"2024-09-12T00:12:36.030408+0000","last_became_peered":"2024-09-12T00:12:36.030408+0000","last_unstale":"2024-09-12T01:11:00.215169+0000","last_undegraded":"2024-09-12T01:11:00.215169+0000","last_fullsized":"2024-09-12T01:11:00.215169+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:33.226277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262211,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":42611,"num_write":1169,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"39'3","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.876104+0000","last_change":"2024-09-12T00:12:40.039805+0000","last_active":"2024-09-12T01:10:57.876104+0000","last_peered":"2024-09-12T01:10:57.876104+0000","last_clean":"2024-09-12T01:10:57.876104+0000","last_became_active":"2024-09-12T00:12:40.039529+0000","last_became_peered":"2024-09-12T00:12:40.039529+0000","last_unstale":"2024-09-12T01:10:57.876104+0000","last_undegraded":"2024-09-12T01:10:57.876104+0000","last_fullsized":"2024-09-12T01:10:57.876104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:59.811179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'764","reported_seq":1473,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.987650+0000","last_change":"2024-09-12T00:12:42.047000+0000","last_active":"2024-09-12T01:10:59.987650+0000","last_peered":"2024-09-12T01:10:59.987650+0000","last_clean":"2024-09-12T01:10:59.987650+0000","last_became_active":"2024-09-12T00:12:42.046668+0000","last_became_peered":"2024-09-12T00:12:42.046668+0000","last_unstale":"2024-09-12T01:10:59.987650+0000","last_undegraded":"2024-09-12T01:10:59.987650+0000","last_fullsized":"2024-09-12T01:10:59.987650+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:28.052922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143901,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1496,"num_read_kb":3385,"num_write":1448,"num_write_kb":1292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:58.035351+0000","last_change":"2024-09-12T00:12:44.054071+0000","last_active":"2024-09-12T01:06:58.035351+0000","last_peered":"2024-09-12T01:06:58.035351+0000","last_clean":"2024-09-12T01:06:58.035351+0000","last_became_active":"2024-09-12T00:12:44.053779+0000","last_became_peered":"2024-09-12T00:12:44.053779+0000","last_unstale":"2024-09-12T01:06:58.035351+0000","last_undegraded":"2024-09-12T01:06:58.035351+0000","last_fullsized":"2024-09-12T01:06:58.035351+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:27.975447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'187","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.839569+0000","last_change":"2024-09-12T00:12:46.055892+0000","last_active":"2024-09-12T01:09:21.839569+0000","last_peered":"2024-09-12T01:09:21.839569+0000","last_clean":"2024-09-12T01:09:21.839569+0000","last_became_active":"2024-09-12T00:12:46.055501+0000","last_became_peered":"2024-09-12T00:12:46.055501+0000","last_unstale":"2024-09-12T01:09:21.839569+0000","last_undegraded":"2024-09-12T01:09:21.839569+0000","last_fullsized":"2024-09-12T01:09:21.839569+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:21.728435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":436,"num_write":384,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'149","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.983294+0000","last_change":"2024-09-12T00:12:38.037702+0000","last_active":"2024-09-12T01:06:50.983294+0000","last_peered":"2024-09-12T01:06:50.983294+0000","last_clean":"2024-09-12T01:06:50.983294+0000","last_became_active":"2024-09-12T00:12:38.037392+0000","last_became_peered":"2024-09-12T00:12:38.037392+0000","last_unstale":"2024-09-12T01:06:50.983294+0000","last_undegraded":"2024-09-12T01:06:50.983294+0000","last_fullsized":"2024-09-12T01:06:50.983294+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:11.775556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":647,"num_read_kb":530,"num_write":212,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.047963+0000","last_change":"2024-09-12T00:12:24.720267+0000","last_active":"2024-09-12T01:08:40.047963+0000","last_peered":"2024-09-12T01:08:40.047963+0000","last_clean":"2024-09-12T01:08:40.047963+0000","last_became_active":"2024-09-12T00:12:22.713657+0000","last_became_peered":"2024-09-12T00:12:22.713657+0000","last_unstale":"2024-09-12T01:08:40.047963+0000","last_undegraded":"2024-09-12T01:08:40.047963+0000","last_fullsized":"2024-09-12T01:08:40.047963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:55.127846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012667690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'335","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.193544+0000","last_change":"2024-09-12T00:12:36.036400+0000","last_active":"2024-09-12T01:11:00.193544+0000","last_peered":"2024-09-12T01:11:00.193544+0000","last_clean":"2024-09-12T01:11:00.193544+0000","last_became_active":"2024-09-12T00:12:36.036010+0000","last_became_peered":"2024-09-12T00:12:36.036010+0000","last_unstale":"2024-09-12T01:11:00.193544+0000","last_undegraded":"2024-09-12T01:11:00.193544+0000","last_fullsized":"2024-09-12T01:11:00.193544+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:28.310996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":7159,"num_write":1103,"num_write_kb":37525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035353+0000","last_change":"2024-09-12T00:12:40.039924+0000","last_active":"2024-09-12T01:06:50.035353+0000","last_peered":"2024-09-12T01:06:50.035353+0000","last_clean":"2024-09-12T01:06:50.035353+0000","last_became_active":"2024-09-12T00:12:40.039592+0000","last_became_peered":"2024-09-12T00:12:40.039592+0000","last_unstale":"2024-09-12T01:06:50.035353+0000","last_undegraded":"2024-09-12T01:06:50.035353+0000","last_fullsized":"2024-09-12T01:06:50.035353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:03.351155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1308","reported_seq":2939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.227167+0000","last_change":"2024-09-12T00:12:42.049983+0000","last_active":"2024-09-12T01:11:00.227167+0000","last_peered":"2024-09-12T01:11:00.227167+0000","last_clean":"2024-09-12T01:11:00.227167+0000","last_became_active":"2024-09-12T00:12:42.049594+0000","last_became_peered":"2024-09-12T00:12:42.049594+0000","last_unstale":"2024-09-12T01:11:00.227167+0000","last_undegraded":"2024-09-12T01:11:00.227167+0000","last_fullsized":"2024-09-12T01:11:00.227167+0000","mapping_epoch":33,"log_start":"263'1201","ondisk_log_start":"263'1201","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":1201,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:24.166453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146958,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3903,"num_write":1160,"num_write_kb":992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.037681+0000","last_change":"2024-09-12T00:12:44.059941+0000","last_active":"2024-09-12T01:07:10.037681+0000","last_peered":"2024-09-12T01:07:10.037681+0000","last_clean":"2024-09-12T01:07:10.037681+0000","last_became_active":"2024-09-12T00:12:44.059188+0000","last_became_peered":"2024-09-12T00:12:44.059188+0000","last_unstale":"2024-09-12T01:07:10.037681+0000","last_undegraded":"2024-09-12T01:07:10.037681+0000","last_fullsized":"2024-09-12T01:07:10.037681+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:21.870093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'151","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.534259+0000","last_change":"2024-09-12T00:12:46.065282+0000","last_active":"2024-09-12T01:09:21.534259+0000","last_peered":"2024-09-12T01:09:21.534259+0000","last_clean":"2024-09-12T01:09:21.534259+0000","last_became_active":"2024-09-12T00:12:46.064993+0000","last_became_peered":"2024-09-12T00:12:46.064993+0000","last_unstale":"2024-09-12T01:09:21.534259+0000","last_undegraded":"2024-09-12T01:09:21.534259+0000","last_fullsized":"2024-09-12T01:09:21.534259+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:44.458446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":277,"num_write":363,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'61","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.153022+0000","last_change":"2024-09-12T00:12:38.039881+0000","last_active":"2024-09-12T01:06:50.153022+0000","last_peered":"2024-09-12T01:06:50.153022+0000","last_clean":"2024-09-12T01:06:50.153022+0000","last_became_active":"2024-09-12T00:12:38.039492+0000","last_became_peered":"2024-09-12T00:12:38.039492+0000","last_unstale":"2024-09-12T01:06:50.153022+0000","last_undegraded":"2024-09-12T01:06:50.153022+0000","last_fullsized":"2024-09-12T01:06:50.153022+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:21.545330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":235,"num_write":88,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.053063+0000","last_change":"2024-09-12T00:12:25.140418+0000","last_active":"2024-09-12T01:08:40.053063+0000","last_peered":"2024-09-12T01:08:40.053063+0000","last_clean":"2024-09-12T01:08:40.053063+0000","last_became_active":"2024-09-12T00:12:22.714487+0000","last_became_peered":"2024-09-12T00:12:22.714487+0000","last_unstale":"2024-09-12T01:08:40.053063+0000","last_undegraded":"2024-09-12T01:08:40.053063+0000","last_fullsized":"2024-09-12T01:08:40.053063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:43.265742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038937299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'315","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.185696+0000","last_change":"2024-09-12T00:12:36.042842+0000","last_active":"2024-09-12T01:11:00.185696+0000","last_peered":"2024-09-12T01:11:00.185696+0000","last_clean":"2024-09-12T01:11:00.185696+0000","last_became_active":"2024-09-12T00:12:36.042293+0000","last_became_peered":"2024-09-12T00:12:36.042293+0000","last_unstale":"2024-09-12T01:11:00.185696+0000","last_undegraded":"2024-09-12T01:11:00.185696+0000","last_fullsized":"2024-09-12T01:11:00.185696+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:27.070087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214314,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":33497,"num_write":1058,"num_write_kb":40497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"32'1","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:50.035127+0000","last_change":"2024-09-12T00:12:40.038528+0000","last_active":"2024-09-12T01:06:50.035127+0000","last_peered":"2024-09-12T01:06:50.035127+0000","last_clean":"2024-09-12T01:06:50.035127+0000","last_became_active":"2024-09-12T00:12:40.038202+0000","last_became_peered":"2024-09-12T00:12:40.038202+0000","last_unstale":"2024-09-12T01:06:50.035127+0000","last_undegraded":"2024-09-12T01:06:50.035127+0000","last_fullsized":"2024-09-12T01:06:50.035127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:20.002180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'248","reported_seq":1480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:30.102145+0000","last_change":"2024-09-12T00:12:42.044804+0000","last_active":"2024-09-12T01:10:30.102145+0000","last_peered":"2024-09-12T01:10:30.102145+0000","last_clean":"2024-09-12T01:10:30.102145+0000","last_became_active":"2024-09-12T00:12:42.044498+0000","last_became_peered":"2024-09-12T00:12:42.044498+0000","last_unstale":"2024-09-12T01:10:30.102145+0000","last_undegraded":"2024-09-12T01:10:30.102145+0000","last_fullsized":"2024-09-12T01:10:30.102145+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:46.624574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":187,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.056476+0000","last_change":"2024-09-12T00:12:44.062318+0000","last_active":"2024-09-12T01:09:00.056476+0000","last_peered":"2024-09-12T01:09:00.056476+0000","last_clean":"2024-09-12T01:09:00.056476+0000","last_became_active":"2024-09-12T00:12:44.062039+0000","last_became_peered":"2024-09-12T00:12:44.062039+0000","last_unstale":"2024-09-12T01:09:00.056476+0000","last_undegraded":"2024-09-12T01:09:00.056476+0000","last_fullsized":"2024-09-12T01:09:00.056476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:41.686967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'260","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.751353+0000","last_change":"2024-09-12T00:12:46.053602+0000","last_active":"2024-09-12T01:09:22.751353+0000","last_peered":"2024-09-12T01:09:22.751353+0000","last_clean":"2024-09-12T01:09:22.751353+0000","last_became_active":"2024-09-12T00:12:46.053228+0000","last_became_peered":"2024-09-12T00:12:46.053228+0000","last_unstale":"2024-09-12T01:09:22.751353+0000","last_undegraded":"2024-09-12T01:09:22.751353+0000","last_fullsized":"2024-09-12T01:09:22.751353+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:21.825120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":531,"num_write":580,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'172","reported_seq":752,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.172609+0000","last_change":"2024-09-12T00:12:38.040785+0000","last_active":"2024-09-12T01:08:55.172609+0000","last_peered":"2024-09-12T01:08:55.172609+0000","last_clean":"2024-09-12T01:08:55.172609+0000","last_became_active":"2024-09-12T00:12:38.040477+0000","last_became_peered":"2024-09-12T00:12:38.040477+0000","last_unstale":"2024-09-12T01:08:55.172609+0000","last_undegraded":"2024-09-12T01:08:55.172609+0000","last_fullsized":"2024-09-12T01:08:55.172609+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.489846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":766,"num_read_kb":623,"num_write":281,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"23'2","reported_seq":527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.048018+0000","last_change":"2024-09-12T00:12:24.719660+0000","last_active":"2024-09-12T01:08:40.048018+0000","last_peered":"2024-09-12T01:08:40.048018+0000","last_clean":"2024-09-12T01:08:40.048018+0000","last_became_active":"2024-09-12T00:12:22.840587+0000","last_became_peered":"2024-09-12T00:12:22.840587+0000","last_unstale":"2024-09-12T01:08:40.048018+0000","last_undegraded":"2024-09-12T01:08:40.048018+0000","last_fullsized":"2024-09-12T01:08:40.048018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:04.555069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065014999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'371","reported_seq":1089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.186177+0000","last_change":"2024-09-12T00:12:36.040303+0000","last_active":"2024-09-12T01:11:00.186177+0000","last_peered":"2024-09-12T01:11:00.186177+0000","last_clean":"2024-09-12T01:11:00.186177+0000","last_became_active":"2024-09-12T00:12:36.039564+0000","last_became_peered":"2024-09-12T00:12:36.039564+0000","last_unstale":"2024-09-12T01:11:00.186177+0000","last_undegraded":"2024-09-12T01:11:00.186177+0000","last_fullsized":"2024-09-12T01:11:00.186177+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:41.381139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568589,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":639,"num_read_kb":35583,"num_write":1189,"num_write_kb":35527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:00.037023+0000","last_change":"2024-09-12T00:12:40.042792+0000","last_active":"2024-09-12T01:07:00.037023+0000","last_peered":"2024-09-12T01:07:00.037023+0000","last_clean":"2024-09-12T01:07:00.037023+0000","last_became_active":"2024-09-12T00:12:40.042510+0000","last_became_peered":"2024-09-12T00:12:40.042510+0000","last_unstale":"2024-09-12T01:07:00.037023+0000","last_undegraded":"2024-09-12T01:07:00.037023+0000","last_fullsized":"2024-09-12T01:07:00.037023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:33.760779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'131","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.054611+0000","last_change":"2024-09-12T00:12:42.051046+0000","last_active":"2024-09-12T01:09:03.054611+0000","last_peered":"2024-09-12T01:09:03.054611+0000","last_clean":"2024-09-12T01:09:03.054611+0000","last_became_active":"2024-09-12T00:12:42.050143+0000","last_became_peered":"2024-09-12T00:12:42.050143+0000","last_unstale":"2024-09-12T01:09:03.054611+0000","last_undegraded":"2024-09-12T01:09:03.054611+0000","last_fullsized":"2024-09-12T01:09:03.054611+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:15.073604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.035914+0000","last_change":"2024-09-12T00:12:44.059423+0000","last_active":"2024-09-12T01:06:55.035914+0000","last_peered":"2024-09-12T01:06:55.035914+0000","last_clean":"2024-09-12T01:06:55.035914+0000","last_became_active":"2024-09-12T00:12:44.059037+0000","last_became_peered":"2024-09-12T00:12:44.059037+0000","last_unstale":"2024-09-12T01:06:55.035914+0000","last_undegraded":"2024-09-12T01:06:55.035914+0000","last_fullsized":"2024-09-12T01:06:55.035914+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:59.363962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'163","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.572035+0000","last_change":"2024-09-12T00:12:46.069307+0000","last_active":"2024-09-12T01:09:21.572035+0000","last_peered":"2024-09-12T01:09:21.572035+0000","last_clean":"2024-09-12T01:09:21.572035+0000","last_became_active":"2024-09-12T00:12:46.068934+0000","last_became_peered":"2024-09-12T00:12:46.068934+0000","last_unstale":"2024-09-12T01:09:21.572035+0000","last_undegraded":"2024-09-12T01:09:21.572035+0000","last_fullsized":"2024-09-12T01:09:21.572035+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:07.233294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":270,"num_read_kb":259,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'110","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.172540+0000","last_change":"2024-09-12T00:12:38.044730+0000","last_active":"2024-09-12T01:08:55.172540+0000","last_peered":"2024-09-12T01:08:55.172540+0000","last_clean":"2024-09-12T01:08:55.172540+0000","last_became_active":"2024-09-12T00:12:38.044464+0000","last_became_peered":"2024-09-12T00:12:38.044464+0000","last_unstale":"2024-09-12T01:08:55.172540+0000","last_undegraded":"2024-09-12T01:08:55.172540+0000","last_fullsized":"2024-09-12T01:08:55.172540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:14.066506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":513,"num_read_kb":428,"num_write":178,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'371","reported_seq":1144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:04.190168+0000","last_change":"2024-09-12T01:11:04.190168+0000","last_active":"2024-09-12T01:11:04.190168+0000","last_peered":"2024-09-12T01:11:04.190168+0000","last_clean":"2024-09-12T01:11:04.190168+0000","last_became_active":"2024-09-12T00:12:36.036570+0000","last_became_peered":"2024-09-12T00:12:36.036570+0000","last_unstale":"2024-09-12T01:11:04.190168+0000","last_undegraded":"2024-09-12T01:11:04.190168+0000","last_fullsized":"2024-09-12T01:11:04.190168+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-12T01:11:04.190045+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-12T01:11:04.190045+0000","last_clean_scrub_stamp":"2024-09-12T01:11:04.190045+0000","objects_scrubbed":9,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:33.603768+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524373,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":804,"num_read_kb":22341,"num_write":1147,"num_write_kb":30942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:38.050417+0000","last_change":"2024-09-12T00:12:24.788080+0000","last_active":"2024-09-12T01:08:38.050417+0000","last_peered":"2024-09-12T01:08:38.050417+0000","last_clean":"2024-09-12T01:08:38.050417+0000","last_became_active":"2024-09-12T00:12:22.840210+0000","last_became_peered":"2024-09-12T00:12:22.840210+0000","last_unstale":"2024-09-12T01:08:38.050417+0000","last_undegraded":"2024-09-12T01:08:38.050417+0000","last_fullsized":"2024-09-12T01:08:38.050417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:32.906053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043827699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.055677+0000","last_change":"2024-09-12T00:12:40.041037+0000","last_active":"2024-09-12T01:08:55.055677+0000","last_peered":"2024-09-12T01:08:55.055677+0000","last_clean":"2024-09-12T01:08:55.055677+0000","last_became_active":"2024-09-12T00:12:40.040760+0000","last_became_peered":"2024-09-12T00:12:40.040760+0000","last_unstale":"2024-09-12T01:08:55.055677+0000","last_undegraded":"2024-09-12T01:08:55.055677+0000","last_fullsized":"2024-09-12T01:08:55.055677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:43.762744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'626","reported_seq":1298,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.572713+0000","last_change":"2024-09-12T00:12:42.053771+0000","last_active":"2024-09-12T01:10:59.572713+0000","last_peered":"2024-09-12T01:10:59.572713+0000","last_clean":"2024-09-12T01:10:59.572713+0000","last_became_active":"2024-09-12T00:12:42.053472+0000","last_became_peered":"2024-09-12T00:12:42.053472+0000","last_unstale":"2024-09-12T01:10:59.572713+0000","last_undegraded":"2024-09-12T01:10:59.572713+0000","last_fullsized":"2024-09-12T01:10:59.572713+0000","mapping_epoch":33,"log_start":"263'600","ondisk_log_start":"263'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:10.598317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1715,"num_read_kb":3028,"num_write":2216,"num_write_kb":2038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.143292+0000","last_change":"2024-09-12T00:12:44.049070+0000","last_active":"2024-09-12T01:09:00.143292+0000","last_peered":"2024-09-12T01:09:00.143292+0000","last_clean":"2024-09-12T01:09:00.143292+0000","last_became_active":"2024-09-12T00:12:44.048703+0000","last_became_peered":"2024-09-12T00:12:44.048703+0000","last_unstale":"2024-09-12T01:09:00.143292+0000","last_undegraded":"2024-09-12T01:09:00.143292+0000","last_fullsized":"2024-09-12T01:09:00.143292+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'142","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.054601+0000","last_change":"2024-09-12T00:12:46.064205+0000","last_active":"2024-09-12T01:09:03.054601+0000","last_peered":"2024-09-12T01:09:03.054601+0000","last_clean":"2024-09-12T01:09:03.054601+0000","last_became_active":"2024-09-12T00:12:46.063429+0000","last_became_peered":"2024-09-12T00:12:46.063429+0000","last_unstale":"2024-09-12T01:09:03.054601+0000","last_undegraded":"2024-09-12T01:09:03.054601+0000","last_fullsized":"2024-09-12T01:09:03.054601+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:01.539611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":320,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'177","reported_seq":787,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.172570+0000","last_change":"2024-09-12T00:12:38.041538+0000","last_active":"2024-09-12T01:08:55.172570+0000","last_peered":"2024-09-12T01:08:55.172570+0000","last_clean":"2024-09-12T01:08:55.172570+0000","last_became_active":"2024-09-12T00:12:38.041178+0000","last_became_peered":"2024-09-12T00:12:38.041178+0000","last_unstale":"2024-09-12T01:08:55.172570+0000","last_undegraded":"2024-09-12T01:08:55.172570+0000","last_fullsized":"2024-09-12T01:08:55.172570+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:50.594465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":778,"num_read_kb":646,"num_write":262,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'366","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.197207+0000","last_change":"2024-09-12T00:12:36.036323+0000","last_active":"2024-09-12T01:11:00.197207+0000","last_peered":"2024-09-12T01:11:00.197207+0000","last_clean":"2024-09-12T01:11:00.197207+0000","last_became_active":"2024-09-12T00:12:36.035932+0000","last_became_peered":"2024-09-12T00:12:36.035932+0000","last_unstale":"2024-09-12T01:11:00.197207+0000","last_undegraded":"2024-09-12T01:11:00.197207+0000","last_fullsized":"2024-09-12T01:11:00.197207+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:58.357878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":22298,"num_write":1170,"num_write_kb":32564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.049776+0000","last_change":"2024-09-12T00:12:24.719653+0000","last_active":"2024-09-12T01:08:55.049776+0000","last_peered":"2024-09-12T01:08:55.049776+0000","last_clean":"2024-09-12T01:08:55.049776+0000","last_became_active":"2024-09-12T00:12:22.713263+0000","last_became_peered":"2024-09-12T00:12:22.713263+0000","last_unstale":"2024-09-12T01:08:55.049776+0000","last_undegraded":"2024-09-12T01:08:55.049776+0000","last_fullsized":"2024-09-12T01:08:55.049776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:13.032469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065424400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.036052+0000","last_change":"2024-09-12T00:12:40.039181+0000","last_active":"2024-09-12T01:08:55.036052+0000","last_peered":"2024-09-12T01:08:55.036052+0000","last_clean":"2024-09-12T01:08:55.036052+0000","last_became_active":"2024-09-12T00:12:40.038903+0000","last_became_peered":"2024-09-12T00:12:40.038903+0000","last_unstale":"2024-09-12T01:08:55.036052+0000","last_undegraded":"2024-09-12T01:08:55.036052+0000","last_fullsized":"2024-09-12T01:08:55.036052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:00.591959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'172","reported_seq":742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.173269+0000","last_change":"2024-09-12T00:12:42.050874+0000","last_active":"2024-09-12T01:09:00.173269+0000","last_peered":"2024-09-12T01:09:00.173269+0000","last_clean":"2024-09-12T01:09:00.173269+0000","last_became_active":"2024-09-12T00:12:42.050580+0000","last_became_peered":"2024-09-12T00:12:42.050580+0000","last_unstale":"2024-09-12T01:09:00.173269+0000","last_undegraded":"2024-09-12T01:09:00.173269+0000","last_fullsized":"2024-09-12T01:09:00.173269+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:59.841756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":221,"num_write":156,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'778","reported_seq":2701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.881010+0000","last_change":"2024-09-12T00:12:44.050548+0000","last_active":"2024-09-12T01:10:57.881010+0000","last_peered":"2024-09-12T01:10:57.881010+0000","last_clean":"2024-09-12T01:10:57.881010+0000","last_became_active":"2024-09-12T00:12:44.050295+0000","last_became_peered":"2024-09-12T00:12:44.050295+0000","last_unstale":"2024-09-12T01:10:57.881010+0000","last_undegraded":"2024-09-12T01:10:57.881010+0000","last_fullsized":"2024-09-12T01:10:57.881010+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:53.235246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'126","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.059081+0000","last_change":"2024-09-12T00:12:46.064323+0000","last_active":"2024-09-12T01:09:15.059081+0000","last_peered":"2024-09-12T01:09:15.059081+0000","last_clean":"2024-09-12T01:09:15.059081+0000","last_became_active":"2024-09-12T00:12:46.064036+0000","last_became_peered":"2024-09-12T00:12:46.064036+0000","last_unstale":"2024-09-12T01:09:15.059081+0000","last_undegraded":"2024-09-12T01:09:15.059081+0000","last_fullsized":"2024-09-12T01:09:15.059081+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:58.782613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1116,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'65","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.900165+0000","last_change":"2024-09-12T00:12:38.040132+0000","last_active":"2024-09-12T01:10:35.900165+0000","last_peered":"2024-09-12T01:10:35.900165+0000","last_clean":"2024-09-12T01:10:35.900165+0000","last_became_active":"2024-09-12T00:12:38.039759+0000","last_became_peered":"2024-09-12T00:12:38.039759+0000","last_unstale":"2024-09-12T01:10:35.900165+0000","last_undegraded":"2024-09-12T01:10:35.900165+0000","last_fullsized":"2024-09-12T01:10:35.900165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:56.827266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":290,"num_read_kb":242,"num_write":89,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'356","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.185119+0000","last_change":"2024-09-12T00:12:36.032820+0000","last_active":"2024-09-12T01:11:00.185119+0000","last_peered":"2024-09-12T01:11:00.185119+0000","last_clean":"2024-09-12T01:11:00.185119+0000","last_became_active":"2024-09-12T00:12:36.032470+0000","last_became_peered":"2024-09-12T00:12:36.032470+0000","last_unstale":"2024-09-12T01:11:00.185119+0000","last_undegraded":"2024-09-12T01:11:00.185119+0000","last_fullsized":"2024-09-12T01:11:00.185119+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:59.424753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":506,"num_read_kb":9897,"num_write":1201,"num_write_kb":25017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.054108+0000","last_change":"2024-09-12T00:12:24.719145+0000","last_active":"2024-09-12T01:08:45.054108+0000","last_peered":"2024-09-12T01:08:45.054108+0000","last_clean":"2024-09-12T01:08:45.054108+0000","last_became_active":"2024-09-12T00:12:22.875452+0000","last_became_peered":"2024-09-12T00:12:22.875452+0000","last_unstale":"2024-09-12T01:08:45.054108+0000","last_undegraded":"2024-09-12T01:08:45.054108+0000","last_fullsized":"2024-09-12T01:08:45.054108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:18.582665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040035500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.049709+0000","last_change":"2024-09-12T00:12:40.040001+0000","last_active":"2024-09-12T01:08:55.049709+0000","last_peered":"2024-09-12T01:08:55.049709+0000","last_clean":"2024-09-12T01:08:55.049709+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:08:55.049709+0000","last_undegraded":"2024-09-12T01:08:55.049709+0000","last_fullsized":"2024-09-12T01:08:55.049709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:47.045425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'129","reported_seq":675,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.050520+0000","last_change":"2024-09-12T00:12:42.048645+0000","last_active":"2024-09-12T01:09:00.050520+0000","last_peered":"2024-09-12T01:09:00.050520+0000","last_clean":"2024-09-12T01:09:00.050520+0000","last_became_active":"2024-09-12T00:12:42.048364+0000","last_became_peered":"2024-09-12T00:12:42.048364+0000","last_unstale":"2024-09-12T01:09:00.050520+0000","last_undegraded":"2024-09-12T01:09:00.050520+0000","last_fullsized":"2024-09-12T01:09:00.050520+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'806","reported_seq":2515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.959059+0000","last_change":"2024-09-12T00:12:44.050927+0000","last_active":"2024-09-12T01:10:57.959059+0000","last_peered":"2024-09-12T01:10:57.959059+0000","last_clean":"2024-09-12T01:10:57.959059+0000","last_became_active":"2024-09-12T00:12:44.049336+0000","last_became_peered":"2024-09-12T00:12:44.049336+0000","last_unstale":"2024-09-12T01:10:57.959059+0000","last_undegraded":"2024-09-12T01:10:57.959059+0000","last_fullsized":"2024-09-12T01:10:57.959059+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:05.958866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'271","reported_seq":790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:44.898434+0000","last_change":"2024-09-12T00:12:46.064357+0000","last_active":"2024-09-12T01:08:44.898434+0000","last_peered":"2024-09-12T01:08:44.898434+0000","last_clean":"2024-09-12T01:08:44.898434+0000","last_became_active":"2024-09-12T00:12:46.064058+0000","last_became_peered":"2024-09-12T00:12:46.064058+0000","last_unstale":"2024-09-12T01:08:44.898434+0000","last_undegraded":"2024-09-12T01:08:44.898434+0000","last_fullsized":"2024-09-12T01:08:44.898434+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:14.383616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":363,"num_read_kb":352,"num_write":596,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'133","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.142775+0000","last_change":"2024-09-12T00:12:38.045014+0000","last_active":"2024-09-12T01:08:55.142775+0000","last_peered":"2024-09-12T01:08:55.142775+0000","last_clean":"2024-09-12T01:08:55.142775+0000","last_became_active":"2024-09-12T00:12:38.044075+0000","last_became_peered":"2024-09-12T00:12:38.044075+0000","last_unstale":"2024-09-12T01:08:55.142775+0000","last_undegraded":"2024-09-12T01:08:55.142775+0000","last_fullsized":"2024-09-12T01:08:55.142775+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:39.495991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":484,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'410","reported_seq":1160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.168785+0000","last_change":"2024-09-12T00:12:36.031043+0000","last_active":"2024-09-12T01:11:00.168785+0000","last_peered":"2024-09-12T01:11:00.168785+0000","last_clean":"2024-09-12T01:11:00.168785+0000","last_became_active":"2024-09-12T00:12:36.030644+0000","last_became_peered":"2024-09-12T00:12:36.030644+0000","last_unstale":"2024-09-12T01:11:00.168785+0000","last_undegraded":"2024-09-12T01:11:00.168785+0000","last_fullsized":"2024-09-12T01:11:00.168785+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:31.856368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568642,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":738,"num_read_kb":123120,"num_write":1245,"num_write_kb":49104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.048638+0000","last_change":"2024-09-12T00:12:24.720016+0000","last_active":"2024-09-12T01:08:45.048638+0000","last_peered":"2024-09-12T01:08:45.048638+0000","last_clean":"2024-09-12T01:08:45.048638+0000","last_became_active":"2024-09-12T00:12:22.875444+0000","last_became_peered":"2024-09-12T00:12:22.875444+0000","last_unstale":"2024-09-12T01:08:45.048638+0000","last_undegraded":"2024-09-12T01:08:45.048638+0000","last_fullsized":"2024-09-12T01:08:45.048638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:21.695522+0000","last_clean_scrub_stamp":"2024-09-12T00:12:21.695522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:01.561555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001017387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'5","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.851756+0000","last_change":"2024-09-12T00:12:40.031664+0000","last_active":"2024-09-12T01:10:57.851756+0000","last_peered":"2024-09-12T01:10:57.851756+0000","last_clean":"2024-09-12T01:10:57.851756+0000","last_became_active":"2024-09-12T00:12:40.031382+0000","last_became_peered":"2024-09-12T00:12:40.031382+0000","last_unstale":"2024-09-12T01:10:57.851756+0000","last_undegraded":"2024-09-12T01:10:57.851756+0000","last_fullsized":"2024-09-12T01:10:57.851756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:43.398397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'730","reported_seq":1456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.754434+0000","last_change":"2024-09-12T00:12:42.043628+0000","last_active":"2024-09-12T01:10:59.754434+0000","last_peered":"2024-09-12T01:10:59.754434+0000","last_clean":"2024-09-12T01:10:59.754434+0000","last_became_active":"2024-09-12T00:12:42.043328+0000","last_became_peered":"2024-09-12T00:12:42.043328+0000","last_unstale":"2024-09-12T01:10:59.754434+0000","last_undegraded":"2024-09-12T01:10:59.754434+0000","last_fullsized":"2024-09-12T01:10:59.754434+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":700,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147946,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1306,"num_read_kb":3069,"num_write":1058,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.056433+0000","last_change":"2024-09-12T00:12:44.062248+0000","last_active":"2024-09-12T01:09:00.056433+0000","last_peered":"2024-09-12T01:09:00.056433+0000","last_clean":"2024-09-12T01:09:00.056433+0000","last_became_active":"2024-09-12T00:12:44.061206+0000","last_became_peered":"2024-09-12T00:12:44.061206+0000","last_unstale":"2024-09-12T01:09:00.056433+0000","last_undegraded":"2024-09-12T01:09:00.056433+0000","last_fullsized":"2024-09-12T01:09:00.056433+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:28.838993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'95","reported_seq":588,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.128446+0000","last_change":"2024-09-12T00:12:46.058756+0000","last_active":"2024-09-12T01:09:23.128446+0000","last_peered":"2024-09-12T01:09:23.128446+0000","last_clean":"2024-09-12T01:09:23.128446+0000","last_became_active":"2024-09-12T00:12:46.058465+0000","last_became_peered":"2024-09-12T00:12:46.058465+0000","last_unstale":"2024-09-12T01:09:23.128446+0000","last_undegraded":"2024-09-12T01:09:23.128446+0000","last_fullsized":"2024-09-12T01:09:23.128446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:59.069997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":101,"num_write":234,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'139","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.693672+0000","last_change":"2024-09-12T00:12:46.063719+0000","last_active":"2024-09-12T01:10:31.693672+0000","last_peered":"2024-09-12T01:10:31.693672+0000","last_clean":"2024-09-12T01:10:31.693672+0000","last_became_active":"2024-09-12T00:12:46.063423+0000","last_became_peered":"2024-09-12T00:12:46.063423+0000","last_unstale":"2024-09-12T01:10:31.693672+0000","last_undegraded":"2024-09-12T01:10:31.693672+0000","last_fullsized":"2024-09-12T01:10:31.693672+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:35.174197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":252,"num_write":335,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'151","reported_seq":720,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:41.717924+0000","last_change":"2024-09-12T00:12:38.041953+0000","last_active":"2024-09-12T01:08:41.717924+0000","last_peered":"2024-09-12T01:08:41.717924+0000","last_clean":"2024-09-12T01:08:41.717924+0000","last_became_active":"2024-09-12T00:12:38.041665+0000","last_became_peered":"2024-09-12T00:12:38.041665+0000","last_unstale":"2024-09-12T01:08:41.717924+0000","last_undegraded":"2024-09-12T01:08:41.717924+0000","last_fullsized":"2024-09-12T01:08:41.717924+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:35.209960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":652,"num_read_kb":531,"num_write":244,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'302","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.162617+0000","last_change":"2024-09-12T00:13:07.152881+0000","last_active":"2024-09-12T01:11:00.162617+0000","last_peered":"2024-09-12T01:11:00.162617+0000","last_clean":"2024-09-12T01:11:00.162617+0000","last_became_active":"2024-09-12T00:13:07.152470+0000","last_became_peered":"2024-09-12T00:13:07.152470+0000","last_unstale":"2024-09-12T01:11:00.162617+0000","last_undegraded":"2024-09-12T01:11:00.162617+0000","last_fullsized":"2024-09-12T01:11:00.162617+0000","mapping_epoch":40,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:42.910204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5098973,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":439,"num_read_kb":19566,"num_write":916,"num_write_kb":20485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.170293+0000","last_change":"2024-09-12T00:12:40.038938+0000","last_active":"2024-09-12T01:08:40.170293+0000","last_peered":"2024-09-12T01:08:40.170293+0000","last_clean":"2024-09-12T01:08:40.170293+0000","last_became_active":"2024-09-12T00:12:40.038618+0000","last_became_peered":"2024-09-12T00:12:40.038618+0000","last_unstale":"2024-09-12T01:08:40.170293+0000","last_undegraded":"2024-09-12T01:08:40.170293+0000","last_fullsized":"2024-09-12T01:08:40.170293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:06.465719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'279","reported_seq":857,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.094930+0000","last_change":"2024-09-12T00:12:42.050190+0000","last_active":"2024-09-12T01:11:00.094930+0000","last_peered":"2024-09-12T01:11:00.094930+0000","last_clean":"2024-09-12T01:11:00.094930+0000","last_became_active":"2024-09-12T00:12:42.049685+0000","last_became_peered":"2024-09-12T00:12:42.049685+0000","last_unstale":"2024-09-12T01:11:00.094930+0000","last_undegraded":"2024-09-12T01:11:00.094930+0000","last_fullsized":"2024-09-12T01:11:00.094930+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:57.050916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49303,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":1021,"num_write":368,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.053983+0000","last_change":"2024-09-12T00:12:44.062762+0000","last_active":"2024-09-12T01:08:45.053983+0000","last_peered":"2024-09-12T01:08:45.053983+0000","last_clean":"2024-09-12T01:08:45.053983+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:08:45.053983+0000","last_undegraded":"2024-09-12T01:08:45.053983+0000","last_fullsized":"2024-09-12T01:08:45.053983+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:30.852996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.431103+0000","last_change":"2024-09-12T00:12:46.064377+0000","last_active":"2024-09-12T01:09:23.431103+0000","last_peered":"2024-09-12T01:09:23.431103+0000","last_clean":"2024-09-12T01:09:23.431103+0000","last_became_active":"2024-09-12T00:12:46.064080+0000","last_became_peered":"2024-09-12T00:12:46.064080+0000","last_unstale":"2024-09-12T01:09:23.431103+0000","last_undegraded":"2024-09-12T01:09:23.431103+0000","last_fullsized":"2024-09-12T01:09:23.431103+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:28.289493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":189,"num_write":302,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'148","reported_seq":740,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.053154+0000","last_change":"2024-09-12T00:12:38.045256+0000","last_active":"2024-09-12T01:08:40.053154+0000","last_peered":"2024-09-12T01:08:40.053154+0000","last_clean":"2024-09-12T01:08:40.053154+0000","last_became_active":"2024-09-12T00:12:38.044990+0000","last_became_peered":"2024-09-12T00:12:38.044990+0000","last_unstale":"2024-09-12T01:08:40.053154+0000","last_undegraded":"2024-09-12T01:08:40.053154+0000","last_fullsized":"2024-09-12T01:08:40.053154+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:23.380297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":701,"num_read_kb":570,"num_write":228,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'340","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.162479+0000","last_change":"2024-09-12T00:12:36.036464+0000","last_active":"2024-09-12T01:11:00.162479+0000","last_peered":"2024-09-12T01:11:00.162479+0000","last_clean":"2024-09-12T01:11:00.162479+0000","last_became_active":"2024-09-12T00:12:36.034816+0000","last_became_peered":"2024-09-12T00:12:36.034816+0000","last_unstale":"2024-09-12T01:11:00.162479+0000","last_undegraded":"2024-09-12T01:11:00.162479+0000","last_fullsized":"2024-09-12T01:11:00.162479+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:54.535251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":1836,"num_write":1158,"num_write_kb":16367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.053198+0000","last_change":"2024-09-12T00:12:40.042449+0000","last_active":"2024-09-12T01:08:40.053198+0000","last_peered":"2024-09-12T01:08:40.053198+0000","last_clean":"2024-09-12T01:08:40.053198+0000","last_became_active":"2024-09-12T00:12:40.042104+0000","last_became_peered":"2024-09-12T00:12:40.042104+0000","last_unstale":"2024-09-12T01:08:40.053198+0000","last_undegraded":"2024-09-12T01:08:40.053198+0000","last_fullsized":"2024-09-12T01:08:40.053198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:33.704187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'55","reported_seq":558,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.054011+0000","last_change":"2024-09-12T00:12:42.043918+0000","last_active":"2024-09-12T01:08:45.054011+0000","last_peered":"2024-09-12T01:08:45.054011+0000","last_clean":"2024-09-12T01:08:45.054011+0000","last_became_active":"2024-09-12T00:12:42.043599+0000","last_became_peered":"2024-09-12T00:12:42.043599+0000","last_unstale":"2024-09-12T01:08:45.054011+0000","last_undegraded":"2024-09-12T01:08:45.054011+0000","last_fullsized":"2024-09-12T01:08:45.054011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:06.844583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.141693+0000","last_change":"2024-09-12T00:12:44.054488+0000","last_active":"2024-09-12T01:08:45.141693+0000","last_peered":"2024-09-12T01:08:45.141693+0000","last_clean":"2024-09-12T01:08:45.141693+0000","last_became_active":"2024-09-12T00:12:44.054145+0000","last_became_peered":"2024-09-12T00:12:44.054145+0000","last_unstale":"2024-09-12T01:08:45.141693+0000","last_undegraded":"2024-09-12T01:08:45.141693+0000","last_fullsized":"2024-09-12T01:08:45.141693+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'200","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.568625+0000","last_change":"2024-09-12T00:12:46.059839+0000","last_active":"2024-09-12T01:09:22.568625+0000","last_peered":"2024-09-12T01:09:22.568625+0000","last_clean":"2024-09-12T01:09:22.568625+0000","last_became_active":"2024-09-12T00:12:46.059520+0000","last_became_peered":"2024-09-12T00:12:46.059520+0000","last_unstale":"2024-09-12T01:09:22.568625+0000","last_undegraded":"2024-09-12T01:09:22.568625+0000","last_fullsized":"2024-09-12T01:09:22.568625+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:17.663006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":406,"num_read_kb":365,"num_write":468,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'124","reported_seq":723,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.811409+0000","last_change":"2024-09-12T00:12:38.041224+0000","last_active":"2024-09-12T01:10:31.811409+0000","last_peered":"2024-09-12T01:10:31.811409+0000","last_clean":"2024-09-12T01:10:31.811409+0000","last_became_active":"2024-09-12T00:12:38.040948+0000","last_became_peered":"2024-09-12T00:12:38.040948+0000","last_unstale":"2024-09-12T01:10:31.811409+0000","last_undegraded":"2024-09-12T01:10:31.811409+0000","last_fullsized":"2024-09-12T01:10:31.811409+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:21.931055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":483,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'334","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.185308+0000","last_change":"2024-09-12T00:12:36.040361+0000","last_active":"2024-09-12T01:11:00.185308+0000","last_peered":"2024-09-12T01:11:00.185308+0000","last_clean":"2024-09-12T01:11:00.185308+0000","last_became_active":"2024-09-12T00:12:36.038823+0000","last_became_peered":"2024-09-12T00:12:36.038823+0000","last_unstale":"2024-09-12T01:11:00.185308+0000","last_undegraded":"2024-09-12T01:11:00.185308+0000","last_fullsized":"2024-09-12T01:11:00.185308+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:53.004387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364565,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":548,"num_read_kb":31576,"num_write":1085,"num_write_kb":24420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.141149+0000","last_change":"2024-09-12T00:12:40.030750+0000","last_active":"2024-09-12T01:08:40.141149+0000","last_peered":"2024-09-12T01:08:40.141149+0000","last_clean":"2024-09-12T01:08:40.141149+0000","last_became_active":"2024-09-12T00:12:40.030447+0000","last_became_peered":"2024-09-12T00:12:40.030447+0000","last_unstale":"2024-09-12T01:08:40.141149+0000","last_undegraded":"2024-09-12T01:08:40.141149+0000","last_fullsized":"2024-09-12T01:08:40.141149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:19.640921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'329","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.460039+0000","last_change":"2024-09-12T00:12:42.051159+0000","last_active":"2024-09-12T01:10:59.460039+0000","last_peered":"2024-09-12T01:10:59.460039+0000","last_clean":"2024-09-12T01:10:59.460039+0000","last_became_active":"2024-09-12T00:12:42.050885+0000","last_became_peered":"2024-09-12T00:12:42.050885+0000","last_unstale":"2024-09-12T01:10:59.460039+0000","last_undegraded":"2024-09-12T01:10:59.460039+0000","last_fullsized":"2024-09-12T01:10:59.460039+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:07.994436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52758,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":1216,"num_write":438,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:25.226242+0000","last_change":"2024-09-12T00:12:44.056404+0000","last_active":"2024-09-12T01:06:25.226242+0000","last_peered":"2024-09-12T01:06:25.226242+0000","last_clean":"2024-09-12T01:06:25.226242+0000","last_became_active":"2024-09-12T00:12:44.056032+0000","last_became_peered":"2024-09-12T00:12:44.056032+0000","last_unstale":"2024-09-12T01:06:25.226242+0000","last_undegraded":"2024-09-12T01:06:25.226242+0000","last_fullsized":"2024-09-12T01:06:25.226242+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:26.625201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'121","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.354255+0000","last_change":"2024-09-12T00:12:46.063983+0000","last_active":"2024-09-12T01:08:28.354255+0000","last_peered":"2024-09-12T01:08:28.354255+0000","last_clean":"2024-09-12T01:08:28.354255+0000","last_became_active":"2024-09-12T00:12:46.063700+0000","last_became_peered":"2024-09-12T00:12:46.063700+0000","last_unstale":"2024-09-12T01:08:28.354255+0000","last_undegraded":"2024-09-12T01:08:28.354255+0000","last_fullsized":"2024-09-12T01:08:28.354255+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:48.139495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'4185","reported_seq":4810,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.053015+0000","last_change":"2024-09-12T00:12:38.042946+0000","last_active":"2024-09-12T01:08:40.053015+0000","last_peered":"2024-09-12T01:08:40.053015+0000","last_clean":"2024-09-12T01:08:40.053015+0000","last_became_active":"2024-09-12T00:12:38.042680+0000","last_became_peered":"2024-09-12T00:12:38.042680+0000","last_unstale":"2024-09-12T01:08:40.053015+0000","last_undegraded":"2024-09-12T01:08:40.053015+0000","last_fullsized":"2024-09-12T01:08:40.053015+0000","mapping_epoch":29,"log_start":"263'4100","ondisk_log_start":"263'4100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":3000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:46.485325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16870,"num_read_kb":14146,"num_write":6296,"num_write_kb":3134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'370","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.145218+0000","last_change":"2024-09-12T00:12:36.034607+0000","last_active":"2024-09-12T01:11:00.145218+0000","last_peered":"2024-09-12T01:11:00.145218+0000","last_clean":"2024-09-12T01:11:00.145218+0000","last_became_active":"2024-09-12T00:12:36.034292+0000","last_became_peered":"2024-09-12T00:12:36.034292+0000","last_unstale":"2024-09-12T01:11:00.145218+0000","last_undegraded":"2024-09-12T01:11:00.145218+0000","last_fullsized":"2024-09-12T01:11:00.145218+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:00.939504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":3622,"num_write":1273,"num_write_kb":13483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.047994+0000","last_change":"2024-09-12T00:12:40.038541+0000","last_active":"2024-09-12T01:08:40.047994+0000","last_peered":"2024-09-12T01:08:40.047994+0000","last_clean":"2024-09-12T01:08:40.047994+0000","last_became_active":"2024-09-12T00:12:40.038192+0000","last_became_peered":"2024-09-12T00:12:40.038192+0000","last_unstale":"2024-09-12T01:08:40.047994+0000","last_undegraded":"2024-09-12T01:08:40.047994+0000","last_fullsized":"2024-09-12T01:08:40.047994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:28.217627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'257","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.285081+0000","last_change":"2024-09-12T00:12:42.046891+0000","last_active":"2024-09-12T01:10:59.285081+0000","last_peered":"2024-09-12T01:10:59.285081+0000","last_clean":"2024-09-12T01:10:59.285081+0000","last_became_active":"2024-09-12T00:12:42.046589+0000","last_became_peered":"2024-09-12T00:12:42.046589+0000","last_unstale":"2024-09-12T01:10:59.285081+0000","last_undegraded":"2024-09-12T01:10:59.285081+0000","last_fullsized":"2024-09-12T01:10:59.285081+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53508,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":1009,"num_write":352,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.054065+0000","last_change":"2024-09-12T00:12:44.057887+0000","last_active":"2024-09-12T01:08:45.054065+0000","last_peered":"2024-09-12T01:08:45.054065+0000","last_clean":"2024-09-12T01:08:45.054065+0000","last_became_active":"2024-09-12T00:12:44.057606+0000","last_became_peered":"2024-09-12T00:12:44.057606+0000","last_unstale":"2024-09-12T01:08:45.054065+0000","last_undegraded":"2024-09-12T01:08:45.054065+0000","last_fullsized":"2024-09-12T01:08:45.054065+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:25.314359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'180","reported_seq":734,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.049840+0000","last_change":"2024-09-12T00:12:38.047826+0000","last_active":"2024-09-12T01:08:55.049840+0000","last_peered":"2024-09-12T01:08:55.049840+0000","last_clean":"2024-09-12T01:08:55.049840+0000","last_became_active":"2024-09-12T00:12:38.047545+0000","last_became_peered":"2024-09-12T00:12:38.047545+0000","last_unstale":"2024-09-12T01:08:55.049840+0000","last_undegraded":"2024-09-12T01:08:55.049840+0000","last_fullsized":"2024-09-12T01:08:55.049840+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:27.324611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":815,"num_read_kb":702,"num_write":306,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'317","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.176527+0000","last_change":"2024-09-12T00:12:36.043322+0000","last_active":"2024-09-12T01:11:00.176527+0000","last_peered":"2024-09-12T01:11:00.176527+0000","last_clean":"2024-09-12T01:11:00.176527+0000","last_became_active":"2024-09-12T00:12:36.042983+0000","last_became_peered":"2024-09-12T00:12:36.042983+0000","last_unstale":"2024-09-12T01:11:00.176527+0000","last_undegraded":"2024-09-12T01:11:00.176527+0000","last_fullsized":"2024-09-12T01:11:00.176527+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:32.011867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":13747,"num_write":1048,"num_write_kb":22365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.171772+0000","last_change":"2024-09-12T00:12:40.039966+0000","last_active":"2024-09-12T01:08:50.171772+0000","last_peered":"2024-09-12T01:08:50.171772+0000","last_clean":"2024-09-12T01:08:50.171772+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:08:50.171772+0000","last_undegraded":"2024-09-12T01:08:50.171772+0000","last_fullsized":"2024-09-12T01:08:50.171772+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:12.418930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'498","reported_seq":1129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.229789+0000","last_change":"2024-09-12T00:12:42.050774+0000","last_active":"2024-09-12T01:10:59.229789+0000","last_peered":"2024-09-12T01:10:59.229789+0000","last_clean":"2024-09-12T01:10:59.229789+0000","last_became_active":"2024-09-12T00:12:42.050479+0000","last_became_peered":"2024-09-12T00:12:42.050479+0000","last_unstale":"2024-09-12T01:10:59.229789+0000","last_undegraded":"2024-09-12T01:10:59.229789+0000","last_fullsized":"2024-09-12T01:10:59.229789+0000","mapping_epoch":33,"log_start":"263'400","ondisk_log_start":"263'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:54.813408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104580,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":898,"num_read_kb":2161,"num_write":774,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.134850+0000","last_change":"2024-09-12T00:12:44.061802+0000","last_active":"2024-09-12T01:07:45.134850+0000","last_peered":"2024-09-12T01:07:45.134850+0000","last_clean":"2024-09-12T01:07:45.134850+0000","last_became_active":"2024-09-12T00:12:44.061554+0000","last_became_peered":"2024-09-12T00:12:44.061554+0000","last_unstale":"2024-09-12T01:07:45.134850+0000","last_undegraded":"2024-09-12T01:07:45.134850+0000","last_fullsized":"2024-09-12T01:07:45.134850+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:41.354262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'159","reported_seq":657,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.539630+0000","last_change":"2024-09-12T00:12:46.062051+0000","last_active":"2024-09-12T01:09:22.539630+0000","last_peered":"2024-09-12T01:09:22.539630+0000","last_clean":"2024-09-12T01:09:22.539630+0000","last_became_active":"2024-09-12T00:12:46.061727+0000","last_became_peered":"2024-09-12T00:12:46.061727+0000","last_unstale":"2024-09-12T01:09:22.539630+0000","last_undegraded":"2024-09-12T01:09:22.539630+0000","last_fullsized":"2024-09-12T01:09:22.539630+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.660864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":216,"num_write":366,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'66","reported_seq":661,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.302716+0000","last_change":"2024-09-12T00:12:38.040768+0000","last_active":"2024-09-12T01:09:23.302716+0000","last_peered":"2024-09-12T01:09:23.302716+0000","last_clean":"2024-09-12T01:09:23.302716+0000","last_became_active":"2024-09-12T00:12:38.040282+0000","last_became_peered":"2024-09-12T00:12:38.040282+0000","last_unstale":"2024-09-12T01:09:23.302716+0000","last_undegraded":"2024-09-12T01:09:23.302716+0000","last_fullsized":"2024-09-12T01:09:23.302716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:50.542495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":276,"num_write":85,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'343","reported_seq":1044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.168566+0000","last_change":"2024-09-12T00:12:36.032117+0000","last_active":"2024-09-12T01:11:00.168566+0000","last_peered":"2024-09-12T01:11:00.168566+0000","last_clean":"2024-09-12T01:11:00.168566+0000","last_became_active":"2024-09-12T00:12:36.031081+0000","last_became_peered":"2024-09-12T00:12:36.031081+0000","last_unstale":"2024-09-12T01:11:00.168566+0000","last_undegraded":"2024-09-12T01:11:00.168566+0000","last_fullsized":"2024-09-12T01:11:00.168566+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:31.633755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069231,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":617,"num_read_kb":88557,"num_write":1073,"num_write_kb":46090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.142866+0000","last_change":"2024-09-12T00:12:40.037157+0000","last_active":"2024-09-12T01:08:55.142866+0000","last_peered":"2024-09-12T01:08:55.142866+0000","last_clean":"2024-09-12T01:08:55.142866+0000","last_became_active":"2024-09-12T00:12:40.036842+0000","last_became_peered":"2024-09-12T00:12:40.036842+0000","last_unstale":"2024-09-12T01:08:55.142866+0000","last_undegraded":"2024-09-12T01:08:55.142866+0000","last_fullsized":"2024-09-12T01:08:55.142866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:07.662805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'299","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.334820+0000","last_change":"2024-09-12T00:12:42.044141+0000","last_active":"2024-09-12T01:10:59.334820+0000","last_peered":"2024-09-12T01:10:59.334820+0000","last_clean":"2024-09-12T01:10:59.334820+0000","last_became_active":"2024-09-12T00:12:42.043681+0000","last_became_peered":"2024-09-12T00:12:42.043681+0000","last_unstale":"2024-09-12T01:10:59.334820+0000","last_undegraded":"2024-09-12T01:10:59.334820+0000","last_fullsized":"2024-09-12T01:10:59.334820+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:57.312003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58226,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":1067,"num_write":414,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042934+0000","last_change":"2024-09-12T00:12:44.058909+0000","last_active":"2024-09-12T01:07:48.042934+0000","last_peered":"2024-09-12T01:07:48.042934+0000","last_clean":"2024-09-12T01:07:48.042934+0000","last_became_active":"2024-09-12T00:12:44.058542+0000","last_became_peered":"2024-09-12T00:12:44.058542+0000","last_unstale":"2024-09-12T01:07:48.042934+0000","last_undegraded":"2024-09-12T01:07:48.042934+0000","last_fullsized":"2024-09-12T01:07:48.042934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:44.072219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'190","reported_seq":717,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:30.032970+0000","last_change":"2024-09-12T00:12:46.063225+0000","last_active":"2024-09-12T01:06:30.032970+0000","last_peered":"2024-09-12T01:06:30.032970+0000","last_clean":"2024-09-12T01:06:30.032970+0000","last_became_active":"2024-09-12T00:12:46.062957+0000","last_became_peered":"2024-09-12T00:12:46.062957+0000","last_unstale":"2024-09-12T01:06:30.032970+0000","last_undegraded":"2024-09-12T01:06:30.032970+0000","last_fullsized":"2024-09-12T01:06:30.032970+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:23.650377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":323,"num_read_kb":295,"num_write":565,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'204","reported_seq":789,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043832+0000","last_change":"2024-09-12T00:12:38.046033+0000","last_active":"2024-09-12T01:07:40.043832+0000","last_peered":"2024-09-12T01:07:40.043832+0000","last_clean":"2024-09-12T01:07:40.043832+0000","last_became_active":"2024-09-12T00:12:38.045576+0000","last_became_peered":"2024-09-12T00:12:38.045576+0000","last_unstale":"2024-09-12T01:07:40.043832+0000","last_undegraded":"2024-09-12T01:07:40.043832+0000","last_fullsized":"2024-09-12T01:07:40.043832+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:34.974243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":691,"num_write":313,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'353","reported_seq":1037,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.152808+0000","last_change":"2024-09-12T00:12:36.036793+0000","last_active":"2024-09-12T01:11:00.152808+0000","last_peered":"2024-09-12T01:11:00.152808+0000","last_clean":"2024-09-12T01:11:00.152808+0000","last_became_active":"2024-09-12T00:12:36.036446+0000","last_became_peered":"2024-09-12T00:12:36.036446+0000","last_unstale":"2024-09-12T01:11:00.152808+0000","last_undegraded":"2024-09-12T01:11:00.152808+0000","last_fullsized":"2024-09-12T01:11:00.152808+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:19.859949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434692,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":621,"num_read_kb":64541,"num_write":1186,"num_write_kb":11770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134208+0000","last_change":"2024-09-12T00:12:40.030166+0000","last_active":"2024-09-12T01:07:40.134208+0000","last_peered":"2024-09-12T01:07:40.134208+0000","last_clean":"2024-09-12T01:07:40.134208+0000","last_became_active":"2024-09-12T00:12:40.029908+0000","last_became_peered":"2024-09-12T00:12:40.029908+0000","last_unstale":"2024-09-12T01:07:40.134208+0000","last_undegraded":"2024-09-12T01:07:40.134208+0000","last_fullsized":"2024-09-12T01:07:40.134208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:24.945019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'279","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.235297+0000","last_change":"2024-09-12T00:12:42.050883+0000","last_active":"2024-09-12T01:10:58.235297+0000","last_peered":"2024-09-12T01:10:58.235297+0000","last_clean":"2024-09-12T01:10:58.235297+0000","last_became_active":"2024-09-12T00:12:42.050599+0000","last_became_peered":"2024-09-12T00:12:42.050599+0000","last_unstale":"2024-09-12T01:10:58.235297+0000","last_undegraded":"2024-09-12T01:10:58.235297+0000","last_fullsized":"2024-09-12T01:10:58.235297+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:27.986140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50970,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":947,"num_write":354,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.055691+0000","last_change":"2024-09-12T00:12:44.062691+0000","last_active":"2024-09-12T01:08:55.055691+0000","last_peered":"2024-09-12T01:08:55.055691+0000","last_clean":"2024-09-12T01:08:55.055691+0000","last_became_active":"2024-09-12T00:12:44.062419+0000","last_became_peered":"2024-09-12T00:12:44.062419+0000","last_unstale":"2024-09-12T01:08:55.055691+0000","last_undegraded":"2024-09-12T01:08:55.055691+0000","last_fullsized":"2024-09-12T01:08:55.055691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.349610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'183","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.002642+0000","last_change":"2024-09-12T00:12:46.067271+0000","last_active":"2024-09-12T01:10:33.002642+0000","last_peered":"2024-09-12T01:10:33.002642+0000","last_clean":"2024-09-12T01:10:33.002642+0000","last_became_active":"2024-09-12T00:12:46.066977+0000","last_became_peered":"2024-09-12T00:12:46.066977+0000","last_unstale":"2024-09-12T01:10:33.002642+0000","last_undegraded":"2024-09-12T01:10:33.002642+0000","last_fullsized":"2024-09-12T01:10:33.002642+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:28.610163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":141,"num_write":422,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'58","reported_seq":591,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043831+0000","last_change":"2024-09-12T00:12:38.044154+0000","last_active":"2024-09-12T01:07:40.043831+0000","last_peered":"2024-09-12T01:07:40.043831+0000","last_clean":"2024-09-12T01:07:40.043831+0000","last_became_active":"2024-09-12T00:12:38.043886+0000","last_became_peered":"2024-09-12T00:12:38.043886+0000","last_unstale":"2024-09-12T01:07:40.043831+0000","last_undegraded":"2024-09-12T01:07:40.043831+0000","last_fullsized":"2024-09-12T01:07:40.043831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:23.214032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":197,"num_write":99,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'362","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.197401+0000","last_change":"2024-09-12T00:12:36.031024+0000","last_active":"2024-09-12T01:11:00.197401+0000","last_peered":"2024-09-12T01:11:00.197401+0000","last_clean":"2024-09-12T01:11:00.197401+0000","last_became_active":"2024-09-12T00:12:36.030663+0000","last_became_peered":"2024-09-12T00:12:36.030663+0000","last_unstale":"2024-09-12T01:11:00.197401+0000","last_undegraded":"2024-09-12T01:11:00.197401+0000","last_fullsized":"2024-09-12T01:11:00.197401+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:04.337764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568456,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":490,"num_read_kb":3753,"num_write":1107,"num_write_kb":36132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043857+0000","last_change":"2024-09-12T00:12:40.040334+0000","last_active":"2024-09-12T01:07:40.043857+0000","last_peered":"2024-09-12T01:07:40.043857+0000","last_clean":"2024-09-12T01:07:40.043857+0000","last_became_active":"2024-09-12T00:12:40.040095+0000","last_became_peered":"2024-09-12T00:12:40.040095+0000","last_unstale":"2024-09-12T01:07:40.043857+0000","last_undegraded":"2024-09-12T01:07:40.043857+0000","last_fullsized":"2024-09-12T01:07:40.043857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:14.746788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'104","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.050614+0000","last_change":"2024-09-12T00:12:42.043827+0000","last_active":"2024-09-12T01:09:00.050614+0000","last_peered":"2024-09-12T01:09:00.050614+0000","last_clean":"2024-09-12T01:09:00.050614+0000","last_became_active":"2024-09-12T00:12:42.043492+0000","last_became_peered":"2024-09-12T00:12:42.043492+0000","last_unstale":"2024-09-12T01:09:00.050614+0000","last_undegraded":"2024-09-12T01:09:00.050614+0000","last_fullsized":"2024-09-12T01:09:00.050614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:42.505398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":110,"num_read_kb":100,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'767","reported_seq":2177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.228238+0000","last_change":"2024-09-12T00:12:44.054520+0000","last_active":"2024-09-12T01:11:00.228238+0000","last_peered":"2024-09-12T01:11:00.228238+0000","last_clean":"2024-09-12T01:11:00.228238+0000","last_became_active":"2024-09-12T00:12:44.054237+0000","last_became_peered":"2024-09-12T00:12:44.054237+0000","last_unstale":"2024-09-12T01:11:00.228238+0000","last_undegraded":"2024-09-12T01:11:00.228238+0000","last_fullsized":"2024-09-12T01:11:00.228238+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'121","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.977988+0000","last_change":"2024-09-12T00:12:46.061987+0000","last_active":"2024-09-12T01:08:19.977988+0000","last_peered":"2024-09-12T01:08:19.977988+0000","last_clean":"2024-09-12T01:08:19.977988+0000","last_became_active":"2024-09-12T00:12:46.061673+0000","last_became_peered":"2024-09-12T00:12:46.061673+0000","last_unstale":"2024-09-12T01:08:19.977988+0000","last_undegraded":"2024-09-12T01:08:19.977988+0000","last_fullsized":"2024-09-12T01:08:19.977988+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:08.970829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'432","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134186+0000","last_change":"2024-09-12T00:12:38.029773+0000","last_active":"2024-09-12T01:07:40.134186+0000","last_peered":"2024-09-12T01:07:40.134186+0000","last_clean":"2024-09-12T01:07:40.134186+0000","last_became_active":"2024-09-12T00:12:38.029483+0000","last_became_peered":"2024-09-12T00:12:38.029483+0000","last_unstale":"2024-09-12T01:07:40.134186+0000","last_undegraded":"2024-09-12T01:07:40.134186+0000","last_fullsized":"2024-09-12T01:07:40.134186+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:54.184567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1848,"num_read_kb":1460,"num_write":651,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'351","reported_seq":958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.190669+0000","last_change":"2024-09-12T00:12:36.034572+0000","last_active":"2024-09-12T01:11:00.190669+0000","last_peered":"2024-09-12T01:11:00.190669+0000","last_clean":"2024-09-12T01:11:00.190669+0000","last_became_active":"2024-09-12T00:12:36.034259+0000","last_became_peered":"2024-09-12T00:12:36.034259+0000","last_unstale":"2024-09-12T01:11:00.190669+0000","last_undegraded":"2024-09-12T01:11:00.190669+0000","last_fullsized":"2024-09-12T01:11:00.190669+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:05.093712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":12694,"num_write":1067,"num_write_kb":34924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.234299+0000","last_change":"2024-09-12T00:12:40.034568+0000","last_active":"2024-09-12T01:07:40.234299+0000","last_peered":"2024-09-12T01:07:40.234299+0000","last_clean":"2024-09-12T01:07:40.234299+0000","last_became_active":"2024-09-12T00:12:40.034301+0000","last_became_peered":"2024-09-12T00:12:40.034301+0000","last_unstale":"2024-09-12T01:07:40.234299+0000","last_undegraded":"2024-09-12T01:07:40.234299+0000","last_fullsized":"2024-09-12T01:07:40.234299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:22.089148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'367","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.597558+0000","last_change":"2024-09-12T00:12:42.044477+0000","last_active":"2024-09-12T01:10:58.597558+0000","last_peered":"2024-09-12T01:10:58.597558+0000","last_clean":"2024-09-12T01:10:58.597558+0000","last_became_active":"2024-09-12T00:12:42.044154+0000","last_became_peered":"2024-09-12T00:12:42.044154+0000","last_unstale":"2024-09-12T01:10:58.597558+0000","last_undegraded":"2024-09-12T01:10:58.597558+0000","last_fullsized":"2024-09-12T01:10:58.597558+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:59.538243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51621,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":561,"num_read_kb":1137,"num_write":454,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.049637+0000","last_change":"2024-09-12T00:12:44.060009+0000","last_active":"2024-09-12T01:08:20.049637+0000","last_peered":"2024-09-12T01:08:20.049637+0000","last_clean":"2024-09-12T01:08:20.049637+0000","last_became_active":"2024-09-12T00:12:44.059671+0000","last_became_peered":"2024-09-12T00:12:44.059671+0000","last_unstale":"2024-09-12T01:08:20.049637+0000","last_undegraded":"2024-09-12T01:08:20.049637+0000","last_fullsized":"2024-09-12T01:08:20.049637+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:58.980993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'125","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.596906+0000","last_change":"2024-09-12T00:12:46.067043+0000","last_active":"2024-09-12T01:09:20.596906+0000","last_peered":"2024-09-12T01:09:20.596906+0000","last_clean":"2024-09-12T01:09:20.596906+0000","last_became_active":"2024-09-12T00:12:46.066777+0000","last_became_peered":"2024-09-12T00:12:46.066777+0000","last_unstale":"2024-09-12T01:09:20.596906+0000","last_undegraded":"2024-09-12T01:09:20.596906+0000","last_fullsized":"2024-09-12T01:09:20.596906+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:01.876836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":239,"num_read_kb":208,"num_write":345,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'510","reported_seq":1326,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134147+0000","last_change":"2024-09-12T00:12:38.040248+0000","last_active":"2024-09-12T01:07:40.134147+0000","last_peered":"2024-09-12T01:07:40.134147+0000","last_clean":"2024-09-12T01:07:40.134147+0000","last_became_active":"2024-09-12T00:12:38.039996+0000","last_became_peered":"2024-09-12T00:12:38.039996+0000","last_unstale":"2024-09-12T01:07:40.134147+0000","last_undegraded":"2024-09-12T01:07:40.134147+0000","last_fullsized":"2024-09-12T01:07:40.134147+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:17.482426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2706,"num_read_kb":2334,"num_write":934,"num_write_kb":583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'299","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.173464+0000","last_change":"2024-09-12T00:12:36.030460+0000","last_active":"2024-09-12T01:11:00.173464+0000","last_peered":"2024-09-12T01:11:00.173464+0000","last_clean":"2024-09-12T01:11:00.173464+0000","last_became_active":"2024-09-12T00:12:36.029998+0000","last_became_peered":"2024-09-12T00:12:36.029998+0000","last_unstale":"2024-09-12T01:11:00.173464+0000","last_undegraded":"2024-09-12T01:11:00.173464+0000","last_fullsized":"2024-09-12T01:11:00.173464+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:09.569791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":565,"num_read_kb":3980,"num_write":924,"num_write_kb":28798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.134195+0000","last_change":"2024-09-12T00:12:40.039109+0000","last_active":"2024-09-12T01:07:40.134195+0000","last_peered":"2024-09-12T01:07:40.134195+0000","last_clean":"2024-09-12T01:07:40.134195+0000","last_became_active":"2024-09-12T00:12:40.038037+0000","last_became_peered":"2024-09-12T00:12:40.038037+0000","last_unstale":"2024-09-12T01:07:40.134195+0000","last_undegraded":"2024-09-12T01:07:40.134195+0000","last_fullsized":"2024-09-12T01:07:40.134195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:11.329535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'284","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.667784+0000","last_change":"2024-09-12T00:12:42.047201+0000","last_active":"2024-09-12T01:10:58.667784+0000","last_peered":"2024-09-12T01:10:58.667784+0000","last_clean":"2024-09-12T01:10:58.667784+0000","last_became_active":"2024-09-12T00:12:42.046917+0000","last_became_peered":"2024-09-12T00:12:42.046917+0000","last_unstale":"2024-09-12T01:10:58.667784+0000","last_undegraded":"2024-09-12T01:10:58.667784+0000","last_fullsized":"2024-09-12T01:10:58.667784+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:26.130504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46808,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1160,"num_write":400,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.047451+0000","last_change":"2024-09-12T00:12:44.058423+0000","last_active":"2024-09-12T01:08:35.047451+0000","last_peered":"2024-09-12T01:08:35.047451+0000","last_clean":"2024-09-12T01:08:35.047451+0000","last_became_active":"2024-09-12T00:12:44.058006+0000","last_became_peered":"2024-09-12T00:12:44.058006+0000","last_unstale":"2024-09-12T01:08:35.047451+0000","last_undegraded":"2024-09-12T01:08:35.047451+0000","last_fullsized":"2024-09-12T01:08:35.047451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:01.738470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'117","reported_seq":622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.048235+0000","last_change":"2024-09-12T00:12:46.065323+0000","last_active":"2024-09-12T01:08:23.048235+0000","last_peered":"2024-09-12T01:08:23.048235+0000","last_clean":"2024-09-12T01:08:23.048235+0000","last_became_active":"2024-09-12T00:12:46.064988+0000","last_became_peered":"2024-09-12T00:12:46.064988+0000","last_unstale":"2024-09-12T01:08:23.048235+0000","last_undegraded":"2024-09-12T01:08:23.048235+0000","last_fullsized":"2024-09-12T01:08:23.048235+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:07.524788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":147,"num_write":261,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'320","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.050462+0000","last_change":"2024-09-12T00:12:38.042896+0000","last_active":"2024-09-12T01:08:25.050462+0000","last_peered":"2024-09-12T01:08:25.050462+0000","last_clean":"2024-09-12T01:08:25.050462+0000","last_became_active":"2024-09-12T00:12:38.042565+0000","last_became_peered":"2024-09-12T00:12:38.042565+0000","last_unstale":"2024-09-12T01:08:25.050462+0000","last_undegraded":"2024-09-12T01:08:25.050462+0000","last_fullsized":"2024-09-12T01:08:25.050462+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:20.595221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1481,"num_read_kb":1253,"num_write":527,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'359","reported_seq":996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.006373+0000","last_change":"2024-09-12T00:12:36.042891+0000","last_active":"2024-09-12T01:11:00.006373+0000","last_peered":"2024-09-12T01:11:00.006373+0000","last_clean":"2024-09-12T01:11:00.006373+0000","last_became_active":"2024-09-12T00:12:36.042198+0000","last_became_peered":"2024-09-12T00:12:36.042198+0000","last_unstale":"2024-09-12T01:11:00.006373+0000","last_undegraded":"2024-09-12T01:11:00.006373+0000","last_fullsized":"2024-09-12T01:11:00.006373+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:27.004848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":61060,"num_write":1123,"num_write_kb":53442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.237962+0000","last_change":"2024-09-12T00:12:40.032609+0000","last_active":"2024-09-12T01:08:15.237962+0000","last_peered":"2024-09-12T01:08:15.237962+0000","last_clean":"2024-09-12T01:08:15.237962+0000","last_became_active":"2024-09-12T00:12:40.032284+0000","last_became_peered":"2024-09-12T00:12:40.032284+0000","last_unstale":"2024-09-12T01:08:15.237962+0000","last_undegraded":"2024-09-12T01:08:15.237962+0000","last_fullsized":"2024-09-12T01:08:15.237962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:20.113080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'257","reported_seq":815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.224454+0000","last_change":"2024-09-12T00:12:42.051390+0000","last_active":"2024-09-12T01:11:00.224454+0000","last_peered":"2024-09-12T01:11:00.224454+0000","last_clean":"2024-09-12T01:11:00.224454+0000","last_became_active":"2024-09-12T00:12:42.051133+0000","last_became_peered":"2024-09-12T00:12:42.051133+0000","last_unstale":"2024-09-12T01:11:00.224454+0000","last_undegraded":"2024-09-12T01:11:00.224454+0000","last_fullsized":"2024-09-12T01:11:00.224454+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:39.225249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":1053,"num_write":352,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041676+0000","last_change":"2024-09-12T00:12:44.060747+0000","last_active":"2024-09-12T01:07:45.041676+0000","last_peered":"2024-09-12T01:07:45.041676+0000","last_clean":"2024-09-12T01:07:45.041676+0000","last_became_active":"2024-09-12T00:12:44.060464+0000","last_became_peered":"2024-09-12T00:12:44.060464+0000","last_unstale":"2024-09-12T01:07:45.041676+0000","last_undegraded":"2024-09-12T01:07:45.041676+0000","last_fullsized":"2024-09-12T01:07:45.041676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:56.068981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'150","reported_seq":1608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.570464+0000","last_change":"2024-09-12T00:12:46.064822+0000","last_active":"2024-09-12T01:09:20.570464+0000","last_peered":"2024-09-12T01:09:20.570464+0000","last_clean":"2024-09-12T01:09:20.570464+0000","last_became_active":"2024-09-12T00:12:46.064565+0000","last_became_peered":"2024-09-12T00:12:46.064565+0000","last_unstale":"2024-09-12T01:09:20.570464+0000","last_undegraded":"2024-09-12T01:09:20.570464+0000","last_fullsized":"2024-09-12T01:09:20.570464+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:23.873971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1152,"num_read_kb":1150,"num_write":337,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'89","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.137995+0000","last_change":"2024-09-12T00:12:38.038149+0000","last_active":"2024-09-12T01:08:15.137995+0000","last_peered":"2024-09-12T01:08:15.137995+0000","last_clean":"2024-09-12T01:08:15.137995+0000","last_became_active":"2024-09-12T00:12:38.037860+0000","last_became_peered":"2024-09-12T00:12:38.037860+0000","last_unstale":"2024-09-12T01:08:15.137995+0000","last_undegraded":"2024-09-12T01:08:15.137995+0000","last_fullsized":"2024-09-12T01:08:15.137995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:24.535343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":333,"num_write":131,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'328","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.176369+0000","last_change":"2024-09-12T00:12:36.042368+0000","last_active":"2024-09-12T01:11:00.176369+0000","last_peered":"2024-09-12T01:11:00.176369+0000","last_clean":"2024-09-12T01:11:00.176369+0000","last_became_active":"2024-09-12T00:12:36.041860+0000","last_became_peered":"2024-09-12T00:12:36.041860+0000","last_unstale":"2024-09-12T01:11:00.176369+0000","last_undegraded":"2024-09-12T01:11:00.176369+0000","last_fullsized":"2024-09-12T01:11:00.176369+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:01.561434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3984538,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":381,"num_read_kb":7023,"num_write":999,"num_write_kb":36211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"32'1","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.050491+0000","last_change":"2024-09-12T00:12:40.039492+0000","last_active":"2024-09-12T01:08:25.050491+0000","last_peered":"2024-09-12T01:08:25.050491+0000","last_clean":"2024-09-12T01:08:25.050491+0000","last_became_active":"2024-09-12T00:12:40.039196+0000","last_became_peered":"2024-09-12T00:12:40.039196+0000","last_unstale":"2024-09-12T01:08:25.050491+0000","last_undegraded":"2024-09-12T01:08:25.050491+0000","last_fullsized":"2024-09-12T01:08:25.050491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:03.281450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'344","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.301784+0000","last_change":"2024-09-12T00:12:42.039343+0000","last_active":"2024-09-12T01:10:58.301784+0000","last_peered":"2024-09-12T01:10:58.301784+0000","last_clean":"2024-09-12T01:10:58.301784+0000","last_became_active":"2024-09-12T00:12:42.039068+0000","last_became_peered":"2024-09-12T00:12:42.039068+0000","last_unstale":"2024-09-12T01:10:58.301784+0000","last_undegraded":"2024-09-12T01:10:58.301784+0000","last_fullsized":"2024-09-12T01:10:58.301784+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:19.273390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44473,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":544,"num_read_kb":1176,"num_write":442,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044483+0000","last_change":"2024-09-12T00:12:44.064609+0000","last_active":"2024-09-12T01:07:45.044483+0000","last_peered":"2024-09-12T01:07:45.044483+0000","last_clean":"2024-09-12T01:07:45.044483+0000","last_became_active":"2024-09-12T00:12:44.064105+0000","last_became_peered":"2024-09-12T00:12:44.064105+0000","last_unstale":"2024-09-12T01:07:45.044483+0000","last_undegraded":"2024-09-12T01:07:45.044483+0000","last_fullsized":"2024-09-12T01:07:45.044483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:34.680066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'146","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.794252+0000","last_change":"2024-09-12T00:12:46.054136+0000","last_active":"2024-09-12T01:10:31.794252+0000","last_peered":"2024-09-12T01:10:31.794252+0000","last_clean":"2024-09-12T01:10:31.794252+0000","last_became_active":"2024-09-12T00:12:46.053763+0000","last_became_peered":"2024-09-12T00:12:46.053763+0000","last_unstale":"2024-09-12T01:10:31.794252+0000","last_undegraded":"2024-09-12T01:10:31.794252+0000","last_fullsized":"2024-09-12T01:10:31.794252+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:31.432295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":382,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'137","reported_seq":721,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:19.975539+0000","last_change":"2024-09-12T00:12:38.044545+0000","last_active":"2024-09-12T01:08:19.975539+0000","last_peered":"2024-09-12T01:08:19.975539+0000","last_clean":"2024-09-12T01:08:19.975539+0000","last_became_active":"2024-09-12T00:12:38.044285+0000","last_became_peered":"2024-09-12T00:12:38.044285+0000","last_unstale":"2024-09-12T01:08:19.975539+0000","last_undegraded":"2024-09-12T01:08:19.975539+0000","last_fullsized":"2024-09-12T01:08:19.975539+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:05.907607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":475,"num_write":234,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'397","reported_seq":1047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.172481+0000","last_change":"2024-09-12T00:12:36.037087+0000","last_active":"2024-09-12T01:11:00.172481+0000","last_peered":"2024-09-12T01:11:00.172481+0000","last_clean":"2024-09-12T01:11:00.172481+0000","last_became_active":"2024-09-12T00:12:36.036773+0000","last_became_peered":"2024-09-12T00:12:36.036773+0000","last_unstale":"2024-09-12T01:11:00.172481+0000","last_undegraded":"2024-09-12T01:11:00.172481+0000","last_fullsized":"2024-09-12T01:11:00.172481+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:15.783771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":606,"num_read_kb":16738,"num_write":1145,"num_write_kb":32233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'47","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:08.460370+0000","last_change":"2024-09-12T00:12:38.037279+0000","last_active":"2024-09-12T01:08:08.460370+0000","last_peered":"2024-09-12T01:08:08.460370+0000","last_clean":"2024-09-12T01:08:08.460370+0000","last_became_active":"2024-09-12T00:12:38.036978+0000","last_became_peered":"2024-09-12T00:12:38.036978+0000","last_unstale":"2024-09-12T01:08:08.460370+0000","last_undegraded":"2024-09-12T01:08:08.460370+0000","last_fullsized":"2024-09-12T01:08:08.460370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:21.347370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":60,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'331","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.175671+0000","last_change":"2024-09-12T00:12:36.035846+0000","last_active":"2024-09-12T01:11:00.175671+0000","last_peered":"2024-09-12T01:11:00.175671+0000","last_clean":"2024-09-12T01:11:00.175671+0000","last_became_active":"2024-09-12T00:12:36.035112+0000","last_became_peered":"2024-09-12T00:12:36.035112+0000","last_unstale":"2024-09-12T01:11:00.175671+0000","last_undegraded":"2024-09-12T01:11:00.175671+0000","last_fullsized":"2024-09-12T01:11:00.175671+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:21.404926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":34939,"num_write":1097,"num_write_kb":28471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'137","reported_seq":769,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:43.101896+0000","last_change":"2024-09-12T00:12:38.040495+0000","last_active":"2024-09-12T01:07:43.101896+0000","last_peered":"2024-09-12T01:07:43.101896+0000","last_clean":"2024-09-12T01:07:43.101896+0000","last_became_active":"2024-09-12T00:12:38.040144+0000","last_became_peered":"2024-09-12T00:12:38.040144+0000","last_unstale":"2024-09-12T01:07:43.101896+0000","last_undegraded":"2024-09-12T01:07:43.101896+0000","last_fullsized":"2024-09-12T01:07:43.101896+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:37.698332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":511,"num_write":216,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'319","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.181432+0000","last_change":"2024-09-12T00:12:36.038607+0000","last_active":"2024-09-12T01:11:00.181432+0000","last_peered":"2024-09-12T01:11:00.181432+0000","last_clean":"2024-09-12T01:11:00.181432+0000","last_became_active":"2024-09-12T00:12:36.035558+0000","last_became_peered":"2024-09-12T00:12:36.035558+0000","last_unstale":"2024-09-12T01:11:00.181432+0000","last_undegraded":"2024-09-12T01:11:00.181432+0000","last_fullsized":"2024-09-12T01:11:00.181432+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:48.869269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287622,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":7822,"num_write":966,"num_write_kb":22426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'275","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:48.033948+0000","last_change":"2024-09-12T00:12:38.026451+0000","last_active":"2024-09-12T01:06:48.033948+0000","last_peered":"2024-09-12T01:06:48.033948+0000","last_clean":"2024-09-12T01:06:48.033948+0000","last_became_active":"2024-09-12T00:12:38.026109+0000","last_became_peered":"2024-09-12T00:12:38.026109+0000","last_unstale":"2024-09-12T01:06:48.033948+0000","last_undegraded":"2024-09-12T01:06:48.033948+0000","last_fullsized":"2024-09-12T01:06:48.033948+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:18.043515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1270,"num_read_kb":1040,"num_write":446,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'331","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.129759+0000","last_change":"2024-09-12T00:12:36.033841+0000","last_active":"2024-09-12T01:11:00.129759+0000","last_peered":"2024-09-12T01:11:00.129759+0000","last_clean":"2024-09-12T01:11:00.129759+0000","last_became_active":"2024-09-12T00:12:36.033426+0000","last_became_peered":"2024-09-12T00:12:36.033426+0000","last_unstale":"2024-09-12T01:11:00.129759+0000","last_undegraded":"2024-09-12T01:11:00.129759+0000","last_fullsized":"2024-09-12T01:11:00.129759+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:43.664314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306676,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":19382,"num_write":951,"num_write_kb":44169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'4265","reported_seq":4908,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:12.043610+0000","last_change":"2024-09-12T00:12:38.028635+0000","last_active":"2024-09-12T01:08:12.043610+0000","last_peered":"2024-09-12T01:08:12.043610+0000","last_clean":"2024-09-12T01:08:12.043610+0000","last_became_active":"2024-09-12T00:12:38.028401+0000","last_became_peered":"2024-09-12T00:12:38.028401+0000","last_unstale":"2024-09-12T01:08:12.043610+0000","last_undegraded":"2024-09-12T01:08:12.043610+0000","last_fullsized":"2024-09-12T01:08:12.043610+0000","mapping_epoch":29,"log_start":"263'4200","ondisk_log_start":"263'4200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":3000,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17227,"num_read_kb":14428,"num_write":6422,"num_write_kb":3205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'326","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.214445+0000","last_change":"2024-09-12T00:12:36.032699+0000","last_active":"2024-09-12T01:11:00.214445+0000","last_peered":"2024-09-12T01:11:00.214445+0000","last_clean":"2024-09-12T01:11:00.214445+0000","last_became_active":"2024-09-12T00:12:36.032341+0000","last_became_peered":"2024-09-12T00:12:36.032341+0000","last_unstale":"2024-09-12T01:11:00.214445+0000","last_undegraded":"2024-09-12T01:11:00.214445+0000","last_fullsized":"2024-09-12T01:11:00.214445+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.087075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2561198,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":66123,"num_write":1057,"num_write_kb":26739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'149","reported_seq":729,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.036066+0000","last_change":"2024-09-12T00:12:38.043531+0000","last_active":"2024-09-12T01:08:55.036066+0000","last_peered":"2024-09-12T01:08:55.036066+0000","last_clean":"2024-09-12T01:08:55.036066+0000","last_became_active":"2024-09-12T00:12:38.043276+0000","last_became_peered":"2024-09-12T00:12:38.043276+0000","last_unstale":"2024-09-12T01:08:55.036066+0000","last_undegraded":"2024-09-12T01:08:55.036066+0000","last_fullsized":"2024-09-12T01:08:55.036066+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:16.032522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":632,"num_read_kb":523,"num_write":222,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'311","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.197706+0000","last_change":"2024-09-12T00:12:36.030036+0000","last_active":"2024-09-12T01:11:00.197706+0000","last_peered":"2024-09-12T01:11:00.197706+0000","last_clean":"2024-09-12T01:11:00.197706+0000","last_became_active":"2024-09-12T00:12:36.029687+0000","last_became_peered":"2024-09-12T00:12:36.029687+0000","last_unstale":"2024-09-12T01:11:00.197706+0000","last_undegraded":"2024-09-12T01:11:00.197706+0000","last_fullsized":"2024-09-12T01:11:00.197706+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:58.296237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":12036,"num_write":1041,"num_write_kb":29691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'211","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.172500+0000","last_change":"2024-09-12T00:12:38.047873+0000","last_active":"2024-09-12T01:08:55.172500+0000","last_peered":"2024-09-12T01:08:55.172500+0000","last_clean":"2024-09-12T01:08:55.172500+0000","last_became_active":"2024-09-12T00:12:38.047575+0000","last_became_peered":"2024-09-12T00:12:38.047575+0000","last_unstale":"2024-09-12T01:08:55.172500+0000","last_undegraded":"2024-09-12T01:08:55.172500+0000","last_fullsized":"2024-09-12T01:08:55.172500+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:28.383492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":952,"num_read_kb":776,"num_write":336,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'364","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.126226+0000","last_change":"2024-09-12T00:12:36.044107+0000","last_active":"2024-09-12T01:11:00.126226+0000","last_peered":"2024-09-12T01:11:00.126226+0000","last_clean":"2024-09-12T01:11:00.126226+0000","last_became_active":"2024-09-12T00:12:36.043803+0000","last_became_peered":"2024-09-12T00:12:36.043803+0000","last_unstale":"2024-09-12T01:11:00.126226+0000","last_undegraded":"2024-09-12T01:11:00.126226+0000","last_fullsized":"2024-09-12T01:11:00.126226+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:42.820031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":463,"num_read_kb":37298,"num_write":1152,"num_write_kb":54766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'143","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.242332+0000","last_change":"2024-09-12T00:12:38.036740+0000","last_active":"2024-09-12T01:08:55.242332+0000","last_peered":"2024-09-12T01:08:55.242332+0000","last_clean":"2024-09-12T01:08:55.242332+0000","last_became_active":"2024-09-12T00:12:38.036463+0000","last_became_peered":"2024-09-12T00:12:38.036463+0000","last_unstale":"2024-09-12T01:08:55.242332+0000","last_undegraded":"2024-09-12T01:08:55.242332+0000","last_fullsized":"2024-09-12T01:08:55.242332+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:20.504629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":509,"num_write":213,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'287","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.172971+0000","last_change":"2024-09-12T00:12:36.042056+0000","last_active":"2024-09-12T01:11:00.172971+0000","last_peered":"2024-09-12T01:11:00.172971+0000","last_clean":"2024-09-12T01:11:00.172971+0000","last_became_active":"2024-09-12T00:12:36.041392+0000","last_became_peered":"2024-09-12T00:12:36.041392+0000","last_unstale":"2024-09-12T01:11:00.172971+0000","last_undegraded":"2024-09-12T01:11:00.172971+0000","last_fullsized":"2024-09-12T01:11:00.172971+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:58.023567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992353,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":407,"num_read_kb":23602,"num_write":1012,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'133","reported_seq":753,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.561904+0000","last_change":"2024-09-12T00:12:38.043147+0000","last_active":"2024-09-12T01:09:22.561904+0000","last_peered":"2024-09-12T01:09:22.561904+0000","last_clean":"2024-09-12T01:09:22.561904+0000","last_became_active":"2024-09-12T00:12:38.042584+0000","last_became_peered":"2024-09-12T00:12:38.042584+0000","last_unstale":"2024-09-12T01:09:22.561904+0000","last_undegraded":"2024-09-12T01:09:22.561904+0000","last_fullsized":"2024-09-12T01:09:22.561904+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:40.303117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":632,"num_read_kb":533,"num_write":194,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'381","reported_seq":1039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.117590+0000","last_change":"2024-09-12T00:12:36.037876+0000","last_active":"2024-09-12T01:11:00.117590+0000","last_peered":"2024-09-12T01:11:00.117590+0000","last_clean":"2024-09-12T01:11:00.117590+0000","last_became_active":"2024-09-12T00:12:36.037461+0000","last_became_peered":"2024-09-12T00:12:36.037461+0000","last_unstale":"2024-09-12T01:11:00.117590+0000","last_undegraded":"2024-09-12T01:11:00.117590+0000","last_fullsized":"2024-09-12T01:11:00.117590+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:05.562845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262313,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":614,"num_read_kb":9826,"num_write":1249,"num_write_kb":32499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'308","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.034557+0000","last_change":"2024-09-12T00:12:38.037217+0000","last_active":"2024-09-12T01:08:40.034557+0000","last_peered":"2024-09-12T01:08:40.034557+0000","last_clean":"2024-09-12T01:08:40.034557+0000","last_became_active":"2024-09-12T00:12:38.036872+0000","last_became_peered":"2024-09-12T00:12:38.036872+0000","last_unstale":"2024-09-12T01:08:40.034557+0000","last_undegraded":"2024-09-12T01:08:40.034557+0000","last_fullsized":"2024-09-12T01:08:40.034557+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:45.277008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1112,"num_write":459,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'341","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.010187+0000","last_change":"2024-09-12T00:12:36.042921+0000","last_active":"2024-09-12T01:11:00.010187+0000","last_peered":"2024-09-12T01:11:00.010187+0000","last_clean":"2024-09-12T01:11:00.010187+0000","last_became_active":"2024-09-12T00:12:36.042159+0000","last_became_peered":"2024-09-12T00:12:36.042159+0000","last_unstale":"2024-09-12T01:11:00.010187+0000","last_undegraded":"2024-09-12T01:11:00.010187+0000","last_fullsized":"2024-09-12T01:11:00.010187+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:47.107719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262267,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":43498,"num_write":1204,"num_write_kb":41544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'313","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:10.061449+0000","last_change":"2024-09-12T00:12:38.045246+0000","last_active":"2024-09-12T01:08:10.061449+0000","last_peered":"2024-09-12T01:08:10.061449+0000","last_clean":"2024-09-12T01:08:10.061449+0000","last_became_active":"2024-09-12T00:12:38.042966+0000","last_became_peered":"2024-09-12T00:12:38.042966+0000","last_unstale":"2024-09-12T01:08:10.061449+0000","last_undegraded":"2024-09-12T01:08:10.061449+0000","last_fullsized":"2024-09-12T01:08:10.061449+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:43.848333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1467,"num_read_kb":1262,"num_write":468,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'377","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.212240+0000","last_change":"2024-09-12T00:12:36.027754+0000","last_active":"2024-09-12T01:11:00.212240+0000","last_peered":"2024-09-12T01:11:00.212240+0000","last_clean":"2024-09-12T01:11:00.212240+0000","last_became_active":"2024-09-12T00:12:36.027423+0000","last_became_peered":"2024-09-12T00:12:36.027423+0000","last_unstale":"2024-09-12T01:11:00.212240+0000","last_undegraded":"2024-09-12T01:11:00.212240+0000","last_fullsized":"2024-09-12T01:11:00.212240+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:36.409512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730133,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":69052,"num_write":1173,"num_write_kb":46135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'156","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.227992+0000","last_change":"2024-09-12T00:12:38.036518+0000","last_active":"2024-09-12T01:06:40.227992+0000","last_peered":"2024-09-12T01:06:40.227992+0000","last_clean":"2024-09-12T01:06:40.227992+0000","last_became_active":"2024-09-12T00:12:38.036235+0000","last_became_peered":"2024-09-12T00:12:38.036235+0000","last_unstale":"2024-09-12T01:06:40.227992+0000","last_undegraded":"2024-09-12T01:06:40.227992+0000","last_fullsized":"2024-09-12T01:06:40.227992+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:14.890009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":550,"num_write":221,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'463","reported_seq":1280,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.162441+0000","last_change":"2024-09-12T00:12:36.038795+0000","last_active":"2024-09-12T01:11:00.162441+0000","last_peered":"2024-09-12T01:11:00.162441+0000","last_clean":"2024-09-12T01:11:00.162441+0000","last_became_active":"2024-09-12T00:12:36.038449+0000","last_became_peered":"2024-09-12T00:12:36.038449+0000","last_unstale":"2024-09-12T01:11:00.162441+0000","last_undegraded":"2024-09-12T01:11:00.162441+0000","last_fullsized":"2024-09-12T01:11:00.162441+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:36.774240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5280724,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1083,"num_read_kb":25378,"num_write":1472,"num_write_kb":31172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'189","reported_seq":837,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.227982+0000","last_change":"2024-09-12T00:12:38.042951+0000","last_active":"2024-09-12T01:06:40.227982+0000","last_peered":"2024-09-12T01:06:40.227982+0000","last_clean":"2024-09-12T01:06:40.227982+0000","last_became_active":"2024-09-12T00:12:38.042691+0000","last_became_peered":"2024-09-12T00:12:38.042691+0000","last_unstale":"2024-09-12T01:06:40.227982+0000","last_undegraded":"2024-09-12T01:06:40.227982+0000","last_fullsized":"2024-09-12T01:06:40.227982+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:20.069819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":710,"num_write":289,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'349","reported_seq":981,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.048019+0000","last_change":"2024-09-12T00:12:36.025331+0000","last_active":"2024-09-12T01:11:00.048019+0000","last_peered":"2024-09-12T01:11:00.048019+0000","last_clean":"2024-09-12T01:11:00.048019+0000","last_became_active":"2024-09-12T00:12:36.025028+0000","last_became_peered":"2024-09-12T00:12:36.025028+0000","last_unstale":"2024-09-12T01:11:00.048019+0000","last_undegraded":"2024-09-12T01:11:00.048019+0000","last_fullsized":"2024-09-12T01:11:00.048019+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:26.322567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":523,"num_read_kb":8333,"num_write":1236,"num_write_kb":35038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'132","reported_seq":746,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:40.033321+0000","last_change":"2024-09-12T00:12:38.047056+0000","last_active":"2024-09-12T01:06:40.033321+0000","last_peered":"2024-09-12T01:06:40.033321+0000","last_clean":"2024-09-12T01:06:40.033321+0000","last_became_active":"2024-09-12T00:12:38.046753+0000","last_became_peered":"2024-09-12T00:12:38.046753+0000","last_unstale":"2024-09-12T01:06:40.033321+0000","last_undegraded":"2024-09-12T01:06:40.033321+0000","last_fullsized":"2024-09-12T01:06:40.033321+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:58.264361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":645,"num_read_kb":546,"num_write":214,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'376","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.106047+0000","last_change":"2024-09-12T00:12:36.047535+0000","last_active":"2024-09-12T01:11:00.106047+0000","last_peered":"2024-09-12T01:11:00.106047+0000","last_clean":"2024-09-12T01:11:00.106047+0000","last_became_active":"2024-09-12T00:12:36.047221+0000","last_became_peered":"2024-09-12T00:12:36.047221+0000","last_unstale":"2024-09-12T01:11:00.106047+0000","last_undegraded":"2024-09-12T01:11:00.106047+0000","last_fullsized":"2024-09-12T01:11:00.106047+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:45.416216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4807090,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":28472,"num_write":1153,"num_write_kb":36833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'173","reported_seq":801,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:46.645799+0000","last_change":"2024-09-12T00:12:38.048404+0000","last_active":"2024-09-12T01:06:46.645799+0000","last_peered":"2024-09-12T01:06:46.645799+0000","last_clean":"2024-09-12T01:06:46.645799+0000","last_became_active":"2024-09-12T00:12:38.048094+0000","last_became_peered":"2024-09-12T00:12:38.048094+0000","last_unstale":"2024-09-12T01:06:46.645799+0000","last_undegraded":"2024-09-12T01:06:46.645799+0000","last_fullsized":"2024-09-12T01:06:46.645799+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:31.879991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":798,"num_read_kb":664,"num_write":275,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'311","reported_seq":914,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.134142+0000","last_change":"2024-09-12T00:12:36.039699+0000","last_active":"2024-09-12T01:11:00.134142+0000","last_peered":"2024-09-12T01:11:00.134142+0000","last_clean":"2024-09-12T01:11:00.134142+0000","last_became_active":"2024-09-12T00:12:36.039442+0000","last_became_peered":"2024-09-12T00:12:36.039442+0000","last_unstale":"2024-09-12T01:11:00.134142+0000","last_undegraded":"2024-09-12T01:11:00.134142+0000","last_fullsized":"2024-09-12T01:11:00.134142+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:18.334602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":5824,"num_write":1002,"num_write_kb":34989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'85","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.229535+0000","last_change":"2024-09-12T00:12:38.042638+0000","last_active":"2024-09-12T01:06:55.229535+0000","last_peered":"2024-09-12T01:06:55.229535+0000","last_clean":"2024-09-12T01:06:55.229535+0000","last_became_active":"2024-09-12T00:12:38.042380+0000","last_became_peered":"2024-09-12T00:12:38.042380+0000","last_unstale":"2024-09-12T01:06:55.229535+0000","last_undegraded":"2024-09-12T01:06:55.229535+0000","last_fullsized":"2024-09-12T01:06:55.229535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:54.486935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":311,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'396","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.122438+0000","last_change":"2024-09-12T00:12:36.036316+0000","last_active":"2024-09-12T01:11:00.122438+0000","last_peered":"2024-09-12T01:11:00.122438+0000","last_clean":"2024-09-12T01:11:00.122438+0000","last_became_active":"2024-09-12T00:12:36.035235+0000","last_became_peered":"2024-09-12T00:12:36.035235+0000","last_unstale":"2024-09-12T01:11:00.122438+0000","last_undegraded":"2024-09-12T01:11:00.122438+0000","last_fullsized":"2024-09-12T01:11:00.122438+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:35.845612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2508578,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":34997,"num_write":1247,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'340","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.028745+0000","last_change":"2024-09-12T00:13:07.150744+0000","last_active":"2024-09-12T01:11:00.028745+0000","last_peered":"2024-09-12T01:11:00.028745+0000","last_clean":"2024-09-12T01:11:00.028745+0000","last_became_active":"2024-09-12T00:13:07.150278+0000","last_became_peered":"2024-09-12T00:13:07.150278+0000","last_unstale":"2024-09-12T01:11:00.028745+0000","last_undegraded":"2024-09-12T01:11:00.028745+0000","last_fullsized":"2024-09-12T01:11:00.028745+0000","mapping_epoch":40,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:11.722385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550106,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":16889,"num_write":1077,"num_write_kb":27724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"263'232","reported_seq":850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.050604+0000","last_change":"2024-09-12T00:12:38.048481+0000","last_active":"2024-09-12T01:08:25.050604+0000","last_peered":"2024-09-12T01:08:25.050604+0000","last_clean":"2024-09-12T01:08:25.050604+0000","last_became_active":"2024-09-12T00:12:38.048092+0000","last_became_peered":"2024-09-12T00:12:38.048092+0000","last_unstale":"2024-09-12T01:08:25.050604+0000","last_undegraded":"2024-09-12T01:08:25.050604+0000","last_fullsized":"2024-09-12T01:08:25.050604+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:42.485985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":909,"num_write":384,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'395","reported_seq":1208,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.186273+0000","last_change":"2024-09-12T00:12:36.035409+0000","last_active":"2024-09-12T01:11:00.186273+0000","last_peered":"2024-09-12T01:11:00.186273+0000","last_clean":"2024-09-12T01:11:00.186273+0000","last_became_active":"2024-09-12T00:12:36.034396+0000","last_became_peered":"2024-09-12T00:12:36.034396+0000","last_unstale":"2024-09-12T01:11:00.186273+0000","last_undegraded":"2024-09-12T01:11:00.186273+0000","last_fullsized":"2024-09-12T01:11:00.186273+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:34.995918+0000","last_clean_scrub_stamp":"2024-09-12T00:12:34.995918+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:08.822878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730115,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":982,"num_read_kb":9206,"num_write":1471,"num_write_kb":42121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'344","reported_seq":938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.830495+0000","last_change":"2024-09-12T00:12:38.040209+0000","last_active":"2024-09-12T01:08:20.830495+0000","last_peered":"2024-09-12T01:08:20.830495+0000","last_clean":"2024-09-12T01:08:20.830495+0000","last_became_active":"2024-09-12T00:12:38.039941+0000","last_became_peered":"2024-09-12T00:12:38.039941+0000","last_unstale":"2024-09-12T01:08:20.830495+0000","last_undegraded":"2024-09-12T01:08:20.830495+0000","last_fullsized":"2024-09-12T01:08:20.830495+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:03.997031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1443,"num_read_kb":1146,"num_write":558,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5787,"num_read_kb":4069,"num_write":1922,"num_write_kb":820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1093,"ondisk_log_size":1093,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15069,"num_read_kb":14720,"num_write":16734,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1768,"ondisk_log_size":1768,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":691,"ondisk_log_size":691,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1599308,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":18230,"num_read_kb":37558,"num_write":15243,"num_write_kb":11785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1995,"ondisk_log_size":1995,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":103162,"num_read_kb":86048,"num_write":37373,"num_write_kb":18894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3928,"ondisk_log_size":3928,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":86738467,"num_objects":386,"num_object_clones":0,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":386,"num_whiteouts":0,"num_read":36305,"num_read_kb":1714849,"num_write":72152,"num_write_kb":2100462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":132317184,"data_stored":132317184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3742,"ondisk_log_size":3742,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":170862,"num_write":186,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":170241,"num_write":186,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510150,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216684,"kb_used_data":14612,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94155156,"statfs":{"total":96636764160,"available":96414879744,"internally_reserved":0,"allocated":14962688,"data_stored":12977820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":206698955},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510153,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108704,"kb_used_data":15120,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94263136,"statfs":{"total":96636764160,"available":96525451264,"internally_reserved":0,"allocated":15482880,"data_stored":13481120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95812038},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510150,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201504,"kb_used_data":21656,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94170336,"statfs":{"total":96636764160,"available":96430424064,"internally_reserved":0,"allocated":22175744,"data_stored":20184672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510151,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":267180,"kb_used_data":28964,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94104660,"statfs":{"total":96636764160,"available":96363171840,"internally_reserved":0,"allocated":29659136,"data_stored":27672539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":243726791},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510151,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":129780,"kb_used_data":22112,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94242060,"statfs":{"total":96636764160,"available":96503869440,"internally_reserved":0,"allocated":22642688,"data_stored":20661729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510150,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":328460,"kb_used_data":22312,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94043380,"statfs":{"total":96636764160,"available":96300421120,"internally_reserved":0,"allocated":22847488,"data_stored":20852874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510153,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115980,"kb_used_data":17856,"kb_used_omap":1,"kb_used_meta":97790,"kb_avail":94255860,"statfs":{"total":96636764160,"available":96518000640,"internally_reserved":0,"allocated":18284544,"data_stored":16272298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100137413},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575558,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268508,"kb_used_data":20512,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94103332,"statfs":{"total":96636764160,"available":96361811968,"internally_reserved":0,"allocated":21004288,"data_stored":19003294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14069760,"data_stored":14069760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18063360,"data_stored":18063360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18460672,"data_stored":18460672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25473024,"data_stored":25473024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17981440,"data_stored":17981440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16211968,"data_stored":16211968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11280384,"data_stored":11280384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10776576,"data_stored":10776576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:11:06.844 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.845 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.845 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.845 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.845 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.845 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.845 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.845 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.845 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.845 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.846 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.846 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.846 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.846 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.846 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.846 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.846 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.846 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.847 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.847 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.847 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.847 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.847 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.847 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.847 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.847 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.847 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.848 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.848 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.848 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.848 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.848 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.848 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.848 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.848 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.848 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.849 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.849 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.849 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.849 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.849 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.849 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.849 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.849 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.849 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.850 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.850 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.850 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.850 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.850 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.850 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.850 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.850 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.851 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.851 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.851 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.851 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.851 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.851 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.851 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.851 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.852 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.852 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.852 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.852 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.852 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.852 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.852 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.852 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.852 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.853 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.853 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.853 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.853 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.853 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.853 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.853 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.853 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.854 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.854 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.854 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.854 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.854 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.854 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.854 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.854 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.854 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.855 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.855 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.855 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.855 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.855 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.855 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.855 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.855 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.855 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.856 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.856 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.856 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.856 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.856 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.856 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.856 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.856 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.857 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.857 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.857 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.857 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.857 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.857 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.857 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.857 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.857 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.858 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.858 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.858 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.858 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.858 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.858 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.858 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.858 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.858 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.859 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.859 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.859 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.859 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.859 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.859 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.859 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.859 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.859 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.860 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.860 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.860 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.860 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.860 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.860 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.860 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.860 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.860 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.861 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.861 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.861 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.861 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.861 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.861 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.861 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.861 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.861 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.862 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.862 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.862 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.862 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.862 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.862 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.862 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.862 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.862 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.862 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.863 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.863 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.863 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.863 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.863 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.863 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.863 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.863 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.863 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.864 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.864 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.864 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.864 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.864 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.864 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.864 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.864 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.864 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.865 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.865 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.865 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.865 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.865 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.865 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.865 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.865 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.865 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.866 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.866 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.866 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.866 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.866 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.866 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.866 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.866 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.866 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.867 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.867 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.867 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.867 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.867 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.867 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.867 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.867 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.867 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.868 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.868 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.868 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.868 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.868 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.868 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.868 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.868 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.868 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.869 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.869 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.869 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.869 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.869 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.869 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.869 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.869 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.869 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.869 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.870 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.870 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.870 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.870 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.870 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.870 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T00:12:16.658840+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.870 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:12:21.695522+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.870 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.870 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.871 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.871 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.871 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.871 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.871 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T00:12:21.695522+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.871 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.871 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.871 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.871 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.872 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.872 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.872 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T00:12:21.695522+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.872 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.872 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.872 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.872 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.872 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.872 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.873 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T00:12:21.695522+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.873 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.873 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.873 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.873 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.873 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.873 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.873 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T00:12:21.695522+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.873 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.874 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.874 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.874 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.874 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.874 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.874 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:12:21.695522+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.874 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.874 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.875 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.875 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.875 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.875 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.875 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T00:12:21.695522+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.875 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.875 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.876 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.876 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.876 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.876 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.876 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:12:21.695522+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=21, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.876 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.876 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.876 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.876 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.877 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.877 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.877 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.877 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.877 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.878 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.878 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.878 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.878 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.878 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.878 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.878 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.878 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.878 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.879 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.879 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.879 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.879 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.879 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.879 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.879 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.879 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.879 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.880 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.880 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.880 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.880 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.880 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.880 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.880 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.880 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.880 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.881 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.881 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.881 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.881 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.881 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.881 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.881 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.881 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.881 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.882 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.882 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.882 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.882 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.882 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.882 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.882 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.882 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.882 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.883 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.883 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.883 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.883 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.883 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.883 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.883 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.883 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.883 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.884 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.884 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.884 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.884 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.884 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.884 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.884 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.884 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.884 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.885 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.885 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.885 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.885 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.885 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.885 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.885 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.885 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.885 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.886 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.886 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.886 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.886 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.886 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.886 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.886 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.886 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.886 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.887 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.887 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.887 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.887 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.887 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.887 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.887 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.887 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.887 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.887 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.888 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.888 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.888 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.888 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.888 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.888 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.888 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.888 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.888 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.889 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.889 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:12:34.995918+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.889 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:06.889 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:11:26.890 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:11:27.226 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:11:27.237 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-09-12T01:11:27.240 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":2032,"stamp":"2024-09-12T01:11:25.343005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88946274,"num_objects":742,"num_object_clones":0,"num_object_copies":1870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":181390,"num_read_kb":2201314,"num_write":143939,"num_write_kb":2394991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":533777,"num_omap_keys":1249,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13620,"ondisk_log_size":13620,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1661832,"kb_used_data":163144,"kb_used_omap":12,"kb_used_meta":1498547,"kb_avail":753312888,"statfs":{"total":773094113280,"available":771392397312,"internally_reserved":0,"allocated":167059456,"data_stored":151106346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1534512690},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":533777,"num_omap_keys":1249,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005580"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.023141+0000","last_change":"2024-09-12T00:46:54.886343+0000","last_active":"2024-09-12T01:06:55.023141+0000","last_peered":"2024-09-12T01:06:55.023141+0000","last_clean":"2024-09-12T01:06:55.023141+0000","last_became_active":"2024-09-12T00:46:54.885628+0000","last_became_peered":"2024-09-12T00:46:54.885628+0000","last_unstale":"2024-09-12T01:06:55.023141+0000","last_undegraded":"2024-09-12T01:06:55.023141+0000","last_fullsized":"2024-09-12T01:06:55.023141+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:28.705045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'4","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.235372+0000","last_change":"2024-09-12T00:30:17.763692+0000","last_active":"2024-09-12T01:07:50.235372+0000","last_peered":"2024-09-12T01:07:50.235372+0000","last_clean":"2024-09-12T01:07:50.235372+0000","last_became_active":"2024-09-12T00:30:17.763402+0000","last_became_peered":"2024-09-12T00:30:17.763402+0000","last_unstale":"2024-09-12T01:07:50.235372+0000","last_undegraded":"2024-09-12T01:07:50.235372+0000","last_fullsized":"2024-09-12T01:07:50.235372+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:07.859938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044542+0000","last_change":"2024-09-12T00:30:14.745260+0000","last_active":"2024-09-12T01:07:45.044542+0000","last_peered":"2024-09-12T01:07:45.044542+0000","last_clean":"2024-09-12T01:07:45.044542+0000","last_became_active":"2024-09-12T00:30:14.744833+0000","last_became_peered":"2024-09-12T00:30:14.744833+0000","last_unstale":"2024-09-12T01:07:45.044542+0000","last_undegraded":"2024-09-12T01:07:45.044542+0000","last_fullsized":"2024-09-12T01:07:45.044542+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:11.503961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'41","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.040605+0000","last_change":"2024-09-12T00:27:42.840206+0000","last_active":"2024-09-12T01:07:20.040605+0000","last_peered":"2024-09-12T01:07:20.040605+0000","last_clean":"2024-09-12T01:07:20.040605+0000","last_became_active":"2024-09-12T00:27:42.839605+0000","last_became_peered":"2024-09-12T00:27:42.839605+0000","last_unstale":"2024-09-12T01:07:20.040605+0000","last_undegraded":"2024-09-12T01:07:20.040605+0000","last_fullsized":"2024-09-12T01:07:20.040605+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:10.785209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":144,"num_write":69,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.153651+0000","last_change":"2024-09-12T00:46:54.885981+0000","last_active":"2024-09-12T01:06:55.153651+0000","last_peered":"2024-09-12T01:06:55.153651+0000","last_clean":"2024-09-12T01:06:55.153651+0000","last_became_active":"2024-09-12T00:46:54.885702+0000","last_became_peered":"2024-09-12T00:46:54.885702+0000","last_unstale":"2024-09-12T01:06:55.153651+0000","last_undegraded":"2024-09-12T01:06:55.153651+0000","last_fullsized":"2024-09-12T01:06:55.153651+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:37.616069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'3","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:20.152789+0000","last_change":"2024-09-12T00:30:17.762666+0000","last_active":"2024-09-12T01:10:20.152789+0000","last_peered":"2024-09-12T01:10:20.152789+0000","last_clean":"2024-09-12T01:10:20.152789+0000","last_became_active":"2024-09-12T00:30:17.762369+0000","last_became_peered":"2024-09-12T00:30:17.762369+0000","last_unstale":"2024-09-12T01:10:20.152789+0000","last_undegraded":"2024-09-12T01:10:20.152789+0000","last_fullsized":"2024-09-12T01:10:20.152789+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:33.357062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042925+0000","last_change":"2024-09-12T00:30:14.747881+0000","last_active":"2024-09-12T01:07:48.042925+0000","last_peered":"2024-09-12T01:07:48.042925+0000","last_clean":"2024-09-12T01:07:48.042925+0000","last_became_active":"2024-09-12T00:30:14.747614+0000","last_became_peered":"2024-09-12T00:30:14.747614+0000","last_unstale":"2024-09-12T01:07:48.042925+0000","last_undegraded":"2024-09-12T01:07:48.042925+0000","last_fullsized":"2024-09-12T01:07:48.042925+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:33.210330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'21","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045493+0000","last_change":"2024-09-12T00:27:42.846591+0000","last_active":"2024-09-12T01:07:50.045493+0000","last_peered":"2024-09-12T01:07:50.045493+0000","last_clean":"2024-09-12T01:07:50.045493+0000","last_became_active":"2024-09-12T00:27:42.846264+0000","last_became_peered":"2024-09-12T00:27:42.846264+0000","last_unstale":"2024-09-12T01:07:50.045493+0000","last_undegraded":"2024-09-12T01:07:50.045493+0000","last_fullsized":"2024-09-12T01:07:50.045493+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:13.645447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.240737+0000","last_change":"2024-09-12T00:46:54.890699+0000","last_active":"2024-09-12T01:08:40.240737+0000","last_peered":"2024-09-12T01:08:40.240737+0000","last_clean":"2024-09-12T01:08:40.240737+0000","last_became_active":"2024-09-12T00:46:54.890430+0000","last_became_peered":"2024-09-12T00:46:54.890430+0000","last_unstale":"2024-09-12T01:08:40.240737+0000","last_undegraded":"2024-09-12T01:08:40.240737+0000","last_fullsized":"2024-09-12T01:08:40.240737+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042970+0000","last_change":"2024-09-12T00:30:17.767409+0000","last_active":"2024-09-12T01:07:48.042970+0000","last_peered":"2024-09-12T01:07:48.042970+0000","last_clean":"2024-09-12T01:07:48.042970+0000","last_became_active":"2024-09-12T00:30:17.767116+0000","last_became_peered":"2024-09-12T00:30:17.767116+0000","last_unstale":"2024-09-12T01:07:48.042970+0000","last_undegraded":"2024-09-12T01:07:48.042970+0000","last_fullsized":"2024-09-12T01:07:48.042970+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:25.469472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"263'6","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.240551+0000","last_change":"2024-09-12T00:30:14.742702+0000","last_active":"2024-09-12T01:10:58.240551+0000","last_peered":"2024-09-12T01:10:58.240551+0000","last_clean":"2024-09-12T01:10:58.240551+0000","last_became_active":"2024-09-12T00:30:14.742434+0000","last_became_peered":"2024-09-12T00:30:14.742434+0000","last_unstale":"2024-09-12T01:10:58.240551+0000","last_undegraded":"2024-09-12T01:10:58.240551+0000","last_fullsized":"2024-09-12T01:10:58.240551+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:37.658561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6194,"num_write":6,"num_write_kb":5170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'36","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160719+0000","last_change":"2024-09-12T00:27:42.842436+0000","last_active":"2024-09-12T01:07:45.160719+0000","last_peered":"2024-09-12T01:07:45.160719+0000","last_clean":"2024-09-12T01:07:45.160719+0000","last_became_active":"2024-09-12T00:27:42.842172+0000","last_became_peered":"2024-09-12T00:27:42.842172+0000","last_unstale":"2024-09-12T01:07:45.160719+0000","last_undegraded":"2024-09-12T01:07:45.160719+0000","last_fullsized":"2024-09-12T01:07:45.160719+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:30.357785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.052073+0000","last_change":"2024-09-12T00:46:54.883267+0000","last_active":"2024-09-12T01:08:48.052073+0000","last_peered":"2024-09-12T01:08:48.052073+0000","last_clean":"2024-09-12T01:08:48.052073+0000","last_became_active":"2024-09-12T00:46:54.882951+0000","last_became_peered":"2024-09-12T00:46:54.882951+0000","last_unstale":"2024-09-12T01:08:48.052073+0000","last_undegraded":"2024-09-12T01:08:48.052073+0000","last_fullsized":"2024-09-12T01:08:48.052073+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:28.067511+0000","last_change":"2024-09-12T00:30:17.766601+0000","last_active":"2024-09-12T01:10:28.067511+0000","last_peered":"2024-09-12T01:10:28.067511+0000","last_clean":"2024-09-12T01:10:28.067511+0000","last_became_active":"2024-09-12T00:30:17.764967+0000","last_became_peered":"2024-09-12T00:30:17.764967+0000","last_unstale":"2024-09-12T01:10:28.067511+0000","last_undegraded":"2024-09-12T01:10:28.067511+0000","last_fullsized":"2024-09-12T01:10:28.067511+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:56.749587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:50.248603+0000","last_change":"2024-09-12T00:30:14.747887+0000","last_active":"2024-09-12T01:09:50.248603+0000","last_peered":"2024-09-12T01:09:50.248603+0000","last_clean":"2024-09-12T01:09:50.248603+0000","last_became_active":"2024-09-12T00:30:14.747423+0000","last_became_peered":"2024-09-12T00:30:14.747423+0000","last_unstale":"2024-09-12T01:09:50.248603+0000","last_undegraded":"2024-09-12T01:09:50.248603+0000","last_fullsized":"2024-09-12T01:09:50.248603+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:10.117387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'27","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160694+0000","last_change":"2024-09-12T00:27:42.837430+0000","last_active":"2024-09-12T01:07:45.160694+0000","last_peered":"2024-09-12T01:07:45.160694+0000","last_clean":"2024-09-12T01:07:45.160694+0000","last_became_active":"2024-09-12T00:27:42.837170+0000","last_became_peered":"2024-09-12T00:27:42.837170+0000","last_unstale":"2024-09-12T01:07:45.160694+0000","last_undegraded":"2024-09-12T01:07:45.160694+0000","last_fullsized":"2024-09-12T01:07:45.160694+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:50.502592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":97,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.056429+0000","last_change":"2024-09-12T00:46:54.885456+0000","last_active":"2024-09-12T01:09:00.056429+0000","last_peered":"2024-09-12T01:09:00.056429+0000","last_clean":"2024-09-12T01:09:00.056429+0000","last_became_active":"2024-09-12T00:46:54.885170+0000","last_became_peered":"2024-09-12T00:46:54.885170+0000","last_unstale":"2024-09-12T01:09:00.056429+0000","last_undegraded":"2024-09-12T01:09:00.056429+0000","last_fullsized":"2024-09-12T01:09:00.056429+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:22.660312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.723358+0000","last_change":"2024-09-12T00:30:17.765475+0000","last_active":"2024-09-12T01:10:58.723358+0000","last_peered":"2024-09-12T01:10:58.723358+0000","last_clean":"2024-09-12T01:10:58.723358+0000","last_became_active":"2024-09-12T00:30:17.765167+0000","last_became_peered":"2024-09-12T00:30:17.765167+0000","last_unstale":"2024-09-12T01:10:58.723358+0000","last_undegraded":"2024-09-12T01:10:58.723358+0000","last_fullsized":"2024-09-12T01:10:58.723358+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:48.717488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6715,"num_write":6,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.053671+0000","last_change":"2024-09-12T00:30:14.742908+0000","last_active":"2024-09-12T01:08:58.053671+0000","last_peered":"2024-09-12T01:08:58.053671+0000","last_clean":"2024-09-12T01:08:58.053671+0000","last_became_active":"2024-09-12T00:30:14.742625+0000","last_became_peered":"2024-09-12T00:30:14.742625+0000","last_unstale":"2024-09-12T01:08:58.053671+0000","last_undegraded":"2024-09-12T01:08:58.053671+0000","last_fullsized":"2024-09-12T01:08:58.053671+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160647+0000","last_change":"2024-09-12T00:27:42.845668+0000","last_active":"2024-09-12T01:07:45.160647+0000","last_peered":"2024-09-12T01:07:45.160647+0000","last_clean":"2024-09-12T01:07:45.160647+0000","last_became_active":"2024-09-12T00:27:42.845406+0000","last_became_peered":"2024-09-12T00:27:42.845406+0000","last_unstale":"2024-09-12T01:07:45.160647+0000","last_undegraded":"2024-09-12T01:07:45.160647+0000","last_fullsized":"2024-09-12T01:07:45.160647+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:58.406118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":45,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044551+0000","last_change":"2024-09-12T00:46:54.877914+0000","last_active":"2024-09-12T01:07:45.044551+0000","last_peered":"2024-09-12T01:07:45.044551+0000","last_clean":"2024-09-12T01:07:45.044551+0000","last_became_active":"2024-09-12T00:46:54.876219+0000","last_became_peered":"2024-09-12T00:46:54.876219+0000","last_unstale":"2024-09-12T01:07:45.044551+0000","last_undegraded":"2024-09-12T01:07:45.044551+0000","last_fullsized":"2024-09-12T01:07:45.044551+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:46.030061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.166748+0000","last_change":"2024-09-12T00:30:17.763491+0000","last_active":"2024-09-12T01:10:59.166748+0000","last_peered":"2024-09-12T01:10:59.166748+0000","last_clean":"2024-09-12T01:10:59.166748+0000","last_became_active":"2024-09-12T00:30:17.762792+0000","last_became_peered":"2024-09-12T00:30:17.762792+0000","last_unstale":"2024-09-12T01:10:59.166748+0000","last_undegraded":"2024-09-12T01:10:59.166748+0000","last_fullsized":"2024-09-12T01:10:59.166748+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:05.051194+0000","last_change":"2024-09-12T00:30:14.745747+0000","last_active":"2024-09-12T01:09:05.051194+0000","last_peered":"2024-09-12T01:09:05.051194+0000","last_clean":"2024-09-12T01:09:05.051194+0000","last_became_active":"2024-09-12T00:30:14.745328+0000","last_became_peered":"2024-09-12T00:30:14.745328+0000","last_unstale":"2024-09-12T01:09:05.051194+0000","last_undegraded":"2024-09-12T01:09:05.051194+0000","last_fullsized":"2024-09-12T01:09:05.051194+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:22.444900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'29","reported_seq":127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.134777+0000","last_change":"2024-09-12T00:27:42.844015+0000","last_active":"2024-09-12T01:07:45.134777+0000","last_peered":"2024-09-12T01:07:45.134777+0000","last_clean":"2024-09-12T01:07:45.134777+0000","last_became_active":"2024-09-12T00:27:42.843745+0000","last_became_peered":"2024-09-12T00:27:42.843745+0000","last_unstale":"2024-09-12T01:07:45.134777+0000","last_undegraded":"2024-09-12T01:07:45.134777+0000","last_fullsized":"2024-09-12T01:07:45.134777+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:02.518882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":101,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.129245+0000","last_change":"2024-09-12T00:46:54.889308+0000","last_active":"2024-09-12T01:06:55.129245+0000","last_peered":"2024-09-12T01:06:55.129245+0000","last_clean":"2024-09-12T01:06:55.129245+0000","last_became_active":"2024-09-12T00:46:54.889006+0000","last_became_peered":"2024-09-12T00:46:54.889006+0000","last_unstale":"2024-09-12T01:06:55.129245+0000","last_undegraded":"2024-09-12T01:06:55.129245+0000","last_fullsized":"2024-09-12T01:06:55.129245+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:09.749976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'11","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:20.152777+0000","last_change":"2024-09-12T00:30:17.759472+0000","last_active":"2024-09-12T01:10:20.152777+0000","last_peered":"2024-09-12T01:10:20.152777+0000","last_clean":"2024-09-12T01:10:20.152777+0000","last_became_active":"2024-09-12T00:30:17.759198+0000","last_became_peered":"2024-09-12T00:30:17.759198+0000","last_unstale":"2024-09-12T01:10:20.152777+0000","last_undegraded":"2024-09-12T01:10:20.152777+0000","last_fullsized":"2024-09-12T01:10:20.152777+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:30.456850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9336,"num_write":16,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.028479+0000","last_change":"2024-09-12T00:30:14.750283+0000","last_active":"2024-09-12T01:07:45.028479+0000","last_peered":"2024-09-12T01:07:45.028479+0000","last_clean":"2024-09-12T01:07:45.028479+0000","last_became_active":"2024-09-12T00:30:14.750004+0000","last_became_peered":"2024-09-12T00:30:14.750004+0000","last_unstale":"2024-09-12T01:07:45.028479+0000","last_undegraded":"2024-09-12T01:07:45.028479+0000","last_fullsized":"2024-09-12T01:07:45.028479+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:54.714545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'18","reported_seq":94,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.055543+0000","last_change":"2024-09-12T00:27:42.835796+0000","last_active":"2024-09-12T01:08:55.055543+0000","last_peered":"2024-09-12T01:08:55.055543+0000","last_clean":"2024-09-12T01:08:55.055543+0000","last_became_active":"2024-09-12T00:27:42.835530+0000","last_became_peered":"2024-09-12T00:27:42.835530+0000","last_unstale":"2024-09-12T01:08:55.055543+0000","last_undegraded":"2024-09-12T01:08:55.055543+0000","last_fullsized":"2024-09-12T01:08:55.055543+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.023205+0000","last_change":"2024-09-12T00:46:54.883214+0000","last_active":"2024-09-12T01:06:55.023205+0000","last_peered":"2024-09-12T01:06:55.023205+0000","last_clean":"2024-09-12T01:06:55.023205+0000","last_became_active":"2024-09-12T00:46:54.882946+0000","last_became_peered":"2024-09-12T00:46:54.882946+0000","last_unstale":"2024-09-12T01:06:55.023205+0000","last_undegraded":"2024-09-12T01:06:55.023205+0000","last_fullsized":"2024-09-12T01:06:55.023205+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:01.444701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045398+0000","last_change":"2024-09-12T00:30:17.766684+0000","last_active":"2024-09-12T01:07:50.045398+0000","last_peered":"2024-09-12T01:07:50.045398+0000","last_clean":"2024-09-12T01:07:50.045398+0000","last_became_active":"2024-09-12T00:30:17.763733+0000","last_became_peered":"2024-09-12T00:30:17.763733+0000","last_unstale":"2024-09-12T01:07:50.045398+0000","last_undegraded":"2024-09-12T01:07:50.045398+0000","last_fullsized":"2024-09-12T01:07:50.045398+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:45.175363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'5","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:15.184368+0000","last_change":"2024-09-12T00:30:14.748751+0000","last_active":"2024-09-12T01:10:15.184368+0000","last_peered":"2024-09-12T01:10:15.184368+0000","last_clean":"2024-09-12T01:10:15.184368+0000","last_became_active":"2024-09-12T00:30:14.748462+0000","last_became_peered":"2024-09-12T00:30:14.748462+0000","last_unstale":"2024-09-12T01:10:15.184368+0000","last_undegraded":"2024-09-12T01:10:15.184368+0000","last_fullsized":"2024-09-12T01:10:15.184368+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:23.544212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'17","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.171612+0000","last_change":"2024-09-12T00:27:42.839309+0000","last_active":"2024-09-12T01:08:50.171612+0000","last_peered":"2024-09-12T01:08:50.171612+0000","last_clean":"2024-09-12T01:08:50.171612+0000","last_became_active":"2024-09-12T00:27:42.838896+0000","last_became_peered":"2024-09-12T00:27:42.838896+0000","last_unstale":"2024-09-12T01:08:50.171612+0000","last_undegraded":"2024-09-12T01:08:50.171612+0000","last_fullsized":"2024-09-12T01:08:50.171612+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.044373+0000","last_change":"2024-09-12T00:46:54.885744+0000","last_active":"2024-09-12T01:07:58.044373+0000","last_peered":"2024-09-12T01:07:58.044373+0000","last_clean":"2024-09-12T01:07:58.044373+0000","last_became_active":"2024-09-12T00:46:54.885457+0000","last_became_peered":"2024-09-12T00:46:54.885457+0000","last_unstale":"2024-09-12T01:07:58.044373+0000","last_undegraded":"2024-09-12T01:07:58.044373+0000","last_fullsized":"2024-09-12T01:07:58.044373+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:36.235325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"260'4","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.056383+0000","last_change":"2024-09-12T00:30:17.765481+0000","last_active":"2024-09-12T01:09:00.056383+0000","last_peered":"2024-09-12T01:09:00.056383+0000","last_clean":"2024-09-12T01:09:00.056383+0000","last_became_active":"2024-09-12T00:30:17.765149+0000","last_became_peered":"2024-09-12T00:30:17.765149+0000","last_unstale":"2024-09-12T01:09:00.056383+0000","last_undegraded":"2024-09-12T01:09:00.056383+0000","last_fullsized":"2024-09-12T01:09:00.056383+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041690+0000","last_change":"2024-09-12T00:30:14.740879+0000","last_active":"2024-09-12T01:07:45.041690+0000","last_peered":"2024-09-12T01:07:45.041690+0000","last_clean":"2024-09-12T01:07:45.041690+0000","last_became_active":"2024-09-12T00:30:14.740516+0000","last_became_peered":"2024-09-12T00:30:14.740516+0000","last_unstale":"2024-09-12T01:07:45.041690+0000","last_undegraded":"2024-09-12T01:07:45.041690+0000","last_fullsized":"2024-09-12T01:07:45.041690+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:43.135121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'20","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.054951+0000","last_change":"2024-09-12T00:27:42.841806+0000","last_active":"2024-09-12T01:08:50.054951+0000","last_peered":"2024-09-12T01:08:50.054951+0000","last_clean":"2024-09-12T01:08:50.054951+0000","last_became_active":"2024-09-12T00:27:42.840919+0000","last_became_peered":"2024-09-12T00:27:42.840919+0000","last_unstale":"2024-09-12T01:08:50.054951+0000","last_undegraded":"2024-09-12T01:08:50.054951+0000","last_fullsized":"2024-09-12T01:08:50.054951+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":83,"num_write":31,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.162301+0000","last_change":"2024-09-12T00:46:54.887403+0000","last_active":"2024-09-12T01:07:55.162301+0000","last_peered":"2024-09-12T01:07:55.162301+0000","last_clean":"2024-09-12T01:07:55.162301+0000","last_became_active":"2024-09-12T00:46:54.887134+0000","last_became_peered":"2024-09-12T00:46:54.887134+0000","last_unstale":"2024-09-12T01:07:55.162301+0000","last_undegraded":"2024-09-12T01:07:55.162301+0000","last_fullsized":"2024-09-12T01:07:55.162301+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:13.379263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'9","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.166881+0000","last_change":"2024-09-12T00:30:17.766525+0000","last_active":"2024-09-12T01:10:59.166881+0000","last_peered":"2024-09-12T01:10:59.166881+0000","last_clean":"2024-09-12T01:10:59.166881+0000","last_became_active":"2024-09-12T00:30:17.766203+0000","last_became_peered":"2024-09-12T00:30:17.766203+0000","last_unstale":"2024-09-12T01:10:59.166881+0000","last_undegraded":"2024-09-12T01:10:59.166881+0000","last_fullsized":"2024-09-12T01:10:59.166881+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:51.225523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13412,"num_write":14,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.036146+0000","last_change":"2024-09-12T00:30:14.746410+0000","last_active":"2024-09-12T01:08:55.036146+0000","last_peered":"2024-09-12T01:08:55.036146+0000","last_clean":"2024-09-12T01:08:55.036146+0000","last_became_active":"2024-09-12T00:30:14.746119+0000","last_became_peered":"2024-09-12T00:30:14.746119+0000","last_unstale":"2024-09-12T01:08:55.036146+0000","last_undegraded":"2024-09-12T01:08:55.036146+0000","last_fullsized":"2024-09-12T01:08:55.036146+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'39","reported_seq":152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.054928+0000","last_change":"2024-09-12T00:27:42.846588+0000","last_active":"2024-09-12T01:08:50.054928+0000","last_peered":"2024-09-12T01:08:50.054928+0000","last_clean":"2024-09-12T01:08:50.054928+0000","last_became_active":"2024-09-12T00:27:42.846198+0000","last_became_peered":"2024-09-12T00:27:42.846198+0000","last_unstale":"2024-09-12T01:08:50.054928+0000","last_undegraded":"2024-09-12T01:08:50.054928+0000","last_fullsized":"2024-09-12T01:08:50.054928+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":138,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.135933+0000","last_change":"2024-09-12T00:46:54.886148+0000","last_active":"2024-09-12T01:07:55.135933+0000","last_peered":"2024-09-12T01:07:55.135933+0000","last_clean":"2024-09-12T01:07:55.135933+0000","last_became_active":"2024-09-12T00:46:54.885879+0000","last_became_peered":"2024-09-12T00:46:54.885879+0000","last_unstale":"2024-09-12T01:07:55.135933+0000","last_undegraded":"2024-09-12T01:07:55.135933+0000","last_fullsized":"2024-09-12T01:07:55.135933+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:12.855547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"260'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.056483+0000","last_change":"2024-09-12T00:30:17.769299+0000","last_active":"2024-09-12T01:09:00.056483+0000","last_peered":"2024-09-12T01:09:00.056483+0000","last_clean":"2024-09-12T01:09:00.056483+0000","last_became_active":"2024-09-12T00:30:17.769051+0000","last_became_peered":"2024-09-12T00:30:17.769051+0000","last_unstale":"2024-09-12T01:09:00.056483+0000","last_undegraded":"2024-09-12T01:09:00.056483+0000","last_fullsized":"2024-09-12T01:09:00.056483+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'8","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.290293+0000","last_change":"2024-09-12T00:30:14.743361+0000","last_active":"2024-09-12T01:10:59.290293+0000","last_peered":"2024-09-12T01:10:59.290293+0000","last_clean":"2024-09-12T01:10:59.290293+0000","last_became_active":"2024-09-12T00:30:14.743083+0000","last_became_peered":"2024-09-12T00:30:14.743083+0000","last_unstale":"2024-09-12T01:10:59.290293+0000","last_undegraded":"2024-09-12T01:10:59.290293+0000","last_fullsized":"2024-09-12T01:10:59.290293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.054811+0000","last_change":"2024-09-12T00:27:42.839353+0000","last_active":"2024-09-12T01:08:50.054811+0000","last_peered":"2024-09-12T01:08:50.054811+0000","last_clean":"2024-09-12T01:08:50.054811+0000","last_became_active":"2024-09-12T00:27:42.839063+0000","last_became_peered":"2024-09-12T00:27:42.839063+0000","last_unstale":"2024-09-12T01:08:50.054811+0000","last_undegraded":"2024-09-12T01:08:50.054811+0000","last_fullsized":"2024-09-12T01:08:50.054811+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":119,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.029600+0000","last_change":"2024-09-12T00:46:54.887703+0000","last_active":"2024-09-12T01:07:55.029600+0000","last_peered":"2024-09-12T01:07:55.029600+0000","last_clean":"2024-09-12T01:07:55.029600+0000","last_became_active":"2024-09-12T00:46:54.887450+0000","last_became_peered":"2024-09-12T00:46:54.887450+0000","last_unstale":"2024-09-12T01:07:55.029600+0000","last_undegraded":"2024-09-12T01:07:55.029600+0000","last_fullsized":"2024-09-12T01:07:55.029600+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:53.371335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.036719+0000","last_change":"2024-09-12T00:30:17.756613+0000","last_active":"2024-09-12T01:09:00.036719+0000","last_peered":"2024-09-12T01:09:00.036719+0000","last_clean":"2024-09-12T01:09:00.036719+0000","last_became_active":"2024-09-12T00:30:17.756342+0000","last_became_peered":"2024-09-12T00:30:17.756342+0000","last_unstale":"2024-09-12T01:09:00.036719+0000","last_undegraded":"2024-09-12T01:09:00.036719+0000","last_fullsized":"2024-09-12T01:09:00.036719+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.162339+0000","last_change":"2024-09-12T00:30:14.748689+0000","last_active":"2024-09-12T01:11:00.162339+0000","last_peered":"2024-09-12T01:11:00.162339+0000","last_clean":"2024-09-12T01:11:00.162339+0000","last_became_active":"2024-09-12T00:30:14.748446+0000","last_became_peered":"2024-09-12T00:30:14.748446+0000","last_unstale":"2024-09-12T01:11:00.162339+0000","last_undegraded":"2024-09-12T01:11:00.162339+0000","last_fullsized":"2024-09-12T01:11:00.162339+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'23","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.040482+0000","last_change":"2024-09-12T00:27:42.845645+0000","last_active":"2024-09-12T01:07:35.040482+0000","last_peered":"2024-09-12T01:07:35.040482+0000","last_clean":"2024-09-12T01:07:35.040482+0000","last_became_active":"2024-09-12T00:27:42.845379+0000","last_became_peered":"2024-09-12T00:27:42.845379+0000","last_unstale":"2024-09-12T01:07:35.040482+0000","last_undegraded":"2024-09-12T01:07:35.040482+0000","last_fullsized":"2024-09-12T01:07:35.040482+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:35.854841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:43.051253+0000","last_change":"2024-09-12T00:46:54.884019+0000","last_active":"2024-09-12T01:08:43.051253+0000","last_peered":"2024-09-12T01:08:43.051253+0000","last_clean":"2024-09-12T01:08:43.051253+0000","last_became_active":"2024-09-12T00:46:54.883713+0000","last_became_peered":"2024-09-12T00:46:54.883713+0000","last_unstale":"2024-09-12T01:08:43.051253+0000","last_undegraded":"2024-09-12T01:08:43.051253+0000","last_fullsized":"2024-09-12T01:08:43.051253+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'7","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:58.062838+0000","last_change":"2024-09-12T00:30:17.764514+0000","last_active":"2024-09-12T01:09:58.062838+0000","last_peered":"2024-09-12T01:09:58.062838+0000","last_clean":"2024-09-12T01:09:58.062838+0000","last_became_active":"2024-09-12T00:30:17.764165+0000","last_became_peered":"2024-09-12T00:30:17.764165+0000","last_unstale":"2024-09-12T01:09:58.062838+0000","last_undegraded":"2024-09-12T01:09:58.062838+0000","last_fullsized":"2024-09-12T01:09:58.062838+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:16.348051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:55.249102+0000","last_change":"2024-09-12T00:30:14.747500+0000","last_active":"2024-09-12T01:09:55.249102+0000","last_peered":"2024-09-12T01:09:55.249102+0000","last_clean":"2024-09-12T01:09:55.249102+0000","last_became_active":"2024-09-12T00:30:14.747184+0000","last_became_peered":"2024-09-12T00:30:14.747184+0000","last_unstale":"2024-09-12T01:09:55.249102+0000","last_undegraded":"2024-09-12T01:09:55.249102+0000","last_fullsized":"2024-09-12T01:09:55.249102+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:20.436960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'76","reported_seq":299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.039285+0000","last_change":"2024-09-12T00:27:42.846397+0000","last_active":"2024-09-12T01:07:25.039285+0000","last_peered":"2024-09-12T01:07:25.039285+0000","last_clean":"2024-09-12T01:07:25.039285+0000","last_became_active":"2024-09-12T00:27:42.846108+0000","last_became_peered":"2024-09-12T00:27:42.846108+0000","last_unstale":"2024-09-12T01:07:25.039285+0000","last_undegraded":"2024-09-12T01:07:25.039285+0000","last_fullsized":"2024-09-12T01:07:25.039285+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:11.395534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":337,"num_write":98,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.170367+0000","last_change":"2024-09-12T00:46:54.889757+0000","last_active":"2024-09-12T01:08:40.170367+0000","last_peered":"2024-09-12T01:08:40.170367+0000","last_clean":"2024-09-12T01:08:40.170367+0000","last_became_active":"2024-09-12T00:46:54.889496+0000","last_became_peered":"2024-09-12T00:46:54.889496+0000","last_unstale":"2024-09-12T01:08:40.170367+0000","last_undegraded":"2024-09-12T01:08:40.170367+0000","last_fullsized":"2024-09-12T01:08:40.170367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:28.265877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.041215+0000","last_change":"2024-09-12T00:30:17.767918+0000","last_active":"2024-09-12T01:07:38.041215+0000","last_peered":"2024-09-12T01:07:38.041215+0000","last_clean":"2024-09-12T01:07:38.041215+0000","last_became_active":"2024-09-12T00:30:17.767526+0000","last_became_peered":"2024-09-12T00:30:17.767526+0000","last_unstale":"2024-09-12T01:07:38.041215+0000","last_undegraded":"2024-09-12T01:07:38.041215+0000","last_fullsized":"2024-09-12T01:07:38.041215+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:28.500175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:58.062808+0000","last_change":"2024-09-12T00:30:14.749360+0000","last_active":"2024-09-12T01:09:58.062808+0000","last_peered":"2024-09-12T01:09:58.062808+0000","last_clean":"2024-09-12T01:09:58.062808+0000","last_became_active":"2024-09-12T00:30:14.749104+0000","last_became_peered":"2024-09-12T00:30:14.749104+0000","last_unstale":"2024-09-12T01:09:58.062808+0000","last_undegraded":"2024-09-12T01:09:58.062808+0000","last_fullsized":"2024-09-12T01:09:58.062808+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:33.044875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'28","reported_seq":124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.041394+0000","last_change":"2024-09-12T00:27:42.841054+0000","last_active":"2024-09-12T01:07:25.041394+0000","last_peered":"2024-09-12T01:07:25.041394+0000","last_clean":"2024-09-12T01:07:25.041394+0000","last_became_active":"2024-09-12T00:27:42.840749+0000","last_became_peered":"2024-09-12T00:27:42.840749+0000","last_unstale":"2024-09-12T01:07:25.041394+0000","last_undegraded":"2024-09-12T01:07:25.041394+0000","last_fullsized":"2024-09-12T01:07:25.041394+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:58.932432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":101,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.046768+0000","last_change":"2024-09-12T00:46:54.876242+0000","last_active":"2024-09-12T01:08:00.046768+0000","last_peered":"2024-09-12T01:08:00.046768+0000","last_clean":"2024-09-12T01:08:00.046768+0000","last_became_active":"2024-09-12T00:46:54.875939+0000","last_became_peered":"2024-09-12T00:46:54.875939+0000","last_unstale":"2024-09-12T01:08:00.046768+0000","last_undegraded":"2024-09-12T01:08:00.046768+0000","last_fullsized":"2024-09-12T01:08:00.046768+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:39.634295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043775+0000","last_change":"2024-09-12T00:30:17.761490+0000","last_active":"2024-09-12T01:07:40.043775+0000","last_peered":"2024-09-12T01:07:40.043775+0000","last_clean":"2024-09-12T01:07:40.043775+0000","last_became_active":"2024-09-12T00:30:17.761182+0000","last_became_peered":"2024-09-12T00:30:17.761182+0000","last_unstale":"2024-09-12T01:07:40.043775+0000","last_undegraded":"2024-09-12T01:07:40.043775+0000","last_fullsized":"2024-09-12T01:07:40.043775+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:42.070821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.233715+0000","last_change":"2024-09-12T00:30:14.748190+0000","last_active":"2024-09-12T01:07:35.233715+0000","last_peered":"2024-09-12T01:07:35.233715+0000","last_clean":"2024-09-12T01:07:35.233715+0000","last_became_active":"2024-09-12T00:30:14.747887+0000","last_became_peered":"2024-09-12T00:30:14.747887+0000","last_unstale":"2024-09-12T01:07:35.233715+0000","last_undegraded":"2024-09-12T01:07:35.233715+0000","last_fullsized":"2024-09-12T01:07:35.233715+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:51.879862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'76","reported_seq":312,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.132545+0000","last_change":"2024-09-12T00:27:42.839562+0000","last_active":"2024-09-12T01:07:25.132545+0000","last_peered":"2024-09-12T01:07:25.132545+0000","last_clean":"2024-09-12T01:07:25.132545+0000","last_became_active":"2024-09-12T00:27:42.839295+0000","last_became_peered":"2024-09-12T00:27:42.839295+0000","last_unstale":"2024-09-12T01:07:25.132545+0000","last_undegraded":"2024-09-12T01:07:25.132545+0000","last_fullsized":"2024-09-12T01:07:25.132545+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:56.924650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":349,"num_write":102,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.170341+0000","last_change":"2024-09-12T00:46:54.881248+0000","last_active":"2024-09-12T01:08:40.170341+0000","last_peered":"2024-09-12T01:08:40.170341+0000","last_clean":"2024-09-12T01:08:40.170341+0000","last_became_active":"2024-09-12T00:46:54.880982+0000","last_became_peered":"2024-09-12T00:46:54.880982+0000","last_unstale":"2024-09-12T01:08:40.170341+0000","last_undegraded":"2024-09-12T01:08:40.170341+0000","last_fullsized":"2024-09-12T01:08:40.170341+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:32.451032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"263'2","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:00.057885+0000","last_change":"2024-09-12T00:30:17.766356+0000","last_active":"2024-09-12T01:10:00.057885+0000","last_peered":"2024-09-12T01:10:00.057885+0000","last_clean":"2024-09-12T01:10:00.057885+0000","last_became_active":"2024-09-12T00:30:17.765384+0000","last_became_peered":"2024-09-12T00:30:17.765384+0000","last_unstale":"2024-09-12T01:10:00.057885+0000","last_undegraded":"2024-09-12T01:10:00.057885+0000","last_fullsized":"2024-09-12T01:10:00.057885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:48.714095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.936260+0000","last_change":"2024-09-12T00:30:14.750712+0000","last_active":"2024-09-12T01:10:59.936260+0000","last_peered":"2024-09-12T01:10:59.936260+0000","last_clean":"2024-09-12T01:10:59.936260+0000","last_became_active":"2024-09-12T00:30:14.750407+0000","last_became_peered":"2024-09-12T00:30:14.750407+0000","last_unstale":"2024-09-12T01:10:59.936260+0000","last_undegraded":"2024-09-12T01:10:59.936260+0000","last_fullsized":"2024-09-12T01:10:59.936260+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:38.391719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5691,"num_write":6,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'35","reported_seq":146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.041332+0000","last_change":"2024-09-12T00:27:42.840411+0000","last_active":"2024-09-12T01:07:25.041332+0000","last_peered":"2024-09-12T01:07:25.041332+0000","last_clean":"2024-09-12T01:07:25.041332+0000","last_became_active":"2024-09-12T00:27:42.840137+0000","last_became_peered":"2024-09-12T00:27:42.840137+0000","last_unstale":"2024-09-12T01:07:25.041332+0000","last_undegraded":"2024-09-12T01:07:25.041332+0000","last_fullsized":"2024-09-12T01:07:25.041332+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:08.491063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":59,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:43.051166+0000","last_change":"2024-09-12T00:46:54.888517+0000","last_active":"2024-09-12T01:08:43.051166+0000","last_peered":"2024-09-12T01:08:43.051166+0000","last_clean":"2024-09-12T01:08:43.051166+0000","last_became_active":"2024-09-12T00:46:54.888207+0000","last_became_peered":"2024-09-12T00:46:54.888207+0000","last_unstale":"2024-09-12T01:08:43.051166+0000","last_undegraded":"2024-09-12T01:08:43.051166+0000","last_fullsized":"2024-09-12T01:08:43.051166+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:38.971555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'7","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.166733+0000","last_change":"2024-09-12T00:30:17.763396+0000","last_active":"2024-09-12T01:10:59.166733+0000","last_peered":"2024-09-12T01:10:59.166733+0000","last_clean":"2024-09-12T01:10:59.166733+0000","last_became_active":"2024-09-12T00:30:17.763106+0000","last_became_peered":"2024-09-12T00:30:17.763106+0000","last_unstale":"2024-09-12T01:10:59.166733+0000","last_undegraded":"2024-09-12T01:10:59.166733+0000","last_fullsized":"2024-09-12T01:10:59.166733+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:48.609847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'3","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:45.156114+0000","last_change":"2024-09-12T00:30:14.746340+0000","last_active":"2024-09-12T01:10:45.156114+0000","last_peered":"2024-09-12T01:10:45.156114+0000","last_clean":"2024-09-12T01:10:45.156114+0000","last_became_active":"2024-09-12T00:30:14.746069+0000","last_became_peered":"2024-09-12T00:30:14.746069+0000","last_unstale":"2024-09-12T01:10:45.156114+0000","last_undegraded":"2024-09-12T01:10:45.156114+0000","last_fullsized":"2024-09-12T01:10:45.156114+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:13.259839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'41","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.049662+0000","last_change":"2024-09-12T00:27:42.841822+0000","last_active":"2024-09-12T01:08:20.049662+0000","last_peered":"2024-09-12T01:08:20.049662+0000","last_clean":"2024-09-12T01:08:20.049662+0000","last_became_active":"2024-09-12T00:27:42.841530+0000","last_became_peered":"2024-09-12T00:27:42.841530+0000","last_unstale":"2024-09-12T01:08:20.049662+0000","last_undegraded":"2024-09-12T01:08:20.049662+0000","last_fullsized":"2024-09-12T01:08:20.049662+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:31.785686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.231129+0000","last_change":"2024-09-12T00:46:54.886162+0000","last_active":"2024-09-12T01:07:10.231129+0000","last_peered":"2024-09-12T01:07:10.231129+0000","last_clean":"2024-09-12T01:07:10.231129+0000","last_became_active":"2024-09-12T00:46:54.885842+0000","last_became_peered":"2024-09-12T00:46:54.885842+0000","last_unstale":"2024-09-12T01:07:10.231129+0000","last_undegraded":"2024-09-12T01:07:10.231129+0000","last_fullsized":"2024-09-12T01:07:10.231129+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:09.698110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'6","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052277+0000","last_change":"2024-09-12T00:30:17.765752+0000","last_active":"2024-09-12T01:08:35.052277+0000","last_peered":"2024-09-12T01:08:35.052277+0000","last_clean":"2024-09-12T01:08:35.052277+0000","last_became_active":"2024-09-12T00:30:17.765404+0000","last_became_peered":"2024-09-12T00:30:17.765404+0000","last_unstale":"2024-09-12T01:08:35.052277+0000","last_undegraded":"2024-09-12T01:08:35.052277+0000","last_fullsized":"2024-09-12T01:08:35.052277+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:56.259889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.167293+0000","last_change":"2024-09-12T00:30:14.743435+0000","last_active":"2024-09-12T01:08:30.167293+0000","last_peered":"2024-09-12T01:08:30.167293+0000","last_clean":"2024-09-12T01:08:30.167293+0000","last_became_active":"2024-09-12T00:30:14.743148+0000","last_became_peered":"2024-09-12T00:30:14.743148+0000","last_unstale":"2024-09-12T01:08:30.167293+0000","last_undegraded":"2024-09-12T01:08:30.167293+0000","last_fullsized":"2024-09-12T01:08:30.167293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:22.367871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'37","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045203+0000","last_change":"2024-09-12T00:27:42.846410+0000","last_active":"2024-09-12T01:08:15.045203+0000","last_peered":"2024-09-12T01:08:15.045203+0000","last_clean":"2024-09-12T01:08:15.045203+0000","last_became_active":"2024-09-12T00:27:42.846090+0000","last_became_peered":"2024-09-12T00:27:42.846090+0000","last_unstale":"2024-09-12T01:08:15.045203+0000","last_undegraded":"2024-09-12T01:08:15.045203+0000","last_fullsized":"2024-09-12T01:08:15.045203+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:24.133207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":132,"num_write":69,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.047409+0000","last_change":"2024-09-12T00:46:54.883396+0000","last_active":"2024-09-12T01:08:35.047409+0000","last_peered":"2024-09-12T01:08:35.047409+0000","last_clean":"2024-09-12T01:08:35.047409+0000","last_became_active":"2024-09-12T00:46:54.883024+0000","last_became_peered":"2024-09-12T00:46:54.883024+0000","last_unstale":"2024-09-12T01:08:35.047409+0000","last_undegraded":"2024-09-12T01:08:35.047409+0000","last_fullsized":"2024-09-12T01:08:35.047409+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:27.222440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:55.073588+0000","last_change":"2024-09-12T00:30:17.769409+0000","last_active":"2024-09-12T01:10:55.073588+0000","last_peered":"2024-09-12T01:10:55.073588+0000","last_clean":"2024-09-12T01:10:55.073588+0000","last_became_active":"2024-09-12T00:30:17.769226+0000","last_became_peered":"2024-09-12T00:30:17.769226+0000","last_unstale":"2024-09-12T01:10:55.073588+0000","last_undegraded":"2024-09-12T01:10:55.073588+0000","last_fullsized":"2024-09-12T01:10:55.073588+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:53.397913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.051372+0000","last_change":"2024-09-12T00:30:14.741263+0000","last_active":"2024-09-12T01:08:30.051372+0000","last_peered":"2024-09-12T01:08:30.051372+0000","last_clean":"2024-09-12T01:08:30.051372+0000","last_became_active":"2024-09-12T00:30:14.740963+0000","last_became_peered":"2024-09-12T00:30:14.740963+0000","last_unstale":"2024-09-12T01:08:30.051372+0000","last_undegraded":"2024-09-12T01:08:30.051372+0000","last_fullsized":"2024-09-12T01:08:30.051372+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:55.514008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.238012+0000","last_change":"2024-09-12T00:27:42.835227+0000","last_active":"2024-09-12T01:08:15.238012+0000","last_peered":"2024-09-12T01:08:15.238012+0000","last_clean":"2024-09-12T01:08:15.238012+0000","last_became_active":"2024-09-12T00:27:42.834942+0000","last_became_peered":"2024-09-12T00:27:42.834942+0000","last_unstale":"2024-09-12T01:08:15.238012+0000","last_undegraded":"2024-09-12T01:08:15.238012+0000","last_fullsized":"2024-09-12T01:08:15.238012+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:10.179555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":105,"num_write":60,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.240177+0000","last_change":"2024-09-12T00:46:54.888100+0000","last_active":"2024-09-12T01:08:35.240177+0000","last_peered":"2024-09-12T01:08:35.240177+0000","last_clean":"2024-09-12T01:08:35.240177+0000","last_became_active":"2024-09-12T00:46:54.887303+0000","last_became_peered":"2024-09-12T00:46:54.887303+0000","last_unstale":"2024-09-12T01:08:35.240177+0000","last_undegraded":"2024-09-12T01:08:35.240177+0000","last_fullsized":"2024-09-12T01:08:35.240177+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:37.539140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:48.070602+0000","last_change":"2024-09-12T00:30:17.768358+0000","last_active":"2024-09-12T01:10:48.070602+0000","last_peered":"2024-09-12T01:10:48.070602+0000","last_clean":"2024-09-12T01:10:48.070602+0000","last_became_active":"2024-09-12T00:30:17.768072+0000","last_became_peered":"2024-09-12T00:30:17.768072+0000","last_unstale":"2024-09-12T01:10:48.070602+0000","last_undegraded":"2024-09-12T01:10:48.070602+0000","last_fullsized":"2024-09-12T01:10:48.070602+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:13.328589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:50.072901+0000","last_change":"2024-09-12T00:30:14.744984+0000","last_active":"2024-09-12T01:10:50.072901+0000","last_peered":"2024-09-12T01:10:50.072901+0000","last_clean":"2024-09-12T01:10:50.072901+0000","last_became_active":"2024-09-12T00:30:14.744485+0000","last_became_peered":"2024-09-12T00:30:14.744485+0000","last_unstale":"2024-09-12T01:10:50.072901+0000","last_undegraded":"2024-09-12T01:10:50.072901+0000","last_fullsized":"2024-09-12T01:10:50.072901+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:02.930319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'50","reported_seq":195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165137+0000","last_change":"2024-09-12T00:27:42.839068+0000","last_active":"2024-09-12T01:08:15.165137+0000","last_peered":"2024-09-12T01:08:15.165137+0000","last_clean":"2024-09-12T01:08:15.165137+0000","last_became_active":"2024-09-12T00:27:42.838771+0000","last_became_peered":"2024-09-12T00:27:42.838771+0000","last_unstale":"2024-09-12T01:08:15.165137+0000","last_undegraded":"2024-09-12T01:08:15.165137+0000","last_fullsized":"2024-09-12T01:08:15.165137+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:39.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":194,"num_write":94,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:13.037715+0000","last_change":"2024-09-12T00:46:54.884379+0000","last_active":"2024-09-12T01:07:13.037715+0000","last_peered":"2024-09-12T01:07:13.037715+0000","last_clean":"2024-09-12T01:07:13.037715+0000","last_became_active":"2024-09-12T00:46:54.883927+0000","last_became_peered":"2024-09-12T00:46:54.883927+0000","last_unstale":"2024-09-12T01:07:13.037715+0000","last_undegraded":"2024-09-12T01:07:13.037715+0000","last_fullsized":"2024-09-12T01:07:13.037715+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:13.845718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'2","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.053093+0000","last_change":"2024-09-12T00:30:17.761674+0000","last_active":"2024-09-12T01:09:20.053093+0000","last_peered":"2024-09-12T01:09:20.053093+0000","last_clean":"2024-09-12T01:09:20.053093+0000","last_became_active":"2024-09-12T00:30:17.761176+0000","last_became_peered":"2024-09-12T00:30:17.761176+0000","last_unstale":"2024-09-12T01:09:20.053093+0000","last_undegraded":"2024-09-12T01:09:20.053093+0000","last_fullsized":"2024-09-12T01:09:20.053093+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:01.925976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.309670+0000","last_change":"2024-09-12T00:30:14.744748+0000","last_active":"2024-09-12T01:10:58.309670+0000","last_peered":"2024-09-12T01:10:58.309670+0000","last_clean":"2024-09-12T01:10:58.309670+0000","last_became_active":"2024-09-12T00:30:14.743730+0000","last_became_peered":"2024-09-12T00:30:14.743730+0000","last_unstale":"2024-09-12T01:10:58.309670+0000","last_undegraded":"2024-09-12T01:10:58.309670+0000","last_fullsized":"2024-09-12T01:10:58.309670+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'40","reported_seq":161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.165081+0000","last_change":"2024-09-12T00:27:42.842498+0000","last_active":"2024-09-12T01:08:15.165081+0000","last_peered":"2024-09-12T01:08:15.165081+0000","last_clean":"2024-09-12T01:08:15.165081+0000","last_became_active":"2024-09-12T00:27:42.842267+0000","last_became_peered":"2024-09-12T00:27:42.842267+0000","last_unstale":"2024-09-12T01:08:15.165081+0000","last_undegraded":"2024-09-12T01:08:15.165081+0000","last_fullsized":"2024-09-12T01:08:15.165081+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:13.278076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":155,"num_write":62,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:15.131566+0000","last_change":"2024-09-12T00:46:54.889599+0000","last_active":"2024-09-12T01:07:15.131566+0000","last_peered":"2024-09-12T01:07:15.131566+0000","last_clean":"2024-09-12T01:07:15.131566+0000","last_became_active":"2024-09-12T00:46:54.889349+0000","last_became_peered":"2024-09-12T00:46:54.889349+0000","last_unstale":"2024-09-12T01:07:15.131566+0000","last_undegraded":"2024-09-12T01:07:15.131566+0000","last_fullsized":"2024-09-12T01:07:15.131566+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:02.442642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.130933+0000","last_change":"2024-09-12T00:30:17.760081+0000","last_active":"2024-09-12T01:07:10.130933+0000","last_peered":"2024-09-12T01:07:10.130933+0000","last_clean":"2024-09-12T01:07:10.130933+0000","last_became_active":"2024-09-12T00:30:17.759769+0000","last_became_peered":"2024-09-12T00:30:17.759769+0000","last_unstale":"2024-09-12T01:07:10.130933+0000","last_undegraded":"2024-09-12T01:07:10.130933+0000","last_fullsized":"2024-09-12T01:07:10.130933+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:22.158179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:08.036968+0000","last_change":"2024-09-12T00:30:14.748668+0000","last_active":"2024-09-12T01:07:08.036968+0000","last_peered":"2024-09-12T01:07:08.036968+0000","last_clean":"2024-09-12T01:07:08.036968+0000","last_became_active":"2024-09-12T00:30:14.748409+0000","last_became_peered":"2024-09-12T00:30:14.748409+0000","last_unstale":"2024-09-12T01:07:08.036968+0000","last_undegraded":"2024-09-12T01:07:08.036968+0000","last_fullsized":"2024-09-12T01:07:08.036968+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:15.762806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'24","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.143313+0000","last_change":"2024-09-12T00:27:42.844619+0000","last_active":"2024-09-12T01:09:00.143313+0000","last_peered":"2024-09-12T01:09:00.143313+0000","last_clean":"2024-09-12T01:09:00.143313+0000","last_became_active":"2024-09-12T00:27:42.844338+0000","last_became_peered":"2024-09-12T00:27:42.844338+0000","last_unstale":"2024-09-12T01:09:00.143313+0000","last_undegraded":"2024-09-12T01:09:00.143313+0000","last_fullsized":"2024-09-12T01:09:00.143313+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":85,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.024797+0000","last_change":"2024-09-12T00:46:54.890993+0000","last_active":"2024-09-12T01:07:10.024797+0000","last_peered":"2024-09-12T01:07:10.024797+0000","last_clean":"2024-09-12T01:07:10.024797+0000","last_became_active":"2024-09-12T00:46:54.890636+0000","last_became_peered":"2024-09-12T00:46:54.890636+0000","last_unstale":"2024-09-12T01:07:10.024797+0000","last_undegraded":"2024-09-12T01:07:10.024797+0000","last_fullsized":"2024-09-12T01:07:10.024797+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:05.237293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.169493+0000","last_change":"2024-09-12T00:30:17.762552+0000","last_active":"2024-09-12T01:08:35.169493+0000","last_peered":"2024-09-12T01:08:35.169493+0000","last_clean":"2024-09-12T01:08:35.169493+0000","last_became_active":"2024-09-12T00:30:17.762239+0000","last_became_peered":"2024-09-12T00:30:17.762239+0000","last_unstale":"2024-09-12T01:08:35.169493+0000","last_undegraded":"2024-09-12T01:08:35.169493+0000","last_fullsized":"2024-09-12T01:08:35.169493+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:41.552516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'11","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.552613+0000","last_change":"2024-09-12T00:30:14.751029+0000","last_active":"2024-09-12T01:10:58.552613+0000","last_peered":"2024-09-12T01:10:58.552613+0000","last_clean":"2024-09-12T01:10:58.552613+0000","last_became_active":"2024-09-12T00:30:14.750745+0000","last_became_peered":"2024-09-12T00:30:14.750745+0000","last_unstale":"2024-09-12T01:10:58.552613+0000","last_undegraded":"2024-09-12T01:10:58.552613+0000","last_fullsized":"2024-09-12T01:10:58.552613+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:09.884275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12861,"num_write":16,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.052980+0000","last_change":"2024-09-12T00:27:42.837910+0000","last_active":"2024-09-12T01:08:53.052980+0000","last_peered":"2024-09-12T01:08:53.052980+0000","last_clean":"2024-09-12T01:08:53.052980+0000","last_became_active":"2024-09-12T00:27:42.837690+0000","last_became_peered":"2024-09-12T00:27:42.837690+0000","last_unstale":"2024-09-12T01:08:53.052980+0000","last_undegraded":"2024-09-12T01:08:53.052980+0000","last_fullsized":"2024-09-12T01:08:53.052980+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:00.171095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.038780+0000","last_change":"2024-09-12T00:46:54.885537+0000","last_active":"2024-09-12T01:07:10.038780+0000","last_peered":"2024-09-12T01:07:10.038780+0000","last_clean":"2024-09-12T01:07:10.038780+0000","last_became_active":"2024-09-12T00:46:54.885262+0000","last_became_peered":"2024-09-12T00:46:54.885262+0000","last_unstale":"2024-09-12T01:07:10.038780+0000","last_undegraded":"2024-09-12T01:07:10.038780+0000","last_fullsized":"2024-09-12T01:07:10.038780+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:34.916083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'7","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.026327+0000","last_change":"2024-09-12T00:30:17.761394+0000","last_active":"2024-09-12T01:07:25.026327+0000","last_peered":"2024-09-12T01:07:25.026327+0000","last_clean":"2024-09-12T01:07:25.026327+0000","last_became_active":"2024-09-12T00:30:17.761071+0000","last_became_peered":"2024-09-12T00:30:17.761071+0000","last_unstale":"2024-09-12T01:07:25.026327+0000","last_undegraded":"2024-09-12T01:07:25.026327+0000","last_fullsized":"2024-09-12T01:07:25.026327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:56.989395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.046932+0000","last_change":"2024-09-12T00:30:14.750202+0000","last_active":"2024-09-12T01:08:30.046932+0000","last_peered":"2024-09-12T01:08:30.046932+0000","last_clean":"2024-09-12T01:08:30.046932+0000","last_became_active":"2024-09-12T00:30:14.749906+0000","last_became_peered":"2024-09-12T00:30:14.749906+0000","last_unstale":"2024-09-12T01:08:30.046932+0000","last_undegraded":"2024-09-12T01:08:30.046932+0000","last_fullsized":"2024-09-12T01:08:30.046932+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:25.050487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'11","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.036018+0000","last_change":"2024-09-12T00:27:42.837136+0000","last_active":"2024-09-12T01:08:55.036018+0000","last_peered":"2024-09-12T01:08:55.036018+0000","last_clean":"2024-09-12T01:08:55.036018+0000","last_became_active":"2024-09-12T00:27:42.836870+0000","last_became_peered":"2024-09-12T00:27:42.836870+0000","last_unstale":"2024-09-12T01:08:55.036018+0000","last_undegraded":"2024-09-12T01:08:55.036018+0000","last_fullsized":"2024-09-12T01:08:55.036018+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.028516+0000","last_change":"2024-09-12T00:46:54.891625+0000","last_active":"2024-09-12T01:07:45.028516+0000","last_peered":"2024-09-12T01:07:45.028516+0000","last_clean":"2024-09-12T01:07:45.028516+0000","last_became_active":"2024-09-12T00:46:54.891359+0000","last_became_peered":"2024-09-12T00:46:54.891359+0000","last_unstale":"2024-09-12T01:07:45.028516+0000","last_undegraded":"2024-09-12T01:07:45.028516+0000","last_fullsized":"2024-09-12T01:07:45.028516+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:36.674826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:03.063577+0000","last_change":"2024-09-12T00:30:17.767137+0000","last_active":"2024-09-12T01:10:03.063577+0000","last_peered":"2024-09-12T01:10:03.063577+0000","last_clean":"2024-09-12T01:10:03.063577+0000","last_became_active":"2024-09-12T00:30:17.766810+0000","last_became_peered":"2024-09-12T00:30:17.766810+0000","last_unstale":"2024-09-12T01:10:03.063577+0000","last_undegraded":"2024-09-12T01:10:03.063577+0000","last_fullsized":"2024-09-12T01:10:03.063577+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:50.589394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041701+0000","last_change":"2024-09-12T00:30:14.744674+0000","last_active":"2024-09-12T01:07:45.041701+0000","last_peered":"2024-09-12T01:07:45.041701+0000","last_clean":"2024-09-12T01:07:45.041701+0000","last_became_active":"2024-09-12T00:30:14.744334+0000","last_became_peered":"2024-09-12T00:30:14.744334+0000","last_unstale":"2024-09-12T01:07:45.041701+0000","last_undegraded":"2024-09-12T01:07:45.041701+0000","last_fullsized":"2024-09-12T01:07:45.041701+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:58.360546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":168,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.055761+0000","last_change":"2024-09-12T00:27:42.836761+0000","last_active":"2024-09-12T01:08:55.055761+0000","last_peered":"2024-09-12T01:08:55.055761+0000","last_clean":"2024-09-12T01:08:55.055761+0000","last_became_active":"2024-09-12T00:27:42.836468+0000","last_became_peered":"2024-09-12T00:27:42.836468+0000","last_unstale":"2024-09-12T01:08:55.055761+0000","last_undegraded":"2024-09-12T01:08:55.055761+0000","last_fullsized":"2024-09-12T01:08:55.055761+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:01.432222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":155,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.028541+0000","last_change":"2024-09-12T00:46:54.888800+0000","last_active":"2024-09-12T01:07:45.028541+0000","last_peered":"2024-09-12T01:07:45.028541+0000","last_clean":"2024-09-12T01:07:45.028541+0000","last_became_active":"2024-09-12T00:46:54.888533+0000","last_became_peered":"2024-09-12T00:46:54.888533+0000","last_unstale":"2024-09-12T01:07:45.028541+0000","last_undegraded":"2024-09-12T01:07:45.028541+0000","last_fullsized":"2024-09-12T01:07:45.028541+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:16.016312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:53.061966+0000","last_change":"2024-09-12T00:30:17.766100+0000","last_active":"2024-09-12T01:09:53.061966+0000","last_peered":"2024-09-12T01:09:53.061966+0000","last_clean":"2024-09-12T01:09:53.061966+0000","last_became_active":"2024-09-12T00:30:17.764747+0000","last_became_peered":"2024-09-12T00:30:17.764747+0000","last_unstale":"2024-09-12T01:09:53.061966+0000","last_undegraded":"2024-09-12T01:09:53.061966+0000","last_fullsized":"2024-09-12T01:09:53.061966+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:28.017911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045464+0000","last_change":"2024-09-12T00:30:14.750085+0000","last_active":"2024-09-12T01:07:50.045464+0000","last_peered":"2024-09-12T01:07:50.045464+0000","last_clean":"2024-09-12T01:07:50.045464+0000","last_became_active":"2024-09-12T00:30:14.749668+0000","last_became_peered":"2024-09-12T00:30:14.749668+0000","last_unstale":"2024-09-12T01:07:50.045464+0000","last_undegraded":"2024-09-12T01:07:50.045464+0000","last_fullsized":"2024-09-12T01:07:50.045464+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:46.909054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'44","reported_seq":170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.049812+0000","last_change":"2024-09-12T00:27:42.846229+0000","last_active":"2024-09-12T01:08:55.049812+0000","last_peered":"2024-09-12T01:08:55.049812+0000","last_clean":"2024-09-12T01:08:55.049812+0000","last_became_active":"2024-09-12T00:27:42.845963+0000","last_became_peered":"2024-09-12T00:27:42.845963+0000","last_unstale":"2024-09-12T01:08:55.049812+0000","last_undegraded":"2024-09-12T01:08:55.049812+0000","last_fullsized":"2024-09-12T01:08:55.049812+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":173,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.054456+0000","last_change":"2024-09-12T00:46:54.885230+0000","last_active":"2024-09-12T01:09:03.054456+0000","last_peered":"2024-09-12T01:09:03.054456+0000","last_clean":"2024-09-12T01:09:03.054456+0000","last_became_active":"2024-09-12T00:46:54.884950+0000","last_became_peered":"2024-09-12T00:46:54.884950+0000","last_unstale":"2024-09-12T01:09:03.054456+0000","last_undegraded":"2024-09-12T01:09:03.054456+0000","last_fullsized":"2024-09-12T01:09:03.054456+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:05.858636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.039122+0000","last_change":"2024-09-12T00:30:17.762675+0000","last_active":"2024-09-12T01:09:20.039122+0000","last_peered":"2024-09-12T01:09:20.039122+0000","last_clean":"2024-09-12T01:09:20.039122+0000","last_became_active":"2024-09-12T00:30:17.762415+0000","last_became_peered":"2024-09-12T00:30:17.762415+0000","last_unstale":"2024-09-12T01:09:20.039122+0000","last_undegraded":"2024-09-12T01:09:20.039122+0000","last_fullsized":"2024-09-12T01:09:20.039122+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:08.499844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'6","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.308694+0000","last_change":"2024-09-12T00:30:14.748878+0000","last_active":"2024-09-12T01:10:58.308694+0000","last_peered":"2024-09-12T01:10:58.308694+0000","last_clean":"2024-09-12T01:10:58.308694+0000","last_became_active":"2024-09-12T00:30:14.748581+0000","last_became_peered":"2024-09-12T00:30:14.748581+0000","last_unstale":"2024-09-12T01:10:58.308694+0000","last_undegraded":"2024-09-12T01:10:58.308694+0000","last_fullsized":"2024-09-12T01:10:58.308694+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.132599+0000","last_change":"2024-09-12T00:27:42.844241+0000","last_active":"2024-09-12T01:07:25.132599+0000","last_peered":"2024-09-12T01:07:25.132599+0000","last_clean":"2024-09-12T01:07:25.132599+0000","last_became_active":"2024-09-12T00:27:42.843968+0000","last_became_peered":"2024-09-12T00:27:42.843968+0000","last_unstale":"2024-09-12T01:07:25.132599+0000","last_undegraded":"2024-09-12T01:07:25.132599+0000","last_fullsized":"2024-09-12T01:07:25.132599+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:47.646443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":171,"num_write":76,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041617+0000","last_change":"2024-09-12T00:46:54.881183+0000","last_active":"2024-09-12T01:07:45.041617+0000","last_peered":"2024-09-12T01:07:45.041617+0000","last_clean":"2024-09-12T01:07:45.041617+0000","last_became_active":"2024-09-12T00:46:54.880874+0000","last_became_peered":"2024-09-12T00:46:54.880874+0000","last_unstale":"2024-09-12T01:07:45.041617+0000","last_undegraded":"2024-09-12T01:07:45.041617+0000","last_fullsized":"2024-09-12T01:07:45.041617+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:52.663395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:10.037704+0000","last_change":"2024-09-12T00:30:17.764321+0000","last_active":"2024-09-12T01:07:10.037704+0000","last_peered":"2024-09-12T01:07:10.037704+0000","last_clean":"2024-09-12T01:07:10.037704+0000","last_became_active":"2024-09-12T00:30:17.762807+0000","last_became_peered":"2024-09-12T00:30:17.762807+0000","last_unstale":"2024-09-12T01:07:10.037704+0000","last_undegraded":"2024-09-12T01:07:10.037704+0000","last_fullsized":"2024-09-12T01:07:10.037704+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:22.911043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.551446+0000","last_change":"2024-09-12T00:30:14.750078+0000","last_active":"2024-09-12T01:10:58.551446+0000","last_peered":"2024-09-12T01:10:58.551446+0000","last_clean":"2024-09-12T01:10:58.551446+0000","last_became_active":"2024-09-12T00:30:14.749608+0000","last_became_peered":"2024-09-12T00:30:14.749608+0000","last_unstale":"2024-09-12T01:10:58.551446+0000","last_undegraded":"2024-09-12T01:10:58.551446+0000","last_fullsized":"2024-09-12T01:10:58.551446+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'41","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.040525+0000","last_change":"2024-09-12T00:27:42.846138+0000","last_active":"2024-09-12T01:07:20.040525+0000","last_peered":"2024-09-12T01:07:20.040525+0000","last_clean":"2024-09-12T01:07:20.040525+0000","last_became_active":"2024-09-12T00:27:42.845889+0000","last_became_peered":"2024-09-12T00:27:42.845889+0000","last_unstale":"2024-09-12T01:07:20.040525+0000","last_undegraded":"2024-09-12T01:07:20.040525+0000","last_fullsized":"2024-09-12T01:07:20.040525+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:08.298324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":162,"num_write":61,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052331+0000","last_change":"2024-09-12T00:46:54.887517+0000","last_active":"2024-09-12T01:08:35.052331+0000","last_peered":"2024-09-12T01:08:35.052331+0000","last_clean":"2024-09-12T01:08:35.052331+0000","last_became_active":"2024-09-12T00:46:54.887206+0000","last_became_peered":"2024-09-12T00:46:54.887206+0000","last_unstale":"2024-09-12T01:08:35.052331+0000","last_undegraded":"2024-09-12T01:08:35.052331+0000","last_fullsized":"2024-09-12T01:08:35.052331+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:31.785829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045384+0000","last_change":"2024-09-12T00:30:17.768384+0000","last_active":"2024-09-12T01:07:50.045384+0000","last_peered":"2024-09-12T01:07:50.045384+0000","last_clean":"2024-09-12T01:07:50.045384+0000","last_became_active":"2024-09-12T00:30:17.767990+0000","last_became_peered":"2024-09-12T00:30:17.767990+0000","last_unstale":"2024-09-12T01:07:50.045384+0000","last_undegraded":"2024-09-12T01:07:50.045384+0000","last_fullsized":"2024-09-12T01:07:50.045384+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:34.324472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"263'2","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:20.152715+0000","last_change":"2024-09-12T00:30:14.745501+0000","last_active":"2024-09-12T01:10:20.152715+0000","last_peered":"2024-09-12T01:10:20.152715+0000","last_clean":"2024-09-12T01:10:20.152715+0000","last_became_active":"2024-09-12T00:30:14.745195+0000","last_became_peered":"2024-09-12T00:30:14.745195+0000","last_unstale":"2024-09-12T01:10:20.152715+0000","last_undegraded":"2024-09-12T01:10:20.152715+0000","last_fullsized":"2024-09-12T01:10:20.152715+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:05.190444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'32","reported_seq":131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.132064+0000","last_change":"2024-09-12T00:27:42.844201+0000","last_active":"2024-09-12T01:07:20.132064+0000","last_peered":"2024-09-12T01:07:20.132064+0000","last_clean":"2024-09-12T01:07:20.132064+0000","last_became_active":"2024-09-12T00:27:42.843841+0000","last_became_peered":"2024-09-12T00:27:42.843841+0000","last_unstale":"2024-09-12T01:07:20.132064+0000","last_undegraded":"2024-09-12T01:07:20.132064+0000","last_fullsized":"2024-09-12T01:07:20.132064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:33.474512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":99,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052355+0000","last_change":"2024-09-12T00:46:54.884403+0000","last_active":"2024-09-12T01:08:35.052355+0000","last_peered":"2024-09-12T01:08:35.052355+0000","last_clean":"2024-09-12T01:08:35.052355+0000","last_became_active":"2024-09-12T00:46:54.884110+0000","last_became_peered":"2024-09-12T00:46:54.884110+0000","last_unstale":"2024-09-12T01:08:35.052355+0000","last_undegraded":"2024-09-12T01:08:35.052355+0000","last_fullsized":"2024-09-12T01:08:35.052355+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:54.447390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.724327+0000","last_change":"2024-09-12T00:30:17.763239+0000","last_active":"2024-09-12T01:10:58.724327+0000","last_peered":"2024-09-12T01:10:58.724327+0000","last_clean":"2024-09-12T01:10:58.724327+0000","last_became_active":"2024-09-12T00:30:17.762850+0000","last_became_peered":"2024-09-12T00:30:17.762850+0000","last_unstale":"2024-09-12T01:10:58.724327+0000","last_undegraded":"2024-09-12T01:10:58.724327+0000","last_fullsized":"2024-09-12T01:10:58.724327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:27.977927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'10","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.365202+0000","last_change":"2024-09-12T00:30:14.736582+0000","last_active":"2024-09-12T01:10:58.365202+0000","last_peered":"2024-09-12T01:10:58.365202+0000","last_clean":"2024-09-12T01:10:58.365202+0000","last_became_active":"2024-09-12T00:30:14.736286+0000","last_became_peered":"2024-09-12T00:30:14.736286+0000","last_unstale":"2024-09-12T01:10:58.365202+0000","last_undegraded":"2024-09-12T01:10:58.365202+0000","last_fullsized":"2024-09-12T01:10:58.365202+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:21.074121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":20,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'42","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.038717+0000","last_change":"2024-09-12T00:27:42.842160+0000","last_active":"2024-09-12T01:07:20.038717+0000","last_peered":"2024-09-12T01:07:20.038717+0000","last_clean":"2024-09-12T01:07:20.038717+0000","last_became_active":"2024-09-12T00:27:42.841880+0000","last_became_peered":"2024-09-12T00:27:42.841880+0000","last_unstale":"2024-09-12T01:07:20.038717+0000","last_undegraded":"2024-09-12T01:07:20.038717+0000","last_fullsized":"2024-09-12T01:07:20.038717+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:58.218462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":149,"num_write":77,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042872+0000","last_change":"2024-09-12T00:46:54.887508+0000","last_active":"2024-09-12T01:07:48.042872+0000","last_peered":"2024-09-12T01:07:48.042872+0000","last_clean":"2024-09-12T01:07:48.042872+0000","last_became_active":"2024-09-12T00:46:54.887241+0000","last_became_peered":"2024-09-12T00:46:54.887241+0000","last_unstale":"2024-09-12T01:07:48.042872+0000","last_undegraded":"2024-09-12T01:07:48.042872+0000","last_fullsized":"2024-09-12T01:07:48.042872+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:05.592034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135434+0000","last_change":"2024-09-12T00:30:17.763748+0000","last_active":"2024-09-12T01:07:50.135434+0000","last_peered":"2024-09-12T01:07:50.135434+0000","last_clean":"2024-09-12T01:07:50.135434+0000","last_became_active":"2024-09-12T00:30:17.763434+0000","last_became_peered":"2024-09-12T00:30:17.763434+0000","last_unstale":"2024-09-12T01:07:50.135434+0000","last_undegraded":"2024-09-12T01:07:50.135434+0000","last_fullsized":"2024-09-12T01:07:50.135434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:35.178500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.160616+0000","last_change":"2024-09-12T00:30:14.745243+0000","last_active":"2024-09-12T01:07:45.160616+0000","last_peered":"2024-09-12T01:07:45.160616+0000","last_clean":"2024-09-12T01:07:45.160616+0000","last_became_active":"2024-09-12T00:30:14.744954+0000","last_became_peered":"2024-09-12T00:30:14.744954+0000","last_unstale":"2024-09-12T01:07:45.160616+0000","last_undegraded":"2024-09-12T01:07:45.160616+0000","last_fullsized":"2024-09-12T01:07:45.160616+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:54.776721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'51","reported_seq":181,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:20.038684+0000","last_change":"2024-09-12T00:27:42.843112+0000","last_active":"2024-09-12T01:07:20.038684+0000","last_peered":"2024-09-12T01:07:20.038684+0000","last_clean":"2024-09-12T01:07:20.038684+0000","last_became_active":"2024-09-12T00:27:42.842779+0000","last_became_peered":"2024-09-12T00:27:42.842779+0000","last_unstale":"2024-09-12T01:07:20.038684+0000","last_undegraded":"2024-09-12T01:07:20.038684+0000","last_fullsized":"2024-09-12T01:07:20.038684+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:44.649308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":161,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.042278+0000","last_change":"2024-09-12T00:46:54.882461+0000","last_active":"2024-09-12T01:07:50.042278+0000","last_peered":"2024-09-12T01:07:50.042278+0000","last_clean":"2024-09-12T01:07:50.042278+0000","last_became_active":"2024-09-12T00:46:54.882192+0000","last_became_peered":"2024-09-12T00:46:54.882192+0000","last_unstale":"2024-09-12T01:07:50.042278+0000","last_undegraded":"2024-09-12T01:07:50.042278+0000","last_fullsized":"2024-09-12T01:07:50.042278+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:45.883428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'6","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.604105+0000","last_change":"2024-09-12T00:30:17.758495+0000","last_active":"2024-09-12T01:10:58.604105+0000","last_peered":"2024-09-12T01:10:58.604105+0000","last_clean":"2024-09-12T01:10:58.604105+0000","last_became_active":"2024-09-12T00:30:17.756710+0000","last_became_peered":"2024-09-12T00:30:17.756710+0000","last_unstale":"2024-09-12T01:10:58.604105+0000","last_undegraded":"2024-09-12T01:10:58.604105+0000","last_fullsized":"2024-09-12T01:10:58.604105+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:26.589681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'5","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.239757+0000","last_change":"2024-09-12T00:30:14.749818+0000","last_active":"2024-09-12T01:10:58.239757+0000","last_peered":"2024-09-12T01:10:58.239757+0000","last_clean":"2024-09-12T01:10:58.239757+0000","last_became_active":"2024-09-12T00:30:14.749353+0000","last_became_peered":"2024-09-12T00:30:14.749353+0000","last_unstale":"2024-09-12T01:10:58.239757+0000","last_undegraded":"2024-09-12T01:10:58.239757+0000","last_fullsized":"2024-09-12T01:10:58.239757+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:18.846302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'16","reported_seq":96,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.135384+0000","last_change":"2024-09-12T00:27:42.846318+0000","last_active":"2024-09-12T01:07:50.135384+0000","last_peered":"2024-09-12T01:07:50.135384+0000","last_clean":"2024-09-12T01:07:50.135384+0000","last_became_active":"2024-09-12T00:27:42.846065+0000","last_became_peered":"2024-09-12T00:27:42.846065+0000","last_unstale":"2024-09-12T01:07:50.135384+0000","last_undegraded":"2024-09-12T01:07:50.135384+0000","last_fullsized":"2024-09-12T01:07:50.135384+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:12.594329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":60,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'368","reported_seq":1044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.199577+0000","last_change":"2024-09-12T01:11:13.199577+0000","last_active":"2024-09-12T01:11:13.199577+0000","last_peered":"2024-09-12T01:11:13.199577+0000","last_clean":"2024-09-12T01:11:13.199577+0000","last_became_active":"2024-09-12T00:12:36.041803+0000","last_became_peered":"2024-09-12T00:12:36.041803+0000","last_unstale":"2024-09-12T01:11:13.199577+0000","last_undegraded":"2024-09-12T01:11:13.199577+0000","last_fullsized":"2024-09-12T01:11:13.199577+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'368","last_scrub_stamp":"2024-09-12T01:11:13.199449+0000","last_deep_scrub":"263'368","last_deep_scrub_stamp":"2024-09-12T01:11:13.199449+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.199449+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:26.747669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48825,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":31202,"num_write":1169,"num_write_kb":36538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'78","reported_seq":677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.245203+0000","last_change":"2024-09-12T01:11:18.245203+0000","last_active":"2024-09-12T01:11:18.245203+0000","last_peered":"2024-09-12T01:11:18.245203+0000","last_clean":"2024-09-12T01:11:18.245203+0000","last_became_active":"2024-09-12T00:12:38.035848+0000","last_became_peered":"2024-09-12T00:12:38.035848+0000","last_unstale":"2024-09-12T01:11:18.245203+0000","last_undegraded":"2024-09-12T01:11:18.245203+0000","last_fullsized":"2024-09-12T01:11:18.245203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'78","last_scrub_stamp":"2024-09-12T01:11:18.245112+0000","last_deep_scrub":"263'78","last_deep_scrub_stamp":"2024-09-12T01:11:18.245112+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.245112+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:00.565463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":321,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'468","reported_seq":1249,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.840938+0000","last_change":"2024-09-12T01:11:17.840938+0000","last_active":"2024-09-12T01:11:17.840938+0000","last_peered":"2024-09-12T01:11:17.840938+0000","last_clean":"2024-09-12T01:11:17.840938+0000","last_became_active":"2024-09-12T00:12:36.045325+0000","last_became_peered":"2024-09-12T00:12:36.045325+0000","last_unstale":"2024-09-12T01:11:17.840938+0000","last_undegraded":"2024-09-12T01:11:17.840938+0000","last_fullsized":"2024-09-12T01:11:17.840938+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'468","last_scrub_stamp":"2024-09-12T01:11:17.840763+0000","last_deep_scrub":"263'468","last_deep_scrub_stamp":"2024-09-12T01:11:17.840763+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.840763+0000","objects_scrubbed":10,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:41.998542+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6448752,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1044,"num_read_kb":48846,"num_write":1428,"num_write_kb":45958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'64","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.041016+0000","last_change":"2024-09-12T00:12:38.041199+0000","last_active":"2024-09-12T01:07:40.041016+0000","last_peered":"2024-09-12T01:07:40.041016+0000","last_clean":"2024-09-12T01:07:40.041016+0000","last_became_active":"2024-09-12T00:12:38.040122+0000","last_became_peered":"2024-09-12T00:12:38.040122+0000","last_unstale":"2024-09-12T01:07:40.041016+0000","last_undegraded":"2024-09-12T01:07:40.041016+0000","last_fullsized":"2024-09-12T01:07:40.041016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:46.078316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":259,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'346","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.861951+0000","last_change":"2024-09-12T01:11:16.861951+0000","last_active":"2024-09-12T01:11:16.861951+0000","last_peered":"2024-09-12T01:11:16.861951+0000","last_clean":"2024-09-12T01:11:16.861951+0000","last_became_active":"2024-09-12T00:12:36.039741+0000","last_became_peered":"2024-09-12T00:12:36.039741+0000","last_unstale":"2024-09-12T01:11:16.861951+0000","last_undegraded":"2024-09-12T01:11:16.861951+0000","last_fullsized":"2024-09-12T01:11:16.861951+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-12T01:11:16.861851+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-12T01:11:16.861851+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.861851+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:47.559046+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262217,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":26393,"num_write":1030,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'307","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.041068+0000","last_change":"2024-09-12T00:12:38.042224+0000","last_active":"2024-09-12T01:07:40.041068+0000","last_peered":"2024-09-12T01:07:40.041068+0000","last_clean":"2024-09-12T01:07:40.041068+0000","last_became_active":"2024-09-12T00:12:38.041795+0000","last_became_peered":"2024-09-12T00:12:38.041795+0000","last_unstale":"2024-09-12T01:07:40.041068+0000","last_undegraded":"2024-09-12T01:07:40.041068+0000","last_fullsized":"2024-09-12T01:07:40.041068+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:58.089809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1291,"num_read_kb":1053,"num_write":447,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'403","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.179422+0000","last_change":"2024-09-12T01:11:07.179422+0000","last_active":"2024-09-12T01:11:07.179422+0000","last_peered":"2024-09-12T01:11:07.179422+0000","last_clean":"2024-09-12T01:11:07.179422+0000","last_became_active":"2024-09-12T00:12:36.036970+0000","last_became_peered":"2024-09-12T00:12:36.036970+0000","last_unstale":"2024-09-12T01:11:07.179422+0000","last_undegraded":"2024-09-12T01:11:07.179422+0000","last_fullsized":"2024-09-12T01:11:07.179422+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-12T01:11:07.179336+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-12T01:11:07.179336+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.179336+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:19.036143+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":29211,"num_write":1250,"num_write_kb":52081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'61","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.432667+0000","last_change":"2024-09-12T01:11:22.432667+0000","last_active":"2024-09-12T01:11:22.432667+0000","last_peered":"2024-09-12T01:11:22.432667+0000","last_clean":"2024-09-12T01:11:22.432667+0000","last_became_active":"2024-09-12T00:12:38.039292+0000","last_became_peered":"2024-09-12T00:12:38.039292+0000","last_unstale":"2024-09-12T01:11:22.432667+0000","last_undegraded":"2024-09-12T01:11:22.432667+0000","last_fullsized":"2024-09-12T01:11:22.432667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'61","last_scrub_stamp":"2024-09-12T01:11:22.432578+0000","last_deep_scrub":"263'61","last_deep_scrub_stamp":"2024-09-12T01:11:22.432578+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.432578+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:17.788153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":95,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'338","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.182576+0000","last_change":"2024-09-12T01:11:22.182576+0000","last_active":"2024-09-12T01:11:22.182576+0000","last_peered":"2024-09-12T01:11:22.182576+0000","last_clean":"2024-09-12T01:11:22.182576+0000","last_became_active":"2024-09-12T00:12:36.044021+0000","last_became_peered":"2024-09-12T00:12:36.044021+0000","last_unstale":"2024-09-12T01:11:22.182576+0000","last_undegraded":"2024-09-12T01:11:22.182576+0000","last_fullsized":"2024-09-12T01:11:22.182576+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-12T01:11:22.182412+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-12T01:11:22.182412+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.182412+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:27.695629+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730157,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":19079,"num_write":1003,"num_write_kb":26981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'448","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.134945+0000","last_change":"2024-09-12T01:11:21.134945+0000","last_active":"2024-09-12T01:11:21.134945+0000","last_peered":"2024-09-12T01:11:21.134945+0000","last_clean":"2024-09-12T01:11:21.134945+0000","last_became_active":"2024-09-12T00:12:38.037000+0000","last_became_peered":"2024-09-12T00:12:38.037000+0000","last_unstale":"2024-09-12T01:11:21.134945+0000","last_undegraded":"2024-09-12T01:11:21.134945+0000","last_fullsized":"2024-09-12T01:11:21.134945+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'448","last_scrub_stamp":"2024-09-12T01:11:21.134865+0000","last_deep_scrub":"263'448","last_deep_scrub_stamp":"2024-09-12T01:11:21.134865+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.134865+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:20.612613+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1930,"num_read_kb":1543,"num_write":735,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":986,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'369","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.185720+0000","last_change":"2024-09-12T01:11:15.185720+0000","last_active":"2024-09-12T01:11:15.185720+0000","last_peered":"2024-09-12T01:11:15.185720+0000","last_clean":"2024-09-12T01:11:15.185720+0000","last_became_active":"2024-09-12T00:12:36.038235+0000","last_became_peered":"2024-09-12T00:12:36.038235+0000","last_unstale":"2024-09-12T01:11:15.185720+0000","last_undegraded":"2024-09-12T01:11:15.185720+0000","last_fullsized":"2024-09-12T01:11:15.185720+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-12T01:11:15.185608+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-12T01:11:15.185608+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.185608+0000","objects_scrubbed":8,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:57.218559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342021,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":629,"num_read_kb":9962,"num_write":1248,"num_write_kb":25658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'300","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.173657+0000","last_change":"2024-09-12T01:11:17.173657+0000","last_active":"2024-09-12T01:11:17.173657+0000","last_peered":"2024-09-12T01:11:17.173657+0000","last_clean":"2024-09-12T01:11:17.173657+0000","last_became_active":"2024-09-12T00:12:38.045308+0000","last_became_peered":"2024-09-12T00:12:38.045308+0000","last_unstale":"2024-09-12T01:11:17.173657+0000","last_undegraded":"2024-09-12T01:11:17.173657+0000","last_fullsized":"2024-09-12T01:11:17.173657+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-12T01:11:17.173563+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-12T01:11:17.173563+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.173563+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:02.418536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1317,"num_read_kb":1075,"num_write":482,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'325","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.176988+0000","last_change":"2024-09-12T01:11:12.176988+0000","last_active":"2024-09-12T01:11:12.176988+0000","last_peered":"2024-09-12T01:11:12.176988+0000","last_clean":"2024-09-12T01:11:12.176988+0000","last_became_active":"2024-09-12T00:12:36.041698+0000","last_became_peered":"2024-09-12T00:12:36.041698+0000","last_unstale":"2024-09-12T01:11:12.176988+0000","last_undegraded":"2024-09-12T01:11:12.176988+0000","last_fullsized":"2024-09-12T01:11:12.176988+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-09-12T01:11:12.176870+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-09-12T01:11:12.176870+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.176870+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:10.449840+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":30384,"num_write":1021,"num_write_kb":31492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'494","reported_seq":1263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.295295+0000","last_change":"2024-09-12T01:11:22.295295+0000","last_active":"2024-09-12T01:11:22.295295+0000","last_peered":"2024-09-12T01:11:22.295295+0000","last_clean":"2024-09-12T01:11:22.295295+0000","last_became_active":"2024-09-12T00:12:38.038023+0000","last_became_peered":"2024-09-12T00:12:38.038023+0000","last_unstale":"2024-09-12T01:11:22.295295+0000","last_undegraded":"2024-09-12T01:11:22.295295+0000","last_fullsized":"2024-09-12T01:11:22.295295+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'494","last_scrub_stamp":"2024-09-12T01:11:22.295202+0000","last_deep_scrub":"263'494","last_deep_scrub_stamp":"2024-09-12T01:11:22.295202+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.295202+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:02.301203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2347,"num_read_kb":2031,"num_write":873,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3149,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'296","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.890838+0000","last_change":"2024-09-12T01:11:15.890838+0000","last_active":"2024-09-12T01:11:15.890838+0000","last_peered":"2024-09-12T01:11:15.890838+0000","last_clean":"2024-09-12T01:11:15.890838+0000","last_became_active":"2024-09-12T00:12:36.050008+0000","last_became_peered":"2024-09-12T00:12:36.050008+0000","last_unstale":"2024-09-12T01:11:15.890838+0000","last_undegraded":"2024-09-12T01:11:15.890838+0000","last_fullsized":"2024-09-12T01:11:15.890838+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'296","last_scrub_stamp":"2024-09-12T01:11:15.890624+0000","last_deep_scrub":"263'296","last_deep_scrub_stamp":"2024-09-12T01:11:15.890624+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.890624+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:16.146979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":30850,"num_write":1048,"num_write_kb":20572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'204","reported_seq":830,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.053105+0000","last_change":"2024-09-12T00:12:38.043322+0000","last_active":"2024-09-12T01:08:53.053105+0000","last_peered":"2024-09-12T01:08:53.053105+0000","last_clean":"2024-09-12T01:08:53.053105+0000","last_became_active":"2024-09-12T00:12:38.043059+0000","last_became_peered":"2024-09-12T00:12:38.043059+0000","last_unstale":"2024-09-12T01:08:53.053105+0000","last_undegraded":"2024-09-12T01:08:53.053105+0000","last_fullsized":"2024-09-12T01:08:53.053105+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:02.061980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":751,"num_write":306,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'111","reported_seq":700,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.047945+0000","last_change":"2024-09-12T00:12:38.040965+0000","last_active":"2024-09-12T01:08:40.047945+0000","last_peered":"2024-09-12T01:08:40.047945+0000","last_clean":"2024-09-12T01:08:40.047945+0000","last_became_active":"2024-09-12T00:12:38.040613+0000","last_became_peered":"2024-09-12T00:12:38.040613+0000","last_unstale":"2024-09-12T01:08:40.047945+0000","last_undegraded":"2024-09-12T01:08:40.047945+0000","last_fullsized":"2024-09-12T01:08:40.047945+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:25.644646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":420,"num_write":176,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'377","reported_seq":1123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.287078+0000","last_change":"2024-09-12T01:11:09.287078+0000","last_active":"2024-09-12T01:11:09.287078+0000","last_peered":"2024-09-12T01:11:09.287078+0000","last_clean":"2024-09-12T01:11:09.287078+0000","last_became_active":"2024-09-12T00:12:36.036905+0000","last_became_peered":"2024-09-12T00:12:36.036905+0000","last_unstale":"2024-09-12T01:11:09.287078+0000","last_undegraded":"2024-09-12T01:11:09.287078+0000","last_fullsized":"2024-09-12T01:11:09.287078+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:11:09.286940+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:11:09.286940+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.286940+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:09.368061+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529645,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":592,"num_read_kb":41745,"num_write":1152,"num_write_kb":45582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'78","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.167491+0000","last_change":"2024-09-12T01:11:16.167491+0000","last_active":"2024-09-12T01:11:16.167491+0000","last_peered":"2024-09-12T01:11:16.167491+0000","last_clean":"2024-09-12T01:11:16.167491+0000","last_became_active":"2024-09-12T00:12:38.038478+0000","last_became_peered":"2024-09-12T00:12:38.038478+0000","last_unstale":"2024-09-12T01:11:16.167491+0000","last_undegraded":"2024-09-12T01:11:16.167491+0000","last_fullsized":"2024-09-12T01:11:16.167491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'78","last_scrub_stamp":"2024-09-12T01:11:16.167401+0000","last_deep_scrub":"263'78","last_deep_scrub_stamp":"2024-09-12T01:11:16.167401+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.167401+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:07.760102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":318,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'378","reported_seq":1023,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.165463+0000","last_change":"2024-09-12T01:11:11.165463+0000","last_active":"2024-09-12T01:11:11.165463+0000","last_peered":"2024-09-12T01:11:11.165463+0000","last_clean":"2024-09-12T01:11:11.165463+0000","last_became_active":"2024-09-12T00:12:36.032821+0000","last_became_peered":"2024-09-12T00:12:36.032821+0000","last_unstale":"2024-09-12T01:11:11.165463+0000","last_undegraded":"2024-09-12T01:11:11.165463+0000","last_fullsized":"2024-09-12T01:11:11.165463+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-12T01:11:11.165328+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-12T01:11:11.165328+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.165328+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:11.501731+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3061552,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":42771,"num_write":1040,"num_write_kb":38443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'199","reported_seq":797,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.231959+0000","last_change":"2024-09-12T01:11:15.231959+0000","last_active":"2024-09-12T01:11:15.231959+0000","last_peered":"2024-09-12T01:11:15.231959+0000","last_clean":"2024-09-12T01:11:15.231959+0000","last_became_active":"2024-09-12T00:12:38.044169+0000","last_became_peered":"2024-09-12T00:12:38.044169+0000","last_unstale":"2024-09-12T01:11:15.231959+0000","last_undegraded":"2024-09-12T01:11:15.231959+0000","last_fullsized":"2024-09-12T01:11:15.231959+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'199","last_scrub_stamp":"2024-09-12T01:11:15.231880+0000","last_deep_scrub":"263'199","last_deep_scrub_stamp":"2024-09-12T01:11:15.231880+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.231880+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:00.268928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":679,"num_write":307,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'331","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.123297+0000","last_change":"2024-09-12T01:11:10.123297+0000","last_active":"2024-09-12T01:11:10.123297+0000","last_peered":"2024-09-12T01:11:10.123297+0000","last_clean":"2024-09-12T01:11:10.123297+0000","last_became_active":"2024-09-12T00:12:36.037200+0000","last_became_peered":"2024-09-12T00:12:36.037200+0000","last_unstale":"2024-09-12T01:11:10.123297+0000","last_undegraded":"2024-09-12T01:11:10.123297+0000","last_fullsized":"2024-09-12T01:11:10.123297+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:11:10.123156+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:11:10.123156+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.123156+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:59.788260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524447,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":1481,"num_write":1070,"num_write_kb":18199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'162","reported_seq":766,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.295446+0000","last_change":"2024-09-12T01:11:20.295446+0000","last_active":"2024-09-12T01:11:20.295446+0000","last_peered":"2024-09-12T01:11:20.295446+0000","last_clean":"2024-09-12T01:11:20.295446+0000","last_became_active":"2024-09-12T00:12:38.044089+0000","last_became_peered":"2024-09-12T00:12:38.044089+0000","last_unstale":"2024-09-12T01:11:20.295446+0000","last_undegraded":"2024-09-12T01:11:20.295446+0000","last_fullsized":"2024-09-12T01:11:20.295446+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-12T01:11:20.295361+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-12T01:11:20.295361+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.295361+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:32.689542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":583,"num_write":265,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'360","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.104690+0000","last_change":"2024-09-12T01:11:09.104690+0000","last_active":"2024-09-12T01:11:09.104690+0000","last_peered":"2024-09-12T01:11:09.104690+0000","last_clean":"2024-09-12T01:11:09.104690+0000","last_became_active":"2024-09-12T00:12:36.029286+0000","last_became_peered":"2024-09-12T00:12:36.029286+0000","last_unstale":"2024-09-12T01:11:09.104690+0000","last_undegraded":"2024-09-12T01:11:09.104690+0000","last_fullsized":"2024-09-12T01:11:09.104690+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-12T01:11:09.104526+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-12T01:11:09.104526+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.104526+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:00.468686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661265,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":28445,"num_write":1057,"num_write_kb":34038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'237","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.046795+0000","last_change":"2024-09-12T00:12:38.042662+0000","last_active":"2024-09-12T01:08:13.046795+0000","last_peered":"2024-09-12T01:08:13.046795+0000","last_clean":"2024-09-12T01:08:13.046795+0000","last_became_active":"2024-09-12T00:12:38.042387+0000","last_became_peered":"2024-09-12T00:12:38.042387+0000","last_unstale":"2024-09-12T01:08:13.046795+0000","last_undegraded":"2024-09-12T01:08:13.046795+0000","last_fullsized":"2024-09-12T01:08:13.046795+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:52.954165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1130,"num_read_kb":955,"num_write":386,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'350","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.214817+0000","last_change":"2024-09-12T01:11:13.214817+0000","last_active":"2024-09-12T01:11:13.214817+0000","last_peered":"2024-09-12T01:11:13.214817+0000","last_clean":"2024-09-12T01:11:13.214817+0000","last_became_active":"2024-09-12T00:12:36.034811+0000","last_became_peered":"2024-09-12T00:12:36.034811+0000","last_unstale":"2024-09-12T01:11:13.214817+0000","last_undegraded":"2024-09-12T01:11:13.214817+0000","last_fullsized":"2024-09-12T01:11:13.214817+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-12T01:11:13.214663+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-12T01:11:13.214663+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.214663+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:38.760865+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":602,"num_read_kb":22753,"num_write":1118,"num_write_kb":14938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'112","reported_seq":711,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.223372+0000","last_change":"2024-09-12T01:11:16.223372+0000","last_active":"2024-09-12T01:11:16.223372+0000","last_peered":"2024-09-12T01:11:16.223372+0000","last_clean":"2024-09-12T01:11:16.223372+0000","last_became_active":"2024-09-12T00:12:38.035835+0000","last_became_peered":"2024-09-12T00:12:38.035835+0000","last_unstale":"2024-09-12T01:11:16.223372+0000","last_undegraded":"2024-09-12T01:11:16.223372+0000","last_fullsized":"2024-09-12T01:11:16.223372+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'112","last_scrub_stamp":"2024-09-12T01:11:16.223277+0000","last_deep_scrub":"263'112","last_deep_scrub_stamp":"2024-09-12T01:11:16.223277+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.223277+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:36.024600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":399,"num_write":174,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'328","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.247820+0000","last_change":"2024-09-12T01:11:11.247820+0000","last_active":"2024-09-12T01:11:11.247820+0000","last_peered":"2024-09-12T01:11:11.247820+0000","last_clean":"2024-09-12T01:11:11.247820+0000","last_became_active":"2024-09-12T00:12:36.036060+0000","last_became_peered":"2024-09-12T00:12:36.036060+0000","last_unstale":"2024-09-12T01:11:11.247820+0000","last_undegraded":"2024-09-12T01:11:11.247820+0000","last_fullsized":"2024-09-12T01:11:11.247820+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-12T01:11:11.247654+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-12T01:11:11.247654+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.247654+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:35.548784+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568184,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":547,"num_read_kb":15680,"num_write":1014,"num_write_kb":17630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'129","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.436476+0000","last_change":"2024-09-12T00:12:46.059495+0000","last_active":"2024-09-12T01:09:23.436476+0000","last_peered":"2024-09-12T01:09:23.436476+0000","last_clean":"2024-09-12T01:09:23.436476+0000","last_became_active":"2024-09-12T00:12:46.059203+0000","last_became_peered":"2024-09-12T00:12:46.059203+0000","last_unstale":"2024-09-12T01:09:23.436476+0000","last_undegraded":"2024-09-12T01:09:23.436476+0000","last_fullsized":"2024-09-12T01:09:23.436476+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:04.594775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":135,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'77","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.238332+0000","last_change":"2024-09-12T01:11:18.238332+0000","last_active":"2024-09-12T01:11:18.238332+0000","last_peered":"2024-09-12T01:11:18.238332+0000","last_clean":"2024-09-12T01:11:18.238332+0000","last_became_active":"2024-09-12T00:12:38.041964+0000","last_became_peered":"2024-09-12T00:12:38.041964+0000","last_unstale":"2024-09-12T01:11:18.238332+0000","last_undegraded":"2024-09-12T01:11:18.238332+0000","last_fullsized":"2024-09-12T01:11:18.238332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'77","last_scrub_stamp":"2024-09-12T01:11:18.238243+0000","last_deep_scrub":"263'77","last_deep_scrub_stamp":"2024-09-12T01:11:18.238243+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.238243+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:12.364311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":305,"num_read_kb":247,"num_write":113,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'357","reported_seq":1213,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.398737+0000","last_change":"2024-09-12T01:11:12.398737+0000","last_active":"2024-09-12T01:11:12.398737+0000","last_peered":"2024-09-12T01:11:12.398737+0000","last_clean":"2024-09-12T01:11:12.398737+0000","last_became_active":"2024-09-12T00:12:36.033666+0000","last_became_peered":"2024-09-12T00:12:36.033666+0000","last_unstale":"2024-09-12T01:11:12.398737+0000","last_undegraded":"2024-09-12T01:11:12.398737+0000","last_fullsized":"2024-09-12T01:11:12.398737+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'357","last_scrub_stamp":"2024-09-12T01:11:12.398592+0000","last_deep_scrub":"263'357","last_deep_scrub_stamp":"2024-09-12T01:11:12.398592+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.398592+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:13.468955+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2017915,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":962,"num_read_kb":16942,"num_write":1189,"num_write_kb":38560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045191+0000","last_change":"2024-09-12T00:12:40.043098+0000","last_active":"2024-09-12T01:08:15.045191+0000","last_peered":"2024-09-12T01:08:15.045191+0000","last_clean":"2024-09-12T01:08:15.045191+0000","last_became_active":"2024-09-12T00:12:40.042778+0000","last_became_peered":"2024-09-12T00:12:40.042778+0000","last_unstale":"2024-09-12T01:08:15.045191+0000","last_undegraded":"2024-09-12T01:08:15.045191+0000","last_fullsized":"2024-09-12T01:08:15.045191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:24.903477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'345","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.811165+0000","last_change":"2024-09-12T00:12:42.041284+0000","last_active":"2024-09-12T01:10:59.811165+0000","last_peered":"2024-09-12T01:10:59.811165+0000","last_clean":"2024-09-12T01:10:59.811165+0000","last_became_active":"2024-09-12T00:12:42.040764+0000","last_became_peered":"2024-09-12T00:12:42.040764+0000","last_unstale":"2024-09-12T01:10:59.811165+0000","last_undegraded":"2024-09-12T01:10:59.811165+0000","last_fullsized":"2024-09-12T01:10:59.811165+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:17.910880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46776,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":561,"num_read_kb":1150,"num_write":442,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.238599+0000","last_change":"2024-09-12T00:12:44.055832+0000","last_active":"2024-09-12T01:08:20.238599+0000","last_peered":"2024-09-12T01:08:20.238599+0000","last_clean":"2024-09-12T01:08:20.238599+0000","last_became_active":"2024-09-12T00:12:44.055504+0000","last_became_peered":"2024-09-12T00:12:44.055504+0000","last_unstale":"2024-09-12T01:08:20.238599+0000","last_undegraded":"2024-09-12T01:08:20.238599+0000","last_fullsized":"2024-09-12T01:08:20.238599+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:45.759712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'168","reported_seq":713,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.825669+0000","last_change":"2024-09-12T00:12:46.065977+0000","last_active":"2024-09-12T01:08:55.825669+0000","last_peered":"2024-09-12T01:08:55.825669+0000","last_clean":"2024-09-12T01:08:55.825669+0000","last_became_active":"2024-09-12T00:12:46.065664+0000","last_became_peered":"2024-09-12T00:12:46.065664+0000","last_unstale":"2024-09-12T01:08:55.825669+0000","last_undegraded":"2024-09-12T01:08:55.825669+0000","last_fullsized":"2024-09-12T01:08:55.825669+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:46.395099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":198,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'177","reported_seq":798,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.332934+0000","last_change":"2024-09-12T01:11:23.332934+0000","last_active":"2024-09-12T01:11:23.332934+0000","last_peered":"2024-09-12T01:11:23.332934+0000","last_clean":"2024-09-12T01:11:23.332934+0000","last_became_active":"2024-09-12T00:12:38.041187+0000","last_became_peered":"2024-09-12T00:12:38.041187+0000","last_unstale":"2024-09-12T01:11:23.332934+0000","last_undegraded":"2024-09-12T01:11:23.332934+0000","last_fullsized":"2024-09-12T01:11:23.332934+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-09-12T01:11:23.332840+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-09-12T01:11:23.332840+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.332840+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:43.482751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":787,"num_read_kb":651,"num_write":272,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'370","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.319094+0000","last_change":"2024-09-12T01:11:09.319094+0000","last_active":"2024-09-12T01:11:09.319094+0000","last_peered":"2024-09-12T01:11:09.319094+0000","last_clean":"2024-09-12T01:11:09.319094+0000","last_became_active":"2024-09-12T00:12:36.033751+0000","last_became_peered":"2024-09-12T00:12:36.033751+0000","last_unstale":"2024-09-12T01:11:09.319094+0000","last_undegraded":"2024-09-12T01:11:09.319094+0000","last_fullsized":"2024-09-12T01:11:09.319094+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-12T01:11:09.318981+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-12T01:11:09.318981+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.318981+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:02.689157+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254460,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":6771,"num_write":1059,"num_write_kb":22452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.054867+0000","last_change":"2024-09-12T00:12:40.032783+0000","last_active":"2024-09-12T01:08:50.054867+0000","last_peered":"2024-09-12T01:08:50.054867+0000","last_clean":"2024-09-12T01:08:50.054867+0000","last_became_active":"2024-09-12T00:12:40.032489+0000","last_became_peered":"2024-09-12T00:12:40.032489+0000","last_unstale":"2024-09-12T01:08:50.054867+0000","last_undegraded":"2024-09-12T01:08:50.054867+0000","last_fullsized":"2024-09-12T01:08:50.054867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'93","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.815511+0000","last_change":"2024-09-12T00:12:42.046654+0000","last_active":"2024-09-12T01:10:31.815511+0000","last_peered":"2024-09-12T01:10:31.815511+0000","last_clean":"2024-09-12T01:10:31.815511+0000","last_became_active":"2024-09-12T00:12:42.046316+0000","last_became_peered":"2024-09-12T00:12:42.046316+0000","last_unstale":"2024-09-12T01:10:31.815511+0000","last_undegraded":"2024-09-12T01:10:31.815511+0000","last_fullsized":"2024-09-12T01:10:31.815511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:43.446982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":105,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.238553+0000","last_change":"2024-09-12T00:12:44.057706+0000","last_active":"2024-09-12T01:08:20.238553+0000","last_peered":"2024-09-12T01:08:20.238553+0000","last_clean":"2024-09-12T01:08:20.238553+0000","last_became_active":"2024-09-12T00:12:44.057398+0000","last_became_peered":"2024-09-12T00:12:44.057398+0000","last_unstale":"2024-09-12T01:08:20.238553+0000","last_undegraded":"2024-09-12T01:08:20.238553+0000","last_fullsized":"2024-09-12T01:08:20.238553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:05.128485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'136","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:39.937608+0000","last_change":"2024-09-12T00:12:46.061250+0000","last_active":"2024-09-12T01:08:39.937608+0000","last_peered":"2024-09-12T01:08:39.937608+0000","last_clean":"2024-09-12T01:08:39.937608+0000","last_became_active":"2024-09-12T00:12:46.060932+0000","last_became_peered":"2024-09-12T00:12:46.060932+0000","last_unstale":"2024-09-12T01:08:39.937608+0000","last_undegraded":"2024-09-12T01:08:39.937608+0000","last_fullsized":"2024-09-12T01:08:39.937608+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:30.826242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'190","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.815777+0000","last_change":"2024-09-12T01:11:22.815777+0000","last_active":"2024-09-12T01:11:22.815777+0000","last_peered":"2024-09-12T01:11:22.815777+0000","last_clean":"2024-09-12T01:11:22.815777+0000","last_became_active":"2024-09-12T00:12:38.038234+0000","last_became_peered":"2024-09-12T00:12:38.038234+0000","last_unstale":"2024-09-12T01:11:22.815777+0000","last_undegraded":"2024-09-12T01:11:22.815777+0000","last_fullsized":"2024-09-12T01:11:22.815777+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-12T01:11:22.815690+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-12T01:11:22.815690+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.815690+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:14.046873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":891,"num_read_kb":755,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'339","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.343865+0000","last_change":"2024-09-12T01:11:08.343865+0000","last_active":"2024-09-12T01:11:08.343865+0000","last_peered":"2024-09-12T01:11:08.343865+0000","last_clean":"2024-09-12T01:11:08.343865+0000","last_became_active":"2024-09-12T00:13:07.149671+0000","last_became_peered":"2024-09-12T00:13:07.149671+0000","last_unstale":"2024-09-12T01:11:08.343865+0000","last_undegraded":"2024-09-12T01:11:08.343865+0000","last_fullsized":"2024-09-12T01:11:08.343865+0000","mapping_epoch":40,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-12T01:11:08.343734+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-12T01:11:08.343734+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.343734+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:10.179873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":33322,"num_write":992,"num_write_kb":23312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.511949+0000","last_change":"2024-09-12T01:11:24.511949+0000","last_active":"2024-09-12T01:11:24.511949+0000","last_peered":"2024-09-12T01:11:24.511949+0000","last_clean":"2024-09-12T01:11:24.511949+0000","last_became_active":"2024-09-12T00:12:40.036714+0000","last_became_peered":"2024-09-12T00:12:40.036714+0000","last_unstale":"2024-09-12T01:11:24.511949+0000","last_undegraded":"2024-09-12T01:11:24.511949+0000","last_fullsized":"2024-09-12T01:11:24.511949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.511863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.511863+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.511863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:42.540269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'128","reported_seq":677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.055715+0000","last_change":"2024-09-12T00:12:42.038292+0000","last_active":"2024-09-12T01:08:55.055715+0000","last_peered":"2024-09-12T01:08:55.055715+0000","last_clean":"2024-09-12T01:08:55.055715+0000","last_became_active":"2024-09-12T00:12:42.037971+0000","last_became_peered":"2024-09-12T00:12:42.037971+0000","last_unstale":"2024-09-12T01:08:55.055715+0000","last_undegraded":"2024-09-12T01:08:55.055715+0000","last_fullsized":"2024-09-12T01:08:55.055715+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":156,"num_read_kb":149,"num_write":106,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'778","reported_seq":2785,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.144095+0000","last_change":"2024-09-12T00:12:44.059925+0000","last_active":"2024-09-12T01:11:00.144095+0000","last_peered":"2024-09-12T01:11:00.144095+0000","last_clean":"2024-09-12T01:11:00.144095+0000","last_became_active":"2024-09-12T00:12:44.059258+0000","last_became_peered":"2024-09-12T00:12:44.059258+0000","last_unstale":"2024-09-12T01:11:00.144095+0000","last_undegraded":"2024-09-12T01:11:00.144095+0000","last_fullsized":"2024-09-12T01:11:00.144095+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:23.120624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'196","reported_seq":1011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.494669+0000","last_change":"2024-09-12T00:12:46.059926+0000","last_active":"2024-09-12T01:09:23.494669+0000","last_peered":"2024-09-12T01:09:23.494669+0000","last_clean":"2024-09-12T01:09:23.494669+0000","last_became_active":"2024-09-12T00:12:46.059591+0000","last_became_peered":"2024-09-12T00:12:46.059591+0000","last_unstale":"2024-09-12T01:09:23.494669+0000","last_undegraded":"2024-09-12T01:09:23.494669+0000","last_fullsized":"2024-09-12T01:09:23.494669+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:40.868229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":585,"num_read_kb":583,"num_write":433,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'4340","reported_seq":5003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:13.046880+0000","last_change":"2024-09-12T00:12:38.036026+0000","last_active":"2024-09-12T01:08:13.046880+0000","last_peered":"2024-09-12T01:08:13.046880+0000","last_clean":"2024-09-12T01:08:13.046880+0000","last_became_active":"2024-09-12T00:12:38.035743+0000","last_became_peered":"2024-09-12T00:12:38.035743+0000","last_unstale":"2024-09-12T01:08:13.046880+0000","last_undegraded":"2024-09-12T01:08:13.046880+0000","last_fullsized":"2024-09-12T01:08:13.046880+0000","mapping_epoch":29,"log_start":"263'4300","ondisk_log_start":"263'4300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:55.482084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17417,"num_read_kb":14583,"num_write":6500,"num_write_kb":3272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'359","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.279315+0000","last_change":"2024-09-12T01:11:05.279315+0000","last_active":"2024-09-12T01:11:05.279315+0000","last_peered":"2024-09-12T01:11:05.279315+0000","last_clean":"2024-09-12T01:11:05.279315+0000","last_became_active":"2024-09-12T00:12:36.038014+0000","last_became_peered":"2024-09-12T00:12:36.038014+0000","last_unstale":"2024-09-12T01:11:05.279315+0000","last_undegraded":"2024-09-12T01:11:05.279315+0000","last_fullsized":"2024-09-12T01:11:05.279315+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T01:11:05.279083+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T01:11:05.279083+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.279083+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:09.655209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924421,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":557,"num_read_kb":22312,"num_write":1056,"num_write_kb":43311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045229+0000","last_change":"2024-09-12T00:12:40.041340+0000","last_active":"2024-09-12T01:08:15.045229+0000","last_peered":"2024-09-12T01:08:15.045229+0000","last_clean":"2024-09-12T01:08:15.045229+0000","last_became_active":"2024-09-12T00:12:40.040992+0000","last_became_peered":"2024-09-12T00:12:40.040992+0000","last_unstale":"2024-09-12T01:08:15.045229+0000","last_undegraded":"2024-09-12T01:08:15.045229+0000","last_fullsized":"2024-09-12T01:08:15.045229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:18.861321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'288","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.252040+0000","last_change":"2024-09-12T01:11:21.252040+0000","last_active":"2024-09-12T01:11:21.252040+0000","last_peered":"2024-09-12T01:11:21.252040+0000","last_clean":"2024-09-12T01:11:21.252040+0000","last_became_active":"2024-09-12T00:12:42.041042+0000","last_became_peered":"2024-09-12T00:12:42.041042+0000","last_unstale":"2024-09-12T01:11:21.252040+0000","last_undegraded":"2024-09-12T01:11:21.252040+0000","last_fullsized":"2024-09-12T01:11:21.252040+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'288","last_scrub_stamp":"2024-09-12T01:11:21.251938+0000","last_deep_scrub":"263'288","last_deep_scrub_stamp":"2024-09-12T01:11:21.251938+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.251938+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:59.500381+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63399,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":1076,"num_write":376,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'806","reported_seq":2517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.234006+0000","last_change":"2024-09-12T00:12:44.062745+0000","last_active":"2024-09-12T01:11:00.234006+0000","last_peered":"2024-09-12T01:11:00.234006+0000","last_clean":"2024-09-12T01:11:00.234006+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:11:00.234006+0000","last_undegraded":"2024-09-12T01:11:00.234006+0000","last_fullsized":"2024-09-12T01:11:00.234006+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'191","reported_seq":829,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.356461+0000","last_change":"2024-09-12T01:11:21.356461+0000","last_active":"2024-09-12T01:11:21.356461+0000","last_peered":"2024-09-12T01:11:21.356461+0000","last_clean":"2024-09-12T01:11:21.356461+0000","last_became_active":"2024-09-12T00:12:38.040030+0000","last_became_peered":"2024-09-12T00:12:38.040030+0000","last_unstale":"2024-09-12T01:11:21.356461+0000","last_undegraded":"2024-09-12T01:11:21.356461+0000","last_fullsized":"2024-09-12T01:11:21.356461+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'191","last_scrub_stamp":"2024-09-12T01:11:21.356376+0000","last_deep_scrub":"263'191","last_deep_scrub_stamp":"2024-09-12T01:11:21.356376+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.356376+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:38.207590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":682,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'345","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.091085+0000","last_change":"2024-09-12T01:11:06.091029+0000","last_active":"2024-09-12T01:11:06.091085+0000","last_peered":"2024-09-12T01:11:06.091085+0000","last_clean":"2024-09-12T01:11:06.091085+0000","last_became_active":"2024-09-12T00:12:36.040657+0000","last_became_peered":"2024-09-12T00:12:36.040657+0000","last_unstale":"2024-09-12T01:11:06.091085+0000","last_undegraded":"2024-09-12T01:11:06.091085+0000","last_fullsized":"2024-09-12T01:11:06.091085+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-12T01:11:06.090928+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-12T01:11:06.090928+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.090928+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:36.844314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":455,"num_read_kb":5571,"num_write":1118,"num_write_kb":16904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.283806+0000","last_change":"2024-09-12T01:11:19.283806+0000","last_active":"2024-09-12T01:11:19.283806+0000","last_peered":"2024-09-12T01:11:19.283806+0000","last_clean":"2024-09-12T01:11:19.283806+0000","last_became_active":"2024-09-12T00:12:40.036362+0000","last_became_peered":"2024-09-12T00:12:40.036362+0000","last_unstale":"2024-09-12T01:11:19.283806+0000","last_undegraded":"2024-09-12T01:11:19.283806+0000","last_fullsized":"2024-09-12T01:11:19.283806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.283725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.283725+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.283725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:49.376690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'356","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.195848+0000","last_change":"2024-09-12T01:11:23.195848+0000","last_active":"2024-09-12T01:11:23.195848+0000","last_peered":"2024-09-12T01:11:23.195848+0000","last_clean":"2024-09-12T01:11:23.195848+0000","last_became_active":"2024-09-12T00:12:42.044418+0000","last_became_peered":"2024-09-12T00:12:42.044418+0000","last_unstale":"2024-09-12T01:11:23.195848+0000","last_undegraded":"2024-09-12T01:11:23.195848+0000","last_fullsized":"2024-09-12T01:11:23.195848+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-12T01:11:23.195680+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-12T01:11:23.195680+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.195680+0000","objects_scrubbed":10,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:40.037982+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51451,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":1107,"num_write":436,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.173321+0000","last_change":"2024-09-12T00:12:44.057796+0000","last_active":"2024-09-12T01:09:00.173321+0000","last_peered":"2024-09-12T01:09:00.173321+0000","last_clean":"2024-09-12T01:09:00.173321+0000","last_became_active":"2024-09-12T00:12:44.057438+0000","last_became_peered":"2024-09-12T00:12:44.057438+0000","last_unstale":"2024-09-12T01:09:00.173321+0000","last_undegraded":"2024-09-12T01:09:00.173321+0000","last_fullsized":"2024-09-12T01:09:00.173321+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'557","reported_seq":1368,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.009815+0000","last_change":"2024-09-12T00:12:46.060839+0000","last_active":"2024-09-12T01:10:33.009815+0000","last_peered":"2024-09-12T01:10:33.009815+0000","last_clean":"2024-09-12T01:10:33.009815+0000","last_became_active":"2024-09-12T00:12:46.060552+0000","last_became_peered":"2024-09-12T00:12:46.060552+0000","last_unstale":"2024-09-12T01:10:33.009815+0000","last_undegraded":"2024-09-12T01:10:33.009815+0000","last_fullsized":"2024-09-12T01:10:33.009815+0000","mapping_epoch":37,"log_start":"263'500","ondisk_log_start":"263'500","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1290,"num_read_kb":1284,"num_write":1146,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'240","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.279256+0000","last_change":"2024-09-12T01:11:11.279256+0000","last_active":"2024-09-12T01:11:11.279256+0000","last_peered":"2024-09-12T01:11:11.279256+0000","last_clean":"2024-09-12T01:11:11.279256+0000","last_became_active":"2024-09-12T00:12:38.041916+0000","last_became_peered":"2024-09-12T00:12:38.041916+0000","last_unstale":"2024-09-12T01:11:11.279256+0000","last_undegraded":"2024-09-12T01:11:11.279256+0000","last_fullsized":"2024-09-12T01:11:11.279256+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'240","last_scrub_stamp":"2024-09-12T01:11:11.279182+0000","last_deep_scrub":"263'240","last_deep_scrub_stamp":"2024-09-12T01:11:11.279182+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.279182+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:57.424825+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1071,"num_read_kb":865,"num_write":389,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'325","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.153251+0000","last_change":"2024-09-12T01:11:09.153171+0000","last_active":"2024-09-12T01:11:09.153251+0000","last_peered":"2024-09-12T01:11:09.153251+0000","last_clean":"2024-09-12T01:11:09.153251+0000","last_became_active":"2024-09-12T00:12:36.042838+0000","last_became_peered":"2024-09-12T00:12:36.042838+0000","last_unstale":"2024-09-12T01:11:09.153251+0000","last_undegraded":"2024-09-12T01:11:09.153251+0000","last_fullsized":"2024-09-12T01:11:09.153251+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-09-12T01:11:09.153023+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-09-12T01:11:09.153023+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.153023+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:42.019020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":480,"num_read_kb":7238,"num_write":1062,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.336520+0000","last_change":"2024-09-12T01:11:22.336520+0000","last_active":"2024-09-12T01:11:22.336520+0000","last_peered":"2024-09-12T01:11:22.336520+0000","last_clean":"2024-09-12T01:11:22.336520+0000","last_became_active":"2024-09-12T00:12:40.042625+0000","last_became_peered":"2024-09-12T00:12:40.042625+0000","last_unstale":"2024-09-12T01:11:22.336520+0000","last_undegraded":"2024-09-12T01:11:22.336520+0000","last_fullsized":"2024-09-12T01:11:22.336520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:22.336417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:22.336417+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.336417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:38.356823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'255","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.718845+0000","last_change":"2024-09-12T00:12:42.040576+0000","last_active":"2024-09-12T01:10:58.718845+0000","last_peered":"2024-09-12T01:10:58.718845+0000","last_clean":"2024-09-12T01:10:58.718845+0000","last_became_active":"2024-09-12T00:12:42.040266+0000","last_became_peered":"2024-09-12T00:12:42.040266+0000","last_unstale":"2024-09-12T01:10:58.718845+0000","last_undegraded":"2024-09-12T01:10:58.718845+0000","last_fullsized":"2024-09-12T01:10:58.718845+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":965,"num_write":348,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.058997+0000","last_change":"2024-09-12T00:12:44.062951+0000","last_active":"2024-09-12T01:09:15.058997+0000","last_peered":"2024-09-12T01:09:15.058997+0000","last_clean":"2024-09-12T01:09:15.058997+0000","last_became_active":"2024-09-12T00:12:44.062608+0000","last_became_peered":"2024-09-12T00:12:44.062608+0000","last_unstale":"2024-09-12T01:09:15.058997+0000","last_undegraded":"2024-09-12T01:09:15.058997+0000","last_fullsized":"2024-09-12T01:09:15.058997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2412","reported_seq":4251,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:35.952241+0000","last_change":"2024-09-12T00:12:46.062926+0000","last_active":"2024-09-12T01:10:35.952241+0000","last_peered":"2024-09-12T01:10:35.952241+0000","last_clean":"2024-09-12T01:10:35.952241+0000","last_became_active":"2024-09-12T00:12:46.062624+0000","last_became_peered":"2024-09-12T00:12:46.062624+0000","last_unstale":"2024-09-12T01:10:35.952241+0000","last_undegraded":"2024-09-12T01:10:35.952241+0000","last_fullsized":"2024-09-12T01:10:35.952241+0000","mapping_epoch":37,"log_start":"263'2400","ondisk_log_start":"263'2400","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":2400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":6065,"num_write":4891,"num_write_kb":1799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'224","reported_seq":843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.214170+0000","last_change":"2024-09-12T01:11:17.214117+0000","last_active":"2024-09-12T01:11:17.214170+0000","last_peered":"2024-09-12T01:11:17.214170+0000","last_clean":"2024-09-12T01:11:17.214170+0000","last_became_active":"2024-09-12T00:12:38.042657+0000","last_became_peered":"2024-09-12T00:12:38.042657+0000","last_unstale":"2024-09-12T01:11:17.214170+0000","last_undegraded":"2024-09-12T01:11:17.214170+0000","last_fullsized":"2024-09-12T01:11:17.214170+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-12T01:11:17.214034+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-12T01:11:17.214034+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.214034+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:55.432133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":947,"num_read_kb":771,"num_write":346,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'377","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.357263+0000","last_change":"2024-09-12T01:11:13.357263+0000","last_active":"2024-09-12T01:11:13.357263+0000","last_peered":"2024-09-12T01:11:13.357263+0000","last_clean":"2024-09-12T01:11:13.357263+0000","last_became_active":"2024-09-12T00:12:36.046196+0000","last_became_peered":"2024-09-12T00:12:36.046196+0000","last_unstale":"2024-09-12T01:11:13.357263+0000","last_undegraded":"2024-09-12T01:11:13.357263+0000","last_fullsized":"2024-09-12T01:11:13.357263+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:11:13.357097+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:11:13.357097+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.357097+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:24.455244+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9646835,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":545,"num_read_kb":69753,"num_write":1204,"num_write_kb":51465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.053734+0000","last_change":"2024-09-12T00:12:40.040357+0000","last_active":"2024-09-12T01:08:58.053734+0000","last_peered":"2024-09-12T01:08:58.053734+0000","last_clean":"2024-09-12T01:08:58.053734+0000","last_became_active":"2024-09-12T00:12:40.039887+0000","last_became_peered":"2024-09-12T00:12:40.039887+0000","last_unstale":"2024-09-12T01:08:58.053734+0000","last_undegraded":"2024-09-12T01:08:58.053734+0000","last_fullsized":"2024-09-12T01:08:58.053734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'330","reported_seq":932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.156898+0000","last_change":"2024-09-12T00:12:42.051353+0000","last_active":"2024-09-12T01:11:00.156898+0000","last_peered":"2024-09-12T01:11:00.156898+0000","last_clean":"2024-09-12T01:11:00.156898+0000","last_became_active":"2024-09-12T00:12:42.051042+0000","last_became_peered":"2024-09-12T00:12:42.051042+0000","last_unstale":"2024-09-12T01:11:00.156898+0000","last_undegraded":"2024-09-12T01:11:00.156898+0000","last_fullsized":"2024-09-12T01:11:00.156898+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50358,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":532,"num_read_kb":1132,"num_write":424,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'806","reported_seq":2513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.234930+0000","last_change":"2024-09-12T00:12:44.057367+0000","last_active":"2024-09-12T01:11:00.234930+0000","last_peered":"2024-09-12T01:11:00.234930+0000","last_clean":"2024-09-12T01:11:00.234930+0000","last_became_active":"2024-09-12T00:12:44.057064+0000","last_became_peered":"2024-09-12T00:12:44.057064+0000","last_unstale":"2024-09-12T01:11:00.234930+0000","last_undegraded":"2024-09-12T01:11:00.234930+0000","last_fullsized":"2024-09-12T01:11:00.234930+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'102","reported_seq":587,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.799277+0000","last_change":"2024-09-12T00:12:46.059872+0000","last_active":"2024-09-12T01:10:31.799277+0000","last_peered":"2024-09-12T01:10:31.799277+0000","last_clean":"2024-09-12T01:10:31.799277+0000","last_became_active":"2024-09-12T00:12:46.059567+0000","last_became_peered":"2024-09-12T00:12:46.059567+0000","last_unstale":"2024-09-12T01:10:31.799277+0000","last_undegraded":"2024-09-12T01:10:31.799277+0000","last_fullsized":"2024-09-12T01:10:31.799277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":78,"num_write":230,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'198","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.877598+0000","last_change":"2024-09-12T01:11:19.877598+0000","last_active":"2024-09-12T01:11:19.877598+0000","last_peered":"2024-09-12T01:11:19.877598+0000","last_clean":"2024-09-12T01:11:19.877598+0000","last_became_active":"2024-09-12T00:12:38.039788+0000","last_became_peered":"2024-09-12T00:12:38.039788+0000","last_unstale":"2024-09-12T01:11:19.877598+0000","last_undegraded":"2024-09-12T01:11:19.877598+0000","last_fullsized":"2024-09-12T01:11:19.877598+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-12T01:11:19.877483+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-12T01:11:19.877483+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.877483+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:31.219578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":765,"num_write":285,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'369","reported_seq":1031,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:04.101519+0000","last_change":"2024-09-12T01:11:04.101465+0000","last_active":"2024-09-12T01:11:04.101519+0000","last_peered":"2024-09-12T01:11:04.101519+0000","last_clean":"2024-09-12T01:11:04.101519+0000","last_became_active":"2024-09-12T00:12:36.034290+0000","last_became_peered":"2024-09-12T00:12:36.034290+0000","last_unstale":"2024-09-12T01:11:04.101519+0000","last_undegraded":"2024-09-12T01:11:04.101519+0000","last_fullsized":"2024-09-12T01:11:04.101519+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-12T01:11:04.101384+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-12T01:11:04.101384+0000","last_clean_scrub_stamp":"2024-09-12T01:11:04.101384+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:59.360381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":18536,"num_write":1160,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.341959+0000","last_change":"2024-09-12T01:11:21.341959+0000","last_active":"2024-09-12T01:11:21.341959+0000","last_peered":"2024-09-12T01:11:21.341959+0000","last_clean":"2024-09-12T01:11:21.341959+0000","last_became_active":"2024-09-12T00:12:40.036551+0000","last_became_peered":"2024-09-12T00:12:40.036551+0000","last_unstale":"2024-09-12T01:11:21.341959+0000","last_undegraded":"2024-09-12T01:11:21.341959+0000","last_fullsized":"2024-09-12T01:11:21.341959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:21.341862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:21.341862+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.341862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:32.869688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'515","reported_seq":1160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.103317+0000","last_change":"2024-09-12T00:12:42.041830+0000","last_active":"2024-09-12T01:10:59.103317+0000","last_peered":"2024-09-12T01:10:59.103317+0000","last_clean":"2024-09-12T01:10:59.103317+0000","last_became_active":"2024-09-12T00:12:42.041307+0000","last_became_peered":"2024-09-12T00:12:42.041307+0000","last_unstale":"2024-09-12T01:10:59.103317+0000","last_undegraded":"2024-09-12T01:10:59.103317+0000","last_fullsized":"2024-09-12T01:10:59.103317+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96065,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":906,"num_read_kb":2178,"num_write":748,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:08.055183+0000","last_change":"2024-09-12T00:12:44.049673+0000","last_active":"2024-09-12T01:09:08.055183+0000","last_peered":"2024-09-12T01:09:08.055183+0000","last_clean":"2024-09-12T01:09:08.055183+0000","last_became_active":"2024-09-12T00:12:44.049211+0000","last_became_peered":"2024-09-12T00:12:44.049211+0000","last_unstale":"2024-09-12T01:09:08.055183+0000","last_undegraded":"2024-09-12T01:09:08.055183+0000","last_fullsized":"2024-09-12T01:09:08.055183+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'145","reported_seq":641,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:10.058142+0000","last_change":"2024-09-12T00:12:46.066668+0000","last_active":"2024-09-12T01:09:10.058142+0000","last_peered":"2024-09-12T01:09:10.058142+0000","last_clean":"2024-09-12T01:09:10.058142+0000","last_became_active":"2024-09-12T00:12:46.066431+0000","last_became_peered":"2024-09-12T00:12:46.066431+0000","last_unstale":"2024-09-12T01:09:10.058142+0000","last_undegraded":"2024-09-12T01:09:10.058142+0000","last_fullsized":"2024-09-12T01:09:10.058142+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":339,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'119","reported_seq":723,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.167274+0000","last_change":"2024-09-12T01:11:18.167274+0000","last_active":"2024-09-12T01:11:18.167274+0000","last_peered":"2024-09-12T01:11:18.167274+0000","last_clean":"2024-09-12T01:11:18.167274+0000","last_became_active":"2024-09-12T00:12:38.037464+0000","last_became_peered":"2024-09-12T00:12:38.037464+0000","last_unstale":"2024-09-12T01:11:18.167274+0000","last_undegraded":"2024-09-12T01:11:18.167274+0000","last_fullsized":"2024-09-12T01:11:18.167274+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T01:11:18.167145+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T01:11:18.167145+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.167145+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:04.870748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'335","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.761453+0000","last_change":"2024-09-12T01:11:06.761365+0000","last_active":"2024-09-12T01:11:06.761453+0000","last_peered":"2024-09-12T01:11:06.761453+0000","last_clean":"2024-09-12T01:11:06.761453+0000","last_became_active":"2024-09-12T00:12:36.045050+0000","last_became_peered":"2024-09-12T00:12:36.045050+0000","last_unstale":"2024-09-12T01:11:06.761453+0000","last_undegraded":"2024-09-12T01:11:06.761453+0000","last_fullsized":"2024-09-12T01:11:06.761453+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:11:06.761211+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:11:06.761211+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.761211+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:53.881887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":13364,"num_write":1093,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.698894+0000","last_change":"2024-09-12T01:11:19.698894+0000","last_active":"2024-09-12T01:11:19.698894+0000","last_peered":"2024-09-12T01:11:19.698894+0000","last_clean":"2024-09-12T01:11:19.698894+0000","last_became_active":"2024-09-12T00:12:40.038036+0000","last_became_peered":"2024-09-12T00:12:40.038036+0000","last_unstale":"2024-09-12T01:11:19.698894+0000","last_undegraded":"2024-09-12T01:11:19.698894+0000","last_fullsized":"2024-09-12T01:11:19.698894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.698778+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:02.239036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'297","reported_seq":877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.161721+0000","last_change":"2024-09-12T00:12:42.051976+0000","last_active":"2024-09-12T01:10:59.161721+0000","last_peered":"2024-09-12T01:10:59.161721+0000","last_clean":"2024-09-12T01:10:59.161721+0000","last_became_active":"2024-09-12T00:12:42.051668+0000","last_became_peered":"2024-09-12T00:12:42.051668+0000","last_unstale":"2024-09-12T01:10:59.161721+0000","last_undegraded":"2024-09-12T01:10:59.161721+0000","last_fullsized":"2024-09-12T01:10:59.161721+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":1104,"num_write":460,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.743268+0000","last_change":"2024-09-12T01:11:23.743222+0000","last_active":"2024-09-12T01:11:23.743268+0000","last_peered":"2024-09-12T01:11:23.743268+0000","last_clean":"2024-09-12T01:11:23.743268+0000","last_became_active":"2024-09-12T00:12:44.061848+0000","last_became_peered":"2024-09-12T00:12:44.061848+0000","last_unstale":"2024-09-12T01:11:23.743268+0000","last_undegraded":"2024-09-12T01:11:23.743268+0000","last_fullsized":"2024-09-12T01:11:23.743268+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.743143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.743143+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.743143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:52.926960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'90","reported_seq":570,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.004115+0000","last_change":"2024-09-12T00:12:46.066391+0000","last_active":"2024-09-12T01:10:33.004115+0000","last_peered":"2024-09-12T01:10:33.004115+0000","last_clean":"2024-09-12T01:10:33.004115+0000","last_became_active":"2024-09-12T00:12:46.066121+0000","last_became_peered":"2024-09-12T00:12:46.066121+0000","last_unstale":"2024-09-12T01:10:33.004115+0000","last_undegraded":"2024-09-12T01:10:33.004115+0000","last_fullsized":"2024-09-12T01:10:33.004115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:35.295982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":71,"num_write":206,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'180","reported_seq":770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.318206+0000","last_change":"2024-09-12T01:11:22.318206+0000","last_active":"2024-09-12T01:11:22.318206+0000","last_peered":"2024-09-12T01:11:22.318206+0000","last_clean":"2024-09-12T01:11:22.318206+0000","last_became_active":"2024-09-12T00:12:38.046276+0000","last_became_peered":"2024-09-12T00:12:38.046276+0000","last_unstale":"2024-09-12T01:11:22.318206+0000","last_undegraded":"2024-09-12T01:11:22.318206+0000","last_fullsized":"2024-09-12T01:11:22.318206+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-12T01:11:22.318112+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-12T01:11:22.318112+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.318112+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:29.522845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":618,"num_write":256,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'495","reported_seq":1207,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.359640+0000","last_change":"2024-09-12T01:11:10.359579+0000","last_active":"2024-09-12T01:11:10.359640+0000","last_peered":"2024-09-12T01:11:10.359640+0000","last_clean":"2024-09-12T01:11:10.359640+0000","last_became_active":"2024-09-12T00:12:36.035311+0000","last_became_peered":"2024-09-12T00:12:36.035311+0000","last_unstale":"2024-09-12T01:11:10.359640+0000","last_undegraded":"2024-09-12T01:11:10.359640+0000","last_fullsized":"2024-09-12T01:11:10.359640+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'495","last_scrub_stamp":"2024-09-12T01:11:10.359440+0000","last_deep_scrub":"263'495","last_deep_scrub_stamp":"2024-09-12T01:11:10.359440+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.359440+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:44.647976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":942,"num_read_kb":11265,"num_write":1473,"num_write_kb":28283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.053753+0000","last_change":"2024-09-12T00:12:40.035887+0000","last_active":"2024-09-12T01:08:58.053753+0000","last_peered":"2024-09-12T01:08:58.053753+0000","last_clean":"2024-09-12T01:08:58.053753+0000","last_became_active":"2024-09-12T00:12:40.035585+0000","last_became_peered":"2024-09-12T00:12:40.035585+0000","last_unstale":"2024-09-12T01:08:58.053753+0000","last_undegraded":"2024-09-12T01:08:58.053753+0000","last_fullsized":"2024-09-12T01:08:58.053753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'310","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.545252+0000","last_change":"2024-09-12T00:12:42.052616+0000","last_active":"2024-09-12T01:10:58.545252+0000","last_peered":"2024-09-12T01:10:58.545252+0000","last_clean":"2024-09-12T01:10:58.545252+0000","last_became_active":"2024-09-12T00:12:42.052279+0000","last_became_peered":"2024-09-12T00:12:42.052279+0000","last_unstale":"2024-09-12T01:10:58.545252+0000","last_undegraded":"2024-09-12T01:10:58.545252+0000","last_fullsized":"2024-09-12T01:10:58.545252+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:39.576180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":1142,"num_write":410,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'773","reported_seq":4983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.728661+0000","last_change":"2024-09-12T01:11:22.728661+0000","last_active":"2024-09-12T01:11:22.728661+0000","last_peered":"2024-09-12T01:11:22.728661+0000","last_clean":"2024-09-12T01:11:22.728661+0000","last_became_active":"2024-09-12T00:12:44.060494+0000","last_became_peered":"2024-09-12T00:12:44.060494+0000","last_unstale":"2024-09-12T01:11:22.728661+0000","last_undegraded":"2024-09-12T01:11:22.728661+0000","last_fullsized":"2024-09-12T01:11:22.728661+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'773","last_scrub_stamp":"2024-09-12T01:11:22.728562+0000","last_deep_scrub":"263'773","last_deep_scrub_stamp":"2024-09-12T01:11:22.728562+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.728562+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:32.761136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'133","reported_seq":622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.536940+0000","last_change":"2024-09-12T00:12:46.060540+0000","last_active":"2024-09-12T01:09:21.536940+0000","last_peered":"2024-09-12T01:09:21.536940+0000","last_clean":"2024-09-12T01:09:21.536940+0000","last_became_active":"2024-09-12T00:12:46.060211+0000","last_became_peered":"2024-09-12T00:12:46.060211+0000","last_unstale":"2024-09-12T01:09:21.536940+0000","last_undegraded":"2024-09-12T01:09:21.536940+0000","last_fullsized":"2024-09-12T01:09:21.536940+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":113,"num_write":319,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'256","reported_seq":896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.174716+0000","last_change":"2024-09-12T01:11:18.174716+0000","last_active":"2024-09-12T01:11:18.174716+0000","last_peered":"2024-09-12T01:11:18.174716+0000","last_clean":"2024-09-12T01:11:18.174716+0000","last_became_active":"2024-09-12T00:12:38.042601+0000","last_became_peered":"2024-09-12T00:12:38.042601+0000","last_unstale":"2024-09-12T01:11:18.174716+0000","last_undegraded":"2024-09-12T01:11:18.174716+0000","last_fullsized":"2024-09-12T01:11:18.174716+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'256","last_scrub_stamp":"2024-09-12T01:11:18.174616+0000","last_deep_scrub":"263'256","last_deep_scrub_stamp":"2024-09-12T01:11:18.174616+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.174616+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:34.619000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1116,"num_read_kb":905,"num_write":388,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'367","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.370115+0000","last_change":"2024-09-12T01:11:11.370115+0000","last_active":"2024-09-12T01:11:11.370115+0000","last_peered":"2024-09-12T01:11:11.370115+0000","last_clean":"2024-09-12T01:11:11.370115+0000","last_became_active":"2024-09-12T00:12:36.043404+0000","last_became_peered":"2024-09-12T00:12:36.043404+0000","last_unstale":"2024-09-12T01:11:11.370115+0000","last_undegraded":"2024-09-12T01:11:11.370115+0000","last_fullsized":"2024-09-12T01:11:11.370115+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-12T01:11:11.370017+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-12T01:11:11.370017+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.370017+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:25.657597+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432371,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":514,"num_read_kb":34059,"num_write":1157,"num_write_kb":45928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'2","reported_seq":1459,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.875830+0000","last_change":"2024-09-12T00:12:40.035929+0000","last_active":"2024-09-12T01:10:57.875830+0000","last_peered":"2024-09-12T01:10:57.875830+0000","last_clean":"2024-09-12T01:10:57.875830+0000","last_became_active":"2024-09-12T00:12:40.035633+0000","last_became_peered":"2024-09-12T00:12:40.035633+0000","last_unstale":"2024-09-12T01:10:57.875830+0000","last_undegraded":"2024-09-12T01:10:57.875830+0000","last_fullsized":"2024-09-12T01:10:57.875830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'82","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.173387+0000","last_change":"2024-09-12T00:12:42.051649+0000","last_active":"2024-09-12T01:09:00.173387+0000","last_peered":"2024-09-12T01:09:00.173387+0000","last_clean":"2024-09-12T01:09:00.173387+0000","last_became_active":"2024-09-12T00:12:42.051384+0000","last_became_peered":"2024-09-12T00:12:42.051384+0000","last_unstale":"2024-09-12T01:09:00.173387+0000","last_undegraded":"2024-09-12T01:09:00.173387+0000","last_fullsized":"2024-09-12T01:09:00.173387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'777","reported_seq":4088,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.232081+0000","last_change":"2024-09-12T00:12:44.062143+0000","last_active":"2024-09-12T01:11:00.232081+0000","last_peered":"2024-09-12T01:11:00.232081+0000","last_clean":"2024-09-12T01:11:00.232081+0000","last_became_active":"2024-09-12T00:12:44.061837+0000","last_became_peered":"2024-09-12T00:12:44.061837+0000","last_unstale":"2024-09-12T01:11:00.232081+0000","last_undegraded":"2024-09-12T01:11:00.232081+0000","last_fullsized":"2024-09-12T01:11:00.232081+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'132","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.556490+0000","last_change":"2024-09-12T00:12:46.059816+0000","last_active":"2024-09-12T01:09:22.556490+0000","last_peered":"2024-09-12T01:09:22.556490+0000","last_clean":"2024-09-12T01:09:22.556490+0000","last_became_active":"2024-09-12T00:12:46.057978+0000","last_became_peered":"2024-09-12T00:12:46.057978+0000","last_unstale":"2024-09-12T01:09:22.556490+0000","last_undegraded":"2024-09-12T01:09:22.556490+0000","last_fullsized":"2024-09-12T01:09:22.556490+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":126,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'235","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.760627+0000","last_change":"2024-09-12T01:11:09.760564+0000","last_active":"2024-09-12T01:11:09.760627+0000","last_peered":"2024-09-12T01:11:09.760627+0000","last_clean":"2024-09-12T01:11:09.760627+0000","last_became_active":"2024-09-12T00:12:38.037035+0000","last_became_peered":"2024-09-12T00:12:38.037035+0000","last_unstale":"2024-09-12T01:11:09.760627+0000","last_undegraded":"2024-09-12T01:11:09.760627+0000","last_fullsized":"2024-09-12T01:11:09.760627+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'235","last_scrub_stamp":"2024-09-12T01:11:09.760480+0000","last_deep_scrub":"263'235","last_deep_scrub_stamp":"2024-09-12T01:11:09.760480+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.760480+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:10.352680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":394,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'298","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.602123+0000","last_change":"2024-09-12T01:11:10.602123+0000","last_active":"2024-09-12T01:11:10.602123+0000","last_peered":"2024-09-12T01:11:10.602123+0000","last_clean":"2024-09-12T01:11:10.602123+0000","last_became_active":"2024-09-12T00:12:36.029059+0000","last_became_peered":"2024-09-12T00:12:36.029059+0000","last_unstale":"2024-09-12T01:11:10.602123+0000","last_undegraded":"2024-09-12T01:11:10.602123+0000","last_fullsized":"2024-09-12T01:11:10.602123+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'298","last_scrub_stamp":"2024-09-12T01:11:10.601960+0000","last_deep_scrub":"263'298","last_deep_scrub_stamp":"2024-09-12T01:11:10.601960+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.601960+0000","objects_scrubbed":9,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:37.836366+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4837920,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":419,"num_read_kb":19038,"num_write":995,"num_write_kb":37710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.049825+0000","last_change":"2024-09-12T00:12:40.042406+0000","last_active":"2024-09-12T01:08:55.049825+0000","last_peered":"2024-09-12T01:08:55.049825+0000","last_clean":"2024-09-12T01:08:55.049825+0000","last_became_active":"2024-09-12T00:12:40.042158+0000","last_became_peered":"2024-09-12T00:12:40.042158+0000","last_unstale":"2024-09-12T01:08:55.049825+0000","last_undegraded":"2024-09-12T01:08:55.049825+0000","last_fullsized":"2024-09-12T01:08:55.049825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'350","reported_seq":958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.869303+0000","last_change":"2024-09-12T00:12:42.049042+0000","last_active":"2024-09-12T01:10:59.869303+0000","last_peered":"2024-09-12T01:10:59.869303+0000","last_clean":"2024-09-12T01:10:59.869303+0000","last_became_active":"2024-09-12T00:12:42.048747+0000","last_became_peered":"2024-09-12T00:12:42.048747+0000","last_unstale":"2024-09-12T01:10:59.869303+0000","last_undegraded":"2024-09-12T01:10:59.869303+0000","last_fullsized":"2024-09-12T01:10:59.869303+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49371,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":1173,"num_write":448,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.331384+0000","last_change":"2024-09-12T01:11:23.331384+0000","last_active":"2024-09-12T01:11:23.331384+0000","last_peered":"2024-09-12T01:11:23.331384+0000","last_clean":"2024-09-12T01:11:23.331384+0000","last_became_active":"2024-09-12T00:12:44.050074+0000","last_became_peered":"2024-09-12T00:12:44.050074+0000","last_unstale":"2024-09-12T01:11:23.331384+0000","last_undegraded":"2024-09-12T01:11:23.331384+0000","last_fullsized":"2024-09-12T01:11:23.331384+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.331283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.331283+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.331283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:57.228673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'192","reported_seq":699,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:05.057345+0000","last_change":"2024-09-12T00:12:46.064781+0000","last_active":"2024-09-12T01:09:05.057345+0000","last_peered":"2024-09-12T01:09:05.057345+0000","last_clean":"2024-09-12T01:09:05.057345+0000","last_became_active":"2024-09-12T00:12:46.064517+0000","last_became_peered":"2024-09-12T00:12:46.064517+0000","last_unstale":"2024-09-12T01:09:05.057345+0000","last_undegraded":"2024-09-12T01:09:05.057345+0000","last_fullsized":"2024-09-12T01:09:05.057345+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":229,"num_read_kb":204,"num_write":354,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'289","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.331049+0000","last_change":"2024-09-12T01:11:20.331049+0000","last_active":"2024-09-12T01:11:20.331049+0000","last_peered":"2024-09-12T01:11:20.331049+0000","last_clean":"2024-09-12T01:11:20.331049+0000","last_became_active":"2024-09-12T00:12:38.040885+0000","last_became_peered":"2024-09-12T00:12:38.040885+0000","last_unstale":"2024-09-12T01:11:20.331049+0000","last_undegraded":"2024-09-12T01:11:20.331049+0000","last_fullsized":"2024-09-12T01:11:20.331049+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-12T01:11:20.330958+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-12T01:11:20.330958+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.330958+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:40.353584+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1200,"num_read_kb":970,"num_write":419,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8074,"num_omap_keys":32,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:04.285268+0000","last_change":"2024-09-12T01:11:04.285268+0000","last_active":"2024-09-12T01:11:04.285268+0000","last_peered":"2024-09-12T01:11:04.285268+0000","last_clean":"2024-09-12T01:11:04.285268+0000","last_became_active":"2024-09-12T00:12:17.817880+0000","last_became_peered":"2024-09-12T00:12:17.817880+0000","last_unstale":"2024-09-12T01:11:04.285268+0000","last_undegraded":"2024-09-12T01:11:04.285268+0000","last_fullsized":"2024-09-12T01:11:04.285268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T01:11:04.285203+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T01:11:04.285203+0000","last_clean_scrub_stamp":"2024-09-12T01:11:04.285203+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:05.465929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.368102+0000","last_change":"2024-09-12T01:11:09.368102+0000","last_active":"2024-09-12T01:11:09.368102+0000","last_peered":"2024-09-12T01:11:09.368102+0000","last_clean":"2024-09-12T01:11:09.368102+0000","last_became_active":"2024-09-12T00:12:22.713297+0000","last_became_peered":"2024-09-12T00:12:22.713297+0000","last_unstale":"2024-09-12T01:11:09.368102+0000","last_undegraded":"2024-09-12T01:11:09.368102+0000","last_fullsized":"2024-09-12T01:11:09.368102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:09.368014+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:09.368014+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.368014+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:32.949309+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0014022310000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'392","reported_seq":1105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.672420+0000","last_change":"2024-09-12T01:11:05.672420+0000","last_active":"2024-09-12T01:11:05.672420+0000","last_peered":"2024-09-12T01:11:05.672420+0000","last_clean":"2024-09-12T01:11:05.672420+0000","last_became_active":"2024-09-12T00:12:36.030408+0000","last_became_peered":"2024-09-12T00:12:36.030408+0000","last_unstale":"2024-09-12T01:11:05.672420+0000","last_undegraded":"2024-09-12T01:11:05.672420+0000","last_fullsized":"2024-09-12T01:11:05.672420+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-12T01:11:05.672292+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-12T01:11:05.672292+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.672292+0000","objects_scrubbed":7,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:44.373893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262211,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":42611,"num_write":1169,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"39'3","reported_seq":980,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.876104+0000","last_change":"2024-09-12T00:12:40.039805+0000","last_active":"2024-09-12T01:10:57.876104+0000","last_peered":"2024-09-12T01:10:57.876104+0000","last_clean":"2024-09-12T01:10:57.876104+0000","last_became_active":"2024-09-12T00:12:40.039529+0000","last_became_peered":"2024-09-12T00:12:40.039529+0000","last_unstale":"2024-09-12T01:10:57.876104+0000","last_undegraded":"2024-09-12T01:10:57.876104+0000","last_fullsized":"2024-09-12T01:10:57.876104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:59.811179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'764","reported_seq":1474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.988495+0000","last_change":"2024-09-12T00:12:42.047000+0000","last_active":"2024-09-12T01:10:59.988495+0000","last_peered":"2024-09-12T01:10:59.988495+0000","last_clean":"2024-09-12T01:10:59.988495+0000","last_became_active":"2024-09-12T00:12:42.046668+0000","last_became_peered":"2024-09-12T00:12:42.046668+0000","last_unstale":"2024-09-12T01:10:59.988495+0000","last_undegraded":"2024-09-12T01:10:59.988495+0000","last_fullsized":"2024-09-12T01:10:59.988495+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143901,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1496,"num_read_kb":3385,"num_write":1448,"num_write_kb":1292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:08.055321+0000","last_change":"2024-09-12T00:12:44.054071+0000","last_active":"2024-09-12T01:09:08.055321+0000","last_peered":"2024-09-12T01:09:08.055321+0000","last_clean":"2024-09-12T01:09:08.055321+0000","last_became_active":"2024-09-12T00:12:44.053779+0000","last_became_peered":"2024-09-12T00:12:44.053779+0000","last_unstale":"2024-09-12T01:09:08.055321+0000","last_undegraded":"2024-09-12T01:09:08.055321+0000","last_fullsized":"2024-09-12T01:09:08.055321+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'187","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.327041+0000","last_change":"2024-09-12T00:12:46.055892+0000","last_active":"2024-09-12T01:09:23.327041+0000","last_peered":"2024-09-12T01:09:23.327041+0000","last_clean":"2024-09-12T01:09:23.327041+0000","last_became_active":"2024-09-12T00:12:46.055501+0000","last_became_peered":"2024-09-12T00:12:46.055501+0000","last_unstale":"2024-09-12T01:09:23.327041+0000","last_undegraded":"2024-09-12T01:09:23.327041+0000","last_fullsized":"2024-09-12T01:09:23.327041+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":436,"num_write":384,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'149","reported_seq":737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.868218+0000","last_change":"2024-09-12T01:11:18.868218+0000","last_active":"2024-09-12T01:11:18.868218+0000","last_peered":"2024-09-12T01:11:18.868218+0000","last_clean":"2024-09-12T01:11:18.868218+0000","last_became_active":"2024-09-12T00:12:38.037392+0000","last_became_peered":"2024-09-12T00:12:38.037392+0000","last_unstale":"2024-09-12T01:11:18.868218+0000","last_undegraded":"2024-09-12T01:11:18.868218+0000","last_fullsized":"2024-09-12T01:11:18.868218+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-12T01:11:18.868095+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-12T01:11:18.868095+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.868095+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:24.230817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":647,"num_read_kb":530,"num_write":212,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.270371+0000","last_change":"2024-09-12T01:11:05.270371+0000","last_active":"2024-09-12T01:11:05.270371+0000","last_peered":"2024-09-12T01:11:05.270371+0000","last_clean":"2024-09-12T01:11:05.270371+0000","last_became_active":"2024-09-12T00:12:22.713657+0000","last_became_peered":"2024-09-12T00:12:22.713657+0000","last_unstale":"2024-09-12T01:11:05.270371+0000","last_undegraded":"2024-09-12T01:11:05.270371+0000","last_fullsized":"2024-09-12T01:11:05.270371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:05.270282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:05.270282+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.270282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:52.804966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012667690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'335","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.358183+0000","last_change":"2024-09-12T01:11:06.358183+0000","last_active":"2024-09-12T01:11:06.358183+0000","last_peered":"2024-09-12T01:11:06.358183+0000","last_clean":"2024-09-12T01:11:06.358183+0000","last_became_active":"2024-09-12T00:12:36.036010+0000","last_became_peered":"2024-09-12T00:12:36.036010+0000","last_unstale":"2024-09-12T01:11:06.358183+0000","last_undegraded":"2024-09-12T01:11:06.358183+0000","last_fullsized":"2024-09-12T01:11:06.358183+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:11:06.358069+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:11:06.358069+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.358069+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.445759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":7159,"num_write":1103,"num_write_kb":37525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.050651+0000","last_change":"2024-09-12T00:12:40.039924+0000","last_active":"2024-09-12T01:09:00.050651+0000","last_peered":"2024-09-12T01:09:00.050651+0000","last_clean":"2024-09-12T01:09:00.050651+0000","last_became_active":"2024-09-12T00:12:40.039592+0000","last_became_peered":"2024-09-12T00:12:40.039592+0000","last_unstale":"2024-09-12T01:09:00.050651+0000","last_undegraded":"2024-09-12T01:09:00.050651+0000","last_fullsized":"2024-09-12T01:09:00.050651+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1308","reported_seq":2939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.227167+0000","last_change":"2024-09-12T00:12:42.049983+0000","last_active":"2024-09-12T01:11:00.227167+0000","last_peered":"2024-09-12T01:11:00.227167+0000","last_clean":"2024-09-12T01:11:00.227167+0000","last_became_active":"2024-09-12T00:12:42.049594+0000","last_became_peered":"2024-09-12T00:12:42.049594+0000","last_unstale":"2024-09-12T01:11:00.227167+0000","last_undegraded":"2024-09-12T01:11:00.227167+0000","last_fullsized":"2024-09-12T01:11:00.227167+0000","mapping_epoch":33,"log_start":"263'1201","ondisk_log_start":"263'1201","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":1201,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:24.166453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146958,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3903,"num_write":1160,"num_write_kb":992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.052533+0000","last_change":"2024-09-12T00:12:44.059941+0000","last_active":"2024-09-12T01:09:15.052533+0000","last_peered":"2024-09-12T01:09:15.052533+0000","last_clean":"2024-09-12T01:09:15.052533+0000","last_became_active":"2024-09-12T00:12:44.059188+0000","last_became_peered":"2024-09-12T00:12:44.059188+0000","last_unstale":"2024-09-12T01:09:15.052533+0000","last_undegraded":"2024-09-12T01:09:15.052533+0000","last_fullsized":"2024-09-12T01:09:15.052533+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'151","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.534259+0000","last_change":"2024-09-12T00:12:46.065282+0000","last_active":"2024-09-12T01:09:21.534259+0000","last_peered":"2024-09-12T01:09:21.534259+0000","last_clean":"2024-09-12T01:09:21.534259+0000","last_became_active":"2024-09-12T00:12:46.064993+0000","last_became_peered":"2024-09-12T00:12:46.064993+0000","last_unstale":"2024-09-12T01:09:21.534259+0000","last_undegraded":"2024-09-12T01:09:21.534259+0000","last_fullsized":"2024-09-12T01:09:21.534259+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:44.458446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":277,"num_write":363,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'61","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.234785+0000","last_change":"2024-09-12T01:11:17.234785+0000","last_active":"2024-09-12T01:11:17.234785+0000","last_peered":"2024-09-12T01:11:17.234785+0000","last_clean":"2024-09-12T01:11:17.234785+0000","last_became_active":"2024-09-12T00:12:38.039492+0000","last_became_peered":"2024-09-12T00:12:38.039492+0000","last_unstale":"2024-09-12T01:11:17.234785+0000","last_undegraded":"2024-09-12T01:11:17.234785+0000","last_fullsized":"2024-09-12T01:11:17.234785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'61","last_scrub_stamp":"2024-09-12T01:11:17.234696+0000","last_deep_scrub":"263'61","last_deep_scrub_stamp":"2024-09-12T01:11:17.234696+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.234696+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:55.520286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":235,"num_write":88,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.746156+0000","last_change":"2024-09-12T01:11:07.746156+0000","last_active":"2024-09-12T01:11:07.746156+0000","last_peered":"2024-09-12T01:11:07.746156+0000","last_clean":"2024-09-12T01:11:07.746156+0000","last_became_active":"2024-09-12T00:12:22.714487+0000","last_became_peered":"2024-09-12T00:12:22.714487+0000","last_unstale":"2024-09-12T01:11:07.746156+0000","last_undegraded":"2024-09-12T01:11:07.746156+0000","last_fullsized":"2024-09-12T01:11:07.746156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:07.746070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:07.746070+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.746070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:58.957625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038937299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'315","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.637646+0000","last_change":"2024-09-12T01:11:06.637646+0000","last_active":"2024-09-12T01:11:06.637646+0000","last_peered":"2024-09-12T01:11:06.637646+0000","last_clean":"2024-09-12T01:11:06.637646+0000","last_became_active":"2024-09-12T00:12:36.042293+0000","last_became_peered":"2024-09-12T00:12:36.042293+0000","last_unstale":"2024-09-12T01:11:06.637646+0000","last_undegraded":"2024-09-12T01:11:06.637646+0000","last_fullsized":"2024-09-12T01:11:06.637646+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-09-12T01:11:06.637502+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-09-12T01:11:06.637502+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.637502+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.943410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214314,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":33497,"num_write":1058,"num_write_kb":40497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.726967+0000","last_change":"2024-09-12T01:11:18.726967+0000","last_active":"2024-09-12T01:11:18.726967+0000","last_peered":"2024-09-12T01:11:18.726967+0000","last_clean":"2024-09-12T01:11:18.726967+0000","last_became_active":"2024-09-12T00:12:40.038202+0000","last_became_peered":"2024-09-12T00:12:40.038202+0000","last_unstale":"2024-09-12T01:11:18.726967+0000","last_undegraded":"2024-09-12T01:11:18.726967+0000","last_fullsized":"2024-09-12T01:11:18.726967+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:18.726875+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:18.726875+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.726875+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:47.107289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'257","reported_seq":1498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.177486+0000","last_change":"2024-09-12T01:11:20.177486+0000","last_active":"2024-09-12T01:11:20.177486+0000","last_peered":"2024-09-12T01:11:20.177486+0000","last_clean":"2024-09-12T01:11:20.177486+0000","last_became_active":"2024-09-12T00:12:42.044498+0000","last_became_peered":"2024-09-12T00:12:42.044498+0000","last_unstale":"2024-09-12T01:11:20.177486+0000","last_undegraded":"2024-09-12T01:11:20.177486+0000","last_fullsized":"2024-09-12T01:11:20.177486+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'257","last_scrub_stamp":"2024-09-12T01:11:20.177386+0000","last_deep_scrub":"263'257","last_deep_scrub_stamp":"2024-09-12T01:11:20.177386+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.177386+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:56.030842+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":187,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.056476+0000","last_change":"2024-09-12T00:12:44.062318+0000","last_active":"2024-09-12T01:09:00.056476+0000","last_peered":"2024-09-12T01:09:00.056476+0000","last_clean":"2024-09-12T01:09:00.056476+0000","last_became_active":"2024-09-12T00:12:44.062039+0000","last_became_peered":"2024-09-12T00:12:44.062039+0000","last_unstale":"2024-09-12T01:09:00.056476+0000","last_undegraded":"2024-09-12T01:09:00.056476+0000","last_fullsized":"2024-09-12T01:09:00.056476+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:41.686967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'260","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.569395+0000","last_change":"2024-09-12T00:12:46.053602+0000","last_active":"2024-09-12T01:09:23.569395+0000","last_peered":"2024-09-12T01:09:23.569395+0000","last_clean":"2024-09-12T01:09:23.569395+0000","last_became_active":"2024-09-12T00:12:46.053228+0000","last_became_peered":"2024-09-12T00:12:46.053228+0000","last_unstale":"2024-09-12T01:09:23.569395+0000","last_undegraded":"2024-09-12T01:09:23.569395+0000","last_fullsized":"2024-09-12T01:09:23.569395+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":531,"num_write":580,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'172","reported_seq":760,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.245410+0000","last_change":"2024-09-12T01:11:16.245410+0000","last_active":"2024-09-12T01:11:16.245410+0000","last_peered":"2024-09-12T01:11:16.245410+0000","last_clean":"2024-09-12T01:11:16.245410+0000","last_became_active":"2024-09-12T00:12:38.040477+0000","last_became_peered":"2024-09-12T00:12:38.040477+0000","last_unstale":"2024-09-12T01:11:16.245410+0000","last_undegraded":"2024-09-12T01:11:16.245410+0000","last_fullsized":"2024-09-12T01:11:16.245410+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-09-12T01:11:16.245307+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-09-12T01:11:16.245307+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.245307+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:24.897173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":766,"num_read_kb":623,"num_write":281,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.249463+0000","last_change":"2024-09-12T01:11:06.249463+0000","last_active":"2024-09-12T01:11:06.249463+0000","last_peered":"2024-09-12T01:11:06.249463+0000","last_clean":"2024-09-12T01:11:06.249463+0000","last_became_active":"2024-09-12T00:12:22.840587+0000","last_became_peered":"2024-09-12T00:12:22.840587+0000","last_unstale":"2024-09-12T01:11:06.249463+0000","last_undegraded":"2024-09-12T01:11:06.249463+0000","last_fullsized":"2024-09-12T01:11:06.249463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:11:06.249395+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:11:06.249395+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.249395+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:59.319645+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00065014999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'371","reported_seq":1097,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.091924+0000","last_change":"2024-09-12T01:11:05.091924+0000","last_active":"2024-09-12T01:11:05.091924+0000","last_peered":"2024-09-12T01:11:05.091924+0000","last_clean":"2024-09-12T01:11:05.091924+0000","last_became_active":"2024-09-12T00:12:36.039564+0000","last_became_peered":"2024-09-12T00:12:36.039564+0000","last_unstale":"2024-09-12T01:11:05.091924+0000","last_undegraded":"2024-09-12T01:11:05.091924+0000","last_fullsized":"2024-09-12T01:11:05.091924+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-12T01:11:05.091758+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-12T01:11:05.091758+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.091758+0000","objects_scrubbed":10,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:28.012152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568589,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":639,"num_read_kb":35583,"num_write":1189,"num_write_kb":35527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.769511+0000","last_change":"2024-09-12T01:11:17.769511+0000","last_active":"2024-09-12T01:11:17.769511+0000","last_peered":"2024-09-12T01:11:17.769511+0000","last_clean":"2024-09-12T01:11:17.769511+0000","last_became_active":"2024-09-12T00:12:40.042510+0000","last_became_peered":"2024-09-12T00:12:40.042510+0000","last_unstale":"2024-09-12T01:11:17.769511+0000","last_undegraded":"2024-09-12T01:11:17.769511+0000","last_fullsized":"2024-09-12T01:11:17.769511+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:17.769411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:17.769411+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.769411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:32.805066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'131","reported_seq":668,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.150602+0000","last_change":"2024-09-12T00:12:42.051046+0000","last_active":"2024-09-12T01:10:33.150602+0000","last_peered":"2024-09-12T01:10:33.150602+0000","last_clean":"2024-09-12T01:10:33.150602+0000","last_became_active":"2024-09-12T00:12:42.050143+0000","last_became_peered":"2024-09-12T00:12:42.050143+0000","last_unstale":"2024-09-12T01:10:33.150602+0000","last_undegraded":"2024-09-12T01:10:33.150602+0000","last_fullsized":"2024-09-12T01:10:33.150602+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:05.051268+0000","last_change":"2024-09-12T00:12:44.059423+0000","last_active":"2024-09-12T01:09:05.051268+0000","last_peered":"2024-09-12T01:09:05.051268+0000","last_clean":"2024-09-12T01:09:05.051268+0000","last_became_active":"2024-09-12T00:12:44.059037+0000","last_became_peered":"2024-09-12T00:12:44.059037+0000","last_unstale":"2024-09-12T01:09:05.051268+0000","last_undegraded":"2024-09-12T01:09:05.051268+0000","last_fullsized":"2024-09-12T01:09:05.051268+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'163","reported_seq":715,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:21.938025+0000","last_change":"2024-09-12T00:12:46.069307+0000","last_active":"2024-09-12T01:09:21.938025+0000","last_peered":"2024-09-12T01:09:21.938025+0000","last_clean":"2024-09-12T01:09:21.938025+0000","last_became_active":"2024-09-12T00:12:46.068934+0000","last_became_peered":"2024-09-12T00:12:46.068934+0000","last_unstale":"2024-09-12T01:09:21.938025+0000","last_undegraded":"2024-09-12T01:09:21.938025+0000","last_fullsized":"2024-09-12T01:09:21.938025+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":270,"num_read_kb":259,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'111","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.199730+0000","last_change":"2024-09-12T01:11:15.199730+0000","last_active":"2024-09-12T01:11:15.199730+0000","last_peered":"2024-09-12T01:11:15.199730+0000","last_clean":"2024-09-12T01:11:15.199730+0000","last_became_active":"2024-09-12T00:12:38.044464+0000","last_became_peered":"2024-09-12T00:12:38.044464+0000","last_unstale":"2024-09-12T01:11:15.199730+0000","last_undegraded":"2024-09-12T01:11:15.199730+0000","last_fullsized":"2024-09-12T01:11:15.199730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:11:15.199631+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:11:15.199631+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.199631+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:16.550535+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":513,"num_read_kb":428,"num_write":178,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'371","reported_seq":1145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:04.190226+0000","last_change":"2024-09-12T01:11:04.190168+0000","last_active":"2024-09-12T01:11:04.190226+0000","last_peered":"2024-09-12T01:11:04.190226+0000","last_clean":"2024-09-12T01:11:04.190226+0000","last_became_active":"2024-09-12T00:12:36.036570+0000","last_became_peered":"2024-09-12T00:12:36.036570+0000","last_unstale":"2024-09-12T01:11:04.190226+0000","last_undegraded":"2024-09-12T01:11:04.190226+0000","last_fullsized":"2024-09-12T01:11:04.190226+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-12T01:11:04.190045+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-12T01:11:04.190045+0000","last_clean_scrub_stamp":"2024-09-12T01:11:04.190045+0000","objects_scrubbed":9,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:33.603768+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524373,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":804,"num_read_kb":22341,"num_write":1147,"num_write_kb":30942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.589125+0000","last_change":"2024-09-12T01:11:05.589125+0000","last_active":"2024-09-12T01:11:05.589125+0000","last_peered":"2024-09-12T01:11:05.589125+0000","last_clean":"2024-09-12T01:11:05.589125+0000","last_became_active":"2024-09-12T00:12:22.840210+0000","last_became_peered":"2024-09-12T00:12:22.840210+0000","last_unstale":"2024-09-12T01:11:05.589125+0000","last_undegraded":"2024-09-12T01:11:05.589125+0000","last_fullsized":"2024-09-12T01:11:05.589125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:05.589031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:05.589031+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.589031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:48.332487+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00043827699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.462491+0000","last_change":"2024-09-12T01:11:23.462491+0000","last_active":"2024-09-12T01:11:23.462491+0000","last_peered":"2024-09-12T01:11:23.462491+0000","last_clean":"2024-09-12T01:11:23.462491+0000","last_became_active":"2024-09-12T00:12:40.040760+0000","last_became_peered":"2024-09-12T00:12:40.040760+0000","last_unstale":"2024-09-12T01:11:23.462491+0000","last_undegraded":"2024-09-12T01:11:23.462491+0000","last_fullsized":"2024-09-12T01:11:23.462491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.462403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.462403+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.462403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:07.120114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'635","reported_seq":1315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.726383+0000","last_change":"2024-09-12T01:11:20.726383+0000","last_active":"2024-09-12T01:11:20.726383+0000","last_peered":"2024-09-12T01:11:20.726383+0000","last_clean":"2024-09-12T01:11:20.726383+0000","last_became_active":"2024-09-12T00:12:42.053472+0000","last_became_peered":"2024-09-12T00:12:42.053472+0000","last_unstale":"2024-09-12T01:11:20.726383+0000","last_undegraded":"2024-09-12T01:11:20.726383+0000","last_fullsized":"2024-09-12T01:11:20.726383+0000","mapping_epoch":33,"log_start":"263'600","ondisk_log_start":"263'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'635","last_scrub_stamp":"2024-09-12T01:11:20.726278+0000","last_deep_scrub":"263'635","last_deep_scrub_stamp":"2024-09-12T01:11:20.726278+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.726278+0000","objects_scrubbed":11,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:47.077848+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1715,"num_read_kb":3028,"num_write":2216,"num_write_kb":2038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":509110,"num_omap_keys":1156,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.143292+0000","last_change":"2024-09-12T00:12:44.049070+0000","last_active":"2024-09-12T01:09:00.143292+0000","last_peered":"2024-09-12T01:09:00.143292+0000","last_clean":"2024-09-12T01:09:00.143292+0000","last_became_active":"2024-09-12T00:12:44.048703+0000","last_became_peered":"2024-09-12T00:12:44.048703+0000","last_unstale":"2024-09-12T01:09:00.143292+0000","last_undegraded":"2024-09-12T01:09:00.143292+0000","last_fullsized":"2024-09-12T01:09:00.143292+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'142","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.593711+0000","last_change":"2024-09-12T00:12:46.064205+0000","last_active":"2024-09-12T01:09:20.593711+0000","last_peered":"2024-09-12T01:09:20.593711+0000","last_clean":"2024-09-12T01:09:20.593711+0000","last_became_active":"2024-09-12T00:12:46.063429+0000","last_became_peered":"2024-09-12T00:12:46.063429+0000","last_unstale":"2024-09-12T01:09:20.593711+0000","last_undegraded":"2024-09-12T01:09:20.593711+0000","last_fullsized":"2024-09-12T01:09:20.593711+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":320,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'178","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.232032+0000","last_change":"2024-09-12T01:11:14.232032+0000","last_active":"2024-09-12T01:11:14.232032+0000","last_peered":"2024-09-12T01:11:14.232032+0000","last_clean":"2024-09-12T01:11:14.232032+0000","last_became_active":"2024-09-12T00:12:38.041178+0000","last_became_peered":"2024-09-12T00:12:38.041178+0000","last_unstale":"2024-09-12T01:11:14.232032+0000","last_undegraded":"2024-09-12T01:11:14.232032+0000","last_fullsized":"2024-09-12T01:11:14.232032+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'178","last_scrub_stamp":"2024-09-12T01:11:14.231899+0000","last_deep_scrub":"263'178","last_deep_scrub_stamp":"2024-09-12T01:11:14.231899+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.231899+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:31.662431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":778,"num_read_kb":646,"num_write":262,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'366","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.335804+0000","last_change":"2024-09-12T01:11:07.335804+0000","last_active":"2024-09-12T01:11:07.335804+0000","last_peered":"2024-09-12T01:11:07.335804+0000","last_clean":"2024-09-12T01:11:07.335804+0000","last_became_active":"2024-09-12T00:12:36.035932+0000","last_became_peered":"2024-09-12T00:12:36.035932+0000","last_unstale":"2024-09-12T01:11:07.335804+0000","last_undegraded":"2024-09-12T01:11:07.335804+0000","last_fullsized":"2024-09-12T01:11:07.335804+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-12T01:11:07.335670+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-12T01:11:07.335670+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.335670+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:26.350544+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":22298,"num_write":1170,"num_write_kb":32564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.332587+0000","last_change":"2024-09-12T01:11:08.332587+0000","last_active":"2024-09-12T01:11:08.332587+0000","last_peered":"2024-09-12T01:11:08.332587+0000","last_clean":"2024-09-12T01:11:08.332587+0000","last_became_active":"2024-09-12T00:12:22.713263+0000","last_became_peered":"2024-09-12T00:12:22.713263+0000","last_unstale":"2024-09-12T01:11:08.332587+0000","last_undegraded":"2024-09-12T01:11:08.332587+0000","last_fullsized":"2024-09-12T01:11:08.332587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:08.332490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:08.332490+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.332490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:24.233170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065424400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.142367+0000","last_change":"2024-09-12T01:11:19.142367+0000","last_active":"2024-09-12T01:11:19.142367+0000","last_peered":"2024-09-12T01:11:19.142367+0000","last_clean":"2024-09-12T01:11:19.142367+0000","last_became_active":"2024-09-12T00:12:40.038903+0000","last_became_peered":"2024-09-12T00:12:40.038903+0000","last_unstale":"2024-09-12T01:11:19.142367+0000","last_undegraded":"2024-09-12T01:11:19.142367+0000","last_fullsized":"2024-09-12T01:11:19.142367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.142267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.142267+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.142267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:18.760101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'172","reported_seq":742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.173269+0000","last_change":"2024-09-12T00:12:42.050874+0000","last_active":"2024-09-12T01:09:00.173269+0000","last_peered":"2024-09-12T01:09:00.173269+0000","last_clean":"2024-09-12T01:09:00.173269+0000","last_became_active":"2024-09-12T00:12:42.050580+0000","last_became_peered":"2024-09-12T00:12:42.050580+0000","last_unstale":"2024-09-12T01:09:00.173269+0000","last_undegraded":"2024-09-12T01:09:00.173269+0000","last_fullsized":"2024-09-12T01:09:00.173269+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:59.841756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":221,"num_write":156,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'778","reported_seq":2701,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:57.881010+0000","last_change":"2024-09-12T00:12:44.050548+0000","last_active":"2024-09-12T01:10:57.881010+0000","last_peered":"2024-09-12T01:10:57.881010+0000","last_clean":"2024-09-12T01:10:57.881010+0000","last_became_active":"2024-09-12T00:12:44.050295+0000","last_became_peered":"2024-09-12T00:12:44.050295+0000","last_unstale":"2024-09-12T01:10:57.881010+0000","last_undegraded":"2024-09-12T01:10:57.881010+0000","last_fullsized":"2024-09-12T01:10:57.881010+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:53.235246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'126","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:15.059081+0000","last_change":"2024-09-12T00:12:46.064323+0000","last_active":"2024-09-12T01:09:15.059081+0000","last_peered":"2024-09-12T01:09:15.059081+0000","last_clean":"2024-09-12T01:09:15.059081+0000","last_became_active":"2024-09-12T00:12:46.064036+0000","last_became_peered":"2024-09-12T00:12:46.064036+0000","last_unstale":"2024-09-12T01:09:15.059081+0000","last_undegraded":"2024-09-12T01:09:15.059081+0000","last_fullsized":"2024-09-12T01:09:15.059081+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:58.782613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1116,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'66","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.583250+0000","last_change":"2024-09-12T01:11:15.583250+0000","last_active":"2024-09-12T01:11:15.583250+0000","last_peered":"2024-09-12T01:11:15.583250+0000","last_clean":"2024-09-12T01:11:15.583250+0000","last_became_active":"2024-09-12T00:12:38.039759+0000","last_became_peered":"2024-09-12T00:12:38.039759+0000","last_unstale":"2024-09-12T01:11:15.583250+0000","last_undegraded":"2024-09-12T01:11:15.583250+0000","last_fullsized":"2024-09-12T01:11:15.583250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'66","last_scrub_stamp":"2024-09-12T01:11:15.583159+0000","last_deep_scrub":"263'66","last_deep_scrub_stamp":"2024-09-12T01:11:15.583159+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.583159+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:34.335798+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":290,"num_read_kb":242,"num_write":89,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":503,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'356","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.632386+0000","last_change":"2024-09-12T01:11:08.632286+0000","last_active":"2024-09-12T01:11:08.632386+0000","last_peered":"2024-09-12T01:11:08.632386+0000","last_clean":"2024-09-12T01:11:08.632386+0000","last_became_active":"2024-09-12T00:12:36.032470+0000","last_became_peered":"2024-09-12T00:12:36.032470+0000","last_unstale":"2024-09-12T01:11:08.632386+0000","last_undegraded":"2024-09-12T01:11:08.632386+0000","last_fullsized":"2024-09-12T01:11:08.632386+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-12T01:11:08.632121+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-12T01:11:08.632121+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.632121+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:33.909337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":506,"num_read_kb":9897,"num_write":1201,"num_write_kb":25017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.678646+0000","last_change":"2024-09-12T01:11:06.678646+0000","last_active":"2024-09-12T01:11:06.678646+0000","last_peered":"2024-09-12T01:11:06.678646+0000","last_clean":"2024-09-12T01:11:06.678646+0000","last_became_active":"2024-09-12T00:12:22.875452+0000","last_became_peered":"2024-09-12T00:12:22.875452+0000","last_unstale":"2024-09-12T01:11:06.678646+0000","last_undegraded":"2024-09-12T01:11:06.678646+0000","last_fullsized":"2024-09-12T01:11:06.678646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:06.678559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:06.678559+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.678559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:14.194427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040035500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.049709+0000","last_change":"2024-09-12T00:12:40.040001+0000","last_active":"2024-09-12T01:08:55.049709+0000","last_peered":"2024-09-12T01:08:55.049709+0000","last_clean":"2024-09-12T01:08:55.049709+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:08:55.049709+0000","last_undegraded":"2024-09-12T01:08:55.049709+0000","last_fullsized":"2024-09-12T01:08:55.049709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:47.045425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'129","reported_seq":675,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.050520+0000","last_change":"2024-09-12T00:12:42.048645+0000","last_active":"2024-09-12T01:09:00.050520+0000","last_peered":"2024-09-12T01:09:00.050520+0000","last_clean":"2024-09-12T01:09:00.050520+0000","last_became_active":"2024-09-12T00:12:42.048364+0000","last_became_peered":"2024-09-12T00:12:42.048364+0000","last_unstale":"2024-09-12T01:09:00.050520+0000","last_undegraded":"2024-09-12T01:09:00.050520+0000","last_fullsized":"2024-09-12T01:09:00.050520+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'806","reported_seq":2516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.233057+0000","last_change":"2024-09-12T00:12:44.050927+0000","last_active":"2024-09-12T01:11:00.233057+0000","last_peered":"2024-09-12T01:11:00.233057+0000","last_clean":"2024-09-12T01:11:00.233057+0000","last_became_active":"2024-09-12T00:12:44.049336+0000","last_became_peered":"2024-09-12T00:12:44.049336+0000","last_unstale":"2024-09-12T01:11:00.233057+0000","last_undegraded":"2024-09-12T01:11:00.233057+0000","last_fullsized":"2024-09-12T01:11:00.233057+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'271","reported_seq":791,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.054550+0000","last_change":"2024-09-12T00:12:46.064357+0000","last_active":"2024-09-12T01:09:03.054550+0000","last_peered":"2024-09-12T01:09:03.054550+0000","last_clean":"2024-09-12T01:09:03.054550+0000","last_became_active":"2024-09-12T00:12:46.064058+0000","last_became_peered":"2024-09-12T00:12:46.064058+0000","last_unstale":"2024-09-12T01:09:03.054550+0000","last_undegraded":"2024-09-12T01:09:03.054550+0000","last_fullsized":"2024-09-12T01:09:03.054550+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":363,"num_read_kb":352,"num_write":596,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'133","reported_seq":725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.182032+0000","last_change":"2024-09-12T01:11:06.182032+0000","last_active":"2024-09-12T01:11:06.182032+0000","last_peered":"2024-09-12T01:11:06.182032+0000","last_clean":"2024-09-12T01:11:06.182032+0000","last_became_active":"2024-09-12T00:12:38.044075+0000","last_became_peered":"2024-09-12T00:12:38.044075+0000","last_unstale":"2024-09-12T01:11:06.182032+0000","last_undegraded":"2024-09-12T01:11:06.182032+0000","last_fullsized":"2024-09-12T01:11:06.182032+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-12T01:11:06.181955+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-12T01:11:06.181955+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.181955+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:46.555230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":484,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'410","reported_seq":1169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.675980+0000","last_change":"2024-09-12T01:11:07.675922+0000","last_active":"2024-09-12T01:11:07.675980+0000","last_peered":"2024-09-12T01:11:07.675980+0000","last_clean":"2024-09-12T01:11:07.675980+0000","last_became_active":"2024-09-12T00:12:36.030644+0000","last_became_peered":"2024-09-12T00:12:36.030644+0000","last_unstale":"2024-09-12T01:11:07.675980+0000","last_undegraded":"2024-09-12T01:11:07.675980+0000","last_fullsized":"2024-09-12T01:11:07.675980+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'410","last_scrub_stamp":"2024-09-12T01:11:07.675795+0000","last_deep_scrub":"263'410","last_deep_scrub_stamp":"2024-09-12T01:11:07.675795+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.675795+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:12.979636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568642,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":738,"num_read_kb":123120,"num_write":1245,"num_write_kb":49104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.293104+0000","last_change":"2024-09-12T01:11:07.293104+0000","last_active":"2024-09-12T01:11:07.293104+0000","last_peered":"2024-09-12T01:11:07.293104+0000","last_clean":"2024-09-12T01:11:07.293104+0000","last_became_active":"2024-09-12T00:12:22.875444+0000","last_became_peered":"2024-09-12T00:12:22.875444+0000","last_unstale":"2024-09-12T01:11:07.293104+0000","last_undegraded":"2024-09-12T01:11:07.293104+0000","last_fullsized":"2024-09-12T01:11:07.293104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:07.293023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:07.293023+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.293023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:23.494982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001017387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"263'6","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.448019+0000","last_change":"2024-09-12T01:11:21.448019+0000","last_active":"2024-09-12T01:11:21.448019+0000","last_peered":"2024-09-12T01:11:21.448019+0000","last_clean":"2024-09-12T01:11:21.448019+0000","last_became_active":"2024-09-12T00:12:40.031382+0000","last_became_peered":"2024-09-12T00:12:40.031382+0000","last_unstale":"2024-09-12T01:11:21.448019+0000","last_undegraded":"2024-09-12T01:11:21.448019+0000","last_fullsized":"2024-09-12T01:11:21.448019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:21.447933+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:21.447933+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.447933+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:55.518009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'730","reported_seq":1456,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.754434+0000","last_change":"2024-09-12T00:12:42.043628+0000","last_active":"2024-09-12T01:10:59.754434+0000","last_peered":"2024-09-12T01:10:59.754434+0000","last_clean":"2024-09-12T01:10:59.754434+0000","last_became_active":"2024-09-12T00:12:42.043328+0000","last_became_peered":"2024-09-12T00:12:42.043328+0000","last_unstale":"2024-09-12T01:10:59.754434+0000","last_undegraded":"2024-09-12T01:10:59.754434+0000","last_fullsized":"2024-09-12T01:10:59.754434+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":700,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147946,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1306,"num_read_kb":3069,"num_write":1058,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.056433+0000","last_change":"2024-09-12T00:12:44.062248+0000","last_active":"2024-09-12T01:09:00.056433+0000","last_peered":"2024-09-12T01:09:00.056433+0000","last_clean":"2024-09-12T01:09:00.056433+0000","last_became_active":"2024-09-12T00:12:44.061206+0000","last_became_peered":"2024-09-12T00:12:44.061206+0000","last_unstale":"2024-09-12T01:09:00.056433+0000","last_undegraded":"2024-09-12T01:09:00.056433+0000","last_fullsized":"2024-09-12T01:09:00.056433+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:28.838993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'95","reported_seq":589,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.297008+0000","last_change":"2024-09-12T00:12:46.058756+0000","last_active":"2024-09-12T01:09:23.297008+0000","last_peered":"2024-09-12T01:09:23.297008+0000","last_clean":"2024-09-12T01:09:23.297008+0000","last_became_active":"2024-09-12T00:12:46.058465+0000","last_became_peered":"2024-09-12T00:12:46.058465+0000","last_unstale":"2024-09-12T01:09:23.297008+0000","last_undegraded":"2024-09-12T01:09:23.297008+0000","last_fullsized":"2024-09-12T01:09:23.297008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":101,"num_write":234,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'139","reported_seq":706,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.805509+0000","last_change":"2024-09-12T00:12:46.063719+0000","last_active":"2024-09-12T01:10:31.805509+0000","last_peered":"2024-09-12T01:10:31.805509+0000","last_clean":"2024-09-12T01:10:31.805509+0000","last_became_active":"2024-09-12T00:12:46.063423+0000","last_became_peered":"2024-09-12T00:12:46.063423+0000","last_unstale":"2024-09-12T01:10:31.805509+0000","last_undegraded":"2024-09-12T01:10:31.805509+0000","last_fullsized":"2024-09-12T01:10:31.805509+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":252,"num_write":335,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'151","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.153506+0000","last_change":"2024-09-12T01:11:08.153506+0000","last_active":"2024-09-12T01:11:08.153506+0000","last_peered":"2024-09-12T01:11:08.153506+0000","last_clean":"2024-09-12T01:11:08.153506+0000","last_became_active":"2024-09-12T00:12:38.041665+0000","last_became_peered":"2024-09-12T00:12:38.041665+0000","last_unstale":"2024-09-12T01:11:08.153506+0000","last_undegraded":"2024-09-12T01:11:08.153506+0000","last_fullsized":"2024-09-12T01:11:08.153506+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-12T01:11:08.153413+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-12T01:11:08.153413+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.153413+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:15.216054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":652,"num_read_kb":531,"num_write":244,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'302","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.351636+0000","last_change":"2024-09-12T01:11:14.351574+0000","last_active":"2024-09-12T01:11:14.351636+0000","last_peered":"2024-09-12T01:11:14.351636+0000","last_clean":"2024-09-12T01:11:14.351636+0000","last_became_active":"2024-09-12T00:13:07.152470+0000","last_became_peered":"2024-09-12T00:13:07.152470+0000","last_unstale":"2024-09-12T01:11:14.351636+0000","last_undegraded":"2024-09-12T01:11:14.351636+0000","last_fullsized":"2024-09-12T01:11:14.351636+0000","mapping_epoch":40,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-12T01:11:14.351438+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-12T01:11:14.351438+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.351438+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:06.001614+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5098973,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":439,"num_read_kb":19566,"num_write":916,"num_write_kb":20485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.301017+0000","last_change":"2024-09-12T01:11:23.301017+0000","last_active":"2024-09-12T01:11:23.301017+0000","last_peered":"2024-09-12T01:11:23.301017+0000","last_clean":"2024-09-12T01:11:23.301017+0000","last_became_active":"2024-09-12T00:12:40.038618+0000","last_became_peered":"2024-09-12T00:12:40.038618+0000","last_unstale":"2024-09-12T01:11:23.301017+0000","last_undegraded":"2024-09-12T01:11:23.301017+0000","last_fullsized":"2024-09-12T01:11:23.301017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.300915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.300915+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.300915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:59.972534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'279","reported_seq":857,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.094930+0000","last_change":"2024-09-12T00:12:42.050190+0000","last_active":"2024-09-12T01:11:00.094930+0000","last_peered":"2024-09-12T01:11:00.094930+0000","last_clean":"2024-09-12T01:11:00.094930+0000","last_became_active":"2024-09-12T00:12:42.049685+0000","last_became_peered":"2024-09-12T00:12:42.049685+0000","last_unstale":"2024-09-12T01:11:00.094930+0000","last_undegraded":"2024-09-12T01:11:00.094930+0000","last_fullsized":"2024-09-12T01:11:00.094930+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:57.050916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49303,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":1021,"num_write":368,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.766555+0000","last_change":"2024-09-12T01:11:24.766555+0000","last_active":"2024-09-12T01:11:24.766555+0000","last_peered":"2024-09-12T01:11:24.766555+0000","last_clean":"2024-09-12T01:11:24.766555+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:11:24.766555+0000","last_undegraded":"2024-09-12T01:11:24.766555+0000","last_fullsized":"2024-09-12T01:11:24.766555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.766460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.766460+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.766460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:23.827912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:23.431103+0000","last_change":"2024-09-12T00:12:46.064377+0000","last_active":"2024-09-12T01:09:23.431103+0000","last_peered":"2024-09-12T01:09:23.431103+0000","last_clean":"2024-09-12T01:09:23.431103+0000","last_became_active":"2024-09-12T00:12:46.064080+0000","last_became_peered":"2024-09-12T00:12:46.064080+0000","last_unstale":"2024-09-12T01:09:23.431103+0000","last_undegraded":"2024-09-12T01:09:23.431103+0000","last_fullsized":"2024-09-12T01:09:23.431103+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:28.289493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":189,"num_write":302,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'149","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.572027+0000","last_change":"2024-09-12T01:11:12.572027+0000","last_active":"2024-09-12T01:11:12.572027+0000","last_peered":"2024-09-12T01:11:12.572027+0000","last_clean":"2024-09-12T01:11:12.572027+0000","last_became_active":"2024-09-12T00:12:38.044990+0000","last_became_peered":"2024-09-12T00:12:38.044990+0000","last_unstale":"2024-09-12T01:11:12.572027+0000","last_undegraded":"2024-09-12T01:11:12.572027+0000","last_fullsized":"2024-09-12T01:11:12.572027+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-12T01:11:12.571917+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-12T01:11:12.571917+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.571917+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:43.018147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":701,"num_read_kb":570,"num_write":228,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'340","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.110025+0000","last_change":"2024-09-12T01:11:07.110025+0000","last_active":"2024-09-12T01:11:07.110025+0000","last_peered":"2024-09-12T01:11:07.110025+0000","last_clean":"2024-09-12T01:11:07.110025+0000","last_became_active":"2024-09-12T00:12:36.034816+0000","last_became_peered":"2024-09-12T00:12:36.034816+0000","last_unstale":"2024-09-12T01:11:07.110025+0000","last_undegraded":"2024-09-12T01:11:07.110025+0000","last_fullsized":"2024-09-12T01:11:07.110025+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:11:07.109934+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:11:07.109934+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.109934+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:11.045354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":1836,"num_write":1158,"num_write_kb":16367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.053198+0000","last_change":"2024-09-12T00:12:40.042449+0000","last_active":"2024-09-12T01:08:40.053198+0000","last_peered":"2024-09-12T01:08:40.053198+0000","last_clean":"2024-09-12T01:08:40.053198+0000","last_became_active":"2024-09-12T00:12:40.042104+0000","last_became_peered":"2024-09-12T00:12:40.042104+0000","last_unstale":"2024-09-12T01:08:40.053198+0000","last_undegraded":"2024-09-12T01:08:40.053198+0000","last_fullsized":"2024-09-12T01:08:40.053198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:33.704187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'55","reported_seq":558,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.054011+0000","last_change":"2024-09-12T00:12:42.043918+0000","last_active":"2024-09-12T01:08:45.054011+0000","last_peered":"2024-09-12T01:08:45.054011+0000","last_clean":"2024-09-12T01:08:45.054011+0000","last_became_active":"2024-09-12T00:12:42.043599+0000","last_became_peered":"2024-09-12T00:12:42.043599+0000","last_unstale":"2024-09-12T01:08:45.054011+0000","last_undegraded":"2024-09-12T01:08:45.054011+0000","last_fullsized":"2024-09-12T01:08:45.054011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:06.844583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.141693+0000","last_change":"2024-09-12T00:12:44.054488+0000","last_active":"2024-09-12T01:08:45.141693+0000","last_peered":"2024-09-12T01:08:45.141693+0000","last_clean":"2024-09-12T01:08:45.141693+0000","last_became_active":"2024-09-12T00:12:44.054145+0000","last_became_peered":"2024-09-12T00:12:44.054145+0000","last_unstale":"2024-09-12T01:08:45.141693+0000","last_undegraded":"2024-09-12T01:08:45.141693+0000","last_fullsized":"2024-09-12T01:08:45.141693+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'200","reported_seq":745,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.568625+0000","last_change":"2024-09-12T00:12:46.059839+0000","last_active":"2024-09-12T01:09:22.568625+0000","last_peered":"2024-09-12T01:09:22.568625+0000","last_clean":"2024-09-12T01:09:22.568625+0000","last_became_active":"2024-09-12T00:12:46.059520+0000","last_became_peered":"2024-09-12T00:12:46.059520+0000","last_unstale":"2024-09-12T01:09:22.568625+0000","last_undegraded":"2024-09-12T01:09:22.568625+0000","last_fullsized":"2024-09-12T01:09:22.568625+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:17.663006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":406,"num_read_kb":365,"num_write":468,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'124","reported_seq":731,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.605360+0000","last_change":"2024-09-12T01:11:14.605360+0000","last_active":"2024-09-12T01:11:14.605360+0000","last_peered":"2024-09-12T01:11:14.605360+0000","last_clean":"2024-09-12T01:11:14.605360+0000","last_became_active":"2024-09-12T00:12:38.040948+0000","last_became_peered":"2024-09-12T00:12:38.040948+0000","last_unstale":"2024-09-12T01:11:14.605360+0000","last_undegraded":"2024-09-12T01:11:14.605360+0000","last_fullsized":"2024-09-12T01:11:14.605360+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'124","last_scrub_stamp":"2024-09-12T01:11:14.605261+0000","last_deep_scrub":"263'124","last_deep_scrub_stamp":"2024-09-12T01:11:14.605261+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.605261+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:12.209675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":483,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'334","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.165772+0000","last_change":"2024-09-12T01:11:12.165772+0000","last_active":"2024-09-12T01:11:12.165772+0000","last_peered":"2024-09-12T01:11:12.165772+0000","last_clean":"2024-09-12T01:11:12.165772+0000","last_became_active":"2024-09-12T00:12:36.038823+0000","last_became_peered":"2024-09-12T00:12:36.038823+0000","last_unstale":"2024-09-12T01:11:12.165772+0000","last_undegraded":"2024-09-12T01:11:12.165772+0000","last_fullsized":"2024-09-12T01:11:12.165772+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'334","last_scrub_stamp":"2024-09-12T01:11:12.165636+0000","last_deep_scrub":"263'334","last_deep_scrub_stamp":"2024-09-12T01:11:12.165636+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.165636+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:57.769236+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364565,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":548,"num_read_kb":31576,"num_write":1085,"num_write_kb":24420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.176056+0000","last_change":"2024-09-12T01:11:13.176056+0000","last_active":"2024-09-12T01:11:13.176056+0000","last_peered":"2024-09-12T01:11:13.176056+0000","last_clean":"2024-09-12T01:11:13.176056+0000","last_became_active":"2024-09-12T00:12:40.030447+0000","last_became_peered":"2024-09-12T00:12:40.030447+0000","last_unstale":"2024-09-12T01:11:13.176056+0000","last_undegraded":"2024-09-12T01:11:13.176056+0000","last_fullsized":"2024-09-12T01:11:13.176056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:13.175928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:13.175928+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.175928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:21.328720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'333","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.686772+0000","last_change":"2024-09-12T01:11:21.686772+0000","last_active":"2024-09-12T01:11:21.686772+0000","last_peered":"2024-09-12T01:11:21.686772+0000","last_clean":"2024-09-12T01:11:21.686772+0000","last_became_active":"2024-09-12T00:12:42.050885+0000","last_became_peered":"2024-09-12T00:12:42.050885+0000","last_unstale":"2024-09-12T01:11:21.686772+0000","last_undegraded":"2024-09-12T01:11:21.686772+0000","last_fullsized":"2024-09-12T01:11:21.686772+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-09-12T01:11:21.686676+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-09-12T01:11:21.686676+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.686676+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:09.163305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52758,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":1216,"num_write":438,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.241329+0000","last_change":"2024-09-12T00:12:44.056404+0000","last_active":"2024-09-12T01:08:45.241329+0000","last_peered":"2024-09-12T01:08:45.241329+0000","last_clean":"2024-09-12T01:08:45.241329+0000","last_became_active":"2024-09-12T00:12:44.056032+0000","last_became_peered":"2024-09-12T00:12:44.056032+0000","last_unstale":"2024-09-12T01:08:45.241329+0000","last_undegraded":"2024-09-12T01:08:45.241329+0000","last_fullsized":"2024-09-12T01:08:45.241329+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'121","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.354255+0000","last_change":"2024-09-12T00:12:46.063983+0000","last_active":"2024-09-12T01:08:28.354255+0000","last_peered":"2024-09-12T01:08:28.354255+0000","last_clean":"2024-09-12T01:08:28.354255+0000","last_became_active":"2024-09-12T00:12:46.063700+0000","last_became_peered":"2024-09-12T00:12:46.063700+0000","last_unstale":"2024-09-12T01:08:28.354255+0000","last_undegraded":"2024-09-12T01:08:28.354255+0000","last_fullsized":"2024-09-12T01:08:28.354255+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:48.139495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'4185","reported_seq":4818,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.690012+0000","last_change":"2024-09-12T01:11:12.690012+0000","last_active":"2024-09-12T01:11:12.690012+0000","last_peered":"2024-09-12T01:11:12.690012+0000","last_clean":"2024-09-12T01:11:12.690012+0000","last_became_active":"2024-09-12T00:12:38.042680+0000","last_became_peered":"2024-09-12T00:12:38.042680+0000","last_unstale":"2024-09-12T01:11:12.690012+0000","last_undegraded":"2024-09-12T01:11:12.690012+0000","last_fullsized":"2024-09-12T01:11:12.690012+0000","mapping_epoch":29,"log_start":"263'4100","ondisk_log_start":"263'4100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4185","last_scrub_stamp":"2024-09-12T01:11:12.689931+0000","last_deep_scrub":"263'4185","last_deep_scrub_stamp":"2024-09-12T01:11:12.689931+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.689931+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":3000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:16.576940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16870,"num_read_kb":14146,"num_write":6296,"num_write_kb":3134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'370","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.630088+0000","last_change":"2024-09-12T01:11:07.630088+0000","last_active":"2024-09-12T01:11:07.630088+0000","last_peered":"2024-09-12T01:11:07.630088+0000","last_clean":"2024-09-12T01:11:07.630088+0000","last_became_active":"2024-09-12T00:12:36.034292+0000","last_became_peered":"2024-09-12T00:12:36.034292+0000","last_unstale":"2024-09-12T01:11:07.630088+0000","last_undegraded":"2024-09-12T01:11:07.630088+0000","last_fullsized":"2024-09-12T01:11:07.630088+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-12T01:11:07.629972+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-12T01:11:07.629972+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.629972+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:32.054059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":3622,"num_write":1273,"num_write_kb":13483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.047994+0000","last_change":"2024-09-12T00:12:40.038541+0000","last_active":"2024-09-12T01:08:40.047994+0000","last_peered":"2024-09-12T01:08:40.047994+0000","last_clean":"2024-09-12T01:08:40.047994+0000","last_became_active":"2024-09-12T00:12:40.038192+0000","last_became_peered":"2024-09-12T00:12:40.038192+0000","last_unstale":"2024-09-12T01:08:40.047994+0000","last_undegraded":"2024-09-12T01:08:40.047994+0000","last_fullsized":"2024-09-12T01:08:40.047994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:28.217627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'260","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.170941+0000","last_change":"2024-09-12T01:11:24.170941+0000","last_active":"2024-09-12T01:11:24.170941+0000","last_peered":"2024-09-12T01:11:24.170941+0000","last_clean":"2024-09-12T01:11:24.170941+0000","last_became_active":"2024-09-12T00:12:42.046589+0000","last_became_peered":"2024-09-12T00:12:42.046589+0000","last_unstale":"2024-09-12T01:11:24.170941+0000","last_undegraded":"2024-09-12T01:11:24.170941+0000","last_fullsized":"2024-09-12T01:11:24.170941+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-12T01:11:24.170844+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-12T01:11:24.170844+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.170844+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:16.778753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53508,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":1009,"num_write":352,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:45.054065+0000","last_change":"2024-09-12T00:12:44.057887+0000","last_active":"2024-09-12T01:08:45.054065+0000","last_peered":"2024-09-12T01:08:45.054065+0000","last_clean":"2024-09-12T01:08:45.054065+0000","last_became_active":"2024-09-12T00:12:44.057606+0000","last_became_peered":"2024-09-12T00:12:44.057606+0000","last_unstale":"2024-09-12T01:08:45.054065+0000","last_undegraded":"2024-09-12T01:08:45.054065+0000","last_fullsized":"2024-09-12T01:08:45.054065+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:25.314359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'180","reported_seq":742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.340966+0000","last_change":"2024-09-12T01:11:24.340966+0000","last_active":"2024-09-12T01:11:24.340966+0000","last_peered":"2024-09-12T01:11:24.340966+0000","last_clean":"2024-09-12T01:11:24.340966+0000","last_became_active":"2024-09-12T00:12:38.047545+0000","last_became_peered":"2024-09-12T00:12:38.047545+0000","last_unstale":"2024-09-12T01:11:24.340966+0000","last_undegraded":"2024-09-12T01:11:24.340966+0000","last_fullsized":"2024-09-12T01:11:24.340966+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-12T01:11:24.340882+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-12T01:11:24.340882+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.340882+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:15.550214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":815,"num_read_kb":702,"num_write":306,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'317","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.679385+0000","last_change":"2024-09-12T01:11:08.679385+0000","last_active":"2024-09-12T01:11:08.679385+0000","last_peered":"2024-09-12T01:11:08.679385+0000","last_clean":"2024-09-12T01:11:08.679385+0000","last_became_active":"2024-09-12T00:12:36.042983+0000","last_became_peered":"2024-09-12T00:12:36.042983+0000","last_unstale":"2024-09-12T01:11:08.679385+0000","last_undegraded":"2024-09-12T01:11:08.679385+0000","last_fullsized":"2024-09-12T01:11:08.679385+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:11:08.679268+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:11:08.679268+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.679268+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:45.909644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":13747,"num_write":1048,"num_write_kb":22365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.334807+0000","last_change":"2024-09-12T01:11:24.334807+0000","last_active":"2024-09-12T01:11:24.334807+0000","last_peered":"2024-09-12T01:11:24.334807+0000","last_clean":"2024-09-12T01:11:24.334807+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:11:24.334807+0000","last_undegraded":"2024-09-12T01:11:24.334807+0000","last_fullsized":"2024-09-12T01:11:24.334807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.334703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.334703+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.334703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:33.166392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'498","reported_seq":1129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.229789+0000","last_change":"2024-09-12T00:12:42.050774+0000","last_active":"2024-09-12T01:10:59.229789+0000","last_peered":"2024-09-12T01:10:59.229789+0000","last_clean":"2024-09-12T01:10:59.229789+0000","last_became_active":"2024-09-12T00:12:42.050479+0000","last_became_peered":"2024-09-12T00:12:42.050479+0000","last_unstale":"2024-09-12T01:10:59.229789+0000","last_undegraded":"2024-09-12T01:10:59.229789+0000","last_fullsized":"2024-09-12T01:10:59.229789+0000","mapping_epoch":33,"log_start":"263'400","ondisk_log_start":"263'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:54.813408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104580,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":898,"num_read_kb":2161,"num_write":774,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.134850+0000","last_change":"2024-09-12T00:12:44.061802+0000","last_active":"2024-09-12T01:07:45.134850+0000","last_peered":"2024-09-12T01:07:45.134850+0000","last_clean":"2024-09-12T01:07:45.134850+0000","last_became_active":"2024-09-12T00:12:44.061554+0000","last_became_peered":"2024-09-12T00:12:44.061554+0000","last_unstale":"2024-09-12T01:07:45.134850+0000","last_undegraded":"2024-09-12T01:07:45.134850+0000","last_fullsized":"2024-09-12T01:07:45.134850+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:41.354262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'159","reported_seq":658,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:22.611853+0000","last_change":"2024-09-12T00:12:46.062051+0000","last_active":"2024-09-12T01:09:22.611853+0000","last_peered":"2024-09-12T01:09:22.611853+0000","last_clean":"2024-09-12T01:09:22.611853+0000","last_became_active":"2024-09-12T00:12:46.061727+0000","last_became_peered":"2024-09-12T00:12:46.061727+0000","last_unstale":"2024-09-12T01:09:22.611853+0000","last_undegraded":"2024-09-12T01:09:22.611853+0000","last_fullsized":"2024-09-12T01:09:22.611853+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":216,"num_write":366,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'66","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.498922+0000","last_change":"2024-09-12T01:11:17.498922+0000","last_active":"2024-09-12T01:11:17.498922+0000","last_peered":"2024-09-12T01:11:17.498922+0000","last_clean":"2024-09-12T01:11:17.498922+0000","last_became_active":"2024-09-12T00:12:38.040282+0000","last_became_peered":"2024-09-12T00:12:38.040282+0000","last_unstale":"2024-09-12T01:11:17.498922+0000","last_undegraded":"2024-09-12T01:11:17.498922+0000","last_fullsized":"2024-09-12T01:11:17.498922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'66","last_scrub_stamp":"2024-09-12T01:11:17.498837+0000","last_deep_scrub":"263'66","last_deep_scrub_stamp":"2024-09-12T01:11:17.498837+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.498837+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:53.294116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":276,"num_write":85,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'343","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.589598+0000","last_change":"2024-09-12T01:11:09.589598+0000","last_active":"2024-09-12T01:11:09.589598+0000","last_peered":"2024-09-12T01:11:09.589598+0000","last_clean":"2024-09-12T01:11:09.589598+0000","last_became_active":"2024-09-12T00:12:36.031081+0000","last_became_peered":"2024-09-12T00:12:36.031081+0000","last_unstale":"2024-09-12T01:11:09.589598+0000","last_undegraded":"2024-09-12T01:11:09.589598+0000","last_fullsized":"2024-09-12T01:11:09.589598+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-12T01:11:09.589432+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-12T01:11:09.589432+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.589432+0000","objects_scrubbed":11,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:48.973187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069231,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":617,"num_read_kb":88557,"num_write":1073,"num_write_kb":46090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.376897+0000","last_change":"2024-09-12T01:11:24.376897+0000","last_active":"2024-09-12T01:11:24.376897+0000","last_peered":"2024-09-12T01:11:24.376897+0000","last_clean":"2024-09-12T01:11:24.376897+0000","last_became_active":"2024-09-12T00:12:40.036842+0000","last_became_peered":"2024-09-12T00:12:40.036842+0000","last_unstale":"2024-09-12T01:11:24.376897+0000","last_undegraded":"2024-09-12T01:11:24.376897+0000","last_fullsized":"2024-09-12T01:11:24.376897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.376783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.376783+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.376783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:02.847925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'299","reported_seq":885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.334820+0000","last_change":"2024-09-12T00:12:42.044141+0000","last_active":"2024-09-12T01:10:59.334820+0000","last_peered":"2024-09-12T01:10:59.334820+0000","last_clean":"2024-09-12T01:10:59.334820+0000","last_became_active":"2024-09-12T00:12:42.043681+0000","last_became_peered":"2024-09-12T00:12:42.043681+0000","last_unstale":"2024-09-12T01:10:59.334820+0000","last_undegraded":"2024-09-12T01:10:59.334820+0000","last_fullsized":"2024-09-12T01:10:59.334820+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:57.312003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58226,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":1067,"num_write":414,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042934+0000","last_change":"2024-09-12T00:12:44.058909+0000","last_active":"2024-09-12T01:07:48.042934+0000","last_peered":"2024-09-12T01:07:48.042934+0000","last_clean":"2024-09-12T01:07:48.042934+0000","last_became_active":"2024-09-12T00:12:44.058542+0000","last_became_peered":"2024-09-12T00:12:44.058542+0000","last_unstale":"2024-09-12T01:07:48.042934+0000","last_undegraded":"2024-09-12T01:07:48.042934+0000","last_fullsized":"2024-09-12T01:07:48.042934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:44.072219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'190","reported_seq":718,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.049195+0000","last_change":"2024-09-12T00:12:46.063225+0000","last_active":"2024-09-12T01:08:50.049195+0000","last_peered":"2024-09-12T01:08:50.049195+0000","last_clean":"2024-09-12T01:08:50.049195+0000","last_became_active":"2024-09-12T00:12:46.062957+0000","last_became_peered":"2024-09-12T00:12:46.062957+0000","last_unstale":"2024-09-12T01:08:50.049195+0000","last_undegraded":"2024-09-12T01:08:50.049195+0000","last_fullsized":"2024-09-12T01:08:50.049195+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":323,"num_read_kb":295,"num_write":565,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'204","reported_seq":797,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.716388+0000","last_change":"2024-09-12T01:11:13.716388+0000","last_active":"2024-09-12T01:11:13.716388+0000","last_peered":"2024-09-12T01:11:13.716388+0000","last_clean":"2024-09-12T01:11:13.716388+0000","last_became_active":"2024-09-12T00:12:38.045576+0000","last_became_peered":"2024-09-12T00:12:38.045576+0000","last_unstale":"2024-09-12T01:11:13.716388+0000","last_undegraded":"2024-09-12T01:11:13.716388+0000","last_fullsized":"2024-09-12T01:11:13.716388+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'204","last_scrub_stamp":"2024-09-12T01:11:13.716299+0000","last_deep_scrub":"263'204","last_deep_scrub_stamp":"2024-09-12T01:11:13.716299+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.716299+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.905678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":691,"num_write":313,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'353","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.259922+0000","last_change":"2024-09-12T01:11:06.259922+0000","last_active":"2024-09-12T01:11:06.259922+0000","last_peered":"2024-09-12T01:11:06.259922+0000","last_clean":"2024-09-12T01:11:06.259922+0000","last_became_active":"2024-09-12T00:12:36.036446+0000","last_became_peered":"2024-09-12T00:12:36.036446+0000","last_unstale":"2024-09-12T01:11:06.259922+0000","last_undegraded":"2024-09-12T01:11:06.259922+0000","last_fullsized":"2024-09-12T01:11:06.259922+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-12T01:11:06.259787+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-12T01:11:06.259787+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.259787+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:04.148146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434692,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":621,"num_read_kb":64541,"num_write":1186,"num_write_kb":11770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.216836+0000","last_change":"2024-09-12T01:11:19.216836+0000","last_active":"2024-09-12T01:11:19.216836+0000","last_peered":"2024-09-12T01:11:19.216836+0000","last_clean":"2024-09-12T01:11:19.216836+0000","last_became_active":"2024-09-12T00:12:40.029908+0000","last_became_peered":"2024-09-12T00:12:40.029908+0000","last_unstale":"2024-09-12T01:11:19.216836+0000","last_undegraded":"2024-09-12T01:11:19.216836+0000","last_fullsized":"2024-09-12T01:11:19.216836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.216748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.216748+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.216748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:17.680930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'279","reported_seq":860,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.235297+0000","last_change":"2024-09-12T00:12:42.050883+0000","last_active":"2024-09-12T01:10:58.235297+0000","last_peered":"2024-09-12T01:10:58.235297+0000","last_clean":"2024-09-12T01:10:58.235297+0000","last_became_active":"2024-09-12T00:12:42.050599+0000","last_became_peered":"2024-09-12T00:12:42.050599+0000","last_unstale":"2024-09-12T01:10:58.235297+0000","last_undegraded":"2024-09-12T01:10:58.235297+0000","last_fullsized":"2024-09-12T01:10:58.235297+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:27.986140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50970,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":947,"num_write":354,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.055691+0000","last_change":"2024-09-12T00:12:44.062691+0000","last_active":"2024-09-12T01:08:55.055691+0000","last_peered":"2024-09-12T01:08:55.055691+0000","last_clean":"2024-09-12T01:08:55.055691+0000","last_became_active":"2024-09-12T00:12:44.062419+0000","last_became_peered":"2024-09-12T00:12:44.062419+0000","last_unstale":"2024-09-12T01:08:55.055691+0000","last_undegraded":"2024-09-12T01:08:55.055691+0000","last_fullsized":"2024-09-12T01:08:55.055691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:28.349610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'183","reported_seq":682,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.012264+0000","last_change":"2024-09-12T00:12:46.067271+0000","last_active":"2024-09-12T01:10:33.012264+0000","last_peered":"2024-09-12T01:10:33.012264+0000","last_clean":"2024-09-12T01:10:33.012264+0000","last_became_active":"2024-09-12T00:12:46.066977+0000","last_became_peered":"2024-09-12T00:12:46.066977+0000","last_unstale":"2024-09-12T01:10:33.012264+0000","last_undegraded":"2024-09-12T01:10:33.012264+0000","last_fullsized":"2024-09-12T01:10:33.012264+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":141,"num_write":422,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'58","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.539314+0000","last_change":"2024-09-12T01:11:16.539314+0000","last_active":"2024-09-12T01:11:16.539314+0000","last_peered":"2024-09-12T01:11:16.539314+0000","last_clean":"2024-09-12T01:11:16.539314+0000","last_became_active":"2024-09-12T00:12:38.043886+0000","last_became_peered":"2024-09-12T00:12:38.043886+0000","last_unstale":"2024-09-12T01:11:16.539314+0000","last_undegraded":"2024-09-12T01:11:16.539314+0000","last_fullsized":"2024-09-12T01:11:16.539314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'58","last_scrub_stamp":"2024-09-12T01:11:16.539199+0000","last_deep_scrub":"263'58","last_deep_scrub_stamp":"2024-09-12T01:11:16.539199+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.539199+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:30.884432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":197,"num_write":99,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'362","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.560609+0000","last_change":"2024-09-12T01:11:11.560609+0000","last_active":"2024-09-12T01:11:11.560609+0000","last_peered":"2024-09-12T01:11:11.560609+0000","last_clean":"2024-09-12T01:11:11.560609+0000","last_became_active":"2024-09-12T00:12:36.030663+0000","last_became_peered":"2024-09-12T00:12:36.030663+0000","last_unstale":"2024-09-12T01:11:11.560609+0000","last_undegraded":"2024-09-12T01:11:11.560609+0000","last_fullsized":"2024-09-12T01:11:11.560609+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-12T01:11:11.560491+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-12T01:11:11.560491+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.560491+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:52.728704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568456,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":490,"num_read_kb":3753,"num_write":1107,"num_write_kb":36132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043857+0000","last_change":"2024-09-12T00:12:40.040334+0000","last_active":"2024-09-12T01:07:40.043857+0000","last_peered":"2024-09-12T01:07:40.043857+0000","last_clean":"2024-09-12T01:07:40.043857+0000","last_became_active":"2024-09-12T00:12:40.040095+0000","last_became_peered":"2024-09-12T00:12:40.040095+0000","last_unstale":"2024-09-12T01:07:40.043857+0000","last_undegraded":"2024-09-12T01:07:40.043857+0000","last_fullsized":"2024-09-12T01:07:40.043857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:14:14.746788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'104","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.050614+0000","last_change":"2024-09-12T00:12:42.043827+0000","last_active":"2024-09-12T01:09:00.050614+0000","last_peered":"2024-09-12T01:09:00.050614+0000","last_clean":"2024-09-12T01:09:00.050614+0000","last_became_active":"2024-09-12T00:12:42.043492+0000","last_became_peered":"2024-09-12T00:12:42.043492+0000","last_unstale":"2024-09-12T01:09:00.050614+0000","last_undegraded":"2024-09-12T01:09:00.050614+0000","last_fullsized":"2024-09-12T01:09:00.050614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:42.505398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":110,"num_read_kb":100,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'767","reported_seq":2177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.228238+0000","last_change":"2024-09-12T00:12:44.054520+0000","last_active":"2024-09-12T01:11:00.228238+0000","last_peered":"2024-09-12T01:11:00.228238+0000","last_clean":"2024-09-12T01:11:00.228238+0000","last_became_active":"2024-09-12T00:12:44.054237+0000","last_became_peered":"2024-09-12T00:12:44.054237+0000","last_unstale":"2024-09-12T01:11:00.228238+0000","last_undegraded":"2024-09-12T01:11:00.228238+0000","last_fullsized":"2024-09-12T01:11:00.228238+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'121","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.049146+0000","last_change":"2024-09-12T00:12:46.061987+0000","last_active":"2024-09-12T01:08:50.049146+0000","last_peered":"2024-09-12T01:08:50.049146+0000","last_clean":"2024-09-12T01:08:50.049146+0000","last_became_active":"2024-09-12T00:12:46.061673+0000","last_became_peered":"2024-09-12T00:12:46.061673+0000","last_unstale":"2024-09-12T01:08:50.049146+0000","last_undegraded":"2024-09-12T01:08:50.049146+0000","last_fullsized":"2024-09-12T01:08:50.049146+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'432","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.146134+0000","last_change":"2024-09-12T01:11:11.146134+0000","last_active":"2024-09-12T01:11:11.146134+0000","last_peered":"2024-09-12T01:11:11.146134+0000","last_clean":"2024-09-12T01:11:11.146134+0000","last_became_active":"2024-09-12T00:12:38.029483+0000","last_became_peered":"2024-09-12T00:12:38.029483+0000","last_unstale":"2024-09-12T01:11:11.146134+0000","last_undegraded":"2024-09-12T01:11:11.146134+0000","last_fullsized":"2024-09-12T01:11:11.146134+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'432","last_scrub_stamp":"2024-09-12T01:11:11.146047+0000","last_deep_scrub":"263'432","last_deep_scrub_stamp":"2024-09-12T01:11:11.146047+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.146047+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:10.366652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1848,"num_read_kb":1460,"num_write":651,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'351","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.306677+0000","last_change":"2024-09-12T01:11:07.306677+0000","last_active":"2024-09-12T01:11:07.306677+0000","last_peered":"2024-09-12T01:11:07.306677+0000","last_clean":"2024-09-12T01:11:07.306677+0000","last_became_active":"2024-09-12T00:12:36.034259+0000","last_became_peered":"2024-09-12T00:12:36.034259+0000","last_unstale":"2024-09-12T01:11:07.306677+0000","last_undegraded":"2024-09-12T01:11:07.306677+0000","last_fullsized":"2024-09-12T01:11:07.306677+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-12T01:11:07.306592+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-12T01:11:07.306592+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.306592+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:20.789146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":12694,"num_write":1067,"num_write_kb":34924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.234299+0000","last_change":"2024-09-12T00:12:40.034568+0000","last_active":"2024-09-12T01:07:40.234299+0000","last_peered":"2024-09-12T01:07:40.234299+0000","last_clean":"2024-09-12T01:07:40.234299+0000","last_became_active":"2024-09-12T00:12:40.034301+0000","last_became_peered":"2024-09-12T00:12:40.034301+0000","last_unstale":"2024-09-12T01:07:40.234299+0000","last_undegraded":"2024-09-12T01:07:40.234299+0000","last_fullsized":"2024-09-12T01:07:40.234299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:22.089148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'367","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.597558+0000","last_change":"2024-09-12T00:12:42.044477+0000","last_active":"2024-09-12T01:10:58.597558+0000","last_peered":"2024-09-12T01:10:58.597558+0000","last_clean":"2024-09-12T01:10:58.597558+0000","last_became_active":"2024-09-12T00:12:42.044154+0000","last_became_peered":"2024-09-12T00:12:42.044154+0000","last_unstale":"2024-09-12T01:10:58.597558+0000","last_undegraded":"2024-09-12T01:10:58.597558+0000","last_fullsized":"2024-09-12T01:10:58.597558+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:59.538243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51621,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":561,"num_read_kb":1137,"num_write":454,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:20.049637+0000","last_change":"2024-09-12T00:12:44.060009+0000","last_active":"2024-09-12T01:08:20.049637+0000","last_peered":"2024-09-12T01:08:20.049637+0000","last_clean":"2024-09-12T01:08:20.049637+0000","last_became_active":"2024-09-12T00:12:44.059671+0000","last_became_peered":"2024-09-12T00:12:44.059671+0000","last_unstale":"2024-09-12T01:08:20.049637+0000","last_undegraded":"2024-09-12T01:08:20.049637+0000","last_fullsized":"2024-09-12T01:08:20.049637+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:58.980993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'125","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.596906+0000","last_change":"2024-09-12T00:12:46.067043+0000","last_active":"2024-09-12T01:09:20.596906+0000","last_peered":"2024-09-12T01:09:20.596906+0000","last_clean":"2024-09-12T01:09:20.596906+0000","last_became_active":"2024-09-12T00:12:46.066777+0000","last_became_peered":"2024-09-12T00:12:46.066777+0000","last_unstale":"2024-09-12T01:09:20.596906+0000","last_undegraded":"2024-09-12T01:09:20.596906+0000","last_fullsized":"2024-09-12T01:09:20.596906+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:01.876836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":239,"num_read_kb":208,"num_write":345,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'510","reported_seq":1334,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.229612+0000","last_change":"2024-09-12T01:11:20.229612+0000","last_active":"2024-09-12T01:11:20.229612+0000","last_peered":"2024-09-12T01:11:20.229612+0000","last_clean":"2024-09-12T01:11:20.229612+0000","last_became_active":"2024-09-12T00:12:38.039996+0000","last_became_peered":"2024-09-12T00:12:38.039996+0000","last_unstale":"2024-09-12T01:11:20.229612+0000","last_undegraded":"2024-09-12T01:11:20.229612+0000","last_fullsized":"2024-09-12T01:11:20.229612+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'510","last_scrub_stamp":"2024-09-12T01:11:20.229511+0000","last_deep_scrub":"263'510","last_deep_scrub_stamp":"2024-09-12T01:11:20.229511+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.229511+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:21.104034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2706,"num_read_kb":2334,"num_write":934,"num_write_kb":583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'299","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.366645+0000","last_change":"2024-09-12T01:11:15.366645+0000","last_active":"2024-09-12T01:11:15.366645+0000","last_peered":"2024-09-12T01:11:15.366645+0000","last_clean":"2024-09-12T01:11:15.366645+0000","last_became_active":"2024-09-12T00:12:36.029998+0000","last_became_peered":"2024-09-12T00:12:36.029998+0000","last_unstale":"2024-09-12T01:11:15.366645+0000","last_undegraded":"2024-09-12T01:11:15.366645+0000","last_fullsized":"2024-09-12T01:11:15.366645+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'299","last_scrub_stamp":"2024-09-12T01:11:15.366509+0000","last_deep_scrub":"263'299","last_deep_scrub_stamp":"2024-09-12T01:11:15.366509+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.366509+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:09.932286+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":565,"num_read_kb":3980,"num_write":924,"num_write_kb":28798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.218749+0000","last_change":"2024-09-12T01:11:14.218749+0000","last_active":"2024-09-12T01:11:14.218749+0000","last_peered":"2024-09-12T01:11:14.218749+0000","last_clean":"2024-09-12T01:11:14.218749+0000","last_became_active":"2024-09-12T00:12:40.038037+0000","last_became_peered":"2024-09-12T00:12:40.038037+0000","last_unstale":"2024-09-12T01:11:14.218749+0000","last_undegraded":"2024-09-12T01:11:14.218749+0000","last_fullsized":"2024-09-12T01:11:14.218749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:14.218626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:14.218626+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.218626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:01.985443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'284","reported_seq":859,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.667784+0000","last_change":"2024-09-12T00:12:42.047201+0000","last_active":"2024-09-12T01:10:58.667784+0000","last_peered":"2024-09-12T01:10:58.667784+0000","last_clean":"2024-09-12T01:10:58.667784+0000","last_became_active":"2024-09-12T00:12:42.046917+0000","last_became_peered":"2024-09-12T00:12:42.046917+0000","last_unstale":"2024-09-12T01:10:58.667784+0000","last_undegraded":"2024-09-12T01:10:58.667784+0000","last_fullsized":"2024-09-12T01:10:58.667784+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:26.130504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46808,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1160,"num_write":400,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.047451+0000","last_change":"2024-09-12T00:12:44.058423+0000","last_active":"2024-09-12T01:08:35.047451+0000","last_peered":"2024-09-12T01:08:35.047451+0000","last_clean":"2024-09-12T01:08:35.047451+0000","last_became_active":"2024-09-12T00:12:44.058006+0000","last_became_peered":"2024-09-12T00:12:44.058006+0000","last_unstale":"2024-09-12T01:08:35.047451+0000","last_undegraded":"2024-09-12T01:08:35.047451+0000","last_fullsized":"2024-09-12T01:08:35.047451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:01.738470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'117","reported_seq":622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:23.048235+0000","last_change":"2024-09-12T00:12:46.065323+0000","last_active":"2024-09-12T01:08:23.048235+0000","last_peered":"2024-09-12T01:08:23.048235+0000","last_clean":"2024-09-12T01:08:23.048235+0000","last_became_active":"2024-09-12T00:12:46.064988+0000","last_became_peered":"2024-09-12T00:12:46.064988+0000","last_unstale":"2024-09-12T01:08:23.048235+0000","last_undegraded":"2024-09-12T01:08:23.048235+0000","last_fullsized":"2024-09-12T01:08:23.048235+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:07.524788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":147,"num_write":261,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'320","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.738849+0000","last_change":"2024-09-12T01:11:11.738849+0000","last_active":"2024-09-12T01:11:11.738849+0000","last_peered":"2024-09-12T01:11:11.738849+0000","last_clean":"2024-09-12T01:11:11.738849+0000","last_became_active":"2024-09-12T00:12:38.042565+0000","last_became_peered":"2024-09-12T00:12:38.042565+0000","last_unstale":"2024-09-12T01:11:11.738849+0000","last_undegraded":"2024-09-12T01:11:11.738849+0000","last_fullsized":"2024-09-12T01:11:11.738849+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'320","last_scrub_stamp":"2024-09-12T01:11:11.738728+0000","last_deep_scrub":"263'320","last_deep_scrub_stamp":"2024-09-12T01:11:11.738728+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.738728+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:44.363536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1481,"num_read_kb":1253,"num_write":527,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'359","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.766708+0000","last_change":"2024-09-12T01:11:10.766708+0000","last_active":"2024-09-12T01:11:10.766708+0000","last_peered":"2024-09-12T01:11:10.766708+0000","last_clean":"2024-09-12T01:11:10.766708+0000","last_became_active":"2024-09-12T00:12:36.042198+0000","last_became_peered":"2024-09-12T00:12:36.042198+0000","last_unstale":"2024-09-12T01:11:10.766708+0000","last_undegraded":"2024-09-12T01:11:10.766708+0000","last_fullsized":"2024-09-12T01:11:10.766708+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T01:11:10.766609+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T01:11:10.766609+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.766609+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:09.163241+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":61060,"num_write":1123,"num_write_kb":53442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.237962+0000","last_change":"2024-09-12T00:12:40.032609+0000","last_active":"2024-09-12T01:08:15.237962+0000","last_peered":"2024-09-12T01:08:15.237962+0000","last_clean":"2024-09-12T01:08:15.237962+0000","last_became_active":"2024-09-12T00:12:40.032284+0000","last_became_peered":"2024-09-12T00:12:40.032284+0000","last_unstale":"2024-09-12T01:08:15.237962+0000","last_undegraded":"2024-09-12T01:08:15.237962+0000","last_fullsized":"2024-09-12T01:08:15.237962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:20.113080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'257","reported_seq":815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.224454+0000","last_change":"2024-09-12T00:12:42.051390+0000","last_active":"2024-09-12T01:11:00.224454+0000","last_peered":"2024-09-12T01:11:00.224454+0000","last_clean":"2024-09-12T01:11:00.224454+0000","last_became_active":"2024-09-12T00:12:42.051133+0000","last_became_peered":"2024-09-12T00:12:42.051133+0000","last_unstale":"2024-09-12T01:11:00.224454+0000","last_undegraded":"2024-09-12T01:11:00.224454+0000","last_fullsized":"2024-09-12T01:11:00.224454+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:39.225249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":1053,"num_write":352,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041676+0000","last_change":"2024-09-12T00:12:44.060747+0000","last_active":"2024-09-12T01:07:45.041676+0000","last_peered":"2024-09-12T01:07:45.041676+0000","last_clean":"2024-09-12T01:07:45.041676+0000","last_became_active":"2024-09-12T00:12:44.060464+0000","last_became_peered":"2024-09-12T00:12:44.060464+0000","last_unstale":"2024-09-12T01:07:45.041676+0000","last_undegraded":"2024-09-12T01:07:45.041676+0000","last_fullsized":"2024-09-12T01:07:45.041676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:56.068981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'150","reported_seq":1608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.570464+0000","last_change":"2024-09-12T00:12:46.064822+0000","last_active":"2024-09-12T01:09:20.570464+0000","last_peered":"2024-09-12T01:09:20.570464+0000","last_clean":"2024-09-12T01:09:20.570464+0000","last_became_active":"2024-09-12T00:12:46.064565+0000","last_became_peered":"2024-09-12T00:12:46.064565+0000","last_unstale":"2024-09-12T01:09:20.570464+0000","last_undegraded":"2024-09-12T01:09:20.570464+0000","last_fullsized":"2024-09-12T01:09:20.570464+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:23.873971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1152,"num_read_kb":1150,"num_write":337,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'89","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.193008+0000","last_change":"2024-09-12T01:11:10.193008+0000","last_active":"2024-09-12T01:11:10.193008+0000","last_peered":"2024-09-12T01:11:10.193008+0000","last_clean":"2024-09-12T01:11:10.193008+0000","last_became_active":"2024-09-12T00:12:38.037860+0000","last_became_peered":"2024-09-12T00:12:38.037860+0000","last_unstale":"2024-09-12T01:11:10.193008+0000","last_undegraded":"2024-09-12T01:11:10.193008+0000","last_fullsized":"2024-09-12T01:11:10.193008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'89","last_scrub_stamp":"2024-09-12T01:11:10.192888+0000","last_deep_scrub":"263'89","last_deep_scrub_stamp":"2024-09-12T01:11:10.192888+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.192888+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:09.120774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":333,"num_write":131,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'328","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.722206+0000","last_change":"2024-09-12T01:11:09.722206+0000","last_active":"2024-09-12T01:11:09.722206+0000","last_peered":"2024-09-12T01:11:09.722206+0000","last_clean":"2024-09-12T01:11:09.722206+0000","last_became_active":"2024-09-12T00:12:36.041860+0000","last_became_peered":"2024-09-12T00:12:36.041860+0000","last_unstale":"2024-09-12T01:11:09.722206+0000","last_undegraded":"2024-09-12T01:11:09.722206+0000","last_fullsized":"2024-09-12T01:11:09.722206+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-12T01:11:09.722064+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-12T01:11:09.722064+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.722064+0000","objects_scrubbed":11,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:38.287167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3984538,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":381,"num_read_kb":7023,"num_write":999,"num_write_kb":36211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"32'1","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:25.050491+0000","last_change":"2024-09-12T00:12:40.039492+0000","last_active":"2024-09-12T01:08:25.050491+0000","last_peered":"2024-09-12T01:08:25.050491+0000","last_clean":"2024-09-12T01:08:25.050491+0000","last_became_active":"2024-09-12T00:12:40.039196+0000","last_became_peered":"2024-09-12T00:12:40.039196+0000","last_unstale":"2024-09-12T01:08:25.050491+0000","last_undegraded":"2024-09-12T01:08:25.050491+0000","last_fullsized":"2024-09-12T01:08:25.050491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:39.020110+0000","last_clean_scrub_stamp":"2024-09-12T00:12:39.020110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:03.281450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'344","reported_seq":940,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.301784+0000","last_change":"2024-09-12T00:12:42.039343+0000","last_active":"2024-09-12T01:10:58.301784+0000","last_peered":"2024-09-12T01:10:58.301784+0000","last_clean":"2024-09-12T01:10:58.301784+0000","last_became_active":"2024-09-12T00:12:42.039068+0000","last_became_peered":"2024-09-12T00:12:42.039068+0000","last_unstale":"2024-09-12T01:10:58.301784+0000","last_undegraded":"2024-09-12T01:10:58.301784+0000","last_fullsized":"2024-09-12T01:10:58.301784+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:41.023775+0000","last_clean_scrub_stamp":"2024-09-12T00:12:41.023775+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:19.273390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44473,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":544,"num_read_kb":1176,"num_write":442,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044483+0000","last_change":"2024-09-12T00:12:44.064609+0000","last_active":"2024-09-12T01:07:45.044483+0000","last_peered":"2024-09-12T01:07:45.044483+0000","last_clean":"2024-09-12T01:07:45.044483+0000","last_became_active":"2024-09-12T00:12:44.064105+0000","last_became_peered":"2024-09-12T00:12:44.064105+0000","last_unstale":"2024-09-12T01:07:45.044483+0000","last_undegraded":"2024-09-12T01:07:45.044483+0000","last_fullsized":"2024-09-12T01:07:45.044483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:34.680066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'146","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:31.817958+0000","last_change":"2024-09-12T00:12:46.054136+0000","last_active":"2024-09-12T01:10:31.817958+0000","last_peered":"2024-09-12T01:10:31.817958+0000","last_clean":"2024-09-12T01:10:31.817958+0000","last_became_active":"2024-09-12T00:12:46.053763+0000","last_became_peered":"2024-09-12T00:12:46.053763+0000","last_unstale":"2024-09-12T01:10:31.817958+0000","last_undegraded":"2024-09-12T01:10:31.817958+0000","last_fullsized":"2024-09-12T01:10:31.817958+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":382,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'137","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.480997+0000","last_change":"2024-09-12T01:11:18.480997+0000","last_active":"2024-09-12T01:11:18.480997+0000","last_peered":"2024-09-12T01:11:18.480997+0000","last_clean":"2024-09-12T01:11:18.480997+0000","last_became_active":"2024-09-12T00:12:38.044285+0000","last_became_peered":"2024-09-12T00:12:38.044285+0000","last_unstale":"2024-09-12T01:11:18.480997+0000","last_undegraded":"2024-09-12T01:11:18.480997+0000","last_fullsized":"2024-09-12T01:11:18.480997+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-12T01:11:18.480916+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-12T01:11:18.480916+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.480916+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:51.540635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":475,"num_write":234,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'397","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.214465+0000","last_change":"2024-09-12T01:11:05.214465+0000","last_active":"2024-09-12T01:11:05.214465+0000","last_peered":"2024-09-12T01:11:05.214465+0000","last_clean":"2024-09-12T01:11:05.214465+0000","last_became_active":"2024-09-12T00:12:36.036773+0000","last_became_peered":"2024-09-12T00:12:36.036773+0000","last_unstale":"2024-09-12T01:11:05.214465+0000","last_undegraded":"2024-09-12T01:11:05.214465+0000","last_fullsized":"2024-09-12T01:11:05.214465+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'397","last_scrub_stamp":"2024-09-12T01:11:05.214323+0000","last_deep_scrub":"263'397","last_deep_scrub_stamp":"2024-09-12T01:11:05.214323+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.214323+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:30.254016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":606,"num_read_kb":16738,"num_write":1145,"num_write_kb":32233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'47","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.706015+0000","last_change":"2024-09-12T01:11:14.706015+0000","last_active":"2024-09-12T01:11:14.706015+0000","last_peered":"2024-09-12T01:11:14.706015+0000","last_clean":"2024-09-12T01:11:14.706015+0000","last_became_active":"2024-09-12T00:12:38.036978+0000","last_became_peered":"2024-09-12T00:12:38.036978+0000","last_unstale":"2024-09-12T01:11:14.706015+0000","last_undegraded":"2024-09-12T01:11:14.706015+0000","last_fullsized":"2024-09-12T01:11:14.706015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-12T01:11:14.705925+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-12T01:11:14.705925+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.705925+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:12.824252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":60,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'331","reported_seq":968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.770480+0000","last_change":"2024-09-12T01:11:08.770480+0000","last_active":"2024-09-12T01:11:08.770480+0000","last_peered":"2024-09-12T01:11:08.770480+0000","last_clean":"2024-09-12T01:11:08.770480+0000","last_became_active":"2024-09-12T00:12:36.035112+0000","last_became_peered":"2024-09-12T00:12:36.035112+0000","last_unstale":"2024-09-12T01:11:08.770480+0000","last_undegraded":"2024-09-12T01:11:08.770480+0000","last_fullsized":"2024-09-12T01:11:08.770480+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:11:08.770383+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:11:08.770383+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.770383+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:44.676691+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":34939,"num_write":1097,"num_write_kb":28471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'137","reported_seq":770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.050573+0000","last_change":"2024-09-12T00:12:38.040495+0000","last_active":"2024-09-12T01:09:00.050573+0000","last_peered":"2024-09-12T01:09:00.050573+0000","last_clean":"2024-09-12T01:09:00.050573+0000","last_became_active":"2024-09-12T00:12:38.040144+0000","last_became_peered":"2024-09-12T00:12:38.040144+0000","last_unstale":"2024-09-12T01:09:00.050573+0000","last_undegraded":"2024-09-12T01:09:00.050573+0000","last_fullsized":"2024-09-12T01:09:00.050573+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":511,"num_write":216,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'319","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.411588+0000","last_change":"2024-09-12T01:11:16.411588+0000","last_active":"2024-09-12T01:11:16.411588+0000","last_peered":"2024-09-12T01:11:16.411588+0000","last_clean":"2024-09-12T01:11:16.411588+0000","last_became_active":"2024-09-12T00:12:36.035558+0000","last_became_peered":"2024-09-12T00:12:36.035558+0000","last_unstale":"2024-09-12T01:11:16.411588+0000","last_undegraded":"2024-09-12T01:11:16.411588+0000","last_fullsized":"2024-09-12T01:11:16.411588+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'319","last_scrub_stamp":"2024-09-12T01:11:16.411468+0000","last_deep_scrub":"263'319","last_deep_scrub_stamp":"2024-09-12T01:11:16.411468+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.411468+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:51.561801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287622,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":7822,"num_write":966,"num_write_kb":22426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'275","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.791183+0000","last_change":"2024-09-12T01:11:21.791183+0000","last_active":"2024-09-12T01:11:21.791183+0000","last_peered":"2024-09-12T01:11:21.791183+0000","last_clean":"2024-09-12T01:11:21.791183+0000","last_became_active":"2024-09-12T00:12:38.026109+0000","last_became_peered":"2024-09-12T00:12:38.026109+0000","last_unstale":"2024-09-12T01:11:21.791183+0000","last_undegraded":"2024-09-12T01:11:21.791183+0000","last_fullsized":"2024-09-12T01:11:21.791183+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'275","last_scrub_stamp":"2024-09-12T01:11:21.791097+0000","last_deep_scrub":"263'275","last_deep_scrub_stamp":"2024-09-12T01:11:21.791097+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.791097+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:10.158792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1270,"num_read_kb":1040,"num_write":446,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'331","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.752050+0000","last_change":"2024-09-12T01:11:11.751974+0000","last_active":"2024-09-12T01:11:11.752050+0000","last_peered":"2024-09-12T01:11:11.752050+0000","last_clean":"2024-09-12T01:11:11.752050+0000","last_became_active":"2024-09-12T00:12:36.033426+0000","last_became_peered":"2024-09-12T00:12:36.033426+0000","last_unstale":"2024-09-12T01:11:11.752050+0000","last_undegraded":"2024-09-12T01:11:11.752050+0000","last_fullsized":"2024-09-12T01:11:11.752050+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:11:11.751820+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:11:11.751820+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.751820+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:01.340846+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306676,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":19382,"num_write":951,"num_write_kb":44169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'4265","reported_seq":4917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.832554+0000","last_change":"2024-09-12T01:11:20.832554+0000","last_active":"2024-09-12T01:11:20.832554+0000","last_peered":"2024-09-12T01:11:20.832554+0000","last_clean":"2024-09-12T01:11:20.832554+0000","last_became_active":"2024-09-12T00:12:38.028401+0000","last_became_peered":"2024-09-12T00:12:38.028401+0000","last_unstale":"2024-09-12T01:11:20.832554+0000","last_undegraded":"2024-09-12T01:11:20.832554+0000","last_fullsized":"2024-09-12T01:11:20.832554+0000","mapping_epoch":29,"log_start":"263'4200","ondisk_log_start":"263'4200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4265","last_scrub_stamp":"2024-09-12T01:11:20.832469+0000","last_deep_scrub":"263'4265","last_deep_scrub_stamp":"2024-09-12T01:11:20.832469+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.832469+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":3000,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:00.963732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17227,"num_read_kb":14428,"num_write":6422,"num_write_kb":3205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'326","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.234518+0000","last_change":"2024-09-12T01:11:12.234518+0000","last_active":"2024-09-12T01:11:12.234518+0000","last_peered":"2024-09-12T01:11:12.234518+0000","last_clean":"2024-09-12T01:11:12.234518+0000","last_became_active":"2024-09-12T00:12:36.032341+0000","last_became_peered":"2024-09-12T00:12:36.032341+0000","last_unstale":"2024-09-12T01:11:12.234518+0000","last_undegraded":"2024-09-12T01:11:12.234518+0000","last_fullsized":"2024-09-12T01:11:12.234518+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-12T01:11:12.234405+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-12T01:11:12.234405+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.234405+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:58.603991+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2561198,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":66123,"num_write":1057,"num_write_kb":26739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'149","reported_seq":737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.200891+0000","last_change":"2024-09-12T01:11:15.200891+0000","last_active":"2024-09-12T01:11:15.200891+0000","last_peered":"2024-09-12T01:11:15.200891+0000","last_clean":"2024-09-12T01:11:15.200891+0000","last_became_active":"2024-09-12T00:12:38.043276+0000","last_became_peered":"2024-09-12T00:12:38.043276+0000","last_unstale":"2024-09-12T01:11:15.200891+0000","last_undegraded":"2024-09-12T01:11:15.200891+0000","last_fullsized":"2024-09-12T01:11:15.200891+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-12T01:11:15.200800+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-12T01:11:15.200800+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.200800+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:25.860652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":632,"num_read_kb":523,"num_write":222,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'311","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.295855+0000","last_change":"2024-09-12T01:11:10.295855+0000","last_active":"2024-09-12T01:11:10.295855+0000","last_peered":"2024-09-12T01:11:10.295855+0000","last_clean":"2024-09-12T01:11:10.295855+0000","last_became_active":"2024-09-12T00:12:36.029687+0000","last_became_peered":"2024-09-12T00:12:36.029687+0000","last_unstale":"2024-09-12T01:11:10.295855+0000","last_undegraded":"2024-09-12T01:11:10.295855+0000","last_fullsized":"2024-09-12T01:11:10.295855+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:11:10.295694+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:11:10.295694+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.295694+0000","objects_scrubbed":6,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:59.583411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":12036,"num_write":1041,"num_write_kb":29691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'211","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.249880+0000","last_change":"2024-09-12T01:11:19.249880+0000","last_active":"2024-09-12T01:11:19.249880+0000","last_peered":"2024-09-12T01:11:19.249880+0000","last_clean":"2024-09-12T01:11:19.249880+0000","last_became_active":"2024-09-12T00:12:38.047575+0000","last_became_peered":"2024-09-12T00:12:38.047575+0000","last_unstale":"2024-09-12T01:11:19.249880+0000","last_undegraded":"2024-09-12T01:11:19.249880+0000","last_fullsized":"2024-09-12T01:11:19.249880+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-12T01:11:19.249774+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-12T01:11:19.249774+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.249774+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:52.534231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":952,"num_read_kb":776,"num_write":336,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'364","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.216422+0000","last_change":"2024-09-12T01:11:16.216422+0000","last_active":"2024-09-12T01:11:16.216422+0000","last_peered":"2024-09-12T01:11:16.216422+0000","last_clean":"2024-09-12T01:11:16.216422+0000","last_became_active":"2024-09-12T00:12:36.043803+0000","last_became_peered":"2024-09-12T00:12:36.043803+0000","last_unstale":"2024-09-12T01:11:16.216422+0000","last_undegraded":"2024-09-12T01:11:16.216422+0000","last_fullsized":"2024-09-12T01:11:16.216422+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-12T01:11:16.216308+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-12T01:11:16.216308+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.216308+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:33.903640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":463,"num_read_kb":37298,"num_write":1152,"num_write_kb":54766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'144","reported_seq":739,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.240217+0000","last_change":"2024-09-12T01:11:12.240217+0000","last_active":"2024-09-12T01:11:12.240217+0000","last_peered":"2024-09-12T01:11:12.240217+0000","last_clean":"2024-09-12T01:11:12.240217+0000","last_became_active":"2024-09-12T00:12:38.036463+0000","last_became_peered":"2024-09-12T00:12:38.036463+0000","last_unstale":"2024-09-12T01:11:12.240217+0000","last_undegraded":"2024-09-12T01:11:12.240217+0000","last_fullsized":"2024-09-12T01:11:12.240217+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-12T01:11:12.240134+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-12T01:11:12.240134+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.240134+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:47.702270+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":509,"num_write":213,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'287","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.771144+0000","last_change":"2024-09-12T01:11:12.771144+0000","last_active":"2024-09-12T01:11:12.771144+0000","last_peered":"2024-09-12T01:11:12.771144+0000","last_clean":"2024-09-12T01:11:12.771144+0000","last_became_active":"2024-09-12T00:12:36.041392+0000","last_became_peered":"2024-09-12T00:12:36.041392+0000","last_unstale":"2024-09-12T01:11:12.771144+0000","last_undegraded":"2024-09-12T01:11:12.771144+0000","last_fullsized":"2024-09-12T01:11:12.771144+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'287","last_scrub_stamp":"2024-09-12T01:11:12.771025+0000","last_deep_scrub":"263'287","last_deep_scrub_stamp":"2024-09-12T01:11:12.771025+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.771025+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:08.477912+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992353,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":407,"num_read_kb":23602,"num_write":1012,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'134","reported_seq":762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.757265+0000","last_change":"2024-09-12T01:11:15.757265+0000","last_active":"2024-09-12T01:11:15.757265+0000","last_peered":"2024-09-12T01:11:15.757265+0000","last_clean":"2024-09-12T01:11:15.757265+0000","last_became_active":"2024-09-12T00:12:38.042584+0000","last_became_peered":"2024-09-12T00:12:38.042584+0000","last_unstale":"2024-09-12T01:11:15.757265+0000","last_undegraded":"2024-09-12T01:11:15.757265+0000","last_fullsized":"2024-09-12T01:11:15.757265+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-12T01:11:15.757170+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-12T01:11:15.757170+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.757170+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:39.681374+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":632,"num_read_kb":533,"num_write":194,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'381","reported_seq":1048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.378596+0000","last_change":"2024-09-12T01:11:17.378508+0000","last_active":"2024-09-12T01:11:17.378596+0000","last_peered":"2024-09-12T01:11:17.378596+0000","last_clean":"2024-09-12T01:11:17.378596+0000","last_became_active":"2024-09-12T00:12:36.037461+0000","last_became_peered":"2024-09-12T00:12:36.037461+0000","last_unstale":"2024-09-12T01:11:17.378596+0000","last_undegraded":"2024-09-12T01:11:17.378596+0000","last_fullsized":"2024-09-12T01:11:17.378596+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'381","last_scrub_stamp":"2024-09-12T01:11:17.378379+0000","last_deep_scrub":"263'381","last_deep_scrub_stamp":"2024-09-12T01:11:17.378379+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.378379+0000","objects_scrubbed":8,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:13.428268+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262313,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":614,"num_read_kb":9826,"num_write":1249,"num_write_kb":32499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'308","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.179705+0000","last_change":"2024-09-12T01:11:14.179705+0000","last_active":"2024-09-12T01:11:14.179705+0000","last_peered":"2024-09-12T01:11:14.179705+0000","last_clean":"2024-09-12T01:11:14.179705+0000","last_became_active":"2024-09-12T00:12:38.036872+0000","last_became_peered":"2024-09-12T00:12:38.036872+0000","last_unstale":"2024-09-12T01:11:14.179705+0000","last_undegraded":"2024-09-12T01:11:14.179705+0000","last_fullsized":"2024-09-12T01:11:14.179705+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'308","last_scrub_stamp":"2024-09-12T01:11:14.179611+0000","last_deep_scrub":"263'308","last_deep_scrub_stamp":"2024-09-12T01:11:14.179611+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.179611+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:04.270135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1112,"num_write":459,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'341","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.799642+0000","last_change":"2024-09-12T01:11:13.799642+0000","last_active":"2024-09-12T01:11:13.799642+0000","last_peered":"2024-09-12T01:11:13.799642+0000","last_clean":"2024-09-12T01:11:13.799642+0000","last_became_active":"2024-09-12T00:12:36.042159+0000","last_became_peered":"2024-09-12T00:12:36.042159+0000","last_unstale":"2024-09-12T01:11:13.799642+0000","last_undegraded":"2024-09-12T01:11:13.799642+0000","last_fullsized":"2024-09-12T01:11:13.799642+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-12T01:11:13.799464+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-12T01:11:13.799464+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.799464+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:02.740372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262267,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":43498,"num_write":1204,"num_write_kb":41544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'313","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:08.055293+0000","last_change":"2024-09-12T00:12:38.045246+0000","last_active":"2024-09-12T01:09:08.055293+0000","last_peered":"2024-09-12T01:09:08.055293+0000","last_clean":"2024-09-12T01:09:08.055293+0000","last_became_active":"2024-09-12T00:12:38.042966+0000","last_became_peered":"2024-09-12T00:12:38.042966+0000","last_unstale":"2024-09-12T01:09:08.055293+0000","last_undegraded":"2024-09-12T01:09:08.055293+0000","last_fullsized":"2024-09-12T01:09:08.055293+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:37.008373+0000","last_clean_scrub_stamp":"2024-09-12T00:12:37.008373+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1467,"num_read_kb":1262,"num_write":468,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'377","reported_seq":1039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.331079+0000","last_change":"2024-09-12T01:11:08.331017+0000","last_active":"2024-09-12T01:11:08.331079+0000","last_peered":"2024-09-12T01:11:08.331079+0000","last_clean":"2024-09-12T01:11:08.331079+0000","last_became_active":"2024-09-12T00:12:36.027423+0000","last_became_peered":"2024-09-12T00:12:36.027423+0000","last_unstale":"2024-09-12T01:11:08.331079+0000","last_undegraded":"2024-09-12T01:11:08.331079+0000","last_fullsized":"2024-09-12T01:11:08.331079+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:11:08.330897+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:11:08.330897+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.330897+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:48.101657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730133,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":69052,"num_write":1173,"num_write_kb":46135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'156","reported_seq":737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.234431+0000","last_change":"2024-09-12T01:11:17.234431+0000","last_active":"2024-09-12T01:11:17.234431+0000","last_peered":"2024-09-12T01:11:17.234431+0000","last_clean":"2024-09-12T01:11:17.234431+0000","last_became_active":"2024-09-12T00:12:38.036235+0000","last_became_peered":"2024-09-12T00:12:38.036235+0000","last_unstale":"2024-09-12T01:11:17.234431+0000","last_undegraded":"2024-09-12T01:11:17.234431+0000","last_fullsized":"2024-09-12T01:11:17.234431+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'156","last_scrub_stamp":"2024-09-12T01:11:17.234365+0000","last_deep_scrub":"263'156","last_deep_scrub_stamp":"2024-09-12T01:11:17.234365+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.234365+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:50.396135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":550,"num_write":221,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'463","reported_seq":1289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.615976+0000","last_change":"2024-09-12T01:11:13.615976+0000","last_active":"2024-09-12T01:11:13.615976+0000","last_peered":"2024-09-12T01:11:13.615976+0000","last_clean":"2024-09-12T01:11:13.615976+0000","last_became_active":"2024-09-12T00:12:36.038449+0000","last_became_peered":"2024-09-12T00:12:36.038449+0000","last_unstale":"2024-09-12T01:11:13.615976+0000","last_undegraded":"2024-09-12T01:11:13.615976+0000","last_fullsized":"2024-09-12T01:11:13.615976+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'463","last_scrub_stamp":"2024-09-12T01:11:13.615824+0000","last_deep_scrub":"263'463","last_deep_scrub_stamp":"2024-09-12T01:11:13.615824+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.615824+0000","objects_scrubbed":10,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:45.835212+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5280724,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1083,"num_read_kb":25378,"num_write":1472,"num_write_kb":31172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'189","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.221767+0000","last_change":"2024-09-12T01:11:14.221767+0000","last_active":"2024-09-12T01:11:14.221767+0000","last_peered":"2024-09-12T01:11:14.221767+0000","last_clean":"2024-09-12T01:11:14.221767+0000","last_became_active":"2024-09-12T00:12:38.042691+0000","last_became_peered":"2024-09-12T00:12:38.042691+0000","last_unstale":"2024-09-12T01:11:14.221767+0000","last_undegraded":"2024-09-12T01:11:14.221767+0000","last_fullsized":"2024-09-12T01:11:14.221767+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'189","last_scrub_stamp":"2024-09-12T01:11:14.221681+0000","last_deep_scrub":"263'189","last_deep_scrub_stamp":"2024-09-12T01:11:14.221681+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.221681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:58.106634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":710,"num_write":289,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'349","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.150591+0000","last_change":"2024-09-12T01:11:08.150533+0000","last_active":"2024-09-12T01:11:08.150591+0000","last_peered":"2024-09-12T01:11:08.150591+0000","last_clean":"2024-09-12T01:11:08.150591+0000","last_became_active":"2024-09-12T00:12:36.025028+0000","last_became_peered":"2024-09-12T00:12:36.025028+0000","last_unstale":"2024-09-12T01:11:08.150591+0000","last_undegraded":"2024-09-12T01:11:08.150591+0000","last_fullsized":"2024-09-12T01:11:08.150591+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'349","last_scrub_stamp":"2024-09-12T01:11:08.150388+0000","last_deep_scrub":"263'349","last_deep_scrub_stamp":"2024-09-12T01:11:08.150388+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.150388+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:51.049508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":523,"num_read_kb":8333,"num_write":1236,"num_write_kb":35038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'132","reported_seq":755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.724523+0000","last_change":"2024-09-12T01:11:16.724523+0000","last_active":"2024-09-12T01:11:16.724523+0000","last_peered":"2024-09-12T01:11:16.724523+0000","last_clean":"2024-09-12T01:11:16.724523+0000","last_became_active":"2024-09-12T00:12:38.046753+0000","last_became_peered":"2024-09-12T00:12:38.046753+0000","last_unstale":"2024-09-12T01:11:16.724523+0000","last_undegraded":"2024-09-12T01:11:16.724523+0000","last_fullsized":"2024-09-12T01:11:16.724523+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'132","last_scrub_stamp":"2024-09-12T01:11:16.724424+0000","last_deep_scrub":"263'132","last_deep_scrub_stamp":"2024-09-12T01:11:16.724424+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.724424+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:10.527369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":645,"num_read_kb":546,"num_write":214,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'376","reported_seq":1029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.407915+0000","last_change":"2024-09-12T01:11:18.407843+0000","last_active":"2024-09-12T01:11:18.407915+0000","last_peered":"2024-09-12T01:11:18.407915+0000","last_clean":"2024-09-12T01:11:18.407915+0000","last_became_active":"2024-09-12T00:12:36.047221+0000","last_became_peered":"2024-09-12T00:12:36.047221+0000","last_unstale":"2024-09-12T01:11:18.407915+0000","last_undegraded":"2024-09-12T01:11:18.407915+0000","last_fullsized":"2024-09-12T01:11:18.407915+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'376","last_scrub_stamp":"2024-09-12T01:11:18.407727+0000","last_deep_scrub":"263'376","last_deep_scrub_stamp":"2024-09-12T01:11:18.407727+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.407727+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:05.332812+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4807090,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":28472,"num_write":1153,"num_write_kb":36833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'174","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.450164+0000","last_change":"2024-09-12T01:11:19.450164+0000","last_active":"2024-09-12T01:11:19.450164+0000","last_peered":"2024-09-12T01:11:19.450164+0000","last_clean":"2024-09-12T01:11:19.450164+0000","last_became_active":"2024-09-12T00:12:38.048094+0000","last_became_peered":"2024-09-12T00:12:38.048094+0000","last_unstale":"2024-09-12T01:11:19.450164+0000","last_undegraded":"2024-09-12T01:11:19.450164+0000","last_fullsized":"2024-09-12T01:11:19.450164+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'174","last_scrub_stamp":"2024-09-12T01:11:19.450075+0000","last_deep_scrub":"263'174","last_deep_scrub_stamp":"2024-09-12T01:11:19.450075+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.450075+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:51.643162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":798,"num_read_kb":664,"num_write":275,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'311","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.726114+0000","last_change":"2024-09-12T01:11:10.726114+0000","last_active":"2024-09-12T01:11:10.726114+0000","last_peered":"2024-09-12T01:11:10.726114+0000","last_clean":"2024-09-12T01:11:10.726114+0000","last_became_active":"2024-09-12T00:12:36.039442+0000","last_became_peered":"2024-09-12T00:12:36.039442+0000","last_unstale":"2024-09-12T01:11:10.726114+0000","last_undegraded":"2024-09-12T01:11:10.726114+0000","last_fullsized":"2024-09-12T01:11:10.726114+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:11:10.725997+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:11:10.725997+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.725997+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:30.008154+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":5824,"num_write":1002,"num_write_kb":34989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'86","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.269437+0000","last_change":"2024-09-12T01:11:13.269371+0000","last_active":"2024-09-12T01:11:13.269437+0000","last_peered":"2024-09-12T01:11:13.269437+0000","last_clean":"2024-09-12T01:11:13.269437+0000","last_became_active":"2024-09-12T00:12:38.042380+0000","last_became_peered":"2024-09-12T00:12:38.042380+0000","last_unstale":"2024-09-12T01:11:13.269437+0000","last_undegraded":"2024-09-12T01:11:13.269437+0000","last_fullsized":"2024-09-12T01:11:13.269437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'86","last_scrub_stamp":"2024-09-12T01:11:13.269288+0000","last_deep_scrub":"263'86","last_deep_scrub_stamp":"2024-09-12T01:11:13.269288+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.269288+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:11.757304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":311,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'396","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.359247+0000","last_change":"2024-09-12T01:11:19.359247+0000","last_active":"2024-09-12T01:11:19.359247+0000","last_peered":"2024-09-12T01:11:19.359247+0000","last_clean":"2024-09-12T01:11:19.359247+0000","last_became_active":"2024-09-12T00:12:36.035235+0000","last_became_peered":"2024-09-12T00:12:36.035235+0000","last_unstale":"2024-09-12T01:11:19.359247+0000","last_undegraded":"2024-09-12T01:11:19.359247+0000","last_fullsized":"2024-09-12T01:11:19.359247+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'396","last_scrub_stamp":"2024-09-12T01:11:19.359113+0000","last_deep_scrub":"263'396","last_deep_scrub_stamp":"2024-09-12T01:11:19.359113+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.359113+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:34.438134+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2508578,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":34997,"num_write":1247,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'340","reported_seq":967,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.297255+0000","last_change":"2024-09-12T01:11:10.297255+0000","last_active":"2024-09-12T01:11:10.297255+0000","last_peered":"2024-09-12T01:11:10.297255+0000","last_clean":"2024-09-12T01:11:10.297255+0000","last_became_active":"2024-09-12T00:13:07.150278+0000","last_became_peered":"2024-09-12T00:13:07.150278+0000","last_unstale":"2024-09-12T01:11:10.297255+0000","last_undegraded":"2024-09-12T01:11:10.297255+0000","last_fullsized":"2024-09-12T01:11:10.297255+0000","mapping_epoch":40,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:11:10.297094+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:11:10.297094+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.297094+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:40.514518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550106,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":16889,"num_write":1077,"num_write_kb":27724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"263'232","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.445613+0000","last_change":"2024-09-12T01:11:20.445613+0000","last_active":"2024-09-12T01:11:20.445613+0000","last_peered":"2024-09-12T01:11:20.445613+0000","last_clean":"2024-09-12T01:11:20.445613+0000","last_became_active":"2024-09-12T00:12:38.048092+0000","last_became_peered":"2024-09-12T00:12:38.048092+0000","last_unstale":"2024-09-12T01:11:20.445613+0000","last_undegraded":"2024-09-12T01:11:20.445613+0000","last_fullsized":"2024-09-12T01:11:20.445613+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T01:11:20.445524+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T01:11:20.445524+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.445524+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:49.570800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":909,"num_write":384,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'395","reported_seq":1216,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.842411+0000","last_change":"2024-09-12T01:11:14.842411+0000","last_active":"2024-09-12T01:11:14.842411+0000","last_peered":"2024-09-12T01:11:14.842411+0000","last_clean":"2024-09-12T01:11:14.842411+0000","last_became_active":"2024-09-12T00:12:36.034396+0000","last_became_peered":"2024-09-12T00:12:36.034396+0000","last_unstale":"2024-09-12T01:11:14.842411+0000","last_undegraded":"2024-09-12T01:11:14.842411+0000","last_fullsized":"2024-09-12T01:11:14.842411+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'395","last_scrub_stamp":"2024-09-12T01:11:14.842306+0000","last_deep_scrub":"263'395","last_deep_scrub_stamp":"2024-09-12T01:11:14.842306+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.842306+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:02.568926+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730115,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":982,"num_read_kb":9206,"num_write":1471,"num_write_kb":42121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'344","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.286803+0000","last_change":"2024-09-12T01:11:20.286803+0000","last_active":"2024-09-12T01:11:20.286803+0000","last_peered":"2024-09-12T01:11:20.286803+0000","last_clean":"2024-09-12T01:11:20.286803+0000","last_became_active":"2024-09-12T00:12:38.039941+0000","last_became_peered":"2024-09-12T00:12:38.039941+0000","last_unstale":"2024-09-12T01:11:20.286803+0000","last_undegraded":"2024-09-12T01:11:20.286803+0000","last_fullsized":"2024-09-12T01:11:20.286803+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-12T01:11:20.286686+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-12T01:11:20.286686+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.286686+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:08.702768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1443,"num_read_kb":1146,"num_write":558,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5787,"num_read_kb":4069,"num_write":1922,"num_write_kb":820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1093,"ondisk_log_size":1093,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15069,"num_read_kb":14720,"num_write":16734,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1768,"ondisk_log_size":1768,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":691,"ondisk_log_size":691,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1599308,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":18230,"num_read_kb":37558,"num_write":15243,"num_write_kb":11785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":514934,"num_omap_keys":1170,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2033,"ondisk_log_size":2033,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":103162,"num_read_kb":86048,"num_write":37373,"num_write_kb":18894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18843,"num_omap_keys":79,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3942,"ondisk_log_size":3942,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":86738467,"num_objects":386,"num_object_clones":0,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":386,"num_whiteouts":0,"num_read":36305,"num_read_kb":1714849,"num_write":72152,"num_write_kb":2100462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":132317184,"data_stored":132317184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3742,"ondisk_log_size":3742,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":170862,"num_write":186,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":170241,"num_write":186,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510154,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220644,"kb_used_data":14612,"kb_used_omap":1,"kb_used_meta":206014,"kb_avail":94151196,"statfs":{"total":96636764160,"available":96410824704,"internally_reserved":0,"allocated":14962688,"data_stored":12977820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":210958795},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510157,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108704,"kb_used_data":15120,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94263136,"statfs":{"total":96636764160,"available":96525451264,"internally_reserved":0,"allocated":15482880,"data_stored":13481120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95812038},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510154,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201320,"kb_used_data":21656,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94170520,"statfs":{"total":96636764160,"available":96430612480,"internally_reserved":0,"allocated":22175744,"data_stored":20184672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510155,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266996,"kb_used_data":28964,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94104844,"statfs":{"total":96636764160,"available":96363360256,"internally_reserved":0,"allocated":29659136,"data_stored":27672539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":243726791},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510155,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147696,"kb_used_data":22112,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94224144,"statfs":{"total":96636764160,"available":96485523456,"internally_reserved":0,"allocated":22642688,"data_stored":20661729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510154,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":328376,"kb_used_data":22312,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94043464,"statfs":{"total":96636764160,"available":96300507136,"internally_reserved":0,"allocated":22847488,"data_stored":20852874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510157,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115664,"kb_used_data":17856,"kb_used_omap":1,"kb_used_meta":97790,"kb_avail":94256176,"statfs":{"total":96636764160,"available":96518324224,"internally_reserved":0,"allocated":18284544,"data_stored":16272298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100137413},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575562,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272432,"kb_used_data":20512,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94099408,"statfs":{"total":96636764160,"available":96357793792,"internally_reserved":0,"allocated":21004288,"data_stored":19003294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14069760,"data_stored":14069760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18063360,"data_stored":18063360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18460672,"data_stored":18460672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25473024,"data_stored":25473024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17981440,"data_stored":17981440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16211968,"data_stored":16211968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11280384,"data_stored":11280384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10776576,"data_stored":10776576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:11:27.319 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.319 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.320 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.320 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.320 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.320 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.320 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.320 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.320 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.320 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.320 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.321 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.321 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.321 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.321 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.321 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.321 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.321 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.321 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.321 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.322 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.322 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.322 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.322 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.322 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.322 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.322 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.322 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.322 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.322 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.323 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.323 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.323 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.323 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.323 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.323 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.323 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.323 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.323 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.324 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.324 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.324 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.324 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.324 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.324 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.324 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.324 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.324 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.325 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.325 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.325 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.325 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.325 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.325 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.325 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.325 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.325 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.326 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.326 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.326 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.326 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.326 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.326 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.326 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.326 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.326 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.326 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.327 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.327 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.327 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.327 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.327 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.327 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.327 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.327 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.327 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.328 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.328 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.328 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.328 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.328 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.328 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.328 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.328 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.328 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.329 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.329 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.329 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.329 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.329 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.329 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.329 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.329 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.329 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.330 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.330 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.330 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.330 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.330 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.330 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.330 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.330 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.330 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.331 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.331 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.331 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.331 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.331 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.331 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.331 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.331 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.331 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.332 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.332 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.332 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.332 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.332 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.332 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.332 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.333 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.333 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.333 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.333 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.333 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.333 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.334 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.334 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.334 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.334 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.334 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.334 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.334 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.335 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.335 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.335 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.335 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.335 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.336 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.336 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.336 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.336 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.337 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.337 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.337 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.337 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.337 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.337 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.338 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.338 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.338 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.338 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.338 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.338 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.339 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.339 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.339 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.339 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.339 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.339 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.339 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.339 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.339 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.340 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.340 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.340 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.340 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.340 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.340 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.340 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.340 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.341 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.341 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.341 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.341 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.341 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.341 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.341 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.341 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.342 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.342 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.342 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.342 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.342 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.342 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.342 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.343 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.343 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.343 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.343 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.343 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.343 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.343 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.343 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.344 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.344 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.344 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.344 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.344 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.344 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.344 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.344 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.345 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.345 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.345 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.345 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.345 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.345 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.345 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.345 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.346 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.346 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.346 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.346 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.346 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.346 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.346 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.346 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.347 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.347 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.347 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.347 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.347 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.347 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.347 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.347 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.348 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.348 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.348 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.348 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.348 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.348 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.348 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.348 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:12:39.020110+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.349 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:12:41.023775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.349 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.349 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.349 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.349 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:12:37.008373+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:27.349 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:11:47.350 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:11:47.686 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:11:47.700 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-09-12T01:11:47.702 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":2043,"stamp":"2024-09-12T01:11:47.353693+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88946274,"num_objects":742,"num_object_clones":0,"num_object_copies":1870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":181390,"num_read_kb":2201314,"num_write":143939,"num_write_kb":2394991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":736683,"num_omap_keys":1779,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13570,"ondisk_log_size":13570,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1653512,"kb_used_data":163144,"kb_used_omap":12,"kb_used_meta":1490227,"kb_avail":753321208,"statfs":{"total":773094113280,"available":771400916992,"internally_reserved":0,"allocated":167059456,"data_stored":151106346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1525993010},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":125361,"num_omap_keys":308,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006005"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.238299+0000","last_change":"2024-09-12T01:11:42.238299+0000","last_active":"2024-09-12T01:11:42.238299+0000","last_peered":"2024-09-12T01:11:42.238299+0000","last_clean":"2024-09-12T01:11:42.238299+0000","last_became_active":"2024-09-12T00:46:54.885628+0000","last_became_peered":"2024-09-12T00:46:54.885628+0000","last_unstale":"2024-09-12T01:11:42.238299+0000","last_undegraded":"2024-09-12T01:11:42.238299+0000","last_fullsized":"2024-09-12T01:11:42.238299+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:42.238174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:42.238174+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.238174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:50.228730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.293811+0000","last_change":"2024-09-12T01:11:41.293811+0000","last_active":"2024-09-12T01:11:41.293811+0000","last_peered":"2024-09-12T01:11:41.293811+0000","last_clean":"2024-09-12T01:11:41.293811+0000","last_became_active":"2024-09-12T00:30:17.763402+0000","last_became_peered":"2024-09-12T00:30:17.763402+0000","last_unstale":"2024-09-12T01:11:41.293811+0000","last_undegraded":"2024-09-12T01:11:41.293811+0000","last_fullsized":"2024-09-12T01:11:41.293811+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-12T01:11:41.293721+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-12T01:11:41.293721+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.293721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:33.238185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.573777+0000","last_change":"2024-09-12T01:11:42.573777+0000","last_active":"2024-09-12T01:11:42.573777+0000","last_peered":"2024-09-12T01:11:42.573777+0000","last_clean":"2024-09-12T01:11:42.573777+0000","last_became_active":"2024-09-12T00:30:14.744833+0000","last_became_peered":"2024-09-12T00:30:14.744833+0000","last_unstale":"2024-09-12T01:11:42.573777+0000","last_undegraded":"2024-09-12T01:11:42.573777+0000","last_fullsized":"2024-09-12T01:11:42.573777+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-12T01:11:42.573690+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-12T01:11:42.573690+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.573690+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:45.289006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'41","reported_seq":162,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:25.060671+0000","last_change":"2024-09-12T00:27:42.840206+0000","last_active":"2024-09-12T01:09:25.060671+0000","last_peered":"2024-09-12T01:09:25.060671+0000","last_clean":"2024-09-12T01:09:25.060671+0000","last_became_active":"2024-09-12T00:27:42.839605+0000","last_became_peered":"2024-09-12T00:27:42.839605+0000","last_unstale":"2024-09-12T01:09:25.060671+0000","last_undegraded":"2024-09-12T01:09:25.060671+0000","last_fullsized":"2024-09-12T01:09:25.060671+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":144,"num_write":69,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":22,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.153651+0000","last_change":"2024-09-12T00:46:54.885981+0000","last_active":"2024-09-12T01:06:55.153651+0000","last_peered":"2024-09-12T01:06:55.153651+0000","last_clean":"2024-09-12T01:06:55.153651+0000","last_became_active":"2024-09-12T00:46:54.885702+0000","last_became_peered":"2024-09-12T00:46:54.885702+0000","last_unstale":"2024-09-12T01:06:55.153651+0000","last_undegraded":"2024-09-12T01:06:55.153651+0000","last_fullsized":"2024-09-12T01:06:55.153651+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:37.616069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'3","reported_seq":38,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:20.152789+0000","last_change":"2024-09-12T00:30:17.762666+0000","last_active":"2024-09-12T01:10:20.152789+0000","last_peered":"2024-09-12T01:10:20.152789+0000","last_clean":"2024-09-12T01:10:20.152789+0000","last_became_active":"2024-09-12T00:30:17.762369+0000","last_became_peered":"2024-09-12T00:30:17.762369+0000","last_unstale":"2024-09-12T01:10:20.152789+0000","last_undegraded":"2024-09-12T01:10:20.152789+0000","last_fullsized":"2024-09-12T01:10:20.152789+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:33.357062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042925+0000","last_change":"2024-09-12T00:30:14.747881+0000","last_active":"2024-09-12T01:07:48.042925+0000","last_peered":"2024-09-12T01:07:48.042925+0000","last_clean":"2024-09-12T01:07:48.042925+0000","last_became_active":"2024-09-12T00:30:14.747614+0000","last_became_peered":"2024-09-12T00:30:14.747614+0000","last_unstale":"2024-09-12T01:07:48.042925+0000","last_undegraded":"2024-09-12T01:07:48.042925+0000","last_fullsized":"2024-09-12T01:07:48.042925+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:33.210330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'21","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.388096+0000","last_change":"2024-09-12T01:11:44.388096+0000","last_active":"2024-09-12T01:11:44.388096+0000","last_peered":"2024-09-12T01:11:44.388096+0000","last_clean":"2024-09-12T01:11:44.388096+0000","last_became_active":"2024-09-12T00:27:42.846264+0000","last_became_peered":"2024-09-12T00:27:42.846264+0000","last_unstale":"2024-09-12T01:11:44.388096+0000","last_undegraded":"2024-09-12T01:11:44.388096+0000","last_fullsized":"2024-09-12T01:11:44.388096+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'21","last_scrub_stamp":"2024-09-12T01:11:44.387999+0000","last_deep_scrub":"263'21","last_deep_scrub_stamp":"2024-09-12T01:11:44.387999+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.387999+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:24.123389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.252024+0000","last_change":"2024-09-12T01:11:45.252024+0000","last_active":"2024-09-12T01:11:45.252024+0000","last_peered":"2024-09-12T01:11:45.252024+0000","last_clean":"2024-09-12T01:11:45.252024+0000","last_became_active":"2024-09-12T00:46:54.890430+0000","last_became_peered":"2024-09-12T00:46:54.890430+0000","last_unstale":"2024-09-12T01:11:45.252024+0000","last_undegraded":"2024-09-12T01:11:45.252024+0000","last_fullsized":"2024-09-12T01:11:45.252024+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:45.251938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:45.251938+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.251938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:34.442709+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042970+0000","last_change":"2024-09-12T00:30:17.767409+0000","last_active":"2024-09-12T01:07:48.042970+0000","last_peered":"2024-09-12T01:07:48.042970+0000","last_clean":"2024-09-12T01:07:48.042970+0000","last_became_active":"2024-09-12T00:30:17.767116+0000","last_became_peered":"2024-09-12T00:30:17.767116+0000","last_unstale":"2024-09-12T01:07:48.042970+0000","last_undegraded":"2024-09-12T01:07:48.042970+0000","last_fullsized":"2024-09-12T01:07:48.042970+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:25.469472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"263'6","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.240551+0000","last_change":"2024-09-12T00:30:14.742702+0000","last_active":"2024-09-12T01:10:58.240551+0000","last_peered":"2024-09-12T01:10:58.240551+0000","last_clean":"2024-09-12T01:10:58.240551+0000","last_became_active":"2024-09-12T00:30:14.742434+0000","last_became_peered":"2024-09-12T00:30:14.742434+0000","last_unstale":"2024-09-12T01:10:58.240551+0000","last_undegraded":"2024-09-12T01:10:58.240551+0000","last_fullsized":"2024-09-12T01:10:58.240551+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:37.658561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6194,"num_write":6,"num_write_kb":5170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'36","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.481877+0000","last_change":"2024-09-12T01:11:41.481877+0000","last_active":"2024-09-12T01:11:41.481877+0000","last_peered":"2024-09-12T01:11:41.481877+0000","last_clean":"2024-09-12T01:11:41.481877+0000","last_became_active":"2024-09-12T00:27:42.842172+0000","last_became_peered":"2024-09-12T00:27:42.842172+0000","last_unstale":"2024-09-12T01:11:41.481877+0000","last_undegraded":"2024-09-12T01:11:41.481877+0000","last_fullsized":"2024-09-12T01:11:41.481877+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-12T01:11:41.481778+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-12T01:11:41.481778+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.481778+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:04.496975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.052073+0000","last_change":"2024-09-12T00:46:54.883267+0000","last_active":"2024-09-12T01:08:48.052073+0000","last_peered":"2024-09-12T01:08:48.052073+0000","last_clean":"2024-09-12T01:08:48.052073+0000","last_became_active":"2024-09-12T00:46:54.882951+0000","last_became_peered":"2024-09-12T00:46:54.882951+0000","last_unstale":"2024-09-12T01:08:48.052073+0000","last_undegraded":"2024-09-12T01:08:48.052073+0000","last_fullsized":"2024-09-12T01:08:48.052073+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:28.067511+0000","last_change":"2024-09-12T00:30:17.766601+0000","last_active":"2024-09-12T01:10:28.067511+0000","last_peered":"2024-09-12T01:10:28.067511+0000","last_clean":"2024-09-12T01:10:28.067511+0000","last_became_active":"2024-09-12T00:30:17.764967+0000","last_became_peered":"2024-09-12T00:30:17.764967+0000","last_unstale":"2024-09-12T01:10:28.067511+0000","last_undegraded":"2024-09-12T01:10:28.067511+0000","last_fullsized":"2024-09-12T01:10:28.067511+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:56.749587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.342294+0000","last_change":"2024-09-12T01:11:40.342294+0000","last_active":"2024-09-12T01:11:40.342294+0000","last_peered":"2024-09-12T01:11:40.342294+0000","last_clean":"2024-09-12T01:11:40.342294+0000","last_became_active":"2024-09-12T00:30:14.747423+0000","last_became_peered":"2024-09-12T00:30:14.747423+0000","last_unstale":"2024-09-12T01:11:40.342294+0000","last_undegraded":"2024-09-12T01:11:40.342294+0000","last_fullsized":"2024-09-12T01:11:40.342294+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:11:40.342210+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:11:40.342210+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.342210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:39.241915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'27","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.510222+0000","last_change":"2024-09-12T01:11:40.510222+0000","last_active":"2024-09-12T01:11:40.510222+0000","last_peered":"2024-09-12T01:11:40.510222+0000","last_clean":"2024-09-12T01:11:40.510222+0000","last_became_active":"2024-09-12T00:27:42.837170+0000","last_became_peered":"2024-09-12T00:27:42.837170+0000","last_unstale":"2024-09-12T01:11:40.510222+0000","last_undegraded":"2024-09-12T01:11:40.510222+0000","last_fullsized":"2024-09-12T01:11:40.510222+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'27","last_scrub_stamp":"2024-09-12T01:11:40.510104+0000","last_deep_scrub":"263'27","last_deep_scrub_stamp":"2024-09-12T01:11:40.510104+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.510104+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:28.001902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":97,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.056429+0000","last_change":"2024-09-12T00:46:54.885456+0000","last_active":"2024-09-12T01:09:00.056429+0000","last_peered":"2024-09-12T01:09:00.056429+0000","last_clean":"2024-09-12T01:09:00.056429+0000","last_became_active":"2024-09-12T00:46:54.885170+0000","last_became_peered":"2024-09-12T00:46:54.885170+0000","last_unstale":"2024-09-12T01:09:00.056429+0000","last_undegraded":"2024-09-12T01:09:00.056429+0000","last_fullsized":"2024-09-12T01:09:00.056429+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:22.660312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.296107+0000","last_change":"2024-09-12T01:11:38.296054+0000","last_active":"2024-09-12T01:11:38.296107+0000","last_peered":"2024-09-12T01:11:38.296107+0000","last_clean":"2024-09-12T01:11:38.296107+0000","last_became_active":"2024-09-12T00:30:17.765167+0000","last_became_peered":"2024-09-12T00:30:17.765167+0000","last_unstale":"2024-09-12T01:11:38.296107+0000","last_undegraded":"2024-09-12T01:11:38.296107+0000","last_fullsized":"2024-09-12T01:11:38.296107+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:38.295957+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:38.295957+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.295957+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:18.827609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6715,"num_write":6,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:58.053671+0000","last_change":"2024-09-12T00:30:14.742908+0000","last_active":"2024-09-12T01:08:58.053671+0000","last_peered":"2024-09-12T01:08:58.053671+0000","last_clean":"2024-09-12T01:08:58.053671+0000","last_became_active":"2024-09-12T00:30:14.742625+0000","last_became_peered":"2024-09-12T00:30:14.742625+0000","last_unstale":"2024-09-12T01:08:58.053671+0000","last_undegraded":"2024-09-12T01:08:58.053671+0000","last_fullsized":"2024-09-12T01:08:58.053671+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.508432+0000","last_change":"2024-09-12T01:11:37.508432+0000","last_active":"2024-09-12T01:11:37.508432+0000","last_peered":"2024-09-12T01:11:37.508432+0000","last_clean":"2024-09-12T01:11:37.508432+0000","last_became_active":"2024-09-12T00:27:42.845406+0000","last_became_peered":"2024-09-12T00:27:42.845406+0000","last_unstale":"2024-09-12T01:11:37.508432+0000","last_undegraded":"2024-09-12T01:11:37.508432+0000","last_fullsized":"2024-09-12T01:11:37.508432+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-12T01:11:37.508351+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-12T01:11:37.508351+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.508351+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:13.033508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":45,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.044551+0000","last_change":"2024-09-12T00:46:54.877914+0000","last_active":"2024-09-12T01:07:45.044551+0000","last_peered":"2024-09-12T01:07:45.044551+0000","last_clean":"2024-09-12T01:07:45.044551+0000","last_became_active":"2024-09-12T00:46:54.876219+0000","last_became_peered":"2024-09-12T00:46:54.876219+0000","last_unstale":"2024-09-12T01:07:45.044551+0000","last_undegraded":"2024-09-12T01:07:45.044551+0000","last_fullsized":"2024-09-12T01:07:45.044551+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:46.030061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.166748+0000","last_change":"2024-09-12T00:30:17.763491+0000","last_active":"2024-09-12T01:10:59.166748+0000","last_peered":"2024-09-12T01:10:59.166748+0000","last_clean":"2024-09-12T01:10:59.166748+0000","last_became_active":"2024-09-12T00:30:17.762792+0000","last_became_peered":"2024-09-12T00:30:17.762792+0000","last_unstale":"2024-09-12T01:10:59.166748+0000","last_undegraded":"2024-09-12T01:10:59.166748+0000","last_fullsized":"2024-09-12T01:10:59.166748+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.164283+0000","last_change":"2024-09-12T00:30:14.745747+0000","last_active":"2024-09-12T01:11:00.164283+0000","last_peered":"2024-09-12T01:11:00.164283+0000","last_clean":"2024-09-12T01:11:00.164283+0000","last_became_active":"2024-09-12T00:30:14.745328+0000","last_became_peered":"2024-09-12T00:30:14.745328+0000","last_unstale":"2024-09-12T01:11:00.164283+0000","last_undegraded":"2024-09-12T01:11:00.164283+0000","last_fullsized":"2024-09-12T01:11:00.164283+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'29","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.240542+0000","last_change":"2024-09-12T01:11:37.240542+0000","last_active":"2024-09-12T01:11:37.240542+0000","last_peered":"2024-09-12T01:11:37.240542+0000","last_clean":"2024-09-12T01:11:37.240542+0000","last_became_active":"2024-09-12T00:27:42.843745+0000","last_became_peered":"2024-09-12T00:27:42.843745+0000","last_unstale":"2024-09-12T01:11:37.240542+0000","last_undegraded":"2024-09-12T01:11:37.240542+0000","last_fullsized":"2024-09-12T01:11:37.240542+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-12T01:11:37.240457+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-12T01:11:37.240457+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.240457+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:02.545550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":101,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:06:55.129245+0000","last_change":"2024-09-12T00:46:54.889308+0000","last_active":"2024-09-12T01:06:55.129245+0000","last_peered":"2024-09-12T01:06:55.129245+0000","last_clean":"2024-09-12T01:06:55.129245+0000","last_became_active":"2024-09-12T00:46:54.889006+0000","last_became_peered":"2024-09-12T00:46:54.889006+0000","last_unstale":"2024-09-12T01:06:55.129245+0000","last_undegraded":"2024-09-12T01:06:55.129245+0000","last_fullsized":"2024-09-12T01:06:55.129245+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:09.749976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'11","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.205260+0000","last_change":"2024-09-12T01:11:44.205260+0000","last_active":"2024-09-12T01:11:44.205260+0000","last_peered":"2024-09-12T01:11:44.205260+0000","last_clean":"2024-09-12T01:11:44.205260+0000","last_became_active":"2024-09-12T00:30:17.759198+0000","last_became_peered":"2024-09-12T00:30:17.759198+0000","last_unstale":"2024-09-12T01:11:44.205260+0000","last_undegraded":"2024-09-12T01:11:44.205260+0000","last_fullsized":"2024-09-12T01:11:44.205260+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T01:11:44.205174+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T01:11:44.205174+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.205174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:56.063872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9336,"num_write":16,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.247614+0000","last_change":"2024-09-12T01:11:34.247614+0000","last_active":"2024-09-12T01:11:34.247614+0000","last_peered":"2024-09-12T01:11:34.247614+0000","last_clean":"2024-09-12T01:11:34.247614+0000","last_became_active":"2024-09-12T00:30:14.750004+0000","last_became_peered":"2024-09-12T00:30:14.750004+0000","last_unstale":"2024-09-12T01:11:34.247614+0000","last_undegraded":"2024-09-12T01:11:34.247614+0000","last_fullsized":"2024-09-12T01:11:34.247614+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:11:34.247482+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:11:34.247482+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.247482+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:38.785894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'18","reported_seq":102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.661226+0000","last_change":"2024-09-12T01:11:37.661226+0000","last_active":"2024-09-12T01:11:37.661226+0000","last_peered":"2024-09-12T01:11:37.661226+0000","last_clean":"2024-09-12T01:11:37.661226+0000","last_became_active":"2024-09-12T00:27:42.835530+0000","last_became_peered":"2024-09-12T00:27:42.835530+0000","last_unstale":"2024-09-12T01:11:37.661226+0000","last_undegraded":"2024-09-12T01:11:37.661226+0000","last_fullsized":"2024-09-12T01:11:37.661226+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'18","last_scrub_stamp":"2024-09-12T01:11:37.661105+0000","last_deep_scrub":"263'18","last_deep_scrub_stamp":"2024-09-12T01:11:37.661105+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.661105+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:17.820227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":30,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.195193+0000","last_change":"2024-09-12T01:11:44.195193+0000","last_active":"2024-09-12T01:11:44.195193+0000","last_peered":"2024-09-12T01:11:44.195193+0000","last_clean":"2024-09-12T01:11:44.195193+0000","last_became_active":"2024-09-12T00:46:54.882946+0000","last_became_peered":"2024-09-12T00:46:54.882946+0000","last_unstale":"2024-09-12T01:11:44.195193+0000","last_undegraded":"2024-09-12T01:11:44.195193+0000","last_fullsized":"2024-09-12T01:11:44.195193+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.195091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.195091+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.195091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:18.277306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"260'4","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045398+0000","last_change":"2024-09-12T00:30:17.766684+0000","last_active":"2024-09-12T01:07:50.045398+0000","last_peered":"2024-09-12T01:07:50.045398+0000","last_clean":"2024-09-12T01:07:50.045398+0000","last_became_active":"2024-09-12T00:30:17.763733+0000","last_became_peered":"2024-09-12T00:30:17.763733+0000","last_unstale":"2024-09-12T01:07:50.045398+0000","last_undegraded":"2024-09-12T01:07:50.045398+0000","last_fullsized":"2024-09-12T01:07:50.045398+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:45.175363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.460827+0000","last_change":"2024-09-12T01:11:43.460827+0000","last_active":"2024-09-12T01:11:43.460827+0000","last_peered":"2024-09-12T01:11:43.460827+0000","last_clean":"2024-09-12T01:11:43.460827+0000","last_became_active":"2024-09-12T00:30:14.748462+0000","last_became_peered":"2024-09-12T00:30:14.748462+0000","last_unstale":"2024-09-12T01:11:43.460827+0000","last_undegraded":"2024-09-12T01:11:43.460827+0000","last_fullsized":"2024-09-12T01:11:43.460827+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:11:43.460734+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:11:43.460734+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.460734+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:09.879424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'17","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.459328+0000","last_change":"2024-09-12T01:11:36.459328+0000","last_active":"2024-09-12T01:11:36.459328+0000","last_peered":"2024-09-12T01:11:36.459328+0000","last_clean":"2024-09-12T01:11:36.459328+0000","last_became_active":"2024-09-12T00:27:42.838896+0000","last_became_peered":"2024-09-12T00:27:42.838896+0000","last_unstale":"2024-09-12T01:11:36.459328+0000","last_undegraded":"2024-09-12T01:11:36.459328+0000","last_fullsized":"2024-09-12T01:11:36.459328+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'17","last_scrub_stamp":"2024-09-12T01:11:36.459214+0000","last_deep_scrub":"263'17","last_deep_scrub_stamp":"2024-09-12T01:11:36.459214+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.459214+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:24.519710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:58.044373+0000","last_change":"2024-09-12T00:46:54.885744+0000","last_active":"2024-09-12T01:07:58.044373+0000","last_peered":"2024-09-12T01:07:58.044373+0000","last_clean":"2024-09-12T01:07:58.044373+0000","last_became_active":"2024-09-12T00:46:54.885457+0000","last_became_peered":"2024-09-12T00:46:54.885457+0000","last_unstale":"2024-09-12T01:07:58.044373+0000","last_undegraded":"2024-09-12T01:07:58.044373+0000","last_fullsized":"2024-09-12T01:07:58.044373+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:36.235325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"260'4","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.056383+0000","last_change":"2024-09-12T00:30:17.765481+0000","last_active":"2024-09-12T01:09:00.056383+0000","last_peered":"2024-09-12T01:09:00.056383+0000","last_clean":"2024-09-12T01:09:00.056383+0000","last_became_active":"2024-09-12T00:30:17.765149+0000","last_became_peered":"2024-09-12T00:30:17.765149+0000","last_unstale":"2024-09-12T01:09:00.056383+0000","last_undegraded":"2024-09-12T01:09:00.056383+0000","last_fullsized":"2024-09-12T01:09:00.056383+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041690+0000","last_change":"2024-09-12T00:30:14.740879+0000","last_active":"2024-09-12T01:07:45.041690+0000","last_peered":"2024-09-12T01:07:45.041690+0000","last_clean":"2024-09-12T01:07:45.041690+0000","last_became_active":"2024-09-12T00:30:14.740516+0000","last_became_peered":"2024-09-12T00:30:14.740516+0000","last_unstale":"2024-09-12T01:07:45.041690+0000","last_undegraded":"2024-09-12T01:07:45.041690+0000","last_fullsized":"2024-09-12T01:07:45.041690+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:43.135121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'20","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.054951+0000","last_change":"2024-09-12T00:27:42.841806+0000","last_active":"2024-09-12T01:08:50.054951+0000","last_peered":"2024-09-12T01:08:50.054951+0000","last_clean":"2024-09-12T01:08:50.054951+0000","last_became_active":"2024-09-12T00:27:42.840919+0000","last_became_peered":"2024-09-12T00:27:42.840919+0000","last_unstale":"2024-09-12T01:08:50.054951+0000","last_undegraded":"2024-09-12T01:08:50.054951+0000","last_fullsized":"2024-09-12T01:08:50.054951+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":83,"num_write":31,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.162301+0000","last_change":"2024-09-12T00:46:54.887403+0000","last_active":"2024-09-12T01:07:55.162301+0000","last_peered":"2024-09-12T01:07:55.162301+0000","last_clean":"2024-09-12T01:07:55.162301+0000","last_became_active":"2024-09-12T00:46:54.887134+0000","last_became_peered":"2024-09-12T00:46:54.887134+0000","last_unstale":"2024-09-12T01:07:55.162301+0000","last_undegraded":"2024-09-12T01:07:55.162301+0000","last_fullsized":"2024-09-12T01:07:55.162301+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:13.379263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'9","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.166881+0000","last_change":"2024-09-12T00:30:17.766525+0000","last_active":"2024-09-12T01:10:59.166881+0000","last_peered":"2024-09-12T01:10:59.166881+0000","last_clean":"2024-09-12T01:10:59.166881+0000","last_became_active":"2024-09-12T00:30:17.766203+0000","last_became_peered":"2024-09-12T00:30:17.766203+0000","last_unstale":"2024-09-12T01:10:59.166881+0000","last_undegraded":"2024-09-12T01:10:59.166881+0000","last_fullsized":"2024-09-12T01:10:59.166881+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:51.225523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13412,"num_write":14,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.236429+0000","last_change":"2024-09-12T01:11:33.236429+0000","last_active":"2024-09-12T01:11:33.236429+0000","last_peered":"2024-09-12T01:11:33.236429+0000","last_clean":"2024-09-12T01:11:33.236429+0000","last_became_active":"2024-09-12T00:30:14.746119+0000","last_became_peered":"2024-09-12T00:30:14.746119+0000","last_unstale":"2024-09-12T01:11:33.236429+0000","last_undegraded":"2024-09-12T01:11:33.236429+0000","last_fullsized":"2024-09-12T01:11:33.236429+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.236340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.236340+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.236340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:17.037415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'39","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.429235+0000","last_change":"2024-09-12T01:11:42.429235+0000","last_active":"2024-09-12T01:11:42.429235+0000","last_peered":"2024-09-12T01:11:42.429235+0000","last_clean":"2024-09-12T01:11:42.429235+0000","last_became_active":"2024-09-12T00:27:42.846198+0000","last_became_peered":"2024-09-12T00:27:42.846198+0000","last_unstale":"2024-09-12T01:11:42.429235+0000","last_undegraded":"2024-09-12T01:11:42.429235+0000","last_fullsized":"2024-09-12T01:11:42.429235+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-09-12T01:11:42.429137+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-09-12T01:11:42.429137+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.429137+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:15.211546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":138,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:55.135933+0000","last_change":"2024-09-12T00:46:54.886148+0000","last_active":"2024-09-12T01:07:55.135933+0000","last_peered":"2024-09-12T01:07:55.135933+0000","last_clean":"2024-09-12T01:07:55.135933+0000","last_became_active":"2024-09-12T00:46:54.885879+0000","last_became_peered":"2024-09-12T00:46:54.885879+0000","last_unstale":"2024-09-12T01:07:55.135933+0000","last_undegraded":"2024-09-12T01:07:55.135933+0000","last_fullsized":"2024-09-12T01:07:55.135933+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:12.855547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"260'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:00.056483+0000","last_change":"2024-09-12T00:30:17.769299+0000","last_active":"2024-09-12T01:09:00.056483+0000","last_peered":"2024-09-12T01:09:00.056483+0000","last_clean":"2024-09-12T01:09:00.056483+0000","last_became_active":"2024-09-12T00:30:17.769051+0000","last_became_peered":"2024-09-12T00:30:17.769051+0000","last_unstale":"2024-09-12T01:09:00.056483+0000","last_undegraded":"2024-09-12T01:09:00.056483+0000","last_fullsized":"2024-09-12T01:09:00.056483+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'8","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.290293+0000","last_change":"2024-09-12T00:30:14.743361+0000","last_active":"2024-09-12T01:10:59.290293+0000","last_peered":"2024-09-12T01:10:59.290293+0000","last_clean":"2024-09-12T01:10:59.290293+0000","last_became_active":"2024-09-12T00:30:14.743083+0000","last_became_peered":"2024-09-12T00:30:14.743083+0000","last_unstale":"2024-09-12T01:10:59.290293+0000","last_undegraded":"2024-09-12T01:10:59.290293+0000","last_fullsized":"2024-09-12T01:10:59.290293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.647382+0000","last_change":"2024-09-12T01:11:35.647382+0000","last_active":"2024-09-12T01:11:35.647382+0000","last_peered":"2024-09-12T01:11:35.647382+0000","last_clean":"2024-09-12T01:11:35.647382+0000","last_became_active":"2024-09-12T00:27:42.839063+0000","last_became_peered":"2024-09-12T00:27:42.839063+0000","last_unstale":"2024-09-12T01:11:35.647382+0000","last_undegraded":"2024-09-12T01:11:35.647382+0000","last_fullsized":"2024-09-12T01:11:35.647382+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-12T01:11:35.647295+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-12T01:11:35.647295+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.647295+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:24.914272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":119,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.251140+0000","last_change":"2024-09-12T01:11:41.251140+0000","last_active":"2024-09-12T01:11:41.251140+0000","last_peered":"2024-09-12T01:11:41.251140+0000","last_clean":"2024-09-12T01:11:41.251140+0000","last_became_active":"2024-09-12T00:46:54.887450+0000","last_became_peered":"2024-09-12T00:46:54.887450+0000","last_unstale":"2024-09-12T01:11:41.251140+0000","last_undegraded":"2024-09-12T01:11:41.251140+0000","last_fullsized":"2024-09-12T01:11:41.251140+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:41.251052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:41.251052+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.251052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:57.971441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.265271+0000","last_change":"2024-09-12T01:11:36.265271+0000","last_active":"2024-09-12T01:11:36.265271+0000","last_peered":"2024-09-12T01:11:36.265271+0000","last_clean":"2024-09-12T01:11:36.265271+0000","last_became_active":"2024-09-12T00:30:17.756342+0000","last_became_peered":"2024-09-12T00:30:17.756342+0000","last_unstale":"2024-09-12T01:11:36.265271+0000","last_undegraded":"2024-09-12T01:11:36.265271+0000","last_fullsized":"2024-09-12T01:11:36.265271+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T01:11:36.265182+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T01:11:36.265182+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.265182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:21.472602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.162339+0000","last_change":"2024-09-12T00:30:14.748689+0000","last_active":"2024-09-12T01:11:00.162339+0000","last_peered":"2024-09-12T01:11:00.162339+0000","last_clean":"2024-09-12T01:11:00.162339+0000","last_became_active":"2024-09-12T00:30:14.748446+0000","last_became_peered":"2024-09-12T00:30:14.748446+0000","last_unstale":"2024-09-12T01:11:00.162339+0000","last_undegraded":"2024-09-12T01:11:00.162339+0000","last_fullsized":"2024-09-12T01:11:00.162339+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'23","reported_seq":106,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:35.040482+0000","last_change":"2024-09-12T00:27:42.845645+0000","last_active":"2024-09-12T01:07:35.040482+0000","last_peered":"2024-09-12T01:07:35.040482+0000","last_clean":"2024-09-12T01:07:35.040482+0000","last_became_active":"2024-09-12T00:27:42.845379+0000","last_became_peered":"2024-09-12T00:27:42.845379+0000","last_unstale":"2024-09-12T01:07:35.040482+0000","last_undegraded":"2024-09-12T01:07:35.040482+0000","last_fullsized":"2024-09-12T01:07:35.040482+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:35.854841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:43.051253+0000","last_change":"2024-09-12T00:46:54.884019+0000","last_active":"2024-09-12T01:08:43.051253+0000","last_peered":"2024-09-12T01:08:43.051253+0000","last_clean":"2024-09-12T01:08:43.051253+0000","last_became_active":"2024-09-12T00:46:54.883713+0000","last_became_peered":"2024-09-12T00:46:54.883713+0000","last_unstale":"2024-09-12T01:08:43.051253+0000","last_undegraded":"2024-09-12T01:08:43.051253+0000","last_fullsized":"2024-09-12T01:08:43.051253+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'7","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:58.062838+0000","last_change":"2024-09-12T00:30:17.764514+0000","last_active":"2024-09-12T01:09:58.062838+0000","last_peered":"2024-09-12T01:09:58.062838+0000","last_clean":"2024-09-12T01:09:58.062838+0000","last_became_active":"2024-09-12T00:30:17.764165+0000","last_became_peered":"2024-09-12T00:30:17.764165+0000","last_unstale":"2024-09-12T01:09:58.062838+0000","last_undegraded":"2024-09-12T01:09:58.062838+0000","last_fullsized":"2024-09-12T01:09:58.062838+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:16.348051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.346199+0000","last_change":"2024-09-12T01:11:38.346199+0000","last_active":"2024-09-12T01:11:38.346199+0000","last_peered":"2024-09-12T01:11:38.346199+0000","last_clean":"2024-09-12T01:11:38.346199+0000","last_became_active":"2024-09-12T00:30:14.747184+0000","last_became_peered":"2024-09-12T00:30:14.747184+0000","last_unstale":"2024-09-12T01:11:38.346199+0000","last_undegraded":"2024-09-12T01:11:38.346199+0000","last_fullsized":"2024-09-12T01:11:38.346199+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:11:38.346116+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:11:38.346116+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.346116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:57.130618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'76","reported_seq":299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:25.039285+0000","last_change":"2024-09-12T00:27:42.846397+0000","last_active":"2024-09-12T01:07:25.039285+0000","last_peered":"2024-09-12T01:07:25.039285+0000","last_clean":"2024-09-12T01:07:25.039285+0000","last_became_active":"2024-09-12T00:27:42.846108+0000","last_became_peered":"2024-09-12T00:27:42.846108+0000","last_unstale":"2024-09-12T01:07:25.039285+0000","last_undegraded":"2024-09-12T01:07:25.039285+0000","last_fullsized":"2024-09-12T01:07:25.039285+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:11.395534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":337,"num_write":98,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.170367+0000","last_change":"2024-09-12T00:46:54.889757+0000","last_active":"2024-09-12T01:08:40.170367+0000","last_peered":"2024-09-12T01:08:40.170367+0000","last_clean":"2024-09-12T01:08:40.170367+0000","last_became_active":"2024-09-12T00:46:54.889496+0000","last_became_peered":"2024-09-12T00:46:54.889496+0000","last_unstale":"2024-09-12T01:08:40.170367+0000","last_undegraded":"2024-09-12T01:08:40.170367+0000","last_fullsized":"2024-09-12T01:08:40.170367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:28.265877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:38.041215+0000","last_change":"2024-09-12T00:30:17.767918+0000","last_active":"2024-09-12T01:07:38.041215+0000","last_peered":"2024-09-12T01:07:38.041215+0000","last_clean":"2024-09-12T01:07:38.041215+0000","last_became_active":"2024-09-12T00:30:17.767526+0000","last_became_peered":"2024-09-12T00:30:17.767526+0000","last_unstale":"2024-09-12T01:07:38.041215+0000","last_undegraded":"2024-09-12T01:07:38.041215+0000","last_fullsized":"2024-09-12T01:07:38.041215+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:28.500175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'5","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:58.062808+0000","last_change":"2024-09-12T00:30:14.749360+0000","last_active":"2024-09-12T01:09:58.062808+0000","last_peered":"2024-09-12T01:09:58.062808+0000","last_clean":"2024-09-12T01:09:58.062808+0000","last_became_active":"2024-09-12T00:30:14.749104+0000","last_became_peered":"2024-09-12T00:30:14.749104+0000","last_unstale":"2024-09-12T01:09:58.062808+0000","last_undegraded":"2024-09-12T01:09:58.062808+0000","last_fullsized":"2024-09-12T01:09:58.062808+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:33.044875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'28","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.688493+0000","last_change":"2024-09-12T01:11:34.688493+0000","last_active":"2024-09-12T01:11:34.688493+0000","last_peered":"2024-09-12T01:11:34.688493+0000","last_clean":"2024-09-12T01:11:34.688493+0000","last_became_active":"2024-09-12T00:27:42.840749+0000","last_became_peered":"2024-09-12T00:27:42.840749+0000","last_unstale":"2024-09-12T01:11:34.688493+0000","last_undegraded":"2024-09-12T01:11:34.688493+0000","last_fullsized":"2024-09-12T01:11:34.688493+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-12T01:11:34.688404+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-12T01:11:34.688404+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.688404+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:36.384869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":101,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:00.046768+0000","last_change":"2024-09-12T00:46:54.876242+0000","last_active":"2024-09-12T01:08:00.046768+0000","last_peered":"2024-09-12T01:08:00.046768+0000","last_clean":"2024-09-12T01:08:00.046768+0000","last_became_active":"2024-09-12T00:46:54.875939+0000","last_became_peered":"2024-09-12T00:46:54.875939+0000","last_unstale":"2024-09-12T01:08:00.046768+0000","last_undegraded":"2024-09-12T01:08:00.046768+0000","last_fullsized":"2024-09-12T01:08:00.046768+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:39.634295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":36,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:40.043775+0000","last_change":"2024-09-12T00:30:17.761490+0000","last_active":"2024-09-12T01:07:40.043775+0000","last_peered":"2024-09-12T01:07:40.043775+0000","last_clean":"2024-09-12T01:07:40.043775+0000","last_became_active":"2024-09-12T00:30:17.761182+0000","last_became_peered":"2024-09-12T00:30:17.761182+0000","last_unstale":"2024-09-12T01:07:40.043775+0000","last_undegraded":"2024-09-12T01:07:40.043775+0000","last_fullsized":"2024-09-12T01:07:40.043775+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:42.070821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.209970+0000","last_change":"2024-09-12T01:11:43.209970+0000","last_active":"2024-09-12T01:11:43.209970+0000","last_peered":"2024-09-12T01:11:43.209970+0000","last_clean":"2024-09-12T01:11:43.209970+0000","last_became_active":"2024-09-12T00:30:14.747887+0000","last_became_peered":"2024-09-12T00:30:14.747887+0000","last_unstale":"2024-09-12T01:11:43.209970+0000","last_undegraded":"2024-09-12T01:11:43.209970+0000","last_fullsized":"2024-09-12T01:11:43.209970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:11:43.209850+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:11:43.209850+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.209850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:12.023552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'77","reported_seq":321,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.256919+0000","last_change":"2024-09-12T01:11:36.256919+0000","last_active":"2024-09-12T01:11:36.256919+0000","last_peered":"2024-09-12T01:11:36.256919+0000","last_clean":"2024-09-12T01:11:36.256919+0000","last_became_active":"2024-09-12T00:27:42.839295+0000","last_became_peered":"2024-09-12T00:27:42.839295+0000","last_unstale":"2024-09-12T01:11:36.256919+0000","last_undegraded":"2024-09-12T01:11:36.256919+0000","last_fullsized":"2024-09-12T01:11:36.256919+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'77","last_scrub_stamp":"2024-09-12T01:11:36.256834+0000","last_deep_scrub":"263'77","last_deep_scrub_stamp":"2024-09-12T01:11:36.256834+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.256834+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:36.670777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":349,"num_write":102,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3012,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:40.170341+0000","last_change":"2024-09-12T00:46:54.881248+0000","last_active":"2024-09-12T01:08:40.170341+0000","last_peered":"2024-09-12T01:08:40.170341+0000","last_clean":"2024-09-12T01:08:40.170341+0000","last_became_active":"2024-09-12T00:46:54.880982+0000","last_became_peered":"2024-09-12T00:46:54.880982+0000","last_unstale":"2024-09-12T01:08:40.170341+0000","last_undegraded":"2024-09-12T01:08:40.170341+0000","last_fullsized":"2024-09-12T01:08:40.170341+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:32.451032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"263'2","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:00.057885+0000","last_change":"2024-09-12T00:30:17.766356+0000","last_active":"2024-09-12T01:10:00.057885+0000","last_peered":"2024-09-12T01:10:00.057885+0000","last_clean":"2024-09-12T01:10:00.057885+0000","last_became_active":"2024-09-12T00:30:17.765384+0000","last_became_peered":"2024-09-12T00:30:17.765384+0000","last_unstale":"2024-09-12T01:10:00.057885+0000","last_undegraded":"2024-09-12T01:10:00.057885+0000","last_fullsized":"2024-09-12T01:10:00.057885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:48.714095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.333996+0000","last_change":"2024-09-12T01:11:39.333996+0000","last_active":"2024-09-12T01:11:39.333996+0000","last_peered":"2024-09-12T01:11:39.333996+0000","last_clean":"2024-09-12T01:11:39.333996+0000","last_became_active":"2024-09-12T00:30:14.750407+0000","last_became_peered":"2024-09-12T00:30:14.750407+0000","last_unstale":"2024-09-12T01:11:39.333996+0000","last_undegraded":"2024-09-12T01:11:39.333996+0000","last_fullsized":"2024-09-12T01:11:39.333996+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:39.333911+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:39.333911+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.333911+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:53.757755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5691,"num_write":6,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'35","reported_seq":154,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.660661+0000","last_change":"2024-09-12T01:11:33.660661+0000","last_active":"2024-09-12T01:11:33.660661+0000","last_peered":"2024-09-12T01:11:33.660661+0000","last_clean":"2024-09-12T01:11:33.660661+0000","last_became_active":"2024-09-12T00:27:42.840137+0000","last_became_peered":"2024-09-12T00:27:42.840137+0000","last_unstale":"2024-09-12T01:11:33.660661+0000","last_undegraded":"2024-09-12T01:11:33.660661+0000","last_fullsized":"2024-09-12T01:11:33.660661+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'35","last_scrub_stamp":"2024-09-12T01:11:33.660566+0000","last_deep_scrub":"263'35","last_deep_scrub_stamp":"2024-09-12T01:11:33.660566+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.660566+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:21.665420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":59,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:43.051166+0000","last_change":"2024-09-12T00:46:54.888517+0000","last_active":"2024-09-12T01:08:43.051166+0000","last_peered":"2024-09-12T01:08:43.051166+0000","last_clean":"2024-09-12T01:08:43.051166+0000","last_became_active":"2024-09-12T00:46:54.888207+0000","last_became_peered":"2024-09-12T00:46:54.888207+0000","last_unstale":"2024-09-12T01:08:43.051166+0000","last_undegraded":"2024-09-12T01:08:43.051166+0000","last_fullsized":"2024-09-12T01:08:43.051166+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:38.971555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'7","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.166733+0000","last_change":"2024-09-12T00:30:17.763396+0000","last_active":"2024-09-12T01:10:59.166733+0000","last_peered":"2024-09-12T01:10:59.166733+0000","last_clean":"2024-09-12T01:10:59.166733+0000","last_became_active":"2024-09-12T00:30:17.763106+0000","last_became_peered":"2024-09-12T00:30:17.763106+0000","last_unstale":"2024-09-12T01:10:59.166733+0000","last_undegraded":"2024-09-12T01:10:59.166733+0000","last_fullsized":"2024-09-12T01:10:59.166733+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:48.609847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.250694+0000","last_change":"2024-09-12T01:11:40.250694+0000","last_active":"2024-09-12T01:11:40.250694+0000","last_peered":"2024-09-12T01:11:40.250694+0000","last_clean":"2024-09-12T01:11:40.250694+0000","last_became_active":"2024-09-12T00:30:14.746069+0000","last_became_peered":"2024-09-12T00:30:14.746069+0000","last_unstale":"2024-09-12T01:11:40.250694+0000","last_undegraded":"2024-09-12T01:11:40.250694+0000","last_fullsized":"2024-09-12T01:11:40.250694+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:11:40.250607+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:11:40.250607+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.250607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:41.014709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'41","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.656174+0000","last_change":"2024-09-12T01:11:32.656174+0000","last_active":"2024-09-12T01:11:32.656174+0000","last_peered":"2024-09-12T01:11:32.656174+0000","last_clean":"2024-09-12T01:11:32.656174+0000","last_became_active":"2024-09-12T00:27:42.841530+0000","last_became_peered":"2024-09-12T00:27:42.841530+0000","last_unstale":"2024-09-12T01:11:32.656174+0000","last_undegraded":"2024-09-12T01:11:32.656174+0000","last_fullsized":"2024-09-12T01:11:32.656174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:11:32.656093+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:11:32.656093+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.656093+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:14.450082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.222599+0000","last_change":"2024-09-12T01:11:44.222599+0000","last_active":"2024-09-12T01:11:44.222599+0000","last_peered":"2024-09-12T01:11:44.222599+0000","last_clean":"2024-09-12T01:11:44.222599+0000","last_became_active":"2024-09-12T00:46:54.885842+0000","last_became_peered":"2024-09-12T00:46:54.885842+0000","last_unstale":"2024-09-12T01:11:44.222599+0000","last_undegraded":"2024-09-12T01:11:44.222599+0000","last_fullsized":"2024-09-12T01:11:44.222599+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.222520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.222520+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.222520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:58.261245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.584161+0000","last_change":"2024-09-12T01:11:43.584161+0000","last_active":"2024-09-12T01:11:43.584161+0000","last_peered":"2024-09-12T01:11:43.584161+0000","last_clean":"2024-09-12T01:11:43.584161+0000","last_became_active":"2024-09-12T00:30:17.765404+0000","last_became_peered":"2024-09-12T00:30:17.765404+0000","last_unstale":"2024-09-12T01:11:43.584161+0000","last_undegraded":"2024-09-12T01:11:43.584161+0000","last_fullsized":"2024-09-12T01:11:43.584161+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-12T01:11:43.584062+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-12T01:11:43.584062+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.584062+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:01.084763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.465660+0000","last_change":"2024-09-12T01:11:44.465660+0000","last_active":"2024-09-12T01:11:44.465660+0000","last_peered":"2024-09-12T01:11:44.465660+0000","last_clean":"2024-09-12T01:11:44.465660+0000","last_became_active":"2024-09-12T00:30:14.743148+0000","last_became_peered":"2024-09-12T00:30:14.743148+0000","last_unstale":"2024-09-12T01:11:44.465660+0000","last_undegraded":"2024-09-12T01:11:44.465660+0000","last_fullsized":"2024-09-12T01:11:44.465660+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.465571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.465571+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.465571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:28.615096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'37","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:15.045203+0000","last_change":"2024-09-12T00:27:42.846410+0000","last_active":"2024-09-12T01:08:15.045203+0000","last_peered":"2024-09-12T01:08:15.045203+0000","last_clean":"2024-09-12T01:08:15.045203+0000","last_became_active":"2024-09-12T00:27:42.846090+0000","last_became_peered":"2024-09-12T00:27:42.846090+0000","last_unstale":"2024-09-12T01:08:15.045203+0000","last_undegraded":"2024-09-12T01:08:15.045203+0000","last_fullsized":"2024-09-12T01:08:15.045203+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:24.133207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":132,"num_write":69,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.047409+0000","last_change":"2024-09-12T00:46:54.883396+0000","last_active":"2024-09-12T01:08:35.047409+0000","last_peered":"2024-09-12T01:08:35.047409+0000","last_clean":"2024-09-12T01:08:35.047409+0000","last_became_active":"2024-09-12T00:46:54.883024+0000","last_became_peered":"2024-09-12T00:46:54.883024+0000","last_unstale":"2024-09-12T01:08:35.047409+0000","last_undegraded":"2024-09-12T01:08:35.047409+0000","last_fullsized":"2024-09-12T01:08:35.047409+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:27.222440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.608595+0000","last_change":"2024-09-12T01:11:44.608595+0000","last_active":"2024-09-12T01:11:44.608595+0000","last_peered":"2024-09-12T01:11:44.608595+0000","last_clean":"2024-09-12T01:11:44.608595+0000","last_became_active":"2024-09-12T00:30:17.769226+0000","last_became_peered":"2024-09-12T00:30:17.769226+0000","last_unstale":"2024-09-12T01:11:44.608595+0000","last_undegraded":"2024-09-12T01:11:44.608595+0000","last_fullsized":"2024-09-12T01:11:44.608595+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:44.608500+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:44.608500+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.608500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:47.547326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"260'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.586898+0000","last_change":"2024-09-12T01:11:41.586898+0000","last_active":"2024-09-12T01:11:41.586898+0000","last_peered":"2024-09-12T01:11:41.586898+0000","last_clean":"2024-09-12T01:11:41.586898+0000","last_became_active":"2024-09-12T00:30:14.740963+0000","last_became_peered":"2024-09-12T00:30:14.740963+0000","last_unstale":"2024-09-12T01:11:41.586898+0000","last_undegraded":"2024-09-12T01:11:41.586898+0000","last_fullsized":"2024-09-12T01:11:41.586898+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-12T01:11:41.586800+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-12T01:11:41.586800+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.586800+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:53.601971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.338328+0000","last_change":"2024-09-12T01:11:35.338328+0000","last_active":"2024-09-12T01:11:35.338328+0000","last_peered":"2024-09-12T01:11:35.338328+0000","last_clean":"2024-09-12T01:11:35.338328+0000","last_became_active":"2024-09-12T00:27:42.834942+0000","last_became_peered":"2024-09-12T00:27:42.834942+0000","last_unstale":"2024-09-12T01:11:35.338328+0000","last_undegraded":"2024-09-12T01:11:35.338328+0000","last_fullsized":"2024-09-12T01:11:35.338328+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-09-12T01:11:35.338210+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-09-12T01:11:35.338210+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.338210+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:15.421635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":105,"num_write":60,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.250915+0000","last_change":"2024-09-12T01:11:42.250915+0000","last_active":"2024-09-12T01:11:42.250915+0000","last_peered":"2024-09-12T01:11:42.250915+0000","last_clean":"2024-09-12T01:11:42.250915+0000","last_became_active":"2024-09-12T00:46:54.887303+0000","last_became_peered":"2024-09-12T00:46:54.887303+0000","last_unstale":"2024-09-12T01:11:42.250915+0000","last_undegraded":"2024-09-12T01:11:42.250915+0000","last_fullsized":"2024-09-12T01:11:42.250915+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:42.250816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:42.250816+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.250816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:51.359281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:48.070602+0000","last_change":"2024-09-12T00:30:17.768358+0000","last_active":"2024-09-12T01:10:48.070602+0000","last_peered":"2024-09-12T01:10:48.070602+0000","last_clean":"2024-09-12T01:10:48.070602+0000","last_became_active":"2024-09-12T00:30:17.768072+0000","last_became_peered":"2024-09-12T00:30:17.768072+0000","last_unstale":"2024-09-12T01:10:48.070602+0000","last_undegraded":"2024-09-12T01:10:48.070602+0000","last_fullsized":"2024-09-12T01:10:48.070602+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:13.328589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.624151+0000","last_change":"2024-09-12T01:11:40.624151+0000","last_active":"2024-09-12T01:11:40.624151+0000","last_peered":"2024-09-12T01:11:40.624151+0000","last_clean":"2024-09-12T01:11:40.624151+0000","last_became_active":"2024-09-12T00:30:14.744485+0000","last_became_peered":"2024-09-12T00:30:14.744485+0000","last_unstale":"2024-09-12T01:11:40.624151+0000","last_undegraded":"2024-09-12T01:11:40.624151+0000","last_fullsized":"2024-09-12T01:11:40.624151+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:40.624068+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:40.624068+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.624068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:32.466602+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'50","reported_seq":203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.515495+0000","last_change":"2024-09-12T01:11:39.515495+0000","last_active":"2024-09-12T01:11:39.515495+0000","last_peered":"2024-09-12T01:11:39.515495+0000","last_clean":"2024-09-12T01:11:39.515495+0000","last_became_active":"2024-09-12T00:27:42.838771+0000","last_became_peered":"2024-09-12T00:27:42.838771+0000","last_unstale":"2024-09-12T01:11:39.515495+0000","last_undegraded":"2024-09-12T01:11:39.515495+0000","last_fullsized":"2024-09-12T01:11:39.515495+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'50","last_scrub_stamp":"2024-09-12T01:11:39.515412+0000","last_deep_scrub":"263'50","last_deep_scrub_stamp":"2024-09-12T01:11:39.515412+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.515412+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:41.609350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":194,"num_write":94,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:28.058234+0000","last_change":"2024-09-12T00:46:54.884379+0000","last_active":"2024-09-12T01:09:28.058234+0000","last_peered":"2024-09-12T01:09:28.058234+0000","last_clean":"2024-09-12T01:09:28.058234+0000","last_became_active":"2024-09-12T00:46:54.883927+0000","last_became_peered":"2024-09-12T00:46:54.883927+0000","last_unstale":"2024-09-12T01:09:28.058234+0000","last_undegraded":"2024-09-12T01:09:28.058234+0000","last_fullsized":"2024-09-12T01:09:28.058234+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.099874+0000","last_change":"2024-09-12T00:30:17.761674+0000","last_active":"2024-09-12T01:11:00.099874+0000","last_peered":"2024-09-12T01:11:00.099874+0000","last_clean":"2024-09-12T01:11:00.099874+0000","last_became_active":"2024-09-12T00:30:17.761176+0000","last_became_peered":"2024-09-12T00:30:17.761176+0000","last_unstale":"2024-09-12T01:11:00.099874+0000","last_undegraded":"2024-09-12T01:11:00.099874+0000","last_fullsized":"2024-09-12T01:11:00.099874+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.692024+0000","last_change":"2024-09-12T01:11:38.692024+0000","last_active":"2024-09-12T01:11:38.692024+0000","last_peered":"2024-09-12T01:11:38.692024+0000","last_clean":"2024-09-12T01:11:38.692024+0000","last_became_active":"2024-09-12T00:30:14.743730+0000","last_became_peered":"2024-09-12T00:30:14.743730+0000","last_unstale":"2024-09-12T01:11:38.692024+0000","last_undegraded":"2024-09-12T01:11:38.692024+0000","last_fullsized":"2024-09-12T01:11:38.692024+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:38.691940+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:38.691940+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.691940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:44.095227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'40","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.437349+0000","last_change":"2024-09-12T01:11:35.437349+0000","last_active":"2024-09-12T01:11:35.437349+0000","last_peered":"2024-09-12T01:11:35.437349+0000","last_clean":"2024-09-12T01:11:35.437349+0000","last_became_active":"2024-09-12T00:27:42.842267+0000","last_became_peered":"2024-09-12T00:27:42.842267+0000","last_unstale":"2024-09-12T01:11:35.437349+0000","last_undegraded":"2024-09-12T01:11:35.437349+0000","last_fullsized":"2024-09-12T01:11:35.437349+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'40","last_scrub_stamp":"2024-09-12T01:11:35.437220+0000","last_deep_scrub":"263'40","last_deep_scrub_stamp":"2024-09-12T01:11:35.437220+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.437220+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:37.048393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":155,"num_write":62,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:30.147025+0000","last_change":"2024-09-12T00:46:54.889599+0000","last_active":"2024-09-12T01:09:30.147025+0000","last_peered":"2024-09-12T01:09:30.147025+0000","last_clean":"2024-09-12T01:09:30.147025+0000","last_became_active":"2024-09-12T00:46:54.889349+0000","last_became_peered":"2024-09-12T00:46:54.889349+0000","last_unstale":"2024-09-12T01:09:30.147025+0000","last_undegraded":"2024-09-12T01:09:30.147025+0000","last_fullsized":"2024-09-12T01:09:30.147025+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.243873+0000","last_change":"2024-09-12T01:11:43.243873+0000","last_active":"2024-09-12T01:11:43.243873+0000","last_peered":"2024-09-12T01:11:43.243873+0000","last_clean":"2024-09-12T01:11:43.243873+0000","last_became_active":"2024-09-12T00:30:17.759769+0000","last_became_peered":"2024-09-12T00:30:17.759769+0000","last_unstale":"2024-09-12T01:11:43.243873+0000","last_undegraded":"2024-09-12T01:11:43.243873+0000","last_fullsized":"2024-09-12T01:11:43.243873+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:43.243774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:43.243774+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.243774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.590615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:18.056778+0000","last_change":"2024-09-12T00:30:14.748668+0000","last_active":"2024-09-12T01:09:18.056778+0000","last_peered":"2024-09-12T01:09:18.056778+0000","last_clean":"2024-09-12T01:09:18.056778+0000","last_became_active":"2024-09-12T00:30:14.748409+0000","last_became_peered":"2024-09-12T00:30:14.748409+0000","last_unstale":"2024-09-12T01:09:18.056778+0000","last_undegraded":"2024-09-12T01:09:18.056778+0000","last_fullsized":"2024-09-12T01:09:18.056778+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'24","reported_seq":123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.292713+0000","last_change":"2024-09-12T01:11:35.292713+0000","last_active":"2024-09-12T01:11:35.292713+0000","last_peered":"2024-09-12T01:11:35.292713+0000","last_clean":"2024-09-12T01:11:35.292713+0000","last_became_active":"2024-09-12T00:27:42.844338+0000","last_became_peered":"2024-09-12T00:27:42.844338+0000","last_unstale":"2024-09-12T01:11:35.292713+0000","last_undegraded":"2024-09-12T01:11:35.292713+0000","last_fullsized":"2024-09-12T01:11:35.292713+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'24","last_scrub_stamp":"2024-09-12T01:11:35.292630+0000","last_deep_scrub":"263'24","last_deep_scrub_stamp":"2024-09-12T01:11:35.292630+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.292630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:02.205316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":85,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.232399+0000","last_change":"2024-09-12T01:11:43.232399+0000","last_active":"2024-09-12T01:11:43.232399+0000","last_peered":"2024-09-12T01:11:43.232399+0000","last_clean":"2024-09-12T01:11:43.232399+0000","last_became_active":"2024-09-12T00:46:54.890636+0000","last_became_peered":"2024-09-12T00:46:54.890636+0000","last_unstale":"2024-09-12T01:11:43.232399+0000","last_undegraded":"2024-09-12T01:11:43.232399+0000","last_fullsized":"2024-09-12T01:11:43.232399+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:43.232308+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:43.232308+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.232308+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:50.652215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.169493+0000","last_change":"2024-09-12T00:30:17.762552+0000","last_active":"2024-09-12T01:08:35.169493+0000","last_peered":"2024-09-12T01:08:35.169493+0000","last_clean":"2024-09-12T01:08:35.169493+0000","last_became_active":"2024-09-12T00:30:17.762239+0000","last_became_peered":"2024-09-12T00:30:17.762239+0000","last_unstale":"2024-09-12T01:08:35.169493+0000","last_undegraded":"2024-09-12T01:08:35.169493+0000","last_fullsized":"2024-09-12T01:08:35.169493+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:41.552516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'11","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.659698+0000","last_change":"2024-09-12T01:11:39.659698+0000","last_active":"2024-09-12T01:11:39.659698+0000","last_peered":"2024-09-12T01:11:39.659698+0000","last_clean":"2024-09-12T01:11:39.659698+0000","last_became_active":"2024-09-12T00:30:14.750745+0000","last_became_peered":"2024-09-12T00:30:14.750745+0000","last_unstale":"2024-09-12T01:11:39.659698+0000","last_undegraded":"2024-09-12T01:11:39.659698+0000","last_fullsized":"2024-09-12T01:11:39.659698+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T01:11:39.659613+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T01:11:39.659613+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.659613+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:44.573741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12861,"num_write":16,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:53.052980+0000","last_change":"2024-09-12T00:27:42.837910+0000","last_active":"2024-09-12T01:08:53.052980+0000","last_peered":"2024-09-12T01:08:53.052980+0000","last_clean":"2024-09-12T01:08:53.052980+0000","last_became_active":"2024-09-12T00:27:42.837690+0000","last_became_peered":"2024-09-12T00:27:42.837690+0000","last_unstale":"2024-09-12T01:08:53.052980+0000","last_undegraded":"2024-09-12T01:08:53.052980+0000","last_fullsized":"2024-09-12T01:08:53.052980+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:00.171095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:25.060620+0000","last_change":"2024-09-12T00:46:54.885537+0000","last_active":"2024-09-12T01:09:25.060620+0000","last_peered":"2024-09-12T01:09:25.060620+0000","last_clean":"2024-09-12T01:09:25.060620+0000","last_became_active":"2024-09-12T00:46:54.885262+0000","last_became_peered":"2024-09-12T00:46:54.885262+0000","last_unstale":"2024-09-12T01:09:25.060620+0000","last_undegraded":"2024-09-12T01:09:25.060620+0000","last_fullsized":"2024-09-12T01:09:25.060620+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'7","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.271088+0000","last_change":"2024-09-12T01:11:37.271022+0000","last_active":"2024-09-12T01:11:37.271088+0000","last_peered":"2024-09-12T01:11:37.271088+0000","last_clean":"2024-09-12T01:11:37.271088+0000","last_became_active":"2024-09-12T00:30:17.761071+0000","last_became_peered":"2024-09-12T00:30:17.761071+0000","last_unstale":"2024-09-12T01:11:37.271088+0000","last_undegraded":"2024-09-12T01:11:37.271088+0000","last_fullsized":"2024-09-12T01:11:37.271088+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-12T01:11:37.270934+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-12T01:11:37.270934+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.270934+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:47.686643+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:30.046932+0000","last_change":"2024-09-12T00:30:14.750202+0000","last_active":"2024-09-12T01:08:30.046932+0000","last_peered":"2024-09-12T01:08:30.046932+0000","last_clean":"2024-09-12T01:08:30.046932+0000","last_became_active":"2024-09-12T00:30:14.749906+0000","last_became_peered":"2024-09-12T00:30:14.749906+0000","last_unstale":"2024-09-12T01:08:30.046932+0000","last_undegraded":"2024-09-12T01:08:30.046932+0000","last_fullsized":"2024-09-12T01:08:30.046932+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:25.050487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'11","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.230893+0000","last_change":"2024-09-12T01:11:32.230893+0000","last_active":"2024-09-12T01:11:32.230893+0000","last_peered":"2024-09-12T01:11:32.230893+0000","last_clean":"2024-09-12T01:11:32.230893+0000","last_became_active":"2024-09-12T00:27:42.836870+0000","last_became_peered":"2024-09-12T00:27:42.836870+0000","last_unstale":"2024-09-12T01:11:32.230893+0000","last_undegraded":"2024-09-12T01:11:32.230893+0000","last_fullsized":"2024-09-12T01:11:32.230893+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T01:11:32.230759+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T01:11:32.230759+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.230759+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:37.663368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.248813+0000","last_change":"2024-09-12T01:11:39.248813+0000","last_active":"2024-09-12T01:11:39.248813+0000","last_peered":"2024-09-12T01:11:39.248813+0000","last_clean":"2024-09-12T01:11:39.248813+0000","last_became_active":"2024-09-12T00:46:54.891359+0000","last_became_peered":"2024-09-12T00:46:54.891359+0000","last_unstale":"2024-09-12T01:11:39.248813+0000","last_undegraded":"2024-09-12T01:11:39.248813+0000","last_fullsized":"2024-09-12T01:11:39.248813+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:39.248715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:39.248715+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.248715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:47.820662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'5","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:03.063577+0000","last_change":"2024-09-12T00:30:17.767137+0000","last_active":"2024-09-12T01:10:03.063577+0000","last_peered":"2024-09-12T01:10:03.063577+0000","last_clean":"2024-09-12T01:10:03.063577+0000","last_became_active":"2024-09-12T00:30:17.766810+0000","last_became_peered":"2024-09-12T00:30:17.766810+0000","last_unstale":"2024-09-12T01:10:03.063577+0000","last_undegraded":"2024-09-12T01:10:03.063577+0000","last_fullsized":"2024-09-12T01:10:03.063577+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:50.589394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041701+0000","last_change":"2024-09-12T00:30:14.744674+0000","last_active":"2024-09-12T01:07:45.041701+0000","last_peered":"2024-09-12T01:07:45.041701+0000","last_clean":"2024-09-12T01:07:45.041701+0000","last_became_active":"2024-09-12T00:30:14.744334+0000","last_became_peered":"2024-09-12T00:30:14.744334+0000","last_unstale":"2024-09-12T01:07:45.041701+0000","last_undegraded":"2024-09-12T01:07:45.041701+0000","last_fullsized":"2024-09-12T01:07:45.041701+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:58.360546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":176,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.391984+0000","last_change":"2024-09-12T01:11:43.391984+0000","last_active":"2024-09-12T01:11:43.391984+0000","last_peered":"2024-09-12T01:11:43.391984+0000","last_clean":"2024-09-12T01:11:43.391984+0000","last_became_active":"2024-09-12T00:27:42.836468+0000","last_became_peered":"2024-09-12T00:27:42.836468+0000","last_unstale":"2024-09-12T01:11:43.391984+0000","last_undegraded":"2024-09-12T01:11:43.391984+0000","last_fullsized":"2024-09-12T01:11:43.391984+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-12T01:11:43.391881+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-12T01:11:43.391881+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.391881+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:16.530349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":155,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.254001+0000","last_change":"2024-09-12T01:11:40.254001+0000","last_active":"2024-09-12T01:11:40.254001+0000","last_peered":"2024-09-12T01:11:40.254001+0000","last_clean":"2024-09-12T01:11:40.254001+0000","last_became_active":"2024-09-12T00:46:54.888533+0000","last_became_peered":"2024-09-12T00:46:54.888533+0000","last_unstale":"2024-09-12T01:11:40.254001+0000","last_undegraded":"2024-09-12T01:11:40.254001+0000","last_fullsized":"2024-09-12T01:11:40.254001+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:40.253917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:40.253917+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.253917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:56.500777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:53.061966+0000","last_change":"2024-09-12T00:30:17.766100+0000","last_active":"2024-09-12T01:09:53.061966+0000","last_peered":"2024-09-12T01:09:53.061966+0000","last_clean":"2024-09-12T01:09:53.061966+0000","last_became_active":"2024-09-12T00:30:17.764747+0000","last_became_peered":"2024-09-12T00:30:17.764747+0000","last_unstale":"2024-09-12T01:09:53.061966+0000","last_undegraded":"2024-09-12T01:09:53.061966+0000","last_fullsized":"2024-09-12T01:09:53.061966+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:28.017911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045464+0000","last_change":"2024-09-12T00:30:14.750085+0000","last_active":"2024-09-12T01:07:50.045464+0000","last_peered":"2024-09-12T01:07:50.045464+0000","last_clean":"2024-09-12T01:07:50.045464+0000","last_became_active":"2024-09-12T00:30:14.749668+0000","last_became_peered":"2024-09-12T00:30:14.749668+0000","last_unstale":"2024-09-12T01:07:50.045464+0000","last_undegraded":"2024-09-12T01:07:50.045464+0000","last_fullsized":"2024-09-12T01:07:50.045464+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:46.909054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'44","reported_seq":170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:55.049812+0000","last_change":"2024-09-12T00:27:42.846229+0000","last_active":"2024-09-12T01:08:55.049812+0000","last_peered":"2024-09-12T01:08:55.049812+0000","last_clean":"2024-09-12T01:08:55.049812+0000","last_became_active":"2024-09-12T00:27:42.845963+0000","last_became_peered":"2024-09-12T00:27:42.845963+0000","last_unstale":"2024-09-12T01:08:55.049812+0000","last_undegraded":"2024-09-12T01:08:55.049812+0000","last_fullsized":"2024-09-12T01:08:55.049812+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":173,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:03.054456+0000","last_change":"2024-09-12T00:46:54.885230+0000","last_active":"2024-09-12T01:09:03.054456+0000","last_peered":"2024-09-12T01:09:03.054456+0000","last_clean":"2024-09-12T01:09:03.054456+0000","last_became_active":"2024-09-12T00:46:54.884950+0000","last_became_peered":"2024-09-12T00:46:54.884950+0000","last_unstale":"2024-09-12T01:09:03.054456+0000","last_undegraded":"2024-09-12T01:09:03.054456+0000","last_fullsized":"2024-09-12T01:09:03.054456+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:05.858636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.264155+0000","last_change":"2024-09-12T01:11:35.264155+0000","last_active":"2024-09-12T01:11:35.264155+0000","last_peered":"2024-09-12T01:11:35.264155+0000","last_clean":"2024-09-12T01:11:35.264155+0000","last_became_active":"2024-09-12T00:30:17.762415+0000","last_became_peered":"2024-09-12T00:30:17.762415+0000","last_unstale":"2024-09-12T01:11:35.264155+0000","last_undegraded":"2024-09-12T01:11:35.264155+0000","last_fullsized":"2024-09-12T01:11:35.264155+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:35.264056+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:35.264056+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.264056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:07.751580+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'6","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.281390+0000","last_change":"2024-09-12T01:11:39.281390+0000","last_active":"2024-09-12T01:11:39.281390+0000","last_peered":"2024-09-12T01:11:39.281390+0000","last_clean":"2024-09-12T01:11:39.281390+0000","last_became_active":"2024-09-12T00:30:14.748581+0000","last_became_peered":"2024-09-12T00:30:14.748581+0000","last_unstale":"2024-09-12T01:11:39.281390+0000","last_undegraded":"2024-09-12T01:11:39.281390+0000","last_fullsized":"2024-09-12T01:11:39.281390+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:39.281303+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:39.281303+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.281303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:29.540255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":186,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.339068+0000","last_change":"2024-09-12T01:11:34.338999+0000","last_active":"2024-09-12T01:11:34.339068+0000","last_peered":"2024-09-12T01:11:34.339068+0000","last_clean":"2024-09-12T01:11:34.339068+0000","last_became_active":"2024-09-12T00:27:42.843968+0000","last_became_peered":"2024-09-12T00:27:42.843968+0000","last_unstale":"2024-09-12T01:11:34.339068+0000","last_undegraded":"2024-09-12T01:11:34.339068+0000","last_fullsized":"2024-09-12T01:11:34.339068+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'46","last_scrub_stamp":"2024-09-12T01:11:34.338918+0000","last_deep_scrub":"263'46","last_deep_scrub_stamp":"2024-09-12T01:11:34.338918+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.338918+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:30.360729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":171,"num_write":76,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041617+0000","last_change":"2024-09-12T00:46:54.881183+0000","last_active":"2024-09-12T01:07:45.041617+0000","last_peered":"2024-09-12T01:07:45.041617+0000","last_clean":"2024-09-12T01:07:45.041617+0000","last_became_active":"2024-09-12T00:46:54.880874+0000","last_became_peered":"2024-09-12T00:46:54.880874+0000","last_unstale":"2024-09-12T01:07:45.041617+0000","last_undegraded":"2024-09-12T01:07:45.041617+0000","last_fullsized":"2024-09-12T01:07:45.041617+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:52.663395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'5","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.053181+0000","last_change":"2024-09-12T00:30:17.764321+0000","last_active":"2024-09-12T01:09:20.053181+0000","last_peered":"2024-09-12T01:09:20.053181+0000","last_clean":"2024-09-12T01:09:20.053181+0000","last_became_active":"2024-09-12T00:30:17.762807+0000","last_became_peered":"2024-09-12T00:30:17.762807+0000","last_unstale":"2024-09-12T01:09:20.053181+0000","last_undegraded":"2024-09-12T01:09:20.053181+0000","last_fullsized":"2024-09-12T01:09:20.053181+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"263'4","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.551446+0000","last_change":"2024-09-12T00:30:14.750078+0000","last_active":"2024-09-12T01:10:58.551446+0000","last_peered":"2024-09-12T01:10:58.551446+0000","last_clean":"2024-09-12T01:10:58.551446+0000","last_became_active":"2024-09-12T00:30:14.749608+0000","last_became_peered":"2024-09-12T00:30:14.749608+0000","last_unstale":"2024-09-12T01:10:58.551446+0000","last_undegraded":"2024-09-12T01:10:58.551446+0000","last_fullsized":"2024-09-12T01:10:58.551446+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'41","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.700866+0000","last_change":"2024-09-12T01:11:31.700866+0000","last_active":"2024-09-12T01:11:31.700866+0000","last_peered":"2024-09-12T01:11:31.700866+0000","last_clean":"2024-09-12T01:11:31.700866+0000","last_became_active":"2024-09-12T00:27:42.845889+0000","last_became_peered":"2024-09-12T00:27:42.845889+0000","last_unstale":"2024-09-12T01:11:31.700866+0000","last_undegraded":"2024-09-12T01:11:31.700866+0000","last_fullsized":"2024-09-12T01:11:31.700866+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:11:31.700770+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:11:31.700770+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.700770+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:28.675940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":162,"num_write":61,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052331+0000","last_change":"2024-09-12T00:46:54.887517+0000","last_active":"2024-09-12T01:08:35.052331+0000","last_peered":"2024-09-12T01:08:35.052331+0000","last_clean":"2024-09-12T01:08:35.052331+0000","last_became_active":"2024-09-12T00:46:54.887206+0000","last_became_peered":"2024-09-12T00:46:54.887206+0000","last_unstale":"2024-09-12T01:08:35.052331+0000","last_undegraded":"2024-09-12T01:08:35.052331+0000","last_fullsized":"2024-09-12T01:08:35.052331+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:31.785829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.045384+0000","last_change":"2024-09-12T00:30:17.768384+0000","last_active":"2024-09-12T01:07:50.045384+0000","last_peered":"2024-09-12T01:07:50.045384+0000","last_clean":"2024-09-12T01:07:50.045384+0000","last_became_active":"2024-09-12T00:30:17.767990+0000","last_became_peered":"2024-09-12T00:30:17.767990+0000","last_unstale":"2024-09-12T01:07:50.045384+0000","last_undegraded":"2024-09-12T01:07:50.045384+0000","last_fullsized":"2024-09-12T01:07:50.045384+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:34.324472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"263'2","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.251479+0000","last_change":"2024-09-12T01:11:38.251479+0000","last_active":"2024-09-12T01:11:38.251479+0000","last_peered":"2024-09-12T01:11:38.251479+0000","last_clean":"2024-09-12T01:11:38.251479+0000","last_became_active":"2024-09-12T00:30:14.745195+0000","last_became_peered":"2024-09-12T00:30:14.745195+0000","last_unstale":"2024-09-12T01:11:38.251479+0000","last_undegraded":"2024-09-12T01:11:38.251479+0000","last_fullsized":"2024-09-12T01:11:38.251479+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:38.251373+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:38.251373+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.251373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:47.047585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'32","reported_seq":140,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.289095+0000","last_change":"2024-09-12T01:11:33.289095+0000","last_active":"2024-09-12T01:11:33.289095+0000","last_peered":"2024-09-12T01:11:33.289095+0000","last_clean":"2024-09-12T01:11:33.289095+0000","last_became_active":"2024-09-12T00:27:42.843841+0000","last_became_peered":"2024-09-12T00:27:42.843841+0000","last_unstale":"2024-09-12T01:11:33.289095+0000","last_undegraded":"2024-09-12T01:11:33.289095+0000","last_fullsized":"2024-09-12T01:11:33.289095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-12T01:11:33.288999+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-12T01:11:33.288999+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.288999+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:52.548586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":99,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.052355+0000","last_change":"2024-09-12T00:46:54.884403+0000","last_active":"2024-09-12T01:08:35.052355+0000","last_peered":"2024-09-12T01:08:35.052355+0000","last_clean":"2024-09-12T01:08:35.052355+0000","last_became_active":"2024-09-12T00:46:54.884110+0000","last_became_peered":"2024-09-12T00:46:54.884110+0000","last_unstale":"2024-09-12T01:08:35.052355+0000","last_undegraded":"2024-09-12T01:08:35.052355+0000","last_fullsized":"2024-09-12T01:08:35.052355+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:54.447390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'4","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.724327+0000","last_change":"2024-09-12T00:30:17.763239+0000","last_active":"2024-09-12T01:10:58.724327+0000","last_peered":"2024-09-12T01:10:58.724327+0000","last_clean":"2024-09-12T01:10:58.724327+0000","last_became_active":"2024-09-12T00:30:17.762850+0000","last_became_peered":"2024-09-12T00:30:17.762850+0000","last_unstale":"2024-09-12T01:10:58.724327+0000","last_undegraded":"2024-09-12T01:10:58.724327+0000","last_fullsized":"2024-09-12T01:10:58.724327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:27.977927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'10","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:58.365202+0000","last_change":"2024-09-12T00:30:14.736582+0000","last_active":"2024-09-12T01:10:58.365202+0000","last_peered":"2024-09-12T01:10:58.365202+0000","last_clean":"2024-09-12T01:10:58.365202+0000","last_became_active":"2024-09-12T00:30:14.736286+0000","last_became_peered":"2024-09-12T00:30:14.736286+0000","last_unstale":"2024-09-12T01:10:58.365202+0000","last_undegraded":"2024-09-12T01:10:58.365202+0000","last_fullsized":"2024-09-12T01:10:58.365202+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:13.715440+0000","last_clean_scrub_stamp":"2024-09-12T00:30:13.715440+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:21.074121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":20,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'42","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:25.053720+0000","last_change":"2024-09-12T00:27:42.842160+0000","last_active":"2024-09-12T01:09:25.053720+0000","last_peered":"2024-09-12T01:09:25.053720+0000","last_clean":"2024-09-12T01:09:25.053720+0000","last_became_active":"2024-09-12T00:27:42.841880+0000","last_became_peered":"2024-09-12T00:27:42.841880+0000","last_unstale":"2024-09-12T01:09:25.053720+0000","last_undegraded":"2024-09-12T01:09:25.053720+0000","last_fullsized":"2024-09-12T01:09:25.053720+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":149,"num_write":77,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:48.042872+0000","last_change":"2024-09-12T00:46:54.887508+0000","last_active":"2024-09-12T01:07:48.042872+0000","last_peered":"2024-09-12T01:07:48.042872+0000","last_clean":"2024-09-12T01:07:48.042872+0000","last_became_active":"2024-09-12T00:46:54.887241+0000","last_became_peered":"2024-09-12T00:46:54.887241+0000","last_unstale":"2024-09-12T01:07:48.042872+0000","last_undegraded":"2024-09-12T01:07:48.042872+0000","last_fullsized":"2024-09-12T01:07:48.042872+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:05.592034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.206563+0000","last_change":"2024-09-12T01:11:42.206563+0000","last_active":"2024-09-12T01:11:42.206563+0000","last_peered":"2024-09-12T01:11:42.206563+0000","last_clean":"2024-09-12T01:11:42.206563+0000","last_became_active":"2024-09-12T00:30:17.763434+0000","last_became_peered":"2024-09-12T00:30:17.763434+0000","last_unstale":"2024-09-12T01:11:42.206563+0000","last_undegraded":"2024-09-12T01:11:42.206563+0000","last_fullsized":"2024-09-12T01:11:42.206563+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:42.206473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:42.206473+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.206473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:27.672537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.504674+0000","last_change":"2024-09-12T01:11:42.504674+0000","last_active":"2024-09-12T01:11:42.504674+0000","last_peered":"2024-09-12T01:11:42.504674+0000","last_clean":"2024-09-12T01:11:42.504674+0000","last_became_active":"2024-09-12T00:30:14.744954+0000","last_became_peered":"2024-09-12T00:30:14.744954+0000","last_unstale":"2024-09-12T01:11:42.504674+0000","last_undegraded":"2024-09-12T01:11:42.504674+0000","last_fullsized":"2024-09-12T01:11:42.504674+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:42.504571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:42.504571+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.504571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:04.012804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'51","reported_seq":182,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:25.053685+0000","last_change":"2024-09-12T00:27:42.843112+0000","last_active":"2024-09-12T01:09:25.053685+0000","last_peered":"2024-09-12T01:09:25.053685+0000","last_clean":"2024-09-12T01:09:25.053685+0000","last_became_active":"2024-09-12T00:27:42.842779+0000","last_became_peered":"2024-09-12T00:27:42.842779+0000","last_unstale":"2024-09-12T01:09:25.053685+0000","last_undegraded":"2024-09-12T01:09:25.053685+0000","last_fullsized":"2024-09-12T01:09:25.053685+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:41.820080+0000","last_clean_scrub_stamp":"2024-09-12T00:27:41.820080+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":161,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:50.042278+0000","last_change":"2024-09-12T00:46:54.882461+0000","last_active":"2024-09-12T01:07:50.042278+0000","last_peered":"2024-09-12T01:07:50.042278+0000","last_clean":"2024-09-12T01:07:50.042278+0000","last_became_active":"2024-09-12T00:46:54.882192+0000","last_became_peered":"2024-09-12T00:46:54.882192+0000","last_unstale":"2024-09-12T01:07:50.042278+0000","last_undegraded":"2024-09-12T01:07:50.042278+0000","last_fullsized":"2024-09-12T01:07:50.042278+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:45.883428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.202340+0000","last_change":"2024-09-12T01:11:41.202340+0000","last_active":"2024-09-12T01:11:41.202340+0000","last_peered":"2024-09-12T01:11:41.202340+0000","last_clean":"2024-09-12T01:11:41.202340+0000","last_became_active":"2024-09-12T00:30:17.756710+0000","last_became_peered":"2024-09-12T00:30:17.756710+0000","last_unstale":"2024-09-12T01:11:41.202340+0000","last_undegraded":"2024-09-12T01:11:41.202340+0000","last_fullsized":"2024-09-12T01:11:41.202340+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:41.202253+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:41.202253+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.202253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:23.774889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.295864+0000","last_change":"2024-09-12T01:11:36.295864+0000","last_active":"2024-09-12T01:11:36.295864+0000","last_peered":"2024-09-12T01:11:36.295864+0000","last_clean":"2024-09-12T01:11:36.295864+0000","last_became_active":"2024-09-12T00:30:14.749353+0000","last_became_peered":"2024-09-12T00:30:14.749353+0000","last_unstale":"2024-09-12T01:11:36.295864+0000","last_undegraded":"2024-09-12T01:11:36.295864+0000","last_fullsized":"2024-09-12T01:11:36.295864+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:11:36.295742+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:11:36.295742+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.295742+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:20.185219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'16","reported_seq":104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.318689+0000","last_change":"2024-09-12T01:11:31.318689+0000","last_active":"2024-09-12T01:11:31.318689+0000","last_peered":"2024-09-12T01:11:31.318689+0000","last_clean":"2024-09-12T01:11:31.318689+0000","last_became_active":"2024-09-12T00:27:42.846065+0000","last_became_peered":"2024-09-12T00:27:42.846065+0000","last_unstale":"2024-09-12T01:11:31.318689+0000","last_undegraded":"2024-09-12T01:11:31.318689+0000","last_fullsized":"2024-09-12T01:11:31.318689+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'16","last_scrub_stamp":"2024-09-12T01:11:31.318604+0000","last_deep_scrub":"260'16","last_deep_scrub_stamp":"2024-09-12T01:11:31.318604+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.318604+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:58.588008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":60,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'368","reported_seq":1044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.199577+0000","last_change":"2024-09-12T01:11:13.199577+0000","last_active":"2024-09-12T01:11:13.199577+0000","last_peered":"2024-09-12T01:11:13.199577+0000","last_clean":"2024-09-12T01:11:13.199577+0000","last_became_active":"2024-09-12T00:12:36.041803+0000","last_became_peered":"2024-09-12T00:12:36.041803+0000","last_unstale":"2024-09-12T01:11:13.199577+0000","last_undegraded":"2024-09-12T01:11:13.199577+0000","last_fullsized":"2024-09-12T01:11:13.199577+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'368","last_scrub_stamp":"2024-09-12T01:11:13.199449+0000","last_deep_scrub":"263'368","last_deep_scrub_stamp":"2024-09-12T01:11:13.199449+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.199449+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:26.747669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48825,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":31202,"num_write":1169,"num_write_kb":36538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'78","reported_seq":677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.245203+0000","last_change":"2024-09-12T01:11:18.245203+0000","last_active":"2024-09-12T01:11:18.245203+0000","last_peered":"2024-09-12T01:11:18.245203+0000","last_clean":"2024-09-12T01:11:18.245203+0000","last_became_active":"2024-09-12T00:12:38.035848+0000","last_became_peered":"2024-09-12T00:12:38.035848+0000","last_unstale":"2024-09-12T01:11:18.245203+0000","last_undegraded":"2024-09-12T01:11:18.245203+0000","last_fullsized":"2024-09-12T01:11:18.245203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'78","last_scrub_stamp":"2024-09-12T01:11:18.245112+0000","last_deep_scrub":"263'78","last_deep_scrub_stamp":"2024-09-12T01:11:18.245112+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.245112+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:00.565463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":321,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'468","reported_seq":1249,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.840938+0000","last_change":"2024-09-12T01:11:17.840938+0000","last_active":"2024-09-12T01:11:17.840938+0000","last_peered":"2024-09-12T01:11:17.840938+0000","last_clean":"2024-09-12T01:11:17.840938+0000","last_became_active":"2024-09-12T00:12:36.045325+0000","last_became_peered":"2024-09-12T00:12:36.045325+0000","last_unstale":"2024-09-12T01:11:17.840938+0000","last_undegraded":"2024-09-12T01:11:17.840938+0000","last_fullsized":"2024-09-12T01:11:17.840938+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'468","last_scrub_stamp":"2024-09-12T01:11:17.840763+0000","last_deep_scrub":"263'468","last_deep_scrub_stamp":"2024-09-12T01:11:17.840763+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.840763+0000","objects_scrubbed":10,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:41.998542+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6448752,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1044,"num_read_kb":48846,"num_write":1428,"num_write_kb":45958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'64","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.383471+0000","last_change":"2024-09-12T01:11:27.383471+0000","last_active":"2024-09-12T01:11:27.383471+0000","last_peered":"2024-09-12T01:11:27.383471+0000","last_clean":"2024-09-12T01:11:27.383471+0000","last_became_active":"2024-09-12T00:12:38.040122+0000","last_became_peered":"2024-09-12T00:12:38.040122+0000","last_unstale":"2024-09-12T01:11:27.383471+0000","last_undegraded":"2024-09-12T01:11:27.383471+0000","last_fullsized":"2024-09-12T01:11:27.383471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'64","last_scrub_stamp":"2024-09-12T01:11:27.383381+0000","last_deep_scrub":"263'64","last_deep_scrub_stamp":"2024-09-12T01:11:27.383381+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.383381+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:51.503948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":259,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'346","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.861951+0000","last_change":"2024-09-12T01:11:16.861951+0000","last_active":"2024-09-12T01:11:16.861951+0000","last_peered":"2024-09-12T01:11:16.861951+0000","last_clean":"2024-09-12T01:11:16.861951+0000","last_became_active":"2024-09-12T00:12:36.039741+0000","last_became_peered":"2024-09-12T00:12:36.039741+0000","last_unstale":"2024-09-12T01:11:16.861951+0000","last_undegraded":"2024-09-12T01:11:16.861951+0000","last_fullsized":"2024-09-12T01:11:16.861951+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-12T01:11:16.861851+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-12T01:11:16.861851+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.861851+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:47.559046+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262217,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":26393,"num_write":1030,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'307","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.421184+0000","last_change":"2024-09-12T01:11:28.421184+0000","last_active":"2024-09-12T01:11:28.421184+0000","last_peered":"2024-09-12T01:11:28.421184+0000","last_clean":"2024-09-12T01:11:28.421184+0000","last_became_active":"2024-09-12T00:12:38.041795+0000","last_became_peered":"2024-09-12T00:12:38.041795+0000","last_unstale":"2024-09-12T01:11:28.421184+0000","last_undegraded":"2024-09-12T01:11:28.421184+0000","last_fullsized":"2024-09-12T01:11:28.421184+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-12T01:11:28.421075+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-12T01:11:28.421075+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.421075+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:51.999413+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1291,"num_read_kb":1053,"num_write":447,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'403","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.179422+0000","last_change":"2024-09-12T01:11:07.179422+0000","last_active":"2024-09-12T01:11:07.179422+0000","last_peered":"2024-09-12T01:11:07.179422+0000","last_clean":"2024-09-12T01:11:07.179422+0000","last_became_active":"2024-09-12T00:12:36.036970+0000","last_became_peered":"2024-09-12T00:12:36.036970+0000","last_unstale":"2024-09-12T01:11:07.179422+0000","last_undegraded":"2024-09-12T01:11:07.179422+0000","last_fullsized":"2024-09-12T01:11:07.179422+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-12T01:11:07.179336+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-12T01:11:07.179336+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.179336+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:19.036143+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":29211,"num_write":1250,"num_write_kb":52081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'61","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.432667+0000","last_change":"2024-09-12T01:11:22.432667+0000","last_active":"2024-09-12T01:11:22.432667+0000","last_peered":"2024-09-12T01:11:22.432667+0000","last_clean":"2024-09-12T01:11:22.432667+0000","last_became_active":"2024-09-12T00:12:38.039292+0000","last_became_peered":"2024-09-12T00:12:38.039292+0000","last_unstale":"2024-09-12T01:11:22.432667+0000","last_undegraded":"2024-09-12T01:11:22.432667+0000","last_fullsized":"2024-09-12T01:11:22.432667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'61","last_scrub_stamp":"2024-09-12T01:11:22.432578+0000","last_deep_scrub":"263'61","last_deep_scrub_stamp":"2024-09-12T01:11:22.432578+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.432578+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:17.788153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":95,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'338","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.182576+0000","last_change":"2024-09-12T01:11:22.182576+0000","last_active":"2024-09-12T01:11:22.182576+0000","last_peered":"2024-09-12T01:11:22.182576+0000","last_clean":"2024-09-12T01:11:22.182576+0000","last_became_active":"2024-09-12T00:12:36.044021+0000","last_became_peered":"2024-09-12T00:12:36.044021+0000","last_unstale":"2024-09-12T01:11:22.182576+0000","last_undegraded":"2024-09-12T01:11:22.182576+0000","last_fullsized":"2024-09-12T01:11:22.182576+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-12T01:11:22.182412+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-12T01:11:22.182412+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.182412+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:27.695629+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730157,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":19079,"num_write":1003,"num_write_kb":26981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'448","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.134945+0000","last_change":"2024-09-12T01:11:21.134945+0000","last_active":"2024-09-12T01:11:21.134945+0000","last_peered":"2024-09-12T01:11:21.134945+0000","last_clean":"2024-09-12T01:11:21.134945+0000","last_became_active":"2024-09-12T00:12:38.037000+0000","last_became_peered":"2024-09-12T00:12:38.037000+0000","last_unstale":"2024-09-12T01:11:21.134945+0000","last_undegraded":"2024-09-12T01:11:21.134945+0000","last_fullsized":"2024-09-12T01:11:21.134945+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'448","last_scrub_stamp":"2024-09-12T01:11:21.134865+0000","last_deep_scrub":"263'448","last_deep_scrub_stamp":"2024-09-12T01:11:21.134865+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.134865+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:20.612613+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1930,"num_read_kb":1543,"num_write":735,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":986,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'369","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.185720+0000","last_change":"2024-09-12T01:11:15.185720+0000","last_active":"2024-09-12T01:11:15.185720+0000","last_peered":"2024-09-12T01:11:15.185720+0000","last_clean":"2024-09-12T01:11:15.185720+0000","last_became_active":"2024-09-12T00:12:36.038235+0000","last_became_peered":"2024-09-12T00:12:36.038235+0000","last_unstale":"2024-09-12T01:11:15.185720+0000","last_undegraded":"2024-09-12T01:11:15.185720+0000","last_fullsized":"2024-09-12T01:11:15.185720+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-12T01:11:15.185608+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-12T01:11:15.185608+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.185608+0000","objects_scrubbed":8,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:57.218559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342021,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":629,"num_read_kb":9962,"num_write":1248,"num_write_kb":25658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'300","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.173657+0000","last_change":"2024-09-12T01:11:17.173657+0000","last_active":"2024-09-12T01:11:17.173657+0000","last_peered":"2024-09-12T01:11:17.173657+0000","last_clean":"2024-09-12T01:11:17.173657+0000","last_became_active":"2024-09-12T00:12:38.045308+0000","last_became_peered":"2024-09-12T00:12:38.045308+0000","last_unstale":"2024-09-12T01:11:17.173657+0000","last_undegraded":"2024-09-12T01:11:17.173657+0000","last_fullsized":"2024-09-12T01:11:17.173657+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-12T01:11:17.173563+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-12T01:11:17.173563+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.173563+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:02.418536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1317,"num_read_kb":1075,"num_write":482,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'325","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.176988+0000","last_change":"2024-09-12T01:11:12.176988+0000","last_active":"2024-09-12T01:11:12.176988+0000","last_peered":"2024-09-12T01:11:12.176988+0000","last_clean":"2024-09-12T01:11:12.176988+0000","last_became_active":"2024-09-12T00:12:36.041698+0000","last_became_peered":"2024-09-12T00:12:36.041698+0000","last_unstale":"2024-09-12T01:11:12.176988+0000","last_undegraded":"2024-09-12T01:11:12.176988+0000","last_fullsized":"2024-09-12T01:11:12.176988+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-09-12T01:11:12.176870+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-09-12T01:11:12.176870+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.176870+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:10.449840+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":30384,"num_write":1021,"num_write_kb":31492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'494","reported_seq":1263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.295295+0000","last_change":"2024-09-12T01:11:22.295295+0000","last_active":"2024-09-12T01:11:22.295295+0000","last_peered":"2024-09-12T01:11:22.295295+0000","last_clean":"2024-09-12T01:11:22.295295+0000","last_became_active":"2024-09-12T00:12:38.038023+0000","last_became_peered":"2024-09-12T00:12:38.038023+0000","last_unstale":"2024-09-12T01:11:22.295295+0000","last_undegraded":"2024-09-12T01:11:22.295295+0000","last_fullsized":"2024-09-12T01:11:22.295295+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'494","last_scrub_stamp":"2024-09-12T01:11:22.295202+0000","last_deep_scrub":"263'494","last_deep_scrub_stamp":"2024-09-12T01:11:22.295202+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.295202+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:02.301203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2347,"num_read_kb":2031,"num_write":873,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3149,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'296","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.890838+0000","last_change":"2024-09-12T01:11:15.890838+0000","last_active":"2024-09-12T01:11:15.890838+0000","last_peered":"2024-09-12T01:11:15.890838+0000","last_clean":"2024-09-12T01:11:15.890838+0000","last_became_active":"2024-09-12T00:12:36.050008+0000","last_became_peered":"2024-09-12T00:12:36.050008+0000","last_unstale":"2024-09-12T01:11:15.890838+0000","last_undegraded":"2024-09-12T01:11:15.890838+0000","last_fullsized":"2024-09-12T01:11:15.890838+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'296","last_scrub_stamp":"2024-09-12T01:11:15.890624+0000","last_deep_scrub":"263'296","last_deep_scrub_stamp":"2024-09-12T01:11:15.890624+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.890624+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:16.146979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":30850,"num_write":1048,"num_write_kb":20572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'204","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.892969+0000","last_change":"2024-09-12T01:11:26.892969+0000","last_active":"2024-09-12T01:11:26.892969+0000","last_peered":"2024-09-12T01:11:26.892969+0000","last_clean":"2024-09-12T01:11:26.892969+0000","last_became_active":"2024-09-12T00:12:38.043059+0000","last_became_peered":"2024-09-12T00:12:38.043059+0000","last_unstale":"2024-09-12T01:11:26.892969+0000","last_undegraded":"2024-09-12T01:11:26.892969+0000","last_fullsized":"2024-09-12T01:11:26.892969+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'204","last_scrub_stamp":"2024-09-12T01:11:26.892863+0000","last_deep_scrub":"263'204","last_deep_scrub_stamp":"2024-09-12T01:11:26.892863+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.892863+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:16.644574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":751,"num_write":306,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'111","reported_seq":708,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.340338+0000","last_change":"2024-09-12T01:11:26.340338+0000","last_active":"2024-09-12T01:11:26.340338+0000","last_peered":"2024-09-12T01:11:26.340338+0000","last_clean":"2024-09-12T01:11:26.340338+0000","last_became_active":"2024-09-12T00:12:38.040613+0000","last_became_peered":"2024-09-12T00:12:38.040613+0000","last_unstale":"2024-09-12T01:11:26.340338+0000","last_undegraded":"2024-09-12T01:11:26.340338+0000","last_fullsized":"2024-09-12T01:11:26.340338+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:11:26.340235+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:11:26.340235+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.340235+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:35.822474+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":420,"num_write":176,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'377","reported_seq":1123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.287078+0000","last_change":"2024-09-12T01:11:09.287078+0000","last_active":"2024-09-12T01:11:09.287078+0000","last_peered":"2024-09-12T01:11:09.287078+0000","last_clean":"2024-09-12T01:11:09.287078+0000","last_became_active":"2024-09-12T00:12:36.036905+0000","last_became_peered":"2024-09-12T00:12:36.036905+0000","last_unstale":"2024-09-12T01:11:09.287078+0000","last_undegraded":"2024-09-12T01:11:09.287078+0000","last_fullsized":"2024-09-12T01:11:09.287078+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:11:09.286940+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:11:09.286940+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.286940+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:09.368061+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529645,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":592,"num_read_kb":41745,"num_write":1152,"num_write_kb":45582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'78","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.167491+0000","last_change":"2024-09-12T01:11:16.167491+0000","last_active":"2024-09-12T01:11:16.167491+0000","last_peered":"2024-09-12T01:11:16.167491+0000","last_clean":"2024-09-12T01:11:16.167491+0000","last_became_active":"2024-09-12T00:12:38.038478+0000","last_became_peered":"2024-09-12T00:12:38.038478+0000","last_unstale":"2024-09-12T01:11:16.167491+0000","last_undegraded":"2024-09-12T01:11:16.167491+0000","last_fullsized":"2024-09-12T01:11:16.167491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'78","last_scrub_stamp":"2024-09-12T01:11:16.167401+0000","last_deep_scrub":"263'78","last_deep_scrub_stamp":"2024-09-12T01:11:16.167401+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.167401+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:07.760102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":318,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'378","reported_seq":1023,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.165463+0000","last_change":"2024-09-12T01:11:11.165463+0000","last_active":"2024-09-12T01:11:11.165463+0000","last_peered":"2024-09-12T01:11:11.165463+0000","last_clean":"2024-09-12T01:11:11.165463+0000","last_became_active":"2024-09-12T00:12:36.032821+0000","last_became_peered":"2024-09-12T00:12:36.032821+0000","last_unstale":"2024-09-12T01:11:11.165463+0000","last_undegraded":"2024-09-12T01:11:11.165463+0000","last_fullsized":"2024-09-12T01:11:11.165463+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-12T01:11:11.165328+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-12T01:11:11.165328+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.165328+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:11.501731+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3061552,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":42771,"num_write":1040,"num_write_kb":38443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'199","reported_seq":797,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.231959+0000","last_change":"2024-09-12T01:11:15.231959+0000","last_active":"2024-09-12T01:11:15.231959+0000","last_peered":"2024-09-12T01:11:15.231959+0000","last_clean":"2024-09-12T01:11:15.231959+0000","last_became_active":"2024-09-12T00:12:38.044169+0000","last_became_peered":"2024-09-12T00:12:38.044169+0000","last_unstale":"2024-09-12T01:11:15.231959+0000","last_undegraded":"2024-09-12T01:11:15.231959+0000","last_fullsized":"2024-09-12T01:11:15.231959+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'199","last_scrub_stamp":"2024-09-12T01:11:15.231880+0000","last_deep_scrub":"263'199","last_deep_scrub_stamp":"2024-09-12T01:11:15.231880+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.231880+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:00.268928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":679,"num_write":307,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'331","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.123297+0000","last_change":"2024-09-12T01:11:10.123297+0000","last_active":"2024-09-12T01:11:10.123297+0000","last_peered":"2024-09-12T01:11:10.123297+0000","last_clean":"2024-09-12T01:11:10.123297+0000","last_became_active":"2024-09-12T00:12:36.037200+0000","last_became_peered":"2024-09-12T00:12:36.037200+0000","last_unstale":"2024-09-12T01:11:10.123297+0000","last_undegraded":"2024-09-12T01:11:10.123297+0000","last_fullsized":"2024-09-12T01:11:10.123297+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:11:10.123156+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:11:10.123156+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.123156+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:59.788260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524447,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":1481,"num_write":1070,"num_write_kb":18199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'162","reported_seq":766,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.295446+0000","last_change":"2024-09-12T01:11:20.295446+0000","last_active":"2024-09-12T01:11:20.295446+0000","last_peered":"2024-09-12T01:11:20.295446+0000","last_clean":"2024-09-12T01:11:20.295446+0000","last_became_active":"2024-09-12T00:12:38.044089+0000","last_became_peered":"2024-09-12T00:12:38.044089+0000","last_unstale":"2024-09-12T01:11:20.295446+0000","last_undegraded":"2024-09-12T01:11:20.295446+0000","last_fullsized":"2024-09-12T01:11:20.295446+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-12T01:11:20.295361+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-12T01:11:20.295361+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.295361+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:32.689542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":583,"num_write":265,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'360","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.104690+0000","last_change":"2024-09-12T01:11:09.104690+0000","last_active":"2024-09-12T01:11:09.104690+0000","last_peered":"2024-09-12T01:11:09.104690+0000","last_clean":"2024-09-12T01:11:09.104690+0000","last_became_active":"2024-09-12T00:12:36.029286+0000","last_became_peered":"2024-09-12T00:12:36.029286+0000","last_unstale":"2024-09-12T01:11:09.104690+0000","last_undegraded":"2024-09-12T01:11:09.104690+0000","last_fullsized":"2024-09-12T01:11:09.104690+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-12T01:11:09.104526+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-12T01:11:09.104526+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.104526+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:00.468686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661265,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":28445,"num_write":1057,"num_write_kb":34038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'237","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.927199+0000","last_change":"2024-09-12T01:11:25.927199+0000","last_active":"2024-09-12T01:11:25.927199+0000","last_peered":"2024-09-12T01:11:25.927199+0000","last_clean":"2024-09-12T01:11:25.927199+0000","last_became_active":"2024-09-12T00:12:38.042387+0000","last_became_peered":"2024-09-12T00:12:38.042387+0000","last_unstale":"2024-09-12T01:11:25.927199+0000","last_undegraded":"2024-09-12T01:11:25.927199+0000","last_fullsized":"2024-09-12T01:11:25.927199+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'237","last_scrub_stamp":"2024-09-12T01:11:25.927079+0000","last_deep_scrub":"263'237","last_deep_scrub_stamp":"2024-09-12T01:11:25.927079+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.927079+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:09.717365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1130,"num_read_kb":955,"num_write":386,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'350","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.214817+0000","last_change":"2024-09-12T01:11:13.214817+0000","last_active":"2024-09-12T01:11:13.214817+0000","last_peered":"2024-09-12T01:11:13.214817+0000","last_clean":"2024-09-12T01:11:13.214817+0000","last_became_active":"2024-09-12T00:12:36.034811+0000","last_became_peered":"2024-09-12T00:12:36.034811+0000","last_unstale":"2024-09-12T01:11:13.214817+0000","last_undegraded":"2024-09-12T01:11:13.214817+0000","last_fullsized":"2024-09-12T01:11:13.214817+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-12T01:11:13.214663+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-12T01:11:13.214663+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.214663+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:38.760865+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":602,"num_read_kb":22753,"num_write":1118,"num_write_kb":14938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'112","reported_seq":711,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.223372+0000","last_change":"2024-09-12T01:11:16.223372+0000","last_active":"2024-09-12T01:11:16.223372+0000","last_peered":"2024-09-12T01:11:16.223372+0000","last_clean":"2024-09-12T01:11:16.223372+0000","last_became_active":"2024-09-12T00:12:38.035835+0000","last_became_peered":"2024-09-12T00:12:38.035835+0000","last_unstale":"2024-09-12T01:11:16.223372+0000","last_undegraded":"2024-09-12T01:11:16.223372+0000","last_fullsized":"2024-09-12T01:11:16.223372+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'112","last_scrub_stamp":"2024-09-12T01:11:16.223277+0000","last_deep_scrub":"263'112","last_deep_scrub_stamp":"2024-09-12T01:11:16.223277+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.223277+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:36.024600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":399,"num_write":174,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'328","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.247820+0000","last_change":"2024-09-12T01:11:11.247820+0000","last_active":"2024-09-12T01:11:11.247820+0000","last_peered":"2024-09-12T01:11:11.247820+0000","last_clean":"2024-09-12T01:11:11.247820+0000","last_became_active":"2024-09-12T00:12:36.036060+0000","last_became_peered":"2024-09-12T00:12:36.036060+0000","last_unstale":"2024-09-12T01:11:11.247820+0000","last_undegraded":"2024-09-12T01:11:11.247820+0000","last_fullsized":"2024-09-12T01:11:11.247820+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-12T01:11:11.247654+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-12T01:11:11.247654+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.247654+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:35.548784+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568184,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":547,"num_read_kb":15680,"num_write":1014,"num_write_kb":17630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'133","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.232223+0000","last_change":"2024-09-12T01:11:30.232223+0000","last_active":"2024-09-12T01:11:30.232223+0000","last_peered":"2024-09-12T01:11:30.232223+0000","last_clean":"2024-09-12T01:11:30.232223+0000","last_became_active":"2024-09-12T00:12:46.059203+0000","last_became_peered":"2024-09-12T00:12:46.059203+0000","last_unstale":"2024-09-12T01:11:30.232223+0000","last_undegraded":"2024-09-12T01:11:30.232223+0000","last_fullsized":"2024-09-12T01:11:30.232223+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-12T01:11:30.232125+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-12T01:11:30.232125+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.232125+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:57.023912+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":135,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'77","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.238332+0000","last_change":"2024-09-12T01:11:18.238332+0000","last_active":"2024-09-12T01:11:18.238332+0000","last_peered":"2024-09-12T01:11:18.238332+0000","last_clean":"2024-09-12T01:11:18.238332+0000","last_became_active":"2024-09-12T00:12:38.041964+0000","last_became_peered":"2024-09-12T00:12:38.041964+0000","last_unstale":"2024-09-12T01:11:18.238332+0000","last_undegraded":"2024-09-12T01:11:18.238332+0000","last_fullsized":"2024-09-12T01:11:18.238332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'77","last_scrub_stamp":"2024-09-12T01:11:18.238243+0000","last_deep_scrub":"263'77","last_deep_scrub_stamp":"2024-09-12T01:11:18.238243+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.238243+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:12.364311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":305,"num_read_kb":247,"num_write":113,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'357","reported_seq":1213,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.398737+0000","last_change":"2024-09-12T01:11:12.398737+0000","last_active":"2024-09-12T01:11:12.398737+0000","last_peered":"2024-09-12T01:11:12.398737+0000","last_clean":"2024-09-12T01:11:12.398737+0000","last_became_active":"2024-09-12T00:12:36.033666+0000","last_became_peered":"2024-09-12T00:12:36.033666+0000","last_unstale":"2024-09-12T01:11:12.398737+0000","last_undegraded":"2024-09-12T01:11:12.398737+0000","last_fullsized":"2024-09-12T01:11:12.398737+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'357","last_scrub_stamp":"2024-09-12T01:11:12.398592+0000","last_deep_scrub":"263'357","last_deep_scrub_stamp":"2024-09-12T01:11:12.398592+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.398592+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:13.468955+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2017915,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":962,"num_read_kb":16942,"num_write":1189,"num_write_kb":38560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.416465+0000","last_change":"2024-09-12T01:11:33.416465+0000","last_active":"2024-09-12T01:11:33.416465+0000","last_peered":"2024-09-12T01:11:33.416465+0000","last_clean":"2024-09-12T01:11:33.416465+0000","last_became_active":"2024-09-12T00:12:40.042778+0000","last_became_peered":"2024-09-12T00:12:40.042778+0000","last_unstale":"2024-09-12T01:11:33.416465+0000","last_undegraded":"2024-09-12T01:11:33.416465+0000","last_fullsized":"2024-09-12T01:11:33.416465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.416381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.416381+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.416381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:21.057767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'351","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.471401+0000","last_change":"2024-09-12T01:11:35.471401+0000","last_active":"2024-09-12T01:11:35.471401+0000","last_peered":"2024-09-12T01:11:35.471401+0000","last_clean":"2024-09-12T01:11:35.471401+0000","last_became_active":"2024-09-12T00:12:42.040764+0000","last_became_peered":"2024-09-12T00:12:42.040764+0000","last_unstale":"2024-09-12T01:11:35.471401+0000","last_undegraded":"2024-09-12T01:11:35.471401+0000","last_fullsized":"2024-09-12T01:11:35.471401+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-12T01:11:35.471303+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-12T01:11:35.471303+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.471303+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:53.053653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46776,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":561,"num_read_kb":1150,"num_write":442,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.275901+0000","last_change":"2024-09-12T01:11:32.275901+0000","last_active":"2024-09-12T01:11:32.275901+0000","last_peered":"2024-09-12T01:11:32.275901+0000","last_clean":"2024-09-12T01:11:32.275901+0000","last_became_active":"2024-09-12T00:12:44.055504+0000","last_became_peered":"2024-09-12T00:12:44.055504+0000","last_unstale":"2024-09-12T01:11:32.275901+0000","last_undegraded":"2024-09-12T01:11:32.275901+0000","last_fullsized":"2024-09-12T01:11:32.275901+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.275803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.275803+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.275803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:26.825661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'172","reported_seq":725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.322275+0000","last_change":"2024-09-12T01:11:34.322275+0000","last_active":"2024-09-12T01:11:34.322275+0000","last_peered":"2024-09-12T01:11:34.322275+0000","last_clean":"2024-09-12T01:11:34.322275+0000","last_became_active":"2024-09-12T00:12:46.065664+0000","last_became_peered":"2024-09-12T00:12:46.065664+0000","last_unstale":"2024-09-12T01:11:34.322275+0000","last_undegraded":"2024-09-12T01:11:34.322275+0000","last_fullsized":"2024-09-12T01:11:34.322275+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-09-12T01:11:34.322194+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-09-12T01:11:34.322194+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.322194+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:51.871169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":198,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'177","reported_seq":798,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.332934+0000","last_change":"2024-09-12T01:11:23.332934+0000","last_active":"2024-09-12T01:11:23.332934+0000","last_peered":"2024-09-12T01:11:23.332934+0000","last_clean":"2024-09-12T01:11:23.332934+0000","last_became_active":"2024-09-12T00:12:38.041187+0000","last_became_peered":"2024-09-12T00:12:38.041187+0000","last_unstale":"2024-09-12T01:11:23.332934+0000","last_undegraded":"2024-09-12T01:11:23.332934+0000","last_fullsized":"2024-09-12T01:11:23.332934+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-09-12T01:11:23.332840+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-09-12T01:11:23.332840+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.332840+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:43.482751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":787,"num_read_kb":651,"num_write":272,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'370","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.319094+0000","last_change":"2024-09-12T01:11:09.319094+0000","last_active":"2024-09-12T01:11:09.319094+0000","last_peered":"2024-09-12T01:11:09.319094+0000","last_clean":"2024-09-12T01:11:09.319094+0000","last_became_active":"2024-09-12T00:12:36.033751+0000","last_became_peered":"2024-09-12T00:12:36.033751+0000","last_unstale":"2024-09-12T01:11:09.319094+0000","last_undegraded":"2024-09-12T01:11:09.319094+0000","last_fullsized":"2024-09-12T01:11:09.319094+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-12T01:11:09.318981+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-12T01:11:09.318981+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.318981+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:02.689157+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254460,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":6771,"num_write":1059,"num_write_kb":22452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.612290+0000","last_change":"2024-09-12T01:11:27.612290+0000","last_active":"2024-09-12T01:11:27.612290+0000","last_peered":"2024-09-12T01:11:27.612290+0000","last_clean":"2024-09-12T01:11:27.612290+0000","last_became_active":"2024-09-12T00:12:40.032489+0000","last_became_peered":"2024-09-12T00:12:40.032489+0000","last_unstale":"2024-09-12T01:11:27.612290+0000","last_undegraded":"2024-09-12T01:11:27.612290+0000","last_fullsized":"2024-09-12T01:11:27.612290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:27.612192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:27.612192+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.612192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:04.891321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'97","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.322249+0000","last_change":"2024-09-12T01:11:30.322249+0000","last_active":"2024-09-12T01:11:30.322249+0000","last_peered":"2024-09-12T01:11:30.322249+0000","last_clean":"2024-09-12T01:11:30.322249+0000","last_became_active":"2024-09-12T00:12:42.046316+0000","last_became_peered":"2024-09-12T00:12:42.046316+0000","last_unstale":"2024-09-12T01:11:30.322249+0000","last_undegraded":"2024-09-12T01:11:30.322249+0000","last_fullsized":"2024-09-12T01:11:30.322249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'97","last_scrub_stamp":"2024-09-12T01:11:30.322163+0000","last_deep_scrub":"263'97","last_deep_scrub_stamp":"2024-09-12T01:11:30.322163+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.322163+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:43.884994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":105,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.322098+0000","last_change":"2024-09-12T01:11:28.322098+0000","last_active":"2024-09-12T01:11:28.322098+0000","last_peered":"2024-09-12T01:11:28.322098+0000","last_clean":"2024-09-12T01:11:28.322098+0000","last_became_active":"2024-09-12T00:12:44.057398+0000","last_became_peered":"2024-09-12T00:12:44.057398+0000","last_unstale":"2024-09-12T01:11:28.322098+0000","last_undegraded":"2024-09-12T01:11:28.322098+0000","last_fullsized":"2024-09-12T01:11:28.322098+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:28.322005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:28.322005+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.322005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:49.268150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'142","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.415911+0000","last_change":"2024-09-12T01:11:32.415911+0000","last_active":"2024-09-12T01:11:32.415911+0000","last_peered":"2024-09-12T01:11:32.415911+0000","last_clean":"2024-09-12T01:11:32.415911+0000","last_became_active":"2024-09-12T00:12:46.060932+0000","last_became_peered":"2024-09-12T00:12:46.060932+0000","last_unstale":"2024-09-12T01:11:32.415911+0000","last_undegraded":"2024-09-12T01:11:32.415911+0000","last_fullsized":"2024-09-12T01:11:32.415911+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-12T01:11:32.415807+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-12T01:11:32.415807+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.415807+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:41.606537+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'190","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.815777+0000","last_change":"2024-09-12T01:11:22.815777+0000","last_active":"2024-09-12T01:11:22.815777+0000","last_peered":"2024-09-12T01:11:22.815777+0000","last_clean":"2024-09-12T01:11:22.815777+0000","last_became_active":"2024-09-12T00:12:38.038234+0000","last_became_peered":"2024-09-12T00:12:38.038234+0000","last_unstale":"2024-09-12T01:11:22.815777+0000","last_undegraded":"2024-09-12T01:11:22.815777+0000","last_fullsized":"2024-09-12T01:11:22.815777+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-12T01:11:22.815690+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-12T01:11:22.815690+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.815690+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:14.046873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":891,"num_read_kb":755,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'339","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.343925+0000","last_change":"2024-09-12T01:11:08.343865+0000","last_active":"2024-09-12T01:11:08.343925+0000","last_peered":"2024-09-12T01:11:08.343925+0000","last_clean":"2024-09-12T01:11:08.343925+0000","last_became_active":"2024-09-12T00:13:07.149671+0000","last_became_peered":"2024-09-12T00:13:07.149671+0000","last_unstale":"2024-09-12T01:11:08.343925+0000","last_undegraded":"2024-09-12T01:11:08.343925+0000","last_fullsized":"2024-09-12T01:11:08.343925+0000","mapping_epoch":40,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-12T01:11:08.343734+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-12T01:11:08.343734+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.343734+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:10.179873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":33322,"num_write":992,"num_write_kb":23312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.511949+0000","last_change":"2024-09-12T01:11:24.511949+0000","last_active":"2024-09-12T01:11:24.511949+0000","last_peered":"2024-09-12T01:11:24.511949+0000","last_clean":"2024-09-12T01:11:24.511949+0000","last_became_active":"2024-09-12T00:12:40.036714+0000","last_became_peered":"2024-09-12T00:12:40.036714+0000","last_unstale":"2024-09-12T01:11:24.511949+0000","last_undegraded":"2024-09-12T01:11:24.511949+0000","last_fullsized":"2024-09-12T01:11:24.511949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.511863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.511863+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.511863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:42.540269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'135","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.451307+0000","last_change":"2024-09-12T01:11:39.451307+0000","last_active":"2024-09-12T01:11:39.451307+0000","last_peered":"2024-09-12T01:11:39.451307+0000","last_clean":"2024-09-12T01:11:39.451307+0000","last_became_active":"2024-09-12T00:12:42.037971+0000","last_became_peered":"2024-09-12T00:12:42.037971+0000","last_unstale":"2024-09-12T01:11:39.451307+0000","last_undegraded":"2024-09-12T01:11:39.451307+0000","last_fullsized":"2024-09-12T01:11:39.451307+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T01:11:39.451216+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T01:11:39.451216+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.451216+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:50.819654+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":156,"num_read_kb":149,"num_write":106,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'779","reported_seq":2794,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.503006+0000","last_change":"2024-09-12T01:11:43.503006+0000","last_active":"2024-09-12T01:11:43.503006+0000","last_peered":"2024-09-12T01:11:43.503006+0000","last_clean":"2024-09-12T01:11:43.503006+0000","last_became_active":"2024-09-12T00:12:44.059258+0000","last_became_peered":"2024-09-12T00:12:44.059258+0000","last_unstale":"2024-09-12T01:11:43.503006+0000","last_undegraded":"2024-09-12T01:11:43.503006+0000","last_fullsized":"2024-09-12T01:11:43.503006+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'779","last_scrub_stamp":"2024-09-12T01:11:43.502879+0000","last_deep_scrub":"263'779","last_deep_scrub_stamp":"2024-09-12T01:11:43.502879+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.502879+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:03.550822+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'198","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.322051+0000","last_change":"2024-09-12T01:11:32.322051+0000","last_active":"2024-09-12T01:11:32.322051+0000","last_peered":"2024-09-12T01:11:32.322051+0000","last_clean":"2024-09-12T01:11:32.322051+0000","last_became_active":"2024-09-12T00:12:46.059591+0000","last_became_peered":"2024-09-12T00:12:46.059591+0000","last_unstale":"2024-09-12T01:11:32.322051+0000","last_undegraded":"2024-09-12T01:11:32.322051+0000","last_fullsized":"2024-09-12T01:11:32.322051+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-12T01:11:32.321961+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-12T01:11:32.321961+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.321961+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:11.086077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":585,"num_read_kb":583,"num_write":433,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'4340","reported_seq":5011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.905715+0000","last_change":"2024-09-12T01:11:24.905715+0000","last_active":"2024-09-12T01:11:24.905715+0000","last_peered":"2024-09-12T01:11:24.905715+0000","last_clean":"2024-09-12T01:11:24.905715+0000","last_became_active":"2024-09-12T00:12:38.035743+0000","last_became_peered":"2024-09-12T00:12:38.035743+0000","last_unstale":"2024-09-12T01:11:24.905715+0000","last_undegraded":"2024-09-12T01:11:24.905715+0000","last_fullsized":"2024-09-12T01:11:24.905715+0000","mapping_epoch":29,"log_start":"263'4300","ondisk_log_start":"263'4300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4340","last_scrub_stamp":"2024-09-12T01:11:24.905599+0000","last_deep_scrub":"263'4340","last_deep_scrub_stamp":"2024-09-12T01:11:24.905599+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.905599+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:01.008082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17417,"num_read_kb":14583,"num_write":6500,"num_write_kb":3272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'359","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.279315+0000","last_change":"2024-09-12T01:11:05.279315+0000","last_active":"2024-09-12T01:11:05.279315+0000","last_peered":"2024-09-12T01:11:05.279315+0000","last_clean":"2024-09-12T01:11:05.279315+0000","last_became_active":"2024-09-12T00:12:36.038014+0000","last_became_peered":"2024-09-12T00:12:36.038014+0000","last_unstale":"2024-09-12T01:11:05.279315+0000","last_undegraded":"2024-09-12T01:11:05.279315+0000","last_fullsized":"2024-09-12T01:11:05.279315+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T01:11:05.279083+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T01:11:05.279083+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.279083+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:09.655209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924421,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":557,"num_read_kb":22312,"num_write":1056,"num_write_kb":43311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.418890+0000","last_change":"2024-09-12T01:11:34.418890+0000","last_active":"2024-09-12T01:11:34.418890+0000","last_peered":"2024-09-12T01:11:34.418890+0000","last_clean":"2024-09-12T01:11:34.418890+0000","last_became_active":"2024-09-12T00:12:40.040992+0000","last_became_peered":"2024-09-12T00:12:40.040992+0000","last_unstale":"2024-09-12T01:11:34.418890+0000","last_undegraded":"2024-09-12T01:11:34.418890+0000","last_fullsized":"2024-09-12T01:11:34.418890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:34.418792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:34.418792+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.418792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:27.413102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'288","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.252040+0000","last_change":"2024-09-12T01:11:21.252040+0000","last_active":"2024-09-12T01:11:21.252040+0000","last_peered":"2024-09-12T01:11:21.252040+0000","last_clean":"2024-09-12T01:11:21.252040+0000","last_became_active":"2024-09-12T00:12:42.041042+0000","last_became_peered":"2024-09-12T00:12:42.041042+0000","last_unstale":"2024-09-12T01:11:21.252040+0000","last_undegraded":"2024-09-12T01:11:21.252040+0000","last_fullsized":"2024-09-12T01:11:21.252040+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'288","last_scrub_stamp":"2024-09-12T01:11:21.251938+0000","last_deep_scrub":"263'288","last_deep_scrub_stamp":"2024-09-12T01:11:21.251938+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.251938+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:59.500381+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63399,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":1076,"num_write":376,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'807","reported_seq":2526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.840199+0000","last_change":"2024-09-12T01:11:35.840199+0000","last_active":"2024-09-12T01:11:35.840199+0000","last_peered":"2024-09-12T01:11:35.840199+0000","last_clean":"2024-09-12T01:11:35.840199+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:11:35.840199+0000","last_undegraded":"2024-09-12T01:11:35.840199+0000","last_fullsized":"2024-09-12T01:11:35.840199+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'807","last_scrub_stamp":"2024-09-12T01:11:35.840113+0000","last_deep_scrub":"263'807","last_deep_scrub_stamp":"2024-09-12T01:11:35.840113+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.840113+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:49.915223+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'191","reported_seq":829,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.356461+0000","last_change":"2024-09-12T01:11:21.356461+0000","last_active":"2024-09-12T01:11:21.356461+0000","last_peered":"2024-09-12T01:11:21.356461+0000","last_clean":"2024-09-12T01:11:21.356461+0000","last_became_active":"2024-09-12T00:12:38.040030+0000","last_became_peered":"2024-09-12T00:12:38.040030+0000","last_unstale":"2024-09-12T01:11:21.356461+0000","last_undegraded":"2024-09-12T01:11:21.356461+0000","last_fullsized":"2024-09-12T01:11:21.356461+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'191","last_scrub_stamp":"2024-09-12T01:11:21.356376+0000","last_deep_scrub":"263'191","last_deep_scrub_stamp":"2024-09-12T01:11:21.356376+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.356376+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:38.207590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":682,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'345","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.091085+0000","last_change":"2024-09-12T01:11:06.091029+0000","last_active":"2024-09-12T01:11:06.091085+0000","last_peered":"2024-09-12T01:11:06.091085+0000","last_clean":"2024-09-12T01:11:06.091085+0000","last_became_active":"2024-09-12T00:12:36.040657+0000","last_became_peered":"2024-09-12T00:12:36.040657+0000","last_unstale":"2024-09-12T01:11:06.091085+0000","last_undegraded":"2024-09-12T01:11:06.091085+0000","last_fullsized":"2024-09-12T01:11:06.091085+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-12T01:11:06.090928+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-12T01:11:06.090928+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.090928+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:36.844314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":455,"num_read_kb":5571,"num_write":1118,"num_write_kb":16904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.283806+0000","last_change":"2024-09-12T01:11:19.283806+0000","last_active":"2024-09-12T01:11:19.283806+0000","last_peered":"2024-09-12T01:11:19.283806+0000","last_clean":"2024-09-12T01:11:19.283806+0000","last_became_active":"2024-09-12T00:12:40.036362+0000","last_became_peered":"2024-09-12T00:12:40.036362+0000","last_unstale":"2024-09-12T01:11:19.283806+0000","last_undegraded":"2024-09-12T01:11:19.283806+0000","last_fullsized":"2024-09-12T01:11:19.283806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.283725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.283725+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.283725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:49.376690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'356","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.195921+0000","last_change":"2024-09-12T01:11:23.195848+0000","last_active":"2024-09-12T01:11:23.195921+0000","last_peered":"2024-09-12T01:11:23.195921+0000","last_clean":"2024-09-12T01:11:23.195921+0000","last_became_active":"2024-09-12T00:12:42.044418+0000","last_became_peered":"2024-09-12T00:12:42.044418+0000","last_unstale":"2024-09-12T01:11:23.195921+0000","last_undegraded":"2024-09-12T01:11:23.195921+0000","last_fullsized":"2024-09-12T01:11:23.195921+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-12T01:11:23.195680+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-12T01:11:23.195680+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.195680+0000","objects_scrubbed":10,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:40.037982+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51451,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":1107,"num_write":436,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.412651+0000","last_change":"2024-09-12T01:11:33.412651+0000","last_active":"2024-09-12T01:11:33.412651+0000","last_peered":"2024-09-12T01:11:33.412651+0000","last_clean":"2024-09-12T01:11:33.412651+0000","last_became_active":"2024-09-12T00:12:44.057438+0000","last_became_peered":"2024-09-12T00:12:44.057438+0000","last_unstale":"2024-09-12T01:11:33.412651+0000","last_undegraded":"2024-09-12T01:11:33.412651+0000","last_fullsized":"2024-09-12T01:11:33.412651+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.412544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.412544+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.412544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:38.474219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'560","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.343742+0000","last_change":"2024-09-12T01:11:29.343742+0000","last_active":"2024-09-12T01:11:29.343742+0000","last_peered":"2024-09-12T01:11:29.343742+0000","last_clean":"2024-09-12T01:11:29.343742+0000","last_became_active":"2024-09-12T00:12:46.060552+0000","last_became_peered":"2024-09-12T00:12:46.060552+0000","last_unstale":"2024-09-12T01:11:29.343742+0000","last_undegraded":"2024-09-12T01:11:29.343742+0000","last_fullsized":"2024-09-12T01:11:29.343742+0000","mapping_epoch":37,"log_start":"263'500","ondisk_log_start":"263'500","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'560","last_scrub_stamp":"2024-09-12T01:11:29.343647+0000","last_deep_scrub":"263'560","last_deep_scrub_stamp":"2024-09-12T01:11:29.343647+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.343647+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:44.779263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1290,"num_read_kb":1284,"num_write":1146,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'240","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.279256+0000","last_change":"2024-09-12T01:11:11.279256+0000","last_active":"2024-09-12T01:11:11.279256+0000","last_peered":"2024-09-12T01:11:11.279256+0000","last_clean":"2024-09-12T01:11:11.279256+0000","last_became_active":"2024-09-12T00:12:38.041916+0000","last_became_peered":"2024-09-12T00:12:38.041916+0000","last_unstale":"2024-09-12T01:11:11.279256+0000","last_undegraded":"2024-09-12T01:11:11.279256+0000","last_fullsized":"2024-09-12T01:11:11.279256+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'240","last_scrub_stamp":"2024-09-12T01:11:11.279182+0000","last_deep_scrub":"263'240","last_deep_scrub_stamp":"2024-09-12T01:11:11.279182+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.279182+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:57.424825+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1071,"num_read_kb":865,"num_write":389,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'325","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.153251+0000","last_change":"2024-09-12T01:11:09.153171+0000","last_active":"2024-09-12T01:11:09.153251+0000","last_peered":"2024-09-12T01:11:09.153251+0000","last_clean":"2024-09-12T01:11:09.153251+0000","last_became_active":"2024-09-12T00:12:36.042838+0000","last_became_peered":"2024-09-12T00:12:36.042838+0000","last_unstale":"2024-09-12T01:11:09.153251+0000","last_undegraded":"2024-09-12T01:11:09.153251+0000","last_fullsized":"2024-09-12T01:11:09.153251+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-09-12T01:11:09.153023+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-09-12T01:11:09.153023+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.153023+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:42.019020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":480,"num_read_kb":7238,"num_write":1062,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.336520+0000","last_change":"2024-09-12T01:11:22.336520+0000","last_active":"2024-09-12T01:11:22.336520+0000","last_peered":"2024-09-12T01:11:22.336520+0000","last_clean":"2024-09-12T01:11:22.336520+0000","last_became_active":"2024-09-12T00:12:40.042625+0000","last_became_peered":"2024-09-12T00:12:40.042625+0000","last_unstale":"2024-09-12T01:11:22.336520+0000","last_undegraded":"2024-09-12T01:11:22.336520+0000","last_fullsized":"2024-09-12T01:11:22.336520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:22.336417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:22.336417+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.336417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:38.356823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'260","reported_seq":845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.599229+0000","last_change":"2024-09-12T01:11:32.599229+0000","last_active":"2024-09-12T01:11:32.599229+0000","last_peered":"2024-09-12T01:11:32.599229+0000","last_clean":"2024-09-12T01:11:32.599229+0000","last_became_active":"2024-09-12T00:12:42.040266+0000","last_became_peered":"2024-09-12T00:12:42.040266+0000","last_unstale":"2024-09-12T01:11:32.599229+0000","last_undegraded":"2024-09-12T01:11:32.599229+0000","last_fullsized":"2024-09-12T01:11:32.599229+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-12T01:11:32.599143+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-12T01:11:32.599143+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.599143+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:32.133004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":965,"num_write":348,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.497801+0000","last_change":"2024-09-12T01:11:36.497801+0000","last_active":"2024-09-12T01:11:36.497801+0000","last_peered":"2024-09-12T01:11:36.497801+0000","last_clean":"2024-09-12T01:11:36.497801+0000","last_became_active":"2024-09-12T00:12:44.062608+0000","last_became_peered":"2024-09-12T00:12:44.062608+0000","last_unstale":"2024-09-12T01:11:36.497801+0000","last_undegraded":"2024-09-12T01:11:36.497801+0000","last_fullsized":"2024-09-12T01:11:36.497801+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:36.497719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:36.497719+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.497719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:59.343902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2414","reported_seq":4261,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.296528+0000","last_change":"2024-09-12T01:11:31.296528+0000","last_active":"2024-09-12T01:11:31.296528+0000","last_peered":"2024-09-12T01:11:31.296528+0000","last_clean":"2024-09-12T01:11:31.296528+0000","last_became_active":"2024-09-12T00:12:46.062624+0000","last_became_peered":"2024-09-12T00:12:46.062624+0000","last_unstale":"2024-09-12T01:11:31.296528+0000","last_undegraded":"2024-09-12T01:11:31.296528+0000","last_fullsized":"2024-09-12T01:11:31.296528+0000","mapping_epoch":37,"log_start":"263'2400","ondisk_log_start":"263'2400","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2414","last_scrub_stamp":"2024-09-12T01:11:31.296426+0000","last_deep_scrub":"263'2414","last_deep_scrub_stamp":"2024-09-12T01:11:31.296426+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.296426+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":2400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:10.080210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":6065,"num_write":4891,"num_write_kb":1799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'224","reported_seq":843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.214170+0000","last_change":"2024-09-12T01:11:17.214117+0000","last_active":"2024-09-12T01:11:17.214170+0000","last_peered":"2024-09-12T01:11:17.214170+0000","last_clean":"2024-09-12T01:11:17.214170+0000","last_became_active":"2024-09-12T00:12:38.042657+0000","last_became_peered":"2024-09-12T00:12:38.042657+0000","last_unstale":"2024-09-12T01:11:17.214170+0000","last_undegraded":"2024-09-12T01:11:17.214170+0000","last_fullsized":"2024-09-12T01:11:17.214170+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-12T01:11:17.214034+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-12T01:11:17.214034+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.214034+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:55.432133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":947,"num_read_kb":771,"num_write":346,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'377","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.357263+0000","last_change":"2024-09-12T01:11:13.357263+0000","last_active":"2024-09-12T01:11:13.357263+0000","last_peered":"2024-09-12T01:11:13.357263+0000","last_clean":"2024-09-12T01:11:13.357263+0000","last_became_active":"2024-09-12T00:12:36.046196+0000","last_became_peered":"2024-09-12T00:12:36.046196+0000","last_unstale":"2024-09-12T01:11:13.357263+0000","last_undegraded":"2024-09-12T01:11:13.357263+0000","last_fullsized":"2024-09-12T01:11:13.357263+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:11:13.357097+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:11:13.357097+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.357097+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:24.455244+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9646835,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":545,"num_read_kb":69753,"num_write":1204,"num_write_kb":51465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.925882+0000","last_change":"2024-09-12T01:11:27.925882+0000","last_active":"2024-09-12T01:11:27.925882+0000","last_peered":"2024-09-12T01:11:27.925882+0000","last_clean":"2024-09-12T01:11:27.925882+0000","last_became_active":"2024-09-12T00:12:40.039887+0000","last_became_peered":"2024-09-12T00:12:40.039887+0000","last_unstale":"2024-09-12T01:11:27.925882+0000","last_undegraded":"2024-09-12T01:11:27.925882+0000","last_fullsized":"2024-09-12T01:11:27.925882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:27.925797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:27.925797+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.925797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:53.232547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'339","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.420396+0000","last_change":"2024-09-12T01:11:37.420396+0000","last_active":"2024-09-12T01:11:37.420396+0000","last_peered":"2024-09-12T01:11:37.420396+0000","last_clean":"2024-09-12T01:11:37.420396+0000","last_became_active":"2024-09-12T00:12:42.051042+0000","last_became_peered":"2024-09-12T00:12:42.051042+0000","last_unstale":"2024-09-12T01:11:37.420396+0000","last_undegraded":"2024-09-12T01:11:37.420396+0000","last_fullsized":"2024-09-12T01:11:37.420396+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-12T01:11:37.420309+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-12T01:11:37.420309+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.420309+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:29.707362+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50358,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":532,"num_read_kb":1132,"num_write":424,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'807","reported_seq":2522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.886201+0000","last_change":"2024-09-12T01:11:34.886201+0000","last_active":"2024-09-12T01:11:34.886201+0000","last_peered":"2024-09-12T01:11:34.886201+0000","last_clean":"2024-09-12T01:11:34.886201+0000","last_became_active":"2024-09-12T00:12:44.057064+0000","last_became_peered":"2024-09-12T00:12:44.057064+0000","last_unstale":"2024-09-12T01:11:34.886201+0000","last_undegraded":"2024-09-12T01:11:34.886201+0000","last_fullsized":"2024-09-12T01:11:34.886201+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'807","last_scrub_stamp":"2024-09-12T01:11:34.886101+0000","last_deep_scrub":"263'807","last_deep_scrub_stamp":"2024-09-12T01:11:34.886101+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.886101+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:20.868443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'102","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.394425+0000","last_change":"2024-09-12T01:11:31.394425+0000","last_active":"2024-09-12T01:11:31.394425+0000","last_peered":"2024-09-12T01:11:31.394425+0000","last_clean":"2024-09-12T01:11:31.394425+0000","last_became_active":"2024-09-12T00:12:46.059567+0000","last_became_peered":"2024-09-12T00:12:46.059567+0000","last_unstale":"2024-09-12T01:11:31.394425+0000","last_undegraded":"2024-09-12T01:11:31.394425+0000","last_fullsized":"2024-09-12T01:11:31.394425+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'102","last_scrub_stamp":"2024-09-12T01:11:31.394337+0000","last_deep_scrub":"263'102","last_deep_scrub_stamp":"2024-09-12T01:11:31.394337+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.394337+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:06.953338+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":78,"num_write":230,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'198","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.877598+0000","last_change":"2024-09-12T01:11:19.877598+0000","last_active":"2024-09-12T01:11:19.877598+0000","last_peered":"2024-09-12T01:11:19.877598+0000","last_clean":"2024-09-12T01:11:19.877598+0000","last_became_active":"2024-09-12T00:12:38.039788+0000","last_became_peered":"2024-09-12T00:12:38.039788+0000","last_unstale":"2024-09-12T01:11:19.877598+0000","last_undegraded":"2024-09-12T01:11:19.877598+0000","last_fullsized":"2024-09-12T01:11:19.877598+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-12T01:11:19.877483+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-12T01:11:19.877483+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.877483+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:31.219578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":765,"num_write":285,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'369","reported_seq":1031,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:04.101519+0000","last_change":"2024-09-12T01:11:04.101465+0000","last_active":"2024-09-12T01:11:04.101519+0000","last_peered":"2024-09-12T01:11:04.101519+0000","last_clean":"2024-09-12T01:11:04.101519+0000","last_became_active":"2024-09-12T00:12:36.034290+0000","last_became_peered":"2024-09-12T00:12:36.034290+0000","last_unstale":"2024-09-12T01:11:04.101519+0000","last_undegraded":"2024-09-12T01:11:04.101519+0000","last_fullsized":"2024-09-12T01:11:04.101519+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-12T01:11:04.101384+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-12T01:11:04.101384+0000","last_clean_scrub_stamp":"2024-09-12T01:11:04.101384+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:59.360381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":18536,"num_write":1160,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.341959+0000","last_change":"2024-09-12T01:11:21.341959+0000","last_active":"2024-09-12T01:11:21.341959+0000","last_peered":"2024-09-12T01:11:21.341959+0000","last_clean":"2024-09-12T01:11:21.341959+0000","last_became_active":"2024-09-12T00:12:40.036551+0000","last_became_peered":"2024-09-12T00:12:40.036551+0000","last_unstale":"2024-09-12T01:11:21.341959+0000","last_undegraded":"2024-09-12T01:11:21.341959+0000","last_fullsized":"2024-09-12T01:11:21.341959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:21.341862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:21.341862+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.341862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:32.869688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'520","reported_seq":1173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.575706+0000","last_change":"2024-09-12T01:11:26.575706+0000","last_active":"2024-09-12T01:11:26.575706+0000","last_peered":"2024-09-12T01:11:26.575706+0000","last_clean":"2024-09-12T01:11:26.575706+0000","last_became_active":"2024-09-12T00:12:42.041307+0000","last_became_peered":"2024-09-12T00:12:42.041307+0000","last_unstale":"2024-09-12T01:11:26.575706+0000","last_undegraded":"2024-09-12T01:11:26.575706+0000","last_fullsized":"2024-09-12T01:11:26.575706+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'520","last_scrub_stamp":"2024-09-12T01:11:26.575606+0000","last_deep_scrub":"263'520","last_deep_scrub_stamp":"2024-09-12T01:11:26.575606+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.575606+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:07.881789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96065,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":906,"num_read_kb":2178,"num_write":748,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.959547+0000","last_change":"2024-09-12T01:11:32.959547+0000","last_active":"2024-09-12T01:11:32.959547+0000","last_peered":"2024-09-12T01:11:32.959547+0000","last_clean":"2024-09-12T01:11:32.959547+0000","last_became_active":"2024-09-12T00:12:44.049211+0000","last_became_peered":"2024-09-12T00:12:44.049211+0000","last_unstale":"2024-09-12T01:11:32.959547+0000","last_undegraded":"2024-09-12T01:11:32.959547+0000","last_fullsized":"2024-09-12T01:11:32.959547+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.959463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.959463+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.959463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:36.812726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'147","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.778629+0000","last_change":"2024-09-12T01:11:28.778629+0000","last_active":"2024-09-12T01:11:28.778629+0000","last_peered":"2024-09-12T01:11:28.778629+0000","last_clean":"2024-09-12T01:11:28.778629+0000","last_became_active":"2024-09-12T00:12:46.066431+0000","last_became_peered":"2024-09-12T00:12:46.066431+0000","last_unstale":"2024-09-12T01:11:28.778629+0000","last_undegraded":"2024-09-12T01:11:28.778629+0000","last_fullsized":"2024-09-12T01:11:28.778629+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'147","last_scrub_stamp":"2024-09-12T01:11:28.778518+0000","last_deep_scrub":"263'147","last_deep_scrub_stamp":"2024-09-12T01:11:28.778518+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.778518+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:27.549650+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":339,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'119","reported_seq":723,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.167274+0000","last_change":"2024-09-12T01:11:18.167274+0000","last_active":"2024-09-12T01:11:18.167274+0000","last_peered":"2024-09-12T01:11:18.167274+0000","last_clean":"2024-09-12T01:11:18.167274+0000","last_became_active":"2024-09-12T00:12:38.037464+0000","last_became_peered":"2024-09-12T00:12:38.037464+0000","last_unstale":"2024-09-12T01:11:18.167274+0000","last_undegraded":"2024-09-12T01:11:18.167274+0000","last_fullsized":"2024-09-12T01:11:18.167274+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T01:11:18.167145+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T01:11:18.167145+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.167145+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:04.870748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'335","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.761453+0000","last_change":"2024-09-12T01:11:06.761365+0000","last_active":"2024-09-12T01:11:06.761453+0000","last_peered":"2024-09-12T01:11:06.761453+0000","last_clean":"2024-09-12T01:11:06.761453+0000","last_became_active":"2024-09-12T00:12:36.045050+0000","last_became_peered":"2024-09-12T00:12:36.045050+0000","last_unstale":"2024-09-12T01:11:06.761453+0000","last_undegraded":"2024-09-12T01:11:06.761453+0000","last_fullsized":"2024-09-12T01:11:06.761453+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:11:06.761211+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:11:06.761211+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.761211+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:53.881887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":13364,"num_write":1093,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.698894+0000","last_change":"2024-09-12T01:11:19.698894+0000","last_active":"2024-09-12T01:11:19.698894+0000","last_peered":"2024-09-12T01:11:19.698894+0000","last_clean":"2024-09-12T01:11:19.698894+0000","last_became_active":"2024-09-12T00:12:40.038036+0000","last_became_peered":"2024-09-12T00:12:40.038036+0000","last_unstale":"2024-09-12T01:11:19.698894+0000","last_undegraded":"2024-09-12T01:11:19.698894+0000","last_fullsized":"2024-09-12T01:11:19.698894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.698778+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:02.239036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'303","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.312972+0000","last_change":"2024-09-12T01:11:27.312972+0000","last_active":"2024-09-12T01:11:27.312972+0000","last_peered":"2024-09-12T01:11:27.312972+0000","last_clean":"2024-09-12T01:11:27.312972+0000","last_became_active":"2024-09-12T00:12:42.051668+0000","last_became_peered":"2024-09-12T00:12:42.051668+0000","last_unstale":"2024-09-12T01:11:27.312972+0000","last_undegraded":"2024-09-12T01:11:27.312972+0000","last_fullsized":"2024-09-12T01:11:27.312972+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'303","last_scrub_stamp":"2024-09-12T01:11:27.312879+0000","last_deep_scrub":"263'303","last_deep_scrub_stamp":"2024-09-12T01:11:27.312879+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.312879+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:39.832181+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":1104,"num_write":460,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.743268+0000","last_change":"2024-09-12T01:11:23.743222+0000","last_active":"2024-09-12T01:11:23.743268+0000","last_peered":"2024-09-12T01:11:23.743268+0000","last_clean":"2024-09-12T01:11:23.743268+0000","last_became_active":"2024-09-12T00:12:44.061848+0000","last_became_peered":"2024-09-12T00:12:44.061848+0000","last_unstale":"2024-09-12T01:11:23.743268+0000","last_undegraded":"2024-09-12T01:11:23.743268+0000","last_fullsized":"2024-09-12T01:11:23.743268+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.743143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.743143+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.743143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:52.926960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'93","reported_seq":581,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.891502+0000","last_change":"2024-09-12T01:11:37.891502+0000","last_active":"2024-09-12T01:11:37.891502+0000","last_peered":"2024-09-12T01:11:37.891502+0000","last_clean":"2024-09-12T01:11:37.891502+0000","last_became_active":"2024-09-12T00:12:46.066121+0000","last_became_peered":"2024-09-12T00:12:46.066121+0000","last_unstale":"2024-09-12T01:11:37.891502+0000","last_undegraded":"2024-09-12T01:11:37.891502+0000","last_fullsized":"2024-09-12T01:11:37.891502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'93","last_scrub_stamp":"2024-09-12T01:11:37.891408+0000","last_deep_scrub":"263'93","last_deep_scrub_stamp":"2024-09-12T01:11:37.891408+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.891408+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:52.951291+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":71,"num_write":206,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'180","reported_seq":770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.318206+0000","last_change":"2024-09-12T01:11:22.318206+0000","last_active":"2024-09-12T01:11:22.318206+0000","last_peered":"2024-09-12T01:11:22.318206+0000","last_clean":"2024-09-12T01:11:22.318206+0000","last_became_active":"2024-09-12T00:12:38.046276+0000","last_became_peered":"2024-09-12T00:12:38.046276+0000","last_unstale":"2024-09-12T01:11:22.318206+0000","last_undegraded":"2024-09-12T01:11:22.318206+0000","last_fullsized":"2024-09-12T01:11:22.318206+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-12T01:11:22.318112+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-12T01:11:22.318112+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.318112+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:29.522845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":618,"num_write":256,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'495","reported_seq":1207,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.359640+0000","last_change":"2024-09-12T01:11:10.359579+0000","last_active":"2024-09-12T01:11:10.359640+0000","last_peered":"2024-09-12T01:11:10.359640+0000","last_clean":"2024-09-12T01:11:10.359640+0000","last_became_active":"2024-09-12T00:12:36.035311+0000","last_became_peered":"2024-09-12T00:12:36.035311+0000","last_unstale":"2024-09-12T01:11:10.359640+0000","last_undegraded":"2024-09-12T01:11:10.359640+0000","last_fullsized":"2024-09-12T01:11:10.359640+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'495","last_scrub_stamp":"2024-09-12T01:11:10.359440+0000","last_deep_scrub":"263'495","last_deep_scrub_stamp":"2024-09-12T01:11:10.359440+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.359440+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:44.647976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":942,"num_read_kb":11265,"num_write":1473,"num_write_kb":28283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.961075+0000","last_change":"2024-09-12T01:11:28.961075+0000","last_active":"2024-09-12T01:11:28.961075+0000","last_peered":"2024-09-12T01:11:28.961075+0000","last_clean":"2024-09-12T01:11:28.961075+0000","last_became_active":"2024-09-12T00:12:40.035585+0000","last_became_peered":"2024-09-12T00:12:40.035585+0000","last_unstale":"2024-09-12T01:11:28.961075+0000","last_undegraded":"2024-09-12T01:11:28.961075+0000","last_fullsized":"2024-09-12T01:11:28.961075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:28.960959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:28.960959+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.960959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:55.520073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'317","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.959538+0000","last_change":"2024-09-12T01:11:30.959538+0000","last_active":"2024-09-12T01:11:30.959538+0000","last_peered":"2024-09-12T01:11:30.959538+0000","last_clean":"2024-09-12T01:11:30.959538+0000","last_became_active":"2024-09-12T00:12:42.052279+0000","last_became_peered":"2024-09-12T00:12:42.052279+0000","last_unstale":"2024-09-12T01:11:30.959538+0000","last_undegraded":"2024-09-12T01:11:30.959538+0000","last_fullsized":"2024-09-12T01:11:30.959538+0000","mapping_epoch":33,"log_start":"263'301","ondisk_log_start":"263'301","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:11:30.959434+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:11:30.959434+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.959434+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:18.728004+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":1142,"num_write":410,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'773","reported_seq":4983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.728661+0000","last_change":"2024-09-12T01:11:22.728661+0000","last_active":"2024-09-12T01:11:22.728661+0000","last_peered":"2024-09-12T01:11:22.728661+0000","last_clean":"2024-09-12T01:11:22.728661+0000","last_became_active":"2024-09-12T00:12:44.060494+0000","last_became_peered":"2024-09-12T00:12:44.060494+0000","last_unstale":"2024-09-12T01:11:22.728661+0000","last_undegraded":"2024-09-12T01:11:22.728661+0000","last_fullsized":"2024-09-12T01:11:22.728661+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'773","last_scrub_stamp":"2024-09-12T01:11:22.728562+0000","last_deep_scrub":"263'773","last_deep_scrub_stamp":"2024-09-12T01:11:22.728562+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.728562+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:32.761136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'136","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.434756+0000","last_change":"2024-09-12T01:11:34.434756+0000","last_active":"2024-09-12T01:11:34.434756+0000","last_peered":"2024-09-12T01:11:34.434756+0000","last_clean":"2024-09-12T01:11:34.434756+0000","last_became_active":"2024-09-12T00:12:46.060211+0000","last_became_peered":"2024-09-12T00:12:46.060211+0000","last_unstale":"2024-09-12T01:11:34.434756+0000","last_undegraded":"2024-09-12T01:11:34.434756+0000","last_fullsized":"2024-09-12T01:11:34.434756+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-12T01:11:34.434647+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-12T01:11:34.434647+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.434647+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:21.846031+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":113,"num_write":319,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'256","reported_seq":896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.174716+0000","last_change":"2024-09-12T01:11:18.174716+0000","last_active":"2024-09-12T01:11:18.174716+0000","last_peered":"2024-09-12T01:11:18.174716+0000","last_clean":"2024-09-12T01:11:18.174716+0000","last_became_active":"2024-09-12T00:12:38.042601+0000","last_became_peered":"2024-09-12T00:12:38.042601+0000","last_unstale":"2024-09-12T01:11:18.174716+0000","last_undegraded":"2024-09-12T01:11:18.174716+0000","last_fullsized":"2024-09-12T01:11:18.174716+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'256","last_scrub_stamp":"2024-09-12T01:11:18.174616+0000","last_deep_scrub":"263'256","last_deep_scrub_stamp":"2024-09-12T01:11:18.174616+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.174616+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:34.619000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1116,"num_read_kb":905,"num_write":388,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'367","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.370115+0000","last_change":"2024-09-12T01:11:11.370115+0000","last_active":"2024-09-12T01:11:11.370115+0000","last_peered":"2024-09-12T01:11:11.370115+0000","last_clean":"2024-09-12T01:11:11.370115+0000","last_became_active":"2024-09-12T00:12:36.043404+0000","last_became_peered":"2024-09-12T00:12:36.043404+0000","last_unstale":"2024-09-12T01:11:11.370115+0000","last_undegraded":"2024-09-12T01:11:11.370115+0000","last_fullsized":"2024-09-12T01:11:11.370115+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-12T01:11:11.370017+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-12T01:11:11.370017+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.370017+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:25.657597+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432371,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":514,"num_read_kb":34059,"num_write":1157,"num_write_kb":45928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1469,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.344139+0000","last_change":"2024-09-12T01:11:23.344139+0000","last_active":"2024-09-12T01:11:23.344139+0000","last_peered":"2024-09-12T01:11:23.344139+0000","last_clean":"2024-09-12T01:11:23.344139+0000","last_became_active":"2024-09-12T00:12:40.035633+0000","last_became_peered":"2024-09-12T00:12:40.035633+0000","last_unstale":"2024-09-12T01:11:23.344139+0000","last_undegraded":"2024-09-12T01:11:23.344139+0000","last_fullsized":"2024-09-12T01:11:23.344139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:11:23.344051+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:11:23.344051+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.344051+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:47.428428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'87","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.424411+0000","last_change":"2024-09-12T01:11:26.424411+0000","last_active":"2024-09-12T01:11:26.424411+0000","last_peered":"2024-09-12T01:11:26.424411+0000","last_clean":"2024-09-12T01:11:26.424411+0000","last_became_active":"2024-09-12T00:12:42.051384+0000","last_became_peered":"2024-09-12T00:12:42.051384+0000","last_unstale":"2024-09-12T01:11:26.424411+0000","last_undegraded":"2024-09-12T01:11:26.424411+0000","last_fullsized":"2024-09-12T01:11:26.424411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'87","last_scrub_stamp":"2024-09-12T01:11:26.424310+0000","last_deep_scrub":"263'87","last_deep_scrub_stamp":"2024-09-12T01:11:26.424310+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.424310+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:29.942056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'777","reported_seq":4096,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.311284+0000","last_change":"2024-09-12T01:11:29.311284+0000","last_active":"2024-09-12T01:11:29.311284+0000","last_peered":"2024-09-12T01:11:29.311284+0000","last_clean":"2024-09-12T01:11:29.311284+0000","last_became_active":"2024-09-12T00:12:44.061837+0000","last_became_peered":"2024-09-12T00:12:44.061837+0000","last_unstale":"2024-09-12T01:11:29.311284+0000","last_undegraded":"2024-09-12T01:11:29.311284+0000","last_fullsized":"2024-09-12T01:11:29.311284+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-12T01:11:29.311182+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-12T01:11:29.311182+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.311182+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:13.873639+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'132","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.376678+0000","last_change":"2024-09-12T01:11:28.376678+0000","last_active":"2024-09-12T01:11:28.376678+0000","last_peered":"2024-09-12T01:11:28.376678+0000","last_clean":"2024-09-12T01:11:28.376678+0000","last_became_active":"2024-09-12T00:12:46.057978+0000","last_became_peered":"2024-09-12T00:12:46.057978+0000","last_unstale":"2024-09-12T01:11:28.376678+0000","last_undegraded":"2024-09-12T01:11:28.376678+0000","last_fullsized":"2024-09-12T01:11:28.376678+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'132","last_scrub_stamp":"2024-09-12T01:11:28.376556+0000","last_deep_scrub":"263'132","last_deep_scrub_stamp":"2024-09-12T01:11:28.376556+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.376556+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:48.943253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":126,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'235","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.760627+0000","last_change":"2024-09-12T01:11:09.760564+0000","last_active":"2024-09-12T01:11:09.760627+0000","last_peered":"2024-09-12T01:11:09.760627+0000","last_clean":"2024-09-12T01:11:09.760627+0000","last_became_active":"2024-09-12T00:12:38.037035+0000","last_became_peered":"2024-09-12T00:12:38.037035+0000","last_unstale":"2024-09-12T01:11:09.760627+0000","last_undegraded":"2024-09-12T01:11:09.760627+0000","last_fullsized":"2024-09-12T01:11:09.760627+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'235","last_scrub_stamp":"2024-09-12T01:11:09.760480+0000","last_deep_scrub":"263'235","last_deep_scrub_stamp":"2024-09-12T01:11:09.760480+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.760480+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:10.352680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":394,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'298","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.602123+0000","last_change":"2024-09-12T01:11:10.602123+0000","last_active":"2024-09-12T01:11:10.602123+0000","last_peered":"2024-09-12T01:11:10.602123+0000","last_clean":"2024-09-12T01:11:10.602123+0000","last_became_active":"2024-09-12T00:12:36.029059+0000","last_became_peered":"2024-09-12T00:12:36.029059+0000","last_unstale":"2024-09-12T01:11:10.602123+0000","last_undegraded":"2024-09-12T01:11:10.602123+0000","last_fullsized":"2024-09-12T01:11:10.602123+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'298","last_scrub_stamp":"2024-09-12T01:11:10.601960+0000","last_deep_scrub":"263'298","last_deep_scrub_stamp":"2024-09-12T01:11:10.601960+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.601960+0000","objects_scrubbed":9,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:37.836366+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4837920,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":419,"num_read_kb":19038,"num_write":995,"num_write_kb":37710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.416878+0000","last_change":"2024-09-12T01:11:31.416878+0000","last_active":"2024-09-12T01:11:31.416878+0000","last_peered":"2024-09-12T01:11:31.416878+0000","last_clean":"2024-09-12T01:11:31.416878+0000","last_became_active":"2024-09-12T00:12:40.042158+0000","last_became_peered":"2024-09-12T00:12:40.042158+0000","last_unstale":"2024-09-12T01:11:31.416878+0000","last_undegraded":"2024-09-12T01:11:31.416878+0000","last_fullsized":"2024-09-12T01:11:31.416878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:31.416768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:31.416768+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.416768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:50.244102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'357","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.375258+0000","last_change":"2024-09-12T01:11:24.375258+0000","last_active":"2024-09-12T01:11:24.375258+0000","last_peered":"2024-09-12T01:11:24.375258+0000","last_clean":"2024-09-12T01:11:24.375258+0000","last_became_active":"2024-09-12T00:12:42.048747+0000","last_became_peered":"2024-09-12T00:12:42.048747+0000","last_unstale":"2024-09-12T01:11:24.375258+0000","last_undegraded":"2024-09-12T01:11:24.375258+0000","last_fullsized":"2024-09-12T01:11:24.375258+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'357","last_scrub_stamp":"2024-09-12T01:11:24.375147+0000","last_deep_scrub":"263'357","last_deep_scrub_stamp":"2024-09-12T01:11:24.375147+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.375147+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:40.708397+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49371,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":1173,"num_write":448,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.331384+0000","last_change":"2024-09-12T01:11:23.331384+0000","last_active":"2024-09-12T01:11:23.331384+0000","last_peered":"2024-09-12T01:11:23.331384+0000","last_clean":"2024-09-12T01:11:23.331384+0000","last_became_active":"2024-09-12T00:12:44.050074+0000","last_became_peered":"2024-09-12T00:12:44.050074+0000","last_unstale":"2024-09-12T01:11:23.331384+0000","last_undegraded":"2024-09-12T01:11:23.331384+0000","last_fullsized":"2024-09-12T01:11:23.331384+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.331283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.331283+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.331283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:57.228673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'195","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.809397+0000","last_change":"2024-09-12T01:11:27.809397+0000","last_active":"2024-09-12T01:11:27.809397+0000","last_peered":"2024-09-12T01:11:27.809397+0000","last_clean":"2024-09-12T01:11:27.809397+0000","last_became_active":"2024-09-12T00:12:46.064517+0000","last_became_peered":"2024-09-12T00:12:46.064517+0000","last_unstale":"2024-09-12T01:11:27.809397+0000","last_undegraded":"2024-09-12T01:11:27.809397+0000","last_fullsized":"2024-09-12T01:11:27.809397+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'195","last_scrub_stamp":"2024-09-12T01:11:27.809309+0000","last_deep_scrub":"263'195","last_deep_scrub_stamp":"2024-09-12T01:11:27.809309+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.809309+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:19.119898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":229,"num_read_kb":204,"num_write":354,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'289","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.331049+0000","last_change":"2024-09-12T01:11:20.331049+0000","last_active":"2024-09-12T01:11:20.331049+0000","last_peered":"2024-09-12T01:11:20.331049+0000","last_clean":"2024-09-12T01:11:20.331049+0000","last_became_active":"2024-09-12T00:12:38.040885+0000","last_became_peered":"2024-09-12T00:12:38.040885+0000","last_unstale":"2024-09-12T01:11:20.331049+0000","last_undegraded":"2024-09-12T01:11:20.331049+0000","last_fullsized":"2024-09-12T01:11:20.331049+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-12T01:11:20.330958+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-12T01:11:20.330958+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.330958+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:40.353584+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1200,"num_read_kb":970,"num_write":419,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8074,"num_omap_keys":32,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:04.285268+0000","last_change":"2024-09-12T01:11:04.285268+0000","last_active":"2024-09-12T01:11:04.285268+0000","last_peered":"2024-09-12T01:11:04.285268+0000","last_clean":"2024-09-12T01:11:04.285268+0000","last_became_active":"2024-09-12T00:12:17.817880+0000","last_became_peered":"2024-09-12T00:12:17.817880+0000","last_unstale":"2024-09-12T01:11:04.285268+0000","last_undegraded":"2024-09-12T01:11:04.285268+0000","last_fullsized":"2024-09-12T01:11:04.285268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T01:11:04.285203+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T01:11:04.285203+0000","last_clean_scrub_stamp":"2024-09-12T01:11:04.285203+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:05.465929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.368102+0000","last_change":"2024-09-12T01:11:09.368102+0000","last_active":"2024-09-12T01:11:09.368102+0000","last_peered":"2024-09-12T01:11:09.368102+0000","last_clean":"2024-09-12T01:11:09.368102+0000","last_became_active":"2024-09-12T00:12:22.713297+0000","last_became_peered":"2024-09-12T00:12:22.713297+0000","last_unstale":"2024-09-12T01:11:09.368102+0000","last_undegraded":"2024-09-12T01:11:09.368102+0000","last_fullsized":"2024-09-12T01:11:09.368102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:09.368014+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:09.368014+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.368014+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:32.949309+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0014022310000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'392","reported_seq":1105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.672420+0000","last_change":"2024-09-12T01:11:05.672420+0000","last_active":"2024-09-12T01:11:05.672420+0000","last_peered":"2024-09-12T01:11:05.672420+0000","last_clean":"2024-09-12T01:11:05.672420+0000","last_became_active":"2024-09-12T00:12:36.030408+0000","last_became_peered":"2024-09-12T00:12:36.030408+0000","last_unstale":"2024-09-12T01:11:05.672420+0000","last_undegraded":"2024-09-12T01:11:05.672420+0000","last_fullsized":"2024-09-12T01:11:05.672420+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-12T01:11:05.672292+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-12T01:11:05.672292+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.672292+0000","objects_scrubbed":7,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:44.373893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262211,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":42611,"num_write":1169,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"263'4","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.138231+0000","last_change":"2024-09-12T01:11:25.138231+0000","last_active":"2024-09-12T01:11:25.138231+0000","last_peered":"2024-09-12T01:11:25.138231+0000","last_clean":"2024-09-12T01:11:25.138231+0000","last_became_active":"2024-09-12T00:12:40.039529+0000","last_became_peered":"2024-09-12T00:12:40.039529+0000","last_unstale":"2024-09-12T01:11:25.138231+0000","last_undegraded":"2024-09-12T01:11:25.138231+0000","last_fullsized":"2024-09-12T01:11:25.138231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:11:25.138154+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:11:25.138154+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.138154+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:54.590988+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'771","reported_seq":1489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.471847+0000","last_change":"2024-09-12T01:11:36.471847+0000","last_active":"2024-09-12T01:11:36.471847+0000","last_peered":"2024-09-12T01:11:36.471847+0000","last_clean":"2024-09-12T01:11:36.471847+0000","last_became_active":"2024-09-12T00:12:42.046668+0000","last_became_peered":"2024-09-12T00:12:42.046668+0000","last_unstale":"2024-09-12T01:11:36.471847+0000","last_undegraded":"2024-09-12T01:11:36.471847+0000","last_fullsized":"2024-09-12T01:11:36.471847+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'771","last_scrub_stamp":"2024-09-12T01:11:36.471732+0000","last_deep_scrub":"263'771","last_deep_scrub_stamp":"2024-09-12T01:11:36.471732+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.471732+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:32.859967+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143901,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1496,"num_read_kb":3385,"num_write":1448,"num_write_kb":1292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106668,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.932802+0000","last_change":"2024-09-12T01:11:33.932802+0000","last_active":"2024-09-12T01:11:33.932802+0000","last_peered":"2024-09-12T01:11:33.932802+0000","last_clean":"2024-09-12T01:11:33.932802+0000","last_became_active":"2024-09-12T00:12:44.053779+0000","last_became_peered":"2024-09-12T00:12:44.053779+0000","last_unstale":"2024-09-12T01:11:33.932802+0000","last_undegraded":"2024-09-12T01:11:33.932802+0000","last_fullsized":"2024-09-12T01:11:33.932802+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.932714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.932714+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.932714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:19.453742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'190","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.225982+0000","last_change":"2024-09-12T01:11:31.225982+0000","last_active":"2024-09-12T01:11:31.225982+0000","last_peered":"2024-09-12T01:11:31.225982+0000","last_clean":"2024-09-12T01:11:31.225982+0000","last_became_active":"2024-09-12T00:12:46.055501+0000","last_became_peered":"2024-09-12T00:12:46.055501+0000","last_unstale":"2024-09-12T01:11:31.225982+0000","last_undegraded":"2024-09-12T01:11:31.225982+0000","last_fullsized":"2024-09-12T01:11:31.225982+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-12T01:11:31.225881+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-12T01:11:31.225881+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.225881+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:31.545264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":436,"num_write":384,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'149","reported_seq":737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.868218+0000","last_change":"2024-09-12T01:11:18.868218+0000","last_active":"2024-09-12T01:11:18.868218+0000","last_peered":"2024-09-12T01:11:18.868218+0000","last_clean":"2024-09-12T01:11:18.868218+0000","last_became_active":"2024-09-12T00:12:38.037392+0000","last_became_peered":"2024-09-12T00:12:38.037392+0000","last_unstale":"2024-09-12T01:11:18.868218+0000","last_undegraded":"2024-09-12T01:11:18.868218+0000","last_fullsized":"2024-09-12T01:11:18.868218+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-12T01:11:18.868095+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-12T01:11:18.868095+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.868095+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:24.230817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":647,"num_read_kb":530,"num_write":212,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.270371+0000","last_change":"2024-09-12T01:11:05.270371+0000","last_active":"2024-09-12T01:11:05.270371+0000","last_peered":"2024-09-12T01:11:05.270371+0000","last_clean":"2024-09-12T01:11:05.270371+0000","last_became_active":"2024-09-12T00:12:22.713657+0000","last_became_peered":"2024-09-12T00:12:22.713657+0000","last_unstale":"2024-09-12T01:11:05.270371+0000","last_undegraded":"2024-09-12T01:11:05.270371+0000","last_fullsized":"2024-09-12T01:11:05.270371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:05.270282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:05.270282+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.270282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:52.804966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012667690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'335","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.358183+0000","last_change":"2024-09-12T01:11:06.358183+0000","last_active":"2024-09-12T01:11:06.358183+0000","last_peered":"2024-09-12T01:11:06.358183+0000","last_clean":"2024-09-12T01:11:06.358183+0000","last_became_active":"2024-09-12T00:12:36.036010+0000","last_became_peered":"2024-09-12T00:12:36.036010+0000","last_unstale":"2024-09-12T01:11:06.358183+0000","last_undegraded":"2024-09-12T01:11:06.358183+0000","last_fullsized":"2024-09-12T01:11:06.358183+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:11:06.358069+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:11:06.358069+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.358069+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.445759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":7159,"num_write":1103,"num_write_kb":37525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.447801+0000","last_change":"2024-09-12T01:11:30.447801+0000","last_active":"2024-09-12T01:11:30.447801+0000","last_peered":"2024-09-12T01:11:30.447801+0000","last_clean":"2024-09-12T01:11:30.447801+0000","last_became_active":"2024-09-12T00:12:40.039592+0000","last_became_peered":"2024-09-12T00:12:40.039592+0000","last_unstale":"2024-09-12T01:11:30.447801+0000","last_undegraded":"2024-09-12T01:11:30.447801+0000","last_fullsized":"2024-09-12T01:11:30.447801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:30.447718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:30.447718+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.447718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:02.060126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1316","reported_seq":2955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.789709+0000","last_change":"2024-09-12T01:11:25.789709+0000","last_active":"2024-09-12T01:11:25.789709+0000","last_peered":"2024-09-12T01:11:25.789709+0000","last_clean":"2024-09-12T01:11:25.789709+0000","last_became_active":"2024-09-12T00:12:42.049594+0000","last_became_peered":"2024-09-12T00:12:42.049594+0000","last_unstale":"2024-09-12T01:11:25.789709+0000","last_undegraded":"2024-09-12T01:11:25.789709+0000","last_fullsized":"2024-09-12T01:11:25.789709+0000","mapping_epoch":33,"log_start":"263'1301","ondisk_log_start":"263'1301","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1316","last_scrub_stamp":"2024-09-12T01:11:25.789564+0000","last_deep_scrub":"263'1316","last_deep_scrub_stamp":"2024-09-12T01:11:25.789564+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.789564+0000","objects_scrubbed":12,"log_size":15,"log_dups_size":1301,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:05.989198+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146958,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3903,"num_write":1160,"num_write_kb":992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.485064+0000","last_change":"2024-09-12T01:11:41.485064+0000","last_active":"2024-09-12T01:11:41.485064+0000","last_peered":"2024-09-12T01:11:41.485064+0000","last_clean":"2024-09-12T01:11:41.485064+0000","last_became_active":"2024-09-12T00:12:44.059188+0000","last_became_peered":"2024-09-12T00:12:44.059188+0000","last_unstale":"2024-09-12T01:11:41.485064+0000","last_undegraded":"2024-09-12T01:11:41.485064+0000","last_fullsized":"2024-09-12T01:11:41.485064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:41.484969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:41.484969+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.484969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:01.830123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'154","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.923474+0000","last_change":"2024-09-12T01:11:38.923474+0000","last_active":"2024-09-12T01:11:38.923474+0000","last_peered":"2024-09-12T01:11:38.923474+0000","last_clean":"2024-09-12T01:11:38.923474+0000","last_became_active":"2024-09-12T00:12:46.064993+0000","last_became_peered":"2024-09-12T00:12:46.064993+0000","last_unstale":"2024-09-12T01:11:38.923474+0000","last_undegraded":"2024-09-12T01:11:38.923474+0000","last_fullsized":"2024-09-12T01:11:38.923474+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-09-12T01:11:38.923382+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-09-12T01:11:38.923382+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.923382+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:08.239621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":277,"num_write":363,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'61","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.234785+0000","last_change":"2024-09-12T01:11:17.234785+0000","last_active":"2024-09-12T01:11:17.234785+0000","last_peered":"2024-09-12T01:11:17.234785+0000","last_clean":"2024-09-12T01:11:17.234785+0000","last_became_active":"2024-09-12T00:12:38.039492+0000","last_became_peered":"2024-09-12T00:12:38.039492+0000","last_unstale":"2024-09-12T01:11:17.234785+0000","last_undegraded":"2024-09-12T01:11:17.234785+0000","last_fullsized":"2024-09-12T01:11:17.234785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'61","last_scrub_stamp":"2024-09-12T01:11:17.234696+0000","last_deep_scrub":"263'61","last_deep_scrub_stamp":"2024-09-12T01:11:17.234696+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.234696+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:55.520286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":235,"num_write":88,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.746156+0000","last_change":"2024-09-12T01:11:07.746156+0000","last_active":"2024-09-12T01:11:07.746156+0000","last_peered":"2024-09-12T01:11:07.746156+0000","last_clean":"2024-09-12T01:11:07.746156+0000","last_became_active":"2024-09-12T00:12:22.714487+0000","last_became_peered":"2024-09-12T00:12:22.714487+0000","last_unstale":"2024-09-12T01:11:07.746156+0000","last_undegraded":"2024-09-12T01:11:07.746156+0000","last_fullsized":"2024-09-12T01:11:07.746156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:07.746070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:07.746070+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.746070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:58.957625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038937299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'315","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.637646+0000","last_change":"2024-09-12T01:11:06.637646+0000","last_active":"2024-09-12T01:11:06.637646+0000","last_peered":"2024-09-12T01:11:06.637646+0000","last_clean":"2024-09-12T01:11:06.637646+0000","last_became_active":"2024-09-12T00:12:36.042293+0000","last_became_peered":"2024-09-12T00:12:36.042293+0000","last_unstale":"2024-09-12T01:11:06.637646+0000","last_undegraded":"2024-09-12T01:11:06.637646+0000","last_fullsized":"2024-09-12T01:11:06.637646+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-09-12T01:11:06.637502+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-09-12T01:11:06.637502+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.637502+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.943410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214314,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":33497,"num_write":1058,"num_write_kb":40497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.726967+0000","last_change":"2024-09-12T01:11:18.726967+0000","last_active":"2024-09-12T01:11:18.726967+0000","last_peered":"2024-09-12T01:11:18.726967+0000","last_clean":"2024-09-12T01:11:18.726967+0000","last_became_active":"2024-09-12T00:12:40.038202+0000","last_became_peered":"2024-09-12T00:12:40.038202+0000","last_unstale":"2024-09-12T01:11:18.726967+0000","last_undegraded":"2024-09-12T01:11:18.726967+0000","last_fullsized":"2024-09-12T01:11:18.726967+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:18.726875+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:18.726875+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.726875+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:47.107289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'257","reported_seq":1498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.177486+0000","last_change":"2024-09-12T01:11:20.177486+0000","last_active":"2024-09-12T01:11:20.177486+0000","last_peered":"2024-09-12T01:11:20.177486+0000","last_clean":"2024-09-12T01:11:20.177486+0000","last_became_active":"2024-09-12T00:12:42.044498+0000","last_became_peered":"2024-09-12T00:12:42.044498+0000","last_unstale":"2024-09-12T01:11:20.177486+0000","last_undegraded":"2024-09-12T01:11:20.177486+0000","last_fullsized":"2024-09-12T01:11:20.177486+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'257","last_scrub_stamp":"2024-09-12T01:11:20.177386+0000","last_deep_scrub":"263'257","last_deep_scrub_stamp":"2024-09-12T01:11:20.177386+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.177386+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:56.030842+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":187,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.618928+0000","last_change":"2024-09-12T01:11:31.618928+0000","last_active":"2024-09-12T01:11:31.618928+0000","last_peered":"2024-09-12T01:11:31.618928+0000","last_clean":"2024-09-12T01:11:31.618928+0000","last_became_active":"2024-09-12T00:12:44.062039+0000","last_became_peered":"2024-09-12T00:12:44.062039+0000","last_unstale":"2024-09-12T01:11:31.618928+0000","last_undegraded":"2024-09-12T01:11:31.618928+0000","last_fullsized":"2024-09-12T01:11:31.618928+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:31.618832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:31.618832+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.618832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:48.890810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'262","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.464282+0000","last_change":"2024-09-12T01:11:41.464282+0000","last_active":"2024-09-12T01:11:41.464282+0000","last_peered":"2024-09-12T01:11:41.464282+0000","last_clean":"2024-09-12T01:11:41.464282+0000","last_became_active":"2024-09-12T00:12:46.053228+0000","last_became_peered":"2024-09-12T00:12:46.053228+0000","last_unstale":"2024-09-12T01:11:41.464282+0000","last_undegraded":"2024-09-12T01:11:41.464282+0000","last_fullsized":"2024-09-12T01:11:41.464282+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'262","last_scrub_stamp":"2024-09-12T01:11:41.464189+0000","last_deep_scrub":"263'262","last_deep_scrub_stamp":"2024-09-12T01:11:41.464189+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.464189+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:30.784637+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":531,"num_write":580,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'172","reported_seq":760,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.245410+0000","last_change":"2024-09-12T01:11:16.245410+0000","last_active":"2024-09-12T01:11:16.245410+0000","last_peered":"2024-09-12T01:11:16.245410+0000","last_clean":"2024-09-12T01:11:16.245410+0000","last_became_active":"2024-09-12T00:12:38.040477+0000","last_became_peered":"2024-09-12T00:12:38.040477+0000","last_unstale":"2024-09-12T01:11:16.245410+0000","last_undegraded":"2024-09-12T01:11:16.245410+0000","last_fullsized":"2024-09-12T01:11:16.245410+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-09-12T01:11:16.245307+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-09-12T01:11:16.245307+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.245307+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:24.897173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":766,"num_read_kb":623,"num_write":281,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.249463+0000","last_change":"2024-09-12T01:11:06.249463+0000","last_active":"2024-09-12T01:11:06.249463+0000","last_peered":"2024-09-12T01:11:06.249463+0000","last_clean":"2024-09-12T01:11:06.249463+0000","last_became_active":"2024-09-12T00:12:22.840587+0000","last_became_peered":"2024-09-12T00:12:22.840587+0000","last_unstale":"2024-09-12T01:11:06.249463+0000","last_undegraded":"2024-09-12T01:11:06.249463+0000","last_fullsized":"2024-09-12T01:11:06.249463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:11:06.249395+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:11:06.249395+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.249395+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:59.319645+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00065014999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'371","reported_seq":1097,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.091924+0000","last_change":"2024-09-12T01:11:05.091924+0000","last_active":"2024-09-12T01:11:05.091924+0000","last_peered":"2024-09-12T01:11:05.091924+0000","last_clean":"2024-09-12T01:11:05.091924+0000","last_became_active":"2024-09-12T00:12:36.039564+0000","last_became_peered":"2024-09-12T00:12:36.039564+0000","last_unstale":"2024-09-12T01:11:05.091924+0000","last_undegraded":"2024-09-12T01:11:05.091924+0000","last_fullsized":"2024-09-12T01:11:05.091924+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-12T01:11:05.091758+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-12T01:11:05.091758+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.091758+0000","objects_scrubbed":10,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:28.012152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568589,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":639,"num_read_kb":35583,"num_write":1189,"num_write_kb":35527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.769511+0000","last_change":"2024-09-12T01:11:17.769511+0000","last_active":"2024-09-12T01:11:17.769511+0000","last_peered":"2024-09-12T01:11:17.769511+0000","last_clean":"2024-09-12T01:11:17.769511+0000","last_became_active":"2024-09-12T00:12:40.042510+0000","last_became_peered":"2024-09-12T00:12:40.042510+0000","last_unstale":"2024-09-12T01:11:17.769511+0000","last_undegraded":"2024-09-12T01:11:17.769511+0000","last_fullsized":"2024-09-12T01:11:17.769511+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:17.769411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:17.769411+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.769411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:32.805066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'138","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.956840+0000","last_change":"2024-09-12T01:11:29.956840+0000","last_active":"2024-09-12T01:11:29.956840+0000","last_peered":"2024-09-12T01:11:29.956840+0000","last_clean":"2024-09-12T01:11:29.956840+0000","last_became_active":"2024-09-12T00:12:42.050143+0000","last_became_peered":"2024-09-12T00:12:42.050143+0000","last_unstale":"2024-09-12T01:11:29.956840+0000","last_undegraded":"2024-09-12T01:11:29.956840+0000","last_fullsized":"2024-09-12T01:11:29.956840+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'138","last_scrub_stamp":"2024-09-12T01:11:29.956738+0000","last_deep_scrub":"263'138","last_deep_scrub_stamp":"2024-09-12T01:11:29.956738+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.956738+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:27.747936+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.503337+0000","last_change":"2024-09-12T01:11:42.503337+0000","last_active":"2024-09-12T01:11:42.503337+0000","last_peered":"2024-09-12T01:11:42.503337+0000","last_clean":"2024-09-12T01:11:42.503337+0000","last_became_active":"2024-09-12T00:12:44.059037+0000","last_became_peered":"2024-09-12T00:12:44.059037+0000","last_unstale":"2024-09-12T01:11:42.503337+0000","last_undegraded":"2024-09-12T01:11:42.503337+0000","last_fullsized":"2024-09-12T01:11:42.503337+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:42.503235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:42.503235+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.503235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:26.070012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'164","reported_seq":724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.315796+0000","last_change":"2024-09-12T01:11:33.315796+0000","last_active":"2024-09-12T01:11:33.315796+0000","last_peered":"2024-09-12T01:11:33.315796+0000","last_clean":"2024-09-12T01:11:33.315796+0000","last_became_active":"2024-09-12T00:12:46.068934+0000","last_became_peered":"2024-09-12T00:12:46.068934+0000","last_unstale":"2024-09-12T01:11:33.315796+0000","last_undegraded":"2024-09-12T01:11:33.315796+0000","last_fullsized":"2024-09-12T01:11:33.315796+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'164","last_scrub_stamp":"2024-09-12T01:11:33.315710+0000","last_deep_scrub":"263'164","last_deep_scrub_stamp":"2024-09-12T01:11:33.315710+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.315710+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:58.486227+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":270,"num_read_kb":259,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'111","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.199730+0000","last_change":"2024-09-12T01:11:15.199730+0000","last_active":"2024-09-12T01:11:15.199730+0000","last_peered":"2024-09-12T01:11:15.199730+0000","last_clean":"2024-09-12T01:11:15.199730+0000","last_became_active":"2024-09-12T00:12:38.044464+0000","last_became_peered":"2024-09-12T00:12:38.044464+0000","last_unstale":"2024-09-12T01:11:15.199730+0000","last_undegraded":"2024-09-12T01:11:15.199730+0000","last_fullsized":"2024-09-12T01:11:15.199730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:11:15.199631+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:11:15.199631+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.199631+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:16.550535+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":513,"num_read_kb":428,"num_write":178,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'371","reported_seq":1145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:04.190226+0000","last_change":"2024-09-12T01:11:04.190168+0000","last_active":"2024-09-12T01:11:04.190226+0000","last_peered":"2024-09-12T01:11:04.190226+0000","last_clean":"2024-09-12T01:11:04.190226+0000","last_became_active":"2024-09-12T00:12:36.036570+0000","last_became_peered":"2024-09-12T00:12:36.036570+0000","last_unstale":"2024-09-12T01:11:04.190226+0000","last_undegraded":"2024-09-12T01:11:04.190226+0000","last_fullsized":"2024-09-12T01:11:04.190226+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-12T01:11:04.190045+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-12T01:11:04.190045+0000","last_clean_scrub_stamp":"2024-09-12T01:11:04.190045+0000","objects_scrubbed":9,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:33.603768+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524373,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":804,"num_read_kb":22341,"num_write":1147,"num_write_kb":30942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.589125+0000","last_change":"2024-09-12T01:11:05.589125+0000","last_active":"2024-09-12T01:11:05.589125+0000","last_peered":"2024-09-12T01:11:05.589125+0000","last_clean":"2024-09-12T01:11:05.589125+0000","last_became_active":"2024-09-12T00:12:22.840210+0000","last_became_peered":"2024-09-12T00:12:22.840210+0000","last_unstale":"2024-09-12T01:11:05.589125+0000","last_undegraded":"2024-09-12T01:11:05.589125+0000","last_fullsized":"2024-09-12T01:11:05.589125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:05.589031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:05.589031+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.589031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:48.332487+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00043827699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.462491+0000","last_change":"2024-09-12T01:11:23.462491+0000","last_active":"2024-09-12T01:11:23.462491+0000","last_peered":"2024-09-12T01:11:23.462491+0000","last_clean":"2024-09-12T01:11:23.462491+0000","last_became_active":"2024-09-12T00:12:40.040760+0000","last_became_peered":"2024-09-12T00:12:40.040760+0000","last_unstale":"2024-09-12T01:11:23.462491+0000","last_undegraded":"2024-09-12T01:11:23.462491+0000","last_fullsized":"2024-09-12T01:11:23.462491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.462403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.462403+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.462403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:07.120114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'635","reported_seq":1315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.726383+0000","last_change":"2024-09-12T01:11:20.726383+0000","last_active":"2024-09-12T01:11:20.726383+0000","last_peered":"2024-09-12T01:11:20.726383+0000","last_clean":"2024-09-12T01:11:20.726383+0000","last_became_active":"2024-09-12T00:12:42.053472+0000","last_became_peered":"2024-09-12T00:12:42.053472+0000","last_unstale":"2024-09-12T01:11:20.726383+0000","last_undegraded":"2024-09-12T01:11:20.726383+0000","last_fullsized":"2024-09-12T01:11:20.726383+0000","mapping_epoch":33,"log_start":"263'600","ondisk_log_start":"263'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'635","last_scrub_stamp":"2024-09-12T01:11:20.726278+0000","last_deep_scrub":"263'635","last_deep_scrub_stamp":"2024-09-12T01:11:20.726278+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.726278+0000","objects_scrubbed":11,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:47.077848+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1715,"num_read_kb":3028,"num_write":2216,"num_write_kb":2038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":509110,"num_omap_keys":1156,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.329191+0000","last_change":"2024-09-12T01:11:25.329191+0000","last_active":"2024-09-12T01:11:25.329191+0000","last_peered":"2024-09-12T01:11:25.329191+0000","last_clean":"2024-09-12T01:11:25.329191+0000","last_became_active":"2024-09-12T00:12:44.048703+0000","last_became_peered":"2024-09-12T00:12:44.048703+0000","last_unstale":"2024-09-12T01:11:25.329191+0000","last_undegraded":"2024-09-12T01:11:25.329191+0000","last_fullsized":"2024-09-12T01:11:25.329191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:25.329100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:25.329100+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.329100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:40.236532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'148","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.845516+0000","last_change":"2024-09-12T01:11:40.845516+0000","last_active":"2024-09-12T01:11:40.845516+0000","last_peered":"2024-09-12T01:11:40.845516+0000","last_clean":"2024-09-12T01:11:40.845516+0000","last_became_active":"2024-09-12T00:12:46.063429+0000","last_became_peered":"2024-09-12T00:12:46.063429+0000","last_unstale":"2024-09-12T01:11:40.845516+0000","last_undegraded":"2024-09-12T01:11:40.845516+0000","last_fullsized":"2024-09-12T01:11:40.845516+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-12T01:11:40.845415+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-12T01:11:40.845415+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.845415+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:07.217647+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":320,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'178","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.232032+0000","last_change":"2024-09-12T01:11:14.232032+0000","last_active":"2024-09-12T01:11:14.232032+0000","last_peered":"2024-09-12T01:11:14.232032+0000","last_clean":"2024-09-12T01:11:14.232032+0000","last_became_active":"2024-09-12T00:12:38.041178+0000","last_became_peered":"2024-09-12T00:12:38.041178+0000","last_unstale":"2024-09-12T01:11:14.232032+0000","last_undegraded":"2024-09-12T01:11:14.232032+0000","last_fullsized":"2024-09-12T01:11:14.232032+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'178","last_scrub_stamp":"2024-09-12T01:11:14.231899+0000","last_deep_scrub":"263'178","last_deep_scrub_stamp":"2024-09-12T01:11:14.231899+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.231899+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:31.662431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":778,"num_read_kb":646,"num_write":262,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'366","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.335804+0000","last_change":"2024-09-12T01:11:07.335804+0000","last_active":"2024-09-12T01:11:07.335804+0000","last_peered":"2024-09-12T01:11:07.335804+0000","last_clean":"2024-09-12T01:11:07.335804+0000","last_became_active":"2024-09-12T00:12:36.035932+0000","last_became_peered":"2024-09-12T00:12:36.035932+0000","last_unstale":"2024-09-12T01:11:07.335804+0000","last_undegraded":"2024-09-12T01:11:07.335804+0000","last_fullsized":"2024-09-12T01:11:07.335804+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-12T01:11:07.335670+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-12T01:11:07.335670+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.335670+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:26.350544+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":22298,"num_write":1170,"num_write_kb":32564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.332587+0000","last_change":"2024-09-12T01:11:08.332587+0000","last_active":"2024-09-12T01:11:08.332587+0000","last_peered":"2024-09-12T01:11:08.332587+0000","last_clean":"2024-09-12T01:11:08.332587+0000","last_became_active":"2024-09-12T00:12:22.713263+0000","last_became_peered":"2024-09-12T00:12:22.713263+0000","last_unstale":"2024-09-12T01:11:08.332587+0000","last_undegraded":"2024-09-12T01:11:08.332587+0000","last_fullsized":"2024-09-12T01:11:08.332587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:08.332490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:08.332490+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.332490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:24.233170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065424400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.142367+0000","last_change":"2024-09-12T01:11:19.142367+0000","last_active":"2024-09-12T01:11:19.142367+0000","last_peered":"2024-09-12T01:11:19.142367+0000","last_clean":"2024-09-12T01:11:19.142367+0000","last_became_active":"2024-09-12T00:12:40.038903+0000","last_became_peered":"2024-09-12T00:12:40.038903+0000","last_unstale":"2024-09-12T01:11:19.142367+0000","last_undegraded":"2024-09-12T01:11:19.142367+0000","last_fullsized":"2024-09-12T01:11:19.142367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.142267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.142267+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.142267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:18.760101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'180","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.380764+0000","last_change":"2024-09-12T01:11:25.380764+0000","last_active":"2024-09-12T01:11:25.380764+0000","last_peered":"2024-09-12T01:11:25.380764+0000","last_clean":"2024-09-12T01:11:25.380764+0000","last_became_active":"2024-09-12T00:12:42.050580+0000","last_became_peered":"2024-09-12T00:12:42.050580+0000","last_unstale":"2024-09-12T01:11:25.380764+0000","last_undegraded":"2024-09-12T01:11:25.380764+0000","last_fullsized":"2024-09-12T01:11:25.380764+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-12T01:11:25.380659+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-12T01:11:25.380659+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.380659+0000","objects_scrubbed":8,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:36.184071+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":221,"num_write":156,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'778","reported_seq":2709,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.362048+0000","last_change":"2024-09-12T01:11:25.362048+0000","last_active":"2024-09-12T01:11:25.362048+0000","last_peered":"2024-09-12T01:11:25.362048+0000","last_clean":"2024-09-12T01:11:25.362048+0000","last_became_active":"2024-09-12T00:12:44.050295+0000","last_became_peered":"2024-09-12T00:12:44.050295+0000","last_unstale":"2024-09-12T01:11:25.362048+0000","last_undegraded":"2024-09-12T01:11:25.362048+0000","last_fullsized":"2024-09-12T01:11:25.362048+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'778","last_scrub_stamp":"2024-09-12T01:11:25.361928+0000","last_deep_scrub":"263'778","last_deep_scrub_stamp":"2024-09-12T01:11:25.361928+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.361928+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:09.364763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'131","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.684055+0000","last_change":"2024-09-12T01:11:36.684055+0000","last_active":"2024-09-12T01:11:36.684055+0000","last_peered":"2024-09-12T01:11:36.684055+0000","last_clean":"2024-09-12T01:11:36.684055+0000","last_became_active":"2024-09-12T00:12:46.064036+0000","last_became_peered":"2024-09-12T00:12:46.064036+0000","last_unstale":"2024-09-12T01:11:36.684055+0000","last_undegraded":"2024-09-12T01:11:36.684055+0000","last_fullsized":"2024-09-12T01:11:36.684055+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-12T01:11:36.683958+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-12T01:11:36.683958+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.683958+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:14.571309+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1116,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'66","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.583250+0000","last_change":"2024-09-12T01:11:15.583250+0000","last_active":"2024-09-12T01:11:15.583250+0000","last_peered":"2024-09-12T01:11:15.583250+0000","last_clean":"2024-09-12T01:11:15.583250+0000","last_became_active":"2024-09-12T00:12:38.039759+0000","last_became_peered":"2024-09-12T00:12:38.039759+0000","last_unstale":"2024-09-12T01:11:15.583250+0000","last_undegraded":"2024-09-12T01:11:15.583250+0000","last_fullsized":"2024-09-12T01:11:15.583250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'66","last_scrub_stamp":"2024-09-12T01:11:15.583159+0000","last_deep_scrub":"263'66","last_deep_scrub_stamp":"2024-09-12T01:11:15.583159+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.583159+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:34.335798+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":290,"num_read_kb":242,"num_write":89,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":503,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'356","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.632386+0000","last_change":"2024-09-12T01:11:08.632286+0000","last_active":"2024-09-12T01:11:08.632386+0000","last_peered":"2024-09-12T01:11:08.632386+0000","last_clean":"2024-09-12T01:11:08.632386+0000","last_became_active":"2024-09-12T00:12:36.032470+0000","last_became_peered":"2024-09-12T00:12:36.032470+0000","last_unstale":"2024-09-12T01:11:08.632386+0000","last_undegraded":"2024-09-12T01:11:08.632386+0000","last_fullsized":"2024-09-12T01:11:08.632386+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-12T01:11:08.632121+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-12T01:11:08.632121+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.632121+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:33.909337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":506,"num_read_kb":9897,"num_write":1201,"num_write_kb":25017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.678646+0000","last_change":"2024-09-12T01:11:06.678646+0000","last_active":"2024-09-12T01:11:06.678646+0000","last_peered":"2024-09-12T01:11:06.678646+0000","last_clean":"2024-09-12T01:11:06.678646+0000","last_became_active":"2024-09-12T00:12:22.875452+0000","last_became_peered":"2024-09-12T00:12:22.875452+0000","last_unstale":"2024-09-12T01:11:06.678646+0000","last_undegraded":"2024-09-12T01:11:06.678646+0000","last_fullsized":"2024-09-12T01:11:06.678646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:06.678559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:06.678559+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.678559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:14.194427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040035500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.458334+0000","last_change":"2024-09-12T01:11:29.458334+0000","last_active":"2024-09-12T01:11:29.458334+0000","last_peered":"2024-09-12T01:11:29.458334+0000","last_clean":"2024-09-12T01:11:29.458334+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:11:29.458334+0000","last_undegraded":"2024-09-12T01:11:29.458334+0000","last_fullsized":"2024-09-12T01:11:29.458334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:29.458251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:29.458251+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.458251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:45.810217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'135","reported_seq":689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.446074+0000","last_change":"2024-09-12T01:11:35.446074+0000","last_active":"2024-09-12T01:11:35.446074+0000","last_peered":"2024-09-12T01:11:35.446074+0000","last_clean":"2024-09-12T01:11:35.446074+0000","last_became_active":"2024-09-12T00:12:42.048364+0000","last_became_peered":"2024-09-12T00:12:42.048364+0000","last_unstale":"2024-09-12T01:11:35.446074+0000","last_undegraded":"2024-09-12T01:11:35.446074+0000","last_fullsized":"2024-09-12T01:11:35.446074+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T01:11:35.445983+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T01:11:35.445983+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.445983+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:10.155213+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'807","reported_seq":2525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.996362+0000","last_change":"2024-09-12T01:11:31.996362+0000","last_active":"2024-09-12T01:11:31.996362+0000","last_peered":"2024-09-12T01:11:31.996362+0000","last_clean":"2024-09-12T01:11:31.996362+0000","last_became_active":"2024-09-12T00:12:44.049336+0000","last_became_peered":"2024-09-12T00:12:44.049336+0000","last_unstale":"2024-09-12T01:11:31.996362+0000","last_undegraded":"2024-09-12T01:11:31.996362+0000","last_fullsized":"2024-09-12T01:11:31.996362+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'807","last_scrub_stamp":"2024-09-12T01:11:31.996271+0000","last_deep_scrub":"263'807","last_deep_scrub_stamp":"2024-09-12T01:11:31.996271+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.996271+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:45.036685+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'276","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.880179+0000","last_change":"2024-09-12T01:11:39.880179+0000","last_active":"2024-09-12T01:11:39.880179+0000","last_peered":"2024-09-12T01:11:39.880179+0000","last_clean":"2024-09-12T01:11:39.880179+0000","last_became_active":"2024-09-12T00:12:46.064058+0000","last_became_peered":"2024-09-12T00:12:46.064058+0000","last_unstale":"2024-09-12T01:11:39.880179+0000","last_undegraded":"2024-09-12T01:11:39.880179+0000","last_fullsized":"2024-09-12T01:11:39.880179+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'276","last_scrub_stamp":"2024-09-12T01:11:39.880061+0000","last_deep_scrub":"263'276","last_deep_scrub_stamp":"2024-09-12T01:11:39.880061+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.880061+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:43.220270+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":363,"num_read_kb":352,"num_write":596,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'133","reported_seq":725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.182032+0000","last_change":"2024-09-12T01:11:06.182032+0000","last_active":"2024-09-12T01:11:06.182032+0000","last_peered":"2024-09-12T01:11:06.182032+0000","last_clean":"2024-09-12T01:11:06.182032+0000","last_became_active":"2024-09-12T00:12:38.044075+0000","last_became_peered":"2024-09-12T00:12:38.044075+0000","last_unstale":"2024-09-12T01:11:06.182032+0000","last_undegraded":"2024-09-12T01:11:06.182032+0000","last_fullsized":"2024-09-12T01:11:06.182032+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-12T01:11:06.181955+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-12T01:11:06.181955+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.181955+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:46.555230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":484,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'410","reported_seq":1169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.675980+0000","last_change":"2024-09-12T01:11:07.675922+0000","last_active":"2024-09-12T01:11:07.675980+0000","last_peered":"2024-09-12T01:11:07.675980+0000","last_clean":"2024-09-12T01:11:07.675980+0000","last_became_active":"2024-09-12T00:12:36.030644+0000","last_became_peered":"2024-09-12T00:12:36.030644+0000","last_unstale":"2024-09-12T01:11:07.675980+0000","last_undegraded":"2024-09-12T01:11:07.675980+0000","last_fullsized":"2024-09-12T01:11:07.675980+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'410","last_scrub_stamp":"2024-09-12T01:11:07.675795+0000","last_deep_scrub":"263'410","last_deep_scrub_stamp":"2024-09-12T01:11:07.675795+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.675795+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:12.979636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568642,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":738,"num_read_kb":123120,"num_write":1245,"num_write_kb":49104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.293104+0000","last_change":"2024-09-12T01:11:07.293104+0000","last_active":"2024-09-12T01:11:07.293104+0000","last_peered":"2024-09-12T01:11:07.293104+0000","last_clean":"2024-09-12T01:11:07.293104+0000","last_became_active":"2024-09-12T00:12:22.875444+0000","last_became_peered":"2024-09-12T00:12:22.875444+0000","last_unstale":"2024-09-12T01:11:07.293104+0000","last_undegraded":"2024-09-12T01:11:07.293104+0000","last_fullsized":"2024-09-12T01:11:07.293104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:07.293023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:07.293023+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.293023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:23.494982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001017387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"263'6","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.448019+0000","last_change":"2024-09-12T01:11:21.448019+0000","last_active":"2024-09-12T01:11:21.448019+0000","last_peered":"2024-09-12T01:11:21.448019+0000","last_clean":"2024-09-12T01:11:21.448019+0000","last_became_active":"2024-09-12T00:12:40.031382+0000","last_became_peered":"2024-09-12T00:12:40.031382+0000","last_unstale":"2024-09-12T01:11:21.448019+0000","last_undegraded":"2024-09-12T01:11:21.448019+0000","last_fullsized":"2024-09-12T01:11:21.448019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:21.447933+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:21.447933+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.447933+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:55.518009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'736","reported_seq":1470,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.161140+0000","last_change":"2024-09-12T01:11:26.161140+0000","last_active":"2024-09-12T01:11:26.161140+0000","last_peered":"2024-09-12T01:11:26.161140+0000","last_clean":"2024-09-12T01:11:26.161140+0000","last_became_active":"2024-09-12T00:12:42.043328+0000","last_became_peered":"2024-09-12T00:12:42.043328+0000","last_unstale":"2024-09-12T01:11:26.161140+0000","last_undegraded":"2024-09-12T01:11:26.161140+0000","last_fullsized":"2024-09-12T01:11:26.161140+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'736","last_scrub_stamp":"2024-09-12T01:11:26.161042+0000","last_deep_scrub":"263'736","last_deep_scrub_stamp":"2024-09-12T01:11:26.161042+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.161042+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:32.910416+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147946,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1306,"num_read_kb":3069,"num_write":1058,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.551253+0000","last_change":"2024-09-12T01:11:33.551253+0000","last_active":"2024-09-12T01:11:33.551253+0000","last_peered":"2024-09-12T01:11:33.551253+0000","last_clean":"2024-09-12T01:11:33.551253+0000","last_became_active":"2024-09-12T00:12:44.061206+0000","last_became_peered":"2024-09-12T00:12:44.061206+0000","last_unstale":"2024-09-12T01:11:33.551253+0000","last_undegraded":"2024-09-12T01:11:33.551253+0000","last_fullsized":"2024-09-12T01:11:33.551253+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.551163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.551163+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.551163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:30.138665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'99","reported_seq":601,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.348833+0000","last_change":"2024-09-12T01:11:30.348833+0000","last_active":"2024-09-12T01:11:30.348833+0000","last_peered":"2024-09-12T01:11:30.348833+0000","last_clean":"2024-09-12T01:11:30.348833+0000","last_became_active":"2024-09-12T00:12:46.058465+0000","last_became_peered":"2024-09-12T00:12:46.058465+0000","last_unstale":"2024-09-12T01:11:30.348833+0000","last_undegraded":"2024-09-12T01:11:30.348833+0000","last_fullsized":"2024-09-12T01:11:30.348833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'99","last_scrub_stamp":"2024-09-12T01:11:30.348742+0000","last_deep_scrub":"263'99","last_deep_scrub_stamp":"2024-09-12T01:11:30.348742+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.348742+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:01.724178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":101,"num_write":234,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'140","reported_seq":715,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.475498+0000","last_change":"2024-09-12T01:11:40.475498+0000","last_active":"2024-09-12T01:11:40.475498+0000","last_peered":"2024-09-12T01:11:40.475498+0000","last_clean":"2024-09-12T01:11:40.475498+0000","last_became_active":"2024-09-12T00:12:46.063423+0000","last_became_peered":"2024-09-12T00:12:46.063423+0000","last_unstale":"2024-09-12T01:11:40.475498+0000","last_undegraded":"2024-09-12T01:11:40.475498+0000","last_fullsized":"2024-09-12T01:11:40.475498+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'140","last_scrub_stamp":"2024-09-12T01:11:40.475408+0000","last_deep_scrub":"263'140","last_deep_scrub_stamp":"2024-09-12T01:11:40.475408+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.475408+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:53.336911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":252,"num_write":335,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'151","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.153506+0000","last_change":"2024-09-12T01:11:08.153506+0000","last_active":"2024-09-12T01:11:08.153506+0000","last_peered":"2024-09-12T01:11:08.153506+0000","last_clean":"2024-09-12T01:11:08.153506+0000","last_became_active":"2024-09-12T00:12:38.041665+0000","last_became_peered":"2024-09-12T00:12:38.041665+0000","last_unstale":"2024-09-12T01:11:08.153506+0000","last_undegraded":"2024-09-12T01:11:08.153506+0000","last_fullsized":"2024-09-12T01:11:08.153506+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-12T01:11:08.153413+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-12T01:11:08.153413+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.153413+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:15.216054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":652,"num_read_kb":531,"num_write":244,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'302","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.351636+0000","last_change":"2024-09-12T01:11:14.351574+0000","last_active":"2024-09-12T01:11:14.351636+0000","last_peered":"2024-09-12T01:11:14.351636+0000","last_clean":"2024-09-12T01:11:14.351636+0000","last_became_active":"2024-09-12T00:13:07.152470+0000","last_became_peered":"2024-09-12T00:13:07.152470+0000","last_unstale":"2024-09-12T01:11:14.351636+0000","last_undegraded":"2024-09-12T01:11:14.351636+0000","last_fullsized":"2024-09-12T01:11:14.351636+0000","mapping_epoch":40,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-12T01:11:14.351438+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-12T01:11:14.351438+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.351438+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:06.001614+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5098973,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":439,"num_read_kb":19566,"num_write":916,"num_write_kb":20485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.301017+0000","last_change":"2024-09-12T01:11:23.301017+0000","last_active":"2024-09-12T01:11:23.301017+0000","last_peered":"2024-09-12T01:11:23.301017+0000","last_clean":"2024-09-12T01:11:23.301017+0000","last_became_active":"2024-09-12T00:12:40.038618+0000","last_became_peered":"2024-09-12T00:12:40.038618+0000","last_unstale":"2024-09-12T01:11:23.301017+0000","last_undegraded":"2024-09-12T01:11:23.301017+0000","last_fullsized":"2024-09-12T01:11:23.301017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.300915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.300915+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.300915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:59.972534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'284","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.433394+0000","last_change":"2024-09-12T01:11:28.433394+0000","last_active":"2024-09-12T01:11:28.433394+0000","last_peered":"2024-09-12T01:11:28.433394+0000","last_clean":"2024-09-12T01:11:28.433394+0000","last_became_active":"2024-09-12T00:12:42.049685+0000","last_became_peered":"2024-09-12T00:12:42.049685+0000","last_unstale":"2024-09-12T01:11:28.433394+0000","last_undegraded":"2024-09-12T01:11:28.433394+0000","last_fullsized":"2024-09-12T01:11:28.433394+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'284","last_scrub_stamp":"2024-09-12T01:11:28.433284+0000","last_deep_scrub":"263'284","last_deep_scrub_stamp":"2024-09-12T01:11:28.433284+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.433284+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:24.058698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49303,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":1021,"num_write":368,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.766555+0000","last_change":"2024-09-12T01:11:24.766555+0000","last_active":"2024-09-12T01:11:24.766555+0000","last_peered":"2024-09-12T01:11:24.766555+0000","last_clean":"2024-09-12T01:11:24.766555+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:11:24.766555+0000","last_undegraded":"2024-09-12T01:11:24.766555+0000","last_fullsized":"2024-09-12T01:11:24.766555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.766460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.766460+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.766460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:23.827912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.715543+0000","last_change":"2024-09-12T01:11:30.715543+0000","last_active":"2024-09-12T01:11:30.715543+0000","last_peered":"2024-09-12T01:11:30.715543+0000","last_clean":"2024-09-12T01:11:30.715543+0000","last_became_active":"2024-09-12T00:12:46.064080+0000","last_became_peered":"2024-09-12T00:12:46.064080+0000","last_unstale":"2024-09-12T01:11:30.715543+0000","last_undegraded":"2024-09-12T01:11:30.715543+0000","last_fullsized":"2024-09-12T01:11:30.715543+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'130","last_scrub_stamp":"2024-09-12T01:11:30.715445+0000","last_deep_scrub":"263'130","last_deep_scrub_stamp":"2024-09-12T01:11:30.715445+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.715445+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:44.481368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":189,"num_write":302,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'149","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.572027+0000","last_change":"2024-09-12T01:11:12.572027+0000","last_active":"2024-09-12T01:11:12.572027+0000","last_peered":"2024-09-12T01:11:12.572027+0000","last_clean":"2024-09-12T01:11:12.572027+0000","last_became_active":"2024-09-12T00:12:38.044990+0000","last_became_peered":"2024-09-12T00:12:38.044990+0000","last_unstale":"2024-09-12T01:11:12.572027+0000","last_undegraded":"2024-09-12T01:11:12.572027+0000","last_fullsized":"2024-09-12T01:11:12.572027+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-12T01:11:12.571917+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-12T01:11:12.571917+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.571917+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:43.018147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":701,"num_read_kb":570,"num_write":228,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'340","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.110025+0000","last_change":"2024-09-12T01:11:07.110025+0000","last_active":"2024-09-12T01:11:07.110025+0000","last_peered":"2024-09-12T01:11:07.110025+0000","last_clean":"2024-09-12T01:11:07.110025+0000","last_became_active":"2024-09-12T00:12:36.034816+0000","last_became_peered":"2024-09-12T00:12:36.034816+0000","last_unstale":"2024-09-12T01:11:07.110025+0000","last_undegraded":"2024-09-12T01:11:07.110025+0000","last_fullsized":"2024-09-12T01:11:07.110025+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:11:07.109934+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:11:07.109934+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.109934+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:11.045354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":1836,"num_write":1158,"num_write_kb":16367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.568944+0000","last_change":"2024-09-12T01:11:30.568944+0000","last_active":"2024-09-12T01:11:30.568944+0000","last_peered":"2024-09-12T01:11:30.568944+0000","last_clean":"2024-09-12T01:11:30.568944+0000","last_became_active":"2024-09-12T00:12:40.042104+0000","last_became_peered":"2024-09-12T00:12:40.042104+0000","last_unstale":"2024-09-12T01:11:30.568944+0000","last_undegraded":"2024-09-12T01:11:30.568944+0000","last_fullsized":"2024-09-12T01:11:30.568944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:30.568846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:30.568846+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.568846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:43.355533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'58","reported_seq":569,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.597786+0000","last_change":"2024-09-12T01:11:29.597786+0000","last_active":"2024-09-12T01:11:29.597786+0000","last_peered":"2024-09-12T01:11:29.597786+0000","last_clean":"2024-09-12T01:11:29.597786+0000","last_became_active":"2024-09-12T00:12:42.043599+0000","last_became_peered":"2024-09-12T00:12:42.043599+0000","last_unstale":"2024-09-12T01:11:29.597786+0000","last_undegraded":"2024-09-12T01:11:29.597786+0000","last_fullsized":"2024-09-12T01:11:29.597786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'58","last_scrub_stamp":"2024-09-12T01:11:29.597680+0000","last_deep_scrub":"263'58","last_deep_scrub_stamp":"2024-09-12T01:11:29.597680+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.597680+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:43.257209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.345992+0000","last_change":"2024-09-12T01:11:26.345992+0000","last_active":"2024-09-12T01:11:26.345992+0000","last_peered":"2024-09-12T01:11:26.345992+0000","last_clean":"2024-09-12T01:11:26.345992+0000","last_became_active":"2024-09-12T00:12:44.054145+0000","last_became_peered":"2024-09-12T00:12:44.054145+0000","last_unstale":"2024-09-12T01:11:26.345992+0000","last_undegraded":"2024-09-12T01:11:26.345992+0000","last_fullsized":"2024-09-12T01:11:26.345992+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:26.345902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:26.345902+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.345902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:27.321728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'203","reported_seq":756,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.505589+0000","last_change":"2024-09-12T01:11:38.505589+0000","last_active":"2024-09-12T01:11:38.505589+0000","last_peered":"2024-09-12T01:11:38.505589+0000","last_clean":"2024-09-12T01:11:38.505589+0000","last_became_active":"2024-09-12T00:12:46.059520+0000","last_became_peered":"2024-09-12T00:12:46.059520+0000","last_unstale":"2024-09-12T01:11:38.505589+0000","last_undegraded":"2024-09-12T01:11:38.505589+0000","last_fullsized":"2024-09-12T01:11:38.505589+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'203","last_scrub_stamp":"2024-09-12T01:11:38.505473+0000","last_deep_scrub":"263'203","last_deep_scrub_stamp":"2024-09-12T01:11:38.505473+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.505473+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:27.246093+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":406,"num_read_kb":365,"num_write":468,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'124","reported_seq":731,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.605360+0000","last_change":"2024-09-12T01:11:14.605360+0000","last_active":"2024-09-12T01:11:14.605360+0000","last_peered":"2024-09-12T01:11:14.605360+0000","last_clean":"2024-09-12T01:11:14.605360+0000","last_became_active":"2024-09-12T00:12:38.040948+0000","last_became_peered":"2024-09-12T00:12:38.040948+0000","last_unstale":"2024-09-12T01:11:14.605360+0000","last_undegraded":"2024-09-12T01:11:14.605360+0000","last_fullsized":"2024-09-12T01:11:14.605360+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'124","last_scrub_stamp":"2024-09-12T01:11:14.605261+0000","last_deep_scrub":"263'124","last_deep_scrub_stamp":"2024-09-12T01:11:14.605261+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.605261+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:12.209675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":483,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'334","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.165772+0000","last_change":"2024-09-12T01:11:12.165772+0000","last_active":"2024-09-12T01:11:12.165772+0000","last_peered":"2024-09-12T01:11:12.165772+0000","last_clean":"2024-09-12T01:11:12.165772+0000","last_became_active":"2024-09-12T00:12:36.038823+0000","last_became_peered":"2024-09-12T00:12:36.038823+0000","last_unstale":"2024-09-12T01:11:12.165772+0000","last_undegraded":"2024-09-12T01:11:12.165772+0000","last_fullsized":"2024-09-12T01:11:12.165772+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'334","last_scrub_stamp":"2024-09-12T01:11:12.165636+0000","last_deep_scrub":"263'334","last_deep_scrub_stamp":"2024-09-12T01:11:12.165636+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.165636+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:57.769236+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364565,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":548,"num_read_kb":31576,"num_write":1085,"num_write_kb":24420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.176056+0000","last_change":"2024-09-12T01:11:13.176056+0000","last_active":"2024-09-12T01:11:13.176056+0000","last_peered":"2024-09-12T01:11:13.176056+0000","last_clean":"2024-09-12T01:11:13.176056+0000","last_became_active":"2024-09-12T00:12:40.030447+0000","last_became_peered":"2024-09-12T00:12:40.030447+0000","last_unstale":"2024-09-12T01:11:13.176056+0000","last_undegraded":"2024-09-12T01:11:13.176056+0000","last_fullsized":"2024-09-12T01:11:13.176056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:13.175928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:13.175928+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.175928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:21.328720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'333","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.686772+0000","last_change":"2024-09-12T01:11:21.686772+0000","last_active":"2024-09-12T01:11:21.686772+0000","last_peered":"2024-09-12T01:11:21.686772+0000","last_clean":"2024-09-12T01:11:21.686772+0000","last_became_active":"2024-09-12T00:12:42.050885+0000","last_became_peered":"2024-09-12T00:12:42.050885+0000","last_unstale":"2024-09-12T01:11:21.686772+0000","last_undegraded":"2024-09-12T01:11:21.686772+0000","last_fullsized":"2024-09-12T01:11:21.686772+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-09-12T01:11:21.686676+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-09-12T01:11:21.686676+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.686676+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:09.163305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52758,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":1216,"num_write":438,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.340453+0000","last_change":"2024-09-12T01:11:26.340453+0000","last_active":"2024-09-12T01:11:26.340453+0000","last_peered":"2024-09-12T01:11:26.340453+0000","last_clean":"2024-09-12T01:11:26.340453+0000","last_became_active":"2024-09-12T00:12:44.056032+0000","last_became_peered":"2024-09-12T00:12:44.056032+0000","last_unstale":"2024-09-12T01:11:26.340453+0000","last_undegraded":"2024-09-12T01:11:26.340453+0000","last_fullsized":"2024-09-12T01:11:26.340453+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:26.340260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:26.340260+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.340260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:13.793288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'121","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:28.354255+0000","last_change":"2024-09-12T00:12:46.063983+0000","last_active":"2024-09-12T01:08:28.354255+0000","last_peered":"2024-09-12T01:08:28.354255+0000","last_clean":"2024-09-12T01:08:28.354255+0000","last_became_active":"2024-09-12T00:12:46.063700+0000","last_became_peered":"2024-09-12T00:12:46.063700+0000","last_unstale":"2024-09-12T01:08:28.354255+0000","last_undegraded":"2024-09-12T01:08:28.354255+0000","last_fullsized":"2024-09-12T01:08:28.354255+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:48.139495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'4185","reported_seq":4818,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.690012+0000","last_change":"2024-09-12T01:11:12.690012+0000","last_active":"2024-09-12T01:11:12.690012+0000","last_peered":"2024-09-12T01:11:12.690012+0000","last_clean":"2024-09-12T01:11:12.690012+0000","last_became_active":"2024-09-12T00:12:38.042680+0000","last_became_peered":"2024-09-12T00:12:38.042680+0000","last_unstale":"2024-09-12T01:11:12.690012+0000","last_undegraded":"2024-09-12T01:11:12.690012+0000","last_fullsized":"2024-09-12T01:11:12.690012+0000","mapping_epoch":29,"log_start":"263'4100","ondisk_log_start":"263'4100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4185","last_scrub_stamp":"2024-09-12T01:11:12.689931+0000","last_deep_scrub":"263'4185","last_deep_scrub_stamp":"2024-09-12T01:11:12.689931+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.689931+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":3000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:16.576940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16870,"num_read_kb":14146,"num_write":6296,"num_write_kb":3134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'370","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.630088+0000","last_change":"2024-09-12T01:11:07.630088+0000","last_active":"2024-09-12T01:11:07.630088+0000","last_peered":"2024-09-12T01:11:07.630088+0000","last_clean":"2024-09-12T01:11:07.630088+0000","last_became_active":"2024-09-12T00:12:36.034292+0000","last_became_peered":"2024-09-12T00:12:36.034292+0000","last_unstale":"2024-09-12T01:11:07.630088+0000","last_undegraded":"2024-09-12T01:11:07.630088+0000","last_fullsized":"2024-09-12T01:11:07.630088+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-12T01:11:07.629972+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-12T01:11:07.629972+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.629972+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:32.054059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":3622,"num_write":1273,"num_write_kb":13483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.404602+0000","last_change":"2024-09-12T01:11:32.404602+0000","last_active":"2024-09-12T01:11:32.404602+0000","last_peered":"2024-09-12T01:11:32.404602+0000","last_clean":"2024-09-12T01:11:32.404602+0000","last_became_active":"2024-09-12T00:12:40.038192+0000","last_became_peered":"2024-09-12T00:12:40.038192+0000","last_unstale":"2024-09-12T01:11:32.404602+0000","last_undegraded":"2024-09-12T01:11:32.404602+0000","last_fullsized":"2024-09-12T01:11:32.404602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.404520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.404520+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.404520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:48.812439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'260","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.170941+0000","last_change":"2024-09-12T01:11:24.170941+0000","last_active":"2024-09-12T01:11:24.170941+0000","last_peered":"2024-09-12T01:11:24.170941+0000","last_clean":"2024-09-12T01:11:24.170941+0000","last_became_active":"2024-09-12T00:12:42.046589+0000","last_became_peered":"2024-09-12T00:12:42.046589+0000","last_unstale":"2024-09-12T01:11:24.170941+0000","last_undegraded":"2024-09-12T01:11:24.170941+0000","last_fullsized":"2024-09-12T01:11:24.170941+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-12T01:11:24.170844+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-12T01:11:24.170844+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.170844+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:16.778753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53508,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":1009,"num_write":352,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.787965+0000","last_change":"2024-09-12T01:11:26.787965+0000","last_active":"2024-09-12T01:11:26.787965+0000","last_peered":"2024-09-12T01:11:26.787965+0000","last_clean":"2024-09-12T01:11:26.787965+0000","last_became_active":"2024-09-12T00:12:44.057606+0000","last_became_peered":"2024-09-12T00:12:44.057606+0000","last_unstale":"2024-09-12T01:11:26.787965+0000","last_undegraded":"2024-09-12T01:11:26.787965+0000","last_fullsized":"2024-09-12T01:11:26.787965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:26.787877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:26.787877+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.787877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:01.737176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'180","reported_seq":742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.340966+0000","last_change":"2024-09-12T01:11:24.340966+0000","last_active":"2024-09-12T01:11:24.340966+0000","last_peered":"2024-09-12T01:11:24.340966+0000","last_clean":"2024-09-12T01:11:24.340966+0000","last_became_active":"2024-09-12T00:12:38.047545+0000","last_became_peered":"2024-09-12T00:12:38.047545+0000","last_unstale":"2024-09-12T01:11:24.340966+0000","last_undegraded":"2024-09-12T01:11:24.340966+0000","last_fullsized":"2024-09-12T01:11:24.340966+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-12T01:11:24.340882+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-12T01:11:24.340882+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.340882+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:15.550214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":815,"num_read_kb":702,"num_write":306,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'317","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.679385+0000","last_change":"2024-09-12T01:11:08.679385+0000","last_active":"2024-09-12T01:11:08.679385+0000","last_peered":"2024-09-12T01:11:08.679385+0000","last_clean":"2024-09-12T01:11:08.679385+0000","last_became_active":"2024-09-12T00:12:36.042983+0000","last_became_peered":"2024-09-12T00:12:36.042983+0000","last_unstale":"2024-09-12T01:11:08.679385+0000","last_undegraded":"2024-09-12T01:11:08.679385+0000","last_fullsized":"2024-09-12T01:11:08.679385+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:11:08.679268+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:11:08.679268+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.679268+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:45.909644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":13747,"num_write":1048,"num_write_kb":22365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.334807+0000","last_change":"2024-09-12T01:11:24.334807+0000","last_active":"2024-09-12T01:11:24.334807+0000","last_peered":"2024-09-12T01:11:24.334807+0000","last_clean":"2024-09-12T01:11:24.334807+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:11:24.334807+0000","last_undegraded":"2024-09-12T01:11:24.334807+0000","last_fullsized":"2024-09-12T01:11:24.334807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.334703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.334703+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.334703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:33.166392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'505","reported_seq":1144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.404493+0000","last_change":"2024-09-12T01:11:30.404493+0000","last_active":"2024-09-12T01:11:30.404493+0000","last_peered":"2024-09-12T01:11:30.404493+0000","last_clean":"2024-09-12T01:11:30.404493+0000","last_became_active":"2024-09-12T00:12:42.050479+0000","last_became_peered":"2024-09-12T00:12:42.050479+0000","last_unstale":"2024-09-12T01:11:30.404493+0000","last_undegraded":"2024-09-12T01:11:30.404493+0000","last_fullsized":"2024-09-12T01:11:30.404493+0000","mapping_epoch":33,"log_start":"263'400","ondisk_log_start":"263'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'505","last_scrub_stamp":"2024-09-12T01:11:30.404398+0000","last_deep_scrub":"263'505","last_deep_scrub_stamp":"2024-09-12T01:11:30.404398+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.404398+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:15.855952+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104580,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":898,"num_read_kb":2161,"num_write":774,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.370979+0000","last_change":"2024-09-12T01:11:27.370979+0000","last_active":"2024-09-12T01:11:27.370979+0000","last_peered":"2024-09-12T01:11:27.370979+0000","last_clean":"2024-09-12T01:11:27.370979+0000","last_became_active":"2024-09-12T00:12:44.061554+0000","last_became_peered":"2024-09-12T00:12:44.061554+0000","last_unstale":"2024-09-12T01:11:27.370979+0000","last_undegraded":"2024-09-12T01:11:27.370979+0000","last_fullsized":"2024-09-12T01:11:27.370979+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:27.370911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:27.370911+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.370911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:02.996936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'162","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.799614+0000","last_change":"2024-09-12T01:11:41.799614+0000","last_active":"2024-09-12T01:11:41.799614+0000","last_peered":"2024-09-12T01:11:41.799614+0000","last_clean":"2024-09-12T01:11:41.799614+0000","last_became_active":"2024-09-12T00:12:46.061727+0000","last_became_peered":"2024-09-12T00:12:46.061727+0000","last_unstale":"2024-09-12T01:11:41.799614+0000","last_undegraded":"2024-09-12T01:11:41.799614+0000","last_fullsized":"2024-09-12T01:11:41.799614+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-12T01:11:41.799508+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-12T01:11:41.799508+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.799508+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:59.525506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":216,"num_write":366,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'66","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.498922+0000","last_change":"2024-09-12T01:11:17.498922+0000","last_active":"2024-09-12T01:11:17.498922+0000","last_peered":"2024-09-12T01:11:17.498922+0000","last_clean":"2024-09-12T01:11:17.498922+0000","last_became_active":"2024-09-12T00:12:38.040282+0000","last_became_peered":"2024-09-12T00:12:38.040282+0000","last_unstale":"2024-09-12T01:11:17.498922+0000","last_undegraded":"2024-09-12T01:11:17.498922+0000","last_fullsized":"2024-09-12T01:11:17.498922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'66","last_scrub_stamp":"2024-09-12T01:11:17.498837+0000","last_deep_scrub":"263'66","last_deep_scrub_stamp":"2024-09-12T01:11:17.498837+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.498837+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:53.294116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":276,"num_write":85,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'343","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.589598+0000","last_change":"2024-09-12T01:11:09.589598+0000","last_active":"2024-09-12T01:11:09.589598+0000","last_peered":"2024-09-12T01:11:09.589598+0000","last_clean":"2024-09-12T01:11:09.589598+0000","last_became_active":"2024-09-12T00:12:36.031081+0000","last_became_peered":"2024-09-12T00:12:36.031081+0000","last_unstale":"2024-09-12T01:11:09.589598+0000","last_undegraded":"2024-09-12T01:11:09.589598+0000","last_fullsized":"2024-09-12T01:11:09.589598+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-12T01:11:09.589432+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-12T01:11:09.589432+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.589432+0000","objects_scrubbed":11,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:48.973187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069231,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":617,"num_read_kb":88557,"num_write":1073,"num_write_kb":46090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.376897+0000","last_change":"2024-09-12T01:11:24.376897+0000","last_active":"2024-09-12T01:11:24.376897+0000","last_peered":"2024-09-12T01:11:24.376897+0000","last_clean":"2024-09-12T01:11:24.376897+0000","last_became_active":"2024-09-12T00:12:40.036842+0000","last_became_peered":"2024-09-12T00:12:40.036842+0000","last_unstale":"2024-09-12T01:11:24.376897+0000","last_undegraded":"2024-09-12T01:11:24.376897+0000","last_fullsized":"2024-09-12T01:11:24.376897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.376783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.376783+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.376783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:02.847925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'307","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.478845+0000","last_change":"2024-09-12T01:11:39.478845+0000","last_active":"2024-09-12T01:11:39.478845+0000","last_peered":"2024-09-12T01:11:39.478845+0000","last_clean":"2024-09-12T01:11:39.478845+0000","last_became_active":"2024-09-12T00:12:42.043681+0000","last_became_peered":"2024-09-12T00:12:42.043681+0000","last_unstale":"2024-09-12T01:11:39.478845+0000","last_undegraded":"2024-09-12T01:11:39.478845+0000","last_fullsized":"2024-09-12T01:11:39.478845+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-12T01:11:39.478715+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-12T01:11:39.478715+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.478715+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:09.605344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58226,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":1067,"num_write":414,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.847108+0000","last_change":"2024-09-12T01:11:36.847108+0000","last_active":"2024-09-12T01:11:36.847108+0000","last_peered":"2024-09-12T01:11:36.847108+0000","last_clean":"2024-09-12T01:11:36.847108+0000","last_became_active":"2024-09-12T00:12:44.058542+0000","last_became_peered":"2024-09-12T00:12:44.058542+0000","last_unstale":"2024-09-12T01:11:36.847108+0000","last_undegraded":"2024-09-12T01:11:36.847108+0000","last_fullsized":"2024-09-12T01:11:36.847108+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:36.847002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:36.847002+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.847002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:24.866169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'190","reported_seq":718,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.049195+0000","last_change":"2024-09-12T00:12:46.063225+0000","last_active":"2024-09-12T01:08:50.049195+0000","last_peered":"2024-09-12T01:08:50.049195+0000","last_clean":"2024-09-12T01:08:50.049195+0000","last_became_active":"2024-09-12T00:12:46.062957+0000","last_became_peered":"2024-09-12T00:12:46.062957+0000","last_unstale":"2024-09-12T01:08:50.049195+0000","last_undegraded":"2024-09-12T01:08:50.049195+0000","last_fullsized":"2024-09-12T01:08:50.049195+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":323,"num_read_kb":295,"num_write":565,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'204","reported_seq":797,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.716388+0000","last_change":"2024-09-12T01:11:13.716388+0000","last_active":"2024-09-12T01:11:13.716388+0000","last_peered":"2024-09-12T01:11:13.716388+0000","last_clean":"2024-09-12T01:11:13.716388+0000","last_became_active":"2024-09-12T00:12:38.045576+0000","last_became_peered":"2024-09-12T00:12:38.045576+0000","last_unstale":"2024-09-12T01:11:13.716388+0000","last_undegraded":"2024-09-12T01:11:13.716388+0000","last_fullsized":"2024-09-12T01:11:13.716388+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'204","last_scrub_stamp":"2024-09-12T01:11:13.716299+0000","last_deep_scrub":"263'204","last_deep_scrub_stamp":"2024-09-12T01:11:13.716299+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.716299+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.905678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":691,"num_write":313,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'353","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.259922+0000","last_change":"2024-09-12T01:11:06.259922+0000","last_active":"2024-09-12T01:11:06.259922+0000","last_peered":"2024-09-12T01:11:06.259922+0000","last_clean":"2024-09-12T01:11:06.259922+0000","last_became_active":"2024-09-12T00:12:36.036446+0000","last_became_peered":"2024-09-12T00:12:36.036446+0000","last_unstale":"2024-09-12T01:11:06.259922+0000","last_undegraded":"2024-09-12T01:11:06.259922+0000","last_fullsized":"2024-09-12T01:11:06.259922+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-12T01:11:06.259787+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-12T01:11:06.259787+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.259787+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:04.148146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434692,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":621,"num_read_kb":64541,"num_write":1186,"num_write_kb":11770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.216836+0000","last_change":"2024-09-12T01:11:19.216836+0000","last_active":"2024-09-12T01:11:19.216836+0000","last_peered":"2024-09-12T01:11:19.216836+0000","last_clean":"2024-09-12T01:11:19.216836+0000","last_became_active":"2024-09-12T00:12:40.029908+0000","last_became_peered":"2024-09-12T00:12:40.029908+0000","last_unstale":"2024-09-12T01:11:19.216836+0000","last_undegraded":"2024-09-12T01:11:19.216836+0000","last_fullsized":"2024-09-12T01:11:19.216836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.216748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.216748+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.216748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:17.680930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'285","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.418321+0000","last_change":"2024-09-12T01:11:29.418321+0000","last_active":"2024-09-12T01:11:29.418321+0000","last_peered":"2024-09-12T01:11:29.418321+0000","last_clean":"2024-09-12T01:11:29.418321+0000","last_became_active":"2024-09-12T00:12:42.050599+0000","last_became_peered":"2024-09-12T00:12:42.050599+0000","last_unstale":"2024-09-12T01:11:29.418321+0000","last_undegraded":"2024-09-12T01:11:29.418321+0000","last_fullsized":"2024-09-12T01:11:29.418321+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'285","last_scrub_stamp":"2024-09-12T01:11:29.418200+0000","last_deep_scrub":"263'285","last_deep_scrub_stamp":"2024-09-12T01:11:29.418200+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.418200+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:15.849823+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50970,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":947,"num_write":354,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.758688+0000","last_change":"2024-09-12T01:11:29.758688+0000","last_active":"2024-09-12T01:11:29.758688+0000","last_peered":"2024-09-12T01:11:29.758688+0000","last_clean":"2024-09-12T01:11:29.758688+0000","last_became_active":"2024-09-12T00:12:44.062419+0000","last_became_peered":"2024-09-12T00:12:44.062419+0000","last_unstale":"2024-09-12T01:11:29.758688+0000","last_undegraded":"2024-09-12T01:11:29.758688+0000","last_fullsized":"2024-09-12T01:11:29.758688+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:29.758599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:29.758599+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.758599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:16.151040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'183","reported_seq":682,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:33.012264+0000","last_change":"2024-09-12T00:12:46.067271+0000","last_active":"2024-09-12T01:10:33.012264+0000","last_peered":"2024-09-12T01:10:33.012264+0000","last_clean":"2024-09-12T01:10:33.012264+0000","last_became_active":"2024-09-12T00:12:46.066977+0000","last_became_peered":"2024-09-12T00:12:46.066977+0000","last_unstale":"2024-09-12T01:10:33.012264+0000","last_undegraded":"2024-09-12T01:10:33.012264+0000","last_fullsized":"2024-09-12T01:10:33.012264+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":141,"num_write":422,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'58","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.539314+0000","last_change":"2024-09-12T01:11:16.539314+0000","last_active":"2024-09-12T01:11:16.539314+0000","last_peered":"2024-09-12T01:11:16.539314+0000","last_clean":"2024-09-12T01:11:16.539314+0000","last_became_active":"2024-09-12T00:12:38.043886+0000","last_became_peered":"2024-09-12T00:12:38.043886+0000","last_unstale":"2024-09-12T01:11:16.539314+0000","last_undegraded":"2024-09-12T01:11:16.539314+0000","last_fullsized":"2024-09-12T01:11:16.539314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'58","last_scrub_stamp":"2024-09-12T01:11:16.539199+0000","last_deep_scrub":"263'58","last_deep_scrub_stamp":"2024-09-12T01:11:16.539199+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.539199+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:30.884432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":197,"num_write":99,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'362","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.560609+0000","last_change":"2024-09-12T01:11:11.560609+0000","last_active":"2024-09-12T01:11:11.560609+0000","last_peered":"2024-09-12T01:11:11.560609+0000","last_clean":"2024-09-12T01:11:11.560609+0000","last_became_active":"2024-09-12T00:12:36.030663+0000","last_became_peered":"2024-09-12T00:12:36.030663+0000","last_unstale":"2024-09-12T01:11:11.560609+0000","last_undegraded":"2024-09-12T01:11:11.560609+0000","last_fullsized":"2024-09-12T01:11:11.560609+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-12T01:11:11.560491+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-12T01:11:11.560491+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.560491+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:52.728704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568456,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":490,"num_read_kb":3753,"num_write":1107,"num_write_kb":36132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.615621+0000","last_change":"2024-09-12T01:11:28.615621+0000","last_active":"2024-09-12T01:11:28.615621+0000","last_peered":"2024-09-12T01:11:28.615621+0000","last_clean":"2024-09-12T01:11:28.615621+0000","last_became_active":"2024-09-12T00:12:40.040095+0000","last_became_peered":"2024-09-12T00:12:40.040095+0000","last_unstale":"2024-09-12T01:11:28.615621+0000","last_undegraded":"2024-09-12T01:11:28.615621+0000","last_fullsized":"2024-09-12T01:11:28.615621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:28.615527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:28.615527+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.615527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:29.592607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'111","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.470106+0000","last_change":"2024-09-12T01:11:40.470106+0000","last_active":"2024-09-12T01:11:40.470106+0000","last_peered":"2024-09-12T01:11:40.470106+0000","last_clean":"2024-09-12T01:11:40.470106+0000","last_became_active":"2024-09-12T00:12:42.043492+0000","last_became_peered":"2024-09-12T00:12:42.043492+0000","last_unstale":"2024-09-12T01:11:40.470106+0000","last_undegraded":"2024-09-12T01:11:40.470106+0000","last_fullsized":"2024-09-12T01:11:40.470106+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:11:40.470000+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:11:40.470000+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.470000+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:16.144396+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":110,"num_read_kb":100,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'767","reported_seq":2185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.158682+0000","last_change":"2024-09-12T01:11:28.158682+0000","last_active":"2024-09-12T01:11:28.158682+0000","last_peered":"2024-09-12T01:11:28.158682+0000","last_clean":"2024-09-12T01:11:28.158682+0000","last_became_active":"2024-09-12T00:12:44.054237+0000","last_became_peered":"2024-09-12T00:12:44.054237+0000","last_unstale":"2024-09-12T01:11:28.158682+0000","last_undegraded":"2024-09-12T01:11:28.158682+0000","last_fullsized":"2024-09-12T01:11:28.158682+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'767","last_scrub_stamp":"2024-09-12T01:11:28.158604+0000","last_deep_scrub":"263'767","last_deep_scrub_stamp":"2024-09-12T01:11:28.158604+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.158604+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:33.126576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'121","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:50.049146+0000","last_change":"2024-09-12T00:12:46.061987+0000","last_active":"2024-09-12T01:08:50.049146+0000","last_peered":"2024-09-12T01:08:50.049146+0000","last_clean":"2024-09-12T01:08:50.049146+0000","last_became_active":"2024-09-12T00:12:46.061673+0000","last_became_peered":"2024-09-12T00:12:46.061673+0000","last_unstale":"2024-09-12T01:08:50.049146+0000","last_undegraded":"2024-09-12T01:08:50.049146+0000","last_fullsized":"2024-09-12T01:08:50.049146+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'432","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.146134+0000","last_change":"2024-09-12T01:11:11.146134+0000","last_active":"2024-09-12T01:11:11.146134+0000","last_peered":"2024-09-12T01:11:11.146134+0000","last_clean":"2024-09-12T01:11:11.146134+0000","last_became_active":"2024-09-12T00:12:38.029483+0000","last_became_peered":"2024-09-12T00:12:38.029483+0000","last_unstale":"2024-09-12T01:11:11.146134+0000","last_undegraded":"2024-09-12T01:11:11.146134+0000","last_fullsized":"2024-09-12T01:11:11.146134+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'432","last_scrub_stamp":"2024-09-12T01:11:11.146047+0000","last_deep_scrub":"263'432","last_deep_scrub_stamp":"2024-09-12T01:11:11.146047+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.146047+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:10.366652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1848,"num_read_kb":1460,"num_write":651,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'351","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.306677+0000","last_change":"2024-09-12T01:11:07.306677+0000","last_active":"2024-09-12T01:11:07.306677+0000","last_peered":"2024-09-12T01:11:07.306677+0000","last_clean":"2024-09-12T01:11:07.306677+0000","last_became_active":"2024-09-12T00:12:36.034259+0000","last_became_peered":"2024-09-12T00:12:36.034259+0000","last_unstale":"2024-09-12T01:11:07.306677+0000","last_undegraded":"2024-09-12T01:11:07.306677+0000","last_fullsized":"2024-09-12T01:11:07.306677+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-12T01:11:07.306592+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-12T01:11:07.306592+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.306592+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:20.789146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":12694,"num_write":1067,"num_write_kb":34924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.297481+0000","last_change":"2024-09-12T01:11:22.297481+0000","last_active":"2024-09-12T01:11:22.297481+0000","last_peered":"2024-09-12T01:11:22.297481+0000","last_clean":"2024-09-12T01:11:22.297481+0000","last_became_active":"2024-09-12T00:12:40.034301+0000","last_became_peered":"2024-09-12T00:12:40.034301+0000","last_unstale":"2024-09-12T01:11:22.297481+0000","last_undegraded":"2024-09-12T01:11:22.297481+0000","last_fullsized":"2024-09-12T01:11:22.297481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:22.297390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:22.297390+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.297390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:58.221125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'377","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.191166+0000","last_change":"2024-09-12T01:11:27.191166+0000","last_active":"2024-09-12T01:11:27.191166+0000","last_peered":"2024-09-12T01:11:27.191166+0000","last_clean":"2024-09-12T01:11:27.191166+0000","last_became_active":"2024-09-12T00:12:42.044154+0000","last_became_peered":"2024-09-12T00:12:42.044154+0000","last_unstale":"2024-09-12T01:11:27.191166+0000","last_undegraded":"2024-09-12T01:11:27.191166+0000","last_fullsized":"2024-09-12T01:11:27.191166+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:11:27.191086+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:11:27.191086+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.191086+0000","objects_scrubbed":11,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:48.409343+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51621,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":561,"num_read_kb":1137,"num_write":454,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.441564+0000","last_change":"2024-09-12T01:11:38.441564+0000","last_active":"2024-09-12T01:11:38.441564+0000","last_peered":"2024-09-12T01:11:38.441564+0000","last_clean":"2024-09-12T01:11:38.441564+0000","last_became_active":"2024-09-12T00:12:44.059671+0000","last_became_peered":"2024-09-12T00:12:44.059671+0000","last_unstale":"2024-09-12T01:11:38.441564+0000","last_undegraded":"2024-09-12T01:11:38.441564+0000","last_fullsized":"2024-09-12T01:11:38.441564+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:38.441478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:38.441478+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.441478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:08.764517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'129","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.342103+0000","last_change":"2024-09-12T01:11:37.342103+0000","last_active":"2024-09-12T01:11:37.342103+0000","last_peered":"2024-09-12T01:11:37.342103+0000","last_clean":"2024-09-12T01:11:37.342103+0000","last_became_active":"2024-09-12T00:12:46.066777+0000","last_became_peered":"2024-09-12T00:12:46.066777+0000","last_unstale":"2024-09-12T01:11:37.342103+0000","last_undegraded":"2024-09-12T01:11:37.342103+0000","last_fullsized":"2024-09-12T01:11:37.342103+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'129","last_scrub_stamp":"2024-09-12T01:11:37.342010+0000","last_deep_scrub":"263'129","last_deep_scrub_stamp":"2024-09-12T01:11:37.342010+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.342010+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:03.914878+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":239,"num_read_kb":208,"num_write":345,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'510","reported_seq":1334,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.229612+0000","last_change":"2024-09-12T01:11:20.229612+0000","last_active":"2024-09-12T01:11:20.229612+0000","last_peered":"2024-09-12T01:11:20.229612+0000","last_clean":"2024-09-12T01:11:20.229612+0000","last_became_active":"2024-09-12T00:12:38.039996+0000","last_became_peered":"2024-09-12T00:12:38.039996+0000","last_unstale":"2024-09-12T01:11:20.229612+0000","last_undegraded":"2024-09-12T01:11:20.229612+0000","last_fullsized":"2024-09-12T01:11:20.229612+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'510","last_scrub_stamp":"2024-09-12T01:11:20.229511+0000","last_deep_scrub":"263'510","last_deep_scrub_stamp":"2024-09-12T01:11:20.229511+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.229511+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:21.104034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2706,"num_read_kb":2334,"num_write":934,"num_write_kb":583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'299","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.366645+0000","last_change":"2024-09-12T01:11:15.366645+0000","last_active":"2024-09-12T01:11:15.366645+0000","last_peered":"2024-09-12T01:11:15.366645+0000","last_clean":"2024-09-12T01:11:15.366645+0000","last_became_active":"2024-09-12T00:12:36.029998+0000","last_became_peered":"2024-09-12T00:12:36.029998+0000","last_unstale":"2024-09-12T01:11:15.366645+0000","last_undegraded":"2024-09-12T01:11:15.366645+0000","last_fullsized":"2024-09-12T01:11:15.366645+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'299","last_scrub_stamp":"2024-09-12T01:11:15.366509+0000","last_deep_scrub":"263'299","last_deep_scrub_stamp":"2024-09-12T01:11:15.366509+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.366509+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:09.932286+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":565,"num_read_kb":3980,"num_write":924,"num_write_kb":28798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.218749+0000","last_change":"2024-09-12T01:11:14.218749+0000","last_active":"2024-09-12T01:11:14.218749+0000","last_peered":"2024-09-12T01:11:14.218749+0000","last_clean":"2024-09-12T01:11:14.218749+0000","last_became_active":"2024-09-12T00:12:40.038037+0000","last_became_peered":"2024-09-12T00:12:40.038037+0000","last_unstale":"2024-09-12T01:11:14.218749+0000","last_undegraded":"2024-09-12T01:11:14.218749+0000","last_fullsized":"2024-09-12T01:11:14.218749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:14.218626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:14.218626+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.218626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:01.985443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'289","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.511035+0000","last_change":"2024-09-12T01:11:34.511035+0000","last_active":"2024-09-12T01:11:34.511035+0000","last_peered":"2024-09-12T01:11:34.511035+0000","last_clean":"2024-09-12T01:11:34.511035+0000","last_became_active":"2024-09-12T00:12:42.046917+0000","last_became_peered":"2024-09-12T00:12:42.046917+0000","last_unstale":"2024-09-12T01:11:34.511035+0000","last_undegraded":"2024-09-12T01:11:34.511035+0000","last_fullsized":"2024-09-12T01:11:34.511035+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-12T01:11:34.510930+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-12T01:11:34.510930+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.510930+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:04.641400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46808,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1160,"num_write":400,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.504840+0000","last_change":"2024-09-12T01:11:44.504840+0000","last_active":"2024-09-12T01:11:44.504840+0000","last_peered":"2024-09-12T01:11:44.504840+0000","last_clean":"2024-09-12T01:11:44.504840+0000","last_became_active":"2024-09-12T00:12:44.058006+0000","last_became_peered":"2024-09-12T00:12:44.058006+0000","last_unstale":"2024-09-12T01:11:44.504840+0000","last_undegraded":"2024-09-12T01:11:44.504840+0000","last_fullsized":"2024-09-12T01:11:44.504840+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.504724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.504724+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.504724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:49.277866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'118","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.802023+0000","last_change":"2024-09-12T01:11:42.802023+0000","last_active":"2024-09-12T01:11:42.802023+0000","last_peered":"2024-09-12T01:11:42.802023+0000","last_clean":"2024-09-12T01:11:42.802023+0000","last_became_active":"2024-09-12T00:12:46.064988+0000","last_became_peered":"2024-09-12T00:12:46.064988+0000","last_unstale":"2024-09-12T01:11:42.802023+0000","last_undegraded":"2024-09-12T01:11:42.802023+0000","last_fullsized":"2024-09-12T01:11:42.802023+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'118","last_scrub_stamp":"2024-09-12T01:11:42.801931+0000","last_deep_scrub":"263'118","last_deep_scrub_stamp":"2024-09-12T01:11:42.801931+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.801931+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:37.541718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":147,"num_write":261,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'320","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.738849+0000","last_change":"2024-09-12T01:11:11.738849+0000","last_active":"2024-09-12T01:11:11.738849+0000","last_peered":"2024-09-12T01:11:11.738849+0000","last_clean":"2024-09-12T01:11:11.738849+0000","last_became_active":"2024-09-12T00:12:38.042565+0000","last_became_peered":"2024-09-12T00:12:38.042565+0000","last_unstale":"2024-09-12T01:11:11.738849+0000","last_undegraded":"2024-09-12T01:11:11.738849+0000","last_fullsized":"2024-09-12T01:11:11.738849+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'320","last_scrub_stamp":"2024-09-12T01:11:11.738728+0000","last_deep_scrub":"263'320","last_deep_scrub_stamp":"2024-09-12T01:11:11.738728+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.738728+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:44.363536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1481,"num_read_kb":1253,"num_write":527,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'359","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.766708+0000","last_change":"2024-09-12T01:11:10.766708+0000","last_active":"2024-09-12T01:11:10.766708+0000","last_peered":"2024-09-12T01:11:10.766708+0000","last_clean":"2024-09-12T01:11:10.766708+0000","last_became_active":"2024-09-12T00:12:36.042198+0000","last_became_peered":"2024-09-12T00:12:36.042198+0000","last_unstale":"2024-09-12T01:11:10.766708+0000","last_undegraded":"2024-09-12T01:11:10.766708+0000","last_fullsized":"2024-09-12T01:11:10.766708+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T01:11:10.766609+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T01:11:10.766609+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.766609+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:09.163241+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":61060,"num_write":1123,"num_write_kb":53442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.318368+0000","last_change":"2024-09-12T01:11:21.318368+0000","last_active":"2024-09-12T01:11:21.318368+0000","last_peered":"2024-09-12T01:11:21.318368+0000","last_clean":"2024-09-12T01:11:21.318368+0000","last_became_active":"2024-09-12T00:12:40.032284+0000","last_became_peered":"2024-09-12T00:12:40.032284+0000","last_unstale":"2024-09-12T01:11:21.318368+0000","last_undegraded":"2024-09-12T01:11:21.318368+0000","last_fullsized":"2024-09-12T01:11:21.318368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:21.318282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:21.318282+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.318282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:49.292980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'259","reported_seq":825,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.470032+0000","last_change":"2024-09-12T01:11:27.470032+0000","last_active":"2024-09-12T01:11:27.470032+0000","last_peered":"2024-09-12T01:11:27.470032+0000","last_clean":"2024-09-12T01:11:27.470032+0000","last_became_active":"2024-09-12T00:12:42.051133+0000","last_became_peered":"2024-09-12T00:12:42.051133+0000","last_unstale":"2024-09-12T01:11:27.470032+0000","last_undegraded":"2024-09-12T01:11:27.470032+0000","last_fullsized":"2024-09-12T01:11:27.470032+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'259","last_scrub_stamp":"2024-09-12T01:11:27.469938+0000","last_deep_scrub":"263'259","last_deep_scrub_stamp":"2024-09-12T01:11:27.469938+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.469938+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:48.123908+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":1053,"num_write":352,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:07:45.041676+0000","last_change":"2024-09-12T00:12:44.060747+0000","last_active":"2024-09-12T01:07:45.041676+0000","last_peered":"2024-09-12T01:07:45.041676+0000","last_clean":"2024-09-12T01:07:45.041676+0000","last_became_active":"2024-09-12T00:12:44.060464+0000","last_became_peered":"2024-09-12T00:12:44.060464+0000","last_unstale":"2024-09-12T01:07:45.041676+0000","last_undegraded":"2024-09-12T01:07:45.041676+0000","last_fullsized":"2024-09-12T01:07:45.041676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:43.028171+0000","last_clean_scrub_stamp":"2024-09-12T00:12:43.028171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:56.068981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'150","reported_seq":1608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:20.570464+0000","last_change":"2024-09-12T00:12:46.064822+0000","last_active":"2024-09-12T01:09:20.570464+0000","last_peered":"2024-09-12T01:09:20.570464+0000","last_clean":"2024-09-12T01:09:20.570464+0000","last_became_active":"2024-09-12T00:12:46.064565+0000","last_became_peered":"2024-09-12T00:12:46.064565+0000","last_unstale":"2024-09-12T01:09:20.570464+0000","last_undegraded":"2024-09-12T01:09:20.570464+0000","last_fullsized":"2024-09-12T01:09:20.570464+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:12:45.041593+0000","last_clean_scrub_stamp":"2024-09-12T00:12:45.041593+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:23.873971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1152,"num_read_kb":1150,"num_write":337,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'89","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.193008+0000","last_change":"2024-09-12T01:11:10.193008+0000","last_active":"2024-09-12T01:11:10.193008+0000","last_peered":"2024-09-12T01:11:10.193008+0000","last_clean":"2024-09-12T01:11:10.193008+0000","last_became_active":"2024-09-12T00:12:38.037860+0000","last_became_peered":"2024-09-12T00:12:38.037860+0000","last_unstale":"2024-09-12T01:11:10.193008+0000","last_undegraded":"2024-09-12T01:11:10.193008+0000","last_fullsized":"2024-09-12T01:11:10.193008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'89","last_scrub_stamp":"2024-09-12T01:11:10.192888+0000","last_deep_scrub":"263'89","last_deep_scrub_stamp":"2024-09-12T01:11:10.192888+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.192888+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:09.120774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":333,"num_write":131,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'328","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.722206+0000","last_change":"2024-09-12T01:11:09.722206+0000","last_active":"2024-09-12T01:11:09.722206+0000","last_peered":"2024-09-12T01:11:09.722206+0000","last_clean":"2024-09-12T01:11:09.722206+0000","last_became_active":"2024-09-12T00:12:36.041860+0000","last_became_peered":"2024-09-12T00:12:36.041860+0000","last_unstale":"2024-09-12T01:11:09.722206+0000","last_undegraded":"2024-09-12T01:11:09.722206+0000","last_fullsized":"2024-09-12T01:11:09.722206+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-12T01:11:09.722064+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-12T01:11:09.722064+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.722064+0000","objects_scrubbed":11,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:38.287167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3984538,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":381,"num_read_kb":7023,"num_write":999,"num_write_kb":36211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.540300+0000","last_change":"2024-09-12T01:11:25.540300+0000","last_active":"2024-09-12T01:11:25.540300+0000","last_peered":"2024-09-12T01:11:25.540300+0000","last_clean":"2024-09-12T01:11:25.540300+0000","last_became_active":"2024-09-12T00:12:40.039196+0000","last_became_peered":"2024-09-12T00:12:40.039196+0000","last_unstale":"2024-09-12T01:11:25.540300+0000","last_undegraded":"2024-09-12T01:11:25.540300+0000","last_fullsized":"2024-09-12T01:11:25.540300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:25.540213+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:25.540213+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.540213+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:01.710510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'350","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.427963+0000","last_change":"2024-09-12T01:11:38.427963+0000","last_active":"2024-09-12T01:11:38.427963+0000","last_peered":"2024-09-12T01:11:38.427963+0000","last_clean":"2024-09-12T01:11:38.427963+0000","last_became_active":"2024-09-12T00:12:42.039068+0000","last_became_peered":"2024-09-12T00:12:42.039068+0000","last_unstale":"2024-09-12T01:11:38.427963+0000","last_undegraded":"2024-09-12T01:11:38.427963+0000","last_fullsized":"2024-09-12T01:11:38.427963+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-12T01:11:38.427868+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-12T01:11:38.427868+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.427868+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:08.441782+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44473,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":544,"num_read_kb":1176,"num_write":442,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.470733+0000","last_change":"2024-09-12T01:11:37.470733+0000","last_active":"2024-09-12T01:11:37.470733+0000","last_peered":"2024-09-12T01:11:37.470733+0000","last_clean":"2024-09-12T01:11:37.470733+0000","last_became_active":"2024-09-12T00:12:44.064105+0000","last_became_peered":"2024-09-12T00:12:44.064105+0000","last_unstale":"2024-09-12T01:11:37.470733+0000","last_undegraded":"2024-09-12T01:11:37.470733+0000","last_fullsized":"2024-09-12T01:11:37.470733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:37.470646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:37.470646+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.470646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:06.703919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'151","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.191321+0000","last_change":"2024-09-12T01:11:29.191321+0000","last_active":"2024-09-12T01:11:29.191321+0000","last_peered":"2024-09-12T01:11:29.191321+0000","last_clean":"2024-09-12T01:11:29.191321+0000","last_became_active":"2024-09-12T00:12:46.053763+0000","last_became_peered":"2024-09-12T00:12:46.053763+0000","last_unstale":"2024-09-12T01:11:29.191321+0000","last_undegraded":"2024-09-12T01:11:29.191321+0000","last_fullsized":"2024-09-12T01:11:29.191321+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-12T01:11:29.191223+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-12T01:11:29.191223+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.191223+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:55.982377+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":382,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'137","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.480997+0000","last_change":"2024-09-12T01:11:18.480997+0000","last_active":"2024-09-12T01:11:18.480997+0000","last_peered":"2024-09-12T01:11:18.480997+0000","last_clean":"2024-09-12T01:11:18.480997+0000","last_became_active":"2024-09-12T00:12:38.044285+0000","last_became_peered":"2024-09-12T00:12:38.044285+0000","last_unstale":"2024-09-12T01:11:18.480997+0000","last_undegraded":"2024-09-12T01:11:18.480997+0000","last_fullsized":"2024-09-12T01:11:18.480997+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-12T01:11:18.480916+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-12T01:11:18.480916+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.480916+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:51.540635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":475,"num_write":234,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'397","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.214465+0000","last_change":"2024-09-12T01:11:05.214465+0000","last_active":"2024-09-12T01:11:05.214465+0000","last_peered":"2024-09-12T01:11:05.214465+0000","last_clean":"2024-09-12T01:11:05.214465+0000","last_became_active":"2024-09-12T00:12:36.036773+0000","last_became_peered":"2024-09-12T00:12:36.036773+0000","last_unstale":"2024-09-12T01:11:05.214465+0000","last_undegraded":"2024-09-12T01:11:05.214465+0000","last_fullsized":"2024-09-12T01:11:05.214465+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'397","last_scrub_stamp":"2024-09-12T01:11:05.214323+0000","last_deep_scrub":"263'397","last_deep_scrub_stamp":"2024-09-12T01:11:05.214323+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.214323+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:30.254016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":606,"num_read_kb":16738,"num_write":1145,"num_write_kb":32233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'47","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.706015+0000","last_change":"2024-09-12T01:11:14.706015+0000","last_active":"2024-09-12T01:11:14.706015+0000","last_peered":"2024-09-12T01:11:14.706015+0000","last_clean":"2024-09-12T01:11:14.706015+0000","last_became_active":"2024-09-12T00:12:38.036978+0000","last_became_peered":"2024-09-12T00:12:38.036978+0000","last_unstale":"2024-09-12T01:11:14.706015+0000","last_undegraded":"2024-09-12T01:11:14.706015+0000","last_fullsized":"2024-09-12T01:11:14.706015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-12T01:11:14.705925+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-12T01:11:14.705925+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.705925+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:12.824252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":60,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'331","reported_seq":968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.770480+0000","last_change":"2024-09-12T01:11:08.770480+0000","last_active":"2024-09-12T01:11:08.770480+0000","last_peered":"2024-09-12T01:11:08.770480+0000","last_clean":"2024-09-12T01:11:08.770480+0000","last_became_active":"2024-09-12T00:12:36.035112+0000","last_became_peered":"2024-09-12T00:12:36.035112+0000","last_unstale":"2024-09-12T01:11:08.770480+0000","last_undegraded":"2024-09-12T01:11:08.770480+0000","last_fullsized":"2024-09-12T01:11:08.770480+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:11:08.770383+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:11:08.770383+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.770383+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:44.676691+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":34939,"num_write":1097,"num_write_kb":28471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'137","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.387951+0000","last_change":"2024-09-12T01:11:25.387951+0000","last_active":"2024-09-12T01:11:25.387951+0000","last_peered":"2024-09-12T01:11:25.387951+0000","last_clean":"2024-09-12T01:11:25.387951+0000","last_became_active":"2024-09-12T00:12:38.040144+0000","last_became_peered":"2024-09-12T00:12:38.040144+0000","last_unstale":"2024-09-12T01:11:25.387951+0000","last_undegraded":"2024-09-12T01:11:25.387951+0000","last_fullsized":"2024-09-12T01:11:25.387951+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-12T01:11:25.387847+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-12T01:11:25.387847+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.387847+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:15.196191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":511,"num_write":216,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'319","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.411588+0000","last_change":"2024-09-12T01:11:16.411588+0000","last_active":"2024-09-12T01:11:16.411588+0000","last_peered":"2024-09-12T01:11:16.411588+0000","last_clean":"2024-09-12T01:11:16.411588+0000","last_became_active":"2024-09-12T00:12:36.035558+0000","last_became_peered":"2024-09-12T00:12:36.035558+0000","last_unstale":"2024-09-12T01:11:16.411588+0000","last_undegraded":"2024-09-12T01:11:16.411588+0000","last_fullsized":"2024-09-12T01:11:16.411588+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'319","last_scrub_stamp":"2024-09-12T01:11:16.411468+0000","last_deep_scrub":"263'319","last_deep_scrub_stamp":"2024-09-12T01:11:16.411468+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.411468+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:51.561801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287622,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":7822,"num_write":966,"num_write_kb":22426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'275","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.791183+0000","last_change":"2024-09-12T01:11:21.791183+0000","last_active":"2024-09-12T01:11:21.791183+0000","last_peered":"2024-09-12T01:11:21.791183+0000","last_clean":"2024-09-12T01:11:21.791183+0000","last_became_active":"2024-09-12T00:12:38.026109+0000","last_became_peered":"2024-09-12T00:12:38.026109+0000","last_unstale":"2024-09-12T01:11:21.791183+0000","last_undegraded":"2024-09-12T01:11:21.791183+0000","last_fullsized":"2024-09-12T01:11:21.791183+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'275","last_scrub_stamp":"2024-09-12T01:11:21.791097+0000","last_deep_scrub":"263'275","last_deep_scrub_stamp":"2024-09-12T01:11:21.791097+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.791097+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:10.158792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1270,"num_read_kb":1040,"num_write":446,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'331","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.752050+0000","last_change":"2024-09-12T01:11:11.751974+0000","last_active":"2024-09-12T01:11:11.752050+0000","last_peered":"2024-09-12T01:11:11.752050+0000","last_clean":"2024-09-12T01:11:11.752050+0000","last_became_active":"2024-09-12T00:12:36.033426+0000","last_became_peered":"2024-09-12T00:12:36.033426+0000","last_unstale":"2024-09-12T01:11:11.752050+0000","last_undegraded":"2024-09-12T01:11:11.752050+0000","last_fullsized":"2024-09-12T01:11:11.752050+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:11:11.751820+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:11:11.751820+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.751820+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:01.340846+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306676,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":19382,"num_write":951,"num_write_kb":44169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'4265","reported_seq":4917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.832554+0000","last_change":"2024-09-12T01:11:20.832554+0000","last_active":"2024-09-12T01:11:20.832554+0000","last_peered":"2024-09-12T01:11:20.832554+0000","last_clean":"2024-09-12T01:11:20.832554+0000","last_became_active":"2024-09-12T00:12:38.028401+0000","last_became_peered":"2024-09-12T00:12:38.028401+0000","last_unstale":"2024-09-12T01:11:20.832554+0000","last_undegraded":"2024-09-12T01:11:20.832554+0000","last_fullsized":"2024-09-12T01:11:20.832554+0000","mapping_epoch":29,"log_start":"263'4200","ondisk_log_start":"263'4200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4265","last_scrub_stamp":"2024-09-12T01:11:20.832469+0000","last_deep_scrub":"263'4265","last_deep_scrub_stamp":"2024-09-12T01:11:20.832469+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.832469+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":3000,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:00.963732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17227,"num_read_kb":14428,"num_write":6422,"num_write_kb":3205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'326","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.234518+0000","last_change":"2024-09-12T01:11:12.234518+0000","last_active":"2024-09-12T01:11:12.234518+0000","last_peered":"2024-09-12T01:11:12.234518+0000","last_clean":"2024-09-12T01:11:12.234518+0000","last_became_active":"2024-09-12T00:12:36.032341+0000","last_became_peered":"2024-09-12T00:12:36.032341+0000","last_unstale":"2024-09-12T01:11:12.234518+0000","last_undegraded":"2024-09-12T01:11:12.234518+0000","last_fullsized":"2024-09-12T01:11:12.234518+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-12T01:11:12.234405+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-12T01:11:12.234405+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.234405+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:58.603991+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2561198,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":66123,"num_write":1057,"num_write_kb":26739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'149","reported_seq":737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.200891+0000","last_change":"2024-09-12T01:11:15.200891+0000","last_active":"2024-09-12T01:11:15.200891+0000","last_peered":"2024-09-12T01:11:15.200891+0000","last_clean":"2024-09-12T01:11:15.200891+0000","last_became_active":"2024-09-12T00:12:38.043276+0000","last_became_peered":"2024-09-12T00:12:38.043276+0000","last_unstale":"2024-09-12T01:11:15.200891+0000","last_undegraded":"2024-09-12T01:11:15.200891+0000","last_fullsized":"2024-09-12T01:11:15.200891+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-12T01:11:15.200800+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-12T01:11:15.200800+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.200800+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:25.860652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":632,"num_read_kb":523,"num_write":222,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'311","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.295855+0000","last_change":"2024-09-12T01:11:10.295855+0000","last_active":"2024-09-12T01:11:10.295855+0000","last_peered":"2024-09-12T01:11:10.295855+0000","last_clean":"2024-09-12T01:11:10.295855+0000","last_became_active":"2024-09-12T00:12:36.029687+0000","last_became_peered":"2024-09-12T00:12:36.029687+0000","last_unstale":"2024-09-12T01:11:10.295855+0000","last_undegraded":"2024-09-12T01:11:10.295855+0000","last_fullsized":"2024-09-12T01:11:10.295855+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:11:10.295694+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:11:10.295694+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.295694+0000","objects_scrubbed":6,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:59.583411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":12036,"num_write":1041,"num_write_kb":29691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'211","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.249880+0000","last_change":"2024-09-12T01:11:19.249880+0000","last_active":"2024-09-12T01:11:19.249880+0000","last_peered":"2024-09-12T01:11:19.249880+0000","last_clean":"2024-09-12T01:11:19.249880+0000","last_became_active":"2024-09-12T00:12:38.047575+0000","last_became_peered":"2024-09-12T00:12:38.047575+0000","last_unstale":"2024-09-12T01:11:19.249880+0000","last_undegraded":"2024-09-12T01:11:19.249880+0000","last_fullsized":"2024-09-12T01:11:19.249880+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-12T01:11:19.249774+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-12T01:11:19.249774+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.249774+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:52.534231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":952,"num_read_kb":776,"num_write":336,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'364","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.216422+0000","last_change":"2024-09-12T01:11:16.216422+0000","last_active":"2024-09-12T01:11:16.216422+0000","last_peered":"2024-09-12T01:11:16.216422+0000","last_clean":"2024-09-12T01:11:16.216422+0000","last_became_active":"2024-09-12T00:12:36.043803+0000","last_became_peered":"2024-09-12T00:12:36.043803+0000","last_unstale":"2024-09-12T01:11:16.216422+0000","last_undegraded":"2024-09-12T01:11:16.216422+0000","last_fullsized":"2024-09-12T01:11:16.216422+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-12T01:11:16.216308+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-12T01:11:16.216308+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.216308+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:33.903640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":463,"num_read_kb":37298,"num_write":1152,"num_write_kb":54766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'144","reported_seq":739,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.240217+0000","last_change":"2024-09-12T01:11:12.240217+0000","last_active":"2024-09-12T01:11:12.240217+0000","last_peered":"2024-09-12T01:11:12.240217+0000","last_clean":"2024-09-12T01:11:12.240217+0000","last_became_active":"2024-09-12T00:12:38.036463+0000","last_became_peered":"2024-09-12T00:12:38.036463+0000","last_unstale":"2024-09-12T01:11:12.240217+0000","last_undegraded":"2024-09-12T01:11:12.240217+0000","last_fullsized":"2024-09-12T01:11:12.240217+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-12T01:11:12.240134+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-12T01:11:12.240134+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.240134+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:47.702270+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":509,"num_write":213,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'287","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.771144+0000","last_change":"2024-09-12T01:11:12.771144+0000","last_active":"2024-09-12T01:11:12.771144+0000","last_peered":"2024-09-12T01:11:12.771144+0000","last_clean":"2024-09-12T01:11:12.771144+0000","last_became_active":"2024-09-12T00:12:36.041392+0000","last_became_peered":"2024-09-12T00:12:36.041392+0000","last_unstale":"2024-09-12T01:11:12.771144+0000","last_undegraded":"2024-09-12T01:11:12.771144+0000","last_fullsized":"2024-09-12T01:11:12.771144+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'287","last_scrub_stamp":"2024-09-12T01:11:12.771025+0000","last_deep_scrub":"263'287","last_deep_scrub_stamp":"2024-09-12T01:11:12.771025+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.771025+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:08.477912+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992353,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":407,"num_read_kb":23602,"num_write":1012,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'134","reported_seq":762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.757265+0000","last_change":"2024-09-12T01:11:15.757265+0000","last_active":"2024-09-12T01:11:15.757265+0000","last_peered":"2024-09-12T01:11:15.757265+0000","last_clean":"2024-09-12T01:11:15.757265+0000","last_became_active":"2024-09-12T00:12:38.042584+0000","last_became_peered":"2024-09-12T00:12:38.042584+0000","last_unstale":"2024-09-12T01:11:15.757265+0000","last_undegraded":"2024-09-12T01:11:15.757265+0000","last_fullsized":"2024-09-12T01:11:15.757265+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-12T01:11:15.757170+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-12T01:11:15.757170+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.757170+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:39.681374+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":632,"num_read_kb":533,"num_write":194,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'381","reported_seq":1048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.378596+0000","last_change":"2024-09-12T01:11:17.378508+0000","last_active":"2024-09-12T01:11:17.378596+0000","last_peered":"2024-09-12T01:11:17.378596+0000","last_clean":"2024-09-12T01:11:17.378596+0000","last_became_active":"2024-09-12T00:12:36.037461+0000","last_became_peered":"2024-09-12T00:12:36.037461+0000","last_unstale":"2024-09-12T01:11:17.378596+0000","last_undegraded":"2024-09-12T01:11:17.378596+0000","last_fullsized":"2024-09-12T01:11:17.378596+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'381","last_scrub_stamp":"2024-09-12T01:11:17.378379+0000","last_deep_scrub":"263'381","last_deep_scrub_stamp":"2024-09-12T01:11:17.378379+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.378379+0000","objects_scrubbed":8,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:13.428268+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262313,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":614,"num_read_kb":9826,"num_write":1249,"num_write_kb":32499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'308","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.179705+0000","last_change":"2024-09-12T01:11:14.179705+0000","last_active":"2024-09-12T01:11:14.179705+0000","last_peered":"2024-09-12T01:11:14.179705+0000","last_clean":"2024-09-12T01:11:14.179705+0000","last_became_active":"2024-09-12T00:12:38.036872+0000","last_became_peered":"2024-09-12T00:12:38.036872+0000","last_unstale":"2024-09-12T01:11:14.179705+0000","last_undegraded":"2024-09-12T01:11:14.179705+0000","last_fullsized":"2024-09-12T01:11:14.179705+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'308","last_scrub_stamp":"2024-09-12T01:11:14.179611+0000","last_deep_scrub":"263'308","last_deep_scrub_stamp":"2024-09-12T01:11:14.179611+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.179611+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:04.270135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1112,"num_write":459,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'341","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.799642+0000","last_change":"2024-09-12T01:11:13.799642+0000","last_active":"2024-09-12T01:11:13.799642+0000","last_peered":"2024-09-12T01:11:13.799642+0000","last_clean":"2024-09-12T01:11:13.799642+0000","last_became_active":"2024-09-12T00:12:36.042159+0000","last_became_peered":"2024-09-12T00:12:36.042159+0000","last_unstale":"2024-09-12T01:11:13.799642+0000","last_undegraded":"2024-09-12T01:11:13.799642+0000","last_fullsized":"2024-09-12T01:11:13.799642+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-12T01:11:13.799464+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-12T01:11:13.799464+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.799464+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:02.740372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262267,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":43498,"num_write":1204,"num_write_kb":41544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'314","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.862426+0000","last_change":"2024-09-12T01:11:23.862426+0000","last_active":"2024-09-12T01:11:23.862426+0000","last_peered":"2024-09-12T01:11:23.862426+0000","last_clean":"2024-09-12T01:11:23.862426+0000","last_became_active":"2024-09-12T00:12:38.042966+0000","last_became_peered":"2024-09-12T00:12:38.042966+0000","last_unstale":"2024-09-12T01:11:23.862426+0000","last_undegraded":"2024-09-12T01:11:23.862426+0000","last_fullsized":"2024-09-12T01:11:23.862426+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-09-12T01:11:23.862308+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-09-12T01:11:23.862308+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.862308+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:32.625743+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1467,"num_read_kb":1262,"num_write":468,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25754,"num_omap_keys":101,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'377","reported_seq":1039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.331079+0000","last_change":"2024-09-12T01:11:08.331017+0000","last_active":"2024-09-12T01:11:08.331079+0000","last_peered":"2024-09-12T01:11:08.331079+0000","last_clean":"2024-09-12T01:11:08.331079+0000","last_became_active":"2024-09-12T00:12:36.027423+0000","last_became_peered":"2024-09-12T00:12:36.027423+0000","last_unstale":"2024-09-12T01:11:08.331079+0000","last_undegraded":"2024-09-12T01:11:08.331079+0000","last_fullsized":"2024-09-12T01:11:08.331079+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:11:08.330897+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:11:08.330897+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.330897+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:48.101657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730133,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":69052,"num_write":1173,"num_write_kb":46135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'156","reported_seq":737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.234431+0000","last_change":"2024-09-12T01:11:17.234431+0000","last_active":"2024-09-12T01:11:17.234431+0000","last_peered":"2024-09-12T01:11:17.234431+0000","last_clean":"2024-09-12T01:11:17.234431+0000","last_became_active":"2024-09-12T00:12:38.036235+0000","last_became_peered":"2024-09-12T00:12:38.036235+0000","last_unstale":"2024-09-12T01:11:17.234431+0000","last_undegraded":"2024-09-12T01:11:17.234431+0000","last_fullsized":"2024-09-12T01:11:17.234431+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'156","last_scrub_stamp":"2024-09-12T01:11:17.234365+0000","last_deep_scrub":"263'156","last_deep_scrub_stamp":"2024-09-12T01:11:17.234365+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.234365+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:50.396135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":550,"num_write":221,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'463","reported_seq":1289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.615976+0000","last_change":"2024-09-12T01:11:13.615976+0000","last_active":"2024-09-12T01:11:13.615976+0000","last_peered":"2024-09-12T01:11:13.615976+0000","last_clean":"2024-09-12T01:11:13.615976+0000","last_became_active":"2024-09-12T00:12:36.038449+0000","last_became_peered":"2024-09-12T00:12:36.038449+0000","last_unstale":"2024-09-12T01:11:13.615976+0000","last_undegraded":"2024-09-12T01:11:13.615976+0000","last_fullsized":"2024-09-12T01:11:13.615976+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'463","last_scrub_stamp":"2024-09-12T01:11:13.615824+0000","last_deep_scrub":"263'463","last_deep_scrub_stamp":"2024-09-12T01:11:13.615824+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.615824+0000","objects_scrubbed":10,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:45.835212+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5280724,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1083,"num_read_kb":25378,"num_write":1472,"num_write_kb":31172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'189","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.221767+0000","last_change":"2024-09-12T01:11:14.221767+0000","last_active":"2024-09-12T01:11:14.221767+0000","last_peered":"2024-09-12T01:11:14.221767+0000","last_clean":"2024-09-12T01:11:14.221767+0000","last_became_active":"2024-09-12T00:12:38.042691+0000","last_became_peered":"2024-09-12T00:12:38.042691+0000","last_unstale":"2024-09-12T01:11:14.221767+0000","last_undegraded":"2024-09-12T01:11:14.221767+0000","last_fullsized":"2024-09-12T01:11:14.221767+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'189","last_scrub_stamp":"2024-09-12T01:11:14.221681+0000","last_deep_scrub":"263'189","last_deep_scrub_stamp":"2024-09-12T01:11:14.221681+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.221681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:58.106634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":710,"num_write":289,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'349","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.150591+0000","last_change":"2024-09-12T01:11:08.150533+0000","last_active":"2024-09-12T01:11:08.150591+0000","last_peered":"2024-09-12T01:11:08.150591+0000","last_clean":"2024-09-12T01:11:08.150591+0000","last_became_active":"2024-09-12T00:12:36.025028+0000","last_became_peered":"2024-09-12T00:12:36.025028+0000","last_unstale":"2024-09-12T01:11:08.150591+0000","last_undegraded":"2024-09-12T01:11:08.150591+0000","last_fullsized":"2024-09-12T01:11:08.150591+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'349","last_scrub_stamp":"2024-09-12T01:11:08.150388+0000","last_deep_scrub":"263'349","last_deep_scrub_stamp":"2024-09-12T01:11:08.150388+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.150388+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:51.049508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":523,"num_read_kb":8333,"num_write":1236,"num_write_kb":35038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'132","reported_seq":755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.724523+0000","last_change":"2024-09-12T01:11:16.724523+0000","last_active":"2024-09-12T01:11:16.724523+0000","last_peered":"2024-09-12T01:11:16.724523+0000","last_clean":"2024-09-12T01:11:16.724523+0000","last_became_active":"2024-09-12T00:12:38.046753+0000","last_became_peered":"2024-09-12T00:12:38.046753+0000","last_unstale":"2024-09-12T01:11:16.724523+0000","last_undegraded":"2024-09-12T01:11:16.724523+0000","last_fullsized":"2024-09-12T01:11:16.724523+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'132","last_scrub_stamp":"2024-09-12T01:11:16.724424+0000","last_deep_scrub":"263'132","last_deep_scrub_stamp":"2024-09-12T01:11:16.724424+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.724424+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:10.527369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":645,"num_read_kb":546,"num_write":214,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'376","reported_seq":1029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.407915+0000","last_change":"2024-09-12T01:11:18.407843+0000","last_active":"2024-09-12T01:11:18.407915+0000","last_peered":"2024-09-12T01:11:18.407915+0000","last_clean":"2024-09-12T01:11:18.407915+0000","last_became_active":"2024-09-12T00:12:36.047221+0000","last_became_peered":"2024-09-12T00:12:36.047221+0000","last_unstale":"2024-09-12T01:11:18.407915+0000","last_undegraded":"2024-09-12T01:11:18.407915+0000","last_fullsized":"2024-09-12T01:11:18.407915+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'376","last_scrub_stamp":"2024-09-12T01:11:18.407727+0000","last_deep_scrub":"263'376","last_deep_scrub_stamp":"2024-09-12T01:11:18.407727+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.407727+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:05.332812+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4807090,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":28472,"num_write":1153,"num_write_kb":36833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'174","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.450164+0000","last_change":"2024-09-12T01:11:19.450164+0000","last_active":"2024-09-12T01:11:19.450164+0000","last_peered":"2024-09-12T01:11:19.450164+0000","last_clean":"2024-09-12T01:11:19.450164+0000","last_became_active":"2024-09-12T00:12:38.048094+0000","last_became_peered":"2024-09-12T00:12:38.048094+0000","last_unstale":"2024-09-12T01:11:19.450164+0000","last_undegraded":"2024-09-12T01:11:19.450164+0000","last_fullsized":"2024-09-12T01:11:19.450164+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'174","last_scrub_stamp":"2024-09-12T01:11:19.450075+0000","last_deep_scrub":"263'174","last_deep_scrub_stamp":"2024-09-12T01:11:19.450075+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.450075+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:51.643162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":798,"num_read_kb":664,"num_write":275,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'311","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.726114+0000","last_change":"2024-09-12T01:11:10.726114+0000","last_active":"2024-09-12T01:11:10.726114+0000","last_peered":"2024-09-12T01:11:10.726114+0000","last_clean":"2024-09-12T01:11:10.726114+0000","last_became_active":"2024-09-12T00:12:36.039442+0000","last_became_peered":"2024-09-12T00:12:36.039442+0000","last_unstale":"2024-09-12T01:11:10.726114+0000","last_undegraded":"2024-09-12T01:11:10.726114+0000","last_fullsized":"2024-09-12T01:11:10.726114+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:11:10.725997+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:11:10.725997+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.725997+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:30.008154+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":5824,"num_write":1002,"num_write_kb":34989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'86","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.269437+0000","last_change":"2024-09-12T01:11:13.269371+0000","last_active":"2024-09-12T01:11:13.269437+0000","last_peered":"2024-09-12T01:11:13.269437+0000","last_clean":"2024-09-12T01:11:13.269437+0000","last_became_active":"2024-09-12T00:12:38.042380+0000","last_became_peered":"2024-09-12T00:12:38.042380+0000","last_unstale":"2024-09-12T01:11:13.269437+0000","last_undegraded":"2024-09-12T01:11:13.269437+0000","last_fullsized":"2024-09-12T01:11:13.269437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'86","last_scrub_stamp":"2024-09-12T01:11:13.269288+0000","last_deep_scrub":"263'86","last_deep_scrub_stamp":"2024-09-12T01:11:13.269288+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.269288+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:11.757304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":311,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'396","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.359247+0000","last_change":"2024-09-12T01:11:19.359247+0000","last_active":"2024-09-12T01:11:19.359247+0000","last_peered":"2024-09-12T01:11:19.359247+0000","last_clean":"2024-09-12T01:11:19.359247+0000","last_became_active":"2024-09-12T00:12:36.035235+0000","last_became_peered":"2024-09-12T00:12:36.035235+0000","last_unstale":"2024-09-12T01:11:19.359247+0000","last_undegraded":"2024-09-12T01:11:19.359247+0000","last_fullsized":"2024-09-12T01:11:19.359247+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'396","last_scrub_stamp":"2024-09-12T01:11:19.359113+0000","last_deep_scrub":"263'396","last_deep_scrub_stamp":"2024-09-12T01:11:19.359113+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.359113+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:34.438134+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2508578,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":34997,"num_write":1247,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'340","reported_seq":968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.297343+0000","last_change":"2024-09-12T01:11:10.297255+0000","last_active":"2024-09-12T01:11:10.297343+0000","last_peered":"2024-09-12T01:11:10.297343+0000","last_clean":"2024-09-12T01:11:10.297343+0000","last_became_active":"2024-09-12T00:13:07.150278+0000","last_became_peered":"2024-09-12T00:13:07.150278+0000","last_unstale":"2024-09-12T01:11:10.297343+0000","last_undegraded":"2024-09-12T01:11:10.297343+0000","last_fullsized":"2024-09-12T01:11:10.297343+0000","mapping_epoch":40,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:11:10.297094+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:11:10.297094+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.297094+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:40.514518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550106,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":16889,"num_write":1077,"num_write_kb":27724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"263'232","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.445613+0000","last_change":"2024-09-12T01:11:20.445613+0000","last_active":"2024-09-12T01:11:20.445613+0000","last_peered":"2024-09-12T01:11:20.445613+0000","last_clean":"2024-09-12T01:11:20.445613+0000","last_became_active":"2024-09-12T00:12:38.048092+0000","last_became_peered":"2024-09-12T00:12:38.048092+0000","last_unstale":"2024-09-12T01:11:20.445613+0000","last_undegraded":"2024-09-12T01:11:20.445613+0000","last_fullsized":"2024-09-12T01:11:20.445613+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T01:11:20.445524+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T01:11:20.445524+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.445524+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:49.570800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":909,"num_write":384,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'395","reported_seq":1216,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.842411+0000","last_change":"2024-09-12T01:11:14.842411+0000","last_active":"2024-09-12T01:11:14.842411+0000","last_peered":"2024-09-12T01:11:14.842411+0000","last_clean":"2024-09-12T01:11:14.842411+0000","last_became_active":"2024-09-12T00:12:36.034396+0000","last_became_peered":"2024-09-12T00:12:36.034396+0000","last_unstale":"2024-09-12T01:11:14.842411+0000","last_undegraded":"2024-09-12T01:11:14.842411+0000","last_fullsized":"2024-09-12T01:11:14.842411+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'395","last_scrub_stamp":"2024-09-12T01:11:14.842306+0000","last_deep_scrub":"263'395","last_deep_scrub_stamp":"2024-09-12T01:11:14.842306+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.842306+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:02.568926+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730115,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":982,"num_read_kb":9206,"num_write":1471,"num_write_kb":42121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'344","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.286803+0000","last_change":"2024-09-12T01:11:20.286803+0000","last_active":"2024-09-12T01:11:20.286803+0000","last_peered":"2024-09-12T01:11:20.286803+0000","last_clean":"2024-09-12T01:11:20.286803+0000","last_became_active":"2024-09-12T00:12:38.039941+0000","last_became_peered":"2024-09-12T00:12:38.039941+0000","last_unstale":"2024-09-12T01:11:20.286803+0000","last_undegraded":"2024-09-12T01:11:20.286803+0000","last_fullsized":"2024-09-12T01:11:20.286803+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-12T01:11:20.286686+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-12T01:11:20.286686+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.286686+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:08.702768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1443,"num_read_kb":1146,"num_write":558,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5787,"num_read_kb":4069,"num_write":1922,"num_write_kb":820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3012,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1094,"ondisk_log_size":1094,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15069,"num_read_kb":14720,"num_write":16734,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1846,"ondisk_log_size":1846,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":695,"ondisk_log_size":695,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1599308,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":18230,"num_read_kb":37558,"num_write":15243,"num_write_kb":11785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685952,"num_omap_keys":1572,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1894,"ondisk_log_size":1894,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":103162,"num_read_kb":86048,"num_write":37373,"num_write_kb":18894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44597,"num_omap_keys":180,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3943,"ondisk_log_size":3943,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":86738467,"num_objects":386,"num_object_clones":0,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":386,"num_whiteouts":0,"num_read":36305,"num_read_kb":1714849,"num_write":72152,"num_write_kb":2100462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":132317184,"data_stored":132317184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3742,"ondisk_log_size":3742,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":170862,"num_write":186,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":170241,"num_write":186,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510158,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220644,"kb_used_data":14612,"kb_used_omap":1,"kb_used_meta":206014,"kb_avail":94151196,"statfs":{"total":96636764160,"available":96410824704,"internally_reserved":0,"allocated":14962688,"data_stored":12977820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":210958795},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510161,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108704,"kb_used_data":15120,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94263136,"statfs":{"total":96636764160,"available":96525451264,"internally_reserved":0,"allocated":15482880,"data_stored":13481120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95812038},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510158,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":201320,"kb_used_data":21656,"kb_used_omap":1,"kb_used_meta":179646,"kb_avail":94170520,"statfs":{"total":96636764160,"available":96430612480,"internally_reserved":0,"allocated":22175744,"data_stored":20184672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":183957957},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510159,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":271156,"kb_used_data":28964,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94100684,"statfs":{"total":96636764160,"available":96359100416,"internally_reserved":0,"allocated":29659136,"data_stored":27672539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":247986631},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510159,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151856,"kb_used_data":22112,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94219984,"statfs":{"total":96636764160,"available":96481263616,"internally_reserved":0,"allocated":22642688,"data_stored":20661729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510159,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":328376,"kb_used_data":22312,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94043464,"statfs":{"total":96636764160,"available":96300507136,"internally_reserved":0,"allocated":22847488,"data_stored":20852874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510161,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99024,"kb_used_data":17856,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94272816,"statfs":{"total":96636764160,"available":96535363584,"internally_reserved":0,"allocated":18284544,"data_stored":16272298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575566,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272432,"kb_used_data":20512,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94099408,"statfs":{"total":96636764160,"available":96357793792,"internally_reserved":0,"allocated":21004288,"data_stored":19003294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14069760,"data_stored":14069760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18063360,"data_stored":18063360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18460672,"data_stored":18460672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25473024,"data_stored":25473024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17981440,"data_stored":17981440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16211968,"data_stored":16211968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11280384,"data_stored":11280384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10776576,"data_stored":10776576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:11:47.718 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.718 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.719 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.719 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.719 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.719 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.719 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.720 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.720 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.720 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.720 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.720 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.720 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.720 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.721 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.721 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.721 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.721 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.721 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.721 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.721 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.721 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.722 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.722 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.722 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.722 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.722 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.722 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.722 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.722 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.722 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.723 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.723 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.723 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.723 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.723 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.723 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.723 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.724 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.724 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.724 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.724 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.724 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.724 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.724 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.724 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.725 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.725 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.725 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.725 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.725 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.725 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.725 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.725 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.726 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.726 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.726 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.726 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.726 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.726 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.726 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.726 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.727 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:30:13.715440+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.727 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.727 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.727 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:27:41.820080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.727 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.730 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.730 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.731 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.731 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.731 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:12:43.028171+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=43, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.731 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:12:45.041593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=12, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:11:47.732 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:12:07.733 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:12:08.070 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:12:08.085 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-09-12T01:12:08.087 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":2053,"stamp":"2024-09-12T01:12:07.362941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88946274,"num_objects":742,"num_object_clones":0,"num_object_copies":1870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":181390,"num_read_kb":2201314,"num_write":143939,"num_write_kb":2394991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740611,"num_omap_keys":1795,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13593,"ondisk_log_size":13593,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1657672,"kb_used_data":163144,"kb_used_omap":12,"kb_used_meta":1494387,"kb_avail":753317048,"statfs":{"total":773094113280,"available":771396657152,"internally_reserved":0,"allocated":167059456,"data_stored":151106346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1530252850},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2988,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005412"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.238390+0000","last_change":"2024-09-12T01:11:42.238299+0000","last_active":"2024-09-12T01:11:42.238390+0000","last_peered":"2024-09-12T01:11:42.238390+0000","last_clean":"2024-09-12T01:11:42.238390+0000","last_became_active":"2024-09-12T00:46:54.885628+0000","last_became_peered":"2024-09-12T00:46:54.885628+0000","last_unstale":"2024-09-12T01:11:42.238390+0000","last_undegraded":"2024-09-12T01:11:42.238390+0000","last_fullsized":"2024-09-12T01:11:42.238390+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:42.238174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:42.238174+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.238174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:50.228730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.293811+0000","last_change":"2024-09-12T01:11:41.293811+0000","last_active":"2024-09-12T01:11:41.293811+0000","last_peered":"2024-09-12T01:11:41.293811+0000","last_clean":"2024-09-12T01:11:41.293811+0000","last_became_active":"2024-09-12T00:30:17.763402+0000","last_became_peered":"2024-09-12T00:30:17.763402+0000","last_unstale":"2024-09-12T01:11:41.293811+0000","last_undegraded":"2024-09-12T01:11:41.293811+0000","last_fullsized":"2024-09-12T01:11:41.293811+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-12T01:11:41.293721+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-12T01:11:41.293721+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.293721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:33.238185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.573777+0000","last_change":"2024-09-12T01:11:42.573777+0000","last_active":"2024-09-12T01:11:42.573777+0000","last_peered":"2024-09-12T01:11:42.573777+0000","last_clean":"2024-09-12T01:11:42.573777+0000","last_became_active":"2024-09-12T00:30:14.744833+0000","last_became_peered":"2024-09-12T00:30:14.744833+0000","last_unstale":"2024-09-12T01:11:42.573777+0000","last_undegraded":"2024-09-12T01:11:42.573777+0000","last_fullsized":"2024-09-12T01:11:42.573777+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-12T01:11:42.573690+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-12T01:11:42.573690+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.573690+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:45.289006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'41","reported_seq":170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.393158+0000","last_change":"2024-09-12T01:11:48.393158+0000","last_active":"2024-09-12T01:11:48.393158+0000","last_peered":"2024-09-12T01:11:48.393158+0000","last_clean":"2024-09-12T01:11:48.393158+0000","last_became_active":"2024-09-12T00:27:42.839605+0000","last_became_peered":"2024-09-12T00:27:42.839605+0000","last_unstale":"2024-09-12T01:11:48.393158+0000","last_undegraded":"2024-09-12T01:11:48.393158+0000","last_fullsized":"2024-09-12T01:11:48.393158+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:11:48.393064+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:11:48.393064+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.393064+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:13.561297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":144,"num_write":69,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.446289+0000","last_change":"2024-09-12T01:11:49.446189+0000","last_active":"2024-09-12T01:11:49.446289+0000","last_peered":"2024-09-12T01:11:49.446289+0000","last_clean":"2024-09-12T01:11:49.446289+0000","last_became_active":"2024-09-12T00:46:54.885702+0000","last_became_peered":"2024-09-12T00:46:54.885702+0000","last_unstale":"2024-09-12T01:11:49.446289+0000","last_undegraded":"2024-09-12T01:11:49.446289+0000","last_fullsized":"2024-09-12T01:11:49.446289+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:49.446092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:49.446092+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.446092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:36.330107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.247187+0000","last_change":"2024-09-12T01:11:45.247187+0000","last_active":"2024-09-12T01:11:45.247187+0000","last_peered":"2024-09-12T01:11:45.247187+0000","last_clean":"2024-09-12T01:11:45.247187+0000","last_became_active":"2024-09-12T00:30:17.762369+0000","last_became_peered":"2024-09-12T00:30:17.762369+0000","last_unstale":"2024-09-12T01:11:45.247187+0000","last_undegraded":"2024-09-12T01:11:45.247187+0000","last_fullsized":"2024-09-12T01:11:45.247187+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:11:45.247111+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:11:45.247111+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.247111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:27.557898+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.840007+0000","last_change":"2024-09-12T01:11:48.840007+0000","last_active":"2024-09-12T01:11:48.840007+0000","last_peered":"2024-09-12T01:11:48.840007+0000","last_clean":"2024-09-12T01:11:48.840007+0000","last_became_active":"2024-09-12T00:30:14.747614+0000","last_became_peered":"2024-09-12T00:30:14.747614+0000","last_unstale":"2024-09-12T01:11:48.840007+0000","last_undegraded":"2024-09-12T01:11:48.840007+0000","last_fullsized":"2024-09-12T01:11:48.840007+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-12T01:11:48.839916+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-12T01:11:48.839916+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.839916+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:33.711517+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'21","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.388154+0000","last_change":"2024-09-12T01:11:44.388096+0000","last_active":"2024-09-12T01:11:44.388154+0000","last_peered":"2024-09-12T01:11:44.388154+0000","last_clean":"2024-09-12T01:11:44.388154+0000","last_became_active":"2024-09-12T00:27:42.846264+0000","last_became_peered":"2024-09-12T00:27:42.846264+0000","last_unstale":"2024-09-12T01:11:44.388154+0000","last_undegraded":"2024-09-12T01:11:44.388154+0000","last_fullsized":"2024-09-12T01:11:44.388154+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'21","last_scrub_stamp":"2024-09-12T01:11:44.387999+0000","last_deep_scrub":"263'21","last_deep_scrub_stamp":"2024-09-12T01:11:44.387999+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.387999+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:24.123389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.252024+0000","last_change":"2024-09-12T01:11:45.252024+0000","last_active":"2024-09-12T01:11:45.252024+0000","last_peered":"2024-09-12T01:11:45.252024+0000","last_clean":"2024-09-12T01:11:45.252024+0000","last_became_active":"2024-09-12T00:46:54.890430+0000","last_became_peered":"2024-09-12T00:46:54.890430+0000","last_unstale":"2024-09-12T01:11:45.252024+0000","last_undegraded":"2024-09-12T01:11:45.252024+0000","last_fullsized":"2024-09-12T01:11:45.252024+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:45.251938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:45.251938+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.251938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:34.442709+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.830946+0000","last_change":"2024-09-12T01:11:57.830876+0000","last_active":"2024-09-12T01:11:57.830946+0000","last_peered":"2024-09-12T01:11:57.830946+0000","last_clean":"2024-09-12T01:11:57.830946+0000","last_became_active":"2024-09-12T00:30:17.767116+0000","last_became_peered":"2024-09-12T00:30:17.767116+0000","last_unstale":"2024-09-12T01:11:57.830946+0000","last_undegraded":"2024-09-12T01:11:57.830946+0000","last_fullsized":"2024-09-12T01:11:57.830946+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-12T01:11:57.830781+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-12T01:11:57.830781+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.830781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:58.505612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"263'6","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.602319+0000","last_change":"2024-09-12T01:11:46.602319+0000","last_active":"2024-09-12T01:11:46.602319+0000","last_peered":"2024-09-12T01:11:46.602319+0000","last_clean":"2024-09-12T01:11:46.602319+0000","last_became_active":"2024-09-12T00:30:14.742434+0000","last_became_peered":"2024-09-12T00:30:14.742434+0000","last_unstale":"2024-09-12T01:11:46.602319+0000","last_undegraded":"2024-09-12T01:11:46.602319+0000","last_fullsized":"2024-09-12T01:11:46.602319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:46.602222+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:46.602222+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.602222+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:48.726174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6194,"num_write":6,"num_write_kb":5170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'36","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.481877+0000","last_change":"2024-09-12T01:11:41.481877+0000","last_active":"2024-09-12T01:11:41.481877+0000","last_peered":"2024-09-12T01:11:41.481877+0000","last_clean":"2024-09-12T01:11:41.481877+0000","last_became_active":"2024-09-12T00:27:42.842172+0000","last_became_peered":"2024-09-12T00:27:42.842172+0000","last_unstale":"2024-09-12T01:11:41.481877+0000","last_undegraded":"2024-09-12T01:11:41.481877+0000","last_fullsized":"2024-09-12T01:11:41.481877+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-12T01:11:41.481778+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-12T01:11:41.481778+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.481778+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:04.496975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:48.052073+0000","last_change":"2024-09-12T00:46:54.883267+0000","last_active":"2024-09-12T01:08:48.052073+0000","last_peered":"2024-09-12T01:08:48.052073+0000","last_clean":"2024-09-12T01:08:48.052073+0000","last_became_active":"2024-09-12T00:46:54.882951+0000","last_became_peered":"2024-09-12T00:46:54.882951+0000","last_unstale":"2024-09-12T01:08:48.052073+0000","last_undegraded":"2024-09-12T01:08:48.052073+0000","last_fullsized":"2024-09-12T01:08:48.052073+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.753360+0000","last_change":"2024-09-12T01:11:53.753360+0000","last_active":"2024-09-12T01:11:53.753360+0000","last_peered":"2024-09-12T01:11:53.753360+0000","last_clean":"2024-09-12T01:11:53.753360+0000","last_became_active":"2024-09-12T00:30:17.764967+0000","last_became_peered":"2024-09-12T00:30:17.764967+0000","last_unstale":"2024-09-12T01:11:53.753360+0000","last_undegraded":"2024-09-12T01:11:53.753360+0000","last_fullsized":"2024-09-12T01:11:53.753360+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:53.753248+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:53.753248+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.753248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:35.057213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.342353+0000","last_change":"2024-09-12T01:11:40.342294+0000","last_active":"2024-09-12T01:11:40.342353+0000","last_peered":"2024-09-12T01:11:40.342353+0000","last_clean":"2024-09-12T01:11:40.342353+0000","last_became_active":"2024-09-12T00:30:14.747423+0000","last_became_peered":"2024-09-12T00:30:14.747423+0000","last_unstale":"2024-09-12T01:11:40.342353+0000","last_undegraded":"2024-09-12T01:11:40.342353+0000","last_fullsized":"2024-09-12T01:11:40.342353+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:11:40.342210+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:11:40.342210+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.342210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:39.241915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'27","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.510222+0000","last_change":"2024-09-12T01:11:40.510222+0000","last_active":"2024-09-12T01:11:40.510222+0000","last_peered":"2024-09-12T01:11:40.510222+0000","last_clean":"2024-09-12T01:11:40.510222+0000","last_became_active":"2024-09-12T00:27:42.837170+0000","last_became_peered":"2024-09-12T00:27:42.837170+0000","last_unstale":"2024-09-12T01:11:40.510222+0000","last_undegraded":"2024-09-12T01:11:40.510222+0000","last_fullsized":"2024-09-12T01:11:40.510222+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'27","last_scrub_stamp":"2024-09-12T01:11:40.510104+0000","last_deep_scrub":"263'27","last_deep_scrub_stamp":"2024-09-12T01:11:40.510104+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.510104+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:28.001902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":97,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.677923+0000","last_change":"2024-09-12T01:11:54.677923+0000","last_active":"2024-09-12T01:11:54.677923+0000","last_peered":"2024-09-12T01:11:54.677923+0000","last_clean":"2024-09-12T01:11:54.677923+0000","last_became_active":"2024-09-12T00:46:54.885170+0000","last_became_peered":"2024-09-12T00:46:54.885170+0000","last_unstale":"2024-09-12T01:11:54.677923+0000","last_undegraded":"2024-09-12T01:11:54.677923+0000","last_fullsized":"2024-09-12T01:11:54.677923+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:54.677837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:54.677837+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.677837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:14.232780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.296107+0000","last_change":"2024-09-12T01:11:38.296054+0000","last_active":"2024-09-12T01:11:38.296107+0000","last_peered":"2024-09-12T01:11:38.296107+0000","last_clean":"2024-09-12T01:11:38.296107+0000","last_became_active":"2024-09-12T00:30:17.765167+0000","last_became_peered":"2024-09-12T00:30:17.765167+0000","last_unstale":"2024-09-12T01:11:38.296107+0000","last_undegraded":"2024-09-12T01:11:38.296107+0000","last_fullsized":"2024-09-12T01:11:38.296107+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:38.295957+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:38.295957+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.295957+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:18.827609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6715,"num_write":6,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.861671+0000","last_change":"2024-09-12T01:11:47.861671+0000","last_active":"2024-09-12T01:11:47.861671+0000","last_peered":"2024-09-12T01:11:47.861671+0000","last_clean":"2024-09-12T01:11:47.861671+0000","last_became_active":"2024-09-12T00:30:14.742625+0000","last_became_peered":"2024-09-12T00:30:14.742625+0000","last_unstale":"2024-09-12T01:11:47.861671+0000","last_undegraded":"2024-09-12T01:11:47.861671+0000","last_fullsized":"2024-09-12T01:11:47.861671+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-12T01:11:47.861564+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-12T01:11:47.861564+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.861564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:43.300600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.508432+0000","last_change":"2024-09-12T01:11:37.508432+0000","last_active":"2024-09-12T01:11:37.508432+0000","last_peered":"2024-09-12T01:11:37.508432+0000","last_clean":"2024-09-12T01:11:37.508432+0000","last_became_active":"2024-09-12T00:27:42.845406+0000","last_became_peered":"2024-09-12T00:27:42.845406+0000","last_unstale":"2024-09-12T01:11:37.508432+0000","last_undegraded":"2024-09-12T01:11:37.508432+0000","last_fullsized":"2024-09-12T01:11:37.508432+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-12T01:11:37.508351+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-12T01:11:37.508351+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.508351+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:13.033508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":45,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.427688+0000","last_change":"2024-09-12T01:11:51.427625+0000","last_active":"2024-09-12T01:11:51.427688+0000","last_peered":"2024-09-12T01:11:51.427688+0000","last_clean":"2024-09-12T01:11:51.427688+0000","last_became_active":"2024-09-12T00:46:54.876219+0000","last_became_peered":"2024-09-12T00:46:54.876219+0000","last_unstale":"2024-09-12T01:11:51.427688+0000","last_undegraded":"2024-09-12T01:11:51.427688+0000","last_fullsized":"2024-09-12T01:11:51.427688+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:51.427529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:51.427529+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.427529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:32.816914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:59.166748+0000","last_change":"2024-09-12T00:30:17.763491+0000","last_active":"2024-09-12T01:10:59.166748+0000","last_peered":"2024-09-12T01:10:59.166748+0000","last_clean":"2024-09-12T01:10:59.166748+0000","last_became_active":"2024-09-12T00:30:17.762792+0000","last_became_peered":"2024-09-12T00:30:17.762792+0000","last_unstale":"2024-09-12T01:10:59.166748+0000","last_undegraded":"2024-09-12T01:10:59.166748+0000","last_fullsized":"2024-09-12T01:10:59.166748+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.382614+0000","last_change":"2024-09-12T01:12:02.382614+0000","last_active":"2024-09-12T01:12:02.382614+0000","last_peered":"2024-09-12T01:12:02.382614+0000","last_clean":"2024-09-12T01:12:02.382614+0000","last_became_active":"2024-09-12T00:30:14.745328+0000","last_became_peered":"2024-09-12T00:30:14.745328+0000","last_unstale":"2024-09-12T01:12:02.382614+0000","last_undegraded":"2024-09-12T01:12:02.382614+0000","last_fullsized":"2024-09-12T01:12:02.382614+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:12:02.382517+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:12:02.382517+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.382517+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:23.011562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'29","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.240542+0000","last_change":"2024-09-12T01:11:37.240542+0000","last_active":"2024-09-12T01:11:37.240542+0000","last_peered":"2024-09-12T01:11:37.240542+0000","last_clean":"2024-09-12T01:11:37.240542+0000","last_became_active":"2024-09-12T00:27:42.843745+0000","last_became_peered":"2024-09-12T00:27:42.843745+0000","last_unstale":"2024-09-12T01:11:37.240542+0000","last_undegraded":"2024-09-12T01:11:37.240542+0000","last_fullsized":"2024-09-12T01:11:37.240542+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-12T01:11:37.240457+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-12T01:11:37.240457+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.240457+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:02.545550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":101,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.197795+0000","last_change":"2024-09-12T01:11:48.197739+0000","last_active":"2024-09-12T01:11:48.197795+0000","last_peered":"2024-09-12T01:11:48.197795+0000","last_clean":"2024-09-12T01:11:48.197795+0000","last_became_active":"2024-09-12T00:46:54.889006+0000","last_became_peered":"2024-09-12T00:46:54.889006+0000","last_unstale":"2024-09-12T01:11:48.197795+0000","last_undegraded":"2024-09-12T01:11:48.197795+0000","last_fullsized":"2024-09-12T01:11:48.197795+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:48.197669+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:48.197669+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.197669+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:58.745528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'11","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.205260+0000","last_change":"2024-09-12T01:11:44.205260+0000","last_active":"2024-09-12T01:11:44.205260+0000","last_peered":"2024-09-12T01:11:44.205260+0000","last_clean":"2024-09-12T01:11:44.205260+0000","last_became_active":"2024-09-12T00:30:17.759198+0000","last_became_peered":"2024-09-12T00:30:17.759198+0000","last_unstale":"2024-09-12T01:11:44.205260+0000","last_undegraded":"2024-09-12T01:11:44.205260+0000","last_fullsized":"2024-09-12T01:11:44.205260+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T01:11:44.205174+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T01:11:44.205174+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.205174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:56.063872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9336,"num_write":16,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.247614+0000","last_change":"2024-09-12T01:11:34.247614+0000","last_active":"2024-09-12T01:11:34.247614+0000","last_peered":"2024-09-12T01:11:34.247614+0000","last_clean":"2024-09-12T01:11:34.247614+0000","last_became_active":"2024-09-12T00:30:14.750004+0000","last_became_peered":"2024-09-12T00:30:14.750004+0000","last_unstale":"2024-09-12T01:11:34.247614+0000","last_undegraded":"2024-09-12T01:11:34.247614+0000","last_fullsized":"2024-09-12T01:11:34.247614+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:11:34.247482+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:11:34.247482+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.247482+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:38.785894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'18","reported_seq":102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.661226+0000","last_change":"2024-09-12T01:11:37.661226+0000","last_active":"2024-09-12T01:11:37.661226+0000","last_peered":"2024-09-12T01:11:37.661226+0000","last_clean":"2024-09-12T01:11:37.661226+0000","last_became_active":"2024-09-12T00:27:42.835530+0000","last_became_peered":"2024-09-12T00:27:42.835530+0000","last_unstale":"2024-09-12T01:11:37.661226+0000","last_undegraded":"2024-09-12T01:11:37.661226+0000","last_fullsized":"2024-09-12T01:11:37.661226+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'18","last_scrub_stamp":"2024-09-12T01:11:37.661105+0000","last_deep_scrub":"263'18","last_deep_scrub_stamp":"2024-09-12T01:11:37.661105+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.661105+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:17.820227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.195273+0000","last_change":"2024-09-12T01:11:44.195193+0000","last_active":"2024-09-12T01:11:44.195273+0000","last_peered":"2024-09-12T01:11:44.195273+0000","last_clean":"2024-09-12T01:11:44.195273+0000","last_became_active":"2024-09-12T00:46:54.882946+0000","last_became_peered":"2024-09-12T00:46:54.882946+0000","last_unstale":"2024-09-12T01:11:44.195273+0000","last_undegraded":"2024-09-12T01:11:44.195273+0000","last_fullsized":"2024-09-12T01:11:44.195273+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.195091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.195091+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.195091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:18.277306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"260'4","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.604565+0000","last_change":"2024-09-12T01:11:51.604565+0000","last_active":"2024-09-12T01:11:51.604565+0000","last_peered":"2024-09-12T01:11:51.604565+0000","last_clean":"2024-09-12T01:11:51.604565+0000","last_became_active":"2024-09-12T00:30:17.763733+0000","last_became_peered":"2024-09-12T00:30:17.763733+0000","last_unstale":"2024-09-12T01:11:51.604565+0000","last_undegraded":"2024-09-12T01:11:51.604565+0000","last_fullsized":"2024-09-12T01:11:51.604565+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-12T01:11:51.604470+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-12T01:11:51.604470+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.604470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:49.686085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.460827+0000","last_change":"2024-09-12T01:11:43.460827+0000","last_active":"2024-09-12T01:11:43.460827+0000","last_peered":"2024-09-12T01:11:43.460827+0000","last_clean":"2024-09-12T01:11:43.460827+0000","last_became_active":"2024-09-12T00:30:14.748462+0000","last_became_peered":"2024-09-12T00:30:14.748462+0000","last_unstale":"2024-09-12T01:11:43.460827+0000","last_undegraded":"2024-09-12T01:11:43.460827+0000","last_fullsized":"2024-09-12T01:11:43.460827+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:11:43.460734+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:11:43.460734+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.460734+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:09.879424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'17","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.459328+0000","last_change":"2024-09-12T01:11:36.459328+0000","last_active":"2024-09-12T01:11:36.459328+0000","last_peered":"2024-09-12T01:11:36.459328+0000","last_clean":"2024-09-12T01:11:36.459328+0000","last_became_active":"2024-09-12T00:27:42.838896+0000","last_became_peered":"2024-09-12T00:27:42.838896+0000","last_unstale":"2024-09-12T01:11:36.459328+0000","last_undegraded":"2024-09-12T01:11:36.459328+0000","last_fullsized":"2024-09-12T01:11:36.459328+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'17","last_scrub_stamp":"2024-09-12T01:11:36.459214+0000","last_deep_scrub":"263'17","last_deep_scrub_stamp":"2024-09-12T01:11:36.459214+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.459214+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:24.519710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.817367+0000","last_change":"2024-09-12T01:11:58.817367+0000","last_active":"2024-09-12T01:11:58.817367+0000","last_peered":"2024-09-12T01:11:58.817367+0000","last_clean":"2024-09-12T01:11:58.817367+0000","last_became_active":"2024-09-12T00:46:54.885457+0000","last_became_peered":"2024-09-12T00:46:54.885457+0000","last_unstale":"2024-09-12T01:11:58.817367+0000","last_undegraded":"2024-09-12T01:11:58.817367+0000","last_fullsized":"2024-09-12T01:11:58.817367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:58.817260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:58.817260+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.817260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:18.075987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.581002+0000","last_change":"2024-09-12T01:11:49.581002+0000","last_active":"2024-09-12T01:11:49.581002+0000","last_peered":"2024-09-12T01:11:49.581002+0000","last_clean":"2024-09-12T01:11:49.581002+0000","last_became_active":"2024-09-12T00:30:17.765149+0000","last_became_peered":"2024-09-12T00:30:17.765149+0000","last_unstale":"2024-09-12T01:11:49.581002+0000","last_undegraded":"2024-09-12T01:11:49.581002+0000","last_fullsized":"2024-09-12T01:11:49.581002+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-12T01:11:49.580912+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-12T01:11:49.580912+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.580912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:48.834592+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.384991+0000","last_change":"2024-09-12T01:12:01.384991+0000","last_active":"2024-09-12T01:12:01.384991+0000","last_peered":"2024-09-12T01:12:01.384991+0000","last_clean":"2024-09-12T01:12:01.384991+0000","last_became_active":"2024-09-12T00:30:14.740516+0000","last_became_peered":"2024-09-12T00:30:14.740516+0000","last_unstale":"2024-09-12T01:12:01.384991+0000","last_undegraded":"2024-09-12T01:12:01.384991+0000","last_fullsized":"2024-09-12T01:12:01.384991+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:01.384889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:01.384889+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.384889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:37.035880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'20","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.419942+0000","last_change":"2024-09-12T01:11:46.419942+0000","last_active":"2024-09-12T01:11:46.419942+0000","last_peered":"2024-09-12T01:11:46.419942+0000","last_clean":"2024-09-12T01:11:46.419942+0000","last_became_active":"2024-09-12T00:27:42.840919+0000","last_became_peered":"2024-09-12T00:27:42.840919+0000","last_unstale":"2024-09-12T01:11:46.419942+0000","last_undegraded":"2024-09-12T01:11:46.419942+0000","last_fullsized":"2024-09-12T01:11:46.419942+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'20","last_scrub_stamp":"2024-09-12T01:11:46.419832+0000","last_deep_scrub":"260'20","last_deep_scrub_stamp":"2024-09-12T01:11:46.419832+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.419832+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:50.045905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":83,"num_write":31,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.448148+0000","last_change":"2024-09-12T01:11:46.448148+0000","last_active":"2024-09-12T01:11:46.448148+0000","last_peered":"2024-09-12T01:11:46.448148+0000","last_clean":"2024-09-12T01:11:46.448148+0000","last_became_active":"2024-09-12T00:46:54.887134+0000","last_became_peered":"2024-09-12T00:46:54.887134+0000","last_unstale":"2024-09-12T01:11:46.448148+0000","last_undegraded":"2024-09-12T01:11:46.448148+0000","last_fullsized":"2024-09-12T01:11:46.448148+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:46.447997+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:46.447997+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.447997+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:21.737874+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'9","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.736249+0000","last_change":"2024-09-12T01:11:54.736249+0000","last_active":"2024-09-12T01:11:54.736249+0000","last_peered":"2024-09-12T01:11:54.736249+0000","last_clean":"2024-09-12T01:11:54.736249+0000","last_became_active":"2024-09-12T00:30:17.766203+0000","last_became_peered":"2024-09-12T00:30:17.766203+0000","last_unstale":"2024-09-12T01:11:54.736249+0000","last_undegraded":"2024-09-12T01:11:54.736249+0000","last_fullsized":"2024-09-12T01:11:54.736249+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T01:11:54.736161+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T01:11:54.736161+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.736161+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:25.463090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13412,"num_write":14,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.236429+0000","last_change":"2024-09-12T01:11:33.236429+0000","last_active":"2024-09-12T01:11:33.236429+0000","last_peered":"2024-09-12T01:11:33.236429+0000","last_clean":"2024-09-12T01:11:33.236429+0000","last_became_active":"2024-09-12T00:30:14.746119+0000","last_became_peered":"2024-09-12T00:30:14.746119+0000","last_unstale":"2024-09-12T01:11:33.236429+0000","last_undegraded":"2024-09-12T01:11:33.236429+0000","last_fullsized":"2024-09-12T01:11:33.236429+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.236340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.236340+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.236340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:17.037415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'39","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.429235+0000","last_change":"2024-09-12T01:11:42.429235+0000","last_active":"2024-09-12T01:11:42.429235+0000","last_peered":"2024-09-12T01:11:42.429235+0000","last_clean":"2024-09-12T01:11:42.429235+0000","last_became_active":"2024-09-12T00:27:42.846198+0000","last_became_peered":"2024-09-12T00:27:42.846198+0000","last_unstale":"2024-09-12T01:11:42.429235+0000","last_undegraded":"2024-09-12T01:11:42.429235+0000","last_fullsized":"2024-09-12T01:11:42.429235+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-09-12T01:11:42.429137+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-09-12T01:11:42.429137+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.429137+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:15.211546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":138,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.239313+0000","last_change":"2024-09-12T01:11:47.239313+0000","last_active":"2024-09-12T01:11:47.239313+0000","last_peered":"2024-09-12T01:11:47.239313+0000","last_clean":"2024-09-12T01:11:47.239313+0000","last_became_active":"2024-09-12T00:46:54.885879+0000","last_became_peered":"2024-09-12T00:46:54.885879+0000","last_unstale":"2024-09-12T01:11:47.239313+0000","last_undegraded":"2024-09-12T01:11:47.239313+0000","last_fullsized":"2024-09-12T01:11:47.239313+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:47.239188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:47.239188+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.239188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:52.705498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.599879+0000","last_change":"2024-09-12T01:11:50.599879+0000","last_active":"2024-09-12T01:11:50.599879+0000","last_peered":"2024-09-12T01:11:50.599879+0000","last_clean":"2024-09-12T01:11:50.599879+0000","last_became_active":"2024-09-12T00:30:17.769051+0000","last_became_peered":"2024-09-12T00:30:17.769051+0000","last_unstale":"2024-09-12T01:11:50.599879+0000","last_undegraded":"2024-09-12T01:11:50.599879+0000","last_fullsized":"2024-09-12T01:11:50.599879+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:11:50.599780+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:11:50.599780+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.599780+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:48.876562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'8","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.649225+0000","last_change":"2024-09-12T01:11:45.649225+0000","last_active":"2024-09-12T01:11:45.649225+0000","last_peered":"2024-09-12T01:11:45.649225+0000","last_clean":"2024-09-12T01:11:45.649225+0000","last_became_active":"2024-09-12T00:30:14.743083+0000","last_became_peered":"2024-09-12T00:30:14.743083+0000","last_unstale":"2024-09-12T01:11:45.649225+0000","last_undegraded":"2024-09-12T01:11:45.649225+0000","last_fullsized":"2024-09-12T01:11:45.649225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T01:11:45.649123+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T01:11:45.649123+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.649123+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:19.130722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.647382+0000","last_change":"2024-09-12T01:11:35.647382+0000","last_active":"2024-09-12T01:11:35.647382+0000","last_peered":"2024-09-12T01:11:35.647382+0000","last_clean":"2024-09-12T01:11:35.647382+0000","last_became_active":"2024-09-12T00:27:42.839063+0000","last_became_peered":"2024-09-12T00:27:42.839063+0000","last_unstale":"2024-09-12T01:11:35.647382+0000","last_undegraded":"2024-09-12T01:11:35.647382+0000","last_fullsized":"2024-09-12T01:11:35.647382+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-12T01:11:35.647295+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-12T01:11:35.647295+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.647295+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:24.914272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":119,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.251140+0000","last_change":"2024-09-12T01:11:41.251140+0000","last_active":"2024-09-12T01:11:41.251140+0000","last_peered":"2024-09-12T01:11:41.251140+0000","last_clean":"2024-09-12T01:11:41.251140+0000","last_became_active":"2024-09-12T00:46:54.887450+0000","last_became_peered":"2024-09-12T00:46:54.887450+0000","last_unstale":"2024-09-12T01:11:41.251140+0000","last_undegraded":"2024-09-12T01:11:41.251140+0000","last_fullsized":"2024-09-12T01:11:41.251140+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:41.251052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:41.251052+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.251052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:57.971441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.265271+0000","last_change":"2024-09-12T01:11:36.265271+0000","last_active":"2024-09-12T01:11:36.265271+0000","last_peered":"2024-09-12T01:11:36.265271+0000","last_clean":"2024-09-12T01:11:36.265271+0000","last_became_active":"2024-09-12T00:30:17.756342+0000","last_became_peered":"2024-09-12T00:30:17.756342+0000","last_unstale":"2024-09-12T01:11:36.265271+0000","last_undegraded":"2024-09-12T01:11:36.265271+0000","last_fullsized":"2024-09-12T01:11:36.265271+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T01:11:36.265182+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T01:11:36.265182+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.265182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:21.472602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.828596+0000","last_change":"2024-09-12T01:11:46.828596+0000","last_active":"2024-09-12T01:11:46.828596+0000","last_peered":"2024-09-12T01:11:46.828596+0000","last_clean":"2024-09-12T01:11:46.828596+0000","last_became_active":"2024-09-12T00:30:14.748446+0000","last_became_peered":"2024-09-12T00:30:14.748446+0000","last_unstale":"2024-09-12T01:11:46.828596+0000","last_undegraded":"2024-09-12T01:11:46.828596+0000","last_fullsized":"2024-09-12T01:11:46.828596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:46.828513+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:46.828513+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.828513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:00.099207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'23","reported_seq":114,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.433663+0000","last_change":"2024-09-12T01:11:56.433663+0000","last_active":"2024-09-12T01:11:56.433663+0000","last_peered":"2024-09-12T01:11:56.433663+0000","last_clean":"2024-09-12T01:11:56.433663+0000","last_became_active":"2024-09-12T00:27:42.845379+0000","last_became_peered":"2024-09-12T00:27:42.845379+0000","last_unstale":"2024-09-12T01:11:56.433663+0000","last_undegraded":"2024-09-12T01:11:56.433663+0000","last_fullsized":"2024-09-12T01:11:56.433663+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-12T01:11:56.433559+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-12T01:11:56.433559+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.433559+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:23.210318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.772822+0000","last_change":"2024-09-12T01:12:02.772822+0000","last_active":"2024-09-12T01:12:02.772822+0000","last_peered":"2024-09-12T01:12:02.772822+0000","last_clean":"2024-09-12T01:12:02.772822+0000","last_became_active":"2024-09-12T00:46:54.883713+0000","last_became_peered":"2024-09-12T00:46:54.883713+0000","last_unstale":"2024-09-12T01:12:02.772822+0000","last_undegraded":"2024-09-12T01:12:02.772822+0000","last_fullsized":"2024-09-12T01:12:02.772822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:02.772725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:02.772725+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.772725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:08.576364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'7","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.797444+0000","last_change":"2024-09-12T01:11:52.797444+0000","last_active":"2024-09-12T01:11:52.797444+0000","last_peered":"2024-09-12T01:11:52.797444+0000","last_clean":"2024-09-12T01:11:52.797444+0000","last_became_active":"2024-09-12T00:30:17.764165+0000","last_became_peered":"2024-09-12T00:30:17.764165+0000","last_unstale":"2024-09-12T01:11:52.797444+0000","last_undegraded":"2024-09-12T01:11:52.797444+0000","last_fullsized":"2024-09-12T01:11:52.797444+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-12T01:11:52.797346+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-12T01:11:52.797346+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.797346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:05.658984+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.346199+0000","last_change":"2024-09-12T01:11:38.346199+0000","last_active":"2024-09-12T01:11:38.346199+0000","last_peered":"2024-09-12T01:11:38.346199+0000","last_clean":"2024-09-12T01:11:38.346199+0000","last_became_active":"2024-09-12T00:30:14.747184+0000","last_became_peered":"2024-09-12T00:30:14.747184+0000","last_unstale":"2024-09-12T01:11:38.346199+0000","last_undegraded":"2024-09-12T01:11:38.346199+0000","last_fullsized":"2024-09-12T01:11:38.346199+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:11:38.346116+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:11:38.346116+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.346116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:57.130618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'77","reported_seq":309,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.462228+0000","last_change":"2024-09-12T01:11:55.462148+0000","last_active":"2024-09-12T01:11:55.462228+0000","last_peered":"2024-09-12T01:11:55.462228+0000","last_clean":"2024-09-12T01:11:55.462228+0000","last_became_active":"2024-09-12T00:27:42.846108+0000","last_became_peered":"2024-09-12T00:27:42.846108+0000","last_unstale":"2024-09-12T01:11:55.462228+0000","last_undegraded":"2024-09-12T01:11:55.462228+0000","last_fullsized":"2024-09-12T01:11:55.462228+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'77","last_scrub_stamp":"2024-09-12T01:11:55.462059+0000","last_deep_scrub":"263'77","last_deep_scrub_stamp":"2024-09-12T01:11:55.462059+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.462059+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:24.541395+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":337,"num_write":98,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2988,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.474051+0000","last_change":"2024-09-12T01:11:48.474051+0000","last_active":"2024-09-12T01:11:48.474051+0000","last_peered":"2024-09-12T01:11:48.474051+0000","last_clean":"2024-09-12T01:11:48.474051+0000","last_became_active":"2024-09-12T00:46:54.889496+0000","last_became_peered":"2024-09-12T00:46:54.889496+0000","last_unstale":"2024-09-12T01:11:48.474051+0000","last_undegraded":"2024-09-12T01:11:48.474051+0000","last_fullsized":"2024-09-12T01:11:48.474051+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:48.473946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:48.473946+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.473946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:29.558693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.830680+0000","last_change":"2024-09-12T01:11:59.830680+0000","last_active":"2024-09-12T01:11:59.830680+0000","last_peered":"2024-09-12T01:11:59.830680+0000","last_clean":"2024-09-12T01:11:59.830680+0000","last_became_active":"2024-09-12T00:30:17.767526+0000","last_became_peered":"2024-09-12T00:30:17.767526+0000","last_unstale":"2024-09-12T01:11:59.830680+0000","last_undegraded":"2024-09-12T01:11:59.830680+0000","last_fullsized":"2024-09-12T01:11:59.830680+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:59.830586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:59.830586+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.830586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:10.326486+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.846392+0000","last_change":"2024-09-12T01:11:45.846392+0000","last_active":"2024-09-12T01:11:45.846392+0000","last_peered":"2024-09-12T01:11:45.846392+0000","last_clean":"2024-09-12T01:11:45.846392+0000","last_became_active":"2024-09-12T00:30:14.749104+0000","last_became_peered":"2024-09-12T00:30:14.749104+0000","last_unstale":"2024-09-12T01:11:45.846392+0000","last_undegraded":"2024-09-12T01:11:45.846392+0000","last_fullsized":"2024-09-12T01:11:45.846392+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:11:45.846273+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:11:45.846273+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.846273+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:59.739185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'28","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.688565+0000","last_change":"2024-09-12T01:11:34.688493+0000","last_active":"2024-09-12T01:11:34.688565+0000","last_peered":"2024-09-12T01:11:34.688565+0000","last_clean":"2024-09-12T01:11:34.688565+0000","last_became_active":"2024-09-12T00:27:42.840749+0000","last_became_peered":"2024-09-12T00:27:42.840749+0000","last_unstale":"2024-09-12T01:11:34.688565+0000","last_undegraded":"2024-09-12T01:11:34.688565+0000","last_fullsized":"2024-09-12T01:11:34.688565+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-12T01:11:34.688404+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-12T01:11:34.688404+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.688404+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:36.384869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":101,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.410117+0000","last_change":"2024-09-12T01:11:50.410117+0000","last_active":"2024-09-12T01:11:50.410117+0000","last_peered":"2024-09-12T01:11:50.410117+0000","last_clean":"2024-09-12T01:11:50.410117+0000","last_became_active":"2024-09-12T00:46:54.875939+0000","last_became_peered":"2024-09-12T00:46:54.875939+0000","last_unstale":"2024-09-12T01:11:50.410117+0000","last_undegraded":"2024-09-12T01:11:50.410117+0000","last_fullsized":"2024-09-12T01:11:50.410117+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:50.410026+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:50.410026+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.410026+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:29.961189+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.618610+0000","last_change":"2024-09-12T01:11:48.618610+0000","last_active":"2024-09-12T01:11:48.618610+0000","last_peered":"2024-09-12T01:11:48.618610+0000","last_clean":"2024-09-12T01:11:48.618610+0000","last_became_active":"2024-09-12T00:30:17.761182+0000","last_became_peered":"2024-09-12T00:30:17.761182+0000","last_unstale":"2024-09-12T01:11:48.618610+0000","last_undegraded":"2024-09-12T01:11:48.618610+0000","last_fullsized":"2024-09-12T01:11:48.618610+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:48.618512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:48.618512+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.618512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:53.833538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.209970+0000","last_change":"2024-09-12T01:11:43.209970+0000","last_active":"2024-09-12T01:11:43.209970+0000","last_peered":"2024-09-12T01:11:43.209970+0000","last_clean":"2024-09-12T01:11:43.209970+0000","last_became_active":"2024-09-12T00:30:14.747887+0000","last_became_peered":"2024-09-12T00:30:14.747887+0000","last_unstale":"2024-09-12T01:11:43.209970+0000","last_undegraded":"2024-09-12T01:11:43.209970+0000","last_fullsized":"2024-09-12T01:11:43.209970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:11:43.209850+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:11:43.209850+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.209850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:12.023552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'77","reported_seq":322,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.256977+0000","last_change":"2024-09-12T01:11:36.256919+0000","last_active":"2024-09-12T01:11:36.256977+0000","last_peered":"2024-09-12T01:11:36.256977+0000","last_clean":"2024-09-12T01:11:36.256977+0000","last_became_active":"2024-09-12T00:27:42.839295+0000","last_became_peered":"2024-09-12T00:27:42.839295+0000","last_unstale":"2024-09-12T01:11:36.256977+0000","last_undegraded":"2024-09-12T01:11:36.256977+0000","last_fullsized":"2024-09-12T01:11:36.256977+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'77","last_scrub_stamp":"2024-09-12T01:11:36.256834+0000","last_deep_scrub":"263'77","last_deep_scrub_stamp":"2024-09-12T01:11:36.256834+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.256834+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:36.670777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":349,"num_write":102,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3012,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.457463+0000","last_change":"2024-09-12T01:11:47.457463+0000","last_active":"2024-09-12T01:11:47.457463+0000","last_peered":"2024-09-12T01:11:47.457463+0000","last_clean":"2024-09-12T01:11:47.457463+0000","last_became_active":"2024-09-12T00:46:54.880982+0000","last_became_peered":"2024-09-12T00:46:54.880982+0000","last_unstale":"2024-09-12T01:11:47.457463+0000","last_undegraded":"2024-09-12T01:11:47.457463+0000","last_fullsized":"2024-09-12T01:11:47.457463+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:47.457379+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:47.457379+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.457379+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:56.693099+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"263'2","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:10:00.057885+0000","last_change":"2024-09-12T00:30:17.766356+0000","last_active":"2024-09-12T01:10:00.057885+0000","last_peered":"2024-09-12T01:10:00.057885+0000","last_clean":"2024-09-12T01:10:00.057885+0000","last_became_active":"2024-09-12T00:30:17.765384+0000","last_became_peered":"2024-09-12T00:30:17.765384+0000","last_unstale":"2024-09-12T01:10:00.057885+0000","last_undegraded":"2024-09-12T01:10:00.057885+0000","last_fullsized":"2024-09-12T01:10:00.057885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:48.714095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.333996+0000","last_change":"2024-09-12T01:11:39.333996+0000","last_active":"2024-09-12T01:11:39.333996+0000","last_peered":"2024-09-12T01:11:39.333996+0000","last_clean":"2024-09-12T01:11:39.333996+0000","last_became_active":"2024-09-12T00:30:14.750407+0000","last_became_peered":"2024-09-12T00:30:14.750407+0000","last_unstale":"2024-09-12T01:11:39.333996+0000","last_undegraded":"2024-09-12T01:11:39.333996+0000","last_fullsized":"2024-09-12T01:11:39.333996+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:39.333911+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:39.333911+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.333911+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:53.757755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5691,"num_write":6,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'35","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.660766+0000","last_change":"2024-09-12T01:11:33.660661+0000","last_active":"2024-09-12T01:11:33.660766+0000","last_peered":"2024-09-12T01:11:33.660766+0000","last_clean":"2024-09-12T01:11:33.660766+0000","last_became_active":"2024-09-12T00:27:42.840137+0000","last_became_peered":"2024-09-12T00:27:42.840137+0000","last_unstale":"2024-09-12T01:11:33.660766+0000","last_undegraded":"2024-09-12T01:11:33.660766+0000","last_fullsized":"2024-09-12T01:11:33.660766+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'35","last_scrub_stamp":"2024-09-12T01:11:33.660566+0000","last_deep_scrub":"263'35","last_deep_scrub_stamp":"2024-09-12T01:11:33.660566+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.660566+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:21.665420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":59,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.785903+0000","last_change":"2024-09-12T01:11:56.785903+0000","last_active":"2024-09-12T01:11:56.785903+0000","last_peered":"2024-09-12T01:11:56.785903+0000","last_clean":"2024-09-12T01:11:56.785903+0000","last_became_active":"2024-09-12T00:46:54.888207+0000","last_became_peered":"2024-09-12T00:46:54.888207+0000","last_unstale":"2024-09-12T01:11:56.785903+0000","last_undegraded":"2024-09-12T01:11:56.785903+0000","last_fullsized":"2024-09-12T01:11:56.785903+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:56.785761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:56.785761+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.785761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.539260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'7","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.611328+0000","last_change":"2024-09-12T01:11:47.611328+0000","last_active":"2024-09-12T01:11:47.611328+0000","last_peered":"2024-09-12T01:11:47.611328+0000","last_clean":"2024-09-12T01:11:47.611328+0000","last_became_active":"2024-09-12T00:30:17.763106+0000","last_became_peered":"2024-09-12T00:30:17.763106+0000","last_unstale":"2024-09-12T01:11:47.611328+0000","last_undegraded":"2024-09-12T01:11:47.611328+0000","last_fullsized":"2024-09-12T01:11:47.611328+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-12T01:11:47.611233+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-12T01:11:47.611233+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.611233+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:38.429762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.250694+0000","last_change":"2024-09-12T01:11:40.250694+0000","last_active":"2024-09-12T01:11:40.250694+0000","last_peered":"2024-09-12T01:11:40.250694+0000","last_clean":"2024-09-12T01:11:40.250694+0000","last_became_active":"2024-09-12T00:30:14.746069+0000","last_became_peered":"2024-09-12T00:30:14.746069+0000","last_unstale":"2024-09-12T01:11:40.250694+0000","last_undegraded":"2024-09-12T01:11:40.250694+0000","last_fullsized":"2024-09-12T01:11:40.250694+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:11:40.250607+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:11:40.250607+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.250607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:41.014709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'41","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.656174+0000","last_change":"2024-09-12T01:11:32.656174+0000","last_active":"2024-09-12T01:11:32.656174+0000","last_peered":"2024-09-12T01:11:32.656174+0000","last_clean":"2024-09-12T01:11:32.656174+0000","last_became_active":"2024-09-12T00:27:42.841530+0000","last_became_peered":"2024-09-12T00:27:42.841530+0000","last_unstale":"2024-09-12T01:11:32.656174+0000","last_undegraded":"2024-09-12T01:11:32.656174+0000","last_fullsized":"2024-09-12T01:11:32.656174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:11:32.656093+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:11:32.656093+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.656093+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:14.450082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.222599+0000","last_change":"2024-09-12T01:11:44.222599+0000","last_active":"2024-09-12T01:11:44.222599+0000","last_peered":"2024-09-12T01:11:44.222599+0000","last_clean":"2024-09-12T01:11:44.222599+0000","last_became_active":"2024-09-12T00:46:54.885842+0000","last_became_peered":"2024-09-12T00:46:54.885842+0000","last_unstale":"2024-09-12T01:11:44.222599+0000","last_undegraded":"2024-09-12T01:11:44.222599+0000","last_fullsized":"2024-09-12T01:11:44.222599+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.222520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.222520+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.222520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:58.261245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.584161+0000","last_change":"2024-09-12T01:11:43.584161+0000","last_active":"2024-09-12T01:11:43.584161+0000","last_peered":"2024-09-12T01:11:43.584161+0000","last_clean":"2024-09-12T01:11:43.584161+0000","last_became_active":"2024-09-12T00:30:17.765404+0000","last_became_peered":"2024-09-12T00:30:17.765404+0000","last_unstale":"2024-09-12T01:11:43.584161+0000","last_undegraded":"2024-09-12T01:11:43.584161+0000","last_fullsized":"2024-09-12T01:11:43.584161+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-12T01:11:43.584062+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-12T01:11:43.584062+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.584062+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:01.084763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.465660+0000","last_change":"2024-09-12T01:11:44.465660+0000","last_active":"2024-09-12T01:11:44.465660+0000","last_peered":"2024-09-12T01:11:44.465660+0000","last_clean":"2024-09-12T01:11:44.465660+0000","last_became_active":"2024-09-12T00:30:14.743148+0000","last_became_peered":"2024-09-12T00:30:14.743148+0000","last_unstale":"2024-09-12T01:11:44.465660+0000","last_undegraded":"2024-09-12T01:11:44.465660+0000","last_fullsized":"2024-09-12T01:11:44.465660+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.465571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.465571+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.465571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:28.615096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'37","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.486303+0000","last_change":"2024-09-12T01:11:54.486303+0000","last_active":"2024-09-12T01:11:54.486303+0000","last_peered":"2024-09-12T01:11:54.486303+0000","last_clean":"2024-09-12T01:11:54.486303+0000","last_became_active":"2024-09-12T00:27:42.846090+0000","last_became_peered":"2024-09-12T00:27:42.846090+0000","last_unstale":"2024-09-12T01:11:54.486303+0000","last_undegraded":"2024-09-12T01:11:54.486303+0000","last_fullsized":"2024-09-12T01:11:54.486303+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'37","last_scrub_stamp":"2024-09-12T01:11:54.486208+0000","last_deep_scrub":"263'37","last_deep_scrub_stamp":"2024-09-12T01:11:54.486208+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.486208+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:10.646913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":132,"num_write":69,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:08:35.047409+0000","last_change":"2024-09-12T00:46:54.883396+0000","last_active":"2024-09-12T01:08:35.047409+0000","last_peered":"2024-09-12T01:08:35.047409+0000","last_clean":"2024-09-12T01:08:35.047409+0000","last_became_active":"2024-09-12T00:46:54.883024+0000","last_became_peered":"2024-09-12T00:46:54.883024+0000","last_unstale":"2024-09-12T01:08:35.047409+0000","last_undegraded":"2024-09-12T01:08:35.047409+0000","last_fullsized":"2024-09-12T01:08:35.047409+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:27.222440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.608595+0000","last_change":"2024-09-12T01:11:44.608595+0000","last_active":"2024-09-12T01:11:44.608595+0000","last_peered":"2024-09-12T01:11:44.608595+0000","last_clean":"2024-09-12T01:11:44.608595+0000","last_became_active":"2024-09-12T00:30:17.769226+0000","last_became_peered":"2024-09-12T00:30:17.769226+0000","last_unstale":"2024-09-12T01:11:44.608595+0000","last_undegraded":"2024-09-12T01:11:44.608595+0000","last_fullsized":"2024-09-12T01:11:44.608595+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:44.608500+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:44.608500+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.608500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:47.547326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"260'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.586898+0000","last_change":"2024-09-12T01:11:41.586898+0000","last_active":"2024-09-12T01:11:41.586898+0000","last_peered":"2024-09-12T01:11:41.586898+0000","last_clean":"2024-09-12T01:11:41.586898+0000","last_became_active":"2024-09-12T00:30:14.740963+0000","last_became_peered":"2024-09-12T00:30:14.740963+0000","last_unstale":"2024-09-12T01:11:41.586898+0000","last_undegraded":"2024-09-12T01:11:41.586898+0000","last_fullsized":"2024-09-12T01:11:41.586898+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-12T01:11:41.586800+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-12T01:11:41.586800+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.586800+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:53.601971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.338328+0000","last_change":"2024-09-12T01:11:35.338328+0000","last_active":"2024-09-12T01:11:35.338328+0000","last_peered":"2024-09-12T01:11:35.338328+0000","last_clean":"2024-09-12T01:11:35.338328+0000","last_became_active":"2024-09-12T00:27:42.834942+0000","last_became_peered":"2024-09-12T00:27:42.834942+0000","last_unstale":"2024-09-12T01:11:35.338328+0000","last_undegraded":"2024-09-12T01:11:35.338328+0000","last_fullsized":"2024-09-12T01:11:35.338328+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-09-12T01:11:35.338210+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-09-12T01:11:35.338210+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.338210+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:15.421635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":105,"num_write":60,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.250915+0000","last_change":"2024-09-12T01:11:42.250915+0000","last_active":"2024-09-12T01:11:42.250915+0000","last_peered":"2024-09-12T01:11:42.250915+0000","last_clean":"2024-09-12T01:11:42.250915+0000","last_became_active":"2024-09-12T00:46:54.887303+0000","last_became_peered":"2024-09-12T00:46:54.887303+0000","last_unstale":"2024-09-12T01:11:42.250915+0000","last_undegraded":"2024-09-12T01:11:42.250915+0000","last_fullsized":"2024-09-12T01:11:42.250915+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:42.250816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:42.250816+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.250816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:51.359281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.819642+0000","last_change":"2024-09-12T01:11:51.819642+0000","last_active":"2024-09-12T01:11:51.819642+0000","last_peered":"2024-09-12T01:11:51.819642+0000","last_clean":"2024-09-12T01:11:51.819642+0000","last_became_active":"2024-09-12T00:30:17.768072+0000","last_became_peered":"2024-09-12T00:30:17.768072+0000","last_unstale":"2024-09-12T01:11:51.819642+0000","last_undegraded":"2024-09-12T01:11:51.819642+0000","last_fullsized":"2024-09-12T01:11:51.819642+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:51.819556+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:51.819556+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.819556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:46.982674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.624151+0000","last_change":"2024-09-12T01:11:40.624151+0000","last_active":"2024-09-12T01:11:40.624151+0000","last_peered":"2024-09-12T01:11:40.624151+0000","last_clean":"2024-09-12T01:11:40.624151+0000","last_became_active":"2024-09-12T00:30:14.744485+0000","last_became_peered":"2024-09-12T00:30:14.744485+0000","last_unstale":"2024-09-12T01:11:40.624151+0000","last_undegraded":"2024-09-12T01:11:40.624151+0000","last_fullsized":"2024-09-12T01:11:40.624151+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:40.624068+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:40.624068+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.624068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:32.466602+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'50","reported_seq":203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.515495+0000","last_change":"2024-09-12T01:11:39.515495+0000","last_active":"2024-09-12T01:11:39.515495+0000","last_peered":"2024-09-12T01:11:39.515495+0000","last_clean":"2024-09-12T01:11:39.515495+0000","last_became_active":"2024-09-12T00:27:42.838771+0000","last_became_peered":"2024-09-12T00:27:42.838771+0000","last_unstale":"2024-09-12T01:11:39.515495+0000","last_undegraded":"2024-09-12T01:11:39.515495+0000","last_fullsized":"2024-09-12T01:11:39.515495+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'50","last_scrub_stamp":"2024-09-12T01:11:39.515412+0000","last_deep_scrub":"263'50","last_deep_scrub_stamp":"2024-09-12T01:11:39.515412+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.515412+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:41.609350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":194,"num_write":94,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.789316+0000","last_change":"2024-09-12T01:12:00.789316+0000","last_active":"2024-09-12T01:12:00.789316+0000","last_peered":"2024-09-12T01:12:00.789316+0000","last_clean":"2024-09-12T01:12:00.789316+0000","last_became_active":"2024-09-12T00:46:54.883927+0000","last_became_peered":"2024-09-12T00:46:54.883927+0000","last_unstale":"2024-09-12T01:12:00.789316+0000","last_undegraded":"2024-09-12T01:12:00.789316+0000","last_fullsized":"2024-09-12T01:12:00.789316+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:00.789222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:00.789222+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.789222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:38.749055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'2","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:00.099874+0000","last_change":"2024-09-12T00:30:17.761674+0000","last_active":"2024-09-12T01:11:00.099874+0000","last_peered":"2024-09-12T01:11:00.099874+0000","last_clean":"2024-09-12T01:11:00.099874+0000","last_became_active":"2024-09-12T00:30:17.761176+0000","last_became_peered":"2024-09-12T00:30:17.761176+0000","last_unstale":"2024-09-12T01:11:00.099874+0000","last_undegraded":"2024-09-12T01:11:00.099874+0000","last_fullsized":"2024-09-12T01:11:00.099874+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:16.736862+0000","last_clean_scrub_stamp":"2024-09-12T00:30:16.736862+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.692024+0000","last_change":"2024-09-12T01:11:38.692024+0000","last_active":"2024-09-12T01:11:38.692024+0000","last_peered":"2024-09-12T01:11:38.692024+0000","last_clean":"2024-09-12T01:11:38.692024+0000","last_became_active":"2024-09-12T00:30:14.743730+0000","last_became_peered":"2024-09-12T00:30:14.743730+0000","last_unstale":"2024-09-12T01:11:38.692024+0000","last_undegraded":"2024-09-12T01:11:38.692024+0000","last_fullsized":"2024-09-12T01:11:38.692024+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:38.691940+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:38.691940+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.691940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:44.095227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'40","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.437349+0000","last_change":"2024-09-12T01:11:35.437349+0000","last_active":"2024-09-12T01:11:35.437349+0000","last_peered":"2024-09-12T01:11:35.437349+0000","last_clean":"2024-09-12T01:11:35.437349+0000","last_became_active":"2024-09-12T00:27:42.842267+0000","last_became_peered":"2024-09-12T00:27:42.842267+0000","last_unstale":"2024-09-12T01:11:35.437349+0000","last_undegraded":"2024-09-12T01:11:35.437349+0000","last_fullsized":"2024-09-12T01:11:35.437349+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'40","last_scrub_stamp":"2024-09-12T01:11:35.437220+0000","last_deep_scrub":"263'40","last_deep_scrub_stamp":"2024-09-12T01:11:35.437220+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.437220+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:37.048393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":155,"num_write":62,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.233653+0000","last_change":"2024-09-12T01:11:46.233653+0000","last_active":"2024-09-12T01:11:46.233653+0000","last_peered":"2024-09-12T01:11:46.233653+0000","last_clean":"2024-09-12T01:11:46.233653+0000","last_became_active":"2024-09-12T00:46:54.889349+0000","last_became_peered":"2024-09-12T00:46:54.889349+0000","last_unstale":"2024-09-12T01:11:46.233653+0000","last_undegraded":"2024-09-12T01:11:46.233653+0000","last_fullsized":"2024-09-12T01:11:46.233653+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:46.233564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:46.233564+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.233564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:46.743926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.243873+0000","last_change":"2024-09-12T01:11:43.243873+0000","last_active":"2024-09-12T01:11:43.243873+0000","last_peered":"2024-09-12T01:11:43.243873+0000","last_clean":"2024-09-12T01:11:43.243873+0000","last_became_active":"2024-09-12T00:30:17.759769+0000","last_became_peered":"2024-09-12T00:30:17.759769+0000","last_unstale":"2024-09-12T01:11:43.243873+0000","last_undegraded":"2024-09-12T01:11:43.243873+0000","last_fullsized":"2024-09-12T01:11:43.243873+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:43.243774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:43.243774+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.243774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.590615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.847678+0000","last_change":"2024-09-12T01:11:44.847678+0000","last_active":"2024-09-12T01:11:44.847678+0000","last_peered":"2024-09-12T01:11:44.847678+0000","last_clean":"2024-09-12T01:11:44.847678+0000","last_became_active":"2024-09-12T00:30:14.748409+0000","last_became_peered":"2024-09-12T00:30:14.748409+0000","last_unstale":"2024-09-12T01:11:44.847678+0000","last_undegraded":"2024-09-12T01:11:44.847678+0000","last_fullsized":"2024-09-12T01:11:44.847678+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.847569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.847569+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.847569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:15.110397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'24","reported_seq":123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.292713+0000","last_change":"2024-09-12T01:11:35.292713+0000","last_active":"2024-09-12T01:11:35.292713+0000","last_peered":"2024-09-12T01:11:35.292713+0000","last_clean":"2024-09-12T01:11:35.292713+0000","last_became_active":"2024-09-12T00:27:42.844338+0000","last_became_peered":"2024-09-12T00:27:42.844338+0000","last_unstale":"2024-09-12T01:11:35.292713+0000","last_undegraded":"2024-09-12T01:11:35.292713+0000","last_fullsized":"2024-09-12T01:11:35.292713+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'24","last_scrub_stamp":"2024-09-12T01:11:35.292630+0000","last_deep_scrub":"263'24","last_deep_scrub_stamp":"2024-09-12T01:11:35.292630+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.292630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:02.205316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":85,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.232399+0000","last_change":"2024-09-12T01:11:43.232399+0000","last_active":"2024-09-12T01:11:43.232399+0000","last_peered":"2024-09-12T01:11:43.232399+0000","last_clean":"2024-09-12T01:11:43.232399+0000","last_became_active":"2024-09-12T00:46:54.890636+0000","last_became_peered":"2024-09-12T00:46:54.890636+0000","last_unstale":"2024-09-12T01:11:43.232399+0000","last_undegraded":"2024-09-12T01:11:43.232399+0000","last_fullsized":"2024-09-12T01:11:43.232399+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:43.232308+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:43.232308+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.232308+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:50.652215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.435967+0000","last_change":"2024-09-12T01:11:45.435967+0000","last_active":"2024-09-12T01:11:45.435967+0000","last_peered":"2024-09-12T01:11:45.435967+0000","last_clean":"2024-09-12T01:11:45.435967+0000","last_became_active":"2024-09-12T00:30:17.762239+0000","last_became_peered":"2024-09-12T00:30:17.762239+0000","last_unstale":"2024-09-12T01:11:45.435967+0000","last_undegraded":"2024-09-12T01:11:45.435967+0000","last_fullsized":"2024-09-12T01:11:45.435967+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:45.435880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:45.435880+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.435880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:23.167185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'11","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.659698+0000","last_change":"2024-09-12T01:11:39.659698+0000","last_active":"2024-09-12T01:11:39.659698+0000","last_peered":"2024-09-12T01:11:39.659698+0000","last_clean":"2024-09-12T01:11:39.659698+0000","last_became_active":"2024-09-12T00:30:14.750745+0000","last_became_peered":"2024-09-12T00:30:14.750745+0000","last_unstale":"2024-09-12T01:11:39.659698+0000","last_undegraded":"2024-09-12T01:11:39.659698+0000","last_fullsized":"2024-09-12T01:11:39.659698+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T01:11:39.659613+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T01:11:39.659613+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.659613+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:44.573741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12861,"num_write":16,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.835267+0000","last_change":"2024-09-12T01:11:43.835267+0000","last_active":"2024-09-12T01:11:43.835267+0000","last_peered":"2024-09-12T01:11:43.835267+0000","last_clean":"2024-09-12T01:11:43.835267+0000","last_became_active":"2024-09-12T00:27:42.837690+0000","last_became_peered":"2024-09-12T00:27:42.837690+0000","last_unstale":"2024-09-12T01:11:43.835267+0000","last_undegraded":"2024-09-12T01:11:43.835267+0000","last_fullsized":"2024-09-12T01:11:43.835267+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-12T01:11:43.835151+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-12T01:11:43.835151+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.835151+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:04.599994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.650576+0000","last_change":"2024-09-12T01:11:53.650576+0000","last_active":"2024-09-12T01:11:53.650576+0000","last_peered":"2024-09-12T01:11:53.650576+0000","last_clean":"2024-09-12T01:11:53.650576+0000","last_became_active":"2024-09-12T00:46:54.885262+0000","last_became_peered":"2024-09-12T00:46:54.885262+0000","last_unstale":"2024-09-12T01:11:53.650576+0000","last_undegraded":"2024-09-12T01:11:53.650576+0000","last_fullsized":"2024-09-12T01:11:53.650576+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:53.650493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:53.650493+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.650493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:54.209809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'7","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.271088+0000","last_change":"2024-09-12T01:11:37.271022+0000","last_active":"2024-09-12T01:11:37.271088+0000","last_peered":"2024-09-12T01:11:37.271088+0000","last_clean":"2024-09-12T01:11:37.271088+0000","last_became_active":"2024-09-12T00:30:17.761071+0000","last_became_peered":"2024-09-12T00:30:17.761071+0000","last_unstale":"2024-09-12T01:11:37.271088+0000","last_undegraded":"2024-09-12T01:11:37.271088+0000","last_fullsized":"2024-09-12T01:11:37.271088+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-12T01:11:37.270934+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-12T01:11:37.270934+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.270934+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:47.686643+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.384075+0000","last_change":"2024-09-12T01:11:58.384075+0000","last_active":"2024-09-12T01:11:58.384075+0000","last_peered":"2024-09-12T01:11:58.384075+0000","last_clean":"2024-09-12T01:11:58.384075+0000","last_became_active":"2024-09-12T00:30:14.749906+0000","last_became_peered":"2024-09-12T00:30:14.749906+0000","last_unstale":"2024-09-12T01:11:58.384075+0000","last_undegraded":"2024-09-12T01:11:58.384075+0000","last_fullsized":"2024-09-12T01:11:58.384075+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:58.383982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:58.383982+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.383982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:53.112001+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'11","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.230893+0000","last_change":"2024-09-12T01:11:32.230893+0000","last_active":"2024-09-12T01:11:32.230893+0000","last_peered":"2024-09-12T01:11:32.230893+0000","last_clean":"2024-09-12T01:11:32.230893+0000","last_became_active":"2024-09-12T00:27:42.836870+0000","last_became_peered":"2024-09-12T00:27:42.836870+0000","last_unstale":"2024-09-12T01:11:32.230893+0000","last_undegraded":"2024-09-12T01:11:32.230893+0000","last_fullsized":"2024-09-12T01:11:32.230893+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T01:11:32.230759+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T01:11:32.230759+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.230759+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:37.663368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.248907+0000","last_change":"2024-09-12T01:11:39.248813+0000","last_active":"2024-09-12T01:11:39.248907+0000","last_peered":"2024-09-12T01:11:39.248907+0000","last_clean":"2024-09-12T01:11:39.248907+0000","last_became_active":"2024-09-12T00:46:54.891359+0000","last_became_peered":"2024-09-12T00:46:54.891359+0000","last_unstale":"2024-09-12T01:11:39.248907+0000","last_undegraded":"2024-09-12T01:11:39.248907+0000","last_fullsized":"2024-09-12T01:11:39.248907+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:39.248715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:39.248715+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.248715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:47.820662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.798014+0000","last_change":"2024-09-12T01:11:50.798014+0000","last_active":"2024-09-12T01:11:50.798014+0000","last_peered":"2024-09-12T01:11:50.798014+0000","last_clean":"2024-09-12T01:11:50.798014+0000","last_became_active":"2024-09-12T00:30:17.766810+0000","last_became_peered":"2024-09-12T00:30:17.766810+0000","last_unstale":"2024-09-12T01:11:50.798014+0000","last_undegraded":"2024-09-12T01:11:50.798014+0000","last_fullsized":"2024-09-12T01:11:50.798014+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:11:50.797923+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:11:50.797923+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.797923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:08.045224+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.356865+0000","last_change":"2024-09-12T01:11:59.356865+0000","last_active":"2024-09-12T01:11:59.356865+0000","last_peered":"2024-09-12T01:11:59.356865+0000","last_clean":"2024-09-12T01:11:59.356865+0000","last_became_active":"2024-09-12T00:30:14.744334+0000","last_became_peered":"2024-09-12T00:30:14.744334+0000","last_unstale":"2024-09-12T01:11:59.356865+0000","last_undegraded":"2024-09-12T01:11:59.356865+0000","last_fullsized":"2024-09-12T01:11:59.356865+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:11:59.356765+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:11:59.356765+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.356765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:21.563798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":176,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.391984+0000","last_change":"2024-09-12T01:11:43.391984+0000","last_active":"2024-09-12T01:11:43.391984+0000","last_peered":"2024-09-12T01:11:43.391984+0000","last_clean":"2024-09-12T01:11:43.391984+0000","last_became_active":"2024-09-12T00:27:42.836468+0000","last_became_peered":"2024-09-12T00:27:42.836468+0000","last_unstale":"2024-09-12T01:11:43.391984+0000","last_undegraded":"2024-09-12T01:11:43.391984+0000","last_fullsized":"2024-09-12T01:11:43.391984+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-12T01:11:43.391881+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-12T01:11:43.391881+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.391881+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:16.530349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":155,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.254054+0000","last_change":"2024-09-12T01:11:40.254001+0000","last_active":"2024-09-12T01:11:40.254054+0000","last_peered":"2024-09-12T01:11:40.254054+0000","last_clean":"2024-09-12T01:11:40.254054+0000","last_became_active":"2024-09-12T00:46:54.888533+0000","last_became_peered":"2024-09-12T00:46:54.888533+0000","last_unstale":"2024-09-12T01:11:40.254054+0000","last_undegraded":"2024-09-12T01:11:40.254054+0000","last_fullsized":"2024-09-12T01:11:40.254054+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:40.253917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:40.253917+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.253917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:56.500777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.822998+0000","last_change":"2024-09-12T01:11:49.822900+0000","last_active":"2024-09-12T01:11:49.822998+0000","last_peered":"2024-09-12T01:11:49.822998+0000","last_clean":"2024-09-12T01:11:49.822998+0000","last_became_active":"2024-09-12T00:30:17.764747+0000","last_became_peered":"2024-09-12T00:30:17.764747+0000","last_unstale":"2024-09-12T01:11:49.822998+0000","last_undegraded":"2024-09-12T01:11:49.822998+0000","last_fullsized":"2024-09-12T01:11:49.822998+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:11:49.822795+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:11:49.822795+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.822795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:15.046766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.433221+0000","last_change":"2024-09-12T01:11:45.433151+0000","last_active":"2024-09-12T01:11:45.433221+0000","last_peered":"2024-09-12T01:11:45.433221+0000","last_clean":"2024-09-12T01:11:45.433221+0000","last_became_active":"2024-09-12T00:30:14.749668+0000","last_became_peered":"2024-09-12T00:30:14.749668+0000","last_unstale":"2024-09-12T01:11:45.433221+0000","last_undegraded":"2024-09-12T01:11:45.433221+0000","last_fullsized":"2024-09-12T01:11:45.433221+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:11:45.433062+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:11:45.433062+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.433062+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:02.494359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'44","reported_seq":178,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.535224+0000","last_change":"2024-09-12T01:11:53.535224+0000","last_active":"2024-09-12T01:11:53.535224+0000","last_peered":"2024-09-12T01:11:53.535224+0000","last_clean":"2024-09-12T01:11:53.535224+0000","last_became_active":"2024-09-12T00:27:42.845963+0000","last_became_peered":"2024-09-12T00:27:42.845963+0000","last_unstale":"2024-09-12T01:11:53.535224+0000","last_undegraded":"2024-09-12T01:11:53.535224+0000","last_fullsized":"2024-09-12T01:11:53.535224+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-12T01:11:53.535134+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-12T01:11:53.535134+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.535134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:40.441738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":173,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.795610+0000","last_change":"2024-09-12T01:12:01.795610+0000","last_active":"2024-09-12T01:12:01.795610+0000","last_peered":"2024-09-12T01:12:01.795610+0000","last_clean":"2024-09-12T01:12:01.795610+0000","last_became_active":"2024-09-12T00:46:54.884950+0000","last_became_peered":"2024-09-12T00:46:54.884950+0000","last_unstale":"2024-09-12T01:12:01.795610+0000","last_undegraded":"2024-09-12T01:12:01.795610+0000","last_fullsized":"2024-09-12T01:12:01.795610+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:01.795507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:01.795507+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.795507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:40.510032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.264155+0000","last_change":"2024-09-12T01:11:35.264155+0000","last_active":"2024-09-12T01:11:35.264155+0000","last_peered":"2024-09-12T01:11:35.264155+0000","last_clean":"2024-09-12T01:11:35.264155+0000","last_became_active":"2024-09-12T00:30:17.762415+0000","last_became_peered":"2024-09-12T00:30:17.762415+0000","last_unstale":"2024-09-12T01:11:35.264155+0000","last_undegraded":"2024-09-12T01:11:35.264155+0000","last_fullsized":"2024-09-12T01:11:35.264155+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:35.264056+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:35.264056+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.264056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:07.751580+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'6","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.281390+0000","last_change":"2024-09-12T01:11:39.281390+0000","last_active":"2024-09-12T01:11:39.281390+0000","last_peered":"2024-09-12T01:11:39.281390+0000","last_clean":"2024-09-12T01:11:39.281390+0000","last_became_active":"2024-09-12T00:30:14.748581+0000","last_became_peered":"2024-09-12T00:30:14.748581+0000","last_unstale":"2024-09-12T01:11:39.281390+0000","last_undegraded":"2024-09-12T01:11:39.281390+0000","last_fullsized":"2024-09-12T01:11:39.281390+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:39.281303+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:39.281303+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.281303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:29.540255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":186,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.339068+0000","last_change":"2024-09-12T01:11:34.338999+0000","last_active":"2024-09-12T01:11:34.339068+0000","last_peered":"2024-09-12T01:11:34.339068+0000","last_clean":"2024-09-12T01:11:34.339068+0000","last_became_active":"2024-09-12T00:27:42.843968+0000","last_became_peered":"2024-09-12T00:27:42.843968+0000","last_unstale":"2024-09-12T01:11:34.339068+0000","last_undegraded":"2024-09-12T01:11:34.339068+0000","last_fullsized":"2024-09-12T01:11:34.339068+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'46","last_scrub_stamp":"2024-09-12T01:11:34.338918+0000","last_deep_scrub":"263'46","last_deep_scrub_stamp":"2024-09-12T01:11:34.338918+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.338918+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:30.360729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":171,"num_write":76,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:50.056431+0000","last_change":"2024-09-12T00:46:54.881183+0000","last_active":"2024-09-12T01:09:50.056431+0000","last_peered":"2024-09-12T01:09:50.056431+0000","last_clean":"2024-09-12T01:09:50.056431+0000","last_became_active":"2024-09-12T00:46:54.880874+0000","last_became_peered":"2024-09-12T00:46:54.880874+0000","last_unstale":"2024-09-12T01:09:50.056431+0000","last_undegraded":"2024-09-12T01:09:50.056431+0000","last_fullsized":"2024-09-12T01:09:50.056431+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.386122+0000","last_change":"2024-09-12T01:12:04.386122+0000","last_active":"2024-09-12T01:12:04.386122+0000","last_peered":"2024-09-12T01:12:04.386122+0000","last_clean":"2024-09-12T01:12:04.386122+0000","last_became_active":"2024-09-12T00:30:17.762807+0000","last_became_peered":"2024-09-12T00:30:17.762807+0000","last_unstale":"2024-09-12T01:12:04.386122+0000","last_undegraded":"2024-09-12T01:12:04.386122+0000","last_fullsized":"2024-09-12T01:12:04.386122+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:12:04.386018+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:12:04.386018+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.386018+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:43.517180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"263'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.359759+0000","last_change":"2024-09-12T01:12:00.359759+0000","last_active":"2024-09-12T01:12:00.359759+0000","last_peered":"2024-09-12T01:12:00.359759+0000","last_clean":"2024-09-12T01:12:00.359759+0000","last_became_active":"2024-09-12T00:30:14.749608+0000","last_became_peered":"2024-09-12T00:30:14.749608+0000","last_unstale":"2024-09-12T01:12:00.359759+0000","last_undegraded":"2024-09-12T01:12:00.359759+0000","last_fullsized":"2024-09-12T01:12:00.359759+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:12:00.359659+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:12:00.359659+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.359659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:22.557961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'41","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.700866+0000","last_change":"2024-09-12T01:11:31.700866+0000","last_active":"2024-09-12T01:11:31.700866+0000","last_peered":"2024-09-12T01:11:31.700866+0000","last_clean":"2024-09-12T01:11:31.700866+0000","last_became_active":"2024-09-12T00:27:42.845889+0000","last_became_peered":"2024-09-12T00:27:42.845889+0000","last_unstale":"2024-09-12T01:11:31.700866+0000","last_undegraded":"2024-09-12T01:11:31.700866+0000","last_fullsized":"2024-09-12T01:11:31.700866+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:11:31.700770+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:11:31.700770+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.700770+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:28.675940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":162,"num_write":61,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.644638+0000","last_change":"2024-09-12T01:11:52.644638+0000","last_active":"2024-09-12T01:11:52.644638+0000","last_peered":"2024-09-12T01:11:52.644638+0000","last_clean":"2024-09-12T01:11:52.644638+0000","last_became_active":"2024-09-12T00:46:54.887206+0000","last_became_peered":"2024-09-12T00:46:54.887206+0000","last_unstale":"2024-09-12T01:11:52.644638+0000","last_undegraded":"2024-09-12T01:11:52.644638+0000","last_fullsized":"2024-09-12T01:11:52.644638+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:52.644547+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:52.644547+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.644547+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:11.152694+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.374321+0000","last_change":"2024-09-12T01:11:47.374260+0000","last_active":"2024-09-12T01:11:47.374321+0000","last_peered":"2024-09-12T01:11:47.374321+0000","last_clean":"2024-09-12T01:11:47.374321+0000","last_became_active":"2024-09-12T00:30:17.767990+0000","last_became_peered":"2024-09-12T00:30:17.767990+0000","last_unstale":"2024-09-12T01:11:47.374321+0000","last_undegraded":"2024-09-12T01:11:47.374321+0000","last_fullsized":"2024-09-12T01:11:47.374321+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-12T01:11:47.374163+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-12T01:11:47.374163+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.374163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:58.901174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"263'2","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.251479+0000","last_change":"2024-09-12T01:11:38.251479+0000","last_active":"2024-09-12T01:11:38.251479+0000","last_peered":"2024-09-12T01:11:38.251479+0000","last_clean":"2024-09-12T01:11:38.251479+0000","last_became_active":"2024-09-12T00:30:14.745195+0000","last_became_peered":"2024-09-12T00:30:14.745195+0000","last_unstale":"2024-09-12T01:11:38.251479+0000","last_undegraded":"2024-09-12T01:11:38.251479+0000","last_fullsized":"2024-09-12T01:11:38.251479+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:38.251373+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:38.251373+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.251373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:47.047585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'32","reported_seq":140,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.289095+0000","last_change":"2024-09-12T01:11:33.289095+0000","last_active":"2024-09-12T01:11:33.289095+0000","last_peered":"2024-09-12T01:11:33.289095+0000","last_clean":"2024-09-12T01:11:33.289095+0000","last_became_active":"2024-09-12T00:27:42.843841+0000","last_became_peered":"2024-09-12T00:27:42.843841+0000","last_unstale":"2024-09-12T01:11:33.289095+0000","last_undegraded":"2024-09-12T01:11:33.289095+0000","last_fullsized":"2024-09-12T01:11:33.289095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-12T01:11:33.288999+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-12T01:11:33.288999+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.288999+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:52.548586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":99,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.428626+0000","last_change":"2024-09-12T01:11:49.428626+0000","last_active":"2024-09-12T01:11:49.428626+0000","last_peered":"2024-09-12T01:11:49.428626+0000","last_clean":"2024-09-12T01:11:49.428626+0000","last_became_active":"2024-09-12T00:46:54.884110+0000","last_became_peered":"2024-09-12T00:46:54.884110+0000","last_unstale":"2024-09-12T01:11:49.428626+0000","last_undegraded":"2024-09-12T01:11:49.428626+0000","last_fullsized":"2024-09-12T01:11:49.428626+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:49.428531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:49.428531+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.428531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:19.241137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'4","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.376079+0000","last_change":"2024-09-12T01:12:03.376079+0000","last_active":"2024-09-12T01:12:03.376079+0000","last_peered":"2024-09-12T01:12:03.376079+0000","last_clean":"2024-09-12T01:12:03.376079+0000","last_became_active":"2024-09-12T00:30:17.762850+0000","last_became_peered":"2024-09-12T00:30:17.762850+0000","last_unstale":"2024-09-12T01:12:03.376079+0000","last_undegraded":"2024-09-12T01:12:03.376079+0000","last_fullsized":"2024-09-12T01:12:03.376079+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:12:03.375993+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:12:03.375993+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.375993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:56.677407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'10","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.405642+0000","last_change":"2024-09-12T01:11:57.405642+0000","last_active":"2024-09-12T01:11:57.405642+0000","last_peered":"2024-09-12T01:11:57.405642+0000","last_clean":"2024-09-12T01:11:57.405642+0000","last_became_active":"2024-09-12T00:30:14.736286+0000","last_became_peered":"2024-09-12T00:30:14.736286+0000","last_unstale":"2024-09-12T01:11:57.405642+0000","last_undegraded":"2024-09-12T01:11:57.405642+0000","last_fullsized":"2024-09-12T01:11:57.405642+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-12T01:11:57.405519+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-12T01:11:57.405519+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.405519+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:40.979476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":20,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'42","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.567454+0000","last_change":"2024-09-12T01:11:52.567454+0000","last_active":"2024-09-12T01:11:52.567454+0000","last_peered":"2024-09-12T01:11:52.567454+0000","last_clean":"2024-09-12T01:11:52.567454+0000","last_became_active":"2024-09-12T00:27:42.841880+0000","last_became_peered":"2024-09-12T00:27:42.841880+0000","last_unstale":"2024-09-12T01:11:52.567454+0000","last_undegraded":"2024-09-12T01:11:52.567454+0000","last_fullsized":"2024-09-12T01:11:52.567454+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-09-12T01:11:52.567365+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-09-12T01:11:52.567365+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.567365+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:03.380498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":149,"num_write":77,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.765151+0000","last_change":"2024-09-12T01:11:55.765047+0000","last_active":"2024-09-12T01:11:55.765151+0000","last_peered":"2024-09-12T01:11:55.765151+0000","last_clean":"2024-09-12T01:11:55.765151+0000","last_became_active":"2024-09-12T00:46:54.887241+0000","last_became_peered":"2024-09-12T00:46:54.887241+0000","last_unstale":"2024-09-12T01:11:55.765151+0000","last_undegraded":"2024-09-12T01:11:55.765151+0000","last_fullsized":"2024-09-12T01:11:55.765151+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:55.764940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:55.764940+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.764940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:07.905414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.206615+0000","last_change":"2024-09-12T01:11:42.206563+0000","last_active":"2024-09-12T01:11:42.206615+0000","last_peered":"2024-09-12T01:11:42.206615+0000","last_clean":"2024-09-12T01:11:42.206615+0000","last_became_active":"2024-09-12T00:30:17.763434+0000","last_became_peered":"2024-09-12T00:30:17.763434+0000","last_unstale":"2024-09-12T01:11:42.206615+0000","last_undegraded":"2024-09-12T01:11:42.206615+0000","last_fullsized":"2024-09-12T01:11:42.206615+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:42.206473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:42.206473+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.206473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:27.672537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.504732+0000","last_change":"2024-09-12T01:11:42.504674+0000","last_active":"2024-09-12T01:11:42.504732+0000","last_peered":"2024-09-12T01:11:42.504732+0000","last_clean":"2024-09-12T01:11:42.504732+0000","last_became_active":"2024-09-12T00:30:14.744954+0000","last_became_peered":"2024-09-12T00:30:14.744954+0000","last_unstale":"2024-09-12T01:11:42.504732+0000","last_undegraded":"2024-09-12T01:11:42.504732+0000","last_fullsized":"2024-09-12T01:11:42.504732+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:42.504571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:42.504571+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.504571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:04.012804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'51","reported_seq":190,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.548748+0000","last_change":"2024-09-12T01:11:51.548748+0000","last_active":"2024-09-12T01:11:51.548748+0000","last_peered":"2024-09-12T01:11:51.548748+0000","last_clean":"2024-09-12T01:11:51.548748+0000","last_became_active":"2024-09-12T00:27:42.842779+0000","last_became_peered":"2024-09-12T00:27:42.842779+0000","last_unstale":"2024-09-12T01:11:51.548748+0000","last_undegraded":"2024-09-12T01:11:51.548748+0000","last_fullsized":"2024-09-12T01:11:51.548748+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-12T01:11:51.548658+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-12T01:11:51.548658+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.548658+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:29.490362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":161,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:09:55.057225+0000","last_change":"2024-09-12T00:46:54.882461+0000","last_active":"2024-09-12T01:09:55.057225+0000","last_peered":"2024-09-12T01:09:55.057225+0000","last_clean":"2024-09-12T01:09:55.057225+0000","last_became_active":"2024-09-12T00:46:54.882192+0000","last_became_peered":"2024-09-12T00:46:54.882192+0000","last_unstale":"2024-09-12T01:09:55.057225+0000","last_undegraded":"2024-09-12T01:09:55.057225+0000","last_fullsized":"2024-09-12T01:09:55.057225+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:53.861946+0000","last_clean_scrub_stamp":"2024-09-12T00:46:53.861946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.202397+0000","last_change":"2024-09-12T01:11:41.202340+0000","last_active":"2024-09-12T01:11:41.202397+0000","last_peered":"2024-09-12T01:11:41.202397+0000","last_clean":"2024-09-12T01:11:41.202397+0000","last_became_active":"2024-09-12T00:30:17.756710+0000","last_became_peered":"2024-09-12T00:30:17.756710+0000","last_unstale":"2024-09-12T01:11:41.202397+0000","last_undegraded":"2024-09-12T01:11:41.202397+0000","last_fullsized":"2024-09-12T01:11:41.202397+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:41.202253+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:41.202253+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.202253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:23.774889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'5","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.295951+0000","last_change":"2024-09-12T01:11:36.295864+0000","last_active":"2024-09-12T01:11:36.295951+0000","last_peered":"2024-09-12T01:11:36.295951+0000","last_clean":"2024-09-12T01:11:36.295951+0000","last_became_active":"2024-09-12T00:30:14.749353+0000","last_became_peered":"2024-09-12T00:30:14.749353+0000","last_unstale":"2024-09-12T01:11:36.295951+0000","last_undegraded":"2024-09-12T01:11:36.295951+0000","last_fullsized":"2024-09-12T01:11:36.295951+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:11:36.295742+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:11:36.295742+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.295742+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:20.185219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'16","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.318746+0000","last_change":"2024-09-12T01:11:31.318689+0000","last_active":"2024-09-12T01:11:31.318746+0000","last_peered":"2024-09-12T01:11:31.318746+0000","last_clean":"2024-09-12T01:11:31.318746+0000","last_became_active":"2024-09-12T00:27:42.846065+0000","last_became_peered":"2024-09-12T00:27:42.846065+0000","last_unstale":"2024-09-12T01:11:31.318746+0000","last_undegraded":"2024-09-12T01:11:31.318746+0000","last_fullsized":"2024-09-12T01:11:31.318746+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'16","last_scrub_stamp":"2024-09-12T01:11:31.318604+0000","last_deep_scrub":"260'16","last_deep_scrub_stamp":"2024-09-12T01:11:31.318604+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.318604+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:58.588008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":60,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'368","reported_seq":1044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.199577+0000","last_change":"2024-09-12T01:11:13.199577+0000","last_active":"2024-09-12T01:11:13.199577+0000","last_peered":"2024-09-12T01:11:13.199577+0000","last_clean":"2024-09-12T01:11:13.199577+0000","last_became_active":"2024-09-12T00:12:36.041803+0000","last_became_peered":"2024-09-12T00:12:36.041803+0000","last_unstale":"2024-09-12T01:11:13.199577+0000","last_undegraded":"2024-09-12T01:11:13.199577+0000","last_fullsized":"2024-09-12T01:11:13.199577+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'368","last_scrub_stamp":"2024-09-12T01:11:13.199449+0000","last_deep_scrub":"263'368","last_deep_scrub_stamp":"2024-09-12T01:11:13.199449+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.199449+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:26.747669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48825,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":31202,"num_write":1169,"num_write_kb":36538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'78","reported_seq":677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.245203+0000","last_change":"2024-09-12T01:11:18.245203+0000","last_active":"2024-09-12T01:11:18.245203+0000","last_peered":"2024-09-12T01:11:18.245203+0000","last_clean":"2024-09-12T01:11:18.245203+0000","last_became_active":"2024-09-12T00:12:38.035848+0000","last_became_peered":"2024-09-12T00:12:38.035848+0000","last_unstale":"2024-09-12T01:11:18.245203+0000","last_undegraded":"2024-09-12T01:11:18.245203+0000","last_fullsized":"2024-09-12T01:11:18.245203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'78","last_scrub_stamp":"2024-09-12T01:11:18.245112+0000","last_deep_scrub":"263'78","last_deep_scrub_stamp":"2024-09-12T01:11:18.245112+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.245112+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:00.565463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":321,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'468","reported_seq":1249,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.840938+0000","last_change":"2024-09-12T01:11:17.840938+0000","last_active":"2024-09-12T01:11:17.840938+0000","last_peered":"2024-09-12T01:11:17.840938+0000","last_clean":"2024-09-12T01:11:17.840938+0000","last_became_active":"2024-09-12T00:12:36.045325+0000","last_became_peered":"2024-09-12T00:12:36.045325+0000","last_unstale":"2024-09-12T01:11:17.840938+0000","last_undegraded":"2024-09-12T01:11:17.840938+0000","last_fullsized":"2024-09-12T01:11:17.840938+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'468","last_scrub_stamp":"2024-09-12T01:11:17.840763+0000","last_deep_scrub":"263'468","last_deep_scrub_stamp":"2024-09-12T01:11:17.840763+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.840763+0000","objects_scrubbed":10,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:41.998542+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6448752,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1044,"num_read_kb":48846,"num_write":1428,"num_write_kb":45958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'64","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.383471+0000","last_change":"2024-09-12T01:11:27.383471+0000","last_active":"2024-09-12T01:11:27.383471+0000","last_peered":"2024-09-12T01:11:27.383471+0000","last_clean":"2024-09-12T01:11:27.383471+0000","last_became_active":"2024-09-12T00:12:38.040122+0000","last_became_peered":"2024-09-12T00:12:38.040122+0000","last_unstale":"2024-09-12T01:11:27.383471+0000","last_undegraded":"2024-09-12T01:11:27.383471+0000","last_fullsized":"2024-09-12T01:11:27.383471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'64","last_scrub_stamp":"2024-09-12T01:11:27.383381+0000","last_deep_scrub":"263'64","last_deep_scrub_stamp":"2024-09-12T01:11:27.383381+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.383381+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:51.503948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":259,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'346","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.861951+0000","last_change":"2024-09-12T01:11:16.861951+0000","last_active":"2024-09-12T01:11:16.861951+0000","last_peered":"2024-09-12T01:11:16.861951+0000","last_clean":"2024-09-12T01:11:16.861951+0000","last_became_active":"2024-09-12T00:12:36.039741+0000","last_became_peered":"2024-09-12T00:12:36.039741+0000","last_unstale":"2024-09-12T01:11:16.861951+0000","last_undegraded":"2024-09-12T01:11:16.861951+0000","last_fullsized":"2024-09-12T01:11:16.861951+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-12T01:11:16.861851+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-12T01:11:16.861851+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.861851+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:47.559046+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262217,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":26393,"num_write":1030,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'307","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.421184+0000","last_change":"2024-09-12T01:11:28.421184+0000","last_active":"2024-09-12T01:11:28.421184+0000","last_peered":"2024-09-12T01:11:28.421184+0000","last_clean":"2024-09-12T01:11:28.421184+0000","last_became_active":"2024-09-12T00:12:38.041795+0000","last_became_peered":"2024-09-12T00:12:38.041795+0000","last_unstale":"2024-09-12T01:11:28.421184+0000","last_undegraded":"2024-09-12T01:11:28.421184+0000","last_fullsized":"2024-09-12T01:11:28.421184+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-12T01:11:28.421075+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-12T01:11:28.421075+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.421075+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:51.999413+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1291,"num_read_kb":1053,"num_write":447,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'403","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.179422+0000","last_change":"2024-09-12T01:11:07.179422+0000","last_active":"2024-09-12T01:11:07.179422+0000","last_peered":"2024-09-12T01:11:07.179422+0000","last_clean":"2024-09-12T01:11:07.179422+0000","last_became_active":"2024-09-12T00:12:36.036970+0000","last_became_peered":"2024-09-12T00:12:36.036970+0000","last_unstale":"2024-09-12T01:11:07.179422+0000","last_undegraded":"2024-09-12T01:11:07.179422+0000","last_fullsized":"2024-09-12T01:11:07.179422+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-12T01:11:07.179336+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-12T01:11:07.179336+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.179336+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:19.036143+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":29211,"num_write":1250,"num_write_kb":52081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'61","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.432667+0000","last_change":"2024-09-12T01:11:22.432667+0000","last_active":"2024-09-12T01:11:22.432667+0000","last_peered":"2024-09-12T01:11:22.432667+0000","last_clean":"2024-09-12T01:11:22.432667+0000","last_became_active":"2024-09-12T00:12:38.039292+0000","last_became_peered":"2024-09-12T00:12:38.039292+0000","last_unstale":"2024-09-12T01:11:22.432667+0000","last_undegraded":"2024-09-12T01:11:22.432667+0000","last_fullsized":"2024-09-12T01:11:22.432667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'61","last_scrub_stamp":"2024-09-12T01:11:22.432578+0000","last_deep_scrub":"263'61","last_deep_scrub_stamp":"2024-09-12T01:11:22.432578+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.432578+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:17.788153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":95,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'338","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.182576+0000","last_change":"2024-09-12T01:11:22.182576+0000","last_active":"2024-09-12T01:11:22.182576+0000","last_peered":"2024-09-12T01:11:22.182576+0000","last_clean":"2024-09-12T01:11:22.182576+0000","last_became_active":"2024-09-12T00:12:36.044021+0000","last_became_peered":"2024-09-12T00:12:36.044021+0000","last_unstale":"2024-09-12T01:11:22.182576+0000","last_undegraded":"2024-09-12T01:11:22.182576+0000","last_fullsized":"2024-09-12T01:11:22.182576+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-12T01:11:22.182412+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-12T01:11:22.182412+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.182412+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:27.695629+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730157,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":19079,"num_write":1003,"num_write_kb":26981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'448","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.134945+0000","last_change":"2024-09-12T01:11:21.134945+0000","last_active":"2024-09-12T01:11:21.134945+0000","last_peered":"2024-09-12T01:11:21.134945+0000","last_clean":"2024-09-12T01:11:21.134945+0000","last_became_active":"2024-09-12T00:12:38.037000+0000","last_became_peered":"2024-09-12T00:12:38.037000+0000","last_unstale":"2024-09-12T01:11:21.134945+0000","last_undegraded":"2024-09-12T01:11:21.134945+0000","last_fullsized":"2024-09-12T01:11:21.134945+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'448","last_scrub_stamp":"2024-09-12T01:11:21.134865+0000","last_deep_scrub":"263'448","last_deep_scrub_stamp":"2024-09-12T01:11:21.134865+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.134865+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:20.612613+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1930,"num_read_kb":1543,"num_write":735,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":986,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'369","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.185720+0000","last_change":"2024-09-12T01:11:15.185720+0000","last_active":"2024-09-12T01:11:15.185720+0000","last_peered":"2024-09-12T01:11:15.185720+0000","last_clean":"2024-09-12T01:11:15.185720+0000","last_became_active":"2024-09-12T00:12:36.038235+0000","last_became_peered":"2024-09-12T00:12:36.038235+0000","last_unstale":"2024-09-12T01:11:15.185720+0000","last_undegraded":"2024-09-12T01:11:15.185720+0000","last_fullsized":"2024-09-12T01:11:15.185720+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-12T01:11:15.185608+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-12T01:11:15.185608+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.185608+0000","objects_scrubbed":8,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:57.218559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342021,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":629,"num_read_kb":9962,"num_write":1248,"num_write_kb":25658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'300","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.173657+0000","last_change":"2024-09-12T01:11:17.173657+0000","last_active":"2024-09-12T01:11:17.173657+0000","last_peered":"2024-09-12T01:11:17.173657+0000","last_clean":"2024-09-12T01:11:17.173657+0000","last_became_active":"2024-09-12T00:12:38.045308+0000","last_became_peered":"2024-09-12T00:12:38.045308+0000","last_unstale":"2024-09-12T01:11:17.173657+0000","last_undegraded":"2024-09-12T01:11:17.173657+0000","last_fullsized":"2024-09-12T01:11:17.173657+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-12T01:11:17.173563+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-12T01:11:17.173563+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.173563+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:02.418536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1317,"num_read_kb":1075,"num_write":482,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'325","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.176988+0000","last_change":"2024-09-12T01:11:12.176988+0000","last_active":"2024-09-12T01:11:12.176988+0000","last_peered":"2024-09-12T01:11:12.176988+0000","last_clean":"2024-09-12T01:11:12.176988+0000","last_became_active":"2024-09-12T00:12:36.041698+0000","last_became_peered":"2024-09-12T00:12:36.041698+0000","last_unstale":"2024-09-12T01:11:12.176988+0000","last_undegraded":"2024-09-12T01:11:12.176988+0000","last_fullsized":"2024-09-12T01:11:12.176988+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-09-12T01:11:12.176870+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-09-12T01:11:12.176870+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.176870+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:10.449840+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":30384,"num_write":1021,"num_write_kb":31492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'494","reported_seq":1263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.295295+0000","last_change":"2024-09-12T01:11:22.295295+0000","last_active":"2024-09-12T01:11:22.295295+0000","last_peered":"2024-09-12T01:11:22.295295+0000","last_clean":"2024-09-12T01:11:22.295295+0000","last_became_active":"2024-09-12T00:12:38.038023+0000","last_became_peered":"2024-09-12T00:12:38.038023+0000","last_unstale":"2024-09-12T01:11:22.295295+0000","last_undegraded":"2024-09-12T01:11:22.295295+0000","last_fullsized":"2024-09-12T01:11:22.295295+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'494","last_scrub_stamp":"2024-09-12T01:11:22.295202+0000","last_deep_scrub":"263'494","last_deep_scrub_stamp":"2024-09-12T01:11:22.295202+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.295202+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:02.301203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2347,"num_read_kb":2031,"num_write":873,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3149,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'296","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.890838+0000","last_change":"2024-09-12T01:11:15.890838+0000","last_active":"2024-09-12T01:11:15.890838+0000","last_peered":"2024-09-12T01:11:15.890838+0000","last_clean":"2024-09-12T01:11:15.890838+0000","last_became_active":"2024-09-12T00:12:36.050008+0000","last_became_peered":"2024-09-12T00:12:36.050008+0000","last_unstale":"2024-09-12T01:11:15.890838+0000","last_undegraded":"2024-09-12T01:11:15.890838+0000","last_fullsized":"2024-09-12T01:11:15.890838+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'296","last_scrub_stamp":"2024-09-12T01:11:15.890624+0000","last_deep_scrub":"263'296","last_deep_scrub_stamp":"2024-09-12T01:11:15.890624+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.890624+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:16.146979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":30850,"num_write":1048,"num_write_kb":20572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'204","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.892969+0000","last_change":"2024-09-12T01:11:26.892969+0000","last_active":"2024-09-12T01:11:26.892969+0000","last_peered":"2024-09-12T01:11:26.892969+0000","last_clean":"2024-09-12T01:11:26.892969+0000","last_became_active":"2024-09-12T00:12:38.043059+0000","last_became_peered":"2024-09-12T00:12:38.043059+0000","last_unstale":"2024-09-12T01:11:26.892969+0000","last_undegraded":"2024-09-12T01:11:26.892969+0000","last_fullsized":"2024-09-12T01:11:26.892969+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'204","last_scrub_stamp":"2024-09-12T01:11:26.892863+0000","last_deep_scrub":"263'204","last_deep_scrub_stamp":"2024-09-12T01:11:26.892863+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.892863+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:16.644574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":751,"num_write":306,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'111","reported_seq":708,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.340338+0000","last_change":"2024-09-12T01:11:26.340338+0000","last_active":"2024-09-12T01:11:26.340338+0000","last_peered":"2024-09-12T01:11:26.340338+0000","last_clean":"2024-09-12T01:11:26.340338+0000","last_became_active":"2024-09-12T00:12:38.040613+0000","last_became_peered":"2024-09-12T00:12:38.040613+0000","last_unstale":"2024-09-12T01:11:26.340338+0000","last_undegraded":"2024-09-12T01:11:26.340338+0000","last_fullsized":"2024-09-12T01:11:26.340338+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:11:26.340235+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:11:26.340235+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.340235+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:35.822474+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":420,"num_write":176,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'377","reported_seq":1123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.287078+0000","last_change":"2024-09-12T01:11:09.287078+0000","last_active":"2024-09-12T01:11:09.287078+0000","last_peered":"2024-09-12T01:11:09.287078+0000","last_clean":"2024-09-12T01:11:09.287078+0000","last_became_active":"2024-09-12T00:12:36.036905+0000","last_became_peered":"2024-09-12T00:12:36.036905+0000","last_unstale":"2024-09-12T01:11:09.287078+0000","last_undegraded":"2024-09-12T01:11:09.287078+0000","last_fullsized":"2024-09-12T01:11:09.287078+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:11:09.286940+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:11:09.286940+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.286940+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:09.368061+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529645,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":592,"num_read_kb":41745,"num_write":1152,"num_write_kb":45582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'78","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.167491+0000","last_change":"2024-09-12T01:11:16.167491+0000","last_active":"2024-09-12T01:11:16.167491+0000","last_peered":"2024-09-12T01:11:16.167491+0000","last_clean":"2024-09-12T01:11:16.167491+0000","last_became_active":"2024-09-12T00:12:38.038478+0000","last_became_peered":"2024-09-12T00:12:38.038478+0000","last_unstale":"2024-09-12T01:11:16.167491+0000","last_undegraded":"2024-09-12T01:11:16.167491+0000","last_fullsized":"2024-09-12T01:11:16.167491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'78","last_scrub_stamp":"2024-09-12T01:11:16.167401+0000","last_deep_scrub":"263'78","last_deep_scrub_stamp":"2024-09-12T01:11:16.167401+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.167401+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:07.760102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":318,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'378","reported_seq":1023,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.165463+0000","last_change":"2024-09-12T01:11:11.165463+0000","last_active":"2024-09-12T01:11:11.165463+0000","last_peered":"2024-09-12T01:11:11.165463+0000","last_clean":"2024-09-12T01:11:11.165463+0000","last_became_active":"2024-09-12T00:12:36.032821+0000","last_became_peered":"2024-09-12T00:12:36.032821+0000","last_unstale":"2024-09-12T01:11:11.165463+0000","last_undegraded":"2024-09-12T01:11:11.165463+0000","last_fullsized":"2024-09-12T01:11:11.165463+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-12T01:11:11.165328+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-12T01:11:11.165328+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.165328+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:11.501731+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3061552,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":42771,"num_write":1040,"num_write_kb":38443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'199","reported_seq":797,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.231959+0000","last_change":"2024-09-12T01:11:15.231959+0000","last_active":"2024-09-12T01:11:15.231959+0000","last_peered":"2024-09-12T01:11:15.231959+0000","last_clean":"2024-09-12T01:11:15.231959+0000","last_became_active":"2024-09-12T00:12:38.044169+0000","last_became_peered":"2024-09-12T00:12:38.044169+0000","last_unstale":"2024-09-12T01:11:15.231959+0000","last_undegraded":"2024-09-12T01:11:15.231959+0000","last_fullsized":"2024-09-12T01:11:15.231959+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'199","last_scrub_stamp":"2024-09-12T01:11:15.231880+0000","last_deep_scrub":"263'199","last_deep_scrub_stamp":"2024-09-12T01:11:15.231880+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.231880+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:00.268928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":679,"num_write":307,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'331","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.123297+0000","last_change":"2024-09-12T01:11:10.123297+0000","last_active":"2024-09-12T01:11:10.123297+0000","last_peered":"2024-09-12T01:11:10.123297+0000","last_clean":"2024-09-12T01:11:10.123297+0000","last_became_active":"2024-09-12T00:12:36.037200+0000","last_became_peered":"2024-09-12T00:12:36.037200+0000","last_unstale":"2024-09-12T01:11:10.123297+0000","last_undegraded":"2024-09-12T01:11:10.123297+0000","last_fullsized":"2024-09-12T01:11:10.123297+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:11:10.123156+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:11:10.123156+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.123156+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:59.788260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524447,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":1481,"num_write":1070,"num_write_kb":18199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'162","reported_seq":766,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.295446+0000","last_change":"2024-09-12T01:11:20.295446+0000","last_active":"2024-09-12T01:11:20.295446+0000","last_peered":"2024-09-12T01:11:20.295446+0000","last_clean":"2024-09-12T01:11:20.295446+0000","last_became_active":"2024-09-12T00:12:38.044089+0000","last_became_peered":"2024-09-12T00:12:38.044089+0000","last_unstale":"2024-09-12T01:11:20.295446+0000","last_undegraded":"2024-09-12T01:11:20.295446+0000","last_fullsized":"2024-09-12T01:11:20.295446+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-12T01:11:20.295361+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-12T01:11:20.295361+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.295361+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:32.689542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":583,"num_write":265,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'360","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.104690+0000","last_change":"2024-09-12T01:11:09.104690+0000","last_active":"2024-09-12T01:11:09.104690+0000","last_peered":"2024-09-12T01:11:09.104690+0000","last_clean":"2024-09-12T01:11:09.104690+0000","last_became_active":"2024-09-12T00:12:36.029286+0000","last_became_peered":"2024-09-12T00:12:36.029286+0000","last_unstale":"2024-09-12T01:11:09.104690+0000","last_undegraded":"2024-09-12T01:11:09.104690+0000","last_fullsized":"2024-09-12T01:11:09.104690+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-12T01:11:09.104526+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-12T01:11:09.104526+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.104526+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:00.468686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661265,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":28445,"num_write":1057,"num_write_kb":34038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'237","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.927199+0000","last_change":"2024-09-12T01:11:25.927199+0000","last_active":"2024-09-12T01:11:25.927199+0000","last_peered":"2024-09-12T01:11:25.927199+0000","last_clean":"2024-09-12T01:11:25.927199+0000","last_became_active":"2024-09-12T00:12:38.042387+0000","last_became_peered":"2024-09-12T00:12:38.042387+0000","last_unstale":"2024-09-12T01:11:25.927199+0000","last_undegraded":"2024-09-12T01:11:25.927199+0000","last_fullsized":"2024-09-12T01:11:25.927199+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'237","last_scrub_stamp":"2024-09-12T01:11:25.927079+0000","last_deep_scrub":"263'237","last_deep_scrub_stamp":"2024-09-12T01:11:25.927079+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.927079+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:09.717365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1130,"num_read_kb":955,"num_write":386,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'350","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.214817+0000","last_change":"2024-09-12T01:11:13.214817+0000","last_active":"2024-09-12T01:11:13.214817+0000","last_peered":"2024-09-12T01:11:13.214817+0000","last_clean":"2024-09-12T01:11:13.214817+0000","last_became_active":"2024-09-12T00:12:36.034811+0000","last_became_peered":"2024-09-12T00:12:36.034811+0000","last_unstale":"2024-09-12T01:11:13.214817+0000","last_undegraded":"2024-09-12T01:11:13.214817+0000","last_fullsized":"2024-09-12T01:11:13.214817+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-12T01:11:13.214663+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-12T01:11:13.214663+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.214663+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:38.760865+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":602,"num_read_kb":22753,"num_write":1118,"num_write_kb":14938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'112","reported_seq":711,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.223372+0000","last_change":"2024-09-12T01:11:16.223372+0000","last_active":"2024-09-12T01:11:16.223372+0000","last_peered":"2024-09-12T01:11:16.223372+0000","last_clean":"2024-09-12T01:11:16.223372+0000","last_became_active":"2024-09-12T00:12:38.035835+0000","last_became_peered":"2024-09-12T00:12:38.035835+0000","last_unstale":"2024-09-12T01:11:16.223372+0000","last_undegraded":"2024-09-12T01:11:16.223372+0000","last_fullsized":"2024-09-12T01:11:16.223372+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'112","last_scrub_stamp":"2024-09-12T01:11:16.223277+0000","last_deep_scrub":"263'112","last_deep_scrub_stamp":"2024-09-12T01:11:16.223277+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.223277+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:36.024600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":399,"num_write":174,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'328","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.247820+0000","last_change":"2024-09-12T01:11:11.247820+0000","last_active":"2024-09-12T01:11:11.247820+0000","last_peered":"2024-09-12T01:11:11.247820+0000","last_clean":"2024-09-12T01:11:11.247820+0000","last_became_active":"2024-09-12T00:12:36.036060+0000","last_became_peered":"2024-09-12T00:12:36.036060+0000","last_unstale":"2024-09-12T01:11:11.247820+0000","last_undegraded":"2024-09-12T01:11:11.247820+0000","last_fullsized":"2024-09-12T01:11:11.247820+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-12T01:11:11.247654+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-12T01:11:11.247654+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.247654+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:35.548784+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568184,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":547,"num_read_kb":15680,"num_write":1014,"num_write_kb":17630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'133","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.232223+0000","last_change":"2024-09-12T01:11:30.232223+0000","last_active":"2024-09-12T01:11:30.232223+0000","last_peered":"2024-09-12T01:11:30.232223+0000","last_clean":"2024-09-12T01:11:30.232223+0000","last_became_active":"2024-09-12T00:12:46.059203+0000","last_became_peered":"2024-09-12T00:12:46.059203+0000","last_unstale":"2024-09-12T01:11:30.232223+0000","last_undegraded":"2024-09-12T01:11:30.232223+0000","last_fullsized":"2024-09-12T01:11:30.232223+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-12T01:11:30.232125+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-12T01:11:30.232125+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.232125+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:57.023912+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":135,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'77","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.238332+0000","last_change":"2024-09-12T01:11:18.238332+0000","last_active":"2024-09-12T01:11:18.238332+0000","last_peered":"2024-09-12T01:11:18.238332+0000","last_clean":"2024-09-12T01:11:18.238332+0000","last_became_active":"2024-09-12T00:12:38.041964+0000","last_became_peered":"2024-09-12T00:12:38.041964+0000","last_unstale":"2024-09-12T01:11:18.238332+0000","last_undegraded":"2024-09-12T01:11:18.238332+0000","last_fullsized":"2024-09-12T01:11:18.238332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'77","last_scrub_stamp":"2024-09-12T01:11:18.238243+0000","last_deep_scrub":"263'77","last_deep_scrub_stamp":"2024-09-12T01:11:18.238243+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.238243+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:12.364311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":305,"num_read_kb":247,"num_write":113,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'357","reported_seq":1213,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.398737+0000","last_change":"2024-09-12T01:11:12.398737+0000","last_active":"2024-09-12T01:11:12.398737+0000","last_peered":"2024-09-12T01:11:12.398737+0000","last_clean":"2024-09-12T01:11:12.398737+0000","last_became_active":"2024-09-12T00:12:36.033666+0000","last_became_peered":"2024-09-12T00:12:36.033666+0000","last_unstale":"2024-09-12T01:11:12.398737+0000","last_undegraded":"2024-09-12T01:11:12.398737+0000","last_fullsized":"2024-09-12T01:11:12.398737+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'357","last_scrub_stamp":"2024-09-12T01:11:12.398592+0000","last_deep_scrub":"263'357","last_deep_scrub_stamp":"2024-09-12T01:11:12.398592+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.398592+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:13.468955+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2017915,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":962,"num_read_kb":16942,"num_write":1189,"num_write_kb":38560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.416465+0000","last_change":"2024-09-12T01:11:33.416465+0000","last_active":"2024-09-12T01:11:33.416465+0000","last_peered":"2024-09-12T01:11:33.416465+0000","last_clean":"2024-09-12T01:11:33.416465+0000","last_became_active":"2024-09-12T00:12:40.042778+0000","last_became_peered":"2024-09-12T00:12:40.042778+0000","last_unstale":"2024-09-12T01:11:33.416465+0000","last_undegraded":"2024-09-12T01:11:33.416465+0000","last_fullsized":"2024-09-12T01:11:33.416465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.416381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.416381+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.416381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:21.057767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'351","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.471401+0000","last_change":"2024-09-12T01:11:35.471401+0000","last_active":"2024-09-12T01:11:35.471401+0000","last_peered":"2024-09-12T01:11:35.471401+0000","last_clean":"2024-09-12T01:11:35.471401+0000","last_became_active":"2024-09-12T00:12:42.040764+0000","last_became_peered":"2024-09-12T00:12:42.040764+0000","last_unstale":"2024-09-12T01:11:35.471401+0000","last_undegraded":"2024-09-12T01:11:35.471401+0000","last_fullsized":"2024-09-12T01:11:35.471401+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-12T01:11:35.471303+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-12T01:11:35.471303+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.471303+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:53.053653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46776,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":561,"num_read_kb":1150,"num_write":442,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.275901+0000","last_change":"2024-09-12T01:11:32.275901+0000","last_active":"2024-09-12T01:11:32.275901+0000","last_peered":"2024-09-12T01:11:32.275901+0000","last_clean":"2024-09-12T01:11:32.275901+0000","last_became_active":"2024-09-12T00:12:44.055504+0000","last_became_peered":"2024-09-12T00:12:44.055504+0000","last_unstale":"2024-09-12T01:11:32.275901+0000","last_undegraded":"2024-09-12T01:11:32.275901+0000","last_fullsized":"2024-09-12T01:11:32.275901+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.275803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.275803+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.275803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:26.825661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'172","reported_seq":725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.322275+0000","last_change":"2024-09-12T01:11:34.322275+0000","last_active":"2024-09-12T01:11:34.322275+0000","last_peered":"2024-09-12T01:11:34.322275+0000","last_clean":"2024-09-12T01:11:34.322275+0000","last_became_active":"2024-09-12T00:12:46.065664+0000","last_became_peered":"2024-09-12T00:12:46.065664+0000","last_unstale":"2024-09-12T01:11:34.322275+0000","last_undegraded":"2024-09-12T01:11:34.322275+0000","last_fullsized":"2024-09-12T01:11:34.322275+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-09-12T01:11:34.322194+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-09-12T01:11:34.322194+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.322194+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:51.871169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":198,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'177","reported_seq":798,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.332934+0000","last_change":"2024-09-12T01:11:23.332934+0000","last_active":"2024-09-12T01:11:23.332934+0000","last_peered":"2024-09-12T01:11:23.332934+0000","last_clean":"2024-09-12T01:11:23.332934+0000","last_became_active":"2024-09-12T00:12:38.041187+0000","last_became_peered":"2024-09-12T00:12:38.041187+0000","last_unstale":"2024-09-12T01:11:23.332934+0000","last_undegraded":"2024-09-12T01:11:23.332934+0000","last_fullsized":"2024-09-12T01:11:23.332934+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-09-12T01:11:23.332840+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-09-12T01:11:23.332840+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.332840+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:43.482751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":787,"num_read_kb":651,"num_write":272,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'370","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.319094+0000","last_change":"2024-09-12T01:11:09.319094+0000","last_active":"2024-09-12T01:11:09.319094+0000","last_peered":"2024-09-12T01:11:09.319094+0000","last_clean":"2024-09-12T01:11:09.319094+0000","last_became_active":"2024-09-12T00:12:36.033751+0000","last_became_peered":"2024-09-12T00:12:36.033751+0000","last_unstale":"2024-09-12T01:11:09.319094+0000","last_undegraded":"2024-09-12T01:11:09.319094+0000","last_fullsized":"2024-09-12T01:11:09.319094+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-12T01:11:09.318981+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-12T01:11:09.318981+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.318981+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:02.689157+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254460,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":6771,"num_write":1059,"num_write_kb":22452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.612290+0000","last_change":"2024-09-12T01:11:27.612290+0000","last_active":"2024-09-12T01:11:27.612290+0000","last_peered":"2024-09-12T01:11:27.612290+0000","last_clean":"2024-09-12T01:11:27.612290+0000","last_became_active":"2024-09-12T00:12:40.032489+0000","last_became_peered":"2024-09-12T00:12:40.032489+0000","last_unstale":"2024-09-12T01:11:27.612290+0000","last_undegraded":"2024-09-12T01:11:27.612290+0000","last_fullsized":"2024-09-12T01:11:27.612290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:27.612192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:27.612192+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.612192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:04.891321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'97","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.322249+0000","last_change":"2024-09-12T01:11:30.322249+0000","last_active":"2024-09-12T01:11:30.322249+0000","last_peered":"2024-09-12T01:11:30.322249+0000","last_clean":"2024-09-12T01:11:30.322249+0000","last_became_active":"2024-09-12T00:12:42.046316+0000","last_became_peered":"2024-09-12T00:12:42.046316+0000","last_unstale":"2024-09-12T01:11:30.322249+0000","last_undegraded":"2024-09-12T01:11:30.322249+0000","last_fullsized":"2024-09-12T01:11:30.322249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'97","last_scrub_stamp":"2024-09-12T01:11:30.322163+0000","last_deep_scrub":"263'97","last_deep_scrub_stamp":"2024-09-12T01:11:30.322163+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.322163+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:43.884994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":105,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.322098+0000","last_change":"2024-09-12T01:11:28.322098+0000","last_active":"2024-09-12T01:11:28.322098+0000","last_peered":"2024-09-12T01:11:28.322098+0000","last_clean":"2024-09-12T01:11:28.322098+0000","last_became_active":"2024-09-12T00:12:44.057398+0000","last_became_peered":"2024-09-12T00:12:44.057398+0000","last_unstale":"2024-09-12T01:11:28.322098+0000","last_undegraded":"2024-09-12T01:11:28.322098+0000","last_fullsized":"2024-09-12T01:11:28.322098+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:28.322005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:28.322005+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.322005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:49.268150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'142","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.415911+0000","last_change":"2024-09-12T01:11:32.415911+0000","last_active":"2024-09-12T01:11:32.415911+0000","last_peered":"2024-09-12T01:11:32.415911+0000","last_clean":"2024-09-12T01:11:32.415911+0000","last_became_active":"2024-09-12T00:12:46.060932+0000","last_became_peered":"2024-09-12T00:12:46.060932+0000","last_unstale":"2024-09-12T01:11:32.415911+0000","last_undegraded":"2024-09-12T01:11:32.415911+0000","last_fullsized":"2024-09-12T01:11:32.415911+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-12T01:11:32.415807+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-12T01:11:32.415807+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.415807+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:41.606537+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'190","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.815777+0000","last_change":"2024-09-12T01:11:22.815777+0000","last_active":"2024-09-12T01:11:22.815777+0000","last_peered":"2024-09-12T01:11:22.815777+0000","last_clean":"2024-09-12T01:11:22.815777+0000","last_became_active":"2024-09-12T00:12:38.038234+0000","last_became_peered":"2024-09-12T00:12:38.038234+0000","last_unstale":"2024-09-12T01:11:22.815777+0000","last_undegraded":"2024-09-12T01:11:22.815777+0000","last_fullsized":"2024-09-12T01:11:22.815777+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-12T01:11:22.815690+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-12T01:11:22.815690+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.815690+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:14.046873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":891,"num_read_kb":755,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'339","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.343925+0000","last_change":"2024-09-12T01:11:08.343865+0000","last_active":"2024-09-12T01:11:08.343925+0000","last_peered":"2024-09-12T01:11:08.343925+0000","last_clean":"2024-09-12T01:11:08.343925+0000","last_became_active":"2024-09-12T00:13:07.149671+0000","last_became_peered":"2024-09-12T00:13:07.149671+0000","last_unstale":"2024-09-12T01:11:08.343925+0000","last_undegraded":"2024-09-12T01:11:08.343925+0000","last_fullsized":"2024-09-12T01:11:08.343925+0000","mapping_epoch":40,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-12T01:11:08.343734+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-12T01:11:08.343734+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.343734+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:10.179873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":33322,"num_write":992,"num_write_kb":23312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.511949+0000","last_change":"2024-09-12T01:11:24.511949+0000","last_active":"2024-09-12T01:11:24.511949+0000","last_peered":"2024-09-12T01:11:24.511949+0000","last_clean":"2024-09-12T01:11:24.511949+0000","last_became_active":"2024-09-12T00:12:40.036714+0000","last_became_peered":"2024-09-12T00:12:40.036714+0000","last_unstale":"2024-09-12T01:11:24.511949+0000","last_undegraded":"2024-09-12T01:11:24.511949+0000","last_fullsized":"2024-09-12T01:11:24.511949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.511863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.511863+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.511863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:42.540269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'135","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.451307+0000","last_change":"2024-09-12T01:11:39.451307+0000","last_active":"2024-09-12T01:11:39.451307+0000","last_peered":"2024-09-12T01:11:39.451307+0000","last_clean":"2024-09-12T01:11:39.451307+0000","last_became_active":"2024-09-12T00:12:42.037971+0000","last_became_peered":"2024-09-12T00:12:42.037971+0000","last_unstale":"2024-09-12T01:11:39.451307+0000","last_undegraded":"2024-09-12T01:11:39.451307+0000","last_fullsized":"2024-09-12T01:11:39.451307+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T01:11:39.451216+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T01:11:39.451216+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.451216+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:50.819654+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":156,"num_read_kb":149,"num_write":106,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'779","reported_seq":2794,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.503006+0000","last_change":"2024-09-12T01:11:43.503006+0000","last_active":"2024-09-12T01:11:43.503006+0000","last_peered":"2024-09-12T01:11:43.503006+0000","last_clean":"2024-09-12T01:11:43.503006+0000","last_became_active":"2024-09-12T00:12:44.059258+0000","last_became_peered":"2024-09-12T00:12:44.059258+0000","last_unstale":"2024-09-12T01:11:43.503006+0000","last_undegraded":"2024-09-12T01:11:43.503006+0000","last_fullsized":"2024-09-12T01:11:43.503006+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'779","last_scrub_stamp":"2024-09-12T01:11:43.502879+0000","last_deep_scrub":"263'779","last_deep_scrub_stamp":"2024-09-12T01:11:43.502879+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.502879+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:03.550822+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'198","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.322051+0000","last_change":"2024-09-12T01:11:32.322051+0000","last_active":"2024-09-12T01:11:32.322051+0000","last_peered":"2024-09-12T01:11:32.322051+0000","last_clean":"2024-09-12T01:11:32.322051+0000","last_became_active":"2024-09-12T00:12:46.059591+0000","last_became_peered":"2024-09-12T00:12:46.059591+0000","last_unstale":"2024-09-12T01:11:32.322051+0000","last_undegraded":"2024-09-12T01:11:32.322051+0000","last_fullsized":"2024-09-12T01:11:32.322051+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-12T01:11:32.321961+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-12T01:11:32.321961+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.321961+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:11.086077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":585,"num_read_kb":583,"num_write":433,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'4340","reported_seq":5011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.905715+0000","last_change":"2024-09-12T01:11:24.905715+0000","last_active":"2024-09-12T01:11:24.905715+0000","last_peered":"2024-09-12T01:11:24.905715+0000","last_clean":"2024-09-12T01:11:24.905715+0000","last_became_active":"2024-09-12T00:12:38.035743+0000","last_became_peered":"2024-09-12T00:12:38.035743+0000","last_unstale":"2024-09-12T01:11:24.905715+0000","last_undegraded":"2024-09-12T01:11:24.905715+0000","last_fullsized":"2024-09-12T01:11:24.905715+0000","mapping_epoch":29,"log_start":"263'4300","ondisk_log_start":"263'4300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4340","last_scrub_stamp":"2024-09-12T01:11:24.905599+0000","last_deep_scrub":"263'4340","last_deep_scrub_stamp":"2024-09-12T01:11:24.905599+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.905599+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:01.008082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17417,"num_read_kb":14583,"num_write":6500,"num_write_kb":3272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'359","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.279315+0000","last_change":"2024-09-12T01:11:05.279315+0000","last_active":"2024-09-12T01:11:05.279315+0000","last_peered":"2024-09-12T01:11:05.279315+0000","last_clean":"2024-09-12T01:11:05.279315+0000","last_became_active":"2024-09-12T00:12:36.038014+0000","last_became_peered":"2024-09-12T00:12:36.038014+0000","last_unstale":"2024-09-12T01:11:05.279315+0000","last_undegraded":"2024-09-12T01:11:05.279315+0000","last_fullsized":"2024-09-12T01:11:05.279315+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T01:11:05.279083+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T01:11:05.279083+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.279083+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:09.655209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924421,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":557,"num_read_kb":22312,"num_write":1056,"num_write_kb":43311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.418890+0000","last_change":"2024-09-12T01:11:34.418890+0000","last_active":"2024-09-12T01:11:34.418890+0000","last_peered":"2024-09-12T01:11:34.418890+0000","last_clean":"2024-09-12T01:11:34.418890+0000","last_became_active":"2024-09-12T00:12:40.040992+0000","last_became_peered":"2024-09-12T00:12:40.040992+0000","last_unstale":"2024-09-12T01:11:34.418890+0000","last_undegraded":"2024-09-12T01:11:34.418890+0000","last_fullsized":"2024-09-12T01:11:34.418890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:34.418792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:34.418792+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.418792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:27.413102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'288","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.252040+0000","last_change":"2024-09-12T01:11:21.252040+0000","last_active":"2024-09-12T01:11:21.252040+0000","last_peered":"2024-09-12T01:11:21.252040+0000","last_clean":"2024-09-12T01:11:21.252040+0000","last_became_active":"2024-09-12T00:12:42.041042+0000","last_became_peered":"2024-09-12T00:12:42.041042+0000","last_unstale":"2024-09-12T01:11:21.252040+0000","last_undegraded":"2024-09-12T01:11:21.252040+0000","last_fullsized":"2024-09-12T01:11:21.252040+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'288","last_scrub_stamp":"2024-09-12T01:11:21.251938+0000","last_deep_scrub":"263'288","last_deep_scrub_stamp":"2024-09-12T01:11:21.251938+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.251938+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:59.500381+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63399,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":1076,"num_write":376,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'807","reported_seq":2526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.840199+0000","last_change":"2024-09-12T01:11:35.840199+0000","last_active":"2024-09-12T01:11:35.840199+0000","last_peered":"2024-09-12T01:11:35.840199+0000","last_clean":"2024-09-12T01:11:35.840199+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:11:35.840199+0000","last_undegraded":"2024-09-12T01:11:35.840199+0000","last_fullsized":"2024-09-12T01:11:35.840199+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'807","last_scrub_stamp":"2024-09-12T01:11:35.840113+0000","last_deep_scrub":"263'807","last_deep_scrub_stamp":"2024-09-12T01:11:35.840113+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.840113+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:49.915223+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'191","reported_seq":829,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.356461+0000","last_change":"2024-09-12T01:11:21.356461+0000","last_active":"2024-09-12T01:11:21.356461+0000","last_peered":"2024-09-12T01:11:21.356461+0000","last_clean":"2024-09-12T01:11:21.356461+0000","last_became_active":"2024-09-12T00:12:38.040030+0000","last_became_peered":"2024-09-12T00:12:38.040030+0000","last_unstale":"2024-09-12T01:11:21.356461+0000","last_undegraded":"2024-09-12T01:11:21.356461+0000","last_fullsized":"2024-09-12T01:11:21.356461+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'191","last_scrub_stamp":"2024-09-12T01:11:21.356376+0000","last_deep_scrub":"263'191","last_deep_scrub_stamp":"2024-09-12T01:11:21.356376+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.356376+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:38.207590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":682,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'345","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.091085+0000","last_change":"2024-09-12T01:11:06.091029+0000","last_active":"2024-09-12T01:11:06.091085+0000","last_peered":"2024-09-12T01:11:06.091085+0000","last_clean":"2024-09-12T01:11:06.091085+0000","last_became_active":"2024-09-12T00:12:36.040657+0000","last_became_peered":"2024-09-12T00:12:36.040657+0000","last_unstale":"2024-09-12T01:11:06.091085+0000","last_undegraded":"2024-09-12T01:11:06.091085+0000","last_fullsized":"2024-09-12T01:11:06.091085+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-12T01:11:06.090928+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-12T01:11:06.090928+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.090928+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:36.844314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":455,"num_read_kb":5571,"num_write":1118,"num_write_kb":16904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.283806+0000","last_change":"2024-09-12T01:11:19.283806+0000","last_active":"2024-09-12T01:11:19.283806+0000","last_peered":"2024-09-12T01:11:19.283806+0000","last_clean":"2024-09-12T01:11:19.283806+0000","last_became_active":"2024-09-12T00:12:40.036362+0000","last_became_peered":"2024-09-12T00:12:40.036362+0000","last_unstale":"2024-09-12T01:11:19.283806+0000","last_undegraded":"2024-09-12T01:11:19.283806+0000","last_fullsized":"2024-09-12T01:11:19.283806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.283725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.283725+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.283725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:49.376690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'356","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.195921+0000","last_change":"2024-09-12T01:11:23.195848+0000","last_active":"2024-09-12T01:11:23.195921+0000","last_peered":"2024-09-12T01:11:23.195921+0000","last_clean":"2024-09-12T01:11:23.195921+0000","last_became_active":"2024-09-12T00:12:42.044418+0000","last_became_peered":"2024-09-12T00:12:42.044418+0000","last_unstale":"2024-09-12T01:11:23.195921+0000","last_undegraded":"2024-09-12T01:11:23.195921+0000","last_fullsized":"2024-09-12T01:11:23.195921+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-12T01:11:23.195680+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-12T01:11:23.195680+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.195680+0000","objects_scrubbed":10,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:40.037982+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51451,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":1107,"num_write":436,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.412651+0000","last_change":"2024-09-12T01:11:33.412651+0000","last_active":"2024-09-12T01:11:33.412651+0000","last_peered":"2024-09-12T01:11:33.412651+0000","last_clean":"2024-09-12T01:11:33.412651+0000","last_became_active":"2024-09-12T00:12:44.057438+0000","last_became_peered":"2024-09-12T00:12:44.057438+0000","last_unstale":"2024-09-12T01:11:33.412651+0000","last_undegraded":"2024-09-12T01:11:33.412651+0000","last_fullsized":"2024-09-12T01:11:33.412651+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.412544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.412544+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.412544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:38.474219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'560","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.343742+0000","last_change":"2024-09-12T01:11:29.343742+0000","last_active":"2024-09-12T01:11:29.343742+0000","last_peered":"2024-09-12T01:11:29.343742+0000","last_clean":"2024-09-12T01:11:29.343742+0000","last_became_active":"2024-09-12T00:12:46.060552+0000","last_became_peered":"2024-09-12T00:12:46.060552+0000","last_unstale":"2024-09-12T01:11:29.343742+0000","last_undegraded":"2024-09-12T01:11:29.343742+0000","last_fullsized":"2024-09-12T01:11:29.343742+0000","mapping_epoch":37,"log_start":"263'500","ondisk_log_start":"263'500","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'560","last_scrub_stamp":"2024-09-12T01:11:29.343647+0000","last_deep_scrub":"263'560","last_deep_scrub_stamp":"2024-09-12T01:11:29.343647+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.343647+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:44.779263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1290,"num_read_kb":1284,"num_write":1146,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'240","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.279256+0000","last_change":"2024-09-12T01:11:11.279256+0000","last_active":"2024-09-12T01:11:11.279256+0000","last_peered":"2024-09-12T01:11:11.279256+0000","last_clean":"2024-09-12T01:11:11.279256+0000","last_became_active":"2024-09-12T00:12:38.041916+0000","last_became_peered":"2024-09-12T00:12:38.041916+0000","last_unstale":"2024-09-12T01:11:11.279256+0000","last_undegraded":"2024-09-12T01:11:11.279256+0000","last_fullsized":"2024-09-12T01:11:11.279256+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'240","last_scrub_stamp":"2024-09-12T01:11:11.279182+0000","last_deep_scrub":"263'240","last_deep_scrub_stamp":"2024-09-12T01:11:11.279182+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.279182+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:57.424825+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1071,"num_read_kb":865,"num_write":389,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'325","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.153251+0000","last_change":"2024-09-12T01:11:09.153171+0000","last_active":"2024-09-12T01:11:09.153251+0000","last_peered":"2024-09-12T01:11:09.153251+0000","last_clean":"2024-09-12T01:11:09.153251+0000","last_became_active":"2024-09-12T00:12:36.042838+0000","last_became_peered":"2024-09-12T00:12:36.042838+0000","last_unstale":"2024-09-12T01:11:09.153251+0000","last_undegraded":"2024-09-12T01:11:09.153251+0000","last_fullsized":"2024-09-12T01:11:09.153251+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-09-12T01:11:09.153023+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-09-12T01:11:09.153023+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.153023+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:42.019020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":480,"num_read_kb":7238,"num_write":1062,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.336520+0000","last_change":"2024-09-12T01:11:22.336520+0000","last_active":"2024-09-12T01:11:22.336520+0000","last_peered":"2024-09-12T01:11:22.336520+0000","last_clean":"2024-09-12T01:11:22.336520+0000","last_became_active":"2024-09-12T00:12:40.042625+0000","last_became_peered":"2024-09-12T00:12:40.042625+0000","last_unstale":"2024-09-12T01:11:22.336520+0000","last_undegraded":"2024-09-12T01:11:22.336520+0000","last_fullsized":"2024-09-12T01:11:22.336520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:22.336417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:22.336417+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.336417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:38.356823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'260","reported_seq":845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.599229+0000","last_change":"2024-09-12T01:11:32.599229+0000","last_active":"2024-09-12T01:11:32.599229+0000","last_peered":"2024-09-12T01:11:32.599229+0000","last_clean":"2024-09-12T01:11:32.599229+0000","last_became_active":"2024-09-12T00:12:42.040266+0000","last_became_peered":"2024-09-12T00:12:42.040266+0000","last_unstale":"2024-09-12T01:11:32.599229+0000","last_undegraded":"2024-09-12T01:11:32.599229+0000","last_fullsized":"2024-09-12T01:11:32.599229+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-12T01:11:32.599143+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-12T01:11:32.599143+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.599143+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:32.133004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":965,"num_write":348,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.497801+0000","last_change":"2024-09-12T01:11:36.497801+0000","last_active":"2024-09-12T01:11:36.497801+0000","last_peered":"2024-09-12T01:11:36.497801+0000","last_clean":"2024-09-12T01:11:36.497801+0000","last_became_active":"2024-09-12T00:12:44.062608+0000","last_became_peered":"2024-09-12T00:12:44.062608+0000","last_unstale":"2024-09-12T01:11:36.497801+0000","last_undegraded":"2024-09-12T01:11:36.497801+0000","last_fullsized":"2024-09-12T01:11:36.497801+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:36.497719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:36.497719+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.497719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:59.343902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2414","reported_seq":4261,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.296528+0000","last_change":"2024-09-12T01:11:31.296528+0000","last_active":"2024-09-12T01:11:31.296528+0000","last_peered":"2024-09-12T01:11:31.296528+0000","last_clean":"2024-09-12T01:11:31.296528+0000","last_became_active":"2024-09-12T00:12:46.062624+0000","last_became_peered":"2024-09-12T00:12:46.062624+0000","last_unstale":"2024-09-12T01:11:31.296528+0000","last_undegraded":"2024-09-12T01:11:31.296528+0000","last_fullsized":"2024-09-12T01:11:31.296528+0000","mapping_epoch":37,"log_start":"263'2400","ondisk_log_start":"263'2400","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2414","last_scrub_stamp":"2024-09-12T01:11:31.296426+0000","last_deep_scrub":"263'2414","last_deep_scrub_stamp":"2024-09-12T01:11:31.296426+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.296426+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":2400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:10.080210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":6065,"num_write":4891,"num_write_kb":1799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'224","reported_seq":843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.214170+0000","last_change":"2024-09-12T01:11:17.214117+0000","last_active":"2024-09-12T01:11:17.214170+0000","last_peered":"2024-09-12T01:11:17.214170+0000","last_clean":"2024-09-12T01:11:17.214170+0000","last_became_active":"2024-09-12T00:12:38.042657+0000","last_became_peered":"2024-09-12T00:12:38.042657+0000","last_unstale":"2024-09-12T01:11:17.214170+0000","last_undegraded":"2024-09-12T01:11:17.214170+0000","last_fullsized":"2024-09-12T01:11:17.214170+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-12T01:11:17.214034+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-12T01:11:17.214034+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.214034+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:55.432133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":947,"num_read_kb":771,"num_write":346,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'377","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.357263+0000","last_change":"2024-09-12T01:11:13.357263+0000","last_active":"2024-09-12T01:11:13.357263+0000","last_peered":"2024-09-12T01:11:13.357263+0000","last_clean":"2024-09-12T01:11:13.357263+0000","last_became_active":"2024-09-12T00:12:36.046196+0000","last_became_peered":"2024-09-12T00:12:36.046196+0000","last_unstale":"2024-09-12T01:11:13.357263+0000","last_undegraded":"2024-09-12T01:11:13.357263+0000","last_fullsized":"2024-09-12T01:11:13.357263+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:11:13.357097+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:11:13.357097+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.357097+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:24.455244+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9646835,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":545,"num_read_kb":69753,"num_write":1204,"num_write_kb":51465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.925882+0000","last_change":"2024-09-12T01:11:27.925882+0000","last_active":"2024-09-12T01:11:27.925882+0000","last_peered":"2024-09-12T01:11:27.925882+0000","last_clean":"2024-09-12T01:11:27.925882+0000","last_became_active":"2024-09-12T00:12:40.039887+0000","last_became_peered":"2024-09-12T00:12:40.039887+0000","last_unstale":"2024-09-12T01:11:27.925882+0000","last_undegraded":"2024-09-12T01:11:27.925882+0000","last_fullsized":"2024-09-12T01:11:27.925882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:27.925797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:27.925797+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.925797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:53.232547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'339","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.420396+0000","last_change":"2024-09-12T01:11:37.420396+0000","last_active":"2024-09-12T01:11:37.420396+0000","last_peered":"2024-09-12T01:11:37.420396+0000","last_clean":"2024-09-12T01:11:37.420396+0000","last_became_active":"2024-09-12T00:12:42.051042+0000","last_became_peered":"2024-09-12T00:12:42.051042+0000","last_unstale":"2024-09-12T01:11:37.420396+0000","last_undegraded":"2024-09-12T01:11:37.420396+0000","last_fullsized":"2024-09-12T01:11:37.420396+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-12T01:11:37.420309+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-12T01:11:37.420309+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.420309+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:29.707362+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50358,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":532,"num_read_kb":1132,"num_write":424,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'807","reported_seq":2522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.886201+0000","last_change":"2024-09-12T01:11:34.886201+0000","last_active":"2024-09-12T01:11:34.886201+0000","last_peered":"2024-09-12T01:11:34.886201+0000","last_clean":"2024-09-12T01:11:34.886201+0000","last_became_active":"2024-09-12T00:12:44.057064+0000","last_became_peered":"2024-09-12T00:12:44.057064+0000","last_unstale":"2024-09-12T01:11:34.886201+0000","last_undegraded":"2024-09-12T01:11:34.886201+0000","last_fullsized":"2024-09-12T01:11:34.886201+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'807","last_scrub_stamp":"2024-09-12T01:11:34.886101+0000","last_deep_scrub":"263'807","last_deep_scrub_stamp":"2024-09-12T01:11:34.886101+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.886101+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:20.868443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'102","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.394425+0000","last_change":"2024-09-12T01:11:31.394425+0000","last_active":"2024-09-12T01:11:31.394425+0000","last_peered":"2024-09-12T01:11:31.394425+0000","last_clean":"2024-09-12T01:11:31.394425+0000","last_became_active":"2024-09-12T00:12:46.059567+0000","last_became_peered":"2024-09-12T00:12:46.059567+0000","last_unstale":"2024-09-12T01:11:31.394425+0000","last_undegraded":"2024-09-12T01:11:31.394425+0000","last_fullsized":"2024-09-12T01:11:31.394425+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'102","last_scrub_stamp":"2024-09-12T01:11:31.394337+0000","last_deep_scrub":"263'102","last_deep_scrub_stamp":"2024-09-12T01:11:31.394337+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.394337+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:06.953338+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":78,"num_write":230,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'198","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.877598+0000","last_change":"2024-09-12T01:11:19.877598+0000","last_active":"2024-09-12T01:11:19.877598+0000","last_peered":"2024-09-12T01:11:19.877598+0000","last_clean":"2024-09-12T01:11:19.877598+0000","last_became_active":"2024-09-12T00:12:38.039788+0000","last_became_peered":"2024-09-12T00:12:38.039788+0000","last_unstale":"2024-09-12T01:11:19.877598+0000","last_undegraded":"2024-09-12T01:11:19.877598+0000","last_fullsized":"2024-09-12T01:11:19.877598+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-12T01:11:19.877483+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-12T01:11:19.877483+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.877483+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:31.219578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":765,"num_write":285,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'369","reported_seq":1031,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:04.101519+0000","last_change":"2024-09-12T01:11:04.101465+0000","last_active":"2024-09-12T01:11:04.101519+0000","last_peered":"2024-09-12T01:11:04.101519+0000","last_clean":"2024-09-12T01:11:04.101519+0000","last_became_active":"2024-09-12T00:12:36.034290+0000","last_became_peered":"2024-09-12T00:12:36.034290+0000","last_unstale":"2024-09-12T01:11:04.101519+0000","last_undegraded":"2024-09-12T01:11:04.101519+0000","last_fullsized":"2024-09-12T01:11:04.101519+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-12T01:11:04.101384+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-12T01:11:04.101384+0000","last_clean_scrub_stamp":"2024-09-12T01:11:04.101384+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:59.360381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":18536,"num_write":1160,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.341959+0000","last_change":"2024-09-12T01:11:21.341959+0000","last_active":"2024-09-12T01:11:21.341959+0000","last_peered":"2024-09-12T01:11:21.341959+0000","last_clean":"2024-09-12T01:11:21.341959+0000","last_became_active":"2024-09-12T00:12:40.036551+0000","last_became_peered":"2024-09-12T00:12:40.036551+0000","last_unstale":"2024-09-12T01:11:21.341959+0000","last_undegraded":"2024-09-12T01:11:21.341959+0000","last_fullsized":"2024-09-12T01:11:21.341959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:21.341862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:21.341862+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.341862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:32.869688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'520","reported_seq":1173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.575706+0000","last_change":"2024-09-12T01:11:26.575706+0000","last_active":"2024-09-12T01:11:26.575706+0000","last_peered":"2024-09-12T01:11:26.575706+0000","last_clean":"2024-09-12T01:11:26.575706+0000","last_became_active":"2024-09-12T00:12:42.041307+0000","last_became_peered":"2024-09-12T00:12:42.041307+0000","last_unstale":"2024-09-12T01:11:26.575706+0000","last_undegraded":"2024-09-12T01:11:26.575706+0000","last_fullsized":"2024-09-12T01:11:26.575706+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'520","last_scrub_stamp":"2024-09-12T01:11:26.575606+0000","last_deep_scrub":"263'520","last_deep_scrub_stamp":"2024-09-12T01:11:26.575606+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.575606+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:07.881789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96065,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":906,"num_read_kb":2178,"num_write":748,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.959547+0000","last_change":"2024-09-12T01:11:32.959547+0000","last_active":"2024-09-12T01:11:32.959547+0000","last_peered":"2024-09-12T01:11:32.959547+0000","last_clean":"2024-09-12T01:11:32.959547+0000","last_became_active":"2024-09-12T00:12:44.049211+0000","last_became_peered":"2024-09-12T00:12:44.049211+0000","last_unstale":"2024-09-12T01:11:32.959547+0000","last_undegraded":"2024-09-12T01:11:32.959547+0000","last_fullsized":"2024-09-12T01:11:32.959547+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.959463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.959463+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.959463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:36.812726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'147","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.778629+0000","last_change":"2024-09-12T01:11:28.778629+0000","last_active":"2024-09-12T01:11:28.778629+0000","last_peered":"2024-09-12T01:11:28.778629+0000","last_clean":"2024-09-12T01:11:28.778629+0000","last_became_active":"2024-09-12T00:12:46.066431+0000","last_became_peered":"2024-09-12T00:12:46.066431+0000","last_unstale":"2024-09-12T01:11:28.778629+0000","last_undegraded":"2024-09-12T01:11:28.778629+0000","last_fullsized":"2024-09-12T01:11:28.778629+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'147","last_scrub_stamp":"2024-09-12T01:11:28.778518+0000","last_deep_scrub":"263'147","last_deep_scrub_stamp":"2024-09-12T01:11:28.778518+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.778518+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:27.549650+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":339,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'119","reported_seq":723,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.167274+0000","last_change":"2024-09-12T01:11:18.167274+0000","last_active":"2024-09-12T01:11:18.167274+0000","last_peered":"2024-09-12T01:11:18.167274+0000","last_clean":"2024-09-12T01:11:18.167274+0000","last_became_active":"2024-09-12T00:12:38.037464+0000","last_became_peered":"2024-09-12T00:12:38.037464+0000","last_unstale":"2024-09-12T01:11:18.167274+0000","last_undegraded":"2024-09-12T01:11:18.167274+0000","last_fullsized":"2024-09-12T01:11:18.167274+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T01:11:18.167145+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T01:11:18.167145+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.167145+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:04.870748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'335","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.761453+0000","last_change":"2024-09-12T01:11:06.761365+0000","last_active":"2024-09-12T01:11:06.761453+0000","last_peered":"2024-09-12T01:11:06.761453+0000","last_clean":"2024-09-12T01:11:06.761453+0000","last_became_active":"2024-09-12T00:12:36.045050+0000","last_became_peered":"2024-09-12T00:12:36.045050+0000","last_unstale":"2024-09-12T01:11:06.761453+0000","last_undegraded":"2024-09-12T01:11:06.761453+0000","last_fullsized":"2024-09-12T01:11:06.761453+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:11:06.761211+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:11:06.761211+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.761211+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:53.881887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":13364,"num_write":1093,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.698894+0000","last_change":"2024-09-12T01:11:19.698894+0000","last_active":"2024-09-12T01:11:19.698894+0000","last_peered":"2024-09-12T01:11:19.698894+0000","last_clean":"2024-09-12T01:11:19.698894+0000","last_became_active":"2024-09-12T00:12:40.038036+0000","last_became_peered":"2024-09-12T00:12:40.038036+0000","last_unstale":"2024-09-12T01:11:19.698894+0000","last_undegraded":"2024-09-12T01:11:19.698894+0000","last_fullsized":"2024-09-12T01:11:19.698894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.698778+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:02.239036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'303","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.312972+0000","last_change":"2024-09-12T01:11:27.312972+0000","last_active":"2024-09-12T01:11:27.312972+0000","last_peered":"2024-09-12T01:11:27.312972+0000","last_clean":"2024-09-12T01:11:27.312972+0000","last_became_active":"2024-09-12T00:12:42.051668+0000","last_became_peered":"2024-09-12T00:12:42.051668+0000","last_unstale":"2024-09-12T01:11:27.312972+0000","last_undegraded":"2024-09-12T01:11:27.312972+0000","last_fullsized":"2024-09-12T01:11:27.312972+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'303","last_scrub_stamp":"2024-09-12T01:11:27.312879+0000","last_deep_scrub":"263'303","last_deep_scrub_stamp":"2024-09-12T01:11:27.312879+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.312879+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:39.832181+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":1104,"num_write":460,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.743268+0000","last_change":"2024-09-12T01:11:23.743222+0000","last_active":"2024-09-12T01:11:23.743268+0000","last_peered":"2024-09-12T01:11:23.743268+0000","last_clean":"2024-09-12T01:11:23.743268+0000","last_became_active":"2024-09-12T00:12:44.061848+0000","last_became_peered":"2024-09-12T00:12:44.061848+0000","last_unstale":"2024-09-12T01:11:23.743268+0000","last_undegraded":"2024-09-12T01:11:23.743268+0000","last_fullsized":"2024-09-12T01:11:23.743268+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.743143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.743143+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.743143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:52.926960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'93","reported_seq":581,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.891502+0000","last_change":"2024-09-12T01:11:37.891502+0000","last_active":"2024-09-12T01:11:37.891502+0000","last_peered":"2024-09-12T01:11:37.891502+0000","last_clean":"2024-09-12T01:11:37.891502+0000","last_became_active":"2024-09-12T00:12:46.066121+0000","last_became_peered":"2024-09-12T00:12:46.066121+0000","last_unstale":"2024-09-12T01:11:37.891502+0000","last_undegraded":"2024-09-12T01:11:37.891502+0000","last_fullsized":"2024-09-12T01:11:37.891502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'93","last_scrub_stamp":"2024-09-12T01:11:37.891408+0000","last_deep_scrub":"263'93","last_deep_scrub_stamp":"2024-09-12T01:11:37.891408+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.891408+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:52.951291+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":71,"num_write":206,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'180","reported_seq":770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.318206+0000","last_change":"2024-09-12T01:11:22.318206+0000","last_active":"2024-09-12T01:11:22.318206+0000","last_peered":"2024-09-12T01:11:22.318206+0000","last_clean":"2024-09-12T01:11:22.318206+0000","last_became_active":"2024-09-12T00:12:38.046276+0000","last_became_peered":"2024-09-12T00:12:38.046276+0000","last_unstale":"2024-09-12T01:11:22.318206+0000","last_undegraded":"2024-09-12T01:11:22.318206+0000","last_fullsized":"2024-09-12T01:11:22.318206+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-12T01:11:22.318112+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-12T01:11:22.318112+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.318112+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:29.522845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":618,"num_write":256,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'495","reported_seq":1207,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.359640+0000","last_change":"2024-09-12T01:11:10.359579+0000","last_active":"2024-09-12T01:11:10.359640+0000","last_peered":"2024-09-12T01:11:10.359640+0000","last_clean":"2024-09-12T01:11:10.359640+0000","last_became_active":"2024-09-12T00:12:36.035311+0000","last_became_peered":"2024-09-12T00:12:36.035311+0000","last_unstale":"2024-09-12T01:11:10.359640+0000","last_undegraded":"2024-09-12T01:11:10.359640+0000","last_fullsized":"2024-09-12T01:11:10.359640+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'495","last_scrub_stamp":"2024-09-12T01:11:10.359440+0000","last_deep_scrub":"263'495","last_deep_scrub_stamp":"2024-09-12T01:11:10.359440+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.359440+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:44.647976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":942,"num_read_kb":11265,"num_write":1473,"num_write_kb":28283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.961075+0000","last_change":"2024-09-12T01:11:28.961075+0000","last_active":"2024-09-12T01:11:28.961075+0000","last_peered":"2024-09-12T01:11:28.961075+0000","last_clean":"2024-09-12T01:11:28.961075+0000","last_became_active":"2024-09-12T00:12:40.035585+0000","last_became_peered":"2024-09-12T00:12:40.035585+0000","last_unstale":"2024-09-12T01:11:28.961075+0000","last_undegraded":"2024-09-12T01:11:28.961075+0000","last_fullsized":"2024-09-12T01:11:28.961075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:28.960959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:28.960959+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.960959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:55.520073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'317","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.959538+0000","last_change":"2024-09-12T01:11:30.959538+0000","last_active":"2024-09-12T01:11:30.959538+0000","last_peered":"2024-09-12T01:11:30.959538+0000","last_clean":"2024-09-12T01:11:30.959538+0000","last_became_active":"2024-09-12T00:12:42.052279+0000","last_became_peered":"2024-09-12T00:12:42.052279+0000","last_unstale":"2024-09-12T01:11:30.959538+0000","last_undegraded":"2024-09-12T01:11:30.959538+0000","last_fullsized":"2024-09-12T01:11:30.959538+0000","mapping_epoch":33,"log_start":"263'301","ondisk_log_start":"263'301","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:11:30.959434+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:11:30.959434+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.959434+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:18.728004+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":1142,"num_write":410,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'773","reported_seq":4983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.728661+0000","last_change":"2024-09-12T01:11:22.728661+0000","last_active":"2024-09-12T01:11:22.728661+0000","last_peered":"2024-09-12T01:11:22.728661+0000","last_clean":"2024-09-12T01:11:22.728661+0000","last_became_active":"2024-09-12T00:12:44.060494+0000","last_became_peered":"2024-09-12T00:12:44.060494+0000","last_unstale":"2024-09-12T01:11:22.728661+0000","last_undegraded":"2024-09-12T01:11:22.728661+0000","last_fullsized":"2024-09-12T01:11:22.728661+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'773","last_scrub_stamp":"2024-09-12T01:11:22.728562+0000","last_deep_scrub":"263'773","last_deep_scrub_stamp":"2024-09-12T01:11:22.728562+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.728562+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:32.761136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'136","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.434756+0000","last_change":"2024-09-12T01:11:34.434756+0000","last_active":"2024-09-12T01:11:34.434756+0000","last_peered":"2024-09-12T01:11:34.434756+0000","last_clean":"2024-09-12T01:11:34.434756+0000","last_became_active":"2024-09-12T00:12:46.060211+0000","last_became_peered":"2024-09-12T00:12:46.060211+0000","last_unstale":"2024-09-12T01:11:34.434756+0000","last_undegraded":"2024-09-12T01:11:34.434756+0000","last_fullsized":"2024-09-12T01:11:34.434756+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-12T01:11:34.434647+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-12T01:11:34.434647+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.434647+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:21.846031+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":113,"num_write":319,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'256","reported_seq":896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.174716+0000","last_change":"2024-09-12T01:11:18.174716+0000","last_active":"2024-09-12T01:11:18.174716+0000","last_peered":"2024-09-12T01:11:18.174716+0000","last_clean":"2024-09-12T01:11:18.174716+0000","last_became_active":"2024-09-12T00:12:38.042601+0000","last_became_peered":"2024-09-12T00:12:38.042601+0000","last_unstale":"2024-09-12T01:11:18.174716+0000","last_undegraded":"2024-09-12T01:11:18.174716+0000","last_fullsized":"2024-09-12T01:11:18.174716+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'256","last_scrub_stamp":"2024-09-12T01:11:18.174616+0000","last_deep_scrub":"263'256","last_deep_scrub_stamp":"2024-09-12T01:11:18.174616+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.174616+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:34.619000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1116,"num_read_kb":905,"num_write":388,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'367","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.370115+0000","last_change":"2024-09-12T01:11:11.370115+0000","last_active":"2024-09-12T01:11:11.370115+0000","last_peered":"2024-09-12T01:11:11.370115+0000","last_clean":"2024-09-12T01:11:11.370115+0000","last_became_active":"2024-09-12T00:12:36.043404+0000","last_became_peered":"2024-09-12T00:12:36.043404+0000","last_unstale":"2024-09-12T01:11:11.370115+0000","last_undegraded":"2024-09-12T01:11:11.370115+0000","last_fullsized":"2024-09-12T01:11:11.370115+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-12T01:11:11.370017+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-12T01:11:11.370017+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.370017+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:25.657597+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432371,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":514,"num_read_kb":34059,"num_write":1157,"num_write_kb":45928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1469,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.344139+0000","last_change":"2024-09-12T01:11:23.344139+0000","last_active":"2024-09-12T01:11:23.344139+0000","last_peered":"2024-09-12T01:11:23.344139+0000","last_clean":"2024-09-12T01:11:23.344139+0000","last_became_active":"2024-09-12T00:12:40.035633+0000","last_became_peered":"2024-09-12T00:12:40.035633+0000","last_unstale":"2024-09-12T01:11:23.344139+0000","last_undegraded":"2024-09-12T01:11:23.344139+0000","last_fullsized":"2024-09-12T01:11:23.344139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:11:23.344051+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:11:23.344051+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.344051+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:47.428428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'87","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.424411+0000","last_change":"2024-09-12T01:11:26.424411+0000","last_active":"2024-09-12T01:11:26.424411+0000","last_peered":"2024-09-12T01:11:26.424411+0000","last_clean":"2024-09-12T01:11:26.424411+0000","last_became_active":"2024-09-12T00:12:42.051384+0000","last_became_peered":"2024-09-12T00:12:42.051384+0000","last_unstale":"2024-09-12T01:11:26.424411+0000","last_undegraded":"2024-09-12T01:11:26.424411+0000","last_fullsized":"2024-09-12T01:11:26.424411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'87","last_scrub_stamp":"2024-09-12T01:11:26.424310+0000","last_deep_scrub":"263'87","last_deep_scrub_stamp":"2024-09-12T01:11:26.424310+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.424310+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:29.942056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'777","reported_seq":4096,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.311284+0000","last_change":"2024-09-12T01:11:29.311284+0000","last_active":"2024-09-12T01:11:29.311284+0000","last_peered":"2024-09-12T01:11:29.311284+0000","last_clean":"2024-09-12T01:11:29.311284+0000","last_became_active":"2024-09-12T00:12:44.061837+0000","last_became_peered":"2024-09-12T00:12:44.061837+0000","last_unstale":"2024-09-12T01:11:29.311284+0000","last_undegraded":"2024-09-12T01:11:29.311284+0000","last_fullsized":"2024-09-12T01:11:29.311284+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-12T01:11:29.311182+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-12T01:11:29.311182+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.311182+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:13.873639+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'132","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.376678+0000","last_change":"2024-09-12T01:11:28.376678+0000","last_active":"2024-09-12T01:11:28.376678+0000","last_peered":"2024-09-12T01:11:28.376678+0000","last_clean":"2024-09-12T01:11:28.376678+0000","last_became_active":"2024-09-12T00:12:46.057978+0000","last_became_peered":"2024-09-12T00:12:46.057978+0000","last_unstale":"2024-09-12T01:11:28.376678+0000","last_undegraded":"2024-09-12T01:11:28.376678+0000","last_fullsized":"2024-09-12T01:11:28.376678+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'132","last_scrub_stamp":"2024-09-12T01:11:28.376556+0000","last_deep_scrub":"263'132","last_deep_scrub_stamp":"2024-09-12T01:11:28.376556+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.376556+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:48.943253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":126,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'235","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.760627+0000","last_change":"2024-09-12T01:11:09.760564+0000","last_active":"2024-09-12T01:11:09.760627+0000","last_peered":"2024-09-12T01:11:09.760627+0000","last_clean":"2024-09-12T01:11:09.760627+0000","last_became_active":"2024-09-12T00:12:38.037035+0000","last_became_peered":"2024-09-12T00:12:38.037035+0000","last_unstale":"2024-09-12T01:11:09.760627+0000","last_undegraded":"2024-09-12T01:11:09.760627+0000","last_fullsized":"2024-09-12T01:11:09.760627+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'235","last_scrub_stamp":"2024-09-12T01:11:09.760480+0000","last_deep_scrub":"263'235","last_deep_scrub_stamp":"2024-09-12T01:11:09.760480+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.760480+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:10.352680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":394,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'298","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.602123+0000","last_change":"2024-09-12T01:11:10.602123+0000","last_active":"2024-09-12T01:11:10.602123+0000","last_peered":"2024-09-12T01:11:10.602123+0000","last_clean":"2024-09-12T01:11:10.602123+0000","last_became_active":"2024-09-12T00:12:36.029059+0000","last_became_peered":"2024-09-12T00:12:36.029059+0000","last_unstale":"2024-09-12T01:11:10.602123+0000","last_undegraded":"2024-09-12T01:11:10.602123+0000","last_fullsized":"2024-09-12T01:11:10.602123+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'298","last_scrub_stamp":"2024-09-12T01:11:10.601960+0000","last_deep_scrub":"263'298","last_deep_scrub_stamp":"2024-09-12T01:11:10.601960+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.601960+0000","objects_scrubbed":9,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:37.836366+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4837920,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":419,"num_read_kb":19038,"num_write":995,"num_write_kb":37710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.416878+0000","last_change":"2024-09-12T01:11:31.416878+0000","last_active":"2024-09-12T01:11:31.416878+0000","last_peered":"2024-09-12T01:11:31.416878+0000","last_clean":"2024-09-12T01:11:31.416878+0000","last_became_active":"2024-09-12T00:12:40.042158+0000","last_became_peered":"2024-09-12T00:12:40.042158+0000","last_unstale":"2024-09-12T01:11:31.416878+0000","last_undegraded":"2024-09-12T01:11:31.416878+0000","last_fullsized":"2024-09-12T01:11:31.416878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:31.416768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:31.416768+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.416768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:50.244102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'357","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.375258+0000","last_change":"2024-09-12T01:11:24.375258+0000","last_active":"2024-09-12T01:11:24.375258+0000","last_peered":"2024-09-12T01:11:24.375258+0000","last_clean":"2024-09-12T01:11:24.375258+0000","last_became_active":"2024-09-12T00:12:42.048747+0000","last_became_peered":"2024-09-12T00:12:42.048747+0000","last_unstale":"2024-09-12T01:11:24.375258+0000","last_undegraded":"2024-09-12T01:11:24.375258+0000","last_fullsized":"2024-09-12T01:11:24.375258+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'357","last_scrub_stamp":"2024-09-12T01:11:24.375147+0000","last_deep_scrub":"263'357","last_deep_scrub_stamp":"2024-09-12T01:11:24.375147+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.375147+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:40.708397+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49371,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":1173,"num_write":448,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.331384+0000","last_change":"2024-09-12T01:11:23.331384+0000","last_active":"2024-09-12T01:11:23.331384+0000","last_peered":"2024-09-12T01:11:23.331384+0000","last_clean":"2024-09-12T01:11:23.331384+0000","last_became_active":"2024-09-12T00:12:44.050074+0000","last_became_peered":"2024-09-12T00:12:44.050074+0000","last_unstale":"2024-09-12T01:11:23.331384+0000","last_undegraded":"2024-09-12T01:11:23.331384+0000","last_fullsized":"2024-09-12T01:11:23.331384+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.331283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.331283+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.331283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:57.228673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'195","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.809397+0000","last_change":"2024-09-12T01:11:27.809397+0000","last_active":"2024-09-12T01:11:27.809397+0000","last_peered":"2024-09-12T01:11:27.809397+0000","last_clean":"2024-09-12T01:11:27.809397+0000","last_became_active":"2024-09-12T00:12:46.064517+0000","last_became_peered":"2024-09-12T00:12:46.064517+0000","last_unstale":"2024-09-12T01:11:27.809397+0000","last_undegraded":"2024-09-12T01:11:27.809397+0000","last_fullsized":"2024-09-12T01:11:27.809397+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'195","last_scrub_stamp":"2024-09-12T01:11:27.809309+0000","last_deep_scrub":"263'195","last_deep_scrub_stamp":"2024-09-12T01:11:27.809309+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.809309+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:19.119898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":229,"num_read_kb":204,"num_write":354,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'289","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.331049+0000","last_change":"2024-09-12T01:11:20.331049+0000","last_active":"2024-09-12T01:11:20.331049+0000","last_peered":"2024-09-12T01:11:20.331049+0000","last_clean":"2024-09-12T01:11:20.331049+0000","last_became_active":"2024-09-12T00:12:38.040885+0000","last_became_peered":"2024-09-12T00:12:38.040885+0000","last_unstale":"2024-09-12T01:11:20.331049+0000","last_undegraded":"2024-09-12T01:11:20.331049+0000","last_fullsized":"2024-09-12T01:11:20.331049+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-12T01:11:20.330958+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-12T01:11:20.330958+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.330958+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:40.353584+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1200,"num_read_kb":970,"num_write":419,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8074,"num_omap_keys":32,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:04.285268+0000","last_change":"2024-09-12T01:11:04.285268+0000","last_active":"2024-09-12T01:11:04.285268+0000","last_peered":"2024-09-12T01:11:04.285268+0000","last_clean":"2024-09-12T01:11:04.285268+0000","last_became_active":"2024-09-12T00:12:17.817880+0000","last_became_peered":"2024-09-12T00:12:17.817880+0000","last_unstale":"2024-09-12T01:11:04.285268+0000","last_undegraded":"2024-09-12T01:11:04.285268+0000","last_fullsized":"2024-09-12T01:11:04.285268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T01:11:04.285203+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T01:11:04.285203+0000","last_clean_scrub_stamp":"2024-09-12T01:11:04.285203+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:05.465929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.368102+0000","last_change":"2024-09-12T01:11:09.368102+0000","last_active":"2024-09-12T01:11:09.368102+0000","last_peered":"2024-09-12T01:11:09.368102+0000","last_clean":"2024-09-12T01:11:09.368102+0000","last_became_active":"2024-09-12T00:12:22.713297+0000","last_became_peered":"2024-09-12T00:12:22.713297+0000","last_unstale":"2024-09-12T01:11:09.368102+0000","last_undegraded":"2024-09-12T01:11:09.368102+0000","last_fullsized":"2024-09-12T01:11:09.368102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:09.368014+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:09.368014+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.368014+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:32.949309+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0014022310000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'392","reported_seq":1105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.672420+0000","last_change":"2024-09-12T01:11:05.672420+0000","last_active":"2024-09-12T01:11:05.672420+0000","last_peered":"2024-09-12T01:11:05.672420+0000","last_clean":"2024-09-12T01:11:05.672420+0000","last_became_active":"2024-09-12T00:12:36.030408+0000","last_became_peered":"2024-09-12T00:12:36.030408+0000","last_unstale":"2024-09-12T01:11:05.672420+0000","last_undegraded":"2024-09-12T01:11:05.672420+0000","last_fullsized":"2024-09-12T01:11:05.672420+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-12T01:11:05.672292+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-12T01:11:05.672292+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.672292+0000","objects_scrubbed":7,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:44.373893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262211,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":42611,"num_write":1169,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"263'4","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.138231+0000","last_change":"2024-09-12T01:11:25.138231+0000","last_active":"2024-09-12T01:11:25.138231+0000","last_peered":"2024-09-12T01:11:25.138231+0000","last_clean":"2024-09-12T01:11:25.138231+0000","last_became_active":"2024-09-12T00:12:40.039529+0000","last_became_peered":"2024-09-12T00:12:40.039529+0000","last_unstale":"2024-09-12T01:11:25.138231+0000","last_undegraded":"2024-09-12T01:11:25.138231+0000","last_fullsized":"2024-09-12T01:11:25.138231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:11:25.138154+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:11:25.138154+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.138154+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:54.590988+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'771","reported_seq":1489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.471847+0000","last_change":"2024-09-12T01:11:36.471847+0000","last_active":"2024-09-12T01:11:36.471847+0000","last_peered":"2024-09-12T01:11:36.471847+0000","last_clean":"2024-09-12T01:11:36.471847+0000","last_became_active":"2024-09-12T00:12:42.046668+0000","last_became_peered":"2024-09-12T00:12:42.046668+0000","last_unstale":"2024-09-12T01:11:36.471847+0000","last_undegraded":"2024-09-12T01:11:36.471847+0000","last_fullsized":"2024-09-12T01:11:36.471847+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'771","last_scrub_stamp":"2024-09-12T01:11:36.471732+0000","last_deep_scrub":"263'771","last_deep_scrub_stamp":"2024-09-12T01:11:36.471732+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.471732+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:32.859967+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143901,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1496,"num_read_kb":3385,"num_write":1448,"num_write_kb":1292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106668,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.932802+0000","last_change":"2024-09-12T01:11:33.932802+0000","last_active":"2024-09-12T01:11:33.932802+0000","last_peered":"2024-09-12T01:11:33.932802+0000","last_clean":"2024-09-12T01:11:33.932802+0000","last_became_active":"2024-09-12T00:12:44.053779+0000","last_became_peered":"2024-09-12T00:12:44.053779+0000","last_unstale":"2024-09-12T01:11:33.932802+0000","last_undegraded":"2024-09-12T01:11:33.932802+0000","last_fullsized":"2024-09-12T01:11:33.932802+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.932714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.932714+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.932714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:19.453742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'190","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.225982+0000","last_change":"2024-09-12T01:11:31.225982+0000","last_active":"2024-09-12T01:11:31.225982+0000","last_peered":"2024-09-12T01:11:31.225982+0000","last_clean":"2024-09-12T01:11:31.225982+0000","last_became_active":"2024-09-12T00:12:46.055501+0000","last_became_peered":"2024-09-12T00:12:46.055501+0000","last_unstale":"2024-09-12T01:11:31.225982+0000","last_undegraded":"2024-09-12T01:11:31.225982+0000","last_fullsized":"2024-09-12T01:11:31.225982+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-12T01:11:31.225881+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-12T01:11:31.225881+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.225881+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:31.545264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":436,"num_write":384,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'149","reported_seq":737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.868218+0000","last_change":"2024-09-12T01:11:18.868218+0000","last_active":"2024-09-12T01:11:18.868218+0000","last_peered":"2024-09-12T01:11:18.868218+0000","last_clean":"2024-09-12T01:11:18.868218+0000","last_became_active":"2024-09-12T00:12:38.037392+0000","last_became_peered":"2024-09-12T00:12:38.037392+0000","last_unstale":"2024-09-12T01:11:18.868218+0000","last_undegraded":"2024-09-12T01:11:18.868218+0000","last_fullsized":"2024-09-12T01:11:18.868218+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-12T01:11:18.868095+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-12T01:11:18.868095+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.868095+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:24.230817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":647,"num_read_kb":530,"num_write":212,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.270371+0000","last_change":"2024-09-12T01:11:05.270371+0000","last_active":"2024-09-12T01:11:05.270371+0000","last_peered":"2024-09-12T01:11:05.270371+0000","last_clean":"2024-09-12T01:11:05.270371+0000","last_became_active":"2024-09-12T00:12:22.713657+0000","last_became_peered":"2024-09-12T00:12:22.713657+0000","last_unstale":"2024-09-12T01:11:05.270371+0000","last_undegraded":"2024-09-12T01:11:05.270371+0000","last_fullsized":"2024-09-12T01:11:05.270371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:05.270282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:05.270282+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.270282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:52.804966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012667690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'335","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.358183+0000","last_change":"2024-09-12T01:11:06.358183+0000","last_active":"2024-09-12T01:11:06.358183+0000","last_peered":"2024-09-12T01:11:06.358183+0000","last_clean":"2024-09-12T01:11:06.358183+0000","last_became_active":"2024-09-12T00:12:36.036010+0000","last_became_peered":"2024-09-12T00:12:36.036010+0000","last_unstale":"2024-09-12T01:11:06.358183+0000","last_undegraded":"2024-09-12T01:11:06.358183+0000","last_fullsized":"2024-09-12T01:11:06.358183+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:11:06.358069+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:11:06.358069+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.358069+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.445759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":7159,"num_write":1103,"num_write_kb":37525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.447801+0000","last_change":"2024-09-12T01:11:30.447801+0000","last_active":"2024-09-12T01:11:30.447801+0000","last_peered":"2024-09-12T01:11:30.447801+0000","last_clean":"2024-09-12T01:11:30.447801+0000","last_became_active":"2024-09-12T00:12:40.039592+0000","last_became_peered":"2024-09-12T00:12:40.039592+0000","last_unstale":"2024-09-12T01:11:30.447801+0000","last_undegraded":"2024-09-12T01:11:30.447801+0000","last_fullsized":"2024-09-12T01:11:30.447801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:30.447718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:30.447718+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.447718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:02.060126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1316","reported_seq":2955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.789709+0000","last_change":"2024-09-12T01:11:25.789709+0000","last_active":"2024-09-12T01:11:25.789709+0000","last_peered":"2024-09-12T01:11:25.789709+0000","last_clean":"2024-09-12T01:11:25.789709+0000","last_became_active":"2024-09-12T00:12:42.049594+0000","last_became_peered":"2024-09-12T00:12:42.049594+0000","last_unstale":"2024-09-12T01:11:25.789709+0000","last_undegraded":"2024-09-12T01:11:25.789709+0000","last_fullsized":"2024-09-12T01:11:25.789709+0000","mapping_epoch":33,"log_start":"263'1301","ondisk_log_start":"263'1301","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1316","last_scrub_stamp":"2024-09-12T01:11:25.789564+0000","last_deep_scrub":"263'1316","last_deep_scrub_stamp":"2024-09-12T01:11:25.789564+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.789564+0000","objects_scrubbed":12,"log_size":15,"log_dups_size":1301,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:05.989198+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146958,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3903,"num_write":1160,"num_write_kb":992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.485064+0000","last_change":"2024-09-12T01:11:41.485064+0000","last_active":"2024-09-12T01:11:41.485064+0000","last_peered":"2024-09-12T01:11:41.485064+0000","last_clean":"2024-09-12T01:11:41.485064+0000","last_became_active":"2024-09-12T00:12:44.059188+0000","last_became_peered":"2024-09-12T00:12:44.059188+0000","last_unstale":"2024-09-12T01:11:41.485064+0000","last_undegraded":"2024-09-12T01:11:41.485064+0000","last_fullsized":"2024-09-12T01:11:41.485064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:41.484969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:41.484969+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.484969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:01.830123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'154","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.923474+0000","last_change":"2024-09-12T01:11:38.923474+0000","last_active":"2024-09-12T01:11:38.923474+0000","last_peered":"2024-09-12T01:11:38.923474+0000","last_clean":"2024-09-12T01:11:38.923474+0000","last_became_active":"2024-09-12T00:12:46.064993+0000","last_became_peered":"2024-09-12T00:12:46.064993+0000","last_unstale":"2024-09-12T01:11:38.923474+0000","last_undegraded":"2024-09-12T01:11:38.923474+0000","last_fullsized":"2024-09-12T01:11:38.923474+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-09-12T01:11:38.923382+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-09-12T01:11:38.923382+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.923382+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:08.239621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":277,"num_write":363,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'61","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.234785+0000","last_change":"2024-09-12T01:11:17.234785+0000","last_active":"2024-09-12T01:11:17.234785+0000","last_peered":"2024-09-12T01:11:17.234785+0000","last_clean":"2024-09-12T01:11:17.234785+0000","last_became_active":"2024-09-12T00:12:38.039492+0000","last_became_peered":"2024-09-12T00:12:38.039492+0000","last_unstale":"2024-09-12T01:11:17.234785+0000","last_undegraded":"2024-09-12T01:11:17.234785+0000","last_fullsized":"2024-09-12T01:11:17.234785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'61","last_scrub_stamp":"2024-09-12T01:11:17.234696+0000","last_deep_scrub":"263'61","last_deep_scrub_stamp":"2024-09-12T01:11:17.234696+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.234696+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:55.520286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":235,"num_write":88,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.746156+0000","last_change":"2024-09-12T01:11:07.746156+0000","last_active":"2024-09-12T01:11:07.746156+0000","last_peered":"2024-09-12T01:11:07.746156+0000","last_clean":"2024-09-12T01:11:07.746156+0000","last_became_active":"2024-09-12T00:12:22.714487+0000","last_became_peered":"2024-09-12T00:12:22.714487+0000","last_unstale":"2024-09-12T01:11:07.746156+0000","last_undegraded":"2024-09-12T01:11:07.746156+0000","last_fullsized":"2024-09-12T01:11:07.746156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:07.746070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:07.746070+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.746070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:58.957625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038937299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'315","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.637646+0000","last_change":"2024-09-12T01:11:06.637646+0000","last_active":"2024-09-12T01:11:06.637646+0000","last_peered":"2024-09-12T01:11:06.637646+0000","last_clean":"2024-09-12T01:11:06.637646+0000","last_became_active":"2024-09-12T00:12:36.042293+0000","last_became_peered":"2024-09-12T00:12:36.042293+0000","last_unstale":"2024-09-12T01:11:06.637646+0000","last_undegraded":"2024-09-12T01:11:06.637646+0000","last_fullsized":"2024-09-12T01:11:06.637646+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-09-12T01:11:06.637502+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-09-12T01:11:06.637502+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.637502+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.943410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214314,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":33497,"num_write":1058,"num_write_kb":40497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.726967+0000","last_change":"2024-09-12T01:11:18.726967+0000","last_active":"2024-09-12T01:11:18.726967+0000","last_peered":"2024-09-12T01:11:18.726967+0000","last_clean":"2024-09-12T01:11:18.726967+0000","last_became_active":"2024-09-12T00:12:40.038202+0000","last_became_peered":"2024-09-12T00:12:40.038202+0000","last_unstale":"2024-09-12T01:11:18.726967+0000","last_undegraded":"2024-09-12T01:11:18.726967+0000","last_fullsized":"2024-09-12T01:11:18.726967+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:18.726875+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:18.726875+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.726875+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:47.107289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'257","reported_seq":1498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.177486+0000","last_change":"2024-09-12T01:11:20.177486+0000","last_active":"2024-09-12T01:11:20.177486+0000","last_peered":"2024-09-12T01:11:20.177486+0000","last_clean":"2024-09-12T01:11:20.177486+0000","last_became_active":"2024-09-12T00:12:42.044498+0000","last_became_peered":"2024-09-12T00:12:42.044498+0000","last_unstale":"2024-09-12T01:11:20.177486+0000","last_undegraded":"2024-09-12T01:11:20.177486+0000","last_fullsized":"2024-09-12T01:11:20.177486+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'257","last_scrub_stamp":"2024-09-12T01:11:20.177386+0000","last_deep_scrub":"263'257","last_deep_scrub_stamp":"2024-09-12T01:11:20.177386+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.177386+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:56.030842+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":187,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.618928+0000","last_change":"2024-09-12T01:11:31.618928+0000","last_active":"2024-09-12T01:11:31.618928+0000","last_peered":"2024-09-12T01:11:31.618928+0000","last_clean":"2024-09-12T01:11:31.618928+0000","last_became_active":"2024-09-12T00:12:44.062039+0000","last_became_peered":"2024-09-12T00:12:44.062039+0000","last_unstale":"2024-09-12T01:11:31.618928+0000","last_undegraded":"2024-09-12T01:11:31.618928+0000","last_fullsized":"2024-09-12T01:11:31.618928+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:31.618832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:31.618832+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.618832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:48.890810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'262","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.464282+0000","last_change":"2024-09-12T01:11:41.464282+0000","last_active":"2024-09-12T01:11:41.464282+0000","last_peered":"2024-09-12T01:11:41.464282+0000","last_clean":"2024-09-12T01:11:41.464282+0000","last_became_active":"2024-09-12T00:12:46.053228+0000","last_became_peered":"2024-09-12T00:12:46.053228+0000","last_unstale":"2024-09-12T01:11:41.464282+0000","last_undegraded":"2024-09-12T01:11:41.464282+0000","last_fullsized":"2024-09-12T01:11:41.464282+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'262","last_scrub_stamp":"2024-09-12T01:11:41.464189+0000","last_deep_scrub":"263'262","last_deep_scrub_stamp":"2024-09-12T01:11:41.464189+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.464189+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:30.784637+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":531,"num_write":580,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'172","reported_seq":760,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.245410+0000","last_change":"2024-09-12T01:11:16.245410+0000","last_active":"2024-09-12T01:11:16.245410+0000","last_peered":"2024-09-12T01:11:16.245410+0000","last_clean":"2024-09-12T01:11:16.245410+0000","last_became_active":"2024-09-12T00:12:38.040477+0000","last_became_peered":"2024-09-12T00:12:38.040477+0000","last_unstale":"2024-09-12T01:11:16.245410+0000","last_undegraded":"2024-09-12T01:11:16.245410+0000","last_fullsized":"2024-09-12T01:11:16.245410+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-09-12T01:11:16.245307+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-09-12T01:11:16.245307+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.245307+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:24.897173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":766,"num_read_kb":623,"num_write":281,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.249463+0000","last_change":"2024-09-12T01:11:06.249463+0000","last_active":"2024-09-12T01:11:06.249463+0000","last_peered":"2024-09-12T01:11:06.249463+0000","last_clean":"2024-09-12T01:11:06.249463+0000","last_became_active":"2024-09-12T00:12:22.840587+0000","last_became_peered":"2024-09-12T00:12:22.840587+0000","last_unstale":"2024-09-12T01:11:06.249463+0000","last_undegraded":"2024-09-12T01:11:06.249463+0000","last_fullsized":"2024-09-12T01:11:06.249463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:11:06.249395+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:11:06.249395+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.249395+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:59.319645+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00065014999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'371","reported_seq":1097,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.091924+0000","last_change":"2024-09-12T01:11:05.091924+0000","last_active":"2024-09-12T01:11:05.091924+0000","last_peered":"2024-09-12T01:11:05.091924+0000","last_clean":"2024-09-12T01:11:05.091924+0000","last_became_active":"2024-09-12T00:12:36.039564+0000","last_became_peered":"2024-09-12T00:12:36.039564+0000","last_unstale":"2024-09-12T01:11:05.091924+0000","last_undegraded":"2024-09-12T01:11:05.091924+0000","last_fullsized":"2024-09-12T01:11:05.091924+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-12T01:11:05.091758+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-12T01:11:05.091758+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.091758+0000","objects_scrubbed":10,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:28.012152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568589,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":639,"num_read_kb":35583,"num_write":1189,"num_write_kb":35527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.769511+0000","last_change":"2024-09-12T01:11:17.769511+0000","last_active":"2024-09-12T01:11:17.769511+0000","last_peered":"2024-09-12T01:11:17.769511+0000","last_clean":"2024-09-12T01:11:17.769511+0000","last_became_active":"2024-09-12T00:12:40.042510+0000","last_became_peered":"2024-09-12T00:12:40.042510+0000","last_unstale":"2024-09-12T01:11:17.769511+0000","last_undegraded":"2024-09-12T01:11:17.769511+0000","last_fullsized":"2024-09-12T01:11:17.769511+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:17.769411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:17.769411+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.769411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:32.805066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'138","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.956840+0000","last_change":"2024-09-12T01:11:29.956840+0000","last_active":"2024-09-12T01:11:29.956840+0000","last_peered":"2024-09-12T01:11:29.956840+0000","last_clean":"2024-09-12T01:11:29.956840+0000","last_became_active":"2024-09-12T00:12:42.050143+0000","last_became_peered":"2024-09-12T00:12:42.050143+0000","last_unstale":"2024-09-12T01:11:29.956840+0000","last_undegraded":"2024-09-12T01:11:29.956840+0000","last_fullsized":"2024-09-12T01:11:29.956840+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'138","last_scrub_stamp":"2024-09-12T01:11:29.956738+0000","last_deep_scrub":"263'138","last_deep_scrub_stamp":"2024-09-12T01:11:29.956738+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.956738+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:27.747936+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.503337+0000","last_change":"2024-09-12T01:11:42.503337+0000","last_active":"2024-09-12T01:11:42.503337+0000","last_peered":"2024-09-12T01:11:42.503337+0000","last_clean":"2024-09-12T01:11:42.503337+0000","last_became_active":"2024-09-12T00:12:44.059037+0000","last_became_peered":"2024-09-12T00:12:44.059037+0000","last_unstale":"2024-09-12T01:11:42.503337+0000","last_undegraded":"2024-09-12T01:11:42.503337+0000","last_fullsized":"2024-09-12T01:11:42.503337+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:42.503235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:42.503235+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.503235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:26.070012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'164","reported_seq":724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.315796+0000","last_change":"2024-09-12T01:11:33.315796+0000","last_active":"2024-09-12T01:11:33.315796+0000","last_peered":"2024-09-12T01:11:33.315796+0000","last_clean":"2024-09-12T01:11:33.315796+0000","last_became_active":"2024-09-12T00:12:46.068934+0000","last_became_peered":"2024-09-12T00:12:46.068934+0000","last_unstale":"2024-09-12T01:11:33.315796+0000","last_undegraded":"2024-09-12T01:11:33.315796+0000","last_fullsized":"2024-09-12T01:11:33.315796+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'164","last_scrub_stamp":"2024-09-12T01:11:33.315710+0000","last_deep_scrub":"263'164","last_deep_scrub_stamp":"2024-09-12T01:11:33.315710+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.315710+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:58.486227+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":270,"num_read_kb":259,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'111","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.199730+0000","last_change":"2024-09-12T01:11:15.199730+0000","last_active":"2024-09-12T01:11:15.199730+0000","last_peered":"2024-09-12T01:11:15.199730+0000","last_clean":"2024-09-12T01:11:15.199730+0000","last_became_active":"2024-09-12T00:12:38.044464+0000","last_became_peered":"2024-09-12T00:12:38.044464+0000","last_unstale":"2024-09-12T01:11:15.199730+0000","last_undegraded":"2024-09-12T01:11:15.199730+0000","last_fullsized":"2024-09-12T01:11:15.199730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:11:15.199631+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:11:15.199631+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.199631+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:16.550535+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":513,"num_read_kb":428,"num_write":178,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'371","reported_seq":1145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:04.190226+0000","last_change":"2024-09-12T01:11:04.190168+0000","last_active":"2024-09-12T01:11:04.190226+0000","last_peered":"2024-09-12T01:11:04.190226+0000","last_clean":"2024-09-12T01:11:04.190226+0000","last_became_active":"2024-09-12T00:12:36.036570+0000","last_became_peered":"2024-09-12T00:12:36.036570+0000","last_unstale":"2024-09-12T01:11:04.190226+0000","last_undegraded":"2024-09-12T01:11:04.190226+0000","last_fullsized":"2024-09-12T01:11:04.190226+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-12T01:11:04.190045+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-12T01:11:04.190045+0000","last_clean_scrub_stamp":"2024-09-12T01:11:04.190045+0000","objects_scrubbed":9,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:33.603768+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524373,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":804,"num_read_kb":22341,"num_write":1147,"num_write_kb":30942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.589125+0000","last_change":"2024-09-12T01:11:05.589125+0000","last_active":"2024-09-12T01:11:05.589125+0000","last_peered":"2024-09-12T01:11:05.589125+0000","last_clean":"2024-09-12T01:11:05.589125+0000","last_became_active":"2024-09-12T00:12:22.840210+0000","last_became_peered":"2024-09-12T00:12:22.840210+0000","last_unstale":"2024-09-12T01:11:05.589125+0000","last_undegraded":"2024-09-12T01:11:05.589125+0000","last_fullsized":"2024-09-12T01:11:05.589125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:05.589031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:05.589031+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.589031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:48.332487+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00043827699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.462491+0000","last_change":"2024-09-12T01:11:23.462491+0000","last_active":"2024-09-12T01:11:23.462491+0000","last_peered":"2024-09-12T01:11:23.462491+0000","last_clean":"2024-09-12T01:11:23.462491+0000","last_became_active":"2024-09-12T00:12:40.040760+0000","last_became_peered":"2024-09-12T00:12:40.040760+0000","last_unstale":"2024-09-12T01:11:23.462491+0000","last_undegraded":"2024-09-12T01:11:23.462491+0000","last_fullsized":"2024-09-12T01:11:23.462491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.462403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.462403+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.462403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:07.120114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'635","reported_seq":1315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.726383+0000","last_change":"2024-09-12T01:11:20.726383+0000","last_active":"2024-09-12T01:11:20.726383+0000","last_peered":"2024-09-12T01:11:20.726383+0000","last_clean":"2024-09-12T01:11:20.726383+0000","last_became_active":"2024-09-12T00:12:42.053472+0000","last_became_peered":"2024-09-12T00:12:42.053472+0000","last_unstale":"2024-09-12T01:11:20.726383+0000","last_undegraded":"2024-09-12T01:11:20.726383+0000","last_fullsized":"2024-09-12T01:11:20.726383+0000","mapping_epoch":33,"log_start":"263'600","ondisk_log_start":"263'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'635","last_scrub_stamp":"2024-09-12T01:11:20.726278+0000","last_deep_scrub":"263'635","last_deep_scrub_stamp":"2024-09-12T01:11:20.726278+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.726278+0000","objects_scrubbed":11,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:47.077848+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1715,"num_read_kb":3028,"num_write":2216,"num_write_kb":2038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":509110,"num_omap_keys":1156,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.329191+0000","last_change":"2024-09-12T01:11:25.329191+0000","last_active":"2024-09-12T01:11:25.329191+0000","last_peered":"2024-09-12T01:11:25.329191+0000","last_clean":"2024-09-12T01:11:25.329191+0000","last_became_active":"2024-09-12T00:12:44.048703+0000","last_became_peered":"2024-09-12T00:12:44.048703+0000","last_unstale":"2024-09-12T01:11:25.329191+0000","last_undegraded":"2024-09-12T01:11:25.329191+0000","last_fullsized":"2024-09-12T01:11:25.329191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:25.329100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:25.329100+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.329100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:40.236532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'148","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.845516+0000","last_change":"2024-09-12T01:11:40.845516+0000","last_active":"2024-09-12T01:11:40.845516+0000","last_peered":"2024-09-12T01:11:40.845516+0000","last_clean":"2024-09-12T01:11:40.845516+0000","last_became_active":"2024-09-12T00:12:46.063429+0000","last_became_peered":"2024-09-12T00:12:46.063429+0000","last_unstale":"2024-09-12T01:11:40.845516+0000","last_undegraded":"2024-09-12T01:11:40.845516+0000","last_fullsized":"2024-09-12T01:11:40.845516+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-12T01:11:40.845415+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-12T01:11:40.845415+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.845415+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:07.217647+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":320,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'178","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.232032+0000","last_change":"2024-09-12T01:11:14.232032+0000","last_active":"2024-09-12T01:11:14.232032+0000","last_peered":"2024-09-12T01:11:14.232032+0000","last_clean":"2024-09-12T01:11:14.232032+0000","last_became_active":"2024-09-12T00:12:38.041178+0000","last_became_peered":"2024-09-12T00:12:38.041178+0000","last_unstale":"2024-09-12T01:11:14.232032+0000","last_undegraded":"2024-09-12T01:11:14.232032+0000","last_fullsized":"2024-09-12T01:11:14.232032+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'178","last_scrub_stamp":"2024-09-12T01:11:14.231899+0000","last_deep_scrub":"263'178","last_deep_scrub_stamp":"2024-09-12T01:11:14.231899+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.231899+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:31.662431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":778,"num_read_kb":646,"num_write":262,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'366","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.335804+0000","last_change":"2024-09-12T01:11:07.335804+0000","last_active":"2024-09-12T01:11:07.335804+0000","last_peered":"2024-09-12T01:11:07.335804+0000","last_clean":"2024-09-12T01:11:07.335804+0000","last_became_active":"2024-09-12T00:12:36.035932+0000","last_became_peered":"2024-09-12T00:12:36.035932+0000","last_unstale":"2024-09-12T01:11:07.335804+0000","last_undegraded":"2024-09-12T01:11:07.335804+0000","last_fullsized":"2024-09-12T01:11:07.335804+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-12T01:11:07.335670+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-12T01:11:07.335670+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.335670+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:26.350544+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":22298,"num_write":1170,"num_write_kb":32564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.332587+0000","last_change":"2024-09-12T01:11:08.332587+0000","last_active":"2024-09-12T01:11:08.332587+0000","last_peered":"2024-09-12T01:11:08.332587+0000","last_clean":"2024-09-12T01:11:08.332587+0000","last_became_active":"2024-09-12T00:12:22.713263+0000","last_became_peered":"2024-09-12T00:12:22.713263+0000","last_unstale":"2024-09-12T01:11:08.332587+0000","last_undegraded":"2024-09-12T01:11:08.332587+0000","last_fullsized":"2024-09-12T01:11:08.332587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:08.332490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:08.332490+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.332490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:24.233170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065424400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.142367+0000","last_change":"2024-09-12T01:11:19.142367+0000","last_active":"2024-09-12T01:11:19.142367+0000","last_peered":"2024-09-12T01:11:19.142367+0000","last_clean":"2024-09-12T01:11:19.142367+0000","last_became_active":"2024-09-12T00:12:40.038903+0000","last_became_peered":"2024-09-12T00:12:40.038903+0000","last_unstale":"2024-09-12T01:11:19.142367+0000","last_undegraded":"2024-09-12T01:11:19.142367+0000","last_fullsized":"2024-09-12T01:11:19.142367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.142267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.142267+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.142267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:18.760101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'180","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.380764+0000","last_change":"2024-09-12T01:11:25.380764+0000","last_active":"2024-09-12T01:11:25.380764+0000","last_peered":"2024-09-12T01:11:25.380764+0000","last_clean":"2024-09-12T01:11:25.380764+0000","last_became_active":"2024-09-12T00:12:42.050580+0000","last_became_peered":"2024-09-12T00:12:42.050580+0000","last_unstale":"2024-09-12T01:11:25.380764+0000","last_undegraded":"2024-09-12T01:11:25.380764+0000","last_fullsized":"2024-09-12T01:11:25.380764+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-12T01:11:25.380659+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-12T01:11:25.380659+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.380659+0000","objects_scrubbed":8,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:36.184071+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":221,"num_write":156,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'778","reported_seq":2709,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.362048+0000","last_change":"2024-09-12T01:11:25.362048+0000","last_active":"2024-09-12T01:11:25.362048+0000","last_peered":"2024-09-12T01:11:25.362048+0000","last_clean":"2024-09-12T01:11:25.362048+0000","last_became_active":"2024-09-12T00:12:44.050295+0000","last_became_peered":"2024-09-12T00:12:44.050295+0000","last_unstale":"2024-09-12T01:11:25.362048+0000","last_undegraded":"2024-09-12T01:11:25.362048+0000","last_fullsized":"2024-09-12T01:11:25.362048+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'778","last_scrub_stamp":"2024-09-12T01:11:25.361928+0000","last_deep_scrub":"263'778","last_deep_scrub_stamp":"2024-09-12T01:11:25.361928+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.361928+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:09.364763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'131","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.684055+0000","last_change":"2024-09-12T01:11:36.684055+0000","last_active":"2024-09-12T01:11:36.684055+0000","last_peered":"2024-09-12T01:11:36.684055+0000","last_clean":"2024-09-12T01:11:36.684055+0000","last_became_active":"2024-09-12T00:12:46.064036+0000","last_became_peered":"2024-09-12T00:12:46.064036+0000","last_unstale":"2024-09-12T01:11:36.684055+0000","last_undegraded":"2024-09-12T01:11:36.684055+0000","last_fullsized":"2024-09-12T01:11:36.684055+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-12T01:11:36.683958+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-12T01:11:36.683958+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.683958+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:14.571309+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1116,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'66","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.583250+0000","last_change":"2024-09-12T01:11:15.583250+0000","last_active":"2024-09-12T01:11:15.583250+0000","last_peered":"2024-09-12T01:11:15.583250+0000","last_clean":"2024-09-12T01:11:15.583250+0000","last_became_active":"2024-09-12T00:12:38.039759+0000","last_became_peered":"2024-09-12T00:12:38.039759+0000","last_unstale":"2024-09-12T01:11:15.583250+0000","last_undegraded":"2024-09-12T01:11:15.583250+0000","last_fullsized":"2024-09-12T01:11:15.583250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'66","last_scrub_stamp":"2024-09-12T01:11:15.583159+0000","last_deep_scrub":"263'66","last_deep_scrub_stamp":"2024-09-12T01:11:15.583159+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.583159+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:34.335798+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":290,"num_read_kb":242,"num_write":89,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":503,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'356","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.632386+0000","last_change":"2024-09-12T01:11:08.632286+0000","last_active":"2024-09-12T01:11:08.632386+0000","last_peered":"2024-09-12T01:11:08.632386+0000","last_clean":"2024-09-12T01:11:08.632386+0000","last_became_active":"2024-09-12T00:12:36.032470+0000","last_became_peered":"2024-09-12T00:12:36.032470+0000","last_unstale":"2024-09-12T01:11:08.632386+0000","last_undegraded":"2024-09-12T01:11:08.632386+0000","last_fullsized":"2024-09-12T01:11:08.632386+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-12T01:11:08.632121+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-12T01:11:08.632121+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.632121+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:33.909337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":506,"num_read_kb":9897,"num_write":1201,"num_write_kb":25017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.678646+0000","last_change":"2024-09-12T01:11:06.678646+0000","last_active":"2024-09-12T01:11:06.678646+0000","last_peered":"2024-09-12T01:11:06.678646+0000","last_clean":"2024-09-12T01:11:06.678646+0000","last_became_active":"2024-09-12T00:12:22.875452+0000","last_became_peered":"2024-09-12T00:12:22.875452+0000","last_unstale":"2024-09-12T01:11:06.678646+0000","last_undegraded":"2024-09-12T01:11:06.678646+0000","last_fullsized":"2024-09-12T01:11:06.678646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:06.678559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:06.678559+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.678559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:14.194427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040035500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.458334+0000","last_change":"2024-09-12T01:11:29.458334+0000","last_active":"2024-09-12T01:11:29.458334+0000","last_peered":"2024-09-12T01:11:29.458334+0000","last_clean":"2024-09-12T01:11:29.458334+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:11:29.458334+0000","last_undegraded":"2024-09-12T01:11:29.458334+0000","last_fullsized":"2024-09-12T01:11:29.458334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:29.458251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:29.458251+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.458251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:45.810217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'135","reported_seq":689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.446074+0000","last_change":"2024-09-12T01:11:35.446074+0000","last_active":"2024-09-12T01:11:35.446074+0000","last_peered":"2024-09-12T01:11:35.446074+0000","last_clean":"2024-09-12T01:11:35.446074+0000","last_became_active":"2024-09-12T00:12:42.048364+0000","last_became_peered":"2024-09-12T00:12:42.048364+0000","last_unstale":"2024-09-12T01:11:35.446074+0000","last_undegraded":"2024-09-12T01:11:35.446074+0000","last_fullsized":"2024-09-12T01:11:35.446074+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T01:11:35.445983+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T01:11:35.445983+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.445983+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:10.155213+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'807","reported_seq":2525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.996362+0000","last_change":"2024-09-12T01:11:31.996362+0000","last_active":"2024-09-12T01:11:31.996362+0000","last_peered":"2024-09-12T01:11:31.996362+0000","last_clean":"2024-09-12T01:11:31.996362+0000","last_became_active":"2024-09-12T00:12:44.049336+0000","last_became_peered":"2024-09-12T00:12:44.049336+0000","last_unstale":"2024-09-12T01:11:31.996362+0000","last_undegraded":"2024-09-12T01:11:31.996362+0000","last_fullsized":"2024-09-12T01:11:31.996362+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'807","last_scrub_stamp":"2024-09-12T01:11:31.996271+0000","last_deep_scrub":"263'807","last_deep_scrub_stamp":"2024-09-12T01:11:31.996271+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.996271+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:45.036685+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'276","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.880179+0000","last_change":"2024-09-12T01:11:39.880179+0000","last_active":"2024-09-12T01:11:39.880179+0000","last_peered":"2024-09-12T01:11:39.880179+0000","last_clean":"2024-09-12T01:11:39.880179+0000","last_became_active":"2024-09-12T00:12:46.064058+0000","last_became_peered":"2024-09-12T00:12:46.064058+0000","last_unstale":"2024-09-12T01:11:39.880179+0000","last_undegraded":"2024-09-12T01:11:39.880179+0000","last_fullsized":"2024-09-12T01:11:39.880179+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'276","last_scrub_stamp":"2024-09-12T01:11:39.880061+0000","last_deep_scrub":"263'276","last_deep_scrub_stamp":"2024-09-12T01:11:39.880061+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.880061+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:43.220270+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":363,"num_read_kb":352,"num_write":596,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'133","reported_seq":725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.182032+0000","last_change":"2024-09-12T01:11:06.182032+0000","last_active":"2024-09-12T01:11:06.182032+0000","last_peered":"2024-09-12T01:11:06.182032+0000","last_clean":"2024-09-12T01:11:06.182032+0000","last_became_active":"2024-09-12T00:12:38.044075+0000","last_became_peered":"2024-09-12T00:12:38.044075+0000","last_unstale":"2024-09-12T01:11:06.182032+0000","last_undegraded":"2024-09-12T01:11:06.182032+0000","last_fullsized":"2024-09-12T01:11:06.182032+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-12T01:11:06.181955+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-12T01:11:06.181955+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.181955+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:46.555230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":484,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'410","reported_seq":1169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.675980+0000","last_change":"2024-09-12T01:11:07.675922+0000","last_active":"2024-09-12T01:11:07.675980+0000","last_peered":"2024-09-12T01:11:07.675980+0000","last_clean":"2024-09-12T01:11:07.675980+0000","last_became_active":"2024-09-12T00:12:36.030644+0000","last_became_peered":"2024-09-12T00:12:36.030644+0000","last_unstale":"2024-09-12T01:11:07.675980+0000","last_undegraded":"2024-09-12T01:11:07.675980+0000","last_fullsized":"2024-09-12T01:11:07.675980+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'410","last_scrub_stamp":"2024-09-12T01:11:07.675795+0000","last_deep_scrub":"263'410","last_deep_scrub_stamp":"2024-09-12T01:11:07.675795+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.675795+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:12.979636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568642,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":738,"num_read_kb":123120,"num_write":1245,"num_write_kb":49104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.293104+0000","last_change":"2024-09-12T01:11:07.293104+0000","last_active":"2024-09-12T01:11:07.293104+0000","last_peered":"2024-09-12T01:11:07.293104+0000","last_clean":"2024-09-12T01:11:07.293104+0000","last_became_active":"2024-09-12T00:12:22.875444+0000","last_became_peered":"2024-09-12T00:12:22.875444+0000","last_unstale":"2024-09-12T01:11:07.293104+0000","last_undegraded":"2024-09-12T01:11:07.293104+0000","last_fullsized":"2024-09-12T01:11:07.293104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:07.293023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:07.293023+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.293023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:23.494982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001017387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"263'6","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.448019+0000","last_change":"2024-09-12T01:11:21.448019+0000","last_active":"2024-09-12T01:11:21.448019+0000","last_peered":"2024-09-12T01:11:21.448019+0000","last_clean":"2024-09-12T01:11:21.448019+0000","last_became_active":"2024-09-12T00:12:40.031382+0000","last_became_peered":"2024-09-12T00:12:40.031382+0000","last_unstale":"2024-09-12T01:11:21.448019+0000","last_undegraded":"2024-09-12T01:11:21.448019+0000","last_fullsized":"2024-09-12T01:11:21.448019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:21.447933+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:21.447933+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.447933+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:55.518009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'736","reported_seq":1470,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.161140+0000","last_change":"2024-09-12T01:11:26.161140+0000","last_active":"2024-09-12T01:11:26.161140+0000","last_peered":"2024-09-12T01:11:26.161140+0000","last_clean":"2024-09-12T01:11:26.161140+0000","last_became_active":"2024-09-12T00:12:42.043328+0000","last_became_peered":"2024-09-12T00:12:42.043328+0000","last_unstale":"2024-09-12T01:11:26.161140+0000","last_undegraded":"2024-09-12T01:11:26.161140+0000","last_fullsized":"2024-09-12T01:11:26.161140+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'736","last_scrub_stamp":"2024-09-12T01:11:26.161042+0000","last_deep_scrub":"263'736","last_deep_scrub_stamp":"2024-09-12T01:11:26.161042+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.161042+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:32.910416+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147946,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1306,"num_read_kb":3069,"num_write":1058,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.551253+0000","last_change":"2024-09-12T01:11:33.551253+0000","last_active":"2024-09-12T01:11:33.551253+0000","last_peered":"2024-09-12T01:11:33.551253+0000","last_clean":"2024-09-12T01:11:33.551253+0000","last_became_active":"2024-09-12T00:12:44.061206+0000","last_became_peered":"2024-09-12T00:12:44.061206+0000","last_unstale":"2024-09-12T01:11:33.551253+0000","last_undegraded":"2024-09-12T01:11:33.551253+0000","last_fullsized":"2024-09-12T01:11:33.551253+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.551163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.551163+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.551163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:30.138665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'99","reported_seq":601,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.348833+0000","last_change":"2024-09-12T01:11:30.348833+0000","last_active":"2024-09-12T01:11:30.348833+0000","last_peered":"2024-09-12T01:11:30.348833+0000","last_clean":"2024-09-12T01:11:30.348833+0000","last_became_active":"2024-09-12T00:12:46.058465+0000","last_became_peered":"2024-09-12T00:12:46.058465+0000","last_unstale":"2024-09-12T01:11:30.348833+0000","last_undegraded":"2024-09-12T01:11:30.348833+0000","last_fullsized":"2024-09-12T01:11:30.348833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'99","last_scrub_stamp":"2024-09-12T01:11:30.348742+0000","last_deep_scrub":"263'99","last_deep_scrub_stamp":"2024-09-12T01:11:30.348742+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.348742+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:01.724178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":101,"num_write":234,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'140","reported_seq":715,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.475498+0000","last_change":"2024-09-12T01:11:40.475498+0000","last_active":"2024-09-12T01:11:40.475498+0000","last_peered":"2024-09-12T01:11:40.475498+0000","last_clean":"2024-09-12T01:11:40.475498+0000","last_became_active":"2024-09-12T00:12:46.063423+0000","last_became_peered":"2024-09-12T00:12:46.063423+0000","last_unstale":"2024-09-12T01:11:40.475498+0000","last_undegraded":"2024-09-12T01:11:40.475498+0000","last_fullsized":"2024-09-12T01:11:40.475498+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'140","last_scrub_stamp":"2024-09-12T01:11:40.475408+0000","last_deep_scrub":"263'140","last_deep_scrub_stamp":"2024-09-12T01:11:40.475408+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.475408+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:53.336911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":252,"num_write":335,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'151","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.153506+0000","last_change":"2024-09-12T01:11:08.153506+0000","last_active":"2024-09-12T01:11:08.153506+0000","last_peered":"2024-09-12T01:11:08.153506+0000","last_clean":"2024-09-12T01:11:08.153506+0000","last_became_active":"2024-09-12T00:12:38.041665+0000","last_became_peered":"2024-09-12T00:12:38.041665+0000","last_unstale":"2024-09-12T01:11:08.153506+0000","last_undegraded":"2024-09-12T01:11:08.153506+0000","last_fullsized":"2024-09-12T01:11:08.153506+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-12T01:11:08.153413+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-12T01:11:08.153413+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.153413+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:15.216054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":652,"num_read_kb":531,"num_write":244,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'302","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.351636+0000","last_change":"2024-09-12T01:11:14.351574+0000","last_active":"2024-09-12T01:11:14.351636+0000","last_peered":"2024-09-12T01:11:14.351636+0000","last_clean":"2024-09-12T01:11:14.351636+0000","last_became_active":"2024-09-12T00:13:07.152470+0000","last_became_peered":"2024-09-12T00:13:07.152470+0000","last_unstale":"2024-09-12T01:11:14.351636+0000","last_undegraded":"2024-09-12T01:11:14.351636+0000","last_fullsized":"2024-09-12T01:11:14.351636+0000","mapping_epoch":40,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-12T01:11:14.351438+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-12T01:11:14.351438+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.351438+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:06.001614+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5098973,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":439,"num_read_kb":19566,"num_write":916,"num_write_kb":20485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.301017+0000","last_change":"2024-09-12T01:11:23.301017+0000","last_active":"2024-09-12T01:11:23.301017+0000","last_peered":"2024-09-12T01:11:23.301017+0000","last_clean":"2024-09-12T01:11:23.301017+0000","last_became_active":"2024-09-12T00:12:40.038618+0000","last_became_peered":"2024-09-12T00:12:40.038618+0000","last_unstale":"2024-09-12T01:11:23.301017+0000","last_undegraded":"2024-09-12T01:11:23.301017+0000","last_fullsized":"2024-09-12T01:11:23.301017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.300915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.300915+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.300915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:59.972534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'284","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.433394+0000","last_change":"2024-09-12T01:11:28.433394+0000","last_active":"2024-09-12T01:11:28.433394+0000","last_peered":"2024-09-12T01:11:28.433394+0000","last_clean":"2024-09-12T01:11:28.433394+0000","last_became_active":"2024-09-12T00:12:42.049685+0000","last_became_peered":"2024-09-12T00:12:42.049685+0000","last_unstale":"2024-09-12T01:11:28.433394+0000","last_undegraded":"2024-09-12T01:11:28.433394+0000","last_fullsized":"2024-09-12T01:11:28.433394+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'284","last_scrub_stamp":"2024-09-12T01:11:28.433284+0000","last_deep_scrub":"263'284","last_deep_scrub_stamp":"2024-09-12T01:11:28.433284+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.433284+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:24.058698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49303,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":1021,"num_write":368,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.766555+0000","last_change":"2024-09-12T01:11:24.766555+0000","last_active":"2024-09-12T01:11:24.766555+0000","last_peered":"2024-09-12T01:11:24.766555+0000","last_clean":"2024-09-12T01:11:24.766555+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:11:24.766555+0000","last_undegraded":"2024-09-12T01:11:24.766555+0000","last_fullsized":"2024-09-12T01:11:24.766555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.766460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.766460+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.766460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:23.827912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.715543+0000","last_change":"2024-09-12T01:11:30.715543+0000","last_active":"2024-09-12T01:11:30.715543+0000","last_peered":"2024-09-12T01:11:30.715543+0000","last_clean":"2024-09-12T01:11:30.715543+0000","last_became_active":"2024-09-12T00:12:46.064080+0000","last_became_peered":"2024-09-12T00:12:46.064080+0000","last_unstale":"2024-09-12T01:11:30.715543+0000","last_undegraded":"2024-09-12T01:11:30.715543+0000","last_fullsized":"2024-09-12T01:11:30.715543+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'130","last_scrub_stamp":"2024-09-12T01:11:30.715445+0000","last_deep_scrub":"263'130","last_deep_scrub_stamp":"2024-09-12T01:11:30.715445+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.715445+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:44.481368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":189,"num_write":302,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'149","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.572027+0000","last_change":"2024-09-12T01:11:12.572027+0000","last_active":"2024-09-12T01:11:12.572027+0000","last_peered":"2024-09-12T01:11:12.572027+0000","last_clean":"2024-09-12T01:11:12.572027+0000","last_became_active":"2024-09-12T00:12:38.044990+0000","last_became_peered":"2024-09-12T00:12:38.044990+0000","last_unstale":"2024-09-12T01:11:12.572027+0000","last_undegraded":"2024-09-12T01:11:12.572027+0000","last_fullsized":"2024-09-12T01:11:12.572027+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-12T01:11:12.571917+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-12T01:11:12.571917+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.571917+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:43.018147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":701,"num_read_kb":570,"num_write":228,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'340","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.110025+0000","last_change":"2024-09-12T01:11:07.110025+0000","last_active":"2024-09-12T01:11:07.110025+0000","last_peered":"2024-09-12T01:11:07.110025+0000","last_clean":"2024-09-12T01:11:07.110025+0000","last_became_active":"2024-09-12T00:12:36.034816+0000","last_became_peered":"2024-09-12T00:12:36.034816+0000","last_unstale":"2024-09-12T01:11:07.110025+0000","last_undegraded":"2024-09-12T01:11:07.110025+0000","last_fullsized":"2024-09-12T01:11:07.110025+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:11:07.109934+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:11:07.109934+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.109934+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:11.045354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":1836,"num_write":1158,"num_write_kb":16367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.568944+0000","last_change":"2024-09-12T01:11:30.568944+0000","last_active":"2024-09-12T01:11:30.568944+0000","last_peered":"2024-09-12T01:11:30.568944+0000","last_clean":"2024-09-12T01:11:30.568944+0000","last_became_active":"2024-09-12T00:12:40.042104+0000","last_became_peered":"2024-09-12T00:12:40.042104+0000","last_unstale":"2024-09-12T01:11:30.568944+0000","last_undegraded":"2024-09-12T01:11:30.568944+0000","last_fullsized":"2024-09-12T01:11:30.568944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:30.568846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:30.568846+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.568846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:43.355533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'58","reported_seq":569,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.597786+0000","last_change":"2024-09-12T01:11:29.597786+0000","last_active":"2024-09-12T01:11:29.597786+0000","last_peered":"2024-09-12T01:11:29.597786+0000","last_clean":"2024-09-12T01:11:29.597786+0000","last_became_active":"2024-09-12T00:12:42.043599+0000","last_became_peered":"2024-09-12T00:12:42.043599+0000","last_unstale":"2024-09-12T01:11:29.597786+0000","last_undegraded":"2024-09-12T01:11:29.597786+0000","last_fullsized":"2024-09-12T01:11:29.597786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'58","last_scrub_stamp":"2024-09-12T01:11:29.597680+0000","last_deep_scrub":"263'58","last_deep_scrub_stamp":"2024-09-12T01:11:29.597680+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.597680+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:43.257209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.345992+0000","last_change":"2024-09-12T01:11:26.345992+0000","last_active":"2024-09-12T01:11:26.345992+0000","last_peered":"2024-09-12T01:11:26.345992+0000","last_clean":"2024-09-12T01:11:26.345992+0000","last_became_active":"2024-09-12T00:12:44.054145+0000","last_became_peered":"2024-09-12T00:12:44.054145+0000","last_unstale":"2024-09-12T01:11:26.345992+0000","last_undegraded":"2024-09-12T01:11:26.345992+0000","last_fullsized":"2024-09-12T01:11:26.345992+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:26.345902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:26.345902+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.345902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:27.321728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'203","reported_seq":756,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.505589+0000","last_change":"2024-09-12T01:11:38.505589+0000","last_active":"2024-09-12T01:11:38.505589+0000","last_peered":"2024-09-12T01:11:38.505589+0000","last_clean":"2024-09-12T01:11:38.505589+0000","last_became_active":"2024-09-12T00:12:46.059520+0000","last_became_peered":"2024-09-12T00:12:46.059520+0000","last_unstale":"2024-09-12T01:11:38.505589+0000","last_undegraded":"2024-09-12T01:11:38.505589+0000","last_fullsized":"2024-09-12T01:11:38.505589+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'203","last_scrub_stamp":"2024-09-12T01:11:38.505473+0000","last_deep_scrub":"263'203","last_deep_scrub_stamp":"2024-09-12T01:11:38.505473+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.505473+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:27.246093+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":406,"num_read_kb":365,"num_write":468,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'124","reported_seq":731,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.605360+0000","last_change":"2024-09-12T01:11:14.605360+0000","last_active":"2024-09-12T01:11:14.605360+0000","last_peered":"2024-09-12T01:11:14.605360+0000","last_clean":"2024-09-12T01:11:14.605360+0000","last_became_active":"2024-09-12T00:12:38.040948+0000","last_became_peered":"2024-09-12T00:12:38.040948+0000","last_unstale":"2024-09-12T01:11:14.605360+0000","last_undegraded":"2024-09-12T01:11:14.605360+0000","last_fullsized":"2024-09-12T01:11:14.605360+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'124","last_scrub_stamp":"2024-09-12T01:11:14.605261+0000","last_deep_scrub":"263'124","last_deep_scrub_stamp":"2024-09-12T01:11:14.605261+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.605261+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:12.209675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":483,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'334","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.165772+0000","last_change":"2024-09-12T01:11:12.165772+0000","last_active":"2024-09-12T01:11:12.165772+0000","last_peered":"2024-09-12T01:11:12.165772+0000","last_clean":"2024-09-12T01:11:12.165772+0000","last_became_active":"2024-09-12T00:12:36.038823+0000","last_became_peered":"2024-09-12T00:12:36.038823+0000","last_unstale":"2024-09-12T01:11:12.165772+0000","last_undegraded":"2024-09-12T01:11:12.165772+0000","last_fullsized":"2024-09-12T01:11:12.165772+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'334","last_scrub_stamp":"2024-09-12T01:11:12.165636+0000","last_deep_scrub":"263'334","last_deep_scrub_stamp":"2024-09-12T01:11:12.165636+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.165636+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:57.769236+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364565,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":548,"num_read_kb":31576,"num_write":1085,"num_write_kb":24420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.176056+0000","last_change":"2024-09-12T01:11:13.176056+0000","last_active":"2024-09-12T01:11:13.176056+0000","last_peered":"2024-09-12T01:11:13.176056+0000","last_clean":"2024-09-12T01:11:13.176056+0000","last_became_active":"2024-09-12T00:12:40.030447+0000","last_became_peered":"2024-09-12T00:12:40.030447+0000","last_unstale":"2024-09-12T01:11:13.176056+0000","last_undegraded":"2024-09-12T01:11:13.176056+0000","last_fullsized":"2024-09-12T01:11:13.176056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:13.175928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:13.175928+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.175928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:21.328720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'333","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.686772+0000","last_change":"2024-09-12T01:11:21.686772+0000","last_active":"2024-09-12T01:11:21.686772+0000","last_peered":"2024-09-12T01:11:21.686772+0000","last_clean":"2024-09-12T01:11:21.686772+0000","last_became_active":"2024-09-12T00:12:42.050885+0000","last_became_peered":"2024-09-12T00:12:42.050885+0000","last_unstale":"2024-09-12T01:11:21.686772+0000","last_undegraded":"2024-09-12T01:11:21.686772+0000","last_fullsized":"2024-09-12T01:11:21.686772+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-09-12T01:11:21.686676+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-09-12T01:11:21.686676+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.686676+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:09.163305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52758,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":1216,"num_write":438,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.340453+0000","last_change":"2024-09-12T01:11:26.340453+0000","last_active":"2024-09-12T01:11:26.340453+0000","last_peered":"2024-09-12T01:11:26.340453+0000","last_clean":"2024-09-12T01:11:26.340453+0000","last_became_active":"2024-09-12T00:12:44.056032+0000","last_became_peered":"2024-09-12T00:12:44.056032+0000","last_unstale":"2024-09-12T01:11:26.340453+0000","last_undegraded":"2024-09-12T01:11:26.340453+0000","last_fullsized":"2024-09-12T01:11:26.340453+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:26.340260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:26.340260+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.340260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:13.793288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'122","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.575779+0000","last_change":"2024-09-12T01:11:50.575779+0000","last_active":"2024-09-12T01:11:50.575779+0000","last_peered":"2024-09-12T01:11:50.575779+0000","last_clean":"2024-09-12T01:11:50.575779+0000","last_became_active":"2024-09-12T00:12:46.063700+0000","last_became_peered":"2024-09-12T00:12:46.063700+0000","last_unstale":"2024-09-12T01:11:50.575779+0000","last_undegraded":"2024-09-12T01:11:50.575779+0000","last_fullsized":"2024-09-12T01:11:50.575779+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'122","last_scrub_stamp":"2024-09-12T01:11:50.575688+0000","last_deep_scrub":"263'122","last_deep_scrub_stamp":"2024-09-12T01:11:50.575688+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.575688+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:10.022175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'4185","reported_seq":4818,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.690012+0000","last_change":"2024-09-12T01:11:12.690012+0000","last_active":"2024-09-12T01:11:12.690012+0000","last_peered":"2024-09-12T01:11:12.690012+0000","last_clean":"2024-09-12T01:11:12.690012+0000","last_became_active":"2024-09-12T00:12:38.042680+0000","last_became_peered":"2024-09-12T00:12:38.042680+0000","last_unstale":"2024-09-12T01:11:12.690012+0000","last_undegraded":"2024-09-12T01:11:12.690012+0000","last_fullsized":"2024-09-12T01:11:12.690012+0000","mapping_epoch":29,"log_start":"263'4100","ondisk_log_start":"263'4100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4185","last_scrub_stamp":"2024-09-12T01:11:12.689931+0000","last_deep_scrub":"263'4185","last_deep_scrub_stamp":"2024-09-12T01:11:12.689931+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.689931+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":3000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:16.576940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16870,"num_read_kb":14146,"num_write":6296,"num_write_kb":3134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'370","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.630088+0000","last_change":"2024-09-12T01:11:07.630088+0000","last_active":"2024-09-12T01:11:07.630088+0000","last_peered":"2024-09-12T01:11:07.630088+0000","last_clean":"2024-09-12T01:11:07.630088+0000","last_became_active":"2024-09-12T00:12:36.034292+0000","last_became_peered":"2024-09-12T00:12:36.034292+0000","last_unstale":"2024-09-12T01:11:07.630088+0000","last_undegraded":"2024-09-12T01:11:07.630088+0000","last_fullsized":"2024-09-12T01:11:07.630088+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-12T01:11:07.629972+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-12T01:11:07.629972+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.629972+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:32.054059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":3622,"num_write":1273,"num_write_kb":13483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.404602+0000","last_change":"2024-09-12T01:11:32.404602+0000","last_active":"2024-09-12T01:11:32.404602+0000","last_peered":"2024-09-12T01:11:32.404602+0000","last_clean":"2024-09-12T01:11:32.404602+0000","last_became_active":"2024-09-12T00:12:40.038192+0000","last_became_peered":"2024-09-12T00:12:40.038192+0000","last_unstale":"2024-09-12T01:11:32.404602+0000","last_undegraded":"2024-09-12T01:11:32.404602+0000","last_fullsized":"2024-09-12T01:11:32.404602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.404520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.404520+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.404520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:48.812439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'260","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.170941+0000","last_change":"2024-09-12T01:11:24.170941+0000","last_active":"2024-09-12T01:11:24.170941+0000","last_peered":"2024-09-12T01:11:24.170941+0000","last_clean":"2024-09-12T01:11:24.170941+0000","last_became_active":"2024-09-12T00:12:42.046589+0000","last_became_peered":"2024-09-12T00:12:42.046589+0000","last_unstale":"2024-09-12T01:11:24.170941+0000","last_undegraded":"2024-09-12T01:11:24.170941+0000","last_fullsized":"2024-09-12T01:11:24.170941+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-12T01:11:24.170844+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-12T01:11:24.170844+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.170844+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:16.778753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53508,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":1009,"num_write":352,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.787965+0000","last_change":"2024-09-12T01:11:26.787965+0000","last_active":"2024-09-12T01:11:26.787965+0000","last_peered":"2024-09-12T01:11:26.787965+0000","last_clean":"2024-09-12T01:11:26.787965+0000","last_became_active":"2024-09-12T00:12:44.057606+0000","last_became_peered":"2024-09-12T00:12:44.057606+0000","last_unstale":"2024-09-12T01:11:26.787965+0000","last_undegraded":"2024-09-12T01:11:26.787965+0000","last_fullsized":"2024-09-12T01:11:26.787965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:26.787877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:26.787877+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.787877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:01.737176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'180","reported_seq":742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.340966+0000","last_change":"2024-09-12T01:11:24.340966+0000","last_active":"2024-09-12T01:11:24.340966+0000","last_peered":"2024-09-12T01:11:24.340966+0000","last_clean":"2024-09-12T01:11:24.340966+0000","last_became_active":"2024-09-12T00:12:38.047545+0000","last_became_peered":"2024-09-12T00:12:38.047545+0000","last_unstale":"2024-09-12T01:11:24.340966+0000","last_undegraded":"2024-09-12T01:11:24.340966+0000","last_fullsized":"2024-09-12T01:11:24.340966+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-12T01:11:24.340882+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-12T01:11:24.340882+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.340882+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:15.550214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":815,"num_read_kb":702,"num_write":306,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'317","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.679385+0000","last_change":"2024-09-12T01:11:08.679385+0000","last_active":"2024-09-12T01:11:08.679385+0000","last_peered":"2024-09-12T01:11:08.679385+0000","last_clean":"2024-09-12T01:11:08.679385+0000","last_became_active":"2024-09-12T00:12:36.042983+0000","last_became_peered":"2024-09-12T00:12:36.042983+0000","last_unstale":"2024-09-12T01:11:08.679385+0000","last_undegraded":"2024-09-12T01:11:08.679385+0000","last_fullsized":"2024-09-12T01:11:08.679385+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:11:08.679268+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:11:08.679268+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.679268+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:45.909644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":13747,"num_write":1048,"num_write_kb":22365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.334807+0000","last_change":"2024-09-12T01:11:24.334807+0000","last_active":"2024-09-12T01:11:24.334807+0000","last_peered":"2024-09-12T01:11:24.334807+0000","last_clean":"2024-09-12T01:11:24.334807+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:11:24.334807+0000","last_undegraded":"2024-09-12T01:11:24.334807+0000","last_fullsized":"2024-09-12T01:11:24.334807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.334703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.334703+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.334703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:33.166392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'505","reported_seq":1144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.404493+0000","last_change":"2024-09-12T01:11:30.404493+0000","last_active":"2024-09-12T01:11:30.404493+0000","last_peered":"2024-09-12T01:11:30.404493+0000","last_clean":"2024-09-12T01:11:30.404493+0000","last_became_active":"2024-09-12T00:12:42.050479+0000","last_became_peered":"2024-09-12T00:12:42.050479+0000","last_unstale":"2024-09-12T01:11:30.404493+0000","last_undegraded":"2024-09-12T01:11:30.404493+0000","last_fullsized":"2024-09-12T01:11:30.404493+0000","mapping_epoch":33,"log_start":"263'400","ondisk_log_start":"263'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'505","last_scrub_stamp":"2024-09-12T01:11:30.404398+0000","last_deep_scrub":"263'505","last_deep_scrub_stamp":"2024-09-12T01:11:30.404398+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.404398+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:15.855952+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104580,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":898,"num_read_kb":2161,"num_write":774,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.370979+0000","last_change":"2024-09-12T01:11:27.370979+0000","last_active":"2024-09-12T01:11:27.370979+0000","last_peered":"2024-09-12T01:11:27.370979+0000","last_clean":"2024-09-12T01:11:27.370979+0000","last_became_active":"2024-09-12T00:12:44.061554+0000","last_became_peered":"2024-09-12T00:12:44.061554+0000","last_unstale":"2024-09-12T01:11:27.370979+0000","last_undegraded":"2024-09-12T01:11:27.370979+0000","last_fullsized":"2024-09-12T01:11:27.370979+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:27.370911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:27.370911+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.370911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:02.996936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'162","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.799614+0000","last_change":"2024-09-12T01:11:41.799614+0000","last_active":"2024-09-12T01:11:41.799614+0000","last_peered":"2024-09-12T01:11:41.799614+0000","last_clean":"2024-09-12T01:11:41.799614+0000","last_became_active":"2024-09-12T00:12:46.061727+0000","last_became_peered":"2024-09-12T00:12:46.061727+0000","last_unstale":"2024-09-12T01:11:41.799614+0000","last_undegraded":"2024-09-12T01:11:41.799614+0000","last_fullsized":"2024-09-12T01:11:41.799614+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-12T01:11:41.799508+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-12T01:11:41.799508+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.799508+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:59.525506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":216,"num_write":366,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'66","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.498922+0000","last_change":"2024-09-12T01:11:17.498922+0000","last_active":"2024-09-12T01:11:17.498922+0000","last_peered":"2024-09-12T01:11:17.498922+0000","last_clean":"2024-09-12T01:11:17.498922+0000","last_became_active":"2024-09-12T00:12:38.040282+0000","last_became_peered":"2024-09-12T00:12:38.040282+0000","last_unstale":"2024-09-12T01:11:17.498922+0000","last_undegraded":"2024-09-12T01:11:17.498922+0000","last_fullsized":"2024-09-12T01:11:17.498922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'66","last_scrub_stamp":"2024-09-12T01:11:17.498837+0000","last_deep_scrub":"263'66","last_deep_scrub_stamp":"2024-09-12T01:11:17.498837+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.498837+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:53.294116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":276,"num_write":85,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'343","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.589598+0000","last_change":"2024-09-12T01:11:09.589598+0000","last_active":"2024-09-12T01:11:09.589598+0000","last_peered":"2024-09-12T01:11:09.589598+0000","last_clean":"2024-09-12T01:11:09.589598+0000","last_became_active":"2024-09-12T00:12:36.031081+0000","last_became_peered":"2024-09-12T00:12:36.031081+0000","last_unstale":"2024-09-12T01:11:09.589598+0000","last_undegraded":"2024-09-12T01:11:09.589598+0000","last_fullsized":"2024-09-12T01:11:09.589598+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-12T01:11:09.589432+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-12T01:11:09.589432+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.589432+0000","objects_scrubbed":11,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:48.973187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069231,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":617,"num_read_kb":88557,"num_write":1073,"num_write_kb":46090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.376897+0000","last_change":"2024-09-12T01:11:24.376897+0000","last_active":"2024-09-12T01:11:24.376897+0000","last_peered":"2024-09-12T01:11:24.376897+0000","last_clean":"2024-09-12T01:11:24.376897+0000","last_became_active":"2024-09-12T00:12:40.036842+0000","last_became_peered":"2024-09-12T00:12:40.036842+0000","last_unstale":"2024-09-12T01:11:24.376897+0000","last_undegraded":"2024-09-12T01:11:24.376897+0000","last_fullsized":"2024-09-12T01:11:24.376897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.376783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.376783+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.376783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:02.847925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'307","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.478845+0000","last_change":"2024-09-12T01:11:39.478845+0000","last_active":"2024-09-12T01:11:39.478845+0000","last_peered":"2024-09-12T01:11:39.478845+0000","last_clean":"2024-09-12T01:11:39.478845+0000","last_became_active":"2024-09-12T00:12:42.043681+0000","last_became_peered":"2024-09-12T00:12:42.043681+0000","last_unstale":"2024-09-12T01:11:39.478845+0000","last_undegraded":"2024-09-12T01:11:39.478845+0000","last_fullsized":"2024-09-12T01:11:39.478845+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-12T01:11:39.478715+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-12T01:11:39.478715+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.478715+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:09.605344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58226,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":1067,"num_write":414,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.847108+0000","last_change":"2024-09-12T01:11:36.847108+0000","last_active":"2024-09-12T01:11:36.847108+0000","last_peered":"2024-09-12T01:11:36.847108+0000","last_clean":"2024-09-12T01:11:36.847108+0000","last_became_active":"2024-09-12T00:12:44.058542+0000","last_became_peered":"2024-09-12T00:12:44.058542+0000","last_unstale":"2024-09-12T01:11:36.847108+0000","last_undegraded":"2024-09-12T01:11:36.847108+0000","last_fullsized":"2024-09-12T01:11:36.847108+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:36.847002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:36.847002+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.847002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:24.866169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'196","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.526679+0000","last_change":"2024-09-12T01:11:48.526679+0000","last_active":"2024-09-12T01:11:48.526679+0000","last_peered":"2024-09-12T01:11:48.526679+0000","last_clean":"2024-09-12T01:11:48.526679+0000","last_became_active":"2024-09-12T00:12:46.062957+0000","last_became_peered":"2024-09-12T00:12:46.062957+0000","last_unstale":"2024-09-12T01:11:48.526679+0000","last_undegraded":"2024-09-12T01:11:48.526679+0000","last_fullsized":"2024-09-12T01:11:48.526679+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-12T01:11:48.526571+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-12T01:11:48.526571+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.526571+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:55.997627+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":323,"num_read_kb":295,"num_write":565,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'204","reported_seq":797,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.716388+0000","last_change":"2024-09-12T01:11:13.716388+0000","last_active":"2024-09-12T01:11:13.716388+0000","last_peered":"2024-09-12T01:11:13.716388+0000","last_clean":"2024-09-12T01:11:13.716388+0000","last_became_active":"2024-09-12T00:12:38.045576+0000","last_became_peered":"2024-09-12T00:12:38.045576+0000","last_unstale":"2024-09-12T01:11:13.716388+0000","last_undegraded":"2024-09-12T01:11:13.716388+0000","last_fullsized":"2024-09-12T01:11:13.716388+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'204","last_scrub_stamp":"2024-09-12T01:11:13.716299+0000","last_deep_scrub":"263'204","last_deep_scrub_stamp":"2024-09-12T01:11:13.716299+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.716299+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.905678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":691,"num_write":313,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'353","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.259922+0000","last_change":"2024-09-12T01:11:06.259922+0000","last_active":"2024-09-12T01:11:06.259922+0000","last_peered":"2024-09-12T01:11:06.259922+0000","last_clean":"2024-09-12T01:11:06.259922+0000","last_became_active":"2024-09-12T00:12:36.036446+0000","last_became_peered":"2024-09-12T00:12:36.036446+0000","last_unstale":"2024-09-12T01:11:06.259922+0000","last_undegraded":"2024-09-12T01:11:06.259922+0000","last_fullsized":"2024-09-12T01:11:06.259922+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-12T01:11:06.259787+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-12T01:11:06.259787+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.259787+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:04.148146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434692,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":621,"num_read_kb":64541,"num_write":1186,"num_write_kb":11770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.216836+0000","last_change":"2024-09-12T01:11:19.216836+0000","last_active":"2024-09-12T01:11:19.216836+0000","last_peered":"2024-09-12T01:11:19.216836+0000","last_clean":"2024-09-12T01:11:19.216836+0000","last_became_active":"2024-09-12T00:12:40.029908+0000","last_became_peered":"2024-09-12T00:12:40.029908+0000","last_unstale":"2024-09-12T01:11:19.216836+0000","last_undegraded":"2024-09-12T01:11:19.216836+0000","last_fullsized":"2024-09-12T01:11:19.216836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.216748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.216748+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.216748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:17.680930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'285","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.418321+0000","last_change":"2024-09-12T01:11:29.418321+0000","last_active":"2024-09-12T01:11:29.418321+0000","last_peered":"2024-09-12T01:11:29.418321+0000","last_clean":"2024-09-12T01:11:29.418321+0000","last_became_active":"2024-09-12T00:12:42.050599+0000","last_became_peered":"2024-09-12T00:12:42.050599+0000","last_unstale":"2024-09-12T01:11:29.418321+0000","last_undegraded":"2024-09-12T01:11:29.418321+0000","last_fullsized":"2024-09-12T01:11:29.418321+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'285","last_scrub_stamp":"2024-09-12T01:11:29.418200+0000","last_deep_scrub":"263'285","last_deep_scrub_stamp":"2024-09-12T01:11:29.418200+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.418200+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:15.849823+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50970,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":947,"num_write":354,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.758688+0000","last_change":"2024-09-12T01:11:29.758688+0000","last_active":"2024-09-12T01:11:29.758688+0000","last_peered":"2024-09-12T01:11:29.758688+0000","last_clean":"2024-09-12T01:11:29.758688+0000","last_became_active":"2024-09-12T00:12:44.062419+0000","last_became_peered":"2024-09-12T00:12:44.062419+0000","last_unstale":"2024-09-12T01:11:29.758688+0000","last_undegraded":"2024-09-12T01:11:29.758688+0000","last_fullsized":"2024-09-12T01:11:29.758688+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:29.758599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:29.758599+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.758599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:16.151040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'187","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.475820+0000","last_change":"2024-09-12T01:11:47.475820+0000","last_active":"2024-09-12T01:11:47.475820+0000","last_peered":"2024-09-12T01:11:47.475820+0000","last_clean":"2024-09-12T01:11:47.475820+0000","last_became_active":"2024-09-12T00:12:46.066977+0000","last_became_peered":"2024-09-12T00:12:46.066977+0000","last_unstale":"2024-09-12T01:11:47.475820+0000","last_undegraded":"2024-09-12T01:11:47.475820+0000","last_fullsized":"2024-09-12T01:11:47.475820+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'187","last_scrub_stamp":"2024-09-12T01:11:47.475736+0000","last_deep_scrub":"263'187","last_deep_scrub_stamp":"2024-09-12T01:11:47.475736+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.475736+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:45.016824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":141,"num_write":422,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'58","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.539314+0000","last_change":"2024-09-12T01:11:16.539314+0000","last_active":"2024-09-12T01:11:16.539314+0000","last_peered":"2024-09-12T01:11:16.539314+0000","last_clean":"2024-09-12T01:11:16.539314+0000","last_became_active":"2024-09-12T00:12:38.043886+0000","last_became_peered":"2024-09-12T00:12:38.043886+0000","last_unstale":"2024-09-12T01:11:16.539314+0000","last_undegraded":"2024-09-12T01:11:16.539314+0000","last_fullsized":"2024-09-12T01:11:16.539314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'58","last_scrub_stamp":"2024-09-12T01:11:16.539199+0000","last_deep_scrub":"263'58","last_deep_scrub_stamp":"2024-09-12T01:11:16.539199+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.539199+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:30.884432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":197,"num_write":99,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'362","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.560609+0000","last_change":"2024-09-12T01:11:11.560609+0000","last_active":"2024-09-12T01:11:11.560609+0000","last_peered":"2024-09-12T01:11:11.560609+0000","last_clean":"2024-09-12T01:11:11.560609+0000","last_became_active":"2024-09-12T00:12:36.030663+0000","last_became_peered":"2024-09-12T00:12:36.030663+0000","last_unstale":"2024-09-12T01:11:11.560609+0000","last_undegraded":"2024-09-12T01:11:11.560609+0000","last_fullsized":"2024-09-12T01:11:11.560609+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-12T01:11:11.560491+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-12T01:11:11.560491+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.560491+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:52.728704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568456,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":490,"num_read_kb":3753,"num_write":1107,"num_write_kb":36132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.615621+0000","last_change":"2024-09-12T01:11:28.615621+0000","last_active":"2024-09-12T01:11:28.615621+0000","last_peered":"2024-09-12T01:11:28.615621+0000","last_clean":"2024-09-12T01:11:28.615621+0000","last_became_active":"2024-09-12T00:12:40.040095+0000","last_became_peered":"2024-09-12T00:12:40.040095+0000","last_unstale":"2024-09-12T01:11:28.615621+0000","last_undegraded":"2024-09-12T01:11:28.615621+0000","last_fullsized":"2024-09-12T01:11:28.615621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:28.615527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:28.615527+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.615527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:29.592607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'111","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.470106+0000","last_change":"2024-09-12T01:11:40.470106+0000","last_active":"2024-09-12T01:11:40.470106+0000","last_peered":"2024-09-12T01:11:40.470106+0000","last_clean":"2024-09-12T01:11:40.470106+0000","last_became_active":"2024-09-12T00:12:42.043492+0000","last_became_peered":"2024-09-12T00:12:42.043492+0000","last_unstale":"2024-09-12T01:11:40.470106+0000","last_undegraded":"2024-09-12T01:11:40.470106+0000","last_fullsized":"2024-09-12T01:11:40.470106+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:11:40.470000+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:11:40.470000+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.470000+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:16.144396+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":110,"num_read_kb":100,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'767","reported_seq":2185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.158682+0000","last_change":"2024-09-12T01:11:28.158682+0000","last_active":"2024-09-12T01:11:28.158682+0000","last_peered":"2024-09-12T01:11:28.158682+0000","last_clean":"2024-09-12T01:11:28.158682+0000","last_became_active":"2024-09-12T00:12:44.054237+0000","last_became_peered":"2024-09-12T00:12:44.054237+0000","last_unstale":"2024-09-12T01:11:28.158682+0000","last_undegraded":"2024-09-12T01:11:28.158682+0000","last_fullsized":"2024-09-12T01:11:28.158682+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'767","last_scrub_stamp":"2024-09-12T01:11:28.158604+0000","last_deep_scrub":"263'767","last_deep_scrub_stamp":"2024-09-12T01:11:28.158604+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.158604+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:33.126576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'121","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.499140+0000","last_change":"2024-09-12T01:11:46.499140+0000","last_active":"2024-09-12T01:11:46.499140+0000","last_peered":"2024-09-12T01:11:46.499140+0000","last_clean":"2024-09-12T01:11:46.499140+0000","last_became_active":"2024-09-12T00:12:46.061673+0000","last_became_peered":"2024-09-12T00:12:46.061673+0000","last_unstale":"2024-09-12T01:11:46.499140+0000","last_undegraded":"2024-09-12T01:11:46.499140+0000","last_fullsized":"2024-09-12T01:11:46.499140+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'121","last_scrub_stamp":"2024-09-12T01:11:46.499045+0000","last_deep_scrub":"263'121","last_deep_scrub_stamp":"2024-09-12T01:11:46.499045+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.499045+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:09.956437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'432","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.146134+0000","last_change":"2024-09-12T01:11:11.146134+0000","last_active":"2024-09-12T01:11:11.146134+0000","last_peered":"2024-09-12T01:11:11.146134+0000","last_clean":"2024-09-12T01:11:11.146134+0000","last_became_active":"2024-09-12T00:12:38.029483+0000","last_became_peered":"2024-09-12T00:12:38.029483+0000","last_unstale":"2024-09-12T01:11:11.146134+0000","last_undegraded":"2024-09-12T01:11:11.146134+0000","last_fullsized":"2024-09-12T01:11:11.146134+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'432","last_scrub_stamp":"2024-09-12T01:11:11.146047+0000","last_deep_scrub":"263'432","last_deep_scrub_stamp":"2024-09-12T01:11:11.146047+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.146047+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:10.366652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1848,"num_read_kb":1460,"num_write":651,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'351","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.306677+0000","last_change":"2024-09-12T01:11:07.306677+0000","last_active":"2024-09-12T01:11:07.306677+0000","last_peered":"2024-09-12T01:11:07.306677+0000","last_clean":"2024-09-12T01:11:07.306677+0000","last_became_active":"2024-09-12T00:12:36.034259+0000","last_became_peered":"2024-09-12T00:12:36.034259+0000","last_unstale":"2024-09-12T01:11:07.306677+0000","last_undegraded":"2024-09-12T01:11:07.306677+0000","last_fullsized":"2024-09-12T01:11:07.306677+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-12T01:11:07.306592+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-12T01:11:07.306592+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.306592+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:20.789146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":12694,"num_write":1067,"num_write_kb":34924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.297481+0000","last_change":"2024-09-12T01:11:22.297481+0000","last_active":"2024-09-12T01:11:22.297481+0000","last_peered":"2024-09-12T01:11:22.297481+0000","last_clean":"2024-09-12T01:11:22.297481+0000","last_became_active":"2024-09-12T00:12:40.034301+0000","last_became_peered":"2024-09-12T00:12:40.034301+0000","last_unstale":"2024-09-12T01:11:22.297481+0000","last_undegraded":"2024-09-12T01:11:22.297481+0000","last_fullsized":"2024-09-12T01:11:22.297481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:22.297390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:22.297390+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.297390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:58.221125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'377","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.191166+0000","last_change":"2024-09-12T01:11:27.191166+0000","last_active":"2024-09-12T01:11:27.191166+0000","last_peered":"2024-09-12T01:11:27.191166+0000","last_clean":"2024-09-12T01:11:27.191166+0000","last_became_active":"2024-09-12T00:12:42.044154+0000","last_became_peered":"2024-09-12T00:12:42.044154+0000","last_unstale":"2024-09-12T01:11:27.191166+0000","last_undegraded":"2024-09-12T01:11:27.191166+0000","last_fullsized":"2024-09-12T01:11:27.191166+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:11:27.191086+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:11:27.191086+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.191086+0000","objects_scrubbed":11,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:48.409343+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51621,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":561,"num_read_kb":1137,"num_write":454,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.441564+0000","last_change":"2024-09-12T01:11:38.441564+0000","last_active":"2024-09-12T01:11:38.441564+0000","last_peered":"2024-09-12T01:11:38.441564+0000","last_clean":"2024-09-12T01:11:38.441564+0000","last_became_active":"2024-09-12T00:12:44.059671+0000","last_became_peered":"2024-09-12T00:12:44.059671+0000","last_unstale":"2024-09-12T01:11:38.441564+0000","last_undegraded":"2024-09-12T01:11:38.441564+0000","last_fullsized":"2024-09-12T01:11:38.441564+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:38.441478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:38.441478+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.441478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:08.764517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'129","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.342103+0000","last_change":"2024-09-12T01:11:37.342103+0000","last_active":"2024-09-12T01:11:37.342103+0000","last_peered":"2024-09-12T01:11:37.342103+0000","last_clean":"2024-09-12T01:11:37.342103+0000","last_became_active":"2024-09-12T00:12:46.066777+0000","last_became_peered":"2024-09-12T00:12:46.066777+0000","last_unstale":"2024-09-12T01:11:37.342103+0000","last_undegraded":"2024-09-12T01:11:37.342103+0000","last_fullsized":"2024-09-12T01:11:37.342103+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'129","last_scrub_stamp":"2024-09-12T01:11:37.342010+0000","last_deep_scrub":"263'129","last_deep_scrub_stamp":"2024-09-12T01:11:37.342010+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.342010+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:03.914878+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":239,"num_read_kb":208,"num_write":345,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'510","reported_seq":1334,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.229612+0000","last_change":"2024-09-12T01:11:20.229612+0000","last_active":"2024-09-12T01:11:20.229612+0000","last_peered":"2024-09-12T01:11:20.229612+0000","last_clean":"2024-09-12T01:11:20.229612+0000","last_became_active":"2024-09-12T00:12:38.039996+0000","last_became_peered":"2024-09-12T00:12:38.039996+0000","last_unstale":"2024-09-12T01:11:20.229612+0000","last_undegraded":"2024-09-12T01:11:20.229612+0000","last_fullsized":"2024-09-12T01:11:20.229612+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'510","last_scrub_stamp":"2024-09-12T01:11:20.229511+0000","last_deep_scrub":"263'510","last_deep_scrub_stamp":"2024-09-12T01:11:20.229511+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.229511+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:21.104034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2706,"num_read_kb":2334,"num_write":934,"num_write_kb":583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'299","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.366645+0000","last_change":"2024-09-12T01:11:15.366645+0000","last_active":"2024-09-12T01:11:15.366645+0000","last_peered":"2024-09-12T01:11:15.366645+0000","last_clean":"2024-09-12T01:11:15.366645+0000","last_became_active":"2024-09-12T00:12:36.029998+0000","last_became_peered":"2024-09-12T00:12:36.029998+0000","last_unstale":"2024-09-12T01:11:15.366645+0000","last_undegraded":"2024-09-12T01:11:15.366645+0000","last_fullsized":"2024-09-12T01:11:15.366645+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'299","last_scrub_stamp":"2024-09-12T01:11:15.366509+0000","last_deep_scrub":"263'299","last_deep_scrub_stamp":"2024-09-12T01:11:15.366509+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.366509+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:09.932286+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":565,"num_read_kb":3980,"num_write":924,"num_write_kb":28798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.218749+0000","last_change":"2024-09-12T01:11:14.218749+0000","last_active":"2024-09-12T01:11:14.218749+0000","last_peered":"2024-09-12T01:11:14.218749+0000","last_clean":"2024-09-12T01:11:14.218749+0000","last_became_active":"2024-09-12T00:12:40.038037+0000","last_became_peered":"2024-09-12T00:12:40.038037+0000","last_unstale":"2024-09-12T01:11:14.218749+0000","last_undegraded":"2024-09-12T01:11:14.218749+0000","last_fullsized":"2024-09-12T01:11:14.218749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:14.218626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:14.218626+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.218626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:01.985443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'289","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.511035+0000","last_change":"2024-09-12T01:11:34.511035+0000","last_active":"2024-09-12T01:11:34.511035+0000","last_peered":"2024-09-12T01:11:34.511035+0000","last_clean":"2024-09-12T01:11:34.511035+0000","last_became_active":"2024-09-12T00:12:42.046917+0000","last_became_peered":"2024-09-12T00:12:42.046917+0000","last_unstale":"2024-09-12T01:11:34.511035+0000","last_undegraded":"2024-09-12T01:11:34.511035+0000","last_fullsized":"2024-09-12T01:11:34.511035+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-12T01:11:34.510930+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-12T01:11:34.510930+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.510930+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:04.641400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46808,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1160,"num_write":400,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.504840+0000","last_change":"2024-09-12T01:11:44.504840+0000","last_active":"2024-09-12T01:11:44.504840+0000","last_peered":"2024-09-12T01:11:44.504840+0000","last_clean":"2024-09-12T01:11:44.504840+0000","last_became_active":"2024-09-12T00:12:44.058006+0000","last_became_peered":"2024-09-12T00:12:44.058006+0000","last_unstale":"2024-09-12T01:11:44.504840+0000","last_undegraded":"2024-09-12T01:11:44.504840+0000","last_fullsized":"2024-09-12T01:11:44.504840+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.504724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.504724+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.504724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:49.277866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'118","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.802023+0000","last_change":"2024-09-12T01:11:42.802023+0000","last_active":"2024-09-12T01:11:42.802023+0000","last_peered":"2024-09-12T01:11:42.802023+0000","last_clean":"2024-09-12T01:11:42.802023+0000","last_became_active":"2024-09-12T00:12:46.064988+0000","last_became_peered":"2024-09-12T00:12:46.064988+0000","last_unstale":"2024-09-12T01:11:42.802023+0000","last_undegraded":"2024-09-12T01:11:42.802023+0000","last_fullsized":"2024-09-12T01:11:42.802023+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'118","last_scrub_stamp":"2024-09-12T01:11:42.801931+0000","last_deep_scrub":"263'118","last_deep_scrub_stamp":"2024-09-12T01:11:42.801931+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.801931+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:37.541718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":147,"num_write":261,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'320","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.738849+0000","last_change":"2024-09-12T01:11:11.738849+0000","last_active":"2024-09-12T01:11:11.738849+0000","last_peered":"2024-09-12T01:11:11.738849+0000","last_clean":"2024-09-12T01:11:11.738849+0000","last_became_active":"2024-09-12T00:12:38.042565+0000","last_became_peered":"2024-09-12T00:12:38.042565+0000","last_unstale":"2024-09-12T01:11:11.738849+0000","last_undegraded":"2024-09-12T01:11:11.738849+0000","last_fullsized":"2024-09-12T01:11:11.738849+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'320","last_scrub_stamp":"2024-09-12T01:11:11.738728+0000","last_deep_scrub":"263'320","last_deep_scrub_stamp":"2024-09-12T01:11:11.738728+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.738728+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:44.363536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1481,"num_read_kb":1253,"num_write":527,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'359","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.766708+0000","last_change":"2024-09-12T01:11:10.766708+0000","last_active":"2024-09-12T01:11:10.766708+0000","last_peered":"2024-09-12T01:11:10.766708+0000","last_clean":"2024-09-12T01:11:10.766708+0000","last_became_active":"2024-09-12T00:12:36.042198+0000","last_became_peered":"2024-09-12T00:12:36.042198+0000","last_unstale":"2024-09-12T01:11:10.766708+0000","last_undegraded":"2024-09-12T01:11:10.766708+0000","last_fullsized":"2024-09-12T01:11:10.766708+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T01:11:10.766609+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T01:11:10.766609+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.766609+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:09.163241+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":61060,"num_write":1123,"num_write_kb":53442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.318368+0000","last_change":"2024-09-12T01:11:21.318368+0000","last_active":"2024-09-12T01:11:21.318368+0000","last_peered":"2024-09-12T01:11:21.318368+0000","last_clean":"2024-09-12T01:11:21.318368+0000","last_became_active":"2024-09-12T00:12:40.032284+0000","last_became_peered":"2024-09-12T00:12:40.032284+0000","last_unstale":"2024-09-12T01:11:21.318368+0000","last_undegraded":"2024-09-12T01:11:21.318368+0000","last_fullsized":"2024-09-12T01:11:21.318368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:21.318282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:21.318282+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.318282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:49.292980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'259","reported_seq":825,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.470032+0000","last_change":"2024-09-12T01:11:27.470032+0000","last_active":"2024-09-12T01:11:27.470032+0000","last_peered":"2024-09-12T01:11:27.470032+0000","last_clean":"2024-09-12T01:11:27.470032+0000","last_became_active":"2024-09-12T00:12:42.051133+0000","last_became_peered":"2024-09-12T00:12:42.051133+0000","last_unstale":"2024-09-12T01:11:27.470032+0000","last_undegraded":"2024-09-12T01:11:27.470032+0000","last_fullsized":"2024-09-12T01:11:27.470032+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'259","last_scrub_stamp":"2024-09-12T01:11:27.469938+0000","last_deep_scrub":"263'259","last_deep_scrub_stamp":"2024-09-12T01:11:27.469938+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.469938+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:48.123908+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":1053,"num_write":352,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.521628+0000","last_change":"2024-09-12T01:11:45.521628+0000","last_active":"2024-09-12T01:11:45.521628+0000","last_peered":"2024-09-12T01:11:45.521628+0000","last_clean":"2024-09-12T01:11:45.521628+0000","last_became_active":"2024-09-12T00:12:44.060464+0000","last_became_peered":"2024-09-12T00:12:44.060464+0000","last_unstale":"2024-09-12T01:11:45.521628+0000","last_undegraded":"2024-09-12T01:11:45.521628+0000","last_fullsized":"2024-09-12T01:11:45.521628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:45.521539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:45.521539+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.521539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:00.056354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'156","reported_seq":1622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.563179+0000","last_change":"2024-09-12T01:11:49.563179+0000","last_active":"2024-09-12T01:11:49.563179+0000","last_peered":"2024-09-12T01:11:49.563179+0000","last_clean":"2024-09-12T01:11:49.563179+0000","last_became_active":"2024-09-12T00:12:46.064565+0000","last_became_peered":"2024-09-12T00:12:46.064565+0000","last_unstale":"2024-09-12T01:11:49.563179+0000","last_undegraded":"2024-09-12T01:11:49.563179+0000","last_fullsized":"2024-09-12T01:11:49.563179+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'156","last_scrub_stamp":"2024-09-12T01:11:49.563087+0000","last_deep_scrub":"263'156","last_deep_scrub_stamp":"2024-09-12T01:11:49.563087+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.563087+0000","objects_scrubbed":6,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:55.465419+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1152,"num_read_kb":1150,"num_write":337,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'89","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.193008+0000","last_change":"2024-09-12T01:11:10.193008+0000","last_active":"2024-09-12T01:11:10.193008+0000","last_peered":"2024-09-12T01:11:10.193008+0000","last_clean":"2024-09-12T01:11:10.193008+0000","last_became_active":"2024-09-12T00:12:38.037860+0000","last_became_peered":"2024-09-12T00:12:38.037860+0000","last_unstale":"2024-09-12T01:11:10.193008+0000","last_undegraded":"2024-09-12T01:11:10.193008+0000","last_fullsized":"2024-09-12T01:11:10.193008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'89","last_scrub_stamp":"2024-09-12T01:11:10.192888+0000","last_deep_scrub":"263'89","last_deep_scrub_stamp":"2024-09-12T01:11:10.192888+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.192888+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:09.120774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":333,"num_write":131,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'328","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.722206+0000","last_change":"2024-09-12T01:11:09.722206+0000","last_active":"2024-09-12T01:11:09.722206+0000","last_peered":"2024-09-12T01:11:09.722206+0000","last_clean":"2024-09-12T01:11:09.722206+0000","last_became_active":"2024-09-12T00:12:36.041860+0000","last_became_peered":"2024-09-12T00:12:36.041860+0000","last_unstale":"2024-09-12T01:11:09.722206+0000","last_undegraded":"2024-09-12T01:11:09.722206+0000","last_fullsized":"2024-09-12T01:11:09.722206+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-12T01:11:09.722064+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-12T01:11:09.722064+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.722064+0000","objects_scrubbed":11,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:38.287167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3984538,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":381,"num_read_kb":7023,"num_write":999,"num_write_kb":36211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.540300+0000","last_change":"2024-09-12T01:11:25.540300+0000","last_active":"2024-09-12T01:11:25.540300+0000","last_peered":"2024-09-12T01:11:25.540300+0000","last_clean":"2024-09-12T01:11:25.540300+0000","last_became_active":"2024-09-12T00:12:40.039196+0000","last_became_peered":"2024-09-12T00:12:40.039196+0000","last_unstale":"2024-09-12T01:11:25.540300+0000","last_undegraded":"2024-09-12T01:11:25.540300+0000","last_fullsized":"2024-09-12T01:11:25.540300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:25.540213+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:25.540213+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.540213+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:01.710510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'350","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.427963+0000","last_change":"2024-09-12T01:11:38.427963+0000","last_active":"2024-09-12T01:11:38.427963+0000","last_peered":"2024-09-12T01:11:38.427963+0000","last_clean":"2024-09-12T01:11:38.427963+0000","last_became_active":"2024-09-12T00:12:42.039068+0000","last_became_peered":"2024-09-12T00:12:42.039068+0000","last_unstale":"2024-09-12T01:11:38.427963+0000","last_undegraded":"2024-09-12T01:11:38.427963+0000","last_fullsized":"2024-09-12T01:11:38.427963+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-12T01:11:38.427868+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-12T01:11:38.427868+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.427868+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:08.441782+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44473,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":544,"num_read_kb":1176,"num_write":442,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.470733+0000","last_change":"2024-09-12T01:11:37.470733+0000","last_active":"2024-09-12T01:11:37.470733+0000","last_peered":"2024-09-12T01:11:37.470733+0000","last_clean":"2024-09-12T01:11:37.470733+0000","last_became_active":"2024-09-12T00:12:44.064105+0000","last_became_peered":"2024-09-12T00:12:44.064105+0000","last_unstale":"2024-09-12T01:11:37.470733+0000","last_undegraded":"2024-09-12T01:11:37.470733+0000","last_fullsized":"2024-09-12T01:11:37.470733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:37.470646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:37.470646+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.470646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:06.703919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'151","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.191321+0000","last_change":"2024-09-12T01:11:29.191321+0000","last_active":"2024-09-12T01:11:29.191321+0000","last_peered":"2024-09-12T01:11:29.191321+0000","last_clean":"2024-09-12T01:11:29.191321+0000","last_became_active":"2024-09-12T00:12:46.053763+0000","last_became_peered":"2024-09-12T00:12:46.053763+0000","last_unstale":"2024-09-12T01:11:29.191321+0000","last_undegraded":"2024-09-12T01:11:29.191321+0000","last_fullsized":"2024-09-12T01:11:29.191321+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-12T01:11:29.191223+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-12T01:11:29.191223+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.191223+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:55.982377+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":382,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'137","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.480997+0000","last_change":"2024-09-12T01:11:18.480997+0000","last_active":"2024-09-12T01:11:18.480997+0000","last_peered":"2024-09-12T01:11:18.480997+0000","last_clean":"2024-09-12T01:11:18.480997+0000","last_became_active":"2024-09-12T00:12:38.044285+0000","last_became_peered":"2024-09-12T00:12:38.044285+0000","last_unstale":"2024-09-12T01:11:18.480997+0000","last_undegraded":"2024-09-12T01:11:18.480997+0000","last_fullsized":"2024-09-12T01:11:18.480997+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-12T01:11:18.480916+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-12T01:11:18.480916+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.480916+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:51.540635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":475,"num_write":234,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'397","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.214465+0000","last_change":"2024-09-12T01:11:05.214465+0000","last_active":"2024-09-12T01:11:05.214465+0000","last_peered":"2024-09-12T01:11:05.214465+0000","last_clean":"2024-09-12T01:11:05.214465+0000","last_became_active":"2024-09-12T00:12:36.036773+0000","last_became_peered":"2024-09-12T00:12:36.036773+0000","last_unstale":"2024-09-12T01:11:05.214465+0000","last_undegraded":"2024-09-12T01:11:05.214465+0000","last_fullsized":"2024-09-12T01:11:05.214465+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'397","last_scrub_stamp":"2024-09-12T01:11:05.214323+0000","last_deep_scrub":"263'397","last_deep_scrub_stamp":"2024-09-12T01:11:05.214323+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.214323+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:30.254016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":606,"num_read_kb":16738,"num_write":1145,"num_write_kb":32233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'47","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.706015+0000","last_change":"2024-09-12T01:11:14.706015+0000","last_active":"2024-09-12T01:11:14.706015+0000","last_peered":"2024-09-12T01:11:14.706015+0000","last_clean":"2024-09-12T01:11:14.706015+0000","last_became_active":"2024-09-12T00:12:38.036978+0000","last_became_peered":"2024-09-12T00:12:38.036978+0000","last_unstale":"2024-09-12T01:11:14.706015+0000","last_undegraded":"2024-09-12T01:11:14.706015+0000","last_fullsized":"2024-09-12T01:11:14.706015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-12T01:11:14.705925+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-12T01:11:14.705925+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.705925+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:12.824252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":60,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'331","reported_seq":968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.770480+0000","last_change":"2024-09-12T01:11:08.770480+0000","last_active":"2024-09-12T01:11:08.770480+0000","last_peered":"2024-09-12T01:11:08.770480+0000","last_clean":"2024-09-12T01:11:08.770480+0000","last_became_active":"2024-09-12T00:12:36.035112+0000","last_became_peered":"2024-09-12T00:12:36.035112+0000","last_unstale":"2024-09-12T01:11:08.770480+0000","last_undegraded":"2024-09-12T01:11:08.770480+0000","last_fullsized":"2024-09-12T01:11:08.770480+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:11:08.770383+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:11:08.770383+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.770383+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:44.676691+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":34939,"num_write":1097,"num_write_kb":28471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'137","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.387951+0000","last_change":"2024-09-12T01:11:25.387951+0000","last_active":"2024-09-12T01:11:25.387951+0000","last_peered":"2024-09-12T01:11:25.387951+0000","last_clean":"2024-09-12T01:11:25.387951+0000","last_became_active":"2024-09-12T00:12:38.040144+0000","last_became_peered":"2024-09-12T00:12:38.040144+0000","last_unstale":"2024-09-12T01:11:25.387951+0000","last_undegraded":"2024-09-12T01:11:25.387951+0000","last_fullsized":"2024-09-12T01:11:25.387951+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-12T01:11:25.387847+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-12T01:11:25.387847+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.387847+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:15.196191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":511,"num_write":216,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'319","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.411588+0000","last_change":"2024-09-12T01:11:16.411588+0000","last_active":"2024-09-12T01:11:16.411588+0000","last_peered":"2024-09-12T01:11:16.411588+0000","last_clean":"2024-09-12T01:11:16.411588+0000","last_became_active":"2024-09-12T00:12:36.035558+0000","last_became_peered":"2024-09-12T00:12:36.035558+0000","last_unstale":"2024-09-12T01:11:16.411588+0000","last_undegraded":"2024-09-12T01:11:16.411588+0000","last_fullsized":"2024-09-12T01:11:16.411588+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'319","last_scrub_stamp":"2024-09-12T01:11:16.411468+0000","last_deep_scrub":"263'319","last_deep_scrub_stamp":"2024-09-12T01:11:16.411468+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.411468+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:51.561801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287622,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":7822,"num_write":966,"num_write_kb":22426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'275","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.791183+0000","last_change":"2024-09-12T01:11:21.791183+0000","last_active":"2024-09-12T01:11:21.791183+0000","last_peered":"2024-09-12T01:11:21.791183+0000","last_clean":"2024-09-12T01:11:21.791183+0000","last_became_active":"2024-09-12T00:12:38.026109+0000","last_became_peered":"2024-09-12T00:12:38.026109+0000","last_unstale":"2024-09-12T01:11:21.791183+0000","last_undegraded":"2024-09-12T01:11:21.791183+0000","last_fullsized":"2024-09-12T01:11:21.791183+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'275","last_scrub_stamp":"2024-09-12T01:11:21.791097+0000","last_deep_scrub":"263'275","last_deep_scrub_stamp":"2024-09-12T01:11:21.791097+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.791097+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:10.158792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1270,"num_read_kb":1040,"num_write":446,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'331","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.752050+0000","last_change":"2024-09-12T01:11:11.751974+0000","last_active":"2024-09-12T01:11:11.752050+0000","last_peered":"2024-09-12T01:11:11.752050+0000","last_clean":"2024-09-12T01:11:11.752050+0000","last_became_active":"2024-09-12T00:12:36.033426+0000","last_became_peered":"2024-09-12T00:12:36.033426+0000","last_unstale":"2024-09-12T01:11:11.752050+0000","last_undegraded":"2024-09-12T01:11:11.752050+0000","last_fullsized":"2024-09-12T01:11:11.752050+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:11:11.751820+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:11:11.751820+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.751820+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:01.340846+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306676,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":19382,"num_write":951,"num_write_kb":44169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'4265","reported_seq":4917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.832554+0000","last_change":"2024-09-12T01:11:20.832554+0000","last_active":"2024-09-12T01:11:20.832554+0000","last_peered":"2024-09-12T01:11:20.832554+0000","last_clean":"2024-09-12T01:11:20.832554+0000","last_became_active":"2024-09-12T00:12:38.028401+0000","last_became_peered":"2024-09-12T00:12:38.028401+0000","last_unstale":"2024-09-12T01:11:20.832554+0000","last_undegraded":"2024-09-12T01:11:20.832554+0000","last_fullsized":"2024-09-12T01:11:20.832554+0000","mapping_epoch":29,"log_start":"263'4200","ondisk_log_start":"263'4200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4265","last_scrub_stamp":"2024-09-12T01:11:20.832469+0000","last_deep_scrub":"263'4265","last_deep_scrub_stamp":"2024-09-12T01:11:20.832469+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.832469+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":3000,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:00.963732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17227,"num_read_kb":14428,"num_write":6422,"num_write_kb":3205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'326","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.234518+0000","last_change":"2024-09-12T01:11:12.234518+0000","last_active":"2024-09-12T01:11:12.234518+0000","last_peered":"2024-09-12T01:11:12.234518+0000","last_clean":"2024-09-12T01:11:12.234518+0000","last_became_active":"2024-09-12T00:12:36.032341+0000","last_became_peered":"2024-09-12T00:12:36.032341+0000","last_unstale":"2024-09-12T01:11:12.234518+0000","last_undegraded":"2024-09-12T01:11:12.234518+0000","last_fullsized":"2024-09-12T01:11:12.234518+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-12T01:11:12.234405+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-12T01:11:12.234405+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.234405+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:58.603991+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2561198,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":66123,"num_write":1057,"num_write_kb":26739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'149","reported_seq":737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.200891+0000","last_change":"2024-09-12T01:11:15.200891+0000","last_active":"2024-09-12T01:11:15.200891+0000","last_peered":"2024-09-12T01:11:15.200891+0000","last_clean":"2024-09-12T01:11:15.200891+0000","last_became_active":"2024-09-12T00:12:38.043276+0000","last_became_peered":"2024-09-12T00:12:38.043276+0000","last_unstale":"2024-09-12T01:11:15.200891+0000","last_undegraded":"2024-09-12T01:11:15.200891+0000","last_fullsized":"2024-09-12T01:11:15.200891+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-12T01:11:15.200800+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-12T01:11:15.200800+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.200800+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:25.860652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":632,"num_read_kb":523,"num_write":222,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'311","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.295855+0000","last_change":"2024-09-12T01:11:10.295855+0000","last_active":"2024-09-12T01:11:10.295855+0000","last_peered":"2024-09-12T01:11:10.295855+0000","last_clean":"2024-09-12T01:11:10.295855+0000","last_became_active":"2024-09-12T00:12:36.029687+0000","last_became_peered":"2024-09-12T00:12:36.029687+0000","last_unstale":"2024-09-12T01:11:10.295855+0000","last_undegraded":"2024-09-12T01:11:10.295855+0000","last_fullsized":"2024-09-12T01:11:10.295855+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:11:10.295694+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:11:10.295694+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.295694+0000","objects_scrubbed":6,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:59.583411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":12036,"num_write":1041,"num_write_kb":29691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'211","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.249880+0000","last_change":"2024-09-12T01:11:19.249880+0000","last_active":"2024-09-12T01:11:19.249880+0000","last_peered":"2024-09-12T01:11:19.249880+0000","last_clean":"2024-09-12T01:11:19.249880+0000","last_became_active":"2024-09-12T00:12:38.047575+0000","last_became_peered":"2024-09-12T00:12:38.047575+0000","last_unstale":"2024-09-12T01:11:19.249880+0000","last_undegraded":"2024-09-12T01:11:19.249880+0000","last_fullsized":"2024-09-12T01:11:19.249880+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-12T01:11:19.249774+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-12T01:11:19.249774+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.249774+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:52.534231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":952,"num_read_kb":776,"num_write":336,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'364","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.216422+0000","last_change":"2024-09-12T01:11:16.216422+0000","last_active":"2024-09-12T01:11:16.216422+0000","last_peered":"2024-09-12T01:11:16.216422+0000","last_clean":"2024-09-12T01:11:16.216422+0000","last_became_active":"2024-09-12T00:12:36.043803+0000","last_became_peered":"2024-09-12T00:12:36.043803+0000","last_unstale":"2024-09-12T01:11:16.216422+0000","last_undegraded":"2024-09-12T01:11:16.216422+0000","last_fullsized":"2024-09-12T01:11:16.216422+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-12T01:11:16.216308+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-12T01:11:16.216308+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.216308+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:33.903640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":463,"num_read_kb":37298,"num_write":1152,"num_write_kb":54766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'144","reported_seq":739,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.240217+0000","last_change":"2024-09-12T01:11:12.240217+0000","last_active":"2024-09-12T01:11:12.240217+0000","last_peered":"2024-09-12T01:11:12.240217+0000","last_clean":"2024-09-12T01:11:12.240217+0000","last_became_active":"2024-09-12T00:12:38.036463+0000","last_became_peered":"2024-09-12T00:12:38.036463+0000","last_unstale":"2024-09-12T01:11:12.240217+0000","last_undegraded":"2024-09-12T01:11:12.240217+0000","last_fullsized":"2024-09-12T01:11:12.240217+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-12T01:11:12.240134+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-12T01:11:12.240134+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.240134+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:47.702270+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":509,"num_write":213,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'287","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.771144+0000","last_change":"2024-09-12T01:11:12.771144+0000","last_active":"2024-09-12T01:11:12.771144+0000","last_peered":"2024-09-12T01:11:12.771144+0000","last_clean":"2024-09-12T01:11:12.771144+0000","last_became_active":"2024-09-12T00:12:36.041392+0000","last_became_peered":"2024-09-12T00:12:36.041392+0000","last_unstale":"2024-09-12T01:11:12.771144+0000","last_undegraded":"2024-09-12T01:11:12.771144+0000","last_fullsized":"2024-09-12T01:11:12.771144+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'287","last_scrub_stamp":"2024-09-12T01:11:12.771025+0000","last_deep_scrub":"263'287","last_deep_scrub_stamp":"2024-09-12T01:11:12.771025+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.771025+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:08.477912+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992353,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":407,"num_read_kb":23602,"num_write":1012,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'134","reported_seq":762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.757265+0000","last_change":"2024-09-12T01:11:15.757265+0000","last_active":"2024-09-12T01:11:15.757265+0000","last_peered":"2024-09-12T01:11:15.757265+0000","last_clean":"2024-09-12T01:11:15.757265+0000","last_became_active":"2024-09-12T00:12:38.042584+0000","last_became_peered":"2024-09-12T00:12:38.042584+0000","last_unstale":"2024-09-12T01:11:15.757265+0000","last_undegraded":"2024-09-12T01:11:15.757265+0000","last_fullsized":"2024-09-12T01:11:15.757265+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-12T01:11:15.757170+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-12T01:11:15.757170+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.757170+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:39.681374+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":632,"num_read_kb":533,"num_write":194,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'381","reported_seq":1048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.378596+0000","last_change":"2024-09-12T01:11:17.378508+0000","last_active":"2024-09-12T01:11:17.378596+0000","last_peered":"2024-09-12T01:11:17.378596+0000","last_clean":"2024-09-12T01:11:17.378596+0000","last_became_active":"2024-09-12T00:12:36.037461+0000","last_became_peered":"2024-09-12T00:12:36.037461+0000","last_unstale":"2024-09-12T01:11:17.378596+0000","last_undegraded":"2024-09-12T01:11:17.378596+0000","last_fullsized":"2024-09-12T01:11:17.378596+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'381","last_scrub_stamp":"2024-09-12T01:11:17.378379+0000","last_deep_scrub":"263'381","last_deep_scrub_stamp":"2024-09-12T01:11:17.378379+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.378379+0000","objects_scrubbed":8,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:13.428268+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262313,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":614,"num_read_kb":9826,"num_write":1249,"num_write_kb":32499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'308","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.179705+0000","last_change":"2024-09-12T01:11:14.179705+0000","last_active":"2024-09-12T01:11:14.179705+0000","last_peered":"2024-09-12T01:11:14.179705+0000","last_clean":"2024-09-12T01:11:14.179705+0000","last_became_active":"2024-09-12T00:12:38.036872+0000","last_became_peered":"2024-09-12T00:12:38.036872+0000","last_unstale":"2024-09-12T01:11:14.179705+0000","last_undegraded":"2024-09-12T01:11:14.179705+0000","last_fullsized":"2024-09-12T01:11:14.179705+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'308","last_scrub_stamp":"2024-09-12T01:11:14.179611+0000","last_deep_scrub":"263'308","last_deep_scrub_stamp":"2024-09-12T01:11:14.179611+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.179611+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:04.270135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1112,"num_write":459,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'341","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.799642+0000","last_change":"2024-09-12T01:11:13.799642+0000","last_active":"2024-09-12T01:11:13.799642+0000","last_peered":"2024-09-12T01:11:13.799642+0000","last_clean":"2024-09-12T01:11:13.799642+0000","last_became_active":"2024-09-12T00:12:36.042159+0000","last_became_peered":"2024-09-12T00:12:36.042159+0000","last_unstale":"2024-09-12T01:11:13.799642+0000","last_undegraded":"2024-09-12T01:11:13.799642+0000","last_fullsized":"2024-09-12T01:11:13.799642+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-12T01:11:13.799464+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-12T01:11:13.799464+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.799464+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:02.740372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262267,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":43498,"num_write":1204,"num_write_kb":41544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'314","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.862426+0000","last_change":"2024-09-12T01:11:23.862426+0000","last_active":"2024-09-12T01:11:23.862426+0000","last_peered":"2024-09-12T01:11:23.862426+0000","last_clean":"2024-09-12T01:11:23.862426+0000","last_became_active":"2024-09-12T00:12:38.042966+0000","last_became_peered":"2024-09-12T00:12:38.042966+0000","last_unstale":"2024-09-12T01:11:23.862426+0000","last_undegraded":"2024-09-12T01:11:23.862426+0000","last_fullsized":"2024-09-12T01:11:23.862426+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-09-12T01:11:23.862308+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-09-12T01:11:23.862308+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.862308+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:32.625743+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1467,"num_read_kb":1262,"num_write":468,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25754,"num_omap_keys":101,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'377","reported_seq":1039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.331079+0000","last_change":"2024-09-12T01:11:08.331017+0000","last_active":"2024-09-12T01:11:08.331079+0000","last_peered":"2024-09-12T01:11:08.331079+0000","last_clean":"2024-09-12T01:11:08.331079+0000","last_became_active":"2024-09-12T00:12:36.027423+0000","last_became_peered":"2024-09-12T00:12:36.027423+0000","last_unstale":"2024-09-12T01:11:08.331079+0000","last_undegraded":"2024-09-12T01:11:08.331079+0000","last_fullsized":"2024-09-12T01:11:08.331079+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:11:08.330897+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:11:08.330897+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.330897+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:48.101657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730133,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":69052,"num_write":1173,"num_write_kb":46135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'156","reported_seq":737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.234431+0000","last_change":"2024-09-12T01:11:17.234431+0000","last_active":"2024-09-12T01:11:17.234431+0000","last_peered":"2024-09-12T01:11:17.234431+0000","last_clean":"2024-09-12T01:11:17.234431+0000","last_became_active":"2024-09-12T00:12:38.036235+0000","last_became_peered":"2024-09-12T00:12:38.036235+0000","last_unstale":"2024-09-12T01:11:17.234431+0000","last_undegraded":"2024-09-12T01:11:17.234431+0000","last_fullsized":"2024-09-12T01:11:17.234431+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'156","last_scrub_stamp":"2024-09-12T01:11:17.234365+0000","last_deep_scrub":"263'156","last_deep_scrub_stamp":"2024-09-12T01:11:17.234365+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.234365+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:50.396135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":550,"num_write":221,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'463","reported_seq":1289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.615976+0000","last_change":"2024-09-12T01:11:13.615976+0000","last_active":"2024-09-12T01:11:13.615976+0000","last_peered":"2024-09-12T01:11:13.615976+0000","last_clean":"2024-09-12T01:11:13.615976+0000","last_became_active":"2024-09-12T00:12:36.038449+0000","last_became_peered":"2024-09-12T00:12:36.038449+0000","last_unstale":"2024-09-12T01:11:13.615976+0000","last_undegraded":"2024-09-12T01:11:13.615976+0000","last_fullsized":"2024-09-12T01:11:13.615976+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'463","last_scrub_stamp":"2024-09-12T01:11:13.615824+0000","last_deep_scrub":"263'463","last_deep_scrub_stamp":"2024-09-12T01:11:13.615824+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.615824+0000","objects_scrubbed":10,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:45.835212+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5280724,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1083,"num_read_kb":25378,"num_write":1472,"num_write_kb":31172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'189","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.221767+0000","last_change":"2024-09-12T01:11:14.221767+0000","last_active":"2024-09-12T01:11:14.221767+0000","last_peered":"2024-09-12T01:11:14.221767+0000","last_clean":"2024-09-12T01:11:14.221767+0000","last_became_active":"2024-09-12T00:12:38.042691+0000","last_became_peered":"2024-09-12T00:12:38.042691+0000","last_unstale":"2024-09-12T01:11:14.221767+0000","last_undegraded":"2024-09-12T01:11:14.221767+0000","last_fullsized":"2024-09-12T01:11:14.221767+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'189","last_scrub_stamp":"2024-09-12T01:11:14.221681+0000","last_deep_scrub":"263'189","last_deep_scrub_stamp":"2024-09-12T01:11:14.221681+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.221681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:58.106634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":710,"num_write":289,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'349","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.150591+0000","last_change":"2024-09-12T01:11:08.150533+0000","last_active":"2024-09-12T01:11:08.150591+0000","last_peered":"2024-09-12T01:11:08.150591+0000","last_clean":"2024-09-12T01:11:08.150591+0000","last_became_active":"2024-09-12T00:12:36.025028+0000","last_became_peered":"2024-09-12T00:12:36.025028+0000","last_unstale":"2024-09-12T01:11:08.150591+0000","last_undegraded":"2024-09-12T01:11:08.150591+0000","last_fullsized":"2024-09-12T01:11:08.150591+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'349","last_scrub_stamp":"2024-09-12T01:11:08.150388+0000","last_deep_scrub":"263'349","last_deep_scrub_stamp":"2024-09-12T01:11:08.150388+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.150388+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:51.049508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":523,"num_read_kb":8333,"num_write":1236,"num_write_kb":35038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'132","reported_seq":755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.724523+0000","last_change":"2024-09-12T01:11:16.724523+0000","last_active":"2024-09-12T01:11:16.724523+0000","last_peered":"2024-09-12T01:11:16.724523+0000","last_clean":"2024-09-12T01:11:16.724523+0000","last_became_active":"2024-09-12T00:12:38.046753+0000","last_became_peered":"2024-09-12T00:12:38.046753+0000","last_unstale":"2024-09-12T01:11:16.724523+0000","last_undegraded":"2024-09-12T01:11:16.724523+0000","last_fullsized":"2024-09-12T01:11:16.724523+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'132","last_scrub_stamp":"2024-09-12T01:11:16.724424+0000","last_deep_scrub":"263'132","last_deep_scrub_stamp":"2024-09-12T01:11:16.724424+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.724424+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:10.527369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":645,"num_read_kb":546,"num_write":214,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'376","reported_seq":1029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.407915+0000","last_change":"2024-09-12T01:11:18.407843+0000","last_active":"2024-09-12T01:11:18.407915+0000","last_peered":"2024-09-12T01:11:18.407915+0000","last_clean":"2024-09-12T01:11:18.407915+0000","last_became_active":"2024-09-12T00:12:36.047221+0000","last_became_peered":"2024-09-12T00:12:36.047221+0000","last_unstale":"2024-09-12T01:11:18.407915+0000","last_undegraded":"2024-09-12T01:11:18.407915+0000","last_fullsized":"2024-09-12T01:11:18.407915+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'376","last_scrub_stamp":"2024-09-12T01:11:18.407727+0000","last_deep_scrub":"263'376","last_deep_scrub_stamp":"2024-09-12T01:11:18.407727+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.407727+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:05.332812+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4807090,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":28472,"num_write":1153,"num_write_kb":36833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'174","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.450164+0000","last_change":"2024-09-12T01:11:19.450164+0000","last_active":"2024-09-12T01:11:19.450164+0000","last_peered":"2024-09-12T01:11:19.450164+0000","last_clean":"2024-09-12T01:11:19.450164+0000","last_became_active":"2024-09-12T00:12:38.048094+0000","last_became_peered":"2024-09-12T00:12:38.048094+0000","last_unstale":"2024-09-12T01:11:19.450164+0000","last_undegraded":"2024-09-12T01:11:19.450164+0000","last_fullsized":"2024-09-12T01:11:19.450164+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'174","last_scrub_stamp":"2024-09-12T01:11:19.450075+0000","last_deep_scrub":"263'174","last_deep_scrub_stamp":"2024-09-12T01:11:19.450075+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.450075+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:51.643162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":798,"num_read_kb":664,"num_write":275,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'311","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.726114+0000","last_change":"2024-09-12T01:11:10.726114+0000","last_active":"2024-09-12T01:11:10.726114+0000","last_peered":"2024-09-12T01:11:10.726114+0000","last_clean":"2024-09-12T01:11:10.726114+0000","last_became_active":"2024-09-12T00:12:36.039442+0000","last_became_peered":"2024-09-12T00:12:36.039442+0000","last_unstale":"2024-09-12T01:11:10.726114+0000","last_undegraded":"2024-09-12T01:11:10.726114+0000","last_fullsized":"2024-09-12T01:11:10.726114+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:11:10.725997+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:11:10.725997+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.725997+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:30.008154+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":5824,"num_write":1002,"num_write_kb":34989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'86","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.269437+0000","last_change":"2024-09-12T01:11:13.269371+0000","last_active":"2024-09-12T01:11:13.269437+0000","last_peered":"2024-09-12T01:11:13.269437+0000","last_clean":"2024-09-12T01:11:13.269437+0000","last_became_active":"2024-09-12T00:12:38.042380+0000","last_became_peered":"2024-09-12T00:12:38.042380+0000","last_unstale":"2024-09-12T01:11:13.269437+0000","last_undegraded":"2024-09-12T01:11:13.269437+0000","last_fullsized":"2024-09-12T01:11:13.269437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'86","last_scrub_stamp":"2024-09-12T01:11:13.269288+0000","last_deep_scrub":"263'86","last_deep_scrub_stamp":"2024-09-12T01:11:13.269288+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.269288+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:11.757304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":311,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'396","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.359247+0000","last_change":"2024-09-12T01:11:19.359247+0000","last_active":"2024-09-12T01:11:19.359247+0000","last_peered":"2024-09-12T01:11:19.359247+0000","last_clean":"2024-09-12T01:11:19.359247+0000","last_became_active":"2024-09-12T00:12:36.035235+0000","last_became_peered":"2024-09-12T00:12:36.035235+0000","last_unstale":"2024-09-12T01:11:19.359247+0000","last_undegraded":"2024-09-12T01:11:19.359247+0000","last_fullsized":"2024-09-12T01:11:19.359247+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'396","last_scrub_stamp":"2024-09-12T01:11:19.359113+0000","last_deep_scrub":"263'396","last_deep_scrub_stamp":"2024-09-12T01:11:19.359113+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.359113+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:34.438134+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2508578,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":34997,"num_write":1247,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'340","reported_seq":968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.297343+0000","last_change":"2024-09-12T01:11:10.297255+0000","last_active":"2024-09-12T01:11:10.297343+0000","last_peered":"2024-09-12T01:11:10.297343+0000","last_clean":"2024-09-12T01:11:10.297343+0000","last_became_active":"2024-09-12T00:13:07.150278+0000","last_became_peered":"2024-09-12T00:13:07.150278+0000","last_unstale":"2024-09-12T01:11:10.297343+0000","last_undegraded":"2024-09-12T01:11:10.297343+0000","last_fullsized":"2024-09-12T01:11:10.297343+0000","mapping_epoch":40,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:11:10.297094+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:11:10.297094+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.297094+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:40.514518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550106,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":16889,"num_write":1077,"num_write_kb":27724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"263'232","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.445613+0000","last_change":"2024-09-12T01:11:20.445613+0000","last_active":"2024-09-12T01:11:20.445613+0000","last_peered":"2024-09-12T01:11:20.445613+0000","last_clean":"2024-09-12T01:11:20.445613+0000","last_became_active":"2024-09-12T00:12:38.048092+0000","last_became_peered":"2024-09-12T00:12:38.048092+0000","last_unstale":"2024-09-12T01:11:20.445613+0000","last_undegraded":"2024-09-12T01:11:20.445613+0000","last_fullsized":"2024-09-12T01:11:20.445613+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T01:11:20.445524+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T01:11:20.445524+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.445524+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:49.570800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":909,"num_write":384,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'395","reported_seq":1216,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.842411+0000","last_change":"2024-09-12T01:11:14.842411+0000","last_active":"2024-09-12T01:11:14.842411+0000","last_peered":"2024-09-12T01:11:14.842411+0000","last_clean":"2024-09-12T01:11:14.842411+0000","last_became_active":"2024-09-12T00:12:36.034396+0000","last_became_peered":"2024-09-12T00:12:36.034396+0000","last_unstale":"2024-09-12T01:11:14.842411+0000","last_undegraded":"2024-09-12T01:11:14.842411+0000","last_fullsized":"2024-09-12T01:11:14.842411+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'395","last_scrub_stamp":"2024-09-12T01:11:14.842306+0000","last_deep_scrub":"263'395","last_deep_scrub_stamp":"2024-09-12T01:11:14.842306+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.842306+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:02.568926+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730115,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":982,"num_read_kb":9206,"num_write":1471,"num_write_kb":42121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'344","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.286803+0000","last_change":"2024-09-12T01:11:20.286803+0000","last_active":"2024-09-12T01:11:20.286803+0000","last_peered":"2024-09-12T01:11:20.286803+0000","last_clean":"2024-09-12T01:11:20.286803+0000","last_became_active":"2024-09-12T00:12:38.039941+0000","last_became_peered":"2024-09-12T00:12:38.039941+0000","last_unstale":"2024-09-12T01:11:20.286803+0000","last_undegraded":"2024-09-12T01:11:20.286803+0000","last_fullsized":"2024-09-12T01:11:20.286803+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-12T01:11:20.286686+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-12T01:11:20.286686+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.286686+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:08.702768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1443,"num_read_kb":1146,"num_write":558,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5787,"num_read_kb":4069,"num_write":1922,"num_write_kb":820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6000,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1095,"ondisk_log_size":1095,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15069,"num_read_kb":14720,"num_write":16734,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1863,"ondisk_log_size":1863,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":695,"ondisk_log_size":695,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1599308,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":18230,"num_read_kb":37558,"num_write":15243,"num_write_kb":11785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685952,"num_omap_keys":1572,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1894,"ondisk_log_size":1894,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":103162,"num_read_kb":86048,"num_write":37373,"num_write_kb":18894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44597,"num_omap_keys":180,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3943,"ondisk_log_size":3943,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":86738467,"num_objects":386,"num_object_clones":0,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":386,"num_whiteouts":0,"num_read":36305,"num_read_kb":1714849,"num_write":72152,"num_write_kb":2100462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":132317184,"data_stored":132317184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3742,"ondisk_log_size":3742,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":170862,"num_write":186,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":170241,"num_write":186,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510162,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220644,"kb_used_data":14612,"kb_used_omap":1,"kb_used_meta":206014,"kb_avail":94151196,"statfs":{"total":96636764160,"available":96410824704,"internally_reserved":0,"allocated":14962688,"data_stored":12977820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":210958795},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510165,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108704,"kb_used_data":15120,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94263136,"statfs":{"total":96636764160,"available":96525451264,"internally_reserved":0,"allocated":15482880,"data_stored":13481120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95812038},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510162,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205480,"kb_used_data":21656,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94166360,"statfs":{"total":96636764160,"available":96426352640,"internally_reserved":0,"allocated":22175744,"data_stored":20184672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510163,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":271156,"kb_used_data":28964,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94100684,"statfs":{"total":96636764160,"available":96359100416,"internally_reserved":0,"allocated":29659136,"data_stored":27672539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":247986631},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510163,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151856,"kb_used_data":22112,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94219984,"statfs":{"total":96636764160,"available":96481263616,"internally_reserved":0,"allocated":22642688,"data_stored":20661729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510163,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":328376,"kb_used_data":22312,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94043464,"statfs":{"total":96636764160,"available":96300507136,"internally_reserved":0,"allocated":22847488,"data_stored":20852874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510165,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99024,"kb_used_data":17856,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94272816,"statfs":{"total":96636764160,"available":96535363584,"internally_reserved":0,"allocated":18284544,"data_stored":16272298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575570,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272432,"kb_used_data":20512,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94099408,"statfs":{"total":96636764160,"available":96357793792,"internally_reserved":0,"allocated":21004288,"data_stored":19003294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14069760,"data_stored":14069760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18063360,"data_stored":18063360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18460672,"data_stored":18460672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25473024,"data_stored":25473024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17981440,"data_stored":17981440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16211968,"data_stored":16211968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11280384,"data_stored":11280384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10776576,"data_stored":10776576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:12:08.104 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:08.105 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:08.105 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:08.105 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:08.106 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:30:16.736862+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:08.106 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:08.106 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:46:53.861946+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=11, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:12:08.110 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:12:28.111 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:12:28.446 INFO:teuthology.orchestra.run.smithi133.stdout: 2024-09-12T01:12:28.457 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2024-09-12T01:12:28.460 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":2063,"stamp":"2024-09-12T01:12:27.372015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88946274,"num_objects":742,"num_object_clones":0,"num_object_copies":1870,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":742,"num_whiteouts":0,"num_read":181390,"num_read_kb":2201314,"num_write":143939,"num_write_kb":2394991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":63,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740611,"num_omap_keys":1795,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13593,"ondisk_log_size":13593,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1657672,"kb_used_data":163144,"kb_used_omap":12,"kb_used_meta":1494387,"kb_avail":753317048,"statfs":{"total":773094113280,"available":771396657152,"internally_reserved":0,"allocated":167059456,"data_stored":151106346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1530252850},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005525"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.238390+0000","last_change":"2024-09-12T01:11:42.238299+0000","last_active":"2024-09-12T01:11:42.238390+0000","last_peered":"2024-09-12T01:11:42.238390+0000","last_clean":"2024-09-12T01:11:42.238390+0000","last_became_active":"2024-09-12T00:46:54.885628+0000","last_became_peered":"2024-09-12T00:46:54.885628+0000","last_unstale":"2024-09-12T01:11:42.238390+0000","last_undegraded":"2024-09-12T01:11:42.238390+0000","last_fullsized":"2024-09-12T01:11:42.238390+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:42.238174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:42.238174+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.238174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:50.228730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.293811+0000","last_change":"2024-09-12T01:11:41.293811+0000","last_active":"2024-09-12T01:11:41.293811+0000","last_peered":"2024-09-12T01:11:41.293811+0000","last_clean":"2024-09-12T01:11:41.293811+0000","last_became_active":"2024-09-12T00:30:17.763402+0000","last_became_peered":"2024-09-12T00:30:17.763402+0000","last_unstale":"2024-09-12T01:11:41.293811+0000","last_undegraded":"2024-09-12T01:11:41.293811+0000","last_fullsized":"2024-09-12T01:11:41.293811+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-12T01:11:41.293721+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-12T01:11:41.293721+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.293721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:33.238185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"260'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.573777+0000","last_change":"2024-09-12T01:11:42.573777+0000","last_active":"2024-09-12T01:11:42.573777+0000","last_peered":"2024-09-12T01:11:42.573777+0000","last_clean":"2024-09-12T01:11:42.573777+0000","last_became_active":"2024-09-12T00:30:14.744833+0000","last_became_peered":"2024-09-12T00:30:14.744833+0000","last_unstale":"2024-09-12T01:11:42.573777+0000","last_undegraded":"2024-09-12T01:11:42.573777+0000","last_fullsized":"2024-09-12T01:11:42.573777+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-12T01:11:42.573690+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-12T01:11:42.573690+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.573690+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:45.289006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8192,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'41","reported_seq":170,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.393158+0000","last_change":"2024-09-12T01:11:48.393158+0000","last_active":"2024-09-12T01:11:48.393158+0000","last_peered":"2024-09-12T01:11:48.393158+0000","last_clean":"2024-09-12T01:11:48.393158+0000","last_became_active":"2024-09-12T00:27:42.839605+0000","last_became_peered":"2024-09-12T00:27:42.839605+0000","last_unstale":"2024-09-12T01:11:48.393158+0000","last_undegraded":"2024-09-12T01:11:48.393158+0000","last_fullsized":"2024-09-12T01:11:48.393158+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:11:48.393064+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:11:48.393064+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.393064+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:13.561297+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":144,"num_write":69,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.446289+0000","last_change":"2024-09-12T01:11:49.446189+0000","last_active":"2024-09-12T01:11:49.446289+0000","last_peered":"2024-09-12T01:11:49.446289+0000","last_clean":"2024-09-12T01:11:49.446289+0000","last_became_active":"2024-09-12T00:46:54.885702+0000","last_became_peered":"2024-09-12T00:46:54.885702+0000","last_unstale":"2024-09-12T01:11:49.446289+0000","last_undegraded":"2024-09-12T01:11:49.446289+0000","last_fullsized":"2024-09-12T01:11:49.446289+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:49.446092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:49.446092+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.446092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:36.330107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"263'3","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.247187+0000","last_change":"2024-09-12T01:11:45.247187+0000","last_active":"2024-09-12T01:11:45.247187+0000","last_peered":"2024-09-12T01:11:45.247187+0000","last_clean":"2024-09-12T01:11:45.247187+0000","last_became_active":"2024-09-12T00:30:17.762369+0000","last_became_peered":"2024-09-12T00:30:17.762369+0000","last_unstale":"2024-09-12T01:11:45.247187+0000","last_undegraded":"2024-09-12T01:11:45.247187+0000","last_fullsized":"2024-09-12T01:11:45.247187+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:11:45.247111+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:11:45.247111+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.247111+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:27.557898+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"260'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.840007+0000","last_change":"2024-09-12T01:11:48.840007+0000","last_active":"2024-09-12T01:11:48.840007+0000","last_peered":"2024-09-12T01:11:48.840007+0000","last_clean":"2024-09-12T01:11:48.840007+0000","last_became_active":"2024-09-12T00:30:14.747614+0000","last_became_peered":"2024-09-12T00:30:14.747614+0000","last_unstale":"2024-09-12T01:11:48.840007+0000","last_undegraded":"2024-09-12T01:11:48.840007+0000","last_fullsized":"2024-09-12T01:11:48.840007+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-12T01:11:48.839916+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-12T01:11:48.839916+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.839916+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:33.711517+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"263'21","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.388154+0000","last_change":"2024-09-12T01:11:44.388096+0000","last_active":"2024-09-12T01:11:44.388154+0000","last_peered":"2024-09-12T01:11:44.388154+0000","last_clean":"2024-09-12T01:11:44.388154+0000","last_became_active":"2024-09-12T00:27:42.846264+0000","last_became_peered":"2024-09-12T00:27:42.846264+0000","last_unstale":"2024-09-12T01:11:44.388154+0000","last_undegraded":"2024-09-12T01:11:44.388154+0000","last_fullsized":"2024-09-12T01:11:44.388154+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'21","last_scrub_stamp":"2024-09-12T01:11:44.387999+0000","last_deep_scrub":"263'21","last_deep_scrub_stamp":"2024-09-12T01:11:44.387999+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.387999+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:24.123389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":40,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.252024+0000","last_change":"2024-09-12T01:11:45.252024+0000","last_active":"2024-09-12T01:11:45.252024+0000","last_peered":"2024-09-12T01:11:45.252024+0000","last_clean":"2024-09-12T01:11:45.252024+0000","last_became_active":"2024-09-12T00:46:54.890430+0000","last_became_peered":"2024-09-12T00:46:54.890430+0000","last_unstale":"2024-09-12T01:11:45.252024+0000","last_undegraded":"2024-09-12T01:11:45.252024+0000","last_fullsized":"2024-09-12T01:11:45.252024+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:45.251938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:45.251938+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.251938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:34.442709+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"260'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.830946+0000","last_change":"2024-09-12T01:11:57.830876+0000","last_active":"2024-09-12T01:11:57.830946+0000","last_peered":"2024-09-12T01:11:57.830946+0000","last_clean":"2024-09-12T01:11:57.830946+0000","last_became_active":"2024-09-12T00:30:17.767116+0000","last_became_peered":"2024-09-12T00:30:17.767116+0000","last_unstale":"2024-09-12T01:11:57.830946+0000","last_undegraded":"2024-09-12T01:11:57.830946+0000","last_fullsized":"2024-09-12T01:11:57.830946+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-12T01:11:57.830781+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-12T01:11:57.830781+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.830781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:58.505612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"263'6","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.602438+0000","last_change":"2024-09-12T01:11:46.602319+0000","last_active":"2024-09-12T01:11:46.602438+0000","last_peered":"2024-09-12T01:11:46.602438+0000","last_clean":"2024-09-12T01:11:46.602438+0000","last_became_active":"2024-09-12T00:30:14.742434+0000","last_became_peered":"2024-09-12T00:30:14.742434+0000","last_unstale":"2024-09-12T01:11:46.602438+0000","last_undegraded":"2024-09-12T01:11:46.602438+0000","last_fullsized":"2024-09-12T01:11:46.602438+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:46.602222+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:46.602222+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.602222+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:48.726174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6194,"num_write":6,"num_write_kb":5170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'36","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.481877+0000","last_change":"2024-09-12T01:11:41.481877+0000","last_active":"2024-09-12T01:11:41.481877+0000","last_peered":"2024-09-12T01:11:41.481877+0000","last_clean":"2024-09-12T01:11:41.481877+0000","last_became_active":"2024-09-12T00:27:42.842172+0000","last_became_peered":"2024-09-12T00:27:42.842172+0000","last_unstale":"2024-09-12T01:11:41.481877+0000","last_undegraded":"2024-09-12T01:11:41.481877+0000","last_fullsized":"2024-09-12T01:11:41.481877+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-12T01:11:41.481778+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-12T01:11:41.481778+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.481778+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:04.496975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":194,"num_read_kb":136,"num_write":66,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.779592+0000","last_change":"2024-09-12T01:12:03.779592+0000","last_active":"2024-09-12T01:12:03.779592+0000","last_peered":"2024-09-12T01:12:03.779592+0000","last_clean":"2024-09-12T01:12:03.779592+0000","last_became_active":"2024-09-12T00:46:54.882951+0000","last_became_peered":"2024-09-12T00:46:54.882951+0000","last_unstale":"2024-09-12T01:12:03.779592+0000","last_undegraded":"2024-09-12T01:12:03.779592+0000","last_fullsized":"2024-09-12T01:12:03.779592+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:03.779491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:03.779491+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.779491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:44.893242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.753360+0000","last_change":"2024-09-12T01:11:53.753360+0000","last_active":"2024-09-12T01:11:53.753360+0000","last_peered":"2024-09-12T01:11:53.753360+0000","last_clean":"2024-09-12T01:11:53.753360+0000","last_became_active":"2024-09-12T00:30:17.764967+0000","last_became_peered":"2024-09-12T00:30:17.764967+0000","last_unstale":"2024-09-12T01:11:53.753360+0000","last_undegraded":"2024-09-12T01:11:53.753360+0000","last_fullsized":"2024-09-12T01:11:53.753360+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:53.753248+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:53.753248+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.753248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:35.057213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.342353+0000","last_change":"2024-09-12T01:11:40.342294+0000","last_active":"2024-09-12T01:11:40.342353+0000","last_peered":"2024-09-12T01:11:40.342353+0000","last_clean":"2024-09-12T01:11:40.342353+0000","last_became_active":"2024-09-12T00:30:14.747423+0000","last_became_peered":"2024-09-12T00:30:14.747423+0000","last_unstale":"2024-09-12T01:11:40.342353+0000","last_undegraded":"2024-09-12T01:11:40.342353+0000","last_fullsized":"2024-09-12T01:11:40.342353+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:11:40.342210+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:11:40.342210+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.342210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:39.241915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'27","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.510222+0000","last_change":"2024-09-12T01:11:40.510222+0000","last_active":"2024-09-12T01:11:40.510222+0000","last_peered":"2024-09-12T01:11:40.510222+0000","last_clean":"2024-09-12T01:11:40.510222+0000","last_became_active":"2024-09-12T00:27:42.837170+0000","last_became_peered":"2024-09-12T00:27:42.837170+0000","last_unstale":"2024-09-12T01:11:40.510222+0000","last_undegraded":"2024-09-12T01:11:40.510222+0000","last_fullsized":"2024-09-12T01:11:40.510222+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'27","last_scrub_stamp":"2024-09-12T01:11:40.510104+0000","last_deep_scrub":"263'27","last_deep_scrub_stamp":"2024-09-12T01:11:40.510104+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.510104+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:28.001902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":97,"num_write":53,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.677923+0000","last_change":"2024-09-12T01:11:54.677923+0000","last_active":"2024-09-12T01:11:54.677923+0000","last_peered":"2024-09-12T01:11:54.677923+0000","last_clean":"2024-09-12T01:11:54.677923+0000","last_became_active":"2024-09-12T00:46:54.885170+0000","last_became_peered":"2024-09-12T00:46:54.885170+0000","last_unstale":"2024-09-12T01:11:54.677923+0000","last_undegraded":"2024-09-12T01:11:54.677923+0000","last_fullsized":"2024-09-12T01:11:54.677923+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:54.677837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:54.677837+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.677837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:14.232780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.296107+0000","last_change":"2024-09-12T01:11:38.296054+0000","last_active":"2024-09-12T01:11:38.296107+0000","last_peered":"2024-09-12T01:11:38.296107+0000","last_clean":"2024-09-12T01:11:38.296107+0000","last_became_active":"2024-09-12T00:30:17.765167+0000","last_became_peered":"2024-09-12T00:30:17.765167+0000","last_unstale":"2024-09-12T01:11:38.296107+0000","last_undegraded":"2024-09-12T01:11:38.296107+0000","last_fullsized":"2024-09-12T01:11:38.296107+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:38.295957+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:38.295957+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.295957+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:18.827609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6715,"num_write":6,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"260'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.861671+0000","last_change":"2024-09-12T01:11:47.861671+0000","last_active":"2024-09-12T01:11:47.861671+0000","last_peered":"2024-09-12T01:11:47.861671+0000","last_clean":"2024-09-12T01:11:47.861671+0000","last_became_active":"2024-09-12T00:30:14.742625+0000","last_became_peered":"2024-09-12T00:30:14.742625+0000","last_unstale":"2024-09-12T01:11:47.861671+0000","last_undegraded":"2024-09-12T01:11:47.861671+0000","last_fullsized":"2024-09-12T01:11:47.861671+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-12T01:11:47.861564+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-12T01:11:47.861564+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.861564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:43.300600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"263'13","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.508432+0000","last_change":"2024-09-12T01:11:37.508432+0000","last_active":"2024-09-12T01:11:37.508432+0000","last_peered":"2024-09-12T01:11:37.508432+0000","last_clean":"2024-09-12T01:11:37.508432+0000","last_became_active":"2024-09-12T00:27:42.845406+0000","last_became_peered":"2024-09-12T00:27:42.845406+0000","last_unstale":"2024-09-12T01:11:37.508432+0000","last_undegraded":"2024-09-12T01:11:37.508432+0000","last_fullsized":"2024-09-12T01:11:37.508432+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-12T01:11:37.508351+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-12T01:11:37.508351+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.508351+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:13.033508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":45,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.427688+0000","last_change":"2024-09-12T01:11:51.427625+0000","last_active":"2024-09-12T01:11:51.427688+0000","last_peered":"2024-09-12T01:11:51.427688+0000","last_clean":"2024-09-12T01:11:51.427688+0000","last_became_active":"2024-09-12T00:46:54.876219+0000","last_became_peered":"2024-09-12T00:46:54.876219+0000","last_unstale":"2024-09-12T01:11:51.427688+0000","last_undegraded":"2024-09-12T01:11:51.427688+0000","last_fullsized":"2024-09-12T01:11:51.427688+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:51.427529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:51.427529+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.427529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:32.816914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:07.411541+0000","last_change":"2024-09-12T01:12:07.411541+0000","last_active":"2024-09-12T01:12:07.411541+0000","last_peered":"2024-09-12T01:12:07.411541+0000","last_clean":"2024-09-12T01:12:07.411541+0000","last_became_active":"2024-09-12T00:30:17.762792+0000","last_became_peered":"2024-09-12T00:30:17.762792+0000","last_unstale":"2024-09-12T01:12:07.411541+0000","last_undegraded":"2024-09-12T01:12:07.411541+0000","last_fullsized":"2024-09-12T01:12:07.411541+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:12:07.411450+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:12:07.411450+0000","last_clean_scrub_stamp":"2024-09-12T01:12:07.411450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:51.184932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.382614+0000","last_change":"2024-09-12T01:12:02.382614+0000","last_active":"2024-09-12T01:12:02.382614+0000","last_peered":"2024-09-12T01:12:02.382614+0000","last_clean":"2024-09-12T01:12:02.382614+0000","last_became_active":"2024-09-12T00:30:14.745328+0000","last_became_peered":"2024-09-12T00:30:14.745328+0000","last_unstale":"2024-09-12T01:12:02.382614+0000","last_undegraded":"2024-09-12T01:12:02.382614+0000","last_fullsized":"2024-09-12T01:12:02.382614+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:12:02.382517+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:12:02.382517+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.382517+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:23.011562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"263'29","reported_seq":135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.240542+0000","last_change":"2024-09-12T01:11:37.240542+0000","last_active":"2024-09-12T01:11:37.240542+0000","last_peered":"2024-09-12T01:11:37.240542+0000","last_clean":"2024-09-12T01:11:37.240542+0000","last_became_active":"2024-09-12T00:27:42.843745+0000","last_became_peered":"2024-09-12T00:27:42.843745+0000","last_unstale":"2024-09-12T01:11:37.240542+0000","last_undegraded":"2024-09-12T01:11:37.240542+0000","last_fullsized":"2024-09-12T01:11:37.240542+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'29","last_scrub_stamp":"2024-09-12T01:11:37.240457+0000","last_deep_scrub":"263'29","last_deep_scrub_stamp":"2024-09-12T01:11:37.240457+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.240457+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:02.545550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":101,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.197795+0000","last_change":"2024-09-12T01:11:48.197739+0000","last_active":"2024-09-12T01:11:48.197795+0000","last_peered":"2024-09-12T01:11:48.197795+0000","last_clean":"2024-09-12T01:11:48.197795+0000","last_became_active":"2024-09-12T00:46:54.889006+0000","last_became_peered":"2024-09-12T00:46:54.889006+0000","last_unstale":"2024-09-12T01:11:48.197795+0000","last_undegraded":"2024-09-12T01:11:48.197795+0000","last_fullsized":"2024-09-12T01:11:48.197795+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:48.197669+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:48.197669+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.197669+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:58.745528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'11","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.205260+0000","last_change":"2024-09-12T01:11:44.205260+0000","last_active":"2024-09-12T01:11:44.205260+0000","last_peered":"2024-09-12T01:11:44.205260+0000","last_clean":"2024-09-12T01:11:44.205260+0000","last_became_active":"2024-09-12T00:30:17.759198+0000","last_became_peered":"2024-09-12T00:30:17.759198+0000","last_unstale":"2024-09-12T01:11:44.205260+0000","last_undegraded":"2024-09-12T01:11:44.205260+0000","last_fullsized":"2024-09-12T01:11:44.205260+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T01:11:44.205174+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T01:11:44.205174+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.205174+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:05:56.063872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9336,"num_write":16,"num_write_kb":6715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"260'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.247614+0000","last_change":"2024-09-12T01:11:34.247614+0000","last_active":"2024-09-12T01:11:34.247614+0000","last_peered":"2024-09-12T01:11:34.247614+0000","last_clean":"2024-09-12T01:11:34.247614+0000","last_became_active":"2024-09-12T00:30:14.750004+0000","last_became_peered":"2024-09-12T00:30:14.750004+0000","last_unstale":"2024-09-12T01:11:34.247614+0000","last_undegraded":"2024-09-12T01:11:34.247614+0000","last_fullsized":"2024-09-12T01:11:34.247614+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:11:34.247482+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:11:34.247482+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.247482+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:38.785894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"263'18","reported_seq":102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.661226+0000","last_change":"2024-09-12T01:11:37.661226+0000","last_active":"2024-09-12T01:11:37.661226+0000","last_peered":"2024-09-12T01:11:37.661226+0000","last_clean":"2024-09-12T01:11:37.661226+0000","last_became_active":"2024-09-12T00:27:42.835530+0000","last_became_peered":"2024-09-12T00:27:42.835530+0000","last_unstale":"2024-09-12T01:11:37.661226+0000","last_undegraded":"2024-09-12T01:11:37.661226+0000","last_fullsized":"2024-09-12T01:11:37.661226+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'18","last_scrub_stamp":"2024-09-12T01:11:37.661105+0000","last_deep_scrub":"263'18","last_deep_scrub_stamp":"2024-09-12T01:11:37.661105+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.661105+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:17.820227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":55,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.195273+0000","last_change":"2024-09-12T01:11:44.195193+0000","last_active":"2024-09-12T01:11:44.195273+0000","last_peered":"2024-09-12T01:11:44.195273+0000","last_clean":"2024-09-12T01:11:44.195273+0000","last_became_active":"2024-09-12T00:46:54.882946+0000","last_became_peered":"2024-09-12T00:46:54.882946+0000","last_unstale":"2024-09-12T01:11:44.195273+0000","last_undegraded":"2024-09-12T01:11:44.195273+0000","last_fullsized":"2024-09-12T01:11:44.195273+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.195091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.195091+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.195091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:18.277306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"260'4","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.604565+0000","last_change":"2024-09-12T01:11:51.604565+0000","last_active":"2024-09-12T01:11:51.604565+0000","last_peered":"2024-09-12T01:11:51.604565+0000","last_clean":"2024-09-12T01:11:51.604565+0000","last_became_active":"2024-09-12T00:30:17.763733+0000","last_became_peered":"2024-09-12T00:30:17.763733+0000","last_unstale":"2024-09-12T01:11:51.604565+0000","last_undegraded":"2024-09-12T01:11:51.604565+0000","last_fullsized":"2024-09-12T01:11:51.604565+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-12T01:11:51.604470+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-12T01:11:51.604470+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.604470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:49.686085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"263'5","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.460827+0000","last_change":"2024-09-12T01:11:43.460827+0000","last_active":"2024-09-12T01:11:43.460827+0000","last_peered":"2024-09-12T01:11:43.460827+0000","last_clean":"2024-09-12T01:11:43.460827+0000","last_became_active":"2024-09-12T00:30:14.748462+0000","last_became_peered":"2024-09-12T00:30:14.748462+0000","last_unstale":"2024-09-12T01:11:43.460827+0000","last_undegraded":"2024-09-12T01:11:43.460827+0000","last_fullsized":"2024-09-12T01:11:43.460827+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:11:43.460734+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:11:43.460734+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.460734+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:09.879424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"263'17","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.459328+0000","last_change":"2024-09-12T01:11:36.459328+0000","last_active":"2024-09-12T01:11:36.459328+0000","last_peered":"2024-09-12T01:11:36.459328+0000","last_clean":"2024-09-12T01:11:36.459328+0000","last_became_active":"2024-09-12T00:27:42.838896+0000","last_became_peered":"2024-09-12T00:27:42.838896+0000","last_unstale":"2024-09-12T01:11:36.459328+0000","last_undegraded":"2024-09-12T01:11:36.459328+0000","last_fullsized":"2024-09-12T01:11:36.459328+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'17","last_scrub_stamp":"2024-09-12T01:11:36.459214+0000","last_deep_scrub":"263'17","last_deep_scrub_stamp":"2024-09-12T01:11:36.459214+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.459214+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:24.519710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":65,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.817367+0000","last_change":"2024-09-12T01:11:58.817367+0000","last_active":"2024-09-12T01:11:58.817367+0000","last_peered":"2024-09-12T01:11:58.817367+0000","last_clean":"2024-09-12T01:11:58.817367+0000","last_became_active":"2024-09-12T00:46:54.885457+0000","last_became_peered":"2024-09-12T00:46:54.885457+0000","last_unstale":"2024-09-12T01:11:58.817367+0000","last_undegraded":"2024-09-12T01:11:58.817367+0000","last_fullsized":"2024-09-12T01:11:58.817367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:58.817260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:58.817260+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.817260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:18.075987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"260'4","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.581002+0000","last_change":"2024-09-12T01:11:49.581002+0000","last_active":"2024-09-12T01:11:49.581002+0000","last_peered":"2024-09-12T01:11:49.581002+0000","last_clean":"2024-09-12T01:11:49.581002+0000","last_became_active":"2024-09-12T00:30:17.765149+0000","last_became_peered":"2024-09-12T00:30:17.765149+0000","last_unstale":"2024-09-12T01:11:49.581002+0000","last_undegraded":"2024-09-12T01:11:49.581002+0000","last_fullsized":"2024-09-12T01:11:49.581002+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-12T01:11:49.580912+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-12T01:11:49.580912+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.580912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:48.834592+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4123,"num_write":4,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.385101+0000","last_change":"2024-09-12T01:12:01.384991+0000","last_active":"2024-09-12T01:12:01.385101+0000","last_peered":"2024-09-12T01:12:01.385101+0000","last_clean":"2024-09-12T01:12:01.385101+0000","last_became_active":"2024-09-12T00:30:14.740516+0000","last_became_peered":"2024-09-12T00:30:14.740516+0000","last_unstale":"2024-09-12T01:12:01.385101+0000","last_undegraded":"2024-09-12T01:12:01.385101+0000","last_fullsized":"2024-09-12T01:12:01.385101+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:01.384889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:01.384889+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.384889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:37.035880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"260'20","reported_seq":117,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.419942+0000","last_change":"2024-09-12T01:11:46.419942+0000","last_active":"2024-09-12T01:11:46.419942+0000","last_peered":"2024-09-12T01:11:46.419942+0000","last_clean":"2024-09-12T01:11:46.419942+0000","last_became_active":"2024-09-12T00:27:42.840919+0000","last_became_peered":"2024-09-12T00:27:42.840919+0000","last_unstale":"2024-09-12T01:11:46.419942+0000","last_undegraded":"2024-09-12T01:11:46.419942+0000","last_fullsized":"2024-09-12T01:11:46.419942+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'20","last_scrub_stamp":"2024-09-12T01:11:46.419832+0000","last_deep_scrub":"260'20","last_deep_scrub_stamp":"2024-09-12T01:11:46.419832+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.419832+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:50.045905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":83,"num_write":31,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.448148+0000","last_change":"2024-09-12T01:11:46.448148+0000","last_active":"2024-09-12T01:11:46.448148+0000","last_peered":"2024-09-12T01:11:46.448148+0000","last_clean":"2024-09-12T01:11:46.448148+0000","last_became_active":"2024-09-12T00:46:54.887134+0000","last_became_peered":"2024-09-12T00:46:54.887134+0000","last_unstale":"2024-09-12T01:11:46.448148+0000","last_undegraded":"2024-09-12T01:11:46.448148+0000","last_fullsized":"2024-09-12T01:11:46.448148+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:46.447997+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:46.447997+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.447997+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:21.737874+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"263'9","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.736249+0000","last_change":"2024-09-12T01:11:54.736249+0000","last_active":"2024-09-12T01:11:54.736249+0000","last_peered":"2024-09-12T01:11:54.736249+0000","last_clean":"2024-09-12T01:11:54.736249+0000","last_became_active":"2024-09-12T00:30:17.766203+0000","last_became_peered":"2024-09-12T00:30:17.766203+0000","last_unstale":"2024-09-12T01:11:54.736249+0000","last_undegraded":"2024-09-12T01:11:54.736249+0000","last_fullsized":"2024-09-12T01:11:54.736249+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-12T01:11:54.736161+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-12T01:11:54.736161+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.736161+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:25.463090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13412,"num_write":14,"num_write_kb":9266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.236429+0000","last_change":"2024-09-12T01:11:33.236429+0000","last_active":"2024-09-12T01:11:33.236429+0000","last_peered":"2024-09-12T01:11:33.236429+0000","last_clean":"2024-09-12T01:11:33.236429+0000","last_became_active":"2024-09-12T00:30:14.746119+0000","last_became_peered":"2024-09-12T00:30:14.746119+0000","last_unstale":"2024-09-12T01:11:33.236429+0000","last_undegraded":"2024-09-12T01:11:33.236429+0000","last_fullsized":"2024-09-12T01:11:33.236429+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.236340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.236340+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.236340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:17.037415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"263'39","reported_seq":160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.429235+0000","last_change":"2024-09-12T01:11:42.429235+0000","last_active":"2024-09-12T01:11:42.429235+0000","last_peered":"2024-09-12T01:11:42.429235+0000","last_clean":"2024-09-12T01:11:42.429235+0000","last_became_active":"2024-09-12T00:27:42.846198+0000","last_became_peered":"2024-09-12T00:27:42.846198+0000","last_unstale":"2024-09-12T01:11:42.429235+0000","last_undegraded":"2024-09-12T01:11:42.429235+0000","last_fullsized":"2024-09-12T01:11:42.429235+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-09-12T01:11:42.429137+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-09-12T01:11:42.429137+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.429137+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:15.211546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":138,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.239313+0000","last_change":"2024-09-12T01:11:47.239313+0000","last_active":"2024-09-12T01:11:47.239313+0000","last_peered":"2024-09-12T01:11:47.239313+0000","last_clean":"2024-09-12T01:11:47.239313+0000","last_became_active":"2024-09-12T00:46:54.885879+0000","last_became_peered":"2024-09-12T00:46:54.885879+0000","last_unstale":"2024-09-12T01:11:47.239313+0000","last_undegraded":"2024-09-12T01:11:47.239313+0000","last_fullsized":"2024-09-12T01:11:47.239313+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:47.239188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:47.239188+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.239188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:52.705498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"260'5","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.599879+0000","last_change":"2024-09-12T01:11:50.599879+0000","last_active":"2024-09-12T01:11:50.599879+0000","last_peered":"2024-09-12T01:11:50.599879+0000","last_clean":"2024-09-12T01:11:50.599879+0000","last_became_active":"2024-09-12T00:30:17.769051+0000","last_became_peered":"2024-09-12T00:30:17.769051+0000","last_unstale":"2024-09-12T01:11:50.599879+0000","last_undegraded":"2024-09-12T01:11:50.599879+0000","last_fullsized":"2024-09-12T01:11:50.599879+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:11:50.599780+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:11:50.599780+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.599780+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:48.876562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"263'8","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.649225+0000","last_change":"2024-09-12T01:11:45.649225+0000","last_active":"2024-09-12T01:11:45.649225+0000","last_peered":"2024-09-12T01:11:45.649225+0000","last_clean":"2024-09-12T01:11:45.649225+0000","last_became_active":"2024-09-12T00:30:14.743083+0000","last_became_peered":"2024-09-12T00:30:14.743083+0000","last_unstale":"2024-09-12T01:11:45.649225+0000","last_undegraded":"2024-09-12T01:11:45.649225+0000","last_fullsized":"2024-09-12T01:11:45.649225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T01:11:45.649123+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T01:11:45.649123+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.649123+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:19.130722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"263'33","reported_seq":147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.647382+0000","last_change":"2024-09-12T01:11:35.647382+0000","last_active":"2024-09-12T01:11:35.647382+0000","last_peered":"2024-09-12T01:11:35.647382+0000","last_clean":"2024-09-12T01:11:35.647382+0000","last_became_active":"2024-09-12T00:27:42.839063+0000","last_became_peered":"2024-09-12T00:27:42.839063+0000","last_unstale":"2024-09-12T01:11:35.647382+0000","last_undegraded":"2024-09-12T01:11:35.647382+0000","last_fullsized":"2024-09-12T01:11:35.647382+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'33","last_scrub_stamp":"2024-09-12T01:11:35.647295+0000","last_deep_scrub":"263'33","last_deep_scrub_stamp":"2024-09-12T01:11:35.647295+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.647295+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:24.914272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":119,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.251140+0000","last_change":"2024-09-12T01:11:41.251140+0000","last_active":"2024-09-12T01:11:41.251140+0000","last_peered":"2024-09-12T01:11:41.251140+0000","last_clean":"2024-09-12T01:11:41.251140+0000","last_became_active":"2024-09-12T00:46:54.887450+0000","last_became_peered":"2024-09-12T00:46:54.887450+0000","last_unstale":"2024-09-12T01:11:41.251140+0000","last_undegraded":"2024-09-12T01:11:41.251140+0000","last_fullsized":"2024-09-12T01:11:41.251140+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:41.251052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:41.251052+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.251052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:57.971441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"260'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.265271+0000","last_change":"2024-09-12T01:11:36.265271+0000","last_active":"2024-09-12T01:11:36.265271+0000","last_peered":"2024-09-12T01:11:36.265271+0000","last_clean":"2024-09-12T01:11:36.265271+0000","last_became_active":"2024-09-12T00:30:17.756342+0000","last_became_peered":"2024-09-12T00:30:17.756342+0000","last_unstale":"2024-09-12T01:11:36.265271+0000","last_undegraded":"2024-09-12T01:11:36.265271+0000","last_fullsized":"2024-09-12T01:11:36.265271+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-12T01:11:36.265182+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-12T01:11:36.265182+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.265182+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:21.472602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.828596+0000","last_change":"2024-09-12T01:11:46.828596+0000","last_active":"2024-09-12T01:11:46.828596+0000","last_peered":"2024-09-12T01:11:46.828596+0000","last_clean":"2024-09-12T01:11:46.828596+0000","last_became_active":"2024-09-12T00:30:14.748446+0000","last_became_peered":"2024-09-12T00:30:14.748446+0000","last_unstale":"2024-09-12T01:11:46.828596+0000","last_undegraded":"2024-09-12T01:11:46.828596+0000","last_fullsized":"2024-09-12T01:11:46.828596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:46.828513+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:46.828513+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.828513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:00.099207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"263'23","reported_seq":115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.433786+0000","last_change":"2024-09-12T01:11:56.433663+0000","last_active":"2024-09-12T01:11:56.433786+0000","last_peered":"2024-09-12T01:11:56.433786+0000","last_clean":"2024-09-12T01:11:56.433786+0000","last_became_active":"2024-09-12T00:27:42.845379+0000","last_became_peered":"2024-09-12T00:27:42.845379+0000","last_unstale":"2024-09-12T01:11:56.433786+0000","last_undegraded":"2024-09-12T01:11:56.433786+0000","last_fullsized":"2024-09-12T01:11:56.433786+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'23","last_scrub_stamp":"2024-09-12T01:11:56.433559+0000","last_deep_scrub":"263'23","last_deep_scrub_stamp":"2024-09-12T01:11:56.433559+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.433559+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:23.210318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":72,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:02.772822+0000","last_change":"2024-09-12T01:12:02.772822+0000","last_active":"2024-09-12T01:12:02.772822+0000","last_peered":"2024-09-12T01:12:02.772822+0000","last_clean":"2024-09-12T01:12:02.772822+0000","last_became_active":"2024-09-12T00:46:54.883713+0000","last_became_peered":"2024-09-12T00:46:54.883713+0000","last_unstale":"2024-09-12T01:12:02.772822+0000","last_undegraded":"2024-09-12T01:12:02.772822+0000","last_fullsized":"2024-09-12T01:12:02.772822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:02.772725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:02.772725+0000","last_clean_scrub_stamp":"2024-09-12T01:12:02.772725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:08.576364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"263'7","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.797538+0000","last_change":"2024-09-12T01:11:52.797444+0000","last_active":"2024-09-12T01:11:52.797538+0000","last_peered":"2024-09-12T01:11:52.797538+0000","last_clean":"2024-09-12T01:11:52.797538+0000","last_became_active":"2024-09-12T00:30:17.764165+0000","last_became_peered":"2024-09-12T00:30:17.764165+0000","last_unstale":"2024-09-12T01:11:52.797538+0000","last_undegraded":"2024-09-12T01:11:52.797538+0000","last_fullsized":"2024-09-12T01:11:52.797538+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-12T01:11:52.797346+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-12T01:11:52.797346+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.797346+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:05.658984+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":3074,"num_write":12,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.346287+0000","last_change":"2024-09-12T01:11:38.346199+0000","last_active":"2024-09-12T01:11:38.346287+0000","last_peered":"2024-09-12T01:11:38.346287+0000","last_clean":"2024-09-12T01:11:38.346287+0000","last_became_active":"2024-09-12T00:30:14.747184+0000","last_became_peered":"2024-09-12T00:30:14.747184+0000","last_unstale":"2024-09-12T01:11:38.346287+0000","last_undegraded":"2024-09-12T01:11:38.346287+0000","last_fullsized":"2024-09-12T01:11:38.346287+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:11:38.346116+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:11:38.346116+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.346116+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:57.130618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4144,"num_write":4,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"263'77","reported_seq":309,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.462228+0000","last_change":"2024-09-12T01:11:55.462148+0000","last_active":"2024-09-12T01:11:55.462228+0000","last_peered":"2024-09-12T01:11:55.462228+0000","last_clean":"2024-09-12T01:11:55.462228+0000","last_became_active":"2024-09-12T00:27:42.846108+0000","last_became_peered":"2024-09-12T00:27:42.846108+0000","last_unstale":"2024-09-12T01:11:55.462228+0000","last_undegraded":"2024-09-12T01:11:55.462228+0000","last_fullsized":"2024-09-12T01:11:55.462228+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'77","last_scrub_stamp":"2024-09-12T01:11:55.462059+0000","last_deep_scrub":"263'77","last_deep_scrub_stamp":"2024-09-12T01:11:55.462059+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.462059+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:24.541395+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":337,"num_write":98,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2988,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.474051+0000","last_change":"2024-09-12T01:11:48.474051+0000","last_active":"2024-09-12T01:11:48.474051+0000","last_peered":"2024-09-12T01:11:48.474051+0000","last_clean":"2024-09-12T01:11:48.474051+0000","last_became_active":"2024-09-12T00:46:54.889496+0000","last_became_peered":"2024-09-12T00:46:54.889496+0000","last_unstale":"2024-09-12T01:11:48.474051+0000","last_undegraded":"2024-09-12T01:11:48.474051+0000","last_fullsized":"2024-09-12T01:11:48.474051+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:48.473946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:48.473946+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.473946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:29.558693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.830781+0000","last_change":"2024-09-12T01:11:59.830680+0000","last_active":"2024-09-12T01:11:59.830781+0000","last_peered":"2024-09-12T01:11:59.830781+0000","last_clean":"2024-09-12T01:11:59.830781+0000","last_became_active":"2024-09-12T00:30:17.767526+0000","last_became_peered":"2024-09-12T00:30:17.767526+0000","last_unstale":"2024-09-12T01:11:59.830781+0000","last_undegraded":"2024-09-12T01:11:59.830781+0000","last_fullsized":"2024-09-12T01:11:59.830781+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:59.830586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:59.830586+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.830586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:10.326486+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"263'5","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.846482+0000","last_change":"2024-09-12T01:11:45.846392+0000","last_active":"2024-09-12T01:11:45.846482+0000","last_peered":"2024-09-12T01:11:45.846482+0000","last_clean":"2024-09-12T01:11:45.846482+0000","last_became_active":"2024-09-12T00:30:14.749104+0000","last_became_peered":"2024-09-12T00:30:14.749104+0000","last_unstale":"2024-09-12T01:11:45.846482+0000","last_undegraded":"2024-09-12T01:11:45.846482+0000","last_fullsized":"2024-09-12T01:11:45.846482+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:11:45.846273+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:11:45.846273+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.846273+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:59.739185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"263'28","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.688565+0000","last_change":"2024-09-12T01:11:34.688493+0000","last_active":"2024-09-12T01:11:34.688565+0000","last_peered":"2024-09-12T01:11:34.688565+0000","last_clean":"2024-09-12T01:11:34.688565+0000","last_became_active":"2024-09-12T00:27:42.840749+0000","last_became_peered":"2024-09-12T00:27:42.840749+0000","last_unstale":"2024-09-12T01:11:34.688565+0000","last_undegraded":"2024-09-12T01:11:34.688565+0000","last_fullsized":"2024-09-12T01:11:34.688565+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-12T01:11:34.688404+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-12T01:11:34.688404+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.688404+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:36.384869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":101,"num_write":50,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.410117+0000","last_change":"2024-09-12T01:11:50.410117+0000","last_active":"2024-09-12T01:11:50.410117+0000","last_peered":"2024-09-12T01:11:50.410117+0000","last_clean":"2024-09-12T01:11:50.410117+0000","last_became_active":"2024-09-12T00:46:54.875939+0000","last_became_peered":"2024-09-12T00:46:54.875939+0000","last_unstale":"2024-09-12T01:11:50.410117+0000","last_undegraded":"2024-09-12T01:11:50.410117+0000","last_fullsized":"2024-09-12T01:11:50.410117+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:50.410026+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:50.410026+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.410026+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:29.961189+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.618680+0000","last_change":"2024-09-12T01:11:48.618610+0000","last_active":"2024-09-12T01:11:48.618680+0000","last_peered":"2024-09-12T01:11:48.618680+0000","last_clean":"2024-09-12T01:11:48.618680+0000","last_became_active":"2024-09-12T00:30:17.761182+0000","last_became_peered":"2024-09-12T00:30:17.761182+0000","last_unstale":"2024-09-12T01:11:48.618680+0000","last_undegraded":"2024-09-12T01:11:48.618680+0000","last_fullsized":"2024-09-12T01:11:48.618680+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:48.618512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:48.618512+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.618512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:53.833538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"260'5","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.210070+0000","last_change":"2024-09-12T01:11:43.209970+0000","last_active":"2024-09-12T01:11:43.210070+0000","last_peered":"2024-09-12T01:11:43.210070+0000","last_clean":"2024-09-12T01:11:43.210070+0000","last_became_active":"2024-09-12T00:30:14.747887+0000","last_became_peered":"2024-09-12T00:30:14.747887+0000","last_unstale":"2024-09-12T01:11:43.210070+0000","last_undegraded":"2024-09-12T01:11:43.210070+0000","last_fullsized":"2024-09-12T01:11:43.210070+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:11:43.209850+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:11:43.209850+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.209850+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:12.023552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'77","reported_seq":322,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.256977+0000","last_change":"2024-09-12T01:11:36.256919+0000","last_active":"2024-09-12T01:11:36.256977+0000","last_peered":"2024-09-12T01:11:36.256977+0000","last_clean":"2024-09-12T01:11:36.256977+0000","last_became_active":"2024-09-12T00:27:42.839295+0000","last_became_peered":"2024-09-12T00:27:42.839295+0000","last_unstale":"2024-09-12T01:11:36.256977+0000","last_undegraded":"2024-09-12T01:11:36.256977+0000","last_fullsized":"2024-09-12T01:11:36.256977+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'77","last_scrub_stamp":"2024-09-12T01:11:36.256834+0000","last_deep_scrub":"263'77","last_deep_scrub_stamp":"2024-09-12T01:11:36.256834+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.256834+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:36.670777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":514,"num_read_kb":349,"num_write":102,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3012,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"263'2","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.457463+0000","last_change":"2024-09-12T01:11:47.457463+0000","last_active":"2024-09-12T01:11:47.457463+0000","last_peered":"2024-09-12T01:11:47.457463+0000","last_clean":"2024-09-12T01:11:47.457463+0000","last_became_active":"2024-09-12T00:46:54.880982+0000","last_became_peered":"2024-09-12T00:46:54.880982+0000","last_unstale":"2024-09-12T01:11:47.457463+0000","last_undegraded":"2024-09-12T01:11:47.457463+0000","last_fullsized":"2024-09-12T01:11:47.457463+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:47.457379+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:47.457379+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.457379+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:56.693099+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:06.412032+0000","last_change":"2024-09-12T01:12:06.411917+0000","last_active":"2024-09-12T01:12:06.412032+0000","last_peered":"2024-09-12T01:12:06.412032+0000","last_clean":"2024-09-12T01:12:06.412032+0000","last_became_active":"2024-09-12T00:30:17.765384+0000","last_became_peered":"2024-09-12T00:30:17.765384+0000","last_unstale":"2024-09-12T01:12:06.412032+0000","last_undegraded":"2024-09-12T01:12:06.412032+0000","last_fullsized":"2024-09-12T01:12:06.412032+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:12:06.411800+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:12:06.411800+0000","last_clean_scrub_stamp":"2024-09-12T01:12:06.411800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:26.188754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.334063+0000","last_change":"2024-09-12T01:11:39.333996+0000","last_active":"2024-09-12T01:11:39.334063+0000","last_peered":"2024-09-12T01:11:39.334063+0000","last_clean":"2024-09-12T01:11:39.334063+0000","last_became_active":"2024-09-12T00:30:14.750407+0000","last_became_peered":"2024-09-12T00:30:14.750407+0000","last_unstale":"2024-09-12T01:11:39.334063+0000","last_undegraded":"2024-09-12T01:11:39.334063+0000","last_fullsized":"2024-09-12T01:11:39.334063+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:39.333911+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:39.333911+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.333911+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:53.757755+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5691,"num_write":6,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"263'35","reported_seq":155,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.660766+0000","last_change":"2024-09-12T01:11:33.660661+0000","last_active":"2024-09-12T01:11:33.660766+0000","last_peered":"2024-09-12T01:11:33.660766+0000","last_clean":"2024-09-12T01:11:33.660766+0000","last_became_active":"2024-09-12T00:27:42.840137+0000","last_became_peered":"2024-09-12T00:27:42.840137+0000","last_unstale":"2024-09-12T01:11:33.660766+0000","last_undegraded":"2024-09-12T01:11:33.660766+0000","last_fullsized":"2024-09-12T01:11:33.660766+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'35","last_scrub_stamp":"2024-09-12T01:11:33.660566+0000","last_deep_scrub":"263'35","last_deep_scrub_stamp":"2024-09-12T01:11:33.660566+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.660566+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:21.665420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":132,"num_write":59,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:56.785903+0000","last_change":"2024-09-12T01:11:56.785903+0000","last_active":"2024-09-12T01:11:56.785903+0000","last_peered":"2024-09-12T01:11:56.785903+0000","last_clean":"2024-09-12T01:11:56.785903+0000","last_became_active":"2024-09-12T00:46:54.888207+0000","last_became_peered":"2024-09-12T00:46:54.888207+0000","last_unstale":"2024-09-12T01:11:56.785903+0000","last_undegraded":"2024-09-12T01:11:56.785903+0000","last_fullsized":"2024-09-12T01:11:56.785903+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:56.785761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:56.785761+0000","last_clean_scrub_stamp":"2024-09-12T01:11:56.785761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.539260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'7","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.611328+0000","last_change":"2024-09-12T01:11:47.611328+0000","last_active":"2024-09-12T01:11:47.611328+0000","last_peered":"2024-09-12T01:11:47.611328+0000","last_clean":"2024-09-12T01:11:47.611328+0000","last_became_active":"2024-09-12T00:30:17.763106+0000","last_became_peered":"2024-09-12T00:30:17.763106+0000","last_unstale":"2024-09-12T01:11:47.611328+0000","last_undegraded":"2024-09-12T01:11:47.611328+0000","last_fullsized":"2024-09-12T01:11:47.611328+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-12T01:11:47.611233+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-12T01:11:47.611233+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.611233+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:38.429762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"263'3","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.250694+0000","last_change":"2024-09-12T01:11:40.250694+0000","last_active":"2024-09-12T01:11:40.250694+0000","last_peered":"2024-09-12T01:11:40.250694+0000","last_clean":"2024-09-12T01:11:40.250694+0000","last_became_active":"2024-09-12T00:30:14.746069+0000","last_became_peered":"2024-09-12T00:30:14.746069+0000","last_unstale":"2024-09-12T01:11:40.250694+0000","last_undegraded":"2024-09-12T01:11:40.250694+0000","last_fullsized":"2024-09-12T01:11:40.250694+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:11:40.250607+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:11:40.250607+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.250607+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:41.014709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"263'41","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.656174+0000","last_change":"2024-09-12T01:11:32.656174+0000","last_active":"2024-09-12T01:11:32.656174+0000","last_peered":"2024-09-12T01:11:32.656174+0000","last_clean":"2024-09-12T01:11:32.656174+0000","last_became_active":"2024-09-12T00:27:42.841530+0000","last_became_peered":"2024-09-12T00:27:42.841530+0000","last_unstale":"2024-09-12T01:11:32.656174+0000","last_undegraded":"2024-09-12T01:11:32.656174+0000","last_fullsized":"2024-09-12T01:11:32.656174+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:11:32.656093+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:11:32.656093+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.656093+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:14.450082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.222599+0000","last_change":"2024-09-12T01:11:44.222599+0000","last_active":"2024-09-12T01:11:44.222599+0000","last_peered":"2024-09-12T01:11:44.222599+0000","last_clean":"2024-09-12T01:11:44.222599+0000","last_became_active":"2024-09-12T00:46:54.885842+0000","last_became_peered":"2024-09-12T00:46:54.885842+0000","last_unstale":"2024-09-12T01:11:44.222599+0000","last_undegraded":"2024-09-12T01:11:44.222599+0000","last_fullsized":"2024-09-12T01:11:44.222599+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.222520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.222520+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.222520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:58.261245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"260'6","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.584161+0000","last_change":"2024-09-12T01:11:43.584161+0000","last_active":"2024-09-12T01:11:43.584161+0000","last_peered":"2024-09-12T01:11:43.584161+0000","last_clean":"2024-09-12T01:11:43.584161+0000","last_became_active":"2024-09-12T00:30:17.765404+0000","last_became_peered":"2024-09-12T00:30:17.765404+0000","last_unstale":"2024-09-12T01:11:43.584161+0000","last_undegraded":"2024-09-12T01:11:43.584161+0000","last_fullsized":"2024-09-12T01:11:43.584161+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'6","last_scrub_stamp":"2024-09-12T01:11:43.584062+0000","last_deep_scrub":"260'6","last_deep_scrub_stamp":"2024-09-12T01:11:43.584062+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.584062+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:01.084763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16386,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.465660+0000","last_change":"2024-09-12T01:11:44.465660+0000","last_active":"2024-09-12T01:11:44.465660+0000","last_peered":"2024-09-12T01:11:44.465660+0000","last_clean":"2024-09-12T01:11:44.465660+0000","last_became_active":"2024-09-12T00:30:14.743148+0000","last_became_peered":"2024-09-12T00:30:14.743148+0000","last_unstale":"2024-09-12T01:11:44.465660+0000","last_undegraded":"2024-09-12T01:11:44.465660+0000","last_fullsized":"2024-09-12T01:11:44.465660+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.465571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.465571+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.465571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:28.615096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"263'37","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:54.486303+0000","last_change":"2024-09-12T01:11:54.486303+0000","last_active":"2024-09-12T01:11:54.486303+0000","last_peered":"2024-09-12T01:11:54.486303+0000","last_clean":"2024-09-12T01:11:54.486303+0000","last_became_active":"2024-09-12T00:27:42.846090+0000","last_became_peered":"2024-09-12T00:27:42.846090+0000","last_unstale":"2024-09-12T01:11:54.486303+0000","last_undegraded":"2024-09-12T01:11:54.486303+0000","last_fullsized":"2024-09-12T01:11:54.486303+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'37","last_scrub_stamp":"2024-09-12T01:11:54.486208+0000","last_deep_scrub":"263'37","last_deep_scrub_stamp":"2024-09-12T01:11:54.486208+0000","last_clean_scrub_stamp":"2024-09-12T01:11:54.486208+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:10.646913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":132,"num_write":69,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:10.526741+0000","last_change":"2024-09-12T01:12:10.526741+0000","last_active":"2024-09-12T01:12:10.526741+0000","last_peered":"2024-09-12T01:12:10.526741+0000","last_clean":"2024-09-12T01:12:10.526741+0000","last_became_active":"2024-09-12T00:46:54.883024+0000","last_became_peered":"2024-09-12T00:46:54.883024+0000","last_unstale":"2024-09-12T01:12:10.526741+0000","last_undegraded":"2024-09-12T01:12:10.526741+0000","last_fullsized":"2024-09-12T01:12:10.526741+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:10.526650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:10.526650+0000","last_clean_scrub_stamp":"2024-09-12T01:12:10.526650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:15.517408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.608595+0000","last_change":"2024-09-12T01:11:44.608595+0000","last_active":"2024-09-12T01:11:44.608595+0000","last_peered":"2024-09-12T01:11:44.608595+0000","last_clean":"2024-09-12T01:11:44.608595+0000","last_became_active":"2024-09-12T00:30:17.769226+0000","last_became_peered":"2024-09-12T00:30:17.769226+0000","last_unstale":"2024-09-12T01:11:44.608595+0000","last_undegraded":"2024-09-12T01:11:44.608595+0000","last_fullsized":"2024-09-12T01:11:44.608595+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:44.608500+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:44.608500+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.608500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:47.547326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"260'4","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.586898+0000","last_change":"2024-09-12T01:11:41.586898+0000","last_active":"2024-09-12T01:11:41.586898+0000","last_peered":"2024-09-12T01:11:41.586898+0000","last_clean":"2024-09-12T01:11:41.586898+0000","last_became_active":"2024-09-12T00:30:14.740963+0000","last_became_peered":"2024-09-12T00:30:14.740963+0000","last_unstale":"2024-09-12T01:11:41.586898+0000","last_undegraded":"2024-09-12T01:11:41.586898+0000","last_fullsized":"2024-09-12T01:11:41.586898+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-12T01:11:41.586800+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-12T01:11:41.586800+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.586800+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:53.601971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"263'30","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.338328+0000","last_change":"2024-09-12T01:11:35.338328+0000","last_active":"2024-09-12T01:11:35.338328+0000","last_peered":"2024-09-12T01:11:35.338328+0000","last_clean":"2024-09-12T01:11:35.338328+0000","last_became_active":"2024-09-12T00:27:42.834942+0000","last_became_peered":"2024-09-12T00:27:42.834942+0000","last_unstale":"2024-09-12T01:11:35.338328+0000","last_undegraded":"2024-09-12T01:11:35.338328+0000","last_fullsized":"2024-09-12T01:11:35.338328+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'30","last_scrub_stamp":"2024-09-12T01:11:35.338210+0000","last_deep_scrub":"263'30","last_deep_scrub_stamp":"2024-09-12T01:11:35.338210+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.338210+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:15.421635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":105,"num_write":60,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.250915+0000","last_change":"2024-09-12T01:11:42.250915+0000","last_active":"2024-09-12T01:11:42.250915+0000","last_peered":"2024-09-12T01:11:42.250915+0000","last_clean":"2024-09-12T01:11:42.250915+0000","last_became_active":"2024-09-12T00:46:54.887303+0000","last_became_peered":"2024-09-12T00:46:54.887303+0000","last_unstale":"2024-09-12T01:11:42.250915+0000","last_undegraded":"2024-09-12T01:11:42.250915+0000","last_fullsized":"2024-09-12T01:11:42.250915+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:42.250816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:42.250816+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.250816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:51.359281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.819642+0000","last_change":"2024-09-12T01:11:51.819642+0000","last_active":"2024-09-12T01:11:51.819642+0000","last_peered":"2024-09-12T01:11:51.819642+0000","last_clean":"2024-09-12T01:11:51.819642+0000","last_became_active":"2024-09-12T00:30:17.768072+0000","last_became_peered":"2024-09-12T00:30:17.768072+0000","last_unstale":"2024-09-12T01:11:51.819642+0000","last_undegraded":"2024-09-12T01:11:51.819642+0000","last_fullsized":"2024-09-12T01:11:51.819642+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:51.819556+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:51.819556+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.819556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:46.982674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"263'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.624151+0000","last_change":"2024-09-12T01:11:40.624151+0000","last_active":"2024-09-12T01:11:40.624151+0000","last_peered":"2024-09-12T01:11:40.624151+0000","last_clean":"2024-09-12T01:11:40.624151+0000","last_became_active":"2024-09-12T00:30:14.744485+0000","last_became_peered":"2024-09-12T00:30:14.744485+0000","last_unstale":"2024-09-12T01:11:40.624151+0000","last_undegraded":"2024-09-12T01:11:40.624151+0000","last_fullsized":"2024-09-12T01:11:40.624151+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:40.624068+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:40.624068+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.624068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:32.466602+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"263'50","reported_seq":203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.515495+0000","last_change":"2024-09-12T01:11:39.515495+0000","last_active":"2024-09-12T01:11:39.515495+0000","last_peered":"2024-09-12T01:11:39.515495+0000","last_clean":"2024-09-12T01:11:39.515495+0000","last_became_active":"2024-09-12T00:27:42.838771+0000","last_became_peered":"2024-09-12T00:27:42.838771+0000","last_unstale":"2024-09-12T01:11:39.515495+0000","last_undegraded":"2024-09-12T01:11:39.515495+0000","last_fullsized":"2024-09-12T01:11:39.515495+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'50","last_scrub_stamp":"2024-09-12T01:11:39.515412+0000","last_deep_scrub":"263'50","last_deep_scrub_stamp":"2024-09-12T01:11:39.515412+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.515412+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:41.609350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":194,"num_write":94,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.789316+0000","last_change":"2024-09-12T01:12:00.789316+0000","last_active":"2024-09-12T01:12:00.789316+0000","last_peered":"2024-09-12T01:12:00.789316+0000","last_clean":"2024-09-12T01:12:00.789316+0000","last_became_active":"2024-09-12T00:46:54.883927+0000","last_became_peered":"2024-09-12T00:46:54.883927+0000","last_unstale":"2024-09-12T01:12:00.789316+0000","last_undegraded":"2024-09-12T01:12:00.789316+0000","last_fullsized":"2024-09-12T01:12:00.789316+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:00.789222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:00.789222+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.789222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:38.749055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:05.365374+0000","last_change":"2024-09-12T01:12:05.365374+0000","last_active":"2024-09-12T01:12:05.365374+0000","last_peered":"2024-09-12T01:12:05.365374+0000","last_clean":"2024-09-12T01:12:05.365374+0000","last_became_active":"2024-09-12T00:30:17.761176+0000","last_became_peered":"2024-09-12T00:30:17.761176+0000","last_unstale":"2024-09-12T01:12:05.365374+0000","last_undegraded":"2024-09-12T01:12:05.365374+0000","last_fullsized":"2024-09-12T01:12:05.365374+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:12:05.365274+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:12:05.365274+0000","last_clean_scrub_stamp":"2024-09-12T01:12:05.365274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:16.991500+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"263'2","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.692024+0000","last_change":"2024-09-12T01:11:38.692024+0000","last_active":"2024-09-12T01:11:38.692024+0000","last_peered":"2024-09-12T01:11:38.692024+0000","last_clean":"2024-09-12T01:11:38.692024+0000","last_became_active":"2024-09-12T00:30:14.743730+0000","last_became_peered":"2024-09-12T00:30:14.743730+0000","last_unstale":"2024-09-12T01:11:38.692024+0000","last_undegraded":"2024-09-12T01:11:38.692024+0000","last_fullsized":"2024-09-12T01:11:38.692024+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:38.691940+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:38.691940+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.691940+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:44.095227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"263'40","reported_seq":169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.437349+0000","last_change":"2024-09-12T01:11:35.437349+0000","last_active":"2024-09-12T01:11:35.437349+0000","last_peered":"2024-09-12T01:11:35.437349+0000","last_clean":"2024-09-12T01:11:35.437349+0000","last_became_active":"2024-09-12T00:27:42.842267+0000","last_became_peered":"2024-09-12T00:27:42.842267+0000","last_unstale":"2024-09-12T01:11:35.437349+0000","last_undegraded":"2024-09-12T01:11:35.437349+0000","last_fullsized":"2024-09-12T01:11:35.437349+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'40","last_scrub_stamp":"2024-09-12T01:11:35.437220+0000","last_deep_scrub":"263'40","last_deep_scrub_stamp":"2024-09-12T01:11:35.437220+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.437220+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:37.048393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":214,"num_read_kb":155,"num_write":62,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.233653+0000","last_change":"2024-09-12T01:11:46.233653+0000","last_active":"2024-09-12T01:11:46.233653+0000","last_peered":"2024-09-12T01:11:46.233653+0000","last_clean":"2024-09-12T01:11:46.233653+0000","last_became_active":"2024-09-12T00:46:54.889349+0000","last_became_peered":"2024-09-12T00:46:54.889349+0000","last_unstale":"2024-09-12T01:11:46.233653+0000","last_undegraded":"2024-09-12T01:11:46.233653+0000","last_fullsized":"2024-09-12T01:11:46.233653+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:46.233564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:46.233564+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.233564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:46.743926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.243873+0000","last_change":"2024-09-12T01:11:43.243873+0000","last_active":"2024-09-12T01:11:43.243873+0000","last_peered":"2024-09-12T01:11:43.243873+0000","last_clean":"2024-09-12T01:11:43.243873+0000","last_became_active":"2024-09-12T00:30:17.759769+0000","last_became_peered":"2024-09-12T00:30:17.759769+0000","last_unstale":"2024-09-12T01:11:43.243873+0000","last_undegraded":"2024-09-12T01:11:43.243873+0000","last_fullsized":"2024-09-12T01:11:43.243873+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:43.243774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:43.243774+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.243774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:38.590615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.847678+0000","last_change":"2024-09-12T01:11:44.847678+0000","last_active":"2024-09-12T01:11:44.847678+0000","last_peered":"2024-09-12T01:11:44.847678+0000","last_clean":"2024-09-12T01:11:44.847678+0000","last_became_active":"2024-09-12T00:30:14.748409+0000","last_became_peered":"2024-09-12T00:30:14.748409+0000","last_unstale":"2024-09-12T01:11:44.847678+0000","last_undegraded":"2024-09-12T01:11:44.847678+0000","last_fullsized":"2024-09-12T01:11:44.847678+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.847569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.847569+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.847569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:15.110397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"263'24","reported_seq":123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.292713+0000","last_change":"2024-09-12T01:11:35.292713+0000","last_active":"2024-09-12T01:11:35.292713+0000","last_peered":"2024-09-12T01:11:35.292713+0000","last_clean":"2024-09-12T01:11:35.292713+0000","last_became_active":"2024-09-12T00:27:42.844338+0000","last_became_peered":"2024-09-12T00:27:42.844338+0000","last_unstale":"2024-09-12T01:11:35.292713+0000","last_undegraded":"2024-09-12T01:11:35.292713+0000","last_fullsized":"2024-09-12T01:11:35.292713+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'24","last_scrub_stamp":"2024-09-12T01:11:35.292630+0000","last_deep_scrub":"263'24","last_deep_scrub_stamp":"2024-09-12T01:11:35.292630+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.292630+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:02.205316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":85,"num_write":51,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.232399+0000","last_change":"2024-09-12T01:11:43.232399+0000","last_active":"2024-09-12T01:11:43.232399+0000","last_peered":"2024-09-12T01:11:43.232399+0000","last_clean":"2024-09-12T01:11:43.232399+0000","last_became_active":"2024-09-12T00:46:54.890636+0000","last_became_peered":"2024-09-12T00:46:54.890636+0000","last_unstale":"2024-09-12T01:11:43.232399+0000","last_undegraded":"2024-09-12T01:11:43.232399+0000","last_fullsized":"2024-09-12T01:11:43.232399+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:43.232308+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:43.232308+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.232308+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:50.652215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.435967+0000","last_change":"2024-09-12T01:11:45.435967+0000","last_active":"2024-09-12T01:11:45.435967+0000","last_peered":"2024-09-12T01:11:45.435967+0000","last_clean":"2024-09-12T01:11:45.435967+0000","last_became_active":"2024-09-12T00:30:17.762239+0000","last_became_peered":"2024-09-12T00:30:17.762239+0000","last_unstale":"2024-09-12T01:11:45.435967+0000","last_undegraded":"2024-09-12T01:11:45.435967+0000","last_fullsized":"2024-09-12T01:11:45.435967+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:45.435880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:45.435880+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.435880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:23.167185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'11","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.659698+0000","last_change":"2024-09-12T01:11:39.659698+0000","last_active":"2024-09-12T01:11:39.659698+0000","last_peered":"2024-09-12T01:11:39.659698+0000","last_clean":"2024-09-12T01:11:39.659698+0000","last_became_active":"2024-09-12T00:30:14.750745+0000","last_became_peered":"2024-09-12T00:30:14.750745+0000","last_unstale":"2024-09-12T01:11:39.659698+0000","last_undegraded":"2024-09-12T01:11:39.659698+0000","last_fullsized":"2024-09-12T01:11:39.659698+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T01:11:39.659613+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T01:11:39.659613+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.659613+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:44.573741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12861,"num_write":16,"num_write_kb":9787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"263'12","reported_seq":92,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.835267+0000","last_change":"2024-09-12T01:11:43.835267+0000","last_active":"2024-09-12T01:11:43.835267+0000","last_peered":"2024-09-12T01:11:43.835267+0000","last_clean":"2024-09-12T01:11:43.835267+0000","last_became_active":"2024-09-12T00:27:42.837690+0000","last_became_peered":"2024-09-12T00:27:42.837690+0000","last_unstale":"2024-09-12T01:11:43.835267+0000","last_undegraded":"2024-09-12T01:11:43.835267+0000","last_fullsized":"2024-09-12T01:11:43.835267+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-12T01:11:43.835151+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-12T01:11:43.835151+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.835151+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:04.599994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.650576+0000","last_change":"2024-09-12T01:11:53.650576+0000","last_active":"2024-09-12T01:11:53.650576+0000","last_peered":"2024-09-12T01:11:53.650576+0000","last_clean":"2024-09-12T01:11:53.650576+0000","last_became_active":"2024-09-12T00:46:54.885262+0000","last_became_peered":"2024-09-12T00:46:54.885262+0000","last_unstale":"2024-09-12T01:11:53.650576+0000","last_undegraded":"2024-09-12T01:11:53.650576+0000","last_fullsized":"2024-09-12T01:11:53.650576+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:53.650493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:53.650493+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.650493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:54.209809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"260'7","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.271088+0000","last_change":"2024-09-12T01:11:37.271022+0000","last_active":"2024-09-12T01:11:37.271088+0000","last_peered":"2024-09-12T01:11:37.271088+0000","last_clean":"2024-09-12T01:11:37.271088+0000","last_became_active":"2024-09-12T00:30:17.761071+0000","last_became_peered":"2024-09-12T00:30:17.761071+0000","last_unstale":"2024-09-12T01:11:37.271088+0000","last_undegraded":"2024-09-12T01:11:37.271088+0000","last_fullsized":"2024-09-12T01:11:37.271088+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-12T01:11:37.270934+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-12T01:11:37.270934+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.270934+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:47.686643+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":13314,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:58.384075+0000","last_change":"2024-09-12T01:11:58.384075+0000","last_active":"2024-09-12T01:11:58.384075+0000","last_peered":"2024-09-12T01:11:58.384075+0000","last_clean":"2024-09-12T01:11:58.384075+0000","last_became_active":"2024-09-12T00:30:14.749906+0000","last_became_peered":"2024-09-12T00:30:14.749906+0000","last_unstale":"2024-09-12T01:11:58.384075+0000","last_undegraded":"2024-09-12T01:11:58.384075+0000","last_fullsized":"2024-09-12T01:11:58.384075+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:58.383982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:58.383982+0000","last_clean_scrub_stamp":"2024-09-12T01:11:58.383982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:53.112001+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"263'11","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.230893+0000","last_change":"2024-09-12T01:11:32.230893+0000","last_active":"2024-09-12T01:11:32.230893+0000","last_peered":"2024-09-12T01:11:32.230893+0000","last_clean":"2024-09-12T01:11:32.230893+0000","last_became_active":"2024-09-12T00:27:42.836870+0000","last_became_peered":"2024-09-12T00:27:42.836870+0000","last_unstale":"2024-09-12T01:11:32.230893+0000","last_undegraded":"2024-09-12T01:11:32.230893+0000","last_fullsized":"2024-09-12T01:11:32.230893+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T01:11:32.230759+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T01:11:32.230759+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.230759+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:37.663368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.248907+0000","last_change":"2024-09-12T01:11:39.248813+0000","last_active":"2024-09-12T01:11:39.248907+0000","last_peered":"2024-09-12T01:11:39.248907+0000","last_clean":"2024-09-12T01:11:39.248907+0000","last_became_active":"2024-09-12T00:46:54.891359+0000","last_became_peered":"2024-09-12T00:46:54.891359+0000","last_unstale":"2024-09-12T01:11:39.248907+0000","last_undegraded":"2024-09-12T01:11:39.248907+0000","last_fullsized":"2024-09-12T01:11:39.248907+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:39.248715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:39.248715+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.248715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:47.820662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.798084+0000","last_change":"2024-09-12T01:11:50.798014+0000","last_active":"2024-09-12T01:11:50.798084+0000","last_peered":"2024-09-12T01:11:50.798084+0000","last_clean":"2024-09-12T01:11:50.798084+0000","last_became_active":"2024-09-12T00:30:17.766810+0000","last_became_peered":"2024-09-12T00:30:17.766810+0000","last_unstale":"2024-09-12T01:11:50.798084+0000","last_undegraded":"2024-09-12T01:11:50.798084+0000","last_fullsized":"2024-09-12T01:11:50.798084+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:11:50.797923+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:11:50.797923+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.797923+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:08.045224+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:59.356865+0000","last_change":"2024-09-12T01:11:59.356865+0000","last_active":"2024-09-12T01:11:59.356865+0000","last_peered":"2024-09-12T01:11:59.356865+0000","last_clean":"2024-09-12T01:11:59.356865+0000","last_became_active":"2024-09-12T00:30:14.744334+0000","last_became_peered":"2024-09-12T00:30:14.744334+0000","last_unstale":"2024-09-12T01:11:59.356865+0000","last_undegraded":"2024-09-12T01:11:59.356865+0000","last_fullsized":"2024-09-12T01:11:59.356865+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:11:59.356765+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:11:59.356765+0000","last_clean_scrub_stamp":"2024-09-12T01:11:59.356765+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:21.563798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"263'44","reported_seq":176,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.391984+0000","last_change":"2024-09-12T01:11:43.391984+0000","last_active":"2024-09-12T01:11:43.391984+0000","last_peered":"2024-09-12T01:11:43.391984+0000","last_clean":"2024-09-12T01:11:43.391984+0000","last_became_active":"2024-09-12T00:27:42.836468+0000","last_became_peered":"2024-09-12T00:27:42.836468+0000","last_unstale":"2024-09-12T01:11:43.391984+0000","last_undegraded":"2024-09-12T01:11:43.391984+0000","last_fullsized":"2024-09-12T01:11:43.391984+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-12T01:11:43.391881+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-12T01:11:43.391881+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.391881+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:16.530349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":222,"num_read_kb":155,"num_write":77,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.254054+0000","last_change":"2024-09-12T01:11:40.254001+0000","last_active":"2024-09-12T01:11:40.254054+0000","last_peered":"2024-09-12T01:11:40.254054+0000","last_clean":"2024-09-12T01:11:40.254054+0000","last_became_active":"2024-09-12T00:46:54.888533+0000","last_became_peered":"2024-09-12T00:46:54.888533+0000","last_unstale":"2024-09-12T01:11:40.254054+0000","last_undegraded":"2024-09-12T01:11:40.254054+0000","last_fullsized":"2024-09-12T01:11:40.254054+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:40.253917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:40.253917+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.253917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:56.500777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"263'4","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.822998+0000","last_change":"2024-09-12T01:11:49.822900+0000","last_active":"2024-09-12T01:11:49.822998+0000","last_peered":"2024-09-12T01:11:49.822998+0000","last_clean":"2024-09-12T01:11:49.822998+0000","last_became_active":"2024-09-12T00:30:17.764747+0000","last_became_peered":"2024-09-12T00:30:17.764747+0000","last_unstale":"2024-09-12T01:11:49.822998+0000","last_undegraded":"2024-09-12T01:11:49.822998+0000","last_fullsized":"2024-09-12T01:11:49.822998+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:11:49.822795+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:11:49.822795+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.822795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:15.046766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"260'5","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.433221+0000","last_change":"2024-09-12T01:11:45.433151+0000","last_active":"2024-09-12T01:11:45.433221+0000","last_peered":"2024-09-12T01:11:45.433221+0000","last_clean":"2024-09-12T01:11:45.433221+0000","last_became_active":"2024-09-12T00:30:14.749668+0000","last_became_peered":"2024-09-12T00:30:14.749668+0000","last_unstale":"2024-09-12T01:11:45.433221+0000","last_undegraded":"2024-09-12T01:11:45.433221+0000","last_fullsized":"2024-09-12T01:11:45.433221+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:11:45.433062+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:11:45.433062+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.433062+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:02.494359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12290,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'44","reported_seq":178,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:53.535224+0000","last_change":"2024-09-12T01:11:53.535224+0000","last_active":"2024-09-12T01:11:53.535224+0000","last_peered":"2024-09-12T01:11:53.535224+0000","last_clean":"2024-09-12T01:11:53.535224+0000","last_became_active":"2024-09-12T00:27:42.845963+0000","last_became_peered":"2024-09-12T00:27:42.845963+0000","last_unstale":"2024-09-12T01:11:53.535224+0000","last_undegraded":"2024-09-12T01:11:53.535224+0000","last_fullsized":"2024-09-12T01:11:53.535224+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'44","last_scrub_stamp":"2024-09-12T01:11:53.535134+0000","last_deep_scrub":"263'44","last_deep_scrub_stamp":"2024-09-12T01:11:53.535134+0000","last_clean_scrub_stamp":"2024-09-12T01:11:53.535134+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:40.441738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":173,"num_write":72,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:01.795610+0000","last_change":"2024-09-12T01:12:01.795610+0000","last_active":"2024-09-12T01:12:01.795610+0000","last_peered":"2024-09-12T01:12:01.795610+0000","last_clean":"2024-09-12T01:12:01.795610+0000","last_became_active":"2024-09-12T00:46:54.884950+0000","last_became_peered":"2024-09-12T00:46:54.884950+0000","last_unstale":"2024-09-12T01:12:01.795610+0000","last_undegraded":"2024-09-12T01:12:01.795610+0000","last_fullsized":"2024-09-12T01:12:01.795610+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:01.795507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:01.795507+0000","last_clean_scrub_stamp":"2024-09-12T01:12:01.795507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:40.510032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.264155+0000","last_change":"2024-09-12T01:11:35.264155+0000","last_active":"2024-09-12T01:11:35.264155+0000","last_peered":"2024-09-12T01:11:35.264155+0000","last_clean":"2024-09-12T01:11:35.264155+0000","last_became_active":"2024-09-12T00:30:17.762415+0000","last_became_peered":"2024-09-12T00:30:17.762415+0000","last_unstale":"2024-09-12T01:11:35.264155+0000","last_undegraded":"2024-09-12T01:11:35.264155+0000","last_fullsized":"2024-09-12T01:11:35.264155+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:35.264056+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:35.264056+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.264056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:07.751580+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'6","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.281390+0000","last_change":"2024-09-12T01:11:39.281390+0000","last_active":"2024-09-12T01:11:39.281390+0000","last_peered":"2024-09-12T01:11:39.281390+0000","last_clean":"2024-09-12T01:11:39.281390+0000","last_became_active":"2024-09-12T00:30:14.748581+0000","last_became_peered":"2024-09-12T00:30:14.748581+0000","last_unstale":"2024-09-12T01:11:39.281390+0000","last_undegraded":"2024-09-12T01:11:39.281390+0000","last_fullsized":"2024-09-12T01:11:39.281390+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:39.281303+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:39.281303+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.281303+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:29.540255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"263'46","reported_seq":186,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.339068+0000","last_change":"2024-09-12T01:11:34.338999+0000","last_active":"2024-09-12T01:11:34.339068+0000","last_peered":"2024-09-12T01:11:34.339068+0000","last_clean":"2024-09-12T01:11:34.339068+0000","last_became_active":"2024-09-12T00:27:42.843968+0000","last_became_peered":"2024-09-12T00:27:42.843968+0000","last_unstale":"2024-09-12T01:11:34.339068+0000","last_undegraded":"2024-09-12T01:11:34.339068+0000","last_fullsized":"2024-09-12T01:11:34.339068+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'46","last_scrub_stamp":"2024-09-12T01:11:34.338918+0000","last_deep_scrub":"263'46","last_deep_scrub_stamp":"2024-09-12T01:11:34.338918+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.338918+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:30.360729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":171,"num_write":76,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:08.455339+0000","last_change":"2024-09-12T01:12:08.455339+0000","last_active":"2024-09-12T01:12:08.455339+0000","last_peered":"2024-09-12T01:12:08.455339+0000","last_clean":"2024-09-12T01:12:08.455339+0000","last_became_active":"2024-09-12T00:46:54.880874+0000","last_became_peered":"2024-09-12T00:46:54.880874+0000","last_unstale":"2024-09-12T01:12:08.455339+0000","last_undegraded":"2024-09-12T01:12:08.455339+0000","last_fullsized":"2024-09-12T01:12:08.455339+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:08.455231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:08.455231+0000","last_clean_scrub_stamp":"2024-09-12T01:12:08.455231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:01.786692+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"260'5","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:04.386122+0000","last_change":"2024-09-12T01:12:04.386122+0000","last_active":"2024-09-12T01:12:04.386122+0000","last_peered":"2024-09-12T01:12:04.386122+0000","last_clean":"2024-09-12T01:12:04.386122+0000","last_became_active":"2024-09-12T00:30:17.762807+0000","last_became_peered":"2024-09-12T00:30:17.762807+0000","last_unstale":"2024-09-12T01:12:04.386122+0000","last_undegraded":"2024-09-12T01:12:04.386122+0000","last_fullsized":"2024-09-12T01:12:04.386122+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-12T01:12:04.386018+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-12T01:12:04.386018+0000","last_clean_scrub_stamp":"2024-09-12T01:12:04.386018+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:43.517180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"263'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:00.359759+0000","last_change":"2024-09-12T01:12:00.359759+0000","last_active":"2024-09-12T01:12:00.359759+0000","last_peered":"2024-09-12T01:12:00.359759+0000","last_clean":"2024-09-12T01:12:00.359759+0000","last_became_active":"2024-09-12T00:30:14.749608+0000","last_became_peered":"2024-09-12T00:30:14.749608+0000","last_unstale":"2024-09-12T01:12:00.359759+0000","last_undegraded":"2024-09-12T01:12:00.359759+0000","last_fullsized":"2024-09-12T01:12:00.359759+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:12:00.359659+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:12:00.359659+0000","last_clean_scrub_stamp":"2024-09-12T01:12:00.359659+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:22.557961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"263'41","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.700866+0000","last_change":"2024-09-12T01:11:31.700866+0000","last_active":"2024-09-12T01:11:31.700866+0000","last_peered":"2024-09-12T01:11:31.700866+0000","last_clean":"2024-09-12T01:11:31.700866+0000","last_became_active":"2024-09-12T00:27:42.845889+0000","last_became_peered":"2024-09-12T00:27:42.845889+0000","last_unstale":"2024-09-12T01:11:31.700866+0000","last_undegraded":"2024-09-12T01:11:31.700866+0000","last_fullsized":"2024-09-12T01:11:31.700866+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:11:31.700770+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:11:31.700770+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.700770+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:28.675940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":162,"num_write":61,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.644638+0000","last_change":"2024-09-12T01:11:52.644638+0000","last_active":"2024-09-12T01:11:52.644638+0000","last_peered":"2024-09-12T01:11:52.644638+0000","last_clean":"2024-09-12T01:11:52.644638+0000","last_became_active":"2024-09-12T00:46:54.887206+0000","last_became_peered":"2024-09-12T00:46:54.887206+0000","last_unstale":"2024-09-12T01:11:52.644638+0000","last_undegraded":"2024-09-12T01:11:52.644638+0000","last_fullsized":"2024-09-12T01:11:52.644638+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:52.644547+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:52.644547+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.644547+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:11.152694+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.374321+0000","last_change":"2024-09-12T01:11:47.374260+0000","last_active":"2024-09-12T01:11:47.374321+0000","last_peered":"2024-09-12T01:11:47.374321+0000","last_clean":"2024-09-12T01:11:47.374321+0000","last_became_active":"2024-09-12T00:30:17.767990+0000","last_became_peered":"2024-09-12T00:30:17.767990+0000","last_unstale":"2024-09-12T01:11:47.374321+0000","last_undegraded":"2024-09-12T01:11:47.374321+0000","last_fullsized":"2024-09-12T01:11:47.374321+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-12T01:11:47.374163+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-12T01:11:47.374163+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.374163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:58.901174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.251549+0000","last_change":"2024-09-12T01:11:38.251479+0000","last_active":"2024-09-12T01:11:38.251549+0000","last_peered":"2024-09-12T01:11:38.251549+0000","last_clean":"2024-09-12T01:11:38.251549+0000","last_became_active":"2024-09-12T00:30:14.745195+0000","last_became_peered":"2024-09-12T00:30:14.745195+0000","last_unstale":"2024-09-12T01:11:38.251549+0000","last_undegraded":"2024-09-12T01:11:38.251549+0000","last_fullsized":"2024-09-12T01:11:38.251549+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:38.251373+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:38.251373+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.251373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:47.047585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"263'32","reported_seq":140,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.289095+0000","last_change":"2024-09-12T01:11:33.289095+0000","last_active":"2024-09-12T01:11:33.289095+0000","last_peered":"2024-09-12T01:11:33.289095+0000","last_clean":"2024-09-12T01:11:33.289095+0000","last_became_active":"2024-09-12T00:27:42.843841+0000","last_became_peered":"2024-09-12T00:27:42.843841+0000","last_unstale":"2024-09-12T01:11:33.289095+0000","last_undegraded":"2024-09-12T01:11:33.289095+0000","last_fullsized":"2024-09-12T01:11:33.289095+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'32","last_scrub_stamp":"2024-09-12T01:11:33.288999+0000","last_deep_scrub":"263'32","last_deep_scrub_stamp":"2024-09-12T01:11:33.288999+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.288999+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:52.548586+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":99,"num_write":65,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.428626+0000","last_change":"2024-09-12T01:11:49.428626+0000","last_active":"2024-09-12T01:11:49.428626+0000","last_peered":"2024-09-12T01:11:49.428626+0000","last_clean":"2024-09-12T01:11:49.428626+0000","last_became_active":"2024-09-12T00:46:54.884110+0000","last_became_peered":"2024-09-12T00:46:54.884110+0000","last_unstale":"2024-09-12T01:11:49.428626+0000","last_undegraded":"2024-09-12T01:11:49.428626+0000","last_fullsized":"2024-09-12T01:11:49.428626+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:49.428531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:49.428531+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.428531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:19.241137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"263'4","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:03.376079+0000","last_change":"2024-09-12T01:12:03.376079+0000","last_active":"2024-09-12T01:12:03.376079+0000","last_peered":"2024-09-12T01:12:03.376079+0000","last_clean":"2024-09-12T01:12:03.376079+0000","last_became_active":"2024-09-12T00:30:17.762850+0000","last_became_peered":"2024-09-12T00:30:17.762850+0000","last_unstale":"2024-09-12T01:12:03.376079+0000","last_undegraded":"2024-09-12T01:12:03.376079+0000","last_fullsized":"2024-09-12T01:12:03.376079+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:12:03.375993+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:12:03.375993+0000","last_clean_scrub_stamp":"2024-09-12T01:12:03.375993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:56.677407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"263'10","reported_seq":69,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:57.405642+0000","last_change":"2024-09-12T01:11:57.405642+0000","last_active":"2024-09-12T01:11:57.405642+0000","last_peered":"2024-09-12T01:11:57.405642+0000","last_clean":"2024-09-12T01:11:57.405642+0000","last_became_active":"2024-09-12T00:30:14.736286+0000","last_became_peered":"2024-09-12T00:30:14.736286+0000","last_unstale":"2024-09-12T01:11:57.405642+0000","last_undegraded":"2024-09-12T01:11:57.405642+0000","last_fullsized":"2024-09-12T01:11:57.405642+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-12T01:11:57.405519+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-12T01:11:57.405519+0000","last_clean_scrub_stamp":"2024-09-12T01:11:57.405519+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:40.979476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":20,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"263'42","reported_seq":172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:52.567454+0000","last_change":"2024-09-12T01:11:52.567454+0000","last_active":"2024-09-12T01:11:52.567454+0000","last_peered":"2024-09-12T01:11:52.567454+0000","last_clean":"2024-09-12T01:11:52.567454+0000","last_became_active":"2024-09-12T00:27:42.841880+0000","last_became_peered":"2024-09-12T00:27:42.841880+0000","last_unstale":"2024-09-12T01:11:52.567454+0000","last_undegraded":"2024-09-12T01:11:52.567454+0000","last_fullsized":"2024-09-12T01:11:52.567454+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'42","last_scrub_stamp":"2024-09-12T01:11:52.567365+0000","last_deep_scrub":"263'42","last_deep_scrub_stamp":"2024-09-12T01:11:52.567365+0000","last_clean_scrub_stamp":"2024-09-12T01:11:52.567365+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:03.380498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":149,"num_write":77,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:55.765151+0000","last_change":"2024-09-12T01:11:55.765047+0000","last_active":"2024-09-12T01:11:55.765151+0000","last_peered":"2024-09-12T01:11:55.765151+0000","last_clean":"2024-09-12T01:11:55.765151+0000","last_became_active":"2024-09-12T00:46:54.887241+0000","last_became_peered":"2024-09-12T00:46:54.887241+0000","last_unstale":"2024-09-12T01:11:55.765151+0000","last_undegraded":"2024-09-12T01:11:55.765151+0000","last_fullsized":"2024-09-12T01:11:55.765151+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:55.764940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:55.764940+0000","last_clean_scrub_stamp":"2024-09-12T01:11:55.764940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:07.905414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.206615+0000","last_change":"2024-09-12T01:11:42.206563+0000","last_active":"2024-09-12T01:11:42.206615+0000","last_peered":"2024-09-12T01:11:42.206615+0000","last_clean":"2024-09-12T01:11:42.206615+0000","last_became_active":"2024-09-12T00:30:17.763434+0000","last_became_peered":"2024-09-12T00:30:17.763434+0000","last_unstale":"2024-09-12T01:11:42.206615+0000","last_undegraded":"2024-09-12T01:11:42.206615+0000","last_fullsized":"2024-09-12T01:11:42.206615+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:42.206473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:42.206473+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.206473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:27.672537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.504732+0000","last_change":"2024-09-12T01:11:42.504674+0000","last_active":"2024-09-12T01:11:42.504732+0000","last_peered":"2024-09-12T01:11:42.504732+0000","last_clean":"2024-09-12T01:11:42.504732+0000","last_became_active":"2024-09-12T00:30:14.744954+0000","last_became_peered":"2024-09-12T00:30:14.744954+0000","last_unstale":"2024-09-12T01:11:42.504732+0000","last_undegraded":"2024-09-12T01:11:42.504732+0000","last_fullsized":"2024-09-12T01:11:42.504732+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:42.504571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:42.504571+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.504571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:04.012804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"263'51","reported_seq":190,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:51.548748+0000","last_change":"2024-09-12T01:11:51.548748+0000","last_active":"2024-09-12T01:11:51.548748+0000","last_peered":"2024-09-12T01:11:51.548748+0000","last_clean":"2024-09-12T01:11:51.548748+0000","last_became_active":"2024-09-12T00:27:42.842779+0000","last_became_peered":"2024-09-12T00:27:42.842779+0000","last_unstale":"2024-09-12T01:11:51.548748+0000","last_undegraded":"2024-09-12T01:11:51.548748+0000","last_fullsized":"2024-09-12T01:11:51.548748+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'51","last_scrub_stamp":"2024-09-12T01:11:51.548658+0000","last_deep_scrub":"263'51","last_deep_scrub_stamp":"2024-09-12T01:11:51.548658+0000","last_clean_scrub_stamp":"2024-09-12T01:11:51.548658+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:29.490362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":161,"num_write":100,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:12:09.499286+0000","last_change":"2024-09-12T01:12:09.499286+0000","last_active":"2024-09-12T01:12:09.499286+0000","last_peered":"2024-09-12T01:12:09.499286+0000","last_clean":"2024-09-12T01:12:09.499286+0000","last_became_active":"2024-09-12T00:46:54.882192+0000","last_became_peered":"2024-09-12T00:46:54.882192+0000","last_unstale":"2024-09-12T01:12:09.499286+0000","last_undegraded":"2024-09-12T01:12:09.499286+0000","last_fullsized":"2024-09-12T01:12:09.499286+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:12:09.499192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:12:09.499192+0000","last_clean_scrub_stamp":"2024-09-12T01:12:09.499192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:44.764857+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"263'6","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.202397+0000","last_change":"2024-09-12T01:11:41.202340+0000","last_active":"2024-09-12T01:11:41.202397+0000","last_peered":"2024-09-12T01:11:41.202397+0000","last_clean":"2024-09-12T01:11:41.202397+0000","last_became_active":"2024-09-12T00:30:17.756710+0000","last_became_peered":"2024-09-12T00:30:17.756710+0000","last_unstale":"2024-09-12T01:11:41.202397+0000","last_undegraded":"2024-09-12T01:11:41.202397+0000","last_fullsized":"2024-09-12T01:11:41.202397+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:41.202253+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:41.202253+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.202253+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:23.774889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"263'5","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.295951+0000","last_change":"2024-09-12T01:11:36.295864+0000","last_active":"2024-09-12T01:11:36.295951+0000","last_peered":"2024-09-12T01:11:36.295951+0000","last_clean":"2024-09-12T01:11:36.295951+0000","last_became_active":"2024-09-12T00:30:14.749353+0000","last_became_peered":"2024-09-12T00:30:14.749353+0000","last_unstale":"2024-09-12T01:11:36.295951+0000","last_undegraded":"2024-09-12T01:11:36.295951+0000","last_fullsized":"2024-09-12T01:11:36.295951+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:11:36.295742+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:11:36.295742+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.295742+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:20.185219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"260'16","reported_seq":105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.318746+0000","last_change":"2024-09-12T01:11:31.318689+0000","last_active":"2024-09-12T01:11:31.318746+0000","last_peered":"2024-09-12T01:11:31.318746+0000","last_clean":"2024-09-12T01:11:31.318746+0000","last_became_active":"2024-09-12T00:27:42.846065+0000","last_became_peered":"2024-09-12T00:27:42.846065+0000","last_unstale":"2024-09-12T01:11:31.318746+0000","last_undegraded":"2024-09-12T01:11:31.318746+0000","last_fullsized":"2024-09-12T01:11:31.318746+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'16","last_scrub_stamp":"2024-09-12T01:11:31.318604+0000","last_deep_scrub":"260'16","last_deep_scrub_stamp":"2024-09-12T01:11:31.318604+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.318604+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:58.588008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":60,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"263'368","reported_seq":1044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.199577+0000","last_change":"2024-09-12T01:11:13.199577+0000","last_active":"2024-09-12T01:11:13.199577+0000","last_peered":"2024-09-12T01:11:13.199577+0000","last_clean":"2024-09-12T01:11:13.199577+0000","last_became_active":"2024-09-12T00:12:36.041803+0000","last_became_peered":"2024-09-12T00:12:36.041803+0000","last_unstale":"2024-09-12T01:11:13.199577+0000","last_undegraded":"2024-09-12T01:11:13.199577+0000","last_fullsized":"2024-09-12T01:11:13.199577+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'368","last_scrub_stamp":"2024-09-12T01:11:13.199449+0000","last_deep_scrub":"263'368","last_deep_scrub_stamp":"2024-09-12T01:11:13.199449+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.199449+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:26.747669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48825,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":597,"num_read_kb":31202,"num_write":1169,"num_write_kb":36538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"263'78","reported_seq":677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.245203+0000","last_change":"2024-09-12T01:11:18.245203+0000","last_active":"2024-09-12T01:11:18.245203+0000","last_peered":"2024-09-12T01:11:18.245203+0000","last_clean":"2024-09-12T01:11:18.245203+0000","last_became_active":"2024-09-12T00:12:38.035848+0000","last_became_peered":"2024-09-12T00:12:38.035848+0000","last_unstale":"2024-09-12T01:11:18.245203+0000","last_undegraded":"2024-09-12T01:11:18.245203+0000","last_fullsized":"2024-09-12T01:11:18.245203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'78","last_scrub_stamp":"2024-09-12T01:11:18.245112+0000","last_deep_scrub":"263'78","last_deep_scrub_stamp":"2024-09-12T01:11:18.245112+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.245112+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:00.565463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":321,"num_write":105,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"263'468","reported_seq":1249,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.840938+0000","last_change":"2024-09-12T01:11:17.840938+0000","last_active":"2024-09-12T01:11:17.840938+0000","last_peered":"2024-09-12T01:11:17.840938+0000","last_clean":"2024-09-12T01:11:17.840938+0000","last_became_active":"2024-09-12T00:12:36.045325+0000","last_became_peered":"2024-09-12T00:12:36.045325+0000","last_unstale":"2024-09-12T01:11:17.840938+0000","last_undegraded":"2024-09-12T01:11:17.840938+0000","last_fullsized":"2024-09-12T01:11:17.840938+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'468","last_scrub_stamp":"2024-09-12T01:11:17.840763+0000","last_deep_scrub":"263'468","last_deep_scrub_stamp":"2024-09-12T01:11:17.840763+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.840763+0000","objects_scrubbed":10,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:41.998542+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6448752,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1044,"num_read_kb":48846,"num_write":1428,"num_write_kb":45958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"263'64","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.383471+0000","last_change":"2024-09-12T01:11:27.383471+0000","last_active":"2024-09-12T01:11:27.383471+0000","last_peered":"2024-09-12T01:11:27.383471+0000","last_clean":"2024-09-12T01:11:27.383471+0000","last_became_active":"2024-09-12T00:12:38.040122+0000","last_became_peered":"2024-09-12T00:12:38.040122+0000","last_unstale":"2024-09-12T01:11:27.383471+0000","last_undegraded":"2024-09-12T01:11:27.383471+0000","last_fullsized":"2024-09-12T01:11:27.383471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'64","last_scrub_stamp":"2024-09-12T01:11:27.383381+0000","last_deep_scrub":"263'64","last_deep_scrub_stamp":"2024-09-12T01:11:27.383381+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.383381+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:51.503948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":259,"num_write":92,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"263'346","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.861951+0000","last_change":"2024-09-12T01:11:16.861951+0000","last_active":"2024-09-12T01:11:16.861951+0000","last_peered":"2024-09-12T01:11:16.861951+0000","last_clean":"2024-09-12T01:11:16.861951+0000","last_became_active":"2024-09-12T00:12:36.039741+0000","last_became_peered":"2024-09-12T00:12:36.039741+0000","last_unstale":"2024-09-12T01:11:16.861951+0000","last_undegraded":"2024-09-12T01:11:16.861951+0000","last_fullsized":"2024-09-12T01:11:16.861951+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'346","last_scrub_stamp":"2024-09-12T01:11:16.861851+0000","last_deep_scrub":"263'346","last_deep_scrub_stamp":"2024-09-12T01:11:16.861851+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.861851+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:47.559046+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262217,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":26393,"num_write":1030,"num_write_kb":30200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"263'307","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.421184+0000","last_change":"2024-09-12T01:11:28.421184+0000","last_active":"2024-09-12T01:11:28.421184+0000","last_peered":"2024-09-12T01:11:28.421184+0000","last_clean":"2024-09-12T01:11:28.421184+0000","last_became_active":"2024-09-12T00:12:38.041795+0000","last_became_peered":"2024-09-12T00:12:38.041795+0000","last_unstale":"2024-09-12T01:11:28.421184+0000","last_undegraded":"2024-09-12T01:11:28.421184+0000","last_fullsized":"2024-09-12T01:11:28.421184+0000","mapping_epoch":29,"log_start":"260'200","ondisk_log_start":"260'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-12T01:11:28.421075+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-12T01:11:28.421075+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.421075+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:51.999413+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1291,"num_read_kb":1053,"num_write":447,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"263'403","reported_seq":1059,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.179422+0000","last_change":"2024-09-12T01:11:07.179422+0000","last_active":"2024-09-12T01:11:07.179422+0000","last_peered":"2024-09-12T01:11:07.179422+0000","last_clean":"2024-09-12T01:11:07.179422+0000","last_became_active":"2024-09-12T00:12:36.036970+0000","last_became_peered":"2024-09-12T00:12:36.036970+0000","last_unstale":"2024-09-12T01:11:07.179422+0000","last_undegraded":"2024-09-12T01:11:07.179422+0000","last_fullsized":"2024-09-12T01:11:07.179422+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'403","last_scrub_stamp":"2024-09-12T01:11:07.179336+0000","last_deep_scrub":"263'403","last_deep_scrub_stamp":"2024-09-12T01:11:07.179336+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.179336+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:19.036143+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":563,"num_read_kb":29211,"num_write":1250,"num_write_kb":52081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"263'61","reported_seq":609,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.432667+0000","last_change":"2024-09-12T01:11:22.432667+0000","last_active":"2024-09-12T01:11:22.432667+0000","last_peered":"2024-09-12T01:11:22.432667+0000","last_clean":"2024-09-12T01:11:22.432667+0000","last_became_active":"2024-09-12T00:12:38.039292+0000","last_became_peered":"2024-09-12T00:12:38.039292+0000","last_unstale":"2024-09-12T01:11:22.432667+0000","last_undegraded":"2024-09-12T01:11:22.432667+0000","last_fullsized":"2024-09-12T01:11:22.432667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'61","last_scrub_stamp":"2024-09-12T01:11:22.432578+0000","last_deep_scrub":"263'61","last_deep_scrub_stamp":"2024-09-12T01:11:22.432578+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.432578+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:17.788153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":265,"num_read_kb":217,"num_write":95,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"263'338","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.182576+0000","last_change":"2024-09-12T01:11:22.182576+0000","last_active":"2024-09-12T01:11:22.182576+0000","last_peered":"2024-09-12T01:11:22.182576+0000","last_clean":"2024-09-12T01:11:22.182576+0000","last_became_active":"2024-09-12T00:12:36.044021+0000","last_became_peered":"2024-09-12T00:12:36.044021+0000","last_unstale":"2024-09-12T01:11:22.182576+0000","last_undegraded":"2024-09-12T01:11:22.182576+0000","last_fullsized":"2024-09-12T01:11:22.182576+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-12T01:11:22.182412+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-12T01:11:22.182412+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.182412+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:27.695629+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730157,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":453,"num_read_kb":19079,"num_write":1003,"num_write_kb":26981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"263'448","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.134945+0000","last_change":"2024-09-12T01:11:21.134945+0000","last_active":"2024-09-12T01:11:21.134945+0000","last_peered":"2024-09-12T01:11:21.134945+0000","last_clean":"2024-09-12T01:11:21.134945+0000","last_became_active":"2024-09-12T00:12:38.037000+0000","last_became_peered":"2024-09-12T00:12:38.037000+0000","last_unstale":"2024-09-12T01:11:21.134945+0000","last_undegraded":"2024-09-12T01:11:21.134945+0000","last_fullsized":"2024-09-12T01:11:21.134945+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'448","last_scrub_stamp":"2024-09-12T01:11:21.134865+0000","last_deep_scrub":"263'448","last_deep_scrub_stamp":"2024-09-12T01:11:21.134865+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.134865+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:20.612613+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1930,"num_read_kb":1543,"num_write":735,"num_write_kb":425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":986,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"263'369","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.185720+0000","last_change":"2024-09-12T01:11:15.185720+0000","last_active":"2024-09-12T01:11:15.185720+0000","last_peered":"2024-09-12T01:11:15.185720+0000","last_clean":"2024-09-12T01:11:15.185720+0000","last_became_active":"2024-09-12T00:12:36.038235+0000","last_became_peered":"2024-09-12T00:12:36.038235+0000","last_unstale":"2024-09-12T01:11:15.185720+0000","last_undegraded":"2024-09-12T01:11:15.185720+0000","last_fullsized":"2024-09-12T01:11:15.185720+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-12T01:11:15.185608+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-12T01:11:15.185608+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.185608+0000","objects_scrubbed":8,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:57.218559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":342021,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":629,"num_read_kb":9962,"num_write":1248,"num_write_kb":25658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"263'300","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.173657+0000","last_change":"2024-09-12T01:11:17.173657+0000","last_active":"2024-09-12T01:11:17.173657+0000","last_peered":"2024-09-12T01:11:17.173657+0000","last_clean":"2024-09-12T01:11:17.173657+0000","last_became_active":"2024-09-12T00:12:38.045308+0000","last_became_peered":"2024-09-12T00:12:38.045308+0000","last_unstale":"2024-09-12T01:11:17.173657+0000","last_undegraded":"2024-09-12T01:11:17.173657+0000","last_fullsized":"2024-09-12T01:11:17.173657+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-12T01:11:17.173563+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-12T01:11:17.173563+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.173563+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:02.418536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1317,"num_read_kb":1075,"num_write":482,"num_write_kb":237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"263'325","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.176988+0000","last_change":"2024-09-12T01:11:12.176988+0000","last_active":"2024-09-12T01:11:12.176988+0000","last_peered":"2024-09-12T01:11:12.176988+0000","last_clean":"2024-09-12T01:11:12.176988+0000","last_became_active":"2024-09-12T00:12:36.041698+0000","last_became_peered":"2024-09-12T00:12:36.041698+0000","last_unstale":"2024-09-12T01:11:12.176988+0000","last_undegraded":"2024-09-12T01:11:12.176988+0000","last_fullsized":"2024-09-12T01:11:12.176988+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-09-12T01:11:12.176870+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-09-12T01:11:12.176870+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.176870+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:10.449840+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":30384,"num_write":1021,"num_write_kb":31492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"263'494","reported_seq":1263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.295295+0000","last_change":"2024-09-12T01:11:22.295295+0000","last_active":"2024-09-12T01:11:22.295295+0000","last_peered":"2024-09-12T01:11:22.295295+0000","last_clean":"2024-09-12T01:11:22.295295+0000","last_became_active":"2024-09-12T00:12:38.038023+0000","last_became_peered":"2024-09-12T00:12:38.038023+0000","last_unstale":"2024-09-12T01:11:22.295295+0000","last_undegraded":"2024-09-12T01:11:22.295295+0000","last_fullsized":"2024-09-12T01:11:22.295295+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'494","last_scrub_stamp":"2024-09-12T01:11:22.295202+0000","last_deep_scrub":"263'494","last_deep_scrub_stamp":"2024-09-12T01:11:22.295202+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.295202+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:02.301203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2347,"num_read_kb":2031,"num_write":873,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3149,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"263'296","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.890838+0000","last_change":"2024-09-12T01:11:15.890838+0000","last_active":"2024-09-12T01:11:15.890838+0000","last_peered":"2024-09-12T01:11:15.890838+0000","last_clean":"2024-09-12T01:11:15.890838+0000","last_became_active":"2024-09-12T00:12:36.050008+0000","last_became_peered":"2024-09-12T00:12:36.050008+0000","last_unstale":"2024-09-12T01:11:15.890838+0000","last_undegraded":"2024-09-12T01:11:15.890838+0000","last_fullsized":"2024-09-12T01:11:15.890838+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'296","last_scrub_stamp":"2024-09-12T01:11:15.890624+0000","last_deep_scrub":"263'296","last_deep_scrub_stamp":"2024-09-12T01:11:15.890624+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.890624+0000","objects_scrubbed":10,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:16.146979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":509,"num_read_kb":30850,"num_write":1048,"num_write_kb":20572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"263'204","reported_seq":838,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.892969+0000","last_change":"2024-09-12T01:11:26.892969+0000","last_active":"2024-09-12T01:11:26.892969+0000","last_peered":"2024-09-12T01:11:26.892969+0000","last_clean":"2024-09-12T01:11:26.892969+0000","last_became_active":"2024-09-12T00:12:38.043059+0000","last_became_peered":"2024-09-12T00:12:38.043059+0000","last_unstale":"2024-09-12T01:11:26.892969+0000","last_undegraded":"2024-09-12T01:11:26.892969+0000","last_fullsized":"2024-09-12T01:11:26.892969+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'204","last_scrub_stamp":"2024-09-12T01:11:26.892863+0000","last_deep_scrub":"263'204","last_deep_scrub_stamp":"2024-09-12T01:11:26.892863+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.892863+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:16.644574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":751,"num_write":306,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"263'111","reported_seq":708,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.340338+0000","last_change":"2024-09-12T01:11:26.340338+0000","last_active":"2024-09-12T01:11:26.340338+0000","last_peered":"2024-09-12T01:11:26.340338+0000","last_clean":"2024-09-12T01:11:26.340338+0000","last_became_active":"2024-09-12T00:12:38.040613+0000","last_became_peered":"2024-09-12T00:12:38.040613+0000","last_unstale":"2024-09-12T01:11:26.340338+0000","last_undegraded":"2024-09-12T01:11:26.340338+0000","last_fullsized":"2024-09-12T01:11:26.340338+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:11:26.340235+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:11:26.340235+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.340235+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:35.822474+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":503,"num_read_kb":420,"num_write":176,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"263'377","reported_seq":1123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.287078+0000","last_change":"2024-09-12T01:11:09.287078+0000","last_active":"2024-09-12T01:11:09.287078+0000","last_peered":"2024-09-12T01:11:09.287078+0000","last_clean":"2024-09-12T01:11:09.287078+0000","last_became_active":"2024-09-12T00:12:36.036905+0000","last_became_peered":"2024-09-12T00:12:36.036905+0000","last_unstale":"2024-09-12T01:11:09.287078+0000","last_undegraded":"2024-09-12T01:11:09.287078+0000","last_fullsized":"2024-09-12T01:11:09.287078+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:11:09.286940+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:11:09.286940+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.286940+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:09.368061+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5529645,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":592,"num_read_kb":41745,"num_write":1152,"num_write_kb":45582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"263'78","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.167491+0000","last_change":"2024-09-12T01:11:16.167491+0000","last_active":"2024-09-12T01:11:16.167491+0000","last_peered":"2024-09-12T01:11:16.167491+0000","last_clean":"2024-09-12T01:11:16.167491+0000","last_became_active":"2024-09-12T00:12:38.038478+0000","last_became_peered":"2024-09-12T00:12:38.038478+0000","last_unstale":"2024-09-12T01:11:16.167491+0000","last_undegraded":"2024-09-12T01:11:16.167491+0000","last_fullsized":"2024-09-12T01:11:16.167491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'78","last_scrub_stamp":"2024-09-12T01:11:16.167401+0000","last_deep_scrub":"263'78","last_deep_scrub_stamp":"2024-09-12T01:11:16.167401+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.167401+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:07.760102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":362,"num_read_kb":318,"num_write":110,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"263'378","reported_seq":1023,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.165463+0000","last_change":"2024-09-12T01:11:11.165463+0000","last_active":"2024-09-12T01:11:11.165463+0000","last_peered":"2024-09-12T01:11:11.165463+0000","last_clean":"2024-09-12T01:11:11.165463+0000","last_became_active":"2024-09-12T00:12:36.032821+0000","last_became_peered":"2024-09-12T00:12:36.032821+0000","last_unstale":"2024-09-12T01:11:11.165463+0000","last_undegraded":"2024-09-12T01:11:11.165463+0000","last_fullsized":"2024-09-12T01:11:11.165463+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'378","last_scrub_stamp":"2024-09-12T01:11:11.165328+0000","last_deep_scrub":"263'378","last_deep_scrub_stamp":"2024-09-12T01:11:11.165328+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.165328+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:11.501731+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3061552,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":42771,"num_write":1040,"num_write_kb":38443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"263'199","reported_seq":797,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.231959+0000","last_change":"2024-09-12T01:11:15.231959+0000","last_active":"2024-09-12T01:11:15.231959+0000","last_peered":"2024-09-12T01:11:15.231959+0000","last_clean":"2024-09-12T01:11:15.231959+0000","last_became_active":"2024-09-12T00:12:38.044169+0000","last_became_peered":"2024-09-12T00:12:38.044169+0000","last_unstale":"2024-09-12T01:11:15.231959+0000","last_undegraded":"2024-09-12T01:11:15.231959+0000","last_fullsized":"2024-09-12T01:11:15.231959+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'199","last_scrub_stamp":"2024-09-12T01:11:15.231880+0000","last_deep_scrub":"263'199","last_deep_scrub_stamp":"2024-09-12T01:11:15.231880+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.231880+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:00.268928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":833,"num_read_kb":679,"num_write":307,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"263'331","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.123297+0000","last_change":"2024-09-12T01:11:10.123297+0000","last_active":"2024-09-12T01:11:10.123297+0000","last_peered":"2024-09-12T01:11:10.123297+0000","last_clean":"2024-09-12T01:11:10.123297+0000","last_became_active":"2024-09-12T00:12:36.037200+0000","last_became_peered":"2024-09-12T00:12:36.037200+0000","last_unstale":"2024-09-12T01:11:10.123297+0000","last_undegraded":"2024-09-12T01:11:10.123297+0000","last_fullsized":"2024-09-12T01:11:10.123297+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:11:10.123156+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:11:10.123156+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.123156+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:59.788260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524447,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":1481,"num_write":1070,"num_write_kb":18199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"263'162","reported_seq":766,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.295446+0000","last_change":"2024-09-12T01:11:20.295446+0000","last_active":"2024-09-12T01:11:20.295446+0000","last_peered":"2024-09-12T01:11:20.295446+0000","last_clean":"2024-09-12T01:11:20.295446+0000","last_became_active":"2024-09-12T00:12:38.044089+0000","last_became_peered":"2024-09-12T00:12:38.044089+0000","last_unstale":"2024-09-12T01:11:20.295446+0000","last_undegraded":"2024-09-12T01:11:20.295446+0000","last_fullsized":"2024-09-12T01:11:20.295446+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-12T01:11:20.295361+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-12T01:11:20.295361+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.295361+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:32.689542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":708,"num_read_kb":583,"num_write":265,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"263'360","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.104690+0000","last_change":"2024-09-12T01:11:09.104690+0000","last_active":"2024-09-12T01:11:09.104690+0000","last_peered":"2024-09-12T01:11:09.104690+0000","last_clean":"2024-09-12T01:11:09.104690+0000","last_became_active":"2024-09-12T00:12:36.029286+0000","last_became_peered":"2024-09-12T00:12:36.029286+0000","last_unstale":"2024-09-12T01:11:09.104690+0000","last_undegraded":"2024-09-12T01:11:09.104690+0000","last_fullsized":"2024-09-12T01:11:09.104690+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-12T01:11:09.104526+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-12T01:11:09.104526+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.104526+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:00.468686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661265,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":28445,"num_write":1057,"num_write_kb":34038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"263'237","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.927199+0000","last_change":"2024-09-12T01:11:25.927199+0000","last_active":"2024-09-12T01:11:25.927199+0000","last_peered":"2024-09-12T01:11:25.927199+0000","last_clean":"2024-09-12T01:11:25.927199+0000","last_became_active":"2024-09-12T00:12:38.042387+0000","last_became_peered":"2024-09-12T00:12:38.042387+0000","last_unstale":"2024-09-12T01:11:25.927199+0000","last_undegraded":"2024-09-12T01:11:25.927199+0000","last_fullsized":"2024-09-12T01:11:25.927199+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'237","last_scrub_stamp":"2024-09-12T01:11:25.927079+0000","last_deep_scrub":"263'237","last_deep_scrub_stamp":"2024-09-12T01:11:25.927079+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.927079+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:09.717365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1130,"num_read_kb":955,"num_write":386,"num_write_kb":223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"263'350","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.214817+0000","last_change":"2024-09-12T01:11:13.214817+0000","last_active":"2024-09-12T01:11:13.214817+0000","last_peered":"2024-09-12T01:11:13.214817+0000","last_clean":"2024-09-12T01:11:13.214817+0000","last_became_active":"2024-09-12T00:12:36.034811+0000","last_became_peered":"2024-09-12T00:12:36.034811+0000","last_unstale":"2024-09-12T01:11:13.214817+0000","last_undegraded":"2024-09-12T01:11:13.214817+0000","last_fullsized":"2024-09-12T01:11:13.214817+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-12T01:11:13.214663+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-12T01:11:13.214663+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.214663+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:38.760865+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":602,"num_read_kb":22753,"num_write":1118,"num_write_kb":14938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"263'112","reported_seq":711,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.223372+0000","last_change":"2024-09-12T01:11:16.223372+0000","last_active":"2024-09-12T01:11:16.223372+0000","last_peered":"2024-09-12T01:11:16.223372+0000","last_clean":"2024-09-12T01:11:16.223372+0000","last_became_active":"2024-09-12T00:12:38.035835+0000","last_became_peered":"2024-09-12T00:12:38.035835+0000","last_unstale":"2024-09-12T01:11:16.223372+0000","last_undegraded":"2024-09-12T01:11:16.223372+0000","last_fullsized":"2024-09-12T01:11:16.223372+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'112","last_scrub_stamp":"2024-09-12T01:11:16.223277+0000","last_deep_scrub":"263'112","last_deep_scrub_stamp":"2024-09-12T01:11:16.223277+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.223277+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:36.024600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":399,"num_write":174,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"263'328","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.247820+0000","last_change":"2024-09-12T01:11:11.247820+0000","last_active":"2024-09-12T01:11:11.247820+0000","last_peered":"2024-09-12T01:11:11.247820+0000","last_clean":"2024-09-12T01:11:11.247820+0000","last_became_active":"2024-09-12T00:12:36.036060+0000","last_became_peered":"2024-09-12T00:12:36.036060+0000","last_unstale":"2024-09-12T01:11:11.247820+0000","last_undegraded":"2024-09-12T01:11:11.247820+0000","last_fullsized":"2024-09-12T01:11:11.247820+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-12T01:11:11.247654+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-12T01:11:11.247654+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.247654+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:35.548784+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568184,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":547,"num_read_kb":15680,"num_write":1014,"num_write_kb":17630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"263'133","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.232223+0000","last_change":"2024-09-12T01:11:30.232223+0000","last_active":"2024-09-12T01:11:30.232223+0000","last_peered":"2024-09-12T01:11:30.232223+0000","last_clean":"2024-09-12T01:11:30.232223+0000","last_became_active":"2024-09-12T00:12:46.059203+0000","last_became_peered":"2024-09-12T00:12:46.059203+0000","last_unstale":"2024-09-12T01:11:30.232223+0000","last_undegraded":"2024-09-12T01:11:30.232223+0000","last_fullsized":"2024-09-12T01:11:30.232223+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-12T01:11:30.232125+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-12T01:11:30.232125+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.232125+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:57.023912+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":135,"num_write":318,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"263'77","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.238332+0000","last_change":"2024-09-12T01:11:18.238332+0000","last_active":"2024-09-12T01:11:18.238332+0000","last_peered":"2024-09-12T01:11:18.238332+0000","last_clean":"2024-09-12T01:11:18.238332+0000","last_became_active":"2024-09-12T00:12:38.041964+0000","last_became_peered":"2024-09-12T00:12:38.041964+0000","last_unstale":"2024-09-12T01:11:18.238332+0000","last_undegraded":"2024-09-12T01:11:18.238332+0000","last_fullsized":"2024-09-12T01:11:18.238332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'77","last_scrub_stamp":"2024-09-12T01:11:18.238243+0000","last_deep_scrub":"263'77","last_deep_scrub_stamp":"2024-09-12T01:11:18.238243+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.238243+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:12.364311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":305,"num_read_kb":247,"num_write":113,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"263'357","reported_seq":1213,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.398737+0000","last_change":"2024-09-12T01:11:12.398737+0000","last_active":"2024-09-12T01:11:12.398737+0000","last_peered":"2024-09-12T01:11:12.398737+0000","last_clean":"2024-09-12T01:11:12.398737+0000","last_became_active":"2024-09-12T00:12:36.033666+0000","last_became_peered":"2024-09-12T00:12:36.033666+0000","last_unstale":"2024-09-12T01:11:12.398737+0000","last_undegraded":"2024-09-12T01:11:12.398737+0000","last_fullsized":"2024-09-12T01:11:12.398737+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'357","last_scrub_stamp":"2024-09-12T01:11:12.398592+0000","last_deep_scrub":"263'357","last_deep_scrub_stamp":"2024-09-12T01:11:12.398592+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.398592+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:13.468955+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2017915,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":962,"num_read_kb":16942,"num_write":1189,"num_write_kb":38560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.416465+0000","last_change":"2024-09-12T01:11:33.416465+0000","last_active":"2024-09-12T01:11:33.416465+0000","last_peered":"2024-09-12T01:11:33.416465+0000","last_clean":"2024-09-12T01:11:33.416465+0000","last_became_active":"2024-09-12T00:12:40.042778+0000","last_became_peered":"2024-09-12T00:12:40.042778+0000","last_unstale":"2024-09-12T01:11:33.416465+0000","last_undegraded":"2024-09-12T01:11:33.416465+0000","last_fullsized":"2024-09-12T01:11:33.416465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.416381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.416381+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.416381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:21.057767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"263'351","reported_seq":974,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.471401+0000","last_change":"2024-09-12T01:11:35.471401+0000","last_active":"2024-09-12T01:11:35.471401+0000","last_peered":"2024-09-12T01:11:35.471401+0000","last_clean":"2024-09-12T01:11:35.471401+0000","last_became_active":"2024-09-12T00:12:42.040764+0000","last_became_peered":"2024-09-12T00:12:42.040764+0000","last_unstale":"2024-09-12T01:11:35.471401+0000","last_undegraded":"2024-09-12T01:11:35.471401+0000","last_fullsized":"2024-09-12T01:11:35.471401+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-12T01:11:35.471303+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-12T01:11:35.471303+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.471303+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:53.053653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46776,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":561,"num_read_kb":1150,"num_write":442,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.275901+0000","last_change":"2024-09-12T01:11:32.275901+0000","last_active":"2024-09-12T01:11:32.275901+0000","last_peered":"2024-09-12T01:11:32.275901+0000","last_clean":"2024-09-12T01:11:32.275901+0000","last_became_active":"2024-09-12T00:12:44.055504+0000","last_became_peered":"2024-09-12T00:12:44.055504+0000","last_unstale":"2024-09-12T01:11:32.275901+0000","last_undegraded":"2024-09-12T01:11:32.275901+0000","last_fullsized":"2024-09-12T01:11:32.275901+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.275803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.275803+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.275803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:26.825661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"263'172","reported_seq":725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.322275+0000","last_change":"2024-09-12T01:11:34.322275+0000","last_active":"2024-09-12T01:11:34.322275+0000","last_peered":"2024-09-12T01:11:34.322275+0000","last_clean":"2024-09-12T01:11:34.322275+0000","last_became_active":"2024-09-12T00:12:46.065664+0000","last_became_peered":"2024-09-12T00:12:46.065664+0000","last_unstale":"2024-09-12T01:11:34.322275+0000","last_undegraded":"2024-09-12T01:11:34.322275+0000","last_fullsized":"2024-09-12T01:11:34.322275+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-09-12T01:11:34.322194+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-09-12T01:11:34.322194+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.322194+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:51.871169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":198,"num_read_kb":198,"num_write":340,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"263'177","reported_seq":798,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.332934+0000","last_change":"2024-09-12T01:11:23.332934+0000","last_active":"2024-09-12T01:11:23.332934+0000","last_peered":"2024-09-12T01:11:23.332934+0000","last_clean":"2024-09-12T01:11:23.332934+0000","last_became_active":"2024-09-12T00:12:38.041187+0000","last_became_peered":"2024-09-12T00:12:38.041187+0000","last_unstale":"2024-09-12T01:11:23.332934+0000","last_undegraded":"2024-09-12T01:11:23.332934+0000","last_fullsized":"2024-09-12T01:11:23.332934+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'177","last_scrub_stamp":"2024-09-12T01:11:23.332840+0000","last_deep_scrub":"263'177","last_deep_scrub_stamp":"2024-09-12T01:11:23.332840+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.332840+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:43.482751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":787,"num_read_kb":651,"num_write":272,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"263'370","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.319094+0000","last_change":"2024-09-12T01:11:09.319094+0000","last_active":"2024-09-12T01:11:09.319094+0000","last_peered":"2024-09-12T01:11:09.319094+0000","last_clean":"2024-09-12T01:11:09.319094+0000","last_became_active":"2024-09-12T00:12:36.033751+0000","last_became_peered":"2024-09-12T00:12:36.033751+0000","last_unstale":"2024-09-12T01:11:09.319094+0000","last_undegraded":"2024-09-12T01:11:09.319094+0000","last_fullsized":"2024-09-12T01:11:09.319094+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-12T01:11:09.318981+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-12T01:11:09.318981+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.318981+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:02.689157+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":254460,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":595,"num_read_kb":6771,"num_write":1059,"num_write_kb":22452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.612290+0000","last_change":"2024-09-12T01:11:27.612290+0000","last_active":"2024-09-12T01:11:27.612290+0000","last_peered":"2024-09-12T01:11:27.612290+0000","last_clean":"2024-09-12T01:11:27.612290+0000","last_became_active":"2024-09-12T00:12:40.032489+0000","last_became_peered":"2024-09-12T00:12:40.032489+0000","last_unstale":"2024-09-12T01:11:27.612290+0000","last_undegraded":"2024-09-12T01:11:27.612290+0000","last_fullsized":"2024-09-12T01:11:27.612290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:27.612192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:27.612192+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.612192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:04.891321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"263'97","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.322249+0000","last_change":"2024-09-12T01:11:30.322249+0000","last_active":"2024-09-12T01:11:30.322249+0000","last_peered":"2024-09-12T01:11:30.322249+0000","last_clean":"2024-09-12T01:11:30.322249+0000","last_became_active":"2024-09-12T00:12:42.046316+0000","last_became_peered":"2024-09-12T00:12:42.046316+0000","last_unstale":"2024-09-12T01:11:30.322249+0000","last_undegraded":"2024-09-12T01:11:30.322249+0000","last_fullsized":"2024-09-12T01:11:30.322249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'97","last_scrub_stamp":"2024-09-12T01:11:30.322163+0000","last_deep_scrub":"263'97","last_deep_scrub_stamp":"2024-09-12T01:11:30.322163+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.322163+0000","objects_scrubbed":4,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:43.884994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":105,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.322098+0000","last_change":"2024-09-12T01:11:28.322098+0000","last_active":"2024-09-12T01:11:28.322098+0000","last_peered":"2024-09-12T01:11:28.322098+0000","last_clean":"2024-09-12T01:11:28.322098+0000","last_became_active":"2024-09-12T00:12:44.057398+0000","last_became_peered":"2024-09-12T00:12:44.057398+0000","last_unstale":"2024-09-12T01:11:28.322098+0000","last_undegraded":"2024-09-12T01:11:28.322098+0000","last_fullsized":"2024-09-12T01:11:28.322098+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:28.322005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:28.322005+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.322005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:49.268150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"263'142","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.415911+0000","last_change":"2024-09-12T01:11:32.415911+0000","last_active":"2024-09-12T01:11:32.415911+0000","last_peered":"2024-09-12T01:11:32.415911+0000","last_clean":"2024-09-12T01:11:32.415911+0000","last_became_active":"2024-09-12T00:12:46.060932+0000","last_became_peered":"2024-09-12T00:12:46.060932+0000","last_unstale":"2024-09-12T01:11:32.415911+0000","last_undegraded":"2024-09-12T01:11:32.415911+0000","last_fullsized":"2024-09-12T01:11:32.415911+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-12T01:11:32.415807+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-12T01:11:32.415807+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.415807+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:41.606537+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"263'190","reported_seq":822,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.815777+0000","last_change":"2024-09-12T01:11:22.815777+0000","last_active":"2024-09-12T01:11:22.815777+0000","last_peered":"2024-09-12T01:11:22.815777+0000","last_clean":"2024-09-12T01:11:22.815777+0000","last_became_active":"2024-09-12T00:12:38.038234+0000","last_became_peered":"2024-09-12T00:12:38.038234+0000","last_unstale":"2024-09-12T01:11:22.815777+0000","last_undegraded":"2024-09-12T01:11:22.815777+0000","last_fullsized":"2024-09-12T01:11:22.815777+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-12T01:11:22.815690+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-12T01:11:22.815690+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.815690+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:14.046873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":891,"num_read_kb":755,"num_write":302,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"263'339","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.343925+0000","last_change":"2024-09-12T01:11:08.343865+0000","last_active":"2024-09-12T01:11:08.343925+0000","last_peered":"2024-09-12T01:11:08.343925+0000","last_clean":"2024-09-12T01:11:08.343925+0000","last_became_active":"2024-09-12T00:13:07.149671+0000","last_became_peered":"2024-09-12T00:13:07.149671+0000","last_unstale":"2024-09-12T01:11:08.343925+0000","last_undegraded":"2024-09-12T01:11:08.343925+0000","last_fullsized":"2024-09-12T01:11:08.343925+0000","mapping_epoch":40,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-12T01:11:08.343734+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-12T01:11:08.343734+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.343734+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:10.179873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":584,"num_read_kb":33322,"num_write":992,"num_write_kb":23312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.511949+0000","last_change":"2024-09-12T01:11:24.511949+0000","last_active":"2024-09-12T01:11:24.511949+0000","last_peered":"2024-09-12T01:11:24.511949+0000","last_clean":"2024-09-12T01:11:24.511949+0000","last_became_active":"2024-09-12T00:12:40.036714+0000","last_became_peered":"2024-09-12T00:12:40.036714+0000","last_unstale":"2024-09-12T01:11:24.511949+0000","last_undegraded":"2024-09-12T01:11:24.511949+0000","last_fullsized":"2024-09-12T01:11:24.511949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.511863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.511863+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.511863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:42.540269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"263'135","reported_seq":692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.451307+0000","last_change":"2024-09-12T01:11:39.451307+0000","last_active":"2024-09-12T01:11:39.451307+0000","last_peered":"2024-09-12T01:11:39.451307+0000","last_clean":"2024-09-12T01:11:39.451307+0000","last_became_active":"2024-09-12T00:12:42.037971+0000","last_became_peered":"2024-09-12T00:12:42.037971+0000","last_unstale":"2024-09-12T01:11:39.451307+0000","last_undegraded":"2024-09-12T01:11:39.451307+0000","last_fullsized":"2024-09-12T01:11:39.451307+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T01:11:39.451216+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T01:11:39.451216+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.451216+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:50.819654+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":156,"num_read_kb":149,"num_write":106,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"263'779","reported_seq":2794,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:43.503006+0000","last_change":"2024-09-12T01:11:43.503006+0000","last_active":"2024-09-12T01:11:43.503006+0000","last_peered":"2024-09-12T01:11:43.503006+0000","last_clean":"2024-09-12T01:11:43.503006+0000","last_became_active":"2024-09-12T00:12:44.059258+0000","last_became_peered":"2024-09-12T00:12:44.059258+0000","last_unstale":"2024-09-12T01:11:43.503006+0000","last_undegraded":"2024-09-12T01:11:43.503006+0000","last_fullsized":"2024-09-12T01:11:43.503006+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'779","last_scrub_stamp":"2024-09-12T01:11:43.502879+0000","last_deep_scrub":"263'779","last_deep_scrub_stamp":"2024-09-12T01:11:43.502879+0000","last_clean_scrub_stamp":"2024-09-12T01:11:43.502879+0000","objects_scrubbed":1,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:03.550822+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"263'198","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.322051+0000","last_change":"2024-09-12T01:11:32.322051+0000","last_active":"2024-09-12T01:11:32.322051+0000","last_peered":"2024-09-12T01:11:32.322051+0000","last_clean":"2024-09-12T01:11:32.322051+0000","last_became_active":"2024-09-12T00:12:46.059591+0000","last_became_peered":"2024-09-12T00:12:46.059591+0000","last_unstale":"2024-09-12T01:11:32.322051+0000","last_undegraded":"2024-09-12T01:11:32.322051+0000","last_fullsized":"2024-09-12T01:11:32.322051+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-12T01:11:32.321961+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-12T01:11:32.321961+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.321961+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:11.086077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":585,"num_read_kb":583,"num_write":433,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"263'4340","reported_seq":5011,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.905715+0000","last_change":"2024-09-12T01:11:24.905715+0000","last_active":"2024-09-12T01:11:24.905715+0000","last_peered":"2024-09-12T01:11:24.905715+0000","last_clean":"2024-09-12T01:11:24.905715+0000","last_became_active":"2024-09-12T00:12:38.035743+0000","last_became_peered":"2024-09-12T00:12:38.035743+0000","last_unstale":"2024-09-12T01:11:24.905715+0000","last_undegraded":"2024-09-12T01:11:24.905715+0000","last_fullsized":"2024-09-12T01:11:24.905715+0000","mapping_epoch":29,"log_start":"263'4300","ondisk_log_start":"263'4300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4340","last_scrub_stamp":"2024-09-12T01:11:24.905599+0000","last_deep_scrub":"263'4340","last_deep_scrub_stamp":"2024-09-12T01:11:24.905599+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.905599+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:01.008082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17417,"num_read_kb":14583,"num_write":6500,"num_write_kb":3272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"263'359","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.279315+0000","last_change":"2024-09-12T01:11:05.279315+0000","last_active":"2024-09-12T01:11:05.279315+0000","last_peered":"2024-09-12T01:11:05.279315+0000","last_clean":"2024-09-12T01:11:05.279315+0000","last_became_active":"2024-09-12T00:12:36.038014+0000","last_became_peered":"2024-09-12T00:12:36.038014+0000","last_unstale":"2024-09-12T01:11:05.279315+0000","last_undegraded":"2024-09-12T01:11:05.279315+0000","last_fullsized":"2024-09-12T01:11:05.279315+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T01:11:05.279083+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T01:11:05.279083+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.279083+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:09.655209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924421,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":557,"num_read_kb":22312,"num_write":1056,"num_write_kb":43311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.418890+0000","last_change":"2024-09-12T01:11:34.418890+0000","last_active":"2024-09-12T01:11:34.418890+0000","last_peered":"2024-09-12T01:11:34.418890+0000","last_clean":"2024-09-12T01:11:34.418890+0000","last_became_active":"2024-09-12T00:12:40.040992+0000","last_became_peered":"2024-09-12T00:12:40.040992+0000","last_unstale":"2024-09-12T01:11:34.418890+0000","last_undegraded":"2024-09-12T01:11:34.418890+0000","last_fullsized":"2024-09-12T01:11:34.418890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:34.418792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:34.418792+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.418792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:27.413102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"263'288","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.252040+0000","last_change":"2024-09-12T01:11:21.252040+0000","last_active":"2024-09-12T01:11:21.252040+0000","last_peered":"2024-09-12T01:11:21.252040+0000","last_clean":"2024-09-12T01:11:21.252040+0000","last_became_active":"2024-09-12T00:12:42.041042+0000","last_became_peered":"2024-09-12T00:12:42.041042+0000","last_unstale":"2024-09-12T01:11:21.252040+0000","last_undegraded":"2024-09-12T01:11:21.252040+0000","last_fullsized":"2024-09-12T01:11:21.252040+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'288","last_scrub_stamp":"2024-09-12T01:11:21.251938+0000","last_deep_scrub":"263'288","last_deep_scrub_stamp":"2024-09-12T01:11:21.251938+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.251938+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:59.500381+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63399,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":1076,"num_write":376,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"263'807","reported_seq":2526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.840199+0000","last_change":"2024-09-12T01:11:35.840199+0000","last_active":"2024-09-12T01:11:35.840199+0000","last_peered":"2024-09-12T01:11:35.840199+0000","last_clean":"2024-09-12T01:11:35.840199+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:11:35.840199+0000","last_undegraded":"2024-09-12T01:11:35.840199+0000","last_fullsized":"2024-09-12T01:11:35.840199+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'807","last_scrub_stamp":"2024-09-12T01:11:35.840113+0000","last_deep_scrub":"263'807","last_deep_scrub_stamp":"2024-09-12T01:11:35.840113+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.840113+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:49.915223+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"263'191","reported_seq":829,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.356461+0000","last_change":"2024-09-12T01:11:21.356461+0000","last_active":"2024-09-12T01:11:21.356461+0000","last_peered":"2024-09-12T01:11:21.356461+0000","last_clean":"2024-09-12T01:11:21.356461+0000","last_became_active":"2024-09-12T00:12:38.040030+0000","last_became_peered":"2024-09-12T00:12:38.040030+0000","last_unstale":"2024-09-12T01:11:21.356461+0000","last_undegraded":"2024-09-12T01:11:21.356461+0000","last_fullsized":"2024-09-12T01:11:21.356461+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'191","last_scrub_stamp":"2024-09-12T01:11:21.356376+0000","last_deep_scrub":"263'191","last_deep_scrub_stamp":"2024-09-12T01:11:21.356376+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.356376+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:38.207590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":682,"num_write":294,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"263'345","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.091085+0000","last_change":"2024-09-12T01:11:06.091029+0000","last_active":"2024-09-12T01:11:06.091085+0000","last_peered":"2024-09-12T01:11:06.091085+0000","last_clean":"2024-09-12T01:11:06.091085+0000","last_became_active":"2024-09-12T00:12:36.040657+0000","last_became_peered":"2024-09-12T00:12:36.040657+0000","last_unstale":"2024-09-12T01:11:06.091085+0000","last_undegraded":"2024-09-12T01:11:06.091085+0000","last_fullsized":"2024-09-12T01:11:06.091085+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'345","last_scrub_stamp":"2024-09-12T01:11:06.090928+0000","last_deep_scrub":"263'345","last_deep_scrub_stamp":"2024-09-12T01:11:06.090928+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.090928+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:36.844314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":455,"num_read_kb":5571,"num_write":1118,"num_write_kb":16904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.283806+0000","last_change":"2024-09-12T01:11:19.283806+0000","last_active":"2024-09-12T01:11:19.283806+0000","last_peered":"2024-09-12T01:11:19.283806+0000","last_clean":"2024-09-12T01:11:19.283806+0000","last_became_active":"2024-09-12T00:12:40.036362+0000","last_became_peered":"2024-09-12T00:12:40.036362+0000","last_unstale":"2024-09-12T01:11:19.283806+0000","last_undegraded":"2024-09-12T01:11:19.283806+0000","last_fullsized":"2024-09-12T01:11:19.283806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.283725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.283725+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.283725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:49.376690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"263'356","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.195921+0000","last_change":"2024-09-12T01:11:23.195848+0000","last_active":"2024-09-12T01:11:23.195921+0000","last_peered":"2024-09-12T01:11:23.195921+0000","last_clean":"2024-09-12T01:11:23.195921+0000","last_became_active":"2024-09-12T00:12:42.044418+0000","last_became_peered":"2024-09-12T00:12:42.044418+0000","last_unstale":"2024-09-12T01:11:23.195921+0000","last_undegraded":"2024-09-12T01:11:23.195921+0000","last_fullsized":"2024-09-12T01:11:23.195921+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-12T01:11:23.195680+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-12T01:11:23.195680+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.195680+0000","objects_scrubbed":10,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:40.037982+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51451,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":1107,"num_write":436,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.412651+0000","last_change":"2024-09-12T01:11:33.412651+0000","last_active":"2024-09-12T01:11:33.412651+0000","last_peered":"2024-09-12T01:11:33.412651+0000","last_clean":"2024-09-12T01:11:33.412651+0000","last_became_active":"2024-09-12T00:12:44.057438+0000","last_became_peered":"2024-09-12T00:12:44.057438+0000","last_unstale":"2024-09-12T01:11:33.412651+0000","last_undegraded":"2024-09-12T01:11:33.412651+0000","last_fullsized":"2024-09-12T01:11:33.412651+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.412544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.412544+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.412544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:38.474219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"263'560","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.343742+0000","last_change":"2024-09-12T01:11:29.343742+0000","last_active":"2024-09-12T01:11:29.343742+0000","last_peered":"2024-09-12T01:11:29.343742+0000","last_clean":"2024-09-12T01:11:29.343742+0000","last_became_active":"2024-09-12T00:12:46.060552+0000","last_became_peered":"2024-09-12T00:12:46.060552+0000","last_unstale":"2024-09-12T01:11:29.343742+0000","last_undegraded":"2024-09-12T01:11:29.343742+0000","last_fullsized":"2024-09-12T01:11:29.343742+0000","mapping_epoch":37,"log_start":"263'500","ondisk_log_start":"263'500","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'560","last_scrub_stamp":"2024-09-12T01:11:29.343647+0000","last_deep_scrub":"263'560","last_deep_scrub_stamp":"2024-09-12T01:11:29.343647+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.343647+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:44.779263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1290,"num_read_kb":1284,"num_write":1146,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"263'240","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.279256+0000","last_change":"2024-09-12T01:11:11.279256+0000","last_active":"2024-09-12T01:11:11.279256+0000","last_peered":"2024-09-12T01:11:11.279256+0000","last_clean":"2024-09-12T01:11:11.279256+0000","last_became_active":"2024-09-12T00:12:38.041916+0000","last_became_peered":"2024-09-12T00:12:38.041916+0000","last_unstale":"2024-09-12T01:11:11.279256+0000","last_undegraded":"2024-09-12T01:11:11.279256+0000","last_fullsized":"2024-09-12T01:11:11.279256+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'240","last_scrub_stamp":"2024-09-12T01:11:11.279182+0000","last_deep_scrub":"263'240","last_deep_scrub_stamp":"2024-09-12T01:11:11.279182+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.279182+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:57.424825+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1071,"num_read_kb":865,"num_write":389,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"263'325","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.153251+0000","last_change":"2024-09-12T01:11:09.153171+0000","last_active":"2024-09-12T01:11:09.153251+0000","last_peered":"2024-09-12T01:11:09.153251+0000","last_clean":"2024-09-12T01:11:09.153251+0000","last_became_active":"2024-09-12T00:12:36.042838+0000","last_became_peered":"2024-09-12T00:12:36.042838+0000","last_unstale":"2024-09-12T01:11:09.153251+0000","last_undegraded":"2024-09-12T01:11:09.153251+0000","last_fullsized":"2024-09-12T01:11:09.153251+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-09-12T01:11:09.153023+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-09-12T01:11:09.153023+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.153023+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:42.019020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":480,"num_read_kb":7238,"num_write":1062,"num_write_kb":12402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.336520+0000","last_change":"2024-09-12T01:11:22.336520+0000","last_active":"2024-09-12T01:11:22.336520+0000","last_peered":"2024-09-12T01:11:22.336520+0000","last_clean":"2024-09-12T01:11:22.336520+0000","last_became_active":"2024-09-12T00:12:40.042625+0000","last_became_peered":"2024-09-12T00:12:40.042625+0000","last_unstale":"2024-09-12T01:11:22.336520+0000","last_undegraded":"2024-09-12T01:11:22.336520+0000","last_fullsized":"2024-09-12T01:11:22.336520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:22.336417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:22.336417+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.336417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:38.356823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"263'260","reported_seq":845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.599229+0000","last_change":"2024-09-12T01:11:32.599229+0000","last_active":"2024-09-12T01:11:32.599229+0000","last_peered":"2024-09-12T01:11:32.599229+0000","last_clean":"2024-09-12T01:11:32.599229+0000","last_became_active":"2024-09-12T00:12:42.040266+0000","last_became_peered":"2024-09-12T00:12:42.040266+0000","last_unstale":"2024-09-12T01:11:32.599229+0000","last_undegraded":"2024-09-12T01:11:32.599229+0000","last_fullsized":"2024-09-12T01:11:32.599229+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-12T01:11:32.599143+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-12T01:11:32.599143+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.599143+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:32.133004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":434,"num_read_kb":965,"num_write":348,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.497801+0000","last_change":"2024-09-12T01:11:36.497801+0000","last_active":"2024-09-12T01:11:36.497801+0000","last_peered":"2024-09-12T01:11:36.497801+0000","last_clean":"2024-09-12T01:11:36.497801+0000","last_became_active":"2024-09-12T00:12:44.062608+0000","last_became_peered":"2024-09-12T00:12:44.062608+0000","last_unstale":"2024-09-12T01:11:36.497801+0000","last_undegraded":"2024-09-12T01:11:36.497801+0000","last_fullsized":"2024-09-12T01:11:36.497801+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:36.497719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:36.497719+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.497719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:59.343902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"263'2414","reported_seq":4261,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.296528+0000","last_change":"2024-09-12T01:11:31.296528+0000","last_active":"2024-09-12T01:11:31.296528+0000","last_peered":"2024-09-12T01:11:31.296528+0000","last_clean":"2024-09-12T01:11:31.296528+0000","last_became_active":"2024-09-12T00:12:46.062624+0000","last_became_peered":"2024-09-12T00:12:46.062624+0000","last_unstale":"2024-09-12T01:11:31.296528+0000","last_undegraded":"2024-09-12T01:11:31.296528+0000","last_fullsized":"2024-09-12T01:11:31.296528+0000","mapping_epoch":37,"log_start":"263'2400","ondisk_log_start":"263'2400","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2414","last_scrub_stamp":"2024-09-12T01:11:31.296426+0000","last_deep_scrub":"263'2414","last_deep_scrub_stamp":"2024-09-12T01:11:31.296426+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.296426+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":2400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:10.080210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6079,"num_read_kb":6065,"num_write":4891,"num_write_kb":1799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"263'224","reported_seq":843,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.214170+0000","last_change":"2024-09-12T01:11:17.214117+0000","last_active":"2024-09-12T01:11:17.214170+0000","last_peered":"2024-09-12T01:11:17.214170+0000","last_clean":"2024-09-12T01:11:17.214170+0000","last_became_active":"2024-09-12T00:12:38.042657+0000","last_became_peered":"2024-09-12T00:12:38.042657+0000","last_unstale":"2024-09-12T01:11:17.214170+0000","last_undegraded":"2024-09-12T01:11:17.214170+0000","last_fullsized":"2024-09-12T01:11:17.214170+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'224","last_scrub_stamp":"2024-09-12T01:11:17.214034+0000","last_deep_scrub":"263'224","last_deep_scrub_stamp":"2024-09-12T01:11:17.214034+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.214034+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:55.432133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":947,"num_read_kb":771,"num_write":346,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"263'377","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.357263+0000","last_change":"2024-09-12T01:11:13.357263+0000","last_active":"2024-09-12T01:11:13.357263+0000","last_peered":"2024-09-12T01:11:13.357263+0000","last_clean":"2024-09-12T01:11:13.357263+0000","last_became_active":"2024-09-12T00:12:36.046196+0000","last_became_peered":"2024-09-12T00:12:36.046196+0000","last_unstale":"2024-09-12T01:11:13.357263+0000","last_undegraded":"2024-09-12T01:11:13.357263+0000","last_fullsized":"2024-09-12T01:11:13.357263+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:11:13.357097+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:11:13.357097+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.357097+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:24.455244+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9646835,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":545,"num_read_kb":69753,"num_write":1204,"num_write_kb":51465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.925882+0000","last_change":"2024-09-12T01:11:27.925882+0000","last_active":"2024-09-12T01:11:27.925882+0000","last_peered":"2024-09-12T01:11:27.925882+0000","last_clean":"2024-09-12T01:11:27.925882+0000","last_became_active":"2024-09-12T00:12:40.039887+0000","last_became_peered":"2024-09-12T00:12:40.039887+0000","last_unstale":"2024-09-12T01:11:27.925882+0000","last_undegraded":"2024-09-12T01:11:27.925882+0000","last_fullsized":"2024-09-12T01:11:27.925882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:27.925797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:27.925797+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.925797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:53.232547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"263'339","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.420396+0000","last_change":"2024-09-12T01:11:37.420396+0000","last_active":"2024-09-12T01:11:37.420396+0000","last_peered":"2024-09-12T01:11:37.420396+0000","last_clean":"2024-09-12T01:11:37.420396+0000","last_became_active":"2024-09-12T00:12:42.051042+0000","last_became_peered":"2024-09-12T00:12:42.051042+0000","last_unstale":"2024-09-12T01:11:37.420396+0000","last_undegraded":"2024-09-12T01:11:37.420396+0000","last_fullsized":"2024-09-12T01:11:37.420396+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-12T01:11:37.420309+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-12T01:11:37.420309+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.420309+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:29.707362+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50358,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":532,"num_read_kb":1132,"num_write":424,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"263'807","reported_seq":2522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.886201+0000","last_change":"2024-09-12T01:11:34.886201+0000","last_active":"2024-09-12T01:11:34.886201+0000","last_peered":"2024-09-12T01:11:34.886201+0000","last_clean":"2024-09-12T01:11:34.886201+0000","last_became_active":"2024-09-12T00:12:44.057064+0000","last_became_peered":"2024-09-12T00:12:44.057064+0000","last_unstale":"2024-09-12T01:11:34.886201+0000","last_undegraded":"2024-09-12T01:11:34.886201+0000","last_fullsized":"2024-09-12T01:11:34.886201+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'807","last_scrub_stamp":"2024-09-12T01:11:34.886101+0000","last_deep_scrub":"263'807","last_deep_scrub_stamp":"2024-09-12T01:11:34.886101+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.886101+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:20.868443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"263'102","reported_seq":595,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.394425+0000","last_change":"2024-09-12T01:11:31.394425+0000","last_active":"2024-09-12T01:11:31.394425+0000","last_peered":"2024-09-12T01:11:31.394425+0000","last_clean":"2024-09-12T01:11:31.394425+0000","last_became_active":"2024-09-12T00:12:46.059567+0000","last_became_peered":"2024-09-12T00:12:46.059567+0000","last_unstale":"2024-09-12T01:11:31.394425+0000","last_undegraded":"2024-09-12T01:11:31.394425+0000","last_fullsized":"2024-09-12T01:11:31.394425+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'102","last_scrub_stamp":"2024-09-12T01:11:31.394337+0000","last_deep_scrub":"263'102","last_deep_scrub_stamp":"2024-09-12T01:11:31.394337+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.394337+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:06.953338+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":78,"num_write":230,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"263'198","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.877598+0000","last_change":"2024-09-12T01:11:19.877598+0000","last_active":"2024-09-12T01:11:19.877598+0000","last_peered":"2024-09-12T01:11:19.877598+0000","last_clean":"2024-09-12T01:11:19.877598+0000","last_became_active":"2024-09-12T00:12:38.039788+0000","last_became_peered":"2024-09-12T00:12:38.039788+0000","last_unstale":"2024-09-12T01:11:19.877598+0000","last_undegraded":"2024-09-12T01:11:19.877598+0000","last_fullsized":"2024-09-12T01:11:19.877598+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-12T01:11:19.877483+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-12T01:11:19.877483+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.877483+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:31.219578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":912,"num_read_kb":765,"num_write":285,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"263'369","reported_seq":1031,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:04.101519+0000","last_change":"2024-09-12T01:11:04.101465+0000","last_active":"2024-09-12T01:11:04.101519+0000","last_peered":"2024-09-12T01:11:04.101519+0000","last_clean":"2024-09-12T01:11:04.101519+0000","last_became_active":"2024-09-12T00:12:36.034290+0000","last_became_peered":"2024-09-12T00:12:36.034290+0000","last_unstale":"2024-09-12T01:11:04.101519+0000","last_undegraded":"2024-09-12T01:11:04.101519+0000","last_fullsized":"2024-09-12T01:11:04.101519+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'369","last_scrub_stamp":"2024-09-12T01:11:04.101384+0000","last_deep_scrub":"263'369","last_deep_scrub_stamp":"2024-09-12T01:11:04.101384+0000","last_clean_scrub_stamp":"2024-09-12T01:11:04.101384+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:59.360381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730154,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":18536,"num_write":1160,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.341959+0000","last_change":"2024-09-12T01:11:21.341959+0000","last_active":"2024-09-12T01:11:21.341959+0000","last_peered":"2024-09-12T01:11:21.341959+0000","last_clean":"2024-09-12T01:11:21.341959+0000","last_became_active":"2024-09-12T00:12:40.036551+0000","last_became_peered":"2024-09-12T00:12:40.036551+0000","last_unstale":"2024-09-12T01:11:21.341959+0000","last_undegraded":"2024-09-12T01:11:21.341959+0000","last_fullsized":"2024-09-12T01:11:21.341959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:21.341862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:21.341862+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.341862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:32.869688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"263'520","reported_seq":1173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.575706+0000","last_change":"2024-09-12T01:11:26.575706+0000","last_active":"2024-09-12T01:11:26.575706+0000","last_peered":"2024-09-12T01:11:26.575706+0000","last_clean":"2024-09-12T01:11:26.575706+0000","last_became_active":"2024-09-12T00:12:42.041307+0000","last_became_peered":"2024-09-12T00:12:42.041307+0000","last_unstale":"2024-09-12T01:11:26.575706+0000","last_undegraded":"2024-09-12T01:11:26.575706+0000","last_fullsized":"2024-09-12T01:11:26.575706+0000","mapping_epoch":33,"log_start":"263'500","ondisk_log_start":"263'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'520","last_scrub_stamp":"2024-09-12T01:11:26.575606+0000","last_deep_scrub":"263'520","last_deep_scrub_stamp":"2024-09-12T01:11:26.575606+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.575606+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:07.881789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96065,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":906,"num_read_kb":2178,"num_write":748,"num_write_kb":629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.959547+0000","last_change":"2024-09-12T01:11:32.959547+0000","last_active":"2024-09-12T01:11:32.959547+0000","last_peered":"2024-09-12T01:11:32.959547+0000","last_clean":"2024-09-12T01:11:32.959547+0000","last_became_active":"2024-09-12T00:12:44.049211+0000","last_became_peered":"2024-09-12T00:12:44.049211+0000","last_unstale":"2024-09-12T01:11:32.959547+0000","last_undegraded":"2024-09-12T01:11:32.959547+0000","last_fullsized":"2024-09-12T01:11:32.959547+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.959463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.959463+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.959463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:36.812726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"263'147","reported_seq":651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.778629+0000","last_change":"2024-09-12T01:11:28.778629+0000","last_active":"2024-09-12T01:11:28.778629+0000","last_peered":"2024-09-12T01:11:28.778629+0000","last_clean":"2024-09-12T01:11:28.778629+0000","last_became_active":"2024-09-12T00:12:46.066431+0000","last_became_peered":"2024-09-12T00:12:46.066431+0000","last_unstale":"2024-09-12T01:11:28.778629+0000","last_undegraded":"2024-09-12T01:11:28.778629+0000","last_fullsized":"2024-09-12T01:11:28.778629+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'147","last_scrub_stamp":"2024-09-12T01:11:28.778518+0000","last_deep_scrub":"263'147","last_deep_scrub_stamp":"2024-09-12T01:11:28.778518+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.778518+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:27.549650+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":137,"num_read_kb":135,"num_write":339,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"263'119","reported_seq":723,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.167274+0000","last_change":"2024-09-12T01:11:18.167274+0000","last_active":"2024-09-12T01:11:18.167274+0000","last_peered":"2024-09-12T01:11:18.167274+0000","last_clean":"2024-09-12T01:11:18.167274+0000","last_became_active":"2024-09-12T00:12:38.037464+0000","last_became_peered":"2024-09-12T00:12:38.037464+0000","last_unstale":"2024-09-12T01:11:18.167274+0000","last_undegraded":"2024-09-12T01:11:18.167274+0000","last_fullsized":"2024-09-12T01:11:18.167274+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-12T01:11:18.167145+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-12T01:11:18.167145+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.167145+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:04.870748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":566,"num_read_kb":476,"num_write":193,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"263'335","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.761453+0000","last_change":"2024-09-12T01:11:06.761365+0000","last_active":"2024-09-12T01:11:06.761453+0000","last_peered":"2024-09-12T01:11:06.761453+0000","last_clean":"2024-09-12T01:11:06.761453+0000","last_became_active":"2024-09-12T00:12:36.045050+0000","last_became_peered":"2024-09-12T00:12:36.045050+0000","last_unstale":"2024-09-12T01:11:06.761453+0000","last_undegraded":"2024-09-12T01:11:06.761453+0000","last_fullsized":"2024-09-12T01:11:06.761453+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:11:06.761211+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:11:06.761211+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.761211+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:53.881887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262225,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":489,"num_read_kb":13364,"num_write":1093,"num_write_kb":33697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.698894+0000","last_change":"2024-09-12T01:11:19.698894+0000","last_active":"2024-09-12T01:11:19.698894+0000","last_peered":"2024-09-12T01:11:19.698894+0000","last_clean":"2024-09-12T01:11:19.698894+0000","last_became_active":"2024-09-12T00:12:40.038036+0000","last_became_peered":"2024-09-12T00:12:40.038036+0000","last_unstale":"2024-09-12T01:11:19.698894+0000","last_undegraded":"2024-09-12T01:11:19.698894+0000","last_fullsized":"2024-09-12T01:11:19.698894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.698778+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:02.239036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"263'303","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.312972+0000","last_change":"2024-09-12T01:11:27.312972+0000","last_active":"2024-09-12T01:11:27.312972+0000","last_peered":"2024-09-12T01:11:27.312972+0000","last_clean":"2024-09-12T01:11:27.312972+0000","last_became_active":"2024-09-12T00:12:42.051668+0000","last_became_peered":"2024-09-12T00:12:42.051668+0000","last_unstale":"2024-09-12T01:11:27.312972+0000","last_undegraded":"2024-09-12T01:11:27.312972+0000","last_fullsized":"2024-09-12T01:11:27.312972+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'303","last_scrub_stamp":"2024-09-12T01:11:27.312879+0000","last_deep_scrub":"263'303","last_deep_scrub_stamp":"2024-09-12T01:11:27.312879+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.312879+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:39.832181+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47921,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":1104,"num_write":460,"num_write_kb":367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.743268+0000","last_change":"2024-09-12T01:11:23.743222+0000","last_active":"2024-09-12T01:11:23.743268+0000","last_peered":"2024-09-12T01:11:23.743268+0000","last_clean":"2024-09-12T01:11:23.743268+0000","last_became_active":"2024-09-12T00:12:44.061848+0000","last_became_peered":"2024-09-12T00:12:44.061848+0000","last_unstale":"2024-09-12T01:11:23.743268+0000","last_undegraded":"2024-09-12T01:11:23.743268+0000","last_fullsized":"2024-09-12T01:11:23.743268+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.743143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.743143+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.743143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:52.926960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"263'93","reported_seq":581,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.891502+0000","last_change":"2024-09-12T01:11:37.891502+0000","last_active":"2024-09-12T01:11:37.891502+0000","last_peered":"2024-09-12T01:11:37.891502+0000","last_clean":"2024-09-12T01:11:37.891502+0000","last_became_active":"2024-09-12T00:12:46.066121+0000","last_became_peered":"2024-09-12T00:12:46.066121+0000","last_unstale":"2024-09-12T01:11:37.891502+0000","last_undegraded":"2024-09-12T01:11:37.891502+0000","last_fullsized":"2024-09-12T01:11:37.891502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'93","last_scrub_stamp":"2024-09-12T01:11:37.891408+0000","last_deep_scrub":"263'93","last_deep_scrub_stamp":"2024-09-12T01:11:37.891408+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.891408+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:52.951291+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":71,"num_write":206,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"263'180","reported_seq":770,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.318206+0000","last_change":"2024-09-12T01:11:22.318206+0000","last_active":"2024-09-12T01:11:22.318206+0000","last_peered":"2024-09-12T01:11:22.318206+0000","last_clean":"2024-09-12T01:11:22.318206+0000","last_became_active":"2024-09-12T00:12:38.046276+0000","last_became_peered":"2024-09-12T00:12:38.046276+0000","last_unstale":"2024-09-12T01:11:22.318206+0000","last_undegraded":"2024-09-12T01:11:22.318206+0000","last_fullsized":"2024-09-12T01:11:22.318206+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-12T01:11:22.318112+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-12T01:11:22.318112+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.318112+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:29.522845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":747,"num_read_kb":618,"num_write":256,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"263'495","reported_seq":1207,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.359640+0000","last_change":"2024-09-12T01:11:10.359579+0000","last_active":"2024-09-12T01:11:10.359640+0000","last_peered":"2024-09-12T01:11:10.359640+0000","last_clean":"2024-09-12T01:11:10.359640+0000","last_became_active":"2024-09-12T00:12:36.035311+0000","last_became_peered":"2024-09-12T00:12:36.035311+0000","last_unstale":"2024-09-12T01:11:10.359640+0000","last_undegraded":"2024-09-12T01:11:10.359640+0000","last_fullsized":"2024-09-12T01:11:10.359640+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'495","last_scrub_stamp":"2024-09-12T01:11:10.359440+0000","last_deep_scrub":"263'495","last_deep_scrub_stamp":"2024-09-12T01:11:10.359440+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.359440+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:44.647976+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":942,"num_read_kb":11265,"num_write":1473,"num_write_kb":28283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.961075+0000","last_change":"2024-09-12T01:11:28.961075+0000","last_active":"2024-09-12T01:11:28.961075+0000","last_peered":"2024-09-12T01:11:28.961075+0000","last_clean":"2024-09-12T01:11:28.961075+0000","last_became_active":"2024-09-12T00:12:40.035585+0000","last_became_peered":"2024-09-12T00:12:40.035585+0000","last_unstale":"2024-09-12T01:11:28.961075+0000","last_undegraded":"2024-09-12T01:11:28.961075+0000","last_fullsized":"2024-09-12T01:11:28.961075+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:28.960959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:28.960959+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.960959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:55.520073+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"263'317","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.959538+0000","last_change":"2024-09-12T01:11:30.959538+0000","last_active":"2024-09-12T01:11:30.959538+0000","last_peered":"2024-09-12T01:11:30.959538+0000","last_clean":"2024-09-12T01:11:30.959538+0000","last_became_active":"2024-09-12T00:12:42.052279+0000","last_became_peered":"2024-09-12T00:12:42.052279+0000","last_unstale":"2024-09-12T01:11:30.959538+0000","last_undegraded":"2024-09-12T01:11:30.959538+0000","last_fullsized":"2024-09-12T01:11:30.959538+0000","mapping_epoch":33,"log_start":"263'301","ondisk_log_start":"263'301","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:11:30.959434+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:11:30.959434+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.959434+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:18.728004+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":1142,"num_write":410,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"263'773","reported_seq":4983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.728661+0000","last_change":"2024-09-12T01:11:22.728661+0000","last_active":"2024-09-12T01:11:22.728661+0000","last_peered":"2024-09-12T01:11:22.728661+0000","last_clean":"2024-09-12T01:11:22.728661+0000","last_became_active":"2024-09-12T00:12:44.060494+0000","last_became_peered":"2024-09-12T00:12:44.060494+0000","last_unstale":"2024-09-12T01:11:22.728661+0000","last_undegraded":"2024-09-12T01:11:22.728661+0000","last_fullsized":"2024-09-12T01:11:22.728661+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'773","last_scrub_stamp":"2024-09-12T01:11:22.728562+0000","last_deep_scrub":"263'773","last_deep_scrub_stamp":"2024-09-12T01:11:22.728562+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.728562+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:32.761136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"263'136","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.434756+0000","last_change":"2024-09-12T01:11:34.434756+0000","last_active":"2024-09-12T01:11:34.434756+0000","last_peered":"2024-09-12T01:11:34.434756+0000","last_clean":"2024-09-12T01:11:34.434756+0000","last_became_active":"2024-09-12T00:12:46.060211+0000","last_became_peered":"2024-09-12T00:12:46.060211+0000","last_unstale":"2024-09-12T01:11:34.434756+0000","last_undegraded":"2024-09-12T01:11:34.434756+0000","last_fullsized":"2024-09-12T01:11:34.434756+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'136","last_scrub_stamp":"2024-09-12T01:11:34.434647+0000","last_deep_scrub":"263'136","last_deep_scrub_stamp":"2024-09-12T01:11:34.434647+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.434647+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:21.846031+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":113,"num_write":319,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"263'256","reported_seq":896,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.174716+0000","last_change":"2024-09-12T01:11:18.174716+0000","last_active":"2024-09-12T01:11:18.174716+0000","last_peered":"2024-09-12T01:11:18.174716+0000","last_clean":"2024-09-12T01:11:18.174716+0000","last_became_active":"2024-09-12T00:12:38.042601+0000","last_became_peered":"2024-09-12T00:12:38.042601+0000","last_unstale":"2024-09-12T01:11:18.174716+0000","last_undegraded":"2024-09-12T01:11:18.174716+0000","last_fullsized":"2024-09-12T01:11:18.174716+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'256","last_scrub_stamp":"2024-09-12T01:11:18.174616+0000","last_deep_scrub":"263'256","last_deep_scrub_stamp":"2024-09-12T01:11:18.174616+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.174616+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:34.619000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1116,"num_read_kb":905,"num_write":388,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"263'367","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.370115+0000","last_change":"2024-09-12T01:11:11.370115+0000","last_active":"2024-09-12T01:11:11.370115+0000","last_peered":"2024-09-12T01:11:11.370115+0000","last_clean":"2024-09-12T01:11:11.370115+0000","last_became_active":"2024-09-12T00:12:36.043404+0000","last_became_peered":"2024-09-12T00:12:36.043404+0000","last_unstale":"2024-09-12T01:11:11.370115+0000","last_undegraded":"2024-09-12T01:11:11.370115+0000","last_fullsized":"2024-09-12T01:11:11.370115+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-12T01:11:11.370017+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-12T01:11:11.370017+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.370017+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:25.657597+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432371,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":514,"num_read_kb":34059,"num_write":1157,"num_write_kb":45928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1469,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.344139+0000","last_change":"2024-09-12T01:11:23.344139+0000","last_active":"2024-09-12T01:11:23.344139+0000","last_peered":"2024-09-12T01:11:23.344139+0000","last_clean":"2024-09-12T01:11:23.344139+0000","last_became_active":"2024-09-12T00:12:40.035633+0000","last_became_peered":"2024-09-12T00:12:40.035633+0000","last_unstale":"2024-09-12T01:11:23.344139+0000","last_undegraded":"2024-09-12T01:11:23.344139+0000","last_fullsized":"2024-09-12T01:11:23.344139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:11:23.344051+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:11:23.344051+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.344051+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:47.428428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":964,"num_read_kb":964,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"263'87","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.424411+0000","last_change":"2024-09-12T01:11:26.424411+0000","last_active":"2024-09-12T01:11:26.424411+0000","last_peered":"2024-09-12T01:11:26.424411+0000","last_clean":"2024-09-12T01:11:26.424411+0000","last_became_active":"2024-09-12T00:12:42.051384+0000","last_became_peered":"2024-09-12T00:12:42.051384+0000","last_unstale":"2024-09-12T01:11:26.424411+0000","last_undegraded":"2024-09-12T01:11:26.424411+0000","last_fullsized":"2024-09-12T01:11:26.424411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'87","last_scrub_stamp":"2024-09-12T01:11:26.424310+0000","last_deep_scrub":"263'87","last_deep_scrub_stamp":"2024-09-12T01:11:26.424310+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.424310+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:29.942056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":86,"num_write":62,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"263'777","reported_seq":4096,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.311284+0000","last_change":"2024-09-12T01:11:29.311284+0000","last_active":"2024-09-12T01:11:29.311284+0000","last_peered":"2024-09-12T01:11:29.311284+0000","last_clean":"2024-09-12T01:11:29.311284+0000","last_became_active":"2024-09-12T00:12:44.061837+0000","last_became_peered":"2024-09-12T00:12:44.061837+0000","last_unstale":"2024-09-12T01:11:29.311284+0000","last_undegraded":"2024-09-12T01:11:29.311284+0000","last_fullsized":"2024-09-12T01:11:29.311284+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-12T01:11:29.311182+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-12T01:11:29.311182+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.311182+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:13.873639+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"263'132","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.376678+0000","last_change":"2024-09-12T01:11:28.376678+0000","last_active":"2024-09-12T01:11:28.376678+0000","last_peered":"2024-09-12T01:11:28.376678+0000","last_clean":"2024-09-12T01:11:28.376678+0000","last_became_active":"2024-09-12T00:12:46.057978+0000","last_became_peered":"2024-09-12T00:12:46.057978+0000","last_unstale":"2024-09-12T01:11:28.376678+0000","last_undegraded":"2024-09-12T01:11:28.376678+0000","last_fullsized":"2024-09-12T01:11:28.376678+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'132","last_scrub_stamp":"2024-09-12T01:11:28.376556+0000","last_deep_scrub":"263'132","last_deep_scrub_stamp":"2024-09-12T01:11:28.376556+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.376556+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:48.943253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":126,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"263'235","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.760627+0000","last_change":"2024-09-12T01:11:09.760564+0000","last_active":"2024-09-12T01:11:09.760627+0000","last_peered":"2024-09-12T01:11:09.760627+0000","last_clean":"2024-09-12T01:11:09.760627+0000","last_became_active":"2024-09-12T00:12:38.037035+0000","last_became_peered":"2024-09-12T00:12:38.037035+0000","last_unstale":"2024-09-12T01:11:09.760627+0000","last_undegraded":"2024-09-12T01:11:09.760627+0000","last_fullsized":"2024-09-12T01:11:09.760627+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'235","last_scrub_stamp":"2024-09-12T01:11:09.760480+0000","last_deep_scrub":"263'235","last_deep_scrub_stamp":"2024-09-12T01:11:09.760480+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.760480+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:10.352680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":992,"num_read_kb":804,"num_write":394,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"263'298","reported_seq":930,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.602123+0000","last_change":"2024-09-12T01:11:10.602123+0000","last_active":"2024-09-12T01:11:10.602123+0000","last_peered":"2024-09-12T01:11:10.602123+0000","last_clean":"2024-09-12T01:11:10.602123+0000","last_became_active":"2024-09-12T00:12:36.029059+0000","last_became_peered":"2024-09-12T00:12:36.029059+0000","last_unstale":"2024-09-12T01:11:10.602123+0000","last_undegraded":"2024-09-12T01:11:10.602123+0000","last_fullsized":"2024-09-12T01:11:10.602123+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'298","last_scrub_stamp":"2024-09-12T01:11:10.601960+0000","last_deep_scrub":"263'298","last_deep_scrub_stamp":"2024-09-12T01:11:10.601960+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.601960+0000","objects_scrubbed":9,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:37.836366+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4837920,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":419,"num_read_kb":19038,"num_write":995,"num_write_kb":37710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.416878+0000","last_change":"2024-09-12T01:11:31.416878+0000","last_active":"2024-09-12T01:11:31.416878+0000","last_peered":"2024-09-12T01:11:31.416878+0000","last_clean":"2024-09-12T01:11:31.416878+0000","last_became_active":"2024-09-12T00:12:40.042158+0000","last_became_peered":"2024-09-12T00:12:40.042158+0000","last_unstale":"2024-09-12T01:11:31.416878+0000","last_undegraded":"2024-09-12T01:11:31.416878+0000","last_fullsized":"2024-09-12T01:11:31.416878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:31.416768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:31.416768+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.416768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:50.244102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"263'357","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.375258+0000","last_change":"2024-09-12T01:11:24.375258+0000","last_active":"2024-09-12T01:11:24.375258+0000","last_peered":"2024-09-12T01:11:24.375258+0000","last_clean":"2024-09-12T01:11:24.375258+0000","last_became_active":"2024-09-12T00:12:42.048747+0000","last_became_peered":"2024-09-12T00:12:42.048747+0000","last_unstale":"2024-09-12T01:11:24.375258+0000","last_undegraded":"2024-09-12T01:11:24.375258+0000","last_fullsized":"2024-09-12T01:11:24.375258+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'357","last_scrub_stamp":"2024-09-12T01:11:24.375147+0000","last_deep_scrub":"263'357","last_deep_scrub_stamp":"2024-09-12T01:11:24.375147+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.375147+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:40.708397+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49371,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":573,"num_read_kb":1173,"num_write":448,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.331384+0000","last_change":"2024-09-12T01:11:23.331384+0000","last_active":"2024-09-12T01:11:23.331384+0000","last_peered":"2024-09-12T01:11:23.331384+0000","last_clean":"2024-09-12T01:11:23.331384+0000","last_became_active":"2024-09-12T00:12:44.050074+0000","last_became_peered":"2024-09-12T00:12:44.050074+0000","last_unstale":"2024-09-12T01:11:23.331384+0000","last_undegraded":"2024-09-12T01:11:23.331384+0000","last_fullsized":"2024-09-12T01:11:23.331384+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.331283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.331283+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.331283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:57.228673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"263'195","reported_seq":710,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.809397+0000","last_change":"2024-09-12T01:11:27.809397+0000","last_active":"2024-09-12T01:11:27.809397+0000","last_peered":"2024-09-12T01:11:27.809397+0000","last_clean":"2024-09-12T01:11:27.809397+0000","last_became_active":"2024-09-12T00:12:46.064517+0000","last_became_peered":"2024-09-12T00:12:46.064517+0000","last_unstale":"2024-09-12T01:11:27.809397+0000","last_undegraded":"2024-09-12T01:11:27.809397+0000","last_fullsized":"2024-09-12T01:11:27.809397+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'195","last_scrub_stamp":"2024-09-12T01:11:27.809309+0000","last_deep_scrub":"263'195","last_deep_scrub_stamp":"2024-09-12T01:11:27.809309+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.809309+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:19.119898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":414,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":229,"num_read_kb":204,"num_write":354,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"263'289","reported_seq":945,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.331049+0000","last_change":"2024-09-12T01:11:20.331049+0000","last_active":"2024-09-12T01:11:20.331049+0000","last_peered":"2024-09-12T01:11:20.331049+0000","last_clean":"2024-09-12T01:11:20.331049+0000","last_became_active":"2024-09-12T00:12:38.040885+0000","last_became_peered":"2024-09-12T00:12:38.040885+0000","last_unstale":"2024-09-12T01:11:20.331049+0000","last_undegraded":"2024-09-12T01:11:20.331049+0000","last_fullsized":"2024-09-12T01:11:20.331049+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-12T01:11:20.330958+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-12T01:11:20.330958+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.330958+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:40.353584+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1200,"num_read_kb":970,"num_write":419,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8074,"num_omap_keys":32,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:04.285322+0000","last_change":"2024-09-12T01:11:04.285268+0000","last_active":"2024-09-12T01:11:04.285322+0000","last_peered":"2024-09-12T01:11:04.285322+0000","last_clean":"2024-09-12T01:11:04.285322+0000","last_became_active":"2024-09-12T00:12:17.817880+0000","last_became_peered":"2024-09-12T00:12:17.817880+0000","last_unstale":"2024-09-12T01:11:04.285322+0000","last_undegraded":"2024-09-12T01:11:04.285322+0000","last_fullsized":"2024-09-12T01:11:04.285322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-12T01:11:04.285203+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-12T01:11:04.285203+0000","last_clean_scrub_stamp":"2024-09-12T01:11:04.285203+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:05.465929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.368102+0000","last_change":"2024-09-12T01:11:09.368102+0000","last_active":"2024-09-12T01:11:09.368102+0000","last_peered":"2024-09-12T01:11:09.368102+0000","last_clean":"2024-09-12T01:11:09.368102+0000","last_became_active":"2024-09-12T00:12:22.713297+0000","last_became_peered":"2024-09-12T00:12:22.713297+0000","last_unstale":"2024-09-12T01:11:09.368102+0000","last_undegraded":"2024-09-12T01:11:09.368102+0000","last_fullsized":"2024-09-12T01:11:09.368102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:09.368014+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:09.368014+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.368014+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:32.949309+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0014022310000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"263'392","reported_seq":1105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.672420+0000","last_change":"2024-09-12T01:11:05.672420+0000","last_active":"2024-09-12T01:11:05.672420+0000","last_peered":"2024-09-12T01:11:05.672420+0000","last_clean":"2024-09-12T01:11:05.672420+0000","last_became_active":"2024-09-12T00:12:36.030408+0000","last_became_peered":"2024-09-12T00:12:36.030408+0000","last_unstale":"2024-09-12T01:11:05.672420+0000","last_undegraded":"2024-09-12T01:11:05.672420+0000","last_fullsized":"2024-09-12T01:11:05.672420+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-12T01:11:05.672292+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-12T01:11:05.672292+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.672292+0000","objects_scrubbed":7,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:44.373893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262211,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":42611,"num_write":1169,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"263'4","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.138231+0000","last_change":"2024-09-12T01:11:25.138231+0000","last_active":"2024-09-12T01:11:25.138231+0000","last_peered":"2024-09-12T01:11:25.138231+0000","last_clean":"2024-09-12T01:11:25.138231+0000","last_became_active":"2024-09-12T00:12:40.039529+0000","last_became_peered":"2024-09-12T00:12:40.039529+0000","last_unstale":"2024-09-12T01:11:25.138231+0000","last_undegraded":"2024-09-12T01:11:25.138231+0000","last_fullsized":"2024-09-12T01:11:25.138231+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:11:25.138154+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:11:25.138154+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.138154+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:54.590988+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":733,"num_read_kb":731,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"263'771","reported_seq":1489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.471847+0000","last_change":"2024-09-12T01:11:36.471847+0000","last_active":"2024-09-12T01:11:36.471847+0000","last_peered":"2024-09-12T01:11:36.471847+0000","last_clean":"2024-09-12T01:11:36.471847+0000","last_became_active":"2024-09-12T00:12:42.046668+0000","last_became_peered":"2024-09-12T00:12:42.046668+0000","last_unstale":"2024-09-12T01:11:36.471847+0000","last_undegraded":"2024-09-12T01:11:36.471847+0000","last_fullsized":"2024-09-12T01:11:36.471847+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'771","last_scrub_stamp":"2024-09-12T01:11:36.471732+0000","last_deep_scrub":"263'771","last_deep_scrub_stamp":"2024-09-12T01:11:36.471732+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.471732+0000","objects_scrubbed":7,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:32.859967+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143901,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1496,"num_read_kb":3385,"num_write":1448,"num_write_kb":1292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106668,"num_omap_keys":256,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.932802+0000","last_change":"2024-09-12T01:11:33.932802+0000","last_active":"2024-09-12T01:11:33.932802+0000","last_peered":"2024-09-12T01:11:33.932802+0000","last_clean":"2024-09-12T01:11:33.932802+0000","last_became_active":"2024-09-12T00:12:44.053779+0000","last_became_peered":"2024-09-12T00:12:44.053779+0000","last_unstale":"2024-09-12T01:11:33.932802+0000","last_undegraded":"2024-09-12T01:11:33.932802+0000","last_fullsized":"2024-09-12T01:11:33.932802+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.932714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.932714+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.932714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:19.453742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"263'190","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.225982+0000","last_change":"2024-09-12T01:11:31.225982+0000","last_active":"2024-09-12T01:11:31.225982+0000","last_peered":"2024-09-12T01:11:31.225982+0000","last_clean":"2024-09-12T01:11:31.225982+0000","last_became_active":"2024-09-12T00:12:46.055501+0000","last_became_peered":"2024-09-12T00:12:46.055501+0000","last_unstale":"2024-09-12T01:11:31.225982+0000","last_undegraded":"2024-09-12T01:11:31.225982+0000","last_fullsized":"2024-09-12T01:11:31.225982+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'190","last_scrub_stamp":"2024-09-12T01:11:31.225881+0000","last_deep_scrub":"263'190","last_deep_scrub_stamp":"2024-09-12T01:11:31.225881+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.225881+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:31.545264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":436,"num_write":384,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"263'149","reported_seq":737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.868218+0000","last_change":"2024-09-12T01:11:18.868218+0000","last_active":"2024-09-12T01:11:18.868218+0000","last_peered":"2024-09-12T01:11:18.868218+0000","last_clean":"2024-09-12T01:11:18.868218+0000","last_became_active":"2024-09-12T00:12:38.037392+0000","last_became_peered":"2024-09-12T00:12:38.037392+0000","last_unstale":"2024-09-12T01:11:18.868218+0000","last_undegraded":"2024-09-12T01:11:18.868218+0000","last_fullsized":"2024-09-12T01:11:18.868218+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-12T01:11:18.868095+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-12T01:11:18.868095+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.868095+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:24.230817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":647,"num_read_kb":530,"num_write":212,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.270371+0000","last_change":"2024-09-12T01:11:05.270371+0000","last_active":"2024-09-12T01:11:05.270371+0000","last_peered":"2024-09-12T01:11:05.270371+0000","last_clean":"2024-09-12T01:11:05.270371+0000","last_became_active":"2024-09-12T00:12:22.713657+0000","last_became_peered":"2024-09-12T00:12:22.713657+0000","last_unstale":"2024-09-12T01:11:05.270371+0000","last_undegraded":"2024-09-12T01:11:05.270371+0000","last_fullsized":"2024-09-12T01:11:05.270371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:05.270282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:05.270282+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.270282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:52.804966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012667690000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"263'335","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.358183+0000","last_change":"2024-09-12T01:11:06.358183+0000","last_active":"2024-09-12T01:11:06.358183+0000","last_peered":"2024-09-12T01:11:06.358183+0000","last_clean":"2024-09-12T01:11:06.358183+0000","last_became_active":"2024-09-12T00:12:36.036010+0000","last_became_peered":"2024-09-12T00:12:36.036010+0000","last_unstale":"2024-09-12T01:11:06.358183+0000","last_undegraded":"2024-09-12T01:11:06.358183+0000","last_fullsized":"2024-09-12T01:11:06.358183+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'335","last_scrub_stamp":"2024-09-12T01:11:06.358069+0000","last_deep_scrub":"263'335","last_deep_scrub_stamp":"2024-09-12T01:11:06.358069+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.358069+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.445759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":524,"num_read_kb":7159,"num_write":1103,"num_write_kb":37525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.447801+0000","last_change":"2024-09-12T01:11:30.447801+0000","last_active":"2024-09-12T01:11:30.447801+0000","last_peered":"2024-09-12T01:11:30.447801+0000","last_clean":"2024-09-12T01:11:30.447801+0000","last_became_active":"2024-09-12T00:12:40.039592+0000","last_became_peered":"2024-09-12T00:12:40.039592+0000","last_unstale":"2024-09-12T01:11:30.447801+0000","last_undegraded":"2024-09-12T01:11:30.447801+0000","last_fullsized":"2024-09-12T01:11:30.447801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:30.447718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:30.447718+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.447718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:02.060126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"263'1316","reported_seq":2955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.789709+0000","last_change":"2024-09-12T01:11:25.789709+0000","last_active":"2024-09-12T01:11:25.789709+0000","last_peered":"2024-09-12T01:11:25.789709+0000","last_clean":"2024-09-12T01:11:25.789709+0000","last_became_active":"2024-09-12T00:12:42.049594+0000","last_became_peered":"2024-09-12T00:12:42.049594+0000","last_unstale":"2024-09-12T01:11:25.789709+0000","last_undegraded":"2024-09-12T01:11:25.789709+0000","last_fullsized":"2024-09-12T01:11:25.789709+0000","mapping_epoch":33,"log_start":"263'1301","ondisk_log_start":"263'1301","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1316","last_scrub_stamp":"2024-09-12T01:11:25.789564+0000","last_deep_scrub":"263'1316","last_deep_scrub_stamp":"2024-09-12T01:11:25.789564+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.789564+0000","objects_scrubbed":12,"log_size":15,"log_dups_size":1301,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:05.989198+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146958,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3903,"num_write":1160,"num_write_kb":992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.485064+0000","last_change":"2024-09-12T01:11:41.485064+0000","last_active":"2024-09-12T01:11:41.485064+0000","last_peered":"2024-09-12T01:11:41.485064+0000","last_clean":"2024-09-12T01:11:41.485064+0000","last_became_active":"2024-09-12T00:12:44.059188+0000","last_became_peered":"2024-09-12T00:12:44.059188+0000","last_unstale":"2024-09-12T01:11:41.485064+0000","last_undegraded":"2024-09-12T01:11:41.485064+0000","last_fullsized":"2024-09-12T01:11:41.485064+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:41.484969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:41.484969+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.484969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:01.830123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"263'154","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.923474+0000","last_change":"2024-09-12T01:11:38.923474+0000","last_active":"2024-09-12T01:11:38.923474+0000","last_peered":"2024-09-12T01:11:38.923474+0000","last_clean":"2024-09-12T01:11:38.923474+0000","last_became_active":"2024-09-12T00:12:46.064993+0000","last_became_peered":"2024-09-12T00:12:46.064993+0000","last_unstale":"2024-09-12T01:11:38.923474+0000","last_undegraded":"2024-09-12T01:11:38.923474+0000","last_fullsized":"2024-09-12T01:11:38.923474+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-09-12T01:11:38.923382+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-09-12T01:11:38.923382+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.923382+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:08.239621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":467,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":334,"num_read_kb":277,"num_write":363,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"263'61","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.234785+0000","last_change":"2024-09-12T01:11:17.234785+0000","last_active":"2024-09-12T01:11:17.234785+0000","last_peered":"2024-09-12T01:11:17.234785+0000","last_clean":"2024-09-12T01:11:17.234785+0000","last_became_active":"2024-09-12T00:12:38.039492+0000","last_became_peered":"2024-09-12T00:12:38.039492+0000","last_unstale":"2024-09-12T01:11:17.234785+0000","last_undegraded":"2024-09-12T01:11:17.234785+0000","last_fullsized":"2024-09-12T01:11:17.234785+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'61","last_scrub_stamp":"2024-09-12T01:11:17.234696+0000","last_deep_scrub":"263'61","last_deep_scrub_stamp":"2024-09-12T01:11:17.234696+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.234696+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:55.520286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":268,"num_read_kb":235,"num_write":88,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.746156+0000","last_change":"2024-09-12T01:11:07.746156+0000","last_active":"2024-09-12T01:11:07.746156+0000","last_peered":"2024-09-12T01:11:07.746156+0000","last_clean":"2024-09-12T01:11:07.746156+0000","last_became_active":"2024-09-12T00:12:22.714487+0000","last_became_peered":"2024-09-12T00:12:22.714487+0000","last_unstale":"2024-09-12T01:11:07.746156+0000","last_undegraded":"2024-09-12T01:11:07.746156+0000","last_fullsized":"2024-09-12T01:11:07.746156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:07.746070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:07.746070+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.746070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:58.957625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038937299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"263'315","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.637646+0000","last_change":"2024-09-12T01:11:06.637646+0000","last_active":"2024-09-12T01:11:06.637646+0000","last_peered":"2024-09-12T01:11:06.637646+0000","last_clean":"2024-09-12T01:11:06.637646+0000","last_became_active":"2024-09-12T00:12:36.042293+0000","last_became_peered":"2024-09-12T00:12:36.042293+0000","last_unstale":"2024-09-12T01:11:06.637646+0000","last_undegraded":"2024-09-12T01:11:06.637646+0000","last_fullsized":"2024-09-12T01:11:06.637646+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'315","last_scrub_stamp":"2024-09-12T01:11:06.637502+0000","last_deep_scrub":"263'315","last_deep_scrub_stamp":"2024-09-12T01:11:06.637502+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.637502+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:05.943410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":214314,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":33497,"num_write":1058,"num_write_kb":40497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.726967+0000","last_change":"2024-09-12T01:11:18.726967+0000","last_active":"2024-09-12T01:11:18.726967+0000","last_peered":"2024-09-12T01:11:18.726967+0000","last_clean":"2024-09-12T01:11:18.726967+0000","last_became_active":"2024-09-12T00:12:40.038202+0000","last_became_peered":"2024-09-12T00:12:40.038202+0000","last_unstale":"2024-09-12T01:11:18.726967+0000","last_undegraded":"2024-09-12T01:11:18.726967+0000","last_fullsized":"2024-09-12T01:11:18.726967+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:18.726875+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:18.726875+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.726875+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:47.107289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"263'257","reported_seq":1498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.177486+0000","last_change":"2024-09-12T01:11:20.177486+0000","last_active":"2024-09-12T01:11:20.177486+0000","last_peered":"2024-09-12T01:11:20.177486+0000","last_clean":"2024-09-12T01:11:20.177486+0000","last_became_active":"2024-09-12T00:12:42.044498+0000","last_became_peered":"2024-09-12T00:12:42.044498+0000","last_unstale":"2024-09-12T01:11:20.177486+0000","last_undegraded":"2024-09-12T01:11:20.177486+0000","last_fullsized":"2024-09-12T01:11:20.177486+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'257","last_scrub_stamp":"2024-09-12T01:11:20.177386+0000","last_deep_scrub":"263'257","last_deep_scrub_stamp":"2024-09-12T01:11:20.177386+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.177386+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:56.030842+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":212,"num_read_kb":202,"num_write":187,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.618928+0000","last_change":"2024-09-12T01:11:31.618928+0000","last_active":"2024-09-12T01:11:31.618928+0000","last_peered":"2024-09-12T01:11:31.618928+0000","last_clean":"2024-09-12T01:11:31.618928+0000","last_became_active":"2024-09-12T00:12:44.062039+0000","last_became_peered":"2024-09-12T00:12:44.062039+0000","last_unstale":"2024-09-12T01:11:31.618928+0000","last_undegraded":"2024-09-12T01:11:31.618928+0000","last_fullsized":"2024-09-12T01:11:31.618928+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:31.618832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:31.618832+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.618832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:48.890810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"263'262","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.464282+0000","last_change":"2024-09-12T01:11:41.464282+0000","last_active":"2024-09-12T01:11:41.464282+0000","last_peered":"2024-09-12T01:11:41.464282+0000","last_clean":"2024-09-12T01:11:41.464282+0000","last_became_active":"2024-09-12T00:12:46.053228+0000","last_became_peered":"2024-09-12T00:12:46.053228+0000","last_unstale":"2024-09-12T01:11:41.464282+0000","last_undegraded":"2024-09-12T01:11:41.464282+0000","last_fullsized":"2024-09-12T01:11:41.464282+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'262","last_scrub_stamp":"2024-09-12T01:11:41.464189+0000","last_deep_scrub":"263'262","last_deep_scrub_stamp":"2024-09-12T01:11:41.464189+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.464189+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:30.784637+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":515,"num_read_kb":531,"num_write":580,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"263'172","reported_seq":760,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.245410+0000","last_change":"2024-09-12T01:11:16.245410+0000","last_active":"2024-09-12T01:11:16.245410+0000","last_peered":"2024-09-12T01:11:16.245410+0000","last_clean":"2024-09-12T01:11:16.245410+0000","last_became_active":"2024-09-12T00:12:38.040477+0000","last_became_peered":"2024-09-12T00:12:38.040477+0000","last_unstale":"2024-09-12T01:11:16.245410+0000","last_undegraded":"2024-09-12T01:11:16.245410+0000","last_fullsized":"2024-09-12T01:11:16.245410+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'172","last_scrub_stamp":"2024-09-12T01:11:16.245307+0000","last_deep_scrub":"263'172","last_deep_scrub_stamp":"2024-09-12T01:11:16.245307+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.245307+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:24.897173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":766,"num_read_kb":623,"num_write":281,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":536,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.249463+0000","last_change":"2024-09-12T01:11:06.249463+0000","last_active":"2024-09-12T01:11:06.249463+0000","last_peered":"2024-09-12T01:11:06.249463+0000","last_clean":"2024-09-12T01:11:06.249463+0000","last_became_active":"2024-09-12T00:12:22.840587+0000","last_became_peered":"2024-09-12T00:12:22.840587+0000","last_unstale":"2024-09-12T01:11:06.249463+0000","last_undegraded":"2024-09-12T01:11:06.249463+0000","last_fullsized":"2024-09-12T01:11:06.249463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:11:06.249395+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:11:06.249395+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.249395+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:59.319645+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00065014999999999995,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"263'371","reported_seq":1097,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.091924+0000","last_change":"2024-09-12T01:11:05.091924+0000","last_active":"2024-09-12T01:11:05.091924+0000","last_peered":"2024-09-12T01:11:05.091924+0000","last_clean":"2024-09-12T01:11:05.091924+0000","last_became_active":"2024-09-12T00:12:36.039564+0000","last_became_peered":"2024-09-12T00:12:36.039564+0000","last_unstale":"2024-09-12T01:11:05.091924+0000","last_undegraded":"2024-09-12T01:11:05.091924+0000","last_fullsized":"2024-09-12T01:11:05.091924+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-12T01:11:05.091758+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-12T01:11:05.091758+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.091758+0000","objects_scrubbed":10,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:43:28.012152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568589,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":639,"num_read_kb":35583,"num_write":1189,"num_write_kb":35527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.769511+0000","last_change":"2024-09-12T01:11:17.769511+0000","last_active":"2024-09-12T01:11:17.769511+0000","last_peered":"2024-09-12T01:11:17.769511+0000","last_clean":"2024-09-12T01:11:17.769511+0000","last_became_active":"2024-09-12T00:12:40.042510+0000","last_became_peered":"2024-09-12T00:12:40.042510+0000","last_unstale":"2024-09-12T01:11:17.769511+0000","last_undegraded":"2024-09-12T01:11:17.769511+0000","last_fullsized":"2024-09-12T01:11:17.769511+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:17.769411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:17.769411+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.769411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:32.805066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"263'138","reported_seq":683,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.956840+0000","last_change":"2024-09-12T01:11:29.956840+0000","last_active":"2024-09-12T01:11:29.956840+0000","last_peered":"2024-09-12T01:11:29.956840+0000","last_clean":"2024-09-12T01:11:29.956840+0000","last_became_active":"2024-09-12T00:12:42.050143+0000","last_became_peered":"2024-09-12T00:12:42.050143+0000","last_unstale":"2024-09-12T01:11:29.956840+0000","last_undegraded":"2024-09-12T01:11:29.956840+0000","last_fullsized":"2024-09-12T01:11:29.956840+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'138","last_scrub_stamp":"2024-09-12T01:11:29.956738+0000","last_deep_scrub":"263'138","last_deep_scrub_stamp":"2024-09-12T01:11:29.956738+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.956738+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:27.747936+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":161,"num_read_kb":155,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.503337+0000","last_change":"2024-09-12T01:11:42.503337+0000","last_active":"2024-09-12T01:11:42.503337+0000","last_peered":"2024-09-12T01:11:42.503337+0000","last_clean":"2024-09-12T01:11:42.503337+0000","last_became_active":"2024-09-12T00:12:44.059037+0000","last_became_peered":"2024-09-12T00:12:44.059037+0000","last_unstale":"2024-09-12T01:11:42.503337+0000","last_undegraded":"2024-09-12T01:11:42.503337+0000","last_fullsized":"2024-09-12T01:11:42.503337+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:42.503235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:42.503235+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.503235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:26.070012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"263'164","reported_seq":724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.315796+0000","last_change":"2024-09-12T01:11:33.315796+0000","last_active":"2024-09-12T01:11:33.315796+0000","last_peered":"2024-09-12T01:11:33.315796+0000","last_clean":"2024-09-12T01:11:33.315796+0000","last_became_active":"2024-09-12T00:12:46.068934+0000","last_became_peered":"2024-09-12T00:12:46.068934+0000","last_unstale":"2024-09-12T01:11:33.315796+0000","last_undegraded":"2024-09-12T01:11:33.315796+0000","last_fullsized":"2024-09-12T01:11:33.315796+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'164","last_scrub_stamp":"2024-09-12T01:11:33.315710+0000","last_deep_scrub":"263'164","last_deep_scrub_stamp":"2024-09-12T01:11:33.315710+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.315710+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:58.486227+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":270,"num_read_kb":259,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"263'111","reported_seq":695,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.199730+0000","last_change":"2024-09-12T01:11:15.199730+0000","last_active":"2024-09-12T01:11:15.199730+0000","last_peered":"2024-09-12T01:11:15.199730+0000","last_clean":"2024-09-12T01:11:15.199730+0000","last_became_active":"2024-09-12T00:12:38.044464+0000","last_became_peered":"2024-09-12T00:12:38.044464+0000","last_unstale":"2024-09-12T01:11:15.199730+0000","last_undegraded":"2024-09-12T01:11:15.199730+0000","last_fullsized":"2024-09-12T01:11:15.199730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:11:15.199631+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:11:15.199631+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.199631+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:16.550535+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":513,"num_read_kb":428,"num_write":178,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"263'371","reported_seq":1145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:04.190226+0000","last_change":"2024-09-12T01:11:04.190168+0000","last_active":"2024-09-12T01:11:04.190226+0000","last_peered":"2024-09-12T01:11:04.190226+0000","last_clean":"2024-09-12T01:11:04.190226+0000","last_became_active":"2024-09-12T00:12:36.036570+0000","last_became_peered":"2024-09-12T00:12:36.036570+0000","last_unstale":"2024-09-12T01:11:04.190226+0000","last_undegraded":"2024-09-12T01:11:04.190226+0000","last_fullsized":"2024-09-12T01:11:04.190226+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-12T01:11:04.190045+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-12T01:11:04.190045+0000","last_clean_scrub_stamp":"2024-09-12T01:11:04.190045+0000","objects_scrubbed":9,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:33.603768+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524373,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":804,"num_read_kb":22341,"num_write":1147,"num_write_kb":30942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.589125+0000","last_change":"2024-09-12T01:11:05.589125+0000","last_active":"2024-09-12T01:11:05.589125+0000","last_peered":"2024-09-12T01:11:05.589125+0000","last_clean":"2024-09-12T01:11:05.589125+0000","last_became_active":"2024-09-12T00:12:22.840210+0000","last_became_peered":"2024-09-12T00:12:22.840210+0000","last_unstale":"2024-09-12T01:11:05.589125+0000","last_undegraded":"2024-09-12T01:11:05.589125+0000","last_fullsized":"2024-09-12T01:11:05.589125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:05.589031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:05.589031+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.589031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:48.332487+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00043827699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.462491+0000","last_change":"2024-09-12T01:11:23.462491+0000","last_active":"2024-09-12T01:11:23.462491+0000","last_peered":"2024-09-12T01:11:23.462491+0000","last_clean":"2024-09-12T01:11:23.462491+0000","last_became_active":"2024-09-12T00:12:40.040760+0000","last_became_peered":"2024-09-12T00:12:40.040760+0000","last_unstale":"2024-09-12T01:11:23.462491+0000","last_undegraded":"2024-09-12T01:11:23.462491+0000","last_fullsized":"2024-09-12T01:11:23.462491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.462403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.462403+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.462403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:07.120114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"263'635","reported_seq":1315,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.726383+0000","last_change":"2024-09-12T01:11:20.726383+0000","last_active":"2024-09-12T01:11:20.726383+0000","last_peered":"2024-09-12T01:11:20.726383+0000","last_clean":"2024-09-12T01:11:20.726383+0000","last_became_active":"2024-09-12T00:12:42.053472+0000","last_became_peered":"2024-09-12T00:12:42.053472+0000","last_unstale":"2024-09-12T01:11:20.726383+0000","last_undegraded":"2024-09-12T01:11:20.726383+0000","last_fullsized":"2024-09-12T01:11:20.726383+0000","mapping_epoch":33,"log_start":"263'600","ondisk_log_start":"263'600","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'635","last_scrub_stamp":"2024-09-12T01:11:20.726278+0000","last_deep_scrub":"263'635","last_deep_scrub_stamp":"2024-09-12T01:11:20.726278+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.726278+0000","objects_scrubbed":11,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:47.077848+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1715,"num_read_kb":3028,"num_write":2216,"num_write_kb":2038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":509110,"num_omap_keys":1156,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.329191+0000","last_change":"2024-09-12T01:11:25.329191+0000","last_active":"2024-09-12T01:11:25.329191+0000","last_peered":"2024-09-12T01:11:25.329191+0000","last_clean":"2024-09-12T01:11:25.329191+0000","last_became_active":"2024-09-12T00:12:44.048703+0000","last_became_peered":"2024-09-12T00:12:44.048703+0000","last_unstale":"2024-09-12T01:11:25.329191+0000","last_undegraded":"2024-09-12T01:11:25.329191+0000","last_fullsized":"2024-09-12T01:11:25.329191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:25.329100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:25.329100+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.329100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:40.236532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"263'148","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.845516+0000","last_change":"2024-09-12T01:11:40.845516+0000","last_active":"2024-09-12T01:11:40.845516+0000","last_peered":"2024-09-12T01:11:40.845516+0000","last_clean":"2024-09-12T01:11:40.845516+0000","last_became_active":"2024-09-12T00:12:46.063429+0000","last_became_peered":"2024-09-12T00:12:46.063429+0000","last_unstale":"2024-09-12T01:11:40.845516+0000","last_undegraded":"2024-09-12T01:11:40.845516+0000","last_fullsized":"2024-09-12T01:11:40.845516+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'148","last_scrub_stamp":"2024-09-12T01:11:40.845415+0000","last_deep_scrub":"263'148","last_deep_scrub_stamp":"2024-09-12T01:11:40.845415+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.845415+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:07.217647+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":121,"num_write":320,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"263'178","reported_seq":796,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.232032+0000","last_change":"2024-09-12T01:11:14.232032+0000","last_active":"2024-09-12T01:11:14.232032+0000","last_peered":"2024-09-12T01:11:14.232032+0000","last_clean":"2024-09-12T01:11:14.232032+0000","last_became_active":"2024-09-12T00:12:38.041178+0000","last_became_peered":"2024-09-12T00:12:38.041178+0000","last_unstale":"2024-09-12T01:11:14.232032+0000","last_undegraded":"2024-09-12T01:11:14.232032+0000","last_fullsized":"2024-09-12T01:11:14.232032+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'178","last_scrub_stamp":"2024-09-12T01:11:14.231899+0000","last_deep_scrub":"263'178","last_deep_scrub_stamp":"2024-09-12T01:11:14.231899+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.231899+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:31.662431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":778,"num_read_kb":646,"num_write":262,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"263'366","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.335804+0000","last_change":"2024-09-12T01:11:07.335804+0000","last_active":"2024-09-12T01:11:07.335804+0000","last_peered":"2024-09-12T01:11:07.335804+0000","last_clean":"2024-09-12T01:11:07.335804+0000","last_became_active":"2024-09-12T00:12:36.035932+0000","last_became_peered":"2024-09-12T00:12:36.035932+0000","last_unstale":"2024-09-12T01:11:07.335804+0000","last_undegraded":"2024-09-12T01:11:07.335804+0000","last_fullsized":"2024-09-12T01:11:07.335804+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'366","last_scrub_stamp":"2024-09-12T01:11:07.335670+0000","last_deep_scrub":"263'366","last_deep_scrub_stamp":"2024-09-12T01:11:07.335670+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.335670+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:26.350544+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":22298,"num_write":1170,"num_write_kb":32564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.332587+0000","last_change":"2024-09-12T01:11:08.332587+0000","last_active":"2024-09-12T01:11:08.332587+0000","last_peered":"2024-09-12T01:11:08.332587+0000","last_clean":"2024-09-12T01:11:08.332587+0000","last_became_active":"2024-09-12T00:12:22.713263+0000","last_became_peered":"2024-09-12T00:12:22.713263+0000","last_unstale":"2024-09-12T01:11:08.332587+0000","last_undegraded":"2024-09-12T01:11:08.332587+0000","last_fullsized":"2024-09-12T01:11:08.332587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:08.332490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:08.332490+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.332490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:24.233170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065424400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.142367+0000","last_change":"2024-09-12T01:11:19.142367+0000","last_active":"2024-09-12T01:11:19.142367+0000","last_peered":"2024-09-12T01:11:19.142367+0000","last_clean":"2024-09-12T01:11:19.142367+0000","last_became_active":"2024-09-12T00:12:40.038903+0000","last_became_peered":"2024-09-12T00:12:40.038903+0000","last_unstale":"2024-09-12T01:11:19.142367+0000","last_undegraded":"2024-09-12T01:11:19.142367+0000","last_fullsized":"2024-09-12T01:11:19.142367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.142267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.142267+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.142267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:18.760101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"263'180","reported_seq":758,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.380764+0000","last_change":"2024-09-12T01:11:25.380764+0000","last_active":"2024-09-12T01:11:25.380764+0000","last_peered":"2024-09-12T01:11:25.380764+0000","last_clean":"2024-09-12T01:11:25.380764+0000","last_became_active":"2024-09-12T00:12:42.050580+0000","last_became_peered":"2024-09-12T00:12:42.050580+0000","last_unstale":"2024-09-12T01:11:25.380764+0000","last_undegraded":"2024-09-12T01:11:25.380764+0000","last_fullsized":"2024-09-12T01:11:25.380764+0000","mapping_epoch":33,"log_start":"260'100","ondisk_log_start":"260'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-12T01:11:25.380659+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-12T01:11:25.380659+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.380659+0000","objects_scrubbed":8,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:36.184071+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":221,"num_write":156,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"263'778","reported_seq":2709,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.362048+0000","last_change":"2024-09-12T01:11:25.362048+0000","last_active":"2024-09-12T01:11:25.362048+0000","last_peered":"2024-09-12T01:11:25.362048+0000","last_clean":"2024-09-12T01:11:25.362048+0000","last_became_active":"2024-09-12T00:12:44.050295+0000","last_became_peered":"2024-09-12T00:12:44.050295+0000","last_unstale":"2024-09-12T01:11:25.362048+0000","last_undegraded":"2024-09-12T01:11:25.362048+0000","last_fullsized":"2024-09-12T01:11:25.362048+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'778","last_scrub_stamp":"2024-09-12T01:11:25.361928+0000","last_deep_scrub":"263'778","last_deep_scrub_stamp":"2024-09-12T01:11:25.361928+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.361928+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:09.364763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"263'131","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.684055+0000","last_change":"2024-09-12T01:11:36.684055+0000","last_active":"2024-09-12T01:11:36.684055+0000","last_peered":"2024-09-12T01:11:36.684055+0000","last_clean":"2024-09-12T01:11:36.684055+0000","last_became_active":"2024-09-12T00:12:46.064036+0000","last_became_peered":"2024-09-12T00:12:46.064036+0000","last_unstale":"2024-09-12T01:11:36.684055+0000","last_undegraded":"2024-09-12T01:11:36.684055+0000","last_fullsized":"2024-09-12T01:11:36.684055+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'131","last_scrub_stamp":"2024-09-12T01:11:36.683958+0000","last_deep_scrub":"263'131","last_deep_scrub_stamp":"2024-09-12T01:11:36.683958+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.683958+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:14.571309+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1116,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"263'66","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.583250+0000","last_change":"2024-09-12T01:11:15.583250+0000","last_active":"2024-09-12T01:11:15.583250+0000","last_peered":"2024-09-12T01:11:15.583250+0000","last_clean":"2024-09-12T01:11:15.583250+0000","last_became_active":"2024-09-12T00:12:38.039759+0000","last_became_peered":"2024-09-12T00:12:38.039759+0000","last_unstale":"2024-09-12T01:11:15.583250+0000","last_undegraded":"2024-09-12T01:11:15.583250+0000","last_fullsized":"2024-09-12T01:11:15.583250+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'66","last_scrub_stamp":"2024-09-12T01:11:15.583159+0000","last_deep_scrub":"263'66","last_deep_scrub_stamp":"2024-09-12T01:11:15.583159+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.583159+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:34.335798+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":290,"num_read_kb":242,"num_write":89,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":503,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"263'356","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.632386+0000","last_change":"2024-09-12T01:11:08.632286+0000","last_active":"2024-09-12T01:11:08.632386+0000","last_peered":"2024-09-12T01:11:08.632386+0000","last_clean":"2024-09-12T01:11:08.632386+0000","last_became_active":"2024-09-12T00:12:36.032470+0000","last_became_peered":"2024-09-12T00:12:36.032470+0000","last_unstale":"2024-09-12T01:11:08.632386+0000","last_undegraded":"2024-09-12T01:11:08.632386+0000","last_fullsized":"2024-09-12T01:11:08.632386+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-12T01:11:08.632121+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-12T01:11:08.632121+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.632121+0000","objects_scrubbed":8,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:33.909337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":506,"num_read_kb":9897,"num_write":1201,"num_write_kb":25017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.678646+0000","last_change":"2024-09-12T01:11:06.678646+0000","last_active":"2024-09-12T01:11:06.678646+0000","last_peered":"2024-09-12T01:11:06.678646+0000","last_clean":"2024-09-12T01:11:06.678646+0000","last_became_active":"2024-09-12T00:12:22.875452+0000","last_became_peered":"2024-09-12T00:12:22.875452+0000","last_unstale":"2024-09-12T01:11:06.678646+0000","last_undegraded":"2024-09-12T01:11:06.678646+0000","last_fullsized":"2024-09-12T01:11:06.678646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:06.678559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:06.678559+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.678559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:14.194427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040035500000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.458334+0000","last_change":"2024-09-12T01:11:29.458334+0000","last_active":"2024-09-12T01:11:29.458334+0000","last_peered":"2024-09-12T01:11:29.458334+0000","last_clean":"2024-09-12T01:11:29.458334+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:11:29.458334+0000","last_undegraded":"2024-09-12T01:11:29.458334+0000","last_fullsized":"2024-09-12T01:11:29.458334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:29.458251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:29.458251+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.458251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:45.810217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"263'135","reported_seq":689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:35.446074+0000","last_change":"2024-09-12T01:11:35.446074+0000","last_active":"2024-09-12T01:11:35.446074+0000","last_peered":"2024-09-12T01:11:35.446074+0000","last_clean":"2024-09-12T01:11:35.446074+0000","last_became_active":"2024-09-12T00:12:42.048364+0000","last_became_peered":"2024-09-12T00:12:42.048364+0000","last_unstale":"2024-09-12T01:11:35.446074+0000","last_undegraded":"2024-09-12T01:11:35.446074+0000","last_fullsized":"2024-09-12T01:11:35.446074+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'135","last_scrub_stamp":"2024-09-12T01:11:35.445983+0000","last_deep_scrub":"263'135","last_deep_scrub_stamp":"2024-09-12T01:11:35.445983+0000","last_clean_scrub_stamp":"2024-09-12T01:11:35.445983+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:10.155213+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"263'807","reported_seq":2525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:31.996362+0000","last_change":"2024-09-12T01:11:31.996362+0000","last_active":"2024-09-12T01:11:31.996362+0000","last_peered":"2024-09-12T01:11:31.996362+0000","last_clean":"2024-09-12T01:11:31.996362+0000","last_became_active":"2024-09-12T00:12:44.049336+0000","last_became_peered":"2024-09-12T00:12:44.049336+0000","last_unstale":"2024-09-12T01:11:31.996362+0000","last_undegraded":"2024-09-12T01:11:31.996362+0000","last_fullsized":"2024-09-12T01:11:31.996362+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'807","last_scrub_stamp":"2024-09-12T01:11:31.996271+0000","last_deep_scrub":"263'807","last_deep_scrub_stamp":"2024-09-12T01:11:31.996271+0000","last_clean_scrub_stamp":"2024-09-12T01:11:31.996271+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:45.036685+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"263'276","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.880179+0000","last_change":"2024-09-12T01:11:39.880179+0000","last_active":"2024-09-12T01:11:39.880179+0000","last_peered":"2024-09-12T01:11:39.880179+0000","last_clean":"2024-09-12T01:11:39.880179+0000","last_became_active":"2024-09-12T00:12:46.064058+0000","last_became_peered":"2024-09-12T00:12:46.064058+0000","last_unstale":"2024-09-12T01:11:39.880179+0000","last_undegraded":"2024-09-12T01:11:39.880179+0000","last_fullsized":"2024-09-12T01:11:39.880179+0000","mapping_epoch":37,"log_start":"263'200","ondisk_log_start":"263'200","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'276","last_scrub_stamp":"2024-09-12T01:11:39.880061+0000","last_deep_scrub":"263'276","last_deep_scrub_stamp":"2024-09-12T01:11:39.880061+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.880061+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:43.220270+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":363,"num_read_kb":352,"num_write":596,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"263'133","reported_seq":725,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.182032+0000","last_change":"2024-09-12T01:11:06.182032+0000","last_active":"2024-09-12T01:11:06.182032+0000","last_peered":"2024-09-12T01:11:06.182032+0000","last_clean":"2024-09-12T01:11:06.182032+0000","last_became_active":"2024-09-12T00:12:38.044075+0000","last_became_peered":"2024-09-12T00:12:38.044075+0000","last_unstale":"2024-09-12T01:11:06.182032+0000","last_undegraded":"2024-09-12T01:11:06.182032+0000","last_fullsized":"2024-09-12T01:11:06.182032+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-12T01:11:06.181955+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-12T01:11:06.181955+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.181955+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:46.555230+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":588,"num_read_kb":484,"num_write":211,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"263'410","reported_seq":1169,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.675980+0000","last_change":"2024-09-12T01:11:07.675922+0000","last_active":"2024-09-12T01:11:07.675980+0000","last_peered":"2024-09-12T01:11:07.675980+0000","last_clean":"2024-09-12T01:11:07.675980+0000","last_became_active":"2024-09-12T00:12:36.030644+0000","last_became_peered":"2024-09-12T00:12:36.030644+0000","last_unstale":"2024-09-12T01:11:07.675980+0000","last_undegraded":"2024-09-12T01:11:07.675980+0000","last_fullsized":"2024-09-12T01:11:07.675980+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'410","last_scrub_stamp":"2024-09-12T01:11:07.675795+0000","last_deep_scrub":"263'410","last_deep_scrub_stamp":"2024-09-12T01:11:07.675795+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.675795+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:12.979636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568642,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":738,"num_read_kb":123120,"num_write":1245,"num_write_kb":49104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.293104+0000","last_change":"2024-09-12T01:11:07.293104+0000","last_active":"2024-09-12T01:11:07.293104+0000","last_peered":"2024-09-12T01:11:07.293104+0000","last_clean":"2024-09-12T01:11:07.293104+0000","last_became_active":"2024-09-12T00:12:22.875444+0000","last_became_peered":"2024-09-12T00:12:22.875444+0000","last_unstale":"2024-09-12T01:11:07.293104+0000","last_undegraded":"2024-09-12T01:11:07.293104+0000","last_fullsized":"2024-09-12T01:11:07.293104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:07.293023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:07.293023+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.293023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:23.494982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001017387,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"263'6","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.448019+0000","last_change":"2024-09-12T01:11:21.448019+0000","last_active":"2024-09-12T01:11:21.448019+0000","last_peered":"2024-09-12T01:11:21.448019+0000","last_clean":"2024-09-12T01:11:21.448019+0000","last_became_active":"2024-09-12T00:12:40.031382+0000","last_became_peered":"2024-09-12T00:12:40.031382+0000","last_unstale":"2024-09-12T01:11:21.448019+0000","last_undegraded":"2024-09-12T01:11:21.448019+0000","last_fullsized":"2024-09-12T01:11:21.448019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T01:11:21.447933+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T01:11:21.447933+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.447933+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:55.518009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":735,"num_read_kb":1204,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"263'736","reported_seq":1470,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.161140+0000","last_change":"2024-09-12T01:11:26.161140+0000","last_active":"2024-09-12T01:11:26.161140+0000","last_peered":"2024-09-12T01:11:26.161140+0000","last_clean":"2024-09-12T01:11:26.161140+0000","last_became_active":"2024-09-12T00:12:42.043328+0000","last_became_peered":"2024-09-12T00:12:42.043328+0000","last_unstale":"2024-09-12T01:11:26.161140+0000","last_undegraded":"2024-09-12T01:11:26.161140+0000","last_fullsized":"2024-09-12T01:11:26.161140+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'736","last_scrub_stamp":"2024-09-12T01:11:26.161042+0000","last_deep_scrub":"263'736","last_deep_scrub_stamp":"2024-09-12T01:11:26.161042+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.161042+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:32.910416+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147946,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1306,"num_read_kb":3069,"num_write":1058,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:33.551253+0000","last_change":"2024-09-12T01:11:33.551253+0000","last_active":"2024-09-12T01:11:33.551253+0000","last_peered":"2024-09-12T01:11:33.551253+0000","last_clean":"2024-09-12T01:11:33.551253+0000","last_became_active":"2024-09-12T00:12:44.061206+0000","last_became_peered":"2024-09-12T00:12:44.061206+0000","last_unstale":"2024-09-12T01:11:33.551253+0000","last_undegraded":"2024-09-12T01:11:33.551253+0000","last_fullsized":"2024-09-12T01:11:33.551253+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:33.551163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:33.551163+0000","last_clean_scrub_stamp":"2024-09-12T01:11:33.551163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:30.138665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"263'99","reported_seq":601,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.348833+0000","last_change":"2024-09-12T01:11:30.348833+0000","last_active":"2024-09-12T01:11:30.348833+0000","last_peered":"2024-09-12T01:11:30.348833+0000","last_clean":"2024-09-12T01:11:30.348833+0000","last_became_active":"2024-09-12T00:12:46.058465+0000","last_became_peered":"2024-09-12T00:12:46.058465+0000","last_unstale":"2024-09-12T01:11:30.348833+0000","last_undegraded":"2024-09-12T01:11:30.348833+0000","last_fullsized":"2024-09-12T01:11:30.348833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'99","last_scrub_stamp":"2024-09-12T01:11:30.348742+0000","last_deep_scrub":"263'99","last_deep_scrub_stamp":"2024-09-12T01:11:30.348742+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.348742+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:01.724178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":104,"num_read_kb":101,"num_write":234,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"263'140","reported_seq":715,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.475498+0000","last_change":"2024-09-12T01:11:40.475498+0000","last_active":"2024-09-12T01:11:40.475498+0000","last_peered":"2024-09-12T01:11:40.475498+0000","last_clean":"2024-09-12T01:11:40.475498+0000","last_became_active":"2024-09-12T00:12:46.063423+0000","last_became_peered":"2024-09-12T00:12:46.063423+0000","last_unstale":"2024-09-12T01:11:40.475498+0000","last_undegraded":"2024-09-12T01:11:40.475498+0000","last_fullsized":"2024-09-12T01:11:40.475498+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'140","last_scrub_stamp":"2024-09-12T01:11:40.475408+0000","last_deep_scrub":"263'140","last_deep_scrub_stamp":"2024-09-12T01:11:40.475408+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.475408+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:53.336911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":268,"num_read_kb":252,"num_write":335,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"263'151","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.153506+0000","last_change":"2024-09-12T01:11:08.153506+0000","last_active":"2024-09-12T01:11:08.153506+0000","last_peered":"2024-09-12T01:11:08.153506+0000","last_clean":"2024-09-12T01:11:08.153506+0000","last_became_active":"2024-09-12T00:12:38.041665+0000","last_became_peered":"2024-09-12T00:12:38.041665+0000","last_unstale":"2024-09-12T01:11:08.153506+0000","last_undegraded":"2024-09-12T01:11:08.153506+0000","last_fullsized":"2024-09-12T01:11:08.153506+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-12T01:11:08.153413+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-12T01:11:08.153413+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.153413+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:15.216054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":652,"num_read_kb":531,"num_write":244,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"263'302","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.351636+0000","last_change":"2024-09-12T01:11:14.351574+0000","last_active":"2024-09-12T01:11:14.351636+0000","last_peered":"2024-09-12T01:11:14.351636+0000","last_clean":"2024-09-12T01:11:14.351636+0000","last_became_active":"2024-09-12T00:13:07.152470+0000","last_became_peered":"2024-09-12T00:13:07.152470+0000","last_unstale":"2024-09-12T01:11:14.351636+0000","last_undegraded":"2024-09-12T01:11:14.351636+0000","last_fullsized":"2024-09-12T01:11:14.351636+0000","mapping_epoch":40,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-12T01:11:14.351438+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-12T01:11:14.351438+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.351438+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:06.001614+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5098973,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":439,"num_read_kb":19566,"num_write":916,"num_write_kb":20485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.301017+0000","last_change":"2024-09-12T01:11:23.301017+0000","last_active":"2024-09-12T01:11:23.301017+0000","last_peered":"2024-09-12T01:11:23.301017+0000","last_clean":"2024-09-12T01:11:23.301017+0000","last_became_active":"2024-09-12T00:12:40.038618+0000","last_became_peered":"2024-09-12T00:12:40.038618+0000","last_unstale":"2024-09-12T01:11:23.301017+0000","last_undegraded":"2024-09-12T01:11:23.301017+0000","last_fullsized":"2024-09-12T01:11:23.301017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:23.300915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:23.300915+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.300915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:59.972534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"263'284","reported_seq":870,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.433394+0000","last_change":"2024-09-12T01:11:28.433394+0000","last_active":"2024-09-12T01:11:28.433394+0000","last_peered":"2024-09-12T01:11:28.433394+0000","last_clean":"2024-09-12T01:11:28.433394+0000","last_became_active":"2024-09-12T00:12:42.049685+0000","last_became_peered":"2024-09-12T00:12:42.049685+0000","last_unstale":"2024-09-12T01:11:28.433394+0000","last_undegraded":"2024-09-12T01:11:28.433394+0000","last_fullsized":"2024-09-12T01:11:28.433394+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'284","last_scrub_stamp":"2024-09-12T01:11:28.433284+0000","last_deep_scrub":"263'284","last_deep_scrub_stamp":"2024-09-12T01:11:28.433284+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.433284+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:24.058698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49303,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":1021,"num_write":368,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.766555+0000","last_change":"2024-09-12T01:11:24.766555+0000","last_active":"2024-09-12T01:11:24.766555+0000","last_peered":"2024-09-12T01:11:24.766555+0000","last_clean":"2024-09-12T01:11:24.766555+0000","last_became_active":"2024-09-12T00:12:44.062468+0000","last_became_peered":"2024-09-12T00:12:44.062468+0000","last_unstale":"2024-09-12T01:11:24.766555+0000","last_undegraded":"2024-09-12T01:11:24.766555+0000","last_fullsized":"2024-09-12T01:11:24.766555+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.766460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.766460+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.766460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:08:23.827912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"263'130","reported_seq":648,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.715543+0000","last_change":"2024-09-12T01:11:30.715543+0000","last_active":"2024-09-12T01:11:30.715543+0000","last_peered":"2024-09-12T01:11:30.715543+0000","last_clean":"2024-09-12T01:11:30.715543+0000","last_became_active":"2024-09-12T00:12:46.064080+0000","last_became_peered":"2024-09-12T00:12:46.064080+0000","last_unstale":"2024-09-12T01:11:30.715543+0000","last_undegraded":"2024-09-12T01:11:30.715543+0000","last_fullsized":"2024-09-12T01:11:30.715543+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'130","last_scrub_stamp":"2024-09-12T01:11:30.715445+0000","last_deep_scrub":"263'130","last_deep_scrub_stamp":"2024-09-12T01:11:30.715445+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.715445+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:44.481368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":189,"num_write":302,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"263'149","reported_seq":749,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.572027+0000","last_change":"2024-09-12T01:11:12.572027+0000","last_active":"2024-09-12T01:11:12.572027+0000","last_peered":"2024-09-12T01:11:12.572027+0000","last_clean":"2024-09-12T01:11:12.572027+0000","last_became_active":"2024-09-12T00:12:38.044990+0000","last_became_peered":"2024-09-12T00:12:38.044990+0000","last_unstale":"2024-09-12T01:11:12.572027+0000","last_undegraded":"2024-09-12T01:11:12.572027+0000","last_fullsized":"2024-09-12T01:11:12.572027+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-12T01:11:12.571917+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-12T01:11:12.571917+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.571917+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:43.018147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":701,"num_read_kb":570,"num_write":228,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4004,"num_omap_keys":18,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"263'340","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.110025+0000","last_change":"2024-09-12T01:11:07.110025+0000","last_active":"2024-09-12T01:11:07.110025+0000","last_peered":"2024-09-12T01:11:07.110025+0000","last_clean":"2024-09-12T01:11:07.110025+0000","last_became_active":"2024-09-12T00:12:36.034816+0000","last_became_peered":"2024-09-12T00:12:36.034816+0000","last_unstale":"2024-09-12T01:11:07.110025+0000","last_undegraded":"2024-09-12T01:11:07.110025+0000","last_fullsized":"2024-09-12T01:11:07.110025+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:11:07.109934+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:11:07.109934+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.109934+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:11.045354+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":1836,"num_write":1158,"num_write_kb":16367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.568944+0000","last_change":"2024-09-12T01:11:30.568944+0000","last_active":"2024-09-12T01:11:30.568944+0000","last_peered":"2024-09-12T01:11:30.568944+0000","last_clean":"2024-09-12T01:11:30.568944+0000","last_became_active":"2024-09-12T00:12:40.042104+0000","last_became_peered":"2024-09-12T00:12:40.042104+0000","last_unstale":"2024-09-12T01:11:30.568944+0000","last_undegraded":"2024-09-12T01:11:30.568944+0000","last_fullsized":"2024-09-12T01:11:30.568944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:30.568846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:30.568846+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.568846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:43.355533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"263'58","reported_seq":569,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.597786+0000","last_change":"2024-09-12T01:11:29.597786+0000","last_active":"2024-09-12T01:11:29.597786+0000","last_peered":"2024-09-12T01:11:29.597786+0000","last_clean":"2024-09-12T01:11:29.597786+0000","last_became_active":"2024-09-12T00:12:42.043599+0000","last_became_peered":"2024-09-12T00:12:42.043599+0000","last_unstale":"2024-09-12T01:11:29.597786+0000","last_undegraded":"2024-09-12T01:11:29.597786+0000","last_fullsized":"2024-09-12T01:11:29.597786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'58","last_scrub_stamp":"2024-09-12T01:11:29.597680+0000","last_deep_scrub":"263'58","last_deep_scrub_stamp":"2024-09-12T01:11:29.597680+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.597680+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:43.257209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.345992+0000","last_change":"2024-09-12T01:11:26.345992+0000","last_active":"2024-09-12T01:11:26.345992+0000","last_peered":"2024-09-12T01:11:26.345992+0000","last_clean":"2024-09-12T01:11:26.345992+0000","last_became_active":"2024-09-12T00:12:44.054145+0000","last_became_peered":"2024-09-12T00:12:44.054145+0000","last_unstale":"2024-09-12T01:11:26.345992+0000","last_undegraded":"2024-09-12T01:11:26.345992+0000","last_fullsized":"2024-09-12T01:11:26.345992+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:26.345902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:26.345902+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.345902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:27.321728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"263'203","reported_seq":756,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.505589+0000","last_change":"2024-09-12T01:11:38.505589+0000","last_active":"2024-09-12T01:11:38.505589+0000","last_peered":"2024-09-12T01:11:38.505589+0000","last_clean":"2024-09-12T01:11:38.505589+0000","last_became_active":"2024-09-12T00:12:46.059520+0000","last_became_peered":"2024-09-12T00:12:46.059520+0000","last_unstale":"2024-09-12T01:11:38.505589+0000","last_undegraded":"2024-09-12T01:11:38.505589+0000","last_fullsized":"2024-09-12T01:11:38.505589+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'203","last_scrub_stamp":"2024-09-12T01:11:38.505473+0000","last_deep_scrub":"263'203","last_deep_scrub_stamp":"2024-09-12T01:11:38.505473+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.505473+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:27.246093+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":406,"num_read_kb":365,"num_write":468,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"263'124","reported_seq":731,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.605360+0000","last_change":"2024-09-12T01:11:14.605360+0000","last_active":"2024-09-12T01:11:14.605360+0000","last_peered":"2024-09-12T01:11:14.605360+0000","last_clean":"2024-09-12T01:11:14.605360+0000","last_became_active":"2024-09-12T00:12:38.040948+0000","last_became_peered":"2024-09-12T00:12:38.040948+0000","last_unstale":"2024-09-12T01:11:14.605360+0000","last_undegraded":"2024-09-12T01:11:14.605360+0000","last_fullsized":"2024-09-12T01:11:14.605360+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'124","last_scrub_stamp":"2024-09-12T01:11:14.605261+0000","last_deep_scrub":"263'124","last_deep_scrub_stamp":"2024-09-12T01:11:14.605261+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.605261+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:12.209675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":483,"num_write":204,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"263'334","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.165772+0000","last_change":"2024-09-12T01:11:12.165772+0000","last_active":"2024-09-12T01:11:12.165772+0000","last_peered":"2024-09-12T01:11:12.165772+0000","last_clean":"2024-09-12T01:11:12.165772+0000","last_became_active":"2024-09-12T00:12:36.038823+0000","last_became_peered":"2024-09-12T00:12:36.038823+0000","last_unstale":"2024-09-12T01:11:12.165772+0000","last_undegraded":"2024-09-12T01:11:12.165772+0000","last_fullsized":"2024-09-12T01:11:12.165772+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'334","last_scrub_stamp":"2024-09-12T01:11:12.165636+0000","last_deep_scrub":"263'334","last_deep_scrub_stamp":"2024-09-12T01:11:12.165636+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.165636+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:57.769236+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4364565,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":548,"num_read_kb":31576,"num_write":1085,"num_write_kb":24420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.176056+0000","last_change":"2024-09-12T01:11:13.176056+0000","last_active":"2024-09-12T01:11:13.176056+0000","last_peered":"2024-09-12T01:11:13.176056+0000","last_clean":"2024-09-12T01:11:13.176056+0000","last_became_active":"2024-09-12T00:12:40.030447+0000","last_became_peered":"2024-09-12T00:12:40.030447+0000","last_unstale":"2024-09-12T01:11:13.176056+0000","last_undegraded":"2024-09-12T01:11:13.176056+0000","last_fullsized":"2024-09-12T01:11:13.176056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:13.175928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:13.175928+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.175928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:21.328720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"263'333","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.686772+0000","last_change":"2024-09-12T01:11:21.686772+0000","last_active":"2024-09-12T01:11:21.686772+0000","last_peered":"2024-09-12T01:11:21.686772+0000","last_clean":"2024-09-12T01:11:21.686772+0000","last_became_active":"2024-09-12T00:12:42.050885+0000","last_became_peered":"2024-09-12T00:12:42.050885+0000","last_unstale":"2024-09-12T01:11:21.686772+0000","last_undegraded":"2024-09-12T01:11:21.686772+0000","last_fullsized":"2024-09-12T01:11:21.686772+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'333","last_scrub_stamp":"2024-09-12T01:11:21.686676+0000","last_deep_scrub":"263'333","last_deep_scrub_stamp":"2024-09-12T01:11:21.686676+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.686676+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:09.163305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52758,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":546,"num_read_kb":1216,"num_write":438,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.340453+0000","last_change":"2024-09-12T01:11:26.340453+0000","last_active":"2024-09-12T01:11:26.340453+0000","last_peered":"2024-09-12T01:11:26.340453+0000","last_clean":"2024-09-12T01:11:26.340453+0000","last_became_active":"2024-09-12T00:12:44.056032+0000","last_became_peered":"2024-09-12T00:12:44.056032+0000","last_unstale":"2024-09-12T01:11:26.340453+0000","last_undegraded":"2024-09-12T01:11:26.340453+0000","last_fullsized":"2024-09-12T01:11:26.340453+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:26.340260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:26.340260+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.340260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:13.793288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"263'122","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:50.575779+0000","last_change":"2024-09-12T01:11:50.575779+0000","last_active":"2024-09-12T01:11:50.575779+0000","last_peered":"2024-09-12T01:11:50.575779+0000","last_clean":"2024-09-12T01:11:50.575779+0000","last_became_active":"2024-09-12T00:12:46.063700+0000","last_became_peered":"2024-09-12T00:12:46.063700+0000","last_unstale":"2024-09-12T01:11:50.575779+0000","last_undegraded":"2024-09-12T01:11:50.575779+0000","last_fullsized":"2024-09-12T01:11:50.575779+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'122","last_scrub_stamp":"2024-09-12T01:11:50.575688+0000","last_deep_scrub":"263'122","last_deep_scrub_stamp":"2024-09-12T01:11:50.575688+0000","last_clean_scrub_stamp":"2024-09-12T01:11:50.575688+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:10.022175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":135,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"263'4185","reported_seq":4818,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.690012+0000","last_change":"2024-09-12T01:11:12.690012+0000","last_active":"2024-09-12T01:11:12.690012+0000","last_peered":"2024-09-12T01:11:12.690012+0000","last_clean":"2024-09-12T01:11:12.690012+0000","last_became_active":"2024-09-12T00:12:38.042680+0000","last_became_peered":"2024-09-12T00:12:38.042680+0000","last_unstale":"2024-09-12T01:11:12.690012+0000","last_undegraded":"2024-09-12T01:11:12.690012+0000","last_fullsized":"2024-09-12T01:11:12.690012+0000","mapping_epoch":29,"log_start":"263'4100","ondisk_log_start":"263'4100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4185","last_scrub_stamp":"2024-09-12T01:11:12.689931+0000","last_deep_scrub":"263'4185","last_deep_scrub_stamp":"2024-09-12T01:11:12.689931+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.689931+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":3000,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:16.576940+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16870,"num_read_kb":14146,"num_write":6296,"num_write_kb":3134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"263'370","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.630088+0000","last_change":"2024-09-12T01:11:07.630088+0000","last_active":"2024-09-12T01:11:07.630088+0000","last_peered":"2024-09-12T01:11:07.630088+0000","last_clean":"2024-09-12T01:11:07.630088+0000","last_became_active":"2024-09-12T00:12:36.034292+0000","last_became_peered":"2024-09-12T00:12:36.034292+0000","last_unstale":"2024-09-12T01:11:07.630088+0000","last_undegraded":"2024-09-12T01:11:07.630088+0000","last_fullsized":"2024-09-12T01:11:07.630088+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-12T01:11:07.629972+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-12T01:11:07.629972+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.629972+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:32.054059+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":3622,"num_write":1273,"num_write_kb":13483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:32.404602+0000","last_change":"2024-09-12T01:11:32.404602+0000","last_active":"2024-09-12T01:11:32.404602+0000","last_peered":"2024-09-12T01:11:32.404602+0000","last_clean":"2024-09-12T01:11:32.404602+0000","last_became_active":"2024-09-12T00:12:40.038192+0000","last_became_peered":"2024-09-12T00:12:40.038192+0000","last_unstale":"2024-09-12T01:11:32.404602+0000","last_undegraded":"2024-09-12T01:11:32.404602+0000","last_fullsized":"2024-09-12T01:11:32.404602+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:32.404520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:32.404520+0000","last_clean_scrub_stamp":"2024-09-12T01:11:32.404520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:48.812439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"263'260","reported_seq":834,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.170941+0000","last_change":"2024-09-12T01:11:24.170941+0000","last_active":"2024-09-12T01:11:24.170941+0000","last_peered":"2024-09-12T01:11:24.170941+0000","last_clean":"2024-09-12T01:11:24.170941+0000","last_became_active":"2024-09-12T00:12:42.046589+0000","last_became_peered":"2024-09-12T00:12:42.046589+0000","last_unstale":"2024-09-12T01:11:24.170941+0000","last_undegraded":"2024-09-12T01:11:24.170941+0000","last_fullsized":"2024-09-12T01:11:24.170941+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'260","last_scrub_stamp":"2024-09-12T01:11:24.170844+0000","last_deep_scrub":"263'260","last_deep_scrub_stamp":"2024-09-12T01:11:24.170844+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.170844+0000","objects_scrubbed":4,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:16.778753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53508,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":436,"num_read_kb":1009,"num_write":352,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:26.787965+0000","last_change":"2024-09-12T01:11:26.787965+0000","last_active":"2024-09-12T01:11:26.787965+0000","last_peered":"2024-09-12T01:11:26.787965+0000","last_clean":"2024-09-12T01:11:26.787965+0000","last_became_active":"2024-09-12T00:12:44.057606+0000","last_became_peered":"2024-09-12T00:12:44.057606+0000","last_unstale":"2024-09-12T01:11:26.787965+0000","last_undegraded":"2024-09-12T01:11:26.787965+0000","last_fullsized":"2024-09-12T01:11:26.787965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:26.787877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:26.787877+0000","last_clean_scrub_stamp":"2024-09-12T01:11:26.787877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:01.737176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"263'180","reported_seq":742,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.340966+0000","last_change":"2024-09-12T01:11:24.340966+0000","last_active":"2024-09-12T01:11:24.340966+0000","last_peered":"2024-09-12T01:11:24.340966+0000","last_clean":"2024-09-12T01:11:24.340966+0000","last_became_active":"2024-09-12T00:12:38.047545+0000","last_became_peered":"2024-09-12T00:12:38.047545+0000","last_unstale":"2024-09-12T01:11:24.340966+0000","last_undegraded":"2024-09-12T01:11:24.340966+0000","last_fullsized":"2024-09-12T01:11:24.340966+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'180","last_scrub_stamp":"2024-09-12T01:11:24.340882+0000","last_deep_scrub":"263'180","last_deep_scrub_stamp":"2024-09-12T01:11:24.340882+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.340882+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:15.550214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":815,"num_read_kb":702,"num_write":306,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"263'317","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.679385+0000","last_change":"2024-09-12T01:11:08.679385+0000","last_active":"2024-09-12T01:11:08.679385+0000","last_peered":"2024-09-12T01:11:08.679385+0000","last_clean":"2024-09-12T01:11:08.679385+0000","last_became_active":"2024-09-12T00:12:36.042983+0000","last_became_peered":"2024-09-12T00:12:36.042983+0000","last_unstale":"2024-09-12T01:11:08.679385+0000","last_undegraded":"2024-09-12T01:11:08.679385+0000","last_fullsized":"2024-09-12T01:11:08.679385+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'317","last_scrub_stamp":"2024-09-12T01:11:08.679268+0000","last_deep_scrub":"263'317","last_deep_scrub_stamp":"2024-09-12T01:11:08.679268+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.679268+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:45.909644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":13747,"num_write":1048,"num_write_kb":22365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.334807+0000","last_change":"2024-09-12T01:11:24.334807+0000","last_active":"2024-09-12T01:11:24.334807+0000","last_peered":"2024-09-12T01:11:24.334807+0000","last_clean":"2024-09-12T01:11:24.334807+0000","last_became_active":"2024-09-12T00:12:40.039678+0000","last_became_peered":"2024-09-12T00:12:40.039678+0000","last_unstale":"2024-09-12T01:11:24.334807+0000","last_undegraded":"2024-09-12T01:11:24.334807+0000","last_fullsized":"2024-09-12T01:11:24.334807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.334703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.334703+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.334703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:33.166392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"263'505","reported_seq":1144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:30.404493+0000","last_change":"2024-09-12T01:11:30.404493+0000","last_active":"2024-09-12T01:11:30.404493+0000","last_peered":"2024-09-12T01:11:30.404493+0000","last_clean":"2024-09-12T01:11:30.404493+0000","last_became_active":"2024-09-12T00:12:42.050479+0000","last_became_peered":"2024-09-12T00:12:42.050479+0000","last_unstale":"2024-09-12T01:11:30.404493+0000","last_undegraded":"2024-09-12T01:11:30.404493+0000","last_fullsized":"2024-09-12T01:11:30.404493+0000","mapping_epoch":33,"log_start":"263'400","ondisk_log_start":"263'400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'505","last_scrub_stamp":"2024-09-12T01:11:30.404398+0000","last_deep_scrub":"263'505","last_deep_scrub_stamp":"2024-09-12T01:11:30.404398+0000","last_clean_scrub_stamp":"2024-09-12T01:11:30.404398+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:15.855952+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104580,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":898,"num_read_kb":2161,"num_write":774,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.370979+0000","last_change":"2024-09-12T01:11:27.370979+0000","last_active":"2024-09-12T01:11:27.370979+0000","last_peered":"2024-09-12T01:11:27.370979+0000","last_clean":"2024-09-12T01:11:27.370979+0000","last_became_active":"2024-09-12T00:12:44.061554+0000","last_became_peered":"2024-09-12T00:12:44.061554+0000","last_unstale":"2024-09-12T01:11:27.370979+0000","last_undegraded":"2024-09-12T01:11:27.370979+0000","last_fullsized":"2024-09-12T01:11:27.370979+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:27.370911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:27.370911+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.370911+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:02.996936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"263'162","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:41.799614+0000","last_change":"2024-09-12T01:11:41.799614+0000","last_active":"2024-09-12T01:11:41.799614+0000","last_peered":"2024-09-12T01:11:41.799614+0000","last_clean":"2024-09-12T01:11:41.799614+0000","last_became_active":"2024-09-12T00:12:46.061727+0000","last_became_peered":"2024-09-12T00:12:46.061727+0000","last_unstale":"2024-09-12T01:11:41.799614+0000","last_undegraded":"2024-09-12T01:11:41.799614+0000","last_fullsized":"2024-09-12T01:11:41.799614+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-12T01:11:41.799508+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-12T01:11:41.799508+0000","last_clean_scrub_stamp":"2024-09-12T01:11:41.799508+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:59.525506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":845,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":215,"num_read_kb":216,"num_write":366,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"263'66","reported_seq":669,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.498922+0000","last_change":"2024-09-12T01:11:17.498922+0000","last_active":"2024-09-12T01:11:17.498922+0000","last_peered":"2024-09-12T01:11:17.498922+0000","last_clean":"2024-09-12T01:11:17.498922+0000","last_became_active":"2024-09-12T00:12:38.040282+0000","last_became_peered":"2024-09-12T00:12:38.040282+0000","last_unstale":"2024-09-12T01:11:17.498922+0000","last_undegraded":"2024-09-12T01:11:17.498922+0000","last_fullsized":"2024-09-12T01:11:17.498922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'66","last_scrub_stamp":"2024-09-12T01:11:17.498837+0000","last_deep_scrub":"263'66","last_deep_scrub_stamp":"2024-09-12T01:11:17.498837+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.498837+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:53.294116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":276,"num_write":85,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"263'343","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.589598+0000","last_change":"2024-09-12T01:11:09.589598+0000","last_active":"2024-09-12T01:11:09.589598+0000","last_peered":"2024-09-12T01:11:09.589598+0000","last_clean":"2024-09-12T01:11:09.589598+0000","last_became_active":"2024-09-12T00:12:36.031081+0000","last_became_peered":"2024-09-12T00:12:36.031081+0000","last_unstale":"2024-09-12T01:11:09.589598+0000","last_undegraded":"2024-09-12T01:11:09.589598+0000","last_fullsized":"2024-09-12T01:11:09.589598+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-12T01:11:09.589432+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-12T01:11:09.589432+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.589432+0000","objects_scrubbed":11,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:48.973187+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069231,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":617,"num_read_kb":88557,"num_write":1073,"num_write_kb":46090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:24.376897+0000","last_change":"2024-09-12T01:11:24.376897+0000","last_active":"2024-09-12T01:11:24.376897+0000","last_peered":"2024-09-12T01:11:24.376897+0000","last_clean":"2024-09-12T01:11:24.376897+0000","last_became_active":"2024-09-12T00:12:40.036842+0000","last_became_peered":"2024-09-12T00:12:40.036842+0000","last_unstale":"2024-09-12T01:11:24.376897+0000","last_undegraded":"2024-09-12T01:11:24.376897+0000","last_fullsized":"2024-09-12T01:11:24.376897+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:24.376783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:24.376783+0000","last_clean_scrub_stamp":"2024-09-12T01:11:24.376783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:02.847925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"263'307","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:39.478845+0000","last_change":"2024-09-12T01:11:39.478845+0000","last_active":"2024-09-12T01:11:39.478845+0000","last_peered":"2024-09-12T01:11:39.478845+0000","last_clean":"2024-09-12T01:11:39.478845+0000","last_became_active":"2024-09-12T00:12:42.043681+0000","last_became_peered":"2024-09-12T00:12:42.043681+0000","last_unstale":"2024-09-12T01:11:39.478845+0000","last_undegraded":"2024-09-12T01:11:39.478845+0000","last_fullsized":"2024-09-12T01:11:39.478845+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'307","last_scrub_stamp":"2024-09-12T01:11:39.478715+0000","last_deep_scrub":"263'307","last_deep_scrub_stamp":"2024-09-12T01:11:39.478715+0000","last_clean_scrub_stamp":"2024-09-12T01:11:39.478715+0000","objects_scrubbed":8,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:09.605344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58226,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":1067,"num_write":414,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:36.847108+0000","last_change":"2024-09-12T01:11:36.847108+0000","last_active":"2024-09-12T01:11:36.847108+0000","last_peered":"2024-09-12T01:11:36.847108+0000","last_clean":"2024-09-12T01:11:36.847108+0000","last_became_active":"2024-09-12T00:12:44.058542+0000","last_became_peered":"2024-09-12T00:12:44.058542+0000","last_unstale":"2024-09-12T01:11:36.847108+0000","last_undegraded":"2024-09-12T01:11:36.847108+0000","last_fullsized":"2024-09-12T01:11:36.847108+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:36.847002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:36.847002+0000","last_clean_scrub_stamp":"2024-09-12T01:11:36.847002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:24.866169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"263'196","reported_seq":732,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:48.526679+0000","last_change":"2024-09-12T01:11:48.526679+0000","last_active":"2024-09-12T01:11:48.526679+0000","last_peered":"2024-09-12T01:11:48.526679+0000","last_clean":"2024-09-12T01:11:48.526679+0000","last_became_active":"2024-09-12T00:12:46.062957+0000","last_became_peered":"2024-09-12T00:12:46.062957+0000","last_unstale":"2024-09-12T01:11:48.526679+0000","last_undegraded":"2024-09-12T01:11:48.526679+0000","last_fullsized":"2024-09-12T01:11:48.526679+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'196","last_scrub_stamp":"2024-09-12T01:11:48.526571+0000","last_deep_scrub":"263'196","last_deep_scrub_stamp":"2024-09-12T01:11:48.526571+0000","last_clean_scrub_stamp":"2024-09-12T01:11:48.526571+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:55.997627+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2026,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":323,"num_read_kb":295,"num_write":565,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"263'204","reported_seq":797,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.716388+0000","last_change":"2024-09-12T01:11:13.716388+0000","last_active":"2024-09-12T01:11:13.716388+0000","last_peered":"2024-09-12T01:11:13.716388+0000","last_clean":"2024-09-12T01:11:13.716388+0000","last_became_active":"2024-09-12T00:12:38.045576+0000","last_became_peered":"2024-09-12T00:12:38.045576+0000","last_unstale":"2024-09-12T01:11:13.716388+0000","last_undegraded":"2024-09-12T01:11:13.716388+0000","last_fullsized":"2024-09-12T01:11:13.716388+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'204","last_scrub_stamp":"2024-09-12T01:11:13.716299+0000","last_deep_scrub":"263'204","last_deep_scrub_stamp":"2024-09-12T01:11:13.716299+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.716299+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:35.905678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":855,"num_read_kb":691,"num_write":313,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"263'353","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:06.259922+0000","last_change":"2024-09-12T01:11:06.259922+0000","last_active":"2024-09-12T01:11:06.259922+0000","last_peered":"2024-09-12T01:11:06.259922+0000","last_clean":"2024-09-12T01:11:06.259922+0000","last_became_active":"2024-09-12T00:12:36.036446+0000","last_became_peered":"2024-09-12T00:12:36.036446+0000","last_unstale":"2024-09-12T01:11:06.259922+0000","last_undegraded":"2024-09-12T01:11:06.259922+0000","last_fullsized":"2024-09-12T01:11:06.259922+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-12T01:11:06.259787+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-12T01:11:06.259787+0000","last_clean_scrub_stamp":"2024-09-12T01:11:06.259787+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:04.148146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434692,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":621,"num_read_kb":64541,"num_write":1186,"num_write_kb":11770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.216836+0000","last_change":"2024-09-12T01:11:19.216836+0000","last_active":"2024-09-12T01:11:19.216836+0000","last_peered":"2024-09-12T01:11:19.216836+0000","last_clean":"2024-09-12T01:11:19.216836+0000","last_became_active":"2024-09-12T00:12:40.029908+0000","last_became_peered":"2024-09-12T00:12:40.029908+0000","last_unstale":"2024-09-12T01:11:19.216836+0000","last_undegraded":"2024-09-12T01:11:19.216836+0000","last_fullsized":"2024-09-12T01:11:19.216836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:19.216748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:19.216748+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.216748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:17.680930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"263'285","reported_seq":874,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.418321+0000","last_change":"2024-09-12T01:11:29.418321+0000","last_active":"2024-09-12T01:11:29.418321+0000","last_peered":"2024-09-12T01:11:29.418321+0000","last_clean":"2024-09-12T01:11:29.418321+0000","last_became_active":"2024-09-12T00:12:42.050599+0000","last_became_peered":"2024-09-12T00:12:42.050599+0000","last_unstale":"2024-09-12T01:11:29.418321+0000","last_undegraded":"2024-09-12T01:11:29.418321+0000","last_fullsized":"2024-09-12T01:11:29.418321+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'285","last_scrub_stamp":"2024-09-12T01:11:29.418200+0000","last_deep_scrub":"263'285","last_deep_scrub_stamp":"2024-09-12T01:11:29.418200+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.418200+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:15.849823+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50970,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":947,"num_write":354,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.758688+0000","last_change":"2024-09-12T01:11:29.758688+0000","last_active":"2024-09-12T01:11:29.758688+0000","last_peered":"2024-09-12T01:11:29.758688+0000","last_clean":"2024-09-12T01:11:29.758688+0000","last_became_active":"2024-09-12T00:12:44.062419+0000","last_became_peered":"2024-09-12T00:12:44.062419+0000","last_unstale":"2024-09-12T01:11:29.758688+0000","last_undegraded":"2024-09-12T01:11:29.758688+0000","last_fullsized":"2024-09-12T01:11:29.758688+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:29.758599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:29.758599+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.758599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:16.151040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"263'187","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:47.475820+0000","last_change":"2024-09-12T01:11:47.475820+0000","last_active":"2024-09-12T01:11:47.475820+0000","last_peered":"2024-09-12T01:11:47.475820+0000","last_clean":"2024-09-12T01:11:47.475820+0000","last_became_active":"2024-09-12T00:12:46.066977+0000","last_became_peered":"2024-09-12T00:12:46.066977+0000","last_unstale":"2024-09-12T01:11:47.475820+0000","last_undegraded":"2024-09-12T01:11:47.475820+0000","last_fullsized":"2024-09-12T01:11:47.475820+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'187","last_scrub_stamp":"2024-09-12T01:11:47.475736+0000","last_deep_scrub":"263'187","last_deep_scrub_stamp":"2024-09-12T01:11:47.475736+0000","last_clean_scrub_stamp":"2024-09-12T01:11:47.475736+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:45.016824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":141,"num_write":422,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"263'58","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.539314+0000","last_change":"2024-09-12T01:11:16.539314+0000","last_active":"2024-09-12T01:11:16.539314+0000","last_peered":"2024-09-12T01:11:16.539314+0000","last_clean":"2024-09-12T01:11:16.539314+0000","last_became_active":"2024-09-12T00:12:38.043886+0000","last_became_peered":"2024-09-12T00:12:38.043886+0000","last_unstale":"2024-09-12T01:11:16.539314+0000","last_undegraded":"2024-09-12T01:11:16.539314+0000","last_fullsized":"2024-09-12T01:11:16.539314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'58","last_scrub_stamp":"2024-09-12T01:11:16.539199+0000","last_deep_scrub":"263'58","last_deep_scrub_stamp":"2024-09-12T01:11:16.539199+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.539199+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:30.884432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":197,"num_write":99,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"263'362","reported_seq":989,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.560609+0000","last_change":"2024-09-12T01:11:11.560609+0000","last_active":"2024-09-12T01:11:11.560609+0000","last_peered":"2024-09-12T01:11:11.560609+0000","last_clean":"2024-09-12T01:11:11.560609+0000","last_became_active":"2024-09-12T00:12:36.030663+0000","last_became_peered":"2024-09-12T00:12:36.030663+0000","last_unstale":"2024-09-12T01:11:11.560609+0000","last_undegraded":"2024-09-12T01:11:11.560609+0000","last_fullsized":"2024-09-12T01:11:11.560609+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-12T01:11:11.560491+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-12T01:11:11.560491+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.560491+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:52.728704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568456,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":490,"num_read_kb":3753,"num_write":1107,"num_write_kb":36132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.615621+0000","last_change":"2024-09-12T01:11:28.615621+0000","last_active":"2024-09-12T01:11:28.615621+0000","last_peered":"2024-09-12T01:11:28.615621+0000","last_clean":"2024-09-12T01:11:28.615621+0000","last_became_active":"2024-09-12T00:12:40.040095+0000","last_became_peered":"2024-09-12T00:12:40.040095+0000","last_unstale":"2024-09-12T01:11:28.615621+0000","last_undegraded":"2024-09-12T01:11:28.615621+0000","last_fullsized":"2024-09-12T01:11:28.615621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:28.615527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:28.615527+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.615527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:29.592607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"263'111","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:40.470106+0000","last_change":"2024-09-12T01:11:40.470106+0000","last_active":"2024-09-12T01:11:40.470106+0000","last_peered":"2024-09-12T01:11:40.470106+0000","last_clean":"2024-09-12T01:11:40.470106+0000","last_became_active":"2024-09-12T00:12:42.043492+0000","last_became_peered":"2024-09-12T00:12:42.043492+0000","last_unstale":"2024-09-12T01:11:40.470106+0000","last_undegraded":"2024-09-12T01:11:40.470106+0000","last_fullsized":"2024-09-12T01:11:40.470106+0000","mapping_epoch":33,"log_start":"263'100","ondisk_log_start":"263'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-12T01:11:40.470000+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-12T01:11:40.470000+0000","last_clean_scrub_stamp":"2024-09-12T01:11:40.470000+0000","objects_scrubbed":7,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:16.144396+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":110,"num_read_kb":100,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"263'767","reported_seq":2185,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:28.158682+0000","last_change":"2024-09-12T01:11:28.158682+0000","last_active":"2024-09-12T01:11:28.158682+0000","last_peered":"2024-09-12T01:11:28.158682+0000","last_clean":"2024-09-12T01:11:28.158682+0000","last_became_active":"2024-09-12T00:12:44.054237+0000","last_became_peered":"2024-09-12T00:12:44.054237+0000","last_unstale":"2024-09-12T01:11:28.158682+0000","last_undegraded":"2024-09-12T01:11:28.158682+0000","last_fullsized":"2024-09-12T01:11:28.158682+0000","mapping_epoch":35,"log_start":"263'700","ondisk_log_start":"263'700","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'767","last_scrub_stamp":"2024-09-12T01:11:28.158604+0000","last_deep_scrub":"263'767","last_deep_scrub_stamp":"2024-09-12T01:11:28.158604+0000","last_clean_scrub_stamp":"2024-09-12T01:11:28.158604+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:33.126576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"263'121","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:46.499140+0000","last_change":"2024-09-12T01:11:46.499140+0000","last_active":"2024-09-12T01:11:46.499140+0000","last_peered":"2024-09-12T01:11:46.499140+0000","last_clean":"2024-09-12T01:11:46.499140+0000","last_became_active":"2024-09-12T00:12:46.061673+0000","last_became_peered":"2024-09-12T00:12:46.061673+0000","last_unstale":"2024-09-12T01:11:46.499140+0000","last_undegraded":"2024-09-12T01:11:46.499140+0000","last_fullsized":"2024-09-12T01:11:46.499140+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'121","last_scrub_stamp":"2024-09-12T01:11:46.499045+0000","last_deep_scrub":"263'121","last_deep_scrub_stamp":"2024-09-12T01:11:46.499045+0000","last_clean_scrub_stamp":"2024-09-12T01:11:46.499045+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:09.956437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":293,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"263'432","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.146134+0000","last_change":"2024-09-12T01:11:11.146134+0000","last_active":"2024-09-12T01:11:11.146134+0000","last_peered":"2024-09-12T01:11:11.146134+0000","last_clean":"2024-09-12T01:11:11.146134+0000","last_became_active":"2024-09-12T00:12:38.029483+0000","last_became_peered":"2024-09-12T00:12:38.029483+0000","last_unstale":"2024-09-12T01:11:11.146134+0000","last_undegraded":"2024-09-12T01:11:11.146134+0000","last_fullsized":"2024-09-12T01:11:11.146134+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'432","last_scrub_stamp":"2024-09-12T01:11:11.146047+0000","last_deep_scrub":"263'432","last_deep_scrub_stamp":"2024-09-12T01:11:11.146047+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.146047+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:10.366652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1848,"num_read_kb":1460,"num_write":651,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"263'351","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:07.306677+0000","last_change":"2024-09-12T01:11:07.306677+0000","last_active":"2024-09-12T01:11:07.306677+0000","last_peered":"2024-09-12T01:11:07.306677+0000","last_clean":"2024-09-12T01:11:07.306677+0000","last_became_active":"2024-09-12T00:12:36.034259+0000","last_became_peered":"2024-09-12T00:12:36.034259+0000","last_unstale":"2024-09-12T01:11:07.306677+0000","last_undegraded":"2024-09-12T01:11:07.306677+0000","last_fullsized":"2024-09-12T01:11:07.306677+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-12T01:11:07.306592+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-12T01:11:07.306592+0000","last_clean_scrub_stamp":"2024-09-12T01:11:07.306592+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:20.789146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":12694,"num_write":1067,"num_write_kb":34924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:22.297481+0000","last_change":"2024-09-12T01:11:22.297481+0000","last_active":"2024-09-12T01:11:22.297481+0000","last_peered":"2024-09-12T01:11:22.297481+0000","last_clean":"2024-09-12T01:11:22.297481+0000","last_became_active":"2024-09-12T00:12:40.034301+0000","last_became_peered":"2024-09-12T00:12:40.034301+0000","last_unstale":"2024-09-12T01:11:22.297481+0000","last_undegraded":"2024-09-12T01:11:22.297481+0000","last_fullsized":"2024-09-12T01:11:22.297481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:22.297390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:22.297390+0000","last_clean_scrub_stamp":"2024-09-12T01:11:22.297390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:58.221125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"263'377","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.191166+0000","last_change":"2024-09-12T01:11:27.191166+0000","last_active":"2024-09-12T01:11:27.191166+0000","last_peered":"2024-09-12T01:11:27.191166+0000","last_clean":"2024-09-12T01:11:27.191166+0000","last_became_active":"2024-09-12T00:12:42.044154+0000","last_became_peered":"2024-09-12T00:12:42.044154+0000","last_unstale":"2024-09-12T01:11:27.191166+0000","last_undegraded":"2024-09-12T01:11:27.191166+0000","last_fullsized":"2024-09-12T01:11:27.191166+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:11:27.191086+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:11:27.191086+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.191086+0000","objects_scrubbed":11,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:48.409343+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51621,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":561,"num_read_kb":1137,"num_write":454,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.441564+0000","last_change":"2024-09-12T01:11:38.441564+0000","last_active":"2024-09-12T01:11:38.441564+0000","last_peered":"2024-09-12T01:11:38.441564+0000","last_clean":"2024-09-12T01:11:38.441564+0000","last_became_active":"2024-09-12T00:12:44.059671+0000","last_became_peered":"2024-09-12T00:12:44.059671+0000","last_unstale":"2024-09-12T01:11:38.441564+0000","last_undegraded":"2024-09-12T01:11:38.441564+0000","last_fullsized":"2024-09-12T01:11:38.441564+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:38.441478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:38.441478+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.441478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:08.764517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"263'129","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.342103+0000","last_change":"2024-09-12T01:11:37.342103+0000","last_active":"2024-09-12T01:11:37.342103+0000","last_peered":"2024-09-12T01:11:37.342103+0000","last_clean":"2024-09-12T01:11:37.342103+0000","last_became_active":"2024-09-12T00:12:46.066777+0000","last_became_peered":"2024-09-12T00:12:46.066777+0000","last_unstale":"2024-09-12T01:11:37.342103+0000","last_undegraded":"2024-09-12T01:11:37.342103+0000","last_fullsized":"2024-09-12T01:11:37.342103+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'129","last_scrub_stamp":"2024-09-12T01:11:37.342010+0000","last_deep_scrub":"263'129","last_deep_scrub_stamp":"2024-09-12T01:11:37.342010+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.342010+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:03.914878+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":239,"num_read_kb":208,"num_write":345,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"263'510","reported_seq":1334,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.229612+0000","last_change":"2024-09-12T01:11:20.229612+0000","last_active":"2024-09-12T01:11:20.229612+0000","last_peered":"2024-09-12T01:11:20.229612+0000","last_clean":"2024-09-12T01:11:20.229612+0000","last_became_active":"2024-09-12T00:12:38.039996+0000","last_became_peered":"2024-09-12T00:12:38.039996+0000","last_unstale":"2024-09-12T01:11:20.229612+0000","last_undegraded":"2024-09-12T01:11:20.229612+0000","last_fullsized":"2024-09-12T01:11:20.229612+0000","mapping_epoch":29,"log_start":"263'400","ondisk_log_start":"263'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'510","last_scrub_stamp":"2024-09-12T01:11:20.229511+0000","last_deep_scrub":"263'510","last_deep_scrub_stamp":"2024-09-12T01:11:20.229511+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.229511+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:21.104034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2706,"num_read_kb":2334,"num_write":934,"num_write_kb":583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"263'299","reported_seq":973,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.366645+0000","last_change":"2024-09-12T01:11:15.366645+0000","last_active":"2024-09-12T01:11:15.366645+0000","last_peered":"2024-09-12T01:11:15.366645+0000","last_clean":"2024-09-12T01:11:15.366645+0000","last_became_active":"2024-09-12T00:12:36.029998+0000","last_became_peered":"2024-09-12T00:12:36.029998+0000","last_unstale":"2024-09-12T01:11:15.366645+0000","last_undegraded":"2024-09-12T01:11:15.366645+0000","last_fullsized":"2024-09-12T01:11:15.366645+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'299","last_scrub_stamp":"2024-09-12T01:11:15.366509+0000","last_deep_scrub":"263'299","last_deep_scrub_stamp":"2024-09-12T01:11:15.366509+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.366509+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:09.932286+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":565,"num_read_kb":3980,"num_write":924,"num_write_kb":28798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.218749+0000","last_change":"2024-09-12T01:11:14.218749+0000","last_active":"2024-09-12T01:11:14.218749+0000","last_peered":"2024-09-12T01:11:14.218749+0000","last_clean":"2024-09-12T01:11:14.218749+0000","last_became_active":"2024-09-12T00:12:40.038037+0000","last_became_peered":"2024-09-12T00:12:40.038037+0000","last_unstale":"2024-09-12T01:11:14.218749+0000","last_undegraded":"2024-09-12T01:11:14.218749+0000","last_fullsized":"2024-09-12T01:11:14.218749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:14.218626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:14.218626+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.218626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:01.985443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"263'289","reported_seq":872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:34.511035+0000","last_change":"2024-09-12T01:11:34.511035+0000","last_active":"2024-09-12T01:11:34.511035+0000","last_peered":"2024-09-12T01:11:34.511035+0000","last_clean":"2024-09-12T01:11:34.511035+0000","last_became_active":"2024-09-12T00:12:42.046917+0000","last_became_peered":"2024-09-12T00:12:42.046917+0000","last_unstale":"2024-09-12T01:11:34.511035+0000","last_undegraded":"2024-09-12T01:11:34.511035+0000","last_fullsized":"2024-09-12T01:11:34.511035+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-12T01:11:34.510930+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-12T01:11:34.510930+0000","last_clean_scrub_stamp":"2024-09-12T01:11:34.510930+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:04.641400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46808,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":488,"num_read_kb":1160,"num_write":400,"num_write_kb":329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:44.504840+0000","last_change":"2024-09-12T01:11:44.504840+0000","last_active":"2024-09-12T01:11:44.504840+0000","last_peered":"2024-09-12T01:11:44.504840+0000","last_clean":"2024-09-12T01:11:44.504840+0000","last_became_active":"2024-09-12T00:12:44.058006+0000","last_became_peered":"2024-09-12T00:12:44.058006+0000","last_unstale":"2024-09-12T01:11:44.504840+0000","last_undegraded":"2024-09-12T01:11:44.504840+0000","last_fullsized":"2024-09-12T01:11:44.504840+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:44.504724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:44.504724+0000","last_clean_scrub_stamp":"2024-09-12T01:11:44.504724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:49.277866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"263'118","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:42.802023+0000","last_change":"2024-09-12T01:11:42.802023+0000","last_active":"2024-09-12T01:11:42.802023+0000","last_peered":"2024-09-12T01:11:42.802023+0000","last_clean":"2024-09-12T01:11:42.802023+0000","last_became_active":"2024-09-12T00:12:46.064988+0000","last_became_peered":"2024-09-12T00:12:46.064988+0000","last_unstale":"2024-09-12T01:11:42.802023+0000","last_undegraded":"2024-09-12T01:11:42.802023+0000","last_fullsized":"2024-09-12T01:11:42.802023+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'118","last_scrub_stamp":"2024-09-12T01:11:42.801931+0000","last_deep_scrub":"263'118","last_deep_scrub_stamp":"2024-09-12T01:11:42.801931+0000","last_clean_scrub_stamp":"2024-09-12T01:11:42.801931+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:37.541718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":151,"num_read_kb":147,"num_write":261,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"263'320","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.738849+0000","last_change":"2024-09-12T01:11:11.738849+0000","last_active":"2024-09-12T01:11:11.738849+0000","last_peered":"2024-09-12T01:11:11.738849+0000","last_clean":"2024-09-12T01:11:11.738849+0000","last_became_active":"2024-09-12T00:12:38.042565+0000","last_became_peered":"2024-09-12T00:12:38.042565+0000","last_unstale":"2024-09-12T01:11:11.738849+0000","last_undegraded":"2024-09-12T01:11:11.738849+0000","last_fullsized":"2024-09-12T01:11:11.738849+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'320","last_scrub_stamp":"2024-09-12T01:11:11.738728+0000","last_deep_scrub":"263'320","last_deep_scrub_stamp":"2024-09-12T01:11:11.738728+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.738728+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:44.363536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1481,"num_read_kb":1253,"num_write":527,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"263'359","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.766708+0000","last_change":"2024-09-12T01:11:10.766708+0000","last_active":"2024-09-12T01:11:10.766708+0000","last_peered":"2024-09-12T01:11:10.766708+0000","last_clean":"2024-09-12T01:11:10.766708+0000","last_became_active":"2024-09-12T00:12:36.042198+0000","last_became_peered":"2024-09-12T00:12:36.042198+0000","last_unstale":"2024-09-12T01:11:10.766708+0000","last_undegraded":"2024-09-12T01:11:10.766708+0000","last_fullsized":"2024-09-12T01:11:10.766708+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-12T01:11:10.766609+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-12T01:11:10.766609+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.766609+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:09.163241+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":61060,"num_write":1123,"num_write_kb":53442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.318368+0000","last_change":"2024-09-12T01:11:21.318368+0000","last_active":"2024-09-12T01:11:21.318368+0000","last_peered":"2024-09-12T01:11:21.318368+0000","last_clean":"2024-09-12T01:11:21.318368+0000","last_became_active":"2024-09-12T00:12:40.032284+0000","last_became_peered":"2024-09-12T00:12:40.032284+0000","last_unstale":"2024-09-12T01:11:21.318368+0000","last_undegraded":"2024-09-12T01:11:21.318368+0000","last_fullsized":"2024-09-12T01:11:21.318368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:21.318282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:21.318282+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.318282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:49.292980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"263'259","reported_seq":825,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:27.470032+0000","last_change":"2024-09-12T01:11:27.470032+0000","last_active":"2024-09-12T01:11:27.470032+0000","last_peered":"2024-09-12T01:11:27.470032+0000","last_clean":"2024-09-12T01:11:27.470032+0000","last_became_active":"2024-09-12T00:12:42.051133+0000","last_became_peered":"2024-09-12T00:12:42.051133+0000","last_unstale":"2024-09-12T01:11:27.470032+0000","last_undegraded":"2024-09-12T01:11:27.470032+0000","last_fullsized":"2024-09-12T01:11:27.470032+0000","mapping_epoch":33,"log_start":"263'200","ondisk_log_start":"263'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'259","last_scrub_stamp":"2024-09-12T01:11:27.469938+0000","last_deep_scrub":"263'259","last_deep_scrub_stamp":"2024-09-12T01:11:27.469938+0000","last_clean_scrub_stamp":"2024-09-12T01:11:27.469938+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:48.123908+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":1053,"num_write":352,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:45.521628+0000","last_change":"2024-09-12T01:11:45.521628+0000","last_active":"2024-09-12T01:11:45.521628+0000","last_peered":"2024-09-12T01:11:45.521628+0000","last_clean":"2024-09-12T01:11:45.521628+0000","last_became_active":"2024-09-12T00:12:44.060464+0000","last_became_peered":"2024-09-12T00:12:44.060464+0000","last_unstale":"2024-09-12T01:11:45.521628+0000","last_undegraded":"2024-09-12T01:11:45.521628+0000","last_fullsized":"2024-09-12T01:11:45.521628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:45.521539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:45.521539+0000","last_clean_scrub_stamp":"2024-09-12T01:11:45.521539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:00.056354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"263'156","reported_seq":1622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:49.563179+0000","last_change":"2024-09-12T01:11:49.563179+0000","last_active":"2024-09-12T01:11:49.563179+0000","last_peered":"2024-09-12T01:11:49.563179+0000","last_clean":"2024-09-12T01:11:49.563179+0000","last_became_active":"2024-09-12T00:12:46.064565+0000","last_became_peered":"2024-09-12T00:12:46.064565+0000","last_unstale":"2024-09-12T01:11:49.563179+0000","last_undegraded":"2024-09-12T01:11:49.563179+0000","last_fullsized":"2024-09-12T01:11:49.563179+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'156","last_scrub_stamp":"2024-09-12T01:11:49.563087+0000","last_deep_scrub":"263'156","last_deep_scrub_stamp":"2024-09-12T01:11:49.563087+0000","last_clean_scrub_stamp":"2024-09-12T01:11:49.563087+0000","objects_scrubbed":6,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:55.465419+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":657,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1152,"num_read_kb":1150,"num_write":337,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"263'89","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.193008+0000","last_change":"2024-09-12T01:11:10.193008+0000","last_active":"2024-09-12T01:11:10.193008+0000","last_peered":"2024-09-12T01:11:10.193008+0000","last_clean":"2024-09-12T01:11:10.193008+0000","last_became_active":"2024-09-12T00:12:38.037860+0000","last_became_peered":"2024-09-12T00:12:38.037860+0000","last_unstale":"2024-09-12T01:11:10.193008+0000","last_undegraded":"2024-09-12T01:11:10.193008+0000","last_fullsized":"2024-09-12T01:11:10.193008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'89","last_scrub_stamp":"2024-09-12T01:11:10.192888+0000","last_deep_scrub":"263'89","last_deep_scrub_stamp":"2024-09-12T01:11:10.192888+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.192888+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:09.120774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":389,"num_read_kb":333,"num_write":131,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"263'328","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:09.722206+0000","last_change":"2024-09-12T01:11:09.722206+0000","last_active":"2024-09-12T01:11:09.722206+0000","last_peered":"2024-09-12T01:11:09.722206+0000","last_clean":"2024-09-12T01:11:09.722206+0000","last_became_active":"2024-09-12T00:12:36.041860+0000","last_became_peered":"2024-09-12T00:12:36.041860+0000","last_unstale":"2024-09-12T01:11:09.722206+0000","last_undegraded":"2024-09-12T01:11:09.722206+0000","last_fullsized":"2024-09-12T01:11:09.722206+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-12T01:11:09.722064+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-12T01:11:09.722064+0000","last_clean_scrub_stamp":"2024-09-12T01:11:09.722064+0000","objects_scrubbed":11,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:38.287167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3984538,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":381,"num_read_kb":7023,"num_write":999,"num_write_kb":36211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.540300+0000","last_change":"2024-09-12T01:11:25.540300+0000","last_active":"2024-09-12T01:11:25.540300+0000","last_peered":"2024-09-12T01:11:25.540300+0000","last_clean":"2024-09-12T01:11:25.540300+0000","last_became_active":"2024-09-12T00:12:40.039196+0000","last_became_peered":"2024-09-12T00:12:40.039196+0000","last_unstale":"2024-09-12T01:11:25.540300+0000","last_undegraded":"2024-09-12T01:11:25.540300+0000","last_fullsized":"2024-09-12T01:11:25.540300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:11:25.540213+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:11:25.540213+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.540213+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:01.710510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"263'350","reported_seq":954,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:38.427963+0000","last_change":"2024-09-12T01:11:38.427963+0000","last_active":"2024-09-12T01:11:38.427963+0000","last_peered":"2024-09-12T01:11:38.427963+0000","last_clean":"2024-09-12T01:11:38.427963+0000","last_became_active":"2024-09-12T00:12:42.039068+0000","last_became_peered":"2024-09-12T00:12:42.039068+0000","last_unstale":"2024-09-12T01:11:38.427963+0000","last_undegraded":"2024-09-12T01:11:38.427963+0000","last_fullsized":"2024-09-12T01:11:38.427963+0000","mapping_epoch":33,"log_start":"263'300","ondisk_log_start":"263'300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'350","last_scrub_stamp":"2024-09-12T01:11:38.427868+0000","last_deep_scrub":"263'350","last_deep_scrub_stamp":"2024-09-12T01:11:38.427868+0000","last_clean_scrub_stamp":"2024-09-12T01:11:38.427868+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:08.441782+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44473,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":544,"num_read_kb":1176,"num_write":442,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:37.470733+0000","last_change":"2024-09-12T01:11:37.470733+0000","last_active":"2024-09-12T01:11:37.470733+0000","last_peered":"2024-09-12T01:11:37.470733+0000","last_clean":"2024-09-12T01:11:37.470733+0000","last_became_active":"2024-09-12T00:12:44.064105+0000","last_became_peered":"2024-09-12T00:12:44.064105+0000","last_unstale":"2024-09-12T01:11:37.470733+0000","last_undegraded":"2024-09-12T01:11:37.470733+0000","last_fullsized":"2024-09-12T01:11:37.470733+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:11:37.470646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:11:37.470646+0000","last_clean_scrub_stamp":"2024-09-12T01:11:37.470646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:06.703919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"263'151","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:29.191321+0000","last_change":"2024-09-12T01:11:29.191321+0000","last_active":"2024-09-12T01:11:29.191321+0000","last_peered":"2024-09-12T01:11:29.191321+0000","last_clean":"2024-09-12T01:11:29.191321+0000","last_became_active":"2024-09-12T00:12:46.053763+0000","last_became_peered":"2024-09-12T00:12:46.053763+0000","last_unstale":"2024-09-12T01:11:29.191321+0000","last_undegraded":"2024-09-12T01:11:29.191321+0000","last_fullsized":"2024-09-12T01:11:29.191321+0000","mapping_epoch":37,"log_start":"263'100","ondisk_log_start":"263'100","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'151","last_scrub_stamp":"2024-09-12T01:11:29.191223+0000","last_deep_scrub":"263'151","last_deep_scrub_stamp":"2024-09-12T01:11:29.191223+0000","last_clean_scrub_stamp":"2024-09-12T01:11:29.191223+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:55.982377+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":155,"num_read_kb":140,"num_write":382,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"263'137","reported_seq":730,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.480997+0000","last_change":"2024-09-12T01:11:18.480997+0000","last_active":"2024-09-12T01:11:18.480997+0000","last_peered":"2024-09-12T01:11:18.480997+0000","last_clean":"2024-09-12T01:11:18.480997+0000","last_became_active":"2024-09-12T00:12:38.044285+0000","last_became_peered":"2024-09-12T00:12:38.044285+0000","last_unstale":"2024-09-12T01:11:18.480997+0000","last_undegraded":"2024-09-12T01:11:18.480997+0000","last_fullsized":"2024-09-12T01:11:18.480997+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-12T01:11:18.480916+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-12T01:11:18.480916+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.480916+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:51.540635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":475,"num_write":234,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"263'397","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:05.214465+0000","last_change":"2024-09-12T01:11:05.214465+0000","last_active":"2024-09-12T01:11:05.214465+0000","last_peered":"2024-09-12T01:11:05.214465+0000","last_clean":"2024-09-12T01:11:05.214465+0000","last_became_active":"2024-09-12T00:12:36.036773+0000","last_became_peered":"2024-09-12T00:12:36.036773+0000","last_unstale":"2024-09-12T01:11:05.214465+0000","last_undegraded":"2024-09-12T01:11:05.214465+0000","last_fullsized":"2024-09-12T01:11:05.214465+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'397","last_scrub_stamp":"2024-09-12T01:11:05.214323+0000","last_deep_scrub":"263'397","last_deep_scrub_stamp":"2024-09-12T01:11:05.214323+0000","last_clean_scrub_stamp":"2024-09-12T01:11:05.214323+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:30.254016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262251,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":606,"num_read_kb":16738,"num_write":1145,"num_write_kb":32233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"263'47","reported_seq":608,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.706015+0000","last_change":"2024-09-12T01:11:14.706015+0000","last_active":"2024-09-12T01:11:14.706015+0000","last_peered":"2024-09-12T01:11:14.706015+0000","last_clean":"2024-09-12T01:11:14.706015+0000","last_became_active":"2024-09-12T00:12:38.036978+0000","last_became_peered":"2024-09-12T00:12:38.036978+0000","last_unstale":"2024-09-12T01:11:14.706015+0000","last_undegraded":"2024-09-12T01:11:14.706015+0000","last_fullsized":"2024-09-12T01:11:14.706015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'47","last_scrub_stamp":"2024-09-12T01:11:14.705925+0000","last_deep_scrub":"263'47","last_deep_scrub_stamp":"2024-09-12T01:11:14.705925+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.705925+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:12.824252+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":183,"num_write":60,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"263'331","reported_seq":968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.770480+0000","last_change":"2024-09-12T01:11:08.770480+0000","last_active":"2024-09-12T01:11:08.770480+0000","last_peered":"2024-09-12T01:11:08.770480+0000","last_clean":"2024-09-12T01:11:08.770480+0000","last_became_active":"2024-09-12T00:12:36.035112+0000","last_became_peered":"2024-09-12T00:12:36.035112+0000","last_unstale":"2024-09-12T01:11:08.770480+0000","last_undegraded":"2024-09-12T01:11:08.770480+0000","last_fullsized":"2024-09-12T01:11:08.770480+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:11:08.770383+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:11:08.770383+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.770383+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:44.676691+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":489,"num_read_kb":34939,"num_write":1097,"num_write_kb":28471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"263'137","reported_seq":778,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:25.387951+0000","last_change":"2024-09-12T01:11:25.387951+0000","last_active":"2024-09-12T01:11:25.387951+0000","last_peered":"2024-09-12T01:11:25.387951+0000","last_clean":"2024-09-12T01:11:25.387951+0000","last_became_active":"2024-09-12T00:12:38.040144+0000","last_became_peered":"2024-09-12T00:12:38.040144+0000","last_unstale":"2024-09-12T01:11:25.387951+0000","last_undegraded":"2024-09-12T01:11:25.387951+0000","last_fullsized":"2024-09-12T01:11:25.387951+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-12T01:11:25.387847+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-12T01:11:25.387847+0000","last_clean_scrub_stamp":"2024-09-12T01:11:25.387847+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:15.196191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":601,"num_read_kb":511,"num_write":216,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"263'319","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.411588+0000","last_change":"2024-09-12T01:11:16.411588+0000","last_active":"2024-09-12T01:11:16.411588+0000","last_peered":"2024-09-12T01:11:16.411588+0000","last_clean":"2024-09-12T01:11:16.411588+0000","last_became_active":"2024-09-12T00:12:36.035558+0000","last_became_peered":"2024-09-12T00:12:36.035558+0000","last_unstale":"2024-09-12T01:11:16.411588+0000","last_undegraded":"2024-09-12T01:11:16.411588+0000","last_fullsized":"2024-09-12T01:11:16.411588+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'319","last_scrub_stamp":"2024-09-12T01:11:16.411468+0000","last_deep_scrub":"263'319","last_deep_scrub_stamp":"2024-09-12T01:11:16.411468+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.411468+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:51.561801+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287622,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":7822,"num_write":966,"num_write_kb":22426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"263'275","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:21.791183+0000","last_change":"2024-09-12T01:11:21.791183+0000","last_active":"2024-09-12T01:11:21.791183+0000","last_peered":"2024-09-12T01:11:21.791183+0000","last_clean":"2024-09-12T01:11:21.791183+0000","last_became_active":"2024-09-12T00:12:38.026109+0000","last_became_peered":"2024-09-12T00:12:38.026109+0000","last_unstale":"2024-09-12T01:11:21.791183+0000","last_undegraded":"2024-09-12T01:11:21.791183+0000","last_fullsized":"2024-09-12T01:11:21.791183+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'275","last_scrub_stamp":"2024-09-12T01:11:21.791097+0000","last_deep_scrub":"263'275","last_deep_scrub_stamp":"2024-09-12T01:11:21.791097+0000","last_clean_scrub_stamp":"2024-09-12T01:11:21.791097+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:10.158792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1270,"num_read_kb":1040,"num_write":446,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"263'331","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:11.752050+0000","last_change":"2024-09-12T01:11:11.751974+0000","last_active":"2024-09-12T01:11:11.752050+0000","last_peered":"2024-09-12T01:11:11.752050+0000","last_clean":"2024-09-12T01:11:11.752050+0000","last_became_active":"2024-09-12T00:12:36.033426+0000","last_became_peered":"2024-09-12T00:12:36.033426+0000","last_unstale":"2024-09-12T01:11:11.752050+0000","last_undegraded":"2024-09-12T01:11:11.752050+0000","last_fullsized":"2024-09-12T01:11:11.752050+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-12T01:11:11.751820+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-12T01:11:11.751820+0000","last_clean_scrub_stamp":"2024-09-12T01:11:11.751820+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:01.340846+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306676,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":19382,"num_write":951,"num_write_kb":44169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"263'4265","reported_seq":4917,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.832554+0000","last_change":"2024-09-12T01:11:20.832554+0000","last_active":"2024-09-12T01:11:20.832554+0000","last_peered":"2024-09-12T01:11:20.832554+0000","last_clean":"2024-09-12T01:11:20.832554+0000","last_became_active":"2024-09-12T00:12:38.028401+0000","last_became_peered":"2024-09-12T00:12:38.028401+0000","last_unstale":"2024-09-12T01:11:20.832554+0000","last_undegraded":"2024-09-12T01:11:20.832554+0000","last_fullsized":"2024-09-12T01:11:20.832554+0000","mapping_epoch":29,"log_start":"263'4200","ondisk_log_start":"263'4200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4265","last_scrub_stamp":"2024-09-12T01:11:20.832469+0000","last_deep_scrub":"263'4265","last_deep_scrub_stamp":"2024-09-12T01:11:20.832469+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.832469+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":3000,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:00.963732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17227,"num_read_kb":14428,"num_write":6422,"num_write_kb":3205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"263'326","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.234518+0000","last_change":"2024-09-12T01:11:12.234518+0000","last_active":"2024-09-12T01:11:12.234518+0000","last_peered":"2024-09-12T01:11:12.234518+0000","last_clean":"2024-09-12T01:11:12.234518+0000","last_became_active":"2024-09-12T00:12:36.032341+0000","last_became_peered":"2024-09-12T00:12:36.032341+0000","last_unstale":"2024-09-12T01:11:12.234518+0000","last_undegraded":"2024-09-12T01:11:12.234518+0000","last_fullsized":"2024-09-12T01:11:12.234518+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'326","last_scrub_stamp":"2024-09-12T01:11:12.234405+0000","last_deep_scrub":"263'326","last_deep_scrub_stamp":"2024-09-12T01:11:12.234405+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.234405+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:58.603991+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2561198,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":66123,"num_write":1057,"num_write_kb":26739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"263'149","reported_seq":737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.200891+0000","last_change":"2024-09-12T01:11:15.200891+0000","last_active":"2024-09-12T01:11:15.200891+0000","last_peered":"2024-09-12T01:11:15.200891+0000","last_clean":"2024-09-12T01:11:15.200891+0000","last_became_active":"2024-09-12T00:12:38.043276+0000","last_became_peered":"2024-09-12T00:12:38.043276+0000","last_unstale":"2024-09-12T01:11:15.200891+0000","last_undegraded":"2024-09-12T01:11:15.200891+0000","last_fullsized":"2024-09-12T01:11:15.200891+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-12T01:11:15.200800+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-12T01:11:15.200800+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.200800+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:25.860652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":632,"num_read_kb":523,"num_write":222,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"263'311","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.295855+0000","last_change":"2024-09-12T01:11:10.295855+0000","last_active":"2024-09-12T01:11:10.295855+0000","last_peered":"2024-09-12T01:11:10.295855+0000","last_clean":"2024-09-12T01:11:10.295855+0000","last_became_active":"2024-09-12T00:12:36.029687+0000","last_became_peered":"2024-09-12T00:12:36.029687+0000","last_unstale":"2024-09-12T01:11:10.295855+0000","last_undegraded":"2024-09-12T01:11:10.295855+0000","last_fullsized":"2024-09-12T01:11:10.295855+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:11:10.295694+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:11:10.295694+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.295694+0000","objects_scrubbed":6,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:59.583411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":444,"num_read_kb":12036,"num_write":1041,"num_write_kb":29691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"263'211","reported_seq":841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.249880+0000","last_change":"2024-09-12T01:11:19.249880+0000","last_active":"2024-09-12T01:11:19.249880+0000","last_peered":"2024-09-12T01:11:19.249880+0000","last_clean":"2024-09-12T01:11:19.249880+0000","last_became_active":"2024-09-12T00:12:38.047575+0000","last_became_peered":"2024-09-12T00:12:38.047575+0000","last_unstale":"2024-09-12T01:11:19.249880+0000","last_undegraded":"2024-09-12T01:11:19.249880+0000","last_fullsized":"2024-09-12T01:11:19.249880+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'211","last_scrub_stamp":"2024-09-12T01:11:19.249774+0000","last_deep_scrub":"263'211","last_deep_scrub_stamp":"2024-09-12T01:11:19.249774+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.249774+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:52.534231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":952,"num_read_kb":776,"num_write":336,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"263'364","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.216422+0000","last_change":"2024-09-12T01:11:16.216422+0000","last_active":"2024-09-12T01:11:16.216422+0000","last_peered":"2024-09-12T01:11:16.216422+0000","last_clean":"2024-09-12T01:11:16.216422+0000","last_became_active":"2024-09-12T00:12:36.043803+0000","last_became_peered":"2024-09-12T00:12:36.043803+0000","last_unstale":"2024-09-12T01:11:16.216422+0000","last_undegraded":"2024-09-12T01:11:16.216422+0000","last_fullsized":"2024-09-12T01:11:16.216422+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-12T01:11:16.216308+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-12T01:11:16.216308+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.216308+0000","objects_scrubbed":6,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:33.903640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":463,"num_read_kb":37298,"num_write":1152,"num_write_kb":54766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"263'144","reported_seq":739,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.240217+0000","last_change":"2024-09-12T01:11:12.240217+0000","last_active":"2024-09-12T01:11:12.240217+0000","last_peered":"2024-09-12T01:11:12.240217+0000","last_clean":"2024-09-12T01:11:12.240217+0000","last_became_active":"2024-09-12T00:12:38.036463+0000","last_became_peered":"2024-09-12T00:12:38.036463+0000","last_unstale":"2024-09-12T01:11:12.240217+0000","last_undegraded":"2024-09-12T01:11:12.240217+0000","last_fullsized":"2024-09-12T01:11:12.240217+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'144","last_scrub_stamp":"2024-09-12T01:11:12.240134+0000","last_deep_scrub":"263'144","last_deep_scrub_stamp":"2024-09-12T01:11:12.240134+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.240134+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:47.702270+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":509,"num_write":213,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":758,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"263'287","reported_seq":895,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:12.771144+0000","last_change":"2024-09-12T01:11:12.771144+0000","last_active":"2024-09-12T01:11:12.771144+0000","last_peered":"2024-09-12T01:11:12.771144+0000","last_clean":"2024-09-12T01:11:12.771144+0000","last_became_active":"2024-09-12T00:12:36.041392+0000","last_became_peered":"2024-09-12T00:12:36.041392+0000","last_unstale":"2024-09-12T01:11:12.771144+0000","last_undegraded":"2024-09-12T01:11:12.771144+0000","last_fullsized":"2024-09-12T01:11:12.771144+0000","mapping_epoch":27,"log_start":"263'200","ondisk_log_start":"263'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'287","last_scrub_stamp":"2024-09-12T01:11:12.771025+0000","last_deep_scrub":"263'287","last_deep_scrub_stamp":"2024-09-12T01:11:12.771025+0000","last_clean_scrub_stamp":"2024-09-12T01:11:12.771025+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:08.477912+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992353,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":407,"num_read_kb":23602,"num_write":1012,"num_write_kb":32733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"263'134","reported_seq":762,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:15.757265+0000","last_change":"2024-09-12T01:11:15.757265+0000","last_active":"2024-09-12T01:11:15.757265+0000","last_peered":"2024-09-12T01:11:15.757265+0000","last_clean":"2024-09-12T01:11:15.757265+0000","last_became_active":"2024-09-12T00:12:38.042584+0000","last_became_peered":"2024-09-12T00:12:38.042584+0000","last_unstale":"2024-09-12T01:11:15.757265+0000","last_undegraded":"2024-09-12T01:11:15.757265+0000","last_fullsized":"2024-09-12T01:11:15.757265+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'134","last_scrub_stamp":"2024-09-12T01:11:15.757170+0000","last_deep_scrub":"263'134","last_deep_scrub_stamp":"2024-09-12T01:11:15.757170+0000","last_clean_scrub_stamp":"2024-09-12T01:11:15.757170+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:39.681374+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":632,"num_read_kb":533,"num_write":194,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"263'381","reported_seq":1048,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.378596+0000","last_change":"2024-09-12T01:11:17.378508+0000","last_active":"2024-09-12T01:11:17.378596+0000","last_peered":"2024-09-12T01:11:17.378596+0000","last_clean":"2024-09-12T01:11:17.378596+0000","last_became_active":"2024-09-12T00:12:36.037461+0000","last_became_peered":"2024-09-12T00:12:36.037461+0000","last_unstale":"2024-09-12T01:11:17.378596+0000","last_undegraded":"2024-09-12T01:11:17.378596+0000","last_fullsized":"2024-09-12T01:11:17.378596+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'381","last_scrub_stamp":"2024-09-12T01:11:17.378379+0000","last_deep_scrub":"263'381","last_deep_scrub_stamp":"2024-09-12T01:11:17.378379+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.378379+0000","objects_scrubbed":8,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:13.428268+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262313,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":614,"num_read_kb":9826,"num_write":1249,"num_write_kb":32499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"263'308","reported_seq":961,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.179705+0000","last_change":"2024-09-12T01:11:14.179705+0000","last_active":"2024-09-12T01:11:14.179705+0000","last_peered":"2024-09-12T01:11:14.179705+0000","last_clean":"2024-09-12T01:11:14.179705+0000","last_became_active":"2024-09-12T00:12:38.036872+0000","last_became_peered":"2024-09-12T00:12:38.036872+0000","last_unstale":"2024-09-12T01:11:14.179705+0000","last_undegraded":"2024-09-12T01:11:14.179705+0000","last_fullsized":"2024-09-12T01:11:14.179705+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'308","last_scrub_stamp":"2024-09-12T01:11:14.179611+0000","last_deep_scrub":"263'308","last_deep_scrub_stamp":"2024-09-12T01:11:14.179611+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.179611+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:04.270135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1112,"num_write":459,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"263'341","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.799642+0000","last_change":"2024-09-12T01:11:13.799642+0000","last_active":"2024-09-12T01:11:13.799642+0000","last_peered":"2024-09-12T01:11:13.799642+0000","last_clean":"2024-09-12T01:11:13.799642+0000","last_became_active":"2024-09-12T00:12:36.042159+0000","last_became_peered":"2024-09-12T00:12:36.042159+0000","last_unstale":"2024-09-12T01:11:13.799642+0000","last_undegraded":"2024-09-12T01:11:13.799642+0000","last_fullsized":"2024-09-12T01:11:13.799642+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-12T01:11:13.799464+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-12T01:11:13.799464+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.799464+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:02.740372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262267,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":513,"num_read_kb":43498,"num_write":1204,"num_write_kb":41544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"263'314","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:23.862426+0000","last_change":"2024-09-12T01:11:23.862426+0000","last_active":"2024-09-12T01:11:23.862426+0000","last_peered":"2024-09-12T01:11:23.862426+0000","last_clean":"2024-09-12T01:11:23.862426+0000","last_became_active":"2024-09-12T00:12:38.042966+0000","last_became_peered":"2024-09-12T00:12:38.042966+0000","last_unstale":"2024-09-12T01:11:23.862426+0000","last_undegraded":"2024-09-12T01:11:23.862426+0000","last_fullsized":"2024-09-12T01:11:23.862426+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'314","last_scrub_stamp":"2024-09-12T01:11:23.862308+0000","last_deep_scrub":"263'314","last_deep_scrub_stamp":"2024-09-12T01:11:23.862308+0000","last_clean_scrub_stamp":"2024-09-12T01:11:23.862308+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:32.625743+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1467,"num_read_kb":1262,"num_write":468,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25754,"num_omap_keys":101,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"263'377","reported_seq":1039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.331079+0000","last_change":"2024-09-12T01:11:08.331017+0000","last_active":"2024-09-12T01:11:08.331079+0000","last_peered":"2024-09-12T01:11:08.331079+0000","last_clean":"2024-09-12T01:11:08.331079+0000","last_became_active":"2024-09-12T00:12:36.027423+0000","last_became_peered":"2024-09-12T00:12:36.027423+0000","last_unstale":"2024-09-12T01:11:08.331079+0000","last_undegraded":"2024-09-12T01:11:08.331079+0000","last_fullsized":"2024-09-12T01:11:08.331079+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-12T01:11:08.330897+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-12T01:11:08.330897+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.330897+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:48.101657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730133,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":529,"num_read_kb":69052,"num_write":1173,"num_write_kb":46135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"263'156","reported_seq":737,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:17.234431+0000","last_change":"2024-09-12T01:11:17.234431+0000","last_active":"2024-09-12T01:11:17.234431+0000","last_peered":"2024-09-12T01:11:17.234431+0000","last_clean":"2024-09-12T01:11:17.234431+0000","last_became_active":"2024-09-12T00:12:38.036235+0000","last_became_peered":"2024-09-12T00:12:38.036235+0000","last_unstale":"2024-09-12T01:11:17.234431+0000","last_undegraded":"2024-09-12T01:11:17.234431+0000","last_fullsized":"2024-09-12T01:11:17.234431+0000","mapping_epoch":29,"log_start":"260'100","ondisk_log_start":"260'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'156","last_scrub_stamp":"2024-09-12T01:11:17.234365+0000","last_deep_scrub":"263'156","last_deep_scrub_stamp":"2024-09-12T01:11:17.234365+0000","last_clean_scrub_stamp":"2024-09-12T01:11:17.234365+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:50.396135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":550,"num_write":221,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"263'463","reported_seq":1289,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.615976+0000","last_change":"2024-09-12T01:11:13.615976+0000","last_active":"2024-09-12T01:11:13.615976+0000","last_peered":"2024-09-12T01:11:13.615976+0000","last_clean":"2024-09-12T01:11:13.615976+0000","last_became_active":"2024-09-12T00:12:36.038449+0000","last_became_peered":"2024-09-12T00:12:36.038449+0000","last_unstale":"2024-09-12T01:11:13.615976+0000","last_undegraded":"2024-09-12T01:11:13.615976+0000","last_fullsized":"2024-09-12T01:11:13.615976+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'463","last_scrub_stamp":"2024-09-12T01:11:13.615824+0000","last_deep_scrub":"263'463","last_deep_scrub_stamp":"2024-09-12T01:11:13.615824+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.615824+0000","objects_scrubbed":10,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:45.835212+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5280724,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1083,"num_read_kb":25378,"num_write":1472,"num_write_kb":31172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"263'189","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.221767+0000","last_change":"2024-09-12T01:11:14.221767+0000","last_active":"2024-09-12T01:11:14.221767+0000","last_peered":"2024-09-12T01:11:14.221767+0000","last_clean":"2024-09-12T01:11:14.221767+0000","last_became_active":"2024-09-12T00:12:38.042691+0000","last_became_peered":"2024-09-12T00:12:38.042691+0000","last_unstale":"2024-09-12T01:11:14.221767+0000","last_undegraded":"2024-09-12T01:11:14.221767+0000","last_fullsized":"2024-09-12T01:11:14.221767+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'189","last_scrub_stamp":"2024-09-12T01:11:14.221681+0000","last_deep_scrub":"263'189","last_deep_scrub_stamp":"2024-09-12T01:11:14.221681+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.221681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:58.106634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":710,"num_write":289,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"263'349","reported_seq":990,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:08.150591+0000","last_change":"2024-09-12T01:11:08.150533+0000","last_active":"2024-09-12T01:11:08.150591+0000","last_peered":"2024-09-12T01:11:08.150591+0000","last_clean":"2024-09-12T01:11:08.150591+0000","last_became_active":"2024-09-12T00:12:36.025028+0000","last_became_peered":"2024-09-12T00:12:36.025028+0000","last_unstale":"2024-09-12T01:11:08.150591+0000","last_undegraded":"2024-09-12T01:11:08.150591+0000","last_fullsized":"2024-09-12T01:11:08.150591+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'349","last_scrub_stamp":"2024-09-12T01:11:08.150388+0000","last_deep_scrub":"263'349","last_deep_scrub_stamp":"2024-09-12T01:11:08.150388+0000","last_clean_scrub_stamp":"2024-09-12T01:11:08.150388+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:51.049508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262241,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":523,"num_read_kb":8333,"num_write":1236,"num_write_kb":35038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"263'132","reported_seq":755,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:16.724523+0000","last_change":"2024-09-12T01:11:16.724523+0000","last_active":"2024-09-12T01:11:16.724523+0000","last_peered":"2024-09-12T01:11:16.724523+0000","last_clean":"2024-09-12T01:11:16.724523+0000","last_became_active":"2024-09-12T00:12:38.046753+0000","last_became_peered":"2024-09-12T00:12:38.046753+0000","last_unstale":"2024-09-12T01:11:16.724523+0000","last_undegraded":"2024-09-12T01:11:16.724523+0000","last_fullsized":"2024-09-12T01:11:16.724523+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'132","last_scrub_stamp":"2024-09-12T01:11:16.724424+0000","last_deep_scrub":"263'132","last_deep_scrub_stamp":"2024-09-12T01:11:16.724424+0000","last_clean_scrub_stamp":"2024-09-12T01:11:16.724424+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:10.527369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":645,"num_read_kb":546,"num_write":214,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"263'376","reported_seq":1029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:18.407915+0000","last_change":"2024-09-12T01:11:18.407843+0000","last_active":"2024-09-12T01:11:18.407915+0000","last_peered":"2024-09-12T01:11:18.407915+0000","last_clean":"2024-09-12T01:11:18.407915+0000","last_became_active":"2024-09-12T00:12:36.047221+0000","last_became_peered":"2024-09-12T00:12:36.047221+0000","last_unstale":"2024-09-12T01:11:18.407915+0000","last_undegraded":"2024-09-12T01:11:18.407915+0000","last_fullsized":"2024-09-12T01:11:18.407915+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'376","last_scrub_stamp":"2024-09-12T01:11:18.407727+0000","last_deep_scrub":"263'376","last_deep_scrub_stamp":"2024-09-12T01:11:18.407727+0000","last_clean_scrub_stamp":"2024-09-12T01:11:18.407727+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:05.332812+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4807090,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":28472,"num_write":1153,"num_write_kb":36833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"263'174","reported_seq":811,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.450164+0000","last_change":"2024-09-12T01:11:19.450164+0000","last_active":"2024-09-12T01:11:19.450164+0000","last_peered":"2024-09-12T01:11:19.450164+0000","last_clean":"2024-09-12T01:11:19.450164+0000","last_became_active":"2024-09-12T00:12:38.048094+0000","last_became_peered":"2024-09-12T00:12:38.048094+0000","last_unstale":"2024-09-12T01:11:19.450164+0000","last_undegraded":"2024-09-12T01:11:19.450164+0000","last_fullsized":"2024-09-12T01:11:19.450164+0000","mapping_epoch":29,"log_start":"263'100","ondisk_log_start":"263'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'174","last_scrub_stamp":"2024-09-12T01:11:19.450075+0000","last_deep_scrub":"263'174","last_deep_scrub_stamp":"2024-09-12T01:11:19.450075+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.450075+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:51.643162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":798,"num_read_kb":664,"num_write":275,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"263'311","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.726114+0000","last_change":"2024-09-12T01:11:10.726114+0000","last_active":"2024-09-12T01:11:10.726114+0000","last_peered":"2024-09-12T01:11:10.726114+0000","last_clean":"2024-09-12T01:11:10.726114+0000","last_became_active":"2024-09-12T00:12:36.039442+0000","last_became_peered":"2024-09-12T00:12:36.039442+0000","last_unstale":"2024-09-12T01:11:10.726114+0000","last_undegraded":"2024-09-12T01:11:10.726114+0000","last_fullsized":"2024-09-12T01:11:10.726114+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-12T01:11:10.725997+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-12T01:11:10.725997+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.725997+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:30.008154+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":5824,"num_write":1002,"num_write_kb":34989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"263'86","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:13.269437+0000","last_change":"2024-09-12T01:11:13.269371+0000","last_active":"2024-09-12T01:11:13.269437+0000","last_peered":"2024-09-12T01:11:13.269437+0000","last_clean":"2024-09-12T01:11:13.269437+0000","last_became_active":"2024-09-12T00:12:38.042380+0000","last_became_peered":"2024-09-12T00:12:38.042380+0000","last_unstale":"2024-09-12T01:11:13.269437+0000","last_undegraded":"2024-09-12T01:11:13.269437+0000","last_fullsized":"2024-09-12T01:11:13.269437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'86","last_scrub_stamp":"2024-09-12T01:11:13.269288+0000","last_deep_scrub":"263'86","last_deep_scrub_stamp":"2024-09-12T01:11:13.269288+0000","last_clean_scrub_stamp":"2024-09-12T01:11:13.269288+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:11.757304+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":311,"num_write":119,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"263'396","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:19.359247+0000","last_change":"2024-09-12T01:11:19.359247+0000","last_active":"2024-09-12T01:11:19.359247+0000","last_peered":"2024-09-12T01:11:19.359247+0000","last_clean":"2024-09-12T01:11:19.359247+0000","last_became_active":"2024-09-12T00:12:36.035235+0000","last_became_peered":"2024-09-12T00:12:36.035235+0000","last_unstale":"2024-09-12T01:11:19.359247+0000","last_undegraded":"2024-09-12T01:11:19.359247+0000","last_fullsized":"2024-09-12T01:11:19.359247+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'396","last_scrub_stamp":"2024-09-12T01:11:19.359113+0000","last_deep_scrub":"263'396","last_deep_scrub_stamp":"2024-09-12T01:11:19.359113+0000","last_clean_scrub_stamp":"2024-09-12T01:11:19.359113+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:34.438134+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2508578,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":34997,"num_write":1247,"num_write_kb":37513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"263'340","reported_seq":968,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:10.297343+0000","last_change":"2024-09-12T01:11:10.297255+0000","last_active":"2024-09-12T01:11:10.297343+0000","last_peered":"2024-09-12T01:11:10.297343+0000","last_clean":"2024-09-12T01:11:10.297343+0000","last_became_active":"2024-09-12T00:13:07.150278+0000","last_became_peered":"2024-09-12T00:13:07.150278+0000","last_unstale":"2024-09-12T01:11:10.297343+0000","last_undegraded":"2024-09-12T01:11:10.297343+0000","last_fullsized":"2024-09-12T01:11:10.297343+0000","mapping_epoch":40,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'340","last_scrub_stamp":"2024-09-12T01:11:10.297094+0000","last_deep_scrub":"263'340","last_deep_scrub_stamp":"2024-09-12T01:11:10.297094+0000","last_clean_scrub_stamp":"2024-09-12T01:11:10.297094+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:40.514518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550106,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":16889,"num_write":1077,"num_write_kb":27724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"263'232","reported_seq":858,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.445613+0000","last_change":"2024-09-12T01:11:20.445613+0000","last_active":"2024-09-12T01:11:20.445613+0000","last_peered":"2024-09-12T01:11:20.445613+0000","last_clean":"2024-09-12T01:11:20.445613+0000","last_became_active":"2024-09-12T00:12:38.048092+0000","last_became_peered":"2024-09-12T00:12:38.048092+0000","last_unstale":"2024-09-12T01:11:20.445613+0000","last_undegraded":"2024-09-12T01:11:20.445613+0000","last_fullsized":"2024-09-12T01:11:20.445613+0000","mapping_epoch":29,"log_start":"263'200","ondisk_log_start":"263'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'232","last_scrub_stamp":"2024-09-12T01:11:20.445524+0000","last_deep_scrub":"263'232","last_deep_scrub_stamp":"2024-09-12T01:11:20.445524+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.445524+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:49.570800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":909,"num_write":384,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"263'395","reported_seq":1216,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:14.842411+0000","last_change":"2024-09-12T01:11:14.842411+0000","last_active":"2024-09-12T01:11:14.842411+0000","last_peered":"2024-09-12T01:11:14.842411+0000","last_clean":"2024-09-12T01:11:14.842411+0000","last_became_active":"2024-09-12T00:12:36.034396+0000","last_became_peered":"2024-09-12T00:12:36.034396+0000","last_unstale":"2024-09-12T01:11:14.842411+0000","last_undegraded":"2024-09-12T01:11:14.842411+0000","last_fullsized":"2024-09-12T01:11:14.842411+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'395","last_scrub_stamp":"2024-09-12T01:11:14.842306+0000","last_deep_scrub":"263'395","last_deep_scrub_stamp":"2024-09-12T01:11:14.842306+0000","last_clean_scrub_stamp":"2024-09-12T01:11:14.842306+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:02.568926+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730115,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":982,"num_read_kb":9206,"num_write":1471,"num_write_kb":42121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"263'344","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-12T01:11:20.286803+0000","last_change":"2024-09-12T01:11:20.286803+0000","last_active":"2024-09-12T01:11:20.286803+0000","last_peered":"2024-09-12T01:11:20.286803+0000","last_clean":"2024-09-12T01:11:20.286803+0000","last_became_active":"2024-09-12T00:12:38.039941+0000","last_became_peered":"2024-09-12T00:12:38.039941+0000","last_unstale":"2024-09-12T01:11:20.286803+0000","last_undegraded":"2024-09-12T01:11:20.286803+0000","last_fullsized":"2024-09-12T01:11:20.286803+0000","mapping_epoch":29,"log_start":"263'300","ondisk_log_start":"263'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-12T01:11:20.286686+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-12T01:11:20.286686+0000","last_clean_scrub_stamp":"2024-09-12T01:11:20.286686+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:08.702768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1443,"num_read_kb":1146,"num_write":558,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5787,"num_read_kb":4069,"num_write":1922,"num_write_kb":820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6000,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1095,"ondisk_log_size":1095,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":16319,"num_objects":95,"num_object_clones":0,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":15069,"num_read_kb":14720,"num_write":16734,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2934,"num_omap_keys":19,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614400,"data_stored":32638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1863,"ondisk_log_size":1863,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":695,"ondisk_log_size":695,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1599308,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":18230,"num_read_kb":37558,"num_write":15243,"num_write_kb":11785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685952,"num_omap_keys":1572,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1894,"ondisk_log_size":1894,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2432,"num_read_kb":2899,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":103162,"num_read_kb":86048,"num_write":37373,"num_write_kb":18894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":44597,"num_omap_keys":180,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3943,"ondisk_log_size":3943,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":86738467,"num_objects":386,"num_object_clones":0,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":386,"num_whiteouts":0,"num_read":36305,"num_read_kb":1714849,"num_write":72152,"num_write_kb":2100462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":132317184,"data_stored":132317184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3742,"ondisk_log_size":3742,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":170862,"num_write":186,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":170241,"num_write":186,"num_write_kb":128243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510166,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220644,"kb_used_data":14612,"kb_used_omap":1,"kb_used_meta":206014,"kb_avail":94151196,"statfs":{"total":96636764160,"available":96410824704,"internally_reserved":0,"allocated":14962688,"data_stored":12977820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":210958795},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510169,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108704,"kb_used_data":15120,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94263136,"statfs":{"total":96636764160,"available":96525451264,"internally_reserved":0,"allocated":15482880,"data_stored":13481120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95812038},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510166,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205480,"kb_used_data":21656,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94166360,"statfs":{"total":96636764160,"available":96426352640,"internally_reserved":0,"allocated":22175744,"data_stored":20184672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510167,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":271156,"kb_used_data":28964,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94100684,"statfs":{"total":96636764160,"available":96359100416,"internally_reserved":0,"allocated":29659136,"data_stored":27672539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":247986631},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510167,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151856,"kb_used_data":22112,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94219984,"statfs":{"total":96636764160,"available":96481263616,"internally_reserved":0,"allocated":22642688,"data_stored":20661729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510167,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":328376,"kb_used_data":22312,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":94043464,"statfs":{"total":96636764160,"available":96300507136,"internally_reserved":0,"allocated":22847488,"data_stored":20852874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510169,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99024,"kb_used_data":17856,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94272816,"statfs":{"total":96636764160,"available":96535363584,"internally_reserved":0,"allocated":18284544,"data_stored":16272298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575574,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":272432,"kb_used_data":20512,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94099408,"statfs":{"total":96636764160,"available":96357793792,"internally_reserved":0,"allocated":21004288,"data_stored":19003294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14069760,"data_stored":14069760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18063360,"data_stored":18063360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18460672,"data_stored":18460672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25473024,"data_stored":25473024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17981440,"data_stored":17981440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16211968,"data_stored":16211968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11280384,"data_stored":11280384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10776576,"data_stored":10776576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":3993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:12:28.482 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T01:12:28.810 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T01:12:28.811 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T01:12:28.811 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T01:12:28.811 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:28.856 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T01:12:28.856 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T01:12:28.856 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:28.914 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T01:12:28.914 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T01:12:28.915 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:28.951 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T01:12:28.951 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T01:12:28.951 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:29.030 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T01:12:29.030 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T01:12:29.030 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:29.081 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T01:12:29.082 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T01:12:29.082 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:29.132 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T01:12:29.132 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T01:12:29.132 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:29.182 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T01:12:29.182 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T01:12:29.182 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:29.231 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T01:12:29.231 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T01:12:29.231 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T01:12:29.231 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:29.256 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T01:12:29.257 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T01:12:29.257 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:29.287 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T01:12:29.287 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T01:12:29.287 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T01:12:29.287 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:29.313 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T01:12:29.314 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T01:12:29.314 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:29.367 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T01:12:29.367 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T01:12:29.367 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:12:29.380 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T01:12:29.380 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T01:12:29.380 DEBUG:teuthology.orchestra.run.smithi133:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T01:12:29.450 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi133.front.sepia.ceph.com 2024-09-12T01:12:29.450 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T01:12:29.670 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi133.front.sepia.ceph.com 2024-09-12T01:12:29.670 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T01:12:29.821 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi133.front.sepia.ceph.com 2024-09-12T01:12:29.822 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T01:12:29.901 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi133.front.sepia.ceph.com 2024-09-12T01:12:29.902 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T01:12:29.975 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-12T01:12:29.976 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T01:12:30.163 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-12T01:12:30.163 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T01:12:30.244 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-12T01:12:30.244 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T01:12:30.317 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-12T01:12:30.317 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T01:12:30.391 INFO:tasks.ceph:Archiving mon data... 2024-09-12T01:12:30.393 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901839/data/mon.a.tgz 2024-09-12T01:12:30.393 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-09-12T01:12:30.423 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.SJVe7B8j28 2024-09-12T01:12:30.423 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SJVe7B8j28 2024-09-12T01:12:30.614 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.SJVe7B8j28 2024-09-12T01:12:30.724 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.SJVe7B8j28 is 459KB 2024-09-12T01:12:30.823 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.SJVe7B8j28 2024-09-12T01:12:30.851 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901839/data/mon.c.tgz 2024-09-12T01:12:30.851 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2024-09-12T01:12:30.921 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.wbGkCLRcsx 2024-09-12T01:12:30.921 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.wbGkCLRcsx 2024-09-12T01:12:31.095 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.wbGkCLRcsx 2024-09-12T01:12:31.205 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.wbGkCLRcsx is 467KB 2024-09-12T01:12:31.301 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.wbGkCLRcsx 2024-09-12T01:12:31.330 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901839/data/mon.b.tgz 2024-09-12T01:12:31.330 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-09-12T01:12:31.365 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.klZw3mHqEb 2024-09-12T01:12:31.365 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.klZw3mHqEb 2024-09-12T01:12:31.557 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.klZw3mHqEb 2024-09-12T01:12:31.667 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.klZw3mHqEb is 467KB 2024-09-12T01:12:31.764 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.klZw3mHqEb 2024-09-12T01:12:31.793 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T01:12:31.793 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:12:31.795 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:12:31.979 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:12:32.008 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:12:32.008 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T01:12:32.010 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901839/remote/smithi133/crash 2024-09-12T01:12:32.010 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:12:32.049 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901839/remote/smithi160/crash 2024-09-12T01:12:32.050 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:12:32.087 INFO:tasks.ceph:Compressing logs... 2024-09-12T01:12:32.088 DEBUG:teuthology.orchestra.run.smithi133:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:12:32.093 DEBUG:teuthology.orchestra.run.smithi160:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:12:32.183 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32896.log 2024-09-12T01:12:32.184 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T01:12:32.184 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32632.log 2024-09-12T01:12:32.184 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32896.log.gz 2024-09-12T01:12:32.184 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32808.log 2024-09-12T01:12:32.184 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32632.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T01:12:32.184 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32632.log.gz 2024-09-12T01:12:32.184 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32808.log.gzgzip 2024-09-12T01:12:32.184 INFO:teuthology.orchestra.run.smithi160.stderr: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:12:32.184 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32852.log 2024-09-12T01:12:32.184 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32588.log 2024-09-12T01:12:32.184 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32676.log 2024-09-12T01:12:32.185 INFO:teuthology.orchestra.run.smithi160.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32852.log.gz 2024-09-12T01:12:32.185 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T01:12:32.185 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32588.log.gz 2024-09-12T01:12:32.185 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32676.log.gz 2024-09-12T01:12:32.185 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T01:12:32.185 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32720.log 2024-09-12T01:12:32.185 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-osd.5.log: 90.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:12:32.185 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:12:32.185 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32720.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32720.log.gz 2024-09-12T01:12:32.185 INFO:teuthology.orchestra.run.smithi160.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32764.log 2024-09-12T01:12:32.185 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T01:12:32.185 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.32764.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32764.log.gz 2024-09-12T01:12:32.185 INFO:teuthology.orchestra.run.smithi160.stderr: -- /var/log/ceph/ceph-mon.b.log 2024-09-12T01:12:32.187 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.b.log: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:12:32.252 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T01:12:32.252 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150056.log 2024-09-12T01:12:32.252 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192140.log 2024-09-12T01:12:32.253 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.150056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54633.log 2024-09-12T01:12:32.253 INFO:teuthology.orchestra.run.smithi133.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.150056.log.gz 2024-09-12T01:12:32.253 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.192140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.186921.log 2024-09-12T01:12:32.253 INFO:teuthology.orchestra.run.smithi133.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.192140.log.gz 2024-09-12T01:12:32.253 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154769.log 2024-09-12T01:12:32.253 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54633.log: /var/log/ceph/ceph-client.0.186921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92328.log 2024-09-12T01:12:32.253 INFO:teuthology.orchestra.run.smithi133.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.186921.log.gz 2024-09-12T01:12:32.253 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.154769.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.54633.log.gz 2024-09-12T01:12:32.253 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75702.log 2024-09-12T01:12:32.253 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.92328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141220.log 2024-09-12T01:12:32.253 INFO:teuthology.orchestra.run.smithi133.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.92328.log.gz 2024-09-12T01:12:32.253 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.75702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165417.log 2024-09-12T01:12:32.253 INFO:teuthology.orchestra.run.smithi133.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.75702.log.gz 2024-09-12T01:12:32.254 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.141220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106466.log 2024-09-12T01:12:32.254 INFO:teuthology.orchestra.run.smithi133.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.141220.log.gz 2024-09-12T01:12:32.254 INFO:teuthology.orchestra.run.smithi133.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.154769.log.gz 2024-09-12T01:12:32.254 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147700.log 2024-09-12T01:12:32.254 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.165417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165417.log.gz 2024-09-12T01:12:32.254 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.106466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167208.log 2024-09-12T01:12:32.254 INFO:teuthology.orchestra.run.smithi133.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.106466.log.gz 2024-09-12T01:12:32.254 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.147700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65981.log 2024-09-12T01:12:32.254 INFO:teuthology.orchestra.run.smithi133.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.147700.log.gz 2024-09-12T01:12:32.254 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.167208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180831.log 2024-09-12T01:12:32.254 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167208.log.gz 2024-09-12T01:12:32.254 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.65981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179613.log 2024-09-12T01:12:32.254 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.180831.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.65981.log.gz 2024-09-12T01:12:32.254 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40308.log 2024-09-12T01:12:32.254 INFO:teuthology.orchestra.run.smithi133.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.180831.log.gz 2024-09-12T01:12:32.255 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.179613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195222.log 2024-09-12T01:12:32.255 INFO:teuthology.orchestra.run.smithi133.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.179613.log.gz 2024-09-12T01:12:32.255 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158892.log 2024-09-12T01:12:32.255 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40308.log.gz 2024-09-12T01:12:32.255 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.195222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91739.log 2024-09-12T01:12:32.255 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195222.log.gz 2024-09-12T01:12:32.255 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.158892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40989.log 2024-09-12T01:12:32.255 INFO:teuthology.orchestra.run.smithi133.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.158892.log.gz 2024-09-12T01:12:32.255 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191361.log 2024-09-12T01:12:32.255 INFO:teuthology.orchestra.run.smithi133.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.91739.log.gz 2024-09-12T01:12:32.255 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.188139.log 2024-09-12T01:12:32.255 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40989.log.gz 2024-09-12T01:12:32.255 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.191361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92917.log 2024-09-12T01:12:32.256 INFO:teuthology.orchestra.run.smithi133.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.191361.log.gz 2024-09-12T01:12:32.256 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.188139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194299.log 2024-09-12T01:12:32.256 INFO:teuthology.orchestra.run.smithi133.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.188139.log.gz/var/log/ceph/ceph-client.admin.92917.log: 2024-09-12T01:12:32.256 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148878.log 2024-09-12T01:12:32.256 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.194299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102932.log 2024-09-12T01:12:32.256 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194299.log.gz 2024-09-12T01:12:32.256 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.148878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117068.log 2024-09-12T01:12:32.256 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40121.log 2024-09-12T01:12:32.256 INFO:teuthology.orchestra.run.smithi133.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102932.log.gz 2024-09-12T01:12:32.256 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.117068.log: gzip 86.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.92917.log.gz -- 2024-09-12T01:12:32.256 INFO:teuthology.orchestra.run.smithi133.stderr: /var/log/ceph/ceph-client.admin.96452.log 2024-09-12T01:12:32.256 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40121.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.117068.log.gz 2024-09-12T01:12:32.256 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40121.log.gz 2024-09-12T01:12:32.256 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88794.log 2024-09-12T01:12:32.257 INFO:teuthology.orchestra.run.smithi133.stderr: 86.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.148878.log.gz 2024-09-12T01:12:32.257 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40675.log 2024-09-12T01:12:32.257 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.96452.log: /var/log/ceph/ceph-client.admin.88794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170525.log 2024-09-12T01:12:32.257 INFO:teuthology.orchestra.run.smithi133.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.96452.log.gz 2024-09-12T01:12:32.257 INFO:teuthology.orchestra.run.smithi133.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.88794.log.gz 2024-09-12T01:12:32.257 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65001.log 2024-09-12T01:12:32.257 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40675.log.gz 2024-09-12T01:12:32.257 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.170525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183876.log 2024-09-12T01:12:32.257 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.65001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119426.log 2024-09-12T01:12:32.257 INFO:teuthology.orchestra.run.smithi133.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.65001.log.gz 2024-09-12T01:12:32.257 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.183876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39821.log 2024-09-12T01:12:32.257 INFO:teuthology.orchestra.run.smithi133.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.183876.log.gz 2024-09-12T01:12:32.257 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.119426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89972.log 2024-09-12T01:12:32.257 INFO:teuthology.orchestra.run.smithi133.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.119426.log.gz 2024-09-12T01:12:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167845.log 2024-09-12T01:12:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39821.log.gz 2024-09-12T01:12:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48352.log 2024-09-12T01:12:32.258 INFO:teuthology.orchestra.run.smithi133.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.89972.log.gz 2024-09-12T01:12:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.167845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97630.log 2024-09-12T01:12:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48352.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.167845.log.gz 2024-09-12T01:12:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195312.log 2024-09-12T01:12:32.258 INFO:teuthology.orchestra.run.smithi133.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.48352.log.gz 2024-09-12T01:12:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128851.log 2024-09-12T01:12:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.195312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195312.log.gz 2024-09-12T01:12:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T01:12:32.258 INFO:teuthology.orchestra.run.smithi133.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.97630.log.gz 2024-09-12T01:12:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.128851.log: -- /var/log/ceph/ceph-client.admin.39914.log 2024-09-12T01:12:32.259 INFO:teuthology.orchestra.run.smithi133.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.170525.log.gz 2024-09-12T01:12:32.259 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192021.log 2024-09-12T01:12:32.259 INFO:teuthology.orchestra.run.smithi133.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.128851.log.gz 2024-09-12T01:12:32.259 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112356.log 2024-09-12T01:12:32.259 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39914.log.gz 2024-09-12T01:12:32.259 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.192021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195176.log 2024-09-12T01:12:32.259 INFO:teuthology.orchestra.run.smithi133.stderr: 24.9% -- replaced with /var/log/ceph/ceph-client.admin.192021.log.gz 2024-09-12T01:12:32.259 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.112356.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T01:12:32.259 INFO:teuthology.orchestra.run.smithi133.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.112356.log.gz 2024-09-12T01:12:32.259 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.195176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95274.log 2024-09-12T01:12:32.259 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195176.log.gz 2024-09-12T01:12:32.259 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167256.log 2024-09-12T01:12:32.259 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.95274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60571.log 2024-09-12T01:12:32.259 INFO:teuthology.orchestra.run.smithi133.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.95274.log.gz 2024-09-12T01:12:32.260 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.167256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.193529.log 2024-09-12T01:12:32.260 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182049.log 2024-09-12T01:12:32.260 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.60571.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.167256.log.gz 2024-09-12T01:12:32.260 INFO:teuthology.orchestra.run.smithi133.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.60571.log.gz 2024-09-12T01:12:32.260 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.193529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155947.log 2024-09-12T01:12:32.260 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39197.log 2024-09-12T01:12:32.260 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.182049.log: /var/log/ceph/ceph-client.admin.155947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44263.log 2024-09-12T01:12:32.260 INFO:teuthology.orchestra.run.smithi133.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.182049.log.gz 2024-09-12T01:12:32.260 INFO:teuthology.orchestra.run.smithi133.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.155947.log.gz 2024-09-12T01:12:32.260 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154180.log 2024-09-12T01:12:32.260 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39197.log.gz 2024-09-12T01:12:32.260 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.44263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104699.log 2024-09-12T01:12:32.260 INFO:teuthology.orchestra.run.smithi133.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.44263.log.gz 2024-09-12T01:12:32.260 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.154180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130029.log 2024-09-12T01:12:32.261 INFO:teuthology.orchestra.run.smithi133.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.154180.log.gz 2024-09-12T01:12:32.261 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165441.log 2024-09-12T01:12:32.261 INFO:teuthology.orchestra.run.smithi133.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.104699.log.gz 2024-09-12T01:12:32.261 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.130029.log: /var/log/ceph/ceph-client.admin.59982.log 2024-09-12T01:12:32.261 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.165441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65206.log 2024-09-12T01:12:32.261 INFO:teuthology.orchestra.run.smithi133.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.165441.log.gz 2024-09-12T01:12:32.261 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142399.log 2024-09-12T01:12:32.261 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.59982.log: /var/log/ceph/ceph-client.admin.65206.log: gzip -5 --verbose -- 54.5% -- replaced with /var/log/ceph/ceph-client.admin.65206.log.gz 2024-09-12T01:12:32.261 INFO:teuthology.orchestra.run.smithi133.stderr: /var/log/ceph/ceph-client.admin.195268.log 2024-09-12T01:12:32.261 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.142399.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.59982.log.gz 2024-09-12T01:12:32.261 INFO:teuthology.orchestra.run.smithi133.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.130029.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98219.log 2024-09-12T01:12:32.261 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-09-12T01:12:32.261 INFO:teuthology.orchestra.run.smithi133.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.142399.log.gz 2024-09-12T01:12:32.261 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.195268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102342.log 2024-09-12T01:12:32.262 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195268.log.gz 2024-09-12T01:12:32.262 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.98219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64431.log 2024-09-12T01:12:32.262 INFO:teuthology.orchestra.run.smithi133.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.98219.log.gz 2024-09-12T01:12:32.262 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.102342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65140.log 2024-09-12T01:12:32.262 INFO:teuthology.orchestra.run.smithi133.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.102342.log.gz 2024-09-12T01:12:32.262 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165393.log 2024-09-12T01:12:32.262 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.64431.log: 62.4% -- replaced with /var/log/ceph/ceph-client.admin.64431.log.gz 2024-09-12T01:12:32.262 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.65140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.186312.log 2024-09-12T01:12:32.262 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.165393.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165393.log.gz 2024-09-12T01:12:32.262 INFO:teuthology.orchestra.run.smithi133.stderr: -- /var/log/ceph/ceph-client.admin.67810.log 2024-09-12T01:12:32.262 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.186312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51003.log 2024-09-12T01:12:32.262 INFO:teuthology.orchestra.run.smithi133.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.186312.log.gz 2024-09-12T01:12:32.262 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112945.log 2024-09-12T01:12:32.262 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163037.log 2024-09-12T01:12:32.263 INFO:teuthology.orchestra.run.smithi133.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.51003.log.gz 2024-09-12T01:12:32.263 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.112945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33084.log 2024-09-12T01:12:32.263 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.163037.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.112945.log.gz 2024-09-12T01:12:32.263 INFO:teuthology.orchestra.run.smithi133.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.163037.log.gz 2024-09-12T01:12:32.263 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194713.log 2024-09-12T01:12:32.263 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.33084.log: /var/log/ceph/ceph-client.0.44866.log 2024-09-12T01:12:32.263 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33084.log.gz 2024-09-12T01:12:32.263 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63564.log 2024-09-12T01:12:32.263 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.194713.log: /var/log/ceph/ceph-client.0.44866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194713.log.gz 2024-09-12T01:12:32.263 INFO:teuthology.orchestra.run.smithi133.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.44866.log.gz 2024-09-12T01:12:32.263 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79531.log 2024-09-12T01:12:32.263 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.63564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39138.log 2024-09-12T01:12:32.263 INFO:teuthology.orchestra.run.smithi133.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.63564.log.gz 2024-09-12T01:12:32.263 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.79531.log: 50.9% -- replaced with /var/log/ceph/ceph-client.admin.79531.log.gz 2024-09-12T01:12:32.264 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143577.log 2024-09-12T01:12:32.264 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134741.log 2024-09-12T01:12:32.264 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.143577.log: /var/log/ceph/ceph-client.admin.39138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39138.log.gz 2024-09-12T01:12:32.264 INFO:teuthology.orchestra.run.smithi133.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.143577.log.gz 2024-09-12T01:12:32.264 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39820.log 2024-09-12T01:12:32.264 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125317.log 2024-09-12T01:12:32.264 INFO:teuthology.orchestra.run.smithi133.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.67810.log.gz 2024-09-12T01:12:32.264 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39820.log: /var/log/ceph/ceph-client.admin.134741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39820.log.gz 2024-09-12T01:12:32.264 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118837.log 2024-09-12T01:12:32.264 INFO:teuthology.orchestra.run.smithi133.stderr: 87.2%/var/log/ceph/ceph-client.admin.125317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53996.log 2024-09-12T01:12:32.264 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.134741.log.gz 2024-09-12T01:12:32.264 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.118837.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125317.log.gz 2024-09-12T01:12:32.264 INFO:teuthology.orchestra.run.smithi133.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.118837.log.gz 2024-09-12T01:12:32.264 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173504.log 2024-09-12T01:12:32.265 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53996.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53996.log.gz 2024-09-12T01:12:32.265 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59345.log 2024-09-12T01:12:32.265 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.173504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40276.log 2024-09-12T01:12:32.265 INFO:teuthology.orchestra.run.smithi133.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.173504.log.gz/var/log/ceph/ceph-client.admin.59345.log: 2024-09-12T01:12:32.265 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39289.log 2024-09-12T01:12:32.265 INFO:teuthology.orchestra.run.smithi133.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.59345.log.gz 2024-09-12T01:12:32.265 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40276.log.gz 2024-09-12T01:12:32.265 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51592.log 2024-09-12T01:12:32.265 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39335.log 2024-09-12T01:12:32.265 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39289.log: /var/log/ceph/ceph-client.admin.51592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144755.log 2024-09-12T01:12:32.265 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39289.log.gz 2024-09-12T01:12:32.265 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51592.log.gz 2024-09-12T01:12:32.265 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39335.log.gz 2024-09-12T01:12:32.265 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147111.log 2024-09-12T01:12:32.266 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138864.log 2024-09-12T01:12:32.266 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.144755.log: /var/log/ceph/ceph-client.admin.147111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185094.log 2024-09-12T01:12:32.266 INFO:teuthology.orchestra.run.smithi133.stderr: 81.7%/var/log/ceph/ceph-client.admin.138864.log: -- replaced with /var/log/ceph/ceph-client.admin.147111.log.gz 2024-09-12T01:12:32.266 INFO:teuthology.orchestra.run.smithi133.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.138864.log.gz 2024-09-12T01:12:32.266 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194575.log 2024-09-12T01:12:32.266 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89383.log 2024-09-12T01:12:32.266 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.185094.log: /var/log/ceph/ceph-client.admin.194575.log: 86.2% 80.4% -- replaced with /var/log/ceph/ceph-client.0.185094.log.gz 2024-09-12T01:12:32.266 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194575.log.gz 2024-09-12T01:12:32.266 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.144755.log.gz 2024-09-12T01:12:32.266 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40899.log 2024-09-12T01:12:32.266 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.89383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40188.log 2024-09-12T01:12:32.266 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65140.log.gz 2024-09-12T01:12:32.266 INFO:teuthology.orchestra.run.smithi133.stderr: 87.1%/var/log/ceph/ceph-client.admin.40899.log: -- replaced with /var/log/ceph/ceph-client.admin.89383.log.gz 2024-09-12T01:12:32.266 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40899.log.gz 2024-09-12T01:12:32.267 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49825.log 2024-09-12T01:12:32.267 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64684.log 2024-09-12T01:12:32.267 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40188.log.gz 2024-09-12T01:12:32.267 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39545.log 2024-09-12T01:12:32.267 INFO:teuthology.orchestra.run.smithi133.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.49825.log.gz/var/log/ceph/ceph-client.admin.64684.log: 2024-09-12T01:12:32.267 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87616.log 2024-09-12T01:12:32.267 INFO:teuthology.orchestra.run.smithi133.stderr: 54.1% -- replaced with /var/log/ceph/ceph-client.admin.64684.log.gz 2024-09-12T01:12:32.267 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41121.log 2024-09-12T01:12:32.267 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39545.log.gz 2024-09-12T01:12:32.267 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.87616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40509.log 2024-09-12T01:12:32.267 INFO:teuthology.orchestra.run.smithi133.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.87616.log.gz 2024-09-12T01:12:32.267 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.41121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41121.log.gz 2024-09-12T01:12:32.267 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43009.log 2024-09-12T01:12:32.267 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78066.log 2024-09-12T01:12:32.268 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40509.log.gz 2024-09-12T01:12:32.268 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.43009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137097.log 2024-09-12T01:12:32.268 INFO:teuthology.orchestra.run.smithi133.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.43009.log.gz 2024-09-12T01:12:32.268 INFO:teuthology.orchestra.run.smithi133.stderr:gzip/var/log/ceph/ceph-client.admin.78066.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39115.log 2024-09-12T01:12:32.268 INFO:teuthology.orchestra.run.smithi133.stderr: 25.1% -- replaced with /var/log/ceph/ceph-client.admin.78066.log.gz 2024-09-12T01:12:32.268 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.137097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194483.log 2024-09-12T01:12:32.268 INFO:teuthology.orchestra.run.smithi133.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.137097.log.gz 2024-09-12T01:12:32.268 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117658.log 2024-09-12T01:12:32.268 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39115.log.gz 2024-09-12T01:12:32.268 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.194483.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194483.log.gz 2024-09-12T01:12:32.268 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.162448.log 2024-09-12T01:12:32.268 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.117658.log: gzip -5 86.8% -- replaced with /var/log/ceph/ceph-client.0.193529.log.gz 2024-09-12T01:12:32.268 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:12:32.269 INFO:teuthology.orchestra.run.smithi133.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.117658.log.gz 2024-09-12T01:12:32.269 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.162448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59958.log 2024-09-12T01:12:32.269 INFO:teuthology.orchestra.run.smithi133.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.162448.log.gz 2024-09-12T01:12:32.269 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66570.log 2024-09-12T01:12:32.269 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.59958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82904.log 2024-09-12T01:12:32.269 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59958.log.gz 2024-09-12T01:12:32.269 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132974.log/var/log/ceph/ceph-client.admin.66570.log: 2024-09-12T01:12:32.269 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123550.log 2024-09-12T01:12:32.269 INFO:teuthology.orchestra.run.smithi133.stderr: 80.7%/var/log/ceph/ceph-client.admin.132974.log: -- replaced with /var/log/ceph/ceph-client.admin.82904.log.gz 2024-09-12T01:12:32.269 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41188.log 2024-09-12T01:12:32.269 INFO:teuthology.orchestra.run.smithi133.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.132974.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39546.log 2024-09-12T01:12:32.269 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-09-12T01:12:32.269 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.123550.log: /var/log/ceph/ceph-client.0.41188.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.123550.log.gz 2024-09-12T01:12:32.269 INFO:teuthology.orchestra.run.smithi133.stderr: 94.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136508.log 2024-09-12T01:12:32.269 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:12:32.270 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74050.log 2024-09-12T01:12:32.270 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39546.log.gz 2024-09-12T01:12:32.270 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.136508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181440.log 2024-09-12T01:12:32.270 INFO:teuthology.orchestra.run.smithi133.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.0.41188.log.gz 2024-09-12T01:12:32.270 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110000.log 2024-09-12T01:12:32.270 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.74050.log: /var/log/ceph/ceph-client.0.181440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93506.log 2024-09-12T01:12:32.270 INFO:teuthology.orchestra.run.smithi133.stderr: 80.4%/var/log/ceph/ceph-client.admin.110000.log: -- replaced with /var/log/ceph/ceph-client.0.181440.log.gz 83.9% -- replaced with /var/log/ceph/ceph-client.admin.74050.log.gz 2024-09-12T01:12:32.270 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-09-12T01:12:32.270 INFO:teuthology.orchestra.run.smithi133.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.110000.log.gz 2024-09-12T01:12:32.270 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172896.log 2024-09-12T01:12:32.270 INFO:teuthology.orchestra.run.smithi133.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.136508.log.gz 2024-09-12T01:12:32.270 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.93506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140042.log 2024-09-12T01:12:32.270 INFO:teuthology.orchestra.run.smithi133.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.93506.log.gz 2024-09-12T01:12:32.270 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.172896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166619.log 2024-09-12T01:12:32.271 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.140042.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.172896.log.gz 2024-09-12T01:12:32.271 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79692.log 2024-09-12T01:12:32.271 INFO:teuthology.orchestra.run.smithi133.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.140042.log.gz 2024-09-12T01:12:32.271 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.166619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194437.log 2024-09-12T01:12:32.271 INFO:teuthology.orchestra.run.smithi133.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.166619.log.gz 2024-09-12T01:12:32.271 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.79692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158303.log 2024-09-12T01:12:32.271 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.194437.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194437.log.gz 2024-09-12T01:12:32.271 INFO:teuthology.orchestra.run.smithi133.stderr: -- /var/log/ceph/ceph-client.admin.40614.log 2024-09-12T01:12:32.271 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.158303.log: gzip -5 --verbose 80.7% -- replaced with /var/log/ceph/ceph-client.admin.158303.log.gz 2024-09-12T01:12:32.271 INFO:teuthology.orchestra.run.smithi133.stderr: -- /var/log/ceph/ceph-client.admin.39243.log 2024-09-12T01:12:32.271 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40614.log.gz 2024-09-12T01:12:32.271 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40635.log 2024-09-12T01:12:32.271 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39243.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39243.log.gz 2024-09-12T01:12:32.271 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40853.log 2024-09-12T01:12:32.272 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40635.log.gz 2024-09-12T01:12:32.272 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153591.log 2024-09-12T01:12:32.272 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40853.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40853.log.gz 2024-09-12T01:12:32.272 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.135330.log 2024-09-12T01:12:32.272 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.153591.log: gzip -5 82.1% -- replaced with /var/log/ceph/ceph-client.admin.153591.log.gz 2024-09-12T01:12:32.272 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62386.log 2024-09-12T01:12:32.272 INFO:teuthology.orchestra.run.smithi133.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.79692.log.gz 2024-09-12T01:12:32.272 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.135330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195081.log 2024-09-12T01:12:32.272 INFO:teuthology.orchestra.run.smithi133.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.135330.log.gz 2024-09-12T01:12:32.272 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176084.log 2024-09-12T01:12:32.272 INFO:teuthology.orchestra.run.smithi133.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.62386.log.gz 2024-09-12T01:12:32.272 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.195081.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195081.log.gz 2024-09-12T01:12:32.272 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58167.log 2024-09-12T01:12:32.273 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.176084.log: gzip -5 92.1% -- replaced with /var/log/ceph/ceph-client.admin.176084.log.gz 2024-09-12T01:12:32.273 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.88205.log 2024-09-12T01:12:32.273 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.58167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156536.log 2024-09-12T01:12:32.273 INFO:teuthology.orchestra.run.smithi133.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.58167.log.gz 2024-09-12T01:12:32.273 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.88205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67191.log 2024-09-12T01:12:32.273 INFO:teuthology.orchestra.run.smithi133.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.88205.log.gz 2024-09-12T01:12:32.273 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.156536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61749.log 2024-09-12T01:12:32.273 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.67191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133563.log 2024-09-12T01:12:32.273 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.61749.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T01:12:32.273 INFO:teuthology.orchestra.run.smithi133.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.67191.log.gz 2024-09-12T01:12:32.273 INFO:teuthology.orchestra.run.smithi133.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.61749.log.gz 2024-09-12T01:12:32.273 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.133563.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.156536.log.gz 2024-09-12T01:12:32.273 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72148.log 2024-09-12T01:12:32.273 INFO:teuthology.orchestra.run.smithi133.stderr:gzip/var/log/ceph/ops-log-ceph-client.admin.log: -5 --verbose 85.0% -- /var/log/ceph/ceph-client.admin.91150.log 2024-09-12T01:12:32.274 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.133563.log.gz 2024-09-12T01:12:32.274 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.72148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56989.log 2024-09-12T01:12:32.274 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.91150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167232.log 2024-09-12T01:12:32.274 INFO:teuthology.orchestra.run.smithi133.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.91150.log.gz 2024-09-12T01:12:32.274 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72148.log.gz 2024-09-12T01:12:32.274 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58756.log 2024-09-12T01:12:32.274 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.167232.log: /var/log/ceph/ceph-client.admin.56989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167232.log.gz 2024-09-12T01:12:32.274 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116479.log 2024-09-12T01:12:32.274 INFO:teuthology.orchestra.run.smithi133.stderr: 81.5%/var/log/ceph/ceph-client.admin.58756.log: -- replaced with /var/log/ceph/ceph-client.admin.56989.log.gz 93.8% -- replaced with /var/log/ceph/ceph-client.admin.66570.log.gz 2024-09-12T01:12:32.274 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160070.log 2024-09-12T01:12:32.274 INFO:teuthology.orchestra.run.smithi133.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.58756.log.gz 2024-09-12T01:12:32.274 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-09-12T01:12:32.274 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.116479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82315.log 2024-09-12T01:12:32.274 INFO:teuthology.orchestra.run.smithi133.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.116479.log.gz 2024-09-12T01:12:32.275 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.160070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39819.log 2024-09-12T01:12:32.275 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.82315.log: gzip 86.7% -- replaced with /var/log/ceph/ceph-client.admin.160070.log.gz 2024-09-12T01:12:32.275 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39051.log 2024-09-12T01:12:32.275 INFO:teuthology.orchestra.run.smithi133.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.82315.log.gz 2024-09-12T01:12:32.275 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39819.log.gz 2024-09-12T01:12:32.275 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194897.log 2024-09-12T01:12:32.275 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152413.log 2024-09-12T01:12:32.275 INFO:teuthology.orchestra.run.smithi133.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T01:12:32.275 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39051.log.gz 2024-09-12T01:12:32.275 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.194897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65078.log 2024-09-12T01:12:32.275 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194897.log.gz 2024-09-12T01:12:32.275 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.152413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192067.log 2024-09-12T01:12:32.275 INFO:teuthology.orchestra.run.smithi133.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.152413.log.gz 2024-09-12T01:12:32.275 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.65078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65805.log 2024-09-12T01:12:32.276 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65078.log.gz 2024-09-12T01:12:32.276 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.192067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40189.log 2024-09-12T01:12:32.276 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192067.log.gz 2024-09-12T01:12:32.276 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.65805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65268.log 2024-09-12T01:12:32.276 INFO:teuthology.orchestra.run.smithi133.stderr: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.65805.log.gz 2024-09-12T01:12:32.276 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39542.log 2024-09-12T01:12:32.276 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40189.log.gz 2024-09-12T01:12:32.276 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.65268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54020.log 2024-09-12T01:12:32.276 INFO:teuthology.orchestra.run.smithi133.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.65268.log.gz 2024-09-12T01:12:32.276 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54044.log 2024-09-12T01:12:32.276 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39542.log.gz 2024-09-12T01:12:32.276 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54020.log.gz 2024-09-12T01:12:32.276 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151824.log 2024-09-12T01:12:32.276 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191407.log 2024-09-12T01:12:32.277 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54044.log: /var/log/ceph/ceph-client.admin.151824.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.54044.log.gz 2024-09-12T01:12:32.277 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T01:12:32.277 INFO:teuthology.orchestra.run.smithi133.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.151824.log.gz 2024-09-12T01:12:32.277 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.191407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162427.log 2024-09-12T01:12:32.277 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191407.log.gz 2024-09-12T01:12:32.277 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81726.log 2024-09-12T01:12:32.277 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.162427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162427.log.gz 2024-09-12T01:12:32.277 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70290.log 2024-09-12T01:12:32.277 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139453.log 2024-09-12T01:12:32.277 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81726.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.81726.log.gz 2024-09-12T01:12:32.277 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127673.log 2024-09-12T01:12:32.277 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.139453.log: gzip -5 81.7% -- replaced with /var/log/ceph/ceph-client.admin.139453.log.gz 2024-09-12T01:12:32.277 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.194667.log 2024-09-12T01:12:32.277 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.127673.log: gzip 81.7% -- replaced with /var/log/ceph/ceph-client.admin.127673.log.gz 2024-09-12T01:12:32.278 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64794.log 2024-09-12T01:12:32.278 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.194667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194667.log.gz 2024-09-12T01:12:32.278 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159481.log 2024-09-12T01:12:32.278 INFO:teuthology.orchestra.run.smithi133.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.70290.log.gz 2024-09-12T01:12:32.278 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.64794.log: gzip -5 --verbose -- 51.1% -- replaced with /var/log/ceph/ceph-client.admin.64794.log.gz 2024-09-12T01:12:32.278 INFO:teuthology.orchestra.run.smithi133.stderr: /var/log/ceph/ceph-client.admin.76884.log 2024-09-12T01:12:32.278 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.159481.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.159481.log.gz 2024-09-12T01:12:32.278 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99986.log 2024-09-12T01:12:32.278 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85849.log 2024-09-12T01:12:32.278 INFO:teuthology.orchestra.run.smithi133.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.76884.log.gz 2024-09-12T01:12:32.278 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.99986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107644.log 2024-09-12T01:12:32.278 INFO:teuthology.orchestra.run.smithi133.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.99986.log.gz 2024-09-12T01:12:32.278 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.85849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41033.log 2024-09-12T01:12:32.278 INFO:teuthology.orchestra.run.smithi133.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.85849.log.gz 2024-09-12T01:12:32.279 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.107644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41797.log 2024-09-12T01:12:32.279 INFO:teuthology.orchestra.run.smithi133.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.107644.log.gz 2024-09-12T01:12:32.279 INFO:teuthology.orchestra.run.smithi133.stderr:gzip/var/log/ceph/ceph-client.admin.41033.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.94095.log 2024-09-12T01:12:32.279 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41033.log.gz 2024-09-12T01:12:32.279 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.41797.log: gzip -5 --verbose -- 43.5% -- replaced with /var/log/ceph/ceph-client.0.41797.log.gz 2024-09-12T01:12:32.279 INFO:teuthology.orchestra.run.smithi133.stderr: /var/log/ceph/ceph-client.admin.39543.log 2024-09-12T01:12:32.279 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.94095.log: gzip -5 80.5% -- replaced with /var/log/ceph/ceph-client.admin.94095.log.gz 2024-09-12T01:12:32.279 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57578.log 2024-09-12T01:12:32.279 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39543.log.gz 2024-09-12T01:12:32.279 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124139.log 2024-09-12T01:12:32.279 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.57578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194207.log 2024-09-12T01:12:32.279 INFO:teuthology.orchestra.run.smithi133.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.57578.log.gz 2024-09-12T01:12:32.279 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.124139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171133.log 2024-09-12T01:12:32.279 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.194207.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194207.log.gz 2024-09-12T01:12:32.280 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.192043.log 2024-09-12T01:12:32.280 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.171133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194943.log 2024-09-12T01:12:32.280 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.192043.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.171133.log.gz 2024-09-12T01:12:32.280 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192043.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55811.log 2024-09-12T01:12:32.280 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-09-12T01:12:32.280 INFO:teuthology.orchestra.run.smithi133.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.124139.log.gz 2024-09-12T01:12:32.280 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.194943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32746.log 2024-09-12T01:12:32.280 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194943.log.gz 2024-09-12T01:12:32.280 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65869.log 2024-09-12T01:12:32.280 INFO:teuthology.orchestra.run.smithi133.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.55811.log.gz 2024-09-12T01:12:32.280 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.32746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69670.log 2024-09-12T01:12:32.280 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32746.log.gz 2024-09-12T01:12:32.280 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.65869.log: gzip -5 19.9% -- replaced with /var/log/ceph/ceph-client.admin.65869.log.gz 2024-09-12T01:12:32.280 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.0.169876.log 2024-09-12T01:12:32.281 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.69670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84671.log 2024-09-12T01:12:32.281 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.169876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128262.log 2024-09-12T01:12:32.281 INFO:teuthology.orchestra.run.smithi133.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.169876.log.gz 2024-09-12T01:12:32.281 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.84671.log: gzip -5 --verbose 82.0% -- replaced with /var/log/ceph/ceph-client.admin.84671.log.gz 2024-09-12T01:12:32.281 INFO:teuthology.orchestra.run.smithi133.stderr: -- /var/log/ceph/ceph-client.admin.114712.log 2024-09-12T01:12:32.281 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.128262.log: gzip -5 --verbose 87.1% -- replaced with /var/log/ceph/ceph-client.admin.128262.log.gz 2024-09-12T01:12:32.281 INFO:teuthology.orchestra.run.smithi133.stderr: -- /var/log/ceph/ceph-client.0.192835.log 2024-09-12T01:12:32.281 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.114712.log: 90.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86438.log 2024-09-12T01:12:32.281 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69670.log.gz 2024-09-12T01:12:32.281 INFO:teuthology.orchestra.run.smithi133.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.114712.log.gz 2024-09-12T01:12:32.281 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40651.log 2024-09-12T01:12:32.281 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.192835.log: /var/log/ceph/ceph-client.admin.86438.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.192835.log.gz 2024-09-12T01:12:32.281 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134152.log 2024-09-12T01:12:32.281 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.86438.log.gz 2024-09-12T01:12:32.282 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40651.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40651.log.gz 2024-09-12T01:12:32.282 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108233.log 2024-09-12T01:12:32.282 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.134152.log: 81.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.134152.log.gz 2024-09-12T01:12:32.282 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.129440.log 2024-09-12T01:12:32.282 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78212.log 2024-09-12T01:12:32.282 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.108233.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.108233.log.gz 2024-09-12T01:12:32.282 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.129440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195035.log 2024-09-12T01:12:32.282 INFO:teuthology.orchestra.run.smithi133.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.129440.log.gz 2024-09-12T01:12:32.282 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.78212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40278.log 2024-09-12T01:12:32.282 INFO:teuthology.orchestra.run.smithi133.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.78212.log.gz 2024-09-12T01:12:32.282 INFO:teuthology.orchestra.run.smithi133.stderr:gzip/var/log/ceph/ceph-client.admin.195035.log: -5 --verbose -- 0.0% /var/log/ceph/ceph-mon.a.log 2024-09-12T01:12:32.282 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.195035.log.gz 2024-09-12T01:12:32.282 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40278.log.gz 2024-09-12T01:12:32.282 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76294.log 2024-09-12T01:12:32.282 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114123.log 2024-09-12T01:12:32.283 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.76294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168434.log 2024-09-12T01:12:32.283 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.114123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90561.log 2024-09-12T01:12:32.283 INFO:teuthology.orchestra.run.smithi133.stderr: 87.2% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.76294.log.gz 2024-09-12T01:12:32.283 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.114123.log.gz 2024-09-12T01:12:32.283 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.168434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194759.log 2024-09-12T01:12:32.283 INFO:teuthology.orchestra.run.smithi133.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.168434.log.gz 2024-09-12T01:12:32.283 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.90561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110589.log 2024-09-12T01:12:32.283 INFO:teuthology.orchestra.run.smithi133.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.90561.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174868.log 2024-09-12T01:12:32.283 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-09-12T01:12:32.283 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.194759.log: /var/log/ceph/ceph-client.admin.110589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194759.log.gz 2024-09-12T01:12:32.283 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107055.log 2024-09-12T01:12:32.283 INFO:teuthology.orchestra.run.smithi133.stderr: 81.5%/var/log/ceph/ceph-client.admin.174868.log: -- replaced with /var/log/ceph/ceph-client.admin.110589.log.gz 2024-09-12T01:12:32.283 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69051.log 2024-09-12T01:12:32.283 INFO:teuthology.orchestra.run.smithi133.stderr: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160659.log 2024-09-12T01:12:32.284 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.174868.log.gz 2024-09-12T01:12:32.284 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.107055.log: /var/log/ceph/ceph-client.admin.69051.log: 81.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130618.log 2024-09-12T01:12:32.284 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107055.log.gz 2024-09-12T01:12:32.284 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.160659.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.160659.log.gz 2024-09-12T01:12:32.284 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105877.log 2024-09-12T01:12:32.284 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148289.log 2024-09-12T01:12:32.284 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105877.log: /var/log/ceph/ceph-client.admin.130618.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.130618.log.gz 2024-09-12T01:12:32.284 INFO:teuthology.orchestra.run.smithi133.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105877.log.gz 2024-09-12T01:12:32.284 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68431.log 2024-09-12T01:12:32.284 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73386.log 2024-09-12T01:12:32.284 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.148289.log: /var/log/ceph/ceph-client.admin.68431.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.148289.log.gz 2024-09-12T01:12:32.284 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141810.log 2024-09-12T01:12:32.284 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.73386.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.69051.log.gz 2024-09-12T01:12:32.284 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137686.log 2024-09-12T01:12:32.285 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.141810.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.141810.log.gz 2024-09-12T01:12:32.285 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172288.log 2024-09-12T01:12:32.285 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.137686.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.137686.log.gz 2024-09-12T01:12:32.285 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- 93.1% -- replaced with /var/log/ceph/ceph-client.admin.68431.log.gz 2024-09-12T01:12:32.285 INFO:teuthology.orchestra.run.smithi133.stderr: /var/log/ceph/ceph-client.admin.97041.log 2024-09-12T01:12:32.285 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.172288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144166.log 2024-09-12T01:12:32.285 INFO:teuthology.orchestra.run.smithi133.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.73386.log.gz 2024-09-12T01:12:32.285 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.97041.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T01:12:32.285 INFO:teuthology.orchestra.run.smithi133.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.97041.log.gz 2024-09-12T01:12:32.285 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.144166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190771.log 2024-09-12T01:12:32.285 INFO:teuthology.orchestra.run.smithi133.stderr: 93.3%/var/log/ceph/ceph-osd.2.log: -- replaced with /var/log/ceph/ceph-client.admin.172288.log.gz 2024-09-12T01:12:32.285 INFO:teuthology.orchestra.run.smithi133.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.144166.log.gz 2024-09-12T01:12:32.285 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142988.log 2024-09-12T01:12:32.285 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.190771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39548.log 2024-09-12T01:12:32.286 INFO:teuthology.orchestra.run.smithi133.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.190771.log.gz 2024-09-12T01:12:32.286 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.142988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124728.log 2024-09-12T01:12:32.286 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39548.log: 0.0% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39548.log.gz 2024-09-12T01:12:32.286 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.142988.log.gz 2024-09-12T01:12:32.286 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40187.log 2024-09-12T01:12:32.286 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.124728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100575.log 2024-09-12T01:12:32.286 INFO:teuthology.orchestra.run.smithi133.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.124728.log.gz 2024-09-12T01:12:32.286 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40187.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26666.log 2024-09-12T01:12:32.286 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.100575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40187.log.gz 2024-09-12T01:12:32.286 INFO:teuthology.orchestra.run.smithi133.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.100575.log.gz 2024-09-12T01:12:32.286 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-12T01:12:32.286 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.tmp-client.admin.26666.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26666.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62975.log 2024-09-12T01:12:32.286 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-09-12T01:12:32.286 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/valgrind/ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157125.log 2024-09-12T01:12:32.287 INFO:teuthology.orchestra.run.smithi133.stderr: 61.8% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-12T01:12:32.287 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40277.log 2024-09-12T01:12:32.287 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.157125.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.62975.log.gz 2024-09-12T01:12:32.287 INFO:teuthology.orchestra.run.smithi133.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.157125.log.gz 2024-09-12T01:12:32.287 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98808.log 2024-09-12T01:12:32.287 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175476.log 2024-09-12T01:12:32.287 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40277.log.gz 2024-09-12T01:12:32.287 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.98808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138275.log 2024-09-12T01:12:32.287 INFO:teuthology.orchestra.run.smithi133.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.98808.log.gz 2024-09-12T01:12:32.287 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.175476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157714.log 2024-09-12T01:12:32.287 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.138275.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.175476.log.gz 2024-09-12T01:12:32.287 INFO:teuthology.orchestra.run.smithi133.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.138275.log.gz 2024-09-12T01:12:32.287 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T01:12:32.287 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38589.log 2024-09-12T01:12:32.288 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.157714.log: /var/log/ceph/ceph-mgr.y.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.157714.log.gz 2024-09-12T01:12:32.288 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77475.log 2024-09-12T01:12:32.288 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.38589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38589.log.gz 2024-09-12T01:12:32.288 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52818.log 2024-09-12T01:12:32.288 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.77475.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.77475.log.gz 2024-09-12T01:12:32.288 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49236.log 2024-09-12T01:12:32.288 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52818.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.52818.log.gz 2024-09-12T01:12:32.288 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39549.log 2024-09-12T01:12:32.288 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49236.log: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.49236.log.gz 2024-09-12T01:12:32.288 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.188748.log 2024-09-12T01:12:32.288 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39549.log.gz 2024-09-12T01:12:32.288 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:12:32.288 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.188748.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.188748.log.gz 2024-09-12T01:12:32.288 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190182.log 2024-09-12T01:12:32.289 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191383.log 2024-09-12T01:12:32.289 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.190182.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.190182.log.gz 2024-09-12T01:12:32.289 INFO:teuthology.orchestra.run.smithi133.stderr: 93.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:12:32.289 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164804.log 2024-09-12T01:12:32.289 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.191383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191383.log.gz 2024-09-12T01:12:32.289 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94685.log 2024-09-12T01:12:32.289 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.164804.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.164804.log.gz 2024-09-12T01:12:32.289 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176692.log 2024-09-12T01:12:32.358 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.94685.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.94685.log.gz 2024-09-12T01:12:32.358 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41165.log 2024-09-12T01:12:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.176692.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.176692.log.gz 2024-09-12T01:12:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166030.log 2024-09-12T01:12:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.41165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41165.log.gz 2024-09-12T01:12:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108822.log 2024-09-12T01:12:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.166030.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.166030.log.gz 2024-09-12T01:12:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75113.log 2024-09-12T01:12:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.108822.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.108822.log.gz 2024-09-12T01:12:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62362.log 2024-09-12T01:12:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.75113.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.75113.log.gz 2024-09-12T01:12:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109411.log 2024-09-12T01:12:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62362.log.gz 2024-09-12T01:12:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46072.log 2024-09-12T01:12:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.109411.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.109411.log.gz 2024-09-12T01:12:32.359 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194851.log 2024-09-12T01:12:32.360 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.46072.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.46072.log.gz 2024-09-12T01:12:32.360 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39544.log 2024-09-12T01:12:32.360 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.194851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194851.log.gz 2024-09-12T01:12:32.360 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191431.log 2024-09-12T01:12:32.360 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39544.log.gz 2024-09-12T01:12:32.360 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149467.log 2024-09-12T01:12:32.360 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.191431.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.191431.log.gz 2024-09-12T01:12:32.360 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183267.log 2024-09-12T01:12:32.360 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.149467.log: 94.4% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T01:12:32.360 INFO:teuthology.orchestra.run.smithi133.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.149467.log.gz 2024-09-12T01:12:32.360 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47757.log 2024-09-12T01:12:32.360 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.183267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40671.log 2024-09-12T01:12:32.360 INFO:teuthology.orchestra.run.smithi133.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.183267.log.gz 2024-09-12T01:12:32.360 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131796.log 2024-09-12T01:12:32.361 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40671.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.47757.log.gz 2024-09-12T01:12:32.361 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40671.log.gz 2024-09-12T01:12:32.361 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192091.log 2024-09-12T01:12:32.361 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.131796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146522.log 2024-09-12T01:12:32.361 INFO:teuthology.orchestra.run.smithi133.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.131796.log.gz 2024-09-12T01:12:32.361 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.192091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192091.log.gz 2024-09-12T01:12:32.361 INFO:teuthology.orchestra.run.smithi133.stderr: 95.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gzgzip 2024-09-12T01:12:32.361 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.84082.log 2024-09-12T01:12:32.361 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.146522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111767.log 2024-09-12T01:12:32.361 INFO:teuthology.orchestra.run.smithi133.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.146522.log.gz 2024-09-12T01:12:32.361 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.84082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195130.log 2024-09-12T01:12:32.361 INFO:teuthology.orchestra.run.smithi133.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.84082.log.gz 2024-09-12T01:12:32.361 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.111767.log: -- /var/log/ceph/ceph-client.0.80301.log 2024-09-12T01:12:32.361 INFO:teuthology.orchestra.run.smithi133.stderr: 81.9%/var/log/ceph/ceph-client.admin.195130.log: -- replaced with /var/log/ceph/ceph-client.admin.111767.log.gz 2024-09-12T01:12:32.362 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161248.log 2024-09-12T01:12:32.362 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195130.log.gz 2024-09-12T01:12:32.362 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151235.log 2024-09-12T01:12:32.362 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.80301.log: gzip 80.2% -- replaced with /var/log/ceph/ceph-client.0.80301.log.gz -5 2024-09-12T01:12:32.362 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.194805.log 2024-09-12T01:12:32.362 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.161248.log: /var/log/ceph/ceph-client.admin.151235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161837.log 2024-09-12T01:12:32.362 INFO:teuthology.orchestra.run.smithi133.stderr: 81.8%/var/log/ceph/ceph-client.admin.194805.log: -- replaced with /var/log/ceph/ceph-client.admin.161248.log.gz 2024-09-12T01:12:32.362 INFO:teuthology.orchestra.run.smithi133.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.151235.log.gz 2024-09-12T01:12:32.362 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194805.log.gz 2024-09-12T01:12:32.362 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42400.log 2024-09-12T01:12:32.362 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.161837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113534.log 2024-09-12T01:12:32.362 INFO:teuthology.orchestra.run.smithi133.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.161837.log.gz 2024-09-12T01:12:32.362 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.42400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194253.log 2024-09-12T01:12:32.362 INFO:teuthology.orchestra.run.smithi133.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.42400.log.gz 2024-09-12T01:12:32.363 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5/var/log/ceph/ceph-client.admin.113534.log: --verbose -- /var/log/ceph/ceph-client.admin.122961.log 2024-09-12T01:12:32.363 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.194253.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.113534.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.180222.log 2024-09-12T01:12:32.363 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-09-12T01:12:32.363 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194253.log.gz 2024-09-12T01:12:32.363 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194391.log 2024-09-12T01:12:32.363 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.122961.log: /var/log/ceph/ceph-client.0.180222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101753.log 2024-09-12T01:12:32.363 INFO:teuthology.orchestra.run.smithi133.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.122961.log.gz 2024-09-12T01:12:32.363 INFO:teuthology.orchestra.run.smithi133.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.180222.log.gz 2024-09-12T01:12:32.363 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.194391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194391.log.gz 2024-09-12T01:12:32.363 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43654.log 2024-09-12T01:12:32.363 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.101753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59934.log 2024-09-12T01:12:32.363 INFO:teuthology.orchestra.run.smithi133.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.101753.log.gz 2024-09-12T01:12:32.363 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.43654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194345.log 2024-09-12T01:12:32.363 INFO:teuthology.orchestra.run.smithi133.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.43654.log.gz 2024-09-12T01:12:32.363 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56400.log 2024-09-12T01:12:32.364 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.59934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59934.log.gz/var/log/ceph/ceph-client.admin.194345.log: 2024-09-12T01:12:32.364 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70909.log 2024-09-12T01:12:32.364 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194345.log.gz 2024-09-12T01:12:32.364 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.56400.log: -- /var/log/ceph/ceph-client.admin.87027.log 2024-09-12T01:12:32.364 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.70909.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.56400.log.gz 2024-09-12T01:12:32.364 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145344.log 2024-09-12T01:12:32.364 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.87027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51640.log 2024-09-12T01:12:32.364 INFO:teuthology.orchestra.run.smithi133.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.87027.log.gz 2024-09-12T01:12:32.364 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.145344.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:12:32.364 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51640.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.145344.log.gz 2024-09-12T01:12:32.364 INFO:teuthology.orchestra.run.smithi133.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.51640.log.gz 2024-09-12T01:12:32.364 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78821.log 2024-09-12T01:12:32.364 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99397.log 2024-09-12T01:12:32.364 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.0.78821.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.78821.log.gz 2024-09-12T01:12:32.365 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194621.log 2024-09-12T01:12:32.365 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.99397.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.99397.log.gz 2024-09-12T01:12:32.365 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39917.log 2024-09-12T01:12:32.365 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.194621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194621.log.gz 2024-09-12T01:12:32.365 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95863.log 2024-09-12T01:12:32.365 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39917.log.gz 2024-09-12T01:12:32.365 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115890.log 2024-09-12T01:12:32.365 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.95863.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.95863.log.gz 2024-09-12T01:12:32.365 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121783.log 2024-09-12T01:12:32.365 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.115890.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.115890.log.gz 2024-09-12T01:12:32.365 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55222.log 2024-09-12T01:12:32.365 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.121783.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.121783.log.gz 2024-09-12T01:12:32.365 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41077.log 2024-09-12T01:12:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55222.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.55222.log.gz 2024-09-12T01:12:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.187530.log 2024-09-12T01:12:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.41077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41077.log.gz 2024-09-12T01:12:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127084.log 2024-09-12T01:12:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.187530.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.187530.log.gz 2024-09-12T01:12:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39547.log 2024-09-12T01:12:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.127084.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.127084.log.gz 2024-09-12T01:12:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135919.log 2024-09-12T01:12:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39547.log.gz 2024-09-12T01:12:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194161.log 2024-09-12T01:12:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.135919.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.135919.log.gz 2024-09-12T01:12:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126495.log 2024-09-12T01:12:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.194161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194161.log.gz 2024-09-12T01:12:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51616.log 2024-09-12T01:12:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.126495.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.126495.log.gz 2024-09-12T01:12:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45469.log 2024-09-12T01:12:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51616.log.gz 2024-09-12T01:12:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153002.log 2024-09-12T01:12:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.45469.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.45469.log.gz 2024-09-12T01:12:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131207.log 2024-09-12T01:12:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.153002.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.153002.log.gz 2024-09-12T01:12:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192116.log 2024-09-12T01:12:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.131207.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.131207.log.gz 2024-09-12T01:12:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115301.log 2024-09-12T01:12:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.192116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192116.log.gz 2024-09-12T01:12:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85260.log 2024-09-12T01:12:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.115301.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.115301.log.gz 2024-09-12T01:12:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52229.log 2024-09-12T01:12:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.85260.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.85260.log.gz 2024-09-12T01:12:32.368 INFO:teuthology.orchestra.run.smithi133.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.70909.log.gz 2024-09-12T01:12:32.368 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184485.log 2024-09-12T01:12:32.368 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182658.log 2024-09-12T01:12:32.368 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52229.log: /var/log/ceph/ceph-client.0.184485.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.52229.log.gz 2024-09-12T01:12:32.368 INFO:teuthology.orchestra.run.smithi133.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.184485.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194529.log 2024-09-12T01:12:32.368 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-09-12T01:12:32.368 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177757.log 2024-09-12T01:12:32.368 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.182658.log: /var/log/ceph/ceph-client.admin.194529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194529.log.gz 2024-09-12T01:12:32.368 INFO:teuthology.orchestra.run.smithi133.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.182658.log.gz 2024-09-12T01:12:32.368 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111178.log 2024-09-12T01:12:32.368 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.177757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40485.log 2024-09-12T01:12:32.368 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.111178.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111178.log.gz 2024-09-12T01:12:32.369 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118247.log 2024-09-12T01:12:32.369 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40485.log.gz 2024-09-12T01:12:32.369 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103521.log 2024-09-12T01:12:32.369 INFO:teuthology.orchestra.run.smithi133.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.177757.log.gz 2024-09-12T01:12:32.369 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.118247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120015.log 2024-09-12T01:12:32.369 INFO:teuthology.orchestra.run.smithi133.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.118247.log.gz 2024-09-12T01:12:32.369 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.103521.log: 82.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.103521.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.178365.log 2024-09-12T01:12:32.369 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-09-12T01:12:32.369 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39916.log 2024-09-12T01:12:32.369 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.120015.log: /var/log/ceph/ceph-client.admin.178365.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.120015.log.gz 2024-09-12T01:12:32.369 INFO:teuthology.orchestra.run.smithi133.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.178365.log.gz 2024-09-12T01:12:32.369 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125906.log 2024-09-12T01:12:32.369 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39916.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39818.log 2024-09-12T01:12:32.369 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-09-12T01:12:32.370 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50414.log 2024-09-12T01:12:32.370 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.125906.log: /var/log/ceph/ceph-client.admin.39818.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.125906.log.gz 2024-09-12T01:12:32.370 INFO:teuthology.orchestra.run.smithi133.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39818.log.gz 2024-09-12T01:12:32.370 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120604.log 2024-09-12T01:12:32.370 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121193.log 2024-09-12T01:12:32.370 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50414.log: /var/log/ceph/ceph-client.admin.120604.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.50414.log.gz 2024-09-12T01:12:32.370 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33175.log 2024-09-12T01:12:32.370 INFO:teuthology.orchestra.run.smithi133.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.120604.log.gz 2024-09-12T01:12:32.370 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.121193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40945.log 2024-09-12T01:12:32.370 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.33175.log: 0.0% 81.7% -- replaced with /var/log/ceph/ceph-client.admin.121193.log.gz 2024-09-12T01:12:32.370 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33175.log.gz 2024-09-12T01:12:32.370 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71529.log 2024-09-12T01:12:32.370 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53407.log 2024-09-12T01:12:32.370 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.40945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40945.log.gz 2024-09-12T01:12:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.71529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140631.log 2024-09-12T01:12:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53407.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.53407.log.gz 2024-09-12T01:12:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145933.log 2024-09-12T01:12:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.140631.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.140631.log.gz 2024-09-12T01:12:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39915.log 2024-09-12T01:12:32.371 INFO:teuthology.orchestra.run.smithi133.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.71529.log.gz 2024-09-12T01:12:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.145933.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T01:12:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.39915.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39915.log.gz 2024-09-12T01:12:32.371 INFO:teuthology.orchestra.run.smithi133.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.145933.log.gz 2024-09-12T01:12:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40636.log 2024-09-12T01:12:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164215.log 2024-09-12T01:12:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.40636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40636.log.gz 2024-09-12T01:12:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62338.log 2024-09-12T01:12:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.164215.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.164215.log.gz 2024-09-12T01:12:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83493.log 2024-09-12T01:12:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.62338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62338.log.gz 2024-09-12T01:12:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72767.log 2024-09-12T01:12:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.83493.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83493.log.gz 2024-09-12T01:12:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101164.log 2024-09-12T01:12:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.72767.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72767.log.gz 2024-09-12T01:12:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150646.log 2024-09-12T01:12:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.101164.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.101164.log.gz 2024-09-12T01:12:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122372.log 2024-09-12T01:12:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.150646.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.150646.log.gz 2024-09-12T01:12:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174112.log 2024-09-12T01:12:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.122372.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.122372.log.gz 2024-09-12T01:12:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185703.log 2024-09-12T01:12:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.174112.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.174112.log.gz 2024-09-12T01:12:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155358.log 2024-09-12T01:12:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.185703.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.185703.log.gz 2024-09-12T01:12:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132385.log 2024-09-12T01:12:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.155358.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.155358.log.gz 2024-09-12T01:12:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163626.log 2024-09-12T01:12:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.132385.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.132385.log.gz 2024-09-12T01:12:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179004.log 2024-09-12T01:12:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.163626.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.163626.log.gz 2024-09-12T01:12:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105288.log 2024-09-12T01:12:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.179004.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.179004.log.gz 2024-09-12T01:12:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104110.log 2024-09-12T01:12:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.105288.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.105288.log.gz 2024-09-12T01:12:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194989.log 2024-09-12T01:12:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.104110.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.104110.log.gz 2024-09-12T01:12:32.374 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61160.log 2024-09-12T01:12:32.374 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.194989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194989.log.gz 2024-09-12T01:12:32.374 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81137.log 2024-09-12T01:12:32.374 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.61160.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.61160.log.gz 2024-09-12T01:12:32.374 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.81137.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.81137.log.gz 2024-09-12T01:12:32.759 INFO:teuthology.orchestra.run.smithi160.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T01:12:32.909 INFO:teuthology.orchestra.run.smithi133.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T01:12:33.087 INFO:teuthology.orchestra.run.smithi160.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T01:12:35.141 INFO:teuthology.orchestra.run.smithi133.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T01:12:36.684 INFO:teuthology.orchestra.run.smithi133.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T01:12:40.797 INFO:teuthology.orchestra.run.smithi160.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T01:12:40.808 INFO:teuthology.orchestra.run.smithi160.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T01:12:40.913 INFO:teuthology.orchestra.run.smithi133.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T01:12:41.438 INFO:teuthology.orchestra.run.smithi133.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T01:12:42.839 INFO:teuthology.orchestra.run.smithi133.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T01:12:43.527 INFO:teuthology.orchestra.run.smithi160.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T01:12:50.648 INFO:teuthology.orchestra.run.smithi133.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T01:12:50.650 INFO:teuthology.orchestra.run.smithi133.stderr: 2024-09-12T01:12:50.650 INFO:teuthology.orchestra.run.smithi133.stderr:real 0m18.532s 2024-09-12T01:12:50.650 INFO:teuthology.orchestra.run.smithi133.stderr:user 0m53.510s 2024-09-12T01:12:50.650 INFO:teuthology.orchestra.run.smithi133.stderr:sys 0m2.120s 2024-09-12T01:12:52.183 INFO:teuthology.orchestra.run.smithi160.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T01:12:52.185 INFO:teuthology.orchestra.run.smithi160.stderr: 2024-09-12T01:12:52.185 INFO:teuthology.orchestra.run.smithi160.stderr:real 0m20.023s 2024-09-12T01:12:52.185 INFO:teuthology.orchestra.run.smithi160.stderr:user 0m48.267s 2024-09-12T01:12:52.185 INFO:teuthology.orchestra.run.smithi160.stderr:sys 0m1.776s 2024-09-12T01:12:52.186 INFO:tasks.ceph:Archiving logs... 2024-09-12T01:12:52.186 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901839/remote/smithi133/log 2024-09-12T01:12:52.187 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:12:59.473 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901839/remote/smithi160/log 2024-09-12T01:12:59.474 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:13:07.251 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T01:13:07.262 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T01:13:07.262 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:13:07.265 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:13:07.368 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T01:13:07.378 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T01:13:07.379 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:13:07.382 DEBUG:teuthology.orchestra.run.smithi160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:13:07.409 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:13:07.411 INFO:teuthology.orchestra.run.smithi133.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:13:07.413 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:13:07.413 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-09-12T01:13:07.413 INFO:teuthology.orchestra.run.smithi160.stdout:^* hv01.front.sepia.ceph.com 3 6 377 25 -829us[ -842us] +/- 56ms 2024-09-12T01:13:07.413 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 -558us[ -558us] +/- 65ms 2024-09-12T01:13:07.413 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 +1855us[+1855us] +/- 78ms 2024-09-12T01:13:07.413 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:13:07.415 INFO:teuthology.orchestra.run.smithi133.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:13:07.415 INFO:teuthology.orchestra.run.smithi133.stdout:=============================================================================== 2024-09-12T01:13:07.415 INFO:teuthology.orchestra.run.smithi133.stdout:^* hv01.front.sepia.ceph.com 3 6 377 17 -825us[ -865us] +/- 56ms 2024-09-12T01:13:07.415 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 25 -536us[ -576us] +/- 65ms 2024-09-12T01:13:07.415 INFO:teuthology.orchestra.run.smithi133.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 +1859us[+1819us] +/- 78ms 2024-09-12T01:13:07.416 INFO:teuthology.orchestra.run.smithi133.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:13:07.416 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T01:13:07.426 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T01:13:07.427 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T01:13:07.436 DEBUG:teuthology.orchestra.run.smithi133:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:13:07.539 DEBUG:teuthology.orchestra.run.smithi160:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:13:07.613 DEBUG:teuthology.orchestra.run.smithi133:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T01:13:07.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:13:07.655 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T01:13:07.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:13:07.697 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T01:13:07.707 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T01:13:07.717 INFO:teuthology.task.internal:Duration was 4072.342529 seconds 2024-09-12T01:13:07.718 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T01:13:07.728 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T01:13:07.728 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:13:07.731 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:13:07.782 INFO:teuthology.orchestra.run.smithi133.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:13:07.789 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:13:08.141 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T01:13:08.142 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2024-09-12T01:13:08.142 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:13:08.175 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi160.front.sepia.ceph.com 2024-09-12T01:13:08.176 DEBUG:teuthology.orchestra.run.smithi160:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:13:08.215 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T01:13:08.216 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:13:08.219 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:13:08.296 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T01:13:08.296 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:13:08.298 DEBUG:teuthology.orchestra.run.smithi160:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:13:08.451 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T01:13:08.471 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T01:13:08.471 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:13:08.511 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:13:08.551 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T01:13:08.573 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:13:08.576 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:13:08.610 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2024-09-12T01:13:08.629 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = core 2024-09-12T01:13:08.649 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:13:08.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:13:08.696 DEBUG:teuthology.orchestra.run.smithi160:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:13:08.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:13:08.724 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T01:13:08.735 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T01:13:08.736 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901839/remote/smithi133 2024-09-12T01:13:08.736 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:13:08.787 DEBUG:teuthology.misc:Transferring archived files from smithi160:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901839/remote/smithi160 2024-09-12T01:13:08.787 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:13:08.834 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T01:13:08.834 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:13:08.837 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:13:08.900 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T01:13:08.914 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T01:13:08.914 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T01:13:08.926 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T01:13:08.926 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:13:08.929 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:13:08.956 INFO:teuthology.orchestra.run.smithi133.stdout: 265648 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:13 /home/ubuntu/cephtest 2024-09-12T01:13:08.970 INFO:teuthology.orchestra.run.smithi160.stdout: 265972 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:13 /home/ubuntu/cephtest 2024-09-12T01:13:08.971 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T01:13:08.984 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T01:13:09.028 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 4072.342529296875 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T01:13:09.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:13:09.123 INFO:teuthology.run:pass